Jul 14 04:58:57.678348 ip-10-0-136-9 systemd[1]: Starting Kubernetes Kubelet... Jul 14 04:58:58.050581 ip-10-0-136-9 kubenswrapper[2584]: Flag --container-runtime-endpoint has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information. Jul 14 04:58:58.050581 ip-10-0-136-9 kubenswrapper[2584]: Flag --minimum-container-ttl-duration has been deprecated, Use --eviction-hard or --eviction-soft instead. Will be removed in a future version. Jul 14 04:58:58.050581 ip-10-0-136-9 kubenswrapper[2584]: Flag --volume-plugin-dir has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information. Jul 14 04:58:58.050581 ip-10-0-136-9 kubenswrapper[2584]: Flag --pod-infra-container-image has been deprecated, will be removed in 1.35. Image garbage collector will get sandbox image information from CRI. Jul 14 04:58:58.050581 ip-10-0-136-9 kubenswrapper[2584]: Flag --system-reserved has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information. Jul 14 04:58:58.051529 ip-10-0-136-9 kubenswrapper[2584]: I0714 04:58:58.051456 2584 server.go:213] "--pod-infra-container-image will not be pruned by the image garbage collector in kubelet and should also be set in the remote runtime" Jul 14 04:58:58.055324 ip-10-0-136-9 kubenswrapper[2584]: W0714 04:58:58.055310 2584 feature_gate.go:328] unrecognized feature gate: OVNObservability Jul 14 04:58:58.055324 ip-10-0-136-9 kubenswrapper[2584]: W0714 04:58:58.055324 2584 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jul 14 04:58:58.055381 ip-10-0-136-9 kubenswrapper[2584]: W0714 04:58:58.055328 2584 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jul 14 04:58:58.055381 ip-10-0-136-9 kubenswrapper[2584]: W0714 04:58:58.055333 2584 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jul 14 04:58:58.055381 ip-10-0-136-9 kubenswrapper[2584]: W0714 04:58:58.055337 2584 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jul 14 04:58:58.055381 ip-10-0-136-9 kubenswrapper[2584]: W0714 04:58:58.055340 2584 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jul 14 04:58:58.055381 ip-10-0-136-9 kubenswrapper[2584]: W0714 04:58:58.055343 2584 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jul 14 04:58:58.055381 ip-10-0-136-9 kubenswrapper[2584]: W0714 04:58:58.055346 2584 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jul 14 04:58:58.055381 ip-10-0-136-9 kubenswrapper[2584]: W0714 04:58:58.055349 2584 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jul 14 04:58:58.055381 ip-10-0-136-9 kubenswrapper[2584]: W0714 04:58:58.055352 2584 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jul 14 04:58:58.055381 ip-10-0-136-9 kubenswrapper[2584]: W0714 04:58:58.055357 2584 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jul 14 04:58:58.055381 ip-10-0-136-9 kubenswrapper[2584]: W0714 04:58:58.055360 2584 feature_gate.go:328] unrecognized feature gate: Example2 Jul 14 04:58:58.055381 ip-10-0-136-9 kubenswrapper[2584]: W0714 04:58:58.055364 2584 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jul 14 04:58:58.055381 ip-10-0-136-9 kubenswrapper[2584]: W0714 04:58:58.055368 2584 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jul 14 04:58:58.055381 ip-10-0-136-9 kubenswrapper[2584]: W0714 04:58:58.055372 2584 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jul 14 04:58:58.055381 ip-10-0-136-9 kubenswrapper[2584]: W0714 04:58:58.055382 2584 feature_gate.go:328] unrecognized feature gate: PinnedImages Jul 14 04:58:58.055696 ip-10-0-136-9 kubenswrapper[2584]: W0714 04:58:58.055391 2584 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jul 14 04:58:58.055696 ip-10-0-136-9 kubenswrapper[2584]: W0714 04:58:58.055394 2584 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jul 14 04:58:58.055696 ip-10-0-136-9 kubenswrapper[2584]: W0714 04:58:58.055398 2584 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jul 14 04:58:58.055696 ip-10-0-136-9 kubenswrapper[2584]: W0714 04:58:58.055400 2584 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jul 14 04:58:58.055696 ip-10-0-136-9 kubenswrapper[2584]: W0714 04:58:58.055403 2584 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jul 14 04:58:58.055696 ip-10-0-136-9 kubenswrapper[2584]: W0714 04:58:58.055405 2584 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jul 14 04:58:58.055696 ip-10-0-136-9 kubenswrapper[2584]: W0714 04:58:58.055407 2584 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jul 14 04:58:58.055696 ip-10-0-136-9 kubenswrapper[2584]: W0714 04:58:58.055410 2584 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jul 14 04:58:58.055696 ip-10-0-136-9 kubenswrapper[2584]: W0714 04:58:58.055412 2584 feature_gate.go:328] unrecognized feature gate: EventTTL Jul 14 04:58:58.055696 ip-10-0-136-9 kubenswrapper[2584]: W0714 04:58:58.055415 2584 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jul 14 04:58:58.055696 ip-10-0-136-9 kubenswrapper[2584]: W0714 04:58:58.055417 2584 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jul 14 04:58:58.055696 ip-10-0-136-9 kubenswrapper[2584]: W0714 04:58:58.055420 2584 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jul 14 04:58:58.055696 ip-10-0-136-9 kubenswrapper[2584]: W0714 04:58:58.055422 2584 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jul 14 04:58:58.055696 ip-10-0-136-9 kubenswrapper[2584]: W0714 04:58:58.055425 2584 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jul 14 04:58:58.055696 ip-10-0-136-9 kubenswrapper[2584]: W0714 04:58:58.055427 2584 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jul 14 04:58:58.055696 ip-10-0-136-9 kubenswrapper[2584]: W0714 04:58:58.055429 2584 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jul 14 04:58:58.055696 ip-10-0-136-9 kubenswrapper[2584]: W0714 04:58:58.055432 2584 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jul 14 04:58:58.055696 ip-10-0-136-9 kubenswrapper[2584]: W0714 04:58:58.055434 2584 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jul 14 04:58:58.055696 ip-10-0-136-9 kubenswrapper[2584]: W0714 04:58:58.055436 2584 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jul 14 04:58:58.055696 ip-10-0-136-9 kubenswrapper[2584]: W0714 04:58:58.055439 2584 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jul 14 04:58:58.056167 ip-10-0-136-9 kubenswrapper[2584]: W0714 04:58:58.055441 2584 feature_gate.go:328] unrecognized feature gate: NewOLM Jul 14 04:58:58.056167 ip-10-0-136-9 kubenswrapper[2584]: W0714 04:58:58.055444 2584 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jul 14 04:58:58.056167 ip-10-0-136-9 kubenswrapper[2584]: W0714 04:58:58.055446 2584 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jul 14 04:58:58.056167 ip-10-0-136-9 kubenswrapper[2584]: W0714 04:58:58.055448 2584 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jul 14 04:58:58.056167 ip-10-0-136-9 kubenswrapper[2584]: W0714 04:58:58.055451 2584 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jul 14 04:58:58.056167 ip-10-0-136-9 kubenswrapper[2584]: W0714 04:58:58.055453 2584 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jul 14 04:58:58.056167 ip-10-0-136-9 kubenswrapper[2584]: W0714 04:58:58.055456 2584 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jul 14 04:58:58.056167 ip-10-0-136-9 kubenswrapper[2584]: W0714 04:58:58.055458 2584 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jul 14 04:58:58.056167 ip-10-0-136-9 kubenswrapper[2584]: W0714 04:58:58.055461 2584 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jul 14 04:58:58.056167 ip-10-0-136-9 kubenswrapper[2584]: W0714 04:58:58.055463 2584 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jul 14 04:58:58.056167 ip-10-0-136-9 kubenswrapper[2584]: W0714 04:58:58.055466 2584 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jul 14 04:58:58.056167 ip-10-0-136-9 kubenswrapper[2584]: W0714 04:58:58.055470 2584 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jul 14 04:58:58.056167 ip-10-0-136-9 kubenswrapper[2584]: W0714 04:58:58.055472 2584 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jul 14 04:58:58.056167 ip-10-0-136-9 kubenswrapper[2584]: W0714 04:58:58.055475 2584 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jul 14 04:58:58.056167 ip-10-0-136-9 kubenswrapper[2584]: W0714 04:58:58.055478 2584 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jul 14 04:58:58.056167 ip-10-0-136-9 kubenswrapper[2584]: W0714 04:58:58.055481 2584 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jul 14 04:58:58.056167 ip-10-0-136-9 kubenswrapper[2584]: W0714 04:58:58.055483 2584 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jul 14 04:58:58.056167 ip-10-0-136-9 kubenswrapper[2584]: W0714 04:58:58.055485 2584 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jul 14 04:58:58.056167 ip-10-0-136-9 kubenswrapper[2584]: W0714 04:58:58.055488 2584 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jul 14 04:58:58.056167 ip-10-0-136-9 kubenswrapper[2584]: W0714 04:58:58.055490 2584 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jul 14 04:58:58.056648 ip-10-0-136-9 kubenswrapper[2584]: W0714 04:58:58.055493 2584 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jul 14 04:58:58.056648 ip-10-0-136-9 kubenswrapper[2584]: W0714 04:58:58.055496 2584 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jul 14 04:58:58.056648 ip-10-0-136-9 kubenswrapper[2584]: W0714 04:58:58.055498 2584 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jul 14 04:58:58.056648 ip-10-0-136-9 kubenswrapper[2584]: W0714 04:58:58.055500 2584 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jul 14 04:58:58.056648 ip-10-0-136-9 kubenswrapper[2584]: W0714 04:58:58.055503 2584 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jul 14 04:58:58.056648 ip-10-0-136-9 kubenswrapper[2584]: W0714 04:58:58.055505 2584 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jul 14 04:58:58.056648 ip-10-0-136-9 kubenswrapper[2584]: W0714 04:58:58.055508 2584 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jul 14 04:58:58.056648 ip-10-0-136-9 kubenswrapper[2584]: W0714 04:58:58.055510 2584 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jul 14 04:58:58.056648 ip-10-0-136-9 kubenswrapper[2584]: W0714 04:58:58.055512 2584 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jul 14 04:58:58.056648 ip-10-0-136-9 kubenswrapper[2584]: W0714 04:58:58.055515 2584 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jul 14 04:58:58.056648 ip-10-0-136-9 kubenswrapper[2584]: W0714 04:58:58.055517 2584 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jul 14 04:58:58.056648 ip-10-0-136-9 kubenswrapper[2584]: W0714 04:58:58.055520 2584 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jul 14 04:58:58.056648 ip-10-0-136-9 kubenswrapper[2584]: W0714 04:58:58.055522 2584 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jul 14 04:58:58.056648 ip-10-0-136-9 kubenswrapper[2584]: W0714 04:58:58.055524 2584 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jul 14 04:58:58.056648 ip-10-0-136-9 kubenswrapper[2584]: W0714 04:58:58.055527 2584 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jul 14 04:58:58.056648 ip-10-0-136-9 kubenswrapper[2584]: W0714 04:58:58.055529 2584 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jul 14 04:58:58.056648 ip-10-0-136-9 kubenswrapper[2584]: W0714 04:58:58.055532 2584 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jul 14 04:58:58.056648 ip-10-0-136-9 kubenswrapper[2584]: W0714 04:58:58.055534 2584 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jul 14 04:58:58.056648 ip-10-0-136-9 kubenswrapper[2584]: W0714 04:58:58.055536 2584 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jul 14 04:58:58.056648 ip-10-0-136-9 kubenswrapper[2584]: W0714 04:58:58.055539 2584 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jul 14 04:58:58.057122 ip-10-0-136-9 kubenswrapper[2584]: W0714 04:58:58.055541 2584 feature_gate.go:328] unrecognized feature gate: OSStreams Jul 14 04:58:58.057122 ip-10-0-136-9 kubenswrapper[2584]: W0714 04:58:58.055544 2584 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jul 14 04:58:58.057122 ip-10-0-136-9 kubenswrapper[2584]: W0714 04:58:58.055547 2584 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jul 14 04:58:58.057122 ip-10-0-136-9 kubenswrapper[2584]: W0714 04:58:58.055549 2584 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jul 14 04:58:58.057122 ip-10-0-136-9 kubenswrapper[2584]: W0714 04:58:58.055551 2584 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jul 14 04:58:58.057122 ip-10-0-136-9 kubenswrapper[2584]: W0714 04:58:58.055555 2584 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jul 14 04:58:58.057122 ip-10-0-136-9 kubenswrapper[2584]: W0714 04:58:58.055558 2584 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jul 14 04:58:58.057122 ip-10-0-136-9 kubenswrapper[2584]: W0714 04:58:58.055561 2584 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jul 14 04:58:58.057122 ip-10-0-136-9 kubenswrapper[2584]: W0714 04:58:58.055563 2584 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jul 14 04:58:58.057122 ip-10-0-136-9 kubenswrapper[2584]: W0714 04:58:58.055566 2584 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jul 14 04:58:58.057122 ip-10-0-136-9 kubenswrapper[2584]: W0714 04:58:58.055568 2584 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jul 14 04:58:58.057122 ip-10-0-136-9 kubenswrapper[2584]: W0714 04:58:58.055571 2584 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jul 14 04:58:58.057122 ip-10-0-136-9 kubenswrapper[2584]: W0714 04:58:58.055573 2584 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jul 14 04:58:58.057122 ip-10-0-136-9 kubenswrapper[2584]: W0714 04:58:58.055575 2584 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jul 14 04:58:58.057122 ip-10-0-136-9 kubenswrapper[2584]: W0714 04:58:58.055577 2584 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jul 14 04:58:58.057122 ip-10-0-136-9 kubenswrapper[2584]: W0714 04:58:58.055580 2584 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jul 14 04:58:58.057122 ip-10-0-136-9 kubenswrapper[2584]: W0714 04:58:58.055582 2584 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jul 14 04:58:58.057122 ip-10-0-136-9 kubenswrapper[2584]: W0714 04:58:58.055584 2584 feature_gate.go:328] unrecognized feature gate: Example Jul 14 04:58:58.057122 ip-10-0-136-9 kubenswrapper[2584]: W0714 04:58:58.055587 2584 feature_gate.go:328] unrecognized feature gate: SignatureStores Jul 14 04:58:58.057122 ip-10-0-136-9 kubenswrapper[2584]: W0714 04:58:58.055589 2584 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jul 14 04:58:58.057606 ip-10-0-136-9 kubenswrapper[2584]: W0714 04:58:58.055591 2584 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jul 14 04:58:58.057606 ip-10-0-136-9 kubenswrapper[2584]: W0714 04:58:58.055594 2584 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jul 14 04:58:58.057606 ip-10-0-136-9 kubenswrapper[2584]: W0714 04:58:58.055596 2584 feature_gate.go:328] unrecognized feature gate: DualReplica Jul 14 04:58:58.057606 ip-10-0-136-9 kubenswrapper[2584]: W0714 04:58:58.057427 2584 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jul 14 04:58:58.057606 ip-10-0-136-9 kubenswrapper[2584]: W0714 04:58:58.057434 2584 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jul 14 04:58:58.057606 ip-10-0-136-9 kubenswrapper[2584]: W0714 04:58:58.057438 2584 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jul 14 04:58:58.057606 ip-10-0-136-9 kubenswrapper[2584]: W0714 04:58:58.057440 2584 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jul 14 04:58:58.057606 ip-10-0-136-9 kubenswrapper[2584]: W0714 04:58:58.057443 2584 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jul 14 04:58:58.057606 ip-10-0-136-9 kubenswrapper[2584]: W0714 04:58:58.057446 2584 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jul 14 04:58:58.057606 ip-10-0-136-9 kubenswrapper[2584]: W0714 04:58:58.057449 2584 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jul 14 04:58:58.057606 ip-10-0-136-9 kubenswrapper[2584]: W0714 04:58:58.057452 2584 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jul 14 04:58:58.057606 ip-10-0-136-9 kubenswrapper[2584]: W0714 04:58:58.057455 2584 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jul 14 04:58:58.057606 ip-10-0-136-9 kubenswrapper[2584]: W0714 04:58:58.057458 2584 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jul 14 04:58:58.057606 ip-10-0-136-9 kubenswrapper[2584]: W0714 04:58:58.057460 2584 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jul 14 04:58:58.057606 ip-10-0-136-9 kubenswrapper[2584]: W0714 04:58:58.057463 2584 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jul 14 04:58:58.057606 ip-10-0-136-9 kubenswrapper[2584]: W0714 04:58:58.057466 2584 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jul 14 04:58:58.057606 ip-10-0-136-9 kubenswrapper[2584]: W0714 04:58:58.057468 2584 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jul 14 04:58:58.057606 ip-10-0-136-9 kubenswrapper[2584]: W0714 04:58:58.057471 2584 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jul 14 04:58:58.057606 ip-10-0-136-9 kubenswrapper[2584]: W0714 04:58:58.057473 2584 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jul 14 04:58:58.057606 ip-10-0-136-9 kubenswrapper[2584]: W0714 04:58:58.057476 2584 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jul 14 04:58:58.058135 ip-10-0-136-9 kubenswrapper[2584]: W0714 04:58:58.057478 2584 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jul 14 04:58:58.058135 ip-10-0-136-9 kubenswrapper[2584]: W0714 04:58:58.057480 2584 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jul 14 04:58:58.058135 ip-10-0-136-9 kubenswrapper[2584]: W0714 04:58:58.057483 2584 feature_gate.go:328] unrecognized feature gate: OVNObservability Jul 14 04:58:58.058135 ip-10-0-136-9 kubenswrapper[2584]: W0714 04:58:58.057485 2584 feature_gate.go:328] unrecognized feature gate: Example Jul 14 04:58:58.058135 ip-10-0-136-9 kubenswrapper[2584]: W0714 04:58:58.057487 2584 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jul 14 04:58:58.058135 ip-10-0-136-9 kubenswrapper[2584]: W0714 04:58:58.057490 2584 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jul 14 04:58:58.058135 ip-10-0-136-9 kubenswrapper[2584]: W0714 04:58:58.057492 2584 feature_gate.go:328] unrecognized feature gate: EventTTL Jul 14 04:58:58.058135 ip-10-0-136-9 kubenswrapper[2584]: W0714 04:58:58.057495 2584 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jul 14 04:58:58.058135 ip-10-0-136-9 kubenswrapper[2584]: W0714 04:58:58.057498 2584 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jul 14 04:58:58.058135 ip-10-0-136-9 kubenswrapper[2584]: W0714 04:58:58.057500 2584 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jul 14 04:58:58.058135 ip-10-0-136-9 kubenswrapper[2584]: W0714 04:58:58.057503 2584 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jul 14 04:58:58.058135 ip-10-0-136-9 kubenswrapper[2584]: W0714 04:58:58.057505 2584 feature_gate.go:328] unrecognized feature gate: SignatureStores Jul 14 04:58:58.058135 ip-10-0-136-9 kubenswrapper[2584]: W0714 04:58:58.057509 2584 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jul 14 04:58:58.058135 ip-10-0-136-9 kubenswrapper[2584]: W0714 04:58:58.057512 2584 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jul 14 04:58:58.058135 ip-10-0-136-9 kubenswrapper[2584]: W0714 04:58:58.057514 2584 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jul 14 04:58:58.058135 ip-10-0-136-9 kubenswrapper[2584]: W0714 04:58:58.057516 2584 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jul 14 04:58:58.058135 ip-10-0-136-9 kubenswrapper[2584]: W0714 04:58:58.057519 2584 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jul 14 04:58:58.058135 ip-10-0-136-9 kubenswrapper[2584]: W0714 04:58:58.057521 2584 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jul 14 04:58:58.058135 ip-10-0-136-9 kubenswrapper[2584]: W0714 04:58:58.057524 2584 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jul 14 04:58:58.058135 ip-10-0-136-9 kubenswrapper[2584]: W0714 04:58:58.057528 2584 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jul 14 04:58:58.058599 ip-10-0-136-9 kubenswrapper[2584]: W0714 04:58:58.057531 2584 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jul 14 04:58:58.058599 ip-10-0-136-9 kubenswrapper[2584]: W0714 04:58:58.057534 2584 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jul 14 04:58:58.058599 ip-10-0-136-9 kubenswrapper[2584]: W0714 04:58:58.057536 2584 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jul 14 04:58:58.058599 ip-10-0-136-9 kubenswrapper[2584]: W0714 04:58:58.057539 2584 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jul 14 04:58:58.058599 ip-10-0-136-9 kubenswrapper[2584]: W0714 04:58:58.057541 2584 feature_gate.go:328] unrecognized feature gate: NewOLM Jul 14 04:58:58.058599 ip-10-0-136-9 kubenswrapper[2584]: W0714 04:58:58.057544 2584 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jul 14 04:58:58.058599 ip-10-0-136-9 kubenswrapper[2584]: W0714 04:58:58.057546 2584 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jul 14 04:58:58.058599 ip-10-0-136-9 kubenswrapper[2584]: W0714 04:58:58.057549 2584 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jul 14 04:58:58.058599 ip-10-0-136-9 kubenswrapper[2584]: W0714 04:58:58.057552 2584 feature_gate.go:328] unrecognized feature gate: DualReplica Jul 14 04:58:58.058599 ip-10-0-136-9 kubenswrapper[2584]: W0714 04:58:58.057554 2584 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jul 14 04:58:58.058599 ip-10-0-136-9 kubenswrapper[2584]: W0714 04:58:58.057557 2584 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jul 14 04:58:58.058599 ip-10-0-136-9 kubenswrapper[2584]: W0714 04:58:58.057559 2584 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jul 14 04:58:58.058599 ip-10-0-136-9 kubenswrapper[2584]: W0714 04:58:58.057561 2584 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jul 14 04:58:58.058599 ip-10-0-136-9 kubenswrapper[2584]: W0714 04:58:58.057564 2584 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jul 14 04:58:58.058599 ip-10-0-136-9 kubenswrapper[2584]: W0714 04:58:58.057566 2584 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jul 14 04:58:58.058599 ip-10-0-136-9 kubenswrapper[2584]: W0714 04:58:58.057569 2584 feature_gate.go:328] unrecognized feature gate: Example2 Jul 14 04:58:58.058599 ip-10-0-136-9 kubenswrapper[2584]: W0714 04:58:58.057571 2584 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jul 14 04:58:58.058599 ip-10-0-136-9 kubenswrapper[2584]: W0714 04:58:58.057573 2584 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jul 14 04:58:58.058599 ip-10-0-136-9 kubenswrapper[2584]: W0714 04:58:58.057576 2584 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jul 14 04:58:58.058599 ip-10-0-136-9 kubenswrapper[2584]: W0714 04:58:58.057578 2584 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jul 14 04:58:58.059056 ip-10-0-136-9 kubenswrapper[2584]: W0714 04:58:58.057582 2584 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jul 14 04:58:58.059056 ip-10-0-136-9 kubenswrapper[2584]: W0714 04:58:58.057585 2584 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jul 14 04:58:58.059056 ip-10-0-136-9 kubenswrapper[2584]: W0714 04:58:58.057587 2584 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jul 14 04:58:58.059056 ip-10-0-136-9 kubenswrapper[2584]: W0714 04:58:58.057589 2584 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jul 14 04:58:58.059056 ip-10-0-136-9 kubenswrapper[2584]: W0714 04:58:58.057592 2584 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jul 14 04:58:58.059056 ip-10-0-136-9 kubenswrapper[2584]: W0714 04:58:58.057594 2584 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jul 14 04:58:58.059056 ip-10-0-136-9 kubenswrapper[2584]: W0714 04:58:58.057597 2584 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jul 14 04:58:58.059056 ip-10-0-136-9 kubenswrapper[2584]: W0714 04:58:58.057599 2584 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jul 14 04:58:58.059056 ip-10-0-136-9 kubenswrapper[2584]: W0714 04:58:58.057602 2584 feature_gate.go:328] unrecognized feature gate: PinnedImages Jul 14 04:58:58.059056 ip-10-0-136-9 kubenswrapper[2584]: W0714 04:58:58.057604 2584 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jul 14 04:58:58.059056 ip-10-0-136-9 kubenswrapper[2584]: W0714 04:58:58.057606 2584 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jul 14 04:58:58.059056 ip-10-0-136-9 kubenswrapper[2584]: W0714 04:58:58.057609 2584 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jul 14 04:58:58.059056 ip-10-0-136-9 kubenswrapper[2584]: W0714 04:58:58.057611 2584 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jul 14 04:58:58.059056 ip-10-0-136-9 kubenswrapper[2584]: W0714 04:58:58.057614 2584 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jul 14 04:58:58.059056 ip-10-0-136-9 kubenswrapper[2584]: W0714 04:58:58.057617 2584 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jul 14 04:58:58.059056 ip-10-0-136-9 kubenswrapper[2584]: W0714 04:58:58.057619 2584 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jul 14 04:58:58.059056 ip-10-0-136-9 kubenswrapper[2584]: W0714 04:58:58.057623 2584 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jul 14 04:58:58.059056 ip-10-0-136-9 kubenswrapper[2584]: W0714 04:58:58.057627 2584 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jul 14 04:58:58.059056 ip-10-0-136-9 kubenswrapper[2584]: W0714 04:58:58.057630 2584 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jul 14 04:58:58.059501 ip-10-0-136-9 kubenswrapper[2584]: W0714 04:58:58.057632 2584 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jul 14 04:58:58.059501 ip-10-0-136-9 kubenswrapper[2584]: W0714 04:58:58.057635 2584 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jul 14 04:58:58.059501 ip-10-0-136-9 kubenswrapper[2584]: W0714 04:58:58.057638 2584 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jul 14 04:58:58.059501 ip-10-0-136-9 kubenswrapper[2584]: W0714 04:58:58.057641 2584 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jul 14 04:58:58.059501 ip-10-0-136-9 kubenswrapper[2584]: W0714 04:58:58.057644 2584 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jul 14 04:58:58.059501 ip-10-0-136-9 kubenswrapper[2584]: W0714 04:58:58.057647 2584 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jul 14 04:58:58.059501 ip-10-0-136-9 kubenswrapper[2584]: W0714 04:58:58.057651 2584 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jul 14 04:58:58.059501 ip-10-0-136-9 kubenswrapper[2584]: W0714 04:58:58.057654 2584 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jul 14 04:58:58.059501 ip-10-0-136-9 kubenswrapper[2584]: W0714 04:58:58.057656 2584 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jul 14 04:58:58.059501 ip-10-0-136-9 kubenswrapper[2584]: W0714 04:58:58.057659 2584 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jul 14 04:58:58.059501 ip-10-0-136-9 kubenswrapper[2584]: W0714 04:58:58.057662 2584 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jul 14 04:58:58.059501 ip-10-0-136-9 kubenswrapper[2584]: W0714 04:58:58.057664 2584 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jul 14 04:58:58.059501 ip-10-0-136-9 kubenswrapper[2584]: W0714 04:58:58.057667 2584 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jul 14 04:58:58.059501 ip-10-0-136-9 kubenswrapper[2584]: W0714 04:58:58.057669 2584 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jul 14 04:58:58.059501 ip-10-0-136-9 kubenswrapper[2584]: W0714 04:58:58.057672 2584 feature_gate.go:328] unrecognized feature gate: OSStreams Jul 14 04:58:58.059501 ip-10-0-136-9 kubenswrapper[2584]: W0714 04:58:58.057675 2584 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jul 14 04:58:58.059501 ip-10-0-136-9 kubenswrapper[2584]: W0714 04:58:58.057678 2584 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jul 14 04:58:58.059501 ip-10-0-136-9 kubenswrapper[2584]: W0714 04:58:58.057682 2584 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jul 14 04:58:58.059501 ip-10-0-136-9 kubenswrapper[2584]: W0714 04:58:58.057685 2584 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jul 14 04:58:58.059940 ip-10-0-136-9 kubenswrapper[2584]: W0714 04:58:58.057688 2584 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jul 14 04:58:58.059940 ip-10-0-136-9 kubenswrapper[2584]: W0714 04:58:58.057691 2584 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jul 14 04:58:58.059940 ip-10-0-136-9 kubenswrapper[2584]: W0714 04:58:58.057694 2584 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jul 14 04:58:58.059940 ip-10-0-136-9 kubenswrapper[2584]: W0714 04:58:58.057696 2584 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jul 14 04:58:58.059940 ip-10-0-136-9 kubenswrapper[2584]: W0714 04:58:58.058032 2584 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jul 14 04:58:58.059940 ip-10-0-136-9 kubenswrapper[2584]: W0714 04:58:58.058037 2584 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jul 14 04:58:58.059940 ip-10-0-136-9 kubenswrapper[2584]: W0714 04:58:58.058039 2584 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jul 14 04:58:58.059940 ip-10-0-136-9 kubenswrapper[2584]: W0714 04:58:58.058042 2584 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jul 14 04:58:58.059940 ip-10-0-136-9 kubenswrapper[2584]: W0714 04:58:58.058045 2584 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jul 14 04:58:58.059940 ip-10-0-136-9 kubenswrapper[2584]: W0714 04:58:58.058047 2584 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jul 14 04:58:58.059940 ip-10-0-136-9 kubenswrapper[2584]: W0714 04:58:58.058050 2584 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jul 14 04:58:58.059940 ip-10-0-136-9 kubenswrapper[2584]: W0714 04:58:58.058052 2584 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jul 14 04:58:58.059940 ip-10-0-136-9 kubenswrapper[2584]: W0714 04:58:58.058055 2584 feature_gate.go:328] unrecognized feature gate: OVNObservability Jul 14 04:58:58.059940 ip-10-0-136-9 kubenswrapper[2584]: W0714 04:58:58.058057 2584 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jul 14 04:58:58.059940 ip-10-0-136-9 kubenswrapper[2584]: W0714 04:58:58.058060 2584 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jul 14 04:58:58.059940 ip-10-0-136-9 kubenswrapper[2584]: W0714 04:58:58.058063 2584 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jul 14 04:58:58.059940 ip-10-0-136-9 kubenswrapper[2584]: W0714 04:58:58.058066 2584 feature_gate.go:328] unrecognized feature gate: PinnedImages Jul 14 04:58:58.059940 ip-10-0-136-9 kubenswrapper[2584]: W0714 04:58:58.058069 2584 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jul 14 04:58:58.059940 ip-10-0-136-9 kubenswrapper[2584]: W0714 04:58:58.058072 2584 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jul 14 04:58:58.059940 ip-10-0-136-9 kubenswrapper[2584]: W0714 04:58:58.058074 2584 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jul 14 04:58:58.060413 ip-10-0-136-9 kubenswrapper[2584]: W0714 04:58:58.058077 2584 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jul 14 04:58:58.060413 ip-10-0-136-9 kubenswrapper[2584]: W0714 04:58:58.058079 2584 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jul 14 04:58:58.060413 ip-10-0-136-9 kubenswrapper[2584]: W0714 04:58:58.058082 2584 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jul 14 04:58:58.060413 ip-10-0-136-9 kubenswrapper[2584]: W0714 04:58:58.058084 2584 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jul 14 04:58:58.060413 ip-10-0-136-9 kubenswrapper[2584]: W0714 04:58:58.058087 2584 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jul 14 04:58:58.060413 ip-10-0-136-9 kubenswrapper[2584]: W0714 04:58:58.058089 2584 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jul 14 04:58:58.060413 ip-10-0-136-9 kubenswrapper[2584]: W0714 04:58:58.058106 2584 feature_gate.go:328] unrecognized feature gate: Example2 Jul 14 04:58:58.060413 ip-10-0-136-9 kubenswrapper[2584]: W0714 04:58:58.058111 2584 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jul 14 04:58:58.060413 ip-10-0-136-9 kubenswrapper[2584]: W0714 04:58:58.058115 2584 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jul 14 04:58:58.060413 ip-10-0-136-9 kubenswrapper[2584]: W0714 04:58:58.058118 2584 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jul 14 04:58:58.060413 ip-10-0-136-9 kubenswrapper[2584]: W0714 04:58:58.058121 2584 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jul 14 04:58:58.060413 ip-10-0-136-9 kubenswrapper[2584]: W0714 04:58:58.058124 2584 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jul 14 04:58:58.060413 ip-10-0-136-9 kubenswrapper[2584]: W0714 04:58:58.058128 2584 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jul 14 04:58:58.060413 ip-10-0-136-9 kubenswrapper[2584]: W0714 04:58:58.058131 2584 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jul 14 04:58:58.060413 ip-10-0-136-9 kubenswrapper[2584]: W0714 04:58:58.058134 2584 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jul 14 04:58:58.060413 ip-10-0-136-9 kubenswrapper[2584]: W0714 04:58:58.058137 2584 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jul 14 04:58:58.060413 ip-10-0-136-9 kubenswrapper[2584]: W0714 04:58:58.058139 2584 feature_gate.go:328] unrecognized feature gate: DualReplica Jul 14 04:58:58.060413 ip-10-0-136-9 kubenswrapper[2584]: W0714 04:58:58.058142 2584 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jul 14 04:58:58.060413 ip-10-0-136-9 kubenswrapper[2584]: W0714 04:58:58.058144 2584 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jul 14 04:58:58.060870 ip-10-0-136-9 kubenswrapper[2584]: W0714 04:58:58.058147 2584 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jul 14 04:58:58.060870 ip-10-0-136-9 kubenswrapper[2584]: W0714 04:58:58.058150 2584 feature_gate.go:328] unrecognized feature gate: EventTTL Jul 14 04:58:58.060870 ip-10-0-136-9 kubenswrapper[2584]: W0714 04:58:58.058152 2584 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jul 14 04:58:58.060870 ip-10-0-136-9 kubenswrapper[2584]: W0714 04:58:58.058155 2584 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jul 14 04:58:58.060870 ip-10-0-136-9 kubenswrapper[2584]: W0714 04:58:58.058157 2584 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jul 14 04:58:58.060870 ip-10-0-136-9 kubenswrapper[2584]: W0714 04:58:58.058160 2584 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jul 14 04:58:58.060870 ip-10-0-136-9 kubenswrapper[2584]: W0714 04:58:58.058162 2584 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jul 14 04:58:58.060870 ip-10-0-136-9 kubenswrapper[2584]: W0714 04:58:58.058164 2584 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jul 14 04:58:58.060870 ip-10-0-136-9 kubenswrapper[2584]: W0714 04:58:58.058167 2584 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jul 14 04:58:58.060870 ip-10-0-136-9 kubenswrapper[2584]: W0714 04:58:58.058170 2584 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jul 14 04:58:58.060870 ip-10-0-136-9 kubenswrapper[2584]: W0714 04:58:58.058173 2584 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jul 14 04:58:58.060870 ip-10-0-136-9 kubenswrapper[2584]: W0714 04:58:58.058176 2584 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jul 14 04:58:58.060870 ip-10-0-136-9 kubenswrapper[2584]: W0714 04:58:58.058179 2584 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jul 14 04:58:58.060870 ip-10-0-136-9 kubenswrapper[2584]: W0714 04:58:58.058181 2584 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jul 14 04:58:58.060870 ip-10-0-136-9 kubenswrapper[2584]: W0714 04:58:58.058184 2584 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jul 14 04:58:58.060870 ip-10-0-136-9 kubenswrapper[2584]: W0714 04:58:58.058187 2584 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jul 14 04:58:58.060870 ip-10-0-136-9 kubenswrapper[2584]: W0714 04:58:58.058189 2584 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jul 14 04:58:58.060870 ip-10-0-136-9 kubenswrapper[2584]: W0714 04:58:58.058191 2584 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jul 14 04:58:58.060870 ip-10-0-136-9 kubenswrapper[2584]: W0714 04:58:58.058194 2584 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jul 14 04:58:58.060870 ip-10-0-136-9 kubenswrapper[2584]: W0714 04:58:58.058196 2584 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jul 14 04:58:58.061350 ip-10-0-136-9 kubenswrapper[2584]: W0714 04:58:58.058199 2584 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jul 14 04:58:58.061350 ip-10-0-136-9 kubenswrapper[2584]: W0714 04:58:58.058201 2584 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jul 14 04:58:58.061350 ip-10-0-136-9 kubenswrapper[2584]: W0714 04:58:58.058204 2584 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jul 14 04:58:58.061350 ip-10-0-136-9 kubenswrapper[2584]: W0714 04:58:58.058206 2584 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jul 14 04:58:58.061350 ip-10-0-136-9 kubenswrapper[2584]: W0714 04:58:58.058208 2584 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jul 14 04:58:58.061350 ip-10-0-136-9 kubenswrapper[2584]: W0714 04:58:58.058211 2584 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jul 14 04:58:58.061350 ip-10-0-136-9 kubenswrapper[2584]: W0714 04:58:58.058213 2584 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jul 14 04:58:58.061350 ip-10-0-136-9 kubenswrapper[2584]: W0714 04:58:58.058216 2584 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jul 14 04:58:58.061350 ip-10-0-136-9 kubenswrapper[2584]: W0714 04:58:58.058218 2584 feature_gate.go:328] unrecognized feature gate: Example Jul 14 04:58:58.061350 ip-10-0-136-9 kubenswrapper[2584]: W0714 04:58:58.058221 2584 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jul 14 04:58:58.061350 ip-10-0-136-9 kubenswrapper[2584]: W0714 04:58:58.058223 2584 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jul 14 04:58:58.061350 ip-10-0-136-9 kubenswrapper[2584]: W0714 04:58:58.058225 2584 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jul 14 04:58:58.061350 ip-10-0-136-9 kubenswrapper[2584]: W0714 04:58:58.058228 2584 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jul 14 04:58:58.061350 ip-10-0-136-9 kubenswrapper[2584]: W0714 04:58:58.058230 2584 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jul 14 04:58:58.061350 ip-10-0-136-9 kubenswrapper[2584]: W0714 04:58:58.058232 2584 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jul 14 04:58:58.061350 ip-10-0-136-9 kubenswrapper[2584]: W0714 04:58:58.058235 2584 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jul 14 04:58:58.061350 ip-10-0-136-9 kubenswrapper[2584]: W0714 04:58:58.058237 2584 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jul 14 04:58:58.061350 ip-10-0-136-9 kubenswrapper[2584]: W0714 04:58:58.058241 2584 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jul 14 04:58:58.061350 ip-10-0-136-9 kubenswrapper[2584]: W0714 04:58:58.058244 2584 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jul 14 04:58:58.061350 ip-10-0-136-9 kubenswrapper[2584]: W0714 04:58:58.058246 2584 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jul 14 04:58:58.061814 ip-10-0-136-9 kubenswrapper[2584]: W0714 04:58:58.058250 2584 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jul 14 04:58:58.061814 ip-10-0-136-9 kubenswrapper[2584]: W0714 04:58:58.058253 2584 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jul 14 04:58:58.061814 ip-10-0-136-9 kubenswrapper[2584]: W0714 04:58:58.058256 2584 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jul 14 04:58:58.061814 ip-10-0-136-9 kubenswrapper[2584]: W0714 04:58:58.058258 2584 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jul 14 04:58:58.061814 ip-10-0-136-9 kubenswrapper[2584]: W0714 04:58:58.058261 2584 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jul 14 04:58:58.061814 ip-10-0-136-9 kubenswrapper[2584]: W0714 04:58:58.058263 2584 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jul 14 04:58:58.061814 ip-10-0-136-9 kubenswrapper[2584]: W0714 04:58:58.058265 2584 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jul 14 04:58:58.061814 ip-10-0-136-9 kubenswrapper[2584]: W0714 04:58:58.058268 2584 feature_gate.go:328] unrecognized feature gate: SignatureStores Jul 14 04:58:58.061814 ip-10-0-136-9 kubenswrapper[2584]: W0714 04:58:58.058270 2584 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jul 14 04:58:58.061814 ip-10-0-136-9 kubenswrapper[2584]: W0714 04:58:58.058274 2584 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jul 14 04:58:58.061814 ip-10-0-136-9 kubenswrapper[2584]: W0714 04:58:58.058277 2584 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jul 14 04:58:58.061814 ip-10-0-136-9 kubenswrapper[2584]: W0714 04:58:58.058279 2584 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jul 14 04:58:58.061814 ip-10-0-136-9 kubenswrapper[2584]: W0714 04:58:58.058282 2584 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jul 14 04:58:58.061814 ip-10-0-136-9 kubenswrapper[2584]: W0714 04:58:58.058284 2584 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jul 14 04:58:58.061814 ip-10-0-136-9 kubenswrapper[2584]: W0714 04:58:58.058287 2584 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jul 14 04:58:58.061814 ip-10-0-136-9 kubenswrapper[2584]: W0714 04:58:58.058289 2584 feature_gate.go:328] unrecognized feature gate: NewOLM Jul 14 04:58:58.061814 ip-10-0-136-9 kubenswrapper[2584]: W0714 04:58:58.058292 2584 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jul 14 04:58:58.061814 ip-10-0-136-9 kubenswrapper[2584]: W0714 04:58:58.058294 2584 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jul 14 04:58:58.061814 ip-10-0-136-9 kubenswrapper[2584]: W0714 04:58:58.058296 2584 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jul 14 04:58:58.061814 ip-10-0-136-9 kubenswrapper[2584]: W0714 04:58:58.058299 2584 feature_gate.go:328] unrecognized feature gate: OSStreams Jul 14 04:58:58.062287 ip-10-0-136-9 kubenswrapper[2584]: W0714 04:58:58.058301 2584 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jul 14 04:58:58.062287 ip-10-0-136-9 kubenswrapper[2584]: W0714 04:58:58.058303 2584 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jul 14 04:58:58.062287 ip-10-0-136-9 kubenswrapper[2584]: W0714 04:58:58.058306 2584 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jul 14 04:58:58.062287 ip-10-0-136-9 kubenswrapper[2584]: W0714 04:58:58.058308 2584 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jul 14 04:58:58.062287 ip-10-0-136-9 kubenswrapper[2584]: I0714 04:58:58.058371 2584 flags.go:64] FLAG: --address="0.0.0.0" Jul 14 04:58:58.062287 ip-10-0-136-9 kubenswrapper[2584]: I0714 04:58:58.058377 2584 flags.go:64] FLAG: --allowed-unsafe-sysctls="[]" Jul 14 04:58:58.062287 ip-10-0-136-9 kubenswrapper[2584]: I0714 04:58:58.058393 2584 flags.go:64] FLAG: --anonymous-auth="true" Jul 14 04:58:58.062287 ip-10-0-136-9 kubenswrapper[2584]: I0714 04:58:58.058399 2584 flags.go:64] FLAG: --application-metrics-count-limit="100" Jul 14 04:58:58.062287 ip-10-0-136-9 kubenswrapper[2584]: I0714 04:58:58.058405 2584 flags.go:64] FLAG: --authentication-token-webhook="false" Jul 14 04:58:58.062287 ip-10-0-136-9 kubenswrapper[2584]: I0714 04:58:58.058409 2584 flags.go:64] FLAG: --authentication-token-webhook-cache-ttl="2m0s" Jul 14 04:58:58.062287 ip-10-0-136-9 kubenswrapper[2584]: I0714 04:58:58.058414 2584 flags.go:64] FLAG: --authorization-mode="AlwaysAllow" Jul 14 04:58:58.062287 ip-10-0-136-9 kubenswrapper[2584]: I0714 04:58:58.058418 2584 flags.go:64] FLAG: --authorization-webhook-cache-authorized-ttl="5m0s" Jul 14 04:58:58.062287 ip-10-0-136-9 kubenswrapper[2584]: I0714 04:58:58.058423 2584 flags.go:64] FLAG: --authorization-webhook-cache-unauthorized-ttl="30s" Jul 14 04:58:58.062287 ip-10-0-136-9 kubenswrapper[2584]: I0714 04:58:58.058426 2584 flags.go:64] FLAG: --boot-id-file="/proc/sys/kernel/random/boot_id" Jul 14 04:58:58.062287 ip-10-0-136-9 kubenswrapper[2584]: I0714 04:58:58.058430 2584 flags.go:64] FLAG: --bootstrap-kubeconfig="/etc/kubernetes/kubeconfig" Jul 14 04:58:58.062287 ip-10-0-136-9 kubenswrapper[2584]: I0714 04:58:58.058433 2584 flags.go:64] FLAG: --cert-dir="/var/lib/kubelet/pki" Jul 14 04:58:58.062287 ip-10-0-136-9 kubenswrapper[2584]: I0714 04:58:58.058436 2584 flags.go:64] FLAG: --cgroup-driver="cgroupfs" Jul 14 04:58:58.062287 ip-10-0-136-9 kubenswrapper[2584]: I0714 04:58:58.058439 2584 flags.go:64] FLAG: --cgroup-root="" Jul 14 04:58:58.062287 ip-10-0-136-9 kubenswrapper[2584]: I0714 04:58:58.058442 2584 flags.go:64] FLAG: --cgroups-per-qos="true" Jul 14 04:58:58.062287 ip-10-0-136-9 kubenswrapper[2584]: I0714 04:58:58.058445 2584 flags.go:64] FLAG: --client-ca-file="" Jul 14 04:58:58.062287 ip-10-0-136-9 kubenswrapper[2584]: I0714 04:58:58.058447 2584 flags.go:64] FLAG: --cloud-provider="external" Jul 14 04:58:58.062287 ip-10-0-136-9 kubenswrapper[2584]: I0714 04:58:58.058450 2584 flags.go:64] FLAG: --cluster-dns="[]" Jul 14 04:58:58.062287 ip-10-0-136-9 kubenswrapper[2584]: I0714 04:58:58.058454 2584 flags.go:64] FLAG: --cluster-domain="" Jul 14 04:58:58.062802 ip-10-0-136-9 kubenswrapper[2584]: I0714 04:58:58.058457 2584 flags.go:64] FLAG: --config="/etc/kubernetes/kubelet.conf" Jul 14 04:58:58.062802 ip-10-0-136-9 kubenswrapper[2584]: I0714 04:58:58.058460 2584 flags.go:64] FLAG: --config-dir="/etc/openshift/kubelet.conf.d" Jul 14 04:58:58.062802 ip-10-0-136-9 kubenswrapper[2584]: I0714 04:58:58.058463 2584 flags.go:64] FLAG: --container-hints="/etc/cadvisor/container_hints.json" Jul 14 04:58:58.062802 ip-10-0-136-9 kubenswrapper[2584]: I0714 04:58:58.058466 2584 flags.go:64] FLAG: --container-log-max-files="5" Jul 14 04:58:58.062802 ip-10-0-136-9 kubenswrapper[2584]: I0714 04:58:58.058469 2584 flags.go:64] FLAG: --container-log-max-size="10Mi" Jul 14 04:58:58.062802 ip-10-0-136-9 kubenswrapper[2584]: I0714 04:58:58.058472 2584 flags.go:64] FLAG: --container-runtime-endpoint="/var/run/crio/crio.sock" Jul 14 04:58:58.062802 ip-10-0-136-9 kubenswrapper[2584]: I0714 04:58:58.058475 2584 flags.go:64] FLAG: --containerd="/run/containerd/containerd.sock" Jul 14 04:58:58.062802 ip-10-0-136-9 kubenswrapper[2584]: I0714 04:58:58.058478 2584 flags.go:64] FLAG: --containerd-namespace="k8s.io" Jul 14 04:58:58.062802 ip-10-0-136-9 kubenswrapper[2584]: I0714 04:58:58.058481 2584 flags.go:64] FLAG: --contention-profiling="false" Jul 14 04:58:58.062802 ip-10-0-136-9 kubenswrapper[2584]: I0714 04:58:58.058484 2584 flags.go:64] FLAG: --cpu-cfs-quota="true" Jul 14 04:58:58.062802 ip-10-0-136-9 kubenswrapper[2584]: I0714 04:58:58.058487 2584 flags.go:64] FLAG: --cpu-cfs-quota-period="100ms" Jul 14 04:58:58.062802 ip-10-0-136-9 kubenswrapper[2584]: I0714 04:58:58.058490 2584 flags.go:64] FLAG: --cpu-manager-policy="none" Jul 14 04:58:58.062802 ip-10-0-136-9 kubenswrapper[2584]: I0714 04:58:58.058492 2584 flags.go:64] FLAG: --cpu-manager-policy-options="" Jul 14 04:58:58.062802 ip-10-0-136-9 kubenswrapper[2584]: I0714 04:58:58.058496 2584 flags.go:64] FLAG: --cpu-manager-reconcile-period="10s" Jul 14 04:58:58.062802 ip-10-0-136-9 kubenswrapper[2584]: I0714 04:58:58.058499 2584 flags.go:64] FLAG: --enable-controller-attach-detach="true" Jul 14 04:58:58.062802 ip-10-0-136-9 kubenswrapper[2584]: I0714 04:58:58.058501 2584 flags.go:64] FLAG: --enable-debugging-handlers="true" Jul 14 04:58:58.062802 ip-10-0-136-9 kubenswrapper[2584]: I0714 04:58:58.058504 2584 flags.go:64] FLAG: --enable-load-reader="false" Jul 14 04:58:58.062802 ip-10-0-136-9 kubenswrapper[2584]: I0714 04:58:58.058507 2584 flags.go:64] FLAG: --enable-server="true" Jul 14 04:58:58.062802 ip-10-0-136-9 kubenswrapper[2584]: I0714 04:58:58.058509 2584 flags.go:64] FLAG: --enforce-node-allocatable="[pods]" Jul 14 04:58:58.062802 ip-10-0-136-9 kubenswrapper[2584]: I0714 04:58:58.058513 2584 flags.go:64] FLAG: --event-burst="100" Jul 14 04:58:58.062802 ip-10-0-136-9 kubenswrapper[2584]: I0714 04:58:58.058516 2584 flags.go:64] FLAG: --event-qps="50" Jul 14 04:58:58.062802 ip-10-0-136-9 kubenswrapper[2584]: I0714 04:58:58.058520 2584 flags.go:64] FLAG: --event-storage-age-limit="default=0" Jul 14 04:58:58.062802 ip-10-0-136-9 kubenswrapper[2584]: I0714 04:58:58.058523 2584 flags.go:64] FLAG: --event-storage-event-limit="default=0" Jul 14 04:58:58.062802 ip-10-0-136-9 kubenswrapper[2584]: I0714 04:58:58.058526 2584 flags.go:64] FLAG: --eviction-hard="" Jul 14 04:58:58.063397 ip-10-0-136-9 kubenswrapper[2584]: I0714 04:58:58.058529 2584 flags.go:64] FLAG: --eviction-max-pod-grace-period="0" Jul 14 04:58:58.063397 ip-10-0-136-9 kubenswrapper[2584]: I0714 04:58:58.058532 2584 flags.go:64] FLAG: --eviction-minimum-reclaim="" Jul 14 04:58:58.063397 ip-10-0-136-9 kubenswrapper[2584]: I0714 04:58:58.058535 2584 flags.go:64] FLAG: --eviction-pressure-transition-period="5m0s" Jul 14 04:58:58.063397 ip-10-0-136-9 kubenswrapper[2584]: I0714 04:58:58.058538 2584 flags.go:64] FLAG: --eviction-soft="" Jul 14 04:58:58.063397 ip-10-0-136-9 kubenswrapper[2584]: I0714 04:58:58.058540 2584 flags.go:64] FLAG: --eviction-soft-grace-period="" Jul 14 04:58:58.063397 ip-10-0-136-9 kubenswrapper[2584]: I0714 04:58:58.058543 2584 flags.go:64] FLAG: --exit-on-lock-contention="false" Jul 14 04:58:58.063397 ip-10-0-136-9 kubenswrapper[2584]: I0714 04:58:58.058546 2584 flags.go:64] FLAG: --experimental-allocatable-ignore-eviction="false" Jul 14 04:58:58.063397 ip-10-0-136-9 kubenswrapper[2584]: I0714 04:58:58.058548 2584 flags.go:64] FLAG: --experimental-mounter-path="" Jul 14 04:58:58.063397 ip-10-0-136-9 kubenswrapper[2584]: I0714 04:58:58.058551 2584 flags.go:64] FLAG: --fail-cgroupv1="false" Jul 14 04:58:58.063397 ip-10-0-136-9 kubenswrapper[2584]: I0714 04:58:58.058554 2584 flags.go:64] FLAG: --fail-swap-on="true" Jul 14 04:58:58.063397 ip-10-0-136-9 kubenswrapper[2584]: I0714 04:58:58.058556 2584 flags.go:64] FLAG: --feature-gates="" Jul 14 04:58:58.063397 ip-10-0-136-9 kubenswrapper[2584]: I0714 04:58:58.058560 2584 flags.go:64] FLAG: --file-check-frequency="20s" Jul 14 04:58:58.063397 ip-10-0-136-9 kubenswrapper[2584]: I0714 04:58:58.058562 2584 flags.go:64] FLAG: --global-housekeeping-interval="1m0s" Jul 14 04:58:58.063397 ip-10-0-136-9 kubenswrapper[2584]: I0714 04:58:58.058565 2584 flags.go:64] FLAG: --hairpin-mode="promiscuous-bridge" Jul 14 04:58:58.063397 ip-10-0-136-9 kubenswrapper[2584]: I0714 04:58:58.058568 2584 flags.go:64] FLAG: --healthz-bind-address="127.0.0.1" Jul 14 04:58:58.063397 ip-10-0-136-9 kubenswrapper[2584]: I0714 04:58:58.058570 2584 flags.go:64] FLAG: --healthz-port="10248" Jul 14 04:58:58.063397 ip-10-0-136-9 kubenswrapper[2584]: I0714 04:58:58.058573 2584 flags.go:64] FLAG: --help="false" Jul 14 04:58:58.063397 ip-10-0-136-9 kubenswrapper[2584]: I0714 04:58:58.058576 2584 flags.go:64] FLAG: --hostname-override="ip-10-0-136-9.ec2.internal" Jul 14 04:58:58.063397 ip-10-0-136-9 kubenswrapper[2584]: I0714 04:58:58.058579 2584 flags.go:64] FLAG: --housekeeping-interval="10s" Jul 14 04:58:58.063397 ip-10-0-136-9 kubenswrapper[2584]: I0714 04:58:58.058582 2584 flags.go:64] FLAG: --http-check-frequency="20s" Jul 14 04:58:58.063397 ip-10-0-136-9 kubenswrapper[2584]: I0714 04:58:58.058585 2584 flags.go:64] FLAG: --image-credential-provider-bin-dir="/usr/libexec/kubelet-image-credential-provider-plugins" Jul 14 04:58:58.063397 ip-10-0-136-9 kubenswrapper[2584]: I0714 04:58:58.058588 2584 flags.go:64] FLAG: --image-credential-provider-config="/etc/kubernetes/credential-providers/ecr-credential-provider.yaml" Jul 14 04:58:58.063397 ip-10-0-136-9 kubenswrapper[2584]: I0714 04:58:58.058591 2584 flags.go:64] FLAG: --image-gc-high-threshold="85" Jul 14 04:58:58.063961 ip-10-0-136-9 kubenswrapper[2584]: I0714 04:58:58.058594 2584 flags.go:64] FLAG: --image-gc-low-threshold="80" Jul 14 04:58:58.063961 ip-10-0-136-9 kubenswrapper[2584]: I0714 04:58:58.058596 2584 flags.go:64] FLAG: --image-service-endpoint="" Jul 14 04:58:58.063961 ip-10-0-136-9 kubenswrapper[2584]: I0714 04:58:58.058599 2584 flags.go:64] FLAG: --kernel-memcg-notification="false" Jul 14 04:58:58.063961 ip-10-0-136-9 kubenswrapper[2584]: I0714 04:58:58.058602 2584 flags.go:64] FLAG: --kube-api-burst="100" Jul 14 04:58:58.063961 ip-10-0-136-9 kubenswrapper[2584]: I0714 04:58:58.058604 2584 flags.go:64] FLAG: --kube-api-content-type="application/vnd.kubernetes.protobuf" Jul 14 04:58:58.063961 ip-10-0-136-9 kubenswrapper[2584]: I0714 04:58:58.058607 2584 flags.go:64] FLAG: --kube-api-qps="50" Jul 14 04:58:58.063961 ip-10-0-136-9 kubenswrapper[2584]: I0714 04:58:58.058612 2584 flags.go:64] FLAG: --kube-reserved="" Jul 14 04:58:58.063961 ip-10-0-136-9 kubenswrapper[2584]: I0714 04:58:58.058615 2584 flags.go:64] FLAG: --kube-reserved-cgroup="" Jul 14 04:58:58.063961 ip-10-0-136-9 kubenswrapper[2584]: I0714 04:58:58.058618 2584 flags.go:64] FLAG: --kubeconfig="/var/lib/kubelet/kubeconfig" Jul 14 04:58:58.063961 ip-10-0-136-9 kubenswrapper[2584]: I0714 04:58:58.058620 2584 flags.go:64] FLAG: --kubelet-cgroups="" Jul 14 04:58:58.063961 ip-10-0-136-9 kubenswrapper[2584]: I0714 04:58:58.058624 2584 flags.go:64] FLAG: --local-storage-capacity-isolation="true" Jul 14 04:58:58.063961 ip-10-0-136-9 kubenswrapper[2584]: I0714 04:58:58.058626 2584 flags.go:64] FLAG: --lock-file="" Jul 14 04:58:58.063961 ip-10-0-136-9 kubenswrapper[2584]: I0714 04:58:58.058629 2584 flags.go:64] FLAG: --log-cadvisor-usage="false" Jul 14 04:58:58.063961 ip-10-0-136-9 kubenswrapper[2584]: I0714 04:58:58.058631 2584 flags.go:64] FLAG: --log-flush-frequency="5s" Jul 14 04:58:58.063961 ip-10-0-136-9 kubenswrapper[2584]: I0714 04:58:58.058634 2584 flags.go:64] FLAG: --log-json-info-buffer-size="0" Jul 14 04:58:58.063961 ip-10-0-136-9 kubenswrapper[2584]: I0714 04:58:58.058639 2584 flags.go:64] FLAG: --log-json-split-stream="false" Jul 14 04:58:58.063961 ip-10-0-136-9 kubenswrapper[2584]: I0714 04:58:58.058642 2584 flags.go:64] FLAG: --log-text-info-buffer-size="0" Jul 14 04:58:58.063961 ip-10-0-136-9 kubenswrapper[2584]: I0714 04:58:58.058644 2584 flags.go:64] FLAG: --log-text-split-stream="false" Jul 14 04:58:58.063961 ip-10-0-136-9 kubenswrapper[2584]: I0714 04:58:58.058647 2584 flags.go:64] FLAG: --logging-format="text" Jul 14 04:58:58.063961 ip-10-0-136-9 kubenswrapper[2584]: I0714 04:58:58.058650 2584 flags.go:64] FLAG: --machine-id-file="/etc/machine-id,/var/lib/dbus/machine-id" Jul 14 04:58:58.063961 ip-10-0-136-9 kubenswrapper[2584]: I0714 04:58:58.058653 2584 flags.go:64] FLAG: --make-iptables-util-chains="true" Jul 14 04:58:58.063961 ip-10-0-136-9 kubenswrapper[2584]: I0714 04:58:58.058655 2584 flags.go:64] FLAG: --manifest-url="" Jul 14 04:58:58.063961 ip-10-0-136-9 kubenswrapper[2584]: I0714 04:58:58.058658 2584 flags.go:64] FLAG: --manifest-url-header="" Jul 14 04:58:58.063961 ip-10-0-136-9 kubenswrapper[2584]: I0714 04:58:58.058662 2584 flags.go:64] FLAG: --max-housekeeping-interval="15s" Jul 14 04:58:58.063961 ip-10-0-136-9 kubenswrapper[2584]: I0714 04:58:58.058665 2584 flags.go:64] FLAG: --max-open-files="1000000" Jul 14 04:58:58.064702 ip-10-0-136-9 kubenswrapper[2584]: I0714 04:58:58.058669 2584 flags.go:64] FLAG: --max-pods="110" Jul 14 04:58:58.064702 ip-10-0-136-9 kubenswrapper[2584]: I0714 04:58:58.058671 2584 flags.go:64] FLAG: --maximum-dead-containers="-1" Jul 14 04:58:58.064702 ip-10-0-136-9 kubenswrapper[2584]: I0714 04:58:58.058674 2584 flags.go:64] FLAG: --maximum-dead-containers-per-container="1" Jul 14 04:58:58.064702 ip-10-0-136-9 kubenswrapper[2584]: I0714 04:58:58.058678 2584 flags.go:64] FLAG: --memory-manager-policy="None" Jul 14 04:58:58.064702 ip-10-0-136-9 kubenswrapper[2584]: I0714 04:58:58.058681 2584 flags.go:64] FLAG: --minimum-container-ttl-duration="6m0s" Jul 14 04:58:58.064702 ip-10-0-136-9 kubenswrapper[2584]: I0714 04:58:58.058683 2584 flags.go:64] FLAG: --minimum-image-ttl-duration="2m0s" Jul 14 04:58:58.064702 ip-10-0-136-9 kubenswrapper[2584]: I0714 04:58:58.058686 2584 flags.go:64] FLAG: --node-ip="0.0.0.0" Jul 14 04:58:58.064702 ip-10-0-136-9 kubenswrapper[2584]: I0714 04:58:58.058689 2584 flags.go:64] FLAG: --node-labels="node-role.kubernetes.io/worker=,node.openshift.io/os_id=rhel" Jul 14 04:58:58.064702 ip-10-0-136-9 kubenswrapper[2584]: I0714 04:58:58.058695 2584 flags.go:64] FLAG: --node-status-max-images="50" Jul 14 04:58:58.064702 ip-10-0-136-9 kubenswrapper[2584]: I0714 04:58:58.058698 2584 flags.go:64] FLAG: --node-status-update-frequency="10s" Jul 14 04:58:58.064702 ip-10-0-136-9 kubenswrapper[2584]: I0714 04:58:58.058701 2584 flags.go:64] FLAG: --oom-score-adj="-999" Jul 14 04:58:58.064702 ip-10-0-136-9 kubenswrapper[2584]: I0714 04:58:58.058704 2584 flags.go:64] FLAG: --pod-cidr="" Jul 14 04:58:58.064702 ip-10-0-136-9 kubenswrapper[2584]: I0714 04:58:58.058707 2584 flags.go:64] FLAG: --pod-infra-container-image="quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:b04c0b1f73af4d021dd8f0b51bfeb302c24482c093de5f2c43654ab56c506926" Jul 14 04:58:58.064702 ip-10-0-136-9 kubenswrapper[2584]: I0714 04:58:58.058713 2584 flags.go:64] FLAG: --pod-manifest-path="" Jul 14 04:58:58.064702 ip-10-0-136-9 kubenswrapper[2584]: I0714 04:58:58.058716 2584 flags.go:64] FLAG: --pod-max-pids="-1" Jul 14 04:58:58.064702 ip-10-0-136-9 kubenswrapper[2584]: I0714 04:58:58.058719 2584 flags.go:64] FLAG: --pods-per-core="0" Jul 14 04:58:58.064702 ip-10-0-136-9 kubenswrapper[2584]: I0714 04:58:58.058722 2584 flags.go:64] FLAG: --port="10250" Jul 14 04:58:58.064702 ip-10-0-136-9 kubenswrapper[2584]: I0714 04:58:58.058724 2584 flags.go:64] FLAG: --protect-kernel-defaults="false" Jul 14 04:58:58.064702 ip-10-0-136-9 kubenswrapper[2584]: I0714 04:58:58.058728 2584 flags.go:64] FLAG: --provider-id="aws:///us-east-1a/i-080471e0cfb2291b1" Jul 14 04:58:58.064702 ip-10-0-136-9 kubenswrapper[2584]: I0714 04:58:58.058731 2584 flags.go:64] FLAG: --qos-reserved="" Jul 14 04:58:58.064702 ip-10-0-136-9 kubenswrapper[2584]: I0714 04:58:58.058733 2584 flags.go:64] FLAG: --read-only-port="10255" Jul 14 04:58:58.064702 ip-10-0-136-9 kubenswrapper[2584]: I0714 04:58:58.058736 2584 flags.go:64] FLAG: --register-node="true" Jul 14 04:58:58.064702 ip-10-0-136-9 kubenswrapper[2584]: I0714 04:58:58.058739 2584 flags.go:64] FLAG: --register-with-taints="" Jul 14 04:58:58.064702 ip-10-0-136-9 kubenswrapper[2584]: I0714 04:58:58.058742 2584 flags.go:64] FLAG: --registry-burst="10" Jul 14 04:58:58.065312 ip-10-0-136-9 kubenswrapper[2584]: I0714 04:58:58.058745 2584 flags.go:64] FLAG: --registry-qps="5" Jul 14 04:58:58.065312 ip-10-0-136-9 kubenswrapper[2584]: I0714 04:58:58.058748 2584 flags.go:64] FLAG: --reserved-cpus="" Jul 14 04:58:58.065312 ip-10-0-136-9 kubenswrapper[2584]: I0714 04:58:58.058750 2584 flags.go:64] FLAG: --reserved-memory="" Jul 14 04:58:58.065312 ip-10-0-136-9 kubenswrapper[2584]: I0714 04:58:58.058753 2584 flags.go:64] FLAG: --resolv-conf="/etc/resolv.conf" Jul 14 04:58:58.065312 ip-10-0-136-9 kubenswrapper[2584]: I0714 04:58:58.058756 2584 flags.go:64] FLAG: --root-dir="/var/lib/kubelet" Jul 14 04:58:58.065312 ip-10-0-136-9 kubenswrapper[2584]: I0714 04:58:58.058759 2584 flags.go:64] FLAG: --rotate-certificates="false" Jul 14 04:58:58.065312 ip-10-0-136-9 kubenswrapper[2584]: I0714 04:58:58.058761 2584 flags.go:64] FLAG: --rotate-server-certificates="false" Jul 14 04:58:58.065312 ip-10-0-136-9 kubenswrapper[2584]: I0714 04:58:58.058764 2584 flags.go:64] FLAG: --runonce="false" Jul 14 04:58:58.065312 ip-10-0-136-9 kubenswrapper[2584]: I0714 04:58:58.058767 2584 flags.go:64] FLAG: --runtime-cgroups="/system.slice/crio.service" Jul 14 04:58:58.065312 ip-10-0-136-9 kubenswrapper[2584]: I0714 04:58:58.058770 2584 flags.go:64] FLAG: --runtime-request-timeout="2m0s" Jul 14 04:58:58.065312 ip-10-0-136-9 kubenswrapper[2584]: I0714 04:58:58.058772 2584 flags.go:64] FLAG: --seccomp-default="false" Jul 14 04:58:58.065312 ip-10-0-136-9 kubenswrapper[2584]: I0714 04:58:58.058775 2584 flags.go:64] FLAG: --serialize-image-pulls="true" Jul 14 04:58:58.065312 ip-10-0-136-9 kubenswrapper[2584]: I0714 04:58:58.058779 2584 flags.go:64] FLAG: --storage-driver-buffer-duration="1m0s" Jul 14 04:58:58.065312 ip-10-0-136-9 kubenswrapper[2584]: I0714 04:58:58.058782 2584 flags.go:64] FLAG: --storage-driver-db="cadvisor" Jul 14 04:58:58.065312 ip-10-0-136-9 kubenswrapper[2584]: I0714 04:58:58.058785 2584 flags.go:64] FLAG: --storage-driver-host="localhost:8086" Jul 14 04:58:58.065312 ip-10-0-136-9 kubenswrapper[2584]: I0714 04:58:58.058788 2584 flags.go:64] FLAG: --storage-driver-password="root" Jul 14 04:58:58.065312 ip-10-0-136-9 kubenswrapper[2584]: I0714 04:58:58.058790 2584 flags.go:64] FLAG: --storage-driver-secure="false" Jul 14 04:58:58.065312 ip-10-0-136-9 kubenswrapper[2584]: I0714 04:58:58.058793 2584 flags.go:64] FLAG: --storage-driver-table="stats" Jul 14 04:58:58.065312 ip-10-0-136-9 kubenswrapper[2584]: I0714 04:58:58.058795 2584 flags.go:64] FLAG: --storage-driver-user="root" Jul 14 04:58:58.065312 ip-10-0-136-9 kubenswrapper[2584]: I0714 04:58:58.058798 2584 flags.go:64] FLAG: --streaming-connection-idle-timeout="4h0m0s" Jul 14 04:58:58.065312 ip-10-0-136-9 kubenswrapper[2584]: I0714 04:58:58.058801 2584 flags.go:64] FLAG: --sync-frequency="1m0s" Jul 14 04:58:58.065312 ip-10-0-136-9 kubenswrapper[2584]: I0714 04:58:58.058805 2584 flags.go:64] FLAG: --system-cgroups="" Jul 14 04:58:58.065312 ip-10-0-136-9 kubenswrapper[2584]: I0714 04:58:58.058808 2584 flags.go:64] FLAG: --system-reserved="cpu=500m,ephemeral-storage=1Gi,memory=1Gi" Jul 14 04:58:58.065312 ip-10-0-136-9 kubenswrapper[2584]: I0714 04:58:58.058813 2584 flags.go:64] FLAG: --system-reserved-cgroup="" Jul 14 04:58:58.065312 ip-10-0-136-9 kubenswrapper[2584]: I0714 04:58:58.058816 2584 flags.go:64] FLAG: --tls-cert-file="" Jul 14 04:58:58.065919 ip-10-0-136-9 kubenswrapper[2584]: I0714 04:58:58.058818 2584 flags.go:64] FLAG: --tls-cipher-suites="[]" Jul 14 04:58:58.065919 ip-10-0-136-9 kubenswrapper[2584]: I0714 04:58:58.058821 2584 flags.go:64] FLAG: --tls-min-version="" Jul 14 04:58:58.065919 ip-10-0-136-9 kubenswrapper[2584]: I0714 04:58:58.058825 2584 flags.go:64] FLAG: --tls-private-key-file="" Jul 14 04:58:58.065919 ip-10-0-136-9 kubenswrapper[2584]: I0714 04:58:58.058827 2584 flags.go:64] FLAG: --topology-manager-policy="none" Jul 14 04:58:58.065919 ip-10-0-136-9 kubenswrapper[2584]: I0714 04:58:58.058830 2584 flags.go:64] FLAG: --topology-manager-policy-options="" Jul 14 04:58:58.065919 ip-10-0-136-9 kubenswrapper[2584]: I0714 04:58:58.058833 2584 flags.go:64] FLAG: --topology-manager-scope="container" Jul 14 04:58:58.065919 ip-10-0-136-9 kubenswrapper[2584]: I0714 04:58:58.058835 2584 flags.go:64] FLAG: --v="2" Jul 14 04:58:58.065919 ip-10-0-136-9 kubenswrapper[2584]: I0714 04:58:58.058839 2584 flags.go:64] FLAG: --version="false" Jul 14 04:58:58.065919 ip-10-0-136-9 kubenswrapper[2584]: I0714 04:58:58.058843 2584 flags.go:64] FLAG: --vmodule="" Jul 14 04:58:58.065919 ip-10-0-136-9 kubenswrapper[2584]: I0714 04:58:58.058846 2584 flags.go:64] FLAG: --volume-plugin-dir="/etc/kubernetes/kubelet-plugins/volume/exec" Jul 14 04:58:58.065919 ip-10-0-136-9 kubenswrapper[2584]: I0714 04:58:58.058849 2584 flags.go:64] FLAG: --volume-stats-agg-period="1m0s" Jul 14 04:58:58.065919 ip-10-0-136-9 kubenswrapper[2584]: W0714 04:58:58.058967 2584 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jul 14 04:58:58.065919 ip-10-0-136-9 kubenswrapper[2584]: W0714 04:58:58.058971 2584 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jul 14 04:58:58.065919 ip-10-0-136-9 kubenswrapper[2584]: W0714 04:58:58.058974 2584 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jul 14 04:58:58.065919 ip-10-0-136-9 kubenswrapper[2584]: W0714 04:58:58.058977 2584 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jul 14 04:58:58.065919 ip-10-0-136-9 kubenswrapper[2584]: W0714 04:58:58.058980 2584 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jul 14 04:58:58.065919 ip-10-0-136-9 kubenswrapper[2584]: W0714 04:58:58.058984 2584 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jul 14 04:58:58.065919 ip-10-0-136-9 kubenswrapper[2584]: W0714 04:58:58.058986 2584 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jul 14 04:58:58.065919 ip-10-0-136-9 kubenswrapper[2584]: W0714 04:58:58.058989 2584 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jul 14 04:58:58.065919 ip-10-0-136-9 kubenswrapper[2584]: W0714 04:58:58.058993 2584 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jul 14 04:58:58.065919 ip-10-0-136-9 kubenswrapper[2584]: W0714 04:58:58.058997 2584 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jul 14 04:58:58.065919 ip-10-0-136-9 kubenswrapper[2584]: W0714 04:58:58.059000 2584 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jul 14 04:58:58.066446 ip-10-0-136-9 kubenswrapper[2584]: W0714 04:58:58.059003 2584 feature_gate.go:328] unrecognized feature gate: DualReplica Jul 14 04:58:58.066446 ip-10-0-136-9 kubenswrapper[2584]: W0714 04:58:58.059006 2584 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jul 14 04:58:58.066446 ip-10-0-136-9 kubenswrapper[2584]: W0714 04:58:58.059008 2584 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jul 14 04:58:58.066446 ip-10-0-136-9 kubenswrapper[2584]: W0714 04:58:58.059011 2584 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jul 14 04:58:58.066446 ip-10-0-136-9 kubenswrapper[2584]: W0714 04:58:58.059013 2584 feature_gate.go:328] unrecognized feature gate: OVNObservability Jul 14 04:58:58.066446 ip-10-0-136-9 kubenswrapper[2584]: W0714 04:58:58.059016 2584 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jul 14 04:58:58.066446 ip-10-0-136-9 kubenswrapper[2584]: W0714 04:58:58.059021 2584 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jul 14 04:58:58.066446 ip-10-0-136-9 kubenswrapper[2584]: W0714 04:58:58.059024 2584 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jul 14 04:58:58.066446 ip-10-0-136-9 kubenswrapper[2584]: W0714 04:58:58.059027 2584 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jul 14 04:58:58.066446 ip-10-0-136-9 kubenswrapper[2584]: W0714 04:58:58.059029 2584 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jul 14 04:58:58.066446 ip-10-0-136-9 kubenswrapper[2584]: W0714 04:58:58.059032 2584 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jul 14 04:58:58.066446 ip-10-0-136-9 kubenswrapper[2584]: W0714 04:58:58.059034 2584 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jul 14 04:58:58.066446 ip-10-0-136-9 kubenswrapper[2584]: W0714 04:58:58.059037 2584 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jul 14 04:58:58.066446 ip-10-0-136-9 kubenswrapper[2584]: W0714 04:58:58.059040 2584 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jul 14 04:58:58.066446 ip-10-0-136-9 kubenswrapper[2584]: W0714 04:58:58.059042 2584 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jul 14 04:58:58.066446 ip-10-0-136-9 kubenswrapper[2584]: W0714 04:58:58.059044 2584 feature_gate.go:328] unrecognized feature gate: NewOLM Jul 14 04:58:58.066446 ip-10-0-136-9 kubenswrapper[2584]: W0714 04:58:58.059047 2584 feature_gate.go:328] unrecognized feature gate: SignatureStores Jul 14 04:58:58.066446 ip-10-0-136-9 kubenswrapper[2584]: W0714 04:58:58.059049 2584 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jul 14 04:58:58.066446 ip-10-0-136-9 kubenswrapper[2584]: W0714 04:58:58.059052 2584 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jul 14 04:58:58.066923 ip-10-0-136-9 kubenswrapper[2584]: W0714 04:58:58.059054 2584 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jul 14 04:58:58.066923 ip-10-0-136-9 kubenswrapper[2584]: W0714 04:58:58.059057 2584 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jul 14 04:58:58.066923 ip-10-0-136-9 kubenswrapper[2584]: W0714 04:58:58.059059 2584 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jul 14 04:58:58.066923 ip-10-0-136-9 kubenswrapper[2584]: W0714 04:58:58.059062 2584 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jul 14 04:58:58.066923 ip-10-0-136-9 kubenswrapper[2584]: W0714 04:58:58.059065 2584 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jul 14 04:58:58.066923 ip-10-0-136-9 kubenswrapper[2584]: W0714 04:58:58.059068 2584 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jul 14 04:58:58.066923 ip-10-0-136-9 kubenswrapper[2584]: W0714 04:58:58.059070 2584 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jul 14 04:58:58.066923 ip-10-0-136-9 kubenswrapper[2584]: W0714 04:58:58.059073 2584 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jul 14 04:58:58.066923 ip-10-0-136-9 kubenswrapper[2584]: W0714 04:58:58.059075 2584 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jul 14 04:58:58.066923 ip-10-0-136-9 kubenswrapper[2584]: W0714 04:58:58.059078 2584 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jul 14 04:58:58.066923 ip-10-0-136-9 kubenswrapper[2584]: W0714 04:58:58.059082 2584 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jul 14 04:58:58.066923 ip-10-0-136-9 kubenswrapper[2584]: W0714 04:58:58.059084 2584 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jul 14 04:58:58.066923 ip-10-0-136-9 kubenswrapper[2584]: W0714 04:58:58.059087 2584 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jul 14 04:58:58.066923 ip-10-0-136-9 kubenswrapper[2584]: W0714 04:58:58.059089 2584 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jul 14 04:58:58.066923 ip-10-0-136-9 kubenswrapper[2584]: W0714 04:58:58.059106 2584 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jul 14 04:58:58.066923 ip-10-0-136-9 kubenswrapper[2584]: W0714 04:58:58.059110 2584 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jul 14 04:58:58.066923 ip-10-0-136-9 kubenswrapper[2584]: W0714 04:58:58.059114 2584 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jul 14 04:58:58.066923 ip-10-0-136-9 kubenswrapper[2584]: W0714 04:58:58.059118 2584 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jul 14 04:58:58.066923 ip-10-0-136-9 kubenswrapper[2584]: W0714 04:58:58.059120 2584 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jul 14 04:58:58.066923 ip-10-0-136-9 kubenswrapper[2584]: W0714 04:58:58.059124 2584 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jul 14 04:58:58.067416 ip-10-0-136-9 kubenswrapper[2584]: W0714 04:58:58.059127 2584 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jul 14 04:58:58.067416 ip-10-0-136-9 kubenswrapper[2584]: W0714 04:58:58.059131 2584 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jul 14 04:58:58.067416 ip-10-0-136-9 kubenswrapper[2584]: W0714 04:58:58.059134 2584 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jul 14 04:58:58.067416 ip-10-0-136-9 kubenswrapper[2584]: W0714 04:58:58.059137 2584 feature_gate.go:328] unrecognized feature gate: OSStreams Jul 14 04:58:58.067416 ip-10-0-136-9 kubenswrapper[2584]: W0714 04:58:58.059140 2584 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jul 14 04:58:58.067416 ip-10-0-136-9 kubenswrapper[2584]: W0714 04:58:58.059142 2584 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jul 14 04:58:58.067416 ip-10-0-136-9 kubenswrapper[2584]: W0714 04:58:58.059145 2584 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jul 14 04:58:58.067416 ip-10-0-136-9 kubenswrapper[2584]: W0714 04:58:58.059148 2584 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jul 14 04:58:58.067416 ip-10-0-136-9 kubenswrapper[2584]: W0714 04:58:58.059151 2584 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jul 14 04:58:58.067416 ip-10-0-136-9 kubenswrapper[2584]: W0714 04:58:58.059153 2584 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jul 14 04:58:58.067416 ip-10-0-136-9 kubenswrapper[2584]: W0714 04:58:58.059156 2584 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jul 14 04:58:58.067416 ip-10-0-136-9 kubenswrapper[2584]: W0714 04:58:58.059158 2584 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jul 14 04:58:58.067416 ip-10-0-136-9 kubenswrapper[2584]: W0714 04:58:58.059160 2584 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jul 14 04:58:58.067416 ip-10-0-136-9 kubenswrapper[2584]: W0714 04:58:58.059163 2584 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jul 14 04:58:58.067416 ip-10-0-136-9 kubenswrapper[2584]: W0714 04:58:58.059165 2584 feature_gate.go:328] unrecognized feature gate: PinnedImages Jul 14 04:58:58.067416 ip-10-0-136-9 kubenswrapper[2584]: W0714 04:58:58.059168 2584 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jul 14 04:58:58.067416 ip-10-0-136-9 kubenswrapper[2584]: W0714 04:58:58.059170 2584 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jul 14 04:58:58.067416 ip-10-0-136-9 kubenswrapper[2584]: W0714 04:58:58.059173 2584 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jul 14 04:58:58.067416 ip-10-0-136-9 kubenswrapper[2584]: W0714 04:58:58.059175 2584 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jul 14 04:58:58.067861 ip-10-0-136-9 kubenswrapper[2584]: W0714 04:58:58.059178 2584 feature_gate.go:328] unrecognized feature gate: EventTTL Jul 14 04:58:58.067861 ip-10-0-136-9 kubenswrapper[2584]: W0714 04:58:58.059180 2584 feature_gate.go:328] unrecognized feature gate: Example Jul 14 04:58:58.067861 ip-10-0-136-9 kubenswrapper[2584]: W0714 04:58:58.059183 2584 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jul 14 04:58:58.067861 ip-10-0-136-9 kubenswrapper[2584]: W0714 04:58:58.059186 2584 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jul 14 04:58:58.067861 ip-10-0-136-9 kubenswrapper[2584]: W0714 04:58:58.059189 2584 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jul 14 04:58:58.067861 ip-10-0-136-9 kubenswrapper[2584]: W0714 04:58:58.059191 2584 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jul 14 04:58:58.067861 ip-10-0-136-9 kubenswrapper[2584]: W0714 04:58:58.059195 2584 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jul 14 04:58:58.067861 ip-10-0-136-9 kubenswrapper[2584]: W0714 04:58:58.059198 2584 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jul 14 04:58:58.067861 ip-10-0-136-9 kubenswrapper[2584]: W0714 04:58:58.059201 2584 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jul 14 04:58:58.067861 ip-10-0-136-9 kubenswrapper[2584]: W0714 04:58:58.059204 2584 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jul 14 04:58:58.067861 ip-10-0-136-9 kubenswrapper[2584]: W0714 04:58:58.059206 2584 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jul 14 04:58:58.067861 ip-10-0-136-9 kubenswrapper[2584]: W0714 04:58:58.059209 2584 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jul 14 04:58:58.067861 ip-10-0-136-9 kubenswrapper[2584]: W0714 04:58:58.059213 2584 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jul 14 04:58:58.067861 ip-10-0-136-9 kubenswrapper[2584]: W0714 04:58:58.059215 2584 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jul 14 04:58:58.067861 ip-10-0-136-9 kubenswrapper[2584]: W0714 04:58:58.059218 2584 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jul 14 04:58:58.067861 ip-10-0-136-9 kubenswrapper[2584]: W0714 04:58:58.059220 2584 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jul 14 04:58:58.067861 ip-10-0-136-9 kubenswrapper[2584]: W0714 04:58:58.059223 2584 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jul 14 04:58:58.067861 ip-10-0-136-9 kubenswrapper[2584]: W0714 04:58:58.059226 2584 feature_gate.go:328] unrecognized feature gate: Example2 Jul 14 04:58:58.067861 ip-10-0-136-9 kubenswrapper[2584]: W0714 04:58:58.059228 2584 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jul 14 04:58:58.067861 ip-10-0-136-9 kubenswrapper[2584]: W0714 04:58:58.059230 2584 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jul 14 04:58:58.068346 ip-10-0-136-9 kubenswrapper[2584]: W0714 04:58:58.059233 2584 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jul 14 04:58:58.068346 ip-10-0-136-9 kubenswrapper[2584]: W0714 04:58:58.059235 2584 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jul 14 04:58:58.068346 ip-10-0-136-9 kubenswrapper[2584]: W0714 04:58:58.059238 2584 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jul 14 04:58:58.068346 ip-10-0-136-9 kubenswrapper[2584]: W0714 04:58:58.059240 2584 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jul 14 04:58:58.068346 ip-10-0-136-9 kubenswrapper[2584]: W0714 04:58:58.059243 2584 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jul 14 04:58:58.068346 ip-10-0-136-9 kubenswrapper[2584]: W0714 04:58:58.059245 2584 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jul 14 04:58:58.068346 ip-10-0-136-9 kubenswrapper[2584]: W0714 04:58:58.059248 2584 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jul 14 04:58:58.068346 ip-10-0-136-9 kubenswrapper[2584]: W0714 04:58:58.059252 2584 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jul 14 04:58:58.068346 ip-10-0-136-9 kubenswrapper[2584]: W0714 04:58:58.059254 2584 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jul 14 04:58:58.068346 ip-10-0-136-9 kubenswrapper[2584]: W0714 04:58:58.059257 2584 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jul 14 04:58:58.068346 ip-10-0-136-9 kubenswrapper[2584]: I0714 04:58:58.059839 2584 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]} Jul 14 04:58:58.068346 ip-10-0-136-9 kubenswrapper[2584]: I0714 04:58:58.066949 2584 server.go:529] "Kubelet version" kubeletVersion="v1.34.9" Jul 14 04:58:58.068346 ip-10-0-136-9 kubenswrapper[2584]: I0714 04:58:58.066966 2584 server.go:531] "Golang settings" GOGC="" GOMAXPROCS="" GOTRACEBACK="" Jul 14 04:58:58.068346 ip-10-0-136-9 kubenswrapper[2584]: I0714 04:58:58.067686 2584 watchdog_linux.go:95] "Systemd watchdog is not enabled" Jul 14 04:58:58.068682 ip-10-0-136-9 kubenswrapper[2584]: I0714 04:58:58.067696 2584 watchdog_linux.go:137] "Systemd watchdog is not enabled or the interval is invalid, so health checking will not be started." Jul 14 04:58:58.068682 ip-10-0-136-9 kubenswrapper[2584]: W0714 04:58:58.067756 2584 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jul 14 04:58:58.068682 ip-10-0-136-9 kubenswrapper[2584]: W0714 04:58:58.067761 2584 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jul 14 04:58:58.068682 ip-10-0-136-9 kubenswrapper[2584]: W0714 04:58:58.067765 2584 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jul 14 04:58:58.068682 ip-10-0-136-9 kubenswrapper[2584]: W0714 04:58:58.067768 2584 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jul 14 04:58:58.068682 ip-10-0-136-9 kubenswrapper[2584]: W0714 04:58:58.067770 2584 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jul 14 04:58:58.068682 ip-10-0-136-9 kubenswrapper[2584]: W0714 04:58:58.067773 2584 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jul 14 04:58:58.068682 ip-10-0-136-9 kubenswrapper[2584]: W0714 04:58:58.067776 2584 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jul 14 04:58:58.068682 ip-10-0-136-9 kubenswrapper[2584]: W0714 04:58:58.067779 2584 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jul 14 04:58:58.068682 ip-10-0-136-9 kubenswrapper[2584]: W0714 04:58:58.067782 2584 feature_gate.go:328] unrecognized feature gate: EventTTL Jul 14 04:58:58.068682 ip-10-0-136-9 kubenswrapper[2584]: W0714 04:58:58.067785 2584 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jul 14 04:58:58.068682 ip-10-0-136-9 kubenswrapper[2584]: W0714 04:58:58.067787 2584 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jul 14 04:58:58.068682 ip-10-0-136-9 kubenswrapper[2584]: W0714 04:58:58.067790 2584 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jul 14 04:58:58.068682 ip-10-0-136-9 kubenswrapper[2584]: W0714 04:58:58.067792 2584 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jul 14 04:58:58.068682 ip-10-0-136-9 kubenswrapper[2584]: W0714 04:58:58.067795 2584 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jul 14 04:58:58.068682 ip-10-0-136-9 kubenswrapper[2584]: W0714 04:58:58.067797 2584 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jul 14 04:58:58.068682 ip-10-0-136-9 kubenswrapper[2584]: W0714 04:58:58.067800 2584 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jul 14 04:58:58.068682 ip-10-0-136-9 kubenswrapper[2584]: W0714 04:58:58.067802 2584 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jul 14 04:58:58.068682 ip-10-0-136-9 kubenswrapper[2584]: W0714 04:58:58.067805 2584 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jul 14 04:58:58.068682 ip-10-0-136-9 kubenswrapper[2584]: W0714 04:58:58.067807 2584 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jul 14 04:58:58.069227 ip-10-0-136-9 kubenswrapper[2584]: W0714 04:58:58.067809 2584 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jul 14 04:58:58.069227 ip-10-0-136-9 kubenswrapper[2584]: W0714 04:58:58.067812 2584 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jul 14 04:58:58.069227 ip-10-0-136-9 kubenswrapper[2584]: W0714 04:58:58.067814 2584 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jul 14 04:58:58.069227 ip-10-0-136-9 kubenswrapper[2584]: W0714 04:58:58.067817 2584 feature_gate.go:328] unrecognized feature gate: SignatureStores Jul 14 04:58:58.069227 ip-10-0-136-9 kubenswrapper[2584]: W0714 04:58:58.067820 2584 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jul 14 04:58:58.069227 ip-10-0-136-9 kubenswrapper[2584]: W0714 04:58:58.067822 2584 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jul 14 04:58:58.069227 ip-10-0-136-9 kubenswrapper[2584]: W0714 04:58:58.067826 2584 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jul 14 04:58:58.069227 ip-10-0-136-9 kubenswrapper[2584]: W0714 04:58:58.067830 2584 feature_gate.go:328] unrecognized feature gate: OSStreams Jul 14 04:58:58.069227 ip-10-0-136-9 kubenswrapper[2584]: W0714 04:58:58.067833 2584 feature_gate.go:328] unrecognized feature gate: DualReplica Jul 14 04:58:58.069227 ip-10-0-136-9 kubenswrapper[2584]: W0714 04:58:58.067835 2584 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jul 14 04:58:58.069227 ip-10-0-136-9 kubenswrapper[2584]: W0714 04:58:58.067849 2584 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jul 14 04:58:58.069227 ip-10-0-136-9 kubenswrapper[2584]: W0714 04:58:58.067853 2584 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jul 14 04:58:58.069227 ip-10-0-136-9 kubenswrapper[2584]: W0714 04:58:58.067855 2584 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jul 14 04:58:58.069227 ip-10-0-136-9 kubenswrapper[2584]: W0714 04:58:58.067858 2584 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jul 14 04:58:58.069227 ip-10-0-136-9 kubenswrapper[2584]: W0714 04:58:58.067860 2584 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jul 14 04:58:58.069227 ip-10-0-136-9 kubenswrapper[2584]: W0714 04:58:58.067864 2584 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jul 14 04:58:58.069227 ip-10-0-136-9 kubenswrapper[2584]: W0714 04:58:58.067868 2584 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jul 14 04:58:58.069227 ip-10-0-136-9 kubenswrapper[2584]: W0714 04:58:58.067871 2584 feature_gate.go:328] unrecognized feature gate: Example2 Jul 14 04:58:58.069227 ip-10-0-136-9 kubenswrapper[2584]: W0714 04:58:58.067874 2584 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jul 14 04:58:58.069666 ip-10-0-136-9 kubenswrapper[2584]: W0714 04:58:58.067876 2584 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jul 14 04:58:58.069666 ip-10-0-136-9 kubenswrapper[2584]: W0714 04:58:58.067879 2584 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jul 14 04:58:58.069666 ip-10-0-136-9 kubenswrapper[2584]: W0714 04:58:58.067882 2584 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jul 14 04:58:58.069666 ip-10-0-136-9 kubenswrapper[2584]: W0714 04:58:58.067884 2584 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jul 14 04:58:58.069666 ip-10-0-136-9 kubenswrapper[2584]: W0714 04:58:58.067887 2584 feature_gate.go:328] unrecognized feature gate: PinnedImages Jul 14 04:58:58.069666 ip-10-0-136-9 kubenswrapper[2584]: W0714 04:58:58.067889 2584 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jul 14 04:58:58.069666 ip-10-0-136-9 kubenswrapper[2584]: W0714 04:58:58.067892 2584 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jul 14 04:58:58.069666 ip-10-0-136-9 kubenswrapper[2584]: W0714 04:58:58.067894 2584 feature_gate.go:328] unrecognized feature gate: Example Jul 14 04:58:58.069666 ip-10-0-136-9 kubenswrapper[2584]: W0714 04:58:58.067897 2584 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jul 14 04:58:58.069666 ip-10-0-136-9 kubenswrapper[2584]: W0714 04:58:58.067899 2584 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jul 14 04:58:58.069666 ip-10-0-136-9 kubenswrapper[2584]: W0714 04:58:58.067901 2584 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jul 14 04:58:58.069666 ip-10-0-136-9 kubenswrapper[2584]: W0714 04:58:58.067904 2584 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jul 14 04:58:58.069666 ip-10-0-136-9 kubenswrapper[2584]: W0714 04:58:58.067906 2584 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jul 14 04:58:58.069666 ip-10-0-136-9 kubenswrapper[2584]: W0714 04:58:58.067908 2584 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jul 14 04:58:58.069666 ip-10-0-136-9 kubenswrapper[2584]: W0714 04:58:58.067911 2584 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jul 14 04:58:58.069666 ip-10-0-136-9 kubenswrapper[2584]: W0714 04:58:58.067914 2584 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jul 14 04:58:58.069666 ip-10-0-136-9 kubenswrapper[2584]: W0714 04:58:58.067916 2584 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jul 14 04:58:58.069666 ip-10-0-136-9 kubenswrapper[2584]: W0714 04:58:58.067918 2584 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jul 14 04:58:58.069666 ip-10-0-136-9 kubenswrapper[2584]: W0714 04:58:58.067921 2584 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jul 14 04:58:58.070122 ip-10-0-136-9 kubenswrapper[2584]: W0714 04:58:58.067923 2584 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jul 14 04:58:58.070122 ip-10-0-136-9 kubenswrapper[2584]: W0714 04:58:58.067926 2584 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jul 14 04:58:58.070122 ip-10-0-136-9 kubenswrapper[2584]: W0714 04:58:58.067928 2584 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jul 14 04:58:58.070122 ip-10-0-136-9 kubenswrapper[2584]: W0714 04:58:58.067930 2584 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jul 14 04:58:58.070122 ip-10-0-136-9 kubenswrapper[2584]: W0714 04:58:58.067934 2584 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jul 14 04:58:58.070122 ip-10-0-136-9 kubenswrapper[2584]: W0714 04:58:58.067942 2584 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jul 14 04:58:58.070122 ip-10-0-136-9 kubenswrapper[2584]: W0714 04:58:58.067945 2584 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jul 14 04:58:58.070122 ip-10-0-136-9 kubenswrapper[2584]: W0714 04:58:58.067947 2584 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jul 14 04:58:58.070122 ip-10-0-136-9 kubenswrapper[2584]: W0714 04:58:58.067950 2584 feature_gate.go:328] unrecognized feature gate: NewOLM Jul 14 04:58:58.070122 ip-10-0-136-9 kubenswrapper[2584]: W0714 04:58:58.067952 2584 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jul 14 04:58:58.070122 ip-10-0-136-9 kubenswrapper[2584]: W0714 04:58:58.067955 2584 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jul 14 04:58:58.070122 ip-10-0-136-9 kubenswrapper[2584]: W0714 04:58:58.067957 2584 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jul 14 04:58:58.070122 ip-10-0-136-9 kubenswrapper[2584]: W0714 04:58:58.067959 2584 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jul 14 04:58:58.070122 ip-10-0-136-9 kubenswrapper[2584]: W0714 04:58:58.067962 2584 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jul 14 04:58:58.070122 ip-10-0-136-9 kubenswrapper[2584]: W0714 04:58:58.067964 2584 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jul 14 04:58:58.070122 ip-10-0-136-9 kubenswrapper[2584]: W0714 04:58:58.067966 2584 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jul 14 04:58:58.070122 ip-10-0-136-9 kubenswrapper[2584]: W0714 04:58:58.067969 2584 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jul 14 04:58:58.070122 ip-10-0-136-9 kubenswrapper[2584]: W0714 04:58:58.067971 2584 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jul 14 04:58:58.070122 ip-10-0-136-9 kubenswrapper[2584]: W0714 04:58:58.067973 2584 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jul 14 04:58:58.070122 ip-10-0-136-9 kubenswrapper[2584]: W0714 04:58:58.067976 2584 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jul 14 04:58:58.070580 ip-10-0-136-9 kubenswrapper[2584]: W0714 04:58:58.067978 2584 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jul 14 04:58:58.070580 ip-10-0-136-9 kubenswrapper[2584]: W0714 04:58:58.067981 2584 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jul 14 04:58:58.070580 ip-10-0-136-9 kubenswrapper[2584]: W0714 04:58:58.067983 2584 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jul 14 04:58:58.070580 ip-10-0-136-9 kubenswrapper[2584]: W0714 04:58:58.067985 2584 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jul 14 04:58:58.070580 ip-10-0-136-9 kubenswrapper[2584]: W0714 04:58:58.067987 2584 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jul 14 04:58:58.070580 ip-10-0-136-9 kubenswrapper[2584]: W0714 04:58:58.067990 2584 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jul 14 04:58:58.070580 ip-10-0-136-9 kubenswrapper[2584]: W0714 04:58:58.067992 2584 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jul 14 04:58:58.070580 ip-10-0-136-9 kubenswrapper[2584]: W0714 04:58:58.067995 2584 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jul 14 04:58:58.070580 ip-10-0-136-9 kubenswrapper[2584]: W0714 04:58:58.067997 2584 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jul 14 04:58:58.070580 ip-10-0-136-9 kubenswrapper[2584]: W0714 04:58:58.068000 2584 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jul 14 04:58:58.070580 ip-10-0-136-9 kubenswrapper[2584]: W0714 04:58:58.068002 2584 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jul 14 04:58:58.070580 ip-10-0-136-9 kubenswrapper[2584]: W0714 04:58:58.068005 2584 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jul 14 04:58:58.070580 ip-10-0-136-9 kubenswrapper[2584]: W0714 04:58:58.068007 2584 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jul 14 04:58:58.070580 ip-10-0-136-9 kubenswrapper[2584]: W0714 04:58:58.068010 2584 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jul 14 04:58:58.070580 ip-10-0-136-9 kubenswrapper[2584]: W0714 04:58:58.068014 2584 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jul 14 04:58:58.070580 ip-10-0-136-9 kubenswrapper[2584]: W0714 04:58:58.068017 2584 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jul 14 04:58:58.070580 ip-10-0-136-9 kubenswrapper[2584]: W0714 04:58:58.068020 2584 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jul 14 04:58:58.070580 ip-10-0-136-9 kubenswrapper[2584]: W0714 04:58:58.068023 2584 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jul 14 04:58:58.070580 ip-10-0-136-9 kubenswrapper[2584]: W0714 04:58:58.068031 2584 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jul 14 04:58:58.071014 ip-10-0-136-9 kubenswrapper[2584]: W0714 04:58:58.068033 2584 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jul 14 04:58:58.071014 ip-10-0-136-9 kubenswrapper[2584]: W0714 04:58:58.068036 2584 feature_gate.go:328] unrecognized feature gate: OVNObservability Jul 14 04:58:58.071014 ip-10-0-136-9 kubenswrapper[2584]: W0714 04:58:58.068038 2584 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jul 14 04:58:58.071014 ip-10-0-136-9 kubenswrapper[2584]: I0714 04:58:58.068043 2584 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]} Jul 14 04:58:58.071014 ip-10-0-136-9 kubenswrapper[2584]: W0714 04:58:58.068200 2584 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jul 14 04:58:58.071014 ip-10-0-136-9 kubenswrapper[2584]: W0714 04:58:58.068206 2584 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jul 14 04:58:58.071014 ip-10-0-136-9 kubenswrapper[2584]: W0714 04:58:58.068208 2584 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jul 14 04:58:58.071014 ip-10-0-136-9 kubenswrapper[2584]: W0714 04:58:58.068211 2584 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jul 14 04:58:58.071014 ip-10-0-136-9 kubenswrapper[2584]: W0714 04:58:58.068214 2584 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jul 14 04:58:58.071014 ip-10-0-136-9 kubenswrapper[2584]: W0714 04:58:58.068216 2584 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jul 14 04:58:58.071014 ip-10-0-136-9 kubenswrapper[2584]: W0714 04:58:58.068219 2584 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jul 14 04:58:58.071014 ip-10-0-136-9 kubenswrapper[2584]: W0714 04:58:58.068222 2584 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jul 14 04:58:58.071014 ip-10-0-136-9 kubenswrapper[2584]: W0714 04:58:58.068224 2584 feature_gate.go:328] unrecognized feature gate: NewOLM Jul 14 04:58:58.071014 ip-10-0-136-9 kubenswrapper[2584]: W0714 04:58:58.068227 2584 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jul 14 04:58:58.071014 ip-10-0-136-9 kubenswrapper[2584]: W0714 04:58:58.068230 2584 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jul 14 04:58:58.071366 ip-10-0-136-9 kubenswrapper[2584]: W0714 04:58:58.068232 2584 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jul 14 04:58:58.071366 ip-10-0-136-9 kubenswrapper[2584]: W0714 04:58:58.068235 2584 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jul 14 04:58:58.071366 ip-10-0-136-9 kubenswrapper[2584]: W0714 04:58:58.068237 2584 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jul 14 04:58:58.071366 ip-10-0-136-9 kubenswrapper[2584]: W0714 04:58:58.068240 2584 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jul 14 04:58:58.071366 ip-10-0-136-9 kubenswrapper[2584]: W0714 04:58:58.068242 2584 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jul 14 04:58:58.071366 ip-10-0-136-9 kubenswrapper[2584]: W0714 04:58:58.068245 2584 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jul 14 04:58:58.071366 ip-10-0-136-9 kubenswrapper[2584]: W0714 04:58:58.068248 2584 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jul 14 04:58:58.071366 ip-10-0-136-9 kubenswrapper[2584]: W0714 04:58:58.068250 2584 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jul 14 04:58:58.071366 ip-10-0-136-9 kubenswrapper[2584]: W0714 04:58:58.068253 2584 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jul 14 04:58:58.071366 ip-10-0-136-9 kubenswrapper[2584]: W0714 04:58:58.068255 2584 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jul 14 04:58:58.071366 ip-10-0-136-9 kubenswrapper[2584]: W0714 04:58:58.068257 2584 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jul 14 04:58:58.071366 ip-10-0-136-9 kubenswrapper[2584]: W0714 04:58:58.068260 2584 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jul 14 04:58:58.071366 ip-10-0-136-9 kubenswrapper[2584]: W0714 04:58:58.068262 2584 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jul 14 04:58:58.071366 ip-10-0-136-9 kubenswrapper[2584]: W0714 04:58:58.068264 2584 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jul 14 04:58:58.071366 ip-10-0-136-9 kubenswrapper[2584]: W0714 04:58:58.068267 2584 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jul 14 04:58:58.071366 ip-10-0-136-9 kubenswrapper[2584]: W0714 04:58:58.068269 2584 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jul 14 04:58:58.071366 ip-10-0-136-9 kubenswrapper[2584]: W0714 04:58:58.068271 2584 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jul 14 04:58:58.071366 ip-10-0-136-9 kubenswrapper[2584]: W0714 04:58:58.068279 2584 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jul 14 04:58:58.071366 ip-10-0-136-9 kubenswrapper[2584]: W0714 04:58:58.068282 2584 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jul 14 04:58:58.071366 ip-10-0-136-9 kubenswrapper[2584]: W0714 04:58:58.068284 2584 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jul 14 04:58:58.071822 ip-10-0-136-9 kubenswrapper[2584]: W0714 04:58:58.068286 2584 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jul 14 04:58:58.071822 ip-10-0-136-9 kubenswrapper[2584]: W0714 04:58:58.068289 2584 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jul 14 04:58:58.071822 ip-10-0-136-9 kubenswrapper[2584]: W0714 04:58:58.068291 2584 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jul 14 04:58:58.071822 ip-10-0-136-9 kubenswrapper[2584]: W0714 04:58:58.068293 2584 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jul 14 04:58:58.071822 ip-10-0-136-9 kubenswrapper[2584]: W0714 04:58:58.068296 2584 feature_gate.go:328] unrecognized feature gate: PinnedImages Jul 14 04:58:58.071822 ip-10-0-136-9 kubenswrapper[2584]: W0714 04:58:58.068298 2584 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jul 14 04:58:58.071822 ip-10-0-136-9 kubenswrapper[2584]: W0714 04:58:58.068300 2584 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jul 14 04:58:58.071822 ip-10-0-136-9 kubenswrapper[2584]: W0714 04:58:58.068303 2584 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jul 14 04:58:58.071822 ip-10-0-136-9 kubenswrapper[2584]: W0714 04:58:58.068305 2584 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jul 14 04:58:58.071822 ip-10-0-136-9 kubenswrapper[2584]: W0714 04:58:58.068307 2584 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jul 14 04:58:58.071822 ip-10-0-136-9 kubenswrapper[2584]: W0714 04:58:58.068310 2584 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jul 14 04:58:58.071822 ip-10-0-136-9 kubenswrapper[2584]: W0714 04:58:58.068312 2584 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jul 14 04:58:58.071822 ip-10-0-136-9 kubenswrapper[2584]: W0714 04:58:58.068314 2584 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jul 14 04:58:58.071822 ip-10-0-136-9 kubenswrapper[2584]: W0714 04:58:58.068317 2584 feature_gate.go:328] unrecognized feature gate: Example2 Jul 14 04:58:58.071822 ip-10-0-136-9 kubenswrapper[2584]: W0714 04:58:58.068319 2584 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jul 14 04:58:58.071822 ip-10-0-136-9 kubenswrapper[2584]: W0714 04:58:58.068322 2584 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jul 14 04:58:58.071822 ip-10-0-136-9 kubenswrapper[2584]: W0714 04:58:58.068324 2584 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jul 14 04:58:58.071822 ip-10-0-136-9 kubenswrapper[2584]: W0714 04:58:58.068326 2584 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jul 14 04:58:58.071822 ip-10-0-136-9 kubenswrapper[2584]: W0714 04:58:58.068329 2584 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jul 14 04:58:58.071822 ip-10-0-136-9 kubenswrapper[2584]: W0714 04:58:58.068331 2584 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jul 14 04:58:58.072380 ip-10-0-136-9 kubenswrapper[2584]: W0714 04:58:58.068335 2584 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jul 14 04:58:58.072380 ip-10-0-136-9 kubenswrapper[2584]: W0714 04:58:58.068338 2584 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jul 14 04:58:58.072380 ip-10-0-136-9 kubenswrapper[2584]: W0714 04:58:58.068341 2584 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jul 14 04:58:58.072380 ip-10-0-136-9 kubenswrapper[2584]: W0714 04:58:58.068344 2584 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jul 14 04:58:58.072380 ip-10-0-136-9 kubenswrapper[2584]: W0714 04:58:58.068346 2584 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jul 14 04:58:58.072380 ip-10-0-136-9 kubenswrapper[2584]: W0714 04:58:58.068349 2584 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jul 14 04:58:58.072380 ip-10-0-136-9 kubenswrapper[2584]: W0714 04:58:58.068352 2584 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jul 14 04:58:58.072380 ip-10-0-136-9 kubenswrapper[2584]: W0714 04:58:58.068355 2584 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jul 14 04:58:58.072380 ip-10-0-136-9 kubenswrapper[2584]: W0714 04:58:58.068358 2584 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jul 14 04:58:58.072380 ip-10-0-136-9 kubenswrapper[2584]: W0714 04:58:58.068361 2584 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jul 14 04:58:58.072380 ip-10-0-136-9 kubenswrapper[2584]: W0714 04:58:58.068370 2584 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jul 14 04:58:58.072380 ip-10-0-136-9 kubenswrapper[2584]: W0714 04:58:58.068372 2584 feature_gate.go:328] unrecognized feature gate: DualReplica Jul 14 04:58:58.072380 ip-10-0-136-9 kubenswrapper[2584]: W0714 04:58:58.068375 2584 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jul 14 04:58:58.072380 ip-10-0-136-9 kubenswrapper[2584]: W0714 04:58:58.068377 2584 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jul 14 04:58:58.072380 ip-10-0-136-9 kubenswrapper[2584]: W0714 04:58:58.068380 2584 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jul 14 04:58:58.072380 ip-10-0-136-9 kubenswrapper[2584]: W0714 04:58:58.068382 2584 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jul 14 04:58:58.072380 ip-10-0-136-9 kubenswrapper[2584]: W0714 04:58:58.068384 2584 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jul 14 04:58:58.072380 ip-10-0-136-9 kubenswrapper[2584]: W0714 04:58:58.068387 2584 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jul 14 04:58:58.072380 ip-10-0-136-9 kubenswrapper[2584]: W0714 04:58:58.068389 2584 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jul 14 04:58:58.072819 ip-10-0-136-9 kubenswrapper[2584]: W0714 04:58:58.068392 2584 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jul 14 04:58:58.072819 ip-10-0-136-9 kubenswrapper[2584]: W0714 04:58:58.068394 2584 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jul 14 04:58:58.072819 ip-10-0-136-9 kubenswrapper[2584]: W0714 04:58:58.068397 2584 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jul 14 04:58:58.072819 ip-10-0-136-9 kubenswrapper[2584]: W0714 04:58:58.068400 2584 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jul 14 04:58:58.072819 ip-10-0-136-9 kubenswrapper[2584]: W0714 04:58:58.068403 2584 feature_gate.go:328] unrecognized feature gate: EventTTL Jul 14 04:58:58.072819 ip-10-0-136-9 kubenswrapper[2584]: W0714 04:58:58.068406 2584 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jul 14 04:58:58.072819 ip-10-0-136-9 kubenswrapper[2584]: W0714 04:58:58.068409 2584 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jul 14 04:58:58.072819 ip-10-0-136-9 kubenswrapper[2584]: W0714 04:58:58.068411 2584 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jul 14 04:58:58.072819 ip-10-0-136-9 kubenswrapper[2584]: W0714 04:58:58.068414 2584 feature_gate.go:328] unrecognized feature gate: OSStreams Jul 14 04:58:58.072819 ip-10-0-136-9 kubenswrapper[2584]: W0714 04:58:58.068416 2584 feature_gate.go:328] unrecognized feature gate: SignatureStores Jul 14 04:58:58.072819 ip-10-0-136-9 kubenswrapper[2584]: W0714 04:58:58.068419 2584 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jul 14 04:58:58.072819 ip-10-0-136-9 kubenswrapper[2584]: W0714 04:58:58.068422 2584 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jul 14 04:58:58.072819 ip-10-0-136-9 kubenswrapper[2584]: W0714 04:58:58.068424 2584 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jul 14 04:58:58.072819 ip-10-0-136-9 kubenswrapper[2584]: W0714 04:58:58.068426 2584 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jul 14 04:58:58.072819 ip-10-0-136-9 kubenswrapper[2584]: W0714 04:58:58.068429 2584 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jul 14 04:58:58.072819 ip-10-0-136-9 kubenswrapper[2584]: W0714 04:58:58.068431 2584 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jul 14 04:58:58.072819 ip-10-0-136-9 kubenswrapper[2584]: W0714 04:58:58.068434 2584 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jul 14 04:58:58.072819 ip-10-0-136-9 kubenswrapper[2584]: W0714 04:58:58.068436 2584 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jul 14 04:58:58.072819 ip-10-0-136-9 kubenswrapper[2584]: W0714 04:58:58.068438 2584 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jul 14 04:58:58.072819 ip-10-0-136-9 kubenswrapper[2584]: W0714 04:58:58.068440 2584 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jul 14 04:58:58.073299 ip-10-0-136-9 kubenswrapper[2584]: W0714 04:58:58.068443 2584 feature_gate.go:328] unrecognized feature gate: Example Jul 14 04:58:58.073299 ip-10-0-136-9 kubenswrapper[2584]: W0714 04:58:58.068445 2584 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jul 14 04:58:58.073299 ip-10-0-136-9 kubenswrapper[2584]: W0714 04:58:58.068448 2584 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jul 14 04:58:58.073299 ip-10-0-136-9 kubenswrapper[2584]: W0714 04:58:58.068450 2584 feature_gate.go:328] unrecognized feature gate: OVNObservability Jul 14 04:58:58.073299 ip-10-0-136-9 kubenswrapper[2584]: W0714 04:58:58.068457 2584 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jul 14 04:58:58.073299 ip-10-0-136-9 kubenswrapper[2584]: W0714 04:58:58.068460 2584 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jul 14 04:58:58.073299 ip-10-0-136-9 kubenswrapper[2584]: W0714 04:58:58.068462 2584 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jul 14 04:58:58.073299 ip-10-0-136-9 kubenswrapper[2584]: W0714 04:58:58.068465 2584 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jul 14 04:58:58.073299 ip-10-0-136-9 kubenswrapper[2584]: W0714 04:58:58.068468 2584 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jul 14 04:58:58.073299 ip-10-0-136-9 kubenswrapper[2584]: I0714 04:58:58.068473 2584 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]} Jul 14 04:58:58.073299 ip-10-0-136-9 kubenswrapper[2584]: I0714 04:58:58.068577 2584 server.go:962] "Client rotation is on, will bootstrap in background" Jul 14 04:58:58.073299 ip-10-0-136-9 kubenswrapper[2584]: I0714 04:58:58.072077 2584 bootstrap.go:101] "Use the bootstrap credentials to request a cert, and set kubeconfig to point to the certificate dir" Jul 14 04:58:58.073598 ip-10-0-136-9 kubenswrapper[2584]: I0714 04:58:58.073574 2584 server.go:1019] "Starting client certificate rotation" Jul 14 04:58:58.073714 ip-10-0-136-9 kubenswrapper[2584]: I0714 04:58:58.073699 2584 certificate_manager.go:422] "Certificate rotation is enabled" logger="kubernetes.io/kube-apiserver-client-kubelet" Jul 14 04:58:58.073746 ip-10-0-136-9 kubenswrapper[2584]: I0714 04:58:58.073728 2584 certificate_manager.go:566] "Rotating certificates" logger="kubernetes.io/kube-apiserver-client-kubelet" Jul 14 04:58:58.076423 ip-10-0-136-9 kubenswrapper[2584]: I0714 04:58:58.076410 2584 dynamic_cafile_content.go:123] "Loaded a new CA Bundle and Verifier" name="client-ca-bundle::/etc/kubernetes/kubelet-ca.crt" Jul 14 04:58:58.080360 ip-10-0-136-9 kubenswrapper[2584]: I0714 04:58:58.080338 2584 dynamic_cafile_content.go:161] "Starting controller" name="client-ca-bundle::/etc/kubernetes/kubelet-ca.crt" Jul 14 04:58:58.089128 ip-10-0-136-9 kubenswrapper[2584]: I0714 04:58:58.089113 2584 log.go:25] "Validated CRI v1 runtime API" Jul 14 04:58:58.093156 ip-10-0-136-9 kubenswrapper[2584]: I0714 04:58:58.093142 2584 log.go:25] "Validated CRI v1 image API" Jul 14 04:58:58.093885 ip-10-0-136-9 kubenswrapper[2584]: I0714 04:58:58.093871 2584 server.go:1429] "Using cgroup driver setting received from the CRI runtime" cgroupDriver="systemd" Jul 14 04:58:58.096054 ip-10-0-136-9 kubenswrapper[2584]: I0714 04:58:58.096033 2584 fs.go:135] Filesystem UUIDs: map[29d11cb0-fee4-44c9-adac-1753b301e9ba:/dev/nvme0n1p3 7B77-95E7:/dev/nvme0n1p2 daf001ef-e550-4696-a4bd-4d2bde3b8be4:/dev/nvme0n1p4] Jul 14 04:58:58.096144 ip-10-0-136-9 kubenswrapper[2584]: I0714 04:58:58.096053 2584 fs.go:136] Filesystem partitions: map[/dev/nvme0n1p3:{mountpoint:/boot major:259 minor:3 fsType:ext4 blockSize:0} /dev/nvme0n1p4:{mountpoint:/var major:259 minor:4 fsType:xfs blockSize:0} /dev/shm:{mountpoint:/dev/shm major:0 minor:22 fsType:tmpfs blockSize:0} /run:{mountpoint:/run major:0 minor:24 fsType:tmpfs blockSize:0} /tmp:{mountpoint:/tmp major:0 minor:31 fsType:tmpfs blockSize:0} composefs_0-33:{mountpoint:/ major:0 minor:33 fsType:overlay blockSize:0}] Jul 14 04:58:58.101107 ip-10-0-136-9 kubenswrapper[2584]: I0714 04:58:58.100977 2584 manager.go:216] Machine: {Timestamp:2026-07-14 04:58:58.099786579 +0000 UTC m=+0.307879698 CPUVendorID:GenuineIntel NumCores:8 NumPhysicalCores:4 NumSockets:1 CpuFrequency:3198697 MemoryCapacity:33164496896 SwapCapacity:0 MemoryByType:map[] NVMInfo:{MemoryModeCapacity:0 AppDirectModeCapacity:0 AvgPowerBudget:0} HugePages:[{PageSize:1048576 NumPages:0} {PageSize:2048 NumPages:0}] MachineID:ec26c56f33722bf1080748355afc916e SystemUUID:ec26c56f-3372-2bf1-0807-48355afc916e BootID:5cacf542-2567-4431-9c86-2fedc3fdcdd5 Filesystems:[{Device:/tmp DeviceMajor:0 DeviceMinor:31 Capacity:16582250496 Type:vfs Inodes:1048576 HasInodes:true} {Device:/dev/nvme0n1p3 DeviceMajor:259 DeviceMinor:3 Capacity:366869504 Type:vfs Inodes:98304 HasInodes:true} {Device:/dev/shm DeviceMajor:0 DeviceMinor:22 Capacity:16582246400 Type:vfs Inodes:4048400 HasInodes:true} {Device:/run DeviceMajor:0 DeviceMinor:24 Capacity:6632902656 Type:vfs Inodes:819200 HasInodes:true} {Device:/dev/nvme0n1p4 DeviceMajor:259 DeviceMinor:4 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:composefs_0-33 DeviceMajor:0 DeviceMinor:33 Capacity:6107136 Type:vfs Inodes:18446744073709551615 HasInodes:true}] DiskMap:map[259:0:{Name:nvme0n1 Major:259 Minor:0 Size:128849018880 Scheduler:none}] NetworkDevices:[{Name:br-ex MacAddress:02:0e:0f:94:00:cb Speed:0 Mtu:9001} {Name:ens5 MacAddress:02:0e:0f:94:00:cb Speed:0 Mtu:9001} {Name:ovs-system MacAddress:66:31:6b:35:ea:45 Speed:0 Mtu:1500}] Topology:[{Id:0 Memory:33164496896 HugePages:[{PageSize:1048576 NumPages:0} {PageSize:2048 NumPages:0}] Cores:[{Id:0 Threads:[0 4] Caches:[{Id:0 Size:32768 Type:Data Level:1} {Id:0 Size:32768 Type:Instruction Level:1} {Id:0 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:1 Threads:[1 5] Caches:[{Id:1 Size:32768 Type:Data Level:1} {Id:1 Size:32768 Type:Instruction Level:1} {Id:1 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:2 Threads:[2 6] Caches:[{Id:2 Size:32768 Type:Data Level:1} {Id:2 Size:32768 Type:Instruction Level:1} {Id:2 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:3 Threads:[3 7] Caches:[{Id:3 Size:32768 Type:Data Level:1} {Id:3 Size:32768 Type:Instruction Level:1} {Id:3 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:}] Caches:[{Id:0 Size:37486592 Type:Unified Level:3}] Distances:[10]}] CloudProvider:Unknown InstanceType:Unknown InstanceID:None} Jul 14 04:58:58.101107 ip-10-0-136-9 kubenswrapper[2584]: I0714 04:58:58.101104 2584 manager_no_libpfm.go:29] cAdvisor is build without cgo and/or libpfm support. Perf event counters are not available. Jul 14 04:58:58.101211 ip-10-0-136-9 kubenswrapper[2584]: I0714 04:58:58.101172 2584 manager.go:232] Version: {KernelVersion:5.14.0-570.126.1.el9_6.x86_64 ContainerOsVersion:Red Hat Enterprise Linux CoreOS 9.6.20260702-0 (Plow) DockerVersion: DockerAPIVersion: CadvisorVersion: CadvisorRevision:} Jul 14 04:58:58.104069 ip-10-0-136-9 kubenswrapper[2584]: I0714 04:58:58.104045 2584 container_manager_linux.go:273] "Container manager verified user specified cgroup-root exists" cgroupRoot=[] Jul 14 04:58:58.104200 ip-10-0-136-9 kubenswrapper[2584]: I0714 04:58:58.104071 2584 container_manager_linux.go:278] "Creating Container Manager object based on Node Config" nodeConfig={"NodeName":"ip-10-0-136-9.ec2.internal","RuntimeCgroupsName":"/system.slice/crio.service","SystemCgroupsName":"/system.slice","KubeletCgroupsName":"","KubeletOOMScoreAdj":-999,"ContainerRuntime":"","CgroupsPerQOS":true,"CgroupRoot":"/","CgroupDriver":"systemd","KubeletRootDir":"/var/lib/kubelet","ProtectKernelDefaults":true,"KubeReservedCgroupName":"","SystemReservedCgroupName":"","ReservedSystemCPUs":{},"EnforceNodeAllocatable":{"pods":{}},"KubeReserved":null,"SystemReserved":{"cpu":"500m","ephemeral-storage":"1Gi","memory":"1Gi"},"HardEvictionThresholds":[{"Signal":"memory.available","Operator":"LessThan","Value":{"Quantity":"100Mi","Percentage":0},"GracePeriod":0,"MinReclaim":null},{"Signal":"nodefs.available","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.1},"GracePeriod":0,"MinReclaim":null},{"Signal":"nodefs.inodesFree","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.05},"GracePeriod":0,"MinReclaim":null},{"Signal":"imagefs.available","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.15},"GracePeriod":0,"MinReclaim":null},{"Signal":"imagefs.inodesFree","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.05},"GracePeriod":0,"MinReclaim":null}],"QOSReserved":{},"CPUManagerPolicy":"none","CPUManagerPolicyOptions":null,"TopologyManagerScope":"container","CPUManagerReconcilePeriod":10000000000,"MemoryManagerPolicy":"None","MemoryManagerReservedMemory":null,"PodPidsLimit":4096,"EnforceCPULimits":true,"CPUCFSQuotaPeriod":100000000,"TopologyManagerPolicy":"none","TopologyManagerPolicyOptions":null,"CgroupVersion":2} Jul 14 04:58:58.104592 ip-10-0-136-9 kubenswrapper[2584]: I0714 04:58:58.104572 2584 reflector.go:439] "Caches populated" logger="kubernetes.io/kube-apiserver-client-kubelet" type="*v1.CertificateSigningRequest" reflector="k8s.io/client-go/tools/watch/informerwatcher.go:162" Jul 14 04:58:58.104788 ip-10-0-136-9 kubenswrapper[2584]: I0714 04:58:58.104778 2584 topology_manager.go:138] "Creating topology manager with none policy" Jul 14 04:58:58.104831 ip-10-0-136-9 kubenswrapper[2584]: I0714 04:58:58.104791 2584 container_manager_linux.go:309] "Creating device plugin manager" Jul 14 04:58:58.104831 ip-10-0-136-9 kubenswrapper[2584]: I0714 04:58:58.104797 2584 manager.go:141] "Creating Device Plugin manager" path="/var/lib/kubelet/device-plugins/kubelet.sock" Jul 14 04:58:58.105529 ip-10-0-136-9 kubenswrapper[2584]: I0714 04:58:58.105519 2584 server.go:74] "Creating device plugin registration server" version="v1beta1" socket="/var/lib/kubelet/device-plugins/kubelet.sock" Jul 14 04:58:58.106931 ip-10-0-136-9 kubenswrapper[2584]: I0714 04:58:58.106920 2584 container_manager_linux.go:318] "Creating Dynamic Resource Allocation (DRA) manager" Jul 14 04:58:58.110961 ip-10-0-136-9 kubenswrapper[2584]: I0714 04:58:58.110951 2584 state_mem.go:36] "Initialized new in-memory state store" Jul 14 04:58:58.111079 ip-10-0-136-9 kubenswrapper[2584]: I0714 04:58:58.111070 2584 server.go:1240] "Using root directory" path="/var/lib/kubelet" Jul 14 04:58:58.111126 ip-10-0-136-9 kubenswrapper[2584]: I0714 04:58:58.111107 2584 kubelet.go:486] "Attempting to sync node with API server" Jul 14 04:58:58.111126 ip-10-0-136-9 kubenswrapper[2584]: I0714 04:58:58.111117 2584 kubelet.go:387] "Adding static pod path" path="/etc/kubernetes/manifests" Jul 14 04:58:58.111126 ip-10-0-136-9 kubenswrapper[2584]: I0714 04:58:58.111126 2584 file.go:69] "Watching path" path="/etc/kubernetes/manifests" Jul 14 04:58:58.111216 ip-10-0-136-9 kubenswrapper[2584]: I0714 04:58:58.111143 2584 kubelet.go:398] "Adding apiserver pod source" Jul 14 04:58:58.111216 ip-10-0-136-9 kubenswrapper[2584]: I0714 04:58:58.111155 2584 apiserver.go:42] "Waiting for node sync before watching apiserver pods" Jul 14 04:58:58.111634 ip-10-0-136-9 kubenswrapper[2584]: I0714 04:58:58.111616 2584 state_mem.go:40] "Initialized new in-memory state store for pod resource information tracking" Jul 14 04:58:58.111680 ip-10-0-136-9 kubenswrapper[2584]: I0714 04:58:58.111652 2584 state_mem.go:40] "Initialized new in-memory state store for pod resource information tracking" Jul 14 04:58:58.113984 ip-10-0-136-9 kubenswrapper[2584]: I0714 04:58:58.113968 2584 kuberuntime_manager.go:301] "Container runtime initialized" containerRuntime="cri-o" version="1.34.10-2.rhaos4.21.git83ee25b.el9" apiVersion="v1" Jul 14 04:58:58.115753 ip-10-0-136-9 kubenswrapper[2584]: I0714 04:58:58.115740 2584 kubelet.go:960] "Not starting ClusterTrustBundle informer because we are in static kubelet mode or the ClusterTrustBundleProjection featuregate is disabled" Jul 14 04:58:58.115809 ip-10-0-136-9 kubenswrapper[2584]: I0714 04:58:58.115769 2584 kubelet.go:984] "Not starting PodCertificateRequest manager because we are in static kubelet mode or the PodCertificateProjection feature gate is disabled" Jul 14 04:58:58.115936 ip-10-0-136-9 kubenswrapper[2584]: I0714 04:58:58.115926 2584 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/portworx-volume" Jul 14 04:58:58.115968 ip-10-0-136-9 kubenswrapper[2584]: I0714 04:58:58.115941 2584 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/empty-dir" Jul 14 04:58:58.115968 ip-10-0-136-9 kubenswrapper[2584]: I0714 04:58:58.115947 2584 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/git-repo" Jul 14 04:58:58.115968 ip-10-0-136-9 kubenswrapper[2584]: I0714 04:58:58.115954 2584 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/host-path" Jul 14 04:58:58.115968 ip-10-0-136-9 kubenswrapper[2584]: I0714 04:58:58.115966 2584 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/nfs" Jul 14 04:58:58.116063 ip-10-0-136-9 kubenswrapper[2584]: I0714 04:58:58.115974 2584 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/secret" Jul 14 04:58:58.117353 ip-10-0-136-9 kubenswrapper[2584]: I0714 04:58:58.117344 2584 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/iscsi" Jul 14 04:58:58.117392 ip-10-0-136-9 kubenswrapper[2584]: I0714 04:58:58.117353 2584 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/downward-api" Jul 14 04:58:58.117392 ip-10-0-136-9 kubenswrapper[2584]: I0714 04:58:58.117360 2584 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/fc" Jul 14 04:58:58.117392 ip-10-0-136-9 kubenswrapper[2584]: I0714 04:58:58.117365 2584 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/configmap" Jul 14 04:58:58.117392 ip-10-0-136-9 kubenswrapper[2584]: I0714 04:58:58.117373 2584 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/projected" Jul 14 04:58:58.117392 ip-10-0-136-9 kubenswrapper[2584]: I0714 04:58:58.117380 2584 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/local-volume" Jul 14 04:58:58.118115 ip-10-0-136-9 kubenswrapper[2584]: I0714 04:58:58.118106 2584 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/csi" Jul 14 04:58:58.118115 ip-10-0-136-9 kubenswrapper[2584]: I0714 04:58:58.118115 2584 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/image" Jul 14 04:58:58.121144 ip-10-0-136-9 kubenswrapper[2584]: I0714 04:58:58.121130 2584 server.go:1268] "Started kubelet" Jul 14 04:58:58.121294 ip-10-0-136-9 kubenswrapper[2584]: I0714 04:58:58.121214 2584 ratelimit.go:56] "Setting rate limiting for endpoint" service="podresources" qps=100 burstTokens=10 Jul 14 04:58:58.121294 ip-10-0-136-9 kubenswrapper[2584]: I0714 04:58:58.121292 2584 server_v1.go:49] "podresources" method="list" useActivePods=true Jul 14 04:58:58.125086 ip-10-0-136-9 kubenswrapper[2584]: I0714 04:58:58.124873 2584 server.go:180] "Starting to listen" address="0.0.0.0" port=10250 Jul 14 04:58:58.125529 ip-10-0-136-9 systemd[1]: Started Kubernetes Kubelet. Jul 14 04:58:58.126279 ip-10-0-136-9 kubenswrapper[2584]: I0714 04:58:58.126260 2584 server.go:249] "Starting to serve the podresources API" endpoint="unix:/var/lib/kubelet/pod-resources/kubelet.sock" Jul 14 04:58:58.128166 ip-10-0-136-9 kubenswrapper[2584]: I0714 04:58:58.128147 2584 server.go:310] "Adding debug handlers to kubelet server" Jul 14 04:58:58.129438 ip-10-0-136-9 kubenswrapper[2584]: I0714 04:58:58.129413 2584 csi_plugin.go:990] Failed to contact API server when waiting for CSINode publishing: csinodes.storage.k8s.io "ip-10-0-136-9.ec2.internal" is forbidden: User "system:anonymous" cannot get resource "csinodes" in API group "storage.k8s.io" at the cluster scope Jul 14 04:58:58.129555 ip-10-0-136-9 kubenswrapper[2584]: E0714 04:58:58.129403 2584 reflector.go:205] "Failed to watch" err="failed to list *v1.Service: services is forbidden: User \"system:anonymous\" cannot list resource \"services\" in API group \"\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Service" Jul 14 04:58:58.129555 ip-10-0-136-9 kubenswrapper[2584]: E0714 04:58:58.129502 2584 reflector.go:205] "Failed to watch" err="failed to list *v1.Node: nodes \"ip-10-0-136-9.ec2.internal\" is forbidden: User \"system:anonymous\" cannot list resource \"nodes\" in API group \"\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Node" Jul 14 04:58:58.131207 ip-10-0-136-9 kubenswrapper[2584]: E0714 04:58:58.131188 2584 kubelet.go:1638] "Image garbage collection failed once. Stats initialization may not have completed yet" err="failed to get imageFs info: unable to find data in memory cache" Jul 14 04:58:58.132089 ip-10-0-136-9 kubenswrapper[2584]: E0714 04:58:58.131257 2584 event.go:359] "Server rejected event (will not retry!)" err="events is forbidden: User \"system:anonymous\" cannot create resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-136-9.ec2.internal.18c20f38972dd643 default 0 0001-01-01 00:00:00 +0000 UTC map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-136-9.ec2.internal,UID:ip-10-0-136-9.ec2.internal,APIVersion:,ResourceVersion:,FieldPath:,},Reason:Starting,Message:Starting kubelet.,Source:EventSource{Component:kubelet,Host:ip-10-0-136-9.ec2.internal,},FirstTimestamp:2026-07-14 04:58:58.121086531 +0000 UTC m=+0.329179650,LastTimestamp:2026-07-14 04:58:58.121086531 +0000 UTC m=+0.329179650,Count:1,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-136-9.ec2.internal,}" Jul 14 04:58:58.134071 ip-10-0-136-9 kubenswrapper[2584]: I0714 04:58:58.134058 2584 fs_resource_analyzer.go:67] "Starting FS ResourceAnalyzer" Jul 14 04:58:58.134138 ip-10-0-136-9 kubenswrapper[2584]: I0714 04:58:58.134074 2584 certificate_manager.go:422] "Certificate rotation is enabled" logger="kubernetes.io/kubelet-serving" Jul 14 04:58:58.134389 ip-10-0-136-9 kubenswrapper[2584]: E0714 04:58:58.134235 2584 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-136-9.ec2.internal\" not found" Jul 14 04:58:58.134767 ip-10-0-136-9 kubenswrapper[2584]: I0714 04:58:58.134693 2584 volume_manager.go:311] "The desired_state_of_world populator starts" Jul 14 04:58:58.134767 ip-10-0-136-9 kubenswrapper[2584]: I0714 04:58:58.134710 2584 volume_manager.go:313] "Starting Kubelet Volume Manager" Jul 14 04:58:58.134863 ip-10-0-136-9 kubenswrapper[2584]: I0714 04:58:58.134793 2584 reconstruct.go:97] "Volume reconstruction finished" Jul 14 04:58:58.134863 ip-10-0-136-9 kubenswrapper[2584]: I0714 04:58:58.134805 2584 reconciler.go:29] "Reconciler: start to sync state" Jul 14 04:58:58.134863 ip-10-0-136-9 kubenswrapper[2584]: I0714 04:58:58.134797 2584 desired_state_of_world_populator.go:146] "Desired state populator starts to run" Jul 14 04:58:58.135291 ip-10-0-136-9 kubenswrapper[2584]: I0714 04:58:58.135277 2584 factory.go:55] Registering systemd factory Jul 14 04:58:58.135291 ip-10-0-136-9 kubenswrapper[2584]: I0714 04:58:58.135293 2584 factory.go:223] Registration of the systemd container factory successfully Jul 14 04:58:58.135655 ip-10-0-136-9 kubenswrapper[2584]: I0714 04:58:58.135520 2584 factory.go:153] Registering CRI-O factory Jul 14 04:58:58.135655 ip-10-0-136-9 kubenswrapper[2584]: I0714 04:58:58.135535 2584 factory.go:223] Registration of the crio container factory successfully Jul 14 04:58:58.135655 ip-10-0-136-9 kubenswrapper[2584]: I0714 04:58:58.135576 2584 factory.go:221] Registration of the containerd container factory failed: unable to create containerd client: containerd: cannot unix dial containerd api service: dial unix /run/containerd/containerd.sock: connect: no such file or directory Jul 14 04:58:58.135655 ip-10-0-136-9 kubenswrapper[2584]: I0714 04:58:58.135597 2584 factory.go:103] Registering Raw factory Jul 14 04:58:58.135655 ip-10-0-136-9 kubenswrapper[2584]: I0714 04:58:58.135610 2584 manager.go:1196] Started watching for new ooms in manager Jul 14 04:58:58.137358 ip-10-0-136-9 kubenswrapper[2584]: I0714 04:58:58.136043 2584 manager.go:349] Starting recovery of all containers Jul 14 04:58:58.138021 ip-10-0-136-9 kubenswrapper[2584]: E0714 04:58:58.137991 2584 reflector.go:205] "Failed to watch" err="failed to list *v1.CSIDriver: csidrivers.storage.k8s.io is forbidden: User \"system:anonymous\" cannot list resource \"csidrivers\" in API group \"storage.k8s.io\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.CSIDriver" Jul 14 04:58:58.138133 ip-10-0-136-9 kubenswrapper[2584]: E0714 04:58:58.138027 2584 controller.go:145] "Failed to ensure lease exists, will retry" err="leases.coordination.k8s.io \"ip-10-0-136-9.ec2.internal\" is forbidden: User \"system:anonymous\" cannot get resource \"leases\" in API group \"coordination.k8s.io\" in the namespace \"kube-node-lease\"" interval="200ms" Jul 14 04:58:58.142290 ip-10-0-136-9 kubenswrapper[2584]: I0714 04:58:58.142263 2584 kubelet_network_linux.go:54] "Initialized iptables rules." protocol="IPv6" Jul 14 04:58:58.145545 ip-10-0-136-9 kubenswrapper[2584]: I0714 04:58:58.145530 2584 manager.go:354] Recovery completed Jul 14 04:58:58.149334 ip-10-0-136-9 kubenswrapper[2584]: I0714 04:58:58.149320 2584 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jul 14 04:58:58.151011 ip-10-0-136-9 kubenswrapper[2584]: I0714 04:58:58.150994 2584 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-136-9.ec2.internal" event="NodeHasSufficientMemory" Jul 14 04:58:58.151073 ip-10-0-136-9 kubenswrapper[2584]: I0714 04:58:58.151024 2584 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-136-9.ec2.internal" event="NodeHasNoDiskPressure" Jul 14 04:58:58.151073 ip-10-0-136-9 kubenswrapper[2584]: I0714 04:58:58.151034 2584 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-136-9.ec2.internal" event="NodeHasSufficientPID" Jul 14 04:58:58.151494 ip-10-0-136-9 kubenswrapper[2584]: I0714 04:58:58.151481 2584 cpu_manager.go:222] "Starting CPU manager" policy="none" Jul 14 04:58:58.151494 ip-10-0-136-9 kubenswrapper[2584]: I0714 04:58:58.151492 2584 cpu_manager.go:223] "Reconciling" reconcilePeriod="10s" Jul 14 04:58:58.151610 ip-10-0-136-9 kubenswrapper[2584]: I0714 04:58:58.151507 2584 state_mem.go:36] "Initialized new in-memory state store" Jul 14 04:58:58.151610 ip-10-0-136-9 kubenswrapper[2584]: I0714 04:58:58.151510 2584 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jul 14 04:58:58.151720 ip-10-0-136-9 kubenswrapper[2584]: I0714 04:58:58.151701 2584 csr.go:274] "Certificate signing request is approved, waiting to be issued" logger="kubernetes.io/kube-apiserver-client-kubelet" csr="csr-5l8bh" Jul 14 04:58:58.152486 ip-10-0-136-9 kubenswrapper[2584]: I0714 04:58:58.152466 2584 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-136-9.ec2.internal" event="NodeHasSufficientMemory" Jul 14 04:58:58.152571 ip-10-0-136-9 kubenswrapper[2584]: I0714 04:58:58.152502 2584 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-136-9.ec2.internal" event="NodeHasNoDiskPressure" Jul 14 04:58:58.152571 ip-10-0-136-9 kubenswrapper[2584]: I0714 04:58:58.152517 2584 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-136-9.ec2.internal" event="NodeHasSufficientPID" Jul 14 04:58:58.153530 ip-10-0-136-9 kubenswrapper[2584]: E0714 04:58:58.153444 2584 event.go:359] "Server rejected event (will not retry!)" err="events is forbidden: User \"system:anonymous\" cannot create resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-136-9.ec2.internal.18c20f3898f6752b default 0 0001-01-01 00:00:00 +0000 UTC map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-136-9.ec2.internal,UID:ip-10-0-136-9.ec2.internal,APIVersion:,ResourceVersion:,FieldPath:,},Reason:NodeHasSufficientMemory,Message:Node ip-10-0-136-9.ec2.internal status is now: NodeHasSufficientMemory,Source:EventSource{Component:kubelet,Host:ip-10-0-136-9.ec2.internal,},FirstTimestamp:2026-07-14 04:58:58.151011627 +0000 UTC m=+0.359104746,LastTimestamp:2026-07-14 04:58:58.151011627 +0000 UTC m=+0.359104746,Count:1,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-136-9.ec2.internal,}" Jul 14 04:58:58.154731 ip-10-0-136-9 kubenswrapper[2584]: I0714 04:58:58.154717 2584 policy_none.go:49] "None policy: Start" Jul 14 04:58:58.154787 ip-10-0-136-9 kubenswrapper[2584]: I0714 04:58:58.154741 2584 memory_manager.go:187] "Starting memorymanager" policy="None" Jul 14 04:58:58.154787 ip-10-0-136-9 kubenswrapper[2584]: I0714 04:58:58.154752 2584 state_mem.go:36] "Initializing new in-memory state store" logger="Memory Manager state checkpoint" Jul 14 04:58:58.156745 ip-10-0-136-9 kubenswrapper[2584]: I0714 04:58:58.156730 2584 policy_none.go:47] "Start" Jul 14 04:58:58.158006 ip-10-0-136-9 kubenswrapper[2584]: I0714 04:58:58.157990 2584 csr.go:270] "Certificate signing request is issued" logger="kubernetes.io/kube-apiserver-client-kubelet" csr="csr-5l8bh" Jul 14 04:58:58.163733 ip-10-0-136-9 kubenswrapper[2584]: E0714 04:58:58.163674 2584 event.go:359] "Server rejected event (will not retry!)" err="events is forbidden: User \"system:anonymous\" cannot create resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-136-9.ec2.internal.18c20f3898f6b70e default 0 0001-01-01 00:00:00 +0000 UTC map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-136-9.ec2.internal,UID:ip-10-0-136-9.ec2.internal,APIVersion:,ResourceVersion:,FieldPath:,},Reason:NodeHasNoDiskPressure,Message:Node ip-10-0-136-9.ec2.internal status is now: NodeHasNoDiskPressure,Source:EventSource{Component:kubelet,Host:ip-10-0-136-9.ec2.internal,},FirstTimestamp:2026-07-14 04:58:58.151028494 +0000 UTC m=+0.359121613,LastTimestamp:2026-07-14 04:58:58.151028494 +0000 UTC m=+0.359121613,Count:1,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-136-9.ec2.internal,}" Jul 14 04:58:59.438615 ip-10-0-136-9 kubenswrapper[2584]: I0714 04:58:59.438451 2584 manager.go:337] "Starting Device Plugin manager" Jul 14 04:58:59.438699 ip-10-0-136-9 kubenswrapper[2584]: E0714 04:58:59.438661 2584 manager.go:513] "Failed to read data from checkpoint" err="checkpoint is not found" checkpoint="kubelet_internal_checkpoint" Jul 14 04:58:59.438699 ip-10-0-136-9 kubenswrapper[2584]: I0714 04:58:59.438676 2584 server.go:87] "Starting device plugin registration server" Jul 14 04:58:59.438914 ip-10-0-136-9 kubenswrapper[2584]: I0714 04:58:59.438902 2584 eviction_manager.go:189] "Eviction manager: starting control loop" Jul 14 04:58:59.438998 ip-10-0-136-9 kubenswrapper[2584]: I0714 04:58:59.438918 2584 container_log_manager.go:146] "Initializing container log rotate workers" workers=1 monitorPeriod="10s" Jul 14 04:58:59.439054 ip-10-0-136-9 kubenswrapper[2584]: I0714 04:58:59.439002 2584 plugin_watcher.go:51] "Plugin Watcher Start" path="/var/lib/kubelet/plugins_registry" Jul 14 04:58:59.439121 ip-10-0-136-9 kubenswrapper[2584]: I0714 04:58:59.439109 2584 plugin_manager.go:116] "The desired_state_of_world populator (plugin watcher) starts" Jul 14 04:58:59.439164 ip-10-0-136-9 kubenswrapper[2584]: I0714 04:58:59.439122 2584 plugin_manager.go:118] "Starting Kubelet Plugin Manager" Jul 14 04:58:59.439582 ip-10-0-136-9 kubenswrapper[2584]: E0714 04:58:59.439565 2584 eviction_manager.go:267] "eviction manager: failed to check if we have separate container filesystem. Ignoring." err="non-existent label \"crio-containers\"" Jul 14 04:58:59.439657 ip-10-0-136-9 kubenswrapper[2584]: E0714 04:58:59.439614 2584 eviction_manager.go:292] "Eviction manager: failed to get summary stats" err="failed to get node info: node \"ip-10-0-136-9.ec2.internal\" not found" Jul 14 04:58:59.523290 ip-10-0-136-9 kubenswrapper[2584]: I0714 04:58:59.523271 2584 kubelet_network_linux.go:54] "Initialized iptables rules." protocol="IPv4" Jul 14 04:58:59.525255 ip-10-0-136-9 kubenswrapper[2584]: I0714 04:58:59.523310 2584 status_manager.go:244] "Starting to sync pod status with apiserver" Jul 14 04:58:59.525255 ip-10-0-136-9 kubenswrapper[2584]: I0714 04:58:59.523328 2584 kubelet.go:2448] "Starting kubelet main sync loop" Jul 14 04:58:59.525255 ip-10-0-136-9 kubenswrapper[2584]: E0714 04:58:59.523358 2584 kubelet.go:2472] "Skipping pod synchronization" err="PLEG is not healthy: pleg has yet to be successful" Jul 14 04:58:59.525398 ip-10-0-136-9 kubenswrapper[2584]: I0714 04:58:59.525386 2584 reflector.go:439] "Caches populated" type="*v1.RuntimeClass" reflector="k8s.io/client-go/informers/factory.go:160" Jul 14 04:58:59.539788 ip-10-0-136-9 kubenswrapper[2584]: I0714 04:58:59.539774 2584 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jul 14 04:58:59.540496 ip-10-0-136-9 kubenswrapper[2584]: I0714 04:58:59.540482 2584 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-136-9.ec2.internal" event="NodeHasSufficientMemory" Jul 14 04:58:59.540564 ip-10-0-136-9 kubenswrapper[2584]: I0714 04:58:59.540508 2584 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-136-9.ec2.internal" event="NodeHasNoDiskPressure" Jul 14 04:58:59.540564 ip-10-0-136-9 kubenswrapper[2584]: I0714 04:58:59.540518 2584 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-136-9.ec2.internal" event="NodeHasSufficientPID" Jul 14 04:58:59.540564 ip-10-0-136-9 kubenswrapper[2584]: I0714 04:58:59.540539 2584 kubelet_node_status.go:78] "Attempting to register node" node="ip-10-0-136-9.ec2.internal" Jul 14 04:58:59.549910 ip-10-0-136-9 kubenswrapper[2584]: I0714 04:58:59.549868 2584 kubelet_node_status.go:81] "Successfully registered node" node="ip-10-0-136-9.ec2.internal" Jul 14 04:58:59.549910 ip-10-0-136-9 kubenswrapper[2584]: E0714 04:58:59.549886 2584 kubelet_node_status.go:536] "Error updating node status, will retry" err="error getting node \"ip-10-0-136-9.ec2.internal\": node \"ip-10-0-136-9.ec2.internal\" not found" Jul 14 04:58:59.578921 ip-10-0-136-9 kubenswrapper[2584]: E0714 04:58:59.578899 2584 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-136-9.ec2.internal\" not found" Jul 14 04:58:59.623858 ip-10-0-136-9 kubenswrapper[2584]: I0714 04:58:59.623829 2584 kubelet.go:2535] "SyncLoop ADD" source="file" pods=["openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-136-9.ec2.internal","kube-system/kube-apiserver-proxy-ip-10-0-136-9.ec2.internal"] Jul 14 04:58:59.623960 ip-10-0-136-9 kubenswrapper[2584]: I0714 04:58:59.623904 2584 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jul 14 04:58:59.625243 ip-10-0-136-9 kubenswrapper[2584]: I0714 04:58:59.625220 2584 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-136-9.ec2.internal" event="NodeHasSufficientMemory" Jul 14 04:58:59.625321 ip-10-0-136-9 kubenswrapper[2584]: I0714 04:58:59.625251 2584 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-136-9.ec2.internal" event="NodeHasNoDiskPressure" Jul 14 04:58:59.625321 ip-10-0-136-9 kubenswrapper[2584]: I0714 04:58:59.625266 2584 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-136-9.ec2.internal" event="NodeHasSufficientPID" Jul 14 04:58:59.627162 ip-10-0-136-9 kubenswrapper[2584]: I0714 04:58:59.627151 2584 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jul 14 04:58:59.627282 ip-10-0-136-9 kubenswrapper[2584]: I0714 04:58:59.627267 2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-136-9.ec2.internal" Jul 14 04:58:59.627323 ip-10-0-136-9 kubenswrapper[2584]: I0714 04:58:59.627296 2584 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jul 14 04:58:59.627779 ip-10-0-136-9 kubenswrapper[2584]: I0714 04:58:59.627766 2584 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-136-9.ec2.internal" event="NodeHasSufficientMemory" Jul 14 04:58:59.627849 ip-10-0-136-9 kubenswrapper[2584]: I0714 04:58:59.627784 2584 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-136-9.ec2.internal" event="NodeHasSufficientMemory" Jul 14 04:58:59.627849 ip-10-0-136-9 kubenswrapper[2584]: I0714 04:58:59.627793 2584 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-136-9.ec2.internal" event="NodeHasNoDiskPressure" Jul 14 04:58:59.627849 ip-10-0-136-9 kubenswrapper[2584]: I0714 04:58:59.627805 2584 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-136-9.ec2.internal" event="NodeHasSufficientPID" Jul 14 04:58:59.627849 ip-10-0-136-9 kubenswrapper[2584]: I0714 04:58:59.627807 2584 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-136-9.ec2.internal" event="NodeHasNoDiskPressure" Jul 14 04:58:59.627849 ip-10-0-136-9 kubenswrapper[2584]: I0714 04:58:59.627819 2584 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-136-9.ec2.internal" event="NodeHasSufficientPID" Jul 14 04:58:59.629707 ip-10-0-136-9 kubenswrapper[2584]: I0714 04:58:59.629692 2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/kube-apiserver-proxy-ip-10-0-136-9.ec2.internal" Jul 14 04:58:59.629758 ip-10-0-136-9 kubenswrapper[2584]: I0714 04:58:59.629718 2584 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jul 14 04:58:59.630341 ip-10-0-136-9 kubenswrapper[2584]: I0714 04:58:59.630326 2584 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-136-9.ec2.internal" event="NodeHasSufficientMemory" Jul 14 04:58:59.630437 ip-10-0-136-9 kubenswrapper[2584]: I0714 04:58:59.630355 2584 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-136-9.ec2.internal" event="NodeHasNoDiskPressure" Jul 14 04:58:59.630437 ip-10-0-136-9 kubenswrapper[2584]: I0714 04:58:59.630372 2584 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-136-9.ec2.internal" event="NodeHasSufficientPID" Jul 14 04:58:59.643418 ip-10-0-136-9 kubenswrapper[2584]: E0714 04:58:59.643396 2584 kubelet.go:3244] "No need to create a mirror pod, since failed to get node info from the cluster" err="node \"ip-10-0-136-9.ec2.internal\" not found" node="ip-10-0-136-9.ec2.internal" Jul 14 04:58:59.646898 ip-10-0-136-9 kubenswrapper[2584]: E0714 04:58:59.646886 2584 kubelet.go:3244] "No need to create a mirror pod, since failed to get node info from the cluster" err="node \"ip-10-0-136-9.ec2.internal\" not found" node="ip-10-0-136-9.ec2.internal" Jul 14 04:58:59.679199 ip-10-0-136-9 kubenswrapper[2584]: E0714 04:58:59.679181 2584 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-136-9.ec2.internal\" not found" Jul 14 04:58:59.683772 ip-10-0-136-9 kubenswrapper[2584]: I0714 04:58:59.683748 2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/1742fd7280f507bfa68896a24fcd9fea-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-136-9.ec2.internal\" (UID: \"1742fd7280f507bfa68896a24fcd9fea\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-136-9.ec2.internal" Jul 14 04:58:59.683856 ip-10-0-136-9 kubenswrapper[2584]: I0714 04:58:59.683779 2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/1742fd7280f507bfa68896a24fcd9fea-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-136-9.ec2.internal\" (UID: \"1742fd7280f507bfa68896a24fcd9fea\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-136-9.ec2.internal" Jul 14 04:58:59.683856 ip-10-0-136-9 kubenswrapper[2584]: I0714 04:58:59.683796 2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/host-path/93e20c48273b3fa7dacbffda6c635805-config\") pod \"kube-apiserver-proxy-ip-10-0-136-9.ec2.internal\" (UID: \"93e20c48273b3fa7dacbffda6c635805\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-136-9.ec2.internal" Jul 14 04:58:59.780020 ip-10-0-136-9 kubenswrapper[2584]: E0714 04:58:59.779992 2584 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-136-9.ec2.internal\" not found" Jul 14 04:58:59.784304 ip-10-0-136-9 kubenswrapper[2584]: I0714 04:58:59.784289 2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/1742fd7280f507bfa68896a24fcd9fea-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-136-9.ec2.internal\" (UID: \"1742fd7280f507bfa68896a24fcd9fea\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-136-9.ec2.internal" Jul 14 04:58:59.784355 ip-10-0-136-9 kubenswrapper[2584]: I0714 04:58:59.784317 2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/1742fd7280f507bfa68896a24fcd9fea-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-136-9.ec2.internal\" (UID: \"1742fd7280f507bfa68896a24fcd9fea\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-136-9.ec2.internal" Jul 14 04:58:59.784355 ip-10-0-136-9 kubenswrapper[2584]: I0714 04:58:59.784333 2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/host-path/93e20c48273b3fa7dacbffda6c635805-config\") pod \"kube-apiserver-proxy-ip-10-0-136-9.ec2.internal\" (UID: \"93e20c48273b3fa7dacbffda6c635805\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-136-9.ec2.internal" Jul 14 04:58:59.784421 ip-10-0-136-9 kubenswrapper[2584]: I0714 04:58:59.784368 2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/host-path/93e20c48273b3fa7dacbffda6c635805-config\") pod \"kube-apiserver-proxy-ip-10-0-136-9.ec2.internal\" (UID: \"93e20c48273b3fa7dacbffda6c635805\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-136-9.ec2.internal" Jul 14 04:58:59.784421 ip-10-0-136-9 kubenswrapper[2584]: I0714 04:58:59.784389 2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/1742fd7280f507bfa68896a24fcd9fea-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-136-9.ec2.internal\" (UID: \"1742fd7280f507bfa68896a24fcd9fea\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-136-9.ec2.internal" Jul 14 04:58:59.784421 ip-10-0-136-9 kubenswrapper[2584]: I0714 04:58:59.784397 2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/1742fd7280f507bfa68896a24fcd9fea-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-136-9.ec2.internal\" (UID: \"1742fd7280f507bfa68896a24fcd9fea\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-136-9.ec2.internal" Jul 14 04:58:59.880686 ip-10-0-136-9 kubenswrapper[2584]: E0714 04:58:59.880661 2584 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-136-9.ec2.internal\" not found" Jul 14 04:58:59.946198 ip-10-0-136-9 kubenswrapper[2584]: I0714 04:58:59.946178 2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-136-9.ec2.internal" Jul 14 04:58:59.949327 ip-10-0-136-9 kubenswrapper[2584]: I0714 04:58:59.949312 2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/kube-apiserver-proxy-ip-10-0-136-9.ec2.internal" Jul 14 04:58:59.981673 ip-10-0-136-9 kubenswrapper[2584]: E0714 04:58:59.981644 2584 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-136-9.ec2.internal\" not found" Jul 14 04:59:00.082067 ip-10-0-136-9 kubenswrapper[2584]: E0714 04:59:00.082039 2584 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-136-9.ec2.internal\" not found" Jul 14 04:59:00.182528 ip-10-0-136-9 kubenswrapper[2584]: E0714 04:59:00.182473 2584 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-136-9.ec2.internal\" not found" Jul 14 04:59:00.282856 ip-10-0-136-9 kubenswrapper[2584]: E0714 04:59:00.282839 2584 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-136-9.ec2.internal\" not found" Jul 14 04:59:00.320139 ip-10-0-136-9 kubenswrapper[2584]: I0714 04:59:00.320122 2584 transport.go:147] "Certificate rotation detected, shutting down client connections to start using new credentials" Jul 14 04:59:00.320547 ip-10-0-136-9 kubenswrapper[2584]: I0714 04:59:00.320246 2584 reflector.go:571] "Warning: watch ended with error" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.RuntimeClass" err="very short watch: k8s.io/client-go/informers/factory.go:160: Unexpected watch close - watch lasted less than a second and no items received" Jul 14 04:59:00.383894 ip-10-0-136-9 kubenswrapper[2584]: E0714 04:59:00.383874 2584 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-136-9.ec2.internal\" not found" Jul 14 04:59:00.409248 ip-10-0-136-9 kubenswrapper[2584]: I0714 04:59:00.409226 2584 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kube-apiserver-client-kubelet" expiration="2028-07-13 04:53:59 +0000 UTC" deadline="2028-01-27 02:21:26.937778422 +0000 UTC" Jul 14 04:59:00.409315 ip-10-0-136-9 kubenswrapper[2584]: I0714 04:59:00.409249 2584 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kube-apiserver-client-kubelet" sleep="13485h22m26.528532522s" Jul 14 04:59:00.428925 ip-10-0-136-9 kubenswrapper[2584]: I0714 04:59:00.428910 2584 reflector.go:439] "Caches populated" type="*v1.Node" reflector="k8s.io/client-go/informers/factory.go:160" Jul 14 04:59:00.481130 ip-10-0-136-9 kubenswrapper[2584]: I0714 04:59:00.481087 2584 kubelet.go:3248] "Creating a mirror pod for static pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-136-9.ec2.internal" Jul 14 04:59:00.496193 ip-10-0-136-9 kubenswrapper[2584]: I0714 04:59:00.496177 2584 warnings.go:110] "Warning: metadata.name: this is used in the Pod's hostname, which can result in surprising behavior; a DNS label is recommended: [must not contain dots]" Jul 14 04:59:00.498243 ip-10-0-136-9 kubenswrapper[2584]: I0714 04:59:00.498224 2584 kubelet.go:3248] "Creating a mirror pod for static pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-136-9.ec2.internal" Jul 14 04:59:00.507327 ip-10-0-136-9 kubenswrapper[2584]: I0714 04:59:00.507311 2584 warnings.go:110] "Warning: metadata.name: this is used in the Pod's hostname, which can result in surprising behavior; a DNS label is recommended: [must not contain dots]" Jul 14 04:59:00.586820 ip-10-0-136-9 kubenswrapper[2584]: I0714 04:59:00.586804 2584 reflector.go:439] "Caches populated" type="*v1.CSIDriver" reflector="k8s.io/client-go/informers/factory.go:160" Jul 14 04:59:00.654299 ip-10-0-136-9 kubenswrapper[2584]: W0714 04:59:00.654273 2584 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod93e20c48273b3fa7dacbffda6c635805.slice/crio-d8888b6ef4f45cb44107e162e357110f8f495fe946a5516e0531b30ce96be243 WatchSource:0}: Error finding container d8888b6ef4f45cb44107e162e357110f8f495fe946a5516e0531b30ce96be243: Status 404 returned error can't find the container with id d8888b6ef4f45cb44107e162e357110f8f495fe946a5516e0531b30ce96be243 Jul 14 04:59:00.654666 ip-10-0-136-9 kubenswrapper[2584]: W0714 04:59:00.654646 2584 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod1742fd7280f507bfa68896a24fcd9fea.slice/crio-4632cb18427e499b4344d5b12e1da0aa385fed8fb1987c82c4657ff97e3dfd65 WatchSource:0}: Error finding container 4632cb18427e499b4344d5b12e1da0aa385fed8fb1987c82c4657ff97e3dfd65: Status 404 returned error can't find the container with id 4632cb18427e499b4344d5b12e1da0aa385fed8fb1987c82c4657ff97e3dfd65 Jul 14 04:59:00.658353 ip-10-0-136-9 kubenswrapper[2584]: I0714 04:59:00.658337 2584 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider Jul 14 04:59:00.769653 ip-10-0-136-9 kubenswrapper[2584]: I0714 04:59:00.769481 2584 reflector.go:439] "Caches populated" type="*v1.Service" reflector="k8s.io/client-go/informers/factory.go:160" Jul 14 04:59:01.358815 ip-10-0-136-9 kubenswrapper[2584]: I0714 04:59:01.358778 2584 apiserver.go:52] "Watching apiserver" Jul 14 04:59:01.367428 ip-10-0-136-9 kubenswrapper[2584]: I0714 04:59:01.367406 2584 reflector.go:439] "Caches populated" type="*v1.Pod" reflector="pkg/kubelet/config/apiserver.go:66" Jul 14 04:59:01.369115 ip-10-0-136-9 kubenswrapper[2584]: I0714 04:59:01.369083 2584 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-multus/network-metrics-daemon-7prdk","kube-system/global-pull-secret-syncer-fb7bm","openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-5hkg2","openshift-cluster-node-tuning-operator/tuned-nhmwr","openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-136-9.ec2.internal","openshift-multus/multus-s7xsv","openshift-network-diagnostics/network-check-target-kr4q2","openshift-network-operator/iptables-alerter-drsfg","openshift-ovn-kubernetes/ovnkube-node-8llzd","kube-system/konnectivity-agent-g257n","kube-system/kube-apiserver-proxy-ip-10-0-136-9.ec2.internal","openshift-dns/node-resolver-t5mq8","openshift-image-registry/node-ca-l8z9r","openshift-multus/multus-additional-cni-plugins-48p6x"] Jul 14 04:59:01.371390 ip-10-0-136-9 kubenswrapper[2584]: I0714 04:59:01.371370 2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-kr4q2" Jul 14 04:59:01.371479 ip-10-0-136-9 kubenswrapper[2584]: E0714 04:59:01.371452 2584 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-kr4q2" podUID="c4902f44-8d7a-4f36-b6e7-0acf7bef5043" Jul 14 04:59:01.373442 ip-10-0-136-9 kubenswrapper[2584]: I0714 04:59:01.373424 2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-operator/iptables-alerter-drsfg" Jul 14 04:59:01.375602 ip-10-0-136-9 kubenswrapper[2584]: I0714 04:59:01.375583 2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-5hkg2" Jul 14 04:59:01.376317 ip-10-0-136-9 kubenswrapper[2584]: I0714 04:59:01.376139 2584 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-operator\"/\"iptables-alerter-dockercfg-d7wd7\"" Jul 14 04:59:01.376317 ip-10-0-136-9 kubenswrapper[2584]: I0714 04:59:01.376156 2584 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"openshift-service-ca.crt\"" Jul 14 04:59:01.376317 ip-10-0-136-9 kubenswrapper[2584]: I0714 04:59:01.376177 2584 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"kube-root-ca.crt\"" Jul 14 04:59:01.376514 ip-10-0-136-9 kubenswrapper[2584]: I0714 04:59:01.376410 2584 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"iptables-alerter-script\"" Jul 14 04:59:01.377774 ip-10-0-136-9 kubenswrapper[2584]: I0714 04:59:01.377754 2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-node-tuning-operator/tuned-nhmwr" Jul 14 04:59:01.377955 ip-10-0-136-9 kubenswrapper[2584]: I0714 04:59:01.377910 2584 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-csi-drivers\"/\"openshift-service-ca.crt\"" Jul 14 04:59:01.378038 ip-10-0-136-9 kubenswrapper[2584]: I0714 04:59:01.378024 2584 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-csi-drivers\"/\"aws-ebs-csi-driver-node-metrics-serving-cert\"" Jul 14 04:59:01.378350 ip-10-0-136-9 kubenswrapper[2584]: I0714 04:59:01.378332 2584 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-csi-drivers\"/\"aws-ebs-csi-driver-node-sa-dockercfg-jvqtr\"" Jul 14 04:59:01.378409 ip-10-0-136-9 kubenswrapper[2584]: I0714 04:59:01.378335 2584 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-csi-drivers\"/\"kube-root-ca.crt\"" Jul 14 04:59:01.379830 ip-10-0-136-9 kubenswrapper[2584]: I0714 04:59:01.379813 2584 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"openshift-service-ca.crt\"" Jul 14 04:59:01.380082 ip-10-0-136-9 kubenswrapper[2584]: I0714 04:59:01.379958 2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-7prdk" Jul 14 04:59:01.380082 ip-10-0-136-9 kubenswrapper[2584]: E0714 04:59:01.380026 2584 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-7prdk" podUID="5d5fe629-46a1-4c48-bab2-32bbaf543c90" Jul 14 04:59:01.380375 ip-10-0-136-9 kubenswrapper[2584]: I0714 04:59:01.380358 2584 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"tuned-dockercfg-vhpl5\"" Jul 14 04:59:01.380457 ip-10-0-136-9 kubenswrapper[2584]: I0714 04:59:01.380358 2584 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"kube-root-ca.crt\"" Jul 14 04:59:01.381632 ip-10-0-136-9 kubenswrapper[2584]: I0714 04:59:01.381614 2584 certificate_manager.go:566] "Rotating certificates" logger="kubernetes.io/kubelet-serving" Jul 14 04:59:01.382142 ip-10-0-136-9 kubenswrapper[2584]: I0714 04:59:01.382122 2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-s7xsv" Jul 14 04:59:01.384296 ip-10-0-136-9 kubenswrapper[2584]: I0714 04:59:01.384273 2584 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"kube-root-ca.crt\"" Jul 14 04:59:01.384434 ip-10-0-136-9 kubenswrapper[2584]: I0714 04:59:01.384415 2584 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"cni-copy-resources\"" Jul 14 04:59:01.384696 ip-10-0-136-9 kubenswrapper[2584]: I0714 04:59:01.384549 2584 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"openshift-service-ca.crt\"" Jul 14 04:59:01.384696 ip-10-0-136-9 kubenswrapper[2584]: I0714 04:59:01.384584 2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ovn-kubernetes/ovnkube-node-8llzd" Jul 14 04:59:01.385227 ip-10-0-136-9 kubenswrapper[2584]: I0714 04:59:01.385206 2584 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"default-dockercfg-nm64x\"" Jul 14 04:59:01.385314 ip-10-0-136-9 kubenswrapper[2584]: I0714 04:59:01.385249 2584 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"multus-daemon-config\"" Jul 14 04:59:01.387053 ip-10-0-136-9 kubenswrapper[2584]: I0714 04:59:01.386999 2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/node-ca-l8z9r" Jul 14 04:59:01.387053 ip-10-0-136-9 kubenswrapper[2584]: I0714 04:59:01.387036 2584 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ovn-kubernetes\"/\"ovn-node-metrics-cert\"" Jul 14 04:59:01.387209 ip-10-0-136-9 kubenswrapper[2584]: I0714 04:59:01.387118 2584 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"openshift-service-ca.crt\"" Jul 14 04:59:01.387748 ip-10-0-136-9 kubenswrapper[2584]: I0714 04:59:01.387730 2584 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"env-overrides\"" Jul 14 04:59:01.388349 ip-10-0-136-9 kubenswrapper[2584]: I0714 04:59:01.388329 2584 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"kube-root-ca.crt\"" Jul 14 04:59:01.388427 ip-10-0-136-9 kubenswrapper[2584]: I0714 04:59:01.388369 2584 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"ovnkube-config\"" Jul 14 04:59:01.388507 ip-10-0-136-9 kubenswrapper[2584]: I0714 04:59:01.388451 2584 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"ovnkube-script-lib\"" Jul 14 04:59:01.388698 ip-10-0-136-9 kubenswrapper[2584]: I0714 04:59:01.388683 2584 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ovn-kubernetes\"/\"ovn-kubernetes-node-dockercfg-fsknn\"" Jul 14 04:59:01.389176 ip-10-0-136-9 kubenswrapper[2584]: I0714 04:59:01.389159 2584 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"image-registry-certificates\"" Jul 14 04:59:01.389378 ip-10-0-136-9 kubenswrapper[2584]: I0714 04:59:01.389364 2584 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"openshift-service-ca.crt\"" Jul 14 04:59:01.389446 ip-10-0-136-9 kubenswrapper[2584]: I0714 04:59:01.389428 2584 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"node-ca-dockercfg-x2cqf\"" Jul 14 04:59:01.391914 ip-10-0-136-9 kubenswrapper[2584]: I0714 04:59:01.390004 2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-fb7bm" Jul 14 04:59:01.391914 ip-10-0-136-9 kubenswrapper[2584]: I0714 04:59:01.390108 2584 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"kube-root-ca.crt\"" Jul 14 04:59:01.391914 ip-10-0-136-9 kubenswrapper[2584]: E0714 04:59:01.390101 2584 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-fb7bm" podUID="7078f217-1a51-4d64-a155-e5ca77500f07" Jul 14 04:59:01.392877 ip-10-0-136-9 kubenswrapper[2584]: I0714 04:59:01.392858 2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/konnectivity-agent-g257n" Jul 14 04:59:01.393610 ip-10-0-136-9 kubenswrapper[2584]: I0714 04:59:01.393571 2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/e71a2404-91a1-47b1-ac2d-b75abe645218-host-slash\") pod \"iptables-alerter-drsfg\" (UID: \"e71a2404-91a1-47b1-ac2d-b75abe645218\") " pod="openshift-network-operator/iptables-alerter-drsfg" Jul 14 04:59:01.393739 ip-10-0-136-9 kubenswrapper[2584]: I0714 04:59:01.393711 2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-swb8d\" (UniqueName: \"kubernetes.io/projected/e71a2404-91a1-47b1-ac2d-b75abe645218-kube-api-access-swb8d\") pod \"iptables-alerter-drsfg\" (UID: \"e71a2404-91a1-47b1-ac2d-b75abe645218\") " pod="openshift-network-operator/iptables-alerter-drsfg" Jul 14 04:59:01.393798 ip-10-0-136-9 kubenswrapper[2584]: I0714 04:59:01.393762 2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/63629ec8-b4b8-4711-a864-26c64b7627fa-socket-dir\") pod \"aws-ebs-csi-driver-node-5hkg2\" (UID: \"63629ec8-b4b8-4711-a864-26c64b7627fa\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-5hkg2" Jul 14 04:59:01.393858 ip-10-0-136-9 kubenswrapper[2584]: I0714 04:59:01.393824 2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/440466b6-da3b-44b5-89fc-75b7d63a8093-etc-sysctl-conf\") pod \"tuned-nhmwr\" (UID: \"440466b6-da3b-44b5-89fc-75b7d63a8093\") " pod="openshift-cluster-node-tuning-operator/tuned-nhmwr" Jul 14 04:59:01.393910 ip-10-0-136-9 kubenswrapper[2584]: I0714 04:59:01.393862 2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/562da33b-a2b1-4ac9-a122-8536e8542e41-system-cni-dir\") pod \"multus-s7xsv\" (UID: \"562da33b-a2b1-4ac9-a122-8536e8542e41\") " pod="openshift-multus/multus-s7xsv" Jul 14 04:59:01.393910 ip-10-0-136-9 kubenswrapper[2584]: I0714 04:59:01.393898 2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/562da33b-a2b1-4ac9-a122-8536e8542e41-cnibin\") pod \"multus-s7xsv\" (UID: \"562da33b-a2b1-4ac9-a122-8536e8542e41\") " pod="openshift-multus/multus-s7xsv" Jul 14 04:59:01.394034 ip-10-0-136-9 kubenswrapper[2584]: I0714 04:59:01.393924 2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/562da33b-a2b1-4ac9-a122-8536e8542e41-cni-binary-copy\") pod \"multus-s7xsv\" (UID: \"562da33b-a2b1-4ac9-a122-8536e8542e41\") " pod="openshift-multus/multus-s7xsv" Jul 14 04:59:01.394034 ip-10-0-136-9 kubenswrapper[2584]: I0714 04:59:01.393971 2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/63629ec8-b4b8-4711-a864-26c64b7627fa-kubelet-dir\") pod \"aws-ebs-csi-driver-node-5hkg2\" (UID: \"63629ec8-b4b8-4711-a864-26c64b7627fa\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-5hkg2" Jul 14 04:59:01.394034 ip-10-0-136-9 kubenswrapper[2584]: I0714 04:59:01.394000 2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/63629ec8-b4b8-4711-a864-26c64b7627fa-registration-dir\") pod \"aws-ebs-csi-driver-node-5hkg2\" (UID: \"63629ec8-b4b8-4711-a864-26c64b7627fa\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-5hkg2" Jul 14 04:59:01.394034 ip-10-0-136-9 kubenswrapper[2584]: I0714 04:59:01.394029 2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/440466b6-da3b-44b5-89fc-75b7d63a8093-etc-kubernetes\") pod \"tuned-nhmwr\" (UID: \"440466b6-da3b-44b5-89fc-75b7d63a8093\") " pod="openshift-cluster-node-tuning-operator/tuned-nhmwr" Jul 14 04:59:01.394227 ip-10-0-136-9 kubenswrapper[2584]: I0714 04:59:01.394055 2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/562da33b-a2b1-4ac9-a122-8536e8542e41-host-run-k8s-cni-cncf-io\") pod \"multus-s7xsv\" (UID: \"562da33b-a2b1-4ac9-a122-8536e8542e41\") " pod="openshift-multus/multus-s7xsv" Jul 14 04:59:01.394227 ip-10-0-136-9 kubenswrapper[2584]: I0714 04:59:01.394083 2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/562da33b-a2b1-4ac9-a122-8536e8542e41-host-var-lib-kubelet\") pod \"multus-s7xsv\" (UID: \"562da33b-a2b1-4ac9-a122-8536e8542e41\") " pod="openshift-multus/multus-s7xsv" Jul 14 04:59:01.394227 ip-10-0-136-9 kubenswrapper[2584]: I0714 04:59:01.394115 2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-wqbjq\" (UniqueName: \"kubernetes.io/projected/562da33b-a2b1-4ac9-a122-8536e8542e41-kube-api-access-wqbjq\") pod \"multus-s7xsv\" (UID: \"562da33b-a2b1-4ac9-a122-8536e8542e41\") " pod="openshift-multus/multus-s7xsv" Jul 14 04:59:01.394227 ip-10-0-136-9 kubenswrapper[2584]: I0714 04:59:01.394130 2584 reflector.go:439] "Caches populated" logger="kubernetes.io/kubelet-serving" type="*v1.CertificateSigningRequest" reflector="k8s.io/client-go/tools/watch/informerwatcher.go:162" Jul 14 04:59:01.394227 ip-10-0-136-9 kubenswrapper[2584]: I0714 04:59:01.394165 2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/e71a2404-91a1-47b1-ac2d-b75abe645218-iptables-alerter-script\") pod \"iptables-alerter-drsfg\" (UID: \"e71a2404-91a1-47b1-ac2d-b75abe645218\") " pod="openshift-network-operator/iptables-alerter-drsfg" Jul 14 04:59:01.394227 ip-10-0-136-9 kubenswrapper[2584]: I0714 04:59:01.394209 2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/440466b6-da3b-44b5-89fc-75b7d63a8093-etc-systemd\") pod \"tuned-nhmwr\" (UID: \"440466b6-da3b-44b5-89fc-75b7d63a8093\") " pod="openshift-cluster-node-tuning-operator/tuned-nhmwr" Jul 14 04:59:01.394513 ip-10-0-136-9 kubenswrapper[2584]: I0714 04:59:01.394249 2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/440466b6-da3b-44b5-89fc-75b7d63a8093-sys\") pod \"tuned-nhmwr\" (UID: \"440466b6-da3b-44b5-89fc-75b7d63a8093\") " pod="openshift-cluster-node-tuning-operator/tuned-nhmwr" Jul 14 04:59:01.394513 ip-10-0-136-9 kubenswrapper[2584]: I0714 04:59:01.394283 2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/562da33b-a2b1-4ac9-a122-8536e8542e41-multus-cni-dir\") pod \"multus-s7xsv\" (UID: \"562da33b-a2b1-4ac9-a122-8536e8542e41\") " pod="openshift-multus/multus-s7xsv" Jul 14 04:59:01.394513 ip-10-0-136-9 kubenswrapper[2584]: I0714 04:59:01.394329 2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/562da33b-a2b1-4ac9-a122-8536e8542e41-os-release\") pod \"multus-s7xsv\" (UID: \"562da33b-a2b1-4ac9-a122-8536e8542e41\") " pod="openshift-multus/multus-s7xsv" Jul 14 04:59:01.394513 ip-10-0-136-9 kubenswrapper[2584]: I0714 04:59:01.394459 2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/562da33b-a2b1-4ac9-a122-8536e8542e41-multus-socket-dir-parent\") pod \"multus-s7xsv\" (UID: \"562da33b-a2b1-4ac9-a122-8536e8542e41\") " pod="openshift-multus/multus-s7xsv" Jul 14 04:59:01.394693 ip-10-0-136-9 kubenswrapper[2584]: I0714 04:59:01.394511 2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/440466b6-da3b-44b5-89fc-75b7d63a8093-etc-modprobe-d\") pod \"tuned-nhmwr\" (UID: \"440466b6-da3b-44b5-89fc-75b7d63a8093\") " pod="openshift-cluster-node-tuning-operator/tuned-nhmwr" Jul 14 04:59:01.394693 ip-10-0-136-9 kubenswrapper[2584]: I0714 04:59:01.394545 2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/440466b6-da3b-44b5-89fc-75b7d63a8093-etc-sysctl-d\") pod \"tuned-nhmwr\" (UID: \"440466b6-da3b-44b5-89fc-75b7d63a8093\") " pod="openshift-cluster-node-tuning-operator/tuned-nhmwr" Jul 14 04:59:01.394693 ip-10-0-136-9 kubenswrapper[2584]: I0714 04:59:01.394604 2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/562da33b-a2b1-4ac9-a122-8536e8542e41-host-var-lib-cni-multus\") pod \"multus-s7xsv\" (UID: \"562da33b-a2b1-4ac9-a122-8536e8542e41\") " pod="openshift-multus/multus-s7xsv" Jul 14 04:59:01.394693 ip-10-0-136-9 kubenswrapper[2584]: I0714 04:59:01.394682 2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/562da33b-a2b1-4ac9-a122-8536e8542e41-hostroot\") pod \"multus-s7xsv\" (UID: \"562da33b-a2b1-4ac9-a122-8536e8542e41\") " pod="openshift-multus/multus-s7xsv" Jul 14 04:59:01.394954 ip-10-0-136-9 kubenswrapper[2584]: I0714 04:59:01.394863 2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/440466b6-da3b-44b5-89fc-75b7d63a8093-tmp\") pod \"tuned-nhmwr\" (UID: \"440466b6-da3b-44b5-89fc-75b7d63a8093\") " pod="openshift-cluster-node-tuning-operator/tuned-nhmwr" Jul 14 04:59:01.394954 ip-10-0-136-9 kubenswrapper[2584]: I0714 04:59:01.394915 2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/63629ec8-b4b8-4711-a864-26c64b7627fa-device-dir\") pod \"aws-ebs-csi-driver-node-5hkg2\" (UID: \"63629ec8-b4b8-4711-a864-26c64b7627fa\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-5hkg2" Jul 14 04:59:01.395080 ip-10-0-136-9 kubenswrapper[2584]: I0714 04:59:01.394985 2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/63629ec8-b4b8-4711-a864-26c64b7627fa-sys-fs\") pod \"aws-ebs-csi-driver-node-5hkg2\" (UID: \"63629ec8-b4b8-4711-a864-26c64b7627fa\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-5hkg2" Jul 14 04:59:01.395080 ip-10-0-136-9 kubenswrapper[2584]: I0714 04:59:01.395034 2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run\" (UniqueName: \"kubernetes.io/host-path/440466b6-da3b-44b5-89fc-75b7d63a8093-run\") pod \"tuned-nhmwr\" (UID: \"440466b6-da3b-44b5-89fc-75b7d63a8093\") " pod="openshift-cluster-node-tuning-operator/tuned-nhmwr" Jul 14 04:59:01.395176 ip-10-0-136-9 kubenswrapper[2584]: I0714 04:59:01.395140 2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/440466b6-da3b-44b5-89fc-75b7d63a8093-var-lib-kubelet\") pod \"tuned-nhmwr\" (UID: \"440466b6-da3b-44b5-89fc-75b7d63a8093\") " pod="openshift-cluster-node-tuning-operator/tuned-nhmwr" Jul 14 04:59:01.395224 ip-10-0-136-9 kubenswrapper[2584]: I0714 04:59:01.395180 2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-55wgs\" (UniqueName: \"kubernetes.io/projected/5d5fe629-46a1-4c48-bab2-32bbaf543c90-kube-api-access-55wgs\") pod \"network-metrics-daemon-7prdk\" (UID: \"5d5fe629-46a1-4c48-bab2-32bbaf543c90\") " pod="openshift-multus/network-metrics-daemon-7prdk" Jul 14 04:59:01.395273 ip-10-0-136-9 kubenswrapper[2584]: I0714 04:59:01.395232 2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/562da33b-a2b1-4ac9-a122-8536e8542e41-multus-conf-dir\") pod \"multus-s7xsv\" (UID: \"562da33b-a2b1-4ac9-a122-8536e8542e41\") " pod="openshift-multus/multus-s7xsv" Jul 14 04:59:01.395273 ip-10-0-136-9 kubenswrapper[2584]: I0714 04:59:01.395266 2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/562da33b-a2b1-4ac9-a122-8536e8542e41-etc-kubernetes\") pod \"multus-s7xsv\" (UID: \"562da33b-a2b1-4ac9-a122-8536e8542e41\") " pod="openshift-multus/multus-s7xsv" Jul 14 04:59:01.395370 ip-10-0-136-9 kubenswrapper[2584]: I0714 04:59:01.395294 2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/63629ec8-b4b8-4711-a864-26c64b7627fa-etc-selinux\") pod \"aws-ebs-csi-driver-node-5hkg2\" (UID: \"63629ec8-b4b8-4711-a864-26c64b7627fa\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-5hkg2" Jul 14 04:59:01.395370 ip-10-0-136-9 kubenswrapper[2584]: I0714 04:59:01.395327 2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-tsfdk\" (UniqueName: \"kubernetes.io/projected/63629ec8-b4b8-4711-a864-26c64b7627fa-kube-api-access-tsfdk\") pod \"aws-ebs-csi-driver-node-5hkg2\" (UID: \"63629ec8-b4b8-4711-a864-26c64b7627fa\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-5hkg2" Jul 14 04:59:01.395370 ip-10-0-136-9 kubenswrapper[2584]: I0714 04:59:01.395361 2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/440466b6-da3b-44b5-89fc-75b7d63a8093-etc-sysconfig\") pod \"tuned-nhmwr\" (UID: \"440466b6-da3b-44b5-89fc-75b7d63a8093\") " pod="openshift-cluster-node-tuning-operator/tuned-nhmwr" Jul 14 04:59:01.395498 ip-10-0-136-9 kubenswrapper[2584]: I0714 04:59:01.395407 2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/440466b6-da3b-44b5-89fc-75b7d63a8093-host\") pod \"tuned-nhmwr\" (UID: \"440466b6-da3b-44b5-89fc-75b7d63a8093\") " pod="openshift-cluster-node-tuning-operator/tuned-nhmwr" Jul 14 04:59:01.395498 ip-10-0-136-9 kubenswrapper[2584]: I0714 04:59:01.395465 2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/440466b6-da3b-44b5-89fc-75b7d63a8093-etc-tuned\") pod \"tuned-nhmwr\" (UID: \"440466b6-da3b-44b5-89fc-75b7d63a8093\") " pod="openshift-cluster-node-tuning-operator/tuned-nhmwr" Jul 14 04:59:01.395592 ip-10-0-136-9 kubenswrapper[2584]: I0714 04:59:01.395510 2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-p8shd\" (UniqueName: \"kubernetes.io/projected/440466b6-da3b-44b5-89fc-75b7d63a8093-kube-api-access-p8shd\") pod \"tuned-nhmwr\" (UID: \"440466b6-da3b-44b5-89fc-75b7d63a8093\") " pod="openshift-cluster-node-tuning-operator/tuned-nhmwr" Jul 14 04:59:01.395592 ip-10-0-136-9 kubenswrapper[2584]: I0714 04:59:01.395560 2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/562da33b-a2b1-4ac9-a122-8536e8542e41-host-run-netns\") pod \"multus-s7xsv\" (UID: \"562da33b-a2b1-4ac9-a122-8536e8542e41\") " pod="openshift-multus/multus-s7xsv" Jul 14 04:59:01.395681 ip-10-0-136-9 kubenswrapper[2584]: I0714 04:59:01.395624 2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/562da33b-a2b1-4ac9-a122-8536e8542e41-multus-daemon-config\") pod \"multus-s7xsv\" (UID: \"562da33b-a2b1-4ac9-a122-8536e8542e41\") " pod="openshift-multus/multus-s7xsv" Jul 14 04:59:01.395681 ip-10-0-136-9 kubenswrapper[2584]: I0714 04:59:01.395659 2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/440466b6-da3b-44b5-89fc-75b7d63a8093-lib-modules\") pod \"tuned-nhmwr\" (UID: \"440466b6-da3b-44b5-89fc-75b7d63a8093\") " pod="openshift-cluster-node-tuning-operator/tuned-nhmwr" Jul 14 04:59:01.395776 ip-10-0-136-9 kubenswrapper[2584]: I0714 04:59:01.395709 2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/5d5fe629-46a1-4c48-bab2-32bbaf543c90-metrics-certs\") pod \"network-metrics-daemon-7prdk\" (UID: \"5d5fe629-46a1-4c48-bab2-32bbaf543c90\") " pod="openshift-multus/network-metrics-daemon-7prdk" Jul 14 04:59:01.395776 ip-10-0-136-9 kubenswrapper[2584]: I0714 04:59:01.395747 2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/562da33b-a2b1-4ac9-a122-8536e8542e41-host-var-lib-cni-bin\") pod \"multus-s7xsv\" (UID: \"562da33b-a2b1-4ac9-a122-8536e8542e41\") " pod="openshift-multus/multus-s7xsv" Jul 14 04:59:01.395873 ip-10-0-136-9 kubenswrapper[2584]: I0714 04:59:01.395787 2584 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kube-system\"/\"konnectivity-ca-bundle\"" Jul 14 04:59:01.396262 ip-10-0-136-9 kubenswrapper[2584]: I0714 04:59:01.395973 2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-additional-cni-plugins-48p6x" Jul 14 04:59:01.396262 ip-10-0-136-9 kubenswrapper[2584]: I0714 04:59:01.395790 2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/562da33b-a2b1-4ac9-a122-8536e8542e41-host-run-multus-certs\") pod \"multus-s7xsv\" (UID: \"562da33b-a2b1-4ac9-a122-8536e8542e41\") " pod="openshift-multus/multus-s7xsv" Jul 14 04:59:01.396262 ip-10-0-136-9 kubenswrapper[2584]: I0714 04:59:01.396141 2584 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"default-dockercfg-fwthw\"" Jul 14 04:59:01.396262 ip-10-0-136-9 kubenswrapper[2584]: I0714 04:59:01.396174 2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-v7nvc\" (UniqueName: \"kubernetes.io/projected/c4902f44-8d7a-4f36-b6e7-0acf7bef5043-kube-api-access-v7nvc\") pod \"network-check-target-kr4q2\" (UID: \"c4902f44-8d7a-4f36-b6e7-0acf7bef5043\") " pod="openshift-network-diagnostics/network-check-target-kr4q2" Jul 14 04:59:01.396519 ip-10-0-136-9 kubenswrapper[2584]: I0714 04:59:01.396499 2584 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"konnectivity-agent\"" Jul 14 04:59:01.398308 ip-10-0-136-9 kubenswrapper[2584]: I0714 04:59:01.398288 2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/node-resolver-t5mq8" Jul 14 04:59:01.398756 ip-10-0-136-9 kubenswrapper[2584]: I0714 04:59:01.398738 2584 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"whereabouts-flatfile-config\"" Jul 14 04:59:01.398833 ip-10-0-136-9 kubenswrapper[2584]: I0714 04:59:01.398745 2584 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"multus-ancillary-tools-dockercfg-fmlnd\"" Jul 14 04:59:01.399117 ip-10-0-136-9 kubenswrapper[2584]: I0714 04:59:01.399098 2584 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"default-cni-sysctl-allowlist\"" Jul 14 04:59:01.400800 ip-10-0-136-9 kubenswrapper[2584]: I0714 04:59:01.400707 2584 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"openshift-service-ca.crt\"" Jul 14 04:59:01.400800 ip-10-0-136-9 kubenswrapper[2584]: I0714 04:59:01.400722 2584 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"node-resolver-dockercfg-tlwwg\"" Jul 14 04:59:01.401034 ip-10-0-136-9 kubenswrapper[2584]: I0714 04:59:01.401017 2584 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"kube-root-ca.crt\"" Jul 14 04:59:01.414629 ip-10-0-136-9 kubenswrapper[2584]: I0714 04:59:01.414609 2584 csr.go:274] "Certificate signing request is approved, waiting to be issued" logger="kubernetes.io/kubelet-serving" csr="csr-29c77" Jul 14 04:59:01.423857 ip-10-0-136-9 kubenswrapper[2584]: I0714 04:59:01.423838 2584 csr.go:270] "Certificate signing request is issued" logger="kubernetes.io/kubelet-serving" csr="csr-29c77" Jul 14 04:59:01.483412 ip-10-0-136-9 kubenswrapper[2584]: I0714 04:59:01.483395 2584 desired_state_of_world_populator.go:154] "Finished populating initial desired state of world" Jul 14 04:59:01.496782 ip-10-0-136-9 kubenswrapper[2584]: I0714 04:59:01.496761 2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/440466b6-da3b-44b5-89fc-75b7d63a8093-etc-modprobe-d\") pod \"tuned-nhmwr\" (UID: \"440466b6-da3b-44b5-89fc-75b7d63a8093\") " pod="openshift-cluster-node-tuning-operator/tuned-nhmwr" Jul 14 04:59:01.496872 ip-10-0-136-9 kubenswrapper[2584]: I0714 04:59:01.496796 2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/694d0f90-6317-495d-a312-b76a3513730e-ovnkube-script-lib\") pod \"ovnkube-node-8llzd\" (UID: \"694d0f90-6317-495d-a312-b76a3513730e\") " pod="openshift-ovn-kubernetes/ovnkube-node-8llzd" Jul 14 04:59:01.496872 ip-10-0-136-9 kubenswrapper[2584]: I0714 04:59:01.496864 2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/562da33b-a2b1-4ac9-a122-8536e8542e41-host-var-lib-cni-multus\") pod \"multus-s7xsv\" (UID: \"562da33b-a2b1-4ac9-a122-8536e8542e41\") " pod="openshift-multus/multus-s7xsv" Jul 14 04:59:01.497036 ip-10-0-136-9 kubenswrapper[2584]: I0714 04:59:01.496890 2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/822d074f-5b43-440a-8521-6cb28777ea8d-host\") pod \"node-ca-l8z9r\" (UID: \"822d074f-5b43-440a-8521-6cb28777ea8d\") " pod="openshift-image-registry/node-ca-l8z9r" Jul 14 04:59:01.497036 ip-10-0-136-9 kubenswrapper[2584]: I0714 04:59:01.496910 2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/562da33b-a2b1-4ac9-a122-8536e8542e41-host-var-lib-cni-multus\") pod \"multus-s7xsv\" (UID: \"562da33b-a2b1-4ac9-a122-8536e8542e41\") " pod="openshift-multus/multus-s7xsv" Jul 14 04:59:01.497036 ip-10-0-136-9 kubenswrapper[2584]: I0714 04:59:01.496915 2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-zkfjr\" (UniqueName: \"kubernetes.io/projected/694d0f90-6317-495d-a312-b76a3513730e-kube-api-access-zkfjr\") pod \"ovnkube-node-8llzd\" (UID: \"694d0f90-6317-495d-a312-b76a3513730e\") " pod="openshift-ovn-kubernetes/ovnkube-node-8llzd" Jul 14 04:59:01.497036 ip-10-0-136-9 kubenswrapper[2584]: I0714 04:59:01.496920 2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/440466b6-da3b-44b5-89fc-75b7d63a8093-etc-modprobe-d\") pod \"tuned-nhmwr\" (UID: \"440466b6-da3b-44b5-89fc-75b7d63a8093\") " pod="openshift-cluster-node-tuning-operator/tuned-nhmwr" Jul 14 04:59:01.497036 ip-10-0-136-9 kubenswrapper[2584]: I0714 04:59:01.496955 2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/63629ec8-b4b8-4711-a864-26c64b7627fa-sys-fs\") pod \"aws-ebs-csi-driver-node-5hkg2\" (UID: \"63629ec8-b4b8-4711-a864-26c64b7627fa\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-5hkg2" Jul 14 04:59:01.497036 ip-10-0-136-9 kubenswrapper[2584]: I0714 04:59:01.496993 2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/440466b6-da3b-44b5-89fc-75b7d63a8093-var-lib-kubelet\") pod \"tuned-nhmwr\" (UID: \"440466b6-da3b-44b5-89fc-75b7d63a8093\") " pod="openshift-cluster-node-tuning-operator/tuned-nhmwr" Jul 14 04:59:01.497036 ip-10-0-136-9 kubenswrapper[2584]: I0714 04:59:01.497001 2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/63629ec8-b4b8-4711-a864-26c64b7627fa-sys-fs\") pod \"aws-ebs-csi-driver-node-5hkg2\" (UID: \"63629ec8-b4b8-4711-a864-26c64b7627fa\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-5hkg2" Jul 14 04:59:01.497036 ip-10-0-136-9 kubenswrapper[2584]: I0714 04:59:01.497019 2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/694d0f90-6317-495d-a312-b76a3513730e-run-systemd\") pod \"ovnkube-node-8llzd\" (UID: \"694d0f90-6317-495d-a312-b76a3513730e\") " pod="openshift-ovn-kubernetes/ovnkube-node-8llzd" Jul 14 04:59:01.497317 ip-10-0-136-9 kubenswrapper[2584]: I0714 04:59:01.497046 2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/440466b6-da3b-44b5-89fc-75b7d63a8093-var-lib-kubelet\") pod \"tuned-nhmwr\" (UID: \"440466b6-da3b-44b5-89fc-75b7d63a8093\") " pod="openshift-cluster-node-tuning-operator/tuned-nhmwr" Jul 14 04:59:01.497317 ip-10-0-136-9 kubenswrapper[2584]: I0714 04:59:01.497045 2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/694d0f90-6317-495d-a312-b76a3513730e-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-8llzd\" (UID: \"694d0f90-6317-495d-a312-b76a3513730e\") " pod="openshift-ovn-kubernetes/ovnkube-node-8llzd" Jul 14 04:59:01.497317 ip-10-0-136-9 kubenswrapper[2584]: I0714 04:59:01.497089 2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/694d0f90-6317-495d-a312-b76a3513730e-ovnkube-config\") pod \"ovnkube-node-8llzd\" (UID: \"694d0f90-6317-495d-a312-b76a3513730e\") " pod="openshift-ovn-kubernetes/ovnkube-node-8llzd" Jul 14 04:59:01.497317 ip-10-0-136-9 kubenswrapper[2584]: I0714 04:59:01.497113 2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/440466b6-da3b-44b5-89fc-75b7d63a8093-etc-sysconfig\") pod \"tuned-nhmwr\" (UID: \"440466b6-da3b-44b5-89fc-75b7d63a8093\") " pod="openshift-cluster-node-tuning-operator/tuned-nhmwr" Jul 14 04:59:01.497317 ip-10-0-136-9 kubenswrapper[2584]: I0714 04:59:01.497136 2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-p8shd\" (UniqueName: \"kubernetes.io/projected/440466b6-da3b-44b5-89fc-75b7d63a8093-kube-api-access-p8shd\") pod \"tuned-nhmwr\" (UID: \"440466b6-da3b-44b5-89fc-75b7d63a8093\") " pod="openshift-cluster-node-tuning-operator/tuned-nhmwr" Jul 14 04:59:01.497317 ip-10-0-136-9 kubenswrapper[2584]: I0714 04:59:01.497191 2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-v7nvc\" (UniqueName: \"kubernetes.io/projected/c4902f44-8d7a-4f36-b6e7-0acf7bef5043-kube-api-access-v7nvc\") pod \"network-check-target-kr4q2\" (UID: \"c4902f44-8d7a-4f36-b6e7-0acf7bef5043\") " pod="openshift-network-diagnostics/network-check-target-kr4q2" Jul 14 04:59:01.497317 ip-10-0-136-9 kubenswrapper[2584]: I0714 04:59:01.497202 2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/440466b6-da3b-44b5-89fc-75b7d63a8093-etc-sysconfig\") pod \"tuned-nhmwr\" (UID: \"440466b6-da3b-44b5-89fc-75b7d63a8093\") " pod="openshift-cluster-node-tuning-operator/tuned-nhmwr" Jul 14 04:59:01.497317 ip-10-0-136-9 kubenswrapper[2584]: I0714 04:59:01.497219 2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/7078f217-1a51-4d64-a155-e5ca77500f07-dbus\") pod \"global-pull-secret-syncer-fb7bm\" (UID: \"7078f217-1a51-4d64-a155-e5ca77500f07\") " pod="kube-system/global-pull-secret-syncer-fb7bm" Jul 14 04:59:01.497317 ip-10-0-136-9 kubenswrapper[2584]: I0714 04:59:01.497244 2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/440466b6-da3b-44b5-89fc-75b7d63a8093-lib-modules\") pod \"tuned-nhmwr\" (UID: \"440466b6-da3b-44b5-89fc-75b7d63a8093\") " pod="openshift-cluster-node-tuning-operator/tuned-nhmwr" Jul 14 04:59:01.497317 ip-10-0-136-9 kubenswrapper[2584]: I0714 04:59:01.497276 2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/5d5fe629-46a1-4c48-bab2-32bbaf543c90-metrics-certs\") pod \"network-metrics-daemon-7prdk\" (UID: \"5d5fe629-46a1-4c48-bab2-32bbaf543c90\") " pod="openshift-multus/network-metrics-daemon-7prdk" Jul 14 04:59:01.497317 ip-10-0-136-9 kubenswrapper[2584]: I0714 04:59:01.497299 2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/562da33b-a2b1-4ac9-a122-8536e8542e41-host-var-lib-cni-bin\") pod \"multus-s7xsv\" (UID: \"562da33b-a2b1-4ac9-a122-8536e8542e41\") " pod="openshift-multus/multus-s7xsv" Jul 14 04:59:01.497777 ip-10-0-136-9 kubenswrapper[2584]: I0714 04:59:01.497321 2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/694d0f90-6317-495d-a312-b76a3513730e-host-kubelet\") pod \"ovnkube-node-8llzd\" (UID: \"694d0f90-6317-495d-a312-b76a3513730e\") " pod="openshift-ovn-kubernetes/ovnkube-node-8llzd" Jul 14 04:59:01.497777 ip-10-0-136-9 kubenswrapper[2584]: I0714 04:59:01.497343 2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/7078f217-1a51-4d64-a155-e5ca77500f07-kubelet-config\") pod \"global-pull-secret-syncer-fb7bm\" (UID: \"7078f217-1a51-4d64-a155-e5ca77500f07\") " pod="kube-system/global-pull-secret-syncer-fb7bm" Jul 14 04:59:01.497777 ip-10-0-136-9 kubenswrapper[2584]: I0714 04:59:01.497378 2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/63629ec8-b4b8-4711-a864-26c64b7627fa-socket-dir\") pod \"aws-ebs-csi-driver-node-5hkg2\" (UID: \"63629ec8-b4b8-4711-a864-26c64b7627fa\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-5hkg2" Jul 14 04:59:01.497777 ip-10-0-136-9 kubenswrapper[2584]: E0714 04:59:01.497400 2584 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jul 14 04:59:01.497777 ip-10-0-136-9 kubenswrapper[2584]: I0714 04:59:01.497427 2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/562da33b-a2b1-4ac9-a122-8536e8542e41-host-var-lib-cni-bin\") pod \"multus-s7xsv\" (UID: \"562da33b-a2b1-4ac9-a122-8536e8542e41\") " pod="openshift-multus/multus-s7xsv" Jul 14 04:59:01.497777 ip-10-0-136-9 kubenswrapper[2584]: E0714 04:59:01.497455 2584 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/5d5fe629-46a1-4c48-bab2-32bbaf543c90-metrics-certs podName:5d5fe629-46a1-4c48-bab2-32bbaf543c90 nodeName:}" failed. No retries permitted until 2026-07-14 04:59:01.997436984 +0000 UTC m=+2.958692684 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/5d5fe629-46a1-4c48-bab2-32bbaf543c90-metrics-certs") pod "network-metrics-daemon-7prdk" (UID: "5d5fe629-46a1-4c48-bab2-32bbaf543c90") : object "openshift-multus"/"metrics-daemon-secret" not registered Jul 14 04:59:01.497777 ip-10-0-136-9 kubenswrapper[2584]: I0714 04:59:01.497456 2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/562da33b-a2b1-4ac9-a122-8536e8542e41-system-cni-dir\") pod \"multus-s7xsv\" (UID: \"562da33b-a2b1-4ac9-a122-8536e8542e41\") " pod="openshift-multus/multus-s7xsv" Jul 14 04:59:01.497777 ip-10-0-136-9 kubenswrapper[2584]: I0714 04:59:01.497572 2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/440466b6-da3b-44b5-89fc-75b7d63a8093-lib-modules\") pod \"tuned-nhmwr\" (UID: \"440466b6-da3b-44b5-89fc-75b7d63a8093\") " pod="openshift-cluster-node-tuning-operator/tuned-nhmwr" Jul 14 04:59:01.497777 ip-10-0-136-9 kubenswrapper[2584]: I0714 04:59:01.497401 2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/562da33b-a2b1-4ac9-a122-8536e8542e41-system-cni-dir\") pod \"multus-s7xsv\" (UID: \"562da33b-a2b1-4ac9-a122-8536e8542e41\") " pod="openshift-multus/multus-s7xsv" Jul 14 04:59:01.497777 ip-10-0-136-9 kubenswrapper[2584]: I0714 04:59:01.497580 2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/63629ec8-b4b8-4711-a864-26c64b7627fa-socket-dir\") pod \"aws-ebs-csi-driver-node-5hkg2\" (UID: \"63629ec8-b4b8-4711-a864-26c64b7627fa\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-5hkg2" Jul 14 04:59:01.497777 ip-10-0-136-9 kubenswrapper[2584]: I0714 04:59:01.497623 2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/562da33b-a2b1-4ac9-a122-8536e8542e41-cnibin\") pod \"multus-s7xsv\" (UID: \"562da33b-a2b1-4ac9-a122-8536e8542e41\") " pod="openshift-multus/multus-s7xsv" Jul 14 04:59:01.497777 ip-10-0-136-9 kubenswrapper[2584]: I0714 04:59:01.497650 2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/562da33b-a2b1-4ac9-a122-8536e8542e41-host-run-k8s-cni-cncf-io\") pod \"multus-s7xsv\" (UID: \"562da33b-a2b1-4ac9-a122-8536e8542e41\") " pod="openshift-multus/multus-s7xsv" Jul 14 04:59:01.497777 ip-10-0-136-9 kubenswrapper[2584]: I0714 04:59:01.497674 2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/c0a9d445-38bf-437d-bfbe-b6f937f91140-cnibin\") pod \"multus-additional-cni-plugins-48p6x\" (UID: \"c0a9d445-38bf-437d-bfbe-b6f937f91140\") " pod="openshift-multus/multus-additional-cni-plugins-48p6x" Jul 14 04:59:01.497777 ip-10-0-136-9 kubenswrapper[2584]: I0714 04:59:01.497751 2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/562da33b-a2b1-4ac9-a122-8536e8542e41-host-run-k8s-cni-cncf-io\") pod \"multus-s7xsv\" (UID: \"562da33b-a2b1-4ac9-a122-8536e8542e41\") " pod="openshift-multus/multus-s7xsv" Jul 14 04:59:01.498434 ip-10-0-136-9 kubenswrapper[2584]: I0714 04:59:01.497789 2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/440466b6-da3b-44b5-89fc-75b7d63a8093-etc-kubernetes\") pod \"tuned-nhmwr\" (UID: \"440466b6-da3b-44b5-89fc-75b7d63a8093\") " pod="openshift-cluster-node-tuning-operator/tuned-nhmwr" Jul 14 04:59:01.498434 ip-10-0-136-9 kubenswrapper[2584]: I0714 04:59:01.497820 2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-6768v\" (UniqueName: \"kubernetes.io/projected/c0a9d445-38bf-437d-bfbe-b6f937f91140-kube-api-access-6768v\") pod \"multus-additional-cni-plugins-48p6x\" (UID: \"c0a9d445-38bf-437d-bfbe-b6f937f91140\") " pod="openshift-multus/multus-additional-cni-plugins-48p6x" Jul 14 04:59:01.498434 ip-10-0-136-9 kubenswrapper[2584]: I0714 04:59:01.497836 2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/562da33b-a2b1-4ac9-a122-8536e8542e41-cnibin\") pod \"multus-s7xsv\" (UID: \"562da33b-a2b1-4ac9-a122-8536e8542e41\") " pod="openshift-multus/multus-s7xsv" Jul 14 04:59:01.498434 ip-10-0-136-9 kubenswrapper[2584]: I0714 04:59:01.497845 2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/694d0f90-6317-495d-a312-b76a3513730e-systemd-units\") pod \"ovnkube-node-8llzd\" (UID: \"694d0f90-6317-495d-a312-b76a3513730e\") " pod="openshift-ovn-kubernetes/ovnkube-node-8llzd" Jul 14 04:59:01.498434 ip-10-0-136-9 kubenswrapper[2584]: I0714 04:59:01.497872 2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/e71a2404-91a1-47b1-ac2d-b75abe645218-iptables-alerter-script\") pod \"iptables-alerter-drsfg\" (UID: \"e71a2404-91a1-47b1-ac2d-b75abe645218\") " pod="openshift-network-operator/iptables-alerter-drsfg" Jul 14 04:59:01.498434 ip-10-0-136-9 kubenswrapper[2584]: I0714 04:59:01.497893 2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/440466b6-da3b-44b5-89fc-75b7d63a8093-etc-systemd\") pod \"tuned-nhmwr\" (UID: \"440466b6-da3b-44b5-89fc-75b7d63a8093\") " pod="openshift-cluster-node-tuning-operator/tuned-nhmwr" Jul 14 04:59:01.498434 ip-10-0-136-9 kubenswrapper[2584]: I0714 04:59:01.497900 2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/440466b6-da3b-44b5-89fc-75b7d63a8093-etc-kubernetes\") pod \"tuned-nhmwr\" (UID: \"440466b6-da3b-44b5-89fc-75b7d63a8093\") " pod="openshift-cluster-node-tuning-operator/tuned-nhmwr" Jul 14 04:59:01.498434 ip-10-0-136-9 kubenswrapper[2584]: I0714 04:59:01.497915 2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/822d074f-5b43-440a-8521-6cb28777ea8d-serviceca\") pod \"node-ca-l8z9r\" (UID: \"822d074f-5b43-440a-8521-6cb28777ea8d\") " pod="openshift-image-registry/node-ca-l8z9r" Jul 14 04:59:01.498434 ip-10-0-136-9 kubenswrapper[2584]: I0714 04:59:01.497957 2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-5n8fx\" (UniqueName: \"kubernetes.io/projected/822d074f-5b43-440a-8521-6cb28777ea8d-kube-api-access-5n8fx\") pod \"node-ca-l8z9r\" (UID: \"822d074f-5b43-440a-8521-6cb28777ea8d\") " pod="openshift-image-registry/node-ca-l8z9r" Jul 14 04:59:01.498434 ip-10-0-136-9 kubenswrapper[2584]: I0714 04:59:01.497985 2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/15609856-4056-487b-acdd-30276263b098-agent-certs\") pod \"konnectivity-agent-g257n\" (UID: \"15609856-4056-487b-acdd-30276263b098\") " pod="kube-system/konnectivity-agent-g257n" Jul 14 04:59:01.498434 ip-10-0-136-9 kubenswrapper[2584]: I0714 04:59:01.498015 2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/694d0f90-6317-495d-a312-b76a3513730e-log-socket\") pod \"ovnkube-node-8llzd\" (UID: \"694d0f90-6317-495d-a312-b76a3513730e\") " pod="openshift-ovn-kubernetes/ovnkube-node-8llzd" Jul 14 04:59:01.498434 ip-10-0-136-9 kubenswrapper[2584]: I0714 04:59:01.498039 2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/694d0f90-6317-495d-a312-b76a3513730e-host-run-ovn-kubernetes\") pod \"ovnkube-node-8llzd\" (UID: \"694d0f90-6317-495d-a312-b76a3513730e\") " pod="openshift-ovn-kubernetes/ovnkube-node-8llzd" Jul 14 04:59:01.498434 ip-10-0-136-9 kubenswrapper[2584]: I0714 04:59:01.498065 2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/694d0f90-6317-495d-a312-b76a3513730e-ovn-node-metrics-cert\") pod \"ovnkube-node-8llzd\" (UID: \"694d0f90-6317-495d-a312-b76a3513730e\") " pod="openshift-ovn-kubernetes/ovnkube-node-8llzd" Jul 14 04:59:01.498434 ip-10-0-136-9 kubenswrapper[2584]: I0714 04:59:01.498088 2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/440466b6-da3b-44b5-89fc-75b7d63a8093-etc-sysctl-d\") pod \"tuned-nhmwr\" (UID: \"440466b6-da3b-44b5-89fc-75b7d63a8093\") " pod="openshift-cluster-node-tuning-operator/tuned-nhmwr" Jul 14 04:59:01.498434 ip-10-0-136-9 kubenswrapper[2584]: I0714 04:59:01.498126 2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/694d0f90-6317-495d-a312-b76a3513730e-etc-openvswitch\") pod \"ovnkube-node-8llzd\" (UID: \"694d0f90-6317-495d-a312-b76a3513730e\") " pod="openshift-ovn-kubernetes/ovnkube-node-8llzd" Jul 14 04:59:01.498434 ip-10-0-136-9 kubenswrapper[2584]: I0714 04:59:01.498159 2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/694d0f90-6317-495d-a312-b76a3513730e-env-overrides\") pod \"ovnkube-node-8llzd\" (UID: \"694d0f90-6317-495d-a312-b76a3513730e\") " pod="openshift-ovn-kubernetes/ovnkube-node-8llzd" Jul 14 04:59:01.498434 ip-10-0-136-9 kubenswrapper[2584]: I0714 04:59:01.498185 2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/7078f217-1a51-4d64-a155-e5ca77500f07-original-pull-secret\") pod \"global-pull-secret-syncer-fb7bm\" (UID: \"7078f217-1a51-4d64-a155-e5ca77500f07\") " pod="kube-system/global-pull-secret-syncer-fb7bm" Jul 14 04:59:01.499201 ip-10-0-136-9 kubenswrapper[2584]: I0714 04:59:01.498211 2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/562da33b-a2b1-4ac9-a122-8536e8542e41-hostroot\") pod \"multus-s7xsv\" (UID: \"562da33b-a2b1-4ac9-a122-8536e8542e41\") " pod="openshift-multus/multus-s7xsv" Jul 14 04:59:01.499201 ip-10-0-136-9 kubenswrapper[2584]: I0714 04:59:01.498233 2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/8986aae0-cba2-493d-8d3e-ccf99b81c90c-tmp-dir\") pod \"node-resolver-t5mq8\" (UID: \"8986aae0-cba2-493d-8d3e-ccf99b81c90c\") " pod="openshift-dns/node-resolver-t5mq8" Jul 14 04:59:01.499201 ip-10-0-136-9 kubenswrapper[2584]: I0714 04:59:01.498257 2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/694d0f90-6317-495d-a312-b76a3513730e-node-log\") pod \"ovnkube-node-8llzd\" (UID: \"694d0f90-6317-495d-a312-b76a3513730e\") " pod="openshift-ovn-kubernetes/ovnkube-node-8llzd" Jul 14 04:59:01.499201 ip-10-0-136-9 kubenswrapper[2584]: I0714 04:59:01.498279 2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/440466b6-da3b-44b5-89fc-75b7d63a8093-tmp\") pod \"tuned-nhmwr\" (UID: \"440466b6-da3b-44b5-89fc-75b7d63a8093\") " pod="openshift-cluster-node-tuning-operator/tuned-nhmwr" Jul 14 04:59:01.499201 ip-10-0-136-9 kubenswrapper[2584]: I0714 04:59:01.498286 2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/440466b6-da3b-44b5-89fc-75b7d63a8093-etc-systemd\") pod \"tuned-nhmwr\" (UID: \"440466b6-da3b-44b5-89fc-75b7d63a8093\") " pod="openshift-cluster-node-tuning-operator/tuned-nhmwr" Jul 14 04:59:01.499201 ip-10-0-136-9 kubenswrapper[2584]: I0714 04:59:01.498301 2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/63629ec8-b4b8-4711-a864-26c64b7627fa-device-dir\") pod \"aws-ebs-csi-driver-node-5hkg2\" (UID: \"63629ec8-b4b8-4711-a864-26c64b7627fa\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-5hkg2" Jul 14 04:59:01.499201 ip-10-0-136-9 kubenswrapper[2584]: I0714 04:59:01.498320 2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/440466b6-da3b-44b5-89fc-75b7d63a8093-etc-sysctl-d\") pod \"tuned-nhmwr\" (UID: \"440466b6-da3b-44b5-89fc-75b7d63a8093\") " pod="openshift-cluster-node-tuning-operator/tuned-nhmwr" Jul 14 04:59:01.499201 ip-10-0-136-9 kubenswrapper[2584]: I0714 04:59:01.498328 2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run\" (UniqueName: \"kubernetes.io/host-path/440466b6-da3b-44b5-89fc-75b7d63a8093-run\") pod \"tuned-nhmwr\" (UID: \"440466b6-da3b-44b5-89fc-75b7d63a8093\") " pod="openshift-cluster-node-tuning-operator/tuned-nhmwr" Jul 14 04:59:01.499201 ip-10-0-136-9 kubenswrapper[2584]: I0714 04:59:01.498392 2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/63629ec8-b4b8-4711-a864-26c64b7627fa-device-dir\") pod \"aws-ebs-csi-driver-node-5hkg2\" (UID: \"63629ec8-b4b8-4711-a864-26c64b7627fa\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-5hkg2" Jul 14 04:59:01.499201 ip-10-0-136-9 kubenswrapper[2584]: I0714 04:59:01.498428 2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/e71a2404-91a1-47b1-ac2d-b75abe645218-iptables-alerter-script\") pod \"iptables-alerter-drsfg\" (UID: \"e71a2404-91a1-47b1-ac2d-b75abe645218\") " pod="openshift-network-operator/iptables-alerter-drsfg" Jul 14 04:59:01.499201 ip-10-0-136-9 kubenswrapper[2584]: I0714 04:59:01.498436 2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/562da33b-a2b1-4ac9-a122-8536e8542e41-hostroot\") pod \"multus-s7xsv\" (UID: \"562da33b-a2b1-4ac9-a122-8536e8542e41\") " pod="openshift-multus/multus-s7xsv" Jul 14 04:59:01.499201 ip-10-0-136-9 kubenswrapper[2584]: I0714 04:59:01.498518 2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"run\" (UniqueName: \"kubernetes.io/host-path/440466b6-da3b-44b5-89fc-75b7d63a8093-run\") pod \"tuned-nhmwr\" (UID: \"440466b6-da3b-44b5-89fc-75b7d63a8093\") " pod="openshift-cluster-node-tuning-operator/tuned-nhmwr" Jul 14 04:59:01.499201 ip-10-0-136-9 kubenswrapper[2584]: I0714 04:59:01.498533 2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-55wgs\" (UniqueName: \"kubernetes.io/projected/5d5fe629-46a1-4c48-bab2-32bbaf543c90-kube-api-access-55wgs\") pod \"network-metrics-daemon-7prdk\" (UID: \"5d5fe629-46a1-4c48-bab2-32bbaf543c90\") " pod="openshift-multus/network-metrics-daemon-7prdk" Jul 14 04:59:01.499201 ip-10-0-136-9 kubenswrapper[2584]: I0714 04:59:01.498565 2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/562da33b-a2b1-4ac9-a122-8536e8542e41-multus-conf-dir\") pod \"multus-s7xsv\" (UID: \"562da33b-a2b1-4ac9-a122-8536e8542e41\") " pod="openshift-multus/multus-s7xsv" Jul 14 04:59:01.499201 ip-10-0-136-9 kubenswrapper[2584]: I0714 04:59:01.498591 2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/562da33b-a2b1-4ac9-a122-8536e8542e41-etc-kubernetes\") pod \"multus-s7xsv\" (UID: \"562da33b-a2b1-4ac9-a122-8536e8542e41\") " pod="openshift-multus/multus-s7xsv" Jul 14 04:59:01.499201 ip-10-0-136-9 kubenswrapper[2584]: I0714 04:59:01.498619 2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/c0a9d445-38bf-437d-bfbe-b6f937f91140-cni-binary-copy\") pod \"multus-additional-cni-plugins-48p6x\" (UID: \"c0a9d445-38bf-437d-bfbe-b6f937f91140\") " pod="openshift-multus/multus-additional-cni-plugins-48p6x" Jul 14 04:59:01.499201 ip-10-0-136-9 kubenswrapper[2584]: I0714 04:59:01.498644 2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/8986aae0-cba2-493d-8d3e-ccf99b81c90c-hosts-file\") pod \"node-resolver-t5mq8\" (UID: \"8986aae0-cba2-493d-8d3e-ccf99b81c90c\") " pod="openshift-dns/node-resolver-t5mq8" Jul 14 04:59:01.499201 ip-10-0-136-9 kubenswrapper[2584]: I0714 04:59:01.498652 2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/562da33b-a2b1-4ac9-a122-8536e8542e41-multus-conf-dir\") pod \"multus-s7xsv\" (UID: \"562da33b-a2b1-4ac9-a122-8536e8542e41\") " pod="openshift-multus/multus-s7xsv" Jul 14 04:59:01.500002 ip-10-0-136-9 kubenswrapper[2584]: I0714 04:59:01.498637 2584 swap_util.go:74] "error creating dir to test if tmpfs noswap is enabled. Assuming not supported" mount path="" error="stat /var/lib/kubelet/plugins/kubernetes.io/empty-dir: no such file or directory" Jul 14 04:59:01.500002 ip-10-0-136-9 kubenswrapper[2584]: I0714 04:59:01.498668 2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/63629ec8-b4b8-4711-a864-26c64b7627fa-etc-selinux\") pod \"aws-ebs-csi-driver-node-5hkg2\" (UID: \"63629ec8-b4b8-4711-a864-26c64b7627fa\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-5hkg2" Jul 14 04:59:01.500002 ip-10-0-136-9 kubenswrapper[2584]: I0714 04:59:01.498788 2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/63629ec8-b4b8-4711-a864-26c64b7627fa-etc-selinux\") pod \"aws-ebs-csi-driver-node-5hkg2\" (UID: \"63629ec8-b4b8-4711-a864-26c64b7627fa\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-5hkg2" Jul 14 04:59:01.500002 ip-10-0-136-9 kubenswrapper[2584]: I0714 04:59:01.498801 2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/562da33b-a2b1-4ac9-a122-8536e8542e41-etc-kubernetes\") pod \"multus-s7xsv\" (UID: \"562da33b-a2b1-4ac9-a122-8536e8542e41\") " pod="openshift-multus/multus-s7xsv" Jul 14 04:59:01.500002 ip-10-0-136-9 kubenswrapper[2584]: I0714 04:59:01.498845 2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-tsfdk\" (UniqueName: \"kubernetes.io/projected/63629ec8-b4b8-4711-a864-26c64b7627fa-kube-api-access-tsfdk\") pod \"aws-ebs-csi-driver-node-5hkg2\" (UID: \"63629ec8-b4b8-4711-a864-26c64b7627fa\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-5hkg2" Jul 14 04:59:01.500002 ip-10-0-136-9 kubenswrapper[2584]: I0714 04:59:01.498882 2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/440466b6-da3b-44b5-89fc-75b7d63a8093-host\") pod \"tuned-nhmwr\" (UID: \"440466b6-da3b-44b5-89fc-75b7d63a8093\") " pod="openshift-cluster-node-tuning-operator/tuned-nhmwr" Jul 14 04:59:01.500002 ip-10-0-136-9 kubenswrapper[2584]: I0714 04:59:01.498997 2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/440466b6-da3b-44b5-89fc-75b7d63a8093-etc-tuned\") pod \"tuned-nhmwr\" (UID: \"440466b6-da3b-44b5-89fc-75b7d63a8093\") " pod="openshift-cluster-node-tuning-operator/tuned-nhmwr" Jul 14 04:59:01.500002 ip-10-0-136-9 kubenswrapper[2584]: I0714 04:59:01.499010 2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host\" (UniqueName: \"kubernetes.io/host-path/440466b6-da3b-44b5-89fc-75b7d63a8093-host\") pod \"tuned-nhmwr\" (UID: \"440466b6-da3b-44b5-89fc-75b7d63a8093\") " pod="openshift-cluster-node-tuning-operator/tuned-nhmwr" Jul 14 04:59:01.500002 ip-10-0-136-9 kubenswrapper[2584]: I0714 04:59:01.499047 2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/562da33b-a2b1-4ac9-a122-8536e8542e41-host-run-netns\") pod \"multus-s7xsv\" (UID: \"562da33b-a2b1-4ac9-a122-8536e8542e41\") " pod="openshift-multus/multus-s7xsv" Jul 14 04:59:01.500002 ip-10-0-136-9 kubenswrapper[2584]: I0714 04:59:01.499143 2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/562da33b-a2b1-4ac9-a122-8536e8542e41-multus-daemon-config\") pod \"multus-s7xsv\" (UID: \"562da33b-a2b1-4ac9-a122-8536e8542e41\") " pod="openshift-multus/multus-s7xsv" Jul 14 04:59:01.500002 ip-10-0-136-9 kubenswrapper[2584]: I0714 04:59:01.499150 2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/562da33b-a2b1-4ac9-a122-8536e8542e41-host-run-netns\") pod \"multus-s7xsv\" (UID: \"562da33b-a2b1-4ac9-a122-8536e8542e41\") " pod="openshift-multus/multus-s7xsv" Jul 14 04:59:01.500002 ip-10-0-136-9 kubenswrapper[2584]: I0714 04:59:01.499186 2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/562da33b-a2b1-4ac9-a122-8536e8542e41-host-run-multus-certs\") pod \"multus-s7xsv\" (UID: \"562da33b-a2b1-4ac9-a122-8536e8542e41\") " pod="openshift-multus/multus-s7xsv" Jul 14 04:59:01.500002 ip-10-0-136-9 kubenswrapper[2584]: I0714 04:59:01.499208 2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/c0a9d445-38bf-437d-bfbe-b6f937f91140-system-cni-dir\") pod \"multus-additional-cni-plugins-48p6x\" (UID: \"c0a9d445-38bf-437d-bfbe-b6f937f91140\") " pod="openshift-multus/multus-additional-cni-plugins-48p6x" Jul 14 04:59:01.500002 ip-10-0-136-9 kubenswrapper[2584]: I0714 04:59:01.499242 2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/15609856-4056-487b-acdd-30276263b098-konnectivity-ca\") pod \"konnectivity-agent-g257n\" (UID: \"15609856-4056-487b-acdd-30276263b098\") " pod="kube-system/konnectivity-agent-g257n" Jul 14 04:59:01.500002 ip-10-0-136-9 kubenswrapper[2584]: I0714 04:59:01.499255 2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/562da33b-a2b1-4ac9-a122-8536e8542e41-host-run-multus-certs\") pod \"multus-s7xsv\" (UID: \"562da33b-a2b1-4ac9-a122-8536e8542e41\") " pod="openshift-multus/multus-s7xsv" Jul 14 04:59:01.500002 ip-10-0-136-9 kubenswrapper[2584]: I0714 04:59:01.499271 2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/c0a9d445-38bf-437d-bfbe-b6f937f91140-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-48p6x\" (UID: \"c0a9d445-38bf-437d-bfbe-b6f937f91140\") " pod="openshift-multus/multus-additional-cni-plugins-48p6x" Jul 14 04:59:01.500002 ip-10-0-136-9 kubenswrapper[2584]: I0714 04:59:01.499295 2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/c0a9d445-38bf-437d-bfbe-b6f937f91140-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-48p6x\" (UID: \"c0a9d445-38bf-437d-bfbe-b6f937f91140\") " pod="openshift-multus/multus-additional-cni-plugins-48p6x" Jul 14 04:59:01.500596 ip-10-0-136-9 kubenswrapper[2584]: I0714 04:59:01.499315 2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/694d0f90-6317-495d-a312-b76a3513730e-host-cni-bin\") pod \"ovnkube-node-8llzd\" (UID: \"694d0f90-6317-495d-a312-b76a3513730e\") " pod="openshift-ovn-kubernetes/ovnkube-node-8llzd" Jul 14 04:59:01.500596 ip-10-0-136-9 kubenswrapper[2584]: I0714 04:59:01.499354 2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/e71a2404-91a1-47b1-ac2d-b75abe645218-host-slash\") pod \"iptables-alerter-drsfg\" (UID: \"e71a2404-91a1-47b1-ac2d-b75abe645218\") " pod="openshift-network-operator/iptables-alerter-drsfg" Jul 14 04:59:01.500596 ip-10-0-136-9 kubenswrapper[2584]: I0714 04:59:01.499373 2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-swb8d\" (UniqueName: \"kubernetes.io/projected/e71a2404-91a1-47b1-ac2d-b75abe645218-kube-api-access-swb8d\") pod \"iptables-alerter-drsfg\" (UID: \"e71a2404-91a1-47b1-ac2d-b75abe645218\") " pod="openshift-network-operator/iptables-alerter-drsfg" Jul 14 04:59:01.500596 ip-10-0-136-9 kubenswrapper[2584]: I0714 04:59:01.499410 2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/e71a2404-91a1-47b1-ac2d-b75abe645218-host-slash\") pod \"iptables-alerter-drsfg\" (UID: \"e71a2404-91a1-47b1-ac2d-b75abe645218\") " pod="openshift-network-operator/iptables-alerter-drsfg" Jul 14 04:59:01.500596 ip-10-0-136-9 kubenswrapper[2584]: I0714 04:59:01.499448 2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/440466b6-da3b-44b5-89fc-75b7d63a8093-etc-sysctl-conf\") pod \"tuned-nhmwr\" (UID: \"440466b6-da3b-44b5-89fc-75b7d63a8093\") " pod="openshift-cluster-node-tuning-operator/tuned-nhmwr" Jul 14 04:59:01.500596 ip-10-0-136-9 kubenswrapper[2584]: I0714 04:59:01.499471 2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/562da33b-a2b1-4ac9-a122-8536e8542e41-cni-binary-copy\") pod \"multus-s7xsv\" (UID: \"562da33b-a2b1-4ac9-a122-8536e8542e41\") " pod="openshift-multus/multus-s7xsv" Jul 14 04:59:01.500596 ip-10-0-136-9 kubenswrapper[2584]: I0714 04:59:01.499493 2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/562da33b-a2b1-4ac9-a122-8536e8542e41-host-var-lib-kubelet\") pod \"multus-s7xsv\" (UID: \"562da33b-a2b1-4ac9-a122-8536e8542e41\") " pod="openshift-multus/multus-s7xsv" Jul 14 04:59:01.500596 ip-10-0-136-9 kubenswrapper[2584]: I0714 04:59:01.499516 2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-wqbjq\" (UniqueName: \"kubernetes.io/projected/562da33b-a2b1-4ac9-a122-8536e8542e41-kube-api-access-wqbjq\") pod \"multus-s7xsv\" (UID: \"562da33b-a2b1-4ac9-a122-8536e8542e41\") " pod="openshift-multus/multus-s7xsv" Jul 14 04:59:01.500596 ip-10-0-136-9 kubenswrapper[2584]: I0714 04:59:01.499542 2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-7lgbt\" (UniqueName: \"kubernetes.io/projected/8986aae0-cba2-493d-8d3e-ccf99b81c90c-kube-api-access-7lgbt\") pod \"node-resolver-t5mq8\" (UID: \"8986aae0-cba2-493d-8d3e-ccf99b81c90c\") " pod="openshift-dns/node-resolver-t5mq8" Jul 14 04:59:01.500596 ip-10-0-136-9 kubenswrapper[2584]: I0714 04:59:01.499568 2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/694d0f90-6317-495d-a312-b76a3513730e-host-slash\") pod \"ovnkube-node-8llzd\" (UID: \"694d0f90-6317-495d-a312-b76a3513730e\") " pod="openshift-ovn-kubernetes/ovnkube-node-8llzd" Jul 14 04:59:01.500596 ip-10-0-136-9 kubenswrapper[2584]: I0714 04:59:01.499592 2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/63629ec8-b4b8-4711-a864-26c64b7627fa-kubelet-dir\") pod \"aws-ebs-csi-driver-node-5hkg2\" (UID: \"63629ec8-b4b8-4711-a864-26c64b7627fa\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-5hkg2" Jul 14 04:59:01.500596 ip-10-0-136-9 kubenswrapper[2584]: I0714 04:59:01.499619 2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/63629ec8-b4b8-4711-a864-26c64b7627fa-registration-dir\") pod \"aws-ebs-csi-driver-node-5hkg2\" (UID: \"63629ec8-b4b8-4711-a864-26c64b7627fa\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-5hkg2" Jul 14 04:59:01.500596 ip-10-0-136-9 kubenswrapper[2584]: I0714 04:59:01.499627 2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/562da33b-a2b1-4ac9-a122-8536e8542e41-host-var-lib-kubelet\") pod \"multus-s7xsv\" (UID: \"562da33b-a2b1-4ac9-a122-8536e8542e41\") " pod="openshift-multus/multus-s7xsv" Jul 14 04:59:01.500596 ip-10-0-136-9 kubenswrapper[2584]: I0714 04:59:01.499650 2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/c0a9d445-38bf-437d-bfbe-b6f937f91140-tuning-conf-dir\") pod \"multus-additional-cni-plugins-48p6x\" (UID: \"c0a9d445-38bf-437d-bfbe-b6f937f91140\") " pod="openshift-multus/multus-additional-cni-plugins-48p6x" Jul 14 04:59:01.500596 ip-10-0-136-9 kubenswrapper[2584]: I0714 04:59:01.499674 2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/694d0f90-6317-495d-a312-b76a3513730e-host-run-netns\") pod \"ovnkube-node-8llzd\" (UID: \"694d0f90-6317-495d-a312-b76a3513730e\") " pod="openshift-ovn-kubernetes/ovnkube-node-8llzd" Jul 14 04:59:01.500596 ip-10-0-136-9 kubenswrapper[2584]: I0714 04:59:01.499696 2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/694d0f90-6317-495d-a312-b76a3513730e-var-lib-openvswitch\") pod \"ovnkube-node-8llzd\" (UID: \"694d0f90-6317-495d-a312-b76a3513730e\") " pod="openshift-ovn-kubernetes/ovnkube-node-8llzd" Jul 14 04:59:01.500596 ip-10-0-136-9 kubenswrapper[2584]: I0714 04:59:01.499709 2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/562da33b-a2b1-4ac9-a122-8536e8542e41-multus-daemon-config\") pod \"multus-s7xsv\" (UID: \"562da33b-a2b1-4ac9-a122-8536e8542e41\") " pod="openshift-multus/multus-s7xsv" Jul 14 04:59:01.501133 ip-10-0-136-9 kubenswrapper[2584]: I0714 04:59:01.499719 2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/694d0f90-6317-495d-a312-b76a3513730e-run-openvswitch\") pod \"ovnkube-node-8llzd\" (UID: \"694d0f90-6317-495d-a312-b76a3513730e\") " pod="openshift-ovn-kubernetes/ovnkube-node-8llzd" Jul 14 04:59:01.501133 ip-10-0-136-9 kubenswrapper[2584]: I0714 04:59:01.499738 2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/440466b6-da3b-44b5-89fc-75b7d63a8093-etc-sysctl-conf\") pod \"tuned-nhmwr\" (UID: \"440466b6-da3b-44b5-89fc-75b7d63a8093\") " pod="openshift-cluster-node-tuning-operator/tuned-nhmwr" Jul 14 04:59:01.501133 ip-10-0-136-9 kubenswrapper[2584]: I0714 04:59:01.499743 2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/694d0f90-6317-495d-a312-b76a3513730e-run-ovn\") pod \"ovnkube-node-8llzd\" (UID: \"694d0f90-6317-495d-a312-b76a3513730e\") " pod="openshift-ovn-kubernetes/ovnkube-node-8llzd" Jul 14 04:59:01.501133 ip-10-0-136-9 kubenswrapper[2584]: I0714 04:59:01.499772 2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/440466b6-da3b-44b5-89fc-75b7d63a8093-sys\") pod \"tuned-nhmwr\" (UID: \"440466b6-da3b-44b5-89fc-75b7d63a8093\") " pod="openshift-cluster-node-tuning-operator/tuned-nhmwr" Jul 14 04:59:01.501133 ip-10-0-136-9 kubenswrapper[2584]: I0714 04:59:01.499796 2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/562da33b-a2b1-4ac9-a122-8536e8542e41-multus-cni-dir\") pod \"multus-s7xsv\" (UID: \"562da33b-a2b1-4ac9-a122-8536e8542e41\") " pod="openshift-multus/multus-s7xsv" Jul 14 04:59:01.501133 ip-10-0-136-9 kubenswrapper[2584]: I0714 04:59:01.499817 2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/562da33b-a2b1-4ac9-a122-8536e8542e41-os-release\") pod \"multus-s7xsv\" (UID: \"562da33b-a2b1-4ac9-a122-8536e8542e41\") " pod="openshift-multus/multus-s7xsv" Jul 14 04:59:01.501133 ip-10-0-136-9 kubenswrapper[2584]: I0714 04:59:01.499846 2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/562da33b-a2b1-4ac9-a122-8536e8542e41-multus-socket-dir-parent\") pod \"multus-s7xsv\" (UID: \"562da33b-a2b1-4ac9-a122-8536e8542e41\") " pod="openshift-multus/multus-s7xsv" Jul 14 04:59:01.501133 ip-10-0-136-9 kubenswrapper[2584]: I0714 04:59:01.499876 2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/c0a9d445-38bf-437d-bfbe-b6f937f91140-os-release\") pod \"multus-additional-cni-plugins-48p6x\" (UID: \"c0a9d445-38bf-437d-bfbe-b6f937f91140\") " pod="openshift-multus/multus-additional-cni-plugins-48p6x" Jul 14 04:59:01.501133 ip-10-0-136-9 kubenswrapper[2584]: I0714 04:59:01.499899 2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/694d0f90-6317-495d-a312-b76a3513730e-host-cni-netd\") pod \"ovnkube-node-8llzd\" (UID: \"694d0f90-6317-495d-a312-b76a3513730e\") " pod="openshift-ovn-kubernetes/ovnkube-node-8llzd" Jul 14 04:59:01.501133 ip-10-0-136-9 kubenswrapper[2584]: I0714 04:59:01.500013 2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/63629ec8-b4b8-4711-a864-26c64b7627fa-kubelet-dir\") pod \"aws-ebs-csi-driver-node-5hkg2\" (UID: \"63629ec8-b4b8-4711-a864-26c64b7627fa\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-5hkg2" Jul 14 04:59:01.501133 ip-10-0-136-9 kubenswrapper[2584]: I0714 04:59:01.500044 2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/63629ec8-b4b8-4711-a864-26c64b7627fa-registration-dir\") pod \"aws-ebs-csi-driver-node-5hkg2\" (UID: \"63629ec8-b4b8-4711-a864-26c64b7627fa\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-5hkg2" Jul 14 04:59:01.501133 ip-10-0-136-9 kubenswrapper[2584]: I0714 04:59:01.500099 2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/562da33b-a2b1-4ac9-a122-8536e8542e41-multus-socket-dir-parent\") pod \"multus-s7xsv\" (UID: \"562da33b-a2b1-4ac9-a122-8536e8542e41\") " pod="openshift-multus/multus-s7xsv" Jul 14 04:59:01.501133 ip-10-0-136-9 kubenswrapper[2584]: I0714 04:59:01.500120 2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/562da33b-a2b1-4ac9-a122-8536e8542e41-os-release\") pod \"multus-s7xsv\" (UID: \"562da33b-a2b1-4ac9-a122-8536e8542e41\") " pod="openshift-multus/multus-s7xsv" Jul 14 04:59:01.501133 ip-10-0-136-9 kubenswrapper[2584]: I0714 04:59:01.500121 2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/562da33b-a2b1-4ac9-a122-8536e8542e41-cni-binary-copy\") pod \"multus-s7xsv\" (UID: \"562da33b-a2b1-4ac9-a122-8536e8542e41\") " pod="openshift-multus/multus-s7xsv" Jul 14 04:59:01.501133 ip-10-0-136-9 kubenswrapper[2584]: I0714 04:59:01.500155 2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/440466b6-da3b-44b5-89fc-75b7d63a8093-sys\") pod \"tuned-nhmwr\" (UID: \"440466b6-da3b-44b5-89fc-75b7d63a8093\") " pod="openshift-cluster-node-tuning-operator/tuned-nhmwr" Jul 14 04:59:01.501133 ip-10-0-136-9 kubenswrapper[2584]: I0714 04:59:01.500234 2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/562da33b-a2b1-4ac9-a122-8536e8542e41-multus-cni-dir\") pod \"multus-s7xsv\" (UID: \"562da33b-a2b1-4ac9-a122-8536e8542e41\") " pod="openshift-multus/multus-s7xsv" Jul 14 04:59:01.502397 ip-10-0-136-9 kubenswrapper[2584]: I0714 04:59:01.502372 2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/440466b6-da3b-44b5-89fc-75b7d63a8093-etc-tuned\") pod \"tuned-nhmwr\" (UID: \"440466b6-da3b-44b5-89fc-75b7d63a8093\") " pod="openshift-cluster-node-tuning-operator/tuned-nhmwr" Jul 14 04:59:01.502469 ip-10-0-136-9 kubenswrapper[2584]: I0714 04:59:01.502398 2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/440466b6-da3b-44b5-89fc-75b7d63a8093-tmp\") pod \"tuned-nhmwr\" (UID: \"440466b6-da3b-44b5-89fc-75b7d63a8093\") " pod="openshift-cluster-node-tuning-operator/tuned-nhmwr" Jul 14 04:59:01.504176 ip-10-0-136-9 kubenswrapper[2584]: E0714 04:59:01.504152 2584 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jul 14 04:59:01.504259 ip-10-0-136-9 kubenswrapper[2584]: E0714 04:59:01.504194 2584 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jul 14 04:59:01.504259 ip-10-0-136-9 kubenswrapper[2584]: E0714 04:59:01.504207 2584 projected.go:196] Error preparing data for projected volume kube-api-access-v7nvc for pod openshift-network-diagnostics/network-check-target-kr4q2: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 14 04:59:01.504378 ip-10-0-136-9 kubenswrapper[2584]: E0714 04:59:01.504262 2584 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/c4902f44-8d7a-4f36-b6e7-0acf7bef5043-kube-api-access-v7nvc podName:c4902f44-8d7a-4f36-b6e7-0acf7bef5043 nodeName:}" failed. No retries permitted until 2026-07-14 04:59:02.004245909 +0000 UTC m=+2.965501606 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "kube-api-access-v7nvc" (UniqueName: "kubernetes.io/projected/c4902f44-8d7a-4f36-b6e7-0acf7bef5043-kube-api-access-v7nvc") pod "network-check-target-kr4q2" (UID: "c4902f44-8d7a-4f36-b6e7-0acf7bef5043") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 14 04:59:01.506402 ip-10-0-136-9 kubenswrapper[2584]: I0714 04:59:01.506377 2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-p8shd\" (UniqueName: \"kubernetes.io/projected/440466b6-da3b-44b5-89fc-75b7d63a8093-kube-api-access-p8shd\") pod \"tuned-nhmwr\" (UID: \"440466b6-da3b-44b5-89fc-75b7d63a8093\") " pod="openshift-cluster-node-tuning-operator/tuned-nhmwr" Jul 14 04:59:01.507887 ip-10-0-136-9 kubenswrapper[2584]: I0714 04:59:01.507860 2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-tsfdk\" (UniqueName: \"kubernetes.io/projected/63629ec8-b4b8-4711-a864-26c64b7627fa-kube-api-access-tsfdk\") pod \"aws-ebs-csi-driver-node-5hkg2\" (UID: \"63629ec8-b4b8-4711-a864-26c64b7627fa\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-5hkg2" Jul 14 04:59:01.508527 ip-10-0-136-9 kubenswrapper[2584]: I0714 04:59:01.508425 2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-55wgs\" (UniqueName: \"kubernetes.io/projected/5d5fe629-46a1-4c48-bab2-32bbaf543c90-kube-api-access-55wgs\") pod \"network-metrics-daemon-7prdk\" (UID: \"5d5fe629-46a1-4c48-bab2-32bbaf543c90\") " pod="openshift-multus/network-metrics-daemon-7prdk" Jul 14 04:59:01.509076 ip-10-0-136-9 kubenswrapper[2584]: I0714 04:59:01.509055 2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-wqbjq\" (UniqueName: \"kubernetes.io/projected/562da33b-a2b1-4ac9-a122-8536e8542e41-kube-api-access-wqbjq\") pod \"multus-s7xsv\" (UID: \"562da33b-a2b1-4ac9-a122-8536e8542e41\") " pod="openshift-multus/multus-s7xsv" Jul 14 04:59:01.509547 ip-10-0-136-9 kubenswrapper[2584]: I0714 04:59:01.509528 2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-swb8d\" (UniqueName: \"kubernetes.io/projected/e71a2404-91a1-47b1-ac2d-b75abe645218-kube-api-access-swb8d\") pod \"iptables-alerter-drsfg\" (UID: \"e71a2404-91a1-47b1-ac2d-b75abe645218\") " pod="openshift-network-operator/iptables-alerter-drsfg" Jul 14 04:59:01.531031 ip-10-0-136-9 kubenswrapper[2584]: I0714 04:59:01.530993 2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-136-9.ec2.internal" event={"ID":"93e20c48273b3fa7dacbffda6c635805","Type":"ContainerStarted","Data":"d8888b6ef4f45cb44107e162e357110f8f495fe946a5516e0531b30ce96be243"} Jul 14 04:59:01.532139 ip-10-0-136-9 kubenswrapper[2584]: I0714 04:59:01.532120 2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-136-9.ec2.internal" event={"ID":"1742fd7280f507bfa68896a24fcd9fea","Type":"ContainerStarted","Data":"4632cb18427e499b4344d5b12e1da0aa385fed8fb1987c82c4657ff97e3dfd65"} Jul 14 04:59:01.601157 ip-10-0-136-9 kubenswrapper[2584]: I0714 04:59:01.601129 2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/c0a9d445-38bf-437d-bfbe-b6f937f91140-cni-binary-copy\") pod \"multus-additional-cni-plugins-48p6x\" (UID: \"c0a9d445-38bf-437d-bfbe-b6f937f91140\") " pod="openshift-multus/multus-additional-cni-plugins-48p6x" Jul 14 04:59:01.601254 ip-10-0-136-9 kubenswrapper[2584]: I0714 04:59:01.601165 2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/8986aae0-cba2-493d-8d3e-ccf99b81c90c-hosts-file\") pod \"node-resolver-t5mq8\" (UID: \"8986aae0-cba2-493d-8d3e-ccf99b81c90c\") " pod="openshift-dns/node-resolver-t5mq8" Jul 14 04:59:01.601254 ip-10-0-136-9 kubenswrapper[2584]: I0714 04:59:01.601194 2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/c0a9d445-38bf-437d-bfbe-b6f937f91140-system-cni-dir\") pod \"multus-additional-cni-plugins-48p6x\" (UID: \"c0a9d445-38bf-437d-bfbe-b6f937f91140\") " pod="openshift-multus/multus-additional-cni-plugins-48p6x" Jul 14 04:59:01.601254 ip-10-0-136-9 kubenswrapper[2584]: I0714 04:59:01.601217 2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/15609856-4056-487b-acdd-30276263b098-konnectivity-ca\") pod \"konnectivity-agent-g257n\" (UID: \"15609856-4056-487b-acdd-30276263b098\") " pod="kube-system/konnectivity-agent-g257n" Jul 14 04:59:01.601254 ip-10-0-136-9 kubenswrapper[2584]: I0714 04:59:01.601242 2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/c0a9d445-38bf-437d-bfbe-b6f937f91140-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-48p6x\" (UID: \"c0a9d445-38bf-437d-bfbe-b6f937f91140\") " pod="openshift-multus/multus-additional-cni-plugins-48p6x" Jul 14 04:59:01.601462 ip-10-0-136-9 kubenswrapper[2584]: I0714 04:59:01.601257 2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/8986aae0-cba2-493d-8d3e-ccf99b81c90c-hosts-file\") pod \"node-resolver-t5mq8\" (UID: \"8986aae0-cba2-493d-8d3e-ccf99b81c90c\") " pod="openshift-dns/node-resolver-t5mq8" Jul 14 04:59:01.601462 ip-10-0-136-9 kubenswrapper[2584]: I0714 04:59:01.601267 2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/c0a9d445-38bf-437d-bfbe-b6f937f91140-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-48p6x\" (UID: \"c0a9d445-38bf-437d-bfbe-b6f937f91140\") " pod="openshift-multus/multus-additional-cni-plugins-48p6x" Jul 14 04:59:01.601462 ip-10-0-136-9 kubenswrapper[2584]: I0714 04:59:01.601301 2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/694d0f90-6317-495d-a312-b76a3513730e-host-cni-bin\") pod \"ovnkube-node-8llzd\" (UID: \"694d0f90-6317-495d-a312-b76a3513730e\") " pod="openshift-ovn-kubernetes/ovnkube-node-8llzd" Jul 14 04:59:01.601462 ip-10-0-136-9 kubenswrapper[2584]: I0714 04:59:01.601335 2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-7lgbt\" (UniqueName: \"kubernetes.io/projected/8986aae0-cba2-493d-8d3e-ccf99b81c90c-kube-api-access-7lgbt\") pod \"node-resolver-t5mq8\" (UID: \"8986aae0-cba2-493d-8d3e-ccf99b81c90c\") " pod="openshift-dns/node-resolver-t5mq8" Jul 14 04:59:01.601462 ip-10-0-136-9 kubenswrapper[2584]: I0714 04:59:01.601360 2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/694d0f90-6317-495d-a312-b76a3513730e-host-slash\") pod \"ovnkube-node-8llzd\" (UID: \"694d0f90-6317-495d-a312-b76a3513730e\") " pod="openshift-ovn-kubernetes/ovnkube-node-8llzd" Jul 14 04:59:01.601462 ip-10-0-136-9 kubenswrapper[2584]: I0714 04:59:01.601394 2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/694d0f90-6317-495d-a312-b76a3513730e-host-cni-bin\") pod \"ovnkube-node-8llzd\" (UID: \"694d0f90-6317-495d-a312-b76a3513730e\") " pod="openshift-ovn-kubernetes/ovnkube-node-8llzd" Jul 14 04:59:01.601462 ip-10-0-136-9 kubenswrapper[2584]: I0714 04:59:01.601411 2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/c0a9d445-38bf-437d-bfbe-b6f937f91140-tuning-conf-dir\") pod \"multus-additional-cni-plugins-48p6x\" (UID: \"c0a9d445-38bf-437d-bfbe-b6f937f91140\") " pod="openshift-multus/multus-additional-cni-plugins-48p6x" Jul 14 04:59:01.601462 ip-10-0-136-9 kubenswrapper[2584]: I0714 04:59:01.601436 2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/694d0f90-6317-495d-a312-b76a3513730e-host-run-netns\") pod \"ovnkube-node-8llzd\" (UID: \"694d0f90-6317-495d-a312-b76a3513730e\") " pod="openshift-ovn-kubernetes/ovnkube-node-8llzd" Jul 14 04:59:01.601462 ip-10-0-136-9 kubenswrapper[2584]: I0714 04:59:01.601445 2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/c0a9d445-38bf-437d-bfbe-b6f937f91140-system-cni-dir\") pod \"multus-additional-cni-plugins-48p6x\" (UID: \"c0a9d445-38bf-437d-bfbe-b6f937f91140\") " pod="openshift-multus/multus-additional-cni-plugins-48p6x" Jul 14 04:59:01.601462 ip-10-0-136-9 kubenswrapper[2584]: I0714 04:59:01.601462 2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/694d0f90-6317-495d-a312-b76a3513730e-var-lib-openvswitch\") pod \"ovnkube-node-8llzd\" (UID: \"694d0f90-6317-495d-a312-b76a3513730e\") " pod="openshift-ovn-kubernetes/ovnkube-node-8llzd" Jul 14 04:59:01.601884 ip-10-0-136-9 kubenswrapper[2584]: I0714 04:59:01.601485 2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/694d0f90-6317-495d-a312-b76a3513730e-run-openvswitch\") pod \"ovnkube-node-8llzd\" (UID: \"694d0f90-6317-495d-a312-b76a3513730e\") " pod="openshift-ovn-kubernetes/ovnkube-node-8llzd" Jul 14 04:59:01.601884 ip-10-0-136-9 kubenswrapper[2584]: I0714 04:59:01.601494 2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/694d0f90-6317-495d-a312-b76a3513730e-host-slash\") pod \"ovnkube-node-8llzd\" (UID: \"694d0f90-6317-495d-a312-b76a3513730e\") " pod="openshift-ovn-kubernetes/ovnkube-node-8llzd" Jul 14 04:59:01.601884 ip-10-0-136-9 kubenswrapper[2584]: I0714 04:59:01.601508 2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/694d0f90-6317-495d-a312-b76a3513730e-run-ovn\") pod \"ovnkube-node-8llzd\" (UID: \"694d0f90-6317-495d-a312-b76a3513730e\") " pod="openshift-ovn-kubernetes/ovnkube-node-8llzd" Jul 14 04:59:01.601884 ip-10-0-136-9 kubenswrapper[2584]: I0714 04:59:01.601534 2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/c0a9d445-38bf-437d-bfbe-b6f937f91140-os-release\") pod \"multus-additional-cni-plugins-48p6x\" (UID: \"c0a9d445-38bf-437d-bfbe-b6f937f91140\") " pod="openshift-multus/multus-additional-cni-plugins-48p6x" Jul 14 04:59:01.601884 ip-10-0-136-9 kubenswrapper[2584]: I0714 04:59:01.601555 2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/694d0f90-6317-495d-a312-b76a3513730e-host-cni-netd\") pod \"ovnkube-node-8llzd\" (UID: \"694d0f90-6317-495d-a312-b76a3513730e\") " pod="openshift-ovn-kubernetes/ovnkube-node-8llzd" Jul 14 04:59:01.601884 ip-10-0-136-9 kubenswrapper[2584]: I0714 04:59:01.601578 2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/694d0f90-6317-495d-a312-b76a3513730e-ovnkube-script-lib\") pod \"ovnkube-node-8llzd\" (UID: \"694d0f90-6317-495d-a312-b76a3513730e\") " pod="openshift-ovn-kubernetes/ovnkube-node-8llzd" Jul 14 04:59:01.601884 ip-10-0-136-9 kubenswrapper[2584]: I0714 04:59:01.601601 2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/822d074f-5b43-440a-8521-6cb28777ea8d-host\") pod \"node-ca-l8z9r\" (UID: \"822d074f-5b43-440a-8521-6cb28777ea8d\") " pod="openshift-image-registry/node-ca-l8z9r" Jul 14 04:59:01.601884 ip-10-0-136-9 kubenswrapper[2584]: I0714 04:59:01.601623 2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-zkfjr\" (UniqueName: \"kubernetes.io/projected/694d0f90-6317-495d-a312-b76a3513730e-kube-api-access-zkfjr\") pod \"ovnkube-node-8llzd\" (UID: \"694d0f90-6317-495d-a312-b76a3513730e\") " pod="openshift-ovn-kubernetes/ovnkube-node-8llzd" Jul 14 04:59:01.601884 ip-10-0-136-9 kubenswrapper[2584]: I0714 04:59:01.601647 2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/694d0f90-6317-495d-a312-b76a3513730e-run-systemd\") pod \"ovnkube-node-8llzd\" (UID: \"694d0f90-6317-495d-a312-b76a3513730e\") " pod="openshift-ovn-kubernetes/ovnkube-node-8llzd" Jul 14 04:59:01.601884 ip-10-0-136-9 kubenswrapper[2584]: I0714 04:59:01.601671 2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/694d0f90-6317-495d-a312-b76a3513730e-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-8llzd\" (UID: \"694d0f90-6317-495d-a312-b76a3513730e\") " pod="openshift-ovn-kubernetes/ovnkube-node-8llzd" Jul 14 04:59:01.601884 ip-10-0-136-9 kubenswrapper[2584]: I0714 04:59:01.601693 2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/694d0f90-6317-495d-a312-b76a3513730e-ovnkube-config\") pod \"ovnkube-node-8llzd\" (UID: \"694d0f90-6317-495d-a312-b76a3513730e\") " pod="openshift-ovn-kubernetes/ovnkube-node-8llzd" Jul 14 04:59:01.601884 ip-10-0-136-9 kubenswrapper[2584]: I0714 04:59:01.601731 2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/7078f217-1a51-4d64-a155-e5ca77500f07-dbus\") pod \"global-pull-secret-syncer-fb7bm\" (UID: \"7078f217-1a51-4d64-a155-e5ca77500f07\") " pod="kube-system/global-pull-secret-syncer-fb7bm" Jul 14 04:59:01.601884 ip-10-0-136-9 kubenswrapper[2584]: I0714 04:59:01.601745 2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/c0a9d445-38bf-437d-bfbe-b6f937f91140-os-release\") pod \"multus-additional-cni-plugins-48p6x\" (UID: \"c0a9d445-38bf-437d-bfbe-b6f937f91140\") " pod="openshift-multus/multus-additional-cni-plugins-48p6x" Jul 14 04:59:01.601884 ip-10-0-136-9 kubenswrapper[2584]: I0714 04:59:01.601766 2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/694d0f90-6317-495d-a312-b76a3513730e-host-kubelet\") pod \"ovnkube-node-8llzd\" (UID: \"694d0f90-6317-495d-a312-b76a3513730e\") " pod="openshift-ovn-kubernetes/ovnkube-node-8llzd" Jul 14 04:59:01.601884 ip-10-0-136-9 kubenswrapper[2584]: I0714 04:59:01.601790 2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/7078f217-1a51-4d64-a155-e5ca77500f07-kubelet-config\") pod \"global-pull-secret-syncer-fb7bm\" (UID: \"7078f217-1a51-4d64-a155-e5ca77500f07\") " pod="kube-system/global-pull-secret-syncer-fb7bm" Jul 14 04:59:01.601884 ip-10-0-136-9 kubenswrapper[2584]: I0714 04:59:01.601823 2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/c0a9d445-38bf-437d-bfbe-b6f937f91140-cnibin\") pod \"multus-additional-cni-plugins-48p6x\" (UID: \"c0a9d445-38bf-437d-bfbe-b6f937f91140\") " pod="openshift-multus/multus-additional-cni-plugins-48p6x" Jul 14 04:59:01.601884 ip-10-0-136-9 kubenswrapper[2584]: I0714 04:59:01.601849 2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-6768v\" (UniqueName: \"kubernetes.io/projected/c0a9d445-38bf-437d-bfbe-b6f937f91140-kube-api-access-6768v\") pod \"multus-additional-cni-plugins-48p6x\" (UID: \"c0a9d445-38bf-437d-bfbe-b6f937f91140\") " pod="openshift-multus/multus-additional-cni-plugins-48p6x" Jul 14 04:59:01.602667 ip-10-0-136-9 kubenswrapper[2584]: I0714 04:59:01.601877 2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/694d0f90-6317-495d-a312-b76a3513730e-systemd-units\") pod \"ovnkube-node-8llzd\" (UID: \"694d0f90-6317-495d-a312-b76a3513730e\") " pod="openshift-ovn-kubernetes/ovnkube-node-8llzd" Jul 14 04:59:01.602667 ip-10-0-136-9 kubenswrapper[2584]: I0714 04:59:01.601902 2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/822d074f-5b43-440a-8521-6cb28777ea8d-serviceca\") pod \"node-ca-l8z9r\" (UID: \"822d074f-5b43-440a-8521-6cb28777ea8d\") " pod="openshift-image-registry/node-ca-l8z9r" Jul 14 04:59:01.602667 ip-10-0-136-9 kubenswrapper[2584]: I0714 04:59:01.601908 2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/694d0f90-6317-495d-a312-b76a3513730e-host-run-netns\") pod \"ovnkube-node-8llzd\" (UID: \"694d0f90-6317-495d-a312-b76a3513730e\") " pod="openshift-ovn-kubernetes/ovnkube-node-8llzd" Jul 14 04:59:01.602667 ip-10-0-136-9 kubenswrapper[2584]: I0714 04:59:01.601924 2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-5n8fx\" (UniqueName: \"kubernetes.io/projected/822d074f-5b43-440a-8521-6cb28777ea8d-kube-api-access-5n8fx\") pod \"node-ca-l8z9r\" (UID: \"822d074f-5b43-440a-8521-6cb28777ea8d\") " pod="openshift-image-registry/node-ca-l8z9r" Jul 14 04:59:01.602667 ip-10-0-136-9 kubenswrapper[2584]: I0714 04:59:01.601962 2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/15609856-4056-487b-acdd-30276263b098-agent-certs\") pod \"konnectivity-agent-g257n\" (UID: \"15609856-4056-487b-acdd-30276263b098\") " pod="kube-system/konnectivity-agent-g257n" Jul 14 04:59:01.602667 ip-10-0-136-9 kubenswrapper[2584]: I0714 04:59:01.601970 2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/694d0f90-6317-495d-a312-b76a3513730e-var-lib-openvswitch\") pod \"ovnkube-node-8llzd\" (UID: \"694d0f90-6317-495d-a312-b76a3513730e\") " pod="openshift-ovn-kubernetes/ovnkube-node-8llzd" Jul 14 04:59:01.602667 ip-10-0-136-9 kubenswrapper[2584]: I0714 04:59:01.601985 2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/694d0f90-6317-495d-a312-b76a3513730e-log-socket\") pod \"ovnkube-node-8llzd\" (UID: \"694d0f90-6317-495d-a312-b76a3513730e\") " pod="openshift-ovn-kubernetes/ovnkube-node-8llzd" Jul 14 04:59:01.602667 ip-10-0-136-9 kubenswrapper[2584]: I0714 04:59:01.602012 2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/694d0f90-6317-495d-a312-b76a3513730e-host-run-ovn-kubernetes\") pod \"ovnkube-node-8llzd\" (UID: \"694d0f90-6317-495d-a312-b76a3513730e\") " pod="openshift-ovn-kubernetes/ovnkube-node-8llzd" Jul 14 04:59:01.602667 ip-10-0-136-9 kubenswrapper[2584]: I0714 04:59:01.602012 2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/694d0f90-6317-495d-a312-b76a3513730e-run-openvswitch\") pod \"ovnkube-node-8llzd\" (UID: \"694d0f90-6317-495d-a312-b76a3513730e\") " pod="openshift-ovn-kubernetes/ovnkube-node-8llzd" Jul 14 04:59:01.602667 ip-10-0-136-9 kubenswrapper[2584]: I0714 04:59:01.602047 2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/694d0f90-6317-495d-a312-b76a3513730e-run-ovn\") pod \"ovnkube-node-8llzd\" (UID: \"694d0f90-6317-495d-a312-b76a3513730e\") " pod="openshift-ovn-kubernetes/ovnkube-node-8llzd" Jul 14 04:59:01.602667 ip-10-0-136-9 kubenswrapper[2584]: I0714 04:59:01.602074 2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/694d0f90-6317-495d-a312-b76a3513730e-host-cni-netd\") pod \"ovnkube-node-8llzd\" (UID: \"694d0f90-6317-495d-a312-b76a3513730e\") " pod="openshift-ovn-kubernetes/ovnkube-node-8llzd" Jul 14 04:59:01.602667 ip-10-0-136-9 kubenswrapper[2584]: I0714 04:59:01.602100 2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/15609856-4056-487b-acdd-30276263b098-konnectivity-ca\") pod \"konnectivity-agent-g257n\" (UID: \"15609856-4056-487b-acdd-30276263b098\") " pod="kube-system/konnectivity-agent-g257n" Jul 14 04:59:01.602667 ip-10-0-136-9 kubenswrapper[2584]: I0714 04:59:01.602123 2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/7078f217-1a51-4d64-a155-e5ca77500f07-kubelet-config\") pod \"global-pull-secret-syncer-fb7bm\" (UID: \"7078f217-1a51-4d64-a155-e5ca77500f07\") " pod="kube-system/global-pull-secret-syncer-fb7bm" Jul 14 04:59:01.602667 ip-10-0-136-9 kubenswrapper[2584]: I0714 04:59:01.602230 2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/694d0f90-6317-495d-a312-b76a3513730e-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-8llzd\" (UID: \"694d0f90-6317-495d-a312-b76a3513730e\") " pod="openshift-ovn-kubernetes/ovnkube-node-8llzd" Jul 14 04:59:01.602667 ip-10-0-136-9 kubenswrapper[2584]: I0714 04:59:01.602280 2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host\" (UniqueName: \"kubernetes.io/host-path/822d074f-5b43-440a-8521-6cb28777ea8d-host\") pod \"node-ca-l8z9r\" (UID: \"822d074f-5b43-440a-8521-6cb28777ea8d\") " pod="openshift-image-registry/node-ca-l8z9r" Jul 14 04:59:01.602667 ip-10-0-136-9 kubenswrapper[2584]: I0714 04:59:01.602387 2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/c0a9d445-38bf-437d-bfbe-b6f937f91140-cni-binary-copy\") pod \"multus-additional-cni-plugins-48p6x\" (UID: \"c0a9d445-38bf-437d-bfbe-b6f937f91140\") " pod="openshift-multus/multus-additional-cni-plugins-48p6x" Jul 14 04:59:01.602667 ip-10-0-136-9 kubenswrapper[2584]: I0714 04:59:01.602461 2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/7078f217-1a51-4d64-a155-e5ca77500f07-dbus\") pod \"global-pull-secret-syncer-fb7bm\" (UID: \"7078f217-1a51-4d64-a155-e5ca77500f07\") " pod="kube-system/global-pull-secret-syncer-fb7bm" Jul 14 04:59:01.602667 ip-10-0-136-9 kubenswrapper[2584]: I0714 04:59:01.602501 2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/694d0f90-6317-495d-a312-b76a3513730e-run-systemd\") pod \"ovnkube-node-8llzd\" (UID: \"694d0f90-6317-495d-a312-b76a3513730e\") " pod="openshift-ovn-kubernetes/ovnkube-node-8llzd" Jul 14 04:59:01.603440 ip-10-0-136-9 kubenswrapper[2584]: I0714 04:59:01.602508 2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/822d074f-5b43-440a-8521-6cb28777ea8d-serviceca\") pod \"node-ca-l8z9r\" (UID: \"822d074f-5b43-440a-8521-6cb28777ea8d\") " pod="openshift-image-registry/node-ca-l8z9r" Jul 14 04:59:01.603440 ip-10-0-136-9 kubenswrapper[2584]: I0714 04:59:01.602558 2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/694d0f90-6317-495d-a312-b76a3513730e-log-socket\") pod \"ovnkube-node-8llzd\" (UID: \"694d0f90-6317-495d-a312-b76a3513730e\") " pod="openshift-ovn-kubernetes/ovnkube-node-8llzd" Jul 14 04:59:01.603440 ip-10-0-136-9 kubenswrapper[2584]: I0714 04:59:01.602571 2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/c0a9d445-38bf-437d-bfbe-b6f937f91140-cnibin\") pod \"multus-additional-cni-plugins-48p6x\" (UID: \"c0a9d445-38bf-437d-bfbe-b6f937f91140\") " pod="openshift-multus/multus-additional-cni-plugins-48p6x" Jul 14 04:59:01.603440 ip-10-0-136-9 kubenswrapper[2584]: I0714 04:59:01.602736 2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/694d0f90-6317-495d-a312-b76a3513730e-systemd-units\") pod \"ovnkube-node-8llzd\" (UID: \"694d0f90-6317-495d-a312-b76a3513730e\") " pod="openshift-ovn-kubernetes/ovnkube-node-8llzd" Jul 14 04:59:01.603440 ip-10-0-136-9 kubenswrapper[2584]: I0714 04:59:01.601876 2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/c0a9d445-38bf-437d-bfbe-b6f937f91140-tuning-conf-dir\") pod \"multus-additional-cni-plugins-48p6x\" (UID: \"c0a9d445-38bf-437d-bfbe-b6f937f91140\") " pod="openshift-multus/multus-additional-cni-plugins-48p6x" Jul 14 04:59:01.603440 ip-10-0-136-9 kubenswrapper[2584]: I0714 04:59:01.602829 2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/694d0f90-6317-495d-a312-b76a3513730e-host-run-ovn-kubernetes\") pod \"ovnkube-node-8llzd\" (UID: \"694d0f90-6317-495d-a312-b76a3513730e\") " pod="openshift-ovn-kubernetes/ovnkube-node-8llzd" Jul 14 04:59:01.603440 ip-10-0-136-9 kubenswrapper[2584]: I0714 04:59:01.602838 2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/694d0f90-6317-495d-a312-b76a3513730e-ovnkube-script-lib\") pod \"ovnkube-node-8llzd\" (UID: \"694d0f90-6317-495d-a312-b76a3513730e\") " pod="openshift-ovn-kubernetes/ovnkube-node-8llzd" Jul 14 04:59:01.603440 ip-10-0-136-9 kubenswrapper[2584]: I0714 04:59:01.602896 2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/694d0f90-6317-495d-a312-b76a3513730e-host-kubelet\") pod \"ovnkube-node-8llzd\" (UID: \"694d0f90-6317-495d-a312-b76a3513730e\") " pod="openshift-ovn-kubernetes/ovnkube-node-8llzd" Jul 14 04:59:01.603440 ip-10-0-136-9 kubenswrapper[2584]: I0714 04:59:01.602075 2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/694d0f90-6317-495d-a312-b76a3513730e-ovn-node-metrics-cert\") pod \"ovnkube-node-8llzd\" (UID: \"694d0f90-6317-495d-a312-b76a3513730e\") " pod="openshift-ovn-kubernetes/ovnkube-node-8llzd" Jul 14 04:59:01.603440 ip-10-0-136-9 kubenswrapper[2584]: I0714 04:59:01.602919 2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/694d0f90-6317-495d-a312-b76a3513730e-ovnkube-config\") pod \"ovnkube-node-8llzd\" (UID: \"694d0f90-6317-495d-a312-b76a3513730e\") " pod="openshift-ovn-kubernetes/ovnkube-node-8llzd" Jul 14 04:59:01.603440 ip-10-0-136-9 kubenswrapper[2584]: I0714 04:59:01.602954 2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/694d0f90-6317-495d-a312-b76a3513730e-etc-openvswitch\") pod \"ovnkube-node-8llzd\" (UID: \"694d0f90-6317-495d-a312-b76a3513730e\") " pod="openshift-ovn-kubernetes/ovnkube-node-8llzd" Jul 14 04:59:01.603440 ip-10-0-136-9 kubenswrapper[2584]: I0714 04:59:01.602978 2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/694d0f90-6317-495d-a312-b76a3513730e-env-overrides\") pod \"ovnkube-node-8llzd\" (UID: \"694d0f90-6317-495d-a312-b76a3513730e\") " pod="openshift-ovn-kubernetes/ovnkube-node-8llzd" Jul 14 04:59:01.603440 ip-10-0-136-9 kubenswrapper[2584]: I0714 04:59:01.602985 2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/694d0f90-6317-495d-a312-b76a3513730e-etc-openvswitch\") pod \"ovnkube-node-8llzd\" (UID: \"694d0f90-6317-495d-a312-b76a3513730e\") " pod="openshift-ovn-kubernetes/ovnkube-node-8llzd" Jul 14 04:59:01.603440 ip-10-0-136-9 kubenswrapper[2584]: I0714 04:59:01.603122 2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/7078f217-1a51-4d64-a155-e5ca77500f07-original-pull-secret\") pod \"global-pull-secret-syncer-fb7bm\" (UID: \"7078f217-1a51-4d64-a155-e5ca77500f07\") " pod="kube-system/global-pull-secret-syncer-fb7bm" Jul 14 04:59:01.603440 ip-10-0-136-9 kubenswrapper[2584]: I0714 04:59:01.603191 2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/8986aae0-cba2-493d-8d3e-ccf99b81c90c-tmp-dir\") pod \"node-resolver-t5mq8\" (UID: \"8986aae0-cba2-493d-8d3e-ccf99b81c90c\") " pod="openshift-dns/node-resolver-t5mq8" Jul 14 04:59:01.603440 ip-10-0-136-9 kubenswrapper[2584]: I0714 04:59:01.603216 2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/694d0f90-6317-495d-a312-b76a3513730e-node-log\") pod \"ovnkube-node-8llzd\" (UID: \"694d0f90-6317-495d-a312-b76a3513730e\") " pod="openshift-ovn-kubernetes/ovnkube-node-8llzd" Jul 14 04:59:01.603440 ip-10-0-136-9 kubenswrapper[2584]: I0714 04:59:01.603278 2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/694d0f90-6317-495d-a312-b76a3513730e-node-log\") pod \"ovnkube-node-8llzd\" (UID: \"694d0f90-6317-495d-a312-b76a3513730e\") " pod="openshift-ovn-kubernetes/ovnkube-node-8llzd" Jul 14 04:59:01.603440 ip-10-0-136-9 kubenswrapper[2584]: I0714 04:59:01.603322 2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/694d0f90-6317-495d-a312-b76a3513730e-env-overrides\") pod \"ovnkube-node-8llzd\" (UID: \"694d0f90-6317-495d-a312-b76a3513730e\") " pod="openshift-ovn-kubernetes/ovnkube-node-8llzd" Jul 14 04:59:01.604226 ip-10-0-136-9 kubenswrapper[2584]: E0714 04:59:01.603350 2584 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jul 14 04:59:01.604226 ip-10-0-136-9 kubenswrapper[2584]: I0714 04:59:01.603396 2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/c0a9d445-38bf-437d-bfbe-b6f937f91140-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-48p6x\" (UID: \"c0a9d445-38bf-437d-bfbe-b6f937f91140\") " pod="openshift-multus/multus-additional-cni-plugins-48p6x" Jul 14 04:59:01.604226 ip-10-0-136-9 kubenswrapper[2584]: E0714 04:59:01.603409 2584 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/7078f217-1a51-4d64-a155-e5ca77500f07-original-pull-secret podName:7078f217-1a51-4d64-a155-e5ca77500f07 nodeName:}" failed. No retries permitted until 2026-07-14 04:59:02.103393977 +0000 UTC m=+3.064649661 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/7078f217-1a51-4d64-a155-e5ca77500f07-original-pull-secret") pod "global-pull-secret-syncer-fb7bm" (UID: "7078f217-1a51-4d64-a155-e5ca77500f07") : object "kube-system"/"original-pull-secret" not registered Jul 14 04:59:01.604226 ip-10-0-136-9 kubenswrapper[2584]: I0714 04:59:01.603639 2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/8986aae0-cba2-493d-8d3e-ccf99b81c90c-tmp-dir\") pod \"node-resolver-t5mq8\" (UID: \"8986aae0-cba2-493d-8d3e-ccf99b81c90c\") " pod="openshift-dns/node-resolver-t5mq8" Jul 14 04:59:01.604226 ip-10-0-136-9 kubenswrapper[2584]: I0714 04:59:01.603832 2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/c0a9d445-38bf-437d-bfbe-b6f937f91140-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-48p6x\" (UID: \"c0a9d445-38bf-437d-bfbe-b6f937f91140\") " pod="openshift-multus/multus-additional-cni-plugins-48p6x" Jul 14 04:59:01.605208 ip-10-0-136-9 kubenswrapper[2584]: I0714 04:59:01.605186 2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/694d0f90-6317-495d-a312-b76a3513730e-ovn-node-metrics-cert\") pod \"ovnkube-node-8llzd\" (UID: \"694d0f90-6317-495d-a312-b76a3513730e\") " pod="openshift-ovn-kubernetes/ovnkube-node-8llzd" Jul 14 04:59:01.605623 ip-10-0-136-9 kubenswrapper[2584]: I0714 04:59:01.605582 2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/15609856-4056-487b-acdd-30276263b098-agent-certs\") pod \"konnectivity-agent-g257n\" (UID: \"15609856-4056-487b-acdd-30276263b098\") " pod="kube-system/konnectivity-agent-g257n" Jul 14 04:59:01.610512 ip-10-0-136-9 kubenswrapper[2584]: I0714 04:59:01.610438 2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-6768v\" (UniqueName: \"kubernetes.io/projected/c0a9d445-38bf-437d-bfbe-b6f937f91140-kube-api-access-6768v\") pod \"multus-additional-cni-plugins-48p6x\" (UID: \"c0a9d445-38bf-437d-bfbe-b6f937f91140\") " pod="openshift-multus/multus-additional-cni-plugins-48p6x" Jul 14 04:59:01.610512 ip-10-0-136-9 kubenswrapper[2584]: I0714 04:59:01.610441 2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-5n8fx\" (UniqueName: \"kubernetes.io/projected/822d074f-5b43-440a-8521-6cb28777ea8d-kube-api-access-5n8fx\") pod \"node-ca-l8z9r\" (UID: \"822d074f-5b43-440a-8521-6cb28777ea8d\") " pod="openshift-image-registry/node-ca-l8z9r" Jul 14 04:59:01.610856 ip-10-0-136-9 kubenswrapper[2584]: I0714 04:59:01.610835 2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-zkfjr\" (UniqueName: \"kubernetes.io/projected/694d0f90-6317-495d-a312-b76a3513730e-kube-api-access-zkfjr\") pod \"ovnkube-node-8llzd\" (UID: \"694d0f90-6317-495d-a312-b76a3513730e\") " pod="openshift-ovn-kubernetes/ovnkube-node-8llzd" Jul 14 04:59:01.611194 ip-10-0-136-9 kubenswrapper[2584]: I0714 04:59:01.611174 2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-7lgbt\" (UniqueName: \"kubernetes.io/projected/8986aae0-cba2-493d-8d3e-ccf99b81c90c-kube-api-access-7lgbt\") pod \"node-resolver-t5mq8\" (UID: \"8986aae0-cba2-493d-8d3e-ccf99b81c90c\") " pod="openshift-dns/node-resolver-t5mq8" Jul 14 04:59:01.686194 ip-10-0-136-9 kubenswrapper[2584]: I0714 04:59:01.686160 2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-operator/iptables-alerter-drsfg" Jul 14 04:59:01.695673 ip-10-0-136-9 kubenswrapper[2584]: I0714 04:59:01.695651 2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-5hkg2" Jul 14 04:59:01.697724 ip-10-0-136-9 kubenswrapper[2584]: W0714 04:59:01.697701 2584 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pode71a2404_91a1_47b1_ac2d_b75abe645218.slice/crio-766c191040a53a7f7f44c0920e0fffb5799bbadc52dcc117f48ee9f94fcfb11c WatchSource:0}: Error finding container 766c191040a53a7f7f44c0920e0fffb5799bbadc52dcc117f48ee9f94fcfb11c: Status 404 returned error can't find the container with id 766c191040a53a7f7f44c0920e0fffb5799bbadc52dcc117f48ee9f94fcfb11c Jul 14 04:59:01.705333 ip-10-0-136-9 kubenswrapper[2584]: W0714 04:59:01.705308 2584 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod63629ec8_b4b8_4711_a864_26c64b7627fa.slice/crio-d31923df9ab735488b02e75df5a848757d5288a15ada80720c8c7df6cc64a258 WatchSource:0}: Error finding container d31923df9ab735488b02e75df5a848757d5288a15ada80720c8c7df6cc64a258: Status 404 returned error can't find the container with id d31923df9ab735488b02e75df5a848757d5288a15ada80720c8c7df6cc64a258 Jul 14 04:59:01.706089 ip-10-0-136-9 kubenswrapper[2584]: I0714 04:59:01.706021 2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/node-ca-l8z9r" Jul 14 04:59:01.712289 ip-10-0-136-9 kubenswrapper[2584]: I0714 04:59:01.712260 2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-node-tuning-operator/tuned-nhmwr" Jul 14 04:59:01.714739 ip-10-0-136-9 kubenswrapper[2584]: W0714 04:59:01.714708 2584 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod822d074f_5b43_440a_8521_6cb28777ea8d.slice/crio-802a955bebbd04f709d364eade632ed045b5ec8f60a1b5d08dee08bbc8a600e5 WatchSource:0}: Error finding container 802a955bebbd04f709d364eade632ed045b5ec8f60a1b5d08dee08bbc8a600e5: Status 404 returned error can't find the container with id 802a955bebbd04f709d364eade632ed045b5ec8f60a1b5d08dee08bbc8a600e5 Jul 14 04:59:01.720239 ip-10-0-136-9 kubenswrapper[2584]: I0714 04:59:01.720221 2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-s7xsv" Jul 14 04:59:01.720852 ip-10-0-136-9 kubenswrapper[2584]: W0714 04:59:01.720825 2584 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod440466b6_da3b_44b5_89fc_75b7d63a8093.slice/crio-ad37bbfaeade023ecda6e0edf1669220c0f255e012eff7907e40f15007b51df7 WatchSource:0}: Error finding container ad37bbfaeade023ecda6e0edf1669220c0f255e012eff7907e40f15007b51df7: Status 404 returned error can't find the container with id ad37bbfaeade023ecda6e0edf1669220c0f255e012eff7907e40f15007b51df7 Jul 14 04:59:01.726270 ip-10-0-136-9 kubenswrapper[2584]: I0714 04:59:01.726252 2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ovn-kubernetes/ovnkube-node-8llzd" Jul 14 04:59:01.729747 ip-10-0-136-9 kubenswrapper[2584]: W0714 04:59:01.729724 2584 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod562da33b_a2b1_4ac9_a122_8536e8542e41.slice/crio-0589a28f6d2e057ba5b6f4caedc6fec49bcaa01ac6ed50eda9dc22e8ef15d155 WatchSource:0}: Error finding container 0589a28f6d2e057ba5b6f4caedc6fec49bcaa01ac6ed50eda9dc22e8ef15d155: Status 404 returned error can't find the container with id 0589a28f6d2e057ba5b6f4caedc6fec49bcaa01ac6ed50eda9dc22e8ef15d155 Jul 14 04:59:01.733509 ip-10-0-136-9 kubenswrapper[2584]: I0714 04:59:01.733492 2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/konnectivity-agent-g257n" Jul 14 04:59:01.734832 ip-10-0-136-9 kubenswrapper[2584]: W0714 04:59:01.734810 2584 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod694d0f90_6317_495d_a312_b76a3513730e.slice/crio-34c1dabb3c7409479fe13585e0ef897c194f22a76e6c5b9ada84223d5fc8410d WatchSource:0}: Error finding container 34c1dabb3c7409479fe13585e0ef897c194f22a76e6c5b9ada84223d5fc8410d: Status 404 returned error can't find the container with id 34c1dabb3c7409479fe13585e0ef897c194f22a76e6c5b9ada84223d5fc8410d Jul 14 04:59:01.740381 ip-10-0-136-9 kubenswrapper[2584]: I0714 04:59:01.740362 2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-additional-cni-plugins-48p6x" Jul 14 04:59:01.745127 ip-10-0-136-9 kubenswrapper[2584]: I0714 04:59:01.745103 2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/node-resolver-t5mq8" Jul 14 04:59:01.808618 ip-10-0-136-9 kubenswrapper[2584]: I0714 04:59:01.808586 2584 reflector.go:439] "Caches populated" type="*v1.RuntimeClass" reflector="k8s.io/client-go/informers/factory.go:160" Jul 14 04:59:02.004510 ip-10-0-136-9 kubenswrapper[2584]: I0714 04:59:02.004430 2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-v7nvc\" (UniqueName: \"kubernetes.io/projected/c4902f44-8d7a-4f36-b6e7-0acf7bef5043-kube-api-access-v7nvc\") pod \"network-check-target-kr4q2\" (UID: \"c4902f44-8d7a-4f36-b6e7-0acf7bef5043\") " pod="openshift-network-diagnostics/network-check-target-kr4q2" Jul 14 04:59:02.004510 ip-10-0-136-9 kubenswrapper[2584]: I0714 04:59:02.004461 2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/5d5fe629-46a1-4c48-bab2-32bbaf543c90-metrics-certs\") pod \"network-metrics-daemon-7prdk\" (UID: \"5d5fe629-46a1-4c48-bab2-32bbaf543c90\") " pod="openshift-multus/network-metrics-daemon-7prdk" Jul 14 04:59:02.004720 ip-10-0-136-9 kubenswrapper[2584]: E0714 04:59:02.004592 2584 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jul 14 04:59:02.004720 ip-10-0-136-9 kubenswrapper[2584]: E0714 04:59:02.004652 2584 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/5d5fe629-46a1-4c48-bab2-32bbaf543c90-metrics-certs podName:5d5fe629-46a1-4c48-bab2-32bbaf543c90 nodeName:}" failed. No retries permitted until 2026-07-14 04:59:03.004638584 +0000 UTC m=+3.965894266 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/5d5fe629-46a1-4c48-bab2-32bbaf543c90-metrics-certs") pod "network-metrics-daemon-7prdk" (UID: "5d5fe629-46a1-4c48-bab2-32bbaf543c90") : object "openshift-multus"/"metrics-daemon-secret" not registered Jul 14 04:59:02.004720 ip-10-0-136-9 kubenswrapper[2584]: E0714 04:59:02.004595 2584 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jul 14 04:59:02.004872 ip-10-0-136-9 kubenswrapper[2584]: E0714 04:59:02.004731 2584 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jul 14 04:59:02.004872 ip-10-0-136-9 kubenswrapper[2584]: E0714 04:59:02.004744 2584 projected.go:196] Error preparing data for projected volume kube-api-access-v7nvc for pod openshift-network-diagnostics/network-check-target-kr4q2: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 14 04:59:02.004872 ip-10-0-136-9 kubenswrapper[2584]: E0714 04:59:02.004793 2584 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/c4902f44-8d7a-4f36-b6e7-0acf7bef5043-kube-api-access-v7nvc podName:c4902f44-8d7a-4f36-b6e7-0acf7bef5043 nodeName:}" failed. No retries permitted until 2026-07-14 04:59:03.004777274 +0000 UTC m=+3.966032971 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "kube-api-access-v7nvc" (UniqueName: "kubernetes.io/projected/c4902f44-8d7a-4f36-b6e7-0acf7bef5043-kube-api-access-v7nvc") pod "network-check-target-kr4q2" (UID: "c4902f44-8d7a-4f36-b6e7-0acf7bef5043") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 14 04:59:02.105195 ip-10-0-136-9 kubenswrapper[2584]: I0714 04:59:02.105167 2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/7078f217-1a51-4d64-a155-e5ca77500f07-original-pull-secret\") pod \"global-pull-secret-syncer-fb7bm\" (UID: \"7078f217-1a51-4d64-a155-e5ca77500f07\") " pod="kube-system/global-pull-secret-syncer-fb7bm" Jul 14 04:59:02.105406 ip-10-0-136-9 kubenswrapper[2584]: E0714 04:59:02.105327 2584 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jul 14 04:59:02.105406 ip-10-0-136-9 kubenswrapper[2584]: E0714 04:59:02.105388 2584 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/7078f217-1a51-4d64-a155-e5ca77500f07-original-pull-secret podName:7078f217-1a51-4d64-a155-e5ca77500f07 nodeName:}" failed. No retries permitted until 2026-07-14 04:59:03.10537076 +0000 UTC m=+4.066626456 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/7078f217-1a51-4d64-a155-e5ca77500f07-original-pull-secret") pod "global-pull-secret-syncer-fb7bm" (UID: "7078f217-1a51-4d64-a155-e5ca77500f07") : object "kube-system"/"original-pull-secret" not registered Jul 14 04:59:02.426891 ip-10-0-136-9 kubenswrapper[2584]: I0714 04:59:02.426843 2584 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kubelet-serving" expiration="2028-07-13 04:54:01 +0000 UTC" deadline="2028-04-11 11:12:30.588503488 +0000 UTC" Jul 14 04:59:02.426891 ip-10-0-136-9 kubenswrapper[2584]: I0714 04:59:02.426889 2584 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kubelet-serving" sleep="15294h13m28.161620883s" Jul 14 04:59:02.524121 ip-10-0-136-9 kubenswrapper[2584]: I0714 04:59:02.523672 2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-kr4q2" Jul 14 04:59:02.524121 ip-10-0-136-9 kubenswrapper[2584]: E0714 04:59:02.523783 2584 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-kr4q2" podUID="c4902f44-8d7a-4f36-b6e7-0acf7bef5043" Jul 14 04:59:02.537364 ip-10-0-136-9 kubenswrapper[2584]: I0714 04:59:02.537283 2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-s7xsv" event={"ID":"562da33b-a2b1-4ac9-a122-8536e8542e41","Type":"ContainerStarted","Data":"0589a28f6d2e057ba5b6f4caedc6fec49bcaa01ac6ed50eda9dc22e8ef15d155"} Jul 14 04:59:02.539192 ip-10-0-136-9 kubenswrapper[2584]: I0714 04:59:02.539121 2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-node-tuning-operator/tuned-nhmwr" event={"ID":"440466b6-da3b-44b5-89fc-75b7d63a8093","Type":"ContainerStarted","Data":"ad37bbfaeade023ecda6e0edf1669220c0f255e012eff7907e40f15007b51df7"} Jul 14 04:59:02.544259 ip-10-0-136-9 kubenswrapper[2584]: I0714 04:59:02.544233 2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/node-ca-l8z9r" event={"ID":"822d074f-5b43-440a-8521-6cb28777ea8d","Type":"ContainerStarted","Data":"802a955bebbd04f709d364eade632ed045b5ec8f60a1b5d08dee08bbc8a600e5"} Jul 14 04:59:02.548500 ip-10-0-136-9 kubenswrapper[2584]: I0714 04:59:02.548432 2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-5hkg2" event={"ID":"63629ec8-b4b8-4711-a864-26c64b7627fa","Type":"ContainerStarted","Data":"d31923df9ab735488b02e75df5a848757d5288a15ada80720c8c7df6cc64a258"} Jul 14 04:59:02.550016 ip-10-0-136-9 kubenswrapper[2584]: I0714 04:59:02.549919 2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-operator/iptables-alerter-drsfg" event={"ID":"e71a2404-91a1-47b1-ac2d-b75abe645218","Type":"ContainerStarted","Data":"766c191040a53a7f7f44c0920e0fffb5799bbadc52dcc117f48ee9f94fcfb11c"} Jul 14 04:59:02.551732 ip-10-0-136-9 kubenswrapper[2584]: I0714 04:59:02.551683 2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-8llzd" event={"ID":"694d0f90-6317-495d-a312-b76a3513730e","Type":"ContainerStarted","Data":"34c1dabb3c7409479fe13585e0ef897c194f22a76e6c5b9ada84223d5fc8410d"} Jul 14 04:59:03.012150 ip-10-0-136-9 kubenswrapper[2584]: I0714 04:59:03.012097 2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-v7nvc\" (UniqueName: \"kubernetes.io/projected/c4902f44-8d7a-4f36-b6e7-0acf7bef5043-kube-api-access-v7nvc\") pod \"network-check-target-kr4q2\" (UID: \"c4902f44-8d7a-4f36-b6e7-0acf7bef5043\") " pod="openshift-network-diagnostics/network-check-target-kr4q2" Jul 14 04:59:03.012150 ip-10-0-136-9 kubenswrapper[2584]: I0714 04:59:03.012152 2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/5d5fe629-46a1-4c48-bab2-32bbaf543c90-metrics-certs\") pod \"network-metrics-daemon-7prdk\" (UID: \"5d5fe629-46a1-4c48-bab2-32bbaf543c90\") " pod="openshift-multus/network-metrics-daemon-7prdk" Jul 14 04:59:03.012456 ip-10-0-136-9 kubenswrapper[2584]: E0714 04:59:03.012289 2584 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jul 14 04:59:03.012456 ip-10-0-136-9 kubenswrapper[2584]: E0714 04:59:03.012347 2584 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/5d5fe629-46a1-4c48-bab2-32bbaf543c90-metrics-certs podName:5d5fe629-46a1-4c48-bab2-32bbaf543c90 nodeName:}" failed. No retries permitted until 2026-07-14 04:59:05.012328313 +0000 UTC m=+5.973584002 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/5d5fe629-46a1-4c48-bab2-32bbaf543c90-metrics-certs") pod "network-metrics-daemon-7prdk" (UID: "5d5fe629-46a1-4c48-bab2-32bbaf543c90") : object "openshift-multus"/"metrics-daemon-secret" not registered Jul 14 04:59:03.012796 ip-10-0-136-9 kubenswrapper[2584]: E0714 04:59:03.012778 2584 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jul 14 04:59:03.012871 ip-10-0-136-9 kubenswrapper[2584]: E0714 04:59:03.012802 2584 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jul 14 04:59:03.012871 ip-10-0-136-9 kubenswrapper[2584]: E0714 04:59:03.012815 2584 projected.go:196] Error preparing data for projected volume kube-api-access-v7nvc for pod openshift-network-diagnostics/network-check-target-kr4q2: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 14 04:59:03.012871 ip-10-0-136-9 kubenswrapper[2584]: E0714 04:59:03.012858 2584 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/c4902f44-8d7a-4f36-b6e7-0acf7bef5043-kube-api-access-v7nvc podName:c4902f44-8d7a-4f36-b6e7-0acf7bef5043 nodeName:}" failed. No retries permitted until 2026-07-14 04:59:05.012843138 +0000 UTC m=+5.974098825 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "kube-api-access-v7nvc" (UniqueName: "kubernetes.io/projected/c4902f44-8d7a-4f36-b6e7-0acf7bef5043-kube-api-access-v7nvc") pod "network-check-target-kr4q2" (UID: "c4902f44-8d7a-4f36-b6e7-0acf7bef5043") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 14 04:59:03.063773 ip-10-0-136-9 kubenswrapper[2584]: W0714 04:59:03.063740 2584 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod8986aae0_cba2_493d_8d3e_ccf99b81c90c.slice/crio-f3adad21900c5dc673438c265d7d949250f9e8985db07e5af84371684c59d9a1 WatchSource:0}: Error finding container f3adad21900c5dc673438c265d7d949250f9e8985db07e5af84371684c59d9a1: Status 404 returned error can't find the container with id f3adad21900c5dc673438c265d7d949250f9e8985db07e5af84371684c59d9a1 Jul 14 04:59:03.091616 ip-10-0-136-9 kubenswrapper[2584]: W0714 04:59:03.091573 2584 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod15609856_4056_487b_acdd_30276263b098.slice/crio-af3512381d7ce67ff1389838bdb24d2b3b7587a92eabbc5bbd2a72e963bdc241 WatchSource:0}: Error finding container af3512381d7ce67ff1389838bdb24d2b3b7587a92eabbc5bbd2a72e963bdc241: Status 404 returned error can't find the container with id af3512381d7ce67ff1389838bdb24d2b3b7587a92eabbc5bbd2a72e963bdc241 Jul 14 04:59:03.112470 ip-10-0-136-9 kubenswrapper[2584]: I0714 04:59:03.112418 2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/7078f217-1a51-4d64-a155-e5ca77500f07-original-pull-secret\") pod \"global-pull-secret-syncer-fb7bm\" (UID: \"7078f217-1a51-4d64-a155-e5ca77500f07\") " pod="kube-system/global-pull-secret-syncer-fb7bm" Jul 14 04:59:03.112575 ip-10-0-136-9 kubenswrapper[2584]: E0714 04:59:03.112559 2584 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jul 14 04:59:03.112647 ip-10-0-136-9 kubenswrapper[2584]: E0714 04:59:03.112624 2584 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/7078f217-1a51-4d64-a155-e5ca77500f07-original-pull-secret podName:7078f217-1a51-4d64-a155-e5ca77500f07 nodeName:}" failed. No retries permitted until 2026-07-14 04:59:05.11259931 +0000 UTC m=+6.073855011 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/7078f217-1a51-4d64-a155-e5ca77500f07-original-pull-secret") pod "global-pull-secret-syncer-fb7bm" (UID: "7078f217-1a51-4d64-a155-e5ca77500f07") : object "kube-system"/"original-pull-secret" not registered Jul 14 04:59:03.427773 ip-10-0-136-9 kubenswrapper[2584]: I0714 04:59:03.427507 2584 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kubelet-serving" expiration="2028-07-13 04:54:01 +0000 UTC" deadline="2028-03-16 11:20:29.386906422 +0000 UTC" Jul 14 04:59:03.427773 ip-10-0-136-9 kubenswrapper[2584]: I0714 04:59:03.427771 2584 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kubelet-serving" sleep="14670h21m25.959140552s" Jul 14 04:59:03.526058 ip-10-0-136-9 kubenswrapper[2584]: I0714 04:59:03.525893 2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-fb7bm" Jul 14 04:59:03.526723 ip-10-0-136-9 kubenswrapper[2584]: I0714 04:59:03.526284 2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-7prdk" Jul 14 04:59:03.526723 ip-10-0-136-9 kubenswrapper[2584]: E0714 04:59:03.526397 2584 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-7prdk" podUID="5d5fe629-46a1-4c48-bab2-32bbaf543c90" Jul 14 04:59:03.527055 ip-10-0-136-9 kubenswrapper[2584]: E0714 04:59:03.527013 2584 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-fb7bm" podUID="7078f217-1a51-4d64-a155-e5ca77500f07" Jul 14 04:59:03.566056 ip-10-0-136-9 kubenswrapper[2584]: I0714 04:59:03.565965 2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/konnectivity-agent-g257n" event={"ID":"15609856-4056-487b-acdd-30276263b098","Type":"ContainerStarted","Data":"af3512381d7ce67ff1389838bdb24d2b3b7587a92eabbc5bbd2a72e963bdc241"} Jul 14 04:59:03.591682 ip-10-0-136-9 kubenswrapper[2584]: I0714 04:59:03.590951 2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-136-9.ec2.internal" event={"ID":"93e20c48273b3fa7dacbffda6c635805","Type":"ContainerStarted","Data":"1856089449e28d3dfae659f06caff1ea318f8040346a541a934738c12a1e5991"} Jul 14 04:59:03.602042 ip-10-0-136-9 kubenswrapper[2584]: I0714 04:59:03.601981 2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/node-resolver-t5mq8" event={"ID":"8986aae0-cba2-493d-8d3e-ccf99b81c90c","Type":"ContainerStarted","Data":"f3adad21900c5dc673438c265d7d949250f9e8985db07e5af84371684c59d9a1"} Jul 14 04:59:03.605556 ip-10-0-136-9 kubenswrapper[2584]: I0714 04:59:03.605495 2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-48p6x" event={"ID":"c0a9d445-38bf-437d-bfbe-b6f937f91140","Type":"ContainerStarted","Data":"a9a0fbb532af7cef665ca017791ce860ab5f563e4e9172f75ba4f66134a2be3b"} Jul 14 04:59:03.608601 ip-10-0-136-9 kubenswrapper[2584]: I0714 04:59:03.608558 2584 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/kube-apiserver-proxy-ip-10-0-136-9.ec2.internal" podStartSLOduration=3.60854185 podStartE2EDuration="3.60854185s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-14 04:59:00 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-14 04:59:03.607663677 +0000 UTC m=+4.568919382" watchObservedRunningTime="2026-07-14 04:59:03.60854185 +0000 UTC m=+4.569797556" Jul 14 04:59:04.524477 ip-10-0-136-9 kubenswrapper[2584]: I0714 04:59:04.524448 2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-kr4q2" Jul 14 04:59:04.524958 ip-10-0-136-9 kubenswrapper[2584]: E0714 04:59:04.524567 2584 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-kr4q2" podUID="c4902f44-8d7a-4f36-b6e7-0acf7bef5043" Jul 14 04:59:04.620643 ip-10-0-136-9 kubenswrapper[2584]: I0714 04:59:04.620602 2584 generic.go:356] "Generic (PLEG): container finished" podID="1742fd7280f507bfa68896a24fcd9fea" containerID="2287509c27f34070f2f1bfeb4803cb73dcbed69c41bb57b2306f6a0d6e24cb24" exitCode=0 Jul 14 04:59:04.620807 ip-10-0-136-9 kubenswrapper[2584]: I0714 04:59:04.620711 2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-136-9.ec2.internal" event={"ID":"1742fd7280f507bfa68896a24fcd9fea","Type":"ContainerDied","Data":"2287509c27f34070f2f1bfeb4803cb73dcbed69c41bb57b2306f6a0d6e24cb24"} Jul 14 04:59:05.028757 ip-10-0-136-9 kubenswrapper[2584]: I0714 04:59:05.028721 2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-v7nvc\" (UniqueName: \"kubernetes.io/projected/c4902f44-8d7a-4f36-b6e7-0acf7bef5043-kube-api-access-v7nvc\") pod \"network-check-target-kr4q2\" (UID: \"c4902f44-8d7a-4f36-b6e7-0acf7bef5043\") " pod="openshift-network-diagnostics/network-check-target-kr4q2" Jul 14 04:59:05.028956 ip-10-0-136-9 kubenswrapper[2584]: I0714 04:59:05.028770 2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/5d5fe629-46a1-4c48-bab2-32bbaf543c90-metrics-certs\") pod \"network-metrics-daemon-7prdk\" (UID: \"5d5fe629-46a1-4c48-bab2-32bbaf543c90\") " pod="openshift-multus/network-metrics-daemon-7prdk" Jul 14 04:59:05.029054 ip-10-0-136-9 kubenswrapper[2584]: E0714 04:59:05.029034 2584 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jul 14 04:59:05.029126 ip-10-0-136-9 kubenswrapper[2584]: E0714 04:59:05.029056 2584 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jul 14 04:59:05.029126 ip-10-0-136-9 kubenswrapper[2584]: E0714 04:59:05.029069 2584 projected.go:196] Error preparing data for projected volume kube-api-access-v7nvc for pod openshift-network-diagnostics/network-check-target-kr4q2: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 14 04:59:05.029126 ip-10-0-136-9 kubenswrapper[2584]: E0714 04:59:05.029119 2584 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/c4902f44-8d7a-4f36-b6e7-0acf7bef5043-kube-api-access-v7nvc podName:c4902f44-8d7a-4f36-b6e7-0acf7bef5043 nodeName:}" failed. No retries permitted until 2026-07-14 04:59:09.029101839 +0000 UTC m=+9.990357524 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "kube-api-access-v7nvc" (UniqueName: "kubernetes.io/projected/c4902f44-8d7a-4f36-b6e7-0acf7bef5043-kube-api-access-v7nvc") pod "network-check-target-kr4q2" (UID: "c4902f44-8d7a-4f36-b6e7-0acf7bef5043") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 14 04:59:05.029521 ip-10-0-136-9 kubenswrapper[2584]: E0714 04:59:05.029432 2584 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jul 14 04:59:05.029521 ip-10-0-136-9 kubenswrapper[2584]: E0714 04:59:05.029488 2584 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/5d5fe629-46a1-4c48-bab2-32bbaf543c90-metrics-certs podName:5d5fe629-46a1-4c48-bab2-32bbaf543c90 nodeName:}" failed. No retries permitted until 2026-07-14 04:59:09.029471185 +0000 UTC m=+9.990726870 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/5d5fe629-46a1-4c48-bab2-32bbaf543c90-metrics-certs") pod "network-metrics-daemon-7prdk" (UID: "5d5fe629-46a1-4c48-bab2-32bbaf543c90") : object "openshift-multus"/"metrics-daemon-secret" not registered Jul 14 04:59:05.130386 ip-10-0-136-9 kubenswrapper[2584]: I0714 04:59:05.129857 2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/7078f217-1a51-4d64-a155-e5ca77500f07-original-pull-secret\") pod \"global-pull-secret-syncer-fb7bm\" (UID: \"7078f217-1a51-4d64-a155-e5ca77500f07\") " pod="kube-system/global-pull-secret-syncer-fb7bm" Jul 14 04:59:05.130386 ip-10-0-136-9 kubenswrapper[2584]: E0714 04:59:05.130013 2584 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jul 14 04:59:05.130386 ip-10-0-136-9 kubenswrapper[2584]: E0714 04:59:05.130068 2584 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/7078f217-1a51-4d64-a155-e5ca77500f07-original-pull-secret podName:7078f217-1a51-4d64-a155-e5ca77500f07 nodeName:}" failed. No retries permitted until 2026-07-14 04:59:09.130051481 +0000 UTC m=+10.091307170 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/7078f217-1a51-4d64-a155-e5ca77500f07-original-pull-secret") pod "global-pull-secret-syncer-fb7bm" (UID: "7078f217-1a51-4d64-a155-e5ca77500f07") : object "kube-system"/"original-pull-secret" not registered Jul 14 04:59:05.525385 ip-10-0-136-9 kubenswrapper[2584]: I0714 04:59:05.524554 2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-7prdk" Jul 14 04:59:05.525385 ip-10-0-136-9 kubenswrapper[2584]: E0714 04:59:05.524704 2584 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-7prdk" podUID="5d5fe629-46a1-4c48-bab2-32bbaf543c90" Jul 14 04:59:05.525385 ip-10-0-136-9 kubenswrapper[2584]: I0714 04:59:05.524774 2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-fb7bm" Jul 14 04:59:05.525385 ip-10-0-136-9 kubenswrapper[2584]: E0714 04:59:05.524874 2584 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-fb7bm" podUID="7078f217-1a51-4d64-a155-e5ca77500f07" Jul 14 04:59:06.524360 ip-10-0-136-9 kubenswrapper[2584]: I0714 04:59:06.524328 2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-kr4q2" Jul 14 04:59:06.524545 ip-10-0-136-9 kubenswrapper[2584]: E0714 04:59:06.524521 2584 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-kr4q2" podUID="c4902f44-8d7a-4f36-b6e7-0acf7bef5043" Jul 14 04:59:07.523787 ip-10-0-136-9 kubenswrapper[2584]: I0714 04:59:07.523722 2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-7prdk" Jul 14 04:59:07.524230 ip-10-0-136-9 kubenswrapper[2584]: E0714 04:59:07.523859 2584 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-7prdk" podUID="5d5fe629-46a1-4c48-bab2-32bbaf543c90" Jul 14 04:59:07.524230 ip-10-0-136-9 kubenswrapper[2584]: I0714 04:59:07.524071 2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-fb7bm" Jul 14 04:59:07.524230 ip-10-0-136-9 kubenswrapper[2584]: E0714 04:59:07.524173 2584 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-fb7bm" podUID="7078f217-1a51-4d64-a155-e5ca77500f07" Jul 14 04:59:08.524430 ip-10-0-136-9 kubenswrapper[2584]: I0714 04:59:08.524398 2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-kr4q2" Jul 14 04:59:08.524852 ip-10-0-136-9 kubenswrapper[2584]: E0714 04:59:08.524517 2584 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-kr4q2" podUID="c4902f44-8d7a-4f36-b6e7-0acf7bef5043" Jul 14 04:59:09.063281 ip-10-0-136-9 kubenswrapper[2584]: I0714 04:59:09.063245 2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-v7nvc\" (UniqueName: \"kubernetes.io/projected/c4902f44-8d7a-4f36-b6e7-0acf7bef5043-kube-api-access-v7nvc\") pod \"network-check-target-kr4q2\" (UID: \"c4902f44-8d7a-4f36-b6e7-0acf7bef5043\") " pod="openshift-network-diagnostics/network-check-target-kr4q2" Jul 14 04:59:09.063445 ip-10-0-136-9 kubenswrapper[2584]: I0714 04:59:09.063299 2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/5d5fe629-46a1-4c48-bab2-32bbaf543c90-metrics-certs\") pod \"network-metrics-daemon-7prdk\" (UID: \"5d5fe629-46a1-4c48-bab2-32bbaf543c90\") " pod="openshift-multus/network-metrics-daemon-7prdk" Jul 14 04:59:09.063445 ip-10-0-136-9 kubenswrapper[2584]: E0714 04:59:09.063410 2584 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jul 14 04:59:09.063445 ip-10-0-136-9 kubenswrapper[2584]: E0714 04:59:09.063434 2584 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jul 14 04:59:09.063602 ip-10-0-136-9 kubenswrapper[2584]: E0714 04:59:09.063463 2584 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jul 14 04:59:09.063602 ip-10-0-136-9 kubenswrapper[2584]: E0714 04:59:09.063467 2584 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/5d5fe629-46a1-4c48-bab2-32bbaf543c90-metrics-certs podName:5d5fe629-46a1-4c48-bab2-32bbaf543c90 nodeName:}" failed. No retries permitted until 2026-07-14 04:59:17.063447915 +0000 UTC m=+18.024703599 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/5d5fe629-46a1-4c48-bab2-32bbaf543c90-metrics-certs") pod "network-metrics-daemon-7prdk" (UID: "5d5fe629-46a1-4c48-bab2-32bbaf543c90") : object "openshift-multus"/"metrics-daemon-secret" not registered Jul 14 04:59:09.063602 ip-10-0-136-9 kubenswrapper[2584]: E0714 04:59:09.063475 2584 projected.go:196] Error preparing data for projected volume kube-api-access-v7nvc for pod openshift-network-diagnostics/network-check-target-kr4q2: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 14 04:59:09.063602 ip-10-0-136-9 kubenswrapper[2584]: E0714 04:59:09.063524 2584 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/c4902f44-8d7a-4f36-b6e7-0acf7bef5043-kube-api-access-v7nvc podName:c4902f44-8d7a-4f36-b6e7-0acf7bef5043 nodeName:}" failed. No retries permitted until 2026-07-14 04:59:17.063509134 +0000 UTC m=+18.024764819 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "kube-api-access-v7nvc" (UniqueName: "kubernetes.io/projected/c4902f44-8d7a-4f36-b6e7-0acf7bef5043-kube-api-access-v7nvc") pod "network-check-target-kr4q2" (UID: "c4902f44-8d7a-4f36-b6e7-0acf7bef5043") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 14 04:59:09.164707 ip-10-0-136-9 kubenswrapper[2584]: I0714 04:59:09.164638 2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/7078f217-1a51-4d64-a155-e5ca77500f07-original-pull-secret\") pod \"global-pull-secret-syncer-fb7bm\" (UID: \"7078f217-1a51-4d64-a155-e5ca77500f07\") " pod="kube-system/global-pull-secret-syncer-fb7bm" Jul 14 04:59:09.164865 ip-10-0-136-9 kubenswrapper[2584]: E0714 04:59:09.164802 2584 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jul 14 04:59:09.164918 ip-10-0-136-9 kubenswrapper[2584]: E0714 04:59:09.164877 2584 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/7078f217-1a51-4d64-a155-e5ca77500f07-original-pull-secret podName:7078f217-1a51-4d64-a155-e5ca77500f07 nodeName:}" failed. No retries permitted until 2026-07-14 04:59:17.164857607 +0000 UTC m=+18.126113303 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/7078f217-1a51-4d64-a155-e5ca77500f07-original-pull-secret") pod "global-pull-secret-syncer-fb7bm" (UID: "7078f217-1a51-4d64-a155-e5ca77500f07") : object "kube-system"/"original-pull-secret" not registered Jul 14 04:59:09.526517 ip-10-0-136-9 kubenswrapper[2584]: I0714 04:59:09.526048 2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-7prdk" Jul 14 04:59:09.526517 ip-10-0-136-9 kubenswrapper[2584]: E0714 04:59:09.526167 2584 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-7prdk" podUID="5d5fe629-46a1-4c48-bab2-32bbaf543c90" Jul 14 04:59:09.526517 ip-10-0-136-9 kubenswrapper[2584]: I0714 04:59:09.526189 2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-fb7bm" Jul 14 04:59:09.526517 ip-10-0-136-9 kubenswrapper[2584]: E0714 04:59:09.526290 2584 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-fb7bm" podUID="7078f217-1a51-4d64-a155-e5ca77500f07" Jul 14 04:59:10.524594 ip-10-0-136-9 kubenswrapper[2584]: I0714 04:59:10.524422 2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-kr4q2" Jul 14 04:59:10.524594 ip-10-0-136-9 kubenswrapper[2584]: E0714 04:59:10.524536 2584 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-kr4q2" podUID="c4902f44-8d7a-4f36-b6e7-0acf7bef5043" Jul 14 04:59:11.524238 ip-10-0-136-9 kubenswrapper[2584]: I0714 04:59:11.524201 2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-7prdk" Jul 14 04:59:11.524694 ip-10-0-136-9 kubenswrapper[2584]: I0714 04:59:11.524202 2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-fb7bm" Jul 14 04:59:11.524694 ip-10-0-136-9 kubenswrapper[2584]: E0714 04:59:11.524346 2584 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-7prdk" podUID="5d5fe629-46a1-4c48-bab2-32bbaf543c90" Jul 14 04:59:11.524694 ip-10-0-136-9 kubenswrapper[2584]: E0714 04:59:11.524416 2584 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-fb7bm" podUID="7078f217-1a51-4d64-a155-e5ca77500f07" Jul 14 04:59:12.523838 ip-10-0-136-9 kubenswrapper[2584]: I0714 04:59:12.523806 2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-kr4q2" Jul 14 04:59:12.524017 ip-10-0-136-9 kubenswrapper[2584]: E0714 04:59:12.523911 2584 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-kr4q2" podUID="c4902f44-8d7a-4f36-b6e7-0acf7bef5043" Jul 14 04:59:13.524337 ip-10-0-136-9 kubenswrapper[2584]: I0714 04:59:13.524300 2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-7prdk" Jul 14 04:59:13.524765 ip-10-0-136-9 kubenswrapper[2584]: I0714 04:59:13.524356 2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-fb7bm" Jul 14 04:59:13.524765 ip-10-0-136-9 kubenswrapper[2584]: E0714 04:59:13.524443 2584 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-7prdk" podUID="5d5fe629-46a1-4c48-bab2-32bbaf543c90" Jul 14 04:59:13.524765 ip-10-0-136-9 kubenswrapper[2584]: E0714 04:59:13.524542 2584 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-fb7bm" podUID="7078f217-1a51-4d64-a155-e5ca77500f07" Jul 14 04:59:14.524398 ip-10-0-136-9 kubenswrapper[2584]: I0714 04:59:14.524354 2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-kr4q2" Jul 14 04:59:14.524844 ip-10-0-136-9 kubenswrapper[2584]: E0714 04:59:14.524489 2584 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-kr4q2" podUID="c4902f44-8d7a-4f36-b6e7-0acf7bef5043" Jul 14 04:59:15.524198 ip-10-0-136-9 kubenswrapper[2584]: I0714 04:59:15.524166 2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-7prdk" Jul 14 04:59:15.524377 ip-10-0-136-9 kubenswrapper[2584]: I0714 04:59:15.524173 2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-fb7bm" Jul 14 04:59:15.524377 ip-10-0-136-9 kubenswrapper[2584]: E0714 04:59:15.524302 2584 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-7prdk" podUID="5d5fe629-46a1-4c48-bab2-32bbaf543c90" Jul 14 04:59:15.524377 ip-10-0-136-9 kubenswrapper[2584]: E0714 04:59:15.524363 2584 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-fb7bm" podUID="7078f217-1a51-4d64-a155-e5ca77500f07" Jul 14 04:59:16.524317 ip-10-0-136-9 kubenswrapper[2584]: I0714 04:59:16.524286 2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-kr4q2" Jul 14 04:59:16.524505 ip-10-0-136-9 kubenswrapper[2584]: E0714 04:59:16.524384 2584 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-kr4q2" podUID="c4902f44-8d7a-4f36-b6e7-0acf7bef5043" Jul 14 04:59:17.121634 ip-10-0-136-9 kubenswrapper[2584]: I0714 04:59:17.121593 2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-v7nvc\" (UniqueName: \"kubernetes.io/projected/c4902f44-8d7a-4f36-b6e7-0acf7bef5043-kube-api-access-v7nvc\") pod \"network-check-target-kr4q2\" (UID: \"c4902f44-8d7a-4f36-b6e7-0acf7bef5043\") " pod="openshift-network-diagnostics/network-check-target-kr4q2" Jul 14 04:59:17.121787 ip-10-0-136-9 kubenswrapper[2584]: I0714 04:59:17.121642 2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/5d5fe629-46a1-4c48-bab2-32bbaf543c90-metrics-certs\") pod \"network-metrics-daemon-7prdk\" (UID: \"5d5fe629-46a1-4c48-bab2-32bbaf543c90\") " pod="openshift-multus/network-metrics-daemon-7prdk" Jul 14 04:59:17.121787 ip-10-0-136-9 kubenswrapper[2584]: E0714 04:59:17.121765 2584 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jul 14 04:59:17.121787 ip-10-0-136-9 kubenswrapper[2584]: E0714 04:59:17.121780 2584 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jul 14 04:59:17.121787 ip-10-0-136-9 kubenswrapper[2584]: E0714 04:59:17.121789 2584 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jul 14 04:59:17.122000 ip-10-0-136-9 kubenswrapper[2584]: E0714 04:59:17.121801 2584 projected.go:196] Error preparing data for projected volume kube-api-access-v7nvc for pod openshift-network-diagnostics/network-check-target-kr4q2: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 14 04:59:17.122000 ip-10-0-136-9 kubenswrapper[2584]: E0714 04:59:17.121836 2584 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/5d5fe629-46a1-4c48-bab2-32bbaf543c90-metrics-certs podName:5d5fe629-46a1-4c48-bab2-32bbaf543c90 nodeName:}" failed. No retries permitted until 2026-07-14 04:59:33.121817335 +0000 UTC m=+34.083073021 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/5d5fe629-46a1-4c48-bab2-32bbaf543c90-metrics-certs") pod "network-metrics-daemon-7prdk" (UID: "5d5fe629-46a1-4c48-bab2-32bbaf543c90") : object "openshift-multus"/"metrics-daemon-secret" not registered Jul 14 04:59:17.122000 ip-10-0-136-9 kubenswrapper[2584]: E0714 04:59:17.121855 2584 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/c4902f44-8d7a-4f36-b6e7-0acf7bef5043-kube-api-access-v7nvc podName:c4902f44-8d7a-4f36-b6e7-0acf7bef5043 nodeName:}" failed. No retries permitted until 2026-07-14 04:59:33.121845551 +0000 UTC m=+34.083101241 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "kube-api-access-v7nvc" (UniqueName: "kubernetes.io/projected/c4902f44-8d7a-4f36-b6e7-0acf7bef5043-kube-api-access-v7nvc") pod "network-check-target-kr4q2" (UID: "c4902f44-8d7a-4f36-b6e7-0acf7bef5043") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 14 04:59:17.222276 ip-10-0-136-9 kubenswrapper[2584]: I0714 04:59:17.222235 2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/7078f217-1a51-4d64-a155-e5ca77500f07-original-pull-secret\") pod \"global-pull-secret-syncer-fb7bm\" (UID: \"7078f217-1a51-4d64-a155-e5ca77500f07\") " pod="kube-system/global-pull-secret-syncer-fb7bm" Jul 14 04:59:17.222442 ip-10-0-136-9 kubenswrapper[2584]: E0714 04:59:17.222421 2584 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jul 14 04:59:17.222518 ip-10-0-136-9 kubenswrapper[2584]: E0714 04:59:17.222495 2584 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/7078f217-1a51-4d64-a155-e5ca77500f07-original-pull-secret podName:7078f217-1a51-4d64-a155-e5ca77500f07 nodeName:}" failed. No retries permitted until 2026-07-14 04:59:33.222473367 +0000 UTC m=+34.183729054 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/7078f217-1a51-4d64-a155-e5ca77500f07-original-pull-secret") pod "global-pull-secret-syncer-fb7bm" (UID: "7078f217-1a51-4d64-a155-e5ca77500f07") : object "kube-system"/"original-pull-secret" not registered Jul 14 04:59:17.524493 ip-10-0-136-9 kubenswrapper[2584]: I0714 04:59:17.524421 2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-7prdk" Jul 14 04:59:17.524901 ip-10-0-136-9 kubenswrapper[2584]: E0714 04:59:17.524568 2584 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-7prdk" podUID="5d5fe629-46a1-4c48-bab2-32bbaf543c90" Jul 14 04:59:17.524901 ip-10-0-136-9 kubenswrapper[2584]: I0714 04:59:17.524628 2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-fb7bm" Jul 14 04:59:17.524901 ip-10-0-136-9 kubenswrapper[2584]: E0714 04:59:17.524747 2584 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-fb7bm" podUID="7078f217-1a51-4d64-a155-e5ca77500f07" Jul 14 04:59:18.524410 ip-10-0-136-9 kubenswrapper[2584]: I0714 04:59:18.524377 2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-kr4q2" Jul 14 04:59:18.524586 ip-10-0-136-9 kubenswrapper[2584]: E0714 04:59:18.524503 2584 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-kr4q2" podUID="c4902f44-8d7a-4f36-b6e7-0acf7bef5043" Jul 14 04:59:19.524731 ip-10-0-136-9 kubenswrapper[2584]: I0714 04:59:19.524702 2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-7prdk" Jul 14 04:59:19.525283 ip-10-0-136-9 kubenswrapper[2584]: E0714 04:59:19.524823 2584 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-7prdk" podUID="5d5fe629-46a1-4c48-bab2-32bbaf543c90" Jul 14 04:59:19.525283 ip-10-0-136-9 kubenswrapper[2584]: I0714 04:59:19.524865 2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-fb7bm" Jul 14 04:59:19.525283 ip-10-0-136-9 kubenswrapper[2584]: E0714 04:59:19.524964 2584 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-fb7bm" podUID="7078f217-1a51-4d64-a155-e5ca77500f07" Jul 14 04:59:20.523590 ip-10-0-136-9 kubenswrapper[2584]: I0714 04:59:20.523568 2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-kr4q2" Jul 14 04:59:20.523677 ip-10-0-136-9 kubenswrapper[2584]: E0714 04:59:20.523660 2584 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-kr4q2" podUID="c4902f44-8d7a-4f36-b6e7-0acf7bef5043" Jul 14 04:59:20.662327 ip-10-0-136-9 kubenswrapper[2584]: I0714 04:59:20.662147 2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-136-9.ec2.internal" event={"ID":"1742fd7280f507bfa68896a24fcd9fea","Type":"ContainerStarted","Data":"c1f949d4c3a971f3793edb88d2976e55665802f8d4abf9d539b636bfda263896"} Jul 14 04:59:21.527223 ip-10-0-136-9 kubenswrapper[2584]: I0714 04:59:21.526868 2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-fb7bm" Jul 14 04:59:21.527345 ip-10-0-136-9 kubenswrapper[2584]: I0714 04:59:21.526914 2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-7prdk" Jul 14 04:59:21.527345 ip-10-0-136-9 kubenswrapper[2584]: E0714 04:59:21.527285 2584 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-fb7bm" podUID="7078f217-1a51-4d64-a155-e5ca77500f07" Jul 14 04:59:21.527445 ip-10-0-136-9 kubenswrapper[2584]: E0714 04:59:21.527347 2584 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-7prdk" podUID="5d5fe629-46a1-4c48-bab2-32bbaf543c90" Jul 14 04:59:21.665336 ip-10-0-136-9 kubenswrapper[2584]: I0714 04:59:21.665307 2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/node-ca-l8z9r" event={"ID":"822d074f-5b43-440a-8521-6cb28777ea8d","Type":"ContainerStarted","Data":"b09e0583bae4662a57c1bd3062195cd58434fb75c23ad6bcec58dc690173a56b"} Jul 14 04:59:21.666630 ip-10-0-136-9 kubenswrapper[2584]: I0714 04:59:21.666610 2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-5hkg2" event={"ID":"63629ec8-b4b8-4711-a864-26c64b7627fa","Type":"ContainerStarted","Data":"916c09bd639fbd9a8fe9a8fd11d236ef5e23c401a2923342e297bcd0c1a90208"} Jul 14 04:59:21.668861 ip-10-0-136-9 kubenswrapper[2584]: I0714 04:59:21.667866 2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/node-resolver-t5mq8" event={"ID":"8986aae0-cba2-493d-8d3e-ccf99b81c90c","Type":"ContainerStarted","Data":"320339badd21b4f8a549de9d4178982cac763f5aad63c1d4b61e435a3d3a8d7d"} Jul 14 04:59:21.672045 ip-10-0-136-9 kubenswrapper[2584]: I0714 04:59:21.672020 2584 generic.go:356] "Generic (PLEG): container finished" podID="c0a9d445-38bf-437d-bfbe-b6f937f91140" containerID="ac326cbf3ceb318a9b6e8d8e03bdaa36165f236df0d1c356bc54d118293fa129" exitCode=0 Jul 14 04:59:21.672144 ip-10-0-136-9 kubenswrapper[2584]: I0714 04:59:21.672099 2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-48p6x" event={"ID":"c0a9d445-38bf-437d-bfbe-b6f937f91140","Type":"ContainerDied","Data":"ac326cbf3ceb318a9b6e8d8e03bdaa36165f236df0d1c356bc54d118293fa129"} Jul 14 04:59:21.673524 ip-10-0-136-9 kubenswrapper[2584]: I0714 04:59:21.673491 2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/konnectivity-agent-g257n" event={"ID":"15609856-4056-487b-acdd-30276263b098","Type":"ContainerStarted","Data":"525db7bc44e7a65fb41d122a2377fd47679f529ef5cdcab3ed3d60d206418ddb"} Jul 14 04:59:21.676117 ip-10-0-136-9 kubenswrapper[2584]: I0714 04:59:21.676102 2584 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-8llzd_694d0f90-6317-495d-a312-b76a3513730e/ovn-acl-logging/0.log" Jul 14 04:59:21.676387 ip-10-0-136-9 kubenswrapper[2584]: I0714 04:59:21.676370 2584 generic.go:356] "Generic (PLEG): container finished" podID="694d0f90-6317-495d-a312-b76a3513730e" containerID="1b4f5b276361b7e7403beeb9ea2f9f643994670195b074dbefed323223b93a1a" exitCode=1 Jul 14 04:59:21.676462 ip-10-0-136-9 kubenswrapper[2584]: I0714 04:59:21.676442 2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-8llzd" event={"ID":"694d0f90-6317-495d-a312-b76a3513730e","Type":"ContainerStarted","Data":"9c33d6e8d2548625daf288172ea43ec6fef59ffd833977cd5da0357899492161"} Jul 14 04:59:21.676550 ip-10-0-136-9 kubenswrapper[2584]: I0714 04:59:21.676506 2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-8llzd" event={"ID":"694d0f90-6317-495d-a312-b76a3513730e","Type":"ContainerStarted","Data":"2c82f561cf9175f89ed3c68e5056275fc479301d94612b0dd47a361792553d79"} Jul 14 04:59:21.676590 ip-10-0-136-9 kubenswrapper[2584]: I0714 04:59:21.676544 2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-8llzd" event={"ID":"694d0f90-6317-495d-a312-b76a3513730e","Type":"ContainerStarted","Data":"b1f4a047845f56e0c9acc204ec514576e438f6bbf76e7a0e432a43ded674264f"} Jul 14 04:59:21.676640 ip-10-0-136-9 kubenswrapper[2584]: I0714 04:59:21.676593 2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-8llzd" event={"ID":"694d0f90-6317-495d-a312-b76a3513730e","Type":"ContainerStarted","Data":"c9ca71f079893b261f0ddf6c255e55cee9bf22eb37b88ca0d512e4f86cfb98b6"} Jul 14 04:59:21.676677 ip-10-0-136-9 kubenswrapper[2584]: I0714 04:59:21.676645 2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-8llzd" event={"ID":"694d0f90-6317-495d-a312-b76a3513730e","Type":"ContainerDied","Data":"1b4f5b276361b7e7403beeb9ea2f9f643994670195b074dbefed323223b93a1a"} Jul 14 04:59:21.676718 ip-10-0-136-9 kubenswrapper[2584]: I0714 04:59:21.676683 2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-8llzd" event={"ID":"694d0f90-6317-495d-a312-b76a3513730e","Type":"ContainerStarted","Data":"216a871ca936011a7f0469c3d00e31916d3aedfb13669be9bab6697d2811a9f1"} Jul 14 04:59:21.677686 ip-10-0-136-9 kubenswrapper[2584]: I0714 04:59:21.677667 2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-s7xsv" event={"ID":"562da33b-a2b1-4ac9-a122-8536e8542e41","Type":"ContainerStarted","Data":"87ea55b5ab7f745201303eab57206baacef52c06725c11410210484baca7b955"} Jul 14 04:59:21.679043 ip-10-0-136-9 kubenswrapper[2584]: I0714 04:59:21.679021 2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-node-tuning-operator/tuned-nhmwr" event={"ID":"440466b6-da3b-44b5-89fc-75b7d63a8093","Type":"ContainerStarted","Data":"7930ac115865710eac72d686aa996ab19500c5d80e381afdfd2fcd7e8d806315"} Jul 14 04:59:21.681625 ip-10-0-136-9 kubenswrapper[2584]: I0714 04:59:21.681594 2584 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-image-registry/node-ca-l8z9r" podStartSLOduration=3.894458248 podStartE2EDuration="22.681584253s" totalImagesPullingTime="18.787126005s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-14 04:58:59 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-14 04:59:21.681403701 +0000 UTC m=+22.642659406" watchObservedRunningTime="2026-07-14 04:59:21.681584253 +0000 UTC m=+22.642839956" Jul 14 04:59:21.696761 ip-10-0-136-9 kubenswrapper[2584]: I0714 04:59:21.696729 2584 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/konnectivity-agent-g257n" podStartSLOduration=5.320001249 podStartE2EDuration="22.69671885s" totalImagesPullingTime="17.376717601s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-14 04:58:59 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-14 04:59:21.696446309 +0000 UTC m=+22.657702012" watchObservedRunningTime="2026-07-14 04:59:21.69671885 +0000 UTC m=+22.657974553" Jul 14 04:59:21.715571 ip-10-0-136-9 kubenswrapper[2584]: I0714 04:59:21.715532 2584 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-dns/node-resolver-t5mq8" podStartSLOduration=5.272478085 podStartE2EDuration="22.715521346s" totalImagesPullingTime="17.443043261s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-14 04:58:59 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-14 04:59:21.71534225 +0000 UTC m=+22.676597954" watchObservedRunningTime="2026-07-14 04:59:21.715521346 +0000 UTC m=+22.676777049" Jul 14 04:59:21.729851 ip-10-0-136-9 kubenswrapper[2584]: I0714 04:59:21.729823 2584 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-136-9.ec2.internal" podStartSLOduration=21.729813432 podStartE2EDuration="21.729813432s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-14 04:59:00 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-14 04:59:21.729526063 +0000 UTC m=+22.690781767" watchObservedRunningTime="2026-07-14 04:59:21.729813432 +0000 UTC m=+22.691069134" Jul 14 04:59:21.768539 ip-10-0-136-9 kubenswrapper[2584]: I0714 04:59:21.768511 2584 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-node-tuning-operator/tuned-nhmwr" podStartSLOduration=3.960611265 podStartE2EDuration="22.768501377s" totalImagesPullingTime="18.807890112s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-14 04:58:59 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-14 04:59:21.768416959 +0000 UTC m=+22.729672663" watchObservedRunningTime="2026-07-14 04:59:21.768501377 +0000 UTC m=+22.729757080" Jul 14 04:59:21.786114 ip-10-0-136-9 kubenswrapper[2584]: I0714 04:59:21.786059 2584 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/multus-s7xsv" podStartSLOduration=3.974072929 podStartE2EDuration="22.786048747s" totalImagesPullingTime="18.811975818s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-14 04:58:59 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-14 04:59:21.78588135 +0000 UTC m=+22.747137076" watchObservedRunningTime="2026-07-14 04:59:21.786048747 +0000 UTC m=+22.747304449" Jul 14 04:59:22.022736 ip-10-0-136-9 kubenswrapper[2584]: I0714 04:59:22.022715 2584 plugin_watcher.go:194] "Adding socket path or updating timestamp to desired state cache" path="/var/lib/kubelet/plugins_registry/ebs.csi.aws.com-reg.sock" Jul 14 04:59:22.449970 ip-10-0-136-9 kubenswrapper[2584]: I0714 04:59:22.449860 2584 reconciler.go:161] "OperationExecutor.RegisterPlugin started" plugin={"SocketPath":"/var/lib/kubelet/plugins_registry/ebs.csi.aws.com-reg.sock","Timestamp":"2026-07-14T04:59:22.022733236Z","UUID":"d11f9f3d-f1cb-4dd8-83c9-425ff08c2766","Handler":null,"Name":"","Endpoint":""} Jul 14 04:59:22.451465 ip-10-0-136-9 kubenswrapper[2584]: I0714 04:59:22.451445 2584 csi_plugin.go:106] kubernetes.io/csi: Trying to validate a new CSI Driver with name: ebs.csi.aws.com endpoint: /var/lib/kubelet/plugins/ebs.csi.aws.com/csi.sock versions: 1.0.0 Jul 14 04:59:22.451576 ip-10-0-136-9 kubenswrapper[2584]: I0714 04:59:22.451478 2584 csi_plugin.go:119] kubernetes.io/csi: Register new plugin with name: ebs.csi.aws.com at endpoint: /var/lib/kubelet/plugins/ebs.csi.aws.com/csi.sock Jul 14 04:59:22.524343 ip-10-0-136-9 kubenswrapper[2584]: I0714 04:59:22.524066 2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-kr4q2" Jul 14 04:59:22.524343 ip-10-0-136-9 kubenswrapper[2584]: E0714 04:59:22.524178 2584 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-kr4q2" podUID="c4902f44-8d7a-4f36-b6e7-0acf7bef5043" Jul 14 04:59:22.682891 ip-10-0-136-9 kubenswrapper[2584]: I0714 04:59:22.682860 2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-operator/iptables-alerter-drsfg" event={"ID":"e71a2404-91a1-47b1-ac2d-b75abe645218","Type":"ContainerStarted","Data":"a1d3991c96b66925bf3edd5af720c6147252998f99b5ffbb04929187c14f4477"} Jul 14 04:59:22.687879 ip-10-0-136-9 kubenswrapper[2584]: I0714 04:59:22.687843 2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-5hkg2" event={"ID":"63629ec8-b4b8-4711-a864-26c64b7627fa","Type":"ContainerStarted","Data":"920214743f4b86939557f14b2297856f7c092b43521212f2e3fa5101c029e560"} Jul 14 04:59:22.706925 ip-10-0-136-9 kubenswrapper[2584]: I0714 04:59:22.706848 2584 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-operator/iptables-alerter-drsfg" podStartSLOduration=4.8792558679999996 podStartE2EDuration="23.706835665s" totalImagesPullingTime="18.827579797s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-14 04:58:59 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-14 04:59:22.706326656 +0000 UTC m=+23.667582360" watchObservedRunningTime="2026-07-14 04:59:22.706835665 +0000 UTC m=+23.668091371" Jul 14 04:59:23.120321 ip-10-0-136-9 kubenswrapper[2584]: I0714 04:59:23.120294 2584 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="kube-system/konnectivity-agent-g257n" Jul 14 04:59:23.120912 ip-10-0-136-9 kubenswrapper[2584]: I0714 04:59:23.120892 2584 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="kube-system/konnectivity-agent-g257n" Jul 14 04:59:23.526077 ip-10-0-136-9 kubenswrapper[2584]: I0714 04:59:23.526058 2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-fb7bm" Jul 14 04:59:23.526191 ip-10-0-136-9 kubenswrapper[2584]: E0714 04:59:23.526143 2584 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-fb7bm" podUID="7078f217-1a51-4d64-a155-e5ca77500f07" Jul 14 04:59:23.526252 ip-10-0-136-9 kubenswrapper[2584]: I0714 04:59:23.526203 2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-7prdk" Jul 14 04:59:23.526332 ip-10-0-136-9 kubenswrapper[2584]: E0714 04:59:23.526314 2584 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-7prdk" podUID="5d5fe629-46a1-4c48-bab2-32bbaf543c90" Jul 14 04:59:23.694159 ip-10-0-136-9 kubenswrapper[2584]: I0714 04:59:23.694126 2584 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-8llzd_694d0f90-6317-495d-a312-b76a3513730e/ovn-acl-logging/0.log" Jul 14 04:59:23.694610 ip-10-0-136-9 kubenswrapper[2584]: I0714 04:59:23.694588 2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-8llzd" event={"ID":"694d0f90-6317-495d-a312-b76a3513730e","Type":"ContainerStarted","Data":"a5b79f1f1126049a90b7ea01d3fc8379a683c1f57a786e55f31d78a3de91b4f5"} Jul 14 04:59:23.696735 ip-10-0-136-9 kubenswrapper[2584]: I0714 04:59:23.696706 2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-5hkg2" event={"ID":"63629ec8-b4b8-4711-a864-26c64b7627fa","Type":"ContainerStarted","Data":"e2122677c6e6e60c8ed7dcfff41e1771bd50e3224a67aecd5218424bdc6cb8ce"} Jul 14 04:59:23.697173 ip-10-0-136-9 kubenswrapper[2584]: I0714 04:59:23.697157 2584 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kube-system/konnectivity-agent-g257n" Jul 14 04:59:23.697599 ip-10-0-136-9 kubenswrapper[2584]: I0714 04:59:23.697581 2584 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kube-system/konnectivity-agent-g257n" Jul 14 04:59:23.714454 ip-10-0-136-9 kubenswrapper[2584]: I0714 04:59:23.714369 2584 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-5hkg2" podStartSLOduration=3.6525550239999998 podStartE2EDuration="24.714351286s" totalImagesPullingTime="21.061796262s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-14 04:58:59 +0000 UTC" imagePullSessionsCount=3 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-14 04:59:23.71412327 +0000 UTC m=+24.675378973" watchObservedRunningTime="2026-07-14 04:59:23.714351286 +0000 UTC m=+24.675606989" Jul 14 04:59:24.524171 ip-10-0-136-9 kubenswrapper[2584]: I0714 04:59:24.523915 2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-kr4q2" Jul 14 04:59:24.524442 ip-10-0-136-9 kubenswrapper[2584]: E0714 04:59:24.524277 2584 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-kr4q2" podUID="c4902f44-8d7a-4f36-b6e7-0acf7bef5043" Jul 14 04:59:25.523949 ip-10-0-136-9 kubenswrapper[2584]: I0714 04:59:25.523895 2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-7prdk" Jul 14 04:59:25.524441 ip-10-0-136-9 kubenswrapper[2584]: I0714 04:59:25.523961 2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-fb7bm" Jul 14 04:59:25.524441 ip-10-0-136-9 kubenswrapper[2584]: E0714 04:59:25.524060 2584 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-7prdk" podUID="5d5fe629-46a1-4c48-bab2-32bbaf543c90" Jul 14 04:59:25.524441 ip-10-0-136-9 kubenswrapper[2584]: E0714 04:59:25.524206 2584 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-fb7bm" podUID="7078f217-1a51-4d64-a155-e5ca77500f07" Jul 14 04:59:26.524362 ip-10-0-136-9 kubenswrapper[2584]: I0714 04:59:26.524145 2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-kr4q2" Jul 14 04:59:26.524958 ip-10-0-136-9 kubenswrapper[2584]: E0714 04:59:26.524384 2584 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-kr4q2" podUID="c4902f44-8d7a-4f36-b6e7-0acf7bef5043" Jul 14 04:59:26.706401 ip-10-0-136-9 kubenswrapper[2584]: I0714 04:59:26.706377 2584 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-8llzd_694d0f90-6317-495d-a312-b76a3513730e/ovn-acl-logging/0.log" Jul 14 04:59:26.706746 ip-10-0-136-9 kubenswrapper[2584]: I0714 04:59:26.706727 2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-8llzd" event={"ID":"694d0f90-6317-495d-a312-b76a3513730e","Type":"ContainerStarted","Data":"aeb09d1490814b66400fec90e0dd39a4925217b4811b8c9a4f7c309a32ec2cc0"} Jul 14 04:59:26.707045 ip-10-0-136-9 kubenswrapper[2584]: I0714 04:59:26.707028 2584 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-8llzd" Jul 14 04:59:26.707149 ip-10-0-136-9 kubenswrapper[2584]: I0714 04:59:26.707090 2584 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-8llzd" Jul 14 04:59:26.707209 ip-10-0-136-9 kubenswrapper[2584]: I0714 04:59:26.707193 2584 scope.go:117] "RemoveContainer" containerID="1b4f5b276361b7e7403beeb9ea2f9f643994670195b074dbefed323223b93a1a" Jul 14 04:59:26.708795 ip-10-0-136-9 kubenswrapper[2584]: I0714 04:59:26.708774 2584 generic.go:356] "Generic (PLEG): container finished" podID="c0a9d445-38bf-437d-bfbe-b6f937f91140" containerID="4cfa17a4374c70ac89029cac4eac423ab012718ad82d1348bb1522ec50675203" exitCode=0 Jul 14 04:59:26.708870 ip-10-0-136-9 kubenswrapper[2584]: I0714 04:59:26.708811 2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-48p6x" event={"ID":"c0a9d445-38bf-437d-bfbe-b6f937f91140","Type":"ContainerDied","Data":"4cfa17a4374c70ac89029cac4eac423ab012718ad82d1348bb1522ec50675203"} Jul 14 04:59:26.723520 ip-10-0-136-9 kubenswrapper[2584]: I0714 04:59:26.723499 2584 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-8llzd" Jul 14 04:59:27.523612 ip-10-0-136-9 kubenswrapper[2584]: I0714 04:59:27.523577 2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-fb7bm" Jul 14 04:59:27.523819 ip-10-0-136-9 kubenswrapper[2584]: I0714 04:59:27.523577 2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-7prdk" Jul 14 04:59:27.523819 ip-10-0-136-9 kubenswrapper[2584]: E0714 04:59:27.523758 2584 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-fb7bm" podUID="7078f217-1a51-4d64-a155-e5ca77500f07" Jul 14 04:59:27.523819 ip-10-0-136-9 kubenswrapper[2584]: E0714 04:59:27.523789 2584 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-7prdk" podUID="5d5fe629-46a1-4c48-bab2-32bbaf543c90" Jul 14 04:59:27.714178 ip-10-0-136-9 kubenswrapper[2584]: I0714 04:59:27.714117 2584 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-8llzd_694d0f90-6317-495d-a312-b76a3513730e/ovn-acl-logging/0.log" Jul 14 04:59:27.714611 ip-10-0-136-9 kubenswrapper[2584]: I0714 04:59:27.714451 2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-8llzd" event={"ID":"694d0f90-6317-495d-a312-b76a3513730e","Type":"ContainerStarted","Data":"60c122bf6ebfc5624fd7725e7b10d792443cd5d0484525170bbddce3ca9d0a1a"} Jul 14 04:59:27.714745 ip-10-0-136-9 kubenswrapper[2584]: I0714 04:59:27.714723 2584 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-8llzd" Jul 14 04:59:27.728711 ip-10-0-136-9 kubenswrapper[2584]: I0714 04:59:27.728692 2584 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-8llzd" Jul 14 04:59:27.752459 ip-10-0-136-9 kubenswrapper[2584]: I0714 04:59:27.752375 2584 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ovn-kubernetes/ovnkube-node-8llzd" podStartSLOduration=9.779722426 podStartE2EDuration="28.752358232s" totalImagesPullingTime="18.972635806s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-14 04:58:59 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-14 04:59:27.749979812 +0000 UTC m=+28.711235519" watchObservedRunningTime="2026-07-14 04:59:27.752358232 +0000 UTC m=+28.713613938" Jul 14 04:59:27.853356 ip-10-0-136-9 kubenswrapper[2584]: I0714 04:59:27.853334 2584 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-multus/network-metrics-daemon-7prdk"] Jul 14 04:59:27.853445 ip-10-0-136-9 kubenswrapper[2584]: I0714 04:59:27.853420 2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-7prdk" Jul 14 04:59:27.853524 ip-10-0-136-9 kubenswrapper[2584]: E0714 04:59:27.853507 2584 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-7prdk" podUID="5d5fe629-46a1-4c48-bab2-32bbaf543c90" Jul 14 04:59:27.863248 ip-10-0-136-9 kubenswrapper[2584]: I0714 04:59:27.863226 2584 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-target-kr4q2"] Jul 14 04:59:27.863343 ip-10-0-136-9 kubenswrapper[2584]: I0714 04:59:27.863331 2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-kr4q2" Jul 14 04:59:27.863446 ip-10-0-136-9 kubenswrapper[2584]: E0714 04:59:27.863427 2584 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-kr4q2" podUID="c4902f44-8d7a-4f36-b6e7-0acf7bef5043" Jul 14 04:59:27.867128 ip-10-0-136-9 kubenswrapper[2584]: I0714 04:59:27.867108 2584 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kube-system/global-pull-secret-syncer-fb7bm"] Jul 14 04:59:27.867213 ip-10-0-136-9 kubenswrapper[2584]: I0714 04:59:27.867188 2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-fb7bm" Jul 14 04:59:27.867303 ip-10-0-136-9 kubenswrapper[2584]: E0714 04:59:27.867283 2584 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-fb7bm" podUID="7078f217-1a51-4d64-a155-e5ca77500f07" Jul 14 04:59:28.718480 ip-10-0-136-9 kubenswrapper[2584]: I0714 04:59:28.718445 2584 generic.go:356] "Generic (PLEG): container finished" podID="c0a9d445-38bf-437d-bfbe-b6f937f91140" containerID="35405cffdd8888f7fa2be5827bef51342f52f2ba473633bddb9f14671d7d5302" exitCode=0 Jul 14 04:59:28.718905 ip-10-0-136-9 kubenswrapper[2584]: I0714 04:59:28.718522 2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-48p6x" event={"ID":"c0a9d445-38bf-437d-bfbe-b6f937f91140","Type":"ContainerDied","Data":"35405cffdd8888f7fa2be5827bef51342f52f2ba473633bddb9f14671d7d5302"} Jul 14 04:59:29.524793 ip-10-0-136-9 kubenswrapper[2584]: I0714 04:59:29.524763 2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-kr4q2" Jul 14 04:59:29.524979 ip-10-0-136-9 kubenswrapper[2584]: E0714 04:59:29.524847 2584 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-kr4q2" podUID="c4902f44-8d7a-4f36-b6e7-0acf7bef5043" Jul 14 04:59:29.524979 ip-10-0-136-9 kubenswrapper[2584]: I0714 04:59:29.524962 2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-7prdk" Jul 14 04:59:29.525107 ip-10-0-136-9 kubenswrapper[2584]: E0714 04:59:29.525072 2584 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-7prdk" podUID="5d5fe629-46a1-4c48-bab2-32bbaf543c90" Jul 14 04:59:29.525162 ip-10-0-136-9 kubenswrapper[2584]: I0714 04:59:29.525109 2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-fb7bm" Jul 14 04:59:29.525211 ip-10-0-136-9 kubenswrapper[2584]: E0714 04:59:29.525195 2584 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-fb7bm" podUID="7078f217-1a51-4d64-a155-e5ca77500f07" Jul 14 04:59:30.725045 ip-10-0-136-9 kubenswrapper[2584]: I0714 04:59:30.724850 2584 generic.go:356] "Generic (PLEG): container finished" podID="c0a9d445-38bf-437d-bfbe-b6f937f91140" containerID="914fc4b2463760c5b1d75694ac06981ee87c52322b06fe8dd01af3052e31edf0" exitCode=0 Jul 14 04:59:30.725045 ip-10-0-136-9 kubenswrapper[2584]: I0714 04:59:30.724942 2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-48p6x" event={"ID":"c0a9d445-38bf-437d-bfbe-b6f937f91140","Type":"ContainerDied","Data":"914fc4b2463760c5b1d75694ac06981ee87c52322b06fe8dd01af3052e31edf0"} Jul 14 04:59:31.523709 ip-10-0-136-9 kubenswrapper[2584]: I0714 04:59:31.523668 2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-fb7bm" Jul 14 04:59:31.523879 ip-10-0-136-9 kubenswrapper[2584]: I0714 04:59:31.523668 2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-kr4q2" Jul 14 04:59:31.523879 ip-10-0-136-9 kubenswrapper[2584]: E0714 04:59:31.523805 2584 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-fb7bm" podUID="7078f217-1a51-4d64-a155-e5ca77500f07" Jul 14 04:59:31.523879 ip-10-0-136-9 kubenswrapper[2584]: I0714 04:59:31.523824 2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-7prdk" Jul 14 04:59:31.524075 ip-10-0-136-9 kubenswrapper[2584]: E0714 04:59:31.523913 2584 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-kr4q2" podUID="c4902f44-8d7a-4f36-b6e7-0acf7bef5043" Jul 14 04:59:31.524075 ip-10-0-136-9 kubenswrapper[2584]: E0714 04:59:31.524011 2584 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-7prdk" podUID="5d5fe629-46a1-4c48-bab2-32bbaf543c90" Jul 14 04:59:33.149157 ip-10-0-136-9 kubenswrapper[2584]: I0714 04:59:33.149122 2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-v7nvc\" (UniqueName: \"kubernetes.io/projected/c4902f44-8d7a-4f36-b6e7-0acf7bef5043-kube-api-access-v7nvc\") pod \"network-check-target-kr4q2\" (UID: \"c4902f44-8d7a-4f36-b6e7-0acf7bef5043\") " pod="openshift-network-diagnostics/network-check-target-kr4q2" Jul 14 04:59:33.149658 ip-10-0-136-9 kubenswrapper[2584]: I0714 04:59:33.149165 2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/5d5fe629-46a1-4c48-bab2-32bbaf543c90-metrics-certs\") pod \"network-metrics-daemon-7prdk\" (UID: \"5d5fe629-46a1-4c48-bab2-32bbaf543c90\") " pod="openshift-multus/network-metrics-daemon-7prdk" Jul 14 04:59:33.149658 ip-10-0-136-9 kubenswrapper[2584]: E0714 04:59:33.149265 2584 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jul 14 04:59:33.149658 ip-10-0-136-9 kubenswrapper[2584]: E0714 04:59:33.149286 2584 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jul 14 04:59:33.149658 ip-10-0-136-9 kubenswrapper[2584]: E0714 04:59:33.149311 2584 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jul 14 04:59:33.149658 ip-10-0-136-9 kubenswrapper[2584]: E0714 04:59:33.149322 2584 projected.go:196] Error preparing data for projected volume kube-api-access-v7nvc for pod openshift-network-diagnostics/network-check-target-kr4q2: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 14 04:59:33.149658 ip-10-0-136-9 kubenswrapper[2584]: E0714 04:59:33.149330 2584 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/5d5fe629-46a1-4c48-bab2-32bbaf543c90-metrics-certs podName:5d5fe629-46a1-4c48-bab2-32bbaf543c90 nodeName:}" failed. No retries permitted until 2026-07-14 05:00:05.149309395 +0000 UTC m=+66.110565080 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/5d5fe629-46a1-4c48-bab2-32bbaf543c90-metrics-certs") pod "network-metrics-daemon-7prdk" (UID: "5d5fe629-46a1-4c48-bab2-32bbaf543c90") : object "openshift-multus"/"metrics-daemon-secret" not registered Jul 14 04:59:33.149658 ip-10-0-136-9 kubenswrapper[2584]: E0714 04:59:33.149371 2584 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/c4902f44-8d7a-4f36-b6e7-0acf7bef5043-kube-api-access-v7nvc podName:c4902f44-8d7a-4f36-b6e7-0acf7bef5043 nodeName:}" failed. No retries permitted until 2026-07-14 05:00:05.149355414 +0000 UTC m=+66.110611096 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "kube-api-access-v7nvc" (UniqueName: "kubernetes.io/projected/c4902f44-8d7a-4f36-b6e7-0acf7bef5043-kube-api-access-v7nvc") pod "network-check-target-kr4q2" (UID: "c4902f44-8d7a-4f36-b6e7-0acf7bef5043") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 14 04:59:33.249828 ip-10-0-136-9 kubenswrapper[2584]: I0714 04:59:33.249798 2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/7078f217-1a51-4d64-a155-e5ca77500f07-original-pull-secret\") pod \"global-pull-secret-syncer-fb7bm\" (UID: \"7078f217-1a51-4d64-a155-e5ca77500f07\") " pod="kube-system/global-pull-secret-syncer-fb7bm" Jul 14 04:59:33.249978 ip-10-0-136-9 kubenswrapper[2584]: E0714 04:59:33.249961 2584 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jul 14 04:59:33.250047 ip-10-0-136-9 kubenswrapper[2584]: E0714 04:59:33.250029 2584 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/7078f217-1a51-4d64-a155-e5ca77500f07-original-pull-secret podName:7078f217-1a51-4d64-a155-e5ca77500f07 nodeName:}" failed. No retries permitted until 2026-07-14 05:00:05.250010853 +0000 UTC m=+66.211266535 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/7078f217-1a51-4d64-a155-e5ca77500f07-original-pull-secret") pod "global-pull-secret-syncer-fb7bm" (UID: "7078f217-1a51-4d64-a155-e5ca77500f07") : object "kube-system"/"original-pull-secret" not registered Jul 14 04:59:33.374626 ip-10-0-136-9 kubenswrapper[2584]: I0714 04:59:33.374605 2584 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-136-9.ec2.internal" event="NodeReady" Jul 14 04:59:33.374730 ip-10-0-136-9 kubenswrapper[2584]: I0714 04:59:33.374699 2584 kubelet_node_status.go:489] "Fast updating node status as it just became ready" Jul 14 04:59:33.418761 ip-10-0-136-9 kubenswrapper[2584]: I0714 04:59:33.418729 2584 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-service-ca-operator/service-ca-operator-7695fc6c8c-5j5s4"] Jul 14 04:59:33.446472 ip-10-0-136-9 kubenswrapper[2584]: I0714 04:59:33.446398 2584 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console-operator/console-operator-7866497494-wh846"] Jul 14 04:59:33.446628 ip-10-0-136-9 kubenswrapper[2584]: I0714 04:59:33.446606 2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-service-ca-operator/service-ca-operator-7695fc6c8c-5j5s4" Jul 14 04:59:33.450328 ip-10-0-136-9 kubenswrapper[2584]: I0714 04:59:33.449269 2584 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-service-ca-operator\"/\"serving-cert\"" Jul 14 04:59:33.450328 ip-10-0-136-9 kubenswrapper[2584]: I0714 04:59:33.449585 2584 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-service-ca-operator\"/\"kube-root-ca.crt\"" Jul 14 04:59:33.450328 ip-10-0-136-9 kubenswrapper[2584]: I0714 04:59:33.449767 2584 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-service-ca-operator\"/\"openshift-service-ca.crt\"" Jul 14 04:59:33.450328 ip-10-0-136-9 kubenswrapper[2584]: I0714 04:59:33.449972 2584 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-service-ca-operator\"/\"service-ca-operator-dockercfg-v9vbj\"" Jul 14 04:59:33.450328 ip-10-0-136-9 kubenswrapper[2584]: I0714 04:59:33.450178 2584 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-service-ca-operator\"/\"service-ca-operator-config\"" Jul 14 04:59:33.464112 ip-10-0-136-9 kubenswrapper[2584]: I0714 04:59:33.464068 2584 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-image-registry/image-registry-6f5d75bf47-rnc9m"] Jul 14 04:59:33.464248 ip-10-0-136-9 kubenswrapper[2584]: I0714 04:59:33.464169 2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console-operator/console-operator-7866497494-wh846" Jul 14 04:59:33.467303 ip-10-0-136-9 kubenswrapper[2584]: I0714 04:59:33.467163 2584 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console-operator\"/\"serving-cert\"" Jul 14 04:59:33.467303 ip-10-0-136-9 kubenswrapper[2584]: I0714 04:59:33.467190 2584 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console-operator\"/\"console-operator-config\"" Jul 14 04:59:33.467858 ip-10-0-136-9 kubenswrapper[2584]: I0714 04:59:33.467504 2584 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console-operator\"/\"console-operator-dockercfg-ms4ql\"" Jul 14 04:59:33.467858 ip-10-0-136-9 kubenswrapper[2584]: I0714 04:59:33.467694 2584 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console-operator\"/\"kube-root-ca.crt\"" Jul 14 04:59:33.467858 ip-10-0-136-9 kubenswrapper[2584]: I0714 04:59:33.467837 2584 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console-operator\"/\"openshift-service-ca.crt\"" Jul 14 04:59:33.476138 ip-10-0-136-9 kubenswrapper[2584]: I0714 04:59:33.476118 2584 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console-operator\"/\"trusted-ca\"" Jul 14 04:59:33.490392 ip-10-0-136-9 kubenswrapper[2584]: I0714 04:59:33.490371 2584 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-dns/dns-default-gkwjs"] Jul 14 04:59:33.490491 ip-10-0-136-9 kubenswrapper[2584]: I0714 04:59:33.490476 2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-6f5d75bf47-rnc9m" Jul 14 04:59:33.494743 ip-10-0-136-9 kubenswrapper[2584]: I0714 04:59:33.494679 2584 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"registry-dockercfg-clkvv\"" Jul 14 04:59:33.494951 ip-10-0-136-9 kubenswrapper[2584]: I0714 04:59:33.494920 2584 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"installation-pull-secrets\"" Jul 14 04:59:33.495167 ip-10-0-136-9 kubenswrapper[2584]: I0714 04:59:33.495149 2584 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"image-registry-tls\"" Jul 14 04:59:33.496437 ip-10-0-136-9 kubenswrapper[2584]: I0714 04:59:33.496285 2584 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"image-registry-private-configuration\"" Jul 14 04:59:33.504922 ip-10-0-136-9 kubenswrapper[2584]: I0714 04:59:33.504900 2584 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"trusted-ca\"" Jul 14 04:59:33.512673 ip-10-0-136-9 kubenswrapper[2584]: I0714 04:59:33.512653 2584 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-cluster-storage-operator/volume-data-source-validator-78495597f6-qblzx"] Jul 14 04:59:33.512808 ip-10-0-136-9 kubenswrapper[2584]: I0714 04:59:33.512790 2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-gkwjs" Jul 14 04:59:33.515581 ip-10-0-136-9 kubenswrapper[2584]: I0714 04:59:33.515558 2584 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"dns-default\"" Jul 14 04:59:33.515680 ip-10-0-136-9 kubenswrapper[2584]: I0714 04:59:33.515632 2584 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-dockercfg-6l8db\"" Jul 14 04:59:33.515792 ip-10-0-136-9 kubenswrapper[2584]: I0714 04:59:33.515775 2584 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-default-metrics-tls\"" Jul 14 04:59:33.531220 ip-10-0-136-9 kubenswrapper[2584]: I0714 04:59:33.531180 2584 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-799cb7f958-fkfct"] Jul 14 04:59:33.531317 ip-10-0-136-9 kubenswrapper[2584]: I0714 04:59:33.531284 2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-storage-operator/volume-data-source-validator-78495597f6-qblzx" Jul 14 04:59:33.531373 ip-10-0-136-9 kubenswrapper[2584]: I0714 04:59:33.531360 2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-fb7bm" Jul 14 04:59:33.531418 ip-10-0-136-9 kubenswrapper[2584]: I0714 04:59:33.531284 2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-kr4q2" Jul 14 04:59:33.531474 ip-10-0-136-9 kubenswrapper[2584]: I0714 04:59:33.531284 2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-7prdk" Jul 14 04:59:33.534088 ip-10-0-136-9 kubenswrapper[2584]: I0714 04:59:33.534069 2584 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-storage-operator\"/\"openshift-service-ca.crt\"" Jul 14 04:59:33.534088 ip-10-0-136-9 kubenswrapper[2584]: I0714 04:59:33.534083 2584 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"original-pull-secret\"" Jul 14 04:59:33.534915 ip-10-0-136-9 kubenswrapper[2584]: I0714 04:59:33.534898 2584 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-storage-operator\"/\"kube-root-ca.crt\"" Jul 14 04:59:33.535008 ip-10-0-136-9 kubenswrapper[2584]: I0714 04:59:33.534898 2584 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"openshift-service-ca.crt\"" Jul 14 04:59:33.535008 ip-10-0-136-9 kubenswrapper[2584]: I0714 04:59:33.534989 2584 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"default-dockercfg-hpjvf\"" Jul 14 04:59:33.535008 ip-10-0-136-9 kubenswrapper[2584]: I0714 04:59:33.534998 2584 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"kube-root-ca.crt\"" Jul 14 04:59:33.535210 ip-10-0-136-9 kubenswrapper[2584]: I0714 04:59:33.535195 2584 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-secret\"" Jul 14 04:59:33.535294 ip-10-0-136-9 kubenswrapper[2584]: I0714 04:59:33.535278 2584 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-sa-dockercfg-jntlj\"" Jul 14 04:59:33.535391 ip-10-0-136-9 kubenswrapper[2584]: I0714 04:59:33.535376 2584 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-storage-operator\"/\"volume-data-source-validator-dockercfg-h2qdh\"" Jul 14 04:59:33.551727 ip-10-0-136-9 kubenswrapper[2584]: I0714 04:59:33.551706 2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/b0b64988-41ac-4e49-bcfd-a08adebb37f7-serving-cert\") pod \"console-operator-7866497494-wh846\" (UID: \"b0b64988-41ac-4e49-bcfd-a08adebb37f7\") " pod="openshift-console-operator/console-operator-7866497494-wh846" Jul 14 04:59:33.551811 ip-10-0-136-9 kubenswrapper[2584]: I0714 04:59:33.551738 2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-d8l2f\" (UniqueName: \"kubernetes.io/projected/90ab614b-66f6-4850-a0ac-0dc019099d3b-kube-api-access-d8l2f\") pod \"service-ca-operator-7695fc6c8c-5j5s4\" (UID: \"90ab614b-66f6-4850-a0ac-0dc019099d3b\") " pod="openshift-service-ca-operator/service-ca-operator-7695fc6c8c-5j5s4" Jul 14 04:59:33.551811 ip-10-0-136-9 kubenswrapper[2584]: I0714 04:59:33.551781 2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/90ab614b-66f6-4850-a0ac-0dc019099d3b-serving-cert\") pod \"service-ca-operator-7695fc6c8c-5j5s4\" (UID: \"90ab614b-66f6-4850-a0ac-0dc019099d3b\") " pod="openshift-service-ca-operator/service-ca-operator-7695fc6c8c-5j5s4" Jul 14 04:59:33.551910 ip-10-0-136-9 kubenswrapper[2584]: I0714 04:59:33.551808 2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/b0b64988-41ac-4e49-bcfd-a08adebb37f7-trusted-ca\") pod \"console-operator-7866497494-wh846\" (UID: \"b0b64988-41ac-4e49-bcfd-a08adebb37f7\") " pod="openshift-console-operator/console-operator-7866497494-wh846" Jul 14 04:59:33.551910 ip-10-0-136-9 kubenswrapper[2584]: I0714 04:59:33.551832 2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/90ab614b-66f6-4850-a0ac-0dc019099d3b-config\") pod \"service-ca-operator-7695fc6c8c-5j5s4\" (UID: \"90ab614b-66f6-4850-a0ac-0dc019099d3b\") " pod="openshift-service-ca-operator/service-ca-operator-7695fc6c8c-5j5s4" Jul 14 04:59:33.551910 ip-10-0-136-9 kubenswrapper[2584]: I0714 04:59:33.551855 2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/b0b64988-41ac-4e49-bcfd-a08adebb37f7-config\") pod \"console-operator-7866497494-wh846\" (UID: \"b0b64988-41ac-4e49-bcfd-a08adebb37f7\") " pod="openshift-console-operator/console-operator-7866497494-wh846" Jul 14 04:59:33.552035 ip-10-0-136-9 kubenswrapper[2584]: I0714 04:59:33.551942 2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-x5jw2\" (UniqueName: \"kubernetes.io/projected/b0b64988-41ac-4e49-bcfd-a08adebb37f7-kube-api-access-x5jw2\") pod \"console-operator-7866497494-wh846\" (UID: \"b0b64988-41ac-4e49-bcfd-a08adebb37f7\") " pod="openshift-console-operator/console-operator-7866497494-wh846" Jul 14 04:59:33.554027 ip-10-0-136-9 kubenswrapper[2584]: I0714 04:59:33.554004 2584 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-service-ca-operator/service-ca-operator-7695fc6c8c-5j5s4"] Jul 14 04:59:33.554138 ip-10-0-136-9 kubenswrapper[2584]: I0714 04:59:33.554111 2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-799cb7f958-fkfct" Jul 14 04:59:33.557806 ip-10-0-136-9 kubenswrapper[2584]: I0714 04:59:33.557775 2584 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-insights/insights-operator-68d9dd94cf-wlmqg"] Jul 14 04:59:33.565824 ip-10-0-136-9 kubenswrapper[2584]: I0714 04:59:33.565803 2584 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-kube-storage-version-migrator-operator\"/\"kube-storage-version-migrator-operator-dockercfg-4jg82\"" Jul 14 04:59:33.566180 ip-10-0-136-9 kubenswrapper[2584]: I0714 04:59:33.566164 2584 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-kube-storage-version-migrator-operator\"/\"kube-root-ca.crt\"" Jul 14 04:59:33.566576 ip-10-0-136-9 kubenswrapper[2584]: I0714 04:59:33.566559 2584 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-kube-storage-version-migrator-operator\"/\"config\"" Jul 14 04:59:33.566856 ip-10-0-136-9 kubenswrapper[2584]: I0714 04:59:33.566838 2584 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-kube-storage-version-migrator-operator\"/\"openshift-service-ca.crt\"" Jul 14 04:59:33.566947 ip-10-0-136-9 kubenswrapper[2584]: I0714 04:59:33.566875 2584 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-kube-storage-version-migrator-operator\"/\"serving-cert\"" Jul 14 04:59:33.582131 ip-10-0-136-9 kubenswrapper[2584]: I0714 04:59:33.582109 2584 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress-canary/ingress-canary-2srpm"] Jul 14 04:59:33.582263 ip-10-0-136-9 kubenswrapper[2584]: I0714 04:59:33.582247 2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-operator-68d9dd94cf-wlmqg" Jul 14 04:59:33.586598 ip-10-0-136-9 kubenswrapper[2584]: I0714 04:59:33.586579 2584 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"openshift-insights-serving-cert\"" Jul 14 04:59:33.587094 ip-10-0-136-9 kubenswrapper[2584]: I0714 04:59:33.587061 2584 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"openshift-service-ca.crt\"" Jul 14 04:59:33.587400 ip-10-0-136-9 kubenswrapper[2584]: I0714 04:59:33.587383 2584 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"kube-root-ca.crt\"" Jul 14 04:59:33.588228 ip-10-0-136-9 kubenswrapper[2584]: I0714 04:59:33.588208 2584 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"operator-dockercfg-976vg\"" Jul 14 04:59:33.591634 ip-10-0-136-9 kubenswrapper[2584]: I0714 04:59:33.591615 2584 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"service-ca-bundle\"" Jul 14 04:59:33.607922 ip-10-0-136-9 kubenswrapper[2584]: I0714 04:59:33.607904 2584 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-cluster-samples-operator/cluster-samples-operator-65db858894-m6cp5"] Jul 14 04:59:33.608033 ip-10-0-136-9 kubenswrapper[2584]: I0714 04:59:33.608020 2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress-canary/ingress-canary-2srpm" Jul 14 04:59:33.615744 ip-10-0-136-9 kubenswrapper[2584]: I0714 04:59:33.615727 2584 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress-canary\"/\"kube-root-ca.crt\"" Jul 14 04:59:33.617016 ip-10-0-136-9 kubenswrapper[2584]: I0714 04:59:33.616988 2584 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress-canary\"/\"openshift-service-ca.crt\"" Jul 14 04:59:33.617160 ip-10-0-136-9 kubenswrapper[2584]: I0714 04:59:33.617145 2584 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-canary\"/\"canary-serving-cert\"" Jul 14 04:59:33.618696 ip-10-0-136-9 kubenswrapper[2584]: I0714 04:59:33.618676 2584 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"trusted-ca-bundle\"" Jul 14 04:59:33.618906 ip-10-0-136-9 kubenswrapper[2584]: I0714 04:59:33.618893 2584 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-canary\"/\"default-dockercfg-nm2tc\"" Jul 14 04:59:33.628068 ip-10-0-136-9 kubenswrapper[2584]: I0714 04:59:33.628028 2584 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-network-diagnostics/network-check-source-869dcfcdcd-d82p2"] Jul 14 04:59:33.628157 ip-10-0-136-9 kubenswrapper[2584]: I0714 04:59:33.628142 2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-samples-operator/cluster-samples-operator-65db858894-m6cp5" Jul 14 04:59:33.631485 ip-10-0-136-9 kubenswrapper[2584]: I0714 04:59:33.630954 2584 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-samples-operator\"/\"cluster-samples-operator-dockercfg-dnkn6\"" Jul 14 04:59:33.631485 ip-10-0-136-9 kubenswrapper[2584]: I0714 04:59:33.630984 2584 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-samples-operator\"/\"openshift-service-ca.crt\"" Jul 14 04:59:33.631485 ip-10-0-136-9 kubenswrapper[2584]: I0714 04:59:33.631233 2584 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-samples-operator\"/\"samples-operator-tls\"" Jul 14 04:59:33.631688 ip-10-0-136-9 kubenswrapper[2584]: I0714 04:59:33.631667 2584 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-samples-operator\"/\"kube-root-ca.crt\"" Jul 14 04:59:33.648304 ip-10-0-136-9 kubenswrapper[2584]: I0714 04:59:33.648289 2584 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/cluster-monitoring-operator-5f7f494dd4-9nsjr"] Jul 14 04:59:33.648418 ip-10-0-136-9 kubenswrapper[2584]: I0714 04:59:33.648401 2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-source-869dcfcdcd-d82p2" Jul 14 04:59:33.651099 ip-10-0-136-9 kubenswrapper[2584]: I0714 04:59:33.651084 2584 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"network-diagnostics-dockercfg-t892b\"" Jul 14 04:59:33.652533 ip-10-0-136-9 kubenswrapper[2584]: I0714 04:59:33.652185 2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-r5rrt\" (UniqueName: \"kubernetes.io/projected/15929c2d-1e38-4405-9353-644c191c8c43-kube-api-access-r5rrt\") pod \"kube-storage-version-migrator-operator-799cb7f958-fkfct\" (UID: \"15929c2d-1e38-4405-9353-644c191c8c43\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-799cb7f958-fkfct" Jul 14 04:59:33.652640 ip-10-0-136-9 kubenswrapper[2584]: I0714 04:59:33.652579 2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/d6fb944a-4c2d-4f24-a25b-e5a3067fe627-metrics-tls\") pod \"dns-default-gkwjs\" (UID: \"d6fb944a-4c2d-4f24-a25b-e5a3067fe627\") " pod="openshift-dns/dns-default-gkwjs" Jul 14 04:59:33.652640 ip-10-0-136-9 kubenswrapper[2584]: I0714 04:59:33.652627 2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/b0b64988-41ac-4e49-bcfd-a08adebb37f7-trusted-ca\") pod \"console-operator-7866497494-wh846\" (UID: \"b0b64988-41ac-4e49-bcfd-a08adebb37f7\") " pod="openshift-console-operator/console-operator-7866497494-wh846" Jul 14 04:59:33.652746 ip-10-0-136-9 kubenswrapper[2584]: I0714 04:59:33.652673 2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/6421bddc-6c3a-4ae2-9a6c-348d3de7aec9-registry-certificates\") pod \"image-registry-6f5d75bf47-rnc9m\" (UID: \"6421bddc-6c3a-4ae2-9a6c-348d3de7aec9\") " pod="openshift-image-registry/image-registry-6f5d75bf47-rnc9m" Jul 14 04:59:33.652746 ip-10-0-136-9 kubenswrapper[2584]: I0714 04:59:33.652706 2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/6421bddc-6c3a-4ae2-9a6c-348d3de7aec9-trusted-ca\") pod \"image-registry-6f5d75bf47-rnc9m\" (UID: \"6421bddc-6c3a-4ae2-9a6c-348d3de7aec9\") " pod="openshift-image-registry/image-registry-6f5d75bf47-rnc9m" Jul 14 04:59:33.652746 ip-10-0-136-9 kubenswrapper[2584]: I0714 04:59:33.652739 2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/90ab614b-66f6-4850-a0ac-0dc019099d3b-config\") pod \"service-ca-operator-7695fc6c8c-5j5s4\" (UID: \"90ab614b-66f6-4850-a0ac-0dc019099d3b\") " pod="openshift-service-ca-operator/service-ca-operator-7695fc6c8c-5j5s4" Jul 14 04:59:33.653416 ip-10-0-136-9 kubenswrapper[2584]: I0714 04:59:33.653395 2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/configmap/90ab614b-66f6-4850-a0ac-0dc019099d3b-config\") pod \"service-ca-operator-7695fc6c8c-5j5s4\" (UID: \"90ab614b-66f6-4850-a0ac-0dc019099d3b\") " pod="openshift-service-ca-operator/service-ca-operator-7695fc6c8c-5j5s4" Jul 14 04:59:33.653627 ip-10-0-136-9 kubenswrapper[2584]: I0714 04:59:33.653605 2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/6421bddc-6c3a-4ae2-9a6c-348d3de7aec9-installation-pull-secrets\") pod \"image-registry-6f5d75bf47-rnc9m\" (UID: \"6421bddc-6c3a-4ae2-9a6c-348d3de7aec9\") " pod="openshift-image-registry/image-registry-6f5d75bf47-rnc9m" Jul 14 04:59:33.653697 ip-10-0-136-9 kubenswrapper[2584]: I0714 04:59:33.653656 2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/b0b64988-41ac-4e49-bcfd-a08adebb37f7-config\") pod \"console-operator-7866497494-wh846\" (UID: \"b0b64988-41ac-4e49-bcfd-a08adebb37f7\") " pod="openshift-console-operator/console-operator-7866497494-wh846" Jul 14 04:59:33.653697 ip-10-0-136-9 kubenswrapper[2584]: I0714 04:59:33.653690 2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/15929c2d-1e38-4405-9353-644c191c8c43-serving-cert\") pod \"kube-storage-version-migrator-operator-799cb7f958-fkfct\" (UID: \"15929c2d-1e38-4405-9353-644c191c8c43\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-799cb7f958-fkfct" Jul 14 04:59:33.653789 ip-10-0-136-9 kubenswrapper[2584]: I0714 04:59:33.653738 2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-59vf2\" (UniqueName: \"kubernetes.io/projected/90b386b6-2530-4cde-9a0c-68e324286ba4-kube-api-access-59vf2\") pod \"volume-data-source-validator-78495597f6-qblzx\" (UID: \"90b386b6-2530-4cde-9a0c-68e324286ba4\") " pod="openshift-cluster-storage-operator/volume-data-source-validator-78495597f6-qblzx" Jul 14 04:59:33.653842 ip-10-0-136-9 kubenswrapper[2584]: I0714 04:59:33.653797 2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-x5jw2\" (UniqueName: \"kubernetes.io/projected/b0b64988-41ac-4e49-bcfd-a08adebb37f7-kube-api-access-x5jw2\") pod \"console-operator-7866497494-wh846\" (UID: \"b0b64988-41ac-4e49-bcfd-a08adebb37f7\") " pod="openshift-console-operator/console-operator-7866497494-wh846" Jul 14 04:59:33.653842 ip-10-0-136-9 kubenswrapper[2584]: I0714 04:59:33.653828 2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/6421bddc-6c3a-4ae2-9a6c-348d3de7aec9-image-registry-private-configuration\") pod \"image-registry-6f5d75bf47-rnc9m\" (UID: \"6421bddc-6c3a-4ae2-9a6c-348d3de7aec9\") " pod="openshift-image-registry/image-registry-6f5d75bf47-rnc9m" Jul 14 04:59:33.653952 ip-10-0-136-9 kubenswrapper[2584]: I0714 04:59:33.653857 2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-plq95\" (UniqueName: \"kubernetes.io/projected/6421bddc-6c3a-4ae2-9a6c-348d3de7aec9-kube-api-access-plq95\") pod \"image-registry-6f5d75bf47-rnc9m\" (UID: \"6421bddc-6c3a-4ae2-9a6c-348d3de7aec9\") " pod="openshift-image-registry/image-registry-6f5d75bf47-rnc9m" Jul 14 04:59:33.653952 ip-10-0-136-9 kubenswrapper[2584]: I0714 04:59:33.653887 2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/d6fb944a-4c2d-4f24-a25b-e5a3067fe627-config-volume\") pod \"dns-default-gkwjs\" (UID: \"d6fb944a-4c2d-4f24-a25b-e5a3067fe627\") " pod="openshift-dns/dns-default-gkwjs" Jul 14 04:59:33.653952 ip-10-0-136-9 kubenswrapper[2584]: I0714 04:59:33.653913 2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-9k8l2\" (UniqueName: \"kubernetes.io/projected/d6fb944a-4c2d-4f24-a25b-e5a3067fe627-kube-api-access-9k8l2\") pod \"dns-default-gkwjs\" (UID: \"d6fb944a-4c2d-4f24-a25b-e5a3067fe627\") " pod="openshift-dns/dns-default-gkwjs" Jul 14 04:59:33.654092 ip-10-0-136-9 kubenswrapper[2584]: I0714 04:59:33.653977 2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/b0b64988-41ac-4e49-bcfd-a08adebb37f7-serving-cert\") pod \"console-operator-7866497494-wh846\" (UID: \"b0b64988-41ac-4e49-bcfd-a08adebb37f7\") " pod="openshift-console-operator/console-operator-7866497494-wh846" Jul 14 04:59:33.654092 ip-10-0-136-9 kubenswrapper[2584]: I0714 04:59:33.654010 2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-d8l2f\" (UniqueName: \"kubernetes.io/projected/90ab614b-66f6-4850-a0ac-0dc019099d3b-kube-api-access-d8l2f\") pod \"service-ca-operator-7695fc6c8c-5j5s4\" (UID: \"90ab614b-66f6-4850-a0ac-0dc019099d3b\") " pod="openshift-service-ca-operator/service-ca-operator-7695fc6c8c-5j5s4" Jul 14 04:59:33.654092 ip-10-0-136-9 kubenswrapper[2584]: I0714 04:59:33.654037 2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/6421bddc-6c3a-4ae2-9a6c-348d3de7aec9-registry-tls\") pod \"image-registry-6f5d75bf47-rnc9m\" (UID: \"6421bddc-6c3a-4ae2-9a6c-348d3de7aec9\") " pod="openshift-image-registry/image-registry-6f5d75bf47-rnc9m" Jul 14 04:59:33.654092 ip-10-0-136-9 kubenswrapper[2584]: I0714 04:59:33.654066 2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/15929c2d-1e38-4405-9353-644c191c8c43-config\") pod \"kube-storage-version-migrator-operator-799cb7f958-fkfct\" (UID: \"15929c2d-1e38-4405-9353-644c191c8c43\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-799cb7f958-fkfct" Jul 14 04:59:33.654277 ip-10-0-136-9 kubenswrapper[2584]: I0714 04:59:33.654126 2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/6421bddc-6c3a-4ae2-9a6c-348d3de7aec9-ca-trust-extracted\") pod \"image-registry-6f5d75bf47-rnc9m\" (UID: \"6421bddc-6c3a-4ae2-9a6c-348d3de7aec9\") " pod="openshift-image-registry/image-registry-6f5d75bf47-rnc9m" Jul 14 04:59:33.654277 ip-10-0-136-9 kubenswrapper[2584]: I0714 04:59:33.654154 2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/6421bddc-6c3a-4ae2-9a6c-348d3de7aec9-bound-sa-token\") pod \"image-registry-6f5d75bf47-rnc9m\" (UID: \"6421bddc-6c3a-4ae2-9a6c-348d3de7aec9\") " pod="openshift-image-registry/image-registry-6f5d75bf47-rnc9m" Jul 14 04:59:33.654277 ip-10-0-136-9 kubenswrapper[2584]: I0714 04:59:33.654185 2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/d6fb944a-4c2d-4f24-a25b-e5a3067fe627-tmp-dir\") pod \"dns-default-gkwjs\" (UID: \"d6fb944a-4c2d-4f24-a25b-e5a3067fe627\") " pod="openshift-dns/dns-default-gkwjs" Jul 14 04:59:33.654277 ip-10-0-136-9 kubenswrapper[2584]: I0714 04:59:33.654226 2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/90ab614b-66f6-4850-a0ac-0dc019099d3b-serving-cert\") pod \"service-ca-operator-7695fc6c8c-5j5s4\" (UID: \"90ab614b-66f6-4850-a0ac-0dc019099d3b\") " pod="openshift-service-ca-operator/service-ca-operator-7695fc6c8c-5j5s4" Jul 14 04:59:33.654914 ip-10-0-136-9 kubenswrapper[2584]: I0714 04:59:33.654613 2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/b0b64988-41ac-4e49-bcfd-a08adebb37f7-trusted-ca\") pod \"console-operator-7866497494-wh846\" (UID: \"b0b64988-41ac-4e49-bcfd-a08adebb37f7\") " pod="openshift-console-operator/console-operator-7866497494-wh846" Jul 14 04:59:33.655357 ip-10-0-136-9 kubenswrapper[2584]: I0714 04:59:33.655335 2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/configmap/b0b64988-41ac-4e49-bcfd-a08adebb37f7-config\") pod \"console-operator-7866497494-wh846\" (UID: \"b0b64988-41ac-4e49-bcfd-a08adebb37f7\") " pod="openshift-console-operator/console-operator-7866497494-wh846" Jul 14 04:59:33.659102 ip-10-0-136-9 kubenswrapper[2584]: I0714 04:59:33.659081 2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/90ab614b-66f6-4850-a0ac-0dc019099d3b-serving-cert\") pod \"service-ca-operator-7695fc6c8c-5j5s4\" (UID: \"90ab614b-66f6-4850-a0ac-0dc019099d3b\") " pod="openshift-service-ca-operator/service-ca-operator-7695fc6c8c-5j5s4" Jul 14 04:59:33.659359 ip-10-0-136-9 kubenswrapper[2584]: I0714 04:59:33.659338 2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/b0b64988-41ac-4e49-bcfd-a08adebb37f7-serving-cert\") pod \"console-operator-7866497494-wh846\" (UID: \"b0b64988-41ac-4e49-bcfd-a08adebb37f7\") " pod="openshift-console-operator/console-operator-7866497494-wh846" Jul 14 04:59:33.666446 ip-10-0-136-9 kubenswrapper[2584]: I0714 04:59:33.666422 2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-x5jw2\" (UniqueName: \"kubernetes.io/projected/b0b64988-41ac-4e49-bcfd-a08adebb37f7-kube-api-access-x5jw2\") pod \"console-operator-7866497494-wh846\" (UID: \"b0b64988-41ac-4e49-bcfd-a08adebb37f7\") " pod="openshift-console-operator/console-operator-7866497494-wh846" Jul 14 04:59:33.667160 ip-10-0-136-9 kubenswrapper[2584]: I0714 04:59:33.667144 2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-d8l2f\" (UniqueName: \"kubernetes.io/projected/90ab614b-66f6-4850-a0ac-0dc019099d3b-kube-api-access-d8l2f\") pod \"service-ca-operator-7695fc6c8c-5j5s4\" (UID: \"90ab614b-66f6-4850-a0ac-0dc019099d3b\") " pod="openshift-service-ca-operator/service-ca-operator-7695fc6c8c-5j5s4" Jul 14 04:59:33.668257 ip-10-0-136-9 kubenswrapper[2584]: I0714 04:59:33.668241 2584 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/router-default-59f7f8d6b6-mb84v"] Jul 14 04:59:33.668369 ip-10-0-136-9 kubenswrapper[2584]: I0714 04:59:33.668353 2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/cluster-monitoring-operator-5f7f494dd4-9nsjr" Jul 14 04:59:33.675113 ip-10-0-136-9 kubenswrapper[2584]: I0714 04:59:33.675093 2584 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"cluster-monitoring-operator-tls\"" Jul 14 04:59:33.675113 ip-10-0-136-9 kubenswrapper[2584]: I0714 04:59:33.675100 2584 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"cluster-monitoring-operator-dockercfg-x95kg\"" Jul 14 04:59:33.675247 ip-10-0-136-9 kubenswrapper[2584]: I0714 04:59:33.675118 2584 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"telemetry-config\"" Jul 14 04:59:33.675247 ip-10-0-136-9 kubenswrapper[2584]: I0714 04:59:33.675112 2584 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"kube-root-ca.crt\"" Jul 14 04:59:33.675346 ip-10-0-136-9 kubenswrapper[2584]: I0714 04:59:33.675321 2584 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"openshift-service-ca.crt\"" Jul 14 04:59:33.690633 ip-10-0-136-9 kubenswrapper[2584]: I0714 04:59:33.690615 2584 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-7987957cd6-cl7xc"] Jul 14 04:59:33.690732 ip-10-0-136-9 kubenswrapper[2584]: I0714 04:59:33.690713 2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/router-default-59f7f8d6b6-mb84v" Jul 14 04:59:33.693493 ip-10-0-136-9 kubenswrapper[2584]: I0714 04:59:33.693460 2584 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"service-ca-bundle\"" Jul 14 04:59:33.693595 ip-10-0-136-9 kubenswrapper[2584]: I0714 04:59:33.693506 2584 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"kube-root-ca.crt\"" Jul 14 04:59:33.693595 ip-10-0-136-9 kubenswrapper[2584]: I0714 04:59:33.693462 2584 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"router-dockercfg-rc5ls\"" Jul 14 04:59:33.693595 ip-10-0-136-9 kubenswrapper[2584]: I0714 04:59:33.693462 2584 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"openshift-service-ca.crt\"" Jul 14 04:59:33.693810 ip-10-0-136-9 kubenswrapper[2584]: I0714 04:59:33.693774 2584 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"default-ingress-cert\"" Jul 14 04:59:33.693924 ip-10-0-136-9 kubenswrapper[2584]: I0714 04:59:33.693904 2584 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"router-stats-default\"" Jul 14 04:59:33.694031 ip-10-0-136-9 kubenswrapper[2584]: I0714 04:59:33.693908 2584 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"router-metrics-certs-default\"" Jul 14 04:59:33.701881 ip-10-0-136-9 kubenswrapper[2584]: I0714 04:59:33.701841 2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-g257n_15609856-4056-487b-acdd-30276263b098/konnectivity-agent/0.log" limit=1024 Jul 14 04:59:33.710835 ip-10-0-136-9 kubenswrapper[2584]: I0714 04:59:33.710816 2584 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["open-cluster-management-agent-addon/klusterlet-addon-workmgr-84c484c684-7bh48"] Jul 14 04:59:33.710958 ip-10-0-136-9 kubenswrapper[2584]: I0714 04:59:33.710925 2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-7987957cd6-cl7xc" Jul 14 04:59:33.714620 ip-10-0-136-9 kubenswrapper[2584]: I0714 04:59:33.714583 2584 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"managed-serviceaccount-dockercfg-t5sdk\"" Jul 14 04:59:33.714620 ip-10-0-136-9 kubenswrapper[2584]: I0714 04:59:33.714598 2584 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"open-cluster-management-agent-addon\"/\"kube-root-ca.crt\"" Jul 14 04:59:33.714778 ip-10-0-136-9 kubenswrapper[2584]: I0714 04:59:33.714645 2584 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"open-cluster-management-agent-addon\"/\"openshift-service-ca.crt\"" Jul 14 04:59:33.714778 ip-10-0-136-9 kubenswrapper[2584]: I0714 04:59:33.714656 2584 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"open-cluster-management-image-pull-credentials\"" Jul 14 04:59:33.714778 ip-10-0-136-9 kubenswrapper[2584]: I0714 04:59:33.714602 2584 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"managed-serviceaccount-hub-kubeconfig\"" Jul 14 04:59:33.726772 ip-10-0-136-9 kubenswrapper[2584]: I0714 04:59:33.726752 2584 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["open-cluster-management-agent-addon/cluster-proxy-proxy-agent-c55458774-qd8rk"] Jul 14 04:59:33.726897 ip-10-0-136-9 kubenswrapper[2584]: I0714 04:59:33.726884 2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-84c484c684-7bh48" Jul 14 04:59:33.729831 ip-10-0-136-9 kubenswrapper[2584]: I0714 04:59:33.729815 2584 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"work-manager-hub-kubeconfig\"" Jul 14 04:59:33.745401 ip-10-0-136-9 kubenswrapper[2584]: I0714 04:59:33.745386 2584 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console-operator/console-operator-7866497494-wh846"] Jul 14 04:59:33.745493 ip-10-0-136-9 kubenswrapper[2584]: I0714 04:59:33.745414 2584 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-cluster-storage-operator/volume-data-source-validator-78495597f6-qblzx"] Jul 14 04:59:33.745493 ip-10-0-136-9 kubenswrapper[2584]: I0714 04:59:33.745452 2584 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-image-registry/image-registry-6f5d75bf47-rnc9m"] Jul 14 04:59:33.745493 ip-10-0-136-9 kubenswrapper[2584]: I0714 04:59:33.745475 2584 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-dns/dns-default-gkwjs"] Jul 14 04:59:33.745493 ip-10-0-136-9 kubenswrapper[2584]: I0714 04:59:33.745488 2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-c55458774-qd8rk" Jul 14 04:59:33.745659 ip-10-0-136-9 kubenswrapper[2584]: I0714 04:59:33.745499 2584 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-799cb7f958-fkfct"] Jul 14 04:59:33.745659 ip-10-0-136-9 kubenswrapper[2584]: I0714 04:59:33.745519 2584 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress-canary/ingress-canary-2srpm"] Jul 14 04:59:33.745659 ip-10-0-136-9 kubenswrapper[2584]: I0714 04:59:33.745537 2584 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-cluster-samples-operator/cluster-samples-operator-65db858894-m6cp5"] Jul 14 04:59:33.745659 ip-10-0-136-9 kubenswrapper[2584]: I0714 04:59:33.745567 2584 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["open-cluster-management-agent-addon/klusterlet-addon-workmgr-84c484c684-7bh48"] Jul 14 04:59:33.745659 ip-10-0-136-9 kubenswrapper[2584]: I0714 04:59:33.745582 2584 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/cluster-monitoring-operator-5f7f494dd4-9nsjr"] Jul 14 04:59:33.745659 ip-10-0-136-9 kubenswrapper[2584]: I0714 04:59:33.745594 2584 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-7987957cd6-cl7xc"] Jul 14 04:59:33.745659 ip-10-0-136-9 kubenswrapper[2584]: I0714 04:59:33.745602 2584 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-source-869dcfcdcd-d82p2"] Jul 14 04:59:33.745659 ip-10-0-136-9 kubenswrapper[2584]: I0714 04:59:33.745614 2584 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/router-default-59f7f8d6b6-mb84v"] Jul 14 04:59:33.745659 ip-10-0-136-9 kubenswrapper[2584]: I0714 04:59:33.745625 2584 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-operator-68d9dd94cf-wlmqg"] Jul 14 04:59:33.745659 ip-10-0-136-9 kubenswrapper[2584]: I0714 04:59:33.745636 2584 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["open-cluster-management-agent-addon/cluster-proxy-proxy-agent-c55458774-qd8rk"] Jul 14 04:59:33.748620 ip-10-0-136-9 kubenswrapper[2584]: I0714 04:59:33.748373 2584 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"cluster-proxy-ca\"" Jul 14 04:59:33.748620 ip-10-0-136-9 kubenswrapper[2584]: I0714 04:59:33.748398 2584 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"cluster-proxy-hub-kubeconfig\"" Jul 14 04:59:33.748620 ip-10-0-136-9 kubenswrapper[2584]: I0714 04:59:33.748453 2584 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"cluster-proxy-service-proxy-server-certificates\"" Jul 14 04:59:33.748620 ip-10-0-136-9 kubenswrapper[2584]: I0714 04:59:33.748453 2584 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"cluster-proxy-open-cluster-management.io-proxy-agent-signer-client-cert\"" Jul 14 04:59:33.754713 ip-10-0-136-9 kubenswrapper[2584]: I0714 04:59:33.754691 2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-cdbdx\" (UniqueName: \"kubernetes.io/projected/13fb9031-3a05-4a3f-bbef-a2466ef852fb-kube-api-access-cdbdx\") pod \"cluster-samples-operator-65db858894-m6cp5\" (UID: \"13fb9031-3a05-4a3f-bbef-a2466ef852fb\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-65db858894-m6cp5" Jul 14 04:59:33.754866 ip-10-0-136-9 kubenswrapper[2584]: I0714 04:59:33.754724 2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"snapshots\" (UniqueName: \"kubernetes.io/empty-dir/32d1dfa7-69ec-4b39-b5c9-154f4774db02-snapshots\") pod \"insights-operator-68d9dd94cf-wlmqg\" (UID: \"32d1dfa7-69ec-4b39-b5c9-154f4774db02\") " pod="openshift-insights/insights-operator-68d9dd94cf-wlmqg" Jul 14 04:59:33.754866 ip-10-0-136-9 kubenswrapper[2584]: I0714 04:59:33.754749 2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/6421bddc-6c3a-4ae2-9a6c-348d3de7aec9-installation-pull-secrets\") pod \"image-registry-6f5d75bf47-rnc9m\" (UID: \"6421bddc-6c3a-4ae2-9a6c-348d3de7aec9\") " pod="openshift-image-registry/image-registry-6f5d75bf47-rnc9m" Jul 14 04:59:33.754866 ip-10-0-136-9 kubenswrapper[2584]: I0714 04:59:33.754796 2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-llzjx\" (UniqueName: \"kubernetes.io/projected/32d1dfa7-69ec-4b39-b5c9-154f4774db02-kube-api-access-llzjx\") pod \"insights-operator-68d9dd94cf-wlmqg\" (UID: \"32d1dfa7-69ec-4b39-b5c9-154f4774db02\") " pod="openshift-insights/insights-operator-68d9dd94cf-wlmqg" Jul 14 04:59:33.754866 ip-10-0-136-9 kubenswrapper[2584]: I0714 04:59:33.754831 2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-tsfdl\" (UniqueName: \"kubernetes.io/projected/eca5065c-f705-4c3f-b5d6-d445634581ac-kube-api-access-tsfdl\") pod \"network-check-source-869dcfcdcd-d82p2\" (UID: \"eca5065c-f705-4c3f-b5d6-d445634581ac\") " pod="openshift-network-diagnostics/network-check-source-869dcfcdcd-d82p2" Jul 14 04:59:33.755089 ip-10-0-136-9 kubenswrapper[2584]: I0714 04:59:33.754904 2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/32d1dfa7-69ec-4b39-b5c9-154f4774db02-trusted-ca-bundle\") pod \"insights-operator-68d9dd94cf-wlmqg\" (UID: \"32d1dfa7-69ec-4b39-b5c9-154f4774db02\") " pod="openshift-insights/insights-operator-68d9dd94cf-wlmqg" Jul 14 04:59:33.755089 ip-10-0-136-9 kubenswrapper[2584]: I0714 04:59:33.754952 2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/6421bddc-6c3a-4ae2-9a6c-348d3de7aec9-image-registry-private-configuration\") pod \"image-registry-6f5d75bf47-rnc9m\" (UID: \"6421bddc-6c3a-4ae2-9a6c-348d3de7aec9\") " pod="openshift-image-registry/image-registry-6f5d75bf47-rnc9m" Jul 14 04:59:33.755089 ip-10-0-136-9 kubenswrapper[2584]: I0714 04:59:33.754980 2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-25r5w\" (UniqueName: \"kubernetes.io/projected/95fdfeab-07ef-4e6d-96cc-2c7056d1c833-kube-api-access-25r5w\") pod \"cluster-monitoring-operator-5f7f494dd4-9nsjr\" (UID: \"95fdfeab-07ef-4e6d-96cc-2c7056d1c833\") " pod="openshift-monitoring/cluster-monitoring-operator-5f7f494dd4-9nsjr" Jul 14 04:59:33.755089 ip-10-0-136-9 kubenswrapper[2584]: I0714 04:59:33.755004 2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-plq95\" (UniqueName: \"kubernetes.io/projected/6421bddc-6c3a-4ae2-9a6c-348d3de7aec9-kube-api-access-plq95\") pod \"image-registry-6f5d75bf47-rnc9m\" (UID: \"6421bddc-6c3a-4ae2-9a6c-348d3de7aec9\") " pod="openshift-image-registry/image-registry-6f5d75bf47-rnc9m" Jul 14 04:59:33.755089 ip-10-0-136-9 kubenswrapper[2584]: I0714 04:59:33.755063 2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/d6fb944a-4c2d-4f24-a25b-e5a3067fe627-config-volume\") pod \"dns-default-gkwjs\" (UID: \"d6fb944a-4c2d-4f24-a25b-e5a3067fe627\") " pod="openshift-dns/dns-default-gkwjs" Jul 14 04:59:33.755346 ip-10-0-136-9 kubenswrapper[2584]: I0714 04:59:33.755193 2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/6421bddc-6c3a-4ae2-9a6c-348d3de7aec9-registry-tls\") pod \"image-registry-6f5d75bf47-rnc9m\" (UID: \"6421bddc-6c3a-4ae2-9a6c-348d3de7aec9\") " pod="openshift-image-registry/image-registry-6f5d75bf47-rnc9m" Jul 14 04:59:33.755346 ip-10-0-136-9 kubenswrapper[2584]: I0714 04:59:33.755229 2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/15929c2d-1e38-4405-9353-644c191c8c43-config\") pod \"kube-storage-version-migrator-operator-799cb7f958-fkfct\" (UID: \"15929c2d-1e38-4405-9353-644c191c8c43\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-799cb7f958-fkfct" Jul 14 04:59:33.755346 ip-10-0-136-9 kubenswrapper[2584]: I0714 04:59:33.755254 2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/344ca47f-b4c4-4592-94f6-93169c9eb55f-cert\") pod \"ingress-canary-2srpm\" (UID: \"344ca47f-b4c4-4592-94f6-93169c9eb55f\") " pod="openshift-ingress-canary/ingress-canary-2srpm" Jul 14 04:59:33.755346 ip-10-0-136-9 kubenswrapper[2584]: I0714 04:59:33.755276 2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/32d1dfa7-69ec-4b39-b5c9-154f4774db02-service-ca-bundle\") pod \"insights-operator-68d9dd94cf-wlmqg\" (UID: \"32d1dfa7-69ec-4b39-b5c9-154f4774db02\") " pod="openshift-insights/insights-operator-68d9dd94cf-wlmqg" Jul 14 04:59:33.755346 ip-10-0-136-9 kubenswrapper[2584]: I0714 04:59:33.755309 2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/6421bddc-6c3a-4ae2-9a6c-348d3de7aec9-bound-sa-token\") pod \"image-registry-6f5d75bf47-rnc9m\" (UID: \"6421bddc-6c3a-4ae2-9a6c-348d3de7aec9\") " pod="openshift-image-registry/image-registry-6f5d75bf47-rnc9m" Jul 14 04:59:33.755346 ip-10-0-136-9 kubenswrapper[2584]: E0714 04:59:33.755335 2584 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found Jul 14 04:59:33.755588 ip-10-0-136-9 kubenswrapper[2584]: E0714 04:59:33.755352 2584 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-6f5d75bf47-rnc9m: secret "image-registry-tls" not found Jul 14 04:59:33.755588 ip-10-0-136-9 kubenswrapper[2584]: E0714 04:59:33.755398 2584 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/6421bddc-6c3a-4ae2-9a6c-348d3de7aec9-registry-tls podName:6421bddc-6c3a-4ae2-9a6c-348d3de7aec9 nodeName:}" failed. No retries permitted until 2026-07-14 04:59:34.255380865 +0000 UTC m=+35.216636547 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/6421bddc-6c3a-4ae2-9a6c-348d3de7aec9-registry-tls") pod "image-registry-6f5d75bf47-rnc9m" (UID: "6421bddc-6c3a-4ae2-9a6c-348d3de7aec9") : secret "image-registry-tls" not found Jul 14 04:59:33.755689 ip-10-0-136-9 kubenswrapper[2584]: I0714 04:59:33.755338 2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/6421bddc-6c3a-4ae2-9a6c-348d3de7aec9-ca-trust-extracted\") pod \"image-registry-6f5d75bf47-rnc9m\" (UID: \"6421bddc-6c3a-4ae2-9a6c-348d3de7aec9\") " pod="openshift-image-registry/image-registry-6f5d75bf47-rnc9m" Jul 14 04:59:33.755689 ip-10-0-136-9 kubenswrapper[2584]: I0714 04:59:33.755621 2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/32d1dfa7-69ec-4b39-b5c9-154f4774db02-tmp\") pod \"insights-operator-68d9dd94cf-wlmqg\" (UID: \"32d1dfa7-69ec-4b39-b5c9-154f4774db02\") " pod="openshift-insights/insights-operator-68d9dd94cf-wlmqg" Jul 14 04:59:33.755689 ip-10-0-136-9 kubenswrapper[2584]: I0714 04:59:33.755658 2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/6421bddc-6c3a-4ae2-9a6c-348d3de7aec9-ca-trust-extracted\") pod \"image-registry-6f5d75bf47-rnc9m\" (UID: \"6421bddc-6c3a-4ae2-9a6c-348d3de7aec9\") " pod="openshift-image-registry/image-registry-6f5d75bf47-rnc9m" Jul 14 04:59:33.755689 ip-10-0-136-9 kubenswrapper[2584]: I0714 04:59:33.755672 2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/95fdfeab-07ef-4e6d-96cc-2c7056d1c833-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-5f7f494dd4-9nsjr\" (UID: \"95fdfeab-07ef-4e6d-96cc-2c7056d1c833\") " pod="openshift-monitoring/cluster-monitoring-operator-5f7f494dd4-9nsjr" Jul 14 04:59:33.755862 ip-10-0-136-9 kubenswrapper[2584]: I0714 04:59:33.755584 2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/d6fb944a-4c2d-4f24-a25b-e5a3067fe627-config-volume\") pod \"dns-default-gkwjs\" (UID: \"d6fb944a-4c2d-4f24-a25b-e5a3067fe627\") " pod="openshift-dns/dns-default-gkwjs" Jul 14 04:59:33.755862 ip-10-0-136-9 kubenswrapper[2584]: I0714 04:59:33.755713 2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-r5rrt\" (UniqueName: \"kubernetes.io/projected/15929c2d-1e38-4405-9353-644c191c8c43-kube-api-access-r5rrt\") pod \"kube-storage-version-migrator-operator-799cb7f958-fkfct\" (UID: \"15929c2d-1e38-4405-9353-644c191c8c43\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-799cb7f958-fkfct" Jul 14 04:59:33.755862 ip-10-0-136-9 kubenswrapper[2584]: I0714 04:59:33.755731 2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/configmap/15929c2d-1e38-4405-9353-644c191c8c43-config\") pod \"kube-storage-version-migrator-operator-799cb7f958-fkfct\" (UID: \"15929c2d-1e38-4405-9353-644c191c8c43\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-799cb7f958-fkfct" Jul 14 04:59:33.755862 ip-10-0-136-9 kubenswrapper[2584]: I0714 04:59:33.755753 2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/d6fb944a-4c2d-4f24-a25b-e5a3067fe627-metrics-tls\") pod \"dns-default-gkwjs\" (UID: \"d6fb944a-4c2d-4f24-a25b-e5a3067fe627\") " pod="openshift-dns/dns-default-gkwjs" Jul 14 04:59:33.755862 ip-10-0-136-9 kubenswrapper[2584]: I0714 04:59:33.755781 2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/6421bddc-6c3a-4ae2-9a6c-348d3de7aec9-trusted-ca\") pod \"image-registry-6f5d75bf47-rnc9m\" (UID: \"6421bddc-6c3a-4ae2-9a6c-348d3de7aec9\") " pod="openshift-image-registry/image-registry-6f5d75bf47-rnc9m" Jul 14 04:59:33.755862 ip-10-0-136-9 kubenswrapper[2584]: I0714 04:59:33.755806 2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-d2bqz\" (UniqueName: \"kubernetes.io/projected/344ca47f-b4c4-4592-94f6-93169c9eb55f-kube-api-access-d2bqz\") pod \"ingress-canary-2srpm\" (UID: \"344ca47f-b4c4-4592-94f6-93169c9eb55f\") " pod="openshift-ingress-canary/ingress-canary-2srpm" Jul 14 04:59:33.755862 ip-10-0-136-9 kubenswrapper[2584]: I0714 04:59:33.755832 2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/13fb9031-3a05-4a3f-bbef-a2466ef852fb-samples-operator-tls\") pod \"cluster-samples-operator-65db858894-m6cp5\" (UID: \"13fb9031-3a05-4a3f-bbef-a2466ef852fb\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-65db858894-m6cp5" Jul 14 04:59:33.755862 ip-10-0-136-9 kubenswrapper[2584]: I0714 04:59:33.755858 2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/32d1dfa7-69ec-4b39-b5c9-154f4774db02-serving-cert\") pod \"insights-operator-68d9dd94cf-wlmqg\" (UID: \"32d1dfa7-69ec-4b39-b5c9-154f4774db02\") " pod="openshift-insights/insights-operator-68d9dd94cf-wlmqg" Jul 14 04:59:33.756224 ip-10-0-136-9 kubenswrapper[2584]: I0714 04:59:33.755889 2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"telemetry-config\" (UniqueName: \"kubernetes.io/configmap/95fdfeab-07ef-4e6d-96cc-2c7056d1c833-telemetry-config\") pod \"cluster-monitoring-operator-5f7f494dd4-9nsjr\" (UID: \"95fdfeab-07ef-4e6d-96cc-2c7056d1c833\") " pod="openshift-monitoring/cluster-monitoring-operator-5f7f494dd4-9nsjr" Jul 14 04:59:33.756224 ip-10-0-136-9 kubenswrapper[2584]: I0714 04:59:33.755920 2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/15929c2d-1e38-4405-9353-644c191c8c43-serving-cert\") pod \"kube-storage-version-migrator-operator-799cb7f958-fkfct\" (UID: \"15929c2d-1e38-4405-9353-644c191c8c43\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-799cb7f958-fkfct" Jul 14 04:59:33.756224 ip-10-0-136-9 kubenswrapper[2584]: I0714 04:59:33.755983 2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-59vf2\" (UniqueName: \"kubernetes.io/projected/90b386b6-2530-4cde-9a0c-68e324286ba4-kube-api-access-59vf2\") pod \"volume-data-source-validator-78495597f6-qblzx\" (UID: \"90b386b6-2530-4cde-9a0c-68e324286ba4\") " pod="openshift-cluster-storage-operator/volume-data-source-validator-78495597f6-qblzx" Jul 14 04:59:33.756224 ip-10-0-136-9 kubenswrapper[2584]: I0714 04:59:33.756033 2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-9k8l2\" (UniqueName: \"kubernetes.io/projected/d6fb944a-4c2d-4f24-a25b-e5a3067fe627-kube-api-access-9k8l2\") pod \"dns-default-gkwjs\" (UID: \"d6fb944a-4c2d-4f24-a25b-e5a3067fe627\") " pod="openshift-dns/dns-default-gkwjs" Jul 14 04:59:33.756224 ip-10-0-136-9 kubenswrapper[2584]: I0714 04:59:33.756091 2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/6421bddc-6c3a-4ae2-9a6c-348d3de7aec9-registry-certificates\") pod \"image-registry-6f5d75bf47-rnc9m\" (UID: \"6421bddc-6c3a-4ae2-9a6c-348d3de7aec9\") " pod="openshift-image-registry/image-registry-6f5d75bf47-rnc9m" Jul 14 04:59:33.756224 ip-10-0-136-9 kubenswrapper[2584]: I0714 04:59:33.756121 2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/d6fb944a-4c2d-4f24-a25b-e5a3067fe627-tmp-dir\") pod \"dns-default-gkwjs\" (UID: \"d6fb944a-4c2d-4f24-a25b-e5a3067fe627\") " pod="openshift-dns/dns-default-gkwjs" Jul 14 04:59:33.756413 ip-10-0-136-9 kubenswrapper[2584]: I0714 04:59:33.756381 2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/d6fb944a-4c2d-4f24-a25b-e5a3067fe627-tmp-dir\") pod \"dns-default-gkwjs\" (UID: \"d6fb944a-4c2d-4f24-a25b-e5a3067fe627\") " pod="openshift-dns/dns-default-gkwjs" Jul 14 04:59:33.756526 ip-10-0-136-9 kubenswrapper[2584]: E0714 04:59:33.755865 2584 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jul 14 04:59:33.756604 ip-10-0-136-9 kubenswrapper[2584]: E0714 04:59:33.756590 2584 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/d6fb944a-4c2d-4f24-a25b-e5a3067fe627-metrics-tls podName:d6fb944a-4c2d-4f24-a25b-e5a3067fe627 nodeName:}" failed. No retries permitted until 2026-07-14 04:59:34.256551743 +0000 UTC m=+35.217807443 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/d6fb944a-4c2d-4f24-a25b-e5a3067fe627-metrics-tls") pod "dns-default-gkwjs" (UID: "d6fb944a-4c2d-4f24-a25b-e5a3067fe627") : secret "dns-default-metrics-tls" not found Jul 14 04:59:33.756723 ip-10-0-136-9 kubenswrapper[2584]: I0714 04:59:33.756700 2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/6421bddc-6c3a-4ae2-9a6c-348d3de7aec9-trusted-ca\") pod \"image-registry-6f5d75bf47-rnc9m\" (UID: \"6421bddc-6c3a-4ae2-9a6c-348d3de7aec9\") " pod="openshift-image-registry/image-registry-6f5d75bf47-rnc9m" Jul 14 04:59:33.756838 ip-10-0-136-9 kubenswrapper[2584]: I0714 04:59:33.756807 2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/6421bddc-6c3a-4ae2-9a6c-348d3de7aec9-registry-certificates\") pod \"image-registry-6f5d75bf47-rnc9m\" (UID: \"6421bddc-6c3a-4ae2-9a6c-348d3de7aec9\") " pod="openshift-image-registry/image-registry-6f5d75bf47-rnc9m" Jul 14 04:59:33.757487 ip-10-0-136-9 kubenswrapper[2584]: I0714 04:59:33.757464 2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/6421bddc-6c3a-4ae2-9a6c-348d3de7aec9-installation-pull-secrets\") pod \"image-registry-6f5d75bf47-rnc9m\" (UID: \"6421bddc-6c3a-4ae2-9a6c-348d3de7aec9\") " pod="openshift-image-registry/image-registry-6f5d75bf47-rnc9m" Jul 14 04:59:33.757656 ip-10-0-136-9 kubenswrapper[2584]: I0714 04:59:33.757623 2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/6421bddc-6c3a-4ae2-9a6c-348d3de7aec9-image-registry-private-configuration\") pod \"image-registry-6f5d75bf47-rnc9m\" (UID: \"6421bddc-6c3a-4ae2-9a6c-348d3de7aec9\") " pod="openshift-image-registry/image-registry-6f5d75bf47-rnc9m" Jul 14 04:59:33.758334 ip-10-0-136-9 kubenswrapper[2584]: I0714 04:59:33.758315 2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-service-ca-operator/service-ca-operator-7695fc6c8c-5j5s4" Jul 14 04:59:33.758489 ip-10-0-136-9 kubenswrapper[2584]: I0714 04:59:33.758467 2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/15929c2d-1e38-4405-9353-644c191c8c43-serving-cert\") pod \"kube-storage-version-migrator-operator-799cb7f958-fkfct\" (UID: \"15929c2d-1e38-4405-9353-644c191c8c43\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-799cb7f958-fkfct" Jul 14 04:59:33.764708 ip-10-0-136-9 kubenswrapper[2584]: I0714 04:59:33.764685 2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/6421bddc-6c3a-4ae2-9a6c-348d3de7aec9-bound-sa-token\") pod \"image-registry-6f5d75bf47-rnc9m\" (UID: \"6421bddc-6c3a-4ae2-9a6c-348d3de7aec9\") " pod="openshift-image-registry/image-registry-6f5d75bf47-rnc9m" Jul 14 04:59:33.765249 ip-10-0-136-9 kubenswrapper[2584]: I0714 04:59:33.765208 2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-plq95\" (UniqueName: \"kubernetes.io/projected/6421bddc-6c3a-4ae2-9a6c-348d3de7aec9-kube-api-access-plq95\") pod \"image-registry-6f5d75bf47-rnc9m\" (UID: \"6421bddc-6c3a-4ae2-9a6c-348d3de7aec9\") " pod="openshift-image-registry/image-registry-6f5d75bf47-rnc9m" Jul 14 04:59:33.765845 ip-10-0-136-9 kubenswrapper[2584]: I0714 04:59:33.765802 2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-9k8l2\" (UniqueName: \"kubernetes.io/projected/d6fb944a-4c2d-4f24-a25b-e5a3067fe627-kube-api-access-9k8l2\") pod \"dns-default-gkwjs\" (UID: \"d6fb944a-4c2d-4f24-a25b-e5a3067fe627\") " pod="openshift-dns/dns-default-gkwjs" Jul 14 04:59:33.766123 ip-10-0-136-9 kubenswrapper[2584]: I0714 04:59:33.766100 2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-59vf2\" (UniqueName: \"kubernetes.io/projected/90b386b6-2530-4cde-9a0c-68e324286ba4-kube-api-access-59vf2\") pod \"volume-data-source-validator-78495597f6-qblzx\" (UID: \"90b386b6-2530-4cde-9a0c-68e324286ba4\") " pod="openshift-cluster-storage-operator/volume-data-source-validator-78495597f6-qblzx" Jul 14 04:59:33.766288 ip-10-0-136-9 kubenswrapper[2584]: I0714 04:59:33.766272 2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-r5rrt\" (UniqueName: \"kubernetes.io/projected/15929c2d-1e38-4405-9353-644c191c8c43-kube-api-access-r5rrt\") pod \"kube-storage-version-migrator-operator-799cb7f958-fkfct\" (UID: \"15929c2d-1e38-4405-9353-644c191c8c43\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-799cb7f958-fkfct" Jul 14 04:59:33.776480 ip-10-0-136-9 kubenswrapper[2584]: I0714 04:59:33.776457 2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console-operator/console-operator-7866497494-wh846" Jul 14 04:59:33.792554 ip-10-0-136-9 kubenswrapper[2584]: I0714 04:59:33.792528 2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-g257n_15609856-4056-487b-acdd-30276263b098/konnectivity-agent/0.log" limit=1024 Jul 14 04:59:33.841667 ip-10-0-136-9 kubenswrapper[2584]: I0714 04:59:33.841644 2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-storage-operator/volume-data-source-validator-78495597f6-qblzx" Jul 14 04:59:33.857176 ip-10-0-136-9 kubenswrapper[2584]: I0714 04:59:33.857154 2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/32d1dfa7-69ec-4b39-b5c9-154f4774db02-trusted-ca-bundle\") pod \"insights-operator-68d9dd94cf-wlmqg\" (UID: \"32d1dfa7-69ec-4b39-b5c9-154f4774db02\") " pod="openshift-insights/insights-operator-68d9dd94cf-wlmqg" Jul 14 04:59:33.857259 ip-10-0-136-9 kubenswrapper[2584]: I0714 04:59:33.857187 2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"additional-service-ca\" (UniqueName: \"kubernetes.io/configmap/70e90187-8fc9-4b4c-8ca4-12659f64bd3c-additional-service-ca\") pod \"cluster-proxy-proxy-agent-c55458774-qd8rk\" (UID: \"70e90187-8fc9-4b4c-8ca4-12659f64bd3c\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-c55458774-qd8rk" Jul 14 04:59:33.857259 ip-10-0-136-9 kubenswrapper[2584]: I0714 04:59:33.857222 2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-25r5w\" (UniqueName: \"kubernetes.io/projected/95fdfeab-07ef-4e6d-96cc-2c7056d1c833-kube-api-access-25r5w\") pod \"cluster-monitoring-operator-5f7f494dd4-9nsjr\" (UID: \"95fdfeab-07ef-4e6d-96cc-2c7056d1c833\") " pod="openshift-monitoring/cluster-monitoring-operator-5f7f494dd4-9nsjr" Jul 14 04:59:33.857259 ip-10-0-136-9 kubenswrapper[2584]: I0714 04:59:33.857249 2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/c9f966c9-5bd6-4602-9a96-ea935895d2d9-metrics-certs\") pod \"router-default-59f7f8d6b6-mb84v\" (UID: \"c9f966c9-5bd6-4602-9a96-ea935895d2d9\") " pod="openshift-ingress/router-default-59f7f8d6b6-mb84v" Jul 14 04:59:33.857396 ip-10-0-136-9 kubenswrapper[2584]: I0714 04:59:33.857297 2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-proxy-server-cert\" (UniqueName: \"kubernetes.io/secret/70e90187-8fc9-4b4c-8ca4-12659f64bd3c-service-proxy-server-cert\") pod \"cluster-proxy-proxy-agent-c55458774-qd8rk\" (UID: \"70e90187-8fc9-4b4c-8ca4-12659f64bd3c\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-c55458774-qd8rk" Jul 14 04:59:33.857396 ip-10-0-136-9 kubenswrapper[2584]: I0714 04:59:33.857324 2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/344ca47f-b4c4-4592-94f6-93169c9eb55f-cert\") pod \"ingress-canary-2srpm\" (UID: \"344ca47f-b4c4-4592-94f6-93169c9eb55f\") " pod="openshift-ingress-canary/ingress-canary-2srpm" Jul 14 04:59:33.857481 ip-10-0-136-9 kubenswrapper[2584]: I0714 04:59:33.857460 2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/32d1dfa7-69ec-4b39-b5c9-154f4774db02-service-ca-bundle\") pod \"insights-operator-68d9dd94cf-wlmqg\" (UID: \"32d1dfa7-69ec-4b39-b5c9-154f4774db02\") " pod="openshift-insights/insights-operator-68d9dd94cf-wlmqg" Jul 14 04:59:33.857520 ip-10-0-136-9 kubenswrapper[2584]: I0714 04:59:33.857510 2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"stats-auth\" (UniqueName: \"kubernetes.io/secret/c9f966c9-5bd6-4602-9a96-ea935895d2d9-stats-auth\") pod \"router-default-59f7f8d6b6-mb84v\" (UID: \"c9f966c9-5bd6-4602-9a96-ea935895d2d9\") " pod="openshift-ingress/router-default-59f7f8d6b6-mb84v" Jul 14 04:59:33.857658 ip-10-0-136-9 kubenswrapper[2584]: I0714 04:59:33.857635 2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hub\" (UniqueName: \"kubernetes.io/secret/70e90187-8fc9-4b4c-8ca4-12659f64bd3c-hub\") pod \"cluster-proxy-proxy-agent-c55458774-qd8rk\" (UID: \"70e90187-8fc9-4b4c-8ca4-12659f64bd3c\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-c55458774-qd8rk" Jul 14 04:59:33.857754 ip-10-0-136-9 kubenswrapper[2584]: I0714 04:59:33.857671 2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hub-kubeconfig\" (UniqueName: \"kubernetes.io/secret/70e90187-8fc9-4b4c-8ca4-12659f64bd3c-hub-kubeconfig\") pod \"cluster-proxy-proxy-agent-c55458774-qd8rk\" (UID: \"70e90187-8fc9-4b4c-8ca4-12659f64bd3c\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-c55458774-qd8rk" Jul 14 04:59:33.857754 ip-10-0-136-9 kubenswrapper[2584]: I0714 04:59:33.857706 2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/32d1dfa7-69ec-4b39-b5c9-154f4774db02-tmp\") pod \"insights-operator-68d9dd94cf-wlmqg\" (UID: \"32d1dfa7-69ec-4b39-b5c9-154f4774db02\") " pod="openshift-insights/insights-operator-68d9dd94cf-wlmqg" Jul 14 04:59:33.857754 ip-10-0-136-9 kubenswrapper[2584]: I0714 04:59:33.857741 2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/95fdfeab-07ef-4e6d-96cc-2c7056d1c833-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-5f7f494dd4-9nsjr\" (UID: \"95fdfeab-07ef-4e6d-96cc-2c7056d1c833\") " pod="openshift-monitoring/cluster-monitoring-operator-5f7f494dd4-9nsjr" Jul 14 04:59:33.857903 ip-10-0-136-9 kubenswrapper[2584]: I0714 04:59:33.857788 2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-d2bqz\" (UniqueName: \"kubernetes.io/projected/344ca47f-b4c4-4592-94f6-93169c9eb55f-kube-api-access-d2bqz\") pod \"ingress-canary-2srpm\" (UID: \"344ca47f-b4c4-4592-94f6-93169c9eb55f\") " pod="openshift-ingress-canary/ingress-canary-2srpm" Jul 14 04:59:33.857903 ip-10-0-136-9 kubenswrapper[2584]: I0714 04:59:33.857815 2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/13fb9031-3a05-4a3f-bbef-a2466ef852fb-samples-operator-tls\") pod \"cluster-samples-operator-65db858894-m6cp5\" (UID: \"13fb9031-3a05-4a3f-bbef-a2466ef852fb\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-65db858894-m6cp5" Jul 14 04:59:33.857903 ip-10-0-136-9 kubenswrapper[2584]: I0714 04:59:33.857841 2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/32d1dfa7-69ec-4b39-b5c9-154f4774db02-serving-cert\") pod \"insights-operator-68d9dd94cf-wlmqg\" (UID: \"32d1dfa7-69ec-4b39-b5c9-154f4774db02\") " pod="openshift-insights/insights-operator-68d9dd94cf-wlmqg" Jul 14 04:59:33.857903 ip-10-0-136-9 kubenswrapper[2584]: I0714 04:59:33.857865 2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"telemetry-config\" (UniqueName: \"kubernetes.io/configmap/95fdfeab-07ef-4e6d-96cc-2c7056d1c833-telemetry-config\") pod \"cluster-monitoring-operator-5f7f494dd4-9nsjr\" (UID: \"95fdfeab-07ef-4e6d-96cc-2c7056d1c833\") " pod="openshift-monitoring/cluster-monitoring-operator-5f7f494dd4-9nsjr" Jul 14 04:59:33.857903 ip-10-0-136-9 kubenswrapper[2584]: I0714 04:59:33.857891 2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"default-certificate\" (UniqueName: \"kubernetes.io/secret/c9f966c9-5bd6-4602-9a96-ea935895d2d9-default-certificate\") pod \"router-default-59f7f8d6b6-mb84v\" (UID: \"c9f966c9-5bd6-4602-9a96-ea935895d2d9\") " pod="openshift-ingress/router-default-59f7f8d6b6-mb84v" Jul 14 04:59:33.858165 ip-10-0-136-9 kubenswrapper[2584]: I0714 04:59:33.857919 2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"klusterlet-config\" (UniqueName: \"kubernetes.io/secret/5f88b859-e251-41e9-8435-e0152a03d835-klusterlet-config\") pod \"klusterlet-addon-workmgr-84c484c684-7bh48\" (UID: \"5f88b859-e251-41e9-8435-e0152a03d835\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-84c484c684-7bh48" Jul 14 04:59:33.858165 ip-10-0-136-9 kubenswrapper[2584]: I0714 04:59:33.857981 2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hub-kubeconfig\" (UniqueName: \"kubernetes.io/secret/6bd66a53-26fb-407d-92ab-baadf5f92cff-hub-kubeconfig\") pod \"managed-serviceaccount-addon-agent-7987957cd6-cl7xc\" (UID: \"6bd66a53-26fb-407d-92ab-baadf5f92cff\") " pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-7987957cd6-cl7xc" Jul 14 04:59:33.858165 ip-10-0-136-9 kubenswrapper[2584]: I0714 04:59:33.858002 2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/32d1dfa7-69ec-4b39-b5c9-154f4774db02-service-ca-bundle\") pod \"insights-operator-68d9dd94cf-wlmqg\" (UID: \"32d1dfa7-69ec-4b39-b5c9-154f4774db02\") " pod="openshift-insights/insights-operator-68d9dd94cf-wlmqg" Jul 14 04:59:33.858165 ip-10-0-136-9 kubenswrapper[2584]: I0714 04:59:33.858010 2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-zmx2v\" (UniqueName: \"kubernetes.io/projected/c9f966c9-5bd6-4602-9a96-ea935895d2d9-kube-api-access-zmx2v\") pod \"router-default-59f7f8d6b6-mb84v\" (UID: \"c9f966c9-5bd6-4602-9a96-ea935895d2d9\") " pod="openshift-ingress/router-default-59f7f8d6b6-mb84v" Jul 14 04:59:33.858165 ip-10-0-136-9 kubenswrapper[2584]: I0714 04:59:33.858048 2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/32d1dfa7-69ec-4b39-b5c9-154f4774db02-tmp\") pod \"insights-operator-68d9dd94cf-wlmqg\" (UID: \"32d1dfa7-69ec-4b39-b5c9-154f4774db02\") " pod="openshift-insights/insights-operator-68d9dd94cf-wlmqg" Jul 14 04:59:33.858165 ip-10-0-136-9 kubenswrapper[2584]: I0714 04:59:33.858058 2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ca\" (UniqueName: \"kubernetes.io/secret/70e90187-8fc9-4b4c-8ca4-12659f64bd3c-ca\") pod \"cluster-proxy-proxy-agent-c55458774-qd8rk\" (UID: \"70e90187-8fc9-4b4c-8ca4-12659f64bd3c\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-c55458774-qd8rk" Jul 14 04:59:33.858165 ip-10-0-136-9 kubenswrapper[2584]: I0714 04:59:33.858068 2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/32d1dfa7-69ec-4b39-b5c9-154f4774db02-trusted-ca-bundle\") pod \"insights-operator-68d9dd94cf-wlmqg\" (UID: \"32d1dfa7-69ec-4b39-b5c9-154f4774db02\") " pod="openshift-insights/insights-operator-68d9dd94cf-wlmqg" Jul 14 04:59:33.858165 ip-10-0-136-9 kubenswrapper[2584]: E0714 04:59:33.858151 2584 secret.go:189] Couldn't get secret openshift-cluster-samples-operator/samples-operator-tls: secret "samples-operator-tls" not found Jul 14 04:59:33.858165 ip-10-0-136-9 kubenswrapper[2584]: E0714 04:59:33.858151 2584 secret.go:189] Couldn't get secret openshift-monitoring/cluster-monitoring-operator-tls: secret "cluster-monitoring-operator-tls" not found Jul 14 04:59:33.858581 ip-10-0-136-9 kubenswrapper[2584]: I0714 04:59:33.858190 2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-pl9d5\" (UniqueName: \"kubernetes.io/projected/6bd66a53-26fb-407d-92ab-baadf5f92cff-kube-api-access-pl9d5\") pod \"managed-serviceaccount-addon-agent-7987957cd6-cl7xc\" (UID: \"6bd66a53-26fb-407d-92ab-baadf5f92cff\") " pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-7987957cd6-cl7xc" Jul 14 04:59:33.858581 ip-10-0-136-9 kubenswrapper[2584]: E0714 04:59:33.858207 2584 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/95fdfeab-07ef-4e6d-96cc-2c7056d1c833-cluster-monitoring-operator-tls podName:95fdfeab-07ef-4e6d-96cc-2c7056d1c833 nodeName:}" failed. No retries permitted until 2026-07-14 04:59:34.358191293 +0000 UTC m=+35.319446980 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "cluster-monitoring-operator-tls" (UniqueName: "kubernetes.io/secret/95fdfeab-07ef-4e6d-96cc-2c7056d1c833-cluster-monitoring-operator-tls") pod "cluster-monitoring-operator-5f7f494dd4-9nsjr" (UID: "95fdfeab-07ef-4e6d-96cc-2c7056d1c833") : secret "cluster-monitoring-operator-tls" not found Jul 14 04:59:33.858581 ip-10-0-136-9 kubenswrapper[2584]: E0714 04:59:33.858283 2584 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/13fb9031-3a05-4a3f-bbef-a2466ef852fb-samples-operator-tls podName:13fb9031-3a05-4a3f-bbef-a2466ef852fb nodeName:}" failed. No retries permitted until 2026-07-14 04:59:34.358263279 +0000 UTC m=+35.319518974 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "samples-operator-tls" (UniqueName: "kubernetes.io/secret/13fb9031-3a05-4a3f-bbef-a2466ef852fb-samples-operator-tls") pod "cluster-samples-operator-65db858894-m6cp5" (UID: "13fb9031-3a05-4a3f-bbef-a2466ef852fb") : secret "samples-operator-tls" not found Jul 14 04:59:33.858581 ip-10-0-136-9 kubenswrapper[2584]: I0714 04:59:33.858352 2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-th487\" (UniqueName: \"kubernetes.io/projected/70e90187-8fc9-4b4c-8ca4-12659f64bd3c-kube-api-access-th487\") pod \"cluster-proxy-proxy-agent-c55458774-qd8rk\" (UID: \"70e90187-8fc9-4b4c-8ca4-12659f64bd3c\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-c55458774-qd8rk" Jul 14 04:59:33.858581 ip-10-0-136-9 kubenswrapper[2584]: I0714 04:59:33.858391 2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/c9f966c9-5bd6-4602-9a96-ea935895d2d9-service-ca-bundle\") pod \"router-default-59f7f8d6b6-mb84v\" (UID: \"c9f966c9-5bd6-4602-9a96-ea935895d2d9\") " pod="openshift-ingress/router-default-59f7f8d6b6-mb84v" Jul 14 04:59:33.858581 ip-10-0-136-9 kubenswrapper[2584]: I0714 04:59:33.858415 2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/5f88b859-e251-41e9-8435-e0152a03d835-tmp\") pod \"klusterlet-addon-workmgr-84c484c684-7bh48\" (UID: \"5f88b859-e251-41e9-8435-e0152a03d835\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-84c484c684-7bh48" Jul 14 04:59:33.858581 ip-10-0-136-9 kubenswrapper[2584]: I0714 04:59:33.858450 2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-cdbdx\" (UniqueName: \"kubernetes.io/projected/13fb9031-3a05-4a3f-bbef-a2466ef852fb-kube-api-access-cdbdx\") pod \"cluster-samples-operator-65db858894-m6cp5\" (UID: \"13fb9031-3a05-4a3f-bbef-a2466ef852fb\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-65db858894-m6cp5" Jul 14 04:59:33.858581 ip-10-0-136-9 kubenswrapper[2584]: I0714 04:59:33.858472 2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"snapshots\" (UniqueName: \"kubernetes.io/empty-dir/32d1dfa7-69ec-4b39-b5c9-154f4774db02-snapshots\") pod \"insights-operator-68d9dd94cf-wlmqg\" (UID: \"32d1dfa7-69ec-4b39-b5c9-154f4774db02\") " pod="openshift-insights/insights-operator-68d9dd94cf-wlmqg" Jul 14 04:59:33.858581 ip-10-0-136-9 kubenswrapper[2584]: I0714 04:59:33.858502 2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-llzjx\" (UniqueName: \"kubernetes.io/projected/32d1dfa7-69ec-4b39-b5c9-154f4774db02-kube-api-access-llzjx\") pod \"insights-operator-68d9dd94cf-wlmqg\" (UID: \"32d1dfa7-69ec-4b39-b5c9-154f4774db02\") " pod="openshift-insights/insights-operator-68d9dd94cf-wlmqg" Jul 14 04:59:33.858581 ip-10-0-136-9 kubenswrapper[2584]: I0714 04:59:33.858526 2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-tsfdl\" (UniqueName: \"kubernetes.io/projected/eca5065c-f705-4c3f-b5d6-d445634581ac-kube-api-access-tsfdl\") pod \"network-check-source-869dcfcdcd-d82p2\" (UID: \"eca5065c-f705-4c3f-b5d6-d445634581ac\") " pod="openshift-network-diagnostics/network-check-source-869dcfcdcd-d82p2" Jul 14 04:59:33.858581 ip-10-0-136-9 kubenswrapper[2584]: I0714 04:59:33.858551 2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-8xwfr\" (UniqueName: \"kubernetes.io/projected/5f88b859-e251-41e9-8435-e0152a03d835-kube-api-access-8xwfr\") pod \"klusterlet-addon-workmgr-84c484c684-7bh48\" (UID: \"5f88b859-e251-41e9-8435-e0152a03d835\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-84c484c684-7bh48" Jul 14 04:59:33.858581 ip-10-0-136-9 kubenswrapper[2584]: I0714 04:59:33.858576 2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"telemetry-config\" (UniqueName: \"kubernetes.io/configmap/95fdfeab-07ef-4e6d-96cc-2c7056d1c833-telemetry-config\") pod \"cluster-monitoring-operator-5f7f494dd4-9nsjr\" (UID: \"95fdfeab-07ef-4e6d-96cc-2c7056d1c833\") " pod="openshift-monitoring/cluster-monitoring-operator-5f7f494dd4-9nsjr" Jul 14 04:59:33.859157 ip-10-0-136-9 kubenswrapper[2584]: I0714 04:59:33.859065 2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"snapshots\" (UniqueName: \"kubernetes.io/empty-dir/32d1dfa7-69ec-4b39-b5c9-154f4774db02-snapshots\") pod \"insights-operator-68d9dd94cf-wlmqg\" (UID: \"32d1dfa7-69ec-4b39-b5c9-154f4774db02\") " pod="openshift-insights/insights-operator-68d9dd94cf-wlmqg" Jul 14 04:59:33.860177 ip-10-0-136-9 kubenswrapper[2584]: I0714 04:59:33.860149 2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/344ca47f-b4c4-4592-94f6-93169c9eb55f-cert\") pod \"ingress-canary-2srpm\" (UID: \"344ca47f-b4c4-4592-94f6-93169c9eb55f\") " pod="openshift-ingress-canary/ingress-canary-2srpm" Jul 14 04:59:33.860534 ip-10-0-136-9 kubenswrapper[2584]: I0714 04:59:33.860515 2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/32d1dfa7-69ec-4b39-b5c9-154f4774db02-serving-cert\") pod \"insights-operator-68d9dd94cf-wlmqg\" (UID: \"32d1dfa7-69ec-4b39-b5c9-154f4774db02\") " pod="openshift-insights/insights-operator-68d9dd94cf-wlmqg" Jul 14 04:59:33.867376 ip-10-0-136-9 kubenswrapper[2584]: I0714 04:59:33.867185 2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-25r5w\" (UniqueName: \"kubernetes.io/projected/95fdfeab-07ef-4e6d-96cc-2c7056d1c833-kube-api-access-25r5w\") pod \"cluster-monitoring-operator-5f7f494dd4-9nsjr\" (UID: \"95fdfeab-07ef-4e6d-96cc-2c7056d1c833\") " pod="openshift-monitoring/cluster-monitoring-operator-5f7f494dd4-9nsjr" Jul 14 04:59:33.867376 ip-10-0-136-9 kubenswrapper[2584]: I0714 04:59:33.867196 2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-799cb7f958-fkfct" Jul 14 04:59:33.867513 ip-10-0-136-9 kubenswrapper[2584]: I0714 04:59:33.867476 2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-d2bqz\" (UniqueName: \"kubernetes.io/projected/344ca47f-b4c4-4592-94f6-93169c9eb55f-kube-api-access-d2bqz\") pod \"ingress-canary-2srpm\" (UID: \"344ca47f-b4c4-4592-94f6-93169c9eb55f\") " pod="openshift-ingress-canary/ingress-canary-2srpm" Jul 14 04:59:33.867802 ip-10-0-136-9 kubenswrapper[2584]: I0714 04:59:33.867781 2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-cdbdx\" (UniqueName: \"kubernetes.io/projected/13fb9031-3a05-4a3f-bbef-a2466ef852fb-kube-api-access-cdbdx\") pod \"cluster-samples-operator-65db858894-m6cp5\" (UID: \"13fb9031-3a05-4a3f-bbef-a2466ef852fb\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-65db858894-m6cp5" Jul 14 04:59:33.869015 ip-10-0-136-9 kubenswrapper[2584]: I0714 04:59:33.868997 2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-llzjx\" (UniqueName: \"kubernetes.io/projected/32d1dfa7-69ec-4b39-b5c9-154f4774db02-kube-api-access-llzjx\") pod \"insights-operator-68d9dd94cf-wlmqg\" (UID: \"32d1dfa7-69ec-4b39-b5c9-154f4774db02\") " pod="openshift-insights/insights-operator-68d9dd94cf-wlmqg" Jul 14 04:59:33.869091 ip-10-0-136-9 kubenswrapper[2584]: I0714 04:59:33.869027 2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-tsfdl\" (UniqueName: \"kubernetes.io/projected/eca5065c-f705-4c3f-b5d6-d445634581ac-kube-api-access-tsfdl\") pod \"network-check-source-869dcfcdcd-d82p2\" (UID: \"eca5065c-f705-4c3f-b5d6-d445634581ac\") " pod="openshift-network-diagnostics/network-check-source-869dcfcdcd-d82p2" Jul 14 04:59:33.891670 ip-10-0-136-9 kubenswrapper[2584]: I0714 04:59:33.891621 2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-operator-68d9dd94cf-wlmqg" Jul 14 04:59:33.916899 ip-10-0-136-9 kubenswrapper[2584]: I0714 04:59:33.916880 2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress-canary/ingress-canary-2srpm" Jul 14 04:59:33.959173 ip-10-0-136-9 kubenswrapper[2584]: I0714 04:59:33.959147 2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-pl9d5\" (UniqueName: \"kubernetes.io/projected/6bd66a53-26fb-407d-92ab-baadf5f92cff-kube-api-access-pl9d5\") pod \"managed-serviceaccount-addon-agent-7987957cd6-cl7xc\" (UID: \"6bd66a53-26fb-407d-92ab-baadf5f92cff\") " pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-7987957cd6-cl7xc" Jul 14 04:59:33.959244 ip-10-0-136-9 kubenswrapper[2584]: I0714 04:59:33.959187 2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-th487\" (UniqueName: \"kubernetes.io/projected/70e90187-8fc9-4b4c-8ca4-12659f64bd3c-kube-api-access-th487\") pod \"cluster-proxy-proxy-agent-c55458774-qd8rk\" (UID: \"70e90187-8fc9-4b4c-8ca4-12659f64bd3c\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-c55458774-qd8rk" Jul 14 04:59:33.959244 ip-10-0-136-9 kubenswrapper[2584]: I0714 04:59:33.959230 2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/c9f966c9-5bd6-4602-9a96-ea935895d2d9-service-ca-bundle\") pod \"router-default-59f7f8d6b6-mb84v\" (UID: \"c9f966c9-5bd6-4602-9a96-ea935895d2d9\") " pod="openshift-ingress/router-default-59f7f8d6b6-mb84v" Jul 14 04:59:33.959336 ip-10-0-136-9 kubenswrapper[2584]: I0714 04:59:33.959268 2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/5f88b859-e251-41e9-8435-e0152a03d835-tmp\") pod \"klusterlet-addon-workmgr-84c484c684-7bh48\" (UID: \"5f88b859-e251-41e9-8435-e0152a03d835\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-84c484c684-7bh48" Jul 14 04:59:33.959336 ip-10-0-136-9 kubenswrapper[2584]: I0714 04:59:33.959306 2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-8xwfr\" (UniqueName: \"kubernetes.io/projected/5f88b859-e251-41e9-8435-e0152a03d835-kube-api-access-8xwfr\") pod \"klusterlet-addon-workmgr-84c484c684-7bh48\" (UID: \"5f88b859-e251-41e9-8435-e0152a03d835\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-84c484c684-7bh48" Jul 14 04:59:33.959427 ip-10-0-136-9 kubenswrapper[2584]: E0714 04:59:33.959405 2584 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/c9f966c9-5bd6-4602-9a96-ea935895d2d9-service-ca-bundle podName:c9f966c9-5bd6-4602-9a96-ea935895d2d9 nodeName:}" failed. No retries permitted until 2026-07-14 04:59:34.45938452 +0000 UTC m=+35.420640218 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "service-ca-bundle" (UniqueName: "kubernetes.io/configmap/c9f966c9-5bd6-4602-9a96-ea935895d2d9-service-ca-bundle") pod "router-default-59f7f8d6b6-mb84v" (UID: "c9f966c9-5bd6-4602-9a96-ea935895d2d9") : configmap references non-existent config key: service-ca.crt Jul 14 04:59:33.959482 ip-10-0-136-9 kubenswrapper[2584]: I0714 04:59:33.959445 2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"additional-service-ca\" (UniqueName: \"kubernetes.io/configmap/70e90187-8fc9-4b4c-8ca4-12659f64bd3c-additional-service-ca\") pod \"cluster-proxy-proxy-agent-c55458774-qd8rk\" (UID: \"70e90187-8fc9-4b4c-8ca4-12659f64bd3c\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-c55458774-qd8rk" Jul 14 04:59:33.959482 ip-10-0-136-9 kubenswrapper[2584]: I0714 04:59:33.959473 2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/c9f966c9-5bd6-4602-9a96-ea935895d2d9-metrics-certs\") pod \"router-default-59f7f8d6b6-mb84v\" (UID: \"c9f966c9-5bd6-4602-9a96-ea935895d2d9\") " pod="openshift-ingress/router-default-59f7f8d6b6-mb84v" Jul 14 04:59:33.959576 ip-10-0-136-9 kubenswrapper[2584]: I0714 04:59:33.959503 2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-proxy-server-cert\" (UniqueName: \"kubernetes.io/secret/70e90187-8fc9-4b4c-8ca4-12659f64bd3c-service-proxy-server-cert\") pod \"cluster-proxy-proxy-agent-c55458774-qd8rk\" (UID: \"70e90187-8fc9-4b4c-8ca4-12659f64bd3c\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-c55458774-qd8rk" Jul 14 04:59:33.959576 ip-10-0-136-9 kubenswrapper[2584]: I0714 04:59:33.959535 2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"stats-auth\" (UniqueName: \"kubernetes.io/secret/c9f966c9-5bd6-4602-9a96-ea935895d2d9-stats-auth\") pod \"router-default-59f7f8d6b6-mb84v\" (UID: \"c9f966c9-5bd6-4602-9a96-ea935895d2d9\") " pod="openshift-ingress/router-default-59f7f8d6b6-mb84v" Jul 14 04:59:33.959576 ip-10-0-136-9 kubenswrapper[2584]: I0714 04:59:33.959562 2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hub\" (UniqueName: \"kubernetes.io/secret/70e90187-8fc9-4b4c-8ca4-12659f64bd3c-hub\") pod \"cluster-proxy-proxy-agent-c55458774-qd8rk\" (UID: \"70e90187-8fc9-4b4c-8ca4-12659f64bd3c\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-c55458774-qd8rk" Jul 14 04:59:33.959712 ip-10-0-136-9 kubenswrapper[2584]: I0714 04:59:33.959585 2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hub-kubeconfig\" (UniqueName: \"kubernetes.io/secret/70e90187-8fc9-4b4c-8ca4-12659f64bd3c-hub-kubeconfig\") pod \"cluster-proxy-proxy-agent-c55458774-qd8rk\" (UID: \"70e90187-8fc9-4b4c-8ca4-12659f64bd3c\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-c55458774-qd8rk" Jul 14 04:59:33.959712 ip-10-0-136-9 kubenswrapper[2584]: E0714 04:59:33.959620 2584 secret.go:189] Couldn't get secret openshift-ingress/router-metrics-certs-default: secret "router-metrics-certs-default" not found Jul 14 04:59:33.959712 ip-10-0-136-9 kubenswrapper[2584]: I0714 04:59:33.959650 2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/5f88b859-e251-41e9-8435-e0152a03d835-tmp\") pod \"klusterlet-addon-workmgr-84c484c684-7bh48\" (UID: \"5f88b859-e251-41e9-8435-e0152a03d835\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-84c484c684-7bh48" Jul 14 04:59:33.959712 ip-10-0-136-9 kubenswrapper[2584]: E0714 04:59:33.959673 2584 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/c9f966c9-5bd6-4602-9a96-ea935895d2d9-metrics-certs podName:c9f966c9-5bd6-4602-9a96-ea935895d2d9 nodeName:}" failed. No retries permitted until 2026-07-14 04:59:34.459656415 +0000 UTC m=+35.420912103 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/c9f966c9-5bd6-4602-9a96-ea935895d2d9-metrics-certs") pod "router-default-59f7f8d6b6-mb84v" (UID: "c9f966c9-5bd6-4602-9a96-ea935895d2d9") : secret "router-metrics-certs-default" not found Jul 14 04:59:33.959712 ip-10-0-136-9 kubenswrapper[2584]: I0714 04:59:33.959690 2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"default-certificate\" (UniqueName: \"kubernetes.io/secret/c9f966c9-5bd6-4602-9a96-ea935895d2d9-default-certificate\") pod \"router-default-59f7f8d6b6-mb84v\" (UID: \"c9f966c9-5bd6-4602-9a96-ea935895d2d9\") " pod="openshift-ingress/router-default-59f7f8d6b6-mb84v" Jul 14 04:59:33.959973 ip-10-0-136-9 kubenswrapper[2584]: I0714 04:59:33.959718 2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"klusterlet-config\" (UniqueName: \"kubernetes.io/secret/5f88b859-e251-41e9-8435-e0152a03d835-klusterlet-config\") pod \"klusterlet-addon-workmgr-84c484c684-7bh48\" (UID: \"5f88b859-e251-41e9-8435-e0152a03d835\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-84c484c684-7bh48" Jul 14 04:59:33.959973 ip-10-0-136-9 kubenswrapper[2584]: I0714 04:59:33.959763 2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hub-kubeconfig\" (UniqueName: \"kubernetes.io/secret/6bd66a53-26fb-407d-92ab-baadf5f92cff-hub-kubeconfig\") pod \"managed-serviceaccount-addon-agent-7987957cd6-cl7xc\" (UID: \"6bd66a53-26fb-407d-92ab-baadf5f92cff\") " pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-7987957cd6-cl7xc" Jul 14 04:59:33.959973 ip-10-0-136-9 kubenswrapper[2584]: I0714 04:59:33.959795 2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-zmx2v\" (UniqueName: \"kubernetes.io/projected/c9f966c9-5bd6-4602-9a96-ea935895d2d9-kube-api-access-zmx2v\") pod \"router-default-59f7f8d6b6-mb84v\" (UID: \"c9f966c9-5bd6-4602-9a96-ea935895d2d9\") " pod="openshift-ingress/router-default-59f7f8d6b6-mb84v" Jul 14 04:59:33.959973 ip-10-0-136-9 kubenswrapper[2584]: I0714 04:59:33.959823 2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ca\" (UniqueName: \"kubernetes.io/secret/70e90187-8fc9-4b4c-8ca4-12659f64bd3c-ca\") pod \"cluster-proxy-proxy-agent-c55458774-qd8rk\" (UID: \"70e90187-8fc9-4b4c-8ca4-12659f64bd3c\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-c55458774-qd8rk" Jul 14 04:59:33.960192 ip-10-0-136-9 kubenswrapper[2584]: I0714 04:59:33.960170 2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"additional-service-ca\" (UniqueName: \"kubernetes.io/configmap/70e90187-8fc9-4b4c-8ca4-12659f64bd3c-additional-service-ca\") pod \"cluster-proxy-proxy-agent-c55458774-qd8rk\" (UID: \"70e90187-8fc9-4b4c-8ca4-12659f64bd3c\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-c55458774-qd8rk" Jul 14 04:59:33.962442 ip-10-0-136-9 kubenswrapper[2584]: I0714 04:59:33.962271 2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-source-869dcfcdcd-d82p2" Jul 14 04:59:33.963079 ip-10-0-136-9 kubenswrapper[2584]: I0714 04:59:33.963014 2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"stats-auth\" (UniqueName: \"kubernetes.io/secret/c9f966c9-5bd6-4602-9a96-ea935895d2d9-stats-auth\") pod \"router-default-59f7f8d6b6-mb84v\" (UID: \"c9f966c9-5bd6-4602-9a96-ea935895d2d9\") " pod="openshift-ingress/router-default-59f7f8d6b6-mb84v" Jul 14 04:59:33.966808 ip-10-0-136-9 kubenswrapper[2584]: I0714 04:59:33.963314 2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"hub-kubeconfig\" (UniqueName: \"kubernetes.io/secret/70e90187-8fc9-4b4c-8ca4-12659f64bd3c-hub-kubeconfig\") pod \"cluster-proxy-proxy-agent-c55458774-qd8rk\" (UID: \"70e90187-8fc9-4b4c-8ca4-12659f64bd3c\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-c55458774-qd8rk" Jul 14 04:59:33.966808 ip-10-0-136-9 kubenswrapper[2584]: I0714 04:59:33.963416 2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"service-proxy-server-cert\" (UniqueName: \"kubernetes.io/secret/70e90187-8fc9-4b4c-8ca4-12659f64bd3c-service-proxy-server-cert\") pod \"cluster-proxy-proxy-agent-c55458774-qd8rk\" (UID: \"70e90187-8fc9-4b4c-8ca4-12659f64bd3c\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-c55458774-qd8rk" Jul 14 04:59:33.966808 ip-10-0-136-9 kubenswrapper[2584]: I0714 04:59:33.963672 2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"hub\" (UniqueName: \"kubernetes.io/secret/70e90187-8fc9-4b4c-8ca4-12659f64bd3c-hub\") pod \"cluster-proxy-proxy-agent-c55458774-qd8rk\" (UID: \"70e90187-8fc9-4b4c-8ca4-12659f64bd3c\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-c55458774-qd8rk" Jul 14 04:59:33.966808 ip-10-0-136-9 kubenswrapper[2584]: I0714 04:59:33.963696 2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ca\" (UniqueName: \"kubernetes.io/secret/70e90187-8fc9-4b4c-8ca4-12659f64bd3c-ca\") pod \"cluster-proxy-proxy-agent-c55458774-qd8rk\" (UID: \"70e90187-8fc9-4b4c-8ca4-12659f64bd3c\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-c55458774-qd8rk" Jul 14 04:59:33.966808 ip-10-0-136-9 kubenswrapper[2584]: I0714 04:59:33.963916 2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"klusterlet-config\" (UniqueName: \"kubernetes.io/secret/5f88b859-e251-41e9-8435-e0152a03d835-klusterlet-config\") pod \"klusterlet-addon-workmgr-84c484c684-7bh48\" (UID: \"5f88b859-e251-41e9-8435-e0152a03d835\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-84c484c684-7bh48" Jul 14 04:59:33.966808 ip-10-0-136-9 kubenswrapper[2584]: I0714 04:59:33.964489 2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"hub-kubeconfig\" (UniqueName: \"kubernetes.io/secret/6bd66a53-26fb-407d-92ab-baadf5f92cff-hub-kubeconfig\") pod \"managed-serviceaccount-addon-agent-7987957cd6-cl7xc\" (UID: \"6bd66a53-26fb-407d-92ab-baadf5f92cff\") " pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-7987957cd6-cl7xc" Jul 14 04:59:33.968820 ip-10-0-136-9 kubenswrapper[2584]: I0714 04:59:33.968771 2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-th487\" (UniqueName: \"kubernetes.io/projected/70e90187-8fc9-4b4c-8ca4-12659f64bd3c-kube-api-access-th487\") pod \"cluster-proxy-proxy-agent-c55458774-qd8rk\" (UID: \"70e90187-8fc9-4b4c-8ca4-12659f64bd3c\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-c55458774-qd8rk" Jul 14 04:59:33.969893 ip-10-0-136-9 kubenswrapper[2584]: I0714 04:59:33.969822 2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"default-certificate\" (UniqueName: \"kubernetes.io/secret/c9f966c9-5bd6-4602-9a96-ea935895d2d9-default-certificate\") pod \"router-default-59f7f8d6b6-mb84v\" (UID: \"c9f966c9-5bd6-4602-9a96-ea935895d2d9\") " pod="openshift-ingress/router-default-59f7f8d6b6-mb84v" Jul 14 04:59:33.970179 ip-10-0-136-9 kubenswrapper[2584]: I0714 04:59:33.970149 2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-8xwfr\" (UniqueName: \"kubernetes.io/projected/5f88b859-e251-41e9-8435-e0152a03d835-kube-api-access-8xwfr\") pod \"klusterlet-addon-workmgr-84c484c684-7bh48\" (UID: \"5f88b859-e251-41e9-8435-e0152a03d835\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-84c484c684-7bh48" Jul 14 04:59:33.970179 ip-10-0-136-9 kubenswrapper[2584]: I0714 04:59:33.970166 2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-zmx2v\" (UniqueName: \"kubernetes.io/projected/c9f966c9-5bd6-4602-9a96-ea935895d2d9-kube-api-access-zmx2v\") pod \"router-default-59f7f8d6b6-mb84v\" (UID: \"c9f966c9-5bd6-4602-9a96-ea935895d2d9\") " pod="openshift-ingress/router-default-59f7f8d6b6-mb84v" Jul 14 04:59:33.970461 ip-10-0-136-9 kubenswrapper[2584]: I0714 04:59:33.970440 2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-pl9d5\" (UniqueName: \"kubernetes.io/projected/6bd66a53-26fb-407d-92ab-baadf5f92cff-kube-api-access-pl9d5\") pod \"managed-serviceaccount-addon-agent-7987957cd6-cl7xc\" (UID: \"6bd66a53-26fb-407d-92ab-baadf5f92cff\") " pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-7987957cd6-cl7xc" Jul 14 04:59:34.031632 ip-10-0-136-9 kubenswrapper[2584]: I0714 04:59:34.031605 2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-7987957cd6-cl7xc" Jul 14 04:59:34.038680 ip-10-0-136-9 kubenswrapper[2584]: I0714 04:59:34.038659 2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-84c484c684-7bh48" Jul 14 04:59:34.054763 ip-10-0-136-9 kubenswrapper[2584]: I0714 04:59:34.054746 2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-c55458774-qd8rk" Jul 14 04:59:34.263850 ip-10-0-136-9 kubenswrapper[2584]: I0714 04:59:34.263776 2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/6421bddc-6c3a-4ae2-9a6c-348d3de7aec9-registry-tls\") pod \"image-registry-6f5d75bf47-rnc9m\" (UID: \"6421bddc-6c3a-4ae2-9a6c-348d3de7aec9\") " pod="openshift-image-registry/image-registry-6f5d75bf47-rnc9m" Jul 14 04:59:34.263850 ip-10-0-136-9 kubenswrapper[2584]: I0714 04:59:34.263829 2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/d6fb944a-4c2d-4f24-a25b-e5a3067fe627-metrics-tls\") pod \"dns-default-gkwjs\" (UID: \"d6fb944a-4c2d-4f24-a25b-e5a3067fe627\") " pod="openshift-dns/dns-default-gkwjs" Jul 14 04:59:34.264366 ip-10-0-136-9 kubenswrapper[2584]: E0714 04:59:34.263949 2584 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found Jul 14 04:59:34.264366 ip-10-0-136-9 kubenswrapper[2584]: E0714 04:59:34.263965 2584 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-6f5d75bf47-rnc9m: secret "image-registry-tls" not found Jul 14 04:59:34.264366 ip-10-0-136-9 kubenswrapper[2584]: E0714 04:59:34.264020 2584 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/6421bddc-6c3a-4ae2-9a6c-348d3de7aec9-registry-tls podName:6421bddc-6c3a-4ae2-9a6c-348d3de7aec9 nodeName:}" failed. No retries permitted until 2026-07-14 04:59:35.264002947 +0000 UTC m=+36.225258649 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/6421bddc-6c3a-4ae2-9a6c-348d3de7aec9-registry-tls") pod "image-registry-6f5d75bf47-rnc9m" (UID: "6421bddc-6c3a-4ae2-9a6c-348d3de7aec9") : secret "image-registry-tls" not found Jul 14 04:59:34.264366 ip-10-0-136-9 kubenswrapper[2584]: E0714 04:59:34.264020 2584 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jul 14 04:59:34.264366 ip-10-0-136-9 kubenswrapper[2584]: E0714 04:59:34.264080 2584 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/d6fb944a-4c2d-4f24-a25b-e5a3067fe627-metrics-tls podName:d6fb944a-4c2d-4f24-a25b-e5a3067fe627 nodeName:}" failed. No retries permitted until 2026-07-14 04:59:35.264061782 +0000 UTC m=+36.225317464 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/d6fb944a-4c2d-4f24-a25b-e5a3067fe627-metrics-tls") pod "dns-default-gkwjs" (UID: "d6fb944a-4c2d-4f24-a25b-e5a3067fe627") : secret "dns-default-metrics-tls" not found Jul 14 04:59:34.364991 ip-10-0-136-9 kubenswrapper[2584]: I0714 04:59:34.364960 2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/95fdfeab-07ef-4e6d-96cc-2c7056d1c833-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-5f7f494dd4-9nsjr\" (UID: \"95fdfeab-07ef-4e6d-96cc-2c7056d1c833\") " pod="openshift-monitoring/cluster-monitoring-operator-5f7f494dd4-9nsjr" Jul 14 04:59:34.365150 ip-10-0-136-9 kubenswrapper[2584]: I0714 04:59:34.365007 2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/13fb9031-3a05-4a3f-bbef-a2466ef852fb-samples-operator-tls\") pod \"cluster-samples-operator-65db858894-m6cp5\" (UID: \"13fb9031-3a05-4a3f-bbef-a2466ef852fb\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-65db858894-m6cp5" Jul 14 04:59:34.365150 ip-10-0-136-9 kubenswrapper[2584]: E0714 04:59:34.365098 2584 secret.go:189] Couldn't get secret openshift-cluster-samples-operator/samples-operator-tls: secret "samples-operator-tls" not found Jul 14 04:59:34.365150 ip-10-0-136-9 kubenswrapper[2584]: E0714 04:59:34.365098 2584 secret.go:189] Couldn't get secret openshift-monitoring/cluster-monitoring-operator-tls: secret "cluster-monitoring-operator-tls" not found Jul 14 04:59:34.365258 ip-10-0-136-9 kubenswrapper[2584]: E0714 04:59:34.365157 2584 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/13fb9031-3a05-4a3f-bbef-a2466ef852fb-samples-operator-tls podName:13fb9031-3a05-4a3f-bbef-a2466ef852fb nodeName:}" failed. No retries permitted until 2026-07-14 04:59:35.365142917 +0000 UTC m=+36.326398600 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "samples-operator-tls" (UniqueName: "kubernetes.io/secret/13fb9031-3a05-4a3f-bbef-a2466ef852fb-samples-operator-tls") pod "cluster-samples-operator-65db858894-m6cp5" (UID: "13fb9031-3a05-4a3f-bbef-a2466ef852fb") : secret "samples-operator-tls" not found Jul 14 04:59:34.365258 ip-10-0-136-9 kubenswrapper[2584]: E0714 04:59:34.365202 2584 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/95fdfeab-07ef-4e6d-96cc-2c7056d1c833-cluster-monitoring-operator-tls podName:95fdfeab-07ef-4e6d-96cc-2c7056d1c833 nodeName:}" failed. No retries permitted until 2026-07-14 04:59:35.365183843 +0000 UTC m=+36.326439527 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "cluster-monitoring-operator-tls" (UniqueName: "kubernetes.io/secret/95fdfeab-07ef-4e6d-96cc-2c7056d1c833-cluster-monitoring-operator-tls") pod "cluster-monitoring-operator-5f7f494dd4-9nsjr" (UID: "95fdfeab-07ef-4e6d-96cc-2c7056d1c833") : secret "cluster-monitoring-operator-tls" not found Jul 14 04:59:34.466632 ip-10-0-136-9 kubenswrapper[2584]: I0714 04:59:34.466601 2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/c9f966c9-5bd6-4602-9a96-ea935895d2d9-service-ca-bundle\") pod \"router-default-59f7f8d6b6-mb84v\" (UID: \"c9f966c9-5bd6-4602-9a96-ea935895d2d9\") " pod="openshift-ingress/router-default-59f7f8d6b6-mb84v" Jul 14 04:59:34.466783 ip-10-0-136-9 kubenswrapper[2584]: I0714 04:59:34.466662 2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/c9f966c9-5bd6-4602-9a96-ea935895d2d9-metrics-certs\") pod \"router-default-59f7f8d6b6-mb84v\" (UID: \"c9f966c9-5bd6-4602-9a96-ea935895d2d9\") " pod="openshift-ingress/router-default-59f7f8d6b6-mb84v" Jul 14 04:59:34.466783 ip-10-0-136-9 kubenswrapper[2584]: E0714 04:59:34.466750 2584 secret.go:189] Couldn't get secret openshift-ingress/router-metrics-certs-default: secret "router-metrics-certs-default" not found Jul 14 04:59:34.466866 ip-10-0-136-9 kubenswrapper[2584]: E0714 04:59:34.466783 2584 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/c9f966c9-5bd6-4602-9a96-ea935895d2d9-service-ca-bundle podName:c9f966c9-5bd6-4602-9a96-ea935895d2d9 nodeName:}" failed. No retries permitted until 2026-07-14 04:59:35.466762446 +0000 UTC m=+36.428018133 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "service-ca-bundle" (UniqueName: "kubernetes.io/configmap/c9f966c9-5bd6-4602-9a96-ea935895d2d9-service-ca-bundle") pod "router-default-59f7f8d6b6-mb84v" (UID: "c9f966c9-5bd6-4602-9a96-ea935895d2d9") : configmap references non-existent config key: service-ca.crt Jul 14 04:59:34.466866 ip-10-0-136-9 kubenswrapper[2584]: E0714 04:59:34.466810 2584 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/c9f966c9-5bd6-4602-9a96-ea935895d2d9-metrics-certs podName:c9f966c9-5bd6-4602-9a96-ea935895d2d9 nodeName:}" failed. No retries permitted until 2026-07-14 04:59:35.46680003 +0000 UTC m=+36.428055712 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/c9f966c9-5bd6-4602-9a96-ea935895d2d9-metrics-certs") pod "router-default-59f7f8d6b6-mb84v" (UID: "c9f966c9-5bd6-4602-9a96-ea935895d2d9") : secret "router-metrics-certs-default" not found Jul 14 04:59:35.244995 ip-10-0-136-9 kubenswrapper[2584]: I0714 04:59:35.244506 2584 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-799cb7f958-fkfct"] Jul 14 04:59:35.262164 ip-10-0-136-9 kubenswrapper[2584]: I0714 04:59:35.259333 2584 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console-operator/console-operator-7866497494-wh846"] Jul 14 04:59:35.277078 ip-10-0-136-9 kubenswrapper[2584]: I0714 04:59:35.276508 2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/6421bddc-6c3a-4ae2-9a6c-348d3de7aec9-registry-tls\") pod \"image-registry-6f5d75bf47-rnc9m\" (UID: \"6421bddc-6c3a-4ae2-9a6c-348d3de7aec9\") " pod="openshift-image-registry/image-registry-6f5d75bf47-rnc9m" Jul 14 04:59:35.277078 ip-10-0-136-9 kubenswrapper[2584]: I0714 04:59:35.276598 2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/d6fb944a-4c2d-4f24-a25b-e5a3067fe627-metrics-tls\") pod \"dns-default-gkwjs\" (UID: \"d6fb944a-4c2d-4f24-a25b-e5a3067fe627\") " pod="openshift-dns/dns-default-gkwjs" Jul 14 04:59:35.277078 ip-10-0-136-9 kubenswrapper[2584]: E0714 04:59:35.276751 2584 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jul 14 04:59:35.277078 ip-10-0-136-9 kubenswrapper[2584]: E0714 04:59:35.276844 2584 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/d6fb944a-4c2d-4f24-a25b-e5a3067fe627-metrics-tls podName:d6fb944a-4c2d-4f24-a25b-e5a3067fe627 nodeName:}" failed. No retries permitted until 2026-07-14 04:59:37.276825588 +0000 UTC m=+38.238081286 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/d6fb944a-4c2d-4f24-a25b-e5a3067fe627-metrics-tls") pod "dns-default-gkwjs" (UID: "d6fb944a-4c2d-4f24-a25b-e5a3067fe627") : secret "dns-default-metrics-tls" not found Jul 14 04:59:35.277078 ip-10-0-136-9 kubenswrapper[2584]: E0714 04:59:35.276909 2584 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found Jul 14 04:59:35.277078 ip-10-0-136-9 kubenswrapper[2584]: E0714 04:59:35.276919 2584 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-6f5d75bf47-rnc9m: secret "image-registry-tls" not found Jul 14 04:59:35.277078 ip-10-0-136-9 kubenswrapper[2584]: E0714 04:59:35.276963 2584 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/6421bddc-6c3a-4ae2-9a6c-348d3de7aec9-registry-tls podName:6421bddc-6c3a-4ae2-9a6c-348d3de7aec9 nodeName:}" failed. No retries permitted until 2026-07-14 04:59:37.276952945 +0000 UTC m=+38.238208630 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/6421bddc-6c3a-4ae2-9a6c-348d3de7aec9-registry-tls") pod "image-registry-6f5d75bf47-rnc9m" (UID: "6421bddc-6c3a-4ae2-9a6c-348d3de7aec9") : secret "image-registry-tls" not found Jul 14 04:59:35.284446 ip-10-0-136-9 kubenswrapper[2584]: I0714 04:59:35.284379 2584 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-source-869dcfcdcd-d82p2"] Jul 14 04:59:35.288910 ip-10-0-136-9 kubenswrapper[2584]: W0714 04:59:35.288883 2584 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podeca5065c_f705_4c3f_b5d6_d445634581ac.slice/crio-251b36a2ec828240540bd631a5b38809828c50b4501b6e71d3681035ae30a79c WatchSource:0}: Error finding container 251b36a2ec828240540bd631a5b38809828c50b4501b6e71d3681035ae30a79c: Status 404 returned error can't find the container with id 251b36a2ec828240540bd631a5b38809828c50b4501b6e71d3681035ae30a79c Jul 14 04:59:35.294287 ip-10-0-136-9 kubenswrapper[2584]: I0714 04:59:35.294259 2584 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-7987957cd6-cl7xc"] Jul 14 04:59:35.297884 ip-10-0-136-9 kubenswrapper[2584]: W0714 04:59:35.297859 2584 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod6bd66a53_26fb_407d_92ab_baadf5f92cff.slice/crio-059c0072b97f54b28338d3dfa24ab10c9e5b74a6c2cb15a0077c7ce1064c555d WatchSource:0}: Error finding container 059c0072b97f54b28338d3dfa24ab10c9e5b74a6c2cb15a0077c7ce1064c555d: Status 404 returned error can't find the container with id 059c0072b97f54b28338d3dfa24ab10c9e5b74a6c2cb15a0077c7ce1064c555d Jul 14 04:59:35.301233 ip-10-0-136-9 kubenswrapper[2584]: I0714 04:59:35.301211 2584 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-operator-68d9dd94cf-wlmqg"] Jul 14 04:59:35.305609 ip-10-0-136-9 kubenswrapper[2584]: W0714 04:59:35.305581 2584 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod32d1dfa7_69ec_4b39_b5c9_154f4774db02.slice/crio-5d63fa8c23cf3fb5cf173ad99a96707973bbb2e7c339bf884342f4157d440d9b WatchSource:0}: Error finding container 5d63fa8c23cf3fb5cf173ad99a96707973bbb2e7c339bf884342f4157d440d9b: Status 404 returned error can't find the container with id 5d63fa8c23cf3fb5cf173ad99a96707973bbb2e7c339bf884342f4157d440d9b Jul 14 04:59:35.308836 ip-10-0-136-9 kubenswrapper[2584]: I0714 04:59:35.308816 2584 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress-canary/ingress-canary-2srpm"] Jul 14 04:59:35.311367 ip-10-0-136-9 kubenswrapper[2584]: W0714 04:59:35.311346 2584 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod344ca47f_b4c4_4592_94f6_93169c9eb55f.slice/crio-975cc848b78bb3891ae18f5409427bcbb581de3641cf38b3235950f0689b2b66 WatchSource:0}: Error finding container 975cc848b78bb3891ae18f5409427bcbb581de3641cf38b3235950f0689b2b66: Status 404 returned error can't find the container with id 975cc848b78bb3891ae18f5409427bcbb581de3641cf38b3235950f0689b2b66 Jul 14 04:59:35.317529 ip-10-0-136-9 kubenswrapper[2584]: I0714 04:59:35.317507 2584 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["open-cluster-management-agent-addon/klusterlet-addon-workmgr-84c484c684-7bh48"] Jul 14 04:59:35.320274 ip-10-0-136-9 kubenswrapper[2584]: W0714 04:59:35.320252 2584 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod5f88b859_e251_41e9_8435_e0152a03d835.slice/crio-6e536c6ab81b5e29c6d2078b34615d74257b8c9b1655535aa68020583549d816 WatchSource:0}: Error finding container 6e536c6ab81b5e29c6d2078b34615d74257b8c9b1655535aa68020583549d816: Status 404 returned error can't find the container with id 6e536c6ab81b5e29c6d2078b34615d74257b8c9b1655535aa68020583549d816 Jul 14 04:59:35.323355 ip-10-0-136-9 kubenswrapper[2584]: I0714 04:59:35.323303 2584 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-cluster-storage-operator/volume-data-source-validator-78495597f6-qblzx"] Jul 14 04:59:35.324533 ip-10-0-136-9 kubenswrapper[2584]: I0714 04:59:35.324512 2584 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-service-ca-operator/service-ca-operator-7695fc6c8c-5j5s4"] Jul 14 04:59:35.326897 ip-10-0-136-9 kubenswrapper[2584]: I0714 04:59:35.326744 2584 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["open-cluster-management-agent-addon/cluster-proxy-proxy-agent-c55458774-qd8rk"] Jul 14 04:59:35.327134 ip-10-0-136-9 kubenswrapper[2584]: W0714 04:59:35.327110 2584 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod90ab614b_66f6_4850_a0ac_0dc019099d3b.slice/crio-fb892bc672fb760463278db27f232fe87f66fabac09f9593833e6aa113f131aa WatchSource:0}: Error finding container fb892bc672fb760463278db27f232fe87f66fabac09f9593833e6aa113f131aa: Status 404 returned error can't find the container with id fb892bc672fb760463278db27f232fe87f66fabac09f9593833e6aa113f131aa Jul 14 04:59:35.328035 ip-10-0-136-9 kubenswrapper[2584]: W0714 04:59:35.328015 2584 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod90b386b6_2530_4cde_9a0c_68e324286ba4.slice/crio-7f8ba786a30845ec4a2c0e63085e507e0fc41bc9520813100d55cb259fb6af36 WatchSource:0}: Error finding container 7f8ba786a30845ec4a2c0e63085e507e0fc41bc9520813100d55cb259fb6af36: Status 404 returned error can't find the container with id 7f8ba786a30845ec4a2c0e63085e507e0fc41bc9520813100d55cb259fb6af36 Jul 14 04:59:35.329848 ip-10-0-136-9 kubenswrapper[2584]: W0714 04:59:35.329808 2584 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod70e90187_8fc9_4b4c_8ca4_12659f64bd3c.slice/crio-66cee6af48003018587bd3aa3425c2a84a56adb67a5e45f757485444ce8052d2 WatchSource:0}: Error finding container 66cee6af48003018587bd3aa3425c2a84a56adb67a5e45f757485444ce8052d2: Status 404 returned error can't find the container with id 66cee6af48003018587bd3aa3425c2a84a56adb67a5e45f757485444ce8052d2 Jul 14 04:59:35.377254 ip-10-0-136-9 kubenswrapper[2584]: I0714 04:59:35.377232 2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/95fdfeab-07ef-4e6d-96cc-2c7056d1c833-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-5f7f494dd4-9nsjr\" (UID: \"95fdfeab-07ef-4e6d-96cc-2c7056d1c833\") " pod="openshift-monitoring/cluster-monitoring-operator-5f7f494dd4-9nsjr" Jul 14 04:59:35.377351 ip-10-0-136-9 kubenswrapper[2584]: I0714 04:59:35.377273 2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/13fb9031-3a05-4a3f-bbef-a2466ef852fb-samples-operator-tls\") pod \"cluster-samples-operator-65db858894-m6cp5\" (UID: \"13fb9031-3a05-4a3f-bbef-a2466ef852fb\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-65db858894-m6cp5" Jul 14 04:59:35.377410 ip-10-0-136-9 kubenswrapper[2584]: E0714 04:59:35.377374 2584 secret.go:189] Couldn't get secret openshift-monitoring/cluster-monitoring-operator-tls: secret "cluster-monitoring-operator-tls" not found Jul 14 04:59:35.377465 ip-10-0-136-9 kubenswrapper[2584]: E0714 04:59:35.377412 2584 secret.go:189] Couldn't get secret openshift-cluster-samples-operator/samples-operator-tls: secret "samples-operator-tls" not found Jul 14 04:59:35.377465 ip-10-0-136-9 kubenswrapper[2584]: E0714 04:59:35.377425 2584 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/95fdfeab-07ef-4e6d-96cc-2c7056d1c833-cluster-monitoring-operator-tls podName:95fdfeab-07ef-4e6d-96cc-2c7056d1c833 nodeName:}" failed. No retries permitted until 2026-07-14 04:59:37.377410667 +0000 UTC m=+38.338666349 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "cluster-monitoring-operator-tls" (UniqueName: "kubernetes.io/secret/95fdfeab-07ef-4e6d-96cc-2c7056d1c833-cluster-monitoring-operator-tls") pod "cluster-monitoring-operator-5f7f494dd4-9nsjr" (UID: "95fdfeab-07ef-4e6d-96cc-2c7056d1c833") : secret "cluster-monitoring-operator-tls" not found Jul 14 04:59:35.377465 ip-10-0-136-9 kubenswrapper[2584]: E0714 04:59:35.377445 2584 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/13fb9031-3a05-4a3f-bbef-a2466ef852fb-samples-operator-tls podName:13fb9031-3a05-4a3f-bbef-a2466ef852fb nodeName:}" failed. No retries permitted until 2026-07-14 04:59:37.377435043 +0000 UTC m=+38.338690725 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "samples-operator-tls" (UniqueName: "kubernetes.io/secret/13fb9031-3a05-4a3f-bbef-a2466ef852fb-samples-operator-tls") pod "cluster-samples-operator-65db858894-m6cp5" (UID: "13fb9031-3a05-4a3f-bbef-a2466ef852fb") : secret "samples-operator-tls" not found Jul 14 04:59:35.478031 ip-10-0-136-9 kubenswrapper[2584]: I0714 04:59:35.477966 2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/c9f966c9-5bd6-4602-9a96-ea935895d2d9-service-ca-bundle\") pod \"router-default-59f7f8d6b6-mb84v\" (UID: \"c9f966c9-5bd6-4602-9a96-ea935895d2d9\") " pod="openshift-ingress/router-default-59f7f8d6b6-mb84v" Jul 14 04:59:35.478166 ip-10-0-136-9 kubenswrapper[2584]: I0714 04:59:35.478029 2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/c9f966c9-5bd6-4602-9a96-ea935895d2d9-metrics-certs\") pod \"router-default-59f7f8d6b6-mb84v\" (UID: \"c9f966c9-5bd6-4602-9a96-ea935895d2d9\") " pod="openshift-ingress/router-default-59f7f8d6b6-mb84v" Jul 14 04:59:35.478166 ip-10-0-136-9 kubenswrapper[2584]: E0714 04:59:35.478137 2584 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/c9f966c9-5bd6-4602-9a96-ea935895d2d9-service-ca-bundle podName:c9f966c9-5bd6-4602-9a96-ea935895d2d9 nodeName:}" failed. No retries permitted until 2026-07-14 04:59:37.478117814 +0000 UTC m=+38.439373516 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "service-ca-bundle" (UniqueName: "kubernetes.io/configmap/c9f966c9-5bd6-4602-9a96-ea935895d2d9-service-ca-bundle") pod "router-default-59f7f8d6b6-mb84v" (UID: "c9f966c9-5bd6-4602-9a96-ea935895d2d9") : configmap references non-existent config key: service-ca.crt Jul 14 04:59:35.478282 ip-10-0-136-9 kubenswrapper[2584]: E0714 04:59:35.478220 2584 secret.go:189] Couldn't get secret openshift-ingress/router-metrics-certs-default: secret "router-metrics-certs-default" not found Jul 14 04:59:35.478329 ip-10-0-136-9 kubenswrapper[2584]: E0714 04:59:35.478290 2584 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/c9f966c9-5bd6-4602-9a96-ea935895d2d9-metrics-certs podName:c9f966c9-5bd6-4602-9a96-ea935895d2d9 nodeName:}" failed. No retries permitted until 2026-07-14 04:59:37.47827236 +0000 UTC m=+38.439528046 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/c9f966c9-5bd6-4602-9a96-ea935895d2d9-metrics-certs") pod "router-default-59f7f8d6b6-mb84v" (UID: "c9f966c9-5bd6-4602-9a96-ea935895d2d9") : secret "router-metrics-certs-default" not found Jul 14 04:59:35.738599 ip-10-0-136-9 kubenswrapper[2584]: I0714 04:59:35.738517 2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-storage-operator/volume-data-source-validator-78495597f6-qblzx" event={"ID":"90b386b6-2530-4cde-9a0c-68e324286ba4","Type":"ContainerStarted","Data":"7f8ba786a30845ec4a2c0e63085e507e0fc41bc9520813100d55cb259fb6af36"} Jul 14 04:59:35.739662 ip-10-0-136-9 kubenswrapper[2584]: I0714 04:59:35.739631 2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-service-ca-operator/service-ca-operator-7695fc6c8c-5j5s4" event={"ID":"90ab614b-66f6-4850-a0ac-0dc019099d3b","Type":"ContainerStarted","Data":"fb892bc672fb760463278db27f232fe87f66fabac09f9593833e6aa113f131aa"} Jul 14 04:59:35.740756 ip-10-0-136-9 kubenswrapper[2584]: I0714 04:59:35.740730 2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-84c484c684-7bh48" event={"ID":"5f88b859-e251-41e9-8435-e0152a03d835","Type":"ContainerStarted","Data":"6e536c6ab81b5e29c6d2078b34615d74257b8c9b1655535aa68020583549d816"} Jul 14 04:59:35.741876 ip-10-0-136-9 kubenswrapper[2584]: I0714 04:59:35.741857 2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console-operator/console-operator-7866497494-wh846" event={"ID":"b0b64988-41ac-4e49-bcfd-a08adebb37f7","Type":"ContainerStarted","Data":"c2ba4ec77da2133c492eb3ec776f5742c09cde3b9b81da99f346d67d901653f8"} Jul 14 04:59:35.743062 ip-10-0-136-9 kubenswrapper[2584]: I0714 04:59:35.743041 2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-c55458774-qd8rk" event={"ID":"70e90187-8fc9-4b4c-8ca4-12659f64bd3c","Type":"ContainerStarted","Data":"66cee6af48003018587bd3aa3425c2a84a56adb67a5e45f757485444ce8052d2"} Jul 14 04:59:35.744252 ip-10-0-136-9 kubenswrapper[2584]: I0714 04:59:35.744217 2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress-canary/ingress-canary-2srpm" event={"ID":"344ca47f-b4c4-4592-94f6-93169c9eb55f","Type":"ContainerStarted","Data":"975cc848b78bb3891ae18f5409427bcbb581de3641cf38b3235950f0689b2b66"} Jul 14 04:59:35.747198 ip-10-0-136-9 kubenswrapper[2584]: I0714 04:59:35.747176 2584 generic.go:356] "Generic (PLEG): container finished" podID="c0a9d445-38bf-437d-bfbe-b6f937f91140" containerID="7404977b6d6156296d3cb80d0f76720667674b093fe0c3b1005599c849cac8a3" exitCode=0 Jul 14 04:59:35.747273 ip-10-0-136-9 kubenswrapper[2584]: I0714 04:59:35.747233 2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-48p6x" event={"ID":"c0a9d445-38bf-437d-bfbe-b6f937f91140","Type":"ContainerDied","Data":"7404977b6d6156296d3cb80d0f76720667674b093fe0c3b1005599c849cac8a3"} Jul 14 04:59:35.748532 ip-10-0-136-9 kubenswrapper[2584]: I0714 04:59:35.748511 2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-operator-68d9dd94cf-wlmqg" event={"ID":"32d1dfa7-69ec-4b39-b5c9-154f4774db02","Type":"ContainerStarted","Data":"5d63fa8c23cf3fb5cf173ad99a96707973bbb2e7c339bf884342f4157d440d9b"} Jul 14 04:59:35.749716 ip-10-0-136-9 kubenswrapper[2584]: I0714 04:59:35.749690 2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-799cb7f958-fkfct" event={"ID":"15929c2d-1e38-4405-9353-644c191c8c43","Type":"ContainerStarted","Data":"014860d1d70bee5640f85e5b734ed02d0704bd99da26dc9f8b42bc4c210aaf35"} Jul 14 04:59:35.750766 ip-10-0-136-9 kubenswrapper[2584]: I0714 04:59:35.750746 2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-7987957cd6-cl7xc" event={"ID":"6bd66a53-26fb-407d-92ab-baadf5f92cff","Type":"ContainerStarted","Data":"059c0072b97f54b28338d3dfa24ab10c9e5b74a6c2cb15a0077c7ce1064c555d"} Jul 14 04:59:35.751855 ip-10-0-136-9 kubenswrapper[2584]: I0714 04:59:35.751834 2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-source-869dcfcdcd-d82p2" event={"ID":"eca5065c-f705-4c3f-b5d6-d445634581ac","Type":"ContainerStarted","Data":"251b36a2ec828240540bd631a5b38809828c50b4501b6e71d3681035ae30a79c"} Jul 14 04:59:36.811976 ip-10-0-136-9 kubenswrapper[2584]: I0714 04:59:36.811771 2584 generic.go:356] "Generic (PLEG): container finished" podID="c0a9d445-38bf-437d-bfbe-b6f937f91140" containerID="e49714342d1bbdd31c77f9778d0a92dff5291ffa6b34ed3a9a50af42d4e5aa68" exitCode=0 Jul 14 04:59:36.811976 ip-10-0-136-9 kubenswrapper[2584]: I0714 04:59:36.811840 2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-48p6x" event={"ID":"c0a9d445-38bf-437d-bfbe-b6f937f91140","Type":"ContainerDied","Data":"e49714342d1bbdd31c77f9778d0a92dff5291ffa6b34ed3a9a50af42d4e5aa68"} Jul 14 04:59:37.298585 ip-10-0-136-9 kubenswrapper[2584]: I0714 04:59:37.297705 2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/6421bddc-6c3a-4ae2-9a6c-348d3de7aec9-registry-tls\") pod \"image-registry-6f5d75bf47-rnc9m\" (UID: \"6421bddc-6c3a-4ae2-9a6c-348d3de7aec9\") " pod="openshift-image-registry/image-registry-6f5d75bf47-rnc9m" Jul 14 04:59:37.298585 ip-10-0-136-9 kubenswrapper[2584]: I0714 04:59:37.298063 2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/d6fb944a-4c2d-4f24-a25b-e5a3067fe627-metrics-tls\") pod \"dns-default-gkwjs\" (UID: \"d6fb944a-4c2d-4f24-a25b-e5a3067fe627\") " pod="openshift-dns/dns-default-gkwjs" Jul 14 04:59:37.298585 ip-10-0-136-9 kubenswrapper[2584]: E0714 04:59:37.298230 2584 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jul 14 04:59:37.298585 ip-10-0-136-9 kubenswrapper[2584]: E0714 04:59:37.298293 2584 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/d6fb944a-4c2d-4f24-a25b-e5a3067fe627-metrics-tls podName:d6fb944a-4c2d-4f24-a25b-e5a3067fe627 nodeName:}" failed. No retries permitted until 2026-07-14 04:59:41.298273827 +0000 UTC m=+42.259529513 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/d6fb944a-4c2d-4f24-a25b-e5a3067fe627-metrics-tls") pod "dns-default-gkwjs" (UID: "d6fb944a-4c2d-4f24-a25b-e5a3067fe627") : secret "dns-default-metrics-tls" not found Jul 14 04:59:37.298585 ip-10-0-136-9 kubenswrapper[2584]: E0714 04:59:37.298456 2584 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found Jul 14 04:59:37.298585 ip-10-0-136-9 kubenswrapper[2584]: E0714 04:59:37.298480 2584 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-6f5d75bf47-rnc9m: secret "image-registry-tls" not found Jul 14 04:59:37.298585 ip-10-0-136-9 kubenswrapper[2584]: E0714 04:59:37.298541 2584 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/6421bddc-6c3a-4ae2-9a6c-348d3de7aec9-registry-tls podName:6421bddc-6c3a-4ae2-9a6c-348d3de7aec9 nodeName:}" failed. No retries permitted until 2026-07-14 04:59:41.298522836 +0000 UTC m=+42.259778527 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/6421bddc-6c3a-4ae2-9a6c-348d3de7aec9-registry-tls") pod "image-registry-6f5d75bf47-rnc9m" (UID: "6421bddc-6c3a-4ae2-9a6c-348d3de7aec9") : secret "image-registry-tls" not found Jul 14 04:59:37.399622 ip-10-0-136-9 kubenswrapper[2584]: I0714 04:59:37.399517 2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/95fdfeab-07ef-4e6d-96cc-2c7056d1c833-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-5f7f494dd4-9nsjr\" (UID: \"95fdfeab-07ef-4e6d-96cc-2c7056d1c833\") " pod="openshift-monitoring/cluster-monitoring-operator-5f7f494dd4-9nsjr" Jul 14 04:59:37.399622 ip-10-0-136-9 kubenswrapper[2584]: I0714 04:59:37.399580 2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/13fb9031-3a05-4a3f-bbef-a2466ef852fb-samples-operator-tls\") pod \"cluster-samples-operator-65db858894-m6cp5\" (UID: \"13fb9031-3a05-4a3f-bbef-a2466ef852fb\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-65db858894-m6cp5" Jul 14 04:59:37.399846 ip-10-0-136-9 kubenswrapper[2584]: E0714 04:59:37.399742 2584 secret.go:189] Couldn't get secret openshift-cluster-samples-operator/samples-operator-tls: secret "samples-operator-tls" not found Jul 14 04:59:37.399846 ip-10-0-136-9 kubenswrapper[2584]: E0714 04:59:37.399800 2584 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/13fb9031-3a05-4a3f-bbef-a2466ef852fb-samples-operator-tls podName:13fb9031-3a05-4a3f-bbef-a2466ef852fb nodeName:}" failed. No retries permitted until 2026-07-14 04:59:41.399782291 +0000 UTC m=+42.361037986 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "samples-operator-tls" (UniqueName: "kubernetes.io/secret/13fb9031-3a05-4a3f-bbef-a2466ef852fb-samples-operator-tls") pod "cluster-samples-operator-65db858894-m6cp5" (UID: "13fb9031-3a05-4a3f-bbef-a2466ef852fb") : secret "samples-operator-tls" not found Jul 14 04:59:37.400358 ip-10-0-136-9 kubenswrapper[2584]: E0714 04:59:37.400187 2584 secret.go:189] Couldn't get secret openshift-monitoring/cluster-monitoring-operator-tls: secret "cluster-monitoring-operator-tls" not found Jul 14 04:59:37.400358 ip-10-0-136-9 kubenswrapper[2584]: E0714 04:59:37.400242 2584 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/95fdfeab-07ef-4e6d-96cc-2c7056d1c833-cluster-monitoring-operator-tls podName:95fdfeab-07ef-4e6d-96cc-2c7056d1c833 nodeName:}" failed. No retries permitted until 2026-07-14 04:59:41.40022481 +0000 UTC m=+42.361480512 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "cluster-monitoring-operator-tls" (UniqueName: "kubernetes.io/secret/95fdfeab-07ef-4e6d-96cc-2c7056d1c833-cluster-monitoring-operator-tls") pod "cluster-monitoring-operator-5f7f494dd4-9nsjr" (UID: "95fdfeab-07ef-4e6d-96cc-2c7056d1c833") : secret "cluster-monitoring-operator-tls" not found Jul 14 04:59:37.500897 ip-10-0-136-9 kubenswrapper[2584]: I0714 04:59:37.500166 2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/c9f966c9-5bd6-4602-9a96-ea935895d2d9-metrics-certs\") pod \"router-default-59f7f8d6b6-mb84v\" (UID: \"c9f966c9-5bd6-4602-9a96-ea935895d2d9\") " pod="openshift-ingress/router-default-59f7f8d6b6-mb84v" Jul 14 04:59:37.500897 ip-10-0-136-9 kubenswrapper[2584]: I0714 04:59:37.500335 2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/c9f966c9-5bd6-4602-9a96-ea935895d2d9-service-ca-bundle\") pod \"router-default-59f7f8d6b6-mb84v\" (UID: \"c9f966c9-5bd6-4602-9a96-ea935895d2d9\") " pod="openshift-ingress/router-default-59f7f8d6b6-mb84v" Jul 14 04:59:37.500897 ip-10-0-136-9 kubenswrapper[2584]: E0714 04:59:37.500473 2584 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/c9f966c9-5bd6-4602-9a96-ea935895d2d9-service-ca-bundle podName:c9f966c9-5bd6-4602-9a96-ea935895d2d9 nodeName:}" failed. No retries permitted until 2026-07-14 04:59:41.500455825 +0000 UTC m=+42.461711513 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "service-ca-bundle" (UniqueName: "kubernetes.io/configmap/c9f966c9-5bd6-4602-9a96-ea935895d2d9-service-ca-bundle") pod "router-default-59f7f8d6b6-mb84v" (UID: "c9f966c9-5bd6-4602-9a96-ea935895d2d9") : configmap references non-existent config key: service-ca.crt Jul 14 04:59:37.500897 ip-10-0-136-9 kubenswrapper[2584]: E0714 04:59:37.500557 2584 secret.go:189] Couldn't get secret openshift-ingress/router-metrics-certs-default: secret "router-metrics-certs-default" not found Jul 14 04:59:37.500897 ip-10-0-136-9 kubenswrapper[2584]: E0714 04:59:37.500600 2584 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/c9f966c9-5bd6-4602-9a96-ea935895d2d9-metrics-certs podName:c9f966c9-5bd6-4602-9a96-ea935895d2d9 nodeName:}" failed. No retries permitted until 2026-07-14 04:59:41.500588789 +0000 UTC m=+42.461844474 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/c9f966c9-5bd6-4602-9a96-ea935895d2d9-metrics-certs") pod "router-default-59f7f8d6b6-mb84v" (UID: "c9f966c9-5bd6-4602-9a96-ea935895d2d9") : secret "router-metrics-certs-default" not found Jul 14 04:59:37.877024 ip-10-0-136-9 kubenswrapper[2584]: I0714 04:59:37.876982 2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-48p6x" event={"ID":"c0a9d445-38bf-437d-bfbe-b6f937f91140","Type":"ContainerStarted","Data":"cd6c9b068e6f2c520c1aeb5df685ffc82216ddb4e35da8201c37de555145e8b1"} Jul 14 04:59:37.903001 ip-10-0-136-9 kubenswrapper[2584]: I0714 04:59:37.902697 2584 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/multus-additional-cni-plugins-48p6x" podStartSLOduration=10.530453553 podStartE2EDuration="38.902677649s" totalImagesPullingTime="28.372224096s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-14 04:58:59 +0000 UTC" imagePullSessionsCount=5 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-14 04:59:37.899510868 +0000 UTC m=+38.860766574" watchObservedRunningTime="2026-07-14 04:59:37.902677649 +0000 UTC m=+38.863933345" Jul 14 04:59:38.024460 ip-10-0-136-9 kubenswrapper[2584]: I0714 04:59:38.024373 2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-g257n_15609856-4056-487b-acdd-30276263b098/konnectivity-agent/0.log" limit=1024 Jul 14 04:59:38.084473 ip-10-0-136-9 kubenswrapper[2584]: I0714 04:59:38.084211 2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-g257n_15609856-4056-487b-acdd-30276263b098/konnectivity-agent/0.log" limit=1024 Jul 14 04:59:39.501127 ip-10-0-136-9 kubenswrapper[2584]: I0714 04:59:39.500952 2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-g257n_15609856-4056-487b-acdd-30276263b098/konnectivity-agent/0.log" limit=1024 Jul 14 04:59:39.600440 ip-10-0-136-9 kubenswrapper[2584]: I0714 04:59:39.599623 2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-g257n_15609856-4056-487b-acdd-30276263b098/konnectivity-agent/0.log" limit=1024 Jul 14 04:59:41.193037 ip-10-0-136-9 kubenswrapper[2584]: I0714 04:59:41.192992 2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-g257n_15609856-4056-487b-acdd-30276263b098/konnectivity-agent/0.log" limit=1024 Jul 14 04:59:41.251493 ip-10-0-136-9 kubenswrapper[2584]: I0714 04:59:41.251459 2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-g257n_15609856-4056-487b-acdd-30276263b098/konnectivity-agent/0.log" limit=1024 Jul 14 04:59:41.338243 ip-10-0-136-9 kubenswrapper[2584]: I0714 04:59:41.338206 2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/6421bddc-6c3a-4ae2-9a6c-348d3de7aec9-registry-tls\") pod \"image-registry-6f5d75bf47-rnc9m\" (UID: \"6421bddc-6c3a-4ae2-9a6c-348d3de7aec9\") " pod="openshift-image-registry/image-registry-6f5d75bf47-rnc9m" Jul 14 04:59:41.338422 ip-10-0-136-9 kubenswrapper[2584]: E0714 04:59:41.338386 2584 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found Jul 14 04:59:41.338422 ip-10-0-136-9 kubenswrapper[2584]: E0714 04:59:41.338407 2584 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-6f5d75bf47-rnc9m: secret "image-registry-tls" not found Jul 14 04:59:41.338528 ip-10-0-136-9 kubenswrapper[2584]: E0714 04:59:41.338484 2584 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/6421bddc-6c3a-4ae2-9a6c-348d3de7aec9-registry-tls podName:6421bddc-6c3a-4ae2-9a6c-348d3de7aec9 nodeName:}" failed. No retries permitted until 2026-07-14 04:59:49.338463098 +0000 UTC m=+50.299718782 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/6421bddc-6c3a-4ae2-9a6c-348d3de7aec9-registry-tls") pod "image-registry-6f5d75bf47-rnc9m" (UID: "6421bddc-6c3a-4ae2-9a6c-348d3de7aec9") : secret "image-registry-tls" not found Jul 14 04:59:41.338528 ip-10-0-136-9 kubenswrapper[2584]: I0714 04:59:41.338389 2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/d6fb944a-4c2d-4f24-a25b-e5a3067fe627-metrics-tls\") pod \"dns-default-gkwjs\" (UID: \"d6fb944a-4c2d-4f24-a25b-e5a3067fe627\") " pod="openshift-dns/dns-default-gkwjs" Jul 14 04:59:41.338634 ip-10-0-136-9 kubenswrapper[2584]: E0714 04:59:41.338483 2584 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jul 14 04:59:41.338691 ip-10-0-136-9 kubenswrapper[2584]: E0714 04:59:41.338646 2584 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/d6fb944a-4c2d-4f24-a25b-e5a3067fe627-metrics-tls podName:d6fb944a-4c2d-4f24-a25b-e5a3067fe627 nodeName:}" failed. No retries permitted until 2026-07-14 04:59:49.338628478 +0000 UTC m=+50.299884200 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/d6fb944a-4c2d-4f24-a25b-e5a3067fe627-metrics-tls") pod "dns-default-gkwjs" (UID: "d6fb944a-4c2d-4f24-a25b-e5a3067fe627") : secret "dns-default-metrics-tls" not found Jul 14 04:59:41.439788 ip-10-0-136-9 kubenswrapper[2584]: I0714 04:59:41.439760 2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/95fdfeab-07ef-4e6d-96cc-2c7056d1c833-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-5f7f494dd4-9nsjr\" (UID: \"95fdfeab-07ef-4e6d-96cc-2c7056d1c833\") " pod="openshift-monitoring/cluster-monitoring-operator-5f7f494dd4-9nsjr" Jul 14 04:59:41.439957 ip-10-0-136-9 kubenswrapper[2584]: I0714 04:59:41.439801 2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/13fb9031-3a05-4a3f-bbef-a2466ef852fb-samples-operator-tls\") pod \"cluster-samples-operator-65db858894-m6cp5\" (UID: \"13fb9031-3a05-4a3f-bbef-a2466ef852fb\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-65db858894-m6cp5" Jul 14 04:59:41.439957 ip-10-0-136-9 kubenswrapper[2584]: E0714 04:59:41.439894 2584 secret.go:189] Couldn't get secret openshift-cluster-samples-operator/samples-operator-tls: secret "samples-operator-tls" not found Jul 14 04:59:41.439957 ip-10-0-136-9 kubenswrapper[2584]: E0714 04:59:41.439912 2584 secret.go:189] Couldn't get secret openshift-monitoring/cluster-monitoring-operator-tls: secret "cluster-monitoring-operator-tls" not found Jul 14 04:59:41.439957 ip-10-0-136-9 kubenswrapper[2584]: E0714 04:59:41.439954 2584 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/13fb9031-3a05-4a3f-bbef-a2466ef852fb-samples-operator-tls podName:13fb9031-3a05-4a3f-bbef-a2466ef852fb nodeName:}" failed. No retries permitted until 2026-07-14 04:59:49.439922651 +0000 UTC m=+50.401178334 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "samples-operator-tls" (UniqueName: "kubernetes.io/secret/13fb9031-3a05-4a3f-bbef-a2466ef852fb-samples-operator-tls") pod "cluster-samples-operator-65db858894-m6cp5" (UID: "13fb9031-3a05-4a3f-bbef-a2466ef852fb") : secret "samples-operator-tls" not found Jul 14 04:59:41.440141 ip-10-0-136-9 kubenswrapper[2584]: E0714 04:59:41.439993 2584 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/95fdfeab-07ef-4e6d-96cc-2c7056d1c833-cluster-monitoring-operator-tls podName:95fdfeab-07ef-4e6d-96cc-2c7056d1c833 nodeName:}" failed. No retries permitted until 2026-07-14 04:59:49.43998016 +0000 UTC m=+50.401235847 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "cluster-monitoring-operator-tls" (UniqueName: "kubernetes.io/secret/95fdfeab-07ef-4e6d-96cc-2c7056d1c833-cluster-monitoring-operator-tls") pod "cluster-monitoring-operator-5f7f494dd4-9nsjr" (UID: "95fdfeab-07ef-4e6d-96cc-2c7056d1c833") : secret "cluster-monitoring-operator-tls" not found Jul 14 04:59:41.541027 ip-10-0-136-9 kubenswrapper[2584]: I0714 04:59:41.540966 2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/c9f966c9-5bd6-4602-9a96-ea935895d2d9-service-ca-bundle\") pod \"router-default-59f7f8d6b6-mb84v\" (UID: \"c9f966c9-5bd6-4602-9a96-ea935895d2d9\") " pod="openshift-ingress/router-default-59f7f8d6b6-mb84v" Jul 14 04:59:41.541027 ip-10-0-136-9 kubenswrapper[2584]: I0714 04:59:41.541017 2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/c9f966c9-5bd6-4602-9a96-ea935895d2d9-metrics-certs\") pod \"router-default-59f7f8d6b6-mb84v\" (UID: \"c9f966c9-5bd6-4602-9a96-ea935895d2d9\") " pod="openshift-ingress/router-default-59f7f8d6b6-mb84v" Jul 14 04:59:41.541165 ip-10-0-136-9 kubenswrapper[2584]: E0714 04:59:41.541117 2584 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/c9f966c9-5bd6-4602-9a96-ea935895d2d9-service-ca-bundle podName:c9f966c9-5bd6-4602-9a96-ea935895d2d9 nodeName:}" failed. No retries permitted until 2026-07-14 04:59:49.54110023 +0000 UTC m=+50.502355933 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "service-ca-bundle" (UniqueName: "kubernetes.io/configmap/c9f966c9-5bd6-4602-9a96-ea935895d2d9-service-ca-bundle") pod "router-default-59f7f8d6b6-mb84v" (UID: "c9f966c9-5bd6-4602-9a96-ea935895d2d9") : configmap references non-existent config key: service-ca.crt Jul 14 04:59:41.541220 ip-10-0-136-9 kubenswrapper[2584]: E0714 04:59:41.541166 2584 secret.go:189] Couldn't get secret openshift-ingress/router-metrics-certs-default: secret "router-metrics-certs-default" not found Jul 14 04:59:41.541220 ip-10-0-136-9 kubenswrapper[2584]: E0714 04:59:41.541214 2584 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/c9f966c9-5bd6-4602-9a96-ea935895d2d9-metrics-certs podName:c9f966c9-5bd6-4602-9a96-ea935895d2d9 nodeName:}" failed. No retries permitted until 2026-07-14 04:59:49.541202656 +0000 UTC m=+50.502458341 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/c9f966c9-5bd6-4602-9a96-ea935895d2d9-metrics-certs") pod "router-default-59f7f8d6b6-mb84v" (UID: "c9f966c9-5bd6-4602-9a96-ea935895d2d9") : secret "router-metrics-certs-default" not found Jul 14 04:59:42.499663 ip-10-0-136-9 kubenswrapper[2584]: I0714 04:59:42.499623 2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-g257n_15609856-4056-487b-acdd-30276263b098/konnectivity-agent/0.log" limit=1024 Jul 14 04:59:42.605476 ip-10-0-136-9 kubenswrapper[2584]: I0714 04:59:42.605420 2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-g257n_15609856-4056-487b-acdd-30276263b098/konnectivity-agent/0.log" limit=1024 Jul 14 04:59:43.507226 ip-10-0-136-9 kubenswrapper[2584]: I0714 04:59:43.507188 2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-g257n_15609856-4056-487b-acdd-30276263b098/konnectivity-agent/0.log" limit=1024 Jul 14 04:59:43.603735 ip-10-0-136-9 kubenswrapper[2584]: I0714 04:59:43.603692 2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-g257n_15609856-4056-487b-acdd-30276263b098/konnectivity-agent/0.log" limit=1024 Jul 14 04:59:43.664712 ip-10-0-136-9 kubenswrapper[2584]: I0714 04:59:43.664675 2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-g257n_15609856-4056-487b-acdd-30276263b098/konnectivity-agent/0.log" limit=1024 Jul 14 04:59:44.734600 ip-10-0-136-9 kubenswrapper[2584]: I0714 04:59:44.734562 2584 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-network-console/networking-console-plugin-6cf856758c-4bfn6"] Jul 14 04:59:44.766669 ip-10-0-136-9 kubenswrapper[2584]: I0714 04:59:44.766641 2584 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-console/networking-console-plugin-6cf856758c-4bfn6"] Jul 14 04:59:44.766826 ip-10-0-136-9 kubenswrapper[2584]: I0714 04:59:44.766748 2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-console/networking-console-plugin-6cf856758c-4bfn6" Jul 14 04:59:44.769626 ip-10-0-136-9 kubenswrapper[2584]: I0714 04:59:44.769585 2584 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-console\"/\"networking-console-plugin-cert\"" Jul 14 04:59:44.769771 ip-10-0-136-9 kubenswrapper[2584]: I0714 04:59:44.769661 2584 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-console\"/\"default-dockercfg-rx69d\"" Jul 14 04:59:44.769771 ip-10-0-136-9 kubenswrapper[2584]: I0714 04:59:44.769593 2584 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-console\"/\"networking-console-plugin\"" Jul 14 04:59:44.867633 ip-10-0-136-9 kubenswrapper[2584]: I0714 04:59:44.867594 2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-g257n_15609856-4056-487b-acdd-30276263b098/konnectivity-agent/0.log" limit=1024 Jul 14 04:59:44.871761 ip-10-0-136-9 kubenswrapper[2584]: I0714 04:59:44.871725 2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/c27a6d7e-9146-4882-ba72-d2c22c209e03-networking-console-plugin-cert\") pod \"networking-console-plugin-6cf856758c-4bfn6\" (UID: \"c27a6d7e-9146-4882-ba72-d2c22c209e03\") " pod="openshift-network-console/networking-console-plugin-6cf856758c-4bfn6" Jul 14 04:59:44.871916 ip-10-0-136-9 kubenswrapper[2584]: I0714 04:59:44.871779 2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"nginx-conf\" (UniqueName: \"kubernetes.io/configmap/c27a6d7e-9146-4882-ba72-d2c22c209e03-nginx-conf\") pod \"networking-console-plugin-6cf856758c-4bfn6\" (UID: \"c27a6d7e-9146-4882-ba72-d2c22c209e03\") " pod="openshift-network-console/networking-console-plugin-6cf856758c-4bfn6" Jul 14 04:59:44.935444 ip-10-0-136-9 kubenswrapper[2584]: I0714 04:59:44.935406 2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-g257n_15609856-4056-487b-acdd-30276263b098/konnectivity-agent/0.log" limit=1024 Jul 14 04:59:44.972307 ip-10-0-136-9 kubenswrapper[2584]: I0714 04:59:44.972280 2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/c27a6d7e-9146-4882-ba72-d2c22c209e03-networking-console-plugin-cert\") pod \"networking-console-plugin-6cf856758c-4bfn6\" (UID: \"c27a6d7e-9146-4882-ba72-d2c22c209e03\") " pod="openshift-network-console/networking-console-plugin-6cf856758c-4bfn6" Jul 14 04:59:44.972438 ip-10-0-136-9 kubenswrapper[2584]: I0714 04:59:44.972312 2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"nginx-conf\" (UniqueName: \"kubernetes.io/configmap/c27a6d7e-9146-4882-ba72-d2c22c209e03-nginx-conf\") pod \"networking-console-plugin-6cf856758c-4bfn6\" (UID: \"c27a6d7e-9146-4882-ba72-d2c22c209e03\") " pod="openshift-network-console/networking-console-plugin-6cf856758c-4bfn6" Jul 14 04:59:44.972499 ip-10-0-136-9 kubenswrapper[2584]: E0714 04:59:44.972437 2584 secret.go:189] Couldn't get secret openshift-network-console/networking-console-plugin-cert: secret "networking-console-plugin-cert" not found Jul 14 04:59:44.972554 ip-10-0-136-9 kubenswrapper[2584]: E0714 04:59:44.972519 2584 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/c27a6d7e-9146-4882-ba72-d2c22c209e03-networking-console-plugin-cert podName:c27a6d7e-9146-4882-ba72-d2c22c209e03 nodeName:}" failed. No retries permitted until 2026-07-14 04:59:45.472500131 +0000 UTC m=+46.433755827 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "networking-console-plugin-cert" (UniqueName: "kubernetes.io/secret/c27a6d7e-9146-4882-ba72-d2c22c209e03-networking-console-plugin-cert") pod "networking-console-plugin-6cf856758c-4bfn6" (UID: "c27a6d7e-9146-4882-ba72-d2c22c209e03") : secret "networking-console-plugin-cert" not found Jul 14 04:59:44.972881 ip-10-0-136-9 kubenswrapper[2584]: I0714 04:59:44.972861 2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"nginx-conf\" (UniqueName: \"kubernetes.io/configmap/c27a6d7e-9146-4882-ba72-d2c22c209e03-nginx-conf\") pod \"networking-console-plugin-6cf856758c-4bfn6\" (UID: \"c27a6d7e-9146-4882-ba72-d2c22c209e03\") " pod="openshift-network-console/networking-console-plugin-6cf856758c-4bfn6" Jul 14 04:59:45.014132 ip-10-0-136-9 kubenswrapper[2584]: I0714 04:59:45.014073 2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-g257n_15609856-4056-487b-acdd-30276263b098/konnectivity-agent/0.log" limit=1024 Jul 14 04:59:45.082366 ip-10-0-136-9 kubenswrapper[2584]: I0714 04:59:45.082341 2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-g257n_15609856-4056-487b-acdd-30276263b098/konnectivity-agent/0.log" limit=1024 Jul 14 04:59:45.476906 ip-10-0-136-9 kubenswrapper[2584]: I0714 04:59:45.476860 2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/c27a6d7e-9146-4882-ba72-d2c22c209e03-networking-console-plugin-cert\") pod \"networking-console-plugin-6cf856758c-4bfn6\" (UID: \"c27a6d7e-9146-4882-ba72-d2c22c209e03\") " pod="openshift-network-console/networking-console-plugin-6cf856758c-4bfn6" Jul 14 04:59:45.477065 ip-10-0-136-9 kubenswrapper[2584]: E0714 04:59:45.477031 2584 secret.go:189] Couldn't get secret openshift-network-console/networking-console-plugin-cert: secret "networking-console-plugin-cert" not found Jul 14 04:59:45.477123 ip-10-0-136-9 kubenswrapper[2584]: E0714 04:59:45.477112 2584 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/c27a6d7e-9146-4882-ba72-d2c22c209e03-networking-console-plugin-cert podName:c27a6d7e-9146-4882-ba72-d2c22c209e03 nodeName:}" failed. No retries permitted until 2026-07-14 04:59:46.477088912 +0000 UTC m=+47.438344597 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "networking-console-plugin-cert" (UniqueName: "kubernetes.io/secret/c27a6d7e-9146-4882-ba72-d2c22c209e03-networking-console-plugin-cert") pod "networking-console-plugin-6cf856758c-4bfn6" (UID: "c27a6d7e-9146-4882-ba72-d2c22c209e03") : secret "networking-console-plugin-cert" not found Jul 14 04:59:46.485689 ip-10-0-136-9 kubenswrapper[2584]: I0714 04:59:46.485651 2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/c27a6d7e-9146-4882-ba72-d2c22c209e03-networking-console-plugin-cert\") pod \"networking-console-plugin-6cf856758c-4bfn6\" (UID: \"c27a6d7e-9146-4882-ba72-d2c22c209e03\") " pod="openshift-network-console/networking-console-plugin-6cf856758c-4bfn6" Jul 14 04:59:46.486058 ip-10-0-136-9 kubenswrapper[2584]: E0714 04:59:46.485800 2584 secret.go:189] Couldn't get secret openshift-network-console/networking-console-plugin-cert: secret "networking-console-plugin-cert" not found Jul 14 04:59:46.486058 ip-10-0-136-9 kubenswrapper[2584]: E0714 04:59:46.485863 2584 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/c27a6d7e-9146-4882-ba72-d2c22c209e03-networking-console-plugin-cert podName:c27a6d7e-9146-4882-ba72-d2c22c209e03 nodeName:}" failed. No retries permitted until 2026-07-14 04:59:48.485848593 +0000 UTC m=+49.447104275 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "networking-console-plugin-cert" (UniqueName: "kubernetes.io/secret/c27a6d7e-9146-4882-ba72-d2c22c209e03-networking-console-plugin-cert") pod "networking-console-plugin-6cf856758c-4bfn6" (UID: "c27a6d7e-9146-4882-ba72-d2c22c209e03") : secret "networking-console-plugin-cert" not found Jul 14 04:59:47.434097 ip-10-0-136-9 kubenswrapper[2584]: I0714 04:59:47.434052 2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-g257n_15609856-4056-487b-acdd-30276263b098/konnectivity-agent/0.log" limit=1024 Jul 14 04:59:47.565524 ip-10-0-136-9 kubenswrapper[2584]: I0714 04:59:47.565489 2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-g257n_15609856-4056-487b-acdd-30276263b098/konnectivity-agent/0.log" limit=1024 Jul 14 04:59:47.665765 ip-10-0-136-9 kubenswrapper[2584]: I0714 04:59:47.665723 2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-g257n_15609856-4056-487b-acdd-30276263b098/konnectivity-agent/0.log" limit=1024 Jul 14 04:59:47.769889 ip-10-0-136-9 kubenswrapper[2584]: I0714 04:59:47.769803 2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-g257n_15609856-4056-487b-acdd-30276263b098/konnectivity-agent/0.log" limit=1024 Jul 14 04:59:48.504092 ip-10-0-136-9 kubenswrapper[2584]: I0714 04:59:48.504061 2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/c27a6d7e-9146-4882-ba72-d2c22c209e03-networking-console-plugin-cert\") pod \"networking-console-plugin-6cf856758c-4bfn6\" (UID: \"c27a6d7e-9146-4882-ba72-d2c22c209e03\") " pod="openshift-network-console/networking-console-plugin-6cf856758c-4bfn6" Jul 14 04:59:48.504266 ip-10-0-136-9 kubenswrapper[2584]: E0714 04:59:48.504230 2584 secret.go:189] Couldn't get secret openshift-network-console/networking-console-plugin-cert: secret "networking-console-plugin-cert" not found Jul 14 04:59:48.504332 ip-10-0-136-9 kubenswrapper[2584]: E0714 04:59:48.504309 2584 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/c27a6d7e-9146-4882-ba72-d2c22c209e03-networking-console-plugin-cert podName:c27a6d7e-9146-4882-ba72-d2c22c209e03 nodeName:}" failed. No retries permitted until 2026-07-14 04:59:52.504288471 +0000 UTC m=+53.465544153 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "networking-console-plugin-cert" (UniqueName: "kubernetes.io/secret/c27a6d7e-9146-4882-ba72-d2c22c209e03-networking-console-plugin-cert") pod "networking-console-plugin-6cf856758c-4bfn6" (UID: "c27a6d7e-9146-4882-ba72-d2c22c209e03") : secret "networking-console-plugin-cert" not found Jul 14 04:59:48.507385 ip-10-0-136-9 kubenswrapper[2584]: I0714 04:59:48.507358 2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-g257n_15609856-4056-487b-acdd-30276263b098/konnectivity-agent/0.log" limit=1024 Jul 14 04:59:48.605604 ip-10-0-136-9 kubenswrapper[2584]: I0714 04:59:48.605568 2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-g257n_15609856-4056-487b-acdd-30276263b098/konnectivity-agent/0.log" limit=1024 Jul 14 04:59:49.413747 ip-10-0-136-9 kubenswrapper[2584]: I0714 04:59:49.412842 2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/6421bddc-6c3a-4ae2-9a6c-348d3de7aec9-registry-tls\") pod \"image-registry-6f5d75bf47-rnc9m\" (UID: \"6421bddc-6c3a-4ae2-9a6c-348d3de7aec9\") " pod="openshift-image-registry/image-registry-6f5d75bf47-rnc9m" Jul 14 04:59:49.413747 ip-10-0-136-9 kubenswrapper[2584]: I0714 04:59:49.412969 2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/d6fb944a-4c2d-4f24-a25b-e5a3067fe627-metrics-tls\") pod \"dns-default-gkwjs\" (UID: \"d6fb944a-4c2d-4f24-a25b-e5a3067fe627\") " pod="openshift-dns/dns-default-gkwjs" Jul 14 04:59:49.413747 ip-10-0-136-9 kubenswrapper[2584]: E0714 04:59:49.413225 2584 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jul 14 04:59:49.413747 ip-10-0-136-9 kubenswrapper[2584]: E0714 04:59:49.413282 2584 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/d6fb944a-4c2d-4f24-a25b-e5a3067fe627-metrics-tls podName:d6fb944a-4c2d-4f24-a25b-e5a3067fe627 nodeName:}" failed. No retries permitted until 2026-07-14 05:00:05.413263325 +0000 UTC m=+66.374519027 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/d6fb944a-4c2d-4f24-a25b-e5a3067fe627-metrics-tls") pod "dns-default-gkwjs" (UID: "d6fb944a-4c2d-4f24-a25b-e5a3067fe627") : secret "dns-default-metrics-tls" not found Jul 14 04:59:49.413747 ip-10-0-136-9 kubenswrapper[2584]: E0714 04:59:49.413661 2584 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found Jul 14 04:59:49.413747 ip-10-0-136-9 kubenswrapper[2584]: E0714 04:59:49.413677 2584 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-6f5d75bf47-rnc9m: secret "image-registry-tls" not found Jul 14 04:59:49.413747 ip-10-0-136-9 kubenswrapper[2584]: E0714 04:59:49.413720 2584 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/6421bddc-6c3a-4ae2-9a6c-348d3de7aec9-registry-tls podName:6421bddc-6c3a-4ae2-9a6c-348d3de7aec9 nodeName:}" failed. No retries permitted until 2026-07-14 05:00:05.413705364 +0000 UTC m=+66.374961046 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/6421bddc-6c3a-4ae2-9a6c-348d3de7aec9-registry-tls") pod "image-registry-6f5d75bf47-rnc9m" (UID: "6421bddc-6c3a-4ae2-9a6c-348d3de7aec9") : secret "image-registry-tls" not found Jul 14 04:59:49.446049 ip-10-0-136-9 kubenswrapper[2584]: I0714 04:59:49.445981 2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-g257n_15609856-4056-487b-acdd-30276263b098/konnectivity-agent/0.log" limit=1024 Jul 14 04:59:49.514967 ip-10-0-136-9 kubenswrapper[2584]: I0714 04:59:49.514582 2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/95fdfeab-07ef-4e6d-96cc-2c7056d1c833-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-5f7f494dd4-9nsjr\" (UID: \"95fdfeab-07ef-4e6d-96cc-2c7056d1c833\") " pod="openshift-monitoring/cluster-monitoring-operator-5f7f494dd4-9nsjr" Jul 14 04:59:49.514967 ip-10-0-136-9 kubenswrapper[2584]: I0714 04:59:49.514650 2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/13fb9031-3a05-4a3f-bbef-a2466ef852fb-samples-operator-tls\") pod \"cluster-samples-operator-65db858894-m6cp5\" (UID: \"13fb9031-3a05-4a3f-bbef-a2466ef852fb\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-65db858894-m6cp5" Jul 14 04:59:49.514967 ip-10-0-136-9 kubenswrapper[2584]: E0714 04:59:49.514808 2584 secret.go:189] Couldn't get secret openshift-monitoring/cluster-monitoring-operator-tls: secret "cluster-monitoring-operator-tls" not found Jul 14 04:59:49.514967 ip-10-0-136-9 kubenswrapper[2584]: E0714 04:59:49.514875 2584 secret.go:189] Couldn't get secret openshift-cluster-samples-operator/samples-operator-tls: secret "samples-operator-tls" not found Jul 14 04:59:49.514967 ip-10-0-136-9 kubenswrapper[2584]: E0714 04:59:49.514897 2584 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/95fdfeab-07ef-4e6d-96cc-2c7056d1c833-cluster-monitoring-operator-tls podName:95fdfeab-07ef-4e6d-96cc-2c7056d1c833 nodeName:}" failed. No retries permitted until 2026-07-14 05:00:05.514876032 +0000 UTC m=+66.476131719 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "cluster-monitoring-operator-tls" (UniqueName: "kubernetes.io/secret/95fdfeab-07ef-4e6d-96cc-2c7056d1c833-cluster-monitoring-operator-tls") pod "cluster-monitoring-operator-5f7f494dd4-9nsjr" (UID: "95fdfeab-07ef-4e6d-96cc-2c7056d1c833") : secret "cluster-monitoring-operator-tls" not found Jul 14 04:59:49.514967 ip-10-0-136-9 kubenswrapper[2584]: E0714 04:59:49.514924 2584 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/13fb9031-3a05-4a3f-bbef-a2466ef852fb-samples-operator-tls podName:13fb9031-3a05-4a3f-bbef-a2466ef852fb nodeName:}" failed. No retries permitted until 2026-07-14 05:00:05.514907642 +0000 UTC m=+66.476163329 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "samples-operator-tls" (UniqueName: "kubernetes.io/secret/13fb9031-3a05-4a3f-bbef-a2466ef852fb-samples-operator-tls") pod "cluster-samples-operator-65db858894-m6cp5" (UID: "13fb9031-3a05-4a3f-bbef-a2466ef852fb") : secret "samples-operator-tls" not found Jul 14 04:59:49.616028 ip-10-0-136-9 kubenswrapper[2584]: I0714 04:59:49.615992 2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/c9f966c9-5bd6-4602-9a96-ea935895d2d9-service-ca-bundle\") pod \"router-default-59f7f8d6b6-mb84v\" (UID: \"c9f966c9-5bd6-4602-9a96-ea935895d2d9\") " pod="openshift-ingress/router-default-59f7f8d6b6-mb84v" Jul 14 04:59:49.616474 ip-10-0-136-9 kubenswrapper[2584]: I0714 04:59:49.616078 2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/c9f966c9-5bd6-4602-9a96-ea935895d2d9-metrics-certs\") pod \"router-default-59f7f8d6b6-mb84v\" (UID: \"c9f966c9-5bd6-4602-9a96-ea935895d2d9\") " pod="openshift-ingress/router-default-59f7f8d6b6-mb84v" Jul 14 04:59:49.616474 ip-10-0-136-9 kubenswrapper[2584]: E0714 04:59:49.616165 2584 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/c9f966c9-5bd6-4602-9a96-ea935895d2d9-service-ca-bundle podName:c9f966c9-5bd6-4602-9a96-ea935895d2d9 nodeName:}" failed. No retries permitted until 2026-07-14 05:00:05.616142368 +0000 UTC m=+66.577398069 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "service-ca-bundle" (UniqueName: "kubernetes.io/configmap/c9f966c9-5bd6-4602-9a96-ea935895d2d9-service-ca-bundle") pod "router-default-59f7f8d6b6-mb84v" (UID: "c9f966c9-5bd6-4602-9a96-ea935895d2d9") : configmap references non-existent config key: service-ca.crt Jul 14 04:59:49.616474 ip-10-0-136-9 kubenswrapper[2584]: E0714 04:59:49.616358 2584 secret.go:189] Couldn't get secret openshift-ingress/router-metrics-certs-default: secret "router-metrics-certs-default" not found Jul 14 04:59:49.616474 ip-10-0-136-9 kubenswrapper[2584]: E0714 04:59:49.616410 2584 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/c9f966c9-5bd6-4602-9a96-ea935895d2d9-metrics-certs podName:c9f966c9-5bd6-4602-9a96-ea935895d2d9 nodeName:}" failed. No retries permitted until 2026-07-14 05:00:05.616397246 +0000 UTC m=+66.577652928 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/c9f966c9-5bd6-4602-9a96-ea935895d2d9-metrics-certs") pod "router-default-59f7f8d6b6-mb84v" (UID: "c9f966c9-5bd6-4602-9a96-ea935895d2d9") : secret "router-metrics-certs-default" not found Jul 14 04:59:49.915646 ip-10-0-136-9 kubenswrapper[2584]: I0714 04:59:49.915559 2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-operator-68d9dd94cf-wlmqg" event={"ID":"32d1dfa7-69ec-4b39-b5c9-154f4774db02","Type":"ContainerStarted","Data":"38ee31d5c5d905045320970387493bf0fc24d0d4ff264f20aebd6cac2e80b481"} Jul 14 04:59:49.917767 ip-10-0-136-9 kubenswrapper[2584]: I0714 04:59:49.917739 2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-799cb7f958-fkfct" event={"ID":"15929c2d-1e38-4405-9353-644c191c8c43","Type":"ContainerStarted","Data":"86be9ae98cb68c461978fef1216096b853624be9d0795ab39ab0507b43122355"} Jul 14 04:59:49.919287 ip-10-0-136-9 kubenswrapper[2584]: I0714 04:59:49.919261 2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-7987957cd6-cl7xc" event={"ID":"6bd66a53-26fb-407d-92ab-baadf5f92cff","Type":"ContainerStarted","Data":"9565a3439d8bb78f09b194d6977eb9ca6dcd7e8ee6a4a5e64088e8fe5cc402ce"} Jul 14 04:59:49.920703 ip-10-0-136-9 kubenswrapper[2584]: I0714 04:59:49.920673 2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-source-869dcfcdcd-d82p2" event={"ID":"eca5065c-f705-4c3f-b5d6-d445634581ac","Type":"ContainerStarted","Data":"6a50674d39cff5f65ac2c2a558e65aaf9a31a5f3ea9ab5f131f2d69875a4cad7"} Jul 14 04:59:49.922390 ip-10-0-136-9 kubenswrapper[2584]: I0714 04:59:49.922343 2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-storage-operator/volume-data-source-validator-78495597f6-qblzx" event={"ID":"90b386b6-2530-4cde-9a0c-68e324286ba4","Type":"ContainerStarted","Data":"97429ff067bbbe395f6464187108ba17d0501c20044b0d3feb914793f579e3a2"} Jul 14 04:59:49.923947 ip-10-0-136-9 kubenswrapper[2584]: I0714 04:59:49.923911 2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-service-ca-operator/service-ca-operator-7695fc6c8c-5j5s4" event={"ID":"90ab614b-66f6-4850-a0ac-0dc019099d3b","Type":"ContainerStarted","Data":"3c4c41120313c96f4a1ed0287432ea7790a79f593372b590071722fea33dc316"} Jul 14 04:59:49.925366 ip-10-0-136-9 kubenswrapper[2584]: I0714 04:59:49.925322 2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-84c484c684-7bh48" event={"ID":"5f88b859-e251-41e9-8435-e0152a03d835","Type":"ContainerStarted","Data":"3f486216476ce4cf674723e377538d9000f08589fb58f65ef663f714102c34ba"} Jul 14 04:59:49.925988 ip-10-0-136-9 kubenswrapper[2584]: I0714 04:59:49.925959 2584 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-84c484c684-7bh48" Jul 14 04:59:49.927669 ip-10-0-136-9 kubenswrapper[2584]: I0714 04:59:49.927651 2584 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-84c484c684-7bh48" Jul 14 04:59:49.928108 ip-10-0-136-9 kubenswrapper[2584]: I0714 04:59:49.928089 2584 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-7866497494-wh846_b0b64988-41ac-4e49-bcfd-a08adebb37f7/console-operator/0.log" Jul 14 04:59:49.928175 ip-10-0-136-9 kubenswrapper[2584]: I0714 04:59:49.928129 2584 generic.go:356] "Generic (PLEG): container finished" podID="b0b64988-41ac-4e49-bcfd-a08adebb37f7" containerID="28bd59fda5aaafd8f88def01b4bae02591a4ee532b28d3aeebb725669e41f9b3" exitCode=255 Jul 14 04:59:49.928381 ip-10-0-136-9 kubenswrapper[2584]: I0714 04:59:49.928350 2584 scope.go:117] "RemoveContainer" containerID="28bd59fda5aaafd8f88def01b4bae02591a4ee532b28d3aeebb725669e41f9b3" Jul 14 04:59:49.928491 ip-10-0-136-9 kubenswrapper[2584]: I0714 04:59:49.928391 2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console-operator/console-operator-7866497494-wh846" event={"ID":"b0b64988-41ac-4e49-bcfd-a08adebb37f7","Type":"ContainerDied","Data":"28bd59fda5aaafd8f88def01b4bae02591a4ee532b28d3aeebb725669e41f9b3"} Jul 14 04:59:49.930795 ip-10-0-136-9 kubenswrapper[2584]: I0714 04:59:49.930508 2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-c55458774-qd8rk" event={"ID":"70e90187-8fc9-4b4c-8ca4-12659f64bd3c","Type":"ContainerStarted","Data":"87bc8c78be7d19a92cec570450ab027d24683632f2bf47381a3cc6515ae9531e"} Jul 14 04:59:49.930795 ip-10-0-136-9 kubenswrapper[2584]: I0714 04:59:49.930540 2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-c55458774-qd8rk" event={"ID":"70e90187-8fc9-4b4c-8ca4-12659f64bd3c","Type":"ContainerStarted","Data":"d3f1b6b40a3fa5ba7f040e502729c58c3e73201fb1e3a180d6bacac1863cb3fc"} Jul 14 04:59:49.930795 ip-10-0-136-9 kubenswrapper[2584]: I0714 04:59:49.930557 2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-c55458774-qd8rk" event={"ID":"70e90187-8fc9-4b4c-8ca4-12659f64bd3c","Type":"ContainerStarted","Data":"afe462390e91d90cc40cae327344aac882e5c0d2ed76ab1f632cfa94c77d7219"} Jul 14 04:59:49.932356 ip-10-0-136-9 kubenswrapper[2584]: I0714 04:59:49.932323 2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress-canary/ingress-canary-2srpm" event={"ID":"344ca47f-b4c4-4592-94f6-93169c9eb55f","Type":"ContainerStarted","Data":"74de93d058bda6678628dbf4c9847795d3b199371e8370c710de0e05b5d0b725"} Jul 14 04:59:49.936535 ip-10-0-136-9 kubenswrapper[2584]: I0714 04:59:49.936495 2584 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-insights/insights-operator-68d9dd94cf-wlmqg" podStartSLOduration=11.215111418 podStartE2EDuration="24.936479624s" totalImagesPullingTime="13.721368206s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-14 04:59:25 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-14 04:59:49.934392742 +0000 UTC m=+50.895648446" watchObservedRunningTime="2026-07-14 04:59:49.936479624 +0000 UTC m=+50.897735331" Jul 14 04:59:49.973508 ip-10-0-136-9 kubenswrapper[2584]: I0714 04:59:49.971813 2584 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-c55458774-qd8rk" podStartSLOduration=11.277966316 podStartE2EDuration="24.971793619s" totalImagesPullingTime="13.693827303s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-14 04:59:25 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-14 04:59:49.971169244 +0000 UTC m=+50.932424950" watchObservedRunningTime="2026-07-14 04:59:49.971793619 +0000 UTC m=+50.933049324" Jul 14 04:59:49.973508 ip-10-0-136-9 kubenswrapper[2584]: I0714 04:59:49.972411 2584 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-7987957cd6-cl7xc" podStartSLOduration=11.243084389 podStartE2EDuration="24.972403163s" totalImagesPullingTime="13.729318774s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-14 04:59:25 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-14 04:59:49.950895305 +0000 UTC m=+50.912151009" watchObservedRunningTime="2026-07-14 04:59:49.972403163 +0000 UTC m=+50.933658868" Jul 14 04:59:49.988837 ip-10-0-136-9 kubenswrapper[2584]: I0714 04:59:49.988784 2584 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-service-ca-operator/service-ca-operator-7695fc6c8c-5j5s4" podStartSLOduration=11.291559042 podStartE2EDuration="24.988765173s" totalImagesPullingTime="13.697206131s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-14 04:59:25 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-14 04:59:49.98761114 +0000 UTC m=+50.948866844" watchObservedRunningTime="2026-07-14 04:59:49.988765173 +0000 UTC m=+50.950020877" Jul 14 04:59:50.009949 ip-10-0-136-9 kubenswrapper[2584]: I0714 04:59:50.007653 2584 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress-canary/ingress-canary-2srpm" podStartSLOduration=3.291754997 podStartE2EDuration="17.007634088s" totalImagesPullingTime="13.715879091s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-14 04:59:33 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-14 04:59:50.006542699 +0000 UTC m=+50.967798405" watchObservedRunningTime="2026-07-14 04:59:50.007634088 +0000 UTC m=+50.968889794" Jul 14 04:59:50.023405 ip-10-0-136-9 kubenswrapper[2584]: I0714 04:59:50.023355 2584 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-storage-operator/volume-data-source-validator-78495597f6-qblzx" podStartSLOduration=11.53101348 podStartE2EDuration="25.023338017s" totalImagesPullingTime="13.492324537s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-14 04:59:25 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-14 04:59:50.022790211 +0000 UTC m=+50.984045913" watchObservedRunningTime="2026-07-14 04:59:50.023338017 +0000 UTC m=+50.984593724" Jul 14 04:59:50.060746 ip-10-0-136-9 kubenswrapper[2584]: I0714 04:59:50.060680 2584 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-799cb7f958-fkfct" podStartSLOduration=11.29496014 podStartE2EDuration="25.060658235s" totalImagesPullingTime="13.765698095s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-14 04:59:25 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-14 04:59:50.041272467 +0000 UTC m=+51.002528172" watchObservedRunningTime="2026-07-14 04:59:50.060658235 +0000 UTC m=+51.021913940" Jul 14 04:59:50.095211 ip-10-0-136-9 kubenswrapper[2584]: I0714 04:59:50.095162 2584 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-diagnostics/network-check-source-869dcfcdcd-d82p2" podStartSLOduration=11.358076346 podStartE2EDuration="25.095142008s" totalImagesPullingTime="13.737065662s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-14 04:59:25 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-14 04:59:50.076143147 +0000 UTC m=+51.037398851" watchObservedRunningTime="2026-07-14 04:59:50.095142008 +0000 UTC m=+51.056397713" Jul 14 04:59:50.095832 ip-10-0-136-9 kubenswrapper[2584]: I0714 04:59:50.095805 2584 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-84c484c684-7bh48" podStartSLOduration=11.373422259 podStartE2EDuration="25.09579741s" totalImagesPullingTime="13.722375151s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-14 04:59:25 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-14 04:59:50.094822636 +0000 UTC m=+51.056078366" watchObservedRunningTime="2026-07-14 04:59:50.09579741 +0000 UTC m=+51.057053115" Jul 14 04:59:50.135239 ip-10-0-136-9 kubenswrapper[2584]: I0714 04:59:50.135208 2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-g257n_15609856-4056-487b-acdd-30276263b098/konnectivity-agent/0.log" limit=1024 Jul 14 04:59:50.222519 ip-10-0-136-9 kubenswrapper[2584]: I0714 04:59:50.222413 2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-g257n_15609856-4056-487b-acdd-30276263b098/konnectivity-agent/0.log" limit=1024 Jul 14 04:59:50.739157 ip-10-0-136-9 kubenswrapper[2584]: I0714 04:59:50.739120 2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-g257n_15609856-4056-487b-acdd-30276263b098/konnectivity-agent/0.log" limit=1024 Jul 14 04:59:50.781960 ip-10-0-136-9 kubenswrapper[2584]: I0714 04:59:50.781133 2584 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-insights/insights-runtime-extractor-t6zw8"] Jul 14 04:59:50.784131 ip-10-0-136-9 kubenswrapper[2584]: I0714 04:59:50.784101 2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-runtime-extractor-t6zw8" Jul 14 04:59:50.787089 ip-10-0-136-9 kubenswrapper[2584]: I0714 04:59:50.787031 2584 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-tls\"" Jul 14 04:59:50.787474 ip-10-0-136-9 kubenswrapper[2584]: I0714 04:59:50.787452 2584 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-sa-dockercfg-5h9dw\"" Jul 14 04:59:50.787698 ip-10-0-136-9 kubenswrapper[2584]: I0714 04:59:50.787681 2584 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"kube-rbac-proxy\"" Jul 14 04:59:50.798267 ip-10-0-136-9 kubenswrapper[2584]: I0714 04:59:50.798242 2584 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-runtime-extractor-t6zw8"] Jul 14 04:59:50.801354 ip-10-0-136-9 kubenswrapper[2584]: I0714 04:59:50.801330 2584 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-kube-storage-version-migrator/migrator-7f59b54f6c-spbxb"] Jul 14 04:59:50.803685 ip-10-0-136-9 kubenswrapper[2584]: I0714 04:59:50.803666 2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-kube-storage-version-migrator/migrator-7f59b54f6c-spbxb" Jul 14 04:59:50.807298 ip-10-0-136-9 kubenswrapper[2584]: I0714 04:59:50.807279 2584 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-kube-storage-version-migrator\"/\"kube-storage-version-migrator-sa-dockercfg-nf95f\"" Jul 14 04:59:50.807957 ip-10-0-136-9 kubenswrapper[2584]: I0714 04:59:50.807755 2584 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-kube-storage-version-migrator\"/\"openshift-service-ca.crt\"" Jul 14 04:59:50.807957 ip-10-0-136-9 kubenswrapper[2584]: I0714 04:59:50.807877 2584 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-kube-storage-version-migrator\"/\"kube-root-ca.crt\"" Jul 14 04:59:50.815992 ip-10-0-136-9 kubenswrapper[2584]: I0714 04:59:50.815971 2584 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-kube-storage-version-migrator/migrator-7f59b54f6c-spbxb"] Jul 14 04:59:50.827482 ip-10-0-136-9 kubenswrapper[2584]: I0714 04:59:50.827422 2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/4e5332d8-9e2c-4660-8546-e026f8f5dd2a-crio-socket\") pod \"insights-runtime-extractor-t6zw8\" (UID: \"4e5332d8-9e2c-4660-8546-e026f8f5dd2a\") " pod="openshift-insights/insights-runtime-extractor-t6zw8" Jul 14 04:59:50.827620 ip-10-0-136-9 kubenswrapper[2584]: I0714 04:59:50.827601 2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/4e5332d8-9e2c-4660-8546-e026f8f5dd2a-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-t6zw8\" (UID: \"4e5332d8-9e2c-4660-8546-e026f8f5dd2a\") " pod="openshift-insights/insights-runtime-extractor-t6zw8" Jul 14 04:59:50.827699 ip-10-0-136-9 kubenswrapper[2584]: I0714 04:59:50.827634 2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-7q7gs\" (UniqueName: \"kubernetes.io/projected/4e5332d8-9e2c-4660-8546-e026f8f5dd2a-kube-api-access-7q7gs\") pod \"insights-runtime-extractor-t6zw8\" (UID: \"4e5332d8-9e2c-4660-8546-e026f8f5dd2a\") " pod="openshift-insights/insights-runtime-extractor-t6zw8" Jul 14 04:59:50.827699 ip-10-0-136-9 kubenswrapper[2584]: I0714 04:59:50.827681 2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/4e5332d8-9e2c-4660-8546-e026f8f5dd2a-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-t6zw8\" (UID: \"4e5332d8-9e2c-4660-8546-e026f8f5dd2a\") " pod="openshift-insights/insights-runtime-extractor-t6zw8" Jul 14 04:59:50.827820 ip-10-0-136-9 kubenswrapper[2584]: I0714 04:59:50.827801 2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-cn9td\" (UniqueName: \"kubernetes.io/projected/1eaa9a47-a22c-4353-8b21-5a0e1ea21d46-kube-api-access-cn9td\") pod \"migrator-7f59b54f6c-spbxb\" (UID: \"1eaa9a47-a22c-4353-8b21-5a0e1ea21d46\") " pod="openshift-kube-storage-version-migrator/migrator-7f59b54f6c-spbxb" Jul 14 04:59:50.827858 ip-10-0-136-9 kubenswrapper[2584]: I0714 04:59:50.827842 2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/4e5332d8-9e2c-4660-8546-e026f8f5dd2a-data-volume\") pod \"insights-runtime-extractor-t6zw8\" (UID: \"4e5332d8-9e2c-4660-8546-e026f8f5dd2a\") " pod="openshift-insights/insights-runtime-extractor-t6zw8" Jul 14 04:59:50.847884 ip-10-0-136-9 kubenswrapper[2584]: I0714 04:59:50.847852 2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-g257n_15609856-4056-487b-acdd-30276263b098/konnectivity-agent/0.log" limit=1024 Jul 14 04:59:50.928565 ip-10-0-136-9 kubenswrapper[2584]: I0714 04:59:50.928534 2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-cn9td\" (UniqueName: \"kubernetes.io/projected/1eaa9a47-a22c-4353-8b21-5a0e1ea21d46-kube-api-access-cn9td\") pod \"migrator-7f59b54f6c-spbxb\" (UID: \"1eaa9a47-a22c-4353-8b21-5a0e1ea21d46\") " pod="openshift-kube-storage-version-migrator/migrator-7f59b54f6c-spbxb" Jul 14 04:59:50.928738 ip-10-0-136-9 kubenswrapper[2584]: I0714 04:59:50.928585 2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/4e5332d8-9e2c-4660-8546-e026f8f5dd2a-data-volume\") pod \"insights-runtime-extractor-t6zw8\" (UID: \"4e5332d8-9e2c-4660-8546-e026f8f5dd2a\") " pod="openshift-insights/insights-runtime-extractor-t6zw8" Jul 14 04:59:50.928738 ip-10-0-136-9 kubenswrapper[2584]: I0714 04:59:50.928640 2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/4e5332d8-9e2c-4660-8546-e026f8f5dd2a-crio-socket\") pod \"insights-runtime-extractor-t6zw8\" (UID: \"4e5332d8-9e2c-4660-8546-e026f8f5dd2a\") " pod="openshift-insights/insights-runtime-extractor-t6zw8" Jul 14 04:59:50.928738 ip-10-0-136-9 kubenswrapper[2584]: I0714 04:59:50.928700 2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/4e5332d8-9e2c-4660-8546-e026f8f5dd2a-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-t6zw8\" (UID: \"4e5332d8-9e2c-4660-8546-e026f8f5dd2a\") " pod="openshift-insights/insights-runtime-extractor-t6zw8" Jul 14 04:59:50.928738 ip-10-0-136-9 kubenswrapper[2584]: I0714 04:59:50.928725 2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-7q7gs\" (UniqueName: \"kubernetes.io/projected/4e5332d8-9e2c-4660-8546-e026f8f5dd2a-kube-api-access-7q7gs\") pod \"insights-runtime-extractor-t6zw8\" (UID: \"4e5332d8-9e2c-4660-8546-e026f8f5dd2a\") " pod="openshift-insights/insights-runtime-extractor-t6zw8" Jul 14 04:59:50.928984 ip-10-0-136-9 kubenswrapper[2584]: I0714 04:59:50.928769 2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/4e5332d8-9e2c-4660-8546-e026f8f5dd2a-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-t6zw8\" (UID: \"4e5332d8-9e2c-4660-8546-e026f8f5dd2a\") " pod="openshift-insights/insights-runtime-extractor-t6zw8" Jul 14 04:59:50.928984 ip-10-0-136-9 kubenswrapper[2584]: E0714 04:59:50.928833 2584 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found Jul 14 04:59:50.928984 ip-10-0-136-9 kubenswrapper[2584]: I0714 04:59:50.928854 2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/4e5332d8-9e2c-4660-8546-e026f8f5dd2a-crio-socket\") pod \"insights-runtime-extractor-t6zw8\" (UID: \"4e5332d8-9e2c-4660-8546-e026f8f5dd2a\") " pod="openshift-insights/insights-runtime-extractor-t6zw8" Jul 14 04:59:50.928984 ip-10-0-136-9 kubenswrapper[2584]: E0714 04:59:50.928909 2584 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/4e5332d8-9e2c-4660-8546-e026f8f5dd2a-kube-rbac-proxy-cm podName:4e5332d8-9e2c-4660-8546-e026f8f5dd2a nodeName:}" failed. No retries permitted until 2026-07-14 04:59:51.428890283 +0000 UTC m=+52.390145966 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/4e5332d8-9e2c-4660-8546-e026f8f5dd2a-kube-rbac-proxy-cm") pod "insights-runtime-extractor-t6zw8" (UID: "4e5332d8-9e2c-4660-8546-e026f8f5dd2a") : configmap "kube-rbac-proxy" not found Jul 14 04:59:50.928984 ip-10-0-136-9 kubenswrapper[2584]: E0714 04:59:50.928969 2584 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found Jul 14 04:59:50.929186 ip-10-0-136-9 kubenswrapper[2584]: I0714 04:59:50.928999 2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/4e5332d8-9e2c-4660-8546-e026f8f5dd2a-data-volume\") pod \"insights-runtime-extractor-t6zw8\" (UID: \"4e5332d8-9e2c-4660-8546-e026f8f5dd2a\") " pod="openshift-insights/insights-runtime-extractor-t6zw8" Jul 14 04:59:50.929186 ip-10-0-136-9 kubenswrapper[2584]: E0714 04:59:50.929028 2584 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/4e5332d8-9e2c-4660-8546-e026f8f5dd2a-insights-runtime-extractor-tls podName:4e5332d8-9e2c-4660-8546-e026f8f5dd2a nodeName:}" failed. No retries permitted until 2026-07-14 04:59:51.429014329 +0000 UTC m=+52.390270011 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/4e5332d8-9e2c-4660-8546-e026f8f5dd2a-insights-runtime-extractor-tls") pod "insights-runtime-extractor-t6zw8" (UID: "4e5332d8-9e2c-4660-8546-e026f8f5dd2a") : secret "insights-runtime-extractor-tls" not found Jul 14 04:59:50.936984 ip-10-0-136-9 kubenswrapper[2584]: I0714 04:59:50.936965 2584 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-7866497494-wh846_b0b64988-41ac-4e49-bcfd-a08adebb37f7/console-operator/1.log" Jul 14 04:59:50.937339 ip-10-0-136-9 kubenswrapper[2584]: I0714 04:59:50.937325 2584 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-7866497494-wh846_b0b64988-41ac-4e49-bcfd-a08adebb37f7/console-operator/0.log" Jul 14 04:59:50.937399 ip-10-0-136-9 kubenswrapper[2584]: I0714 04:59:50.937358 2584 generic.go:356] "Generic (PLEG): container finished" podID="b0b64988-41ac-4e49-bcfd-a08adebb37f7" containerID="7b589c55541c40cd5bb0dc2bea20f2ee0ef2b500cfa5f292c6ce7575a2cd14c6" exitCode=255 Jul 14 04:59:50.937434 ip-10-0-136-9 kubenswrapper[2584]: I0714 04:59:50.937385 2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console-operator/console-operator-7866497494-wh846" event={"ID":"b0b64988-41ac-4e49-bcfd-a08adebb37f7","Type":"ContainerDied","Data":"7b589c55541c40cd5bb0dc2bea20f2ee0ef2b500cfa5f292c6ce7575a2cd14c6"} Jul 14 04:59:50.937477 ip-10-0-136-9 kubenswrapper[2584]: I0714 04:59:50.937455 2584 scope.go:117] "RemoveContainer" containerID="28bd59fda5aaafd8f88def01b4bae02591a4ee532b28d3aeebb725669e41f9b3" Jul 14 04:59:50.937698 ip-10-0-136-9 kubenswrapper[2584]: I0714 04:59:50.937683 2584 scope.go:117] "RemoveContainer" containerID="7b589c55541c40cd5bb0dc2bea20f2ee0ef2b500cfa5f292c6ce7575a2cd14c6" Jul 14 04:59:50.937900 ip-10-0-136-9 kubenswrapper[2584]: E0714 04:59:50.937867 2584 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"console-operator\" with CrashLoopBackOff: \"back-off 10s restarting failed container=console-operator pod=console-operator-7866497494-wh846_openshift-console-operator(b0b64988-41ac-4e49-bcfd-a08adebb37f7)\"" pod="openshift-console-operator/console-operator-7866497494-wh846" podUID="b0b64988-41ac-4e49-bcfd-a08adebb37f7" Jul 14 04:59:50.942177 ip-10-0-136-9 kubenswrapper[2584]: I0714 04:59:50.942151 2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-7q7gs\" (UniqueName: \"kubernetes.io/projected/4e5332d8-9e2c-4660-8546-e026f8f5dd2a-kube-api-access-7q7gs\") pod \"insights-runtime-extractor-t6zw8\" (UID: \"4e5332d8-9e2c-4660-8546-e026f8f5dd2a\") " pod="openshift-insights/insights-runtime-extractor-t6zw8" Jul 14 04:59:50.942296 ip-10-0-136-9 kubenswrapper[2584]: I0714 04:59:50.942188 2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-cn9td\" (UniqueName: \"kubernetes.io/projected/1eaa9a47-a22c-4353-8b21-5a0e1ea21d46-kube-api-access-cn9td\") pod \"migrator-7f59b54f6c-spbxb\" (UID: \"1eaa9a47-a22c-4353-8b21-5a0e1ea21d46\") " pod="openshift-kube-storage-version-migrator/migrator-7f59b54f6c-spbxb" Jul 14 04:59:50.942463 ip-10-0-136-9 kubenswrapper[2584]: I0714 04:59:50.942444 2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-g257n_15609856-4056-487b-acdd-30276263b098/konnectivity-agent/0.log" limit=1024 Jul 14 04:59:51.113202 ip-10-0-136-9 kubenswrapper[2584]: I0714 04:59:51.113172 2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-kube-storage-version-migrator/migrator-7f59b54f6c-spbxb" Jul 14 04:59:51.230617 ip-10-0-136-9 kubenswrapper[2584]: I0714 04:59:51.230596 2584 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-kube-storage-version-migrator/migrator-7f59b54f6c-spbxb"] Jul 14 04:59:51.233158 ip-10-0-136-9 kubenswrapper[2584]: W0714 04:59:51.233132 2584 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod1eaa9a47_a22c_4353_8b21_5a0e1ea21d46.slice/crio-f76f330b08efbfc4e149a629c8323aafc44fc961be6be8c5aa6051ba62d226a4 WatchSource:0}: Error finding container f76f330b08efbfc4e149a629c8323aafc44fc961be6be8c5aa6051ba62d226a4: Status 404 returned error can't find the container with id f76f330b08efbfc4e149a629c8323aafc44fc961be6be8c5aa6051ba62d226a4 Jul 14 04:59:51.338387 ip-10-0-136-9 kubenswrapper[2584]: I0714 04:59:51.338346 2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-g257n_15609856-4056-487b-acdd-30276263b098/konnectivity-agent/0.log" limit=1024 Jul 14 04:59:51.393244 ip-10-0-136-9 kubenswrapper[2584]: I0714 04:59:51.393160 2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-g257n_15609856-4056-487b-acdd-30276263b098/konnectivity-agent/0.log" limit=1024 Jul 14 04:59:51.434697 ip-10-0-136-9 kubenswrapper[2584]: I0714 04:59:51.434670 2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/4e5332d8-9e2c-4660-8546-e026f8f5dd2a-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-t6zw8\" (UID: \"4e5332d8-9e2c-4660-8546-e026f8f5dd2a\") " pod="openshift-insights/insights-runtime-extractor-t6zw8" Jul 14 04:59:51.434809 ip-10-0-136-9 kubenswrapper[2584]: I0714 04:59:51.434706 2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/4e5332d8-9e2c-4660-8546-e026f8f5dd2a-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-t6zw8\" (UID: \"4e5332d8-9e2c-4660-8546-e026f8f5dd2a\") " pod="openshift-insights/insights-runtime-extractor-t6zw8" Jul 14 04:59:51.434879 ip-10-0-136-9 kubenswrapper[2584]: E0714 04:59:51.434803 2584 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found Jul 14 04:59:51.434879 ip-10-0-136-9 kubenswrapper[2584]: E0714 04:59:51.434841 2584 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found Jul 14 04:59:51.434879 ip-10-0-136-9 kubenswrapper[2584]: E0714 04:59:51.434873 2584 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/4e5332d8-9e2c-4660-8546-e026f8f5dd2a-kube-rbac-proxy-cm podName:4e5332d8-9e2c-4660-8546-e026f8f5dd2a nodeName:}" failed. No retries permitted until 2026-07-14 04:59:52.434853553 +0000 UTC m=+53.396109249 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/4e5332d8-9e2c-4660-8546-e026f8f5dd2a-kube-rbac-proxy-cm") pod "insights-runtime-extractor-t6zw8" (UID: "4e5332d8-9e2c-4660-8546-e026f8f5dd2a") : configmap "kube-rbac-proxy" not found Jul 14 04:59:51.435060 ip-10-0-136-9 kubenswrapper[2584]: E0714 04:59:51.434897 2584 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/4e5332d8-9e2c-4660-8546-e026f8f5dd2a-insights-runtime-extractor-tls podName:4e5332d8-9e2c-4660-8546-e026f8f5dd2a nodeName:}" failed. No retries permitted until 2026-07-14 04:59:52.434884942 +0000 UTC m=+53.396140626 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/4e5332d8-9e2c-4660-8546-e026f8f5dd2a-insights-runtime-extractor-tls") pod "insights-runtime-extractor-t6zw8" (UID: "4e5332d8-9e2c-4660-8546-e026f8f5dd2a") : secret "insights-runtime-extractor-tls" not found Jul 14 04:59:51.630082 ip-10-0-136-9 kubenswrapper[2584]: I0714 04:59:51.630045 2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-g257n_15609856-4056-487b-acdd-30276263b098/konnectivity-agent/0.log" limit=1024 Jul 14 04:59:51.753741 ip-10-0-136-9 kubenswrapper[2584]: I0714 04:59:51.753664 2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-g257n_15609856-4056-487b-acdd-30276263b098/konnectivity-agent/0.log" limit=1024 Jul 14 04:59:51.943009 ip-10-0-136-9 kubenswrapper[2584]: I0714 04:59:51.942983 2584 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-7866497494-wh846_b0b64988-41ac-4e49-bcfd-a08adebb37f7/console-operator/1.log" Jul 14 04:59:51.943386 ip-10-0-136-9 kubenswrapper[2584]: I0714 04:59:51.943364 2584 scope.go:117] "RemoveContainer" containerID="7b589c55541c40cd5bb0dc2bea20f2ee0ef2b500cfa5f292c6ce7575a2cd14c6" Jul 14 04:59:51.943568 ip-10-0-136-9 kubenswrapper[2584]: E0714 04:59:51.943543 2584 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"console-operator\" with CrashLoopBackOff: \"back-off 10s restarting failed container=console-operator pod=console-operator-7866497494-wh846_openshift-console-operator(b0b64988-41ac-4e49-bcfd-a08adebb37f7)\"" pod="openshift-console-operator/console-operator-7866497494-wh846" podUID="b0b64988-41ac-4e49-bcfd-a08adebb37f7" Jul 14 04:59:51.944353 ip-10-0-136-9 kubenswrapper[2584]: I0714 04:59:51.944327 2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator/migrator-7f59b54f6c-spbxb" event={"ID":"1eaa9a47-a22c-4353-8b21-5a0e1ea21d46","Type":"ContainerStarted","Data":"f76f330b08efbfc4e149a629c8323aafc44fc961be6be8c5aa6051ba62d226a4"} Jul 14 04:59:52.167891 ip-10-0-136-9 kubenswrapper[2584]: I0714 04:59:52.167860 2584 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_node-resolver-t5mq8_8986aae0-cba2-493d-8d3e-ccf99b81c90c/dns-node-resolver/0.log" Jul 14 04:59:52.444144 ip-10-0-136-9 kubenswrapper[2584]: I0714 04:59:52.443474 2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/4e5332d8-9e2c-4660-8546-e026f8f5dd2a-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-t6zw8\" (UID: \"4e5332d8-9e2c-4660-8546-e026f8f5dd2a\") " pod="openshift-insights/insights-runtime-extractor-t6zw8" Jul 14 04:59:52.444144 ip-10-0-136-9 kubenswrapper[2584]: I0714 04:59:52.443539 2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/4e5332d8-9e2c-4660-8546-e026f8f5dd2a-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-t6zw8\" (UID: \"4e5332d8-9e2c-4660-8546-e026f8f5dd2a\") " pod="openshift-insights/insights-runtime-extractor-t6zw8" Jul 14 04:59:52.444144 ip-10-0-136-9 kubenswrapper[2584]: E0714 04:59:52.443757 2584 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found Jul 14 04:59:52.444144 ip-10-0-136-9 kubenswrapper[2584]: E0714 04:59:52.443814 2584 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/4e5332d8-9e2c-4660-8546-e026f8f5dd2a-insights-runtime-extractor-tls podName:4e5332d8-9e2c-4660-8546-e026f8f5dd2a nodeName:}" failed. No retries permitted until 2026-07-14 04:59:54.443796575 +0000 UTC m=+55.405052261 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/4e5332d8-9e2c-4660-8546-e026f8f5dd2a-insights-runtime-extractor-tls") pod "insights-runtime-extractor-t6zw8" (UID: "4e5332d8-9e2c-4660-8546-e026f8f5dd2a") : secret "insights-runtime-extractor-tls" not found Jul 14 04:59:52.444144 ip-10-0-136-9 kubenswrapper[2584]: E0714 04:59:52.443860 2584 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found Jul 14 04:59:52.444144 ip-10-0-136-9 kubenswrapper[2584]: E0714 04:59:52.443887 2584 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/4e5332d8-9e2c-4660-8546-e026f8f5dd2a-kube-rbac-proxy-cm podName:4e5332d8-9e2c-4660-8546-e026f8f5dd2a nodeName:}" failed. No retries permitted until 2026-07-14 04:59:54.443879947 +0000 UTC m=+55.405135630 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/4e5332d8-9e2c-4660-8546-e026f8f5dd2a-kube-rbac-proxy-cm") pod "insights-runtime-extractor-t6zw8" (UID: "4e5332d8-9e2c-4660-8546-e026f8f5dd2a") : configmap "kube-rbac-proxy" not found Jul 14 04:59:52.544235 ip-10-0-136-9 kubenswrapper[2584]: I0714 04:59:52.544212 2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/c27a6d7e-9146-4882-ba72-d2c22c209e03-networking-console-plugin-cert\") pod \"networking-console-plugin-6cf856758c-4bfn6\" (UID: \"c27a6d7e-9146-4882-ba72-d2c22c209e03\") " pod="openshift-network-console/networking-console-plugin-6cf856758c-4bfn6" Jul 14 04:59:52.544383 ip-10-0-136-9 kubenswrapper[2584]: E0714 04:59:52.544367 2584 secret.go:189] Couldn't get secret openshift-network-console/networking-console-plugin-cert: secret "networking-console-plugin-cert" not found Jul 14 04:59:52.544441 ip-10-0-136-9 kubenswrapper[2584]: E0714 04:59:52.544431 2584 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/c27a6d7e-9146-4882-ba72-d2c22c209e03-networking-console-plugin-cert podName:c27a6d7e-9146-4882-ba72-d2c22c209e03 nodeName:}" failed. No retries permitted until 2026-07-14 05:00:00.544416644 +0000 UTC m=+61.505672327 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "networking-console-plugin-cert" (UniqueName: "kubernetes.io/secret/c27a6d7e-9146-4882-ba72-d2c22c209e03-networking-console-plugin-cert") pod "networking-console-plugin-6cf856758c-4bfn6" (UID: "c27a6d7e-9146-4882-ba72-d2c22c209e03") : secret "networking-console-plugin-cert" not found Jul 14 04:59:52.949040 ip-10-0-136-9 kubenswrapper[2584]: I0714 04:59:52.949003 2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator/migrator-7f59b54f6c-spbxb" event={"ID":"1eaa9a47-a22c-4353-8b21-5a0e1ea21d46","Type":"ContainerStarted","Data":"2f9ff39fdf1b523a2a7ec8ec9cb0e69720eda57cf173bfd664c6c3d2b3293021"} Jul 14 04:59:52.949435 ip-10-0-136-9 kubenswrapper[2584]: I0714 04:59:52.949093 2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator/migrator-7f59b54f6c-spbxb" event={"ID":"1eaa9a47-a22c-4353-8b21-5a0e1ea21d46","Type":"ContainerStarted","Data":"4b7e76554c5670cbba94b4339b48976a3c34f126f2771dbaa93b65d36f577a67"} Jul 14 04:59:52.967226 ip-10-0-136-9 kubenswrapper[2584]: I0714 04:59:52.967171 2584 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-kube-storage-version-migrator/migrator-7f59b54f6c-spbxb" podStartSLOduration=1.7161996290000001 podStartE2EDuration="2.967152251s" totalImagesPullingTime="1.250952622s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-14 04:59:50 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-14 04:59:52.965873173 +0000 UTC m=+53.927128877" watchObservedRunningTime="2026-07-14 04:59:52.967152251 +0000 UTC m=+53.928407957" Jul 14 04:59:52.967429 ip-10-0-136-9 kubenswrapper[2584]: I0714 04:59:52.967414 2584 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_node-ca-l8z9r_822d074f-5b43-440a-8521-6cb28777ea8d/node-ca/0.log" Jul 14 04:59:53.037528 ip-10-0-136-9 kubenswrapper[2584]: I0714 04:59:53.037491 2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-g257n_15609856-4056-487b-acdd-30276263b098/konnectivity-agent/0.log" limit=1024 Jul 14 04:59:53.101413 ip-10-0-136-9 kubenswrapper[2584]: I0714 04:59:53.101381 2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-g257n_15609856-4056-487b-acdd-30276263b098/konnectivity-agent/0.log" limit=1024 Jul 14 04:59:53.222503 ip-10-0-136-9 kubenswrapper[2584]: I0714 04:59:53.222427 2584 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-service-ca/service-ca-79f68b9f4f-8m67q"] Jul 14 04:59:53.224302 ip-10-0-136-9 kubenswrapper[2584]: I0714 04:59:53.224288 2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-service-ca/service-ca-79f68b9f4f-8m67q" Jul 14 04:59:53.227153 ip-10-0-136-9 kubenswrapper[2584]: I0714 04:59:53.227127 2584 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-service-ca\"/\"signing-key\"" Jul 14 04:59:53.227153 ip-10-0-136-9 kubenswrapper[2584]: I0714 04:59:53.227146 2584 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-service-ca\"/\"signing-cabundle\"" Jul 14 04:59:53.227325 ip-10-0-136-9 kubenswrapper[2584]: I0714 04:59:53.227174 2584 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-service-ca\"/\"openshift-service-ca.crt\"" Jul 14 04:59:53.227325 ip-10-0-136-9 kubenswrapper[2584]: I0714 04:59:53.227186 2584 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-service-ca\"/\"service-ca-dockercfg-6l6bb\"" Jul 14 04:59:53.228141 ip-10-0-136-9 kubenswrapper[2584]: I0714 04:59:53.228128 2584 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-service-ca\"/\"kube-root-ca.crt\"" Jul 14 04:59:53.233621 ip-10-0-136-9 kubenswrapper[2584]: I0714 04:59:53.233600 2584 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-service-ca/service-ca-79f68b9f4f-8m67q"] Jul 14 04:59:53.252071 ip-10-0-136-9 kubenswrapper[2584]: I0714 04:59:53.252038 2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-g257n_15609856-4056-487b-acdd-30276263b098/konnectivity-agent/0.log" limit=1024 Jul 14 04:59:53.351355 ip-10-0-136-9 kubenswrapper[2584]: I0714 04:59:53.351322 2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-g257n_15609856-4056-487b-acdd-30276263b098/konnectivity-agent/0.log" limit=1024 Jul 14 04:59:53.352461 ip-10-0-136-9 kubenswrapper[2584]: I0714 04:59:53.352442 2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-p57zm\" (UniqueName: \"kubernetes.io/projected/2e6461fe-42e8-4cd6-8552-1e8fbd33120a-kube-api-access-p57zm\") pod \"service-ca-79f68b9f4f-8m67q\" (UID: \"2e6461fe-42e8-4cd6-8552-1e8fbd33120a\") " pod="openshift-service-ca/service-ca-79f68b9f4f-8m67q" Jul 14 04:59:53.352529 ip-10-0-136-9 kubenswrapper[2584]: I0714 04:59:53.352470 2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"signing-cabundle\" (UniqueName: \"kubernetes.io/configmap/2e6461fe-42e8-4cd6-8552-1e8fbd33120a-signing-cabundle\") pod \"service-ca-79f68b9f4f-8m67q\" (UID: \"2e6461fe-42e8-4cd6-8552-1e8fbd33120a\") " pod="openshift-service-ca/service-ca-79f68b9f4f-8m67q" Jul 14 04:59:53.352566 ip-10-0-136-9 kubenswrapper[2584]: I0714 04:59:53.352556 2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"signing-key\" (UniqueName: \"kubernetes.io/secret/2e6461fe-42e8-4cd6-8552-1e8fbd33120a-signing-key\") pod \"service-ca-79f68b9f4f-8m67q\" (UID: \"2e6461fe-42e8-4cd6-8552-1e8fbd33120a\") " pod="openshift-service-ca/service-ca-79f68b9f4f-8m67q" Jul 14 04:59:53.453019 ip-10-0-136-9 kubenswrapper[2584]: I0714 04:59:53.452990 2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-p57zm\" (UniqueName: \"kubernetes.io/projected/2e6461fe-42e8-4cd6-8552-1e8fbd33120a-kube-api-access-p57zm\") pod \"service-ca-79f68b9f4f-8m67q\" (UID: \"2e6461fe-42e8-4cd6-8552-1e8fbd33120a\") " pod="openshift-service-ca/service-ca-79f68b9f4f-8m67q" Jul 14 04:59:53.453178 ip-10-0-136-9 kubenswrapper[2584]: I0714 04:59:53.453031 2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"signing-cabundle\" (UniqueName: \"kubernetes.io/configmap/2e6461fe-42e8-4cd6-8552-1e8fbd33120a-signing-cabundle\") pod \"service-ca-79f68b9f4f-8m67q\" (UID: \"2e6461fe-42e8-4cd6-8552-1e8fbd33120a\") " pod="openshift-service-ca/service-ca-79f68b9f4f-8m67q" Jul 14 04:59:53.453178 ip-10-0-136-9 kubenswrapper[2584]: I0714 04:59:53.453065 2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-g257n_15609856-4056-487b-acdd-30276263b098/konnectivity-agent/0.log" limit=1024 Jul 14 04:59:53.453299 ip-10-0-136-9 kubenswrapper[2584]: I0714 04:59:53.453198 2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"signing-key\" (UniqueName: \"kubernetes.io/secret/2e6461fe-42e8-4cd6-8552-1e8fbd33120a-signing-key\") pod \"service-ca-79f68b9f4f-8m67q\" (UID: \"2e6461fe-42e8-4cd6-8552-1e8fbd33120a\") " pod="openshift-service-ca/service-ca-79f68b9f4f-8m67q" Jul 14 04:59:53.453776 ip-10-0-136-9 kubenswrapper[2584]: I0714 04:59:53.453756 2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"signing-cabundle\" (UniqueName: \"kubernetes.io/configmap/2e6461fe-42e8-4cd6-8552-1e8fbd33120a-signing-cabundle\") pod \"service-ca-79f68b9f4f-8m67q\" (UID: \"2e6461fe-42e8-4cd6-8552-1e8fbd33120a\") " pod="openshift-service-ca/service-ca-79f68b9f4f-8m67q" Jul 14 04:59:53.455616 ip-10-0-136-9 kubenswrapper[2584]: I0714 04:59:53.455597 2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"signing-key\" (UniqueName: \"kubernetes.io/secret/2e6461fe-42e8-4cd6-8552-1e8fbd33120a-signing-key\") pod \"service-ca-79f68b9f4f-8m67q\" (UID: \"2e6461fe-42e8-4cd6-8552-1e8fbd33120a\") " pod="openshift-service-ca/service-ca-79f68b9f4f-8m67q" Jul 14 04:59:53.462122 ip-10-0-136-9 kubenswrapper[2584]: I0714 04:59:53.462097 2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-p57zm\" (UniqueName: \"kubernetes.io/projected/2e6461fe-42e8-4cd6-8552-1e8fbd33120a-kube-api-access-p57zm\") pod \"service-ca-79f68b9f4f-8m67q\" (UID: \"2e6461fe-42e8-4cd6-8552-1e8fbd33120a\") " pod="openshift-service-ca/service-ca-79f68b9f4f-8m67q" Jul 14 04:59:53.532923 ip-10-0-136-9 kubenswrapper[2584]: I0714 04:59:53.532847 2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-service-ca/service-ca-79f68b9f4f-8m67q" Jul 14 04:59:53.554106 ip-10-0-136-9 kubenswrapper[2584]: I0714 04:59:53.554066 2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-g257n_15609856-4056-487b-acdd-30276263b098/konnectivity-agent/0.log" limit=1024 Jul 14 04:59:53.565684 ip-10-0-136-9 kubenswrapper[2584]: I0714 04:59:53.565657 2584 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress-canary_ingress-canary-2srpm_344ca47f-b4c4-4592-94f6-93169c9eb55f/serve-healthcheck-canary/0.log" Jul 14 04:59:53.653663 ip-10-0-136-9 kubenswrapper[2584]: I0714 04:59:53.653638 2584 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-service-ca/service-ca-79f68b9f4f-8m67q"] Jul 14 04:59:53.655892 ip-10-0-136-9 kubenswrapper[2584]: W0714 04:59:53.655865 2584 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod2e6461fe_42e8_4cd6_8552_1e8fbd33120a.slice/crio-02e9c724d1f4cc6ef520339170ff593102b665ce0119041173744fe411a4d669 WatchSource:0}: Error finding container 02e9c724d1f4cc6ef520339170ff593102b665ce0119041173744fe411a4d669: Status 404 returned error can't find the container with id 02e9c724d1f4cc6ef520339170ff593102b665ce0119041173744fe411a4d669 Jul 14 04:59:53.777016 ip-10-0-136-9 kubenswrapper[2584]: I0714 04:59:53.776985 2584 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console-operator/console-operator-7866497494-wh846" Jul 14 04:59:53.777202 ip-10-0-136-9 kubenswrapper[2584]: I0714 04:59:53.777083 2584 kubelet.go:2654] "SyncLoop (probe)" probe="liveness" status="unhealthy" pod="openshift-console-operator/console-operator-7866497494-wh846" Jul 14 04:59:53.777468 ip-10-0-136-9 kubenswrapper[2584]: I0714 04:59:53.777454 2584 scope.go:117] "RemoveContainer" containerID="7b589c55541c40cd5bb0dc2bea20f2ee0ef2b500cfa5f292c6ce7575a2cd14c6" Jul 14 04:59:53.777627 ip-10-0-136-9 kubenswrapper[2584]: E0714 04:59:53.777609 2584 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"console-operator\" with CrashLoopBackOff: \"back-off 10s restarting failed container=console-operator pod=console-operator-7866497494-wh846_openshift-console-operator(b0b64988-41ac-4e49-bcfd-a08adebb37f7)\"" pod="openshift-console-operator/console-operator-7866497494-wh846" podUID="b0b64988-41ac-4e49-bcfd-a08adebb37f7" Jul 14 04:59:53.953398 ip-10-0-136-9 kubenswrapper[2584]: I0714 04:59:53.953363 2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-service-ca/service-ca-79f68b9f4f-8m67q" event={"ID":"2e6461fe-42e8-4cd6-8552-1e8fbd33120a","Type":"ContainerStarted","Data":"0f50955d82531d10cc8dd0c70cfb7b5ef1d30b12ed95cb1e91ffd9fc546575a3"} Jul 14 04:59:53.953823 ip-10-0-136-9 kubenswrapper[2584]: I0714 04:59:53.953411 2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-service-ca/service-ca-79f68b9f4f-8m67q" event={"ID":"2e6461fe-42e8-4cd6-8552-1e8fbd33120a","Type":"ContainerStarted","Data":"02e9c724d1f4cc6ef520339170ff593102b665ce0119041173744fe411a4d669"} Jul 14 04:59:53.953966 ip-10-0-136-9 kubenswrapper[2584]: I0714 04:59:53.953925 2584 scope.go:117] "RemoveContainer" containerID="7b589c55541c40cd5bb0dc2bea20f2ee0ef2b500cfa5f292c6ce7575a2cd14c6" Jul 14 04:59:53.954131 ip-10-0-136-9 kubenswrapper[2584]: E0714 04:59:53.954110 2584 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"console-operator\" with CrashLoopBackOff: \"back-off 10s restarting failed container=console-operator pod=console-operator-7866497494-wh846_openshift-console-operator(b0b64988-41ac-4e49-bcfd-a08adebb37f7)\"" pod="openshift-console-operator/console-operator-7866497494-wh846" podUID="b0b64988-41ac-4e49-bcfd-a08adebb37f7" Jul 14 04:59:53.972377 ip-10-0-136-9 kubenswrapper[2584]: I0714 04:59:53.972321 2584 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-service-ca/service-ca-79f68b9f4f-8m67q" podStartSLOduration=0.972304762 podStartE2EDuration="972.304762ms" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-14 04:59:53 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-14 04:59:53.970811872 +0000 UTC m=+54.932067577" watchObservedRunningTime="2026-07-14 04:59:53.972304762 +0000 UTC m=+54.933560462" Jul 14 04:59:54.253677 ip-10-0-136-9 kubenswrapper[2584]: I0714 04:59:54.253592 2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-g257n_15609856-4056-487b-acdd-30276263b098/konnectivity-agent/0.log" limit=1024 Jul 14 04:59:54.461428 ip-10-0-136-9 kubenswrapper[2584]: I0714 04:59:54.461391 2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/4e5332d8-9e2c-4660-8546-e026f8f5dd2a-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-t6zw8\" (UID: \"4e5332d8-9e2c-4660-8546-e026f8f5dd2a\") " pod="openshift-insights/insights-runtime-extractor-t6zw8" Jul 14 04:59:54.461594 ip-10-0-136-9 kubenswrapper[2584]: I0714 04:59:54.461440 2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/4e5332d8-9e2c-4660-8546-e026f8f5dd2a-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-t6zw8\" (UID: \"4e5332d8-9e2c-4660-8546-e026f8f5dd2a\") " pod="openshift-insights/insights-runtime-extractor-t6zw8" Jul 14 04:59:54.461594 ip-10-0-136-9 kubenswrapper[2584]: E0714 04:59:54.461509 2584 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found Jul 14 04:59:54.461594 ip-10-0-136-9 kubenswrapper[2584]: E0714 04:59:54.461560 2584 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found Jul 14 04:59:54.461594 ip-10-0-136-9 kubenswrapper[2584]: E0714 04:59:54.461570 2584 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/4e5332d8-9e2c-4660-8546-e026f8f5dd2a-kube-rbac-proxy-cm podName:4e5332d8-9e2c-4660-8546-e026f8f5dd2a nodeName:}" failed. No retries permitted until 2026-07-14 04:59:58.461550543 +0000 UTC m=+59.422806247 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/4e5332d8-9e2c-4660-8546-e026f8f5dd2a-kube-rbac-proxy-cm") pod "insights-runtime-extractor-t6zw8" (UID: "4e5332d8-9e2c-4660-8546-e026f8f5dd2a") : configmap "kube-rbac-proxy" not found Jul 14 04:59:54.461594 ip-10-0-136-9 kubenswrapper[2584]: E0714 04:59:54.461596 2584 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/4e5332d8-9e2c-4660-8546-e026f8f5dd2a-insights-runtime-extractor-tls podName:4e5332d8-9e2c-4660-8546-e026f8f5dd2a nodeName:}" failed. No retries permitted until 2026-07-14 04:59:58.461586209 +0000 UTC m=+59.422841891 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/4e5332d8-9e2c-4660-8546-e026f8f5dd2a-insights-runtime-extractor-tls") pod "insights-runtime-extractor-t6zw8" (UID: "4e5332d8-9e2c-4660-8546-e026f8f5dd2a") : secret "insights-runtime-extractor-tls" not found Jul 14 04:59:55.248605 ip-10-0-136-9 kubenswrapper[2584]: I0714 04:59:55.248557 2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-g257n_15609856-4056-487b-acdd-30276263b098/konnectivity-agent/0.log" limit=1024 Jul 14 04:59:55.344558 ip-10-0-136-9 kubenswrapper[2584]: I0714 04:59:55.344527 2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-g257n_15609856-4056-487b-acdd-30276263b098/konnectivity-agent/0.log" limit=1024 Jul 14 04:59:55.506875 ip-10-0-136-9 kubenswrapper[2584]: I0714 04:59:55.506791 2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-g257n_15609856-4056-487b-acdd-30276263b098/konnectivity-agent/0.log" limit=1024 Jul 14 04:59:55.601582 ip-10-0-136-9 kubenswrapper[2584]: I0714 04:59:55.601513 2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-g257n_15609856-4056-487b-acdd-30276263b098/konnectivity-agent/0.log" limit=1024 Jul 14 04:59:55.701387 ip-10-0-136-9 kubenswrapper[2584]: I0714 04:59:55.701351 2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-g257n_15609856-4056-487b-acdd-30276263b098/konnectivity-agent/0.log" limit=1024 Jul 14 04:59:56.132564 ip-10-0-136-9 kubenswrapper[2584]: I0714 04:59:56.132532 2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-g257n_15609856-4056-487b-acdd-30276263b098/konnectivity-agent/0.log" limit=1024 Jul 14 04:59:56.333710 ip-10-0-136-9 kubenswrapper[2584]: I0714 04:59:56.333671 2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-g257n_15609856-4056-487b-acdd-30276263b098/konnectivity-agent/0.log" limit=1024 Jul 14 04:59:57.137455 ip-10-0-136-9 kubenswrapper[2584]: I0714 04:59:57.137427 2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-g257n_15609856-4056-487b-acdd-30276263b098/konnectivity-agent/0.log" limit=1024 Jul 14 04:59:57.454193 ip-10-0-136-9 kubenswrapper[2584]: I0714 04:59:57.454120 2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-g257n_15609856-4056-487b-acdd-30276263b098/konnectivity-agent/0.log" limit=1024 Jul 14 04:59:57.743601 ip-10-0-136-9 kubenswrapper[2584]: I0714 04:59:57.743544 2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-g257n_15609856-4056-487b-acdd-30276263b098/konnectivity-agent/0.log" limit=1024 Jul 14 04:59:57.978005 ip-10-0-136-9 kubenswrapper[2584]: I0714 04:59:57.977978 2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-g257n_15609856-4056-487b-acdd-30276263b098/konnectivity-agent/0.log" limit=1024 Jul 14 04:59:58.182172 ip-10-0-136-9 kubenswrapper[2584]: I0714 04:59:58.182146 2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-g257n_15609856-4056-487b-acdd-30276263b098/konnectivity-agent/0.log" limit=1024 Jul 14 04:59:58.285491 ip-10-0-136-9 kubenswrapper[2584]: I0714 04:59:58.285465 2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-g257n_15609856-4056-487b-acdd-30276263b098/konnectivity-agent/0.log" limit=1024 Jul 14 04:59:58.496122 ip-10-0-136-9 kubenswrapper[2584]: I0714 04:59:58.496059 2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/4e5332d8-9e2c-4660-8546-e026f8f5dd2a-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-t6zw8\" (UID: \"4e5332d8-9e2c-4660-8546-e026f8f5dd2a\") " pod="openshift-insights/insights-runtime-extractor-t6zw8" Jul 14 04:59:58.496122 ip-10-0-136-9 kubenswrapper[2584]: I0714 04:59:58.496098 2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/4e5332d8-9e2c-4660-8546-e026f8f5dd2a-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-t6zw8\" (UID: \"4e5332d8-9e2c-4660-8546-e026f8f5dd2a\") " pod="openshift-insights/insights-runtime-extractor-t6zw8" Jul 14 04:59:58.496472 ip-10-0-136-9 kubenswrapper[2584]: E0714 04:59:58.496190 2584 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found Jul 14 04:59:58.496472 ip-10-0-136-9 kubenswrapper[2584]: E0714 04:59:58.496250 2584 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found Jul 14 04:59:58.496472 ip-10-0-136-9 kubenswrapper[2584]: E0714 04:59:58.496254 2584 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/4e5332d8-9e2c-4660-8546-e026f8f5dd2a-kube-rbac-proxy-cm podName:4e5332d8-9e2c-4660-8546-e026f8f5dd2a nodeName:}" failed. No retries permitted until 2026-07-14 05:00:06.496238433 +0000 UTC m=+67.457494115 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/4e5332d8-9e2c-4660-8546-e026f8f5dd2a-kube-rbac-proxy-cm") pod "insights-runtime-extractor-t6zw8" (UID: "4e5332d8-9e2c-4660-8546-e026f8f5dd2a") : configmap "kube-rbac-proxy" not found Jul 14 04:59:58.496472 ip-10-0-136-9 kubenswrapper[2584]: E0714 04:59:58.496305 2584 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/4e5332d8-9e2c-4660-8546-e026f8f5dd2a-insights-runtime-extractor-tls podName:4e5332d8-9e2c-4660-8546-e026f8f5dd2a nodeName:}" failed. No retries permitted until 2026-07-14 05:00:06.496292641 +0000 UTC m=+67.457548323 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/4e5332d8-9e2c-4660-8546-e026f8f5dd2a-insights-runtime-extractor-tls") pod "insights-runtime-extractor-t6zw8" (UID: "4e5332d8-9e2c-4660-8546-e026f8f5dd2a") : secret "insights-runtime-extractor-tls" not found Jul 14 04:59:58.556635 ip-10-0-136-9 kubenswrapper[2584]: I0714 04:59:58.556613 2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-g257n_15609856-4056-487b-acdd-30276263b098/konnectivity-agent/0.log" limit=1024 Jul 14 04:59:58.882767 ip-10-0-136-9 kubenswrapper[2584]: I0714 04:59:58.882743 2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-g257n_15609856-4056-487b-acdd-30276263b098/konnectivity-agent/0.log" limit=1024 Jul 14 04:59:58.983398 ip-10-0-136-9 kubenswrapper[2584]: I0714 04:59:58.983372 2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-g257n_15609856-4056-487b-acdd-30276263b098/konnectivity-agent/0.log" limit=1024 Jul 14 04:59:59.144368 ip-10-0-136-9 kubenswrapper[2584]: I0714 04:59:59.144304 2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-g257n_15609856-4056-487b-acdd-30276263b098/konnectivity-agent/0.log" limit=1024 Jul 14 04:59:59.336398 ip-10-0-136-9 kubenswrapper[2584]: I0714 04:59:59.336375 2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-g257n_15609856-4056-487b-acdd-30276263b098/konnectivity-agent/0.log" limit=1024 Jul 14 04:59:59.401412 ip-10-0-136-9 kubenswrapper[2584]: I0714 04:59:59.401332 2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-g257n_15609856-4056-487b-acdd-30276263b098/konnectivity-agent/0.log" limit=1024 Jul 14 04:59:59.533788 ip-10-0-136-9 kubenswrapper[2584]: I0714 04:59:59.533761 2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-g257n_15609856-4056-487b-acdd-30276263b098/konnectivity-agent/0.log" limit=1024 Jul 14 04:59:59.731071 ip-10-0-136-9 kubenswrapper[2584]: I0714 04:59:59.731011 2584 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-8llzd" Jul 14 04:59:59.742000 ip-10-0-136-9 kubenswrapper[2584]: I0714 04:59:59.741975 2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-g257n_15609856-4056-487b-acdd-30276263b098/konnectivity-agent/0.log" limit=1024 Jul 14 05:00:00.177826 ip-10-0-136-9 kubenswrapper[2584]: I0714 05:00:00.177788 2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-g257n_15609856-4056-487b-acdd-30276263b098/konnectivity-agent/0.log" limit=1024 Jul 14 05:00:00.242603 ip-10-0-136-9 kubenswrapper[2584]: I0714 05:00:00.242563 2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-g257n_15609856-4056-487b-acdd-30276263b098/konnectivity-agent/0.log" limit=1024 Jul 14 05:00:00.613344 ip-10-0-136-9 kubenswrapper[2584]: I0714 05:00:00.613317 2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/c27a6d7e-9146-4882-ba72-d2c22c209e03-networking-console-plugin-cert\") pod \"networking-console-plugin-6cf856758c-4bfn6\" (UID: \"c27a6d7e-9146-4882-ba72-d2c22c209e03\") " pod="openshift-network-console/networking-console-plugin-6cf856758c-4bfn6" Jul 14 05:00:00.613668 ip-10-0-136-9 kubenswrapper[2584]: E0714 05:00:00.613461 2584 secret.go:189] Couldn't get secret openshift-network-console/networking-console-plugin-cert: secret "networking-console-plugin-cert" not found Jul 14 05:00:00.613668 ip-10-0-136-9 kubenswrapper[2584]: E0714 05:00:00.613529 2584 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/c27a6d7e-9146-4882-ba72-d2c22c209e03-networking-console-plugin-cert podName:c27a6d7e-9146-4882-ba72-d2c22c209e03 nodeName:}" failed. No retries permitted until 2026-07-14 05:00:16.613510385 +0000 UTC m=+77.574766068 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "networking-console-plugin-cert" (UniqueName: "kubernetes.io/secret/c27a6d7e-9146-4882-ba72-d2c22c209e03-networking-console-plugin-cert") pod "networking-console-plugin-6cf856758c-4bfn6" (UID: "c27a6d7e-9146-4882-ba72-d2c22c209e03") : secret "networking-console-plugin-cert" not found Jul 14 05:00:00.932517 ip-10-0-136-9 kubenswrapper[2584]: I0714 05:00:00.932444 2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-g257n_15609856-4056-487b-acdd-30276263b098/konnectivity-agent/0.log" limit=1024 Jul 14 05:00:01.457712 ip-10-0-136-9 kubenswrapper[2584]: I0714 05:00:01.457685 2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-g257n_15609856-4056-487b-acdd-30276263b098/konnectivity-agent/0.log" limit=1024 Jul 14 05:00:01.584635 ip-10-0-136-9 kubenswrapper[2584]: I0714 05:00:01.584583 2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-g257n_15609856-4056-487b-acdd-30276263b098/konnectivity-agent/0.log" limit=1024 Jul 14 05:00:01.730242 ip-10-0-136-9 kubenswrapper[2584]: I0714 05:00:01.730176 2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-g257n_15609856-4056-487b-acdd-30276263b098/konnectivity-agent/0.log" limit=1024 Jul 14 05:00:01.830955 ip-10-0-136-9 kubenswrapper[2584]: I0714 05:00:01.830914 2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-g257n_15609856-4056-487b-acdd-30276263b098/konnectivity-agent/0.log" limit=1024 Jul 14 05:00:02.314477 ip-10-0-136-9 kubenswrapper[2584]: I0714 05:00:02.314449 2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-g257n_15609856-4056-487b-acdd-30276263b098/konnectivity-agent/0.log" limit=1024 Jul 14 05:00:02.937044 ip-10-0-136-9 kubenswrapper[2584]: I0714 05:00:02.937013 2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-g257n_15609856-4056-487b-acdd-30276263b098/konnectivity-agent/0.log" limit=1024 Jul 14 05:00:03.141108 ip-10-0-136-9 kubenswrapper[2584]: I0714 05:00:03.141059 2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-g257n_15609856-4056-487b-acdd-30276263b098/konnectivity-agent/0.log" limit=1024 Jul 14 05:00:03.331222 ip-10-0-136-9 kubenswrapper[2584]: I0714 05:00:03.331146 2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-g257n_15609856-4056-487b-acdd-30276263b098/konnectivity-agent/0.log" limit=1024 Jul 14 05:00:03.732513 ip-10-0-136-9 kubenswrapper[2584]: I0714 05:00:03.732487 2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-g257n_15609856-4056-487b-acdd-30276263b098/konnectivity-agent/0.log" limit=1024 Jul 14 05:00:04.648696 ip-10-0-136-9 kubenswrapper[2584]: I0714 05:00:04.648643 2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-g257n_15609856-4056-487b-acdd-30276263b098/konnectivity-agent/0.log" limit=1024 Jul 14 05:00:04.749419 ip-10-0-136-9 kubenswrapper[2584]: I0714 05:00:04.749389 2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-g257n_15609856-4056-487b-acdd-30276263b098/konnectivity-agent/0.log" limit=1024 Jul 14 05:00:04.944471 ip-10-0-136-9 kubenswrapper[2584]: I0714 05:00:04.944399 2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-g257n_15609856-4056-487b-acdd-30276263b098/konnectivity-agent/0.log" limit=1024 Jul 14 05:00:05.149399 ip-10-0-136-9 kubenswrapper[2584]: I0714 05:00:05.149363 2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/5d5fe629-46a1-4c48-bab2-32bbaf543c90-metrics-certs\") pod \"network-metrics-daemon-7prdk\" (UID: \"5d5fe629-46a1-4c48-bab2-32bbaf543c90\") " pod="openshift-multus/network-metrics-daemon-7prdk" Jul 14 05:00:05.152156 ip-10-0-136-9 kubenswrapper[2584]: I0714 05:00:05.152138 2584 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-secret\"" Jul 14 05:00:05.162604 ip-10-0-136-9 kubenswrapper[2584]: I0714 05:00:05.162576 2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/5d5fe629-46a1-4c48-bab2-32bbaf543c90-metrics-certs\") pod \"network-metrics-daemon-7prdk\" (UID: \"5d5fe629-46a1-4c48-bab2-32bbaf543c90\") " pod="openshift-multus/network-metrics-daemon-7prdk" Jul 14 05:00:05.172617 ip-10-0-136-9 kubenswrapper[2584]: I0714 05:00:05.172574 2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-g257n_15609856-4056-487b-acdd-30276263b098/konnectivity-agent/0.log" limit=1024 Jul 14 05:00:05.249681 ip-10-0-136-9 kubenswrapper[2584]: I0714 05:00:05.249623 2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-v7nvc\" (UniqueName: \"kubernetes.io/projected/c4902f44-8d7a-4f36-b6e7-0acf7bef5043-kube-api-access-v7nvc\") pod \"network-check-target-kr4q2\" (UID: \"c4902f44-8d7a-4f36-b6e7-0acf7bef5043\") " pod="openshift-network-diagnostics/network-check-target-kr4q2" Jul 14 05:00:05.251875 ip-10-0-136-9 kubenswrapper[2584]: I0714 05:00:05.251855 2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-v7nvc\" (UniqueName: \"kubernetes.io/projected/c4902f44-8d7a-4f36-b6e7-0acf7bef5043-kube-api-access-v7nvc\") pod \"network-check-target-kr4q2\" (UID: \"c4902f44-8d7a-4f36-b6e7-0acf7bef5043\") " pod="openshift-network-diagnostics/network-check-target-kr4q2" Jul 14 05:00:05.350581 ip-10-0-136-9 kubenswrapper[2584]: I0714 05:00:05.350549 2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/7078f217-1a51-4d64-a155-e5ca77500f07-original-pull-secret\") pod \"global-pull-secret-syncer-fb7bm\" (UID: \"7078f217-1a51-4d64-a155-e5ca77500f07\") " pod="kube-system/global-pull-secret-syncer-fb7bm" Jul 14 05:00:05.353442 ip-10-0-136-9 kubenswrapper[2584]: I0714 05:00:05.353426 2584 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"original-pull-secret\"" Jul 14 05:00:05.356652 ip-10-0-136-9 kubenswrapper[2584]: I0714 05:00:05.356636 2584 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"default-dockercfg-hpjvf\"" Jul 14 05:00:05.362643 ip-10-0-136-9 kubenswrapper[2584]: I0714 05:00:05.362627 2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/7078f217-1a51-4d64-a155-e5ca77500f07-original-pull-secret\") pod \"global-pull-secret-syncer-fb7bm\" (UID: \"7078f217-1a51-4d64-a155-e5ca77500f07\") " pod="kube-system/global-pull-secret-syncer-fb7bm" Jul 14 05:00:05.363470 ip-10-0-136-9 kubenswrapper[2584]: I0714 05:00:05.363455 2584 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-sa-dockercfg-jntlj\"" Jul 14 05:00:05.365466 ip-10-0-136-9 kubenswrapper[2584]: I0714 05:00:05.365453 2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-kr4q2" Jul 14 05:00:05.378552 ip-10-0-136-9 kubenswrapper[2584]: I0714 05:00:05.378534 2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-7prdk" Jul 14 05:00:05.452026 ip-10-0-136-9 kubenswrapper[2584]: I0714 05:00:05.451997 2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/6421bddc-6c3a-4ae2-9a6c-348d3de7aec9-registry-tls\") pod \"image-registry-6f5d75bf47-rnc9m\" (UID: \"6421bddc-6c3a-4ae2-9a6c-348d3de7aec9\") " pod="openshift-image-registry/image-registry-6f5d75bf47-rnc9m" Jul 14 05:00:05.452162 ip-10-0-136-9 kubenswrapper[2584]: I0714 05:00:05.452070 2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/d6fb944a-4c2d-4f24-a25b-e5a3067fe627-metrics-tls\") pod \"dns-default-gkwjs\" (UID: \"d6fb944a-4c2d-4f24-a25b-e5a3067fe627\") " pod="openshift-dns/dns-default-gkwjs" Jul 14 05:00:05.454674 ip-10-0-136-9 kubenswrapper[2584]: I0714 05:00:05.454597 2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/d6fb944a-4c2d-4f24-a25b-e5a3067fe627-metrics-tls\") pod \"dns-default-gkwjs\" (UID: \"d6fb944a-4c2d-4f24-a25b-e5a3067fe627\") " pod="openshift-dns/dns-default-gkwjs" Jul 14 05:00:05.454674 ip-10-0-136-9 kubenswrapper[2584]: I0714 05:00:05.454604 2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/6421bddc-6c3a-4ae2-9a6c-348d3de7aec9-registry-tls\") pod \"image-registry-6f5d75bf47-rnc9m\" (UID: \"6421bddc-6c3a-4ae2-9a6c-348d3de7aec9\") " pod="openshift-image-registry/image-registry-6f5d75bf47-rnc9m" Jul 14 05:00:05.511183 ip-10-0-136-9 kubenswrapper[2584]: I0714 05:00:05.511162 2584 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-multus/network-metrics-daemon-7prdk"] Jul 14 05:00:05.513555 ip-10-0-136-9 kubenswrapper[2584]: W0714 05:00:05.513532 2584 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod5d5fe629_46a1_4c48_bab2_32bbaf543c90.slice/crio-3673bc6788bc6060a70b1e86c7ac38fb510bd317f50de54b13172d911d196b3d WatchSource:0}: Error finding container 3673bc6788bc6060a70b1e86c7ac38fb510bd317f50de54b13172d911d196b3d: Status 404 returned error can't find the container with id 3673bc6788bc6060a70b1e86c7ac38fb510bd317f50de54b13172d911d196b3d Jul 14 05:00:05.528221 ip-10-0-136-9 kubenswrapper[2584]: I0714 05:00:05.528202 2584 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-target-kr4q2"] Jul 14 05:00:05.529371 ip-10-0-136-9 kubenswrapper[2584]: W0714 05:00:05.529349 2584 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podc4902f44_8d7a_4f36_b6e7_0acf7bef5043.slice/crio-153f616dcc7eb0911b98fde5f480957b6a86bbb1957e415b7c23333a5b2fc3e7 WatchSource:0}: Error finding container 153f616dcc7eb0911b98fde5f480957b6a86bbb1957e415b7c23333a5b2fc3e7: Status 404 returned error can't find the container with id 153f616dcc7eb0911b98fde5f480957b6a86bbb1957e415b7c23333a5b2fc3e7 Jul 14 05:00:05.537514 ip-10-0-136-9 kubenswrapper[2584]: I0714 05:00:05.537491 2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-g257n_15609856-4056-487b-acdd-30276263b098/konnectivity-agent/0.log" limit=1024 Jul 14 05:00:05.552604 ip-10-0-136-9 kubenswrapper[2584]: I0714 05:00:05.552569 2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/95fdfeab-07ef-4e6d-96cc-2c7056d1c833-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-5f7f494dd4-9nsjr\" (UID: \"95fdfeab-07ef-4e6d-96cc-2c7056d1c833\") " pod="openshift-monitoring/cluster-monitoring-operator-5f7f494dd4-9nsjr" Jul 14 05:00:05.552697 ip-10-0-136-9 kubenswrapper[2584]: I0714 05:00:05.552630 2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/13fb9031-3a05-4a3f-bbef-a2466ef852fb-samples-operator-tls\") pod \"cluster-samples-operator-65db858894-m6cp5\" (UID: \"13fb9031-3a05-4a3f-bbef-a2466ef852fb\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-65db858894-m6cp5" Jul 14 05:00:05.554574 ip-10-0-136-9 kubenswrapper[2584]: I0714 05:00:05.554554 2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/95fdfeab-07ef-4e6d-96cc-2c7056d1c833-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-5f7f494dd4-9nsjr\" (UID: \"95fdfeab-07ef-4e6d-96cc-2c7056d1c833\") " pod="openshift-monitoring/cluster-monitoring-operator-5f7f494dd4-9nsjr" Jul 14 05:00:05.554682 ip-10-0-136-9 kubenswrapper[2584]: I0714 05:00:05.554666 2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/13fb9031-3a05-4a3f-bbef-a2466ef852fb-samples-operator-tls\") pod \"cluster-samples-operator-65db858894-m6cp5\" (UID: \"13fb9031-3a05-4a3f-bbef-a2466ef852fb\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-65db858894-m6cp5" Jul 14 05:00:05.602418 ip-10-0-136-9 kubenswrapper[2584]: I0714 05:00:05.602402 2584 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"registry-dockercfg-clkvv\"" Jul 14 05:00:05.609642 ip-10-0-136-9 kubenswrapper[2584]: I0714 05:00:05.609626 2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-6f5d75bf47-rnc9m" Jul 14 05:00:05.624477 ip-10-0-136-9 kubenswrapper[2584]: I0714 05:00:05.624456 2584 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-dockercfg-6l8db\"" Jul 14 05:00:05.632722 ip-10-0-136-9 kubenswrapper[2584]: I0714 05:00:05.632700 2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-gkwjs" Jul 14 05:00:05.648012 ip-10-0-136-9 kubenswrapper[2584]: I0714 05:00:05.647989 2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-fb7bm" Jul 14 05:00:05.655002 ip-10-0-136-9 kubenswrapper[2584]: I0714 05:00:05.653507 2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/c9f966c9-5bd6-4602-9a96-ea935895d2d9-service-ca-bundle\") pod \"router-default-59f7f8d6b6-mb84v\" (UID: \"c9f966c9-5bd6-4602-9a96-ea935895d2d9\") " pod="openshift-ingress/router-default-59f7f8d6b6-mb84v" Jul 14 05:00:05.655002 ip-10-0-136-9 kubenswrapper[2584]: I0714 05:00:05.653562 2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/c9f966c9-5bd6-4602-9a96-ea935895d2d9-metrics-certs\") pod \"router-default-59f7f8d6b6-mb84v\" (UID: \"c9f966c9-5bd6-4602-9a96-ea935895d2d9\") " pod="openshift-ingress/router-default-59f7f8d6b6-mb84v" Jul 14 05:00:05.655002 ip-10-0-136-9 kubenswrapper[2584]: I0714 05:00:05.654717 2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/c9f966c9-5bd6-4602-9a96-ea935895d2d9-service-ca-bundle\") pod \"router-default-59f7f8d6b6-mb84v\" (UID: \"c9f966c9-5bd6-4602-9a96-ea935895d2d9\") " pod="openshift-ingress/router-default-59f7f8d6b6-mb84v" Jul 14 05:00:05.656790 ip-10-0-136-9 kubenswrapper[2584]: I0714 05:00:05.656764 2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/c9f966c9-5bd6-4602-9a96-ea935895d2d9-metrics-certs\") pod \"router-default-59f7f8d6b6-mb84v\" (UID: \"c9f966c9-5bd6-4602-9a96-ea935895d2d9\") " pod="openshift-ingress/router-default-59f7f8d6b6-mb84v" Jul 14 05:00:05.711159 ip-10-0-136-9 kubenswrapper[2584]: I0714 05:00:05.710461 2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-g257n_15609856-4056-487b-acdd-30276263b098/konnectivity-agent/0.log" limit=1024 Jul 14 05:00:05.742278 ip-10-0-136-9 kubenswrapper[2584]: I0714 05:00:05.742249 2584 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-samples-operator\"/\"cluster-samples-operator-dockercfg-dnkn6\"" Jul 14 05:00:05.747809 ip-10-0-136-9 kubenswrapper[2584]: I0714 05:00:05.747729 2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-samples-operator/cluster-samples-operator-65db858894-m6cp5" Jul 14 05:00:05.761187 ip-10-0-136-9 kubenswrapper[2584]: I0714 05:00:05.760523 2584 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-image-registry/image-registry-6f5d75bf47-rnc9m"] Jul 14 05:00:05.762806 ip-10-0-136-9 kubenswrapper[2584]: W0714 05:00:05.762780 2584 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod6421bddc_6c3a_4ae2_9a6c_348d3de7aec9.slice/crio-7629be8d8b3673be9a41537803a8942dd1109de02adfec911e02978dfc877713 WatchSource:0}: Error finding container 7629be8d8b3673be9a41537803a8942dd1109de02adfec911e02978dfc877713: Status 404 returned error can't find the container with id 7629be8d8b3673be9a41537803a8942dd1109de02adfec911e02978dfc877713 Jul 14 05:00:05.781965 ip-10-0-136-9 kubenswrapper[2584]: I0714 05:00:05.781922 2584 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-dns/dns-default-gkwjs"] Jul 14 05:00:05.783962 ip-10-0-136-9 kubenswrapper[2584]: W0714 05:00:05.783914 2584 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podd6fb944a_4c2d_4f24_a25b_e5a3067fe627.slice/crio-71caf689dc4ca960b0d5b0f9e7dff6be7a0cdabbf82fda9453976c87c5d7e571 WatchSource:0}: Error finding container 71caf689dc4ca960b0d5b0f9e7dff6be7a0cdabbf82fda9453976c87c5d7e571: Status 404 returned error can't find the container with id 71caf689dc4ca960b0d5b0f9e7dff6be7a0cdabbf82fda9453976c87c5d7e571 Jul 14 05:00:05.786083 ip-10-0-136-9 kubenswrapper[2584]: I0714 05:00:05.786063 2584 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"cluster-monitoring-operator-dockercfg-x95kg\"" Jul 14 05:00:05.793975 ip-10-0-136-9 kubenswrapper[2584]: I0714 05:00:05.793946 2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/cluster-monitoring-operator-5f7f494dd4-9nsjr" Jul 14 05:00:05.797651 ip-10-0-136-9 kubenswrapper[2584]: I0714 05:00:05.797607 2584 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kube-system/global-pull-secret-syncer-fb7bm"] Jul 14 05:00:05.802383 ip-10-0-136-9 kubenswrapper[2584]: I0714 05:00:05.802368 2584 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"router-dockercfg-rc5ls\"" Jul 14 05:00:05.809041 ip-10-0-136-9 kubenswrapper[2584]: W0714 05:00:05.809014 2584 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod7078f217_1a51_4d64_a155_e5ca77500f07.slice/crio-4e968a7937193068b76b6efa33a5cf4f3675cab24d9cc1d10f047a0141bd8cfc WatchSource:0}: Error finding container 4e968a7937193068b76b6efa33a5cf4f3675cab24d9cc1d10f047a0141bd8cfc: Status 404 returned error can't find the container with id 4e968a7937193068b76b6efa33a5cf4f3675cab24d9cc1d10f047a0141bd8cfc Jul 14 05:00:05.809997 ip-10-0-136-9 kubenswrapper[2584]: I0714 05:00:05.809975 2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/router-default-59f7f8d6b6-mb84v" Jul 14 05:00:05.910995 ip-10-0-136-9 kubenswrapper[2584]: I0714 05:00:05.910874 2584 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-cluster-samples-operator/cluster-samples-operator-65db858894-m6cp5"] Jul 14 05:00:05.961254 ip-10-0-136-9 kubenswrapper[2584]: I0714 05:00:05.961232 2584 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/cluster-monitoring-operator-5f7f494dd4-9nsjr"] Jul 14 05:00:05.963922 ip-10-0-136-9 kubenswrapper[2584]: W0714 05:00:05.963898 2584 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod95fdfeab_07ef_4e6d_96cc_2c7056d1c833.slice/crio-40923fca15c68847b6256b4fae51795409c1b6d8a3c6697582641a6f12180048 WatchSource:0}: Error finding container 40923fca15c68847b6256b4fae51795409c1b6d8a3c6697582641a6f12180048: Status 404 returned error can't find the container with id 40923fca15c68847b6256b4fae51795409c1b6d8a3c6697582641a6f12180048 Jul 14 05:00:05.980137 ip-10-0-136-9 kubenswrapper[2584]: I0714 05:00:05.980120 2584 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/router-default-59f7f8d6b6-mb84v"] Jul 14 05:00:05.982121 ip-10-0-136-9 kubenswrapper[2584]: W0714 05:00:05.982101 2584 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podc9f966c9_5bd6_4602_9a96_ea935895d2d9.slice/crio-621000c4c22d4f807b27b8412644468f836b55ee1eab26d2c393cf8d399ae5dd WatchSource:0}: Error finding container 621000c4c22d4f807b27b8412644468f836b55ee1eab26d2c393cf8d399ae5dd: Status 404 returned error can't find the container with id 621000c4c22d4f807b27b8412644468f836b55ee1eab26d2c393cf8d399ae5dd Jul 14 05:00:05.998265 ip-10-0-136-9 kubenswrapper[2584]: I0714 05:00:05.998235 2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-target-kr4q2" event={"ID":"c4902f44-8d7a-4f36-b6e7-0acf7bef5043","Type":"ContainerStarted","Data":"b5539dfc4d7235b8922b4036a21e7a9c508875cc2a18c54bd2b45f8f0ba4bf28"} Jul 14 05:00:05.998384 ip-10-0-136-9 kubenswrapper[2584]: I0714 05:00:05.998286 2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-target-kr4q2" event={"ID":"c4902f44-8d7a-4f36-b6e7-0acf7bef5043","Type":"ContainerStarted","Data":"153f616dcc7eb0911b98fde5f480957b6a86bbb1957e415b7c23333a5b2fc3e7"} Jul 14 05:00:05.998384 ip-10-0-136-9 kubenswrapper[2584]: I0714 05:00:05.998315 2584 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-network-diagnostics/network-check-target-kr4q2" Jul 14 05:00:05.999845 ip-10-0-136-9 kubenswrapper[2584]: I0714 05:00:05.999812 2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-gkwjs" event={"ID":"d6fb944a-4c2d-4f24-a25b-e5a3067fe627","Type":"ContainerStarted","Data":"71caf689dc4ca960b0d5b0f9e7dff6be7a0cdabbf82fda9453976c87c5d7e571"} Jul 14 05:00:06.001270 ip-10-0-136-9 kubenswrapper[2584]: I0714 05:00:06.001244 2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-samples-operator/cluster-samples-operator-65db858894-m6cp5" event={"ID":"13fb9031-3a05-4a3f-bbef-a2466ef852fb","Type":"ContainerStarted","Data":"4fe7409d66a01566f771d86f5d6797e7ffa6a9fcef2bb059cab4da4c74882bdb"} Jul 14 05:00:06.002625 ip-10-0-136-9 kubenswrapper[2584]: I0714 05:00:06.002589 2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/global-pull-secret-syncer-fb7bm" event={"ID":"7078f217-1a51-4d64-a155-e5ca77500f07","Type":"ContainerStarted","Data":"4e968a7937193068b76b6efa33a5cf4f3675cab24d9cc1d10f047a0141bd8cfc"} Jul 14 05:00:06.003832 ip-10-0-136-9 kubenswrapper[2584]: I0714 05:00:06.003809 2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/router-default-59f7f8d6b6-mb84v" event={"ID":"c9f966c9-5bd6-4602-9a96-ea935895d2d9","Type":"ContainerStarted","Data":"621000c4c22d4f807b27b8412644468f836b55ee1eab26d2c393cf8d399ae5dd"} Jul 14 05:00:06.005162 ip-10-0-136-9 kubenswrapper[2584]: I0714 05:00:06.005138 2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-7prdk" event={"ID":"5d5fe629-46a1-4c48-bab2-32bbaf543c90","Type":"ContainerStarted","Data":"3673bc6788bc6060a70b1e86c7ac38fb510bd317f50de54b13172d911d196b3d"} Jul 14 05:00:06.006259 ip-10-0-136-9 kubenswrapper[2584]: I0714 05:00:06.006228 2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/cluster-monitoring-operator-5f7f494dd4-9nsjr" event={"ID":"95fdfeab-07ef-4e6d-96cc-2c7056d1c833","Type":"ContainerStarted","Data":"40923fca15c68847b6256b4fae51795409c1b6d8a3c6697582641a6f12180048"} Jul 14 05:00:06.007609 ip-10-0-136-9 kubenswrapper[2584]: I0714 05:00:06.007586 2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-6f5d75bf47-rnc9m" event={"ID":"6421bddc-6c3a-4ae2-9a6c-348d3de7aec9","Type":"ContainerStarted","Data":"b44b979dae3af343d2d5cc02eec172e10236539c28067a9d728bc2890666dd70"} Jul 14 05:00:06.007691 ip-10-0-136-9 kubenswrapper[2584]: I0714 05:00:06.007621 2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-6f5d75bf47-rnc9m" event={"ID":"6421bddc-6c3a-4ae2-9a6c-348d3de7aec9","Type":"ContainerStarted","Data":"7629be8d8b3673be9a41537803a8942dd1109de02adfec911e02978dfc877713"} Jul 14 05:00:06.007738 ip-10-0-136-9 kubenswrapper[2584]: I0714 05:00:06.007718 2584 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-image-registry/image-registry-6f5d75bf47-rnc9m" Jul 14 05:00:06.013752 ip-10-0-136-9 kubenswrapper[2584]: I0714 05:00:06.013716 2584 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-diagnostics/network-check-target-kr4q2" podStartSLOduration=67.013702406 podStartE2EDuration="1m7.013702406s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-14 04:58:59 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-14 05:00:06.012547603 +0000 UTC m=+66.973803309" watchObservedRunningTime="2026-07-14 05:00:06.013702406 +0000 UTC m=+66.974958111" Jul 14 05:00:06.034502 ip-10-0-136-9 kubenswrapper[2584]: I0714 05:00:06.034456 2584 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-image-registry/image-registry-6f5d75bf47-rnc9m" podStartSLOduration=66.034438053 podStartE2EDuration="1m6.034438053s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-14 04:59:00 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-14 05:00:06.032853386 +0000 UTC m=+66.994109090" watchObservedRunningTime="2026-07-14 05:00:06.034438053 +0000 UTC m=+66.995693758" Jul 14 05:00:06.210024 ip-10-0-136-9 kubenswrapper[2584]: I0714 05:00:06.209952 2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-g257n_15609856-4056-487b-acdd-30276263b098/konnectivity-agent/0.log" limit=1024 Jul 14 05:00:06.339206 ip-10-0-136-9 kubenswrapper[2584]: I0714 05:00:06.339149 2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-g257n_15609856-4056-487b-acdd-30276263b098/konnectivity-agent/0.log" limit=1024 Jul 14 05:00:06.564388 ip-10-0-136-9 kubenswrapper[2584]: I0714 05:00:06.563801 2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/4e5332d8-9e2c-4660-8546-e026f8f5dd2a-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-t6zw8\" (UID: \"4e5332d8-9e2c-4660-8546-e026f8f5dd2a\") " pod="openshift-insights/insights-runtime-extractor-t6zw8" Jul 14 05:00:06.564388 ip-10-0-136-9 kubenswrapper[2584]: I0714 05:00:06.563861 2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/4e5332d8-9e2c-4660-8546-e026f8f5dd2a-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-t6zw8\" (UID: \"4e5332d8-9e2c-4660-8546-e026f8f5dd2a\") " pod="openshift-insights/insights-runtime-extractor-t6zw8" Jul 14 05:00:06.564758 ip-10-0-136-9 kubenswrapper[2584]: I0714 05:00:06.564709 2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/4e5332d8-9e2c-4660-8546-e026f8f5dd2a-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-t6zw8\" (UID: \"4e5332d8-9e2c-4660-8546-e026f8f5dd2a\") " pod="openshift-insights/insights-runtime-extractor-t6zw8" Jul 14 05:00:06.567994 ip-10-0-136-9 kubenswrapper[2584]: I0714 05:00:06.567968 2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/4e5332d8-9e2c-4660-8546-e026f8f5dd2a-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-t6zw8\" (UID: \"4e5332d8-9e2c-4660-8546-e026f8f5dd2a\") " pod="openshift-insights/insights-runtime-extractor-t6zw8" Jul 14 05:00:06.698387 ip-10-0-136-9 kubenswrapper[2584]: I0714 05:00:06.698319 2584 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-sa-dockercfg-5h9dw\"" Jul 14 05:00:06.706688 ip-10-0-136-9 kubenswrapper[2584]: I0714 05:00:06.706606 2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-runtime-extractor-t6zw8" Jul 14 05:00:06.879013 ip-10-0-136-9 kubenswrapper[2584]: I0714 05:00:06.878915 2584 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-runtime-extractor-t6zw8"] Jul 14 05:00:06.886468 ip-10-0-136-9 kubenswrapper[2584]: W0714 05:00:06.886429 2584 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod4e5332d8_9e2c_4660_8546_e026f8f5dd2a.slice/crio-4fb02e7f959cf2844d7fbaea4894295dd751eb71af44deb33d06b3e702487569 WatchSource:0}: Error finding container 4fb02e7f959cf2844d7fbaea4894295dd751eb71af44deb33d06b3e702487569: Status 404 returned error can't find the container with id 4fb02e7f959cf2844d7fbaea4894295dd751eb71af44deb33d06b3e702487569 Jul 14 05:00:07.016996 ip-10-0-136-9 kubenswrapper[2584]: I0714 05:00:07.016628 2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/router-default-59f7f8d6b6-mb84v" event={"ID":"c9f966c9-5bd6-4602-9a96-ea935895d2d9","Type":"ContainerStarted","Data":"7897ff6bc709add32e6c69770e85621ea5597a01266f4947125881db8a30c53d"} Jul 14 05:00:07.022512 ip-10-0-136-9 kubenswrapper[2584]: I0714 05:00:07.022436 2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-7prdk" event={"ID":"5d5fe629-46a1-4c48-bab2-32bbaf543c90","Type":"ContainerStarted","Data":"a247edad344a315e58a9c4d9f7e886783092b5b64f38d573f2809085469dd637"} Jul 14 05:00:07.022748 ip-10-0-136-9 kubenswrapper[2584]: I0714 05:00:07.022692 2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-7prdk" event={"ID":"5d5fe629-46a1-4c48-bab2-32bbaf543c90","Type":"ContainerStarted","Data":"4cc930c2d0f07a3a532698468f0287402b6eec5d362d0ea074e129ce2ca9cbbc"} Jul 14 05:00:07.025591 ip-10-0-136-9 kubenswrapper[2584]: I0714 05:00:07.025269 2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-t6zw8" event={"ID":"4e5332d8-9e2c-4660-8546-e026f8f5dd2a","Type":"ContainerStarted","Data":"4fb02e7f959cf2844d7fbaea4894295dd751eb71af44deb33d06b3e702487569"} Jul 14 05:00:07.043955 ip-10-0-136-9 kubenswrapper[2584]: I0714 05:00:07.043889 2584 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/router-default-59f7f8d6b6-mb84v" podStartSLOduration=42.043872462 podStartE2EDuration="42.043872462s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-14 04:59:25 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-14 05:00:07.041522701 +0000 UTC m=+68.002778425" watchObservedRunningTime="2026-07-14 05:00:07.043872462 +0000 UTC m=+68.005128145" Jul 14 05:00:07.527059 ip-10-0-136-9 kubenswrapper[2584]: I0714 05:00:07.525649 2584 scope.go:117] "RemoveContainer" containerID="7b589c55541c40cd5bb0dc2bea20f2ee0ef2b500cfa5f292c6ce7575a2cd14c6" Jul 14 05:00:07.810861 ip-10-0-136-9 kubenswrapper[2584]: I0714 05:00:07.810777 2584 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/router-default-59f7f8d6b6-mb84v" Jul 14 05:00:07.814130 ip-10-0-136-9 kubenswrapper[2584]: I0714 05:00:07.813786 2584 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/router-default-59f7f8d6b6-mb84v" Jul 14 05:00:07.839971 ip-10-0-136-9 kubenswrapper[2584]: I0714 05:00:07.837814 2584 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/network-metrics-daemon-7prdk" podStartSLOduration=67.629248934 podStartE2EDuration="1m8.837796126s" totalImagesPullingTime="1.208547192s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-14 04:58:59 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-14 05:00:07.05889594 +0000 UTC m=+68.020151645" watchObservedRunningTime="2026-07-14 05:00:07.837796126 +0000 UTC m=+68.799051830" Jul 14 05:00:08.030924 ip-10-0-136-9 kubenswrapper[2584]: I0714 05:00:08.030869 2584 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/router-default-59f7f8d6b6-mb84v" Jul 14 05:00:08.032231 ip-10-0-136-9 kubenswrapper[2584]: I0714 05:00:08.032107 2584 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/router-default-59f7f8d6b6-mb84v" Jul 14 05:00:11.194026 ip-10-0-136-9 kubenswrapper[2584]: I0714 05:00:11.193992 2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-g257n_15609856-4056-487b-acdd-30276263b098/konnectivity-agent/0.log" limit=1024 Jul 14 05:00:11.246210 ip-10-0-136-9 kubenswrapper[2584]: I0714 05:00:11.246176 2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-g257n_15609856-4056-487b-acdd-30276263b098/konnectivity-agent/0.log" limit=1024 Jul 14 05:00:11.732990 ip-10-0-136-9 kubenswrapper[2584]: I0714 05:00:11.732473 2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-g257n_15609856-4056-487b-acdd-30276263b098/konnectivity-agent/0.log" limit=1024 Jul 14 05:00:11.840914 ip-10-0-136-9 kubenswrapper[2584]: I0714 05:00:11.840881 2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-g257n_15609856-4056-487b-acdd-30276263b098/konnectivity-agent/0.log" limit=1024 Jul 14 05:00:11.972232 ip-10-0-136-9 kubenswrapper[2584]: I0714 05:00:11.972096 2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-g257n_15609856-4056-487b-acdd-30276263b098/konnectivity-agent/0.log" limit=1024 Jul 14 05:00:12.052301 ip-10-0-136-9 kubenswrapper[2584]: I0714 05:00:12.052194 2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/cluster-monitoring-operator-5f7f494dd4-9nsjr" event={"ID":"95fdfeab-07ef-4e6d-96cc-2c7056d1c833","Type":"ContainerStarted","Data":"1a3fd3249772f8afbc859a0c3c50f6802510f4350abbc39091b50fff3b2c6d91"} Jul 14 05:00:12.054369 ip-10-0-136-9 kubenswrapper[2584]: I0714 05:00:12.054314 2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-gkwjs" event={"ID":"d6fb944a-4c2d-4f24-a25b-e5a3067fe627","Type":"ContainerStarted","Data":"ae2e341eafe64f067e2cc9656f862856db922dddb7fbcdc0870650c27609fd76"} Jul 14 05:00:12.056671 ip-10-0-136-9 kubenswrapper[2584]: I0714 05:00:12.056616 2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-samples-operator/cluster-samples-operator-65db858894-m6cp5" event={"ID":"13fb9031-3a05-4a3f-bbef-a2466ef852fb","Type":"ContainerStarted","Data":"6a85c649044432d1c4b6e7294593f84651c489a5b7ed900697c8c39c26cac4ec"} Jul 14 05:00:12.059726 ip-10-0-136-9 kubenswrapper[2584]: I0714 05:00:12.059697 2584 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-7866497494-wh846_b0b64988-41ac-4e49-bcfd-a08adebb37f7/console-operator/1.log" Jul 14 05:00:12.059814 ip-10-0-136-9 kubenswrapper[2584]: I0714 05:00:12.059739 2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console-operator/console-operator-7866497494-wh846" event={"ID":"b0b64988-41ac-4e49-bcfd-a08adebb37f7","Type":"ContainerStarted","Data":"d926c38fbca6814b3a892ab007c92248093d5562bb08bca73a22a9df56568074"} Jul 14 05:00:12.060917 ip-10-0-136-9 kubenswrapper[2584]: I0714 05:00:12.060408 2584 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console-operator/console-operator-7866497494-wh846" Jul 14 05:00:12.072416 ip-10-0-136-9 kubenswrapper[2584]: I0714 05:00:12.072376 2584 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/cluster-monitoring-operator-5f7f494dd4-9nsjr" podStartSLOduration=41.731957267 podStartE2EDuration="47.072359887s" totalImagesPullingTime="5.34040262s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-14 04:59:25 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-14 05:00:12.07066067 +0000 UTC m=+73.031916371" watchObservedRunningTime="2026-07-14 05:00:12.072359887 +0000 UTC m=+73.033615591" Jul 14 05:00:12.090063 ip-10-0-136-9 kubenswrapper[2584]: I0714 05:00:12.090029 2584 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console-operator/console-operator-7866497494-wh846" podStartSLOduration=33.334334208 podStartE2EDuration="47.090012978s" totalImagesPullingTime="13.75567877s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-14 04:59:25 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-14 05:00:12.089776559 +0000 UTC m=+73.051032263" watchObservedRunningTime="2026-07-14 05:00:12.090012978 +0000 UTC m=+73.051268685" Jul 14 05:00:12.216323 ip-10-0-136-9 kubenswrapper[2584]: I0714 05:00:12.216228 2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-g257n_15609856-4056-487b-acdd-30276263b098/konnectivity-agent/0.log" limit=1024 Jul 14 05:00:12.629283 ip-10-0-136-9 kubenswrapper[2584]: I0714 05:00:12.629255 2584 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console-operator/console-operator-7866497494-wh846" Jul 14 05:00:12.832674 ip-10-0-136-9 kubenswrapper[2584]: I0714 05:00:12.832635 2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-g257n_15609856-4056-487b-acdd-30276263b098/konnectivity-agent/0.log" limit=1024 Jul 14 05:00:12.934207 ip-10-0-136-9 kubenswrapper[2584]: I0714 05:00:12.934119 2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-g257n_15609856-4056-487b-acdd-30276263b098/konnectivity-agent/0.log" limit=1024 Jul 14 05:00:12.993034 ip-10-0-136-9 kubenswrapper[2584]: I0714 05:00:12.992996 2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-g257n_15609856-4056-487b-acdd-30276263b098/konnectivity-agent/0.log" limit=1024 Jul 14 05:00:13.118273 ip-10-0-136-9 kubenswrapper[2584]: I0714 05:00:13.118237 2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-g257n_15609856-4056-487b-acdd-30276263b098/konnectivity-agent/0.log" limit=1024 Jul 14 05:00:13.489160 ip-10-0-136-9 kubenswrapper[2584]: I0714 05:00:13.489094 2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-g257n_15609856-4056-487b-acdd-30276263b098/konnectivity-agent/0.log" limit=1024 Jul 14 05:00:13.590319 ip-10-0-136-9 kubenswrapper[2584]: I0714 05:00:13.590280 2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-g257n_15609856-4056-487b-acdd-30276263b098/konnectivity-agent/0.log" limit=1024 Jul 14 05:00:14.006412 ip-10-0-136-9 kubenswrapper[2584]: I0714 05:00:14.006369 2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-g257n_15609856-4056-487b-acdd-30276263b098/konnectivity-agent/0.log" limit=1024 Jul 14 05:00:14.101911 ip-10-0-136-9 kubenswrapper[2584]: I0714 05:00:14.101879 2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-g257n_15609856-4056-487b-acdd-30276263b098/konnectivity-agent/0.log" limit=1024 Jul 14 05:00:14.156278 ip-10-0-136-9 kubenswrapper[2584]: I0714 05:00:14.156246 2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-g257n_15609856-4056-487b-acdd-30276263b098/konnectivity-agent/0.log" limit=1024 Jul 14 05:00:14.496897 ip-10-0-136-9 kubenswrapper[2584]: I0714 05:00:14.496856 2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-g257n_15609856-4056-487b-acdd-30276263b098/konnectivity-agent/0.log" limit=1024 Jul 14 05:00:14.790539 ip-10-0-136-9 kubenswrapper[2584]: I0714 05:00:14.790512 2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-g257n_15609856-4056-487b-acdd-30276263b098/konnectivity-agent/0.log" limit=1024 Jul 14 05:00:15.046413 ip-10-0-136-9 kubenswrapper[2584]: I0714 05:00:15.046353 2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-g257n_15609856-4056-487b-acdd-30276263b098/konnectivity-agent/0.log" limit=1024 Jul 14 05:00:15.072141 ip-10-0-136-9 kubenswrapper[2584]: I0714 05:00:15.072111 2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-samples-operator/cluster-samples-operator-65db858894-m6cp5" event={"ID":"13fb9031-3a05-4a3f-bbef-a2466ef852fb","Type":"ContainerStarted","Data":"d28f80e61d5ddd26ff96437f638f07e51736b4f267c7c2fbcb75747f24f1ca03"} Jul 14 05:00:15.073631 ip-10-0-136-9 kubenswrapper[2584]: I0714 05:00:15.073605 2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/global-pull-secret-syncer-fb7bm" event={"ID":"7078f217-1a51-4d64-a155-e5ca77500f07","Type":"ContainerStarted","Data":"ad753426dc3cdf9c27c373d2ac4b915f8f0f7baa6fc222f54697c05a7190e840"} Jul 14 05:00:15.074980 ip-10-0-136-9 kubenswrapper[2584]: I0714 05:00:15.074959 2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-t6zw8" event={"ID":"4e5332d8-9e2c-4660-8546-e026f8f5dd2a","Type":"ContainerStarted","Data":"3822c8b034a95a30c74105f17082ab10410f3bae38cd089c4fde44406cb06fd8"} Jul 14 05:00:15.076505 ip-10-0-136-9 kubenswrapper[2584]: I0714 05:00:15.076485 2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-gkwjs" event={"ID":"d6fb944a-4c2d-4f24-a25b-e5a3067fe627","Type":"ContainerStarted","Data":"2e43c4bdea8b6a138bdb6346576dabe02b6fa2f72dd07bbb77cf698a5ef96c07"} Jul 14 05:00:15.076633 ip-10-0-136-9 kubenswrapper[2584]: I0714 05:00:15.076611 2584 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-dns/dns-default-gkwjs" Jul 14 05:00:15.089772 ip-10-0-136-9 kubenswrapper[2584]: I0714 05:00:15.089737 2584 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-samples-operator/cluster-samples-operator-65db858894-m6cp5" podStartSLOduration=44.746940504 podStartE2EDuration="50.089726652s" totalImagesPullingTime="5.342786148s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-14 04:59:25 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-14 05:00:15.088514194 +0000 UTC m=+76.049769910" watchObservedRunningTime="2026-07-14 05:00:15.089726652 +0000 UTC m=+76.050982355" Jul 14 05:00:15.102400 ip-10-0-136-9 kubenswrapper[2584]: I0714 05:00:15.102361 2584 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/global-pull-secret-syncer-fb7bm" podStartSLOduration=67.482534767 podStartE2EDuration="1m16.102347482s" totalImagesPullingTime="8.619812715s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-14 04:58:59 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-14 05:00:15.101692859 +0000 UTC m=+76.062948563" watchObservedRunningTime="2026-07-14 05:00:15.102347482 +0000 UTC m=+76.063603186" Jul 14 05:00:15.118000 ip-10-0-136-9 kubenswrapper[2584]: I0714 05:00:15.117969 2584 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-dns/dns-default-gkwjs" podStartSLOduration=36.605326465 podStartE2EDuration="42.117958926s" totalImagesPullingTime="5.512632461s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-14 04:59:33 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-14 05:00:15.117034792 +0000 UTC m=+76.078290497" watchObservedRunningTime="2026-07-14 05:00:15.117958926 +0000 UTC m=+76.079214629" Jul 14 05:00:16.082910 ip-10-0-136-9 kubenswrapper[2584]: I0714 05:00:16.082876 2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-t6zw8" event={"ID":"4e5332d8-9e2c-4660-8546-e026f8f5dd2a","Type":"ContainerStarted","Data":"d05f4ec19cee8da5b4f0a4b78abd47f33f5d32c64399956b719b21f27e720dc8"} Jul 14 05:00:16.115547 ip-10-0-136-9 kubenswrapper[2584]: I0714 05:00:16.115492 2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-g257n_15609856-4056-487b-acdd-30276263b098/konnectivity-agent/0.log" limit=1024 Jul 14 05:00:16.184817 ip-10-0-136-9 kubenswrapper[2584]: I0714 05:00:16.184793 2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-g257n_15609856-4056-487b-acdd-30276263b098/konnectivity-agent/0.log" limit=1024 Jul 14 05:00:16.652449 ip-10-0-136-9 kubenswrapper[2584]: I0714 05:00:16.652419 2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/c27a6d7e-9146-4882-ba72-d2c22c209e03-networking-console-plugin-cert\") pod \"networking-console-plugin-6cf856758c-4bfn6\" (UID: \"c27a6d7e-9146-4882-ba72-d2c22c209e03\") " pod="openshift-network-console/networking-console-plugin-6cf856758c-4bfn6" Jul 14 05:00:16.654793 ip-10-0-136-9 kubenswrapper[2584]: I0714 05:00:16.654770 2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/c27a6d7e-9146-4882-ba72-d2c22c209e03-networking-console-plugin-cert\") pod \"networking-console-plugin-6cf856758c-4bfn6\" (UID: \"c27a6d7e-9146-4882-ba72-d2c22c209e03\") " pod="openshift-network-console/networking-console-plugin-6cf856758c-4bfn6" Jul 14 05:00:16.878865 ip-10-0-136-9 kubenswrapper[2584]: I0714 05:00:16.878835 2584 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-console\"/\"default-dockercfg-rx69d\"" Jul 14 05:00:16.886969 ip-10-0-136-9 kubenswrapper[2584]: I0714 05:00:16.886917 2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-console/networking-console-plugin-6cf856758c-4bfn6" Jul 14 05:00:17.043261 ip-10-0-136-9 kubenswrapper[2584]: I0714 05:00:17.043235 2584 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-console/networking-console-plugin-6cf856758c-4bfn6"] Jul 14 05:00:17.045063 ip-10-0-136-9 kubenswrapper[2584]: W0714 05:00:17.045038 2584 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podc27a6d7e_9146_4882_ba72_d2c22c209e03.slice/crio-643415185a9ee5cc55320c059a002756d49bb0db9054ad88252ed70ba7ede4a4 WatchSource:0}: Error finding container 643415185a9ee5cc55320c059a002756d49bb0db9054ad88252ed70ba7ede4a4: Status 404 returned error can't find the container with id 643415185a9ee5cc55320c059a002756d49bb0db9054ad88252ed70ba7ede4a4 Jul 14 05:00:17.088165 ip-10-0-136-9 kubenswrapper[2584]: I0714 05:00:17.088138 2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-console/networking-console-plugin-6cf856758c-4bfn6" event={"ID":"c27a6d7e-9146-4882-ba72-d2c22c209e03","Type":"ContainerStarted","Data":"643415185a9ee5cc55320c059a002756d49bb0db9054ad88252ed70ba7ede4a4"} Jul 14 05:00:17.384449 ip-10-0-136-9 kubenswrapper[2584]: I0714 05:00:17.384406 2584 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/prometheus-operator-admission-webhook-77d98bc786-wxbfc"] Jul 14 05:00:17.416607 ip-10-0-136-9 kubenswrapper[2584]: I0714 05:00:17.414611 2584 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-operator-admission-webhook-77d98bc786-wxbfc"] Jul 14 05:00:17.416607 ip-10-0-136-9 kubenswrapper[2584]: I0714 05:00:17.414760 2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-operator-admission-webhook-77d98bc786-wxbfc" Jul 14 05:00:17.418987 ip-10-0-136-9 kubenswrapper[2584]: I0714 05:00:17.418924 2584 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-operator-admission-webhook-tls\"" Jul 14 05:00:17.419883 ip-10-0-136-9 kubenswrapper[2584]: I0714 05:00:17.419680 2584 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-operator-admission-webhook-dockercfg-kftmz\"" Jul 14 05:00:17.489416 ip-10-0-136-9 kubenswrapper[2584]: I0714 05:00:17.489382 2584 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console/downloads-68c9cbb497-ch2f4"] Jul 14 05:00:17.505753 ip-10-0-136-9 kubenswrapper[2584]: I0714 05:00:17.505725 2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/downloads-68c9cbb497-ch2f4" Jul 14 05:00:17.508649 ip-10-0-136-9 kubenswrapper[2584]: I0714 05:00:17.508619 2584 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"openshift-service-ca.crt\"" Jul 14 05:00:17.508769 ip-10-0-136-9 kubenswrapper[2584]: I0714 05:00:17.508659 2584 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"kube-root-ca.crt\"" Jul 14 05:00:17.508769 ip-10-0-136-9 kubenswrapper[2584]: I0714 05:00:17.508718 2584 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"default-dockercfg-dn6qv\"" Jul 14 05:00:17.511481 ip-10-0-136-9 kubenswrapper[2584]: I0714 05:00:17.511456 2584 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/downloads-68c9cbb497-ch2f4"] Jul 14 05:00:17.525601 ip-10-0-136-9 kubenswrapper[2584]: I0714 05:00:17.525540 2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-g257n_15609856-4056-487b-acdd-30276263b098/konnectivity-agent/0.log" limit=1024 Jul 14 05:00:17.561345 ip-10-0-136-9 kubenswrapper[2584]: I0714 05:00:17.561318 2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certificates\" (UniqueName: \"kubernetes.io/secret/a498d55f-a96d-469a-b15e-995e13d25c5a-tls-certificates\") pod \"prometheus-operator-admission-webhook-77d98bc786-wxbfc\" (UID: \"a498d55f-a96d-469a-b15e-995e13d25c5a\") " pod="openshift-monitoring/prometheus-operator-admission-webhook-77d98bc786-wxbfc" Jul 14 05:00:17.662573 ip-10-0-136-9 kubenswrapper[2584]: I0714 05:00:17.662519 2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-swsgh\" (UniqueName: \"kubernetes.io/projected/5813b135-d940-4fd9-8d37-4dbd772504eb-kube-api-access-swsgh\") pod \"downloads-68c9cbb497-ch2f4\" (UID: \"5813b135-d940-4fd9-8d37-4dbd772504eb\") " pod="openshift-console/downloads-68c9cbb497-ch2f4" Jul 14 05:00:17.662668 ip-10-0-136-9 kubenswrapper[2584]: I0714 05:00:17.662600 2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certificates\" (UniqueName: \"kubernetes.io/secret/a498d55f-a96d-469a-b15e-995e13d25c5a-tls-certificates\") pod \"prometheus-operator-admission-webhook-77d98bc786-wxbfc\" (UID: \"a498d55f-a96d-469a-b15e-995e13d25c5a\") " pod="openshift-monitoring/prometheus-operator-admission-webhook-77d98bc786-wxbfc" Jul 14 05:00:17.664829 ip-10-0-136-9 kubenswrapper[2584]: I0714 05:00:17.664807 2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certificates\" (UniqueName: \"kubernetes.io/secret/a498d55f-a96d-469a-b15e-995e13d25c5a-tls-certificates\") pod \"prometheus-operator-admission-webhook-77d98bc786-wxbfc\" (UID: \"a498d55f-a96d-469a-b15e-995e13d25c5a\") " pod="openshift-monitoring/prometheus-operator-admission-webhook-77d98bc786-wxbfc" Jul 14 05:00:17.729797 ip-10-0-136-9 kubenswrapper[2584]: I0714 05:00:17.729769 2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-operator-admission-webhook-77d98bc786-wxbfc" Jul 14 05:00:17.735320 ip-10-0-136-9 kubenswrapper[2584]: I0714 05:00:17.735288 2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-g257n_15609856-4056-487b-acdd-30276263b098/konnectivity-agent/0.log" limit=1024 Jul 14 05:00:17.763955 ip-10-0-136-9 kubenswrapper[2584]: I0714 05:00:17.763919 2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-swsgh\" (UniqueName: \"kubernetes.io/projected/5813b135-d940-4fd9-8d37-4dbd772504eb-kube-api-access-swsgh\") pod \"downloads-68c9cbb497-ch2f4\" (UID: \"5813b135-d940-4fd9-8d37-4dbd772504eb\") " pod="openshift-console/downloads-68c9cbb497-ch2f4" Jul 14 05:00:17.774070 ip-10-0-136-9 kubenswrapper[2584]: I0714 05:00:17.774050 2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-swsgh\" (UniqueName: \"kubernetes.io/projected/5813b135-d940-4fd9-8d37-4dbd772504eb-kube-api-access-swsgh\") pod \"downloads-68c9cbb497-ch2f4\" (UID: \"5813b135-d940-4fd9-8d37-4dbd772504eb\") " pod="openshift-console/downloads-68c9cbb497-ch2f4" Jul 14 05:00:17.817971 ip-10-0-136-9 kubenswrapper[2584]: I0714 05:00:17.817953 2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/downloads-68c9cbb497-ch2f4" Jul 14 05:00:17.819062 ip-10-0-136-9 kubenswrapper[2584]: I0714 05:00:17.819034 2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-g257n_15609856-4056-487b-acdd-30276263b098/konnectivity-agent/0.log" limit=1024 Jul 14 05:00:17.919033 ip-10-0-136-9 kubenswrapper[2584]: I0714 05:00:17.918947 2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-g257n_15609856-4056-487b-acdd-30276263b098/konnectivity-agent/0.log" limit=1024 Jul 14 05:00:19.064169 ip-10-0-136-9 kubenswrapper[2584]: I0714 05:00:19.064137 2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-g257n_15609856-4056-487b-acdd-30276263b098/konnectivity-agent/0.log" limit=1024 Jul 14 05:00:19.132952 ip-10-0-136-9 kubenswrapper[2584]: I0714 05:00:19.132893 2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-g257n_15609856-4056-487b-acdd-30276263b098/konnectivity-agent/0.log" limit=1024 Jul 14 05:00:19.745273 ip-10-0-136-9 kubenswrapper[2584]: I0714 05:00:19.745250 2584 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/downloads-68c9cbb497-ch2f4"] Jul 14 05:00:19.747373 ip-10-0-136-9 kubenswrapper[2584]: W0714 05:00:19.747348 2584 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod5813b135_d940_4fd9_8d37_4dbd772504eb.slice/crio-67fd62e6e84cda5d9cc84197263652270c9efc4c76ae6fa6f89e1f4441a10146 WatchSource:0}: Error finding container 67fd62e6e84cda5d9cc84197263652270c9efc4c76ae6fa6f89e1f4441a10146: Status 404 returned error can't find the container with id 67fd62e6e84cda5d9cc84197263652270c9efc4c76ae6fa6f89e1f4441a10146 Jul 14 05:00:19.763732 ip-10-0-136-9 kubenswrapper[2584]: I0714 05:00:19.763710 2584 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-operator-admission-webhook-77d98bc786-wxbfc"] Jul 14 05:00:19.765787 ip-10-0-136-9 kubenswrapper[2584]: W0714 05:00:19.765764 2584 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poda498d55f_a96d_469a_b15e_995e13d25c5a.slice/crio-a0b660dad7499f4decdd817fe75dbc48d52c70c517a0ac86a3773ad9bc52cfa2 WatchSource:0}: Error finding container a0b660dad7499f4decdd817fe75dbc48d52c70c517a0ac86a3773ad9bc52cfa2: Status 404 returned error can't find the container with id a0b660dad7499f4decdd817fe75dbc48d52c70c517a0ac86a3773ad9bc52cfa2 Jul 14 05:00:20.102643 ip-10-0-136-9 kubenswrapper[2584]: I0714 05:00:20.102610 2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-console/networking-console-plugin-6cf856758c-4bfn6" event={"ID":"c27a6d7e-9146-4882-ba72-d2c22c209e03","Type":"ContainerStarted","Data":"3e3fd568b78f41061ff6e5be0e64061017c70f401e42da10a31b6ebd3ba8d3c1"} Jul 14 05:00:20.103688 ip-10-0-136-9 kubenswrapper[2584]: I0714 05:00:20.103666 2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/downloads-68c9cbb497-ch2f4" event={"ID":"5813b135-d940-4fd9-8d37-4dbd772504eb","Type":"ContainerStarted","Data":"67fd62e6e84cda5d9cc84197263652270c9efc4c76ae6fa6f89e1f4441a10146"} Jul 14 05:00:20.105429 ip-10-0-136-9 kubenswrapper[2584]: I0714 05:00:20.105405 2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-t6zw8" event={"ID":"4e5332d8-9e2c-4660-8546-e026f8f5dd2a","Type":"ContainerStarted","Data":"d3f330fb9af16d74736cc2bca74206e70eaecccdca18d5153aa6ec22927da735"} Jul 14 05:00:20.106439 ip-10-0-136-9 kubenswrapper[2584]: I0714 05:00:20.106420 2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-operator-admission-webhook-77d98bc786-wxbfc" event={"ID":"a498d55f-a96d-469a-b15e-995e13d25c5a","Type":"ContainerStarted","Data":"a0b660dad7499f4decdd817fe75dbc48d52c70c517a0ac86a3773ad9bc52cfa2"} Jul 14 05:00:20.118944 ip-10-0-136-9 kubenswrapper[2584]: I0714 05:00:20.118895 2584 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-console/networking-console-plugin-6cf856758c-4bfn6" podStartSLOduration=33.571019699 podStartE2EDuration="36.11888132s" totalImagesPullingTime="2.547861621s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-14 04:59:44 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-14 05:00:20.117340703 +0000 UTC m=+81.078596409" watchObservedRunningTime="2026-07-14 05:00:20.11888132 +0000 UTC m=+81.080137056" Jul 14 05:00:20.137766 ip-10-0-136-9 kubenswrapper[2584]: I0714 05:00:20.137722 2584 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-insights/insights-runtime-extractor-t6zw8" podStartSLOduration=17.657993845 podStartE2EDuration="30.13770785s" totalImagesPullingTime="12.479714005s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-14 04:59:50 +0000 UTC" imagePullSessionsCount=3 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-14 05:00:20.136891703 +0000 UTC m=+81.098147419" watchObservedRunningTime="2026-07-14 05:00:20.13770785 +0000 UTC m=+81.098963553" Jul 14 05:00:20.301990 ip-10-0-136-9 kubenswrapper[2584]: I0714 05:00:20.301963 2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-g257n_15609856-4056-487b-acdd-30276263b098/konnectivity-agent/0.log" limit=1024 Jul 14 05:00:20.402833 ip-10-0-136-9 kubenswrapper[2584]: I0714 05:00:20.402770 2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-g257n_15609856-4056-487b-acdd-30276263b098/konnectivity-agent/0.log" limit=1024 Jul 14 05:00:20.604866 ip-10-0-136-9 kubenswrapper[2584]: I0714 05:00:20.604814 2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-g257n_15609856-4056-487b-acdd-30276263b098/konnectivity-agent/0.log" limit=1024 Jul 14 05:00:20.660218 ip-10-0-136-9 kubenswrapper[2584]: I0714 05:00:20.660154 2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-g257n_15609856-4056-487b-acdd-30276263b098/konnectivity-agent/0.log" limit=1024 Jul 14 05:00:21.830658 ip-10-0-136-9 kubenswrapper[2584]: I0714 05:00:21.830567 2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-g257n_15609856-4056-487b-acdd-30276263b098/konnectivity-agent/0.log" limit=1024 Jul 14 05:00:22.085391 ip-10-0-136-9 kubenswrapper[2584]: I0714 05:00:22.085367 2584 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-dns/dns-default-gkwjs" Jul 14 05:00:22.121026 ip-10-0-136-9 kubenswrapper[2584]: I0714 05:00:22.120992 2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-operator-admission-webhook-77d98bc786-wxbfc" event={"ID":"a498d55f-a96d-469a-b15e-995e13d25c5a","Type":"ContainerStarted","Data":"8ee092d931d430dfdf13de9c872f2c1161c13405bfdbc989ce7d7761ce5c181c"} Jul 14 05:00:22.121326 ip-10-0-136-9 kubenswrapper[2584]: I0714 05:00:22.121303 2584 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-monitoring/prometheus-operator-admission-webhook-77d98bc786-wxbfc" Jul 14 05:00:22.126480 ip-10-0-136-9 kubenswrapper[2584]: I0714 05:00:22.126455 2584 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-monitoring/prometheus-operator-admission-webhook-77d98bc786-wxbfc" Jul 14 05:00:22.136335 ip-10-0-136-9 kubenswrapper[2584]: I0714 05:00:22.136291 2584 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/prometheus-operator-admission-webhook-77d98bc786-wxbfc" podStartSLOduration=3.381385424 podStartE2EDuration="5.136274632s" totalImagesPullingTime="1.754889208s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-14 05:00:17 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-14 05:00:22.136134966 +0000 UTC m=+83.097390674" watchObservedRunningTime="2026-07-14 05:00:22.136274632 +0000 UTC m=+83.097530336" Jul 14 05:00:22.935475 ip-10-0-136-9 kubenswrapper[2584]: I0714 05:00:22.935437 2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-g257n_15609856-4056-487b-acdd-30276263b098/konnectivity-agent/0.log" limit=1024 Jul 14 05:00:23.012164 ip-10-0-136-9 kubenswrapper[2584]: I0714 05:00:23.012127 2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-g257n_15609856-4056-487b-acdd-30276263b098/konnectivity-agent/0.log" limit=1024 Jul 14 05:00:23.088718 ip-10-0-136-9 kubenswrapper[2584]: I0714 05:00:23.088683 2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-g257n_15609856-4056-487b-acdd-30276263b098/konnectivity-agent/0.log" limit=1024 Jul 14 05:00:23.231565 ip-10-0-136-9 kubenswrapper[2584]: I0714 05:00:23.231479 2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-g257n_15609856-4056-487b-acdd-30276263b098/konnectivity-agent/0.log" limit=1024 Jul 14 05:00:23.287656 ip-10-0-136-9 kubenswrapper[2584]: I0714 05:00:23.287609 2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-g257n_15609856-4056-487b-acdd-30276263b098/konnectivity-agent/0.log" limit=1024 Jul 14 05:00:25.615910 ip-10-0-136-9 kubenswrapper[2584]: I0714 05:00:25.615871 2584 patch_prober.go:28] interesting pod/image-registry-6f5d75bf47-rnc9m container/registry namespace/openshift-image-registry: Liveness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body={"errors":[{"code":"UNAVAILABLE","message":"service unavailable","detail":"health check failed: please see /debug/health"}]} Jul 14 05:00:25.616354 ip-10-0-136-9 kubenswrapper[2584]: I0714 05:00:25.615957 2584 prober.go:120] "Probe failed" probeType="Liveness" pod="openshift-image-registry/image-registry-6f5d75bf47-rnc9m" podUID="6421bddc-6c3a-4ae2-9a6c-348d3de7aec9" containerName="registry" probeResult="failure" output="HTTP probe failed with statuscode: 503" Jul 14 05:00:26.814190 ip-10-0-136-9 kubenswrapper[2584]: I0714 05:00:26.814157 2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-g257n_15609856-4056-487b-acdd-30276263b098/konnectivity-agent/0.log" limit=1024 Jul 14 05:00:27.029973 ip-10-0-136-9 kubenswrapper[2584]: I0714 05:00:27.029926 2584 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-image-registry/image-registry-6f5d75bf47-rnc9m" Jul 14 05:00:27.278491 ip-10-0-136-9 kubenswrapper[2584]: I0714 05:00:27.278452 2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-g257n_15609856-4056-487b-acdd-30276263b098/konnectivity-agent/0.log" limit=1024 Jul 14 05:00:27.337008 ip-10-0-136-9 kubenswrapper[2584]: I0714 05:00:27.336978 2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-g257n_15609856-4056-487b-acdd-30276263b098/konnectivity-agent/0.log" limit=1024 Jul 14 05:00:27.555783 ip-10-0-136-9 kubenswrapper[2584]: I0714 05:00:27.555707 2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-g257n_15609856-4056-487b-acdd-30276263b098/konnectivity-agent/0.log" limit=1024 Jul 14 05:00:27.886587 ip-10-0-136-9 kubenswrapper[2584]: I0714 05:00:27.886538 2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-g257n_15609856-4056-487b-acdd-30276263b098/konnectivity-agent/0.log" limit=1024 Jul 14 05:00:29.101028 ip-10-0-136-9 kubenswrapper[2584]: I0714 05:00:29.100990 2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-g257n_15609856-4056-487b-acdd-30276263b098/konnectivity-agent/0.log" limit=1024 Jul 14 05:00:29.332612 ip-10-0-136-9 kubenswrapper[2584]: I0714 05:00:29.332573 2584 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/node-exporter-7p74v"] Jul 14 05:00:29.335768 ip-10-0-136-9 kubenswrapper[2584]: I0714 05:00:29.335744 2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/node-exporter-7p74v" Jul 14 05:00:29.338921 ip-10-0-136-9 kubenswrapper[2584]: I0714 05:00:29.338573 2584 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"metrics-client-ca\"" Jul 14 05:00:29.338921 ip-10-0-136-9 kubenswrapper[2584]: I0714 05:00:29.338707 2584 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-kube-rbac-proxy-config\"" Jul 14 05:00:29.338921 ip-10-0-136-9 kubenswrapper[2584]: I0714 05:00:29.338865 2584 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-dockercfg-m22l6\"" Jul 14 05:00:29.340006 ip-10-0-136-9 kubenswrapper[2584]: I0714 05:00:29.339986 2584 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-tls\"" Jul 14 05:00:29.340174 ip-10-0-136-9 kubenswrapper[2584]: I0714 05:00:29.339992 2584 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"node-exporter-accelerators-collector-config\"" Jul 14 05:00:29.369081 ip-10-0-136-9 kubenswrapper[2584]: I0714 05:00:29.368815 2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/e8606dd5-f76a-4af0-93ba-b8861980b30c-node-exporter-accelerators-collector-config\") pod \"node-exporter-7p74v\" (UID: \"e8606dd5-f76a-4af0-93ba-b8861980b30c\") " pod="openshift-monitoring/node-exporter-7p74v" Jul 14 05:00:29.369081 ip-10-0-136-9 kubenswrapper[2584]: I0714 05:00:29.368854 2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"root\" (UniqueName: \"kubernetes.io/host-path/e8606dd5-f76a-4af0-93ba-b8861980b30c-root\") pod \"node-exporter-7p74v\" (UID: \"e8606dd5-f76a-4af0-93ba-b8861980b30c\") " pod="openshift-monitoring/node-exporter-7p74v" Jul 14 05:00:29.369081 ip-10-0-136-9 kubenswrapper[2584]: I0714 05:00:29.368900 2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/e8606dd5-f76a-4af0-93ba-b8861980b30c-metrics-client-ca\") pod \"node-exporter-7p74v\" (UID: \"e8606dd5-f76a-4af0-93ba-b8861980b30c\") " pod="openshift-monitoring/node-exporter-7p74v" Jul 14 05:00:29.369081 ip-10-0-136-9 kubenswrapper[2584]: I0714 05:00:29.368952 2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/e8606dd5-f76a-4af0-93ba-b8861980b30c-sys\") pod \"node-exporter-7p74v\" (UID: \"e8606dd5-f76a-4af0-93ba-b8861980b30c\") " pod="openshift-monitoring/node-exporter-7p74v" Jul 14 05:00:29.369081 ip-10-0-136-9 kubenswrapper[2584]: I0714 05:00:29.368975 2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/e8606dd5-f76a-4af0-93ba-b8861980b30c-node-exporter-wtmp\") pod \"node-exporter-7p74v\" (UID: \"e8606dd5-f76a-4af0-93ba-b8861980b30c\") " pod="openshift-monitoring/node-exporter-7p74v" Jul 14 05:00:29.369081 ip-10-0-136-9 kubenswrapper[2584]: I0714 05:00:29.368997 2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-m7cl2\" (UniqueName: \"kubernetes.io/projected/e8606dd5-f76a-4af0-93ba-b8861980b30c-kube-api-access-m7cl2\") pod \"node-exporter-7p74v\" (UID: \"e8606dd5-f76a-4af0-93ba-b8861980b30c\") " pod="openshift-monitoring/node-exporter-7p74v" Jul 14 05:00:29.369081 ip-10-0-136-9 kubenswrapper[2584]: I0714 05:00:29.369041 2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/e8606dd5-f76a-4af0-93ba-b8861980b30c-node-exporter-textfile\") pod \"node-exporter-7p74v\" (UID: \"e8606dd5-f76a-4af0-93ba-b8861980b30c\") " pod="openshift-monitoring/node-exporter-7p74v" Jul 14 05:00:29.369081 ip-10-0-136-9 kubenswrapper[2584]: I0714 05:00:29.369071 2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/e8606dd5-f76a-4af0-93ba-b8861980b30c-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-7p74v\" (UID: \"e8606dd5-f76a-4af0-93ba-b8861980b30c\") " pod="openshift-monitoring/node-exporter-7p74v" Jul 14 05:00:29.369392 ip-10-0-136-9 kubenswrapper[2584]: I0714 05:00:29.369105 2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/e8606dd5-f76a-4af0-93ba-b8861980b30c-node-exporter-tls\") pod \"node-exporter-7p74v\" (UID: \"e8606dd5-f76a-4af0-93ba-b8861980b30c\") " pod="openshift-monitoring/node-exporter-7p74v" Jul 14 05:00:29.374055 ip-10-0-136-9 kubenswrapper[2584]: I0714 05:00:29.373896 2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-g257n_15609856-4056-487b-acdd-30276263b098/konnectivity-agent/0.log" limit=1024 Jul 14 05:00:29.444148 ip-10-0-136-9 kubenswrapper[2584]: I0714 05:00:29.444115 2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-g257n_15609856-4056-487b-acdd-30276263b098/konnectivity-agent/0.log" limit=1024 Jul 14 05:00:29.470240 ip-10-0-136-9 kubenswrapper[2584]: I0714 05:00:29.469570 2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/e8606dd5-f76a-4af0-93ba-b8861980b30c-node-exporter-accelerators-collector-config\") pod \"node-exporter-7p74v\" (UID: \"e8606dd5-f76a-4af0-93ba-b8861980b30c\") " pod="openshift-monitoring/node-exporter-7p74v" Jul 14 05:00:29.470240 ip-10-0-136-9 kubenswrapper[2584]: I0714 05:00:29.469614 2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"root\" (UniqueName: \"kubernetes.io/host-path/e8606dd5-f76a-4af0-93ba-b8861980b30c-root\") pod \"node-exporter-7p74v\" (UID: \"e8606dd5-f76a-4af0-93ba-b8861980b30c\") " pod="openshift-monitoring/node-exporter-7p74v" Jul 14 05:00:29.470240 ip-10-0-136-9 kubenswrapper[2584]: I0714 05:00:29.469658 2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/e8606dd5-f76a-4af0-93ba-b8861980b30c-metrics-client-ca\") pod \"node-exporter-7p74v\" (UID: \"e8606dd5-f76a-4af0-93ba-b8861980b30c\") " pod="openshift-monitoring/node-exporter-7p74v" Jul 14 05:00:29.470240 ip-10-0-136-9 kubenswrapper[2584]: I0714 05:00:29.469693 2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/e8606dd5-f76a-4af0-93ba-b8861980b30c-sys\") pod \"node-exporter-7p74v\" (UID: \"e8606dd5-f76a-4af0-93ba-b8861980b30c\") " pod="openshift-monitoring/node-exporter-7p74v" Jul 14 05:00:29.470240 ip-10-0-136-9 kubenswrapper[2584]: I0714 05:00:29.469717 2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/e8606dd5-f76a-4af0-93ba-b8861980b30c-node-exporter-wtmp\") pod \"node-exporter-7p74v\" (UID: \"e8606dd5-f76a-4af0-93ba-b8861980b30c\") " pod="openshift-monitoring/node-exporter-7p74v" Jul 14 05:00:29.470240 ip-10-0-136-9 kubenswrapper[2584]: I0714 05:00:29.469718 2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"root\" (UniqueName: \"kubernetes.io/host-path/e8606dd5-f76a-4af0-93ba-b8861980b30c-root\") pod \"node-exporter-7p74v\" (UID: \"e8606dd5-f76a-4af0-93ba-b8861980b30c\") " pod="openshift-monitoring/node-exporter-7p74v" Jul 14 05:00:29.470240 ip-10-0-136-9 kubenswrapper[2584]: I0714 05:00:29.469739 2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-m7cl2\" (UniqueName: \"kubernetes.io/projected/e8606dd5-f76a-4af0-93ba-b8861980b30c-kube-api-access-m7cl2\") pod \"node-exporter-7p74v\" (UID: \"e8606dd5-f76a-4af0-93ba-b8861980b30c\") " pod="openshift-monitoring/node-exporter-7p74v" Jul 14 05:00:29.470240 ip-10-0-136-9 kubenswrapper[2584]: I0714 05:00:29.469769 2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/e8606dd5-f76a-4af0-93ba-b8861980b30c-node-exporter-textfile\") pod \"node-exporter-7p74v\" (UID: \"e8606dd5-f76a-4af0-93ba-b8861980b30c\") " pod="openshift-monitoring/node-exporter-7p74v" Jul 14 05:00:29.470240 ip-10-0-136-9 kubenswrapper[2584]: I0714 05:00:29.469774 2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/e8606dd5-f76a-4af0-93ba-b8861980b30c-sys\") pod \"node-exporter-7p74v\" (UID: \"e8606dd5-f76a-4af0-93ba-b8861980b30c\") " pod="openshift-monitoring/node-exporter-7p74v" Jul 14 05:00:29.470240 ip-10-0-136-9 kubenswrapper[2584]: I0714 05:00:29.469795 2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/e8606dd5-f76a-4af0-93ba-b8861980b30c-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-7p74v\" (UID: \"e8606dd5-f76a-4af0-93ba-b8861980b30c\") " pod="openshift-monitoring/node-exporter-7p74v" Jul 14 05:00:29.470240 ip-10-0-136-9 kubenswrapper[2584]: I0714 05:00:29.469832 2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/e8606dd5-f76a-4af0-93ba-b8861980b30c-node-exporter-tls\") pod \"node-exporter-7p74v\" (UID: \"e8606dd5-f76a-4af0-93ba-b8861980b30c\") " pod="openshift-monitoring/node-exporter-7p74v" Jul 14 05:00:29.470240 ip-10-0-136-9 kubenswrapper[2584]: E0714 05:00:29.469980 2584 secret.go:189] Couldn't get secret openshift-monitoring/node-exporter-tls: secret "node-exporter-tls" not found Jul 14 05:00:29.470240 ip-10-0-136-9 kubenswrapper[2584]: I0714 05:00:29.469987 2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/e8606dd5-f76a-4af0-93ba-b8861980b30c-node-exporter-wtmp\") pod \"node-exporter-7p74v\" (UID: \"e8606dd5-f76a-4af0-93ba-b8861980b30c\") " pod="openshift-monitoring/node-exporter-7p74v" Jul 14 05:00:29.470240 ip-10-0-136-9 kubenswrapper[2584]: E0714 05:00:29.470037 2584 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/e8606dd5-f76a-4af0-93ba-b8861980b30c-node-exporter-tls podName:e8606dd5-f76a-4af0-93ba-b8861980b30c nodeName:}" failed. No retries permitted until 2026-07-14 05:00:29.970019943 +0000 UTC m=+90.931275627 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "node-exporter-tls" (UniqueName: "kubernetes.io/secret/e8606dd5-f76a-4af0-93ba-b8861980b30c-node-exporter-tls") pod "node-exporter-7p74v" (UID: "e8606dd5-f76a-4af0-93ba-b8861980b30c") : secret "node-exporter-tls" not found Jul 14 05:00:29.470240 ip-10-0-136-9 kubenswrapper[2584]: I0714 05:00:29.470230 2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/e8606dd5-f76a-4af0-93ba-b8861980b30c-node-exporter-accelerators-collector-config\") pod \"node-exporter-7p74v\" (UID: \"e8606dd5-f76a-4af0-93ba-b8861980b30c\") " pod="openshift-monitoring/node-exporter-7p74v" Jul 14 05:00:29.470240 ip-10-0-136-9 kubenswrapper[2584]: I0714 05:00:29.470240 2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/e8606dd5-f76a-4af0-93ba-b8861980b30c-node-exporter-textfile\") pod \"node-exporter-7p74v\" (UID: \"e8606dd5-f76a-4af0-93ba-b8861980b30c\") " pod="openshift-monitoring/node-exporter-7p74v" Jul 14 05:00:29.471097 ip-10-0-136-9 kubenswrapper[2584]: I0714 05:00:29.470263 2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/e8606dd5-f76a-4af0-93ba-b8861980b30c-metrics-client-ca\") pod \"node-exporter-7p74v\" (UID: \"e8606dd5-f76a-4af0-93ba-b8861980b30c\") " pod="openshift-monitoring/node-exporter-7p74v" Jul 14 05:00:29.472843 ip-10-0-136-9 kubenswrapper[2584]: I0714 05:00:29.472774 2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/e8606dd5-f76a-4af0-93ba-b8861980b30c-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-7p74v\" (UID: \"e8606dd5-f76a-4af0-93ba-b8861980b30c\") " pod="openshift-monitoring/node-exporter-7p74v" Jul 14 05:00:29.480948 ip-10-0-136-9 kubenswrapper[2584]: I0714 05:00:29.480891 2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-m7cl2\" (UniqueName: \"kubernetes.io/projected/e8606dd5-f76a-4af0-93ba-b8861980b30c-kube-api-access-m7cl2\") pod \"node-exporter-7p74v\" (UID: \"e8606dd5-f76a-4af0-93ba-b8861980b30c\") " pod="openshift-monitoring/node-exporter-7p74v" Jul 14 05:00:29.540856 ip-10-0-136-9 kubenswrapper[2584]: I0714 05:00:29.540820 2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-g257n_15609856-4056-487b-acdd-30276263b098/konnectivity-agent/0.log" limit=1024 Jul 14 05:00:29.668731 ip-10-0-136-9 kubenswrapper[2584]: I0714 05:00:29.668645 2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-g257n_15609856-4056-487b-acdd-30276263b098/konnectivity-agent/0.log" limit=1024 Jul 14 05:00:29.760753 ip-10-0-136-9 kubenswrapper[2584]: I0714 05:00:29.760672 2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-g257n_15609856-4056-487b-acdd-30276263b098/konnectivity-agent/0.log" limit=1024 Jul 14 05:00:29.819568 ip-10-0-136-9 kubenswrapper[2584]: I0714 05:00:29.819534 2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-g257n_15609856-4056-487b-acdd-30276263b098/konnectivity-agent/0.log" limit=1024 Jul 14 05:00:29.974215 ip-10-0-136-9 kubenswrapper[2584]: I0714 05:00:29.974136 2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/e8606dd5-f76a-4af0-93ba-b8861980b30c-node-exporter-tls\") pod \"node-exporter-7p74v\" (UID: \"e8606dd5-f76a-4af0-93ba-b8861980b30c\") " pod="openshift-monitoring/node-exporter-7p74v" Jul 14 05:00:29.976825 ip-10-0-136-9 kubenswrapper[2584]: I0714 05:00:29.976800 2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/e8606dd5-f76a-4af0-93ba-b8861980b30c-node-exporter-tls\") pod \"node-exporter-7p74v\" (UID: \"e8606dd5-f76a-4af0-93ba-b8861980b30c\") " pod="openshift-monitoring/node-exporter-7p74v" Jul 14 05:00:30.249511 ip-10-0-136-9 kubenswrapper[2584]: I0714 05:00:30.249433 2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/node-exporter-7p74v" Jul 14 05:00:30.260778 ip-10-0-136-9 kubenswrapper[2584]: I0714 05:00:30.260747 2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-g257n_15609856-4056-487b-acdd-30276263b098/konnectivity-agent/0.log" limit=1024 Jul 14 05:00:30.358409 ip-10-0-136-9 kubenswrapper[2584]: I0714 05:00:30.358370 2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-g257n_15609856-4056-487b-acdd-30276263b098/konnectivity-agent/0.log" limit=1024 Jul 14 05:00:30.438432 ip-10-0-136-9 kubenswrapper[2584]: I0714 05:00:30.438385 2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-g257n_15609856-4056-487b-acdd-30276263b098/konnectivity-agent/0.log" limit=1024 Jul 14 05:00:30.679585 ip-10-0-136-9 kubenswrapper[2584]: I0714 05:00:30.679548 2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-g257n_15609856-4056-487b-acdd-30276263b098/konnectivity-agent/0.log" limit=1024 Jul 14 05:00:31.280640 ip-10-0-136-9 kubenswrapper[2584]: I0714 05:00:31.280600 2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-g257n_15609856-4056-487b-acdd-30276263b098/konnectivity-agent/0.log" limit=1024 Jul 14 05:00:31.579395 ip-10-0-136-9 kubenswrapper[2584]: I0714 05:00:31.579310 2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-g257n_15609856-4056-487b-acdd-30276263b098/konnectivity-agent/0.log" limit=1024 Jul 14 05:00:32.554532 ip-10-0-136-9 kubenswrapper[2584]: I0714 05:00:32.554496 2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-g257n_15609856-4056-487b-acdd-30276263b098/konnectivity-agent/0.log" limit=1024 Jul 14 05:00:32.654878 ip-10-0-136-9 kubenswrapper[2584]: I0714 05:00:32.654834 2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-g257n_15609856-4056-487b-acdd-30276263b098/konnectivity-agent/0.log" limit=1024 Jul 14 05:00:32.798029 ip-10-0-136-9 kubenswrapper[2584]: I0714 05:00:32.797983 2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-g257n_15609856-4056-487b-acdd-30276263b098/konnectivity-agent/0.log" limit=1024 Jul 14 05:00:32.898362 ip-10-0-136-9 kubenswrapper[2584]: I0714 05:00:32.898233 2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-g257n_15609856-4056-487b-acdd-30276263b098/konnectivity-agent/0.log" limit=1024 Jul 14 05:00:33.049469 ip-10-0-136-9 kubenswrapper[2584]: I0714 05:00:33.049420 2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-g257n_15609856-4056-487b-acdd-30276263b098/konnectivity-agent/0.log" limit=1024 Jul 14 05:00:33.099621 ip-10-0-136-9 kubenswrapper[2584]: I0714 05:00:33.099583 2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-g257n_15609856-4056-487b-acdd-30276263b098/konnectivity-agent/0.log" limit=1024 Jul 14 05:00:33.713732 ip-10-0-136-9 kubenswrapper[2584]: I0714 05:00:33.713692 2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-g257n_15609856-4056-487b-acdd-30276263b098/konnectivity-agent/0.log" limit=1024 Jul 14 05:00:33.976010 ip-10-0-136-9 kubenswrapper[2584]: I0714 05:00:33.975907 2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-g257n_15609856-4056-487b-acdd-30276263b098/konnectivity-agent/0.log" limit=1024 Jul 14 05:00:34.085111 ip-10-0-136-9 kubenswrapper[2584]: I0714 05:00:34.085080 2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-g257n_15609856-4056-487b-acdd-30276263b098/konnectivity-agent/0.log" limit=1024 Jul 14 05:00:34.144224 ip-10-0-136-9 kubenswrapper[2584]: I0714 05:00:34.144192 2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-g257n_15609856-4056-487b-acdd-30276263b098/konnectivity-agent/0.log" limit=1024 Jul 14 05:00:34.383492 ip-10-0-136-9 kubenswrapper[2584]: I0714 05:00:34.383457 2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-g257n_15609856-4056-487b-acdd-30276263b098/konnectivity-agent/0.log" limit=1024 Jul 14 05:00:34.852194 ip-10-0-136-9 kubenswrapper[2584]: I0714 05:00:34.852161 2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-g257n_15609856-4056-487b-acdd-30276263b098/konnectivity-agent/0.log" limit=1024 Jul 14 05:00:34.912961 ip-10-0-136-9 kubenswrapper[2584]: I0714 05:00:34.912911 2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-g257n_15609856-4056-487b-acdd-30276263b098/konnectivity-agent/0.log" limit=1024 Jul 14 05:00:35.732458 ip-10-0-136-9 kubenswrapper[2584]: I0714 05:00:35.732413 2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-g257n_15609856-4056-487b-acdd-30276263b098/konnectivity-agent/0.log" limit=1024 Jul 14 05:00:35.832574 ip-10-0-136-9 kubenswrapper[2584]: W0714 05:00:35.832544 2584 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pode8606dd5_f76a_4af0_93ba_b8861980b30c.slice/crio-0f6bbbed74cad3c78f22ba983a7d3ecb0c0ee6b84975eba40f2078b34e11d23d WatchSource:0}: Error finding container 0f6bbbed74cad3c78f22ba983a7d3ecb0c0ee6b84975eba40f2078b34e11d23d: Status 404 returned error can't find the container with id 0f6bbbed74cad3c78f22ba983a7d3ecb0c0ee6b84975eba40f2078b34e11d23d Jul 14 05:00:36.186643 ip-10-0-136-9 kubenswrapper[2584]: I0714 05:00:36.186613 2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-7p74v" event={"ID":"e8606dd5-f76a-4af0-93ba-b8861980b30c","Type":"ContainerStarted","Data":"0f6bbbed74cad3c78f22ba983a7d3ecb0c0ee6b84975eba40f2078b34e11d23d"} Jul 14 05:00:37.028612 ip-10-0-136-9 kubenswrapper[2584]: I0714 05:00:37.028547 2584 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-network-diagnostics/network-check-target-kr4q2" Jul 14 05:00:37.193776 ip-10-0-136-9 kubenswrapper[2584]: I0714 05:00:37.193675 2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/downloads-68c9cbb497-ch2f4" event={"ID":"5813b135-d940-4fd9-8d37-4dbd772504eb","Type":"ContainerStarted","Data":"b9136d49e418953052d8b8200267288499e6632337415467b644727e673d5d0d"} Jul 14 05:00:37.193776 ip-10-0-136-9 kubenswrapper[2584]: I0714 05:00:37.193741 2584 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/downloads-68c9cbb497-ch2f4" Jul 14 05:00:37.196097 ip-10-0-136-9 kubenswrapper[2584]: I0714 05:00:37.196061 2584 generic.go:356] "Generic (PLEG): container finished" podID="e8606dd5-f76a-4af0-93ba-b8861980b30c" containerID="d1f4760cc8327805b24e6cfd9261abfff153ad148753c4014b32863119a4cd54" exitCode=0 Jul 14 05:00:37.196218 ip-10-0-136-9 kubenswrapper[2584]: I0714 05:00:37.196115 2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-7p74v" event={"ID":"e8606dd5-f76a-4af0-93ba-b8861980b30c","Type":"ContainerDied","Data":"d1f4760cc8327805b24e6cfd9261abfff153ad148753c4014b32863119a4cd54"} Jul 14 05:00:37.206775 ip-10-0-136-9 kubenswrapper[2584]: I0714 05:00:37.206756 2584 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console/downloads-68c9cbb497-ch2f4" Jul 14 05:00:37.209833 ip-10-0-136-9 kubenswrapper[2584]: I0714 05:00:37.209784 2584 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console/downloads-68c9cbb497-ch2f4" podStartSLOduration=3.823761318 podStartE2EDuration="20.209767531s" totalImagesPullingTime="16.386006213s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-14 05:00:17 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-14 05:00:37.209119224 +0000 UTC m=+98.170374929" watchObservedRunningTime="2026-07-14 05:00:37.209767531 +0000 UTC m=+98.171023235" Jul 14 05:00:38.140676 ip-10-0-136-9 kubenswrapper[2584]: I0714 05:00:38.140630 2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-g257n_15609856-4056-487b-acdd-30276263b098/konnectivity-agent/0.log" limit=1024 Jul 14 05:00:38.204376 ip-10-0-136-9 kubenswrapper[2584]: I0714 05:00:38.204218 2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-7p74v" event={"ID":"e8606dd5-f76a-4af0-93ba-b8861980b30c","Type":"ContainerStarted","Data":"c13515e01de1d2c9fcb1ecb10643c88903f213bafb27c3ba33a841dfe945a98d"} Jul 14 05:00:38.204376 ip-10-0-136-9 kubenswrapper[2584]: I0714 05:00:38.204293 2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-7p74v" event={"ID":"e8606dd5-f76a-4af0-93ba-b8861980b30c","Type":"ContainerStarted","Data":"423109951dc47ca2b37d9d8a1119543d262b97514de21f78a9eb5ccd2c6c9c14"} Jul 14 05:00:38.224977 ip-10-0-136-9 kubenswrapper[2584]: I0714 05:00:38.224916 2584 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/node-exporter-7p74v" podStartSLOduration=8.241188641 podStartE2EDuration="9.224897319s" totalImagesPullingTime="910.501131ms" totalInitContainerRuntime="73.207547ms" isStatefulPod=true podCreationTimestamp="2026-07-14 05:00:29 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-14 05:00:38.223504044 +0000 UTC m=+99.184759775" watchObservedRunningTime="2026-07-14 05:00:38.224897319 +0000 UTC m=+99.186153023" Jul 14 05:00:38.228221 ip-10-0-136-9 kubenswrapper[2584]: I0714 05:00:38.228185 2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-g257n_15609856-4056-487b-acdd-30276263b098/konnectivity-agent/0.log" limit=1024 Jul 14 05:00:38.939066 ip-10-0-136-9 kubenswrapper[2584]: I0714 05:00:38.939027 2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-g257n_15609856-4056-487b-acdd-30276263b098/konnectivity-agent/0.log" limit=1024 Jul 14 05:00:39.040801 ip-10-0-136-9 kubenswrapper[2584]: I0714 05:00:39.040746 2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-g257n_15609856-4056-487b-acdd-30276263b098/konnectivity-agent/0.log" limit=1024 Jul 14 05:00:41.191391 ip-10-0-136-9 kubenswrapper[2584]: I0714 05:00:41.191352 2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-g257n_15609856-4056-487b-acdd-30276263b098/konnectivity-agent/0.log" limit=1024 Jul 14 05:00:41.288685 ip-10-0-136-9 kubenswrapper[2584]: I0714 05:00:41.288644 2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-g257n_15609856-4056-487b-acdd-30276263b098/konnectivity-agent/0.log" limit=1024 Jul 14 05:00:42.343497 ip-10-0-136-9 kubenswrapper[2584]: I0714 05:00:42.343464 2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-g257n_15609856-4056-487b-acdd-30276263b098/konnectivity-agent/0.log" limit=1024 Jul 14 05:00:42.440214 ip-10-0-136-9 kubenswrapper[2584]: I0714 05:00:42.440176 2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-g257n_15609856-4056-487b-acdd-30276263b098/konnectivity-agent/0.log" limit=1024 Jul 14 05:00:42.550266 ip-10-0-136-9 kubenswrapper[2584]: I0714 05:00:42.550233 2584 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-image-registry/image-registry-6f5d75bf47-rnc9m"] Jul 14 05:00:42.756490 ip-10-0-136-9 kubenswrapper[2584]: I0714 05:00:42.756414 2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-g257n_15609856-4056-487b-acdd-30276263b098/konnectivity-agent/0.log" limit=1024 Jul 14 05:00:42.857220 ip-10-0-136-9 kubenswrapper[2584]: I0714 05:00:42.857183 2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-g257n_15609856-4056-487b-acdd-30276263b098/konnectivity-agent/0.log" limit=1024 Jul 14 05:00:43.857174 ip-10-0-136-9 kubenswrapper[2584]: I0714 05:00:43.857132 2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-g257n_15609856-4056-487b-acdd-30276263b098/konnectivity-agent/0.log" limit=1024 Jul 14 05:00:43.958749 ip-10-0-136-9 kubenswrapper[2584]: I0714 05:00:43.958708 2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-g257n_15609856-4056-487b-acdd-30276263b098/konnectivity-agent/0.log" limit=1024 Jul 14 05:00:44.703807 ip-10-0-136-9 kubenswrapper[2584]: I0714 05:00:44.703772 2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-g257n_15609856-4056-487b-acdd-30276263b098/konnectivity-agent/0.log" limit=1024 Jul 14 05:00:44.805329 ip-10-0-136-9 kubenswrapper[2584]: I0714 05:00:44.805282 2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-g257n_15609856-4056-487b-acdd-30276263b098/konnectivity-agent/0.log" limit=1024 Jul 14 05:00:44.865982 ip-10-0-136-9 kubenswrapper[2584]: I0714 05:00:44.865956 2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-g257n_15609856-4056-487b-acdd-30276263b098/konnectivity-agent/0.log" limit=1024 Jul 14 05:00:46.702110 ip-10-0-136-9 kubenswrapper[2584]: I0714 05:00:46.702075 2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-g257n_15609856-4056-487b-acdd-30276263b098/konnectivity-agent/0.log" limit=1024 Jul 14 05:00:46.804021 ip-10-0-136-9 kubenswrapper[2584]: I0714 05:00:46.803964 2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-g257n_15609856-4056-487b-acdd-30276263b098/konnectivity-agent/0.log" limit=1024 Jul 14 05:00:49.768692 ip-10-0-136-9 kubenswrapper[2584]: I0714 05:00:49.768653 2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-g257n_15609856-4056-487b-acdd-30276263b098/konnectivity-agent/0.log" limit=1024 Jul 14 05:00:49.869652 ip-10-0-136-9 kubenswrapper[2584]: I0714 05:00:49.869620 2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-g257n_15609856-4056-487b-acdd-30276263b098/konnectivity-agent/0.log" limit=1024 Jul 14 05:00:49.970122 ip-10-0-136-9 kubenswrapper[2584]: I0714 05:00:49.970086 2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-g257n_15609856-4056-487b-acdd-30276263b098/konnectivity-agent/0.log" limit=1024 Jul 14 05:00:50.021852 ip-10-0-136-9 kubenswrapper[2584]: I0714 05:00:50.021771 2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-g257n_15609856-4056-487b-acdd-30276263b098/konnectivity-agent/0.log" limit=1024 Jul 14 05:00:53.668920 ip-10-0-136-9 kubenswrapper[2584]: I0714 05:00:53.668879 2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-g257n_15609856-4056-487b-acdd-30276263b098/konnectivity-agent/0.log" limit=1024 Jul 14 05:00:53.774816 ip-10-0-136-9 kubenswrapper[2584]: I0714 05:00:53.774785 2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-g257n_15609856-4056-487b-acdd-30276263b098/konnectivity-agent/0.log" limit=1024 Jul 14 05:00:54.055905 ip-10-0-136-9 kubenswrapper[2584]: I0714 05:00:54.055808 2584 prober.go:120] "Probe failed" probeType="Liveness" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-c55458774-qd8rk" podUID="70e90187-8fc9-4b4c-8ca4-12659f64bd3c" containerName="service-proxy" probeResult="failure" output="HTTP probe failed with statuscode: 500" Jul 14 05:00:55.275662 ip-10-0-136-9 kubenswrapper[2584]: I0714 05:00:55.275599 2584 generic.go:356] "Generic (PLEG): container finished" podID="32d1dfa7-69ec-4b39-b5c9-154f4774db02" containerID="38ee31d5c5d905045320970387493bf0fc24d0d4ff264f20aebd6cac2e80b481" exitCode=0 Jul 14 05:00:55.275974 ip-10-0-136-9 kubenswrapper[2584]: I0714 05:00:55.275673 2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-operator-68d9dd94cf-wlmqg" event={"ID":"32d1dfa7-69ec-4b39-b5c9-154f4774db02","Type":"ContainerDied","Data":"38ee31d5c5d905045320970387493bf0fc24d0d4ff264f20aebd6cac2e80b481"} Jul 14 05:00:55.276045 ip-10-0-136-9 kubenswrapper[2584]: I0714 05:00:55.276024 2584 scope.go:117] "RemoveContainer" containerID="38ee31d5c5d905045320970387493bf0fc24d0d4ff264f20aebd6cac2e80b481" Jul 14 05:00:56.183791 ip-10-0-136-9 kubenswrapper[2584]: I0714 05:00:56.183756 2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-g257n_15609856-4056-487b-acdd-30276263b098/konnectivity-agent/0.log" limit=1024 Jul 14 05:00:56.234728 ip-10-0-136-9 kubenswrapper[2584]: I0714 05:00:56.234695 2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-g257n_15609856-4056-487b-acdd-30276263b098/konnectivity-agent/0.log" limit=1024 Jul 14 05:00:56.281852 ip-10-0-136-9 kubenswrapper[2584]: I0714 05:00:56.281831 2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-operator-68d9dd94cf-wlmqg" event={"ID":"32d1dfa7-69ec-4b39-b5c9-154f4774db02","Type":"ContainerStarted","Data":"9f164847dc49fffbda4970ba02a2fc6fd5603b177a045126fbc9c1c8f6b741ec"} Jul 14 05:01:02.567586 ip-10-0-136-9 kubenswrapper[2584]: I0714 05:01:02.567541 2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-g257n_15609856-4056-487b-acdd-30276263b098/konnectivity-agent/0.log" limit=1024 Jul 14 05:01:04.056203 ip-10-0-136-9 kubenswrapper[2584]: I0714 05:01:04.056163 2584 prober.go:120] "Probe failed" probeType="Liveness" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-c55458774-qd8rk" podUID="70e90187-8fc9-4b4c-8ca4-12659f64bd3c" containerName="service-proxy" probeResult="failure" output="HTTP probe failed with statuscode: 500" Jul 14 05:01:07.574606 ip-10-0-136-9 kubenswrapper[2584]: I0714 05:01:07.574547 2584 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-image-registry/image-registry-6f5d75bf47-rnc9m" podUID="6421bddc-6c3a-4ae2-9a6c-348d3de7aec9" containerName="registry" containerID="cri-o://b44b979dae3af343d2d5cc02eec172e10236539c28067a9d728bc2890666dd70" gracePeriod=30 Jul 14 05:01:07.874086 ip-10-0-136-9 kubenswrapper[2584]: I0714 05:01:07.873883 2584 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-6f5d75bf47-rnc9m" Jul 14 05:01:07.976832 ip-10-0-136-9 kubenswrapper[2584]: I0714 05:01:07.976802 2584 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/6421bddc-6c3a-4ae2-9a6c-348d3de7aec9-registry-certificates\") pod \"6421bddc-6c3a-4ae2-9a6c-348d3de7aec9\" (UID: \"6421bddc-6c3a-4ae2-9a6c-348d3de7aec9\") " Jul 14 05:01:07.977006 ip-10-0-136-9 kubenswrapper[2584]: I0714 05:01:07.976843 2584 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/6421bddc-6c3a-4ae2-9a6c-348d3de7aec9-registry-tls\") pod \"6421bddc-6c3a-4ae2-9a6c-348d3de7aec9\" (UID: \"6421bddc-6c3a-4ae2-9a6c-348d3de7aec9\") " Jul 14 05:01:07.977006 ip-10-0-136-9 kubenswrapper[2584]: I0714 05:01:07.976877 2584 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/6421bddc-6c3a-4ae2-9a6c-348d3de7aec9-image-registry-private-configuration\") pod \"6421bddc-6c3a-4ae2-9a6c-348d3de7aec9\" (UID: \"6421bddc-6c3a-4ae2-9a6c-348d3de7aec9\") " Jul 14 05:01:07.977006 ip-10-0-136-9 kubenswrapper[2584]: I0714 05:01:07.976960 2584 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/6421bddc-6c3a-4ae2-9a6c-348d3de7aec9-ca-trust-extracted\") pod \"6421bddc-6c3a-4ae2-9a6c-348d3de7aec9\" (UID: \"6421bddc-6c3a-4ae2-9a6c-348d3de7aec9\") " Jul 14 05:01:07.977164 ip-10-0-136-9 kubenswrapper[2584]: I0714 05:01:07.977007 2584 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-plq95\" (UniqueName: \"kubernetes.io/projected/6421bddc-6c3a-4ae2-9a6c-348d3de7aec9-kube-api-access-plq95\") pod \"6421bddc-6c3a-4ae2-9a6c-348d3de7aec9\" (UID: \"6421bddc-6c3a-4ae2-9a6c-348d3de7aec9\") " Jul 14 05:01:07.977164 ip-10-0-136-9 kubenswrapper[2584]: I0714 05:01:07.977047 2584 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/6421bddc-6c3a-4ae2-9a6c-348d3de7aec9-trusted-ca\") pod \"6421bddc-6c3a-4ae2-9a6c-348d3de7aec9\" (UID: \"6421bddc-6c3a-4ae2-9a6c-348d3de7aec9\") " Jul 14 05:01:07.977164 ip-10-0-136-9 kubenswrapper[2584]: I0714 05:01:07.977081 2584 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/6421bddc-6c3a-4ae2-9a6c-348d3de7aec9-installation-pull-secrets\") pod \"6421bddc-6c3a-4ae2-9a6c-348d3de7aec9\" (UID: \"6421bddc-6c3a-4ae2-9a6c-348d3de7aec9\") " Jul 14 05:01:07.977298 ip-10-0-136-9 kubenswrapper[2584]: I0714 05:01:07.977194 2584 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/6421bddc-6c3a-4ae2-9a6c-348d3de7aec9-bound-sa-token\") pod \"6421bddc-6c3a-4ae2-9a6c-348d3de7aec9\" (UID: \"6421bddc-6c3a-4ae2-9a6c-348d3de7aec9\") " Jul 14 05:01:07.977298 ip-10-0-136-9 kubenswrapper[2584]: I0714 05:01:07.977205 2584 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/6421bddc-6c3a-4ae2-9a6c-348d3de7aec9-registry-certificates" (OuterVolumeSpecName: "registry-certificates") pod "6421bddc-6c3a-4ae2-9a6c-348d3de7aec9" (UID: "6421bddc-6c3a-4ae2-9a6c-348d3de7aec9"). InnerVolumeSpecName "registry-certificates". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 14 05:01:07.977499 ip-10-0-136-9 kubenswrapper[2584]: I0714 05:01:07.977459 2584 reconciler_common.go:299] "Volume detached for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/6421bddc-6c3a-4ae2-9a6c-348d3de7aec9-registry-certificates\") on node \"ip-10-0-136-9.ec2.internal\" DevicePath \"\"" Jul 14 05:01:07.977577 ip-10-0-136-9 kubenswrapper[2584]: I0714 05:01:07.977526 2584 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/6421bddc-6c3a-4ae2-9a6c-348d3de7aec9-trusted-ca" (OuterVolumeSpecName: "trusted-ca") pod "6421bddc-6c3a-4ae2-9a6c-348d3de7aec9" (UID: "6421bddc-6c3a-4ae2-9a6c-348d3de7aec9"). InnerVolumeSpecName "trusted-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 14 05:01:07.980079 ip-10-0-136-9 kubenswrapper[2584]: I0714 05:01:07.980029 2584 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/6421bddc-6c3a-4ae2-9a6c-348d3de7aec9-installation-pull-secrets" (OuterVolumeSpecName: "installation-pull-secrets") pod "6421bddc-6c3a-4ae2-9a6c-348d3de7aec9" (UID: "6421bddc-6c3a-4ae2-9a6c-348d3de7aec9"). InnerVolumeSpecName "installation-pull-secrets". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 14 05:01:07.980205 ip-10-0-136-9 kubenswrapper[2584]: I0714 05:01:07.980125 2584 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/6421bddc-6c3a-4ae2-9a6c-348d3de7aec9-registry-tls" (OuterVolumeSpecName: "registry-tls") pod "6421bddc-6c3a-4ae2-9a6c-348d3de7aec9" (UID: "6421bddc-6c3a-4ae2-9a6c-348d3de7aec9"). InnerVolumeSpecName "registry-tls". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 14 05:01:07.980281 ip-10-0-136-9 kubenswrapper[2584]: I0714 05:01:07.980200 2584 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/6421bddc-6c3a-4ae2-9a6c-348d3de7aec9-kube-api-access-plq95" (OuterVolumeSpecName: "kube-api-access-plq95") pod "6421bddc-6c3a-4ae2-9a6c-348d3de7aec9" (UID: "6421bddc-6c3a-4ae2-9a6c-348d3de7aec9"). InnerVolumeSpecName "kube-api-access-plq95". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 14 05:01:07.980366 ip-10-0-136-9 kubenswrapper[2584]: I0714 05:01:07.980347 2584 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/6421bddc-6c3a-4ae2-9a6c-348d3de7aec9-image-registry-private-configuration" (OuterVolumeSpecName: "image-registry-private-configuration") pod "6421bddc-6c3a-4ae2-9a6c-348d3de7aec9" (UID: "6421bddc-6c3a-4ae2-9a6c-348d3de7aec9"). InnerVolumeSpecName "image-registry-private-configuration". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 14 05:01:07.980471 ip-10-0-136-9 kubenswrapper[2584]: I0714 05:01:07.980451 2584 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/6421bddc-6c3a-4ae2-9a6c-348d3de7aec9-bound-sa-token" (OuterVolumeSpecName: "bound-sa-token") pod "6421bddc-6c3a-4ae2-9a6c-348d3de7aec9" (UID: "6421bddc-6c3a-4ae2-9a6c-348d3de7aec9"). InnerVolumeSpecName "bound-sa-token". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 14 05:01:07.986335 ip-10-0-136-9 kubenswrapper[2584]: I0714 05:01:07.986313 2584 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/6421bddc-6c3a-4ae2-9a6c-348d3de7aec9-ca-trust-extracted" (OuterVolumeSpecName: "ca-trust-extracted") pod "6421bddc-6c3a-4ae2-9a6c-348d3de7aec9" (UID: "6421bddc-6c3a-4ae2-9a6c-348d3de7aec9"). InnerVolumeSpecName "ca-trust-extracted". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 14 05:01:08.078423 ip-10-0-136-9 kubenswrapper[2584]: I0714 05:01:08.078388 2584 reconciler_common.go:299] "Volume detached for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/6421bddc-6c3a-4ae2-9a6c-348d3de7aec9-registry-tls\") on node \"ip-10-0-136-9.ec2.internal\" DevicePath \"\"" Jul 14 05:01:08.078423 ip-10-0-136-9 kubenswrapper[2584]: I0714 05:01:08.078417 2584 reconciler_common.go:299] "Volume detached for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/6421bddc-6c3a-4ae2-9a6c-348d3de7aec9-image-registry-private-configuration\") on node \"ip-10-0-136-9.ec2.internal\" DevicePath \"\"" Jul 14 05:01:08.078423 ip-10-0-136-9 kubenswrapper[2584]: I0714 05:01:08.078428 2584 reconciler_common.go:299] "Volume detached for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/6421bddc-6c3a-4ae2-9a6c-348d3de7aec9-ca-trust-extracted\") on node \"ip-10-0-136-9.ec2.internal\" DevicePath \"\"" Jul 14 05:01:08.078637 ip-10-0-136-9 kubenswrapper[2584]: I0714 05:01:08.078437 2584 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-plq95\" (UniqueName: \"kubernetes.io/projected/6421bddc-6c3a-4ae2-9a6c-348d3de7aec9-kube-api-access-plq95\") on node \"ip-10-0-136-9.ec2.internal\" DevicePath \"\"" Jul 14 05:01:08.078637 ip-10-0-136-9 kubenswrapper[2584]: I0714 05:01:08.078445 2584 reconciler_common.go:299] "Volume detached for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/6421bddc-6c3a-4ae2-9a6c-348d3de7aec9-trusted-ca\") on node \"ip-10-0-136-9.ec2.internal\" DevicePath \"\"" Jul 14 05:01:08.078637 ip-10-0-136-9 kubenswrapper[2584]: I0714 05:01:08.078452 2584 reconciler_common.go:299] "Volume detached for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/6421bddc-6c3a-4ae2-9a6c-348d3de7aec9-installation-pull-secrets\") on node \"ip-10-0-136-9.ec2.internal\" DevicePath \"\"" Jul 14 05:01:08.078637 ip-10-0-136-9 kubenswrapper[2584]: I0714 05:01:08.078460 2584 reconciler_common.go:299] "Volume detached for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/6421bddc-6c3a-4ae2-9a6c-348d3de7aec9-bound-sa-token\") on node \"ip-10-0-136-9.ec2.internal\" DevicePath \"\"" Jul 14 05:01:08.333953 ip-10-0-136-9 kubenswrapper[2584]: I0714 05:01:08.330241 2584 generic.go:356] "Generic (PLEG): container finished" podID="6421bddc-6c3a-4ae2-9a6c-348d3de7aec9" containerID="b44b979dae3af343d2d5cc02eec172e10236539c28067a9d728bc2890666dd70" exitCode=0 Jul 14 05:01:08.333953 ip-10-0-136-9 kubenswrapper[2584]: I0714 05:01:08.330326 2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-6f5d75bf47-rnc9m" event={"ID":"6421bddc-6c3a-4ae2-9a6c-348d3de7aec9","Type":"ContainerDied","Data":"b44b979dae3af343d2d5cc02eec172e10236539c28067a9d728bc2890666dd70"} Jul 14 05:01:08.333953 ip-10-0-136-9 kubenswrapper[2584]: I0714 05:01:08.330379 2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-6f5d75bf47-rnc9m" event={"ID":"6421bddc-6c3a-4ae2-9a6c-348d3de7aec9","Type":"ContainerDied","Data":"7629be8d8b3673be9a41537803a8942dd1109de02adfec911e02978dfc877713"} Jul 14 05:01:08.333953 ip-10-0-136-9 kubenswrapper[2584]: I0714 05:01:08.330409 2584 scope.go:117] "RemoveContainer" containerID="b44b979dae3af343d2d5cc02eec172e10236539c28067a9d728bc2890666dd70" Jul 14 05:01:08.333953 ip-10-0-136-9 kubenswrapper[2584]: I0714 05:01:08.330581 2584 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-6f5d75bf47-rnc9m" Jul 14 05:01:08.350214 ip-10-0-136-9 kubenswrapper[2584]: I0714 05:01:08.350175 2584 scope.go:117] "RemoveContainer" containerID="b44b979dae3af343d2d5cc02eec172e10236539c28067a9d728bc2890666dd70" Jul 14 05:01:08.350841 ip-10-0-136-9 kubenswrapper[2584]: E0714 05:01:08.350811 2584 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"b44b979dae3af343d2d5cc02eec172e10236539c28067a9d728bc2890666dd70\": container with ID starting with b44b979dae3af343d2d5cc02eec172e10236539c28067a9d728bc2890666dd70 not found: ID does not exist" containerID="b44b979dae3af343d2d5cc02eec172e10236539c28067a9d728bc2890666dd70" Jul 14 05:01:08.350960 ip-10-0-136-9 kubenswrapper[2584]: I0714 05:01:08.350851 2584 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"b44b979dae3af343d2d5cc02eec172e10236539c28067a9d728bc2890666dd70"} err="failed to get container status \"b44b979dae3af343d2d5cc02eec172e10236539c28067a9d728bc2890666dd70\": rpc error: code = NotFound desc = could not find container \"b44b979dae3af343d2d5cc02eec172e10236539c28067a9d728bc2890666dd70\": container with ID starting with b44b979dae3af343d2d5cc02eec172e10236539c28067a9d728bc2890666dd70 not found: ID does not exist" Jul 14 05:01:08.358126 ip-10-0-136-9 kubenswrapper[2584]: I0714 05:01:08.358101 2584 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-image-registry/image-registry-6f5d75bf47-rnc9m"] Jul 14 05:01:08.361673 ip-10-0-136-9 kubenswrapper[2584]: I0714 05:01:08.361652 2584 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-image-registry/image-registry-6f5d75bf47-rnc9m"] Jul 14 05:01:09.535416 ip-10-0-136-9 kubenswrapper[2584]: I0714 05:01:09.535380 2584 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="6421bddc-6c3a-4ae2-9a6c-348d3de7aec9" path="/var/lib/kubelet/pods/6421bddc-6c3a-4ae2-9a6c-348d3de7aec9/volumes" Jul 14 05:01:14.056524 ip-10-0-136-9 kubenswrapper[2584]: I0714 05:01:14.056486 2584 prober.go:120] "Probe failed" probeType="Liveness" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-c55458774-qd8rk" podUID="70e90187-8fc9-4b4c-8ca4-12659f64bd3c" containerName="service-proxy" probeResult="failure" output="HTTP probe failed with statuscode: 500" Jul 14 05:01:14.057003 ip-10-0-136-9 kubenswrapper[2584]: I0714 05:01:14.056559 2584 kubelet.go:2654] "SyncLoop (probe)" probe="liveness" status="unhealthy" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-c55458774-qd8rk" Jul 14 05:01:14.057204 ip-10-0-136-9 kubenswrapper[2584]: I0714 05:01:14.057181 2584 kuberuntime_manager.go:1192] "Message for Container of pod" containerName="service-proxy" containerStatusID={"Type":"cri-o","ID":"87bc8c78be7d19a92cec570450ab027d24683632f2bf47381a3cc6515ae9531e"} pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-c55458774-qd8rk" containerMessage="Container service-proxy failed liveness probe, will be restarted" Jul 14 05:01:14.057274 ip-10-0-136-9 kubenswrapper[2584]: I0714 05:01:14.057230 2584 kuberuntime_container.go:873] "Killing container with a grace period" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-c55458774-qd8rk" podUID="70e90187-8fc9-4b4c-8ca4-12659f64bd3c" containerName="service-proxy" containerID="cri-o://87bc8c78be7d19a92cec570450ab027d24683632f2bf47381a3cc6515ae9531e" gracePeriod=30 Jul 14 05:01:14.357967 ip-10-0-136-9 kubenswrapper[2584]: I0714 05:01:14.357914 2584 generic.go:356] "Generic (PLEG): container finished" podID="70e90187-8fc9-4b4c-8ca4-12659f64bd3c" containerID="87bc8c78be7d19a92cec570450ab027d24683632f2bf47381a3cc6515ae9531e" exitCode=2 Jul 14 05:01:14.358143 ip-10-0-136-9 kubenswrapper[2584]: I0714 05:01:14.357989 2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-c55458774-qd8rk" event={"ID":"70e90187-8fc9-4b4c-8ca4-12659f64bd3c","Type":"ContainerDied","Data":"87bc8c78be7d19a92cec570450ab027d24683632f2bf47381a3cc6515ae9531e"} Jul 14 05:01:14.358143 ip-10-0-136-9 kubenswrapper[2584]: I0714 05:01:14.358039 2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-c55458774-qd8rk" event={"ID":"70e90187-8fc9-4b4c-8ca4-12659f64bd3c","Type":"ContainerStarted","Data":"a116410eac999cecff94df40afb864c091e2b3d54fd40d2a4736306a4b7e879d"} Jul 14 05:01:15.367302 ip-10-0-136-9 kubenswrapper[2584]: I0714 05:01:15.367212 2584 generic.go:356] "Generic (PLEG): container finished" podID="90ab614b-66f6-4850-a0ac-0dc019099d3b" containerID="3c4c41120313c96f4a1ed0287432ea7790a79f593372b590071722fea33dc316" exitCode=0 Jul 14 05:01:15.367302 ip-10-0-136-9 kubenswrapper[2584]: I0714 05:01:15.367249 2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-service-ca-operator/service-ca-operator-7695fc6c8c-5j5s4" event={"ID":"90ab614b-66f6-4850-a0ac-0dc019099d3b","Type":"ContainerDied","Data":"3c4c41120313c96f4a1ed0287432ea7790a79f593372b590071722fea33dc316"} Jul 14 05:01:15.367689 ip-10-0-136-9 kubenswrapper[2584]: I0714 05:01:15.367561 2584 scope.go:117] "RemoveContainer" containerID="3c4c41120313c96f4a1ed0287432ea7790a79f593372b590071722fea33dc316" Jul 14 05:01:16.373684 ip-10-0-136-9 kubenswrapper[2584]: I0714 05:01:16.373647 2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-service-ca-operator/service-ca-operator-7695fc6c8c-5j5s4" event={"ID":"90ab614b-66f6-4850-a0ac-0dc019099d3b","Type":"ContainerStarted","Data":"8faee55eb08239496503dc83fa503977d603a08d22011f764a5d3e7740e80359"} Jul 14 05:01:25.411999 ip-10-0-136-9 kubenswrapper[2584]: I0714 05:01:25.411967 2584 generic.go:356] "Generic (PLEG): container finished" podID="15929c2d-1e38-4405-9353-644c191c8c43" containerID="86be9ae98cb68c461978fef1216096b853624be9d0795ab39ab0507b43122355" exitCode=0 Jul 14 05:01:25.412393 ip-10-0-136-9 kubenswrapper[2584]: I0714 05:01:25.412045 2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-799cb7f958-fkfct" event={"ID":"15929c2d-1e38-4405-9353-644c191c8c43","Type":"ContainerDied","Data":"86be9ae98cb68c461978fef1216096b853624be9d0795ab39ab0507b43122355"} Jul 14 05:01:25.412393 ip-10-0-136-9 kubenswrapper[2584]: I0714 05:01:25.412357 2584 scope.go:117] "RemoveContainer" containerID="86be9ae98cb68c461978fef1216096b853624be9d0795ab39ab0507b43122355" Jul 14 05:01:26.418110 ip-10-0-136-9 kubenswrapper[2584]: I0714 05:01:26.418077 2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-799cb7f958-fkfct" event={"ID":"15929c2d-1e38-4405-9353-644c191c8c43","Type":"ContainerStarted","Data":"8e1a686acc40814e5bc2db574ecb3d0b31e6d5b4c0169eb2800da353d8046731"} Jul 14 05:01:48.555678 ip-10-0-136-9 kubenswrapper[2584]: I0714 05:01:48.555648 2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-g257n_15609856-4056-487b-acdd-30276263b098/konnectivity-agent/0.log" limit=1024 Jul 14 05:01:49.088259 ip-10-0-136-9 kubenswrapper[2584]: I0714 05:01:49.088223 2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-g257n_15609856-4056-487b-acdd-30276263b098/konnectivity-agent/0.log" limit=1024 Jul 14 05:01:58.107224 ip-10-0-136-9 kubenswrapper[2584]: I0714 05:01:58.107119 2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-g257n_15609856-4056-487b-acdd-30276263b098/konnectivity-agent/0.log" limit=1024 Jul 14 05:01:58.570293 ip-10-0-136-9 kubenswrapper[2584]: I0714 05:01:58.570210 2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-g257n_15609856-4056-487b-acdd-30276263b098/konnectivity-agent/0.log" limit=1024 Jul 14 05:01:58.670264 ip-10-0-136-9 kubenswrapper[2584]: I0714 05:01:58.670226 2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-g257n_15609856-4056-487b-acdd-30276263b098/konnectivity-agent/0.log" limit=1024 Jul 14 05:01:58.839646 ip-10-0-136-9 kubenswrapper[2584]: I0714 05:01:58.839601 2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-g257n_15609856-4056-487b-acdd-30276263b098/konnectivity-agent/0.log" limit=1024 Jul 14 05:01:58.941107 ip-10-0-136-9 kubenswrapper[2584]: I0714 05:01:58.941080 2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-g257n_15609856-4056-487b-acdd-30276263b098/konnectivity-agent/0.log" limit=1024 Jul 14 05:02:09.056987 ip-10-0-136-9 kubenswrapper[2584]: I0714 05:02:09.056927 2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-g257n_15609856-4056-487b-acdd-30276263b098/konnectivity-agent/0.log" limit=1024 Jul 14 05:02:09.157758 ip-10-0-136-9 kubenswrapper[2584]: I0714 05:02:09.157719 2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-g257n_15609856-4056-487b-acdd-30276263b098/konnectivity-agent/0.log" limit=1024 Jul 14 05:02:09.210784 ip-10-0-136-9 kubenswrapper[2584]: I0714 05:02:09.210754 2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-g257n_15609856-4056-487b-acdd-30276263b098/konnectivity-agent/0.log" limit=1024 Jul 14 05:02:23.222247 ip-10-0-136-9 kubenswrapper[2584]: I0714 05:02:23.222205 2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-g257n_15609856-4056-487b-acdd-30276263b098/konnectivity-agent/0.log" limit=1024 Jul 14 05:02:26.234819 ip-10-0-136-9 kubenswrapper[2584]: I0714 05:02:26.234777 2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-g257n_15609856-4056-487b-acdd-30276263b098/konnectivity-agent/0.log" limit=1024 Jul 14 05:02:26.286391 ip-10-0-136-9 kubenswrapper[2584]: I0714 05:02:26.286359 2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-g257n_15609856-4056-487b-acdd-30276263b098/konnectivity-agent/0.log" limit=1024 Jul 14 05:02:44.930023 ip-10-0-136-9 kubenswrapper[2584]: I0714 05:02:44.929980 2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-g257n_15609856-4056-487b-acdd-30276263b098/konnectivity-agent/0.log" limit=1024 Jul 14 05:02:56.261826 ip-10-0-136-9 kubenswrapper[2584]: I0714 05:02:56.261783 2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-g257n_15609856-4056-487b-acdd-30276263b098/konnectivity-agent/0.log" limit=1024 Jul 14 05:03:03.909957 ip-10-0-136-9 kubenswrapper[2584]: I0714 05:03:03.909901 2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-g257n_15609856-4056-487b-acdd-30276263b098/konnectivity-agent/0.log" limit=1024 Jul 14 05:03:04.672860 ip-10-0-136-9 kubenswrapper[2584]: I0714 05:03:04.672829 2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-g257n_15609856-4056-487b-acdd-30276263b098/konnectivity-agent/0.log" limit=1024 Jul 14 05:03:13.108691 ip-10-0-136-9 kubenswrapper[2584]: I0714 05:03:13.108650 2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-g257n_15609856-4056-487b-acdd-30276263b098/konnectivity-agent/0.log" limit=1024 Jul 14 05:03:13.208642 ip-10-0-136-9 kubenswrapper[2584]: I0714 05:03:13.208614 2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-g257n_15609856-4056-487b-acdd-30276263b098/konnectivity-agent/0.log" limit=1024 Jul 14 05:03:13.262872 ip-10-0-136-9 kubenswrapper[2584]: I0714 05:03:13.262849 2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-g257n_15609856-4056-487b-acdd-30276263b098/konnectivity-agent/0.log" limit=1024 Jul 14 05:03:13.831165 ip-10-0-136-9 kubenswrapper[2584]: I0714 05:03:13.831136 2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-g257n_15609856-4056-487b-acdd-30276263b098/konnectivity-agent/0.log" limit=1024 Jul 14 05:03:13.893458 ip-10-0-136-9 kubenswrapper[2584]: I0714 05:03:13.893429 2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-g257n_15609856-4056-487b-acdd-30276263b098/konnectivity-agent/0.log" limit=1024 Jul 14 05:03:15.793498 ip-10-0-136-9 kubenswrapper[2584]: I0714 05:03:15.793460 2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-g257n_15609856-4056-487b-acdd-30276263b098/konnectivity-agent/0.log" limit=1024 Jul 14 05:03:15.855223 ip-10-0-136-9 kubenswrapper[2584]: I0714 05:03:15.855193 2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-g257n_15609856-4056-487b-acdd-30276263b098/konnectivity-agent/0.log" limit=1024 Jul 14 05:03:24.284405 ip-10-0-136-9 kubenswrapper[2584]: I0714 05:03:24.284318 2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-g257n_15609856-4056-487b-acdd-30276263b098/konnectivity-agent/0.log" limit=1024 Jul 14 05:03:24.384462 ip-10-0-136-9 kubenswrapper[2584]: I0714 05:03:24.384432 2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-g257n_15609856-4056-487b-acdd-30276263b098/konnectivity-agent/0.log" limit=1024 Jul 14 05:03:24.484769 ip-10-0-136-9 kubenswrapper[2584]: I0714 05:03:24.484746 2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-g257n_15609856-4056-487b-acdd-30276263b098/konnectivity-agent/0.log" limit=1024 Jul 14 05:03:24.541401 ip-10-0-136-9 kubenswrapper[2584]: I0714 05:03:24.541333 2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-g257n_15609856-4056-487b-acdd-30276263b098/konnectivity-agent/0.log" limit=1024 Jul 14 05:03:26.192033 ip-10-0-136-9 kubenswrapper[2584]: I0714 05:03:26.191998 2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-g257n_15609856-4056-487b-acdd-30276263b098/konnectivity-agent/0.log" limit=1024 Jul 14 05:03:26.293391 ip-10-0-136-9 kubenswrapper[2584]: I0714 05:03:26.293357 2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-g257n_15609856-4056-487b-acdd-30276263b098/konnectivity-agent/0.log" limit=1024 Jul 14 05:03:54.049984 ip-10-0-136-9 kubenswrapper[2584]: I0714 05:03:54.049953 2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-g257n_15609856-4056-487b-acdd-30276263b098/konnectivity-agent/0.log" limit=1024 Jul 14 05:03:54.138228 ip-10-0-136-9 kubenswrapper[2584]: I0714 05:03:54.138197 2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-g257n_15609856-4056-487b-acdd-30276263b098/konnectivity-agent/0.log" limit=1024 Jul 14 05:03:59.393415 ip-10-0-136-9 kubenswrapper[2584]: I0714 05:03:59.393387 2584 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-7866497494-wh846_b0b64988-41ac-4e49-bcfd-a08adebb37f7/console-operator/1.log" Jul 14 05:03:59.398654 ip-10-0-136-9 kubenswrapper[2584]: I0714 05:03:59.398633 2584 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-7866497494-wh846_b0b64988-41ac-4e49-bcfd-a08adebb37f7/console-operator/1.log" Jul 14 05:03:59.400275 ip-10-0-136-9 kubenswrapper[2584]: I0714 05:03:59.400258 2584 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-8llzd_694d0f90-6317-495d-a312-b76a3513730e/ovn-acl-logging/0.log" Jul 14 05:03:59.405119 ip-10-0-136-9 kubenswrapper[2584]: I0714 05:03:59.405104 2584 kubelet.go:1648] "Image garbage collection succeeded" Jul 14 05:03:59.405212 ip-10-0-136-9 kubenswrapper[2584]: I0714 05:03:59.405137 2584 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-8llzd_694d0f90-6317-495d-a312-b76a3513730e/ovn-acl-logging/0.log" Jul 14 05:04:20.483969 ip-10-0-136-9 kubenswrapper[2584]: I0714 05:04:20.483910 2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-g257n_15609856-4056-487b-acdd-30276263b098/konnectivity-agent/0.log" limit=1024 Jul 14 05:04:22.406031 ip-10-0-136-9 kubenswrapper[2584]: I0714 05:04:22.405994 2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-g257n_15609856-4056-487b-acdd-30276263b098/konnectivity-agent/0.log" limit=1024 Jul 14 05:04:24.094042 ip-10-0-136-9 kubenswrapper[2584]: I0714 05:04:24.093982 2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-g257n_15609856-4056-487b-acdd-30276263b098/konnectivity-agent/0.log" limit=1024 Jul 14 05:04:24.195060 ip-10-0-136-9 kubenswrapper[2584]: I0714 05:04:24.195021 2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-g257n_15609856-4056-487b-acdd-30276263b098/konnectivity-agent/0.log" limit=1024 Jul 14 05:04:25.787244 ip-10-0-136-9 kubenswrapper[2584]: I0714 05:04:25.787180 2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-g257n_15609856-4056-487b-acdd-30276263b098/konnectivity-agent/0.log" limit=1024 Jul 14 05:04:25.899076 ip-10-0-136-9 kubenswrapper[2584]: I0714 05:04:25.899049 2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-g257n_15609856-4056-487b-acdd-30276263b098/konnectivity-agent/0.log" limit=1024 Jul 14 05:04:26.381083 ip-10-0-136-9 kubenswrapper[2584]: I0714 05:04:26.381046 2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-g257n_15609856-4056-487b-acdd-30276263b098/konnectivity-agent/0.log" limit=1024 Jul 14 05:04:26.486051 ip-10-0-136-9 kubenswrapper[2584]: I0714 05:04:26.486015 2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-g257n_15609856-4056-487b-acdd-30276263b098/konnectivity-agent/0.log" limit=1024 Jul 14 05:04:28.588973 ip-10-0-136-9 kubenswrapper[2584]: I0714 05:04:28.588924 2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-g257n_15609856-4056-487b-acdd-30276263b098/konnectivity-agent/0.log" limit=1024 Jul 14 05:04:28.797246 ip-10-0-136-9 kubenswrapper[2584]: I0714 05:04:28.797210 2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-g257n_15609856-4056-487b-acdd-30276263b098/konnectivity-agent/0.log" limit=1024 Jul 14 05:04:31.091373 ip-10-0-136-9 kubenswrapper[2584]: I0714 05:04:31.091342 2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-g257n_15609856-4056-487b-acdd-30276263b098/konnectivity-agent/0.log" limit=1024 Jul 14 05:04:31.191389 ip-10-0-136-9 kubenswrapper[2584]: I0714 05:04:31.191359 2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-g257n_15609856-4056-487b-acdd-30276263b098/konnectivity-agent/0.log" limit=1024 Jul 14 05:04:34.901517 ip-10-0-136-9 kubenswrapper[2584]: I0714 05:04:34.901481 2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-g257n_15609856-4056-487b-acdd-30276263b098/konnectivity-agent/0.log" limit=1024 Jul 14 05:04:34.993947 ip-10-0-136-9 kubenswrapper[2584]: I0714 05:04:34.993895 2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-g257n_15609856-4056-487b-acdd-30276263b098/konnectivity-agent/0.log" limit=1024 Jul 14 05:04:36.785004 ip-10-0-136-9 kubenswrapper[2584]: I0714 05:04:36.784921 2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-g257n_15609856-4056-487b-acdd-30276263b098/konnectivity-agent/0.log" limit=1024 Jul 14 05:04:41.251788 ip-10-0-136-9 kubenswrapper[2584]: I0714 05:04:41.251748 2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-g257n_15609856-4056-487b-acdd-30276263b098/konnectivity-agent/0.log" limit=1024 Jul 14 05:04:41.351570 ip-10-0-136-9 kubenswrapper[2584]: I0714 05:04:41.351537 2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-g257n_15609856-4056-487b-acdd-30276263b098/konnectivity-agent/0.log" limit=1024 Jul 14 05:04:43.422533 ip-10-0-136-9 kubenswrapper[2584]: I0714 05:04:43.422491 2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-g257n_15609856-4056-487b-acdd-30276263b098/konnectivity-agent/0.log" limit=1024 Jul 14 05:04:51.624025 ip-10-0-136-9 kubenswrapper[2584]: I0714 05:04:51.623921 2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-g257n_15609856-4056-487b-acdd-30276263b098/konnectivity-agent/0.log" limit=1024 Jul 14 05:04:51.687147 ip-10-0-136-9 kubenswrapper[2584]: I0714 05:04:51.687115 2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-g257n_15609856-4056-487b-acdd-30276263b098/konnectivity-agent/0.log" limit=1024 Jul 14 05:04:59.699178 ip-10-0-136-9 kubenswrapper[2584]: I0714 05:04:59.699128 2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-g257n_15609856-4056-487b-acdd-30276263b098/konnectivity-agent/0.log" limit=1024 Jul 14 05:04:59.812186 ip-10-0-136-9 kubenswrapper[2584]: I0714 05:04:59.812147 2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-g257n_15609856-4056-487b-acdd-30276263b098/konnectivity-agent/0.log" limit=1024 Jul 14 05:04:59.958623 ip-10-0-136-9 kubenswrapper[2584]: I0714 05:04:59.958537 2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-g257n_15609856-4056-487b-acdd-30276263b098/konnectivity-agent/0.log" limit=1024 Jul 14 05:05:00.060675 ip-10-0-136-9 kubenswrapper[2584]: I0714 05:05:00.060638 2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-g257n_15609856-4056-487b-acdd-30276263b098/konnectivity-agent/0.log" limit=1024 Jul 14 05:05:00.534852 ip-10-0-136-9 kubenswrapper[2584]: I0714 05:05:00.534823 2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-g257n_15609856-4056-487b-acdd-30276263b098/konnectivity-agent/0.log" limit=1024 Jul 14 05:05:00.805313 ip-10-0-136-9 kubenswrapper[2584]: I0714 05:05:00.805238 2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-g257n_15609856-4056-487b-acdd-30276263b098/konnectivity-agent/0.log" limit=1024 Jul 14 05:05:00.909598 ip-10-0-136-9 kubenswrapper[2584]: I0714 05:05:00.909570 2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-g257n_15609856-4056-487b-acdd-30276263b098/konnectivity-agent/0.log" limit=1024 Jul 14 05:05:00.921342 ip-10-0-136-9 kubenswrapper[2584]: I0714 05:05:00.921318 2584 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-6d474f5bbf-9zx9p"] Jul 14 05:05:00.921662 ip-10-0-136-9 kubenswrapper[2584]: I0714 05:05:00.921642 2584 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="6421bddc-6c3a-4ae2-9a6c-348d3de7aec9" containerName="registry" Jul 14 05:05:00.921662 ip-10-0-136-9 kubenswrapper[2584]: I0714 05:05:00.921657 2584 state_mem.go:107] "Deleted CPUSet assignment" podUID="6421bddc-6c3a-4ae2-9a6c-348d3de7aec9" containerName="registry" Jul 14 05:05:00.921816 ip-10-0-136-9 kubenswrapper[2584]: I0714 05:05:00.921727 2584 memory_manager.go:368] "RemoveStaleState removing state" podUID="6421bddc-6c3a-4ae2-9a6c-348d3de7aec9" containerName="registry" Jul 14 05:05:00.923509 ip-10-0-136-9 kubenswrapper[2584]: I0714 05:05:00.923492 2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/opendatahub-operator-controller-manager-6d474f5bbf-9zx9p" Jul 14 05:05:00.926135 ip-10-0-136-9 kubenswrapper[2584]: I0714 05:05:00.926114 2584 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-webhook-cert\"" Jul 14 05:05:00.926254 ip-10-0-136-9 kubenswrapper[2584]: I0714 05:05:00.926235 2584 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"openshift-service-ca.crt\"" Jul 14 05:05:00.926561 ip-10-0-136-9 kubenswrapper[2584]: I0714 05:05:00.926545 2584 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-manager-service-cert\"" Jul 14 05:05:00.926653 ip-10-0-136-9 kubenswrapper[2584]: I0714 05:05:00.926575 2584 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"kube-root-ca.crt\"" Jul 14 05:05:00.926717 ip-10-0-136-9 kubenswrapper[2584]: I0714 05:05:00.926651 2584 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-manager-dockercfg-gl2pb\"" Jul 14 05:05:00.944866 ip-10-0-136-9 kubenswrapper[2584]: I0714 05:05:00.944846 2584 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-6d474f5bbf-9zx9p"] Jul 14 05:05:01.006603 ip-10-0-136-9 kubenswrapper[2584]: I0714 05:05:01.006575 2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-k6742\" (UniqueName: \"kubernetes.io/projected/d09957f3-0d46-4fd6-b16e-d9cdabc8640c-kube-api-access-k6742\") pod \"opendatahub-operator-controller-manager-6d474f5bbf-9zx9p\" (UID: \"d09957f3-0d46-4fd6-b16e-d9cdabc8640c\") " pod="opendatahub/opendatahub-operator-controller-manager-6d474f5bbf-9zx9p" Jul 14 05:05:01.006709 ip-10-0-136-9 kubenswrapper[2584]: I0714 05:05:01.006613 2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/d09957f3-0d46-4fd6-b16e-d9cdabc8640c-apiservice-cert\") pod \"opendatahub-operator-controller-manager-6d474f5bbf-9zx9p\" (UID: \"d09957f3-0d46-4fd6-b16e-d9cdabc8640c\") " pod="opendatahub/opendatahub-operator-controller-manager-6d474f5bbf-9zx9p" Jul 14 05:05:01.006709 ip-10-0-136-9 kubenswrapper[2584]: I0714 05:05:01.006700 2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/d09957f3-0d46-4fd6-b16e-d9cdabc8640c-tmp\") pod \"opendatahub-operator-controller-manager-6d474f5bbf-9zx9p\" (UID: \"d09957f3-0d46-4fd6-b16e-d9cdabc8640c\") " pod="opendatahub/opendatahub-operator-controller-manager-6d474f5bbf-9zx9p" Jul 14 05:05:01.006777 ip-10-0-136-9 kubenswrapper[2584]: I0714 05:05:01.006722 2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/d09957f3-0d46-4fd6-b16e-d9cdabc8640c-manifests\") pod \"opendatahub-operator-controller-manager-6d474f5bbf-9zx9p\" (UID: \"d09957f3-0d46-4fd6-b16e-d9cdabc8640c\") " pod="opendatahub/opendatahub-operator-controller-manager-6d474f5bbf-9zx9p" Jul 14 05:05:01.006777 ip-10-0-136-9 kubenswrapper[2584]: I0714 05:05:01.006745 2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/d09957f3-0d46-4fd6-b16e-d9cdabc8640c-webhook-cert\") pod \"opendatahub-operator-controller-manager-6d474f5bbf-9zx9p\" (UID: \"d09957f3-0d46-4fd6-b16e-d9cdabc8640c\") " pod="opendatahub/opendatahub-operator-controller-manager-6d474f5bbf-9zx9p" Jul 14 05:05:01.056457 ip-10-0-136-9 kubenswrapper[2584]: I0714 05:05:01.056400 2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-g257n_15609856-4056-487b-acdd-30276263b098/konnectivity-agent/0.log" limit=1024 Jul 14 05:05:01.107975 ip-10-0-136-9 kubenswrapper[2584]: I0714 05:05:01.107951 2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/d09957f3-0d46-4fd6-b16e-d9cdabc8640c-tmp\") pod \"opendatahub-operator-controller-manager-6d474f5bbf-9zx9p\" (UID: \"d09957f3-0d46-4fd6-b16e-d9cdabc8640c\") " pod="opendatahub/opendatahub-operator-controller-manager-6d474f5bbf-9zx9p" Jul 14 05:05:01.108076 ip-10-0-136-9 kubenswrapper[2584]: I0714 05:05:01.107982 2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/d09957f3-0d46-4fd6-b16e-d9cdabc8640c-manifests\") pod \"opendatahub-operator-controller-manager-6d474f5bbf-9zx9p\" (UID: \"d09957f3-0d46-4fd6-b16e-d9cdabc8640c\") " pod="opendatahub/opendatahub-operator-controller-manager-6d474f5bbf-9zx9p" Jul 14 05:05:01.108076 ip-10-0-136-9 kubenswrapper[2584]: I0714 05:05:01.108000 2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/d09957f3-0d46-4fd6-b16e-d9cdabc8640c-webhook-cert\") pod \"opendatahub-operator-controller-manager-6d474f5bbf-9zx9p\" (UID: \"d09957f3-0d46-4fd6-b16e-d9cdabc8640c\") " pod="opendatahub/opendatahub-operator-controller-manager-6d474f5bbf-9zx9p" Jul 14 05:05:01.108076 ip-10-0-136-9 kubenswrapper[2584]: I0714 05:05:01.108027 2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-k6742\" (UniqueName: \"kubernetes.io/projected/d09957f3-0d46-4fd6-b16e-d9cdabc8640c-kube-api-access-k6742\") pod \"opendatahub-operator-controller-manager-6d474f5bbf-9zx9p\" (UID: \"d09957f3-0d46-4fd6-b16e-d9cdabc8640c\") " pod="opendatahub/opendatahub-operator-controller-manager-6d474f5bbf-9zx9p" Jul 14 05:05:01.108076 ip-10-0-136-9 kubenswrapper[2584]: I0714 05:05:01.108058 2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/d09957f3-0d46-4fd6-b16e-d9cdabc8640c-apiservice-cert\") pod \"opendatahub-operator-controller-manager-6d474f5bbf-9zx9p\" (UID: \"d09957f3-0d46-4fd6-b16e-d9cdabc8640c\") " pod="opendatahub/opendatahub-operator-controller-manager-6d474f5bbf-9zx9p" Jul 14 05:05:01.108391 ip-10-0-136-9 kubenswrapper[2584]: I0714 05:05:01.108365 2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/d09957f3-0d46-4fd6-b16e-d9cdabc8640c-manifests\") pod \"opendatahub-operator-controller-manager-6d474f5bbf-9zx9p\" (UID: \"d09957f3-0d46-4fd6-b16e-d9cdabc8640c\") " pod="opendatahub/opendatahub-operator-controller-manager-6d474f5bbf-9zx9p" Jul 14 05:05:01.110427 ip-10-0-136-9 kubenswrapper[2584]: I0714 05:05:01.110405 2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/d09957f3-0d46-4fd6-b16e-d9cdabc8640c-tmp\") pod \"opendatahub-operator-controller-manager-6d474f5bbf-9zx9p\" (UID: \"d09957f3-0d46-4fd6-b16e-d9cdabc8640c\") " pod="opendatahub/opendatahub-operator-controller-manager-6d474f5bbf-9zx9p" Jul 14 05:05:01.110524 ip-10-0-136-9 kubenswrapper[2584]: I0714 05:05:01.110430 2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/d09957f3-0d46-4fd6-b16e-d9cdabc8640c-webhook-cert\") pod \"opendatahub-operator-controller-manager-6d474f5bbf-9zx9p\" (UID: \"d09957f3-0d46-4fd6-b16e-d9cdabc8640c\") " pod="opendatahub/opendatahub-operator-controller-manager-6d474f5bbf-9zx9p" Jul 14 05:05:01.110604 ip-10-0-136-9 kubenswrapper[2584]: I0714 05:05:01.110583 2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/d09957f3-0d46-4fd6-b16e-d9cdabc8640c-apiservice-cert\") pod \"opendatahub-operator-controller-manager-6d474f5bbf-9zx9p\" (UID: \"d09957f3-0d46-4fd6-b16e-d9cdabc8640c\") " pod="opendatahub/opendatahub-operator-controller-manager-6d474f5bbf-9zx9p" Jul 14 05:05:01.115887 ip-10-0-136-9 kubenswrapper[2584]: I0714 05:05:01.115858 2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-k6742\" (UniqueName: \"kubernetes.io/projected/d09957f3-0d46-4fd6-b16e-d9cdabc8640c-kube-api-access-k6742\") pod \"opendatahub-operator-controller-manager-6d474f5bbf-9zx9p\" (UID: \"d09957f3-0d46-4fd6-b16e-d9cdabc8640c\") " pod="opendatahub/opendatahub-operator-controller-manager-6d474f5bbf-9zx9p" Jul 14 05:05:01.162248 ip-10-0-136-9 kubenswrapper[2584]: I0714 05:05:01.162224 2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-g257n_15609856-4056-487b-acdd-30276263b098/konnectivity-agent/0.log" limit=1024 Jul 14 05:05:01.233969 ip-10-0-136-9 kubenswrapper[2584]: I0714 05:05:01.233927 2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/opendatahub-operator-controller-manager-6d474f5bbf-9zx9p" Jul 14 05:05:01.258087 ip-10-0-136-9 kubenswrapper[2584]: I0714 05:05:01.258058 2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-g257n_15609856-4056-487b-acdd-30276263b098/konnectivity-agent/0.log" limit=1024 Jul 14 05:05:01.361339 ip-10-0-136-9 kubenswrapper[2584]: I0714 05:05:01.361313 2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-g257n_15609856-4056-487b-acdd-30276263b098/konnectivity-agent/0.log" limit=1024 Jul 14 05:05:01.367563 ip-10-0-136-9 kubenswrapper[2584]: I0714 05:05:01.367539 2584 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-6d474f5bbf-9zx9p"] Jul 14 05:05:01.369356 ip-10-0-136-9 kubenswrapper[2584]: W0714 05:05:01.369330 2584 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podd09957f3_0d46_4fd6_b16e_d9cdabc8640c.slice/crio-e361d7b495e1e052387ce7de4fa8d9cf0c534063a41cc57b3d93c5f1ac22817b WatchSource:0}: Error finding container e361d7b495e1e052387ce7de4fa8d9cf0c534063a41cc57b3d93c5f1ac22817b: Status 404 returned error can't find the container with id e361d7b495e1e052387ce7de4fa8d9cf0c534063a41cc57b3d93c5f1ac22817b Jul 14 05:05:01.371150 ip-10-0-136-9 kubenswrapper[2584]: I0714 05:05:01.371133 2584 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider Jul 14 05:05:01.427576 ip-10-0-136-9 kubenswrapper[2584]: I0714 05:05:01.427550 2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-g257n_15609856-4056-487b-acdd-30276263b098/konnectivity-agent/0.log" limit=1024 Jul 14 05:05:01.496709 ip-10-0-136-9 kubenswrapper[2584]: I0714 05:05:01.496683 2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-g257n_15609856-4056-487b-acdd-30276263b098/konnectivity-agent/0.log" limit=1024 Jul 14 05:05:01.596579 ip-10-0-136-9 kubenswrapper[2584]: I0714 05:05:01.596549 2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-g257n_15609856-4056-487b-acdd-30276263b098/konnectivity-agent/0.log" limit=1024 Jul 14 05:05:02.238464 ip-10-0-136-9 kubenswrapper[2584]: I0714 05:05:02.238427 2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-6d474f5bbf-9zx9p" event={"ID":"d09957f3-0d46-4fd6-b16e-d9cdabc8640c","Type":"ContainerStarted","Data":"e361d7b495e1e052387ce7de4fa8d9cf0c534063a41cc57b3d93c5f1ac22817b"} Jul 14 05:05:05.253301 ip-10-0-136-9 kubenswrapper[2584]: I0714 05:05:05.253264 2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-6d474f5bbf-9zx9p" event={"ID":"d09957f3-0d46-4fd6-b16e-d9cdabc8640c","Type":"ContainerStarted","Data":"8773cfa8202c1657708954144cfbb4a2f0cffa53232e59def477acbe51aee7b6"} Jul 14 05:05:06.258916 ip-10-0-136-9 kubenswrapper[2584]: I0714 05:05:06.258827 2584 generic.go:356] "Generic (PLEG): container finished" podID="d09957f3-0d46-4fd6-b16e-d9cdabc8640c" containerID="8773cfa8202c1657708954144cfbb4a2f0cffa53232e59def477acbe51aee7b6" exitCode=0 Jul 14 05:05:06.258916 ip-10-0-136-9 kubenswrapper[2584]: I0714 05:05:06.258878 2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-6d474f5bbf-9zx9p" event={"ID":"d09957f3-0d46-4fd6-b16e-d9cdabc8640c","Type":"ContainerDied","Data":"8773cfa8202c1657708954144cfbb4a2f0cffa53232e59def477acbe51aee7b6"} Jul 14 05:05:07.265845 ip-10-0-136-9 kubenswrapper[2584]: I0714 05:05:07.265807 2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-6d474f5bbf-9zx9p" event={"ID":"d09957f3-0d46-4fd6-b16e-d9cdabc8640c","Type":"ContainerStarted","Data":"1f5a0ffadd872c2a2756f3bb36e02edf278d2af2d29acbbd577cdeeee5ddf9bf"} Jul 14 05:05:07.266268 ip-10-0-136-9 kubenswrapper[2584]: I0714 05:05:07.265910 2584 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/opendatahub-operator-controller-manager-6d474f5bbf-9zx9p" Jul 14 05:05:07.287871 ip-10-0-136-9 kubenswrapper[2584]: I0714 05:05:07.287829 2584 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/opendatahub-operator-controller-manager-6d474f5bbf-9zx9p" podStartSLOduration=2.420892151 podStartE2EDuration="7.287815204s" totalImagesPullingTime="3.863740685s" totalInitContainerRuntime="1.003182368s" isStatefulPod=false podCreationTimestamp="2026-07-14 05:05:00 +0000 UTC" imagePullSessionsCount=2 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-14 05:05:07.285990701 +0000 UTC m=+368.247246405" watchObservedRunningTime="2026-07-14 05:05:07.287815204 +0000 UTC m=+368.249070908" Jul 14 05:05:12.429952 ip-10-0-136-9 kubenswrapper[2584]: I0714 05:05:12.429898 2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-g257n_15609856-4056-487b-acdd-30276263b098/konnectivity-agent/0.log" limit=1024 Jul 14 05:05:12.532968 ip-10-0-136-9 kubenswrapper[2584]: I0714 05:05:12.532913 2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-g257n_15609856-4056-487b-acdd-30276263b098/konnectivity-agent/0.log" limit=1024 Jul 14 05:05:18.272759 ip-10-0-136-9 kubenswrapper[2584]: I0714 05:05:18.272723 2584 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/opendatahub-operator-controller-manager-6d474f5bbf-9zx9p" Jul 14 05:05:20.358146 ip-10-0-136-9 kubenswrapper[2584]: I0714 05:05:20.358100 2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-g257n_15609856-4056-487b-acdd-30276263b098/konnectivity-agent/0.log" limit=1024 Jul 14 05:05:20.468907 ip-10-0-136-9 kubenswrapper[2584]: I0714 05:05:20.468865 2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-g257n_15609856-4056-487b-acdd-30276263b098/konnectivity-agent/0.log" limit=1024 Jul 14 05:05:20.633974 ip-10-0-136-9 kubenswrapper[2584]: I0714 05:05:20.633848 2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-g257n_15609856-4056-487b-acdd-30276263b098/konnectivity-agent/0.log" limit=1024 Jul 14 05:05:20.778214 ip-10-0-136-9 kubenswrapper[2584]: I0714 05:05:20.778180 2584 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/kube-auth-proxy-5d4dd7888d-x64pt"] Jul 14 05:05:20.788987 ip-10-0-136-9 kubenswrapper[2584]: I0714 05:05:20.788960 2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/kube-auth-proxy-5d4dd7888d-x64pt" Jul 14 05:05:20.791996 ip-10-0-136-9 kubenswrapper[2584]: I0714 05:05:20.791969 2584 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/kube-auth-proxy-5d4dd7888d-x64pt"] Jul 14 05:05:20.793448 ip-10-0-136-9 kubenswrapper[2584]: I0714 05:05:20.793425 2584 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"kube-auth-proxy-dockercfg-mpprc\"" Jul 14 05:05:20.793678 ip-10-0-136-9 kubenswrapper[2584]: I0714 05:05:20.793659 2584 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"kube-auth-proxy-tls\"" Jul 14 05:05:20.793842 ip-10-0-136-9 kubenswrapper[2584]: I0714 05:05:20.793827 2584 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"kube-auth-proxy-creds\"" Jul 14 05:05:20.968857 ip-10-0-136-9 kubenswrapper[2584]: I0714 05:05:20.968757 2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-w8mdk\" (UniqueName: \"kubernetes.io/projected/018b10c5-775d-4180-9f5c-3454b7cab921-kube-api-access-w8mdk\") pod \"kube-auth-proxy-5d4dd7888d-x64pt\" (UID: \"018b10c5-775d-4180-9f5c-3454b7cab921\") " pod="openshift-ingress/kube-auth-proxy-5d4dd7888d-x64pt" Jul 14 05:05:20.969036 ip-10-0-136-9 kubenswrapper[2584]: I0714 05:05:20.968877 2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/018b10c5-775d-4180-9f5c-3454b7cab921-tls-certs\") pod \"kube-auth-proxy-5d4dd7888d-x64pt\" (UID: \"018b10c5-775d-4180-9f5c-3454b7cab921\") " pod="openshift-ingress/kube-auth-proxy-5d4dd7888d-x64pt" Jul 14 05:05:20.969036 ip-10-0-136-9 kubenswrapper[2584]: I0714 05:05:20.968968 2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/018b10c5-775d-4180-9f5c-3454b7cab921-tmp\") pod \"kube-auth-proxy-5d4dd7888d-x64pt\" (UID: \"018b10c5-775d-4180-9f5c-3454b7cab921\") " pod="openshift-ingress/kube-auth-proxy-5d4dd7888d-x64pt" Jul 14 05:05:21.010660 ip-10-0-136-9 kubenswrapper[2584]: I0714 05:05:21.010620 2584 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/odh-model-controller-7998c67dc4-7bhln"] Jul 14 05:05:21.014555 ip-10-0-136-9 kubenswrapper[2584]: I0714 05:05:21.014526 2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/odh-model-controller-7998c67dc4-7bhln" Jul 14 05:05:21.017464 ip-10-0-136-9 kubenswrapper[2584]: I0714 05:05:21.017440 2584 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"odh-model-controller-dockercfg-xd2x9\"" Jul 14 05:05:21.017689 ip-10-0-136-9 kubenswrapper[2584]: I0714 05:05:21.017657 2584 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"odh-model-controller-webhook-cert\"" Jul 14 05:05:21.025590 ip-10-0-136-9 kubenswrapper[2584]: I0714 05:05:21.025556 2584 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/odh-model-controller-7998c67dc4-7bhln"] Jul 14 05:05:21.053802 ip-10-0-136-9 kubenswrapper[2584]: I0714 05:05:21.053759 2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-g257n_15609856-4056-487b-acdd-30276263b098/konnectivity-agent/0.log" limit=1024 Jul 14 05:05:21.069796 ip-10-0-136-9 kubenswrapper[2584]: I0714 05:05:21.069758 2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/018b10c5-775d-4180-9f5c-3454b7cab921-tls-certs\") pod \"kube-auth-proxy-5d4dd7888d-x64pt\" (UID: \"018b10c5-775d-4180-9f5c-3454b7cab921\") " pod="openshift-ingress/kube-auth-proxy-5d4dd7888d-x64pt" Jul 14 05:05:21.069985 ip-10-0-136-9 kubenswrapper[2584]: I0714 05:05:21.069802 2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/018b10c5-775d-4180-9f5c-3454b7cab921-tmp\") pod \"kube-auth-proxy-5d4dd7888d-x64pt\" (UID: \"018b10c5-775d-4180-9f5c-3454b7cab921\") " pod="openshift-ingress/kube-auth-proxy-5d4dd7888d-x64pt" Jul 14 05:05:21.069985 ip-10-0-136-9 kubenswrapper[2584]: I0714 05:05:21.069841 2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-w8mdk\" (UniqueName: \"kubernetes.io/projected/018b10c5-775d-4180-9f5c-3454b7cab921-kube-api-access-w8mdk\") pod \"kube-auth-proxy-5d4dd7888d-x64pt\" (UID: \"018b10c5-775d-4180-9f5c-3454b7cab921\") " pod="openshift-ingress/kube-auth-proxy-5d4dd7888d-x64pt" Jul 14 05:05:21.069985 ip-10-0-136-9 kubenswrapper[2584]: E0714 05:05:21.069916 2584 secret.go:189] Couldn't get secret openshift-ingress/kube-auth-proxy-tls: secret "kube-auth-proxy-tls" not found Jul 14 05:05:21.070137 ip-10-0-136-9 kubenswrapper[2584]: E0714 05:05:21.070013 2584 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/018b10c5-775d-4180-9f5c-3454b7cab921-tls-certs podName:018b10c5-775d-4180-9f5c-3454b7cab921 nodeName:}" failed. No retries permitted until 2026-07-14 05:05:21.569996514 +0000 UTC m=+382.531252202 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "tls-certs" (UniqueName: "kubernetes.io/secret/018b10c5-775d-4180-9f5c-3454b7cab921-tls-certs") pod "kube-auth-proxy-5d4dd7888d-x64pt" (UID: "018b10c5-775d-4180-9f5c-3454b7cab921") : secret "kube-auth-proxy-tls" not found Jul 14 05:05:21.072087 ip-10-0-136-9 kubenswrapper[2584]: I0714 05:05:21.072063 2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/018b10c5-775d-4180-9f5c-3454b7cab921-tmp\") pod \"kube-auth-proxy-5d4dd7888d-x64pt\" (UID: \"018b10c5-775d-4180-9f5c-3454b7cab921\") " pod="openshift-ingress/kube-auth-proxy-5d4dd7888d-x64pt" Jul 14 05:05:21.079252 ip-10-0-136-9 kubenswrapper[2584]: I0714 05:05:21.079225 2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-w8mdk\" (UniqueName: \"kubernetes.io/projected/018b10c5-775d-4180-9f5c-3454b7cab921-kube-api-access-w8mdk\") pod \"kube-auth-proxy-5d4dd7888d-x64pt\" (UID: \"018b10c5-775d-4180-9f5c-3454b7cab921\") " pod="openshift-ingress/kube-auth-proxy-5d4dd7888d-x64pt" Jul 14 05:05:21.155246 ip-10-0-136-9 kubenswrapper[2584]: I0714 05:05:21.155210 2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-g257n_15609856-4056-487b-acdd-30276263b098/konnectivity-agent/0.log" limit=1024 Jul 14 05:05:21.170611 ip-10-0-136-9 kubenswrapper[2584]: I0714 05:05:21.170580 2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-7m9fq\" (UniqueName: \"kubernetes.io/projected/5d457cd7-f48e-45c0-9d4f-d8a7369aa39c-kube-api-access-7m9fq\") pod \"odh-model-controller-7998c67dc4-7bhln\" (UID: \"5d457cd7-f48e-45c0-9d4f-d8a7369aa39c\") " pod="opendatahub/odh-model-controller-7998c67dc4-7bhln" Jul 14 05:05:21.170790 ip-10-0-136-9 kubenswrapper[2584]: I0714 05:05:21.170713 2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/5d457cd7-f48e-45c0-9d4f-d8a7369aa39c-cert\") pod \"odh-model-controller-7998c67dc4-7bhln\" (UID: \"5d457cd7-f48e-45c0-9d4f-d8a7369aa39c\") " pod="opendatahub/odh-model-controller-7998c67dc4-7bhln" Jul 14 05:05:21.264575 ip-10-0-136-9 kubenswrapper[2584]: I0714 05:05:21.264489 2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-g257n_15609856-4056-487b-acdd-30276263b098/konnectivity-agent/0.log" limit=1024 Jul 14 05:05:21.271609 ip-10-0-136-9 kubenswrapper[2584]: I0714 05:05:21.271578 2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-7m9fq\" (UniqueName: \"kubernetes.io/projected/5d457cd7-f48e-45c0-9d4f-d8a7369aa39c-kube-api-access-7m9fq\") pod \"odh-model-controller-7998c67dc4-7bhln\" (UID: \"5d457cd7-f48e-45c0-9d4f-d8a7369aa39c\") " pod="opendatahub/odh-model-controller-7998c67dc4-7bhln" Jul 14 05:05:21.271757 ip-10-0-136-9 kubenswrapper[2584]: I0714 05:05:21.271708 2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/5d457cd7-f48e-45c0-9d4f-d8a7369aa39c-cert\") pod \"odh-model-controller-7998c67dc4-7bhln\" (UID: \"5d457cd7-f48e-45c0-9d4f-d8a7369aa39c\") " pod="opendatahub/odh-model-controller-7998c67dc4-7bhln" Jul 14 05:05:21.271851 ip-10-0-136-9 kubenswrapper[2584]: E0714 05:05:21.271825 2584 secret.go:189] Couldn't get secret opendatahub/odh-model-controller-webhook-cert: secret "odh-model-controller-webhook-cert" not found Jul 14 05:05:21.271983 ip-10-0-136-9 kubenswrapper[2584]: E0714 05:05:21.271894 2584 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/5d457cd7-f48e-45c0-9d4f-d8a7369aa39c-cert podName:5d457cd7-f48e-45c0-9d4f-d8a7369aa39c nodeName:}" failed. No retries permitted until 2026-07-14 05:05:21.771877814 +0000 UTC m=+382.733133498 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "cert" (UniqueName: "kubernetes.io/secret/5d457cd7-f48e-45c0-9d4f-d8a7369aa39c-cert") pod "odh-model-controller-7998c67dc4-7bhln" (UID: "5d457cd7-f48e-45c0-9d4f-d8a7369aa39c") : secret "odh-model-controller-webhook-cert" not found Jul 14 05:05:21.281558 ip-10-0-136-9 kubenswrapper[2584]: I0714 05:05:21.281529 2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-7m9fq\" (UniqueName: \"kubernetes.io/projected/5d457cd7-f48e-45c0-9d4f-d8a7369aa39c-kube-api-access-7m9fq\") pod \"odh-model-controller-7998c67dc4-7bhln\" (UID: \"5d457cd7-f48e-45c0-9d4f-d8a7369aa39c\") " pod="opendatahub/odh-model-controller-7998c67dc4-7bhln" Jul 14 05:05:21.393984 ip-10-0-136-9 kubenswrapper[2584]: I0714 05:05:21.393925 2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-g257n_15609856-4056-487b-acdd-30276263b098/konnectivity-agent/0.log" limit=1024 Jul 14 05:05:21.573994 ip-10-0-136-9 kubenswrapper[2584]: I0714 05:05:21.573886 2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/018b10c5-775d-4180-9f5c-3454b7cab921-tls-certs\") pod \"kube-auth-proxy-5d4dd7888d-x64pt\" (UID: \"018b10c5-775d-4180-9f5c-3454b7cab921\") " pod="openshift-ingress/kube-auth-proxy-5d4dd7888d-x64pt" Jul 14 05:05:21.576538 ip-10-0-136-9 kubenswrapper[2584]: I0714 05:05:21.576502 2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/018b10c5-775d-4180-9f5c-3454b7cab921-tls-certs\") pod \"kube-auth-proxy-5d4dd7888d-x64pt\" (UID: \"018b10c5-775d-4180-9f5c-3454b7cab921\") " pod="openshift-ingress/kube-auth-proxy-5d4dd7888d-x64pt" Jul 14 05:05:21.702427 ip-10-0-136-9 kubenswrapper[2584]: I0714 05:05:21.702392 2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/kube-auth-proxy-5d4dd7888d-x64pt" Jul 14 05:05:21.740955 ip-10-0-136-9 kubenswrapper[2584]: I0714 05:05:21.740914 2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-g257n_15609856-4056-487b-acdd-30276263b098/konnectivity-agent/0.log" limit=1024 Jul 14 05:05:21.775089 ip-10-0-136-9 kubenswrapper[2584]: I0714 05:05:21.774987 2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/5d457cd7-f48e-45c0-9d4f-d8a7369aa39c-cert\") pod \"odh-model-controller-7998c67dc4-7bhln\" (UID: \"5d457cd7-f48e-45c0-9d4f-d8a7369aa39c\") " pod="opendatahub/odh-model-controller-7998c67dc4-7bhln" Jul 14 05:05:21.779978 ip-10-0-136-9 kubenswrapper[2584]: I0714 05:05:21.778135 2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/5d457cd7-f48e-45c0-9d4f-d8a7369aa39c-cert\") pod \"odh-model-controller-7998c67dc4-7bhln\" (UID: \"5d457cd7-f48e-45c0-9d4f-d8a7369aa39c\") " pod="opendatahub/odh-model-controller-7998c67dc4-7bhln" Jul 14 05:05:21.846024 ip-10-0-136-9 kubenswrapper[2584]: I0714 05:05:21.845984 2584 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/kube-auth-proxy-5d4dd7888d-x64pt"] Jul 14 05:05:21.848393 ip-10-0-136-9 kubenswrapper[2584]: W0714 05:05:21.848361 2584 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod018b10c5_775d_4180_9f5c_3454b7cab921.slice/crio-0f59ea8f1385313bf88cf19292e3a7f9280fb0923f6a7c00f5b143e3727bdb7b WatchSource:0}: Error finding container 0f59ea8f1385313bf88cf19292e3a7f9280fb0923f6a7c00f5b143e3727bdb7b: Status 404 returned error can't find the container with id 0f59ea8f1385313bf88cf19292e3a7f9280fb0923f6a7c00f5b143e3727bdb7b Jul 14 05:05:21.875891 ip-10-0-136-9 kubenswrapper[2584]: I0714 05:05:21.875861 2584 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/model-serving-api-54d89bd5fc-fcl6g"] Jul 14 05:05:21.880083 ip-10-0-136-9 kubenswrapper[2584]: I0714 05:05:21.880065 2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/model-serving-api-54d89bd5fc-fcl6g" Jul 14 05:05:21.883244 ip-10-0-136-9 kubenswrapper[2584]: I0714 05:05:21.883227 2584 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"model-serving-api-tls\"" Jul 14 05:05:21.891891 ip-10-0-136-9 kubenswrapper[2584]: I0714 05:05:21.891867 2584 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/model-serving-api-54d89bd5fc-fcl6g"] Jul 14 05:05:21.896816 ip-10-0-136-9 kubenswrapper[2584]: I0714 05:05:21.896790 2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-g257n_15609856-4056-487b-acdd-30276263b098/konnectivity-agent/0.log" limit=1024 Jul 14 05:05:21.926818 ip-10-0-136-9 kubenswrapper[2584]: I0714 05:05:21.926780 2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/odh-model-controller-7998c67dc4-7bhln" Jul 14 05:05:21.976770 ip-10-0-136-9 kubenswrapper[2584]: I0714 05:05:21.976735 2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-xfr87\" (UniqueName: \"kubernetes.io/projected/678abb7d-9394-4cf0-811c-16ec0ed3e414-kube-api-access-xfr87\") pod \"model-serving-api-54d89bd5fc-fcl6g\" (UID: \"678abb7d-9394-4cf0-811c-16ec0ed3e414\") " pod="opendatahub/model-serving-api-54d89bd5fc-fcl6g" Jul 14 05:05:21.976988 ip-10-0-136-9 kubenswrapper[2584]: I0714 05:05:21.976957 2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-g257n_15609856-4056-487b-acdd-30276263b098/konnectivity-agent/0.log" limit=1024 Jul 14 05:05:21.977120 ip-10-0-136-9 kubenswrapper[2584]: I0714 05:05:21.977097 2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/678abb7d-9394-4cf0-811c-16ec0ed3e414-tls-certs\") pod \"model-serving-api-54d89bd5fc-fcl6g\" (UID: \"678abb7d-9394-4cf0-811c-16ec0ed3e414\") " pod="opendatahub/model-serving-api-54d89bd5fc-fcl6g" Jul 14 05:05:22.063783 ip-10-0-136-9 kubenswrapper[2584]: I0714 05:05:22.063760 2584 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/odh-model-controller-7998c67dc4-7bhln"] Jul 14 05:05:22.065460 ip-10-0-136-9 kubenswrapper[2584]: W0714 05:05:22.065436 2584 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod5d457cd7_f48e_45c0_9d4f_d8a7369aa39c.slice/crio-67d272a6843a218b327f1d24c0727dce0e2a6934e135321aa91f62dee65e7176 WatchSource:0}: Error finding container 67d272a6843a218b327f1d24c0727dce0e2a6934e135321aa91f62dee65e7176: Status 404 returned error can't find the container with id 67d272a6843a218b327f1d24c0727dce0e2a6934e135321aa91f62dee65e7176 Jul 14 05:05:22.078115 ip-10-0-136-9 kubenswrapper[2584]: I0714 05:05:22.078081 2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-xfr87\" (UniqueName: \"kubernetes.io/projected/678abb7d-9394-4cf0-811c-16ec0ed3e414-kube-api-access-xfr87\") pod \"model-serving-api-54d89bd5fc-fcl6g\" (UID: \"678abb7d-9394-4cf0-811c-16ec0ed3e414\") " pod="opendatahub/model-serving-api-54d89bd5fc-fcl6g" Jul 14 05:05:22.078236 ip-10-0-136-9 kubenswrapper[2584]: I0714 05:05:22.078134 2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/678abb7d-9394-4cf0-811c-16ec0ed3e414-tls-certs\") pod \"model-serving-api-54d89bd5fc-fcl6g\" (UID: \"678abb7d-9394-4cf0-811c-16ec0ed3e414\") " pod="opendatahub/model-serving-api-54d89bd5fc-fcl6g" Jul 14 05:05:22.080470 ip-10-0-136-9 kubenswrapper[2584]: I0714 05:05:22.080448 2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/678abb7d-9394-4cf0-811c-16ec0ed3e414-tls-certs\") pod \"model-serving-api-54d89bd5fc-fcl6g\" (UID: \"678abb7d-9394-4cf0-811c-16ec0ed3e414\") " pod="opendatahub/model-serving-api-54d89bd5fc-fcl6g" Jul 14 05:05:22.087805 ip-10-0-136-9 kubenswrapper[2584]: I0714 05:05:22.087778 2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-xfr87\" (UniqueName: \"kubernetes.io/projected/678abb7d-9394-4cf0-811c-16ec0ed3e414-kube-api-access-xfr87\") pod \"model-serving-api-54d89bd5fc-fcl6g\" (UID: \"678abb7d-9394-4cf0-811c-16ec0ed3e414\") " pod="opendatahub/model-serving-api-54d89bd5fc-fcl6g" Jul 14 05:05:22.134691 ip-10-0-136-9 kubenswrapper[2584]: I0714 05:05:22.134614 2584 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/istiod-openshift-gateway-7574459656-tfrls"] Jul 14 05:05:22.139193 ip-10-0-136-9 kubenswrapper[2584]: I0714 05:05:22.139158 2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-g257n_15609856-4056-487b-acdd-30276263b098/konnectivity-agent/0.log" limit=1024 Jul 14 05:05:22.139462 ip-10-0-136-9 kubenswrapper[2584]: I0714 05:05:22.139443 2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/istiod-openshift-gateway-7574459656-tfrls" Jul 14 05:05:22.142355 ip-10-0-136-9 kubenswrapper[2584]: I0714 05:05:22.142336 2584 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"cacerts\"" Jul 14 05:05:22.142355 ip-10-0-136-9 kubenswrapper[2584]: I0714 05:05:22.142346 2584 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"istiod-openshift-gateway-dockercfg-cs82r\"" Jul 14 05:05:22.142543 ip-10-0-136-9 kubenswrapper[2584]: I0714 05:05:22.142341 2584 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"openshift-gw-ca-root-cert\"" Jul 14 05:05:22.142543 ip-10-0-136-9 kubenswrapper[2584]: I0714 05:05:22.142341 2584 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"istio-kubeconfig\"" Jul 14 05:05:22.142675 ip-10-0-136-9 kubenswrapper[2584]: I0714 05:05:22.142586 2584 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"istiod-tls\"" Jul 14 05:05:22.149923 ip-10-0-136-9 kubenswrapper[2584]: I0714 05:05:22.149899 2584 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/istiod-openshift-gateway-7574459656-tfrls"] Jul 14 05:05:22.190985 ip-10-0-136-9 kubenswrapper[2584]: I0714 05:05:22.190946 2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/model-serving-api-54d89bd5fc-fcl6g" Jul 14 05:05:22.209264 ip-10-0-136-9 kubenswrapper[2584]: I0714 05:05:22.209132 2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-g257n_15609856-4056-487b-acdd-30276263b098/konnectivity-agent/0.log" limit=1024 Jul 14 05:05:22.279730 ip-10-0-136-9 kubenswrapper[2584]: I0714 05:05:22.279600 2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-tvvn8\" (UniqueName: \"kubernetes.io/projected/99f63af2-f5ca-47bb-9389-500895646d8c-kube-api-access-tvvn8\") pod \"istiod-openshift-gateway-7574459656-tfrls\" (UID: \"99f63af2-f5ca-47bb-9389-500895646d8c\") " pod="openshift-ingress/istiod-openshift-gateway-7574459656-tfrls" Jul 14 05:05:22.279848 ip-10-0-136-9 kubenswrapper[2584]: I0714 05:05:22.279738 2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-csr-dns-cert\" (UniqueName: \"kubernetes.io/secret/99f63af2-f5ca-47bb-9389-500895646d8c-istio-csr-dns-cert\") pod \"istiod-openshift-gateway-7574459656-tfrls\" (UID: \"99f63af2-f5ca-47bb-9389-500895646d8c\") " pod="openshift-ingress/istiod-openshift-gateway-7574459656-tfrls" Jul 14 05:05:22.279848 ip-10-0-136-9 kubenswrapper[2584]: I0714 05:05:22.279798 2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-csr-ca-configmap\" (UniqueName: \"kubernetes.io/configmap/99f63af2-f5ca-47bb-9389-500895646d8c-istio-csr-ca-configmap\") pod \"istiod-openshift-gateway-7574459656-tfrls\" (UID: \"99f63af2-f5ca-47bb-9389-500895646d8c\") " pod="openshift-ingress/istiod-openshift-gateway-7574459656-tfrls" Jul 14 05:05:22.279990 ip-10-0-136-9 kubenswrapper[2584]: I0714 05:05:22.279849 2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"local-certs\" (UniqueName: \"kubernetes.io/empty-dir/99f63af2-f5ca-47bb-9389-500895646d8c-local-certs\") pod \"istiod-openshift-gateway-7574459656-tfrls\" (UID: \"99f63af2-f5ca-47bb-9389-500895646d8c\") " pod="openshift-ingress/istiod-openshift-gateway-7574459656-tfrls" Jul 14 05:05:22.279990 ip-10-0-136-9 kubenswrapper[2584]: I0714 05:05:22.279879 2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-kubeconfig\" (UniqueName: \"kubernetes.io/secret/99f63af2-f5ca-47bb-9389-500895646d8c-istio-kubeconfig\") pod \"istiod-openshift-gateway-7574459656-tfrls\" (UID: \"99f63af2-f5ca-47bb-9389-500895646d8c\") " pod="openshift-ingress/istiod-openshift-gateway-7574459656-tfrls" Jul 14 05:05:22.279990 ip-10-0-136-9 kubenswrapper[2584]: I0714 05:05:22.279963 2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cacerts\" (UniqueName: \"kubernetes.io/secret/99f63af2-f5ca-47bb-9389-500895646d8c-cacerts\") pod \"istiod-openshift-gateway-7574459656-tfrls\" (UID: \"99f63af2-f5ca-47bb-9389-500895646d8c\") " pod="openshift-ingress/istiod-openshift-gateway-7574459656-tfrls" Jul 14 05:05:22.280134 ip-10-0-136-9 kubenswrapper[2584]: I0714 05:05:22.279999 2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/99f63af2-f5ca-47bb-9389-500895646d8c-istio-token\") pod \"istiod-openshift-gateway-7574459656-tfrls\" (UID: \"99f63af2-f5ca-47bb-9389-500895646d8c\") " pod="openshift-ingress/istiod-openshift-gateway-7574459656-tfrls" Jul 14 05:05:22.330313 ip-10-0-136-9 kubenswrapper[2584]: I0714 05:05:22.330221 2584 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/model-serving-api-54d89bd5fc-fcl6g"] Jul 14 05:05:22.330918 ip-10-0-136-9 kubenswrapper[2584]: I0714 05:05:22.330893 2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/odh-model-controller-7998c67dc4-7bhln" event={"ID":"5d457cd7-f48e-45c0-9d4f-d8a7369aa39c","Type":"ContainerStarted","Data":"67d272a6843a218b327f1d24c0727dce0e2a6934e135321aa91f62dee65e7176"} Jul 14 05:05:22.332201 ip-10-0-136-9 kubenswrapper[2584]: I0714 05:05:22.332177 2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/kube-auth-proxy-5d4dd7888d-x64pt" event={"ID":"018b10c5-775d-4180-9f5c-3454b7cab921","Type":"ContainerStarted","Data":"0f59ea8f1385313bf88cf19292e3a7f9280fb0923f6a7c00f5b143e3727bdb7b"} Jul 14 05:05:22.333532 ip-10-0-136-9 kubenswrapper[2584]: W0714 05:05:22.333509 2584 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod678abb7d_9394_4cf0_811c_16ec0ed3e414.slice/crio-0dc200a53339103fff4687743ff9c94d5b9727c74ed960d880d53d3240c4b00e WatchSource:0}: Error finding container 0dc200a53339103fff4687743ff9c94d5b9727c74ed960d880d53d3240c4b00e: Status 404 returned error can't find the container with id 0dc200a53339103fff4687743ff9c94d5b9727c74ed960d880d53d3240c4b00e Jul 14 05:05:22.380964 ip-10-0-136-9 kubenswrapper[2584]: I0714 05:05:22.380915 2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cacerts\" (UniqueName: \"kubernetes.io/secret/99f63af2-f5ca-47bb-9389-500895646d8c-cacerts\") pod \"istiod-openshift-gateway-7574459656-tfrls\" (UID: \"99f63af2-f5ca-47bb-9389-500895646d8c\") " pod="openshift-ingress/istiod-openshift-gateway-7574459656-tfrls" Jul 14 05:05:22.381048 ip-10-0-136-9 kubenswrapper[2584]: I0714 05:05:22.380980 2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/99f63af2-f5ca-47bb-9389-500895646d8c-istio-token\") pod \"istiod-openshift-gateway-7574459656-tfrls\" (UID: \"99f63af2-f5ca-47bb-9389-500895646d8c\") " pod="openshift-ingress/istiod-openshift-gateway-7574459656-tfrls" Jul 14 05:05:22.381048 ip-10-0-136-9 kubenswrapper[2584]: I0714 05:05:22.381015 2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-tvvn8\" (UniqueName: \"kubernetes.io/projected/99f63af2-f5ca-47bb-9389-500895646d8c-kube-api-access-tvvn8\") pod \"istiod-openshift-gateway-7574459656-tfrls\" (UID: \"99f63af2-f5ca-47bb-9389-500895646d8c\") " pod="openshift-ingress/istiod-openshift-gateway-7574459656-tfrls" Jul 14 05:05:22.381137 ip-10-0-136-9 kubenswrapper[2584]: I0714 05:05:22.381060 2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-csr-dns-cert\" (UniqueName: \"kubernetes.io/secret/99f63af2-f5ca-47bb-9389-500895646d8c-istio-csr-dns-cert\") pod \"istiod-openshift-gateway-7574459656-tfrls\" (UID: \"99f63af2-f5ca-47bb-9389-500895646d8c\") " pod="openshift-ingress/istiod-openshift-gateway-7574459656-tfrls" Jul 14 05:05:22.381137 ip-10-0-136-9 kubenswrapper[2584]: I0714 05:05:22.381106 2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-csr-ca-configmap\" (UniqueName: \"kubernetes.io/configmap/99f63af2-f5ca-47bb-9389-500895646d8c-istio-csr-ca-configmap\") pod \"istiod-openshift-gateway-7574459656-tfrls\" (UID: \"99f63af2-f5ca-47bb-9389-500895646d8c\") " pod="openshift-ingress/istiod-openshift-gateway-7574459656-tfrls" Jul 14 05:05:22.381232 ip-10-0-136-9 kubenswrapper[2584]: I0714 05:05:22.381150 2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"local-certs\" (UniqueName: \"kubernetes.io/empty-dir/99f63af2-f5ca-47bb-9389-500895646d8c-local-certs\") pod \"istiod-openshift-gateway-7574459656-tfrls\" (UID: \"99f63af2-f5ca-47bb-9389-500895646d8c\") " pod="openshift-ingress/istiod-openshift-gateway-7574459656-tfrls" Jul 14 05:05:22.381232 ip-10-0-136-9 kubenswrapper[2584]: I0714 05:05:22.381177 2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-kubeconfig\" (UniqueName: \"kubernetes.io/secret/99f63af2-f5ca-47bb-9389-500895646d8c-istio-kubeconfig\") pod \"istiod-openshift-gateway-7574459656-tfrls\" (UID: \"99f63af2-f5ca-47bb-9389-500895646d8c\") " pod="openshift-ingress/istiod-openshift-gateway-7574459656-tfrls" Jul 14 05:05:22.381656 ip-10-0-136-9 kubenswrapper[2584]: I0714 05:05:22.381631 2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-csr-ca-configmap\" (UniqueName: \"kubernetes.io/configmap/99f63af2-f5ca-47bb-9389-500895646d8c-istio-csr-ca-configmap\") pod \"istiod-openshift-gateway-7574459656-tfrls\" (UID: \"99f63af2-f5ca-47bb-9389-500895646d8c\") " pod="openshift-ingress/istiod-openshift-gateway-7574459656-tfrls" Jul 14 05:05:22.383340 ip-10-0-136-9 kubenswrapper[2584]: I0714 05:05:22.383316 2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"local-certs\" (UniqueName: \"kubernetes.io/empty-dir/99f63af2-f5ca-47bb-9389-500895646d8c-local-certs\") pod \"istiod-openshift-gateway-7574459656-tfrls\" (UID: \"99f63af2-f5ca-47bb-9389-500895646d8c\") " pod="openshift-ingress/istiod-openshift-gateway-7574459656-tfrls" Jul 14 05:05:22.383417 ip-10-0-136-9 kubenswrapper[2584]: I0714 05:05:22.383341 2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-csr-dns-cert\" (UniqueName: \"kubernetes.io/secret/99f63af2-f5ca-47bb-9389-500895646d8c-istio-csr-dns-cert\") pod \"istiod-openshift-gateway-7574459656-tfrls\" (UID: \"99f63af2-f5ca-47bb-9389-500895646d8c\") " pod="openshift-ingress/istiod-openshift-gateway-7574459656-tfrls" Jul 14 05:05:22.383668 ip-10-0-136-9 kubenswrapper[2584]: I0714 05:05:22.383654 2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-kubeconfig\" (UniqueName: \"kubernetes.io/secret/99f63af2-f5ca-47bb-9389-500895646d8c-istio-kubeconfig\") pod \"istiod-openshift-gateway-7574459656-tfrls\" (UID: \"99f63af2-f5ca-47bb-9389-500895646d8c\") " pod="openshift-ingress/istiod-openshift-gateway-7574459656-tfrls" Jul 14 05:05:22.383732 ip-10-0-136-9 kubenswrapper[2584]: I0714 05:05:22.383716 2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cacerts\" (UniqueName: \"kubernetes.io/secret/99f63af2-f5ca-47bb-9389-500895646d8c-cacerts\") pod \"istiod-openshift-gateway-7574459656-tfrls\" (UID: \"99f63af2-f5ca-47bb-9389-500895646d8c\") " pod="openshift-ingress/istiod-openshift-gateway-7574459656-tfrls" Jul 14 05:05:22.404007 ip-10-0-136-9 kubenswrapper[2584]: I0714 05:05:22.403945 2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/99f63af2-f5ca-47bb-9389-500895646d8c-istio-token\") pod \"istiod-openshift-gateway-7574459656-tfrls\" (UID: \"99f63af2-f5ca-47bb-9389-500895646d8c\") " pod="openshift-ingress/istiod-openshift-gateway-7574459656-tfrls" Jul 14 05:05:22.404275 ip-10-0-136-9 kubenswrapper[2584]: I0714 05:05:22.404151 2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-tvvn8\" (UniqueName: \"kubernetes.io/projected/99f63af2-f5ca-47bb-9389-500895646d8c-kube-api-access-tvvn8\") pod \"istiod-openshift-gateway-7574459656-tfrls\" (UID: \"99f63af2-f5ca-47bb-9389-500895646d8c\") " pod="openshift-ingress/istiod-openshift-gateway-7574459656-tfrls" Jul 14 05:05:22.451068 ip-10-0-136-9 kubenswrapper[2584]: I0714 05:05:22.451032 2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/istiod-openshift-gateway-7574459656-tfrls" Jul 14 05:05:22.592414 ip-10-0-136-9 kubenswrapper[2584]: I0714 05:05:22.592387 2584 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/istiod-openshift-gateway-7574459656-tfrls"] Jul 14 05:05:22.594567 ip-10-0-136-9 kubenswrapper[2584]: W0714 05:05:22.594536 2584 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod99f63af2_f5ca_47bb_9389_500895646d8c.slice/crio-c484d61186471088e63525473c972c971ebaaf895305f9104a3388b06c9d4449 WatchSource:0}: Error finding container c484d61186471088e63525473c972c971ebaaf895305f9104a3388b06c9d4449: Status 404 returned error can't find the container with id c484d61186471088e63525473c972c971ebaaf895305f9104a3388b06c9d4449 Jul 14 05:05:23.113672 ip-10-0-136-9 kubenswrapper[2584]: I0714 05:05:23.113574 2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-g257n_15609856-4056-487b-acdd-30276263b098/konnectivity-agent/0.log" limit=1024 Jul 14 05:05:23.342091 ip-10-0-136-9 kubenswrapper[2584]: I0714 05:05:23.341983 2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/istiod-openshift-gateway-7574459656-tfrls" event={"ID":"99f63af2-f5ca-47bb-9389-500895646d8c","Type":"ContainerStarted","Data":"c484d61186471088e63525473c972c971ebaaf895305f9104a3388b06c9d4449"} Jul 14 05:05:23.343860 ip-10-0-136-9 kubenswrapper[2584]: I0714 05:05:23.343771 2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/model-serving-api-54d89bd5fc-fcl6g" event={"ID":"678abb7d-9394-4cf0-811c-16ec0ed3e414","Type":"ContainerStarted","Data":"0dc200a53339103fff4687743ff9c94d5b9727c74ed960d880d53d3240c4b00e"} Jul 14 05:05:27.524364 ip-10-0-136-9 kubenswrapper[2584]: I0714 05:05:27.524330 2584 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"} Jul 14 05:05:27.524754 ip-10-0-136-9 kubenswrapper[2584]: I0714 05:05:27.524410 2584 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"} Jul 14 05:05:28.206845 ip-10-0-136-9 kubenswrapper[2584]: I0714 05:05:28.206803 2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-g257n_15609856-4056-487b-acdd-30276263b098/konnectivity-agent/0.log" limit=1024 Jul 14 05:05:28.305729 ip-10-0-136-9 kubenswrapper[2584]: I0714 05:05:28.305698 2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-g257n_15609856-4056-487b-acdd-30276263b098/konnectivity-agent/0.log" limit=1024 Jul 14 05:05:28.374274 ip-10-0-136-9 kubenswrapper[2584]: I0714 05:05:28.374233 2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/istiod-openshift-gateway-7574459656-tfrls" event={"ID":"99f63af2-f5ca-47bb-9389-500895646d8c","Type":"ContainerStarted","Data":"b1456ac293dd309c84799e017c2e4d76b4c7fc6695e537b0575855630711c5dd"} Jul 14 05:05:28.374463 ip-10-0-136-9 kubenswrapper[2584]: I0714 05:05:28.374428 2584 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/istiod-openshift-gateway-7574459656-tfrls" Jul 14 05:05:28.375955 ip-10-0-136-9 kubenswrapper[2584]: I0714 05:05:28.375912 2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/odh-model-controller-7998c67dc4-7bhln" event={"ID":"5d457cd7-f48e-45c0-9d4f-d8a7369aa39c","Type":"ContainerStarted","Data":"9fb6e2911845f40031c59fda871c43d06694327d2e3575ca5bb88325216d0a22"} Jul 14 05:05:28.376074 ip-10-0-136-9 kubenswrapper[2584]: I0714 05:05:28.376048 2584 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/odh-model-controller-7998c67dc4-7bhln" Jul 14 05:05:28.376140 ip-10-0-136-9 kubenswrapper[2584]: I0714 05:05:28.376078 2584 patch_prober.go:28] interesting pod/istiod-openshift-gateway-7574459656-tfrls container/discovery namespace/openshift-ingress: Readiness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body= Jul 14 05:05:28.376140 ip-10-0-136-9 kubenswrapper[2584]: I0714 05:05:28.376118 2584 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/istiod-openshift-gateway-7574459656-tfrls" podUID="99f63af2-f5ca-47bb-9389-500895646d8c" containerName="discovery" probeResult="failure" output="HTTP probe failed with statuscode: 503" Jul 14 05:05:28.377414 ip-10-0-136-9 kubenswrapper[2584]: I0714 05:05:28.377393 2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/kube-auth-proxy-5d4dd7888d-x64pt" event={"ID":"018b10c5-775d-4180-9f5c-3454b7cab921","Type":"ContainerStarted","Data":"c92a37c368c956e9614014fb27af404d6ca63dfc96c0986cff76eefebb998455"} Jul 14 05:05:28.378785 ip-10-0-136-9 kubenswrapper[2584]: I0714 05:05:28.378768 2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/model-serving-api-54d89bd5fc-fcl6g" event={"ID":"678abb7d-9394-4cf0-811c-16ec0ed3e414","Type":"ContainerStarted","Data":"8ef191687a5bcf805120443119d1935d85451564a386b18571e014dcd29ab1db"} Jul 14 05:05:28.378860 ip-10-0-136-9 kubenswrapper[2584]: I0714 05:05:28.378808 2584 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/model-serving-api-54d89bd5fc-fcl6g" Jul 14 05:05:28.410730 ip-10-0-136-9 kubenswrapper[2584]: I0714 05:05:28.410685 2584 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/istiod-openshift-gateway-7574459656-tfrls" podStartSLOduration=1.48313394 podStartE2EDuration="6.410671325s" totalImagesPullingTime="4.927537385s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-14 05:05:22 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-14 05:05:28.407977058 +0000 UTC m=+389.369232754" watchObservedRunningTime="2026-07-14 05:05:28.410671325 +0000 UTC m=+389.371927029" Jul 14 05:05:28.437351 ip-10-0-136-9 kubenswrapper[2584]: I0714 05:05:28.437306 2584 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/model-serving-api-54d89bd5fc-fcl6g" podStartSLOduration=2.251442573 podStartE2EDuration="7.437292505s" totalImagesPullingTime="5.185849932s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-14 05:05:21 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-14 05:05:28.436228424 +0000 UTC m=+389.397484128" watchObservedRunningTime="2026-07-14 05:05:28.437292505 +0000 UTC m=+389.398548210" Jul 14 05:05:28.466171 ip-10-0-136-9 kubenswrapper[2584]: I0714 05:05:28.466080 2584 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/odh-model-controller-7998c67dc4-7bhln" podStartSLOduration=2.999546505 podStartE2EDuration="8.466065249s" totalImagesPullingTime="5.466518744s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-14 05:05:20 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-14 05:05:28.46448996 +0000 UTC m=+389.425745666" watchObservedRunningTime="2026-07-14 05:05:28.466065249 +0000 UTC m=+389.427320932" Jul 14 05:05:28.487777 ip-10-0-136-9 kubenswrapper[2584]: I0714 05:05:28.487724 2584 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/kube-auth-proxy-5d4dd7888d-x64pt" podStartSLOduration=2.807118822 podStartE2EDuration="8.487709643s" totalImagesPullingTime="5.680590821s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-14 05:05:20 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-14 05:05:28.486449643 +0000 UTC m=+389.447705350" watchObservedRunningTime="2026-07-14 05:05:28.487709643 +0000 UTC m=+389.448965349" Jul 14 05:05:28.936221 ip-10-0-136-9 kubenswrapper[2584]: I0714 05:05:28.936170 2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-g257n_15609856-4056-487b-acdd-30276263b098/konnectivity-agent/0.log" limit=1024 Jul 14 05:05:29.139321 ip-10-0-136-9 kubenswrapper[2584]: I0714 05:05:29.139281 2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-g257n_15609856-4056-487b-acdd-30276263b098/konnectivity-agent/0.log" limit=1024 Jul 14 05:05:29.233141 ip-10-0-136-9 kubenswrapper[2584]: I0714 05:05:29.233057 2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-g257n_15609856-4056-487b-acdd-30276263b098/konnectivity-agent/0.log" limit=1024 Jul 14 05:05:29.384750 ip-10-0-136-9 kubenswrapper[2584]: I0714 05:05:29.384725 2584 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/istiod-openshift-gateway-7574459656-tfrls" Jul 14 05:05:32.141912 ip-10-0-136-9 kubenswrapper[2584]: I0714 05:05:32.141854 2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-g257n_15609856-4056-487b-acdd-30276263b098/konnectivity-agent/0.log" limit=1024 Jul 14 05:05:32.199332 ip-10-0-136-9 kubenswrapper[2584]: I0714 05:05:32.199301 2584 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/llmisvc-controller-manager-777c6bd7d5-t96wm"] Jul 14 05:05:32.203608 ip-10-0-136-9 kubenswrapper[2584]: I0714 05:05:32.203577 2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-t96wm" Jul 14 05:05:32.206677 ip-10-0-136-9 kubenswrapper[2584]: I0714 05:05:32.206607 2584 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"llmisvc-webhook-server-cert\"" Jul 14 05:05:32.206848 ip-10-0-136-9 kubenswrapper[2584]: I0714 05:05:32.206827 2584 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"llmisvc-controller-manager-dockercfg-v5ldh\"" Jul 14 05:05:32.215956 ip-10-0-136-9 kubenswrapper[2584]: I0714 05:05:32.215913 2584 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/llmisvc-controller-manager-777c6bd7d5-t96wm"] Jul 14 05:05:32.257899 ip-10-0-136-9 kubenswrapper[2584]: I0714 05:05:32.257861 2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-g257n_15609856-4056-487b-acdd-30276263b098/konnectivity-agent/0.log" limit=1024 Jul 14 05:05:32.269130 ip-10-0-136-9 kubenswrapper[2584]: I0714 05:05:32.269100 2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-szc5x\" (UniqueName: \"kubernetes.io/projected/92403f10-2422-42d9-8a95-2e103c37b148-kube-api-access-szc5x\") pod \"llmisvc-controller-manager-777c6bd7d5-t96wm\" (UID: \"92403f10-2422-42d9-8a95-2e103c37b148\") " pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-t96wm" Jul 14 05:05:32.269130 ip-10-0-136-9 kubenswrapper[2584]: I0714 05:05:32.269133 2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/92403f10-2422-42d9-8a95-2e103c37b148-cert\") pod \"llmisvc-controller-manager-777c6bd7d5-t96wm\" (UID: \"92403f10-2422-42d9-8a95-2e103c37b148\") " pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-t96wm" Jul 14 05:05:32.370795 ip-10-0-136-9 kubenswrapper[2584]: I0714 05:05:32.369600 2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-szc5x\" (UniqueName: \"kubernetes.io/projected/92403f10-2422-42d9-8a95-2e103c37b148-kube-api-access-szc5x\") pod \"llmisvc-controller-manager-777c6bd7d5-t96wm\" (UID: \"92403f10-2422-42d9-8a95-2e103c37b148\") " pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-t96wm" Jul 14 05:05:32.370795 ip-10-0-136-9 kubenswrapper[2584]: I0714 05:05:32.369648 2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/92403f10-2422-42d9-8a95-2e103c37b148-cert\") pod \"llmisvc-controller-manager-777c6bd7d5-t96wm\" (UID: \"92403f10-2422-42d9-8a95-2e103c37b148\") " pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-t96wm" Jul 14 05:05:32.370795 ip-10-0-136-9 kubenswrapper[2584]: E0714 05:05:32.369772 2584 secret.go:189] Couldn't get secret opendatahub/llmisvc-webhook-server-cert: secret "llmisvc-webhook-server-cert" not found Jul 14 05:05:32.370795 ip-10-0-136-9 kubenswrapper[2584]: E0714 05:05:32.369834 2584 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/92403f10-2422-42d9-8a95-2e103c37b148-cert podName:92403f10-2422-42d9-8a95-2e103c37b148 nodeName:}" failed. No retries permitted until 2026-07-14 05:05:32.869813641 +0000 UTC m=+393.831069330 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "cert" (UniqueName: "kubernetes.io/secret/92403f10-2422-42d9-8a95-2e103c37b148-cert") pod "llmisvc-controller-manager-777c6bd7d5-t96wm" (UID: "92403f10-2422-42d9-8a95-2e103c37b148") : secret "llmisvc-webhook-server-cert" not found Jul 14 05:05:32.383306 ip-10-0-136-9 kubenswrapper[2584]: I0714 05:05:32.383276 2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-szc5x\" (UniqueName: \"kubernetes.io/projected/92403f10-2422-42d9-8a95-2e103c37b148-kube-api-access-szc5x\") pod \"llmisvc-controller-manager-777c6bd7d5-t96wm\" (UID: \"92403f10-2422-42d9-8a95-2e103c37b148\") " pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-t96wm" Jul 14 05:05:32.628585 ip-10-0-136-9 kubenswrapper[2584]: I0714 05:05:32.628548 2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-g257n_15609856-4056-487b-acdd-30276263b098/konnectivity-agent/0.log" limit=1024 Jul 14 05:05:32.725654 ip-10-0-136-9 kubenswrapper[2584]: I0714 05:05:32.725616 2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-g257n_15609856-4056-487b-acdd-30276263b098/konnectivity-agent/0.log" limit=1024 Jul 14 05:05:32.873608 ip-10-0-136-9 kubenswrapper[2584]: I0714 05:05:32.873567 2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/92403f10-2422-42d9-8a95-2e103c37b148-cert\") pod \"llmisvc-controller-manager-777c6bd7d5-t96wm\" (UID: \"92403f10-2422-42d9-8a95-2e103c37b148\") " pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-t96wm" Jul 14 05:05:32.876086 ip-10-0-136-9 kubenswrapper[2584]: I0714 05:05:32.876053 2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/92403f10-2422-42d9-8a95-2e103c37b148-cert\") pod \"llmisvc-controller-manager-777c6bd7d5-t96wm\" (UID: \"92403f10-2422-42d9-8a95-2e103c37b148\") " pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-t96wm" Jul 14 05:05:33.116911 ip-10-0-136-9 kubenswrapper[2584]: I0714 05:05:33.116869 2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-t96wm" Jul 14 05:05:33.251086 ip-10-0-136-9 kubenswrapper[2584]: I0714 05:05:33.251054 2584 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/llmisvc-controller-manager-777c6bd7d5-t96wm"] Jul 14 05:05:33.254643 ip-10-0-136-9 kubenswrapper[2584]: W0714 05:05:33.254609 2584 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-pod92403f10_2422_42d9_8a95_2e103c37b148.slice/crio-52df7c2f346dca45d379fc05cefcfdd6c6b55de9486ce0509e2b4cd135c61e21 WatchSource:0}: Error finding container 52df7c2f346dca45d379fc05cefcfdd6c6b55de9486ce0509e2b4cd135c61e21: Status 404 returned error can't find the container with id 52df7c2f346dca45d379fc05cefcfdd6c6b55de9486ce0509e2b4cd135c61e21 Jul 14 05:05:33.402888 ip-10-0-136-9 kubenswrapper[2584]: I0714 05:05:33.402802 2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-t96wm" event={"ID":"92403f10-2422-42d9-8a95-2e103c37b148","Type":"ContainerStarted","Data":"52df7c2f346dca45d379fc05cefcfdd6c6b55de9486ce0509e2b4cd135c61e21"} Jul 14 05:05:33.526182 ip-10-0-136-9 kubenswrapper[2584]: I0714 05:05:33.526138 2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-g257n_15609856-4056-487b-acdd-30276263b098/konnectivity-agent/0.log" limit=1024 Jul 14 05:05:33.655049 ip-10-0-136-9 kubenswrapper[2584]: I0714 05:05:33.654961 2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-g257n_15609856-4056-487b-acdd-30276263b098/konnectivity-agent/0.log" limit=1024 Jul 14 05:05:35.743992 ip-10-0-136-9 kubenswrapper[2584]: I0714 05:05:35.743954 2584 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/istiod-openshift-gateway-7574459656-tfrls"] Jul 14 05:05:35.744425 ip-10-0-136-9 kubenswrapper[2584]: I0714 05:05:35.744171 2584 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/istiod-openshift-gateway-7574459656-tfrls" podUID="99f63af2-f5ca-47bb-9389-500895646d8c" containerName="discovery" containerID="cri-o://b1456ac293dd309c84799e017c2e4d76b4c7fc6695e537b0575855630711c5dd" gracePeriod=30 Jul 14 05:05:36.419764 ip-10-0-136-9 kubenswrapper[2584]: I0714 05:05:36.419695 2584 generic.go:356] "Generic (PLEG): container finished" podID="99f63af2-f5ca-47bb-9389-500895646d8c" containerID="b1456ac293dd309c84799e017c2e4d76b4c7fc6695e537b0575855630711c5dd" exitCode=0 Jul 14 05:05:36.419958 ip-10-0-136-9 kubenswrapper[2584]: I0714 05:05:36.419771 2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/istiod-openshift-gateway-7574459656-tfrls" event={"ID":"99f63af2-f5ca-47bb-9389-500895646d8c","Type":"ContainerDied","Data":"b1456ac293dd309c84799e017c2e4d76b4c7fc6695e537b0575855630711c5dd"} Jul 14 05:05:36.534132 ip-10-0-136-9 kubenswrapper[2584]: I0714 05:05:36.534106 2584 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/istiod-openshift-gateway-7574459656-tfrls" Jul 14 05:05:36.614320 ip-10-0-136-9 kubenswrapper[2584]: I0714 05:05:36.614292 2584 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/99f63af2-f5ca-47bb-9389-500895646d8c-istio-token\") pod \"99f63af2-f5ca-47bb-9389-500895646d8c\" (UID: \"99f63af2-f5ca-47bb-9389-500895646d8c\") " Jul 14 05:05:36.614471 ip-10-0-136-9 kubenswrapper[2584]: I0714 05:05:36.614337 2584 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"local-certs\" (UniqueName: \"kubernetes.io/empty-dir/99f63af2-f5ca-47bb-9389-500895646d8c-local-certs\") pod \"99f63af2-f5ca-47bb-9389-500895646d8c\" (UID: \"99f63af2-f5ca-47bb-9389-500895646d8c\") " Jul 14 05:05:36.614471 ip-10-0-136-9 kubenswrapper[2584]: I0714 05:05:36.614383 2584 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-tvvn8\" (UniqueName: \"kubernetes.io/projected/99f63af2-f5ca-47bb-9389-500895646d8c-kube-api-access-tvvn8\") pod \"99f63af2-f5ca-47bb-9389-500895646d8c\" (UID: \"99f63af2-f5ca-47bb-9389-500895646d8c\") " Jul 14 05:05:36.614471 ip-10-0-136-9 kubenswrapper[2584]: I0714 05:05:36.614414 2584 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-kubeconfig\" (UniqueName: \"kubernetes.io/secret/99f63af2-f5ca-47bb-9389-500895646d8c-istio-kubeconfig\") pod \"99f63af2-f5ca-47bb-9389-500895646d8c\" (UID: \"99f63af2-f5ca-47bb-9389-500895646d8c\") " Jul 14 05:05:36.614471 ip-10-0-136-9 kubenswrapper[2584]: I0714 05:05:36.614469 2584 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-csr-ca-configmap\" (UniqueName: \"kubernetes.io/configmap/99f63af2-f5ca-47bb-9389-500895646d8c-istio-csr-ca-configmap\") pod \"99f63af2-f5ca-47bb-9389-500895646d8c\" (UID: \"99f63af2-f5ca-47bb-9389-500895646d8c\") " Jul 14 05:05:36.615022 ip-10-0-136-9 kubenswrapper[2584]: I0714 05:05:36.614500 2584 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-csr-dns-cert\" (UniqueName: \"kubernetes.io/secret/99f63af2-f5ca-47bb-9389-500895646d8c-istio-csr-dns-cert\") pod \"99f63af2-f5ca-47bb-9389-500895646d8c\" (UID: \"99f63af2-f5ca-47bb-9389-500895646d8c\") " Jul 14 05:05:36.615022 ip-10-0-136-9 kubenswrapper[2584]: I0714 05:05:36.614575 2584 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"cacerts\" (UniqueName: \"kubernetes.io/secret/99f63af2-f5ca-47bb-9389-500895646d8c-cacerts\") pod \"99f63af2-f5ca-47bb-9389-500895646d8c\" (UID: \"99f63af2-f5ca-47bb-9389-500895646d8c\") " Jul 14 05:05:36.615760 ip-10-0-136-9 kubenswrapper[2584]: I0714 05:05:36.615436 2584 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/99f63af2-f5ca-47bb-9389-500895646d8c-istio-csr-ca-configmap" (OuterVolumeSpecName: "istio-csr-ca-configmap") pod "99f63af2-f5ca-47bb-9389-500895646d8c" (UID: "99f63af2-f5ca-47bb-9389-500895646d8c"). InnerVolumeSpecName "istio-csr-ca-configmap". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 14 05:05:36.617163 ip-10-0-136-9 kubenswrapper[2584]: I0714 05:05:36.617143 2584 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/99f63af2-f5ca-47bb-9389-500895646d8c-local-certs" (OuterVolumeSpecName: "local-certs") pod "99f63af2-f5ca-47bb-9389-500895646d8c" (UID: "99f63af2-f5ca-47bb-9389-500895646d8c"). InnerVolumeSpecName "local-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 14 05:05:36.617297 ip-10-0-136-9 kubenswrapper[2584]: I0714 05:05:36.617277 2584 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/99f63af2-f5ca-47bb-9389-500895646d8c-istio-token" (OuterVolumeSpecName: "istio-token") pod "99f63af2-f5ca-47bb-9389-500895646d8c" (UID: "99f63af2-f5ca-47bb-9389-500895646d8c"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 14 05:05:36.688639 ip-10-0-136-9 kubenswrapper[2584]: I0714 05:05:36.688542 2584 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/99f63af2-f5ca-47bb-9389-500895646d8c-istio-kubeconfig" (OuterVolumeSpecName: "istio-kubeconfig") pod "99f63af2-f5ca-47bb-9389-500895646d8c" (UID: "99f63af2-f5ca-47bb-9389-500895646d8c"). InnerVolumeSpecName "istio-kubeconfig". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 14 05:05:36.688639 ip-10-0-136-9 kubenswrapper[2584]: I0714 05:05:36.688621 2584 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/99f63af2-f5ca-47bb-9389-500895646d8c-cacerts" (OuterVolumeSpecName: "cacerts") pod "99f63af2-f5ca-47bb-9389-500895646d8c" (UID: "99f63af2-f5ca-47bb-9389-500895646d8c"). InnerVolumeSpecName "cacerts". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 14 05:05:36.688893 ip-10-0-136-9 kubenswrapper[2584]: I0714 05:05:36.688752 2584 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/99f63af2-f5ca-47bb-9389-500895646d8c-istio-csr-dns-cert" (OuterVolumeSpecName: "istio-csr-dns-cert") pod "99f63af2-f5ca-47bb-9389-500895646d8c" (UID: "99f63af2-f5ca-47bb-9389-500895646d8c"). InnerVolumeSpecName "istio-csr-dns-cert". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 14 05:05:36.688971 ip-10-0-136-9 kubenswrapper[2584]: I0714 05:05:36.688911 2584 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/99f63af2-f5ca-47bb-9389-500895646d8c-kube-api-access-tvvn8" (OuterVolumeSpecName: "kube-api-access-tvvn8") pod "99f63af2-f5ca-47bb-9389-500895646d8c" (UID: "99f63af2-f5ca-47bb-9389-500895646d8c"). InnerVolumeSpecName "kube-api-access-tvvn8". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 14 05:05:36.716260 ip-10-0-136-9 kubenswrapper[2584]: I0714 05:05:36.716230 2584 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/99f63af2-f5ca-47bb-9389-500895646d8c-istio-token\") on node \"ip-10-0-136-9.ec2.internal\" DevicePath \"\"" Jul 14 05:05:36.716260 ip-10-0-136-9 kubenswrapper[2584]: I0714 05:05:36.716258 2584 reconciler_common.go:299] "Volume detached for volume \"local-certs\" (UniqueName: \"kubernetes.io/empty-dir/99f63af2-f5ca-47bb-9389-500895646d8c-local-certs\") on node \"ip-10-0-136-9.ec2.internal\" DevicePath \"\"" Jul 14 05:05:36.716435 ip-10-0-136-9 kubenswrapper[2584]: I0714 05:05:36.716268 2584 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-tvvn8\" (UniqueName: \"kubernetes.io/projected/99f63af2-f5ca-47bb-9389-500895646d8c-kube-api-access-tvvn8\") on node \"ip-10-0-136-9.ec2.internal\" DevicePath \"\"" Jul 14 05:05:36.716435 ip-10-0-136-9 kubenswrapper[2584]: I0714 05:05:36.716277 2584 reconciler_common.go:299] "Volume detached for volume \"istio-kubeconfig\" (UniqueName: \"kubernetes.io/secret/99f63af2-f5ca-47bb-9389-500895646d8c-istio-kubeconfig\") on node \"ip-10-0-136-9.ec2.internal\" DevicePath \"\"" Jul 14 05:05:36.716435 ip-10-0-136-9 kubenswrapper[2584]: I0714 05:05:36.716286 2584 reconciler_common.go:299] "Volume detached for volume \"istio-csr-ca-configmap\" (UniqueName: \"kubernetes.io/configmap/99f63af2-f5ca-47bb-9389-500895646d8c-istio-csr-ca-configmap\") on node \"ip-10-0-136-9.ec2.internal\" DevicePath \"\"" Jul 14 05:05:36.716435 ip-10-0-136-9 kubenswrapper[2584]: I0714 05:05:36.716294 2584 reconciler_common.go:299] "Volume detached for volume \"istio-csr-dns-cert\" (UniqueName: \"kubernetes.io/secret/99f63af2-f5ca-47bb-9389-500895646d8c-istio-csr-dns-cert\") on node \"ip-10-0-136-9.ec2.internal\" DevicePath \"\"" Jul 14 05:05:36.716435 ip-10-0-136-9 kubenswrapper[2584]: I0714 05:05:36.716302 2584 reconciler_common.go:299] "Volume detached for volume \"cacerts\" (UniqueName: \"kubernetes.io/secret/99f63af2-f5ca-47bb-9389-500895646d8c-cacerts\") on node \"ip-10-0-136-9.ec2.internal\" DevicePath \"\"" Jul 14 05:05:37.426694 ip-10-0-136-9 kubenswrapper[2584]: I0714 05:05:37.426656 2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-t96wm" event={"ID":"92403f10-2422-42d9-8a95-2e103c37b148","Type":"ContainerStarted","Data":"ff6b325cf2753fda6cf4bb9e5510ef0c60496a94962fbaf010f03b6c23d04a5e"} Jul 14 05:05:37.427094 ip-10-0-136-9 kubenswrapper[2584]: I0714 05:05:37.426765 2584 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-t96wm" Jul 14 05:05:37.428000 ip-10-0-136-9 kubenswrapper[2584]: I0714 05:05:37.427975 2584 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/istiod-openshift-gateway-7574459656-tfrls" Jul 14 05:05:37.428097 ip-10-0-136-9 kubenswrapper[2584]: I0714 05:05:37.427980 2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/istiod-openshift-gateway-7574459656-tfrls" event={"ID":"99f63af2-f5ca-47bb-9389-500895646d8c","Type":"ContainerDied","Data":"c484d61186471088e63525473c972c971ebaaf895305f9104a3388b06c9d4449"} Jul 14 05:05:37.428145 ip-10-0-136-9 kubenswrapper[2584]: I0714 05:05:37.428104 2584 scope.go:117] "RemoveContainer" containerID="b1456ac293dd309c84799e017c2e4d76b4c7fc6695e537b0575855630711c5dd" Jul 14 05:05:37.444726 ip-10-0-136-9 kubenswrapper[2584]: I0714 05:05:37.444677 2584 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-t96wm" podStartSLOduration=2.135558084 podStartE2EDuration="5.444663493s" totalImagesPullingTime="3.309105409s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-14 05:05:32 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-14 05:05:37.444015794 +0000 UTC m=+398.405271499" watchObservedRunningTime="2026-07-14 05:05:37.444663493 +0000 UTC m=+398.405919255" Jul 14 05:05:37.458235 ip-10-0-136-9 kubenswrapper[2584]: I0714 05:05:37.458210 2584 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/istiod-openshift-gateway-7574459656-tfrls"] Jul 14 05:05:37.462424 ip-10-0-136-9 kubenswrapper[2584]: I0714 05:05:37.462401 2584 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/istiod-openshift-gateway-7574459656-tfrls"] Jul 14 05:05:37.530518 ip-10-0-136-9 kubenswrapper[2584]: I0714 05:05:37.530486 2584 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="99f63af2-f5ca-47bb-9389-500895646d8c" path="/var/lib/kubelet/pods/99f63af2-f5ca-47bb-9389-500895646d8c/volumes" Jul 14 05:05:39.386464 ip-10-0-136-9 kubenswrapper[2584]: I0714 05:05:39.386436 2584 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/odh-model-controller-7998c67dc4-7bhln" Jul 14 05:05:39.388197 ip-10-0-136-9 kubenswrapper[2584]: I0714 05:05:39.388170 2584 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/model-serving-api-54d89bd5fc-fcl6g" Jul 14 05:05:57.820299 ip-10-0-136-9 kubenswrapper[2584]: I0714 05:05:57.820263 2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-g257n_15609856-4056-487b-acdd-30276263b098/konnectivity-agent/0.log" limit=1024 Jul 14 05:05:57.880533 ip-10-0-136-9 kubenswrapper[2584]: I0714 05:05:57.880502 2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-g257n_15609856-4056-487b-acdd-30276263b098/konnectivity-agent/0.log" limit=1024 Jul 14 05:06:03.666734 ip-10-0-136-9 kubenswrapper[2584]: I0714 05:06:03.666699 2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-g257n_15609856-4056-487b-acdd-30276263b098/konnectivity-agent/0.log" limit=1024 Jul 14 05:06:03.722818 ip-10-0-136-9 kubenswrapper[2584]: I0714 05:06:03.722784 2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-g257n_15609856-4056-487b-acdd-30276263b098/konnectivity-agent/0.log" limit=1024 Jul 14 05:06:08.435900 ip-10-0-136-9 kubenswrapper[2584]: I0714 05:06:08.435865 2584 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-t96wm" Jul 14 05:06:21.861326 ip-10-0-136-9 kubenswrapper[2584]: I0714 05:06:21.861232 2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-g257n_15609856-4056-487b-acdd-30276263b098/konnectivity-agent/0.log" limit=1024 Jul 14 05:06:21.958806 ip-10-0-136-9 kubenswrapper[2584]: I0714 05:06:21.958747 2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-g257n_15609856-4056-487b-acdd-30276263b098/konnectivity-agent/0.log" limit=1024 Jul 14 05:06:21.978700 ip-10-0-136-9 kubenswrapper[2584]: I0714 05:06:21.978663 2584 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/kuadrant-operator-catalog-tkd2r"] Jul 14 05:06:21.979038 ip-10-0-136-9 kubenswrapper[2584]: I0714 05:06:21.979023 2584 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="99f63af2-f5ca-47bb-9389-500895646d8c" containerName="discovery" Jul 14 05:06:21.979104 ip-10-0-136-9 kubenswrapper[2584]: I0714 05:06:21.979041 2584 state_mem.go:107] "Deleted CPUSet assignment" podUID="99f63af2-f5ca-47bb-9389-500895646d8c" containerName="discovery" Jul 14 05:06:21.979139 ip-10-0-136-9 kubenswrapper[2584]: I0714 05:06:21.979123 2584 memory_manager.go:368] "RemoveStaleState removing state" podUID="99f63af2-f5ca-47bb-9389-500895646d8c" containerName="discovery" Jul 14 05:06:21.982180 ip-10-0-136-9 kubenswrapper[2584]: I0714 05:06:21.982159 2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-catalog-tkd2r" Jul 14 05:06:21.987975 ip-10-0-136-9 kubenswrapper[2584]: I0714 05:06:21.987825 2584 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"openshift-service-ca.crt\"" Jul 14 05:06:21.987975 ip-10-0-136-9 kubenswrapper[2584]: I0714 05:06:21.987861 2584 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"kube-root-ca.crt\"" Jul 14 05:06:21.988213 ip-10-0-136-9 kubenswrapper[2584]: I0714 05:06:21.988179 2584 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"kuadrant-operator-catalog-dockercfg-s5r6g\"" Jul 14 05:06:21.990882 ip-10-0-136-9 kubenswrapper[2584]: I0714 05:06:21.990825 2584 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-catalog-tkd2r"] Jul 14 05:06:22.005414 ip-10-0-136-9 kubenswrapper[2584]: I0714 05:06:22.005380 2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-mqpcn\" (UniqueName: \"kubernetes.io/projected/b48dbf3b-4765-407d-b5a0-3b60a1fcede9-kube-api-access-mqpcn\") pod \"kuadrant-operator-catalog-tkd2r\" (UID: \"b48dbf3b-4765-407d-b5a0-3b60a1fcede9\") " pod="kuadrant-system/kuadrant-operator-catalog-tkd2r" Jul 14 05:06:22.058730 ip-10-0-136-9 kubenswrapper[2584]: I0714 05:06:22.058675 2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-g257n_15609856-4056-487b-acdd-30276263b098/konnectivity-agent/0.log" limit=1024 Jul 14 05:06:22.106023 ip-10-0-136-9 kubenswrapper[2584]: I0714 05:06:22.105982 2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-mqpcn\" (UniqueName: \"kubernetes.io/projected/b48dbf3b-4765-407d-b5a0-3b60a1fcede9-kube-api-access-mqpcn\") pod \"kuadrant-operator-catalog-tkd2r\" (UID: \"b48dbf3b-4765-407d-b5a0-3b60a1fcede9\") " pod="kuadrant-system/kuadrant-operator-catalog-tkd2r" Jul 14 05:06:22.114147 ip-10-0-136-9 kubenswrapper[2584]: I0714 05:06:22.114076 2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-mqpcn\" (UniqueName: \"kubernetes.io/projected/b48dbf3b-4765-407d-b5a0-3b60a1fcede9-kube-api-access-mqpcn\") pod \"kuadrant-operator-catalog-tkd2r\" (UID: \"b48dbf3b-4765-407d-b5a0-3b60a1fcede9\") " pod="kuadrant-system/kuadrant-operator-catalog-tkd2r" Jul 14 05:06:22.294447 ip-10-0-136-9 kubenswrapper[2584]: I0714 05:06:22.294407 2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-catalog-tkd2r" Jul 14 05:06:22.349687 ip-10-0-136-9 kubenswrapper[2584]: I0714 05:06:22.349608 2584 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-catalog-tkd2r"] Jul 14 05:06:22.440292 ip-10-0-136-9 kubenswrapper[2584]: I0714 05:06:22.440258 2584 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-catalog-tkd2r"] Jul 14 05:06:22.443594 ip-10-0-136-9 kubenswrapper[2584]: W0714 05:06:22.443563 2584 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podb48dbf3b_4765_407d_b5a0_3b60a1fcede9.slice/crio-9b2f311b98f9005b7c2e31eba17293a071c7a550f22c4ef6bc7582716623f95f WatchSource:0}: Error finding container 9b2f311b98f9005b7c2e31eba17293a071c7a550f22c4ef6bc7582716623f95f: Status 404 returned error can't find the container with id 9b2f311b98f9005b7c2e31eba17293a071c7a550f22c4ef6bc7582716623f95f Jul 14 05:06:22.558622 ip-10-0-136-9 kubenswrapper[2584]: I0714 05:06:22.558584 2584 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/kuadrant-operator-catalog-6v6rx"] Jul 14 05:06:22.563268 ip-10-0-136-9 kubenswrapper[2584]: I0714 05:06:22.563239 2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-catalog-6v6rx" Jul 14 05:06:22.569571 ip-10-0-136-9 kubenswrapper[2584]: I0714 05:06:22.569541 2584 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-catalog-6v6rx"] Jul 14 05:06:22.609979 ip-10-0-136-9 kubenswrapper[2584]: I0714 05:06:22.609925 2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-pjfkf\" (UniqueName: \"kubernetes.io/projected/35849b26-d191-4a4d-8e52-2af51c4a8be6-kube-api-access-pjfkf\") pod \"kuadrant-operator-catalog-6v6rx\" (UID: \"35849b26-d191-4a4d-8e52-2af51c4a8be6\") " pod="kuadrant-system/kuadrant-operator-catalog-6v6rx" Jul 14 05:06:22.631045 ip-10-0-136-9 kubenswrapper[2584]: I0714 05:06:22.631008 2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-catalog-tkd2r" event={"ID":"b48dbf3b-4765-407d-b5a0-3b60a1fcede9","Type":"ContainerStarted","Data":"9b2f311b98f9005b7c2e31eba17293a071c7a550f22c4ef6bc7582716623f95f"} Jul 14 05:06:22.710866 ip-10-0-136-9 kubenswrapper[2584]: I0714 05:06:22.710770 2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-pjfkf\" (UniqueName: \"kubernetes.io/projected/35849b26-d191-4a4d-8e52-2af51c4a8be6-kube-api-access-pjfkf\") pod \"kuadrant-operator-catalog-6v6rx\" (UID: \"35849b26-d191-4a4d-8e52-2af51c4a8be6\") " pod="kuadrant-system/kuadrant-operator-catalog-6v6rx" Jul 14 05:06:22.719010 ip-10-0-136-9 kubenswrapper[2584]: I0714 05:06:22.718976 2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-pjfkf\" (UniqueName: \"kubernetes.io/projected/35849b26-d191-4a4d-8e52-2af51c4a8be6-kube-api-access-pjfkf\") pod \"kuadrant-operator-catalog-6v6rx\" (UID: \"35849b26-d191-4a4d-8e52-2af51c4a8be6\") " pod="kuadrant-system/kuadrant-operator-catalog-6v6rx" Jul 14 05:06:22.776627 ip-10-0-136-9 kubenswrapper[2584]: I0714 05:06:22.776595 2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-g257n_15609856-4056-487b-acdd-30276263b098/konnectivity-agent/0.log" limit=1024 Jul 14 05:06:22.873877 ip-10-0-136-9 kubenswrapper[2584]: I0714 05:06:22.873839 2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-catalog-6v6rx" Jul 14 05:06:22.987863 ip-10-0-136-9 kubenswrapper[2584]: I0714 05:06:22.987815 2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-g257n_15609856-4056-487b-acdd-30276263b098/konnectivity-agent/0.log" limit=1024 Jul 14 05:06:23.028616 ip-10-0-136-9 kubenswrapper[2584]: I0714 05:06:23.028593 2584 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-catalog-6v6rx"] Jul 14 05:06:23.030972 ip-10-0-136-9 kubenswrapper[2584]: W0714 05:06:23.030914 2584 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod35849b26_d191_4a4d_8e52_2af51c4a8be6.slice/crio-e47875c4481d7a6de7e89cedde88d58c88c0b9d3e46af1a3a771cd4e8066696a WatchSource:0}: Error finding container e47875c4481d7a6de7e89cedde88d58c88c0b9d3e46af1a3a771cd4e8066696a: Status 404 returned error can't find the container with id e47875c4481d7a6de7e89cedde88d58c88c0b9d3e46af1a3a771cd4e8066696a Jul 14 05:06:23.641464 ip-10-0-136-9 kubenswrapper[2584]: I0714 05:06:23.641384 2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-catalog-6v6rx" event={"ID":"35849b26-d191-4a4d-8e52-2af51c4a8be6","Type":"ContainerStarted","Data":"e47875c4481d7a6de7e89cedde88d58c88c0b9d3e46af1a3a771cd4e8066696a"} Jul 14 05:06:25.651736 ip-10-0-136-9 kubenswrapper[2584]: I0714 05:06:25.651681 2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-catalog-tkd2r" event={"ID":"b48dbf3b-4765-407d-b5a0-3b60a1fcede9","Type":"ContainerStarted","Data":"4137468f07179eb4fcc2280ca73a385e7d8a44a3170eee821c0895bf65ff7c52"} Jul 14 05:06:25.652192 ip-10-0-136-9 kubenswrapper[2584]: I0714 05:06:25.651718 2584 kuberuntime_container.go:873] "Killing container with a grace period" pod="kuadrant-system/kuadrant-operator-catalog-tkd2r" podUID="b48dbf3b-4765-407d-b5a0-3b60a1fcede9" containerName="registry-server" containerID="cri-o://4137468f07179eb4fcc2280ca73a385e7d8a44a3170eee821c0895bf65ff7c52" gracePeriod=2 Jul 14 05:06:25.653299 ip-10-0-136-9 kubenswrapper[2584]: I0714 05:06:25.653275 2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-catalog-6v6rx" event={"ID":"35849b26-d191-4a4d-8e52-2af51c4a8be6","Type":"ContainerStarted","Data":"20add54a9ff6128a9742cc05750da1726f8eaff8da747f1c66212e4a4af8b67c"} Jul 14 05:06:25.669486 ip-10-0-136-9 kubenswrapper[2584]: I0714 05:06:25.669429 2584 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/kuadrant-operator-catalog-tkd2r" podStartSLOduration=2.411764815 podStartE2EDuration="4.669405455s" totalImagesPullingTime="2.25764064s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-14 05:06:21 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-14 05:06:25.6667721 +0000 UTC m=+446.628027808" watchObservedRunningTime="2026-07-14 05:06:25.669405455 +0000 UTC m=+446.630661161" Jul 14 05:06:25.683797 ip-10-0-136-9 kubenswrapper[2584]: I0714 05:06:25.683747 2584 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/kuadrant-operator-catalog-6v6rx" podStartSLOduration=2.017047037 podStartE2EDuration="3.683732604s" totalImagesPullingTime="1.666685567s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-14 05:06:22 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-14 05:06:25.682316588 +0000 UTC m=+446.643572295" watchObservedRunningTime="2026-07-14 05:06:25.683732604 +0000 UTC m=+446.644988309" Jul 14 05:06:25.898866 ip-10-0-136-9 kubenswrapper[2584]: I0714 05:06:25.898837 2584 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-catalog-tkd2r" Jul 14 05:06:25.940467 ip-10-0-136-9 kubenswrapper[2584]: I0714 05:06:25.940380 2584 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-mqpcn\" (UniqueName: \"kubernetes.io/projected/b48dbf3b-4765-407d-b5a0-3b60a1fcede9-kube-api-access-mqpcn\") pod \"b48dbf3b-4765-407d-b5a0-3b60a1fcede9\" (UID: \"b48dbf3b-4765-407d-b5a0-3b60a1fcede9\") " Jul 14 05:06:25.942549 ip-10-0-136-9 kubenswrapper[2584]: I0714 05:06:25.942522 2584 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/b48dbf3b-4765-407d-b5a0-3b60a1fcede9-kube-api-access-mqpcn" (OuterVolumeSpecName: "kube-api-access-mqpcn") pod "b48dbf3b-4765-407d-b5a0-3b60a1fcede9" (UID: "b48dbf3b-4765-407d-b5a0-3b60a1fcede9"). InnerVolumeSpecName "kube-api-access-mqpcn". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 14 05:06:26.041789 ip-10-0-136-9 kubenswrapper[2584]: I0714 05:06:26.041750 2584 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-mqpcn\" (UniqueName: \"kubernetes.io/projected/b48dbf3b-4765-407d-b5a0-3b60a1fcede9-kube-api-access-mqpcn\") on node \"ip-10-0-136-9.ec2.internal\" DevicePath \"\"" Jul 14 05:06:26.659044 ip-10-0-136-9 kubenswrapper[2584]: I0714 05:06:26.659007 2584 generic.go:356] "Generic (PLEG): container finished" podID="b48dbf3b-4765-407d-b5a0-3b60a1fcede9" containerID="4137468f07179eb4fcc2280ca73a385e7d8a44a3170eee821c0895bf65ff7c52" exitCode=0 Jul 14 05:06:26.659044 ip-10-0-136-9 kubenswrapper[2584]: I0714 05:06:26.659048 2584 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-catalog-tkd2r" Jul 14 05:06:26.659560 ip-10-0-136-9 kubenswrapper[2584]: I0714 05:06:26.659088 2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-catalog-tkd2r" event={"ID":"b48dbf3b-4765-407d-b5a0-3b60a1fcede9","Type":"ContainerDied","Data":"4137468f07179eb4fcc2280ca73a385e7d8a44a3170eee821c0895bf65ff7c52"} Jul 14 05:06:26.659560 ip-10-0-136-9 kubenswrapper[2584]: I0714 05:06:26.659139 2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-catalog-tkd2r" event={"ID":"b48dbf3b-4765-407d-b5a0-3b60a1fcede9","Type":"ContainerDied","Data":"9b2f311b98f9005b7c2e31eba17293a071c7a550f22c4ef6bc7582716623f95f"} Jul 14 05:06:26.659560 ip-10-0-136-9 kubenswrapper[2584]: I0714 05:06:26.659160 2584 scope.go:117] "RemoveContainer" containerID="4137468f07179eb4fcc2280ca73a385e7d8a44a3170eee821c0895bf65ff7c52" Jul 14 05:06:26.669291 ip-10-0-136-9 kubenswrapper[2584]: I0714 05:06:26.669275 2584 scope.go:117] "RemoveContainer" containerID="4137468f07179eb4fcc2280ca73a385e7d8a44a3170eee821c0895bf65ff7c52" Jul 14 05:06:26.669567 ip-10-0-136-9 kubenswrapper[2584]: E0714 05:06:26.669546 2584 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"4137468f07179eb4fcc2280ca73a385e7d8a44a3170eee821c0895bf65ff7c52\": container with ID starting with 4137468f07179eb4fcc2280ca73a385e7d8a44a3170eee821c0895bf65ff7c52 not found: ID does not exist" containerID="4137468f07179eb4fcc2280ca73a385e7d8a44a3170eee821c0895bf65ff7c52" Jul 14 05:06:26.669630 ip-10-0-136-9 kubenswrapper[2584]: I0714 05:06:26.669580 2584 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"4137468f07179eb4fcc2280ca73a385e7d8a44a3170eee821c0895bf65ff7c52"} err="failed to get container status \"4137468f07179eb4fcc2280ca73a385e7d8a44a3170eee821c0895bf65ff7c52\": rpc error: code = NotFound desc = could not find container \"4137468f07179eb4fcc2280ca73a385e7d8a44a3170eee821c0895bf65ff7c52\": container with ID starting with 4137468f07179eb4fcc2280ca73a385e7d8a44a3170eee821c0895bf65ff7c52 not found: ID does not exist" Jul 14 05:06:26.679553 ip-10-0-136-9 kubenswrapper[2584]: I0714 05:06:26.679529 2584 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-catalog-tkd2r"] Jul 14 05:06:26.683280 ip-10-0-136-9 kubenswrapper[2584]: I0714 05:06:26.683261 2584 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/kuadrant-operator-catalog-tkd2r"] Jul 14 05:06:27.529790 ip-10-0-136-9 kubenswrapper[2584]: I0714 05:06:27.529752 2584 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="b48dbf3b-4765-407d-b5a0-3b60a1fcede9" path="/var/lib/kubelet/pods/b48dbf3b-4765-407d-b5a0-3b60a1fcede9/volumes" Jul 14 05:06:32.874374 ip-10-0-136-9 kubenswrapper[2584]: I0714 05:06:32.874328 2584 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/kuadrant-operator-catalog-6v6rx" Jul 14 05:06:32.874880 ip-10-0-136-9 kubenswrapper[2584]: I0714 05:06:32.874404 2584 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="kuadrant-system/kuadrant-operator-catalog-6v6rx" Jul 14 05:06:32.897572 ip-10-0-136-9 kubenswrapper[2584]: I0714 05:06:32.897534 2584 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="kuadrant-system/kuadrant-operator-catalog-6v6rx" Jul 14 05:06:33.714961 ip-10-0-136-9 kubenswrapper[2584]: I0714 05:06:33.714917 2584 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/kuadrant-operator-catalog-6v6rx" Jul 14 05:06:51.559980 ip-10-0-136-9 kubenswrapper[2584]: I0714 05:06:51.559924 2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-g257n_15609856-4056-487b-acdd-30276263b098/konnectivity-agent/0.log" limit=1024 Jul 14 05:06:55.637441 ip-10-0-136-9 kubenswrapper[2584]: I0714 05:06:55.637386 2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-g257n_15609856-4056-487b-acdd-30276263b098/konnectivity-agent/0.log" limit=1024 Jul 14 05:06:56.707426 ip-10-0-136-9 kubenswrapper[2584]: I0714 05:06:56.707382 2584 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-xd8x8"] Jul 14 05:06:56.707860 ip-10-0-136-9 kubenswrapper[2584]: I0714 05:06:56.707779 2584 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="b48dbf3b-4765-407d-b5a0-3b60a1fcede9" containerName="registry-server" Jul 14 05:06:56.707860 ip-10-0-136-9 kubenswrapper[2584]: I0714 05:06:56.707794 2584 state_mem.go:107] "Deleted CPUSet assignment" podUID="b48dbf3b-4765-407d-b5a0-3b60a1fcede9" containerName="registry-server" Jul 14 05:06:56.707952 ip-10-0-136-9 kubenswrapper[2584]: I0714 05:06:56.707880 2584 memory_manager.go:368] "RemoveStaleState removing state" podUID="b48dbf3b-4765-407d-b5a0-3b60a1fcede9" containerName="registry-server" Jul 14 05:06:56.714391 ip-10-0-136-9 kubenswrapper[2584]: I0714 05:06:56.714367 2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-xd8x8" Jul 14 05:06:56.720381 ip-10-0-136-9 kubenswrapper[2584]: I0714 05:06:56.720352 2584 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"kuadrant-operator-controller-manager-dockercfg-xttpq\"" Jul 14 05:06:56.747176 ip-10-0-136-9 kubenswrapper[2584]: I0714 05:06:56.747137 2584 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-xd8x8"] Jul 14 05:06:56.817383 ip-10-0-136-9 kubenswrapper[2584]: I0714 05:06:56.817339 2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/f0a682af-38b8-4bdc-ad52-2d02b666022d-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-8684c9ff49-xd8x8\" (UID: \"f0a682af-38b8-4bdc-ad52-2d02b666022d\") " pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-xd8x8" Jul 14 05:06:56.817646 ip-10-0-136-9 kubenswrapper[2584]: I0714 05:06:56.817410 2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-97gzq\" (UniqueName: \"kubernetes.io/projected/f0a682af-38b8-4bdc-ad52-2d02b666022d-kube-api-access-97gzq\") pod \"kuadrant-operator-controller-manager-8684c9ff49-xd8x8\" (UID: \"f0a682af-38b8-4bdc-ad52-2d02b666022d\") " pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-xd8x8" Jul 14 05:06:56.918700 ip-10-0-136-9 kubenswrapper[2584]: I0714 05:06:56.918666 2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/f0a682af-38b8-4bdc-ad52-2d02b666022d-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-8684c9ff49-xd8x8\" (UID: \"f0a682af-38b8-4bdc-ad52-2d02b666022d\") " pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-xd8x8" Jul 14 05:06:56.918877 ip-10-0-136-9 kubenswrapper[2584]: I0714 05:06:56.918723 2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-97gzq\" (UniqueName: \"kubernetes.io/projected/f0a682af-38b8-4bdc-ad52-2d02b666022d-kube-api-access-97gzq\") pod \"kuadrant-operator-controller-manager-8684c9ff49-xd8x8\" (UID: \"f0a682af-38b8-4bdc-ad52-2d02b666022d\") " pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-xd8x8" Jul 14 05:06:56.919097 ip-10-0-136-9 kubenswrapper[2584]: I0714 05:06:56.919078 2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/f0a682af-38b8-4bdc-ad52-2d02b666022d-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-8684c9ff49-xd8x8\" (UID: \"f0a682af-38b8-4bdc-ad52-2d02b666022d\") " pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-xd8x8" Jul 14 05:06:56.931073 ip-10-0-136-9 kubenswrapper[2584]: I0714 05:06:56.931040 2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-97gzq\" (UniqueName: \"kubernetes.io/projected/f0a682af-38b8-4bdc-ad52-2d02b666022d-kube-api-access-97gzq\") pod \"kuadrant-operator-controller-manager-8684c9ff49-xd8x8\" (UID: \"f0a682af-38b8-4bdc-ad52-2d02b666022d\") " pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-xd8x8" Jul 14 05:06:56.963831 ip-10-0-136-9 kubenswrapper[2584]: I0714 05:06:56.963745 2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-g257n_15609856-4056-487b-acdd-30276263b098/konnectivity-agent/0.log" limit=1024 Jul 14 05:06:57.025567 ip-10-0-136-9 kubenswrapper[2584]: I0714 05:06:57.025516 2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-xd8x8" Jul 14 05:06:57.160500 ip-10-0-136-9 kubenswrapper[2584]: I0714 05:06:57.160461 2584 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-xd8x8"] Jul 14 05:06:57.164559 ip-10-0-136-9 kubenswrapper[2584]: W0714 05:06:57.164531 2584 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podf0a682af_38b8_4bdc_ad52_2d02b666022d.slice/crio-d34383ccebac6de5cbde7a5c6012ee2227a88b044178d4b2b1c83639fa265d6a WatchSource:0}: Error finding container d34383ccebac6de5cbde7a5c6012ee2227a88b044178d4b2b1c83639fa265d6a: Status 404 returned error can't find the container with id d34383ccebac6de5cbde7a5c6012ee2227a88b044178d4b2b1c83639fa265d6a Jul 14 05:06:57.357546 ip-10-0-136-9 kubenswrapper[2584]: I0714 05:06:57.357494 2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-g257n_15609856-4056-487b-acdd-30276263b098/konnectivity-agent/0.log" limit=1024 Jul 14 05:06:57.808576 ip-10-0-136-9 kubenswrapper[2584]: I0714 05:06:57.808475 2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-xd8x8" event={"ID":"f0a682af-38b8-4bdc-ad52-2d02b666022d","Type":"ContainerStarted","Data":"d34383ccebac6de5cbde7a5c6012ee2227a88b044178d4b2b1c83639fa265d6a"} Jul 14 05:06:57.968232 ip-10-0-136-9 kubenswrapper[2584]: I0714 05:06:57.968158 2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-g257n_15609856-4056-487b-acdd-30276263b098/konnectivity-agent/0.log" limit=1024 Jul 14 05:06:58.385894 ip-10-0-136-9 kubenswrapper[2584]: I0714 05:06:58.385853 2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-g257n_15609856-4056-487b-acdd-30276263b098/konnectivity-agent/0.log" limit=1024 Jul 14 05:06:58.485559 ip-10-0-136-9 kubenswrapper[2584]: I0714 05:06:58.485507 2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-g257n_15609856-4056-487b-acdd-30276263b098/konnectivity-agent/0.log" limit=1024 Jul 14 05:06:59.413377 ip-10-0-136-9 kubenswrapper[2584]: I0714 05:06:59.413341 2584 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/authorino-operator-75cc8d5cb7-hkhlt"] Jul 14 05:06:59.417830 ip-10-0-136-9 kubenswrapper[2584]: I0714 05:06:59.417802 2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-operator-75cc8d5cb7-hkhlt" Jul 14 05:06:59.420563 ip-10-0-136-9 kubenswrapper[2584]: I0714 05:06:59.420535 2584 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"authorino-operator-dockercfg-nk9bj\"" Jul 14 05:06:59.432507 ip-10-0-136-9 kubenswrapper[2584]: I0714 05:06:59.432464 2584 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-operator-75cc8d5cb7-hkhlt"] Jul 14 05:06:59.542084 ip-10-0-136-9 kubenswrapper[2584]: I0714 05:06:59.542043 2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-5487s\" (UniqueName: \"kubernetes.io/projected/13b189eb-052f-4108-a70e-49be5e405034-kube-api-access-5487s\") pod \"authorino-operator-75cc8d5cb7-hkhlt\" (UID: \"13b189eb-052f-4108-a70e-49be5e405034\") " pod="kuadrant-system/authorino-operator-75cc8d5cb7-hkhlt" Jul 14 05:06:59.642856 ip-10-0-136-9 kubenswrapper[2584]: I0714 05:06:59.642818 2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-5487s\" (UniqueName: \"kubernetes.io/projected/13b189eb-052f-4108-a70e-49be5e405034-kube-api-access-5487s\") pod \"authorino-operator-75cc8d5cb7-hkhlt\" (UID: \"13b189eb-052f-4108-a70e-49be5e405034\") " pod="kuadrant-system/authorino-operator-75cc8d5cb7-hkhlt" Jul 14 05:06:59.651501 ip-10-0-136-9 kubenswrapper[2584]: I0714 05:06:59.651473 2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-5487s\" (UniqueName: \"kubernetes.io/projected/13b189eb-052f-4108-a70e-49be5e405034-kube-api-access-5487s\") pod \"authorino-operator-75cc8d5cb7-hkhlt\" (UID: \"13b189eb-052f-4108-a70e-49be5e405034\") " pod="kuadrant-system/authorino-operator-75cc8d5cb7-hkhlt" Jul 14 05:06:59.734135 ip-10-0-136-9 kubenswrapper[2584]: I0714 05:06:59.734053 2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-operator-75cc8d5cb7-hkhlt" Jul 14 05:06:59.895733 ip-10-0-136-9 kubenswrapper[2584]: I0714 05:06:59.895701 2584 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-operator-75cc8d5cb7-hkhlt"] Jul 14 05:06:59.898405 ip-10-0-136-9 kubenswrapper[2584]: W0714 05:06:59.898377 2584 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod13b189eb_052f_4108_a70e_49be5e405034.slice/crio-5f84970a9915af1cc8cfa9a500d622b814f61146264cdedb8829d6d935619dd4 WatchSource:0}: Error finding container 5f84970a9915af1cc8cfa9a500d622b814f61146264cdedb8829d6d935619dd4: Status 404 returned error can't find the container with id 5f84970a9915af1cc8cfa9a500d622b814f61146264cdedb8829d6d935619dd4 Jul 14 05:06:59.997630 ip-10-0-136-9 kubenswrapper[2584]: I0714 05:06:59.997543 2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-g257n_15609856-4056-487b-acdd-30276263b098/konnectivity-agent/0.log" limit=1024 Jul 14 05:07:00.106540 ip-10-0-136-9 kubenswrapper[2584]: I0714 05:07:00.106501 2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-g257n_15609856-4056-487b-acdd-30276263b098/konnectivity-agent/0.log" limit=1024 Jul 14 05:07:00.837923 ip-10-0-136-9 kubenswrapper[2584]: I0714 05:07:00.837872 2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-operator-75cc8d5cb7-hkhlt" event={"ID":"13b189eb-052f-4108-a70e-49be5e405034","Type":"ContainerStarted","Data":"5f84970a9915af1cc8cfa9a500d622b814f61146264cdedb8829d6d935619dd4"} Jul 14 05:07:01.032404 ip-10-0-136-9 kubenswrapper[2584]: I0714 05:07:01.032360 2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-g257n_15609856-4056-487b-acdd-30276263b098/konnectivity-agent/0.log" limit=1024 Jul 14 05:07:01.320157 ip-10-0-136-9 kubenswrapper[2584]: I0714 05:07:01.320065 2584 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/limitador-operator-controller-manager-859d7b78bd-lfvfs"] Jul 14 05:07:01.328916 ip-10-0-136-9 kubenswrapper[2584]: I0714 05:07:01.328879 2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-lfvfs" Jul 14 05:07:01.332138 ip-10-0-136-9 kubenswrapper[2584]: I0714 05:07:01.332008 2584 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"limitador-operator-controller-manager-dockercfg-g5n4h\"" Jul 14 05:07:01.333567 ip-10-0-136-9 kubenswrapper[2584]: I0714 05:07:01.333347 2584 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-operator-controller-manager-859d7b78bd-lfvfs"] Jul 14 05:07:01.458653 ip-10-0-136-9 kubenswrapper[2584]: I0714 05:07:01.458605 2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-mg4zb\" (UniqueName: \"kubernetes.io/projected/d3afc612-35fd-4a08-b3ab-06a88b02d777-kube-api-access-mg4zb\") pod \"limitador-operator-controller-manager-859d7b78bd-lfvfs\" (UID: \"d3afc612-35fd-4a08-b3ab-06a88b02d777\") " pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-lfvfs" Jul 14 05:07:01.559910 ip-10-0-136-9 kubenswrapper[2584]: I0714 05:07:01.559860 2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-mg4zb\" (UniqueName: \"kubernetes.io/projected/d3afc612-35fd-4a08-b3ab-06a88b02d777-kube-api-access-mg4zb\") pod \"limitador-operator-controller-manager-859d7b78bd-lfvfs\" (UID: \"d3afc612-35fd-4a08-b3ab-06a88b02d777\") " pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-lfvfs" Jul 14 05:07:01.574248 ip-10-0-136-9 kubenswrapper[2584]: I0714 05:07:01.574163 2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-mg4zb\" (UniqueName: \"kubernetes.io/projected/d3afc612-35fd-4a08-b3ab-06a88b02d777-kube-api-access-mg4zb\") pod \"limitador-operator-controller-manager-859d7b78bd-lfvfs\" (UID: \"d3afc612-35fd-4a08-b3ab-06a88b02d777\") " pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-lfvfs" Jul 14 05:07:01.644879 ip-10-0-136-9 kubenswrapper[2584]: I0714 05:07:01.644839 2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-lfvfs" Jul 14 05:07:02.421682 ip-10-0-136-9 kubenswrapper[2584]: I0714 05:07:02.421633 2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-g257n_15609856-4056-487b-acdd-30276263b098/konnectivity-agent/0.log" limit=1024 Jul 14 05:07:03.498490 ip-10-0-136-9 kubenswrapper[2584]: I0714 05:07:03.498447 2584 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-operator-controller-manager-859d7b78bd-lfvfs"] Jul 14 05:07:03.501041 ip-10-0-136-9 kubenswrapper[2584]: W0714 05:07:03.501007 2584 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podd3afc612_35fd_4a08_b3ab_06a88b02d777.slice/crio-4b7238181ab5e46934ea53d62a92d9ebae876e62216506c3a87fb048be70a9de WatchSource:0}: Error finding container 4b7238181ab5e46934ea53d62a92d9ebae876e62216506c3a87fb048be70a9de: Status 404 returned error can't find the container with id 4b7238181ab5e46934ea53d62a92d9ebae876e62216506c3a87fb048be70a9de Jul 14 05:07:03.631328 ip-10-0-136-9 kubenswrapper[2584]: I0714 05:07:03.631234 2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-g257n_15609856-4056-487b-acdd-30276263b098/konnectivity-agent/0.log" limit=1024 Jul 14 05:07:03.853686 ip-10-0-136-9 kubenswrapper[2584]: I0714 05:07:03.853645 2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-operator-75cc8d5cb7-hkhlt" event={"ID":"13b189eb-052f-4108-a70e-49be5e405034","Type":"ContainerStarted","Data":"96b887e4c8176720ae12b39e2b060fe8effbf798a15ce066fdd9d54e06602c82"} Jul 14 05:07:03.853903 ip-10-0-136-9 kubenswrapper[2584]: I0714 05:07:03.853798 2584 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/authorino-operator-75cc8d5cb7-hkhlt" Jul 14 05:07:03.855405 ip-10-0-136-9 kubenswrapper[2584]: I0714 05:07:03.855379 2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-xd8x8" event={"ID":"f0a682af-38b8-4bdc-ad52-2d02b666022d","Type":"ContainerStarted","Data":"c6591d5a87fb525f0cd46078f14839f65b43dfeeacdb081f7b74faa158c25210"} Jul 14 05:07:03.855551 ip-10-0-136-9 kubenswrapper[2584]: I0714 05:07:03.855432 2584 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-xd8x8" Jul 14 05:07:03.856631 ip-10-0-136-9 kubenswrapper[2584]: I0714 05:07:03.856612 2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-lfvfs" event={"ID":"d3afc612-35fd-4a08-b3ab-06a88b02d777","Type":"ContainerStarted","Data":"4b7238181ab5e46934ea53d62a92d9ebae876e62216506c3a87fb048be70a9de"} Jul 14 05:07:03.872075 ip-10-0-136-9 kubenswrapper[2584]: I0714 05:07:03.872019 2584 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/authorino-operator-75cc8d5cb7-hkhlt" podStartSLOduration=1.4180156369999999 podStartE2EDuration="4.872004793s" totalImagesPullingTime="3.453989156s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-14 05:06:59 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-14 05:07:03.87113362 +0000 UTC m=+484.832389326" watchObservedRunningTime="2026-07-14 05:07:03.872004793 +0000 UTC m=+484.833260475" Jul 14 05:07:03.892049 ip-10-0-136-9 kubenswrapper[2584]: I0714 05:07:03.891948 2584 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-xd8x8" podStartSLOduration=1.688728505 podStartE2EDuration="7.891913876s" totalImagesPullingTime="6.203185371s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-14 05:06:56 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-14 05:07:03.890978342 +0000 UTC m=+484.852234046" watchObservedRunningTime="2026-07-14 05:07:03.891913876 +0000 UTC m=+484.853169581" Jul 14 05:07:04.077073 ip-10-0-136-9 kubenswrapper[2584]: I0714 05:07:04.077038 2584 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/dns-operator-controller-manager-864dd78c4c-dgxt6"] Jul 14 05:07:04.080672 ip-10-0-136-9 kubenswrapper[2584]: I0714 05:07:04.080645 2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/dns-operator-controller-manager-864dd78c4c-dgxt6" Jul 14 05:07:04.084480 ip-10-0-136-9 kubenswrapper[2584]: I0714 05:07:04.084452 2584 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"dns-operator-controller-env\"" Jul 14 05:07:04.084645 ip-10-0-136-9 kubenswrapper[2584]: I0714 05:07:04.084500 2584 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"dns-operator-controller-manager-dockercfg-g524d\"" Jul 14 05:07:04.092795 ip-10-0-136-9 kubenswrapper[2584]: I0714 05:07:04.092744 2584 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/dns-operator-controller-manager-864dd78c4c-dgxt6"] Jul 14 05:07:04.182294 ip-10-0-136-9 kubenswrapper[2584]: I0714 05:07:04.182198 2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-4fszg\" (UniqueName: \"kubernetes.io/projected/0b75b949-775e-4ae8-8541-8fb677845271-kube-api-access-4fszg\") pod \"dns-operator-controller-manager-864dd78c4c-dgxt6\" (UID: \"0b75b949-775e-4ae8-8541-8fb677845271\") " pod="kuadrant-system/dns-operator-controller-manager-864dd78c4c-dgxt6" Jul 14 05:07:04.283559 ip-10-0-136-9 kubenswrapper[2584]: I0714 05:07:04.283511 2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-4fszg\" (UniqueName: \"kubernetes.io/projected/0b75b949-775e-4ae8-8541-8fb677845271-kube-api-access-4fszg\") pod \"dns-operator-controller-manager-864dd78c4c-dgxt6\" (UID: \"0b75b949-775e-4ae8-8541-8fb677845271\") " pod="kuadrant-system/dns-operator-controller-manager-864dd78c4c-dgxt6" Jul 14 05:07:04.292346 ip-10-0-136-9 kubenswrapper[2584]: I0714 05:07:04.292314 2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-4fszg\" (UniqueName: \"kubernetes.io/projected/0b75b949-775e-4ae8-8541-8fb677845271-kube-api-access-4fszg\") pod \"dns-operator-controller-manager-864dd78c4c-dgxt6\" (UID: \"0b75b949-775e-4ae8-8541-8fb677845271\") " pod="kuadrant-system/dns-operator-controller-manager-864dd78c4c-dgxt6" Jul 14 05:07:04.395695 ip-10-0-136-9 kubenswrapper[2584]: I0714 05:07:04.395646 2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/dns-operator-controller-manager-864dd78c4c-dgxt6" Jul 14 05:07:04.657198 ip-10-0-136-9 kubenswrapper[2584]: I0714 05:07:04.657170 2584 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/dns-operator-controller-manager-864dd78c4c-dgxt6"] Jul 14 05:07:04.659607 ip-10-0-136-9 kubenswrapper[2584]: W0714 05:07:04.659581 2584 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod0b75b949_775e_4ae8_8541_8fb677845271.slice/crio-1c28393124d9248a681cf8cea11221236313195764f6d847ff1f1faf1630fc2c WatchSource:0}: Error finding container 1c28393124d9248a681cf8cea11221236313195764f6d847ff1f1faf1630fc2c: Status 404 returned error can't find the container with id 1c28393124d9248a681cf8cea11221236313195764f6d847ff1f1faf1630fc2c Jul 14 05:07:04.867191 ip-10-0-136-9 kubenswrapper[2584]: I0714 05:07:04.867147 2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/dns-operator-controller-manager-864dd78c4c-dgxt6" event={"ID":"0b75b949-775e-4ae8-8541-8fb677845271","Type":"ContainerStarted","Data":"1c28393124d9248a681cf8cea11221236313195764f6d847ff1f1faf1630fc2c"} Jul 14 05:07:05.875871 ip-10-0-136-9 kubenswrapper[2584]: I0714 05:07:05.875831 2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-lfvfs" event={"ID":"d3afc612-35fd-4a08-b3ab-06a88b02d777","Type":"ContainerStarted","Data":"3eb31dcacb26f00202e73303a1c3009de674473bdc37a5dca9b526795cbbaf87"} Jul 14 05:07:05.876336 ip-10-0-136-9 kubenswrapper[2584]: I0714 05:07:05.875998 2584 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-lfvfs" Jul 14 05:07:05.896683 ip-10-0-136-9 kubenswrapper[2584]: I0714 05:07:05.896583 2584 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-lfvfs" podStartSLOduration=2.82515799 podStartE2EDuration="4.896561366s" totalImagesPullingTime="2.071403376s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-14 05:07:01 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-14 05:07:05.89527109 +0000 UTC m=+486.856526815" watchObservedRunningTime="2026-07-14 05:07:05.896561366 +0000 UTC m=+486.857817071" Jul 14 05:07:06.262740 ip-10-0-136-9 kubenswrapper[2584]: I0714 05:07:06.262648 2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-g257n_15609856-4056-487b-acdd-30276263b098/konnectivity-agent/0.log" limit=1024 Jul 14 05:07:06.340666 ip-10-0-136-9 kubenswrapper[2584]: I0714 05:07:06.340624 2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-g257n_15609856-4056-487b-acdd-30276263b098/konnectivity-agent/0.log" limit=1024 Jul 14 05:07:06.473657 ip-10-0-136-9 kubenswrapper[2584]: I0714 05:07:06.473613 2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-g257n_15609856-4056-487b-acdd-30276263b098/konnectivity-agent/0.log" limit=1024 Jul 14 05:07:06.803308 ip-10-0-136-9 kubenswrapper[2584]: I0714 05:07:06.803252 2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-g257n_15609856-4056-487b-acdd-30276263b098/konnectivity-agent/0.log" limit=1024 Jul 14 05:07:07.887504 ip-10-0-136-9 kubenswrapper[2584]: I0714 05:07:07.887473 2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/dns-operator-controller-manager-864dd78c4c-dgxt6" event={"ID":"0b75b949-775e-4ae8-8541-8fb677845271","Type":"ContainerStarted","Data":"8e3eaa481283d4696ae3445a820a32ff32501f3958e8800078c575a0ef25d387"} Jul 14 05:07:07.887913 ip-10-0-136-9 kubenswrapper[2584]: I0714 05:07:07.887547 2584 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/dns-operator-controller-manager-864dd78c4c-dgxt6" Jul 14 05:07:07.906396 ip-10-0-136-9 kubenswrapper[2584]: I0714 05:07:07.906335 2584 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/dns-operator-controller-manager-864dd78c4c-dgxt6" podStartSLOduration=1.528986042 podStartE2EDuration="3.90631811s" totalImagesPullingTime="2.377332068s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-14 05:07:04 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-14 05:07:07.905458676 +0000 UTC m=+488.866714421" watchObservedRunningTime="2026-07-14 05:07:07.90631811 +0000 UTC m=+488.867573815" Jul 14 05:07:10.460385 ip-10-0-136-9 kubenswrapper[2584]: I0714 05:07:10.460341 2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-g257n_15609856-4056-487b-acdd-30276263b098/konnectivity-agent/0.log" limit=1024 Jul 14 05:07:10.560556 ip-10-0-136-9 kubenswrapper[2584]: I0714 05:07:10.560517 2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-g257n_15609856-4056-487b-acdd-30276263b098/konnectivity-agent/0.log" limit=1024 Jul 14 05:07:14.869403 ip-10-0-136-9 kubenswrapper[2584]: I0714 05:07:14.869372 2584 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-xd8x8" Jul 14 05:07:14.869812 ip-10-0-136-9 kubenswrapper[2584]: I0714 05:07:14.869456 2584 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/authorino-operator-75cc8d5cb7-hkhlt" Jul 14 05:07:16.192941 ip-10-0-136-9 kubenswrapper[2584]: I0714 05:07:16.192903 2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-g257n_15609856-4056-487b-acdd-30276263b098/konnectivity-agent/0.log" limit=1024 Jul 14 05:07:16.322944 ip-10-0-136-9 kubenswrapper[2584]: I0714 05:07:16.322899 2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-g257n_15609856-4056-487b-acdd-30276263b098/konnectivity-agent/0.log" limit=1024 Jul 14 05:07:16.694023 ip-10-0-136-9 kubenswrapper[2584]: I0714 05:07:16.693984 2584 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-xd8x8"] Jul 14 05:07:16.694229 ip-10-0-136-9 kubenswrapper[2584]: I0714 05:07:16.694207 2584 kuberuntime_container.go:873] "Killing container with a grace period" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-xd8x8" podUID="f0a682af-38b8-4bdc-ad52-2d02b666022d" containerName="manager" containerID="cri-o://c6591d5a87fb525f0cd46078f14839f65b43dfeeacdb081f7b74faa158c25210" gracePeriod=2 Jul 14 05:07:16.703724 ip-10-0-136-9 kubenswrapper[2584]: I0714 05:07:16.703690 2584 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-xd8x8"] Jul 14 05:07:16.705850 ip-10-0-136-9 kubenswrapper[2584]: E0714 05:07:16.705816 2584 status_manager.go:1041] "Failed to update status for pod" err="failed to patch status \"{\\\"metadata\\\":{\\\"uid\\\":\\\"f0a682af-38b8-4bdc-ad52-2d02b666022d\\\"},\\\"status\\\":{\\\"$setElementOrder/conditions\\\":[{\\\"type\\\":\\\"PodReadyToStartContainers\\\"},{\\\"type\\\":\\\"Initialized\\\"},{\\\"type\\\":\\\"Ready\\\"},{\\\"type\\\":\\\"ContainersReady\\\"},{\\\"type\\\":\\\"PodScheduled\\\"}],\\\"conditions\\\":[{\\\"observedGeneration\\\":2,\\\"type\\\":\\\"PodReadyToStartContainers\\\"},{\\\"observedGeneration\\\":2,\\\"type\\\":\\\"Initialized\\\"},{\\\"observedGeneration\\\":2,\\\"type\\\":\\\"Ready\\\"},{\\\"observedGeneration\\\":2,\\\"type\\\":\\\"ContainersReady\\\"},{\\\"observedGeneration\\\":2,\\\"type\\\":\\\"PodScheduled\\\"}],\\\"observedGeneration\\\":2}}\" for pod \"kuadrant-system\"/\"kuadrant-operator-controller-manager-8684c9ff49-xd8x8\": pods \"kuadrant-operator-controller-manager-8684c9ff49-xd8x8\" not found" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-xd8x8" Jul 14 05:07:16.715861 ip-10-0-136-9 kubenswrapper[2584]: I0714 05:07:16.715824 2584 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/limitador-operator-controller-manager-859d7b78bd-lfvfs"] Jul 14 05:07:16.716296 ip-10-0-136-9 kubenswrapper[2584]: I0714 05:07:16.716096 2584 kuberuntime_container.go:873] "Killing container with a grace period" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-lfvfs" podUID="d3afc612-35fd-4a08-b3ab-06a88b02d777" containerName="manager" containerID="cri-o://3eb31dcacb26f00202e73303a1c3009de674473bdc37a5dca9b526795cbbaf87" gracePeriod=2 Jul 14 05:07:16.719210 ip-10-0-136-9 kubenswrapper[2584]: E0714 05:07:16.718825 2584 status_manager.go:1018] "Failed to get status for pod" err="pods \"kuadrant-operator-controller-manager-8684c9ff49-xd8x8\" is forbidden: User \"system:node:ip-10-0-136-9.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-136-9.ec2.internal' and this object" podUID="f0a682af-38b8-4bdc-ad52-2d02b666022d" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-xd8x8" Jul 14 05:07:16.719857 ip-10-0-136-9 kubenswrapper[2584]: I0714 05:07:16.719834 2584 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-lfvfs" Jul 14 05:07:16.721434 ip-10-0-136-9 kubenswrapper[2584]: I0714 05:07:16.721406 2584 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-7mw5n"] Jul 14 05:07:16.722189 ip-10-0-136-9 kubenswrapper[2584]: I0714 05:07:16.722170 2584 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="f0a682af-38b8-4bdc-ad52-2d02b666022d" containerName="manager" Jul 14 05:07:16.722292 ip-10-0-136-9 kubenswrapper[2584]: I0714 05:07:16.722281 2584 state_mem.go:107] "Deleted CPUSet assignment" podUID="f0a682af-38b8-4bdc-ad52-2d02b666022d" containerName="manager" Jul 14 05:07:16.722483 ip-10-0-136-9 kubenswrapper[2584]: I0714 05:07:16.722473 2584 memory_manager.go:368] "RemoveStaleState removing state" podUID="f0a682af-38b8-4bdc-ad52-2d02b666022d" containerName="manager" Jul 14 05:07:16.728809 ip-10-0-136-9 kubenswrapper[2584]: I0714 05:07:16.728783 2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-7mw5n" Jul 14 05:07:16.729150 ip-10-0-136-9 kubenswrapper[2584]: I0714 05:07:16.729118 2584 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/limitador-operator-controller-manager-859d7b78bd-lfvfs"] Jul 14 05:07:16.730329 ip-10-0-136-9 kubenswrapper[2584]: E0714 05:07:16.729763 2584 status_manager.go:1041] "Failed to update status for pod" err="failed to patch status \"{\\\"metadata\\\":{\\\"uid\\\":\\\"d3afc612-35fd-4a08-b3ab-06a88b02d777\\\"},\\\"status\\\":{\\\"$setElementOrder/conditions\\\":[{\\\"type\\\":\\\"PodReadyToStartContainers\\\"},{\\\"type\\\":\\\"Initialized\\\"},{\\\"type\\\":\\\"Ready\\\"},{\\\"type\\\":\\\"ContainersReady\\\"},{\\\"type\\\":\\\"PodScheduled\\\"}],\\\"conditions\\\":[{\\\"observedGeneration\\\":2,\\\"type\\\":\\\"PodReadyToStartContainers\\\"},{\\\"observedGeneration\\\":2,\\\"type\\\":\\\"Initialized\\\"},{\\\"observedGeneration\\\":2,\\\"type\\\":\\\"Ready\\\"},{\\\"observedGeneration\\\":2,\\\"type\\\":\\\"ContainersReady\\\"},{\\\"observedGeneration\\\":2,\\\"type\\\":\\\"PodScheduled\\\"}],\\\"observedGeneration\\\":2}}\" for pod \"kuadrant-system\"/\"limitador-operator-controller-manager-859d7b78bd-lfvfs\": pods \"limitador-operator-controller-manager-859d7b78bd-lfvfs\" not found" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-lfvfs" Jul 14 05:07:16.732414 ip-10-0-136-9 kubenswrapper[2584]: E0714 05:07:16.732171 2584 status_manager.go:1018] "Failed to get status for pod" err="pods \"limitador-operator-controller-manager-859d7b78bd-lfvfs\" is forbidden: User \"system:node:ip-10-0-136-9.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-136-9.ec2.internal' and this object" podUID="d3afc612-35fd-4a08-b3ab-06a88b02d777" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-lfvfs" Jul 14 05:07:16.734594 ip-10-0-136-9 kubenswrapper[2584]: E0714 05:07:16.734479 2584 status_manager.go:1018] "Failed to get status for pod" err="pods \"kuadrant-operator-controller-manager-8684c9ff49-xd8x8\" is forbidden: User \"system:node:ip-10-0-136-9.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-136-9.ec2.internal' and this object" podUID="f0a682af-38b8-4bdc-ad52-2d02b666022d" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-xd8x8" Jul 14 05:07:16.738478 ip-10-0-136-9 kubenswrapper[2584]: I0714 05:07:16.738372 2584 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-7mw5n"] Jul 14 05:07:16.743696 ip-10-0-136-9 kubenswrapper[2584]: I0714 05:07:16.743673 2584 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/limitador-operator-controller-manager-859d7b78bd-74x4l"] Jul 14 05:07:16.744073 ip-10-0-136-9 kubenswrapper[2584]: I0714 05:07:16.744059 2584 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="d3afc612-35fd-4a08-b3ab-06a88b02d777" containerName="manager" Jul 14 05:07:16.744073 ip-10-0-136-9 kubenswrapper[2584]: I0714 05:07:16.744072 2584 state_mem.go:107] "Deleted CPUSet assignment" podUID="d3afc612-35fd-4a08-b3ab-06a88b02d777" containerName="manager" Jul 14 05:07:16.744212 ip-10-0-136-9 kubenswrapper[2584]: I0714 05:07:16.744144 2584 memory_manager.go:368] "RemoveStaleState removing state" podUID="d3afc612-35fd-4a08-b3ab-06a88b02d777" containerName="manager" Jul 14 05:07:16.747052 ip-10-0-136-9 kubenswrapper[2584]: I0714 05:07:16.747032 2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-74x4l" Jul 14 05:07:16.758666 ip-10-0-136-9 kubenswrapper[2584]: I0714 05:07:16.758635 2584 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-operator-controller-manager-859d7b78bd-74x4l"] Jul 14 05:07:16.763077 ip-10-0-136-9 kubenswrapper[2584]: E0714 05:07:16.763037 2584 status_manager.go:1018] "Failed to get status for pod" err="pods \"limitador-operator-controller-manager-859d7b78bd-lfvfs\" is forbidden: User \"system:node:ip-10-0-136-9.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-136-9.ec2.internal' and this object" podUID="d3afc612-35fd-4a08-b3ab-06a88b02d777" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-lfvfs" Jul 14 05:07:16.786089 ip-10-0-136-9 kubenswrapper[2584]: E0714 05:07:16.786041 2584 status_manager.go:1018] "Failed to get status for pod" err="pods \"kuadrant-operator-controller-manager-8684c9ff49-xd8x8\" is forbidden: User \"system:node:ip-10-0-136-9.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-136-9.ec2.internal' and this object" podUID="f0a682af-38b8-4bdc-ad52-2d02b666022d" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-xd8x8" Jul 14 05:07:16.788354 ip-10-0-136-9 kubenswrapper[2584]: I0714 05:07:16.788323 2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/0afbd3c9-0952-4fdf-b8b4-5b2109205264-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-8684c9ff49-7mw5n\" (UID: \"0afbd3c9-0952-4fdf-b8b4-5b2109205264\") " pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-7mw5n" Jul 14 05:07:16.788498 ip-10-0-136-9 kubenswrapper[2584]: I0714 05:07:16.788381 2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-5kqdn\" (UniqueName: \"kubernetes.io/projected/0afbd3c9-0952-4fdf-b8b4-5b2109205264-kube-api-access-5kqdn\") pod \"kuadrant-operator-controller-manager-8684c9ff49-7mw5n\" (UID: \"0afbd3c9-0952-4fdf-b8b4-5b2109205264\") " pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-7mw5n" Jul 14 05:07:16.788498 ip-10-0-136-9 kubenswrapper[2584]: I0714 05:07:16.788432 2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-pqfmp\" (UniqueName: \"kubernetes.io/projected/82bd2345-69fa-4478-9a0e-3cec1e4d68c9-kube-api-access-pqfmp\") pod \"limitador-operator-controller-manager-859d7b78bd-74x4l\" (UID: \"82bd2345-69fa-4478-9a0e-3cec1e4d68c9\") " pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-74x4l" Jul 14 05:07:16.890160 ip-10-0-136-9 kubenswrapper[2584]: I0714 05:07:16.889558 2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/0afbd3c9-0952-4fdf-b8b4-5b2109205264-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-8684c9ff49-7mw5n\" (UID: \"0afbd3c9-0952-4fdf-b8b4-5b2109205264\") " pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-7mw5n" Jul 14 05:07:16.890160 ip-10-0-136-9 kubenswrapper[2584]: I0714 05:07:16.889650 2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-5kqdn\" (UniqueName: \"kubernetes.io/projected/0afbd3c9-0952-4fdf-b8b4-5b2109205264-kube-api-access-5kqdn\") pod \"kuadrant-operator-controller-manager-8684c9ff49-7mw5n\" (UID: \"0afbd3c9-0952-4fdf-b8b4-5b2109205264\") " pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-7mw5n" Jul 14 05:07:16.890160 ip-10-0-136-9 kubenswrapper[2584]: I0714 05:07:16.889704 2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-pqfmp\" (UniqueName: \"kubernetes.io/projected/82bd2345-69fa-4478-9a0e-3cec1e4d68c9-kube-api-access-pqfmp\") pod \"limitador-operator-controller-manager-859d7b78bd-74x4l\" (UID: \"82bd2345-69fa-4478-9a0e-3cec1e4d68c9\") " pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-74x4l" Jul 14 05:07:16.890160 ip-10-0-136-9 kubenswrapper[2584]: I0714 05:07:16.890030 2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/0afbd3c9-0952-4fdf-b8b4-5b2109205264-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-8684c9ff49-7mw5n\" (UID: \"0afbd3c9-0952-4fdf-b8b4-5b2109205264\") " pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-7mw5n" Jul 14 05:07:16.905261 ip-10-0-136-9 kubenswrapper[2584]: I0714 05:07:16.905223 2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-pqfmp\" (UniqueName: \"kubernetes.io/projected/82bd2345-69fa-4478-9a0e-3cec1e4d68c9-kube-api-access-pqfmp\") pod \"limitador-operator-controller-manager-859d7b78bd-74x4l\" (UID: \"82bd2345-69fa-4478-9a0e-3cec1e4d68c9\") " pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-74x4l" Jul 14 05:07:16.906058 ip-10-0-136-9 kubenswrapper[2584]: I0714 05:07:16.906020 2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-5kqdn\" (UniqueName: \"kubernetes.io/projected/0afbd3c9-0952-4fdf-b8b4-5b2109205264-kube-api-access-5kqdn\") pod \"kuadrant-operator-controller-manager-8684c9ff49-7mw5n\" (UID: \"0afbd3c9-0952-4fdf-b8b4-5b2109205264\") " pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-7mw5n" Jul 14 05:07:16.934226 ip-10-0-136-9 kubenswrapper[2584]: I0714 05:07:16.934190 2584 generic.go:356] "Generic (PLEG): container finished" podID="d3afc612-35fd-4a08-b3ab-06a88b02d777" containerID="3eb31dcacb26f00202e73303a1c3009de674473bdc37a5dca9b526795cbbaf87" exitCode=0 Jul 14 05:07:16.936156 ip-10-0-136-9 kubenswrapper[2584]: I0714 05:07:16.936121 2584 generic.go:356] "Generic (PLEG): container finished" podID="f0a682af-38b8-4bdc-ad52-2d02b666022d" containerID="c6591d5a87fb525f0cd46078f14839f65b43dfeeacdb081f7b74faa158c25210" exitCode=0 Jul 14 05:07:16.962633 ip-10-0-136-9 kubenswrapper[2584]: I0714 05:07:16.962605 2584 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-xd8x8" Jul 14 05:07:16.964662 ip-10-0-136-9 kubenswrapper[2584]: I0714 05:07:16.964645 2584 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-lfvfs" Jul 14 05:07:16.965080 ip-10-0-136-9 kubenswrapper[2584]: E0714 05:07:16.965057 2584 status_manager.go:1018] "Failed to get status for pod" err="pods \"limitador-operator-controller-manager-859d7b78bd-lfvfs\" is forbidden: User \"system:node:ip-10-0-136-9.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-136-9.ec2.internal' and this object" podUID="d3afc612-35fd-4a08-b3ab-06a88b02d777" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-lfvfs" Jul 14 05:07:16.967104 ip-10-0-136-9 kubenswrapper[2584]: E0714 05:07:16.967083 2584 status_manager.go:1018] "Failed to get status for pod" err="pods \"kuadrant-operator-controller-manager-8684c9ff49-xd8x8\" is forbidden: User \"system:node:ip-10-0-136-9.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-136-9.ec2.internal' and this object" podUID="f0a682af-38b8-4bdc-ad52-2d02b666022d" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-xd8x8" Jul 14 05:07:16.969390 ip-10-0-136-9 kubenswrapper[2584]: E0714 05:07:16.969367 2584 status_manager.go:1018] "Failed to get status for pod" err="pods \"limitador-operator-controller-manager-859d7b78bd-lfvfs\" is forbidden: User \"system:node:ip-10-0-136-9.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-136-9.ec2.internal' and this object" podUID="d3afc612-35fd-4a08-b3ab-06a88b02d777" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-lfvfs" Jul 14 05:07:16.974662 ip-10-0-136-9 kubenswrapper[2584]: E0714 05:07:16.974637 2584 status_manager.go:1018] "Failed to get status for pod" err="pods \"kuadrant-operator-controller-manager-8684c9ff49-xd8x8\" is forbidden: User \"system:node:ip-10-0-136-9.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-136-9.ec2.internal' and this object" podUID="f0a682af-38b8-4bdc-ad52-2d02b666022d" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-xd8x8" Jul 14 05:07:16.991082 ip-10-0-136-9 kubenswrapper[2584]: I0714 05:07:16.991051 2584 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-97gzq\" (UniqueName: \"kubernetes.io/projected/f0a682af-38b8-4bdc-ad52-2d02b666022d-kube-api-access-97gzq\") pod \"f0a682af-38b8-4bdc-ad52-2d02b666022d\" (UID: \"f0a682af-38b8-4bdc-ad52-2d02b666022d\") " Jul 14 05:07:16.991228 ip-10-0-136-9 kubenswrapper[2584]: I0714 05:07:16.991145 2584 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/f0a682af-38b8-4bdc-ad52-2d02b666022d-extensions-socket-volume\") pod \"f0a682af-38b8-4bdc-ad52-2d02b666022d\" (UID: \"f0a682af-38b8-4bdc-ad52-2d02b666022d\") " Jul 14 05:07:16.991228 ip-10-0-136-9 kubenswrapper[2584]: I0714 05:07:16.991167 2584 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-mg4zb\" (UniqueName: \"kubernetes.io/projected/d3afc612-35fd-4a08-b3ab-06a88b02d777-kube-api-access-mg4zb\") pod \"d3afc612-35fd-4a08-b3ab-06a88b02d777\" (UID: \"d3afc612-35fd-4a08-b3ab-06a88b02d777\") " Jul 14 05:07:16.991674 ip-10-0-136-9 kubenswrapper[2584]: I0714 05:07:16.991633 2584 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/f0a682af-38b8-4bdc-ad52-2d02b666022d-extensions-socket-volume" (OuterVolumeSpecName: "extensions-socket-volume") pod "f0a682af-38b8-4bdc-ad52-2d02b666022d" (UID: "f0a682af-38b8-4bdc-ad52-2d02b666022d"). InnerVolumeSpecName "extensions-socket-volume". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 14 05:07:16.993307 ip-10-0-136-9 kubenswrapper[2584]: I0714 05:07:16.993281 2584 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/d3afc612-35fd-4a08-b3ab-06a88b02d777-kube-api-access-mg4zb" (OuterVolumeSpecName: "kube-api-access-mg4zb") pod "d3afc612-35fd-4a08-b3ab-06a88b02d777" (UID: "d3afc612-35fd-4a08-b3ab-06a88b02d777"). InnerVolumeSpecName "kube-api-access-mg4zb". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 14 05:07:16.993307 ip-10-0-136-9 kubenswrapper[2584]: I0714 05:07:16.993295 2584 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/f0a682af-38b8-4bdc-ad52-2d02b666022d-kube-api-access-97gzq" (OuterVolumeSpecName: "kube-api-access-97gzq") pod "f0a682af-38b8-4bdc-ad52-2d02b666022d" (UID: "f0a682af-38b8-4bdc-ad52-2d02b666022d"). InnerVolumeSpecName "kube-api-access-97gzq". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 14 05:07:17.091964 ip-10-0-136-9 kubenswrapper[2584]: I0714 05:07:17.091887 2584 reconciler_common.go:299] "Volume detached for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/f0a682af-38b8-4bdc-ad52-2d02b666022d-extensions-socket-volume\") on node \"ip-10-0-136-9.ec2.internal\" DevicePath \"\"" Jul 14 05:07:17.091964 ip-10-0-136-9 kubenswrapper[2584]: I0714 05:07:17.091968 2584 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-mg4zb\" (UniqueName: \"kubernetes.io/projected/d3afc612-35fd-4a08-b3ab-06a88b02d777-kube-api-access-mg4zb\") on node \"ip-10-0-136-9.ec2.internal\" DevicePath \"\"" Jul 14 05:07:17.091964 ip-10-0-136-9 kubenswrapper[2584]: I0714 05:07:17.091979 2584 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-97gzq\" (UniqueName: \"kubernetes.io/projected/f0a682af-38b8-4bdc-ad52-2d02b666022d-kube-api-access-97gzq\") on node \"ip-10-0-136-9.ec2.internal\" DevicePath \"\"" Jul 14 05:07:17.125106 ip-10-0-136-9 kubenswrapper[2584]: I0714 05:07:17.125069 2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-7mw5n" Jul 14 05:07:17.134117 ip-10-0-136-9 kubenswrapper[2584]: I0714 05:07:17.134094 2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-74x4l" Jul 14 05:07:17.298176 ip-10-0-136-9 kubenswrapper[2584]: I0714 05:07:17.298147 2584 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-operator-controller-manager-859d7b78bd-74x4l"] Jul 14 05:07:17.300454 ip-10-0-136-9 kubenswrapper[2584]: W0714 05:07:17.300419 2584 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod82bd2345_69fa_4478_9a0e_3cec1e4d68c9.slice/crio-27dfdfc08f01db789243ea764618ec9f153421c2a4cefdc35ad7d2a865636f69 WatchSource:0}: Error finding container 27dfdfc08f01db789243ea764618ec9f153421c2a4cefdc35ad7d2a865636f69: Status 404 returned error can't find the container with id 27dfdfc08f01db789243ea764618ec9f153421c2a4cefdc35ad7d2a865636f69 Jul 14 05:07:17.327134 ip-10-0-136-9 kubenswrapper[2584]: I0714 05:07:17.327110 2584 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-7mw5n"] Jul 14 05:07:17.332095 ip-10-0-136-9 kubenswrapper[2584]: W0714 05:07:17.332066 2584 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod0afbd3c9_0952_4fdf_b8b4_5b2109205264.slice/crio-8825aa03e03d66272e6327c2f44dfb44259175649616722513c439606fcd2b3e WatchSource:0}: Error finding container 8825aa03e03d66272e6327c2f44dfb44259175649616722513c439606fcd2b3e: Status 404 returned error can't find the container with id 8825aa03e03d66272e6327c2f44dfb44259175649616722513c439606fcd2b3e Jul 14 05:07:17.530260 ip-10-0-136-9 kubenswrapper[2584]: I0714 05:07:17.530180 2584 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="d3afc612-35fd-4a08-b3ab-06a88b02d777" path="/var/lib/kubelet/pods/d3afc612-35fd-4a08-b3ab-06a88b02d777/volumes" Jul 14 05:07:17.530539 ip-10-0-136-9 kubenswrapper[2584]: I0714 05:07:17.530527 2584 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="f0a682af-38b8-4bdc-ad52-2d02b666022d" path="/var/lib/kubelet/pods/f0a682af-38b8-4bdc-ad52-2d02b666022d/volumes" Jul 14 05:07:17.942457 ip-10-0-136-9 kubenswrapper[2584]: I0714 05:07:17.942428 2584 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-xd8x8" Jul 14 05:07:17.942457 ip-10-0-136-9 kubenswrapper[2584]: I0714 05:07:17.942447 2584 scope.go:117] "RemoveContainer" containerID="c6591d5a87fb525f0cd46078f14839f65b43dfeeacdb081f7b74faa158c25210" Jul 14 05:07:17.948024 ip-10-0-136-9 kubenswrapper[2584]: I0714 05:07:17.947980 2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-74x4l" event={"ID":"82bd2345-69fa-4478-9a0e-3cec1e4d68c9","Type":"ContainerStarted","Data":"4a4cb99c02eeab1cc0cfddb8fe815558f4a4555c42dec71bcedf657fd0425631"} Jul 14 05:07:17.948185 ip-10-0-136-9 kubenswrapper[2584]: I0714 05:07:17.948046 2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-74x4l" event={"ID":"82bd2345-69fa-4478-9a0e-3cec1e4d68c9","Type":"ContainerStarted","Data":"27dfdfc08f01db789243ea764618ec9f153421c2a4cefdc35ad7d2a865636f69"} Jul 14 05:07:17.948256 ip-10-0-136-9 kubenswrapper[2584]: I0714 05:07:17.948243 2584 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-74x4l" Jul 14 05:07:17.949597 ip-10-0-136-9 kubenswrapper[2584]: I0714 05:07:17.949580 2584 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-lfvfs" Jul 14 05:07:17.951428 ip-10-0-136-9 kubenswrapper[2584]: I0714 05:07:17.951399 2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-7mw5n" event={"ID":"0afbd3c9-0952-4fdf-b8b4-5b2109205264","Type":"ContainerStarted","Data":"caccabf5c0c4a625ab7f893369fe8eb687472e88776e59728f239441d66eaec2"} Jul 14 05:07:17.951535 ip-10-0-136-9 kubenswrapper[2584]: I0714 05:07:17.951450 2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-7mw5n" event={"ID":"0afbd3c9-0952-4fdf-b8b4-5b2109205264","Type":"ContainerStarted","Data":"8825aa03e03d66272e6327c2f44dfb44259175649616722513c439606fcd2b3e"} Jul 14 05:07:17.951611 ip-10-0-136-9 kubenswrapper[2584]: I0714 05:07:17.951561 2584 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-7mw5n" Jul 14 05:07:17.954950 ip-10-0-136-9 kubenswrapper[2584]: I0714 05:07:17.954921 2584 scope.go:117] "RemoveContainer" containerID="3eb31dcacb26f00202e73303a1c3009de674473bdc37a5dca9b526795cbbaf87" Jul 14 05:07:17.972655 ip-10-0-136-9 kubenswrapper[2584]: I0714 05:07:17.972601 2584 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-74x4l" podStartSLOduration=1.972583843 podStartE2EDuration="1.972583843s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-14 05:07:16 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-14 05:07:17.970879034 +0000 UTC m=+498.932134738" watchObservedRunningTime="2026-07-14 05:07:17.972583843 +0000 UTC m=+498.933839538" Jul 14 05:07:17.981472 ip-10-0-136-9 kubenswrapper[2584]: I0714 05:07:17.981441 2584 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-86878c769f-jr6zj"] Jul 14 05:07:17.986037 ip-10-0-136-9 kubenswrapper[2584]: I0714 05:07:17.986015 2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-jr6zj" Jul 14 05:07:17.992839 ip-10-0-136-9 kubenswrapper[2584]: I0714 05:07:17.992791 2584 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-7mw5n" podStartSLOduration=1.992774115 podStartE2EDuration="1.992774115s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-14 05:07:16 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-14 05:07:17.991612032 +0000 UTC m=+498.952867737" watchObservedRunningTime="2026-07-14 05:07:17.992774115 +0000 UTC m=+498.954029819" Jul 14 05:07:17.999577 ip-10-0-136-9 kubenswrapper[2584]: I0714 05:07:17.999553 2584 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-86878c769f-jr6zj"] Jul 14 05:07:18.105301 ip-10-0-136-9 kubenswrapper[2584]: I0714 05:07:18.105258 2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/e567720d-9691-47a0-b435-d71eea552638-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-86878c769f-jr6zj\" (UID: \"e567720d-9691-47a0-b435-d71eea552638\") " pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-jr6zj" Jul 14 05:07:18.105301 ip-10-0-136-9 kubenswrapper[2584]: I0714 05:07:18.105300 2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-wd8bc\" (UniqueName: \"kubernetes.io/projected/e567720d-9691-47a0-b435-d71eea552638-kube-api-access-wd8bc\") pod \"kuadrant-operator-controller-manager-86878c769f-jr6zj\" (UID: \"e567720d-9691-47a0-b435-d71eea552638\") " pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-jr6zj" Jul 14 05:07:18.206581 ip-10-0-136-9 kubenswrapper[2584]: I0714 05:07:18.206489 2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/e567720d-9691-47a0-b435-d71eea552638-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-86878c769f-jr6zj\" (UID: \"e567720d-9691-47a0-b435-d71eea552638\") " pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-jr6zj" Jul 14 05:07:18.206581 ip-10-0-136-9 kubenswrapper[2584]: I0714 05:07:18.206527 2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-wd8bc\" (UniqueName: \"kubernetes.io/projected/e567720d-9691-47a0-b435-d71eea552638-kube-api-access-wd8bc\") pod \"kuadrant-operator-controller-manager-86878c769f-jr6zj\" (UID: \"e567720d-9691-47a0-b435-d71eea552638\") " pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-jr6zj" Jul 14 05:07:18.206927 ip-10-0-136-9 kubenswrapper[2584]: I0714 05:07:18.206908 2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/e567720d-9691-47a0-b435-d71eea552638-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-86878c769f-jr6zj\" (UID: \"e567720d-9691-47a0-b435-d71eea552638\") " pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-jr6zj" Jul 14 05:07:18.215310 ip-10-0-136-9 kubenswrapper[2584]: I0714 05:07:18.215283 2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-wd8bc\" (UniqueName: \"kubernetes.io/projected/e567720d-9691-47a0-b435-d71eea552638-kube-api-access-wd8bc\") pod \"kuadrant-operator-controller-manager-86878c769f-jr6zj\" (UID: \"e567720d-9691-47a0-b435-d71eea552638\") " pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-jr6zj" Jul 14 05:07:18.298496 ip-10-0-136-9 kubenswrapper[2584]: I0714 05:07:18.298460 2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-jr6zj" Jul 14 05:07:18.442020 ip-10-0-136-9 kubenswrapper[2584]: I0714 05:07:18.441994 2584 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-86878c769f-jr6zj"] Jul 14 05:07:18.445035 ip-10-0-136-9 kubenswrapper[2584]: W0714 05:07:18.445004 2584 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pode567720d_9691_47a0_b435_d71eea552638.slice/crio-2db0ed6656f60295e6b3e0d9232a7acb351c97e11de6304b71642e491eb2688a WatchSource:0}: Error finding container 2db0ed6656f60295e6b3e0d9232a7acb351c97e11de6304b71642e491eb2688a: Status 404 returned error can't find the container with id 2db0ed6656f60295e6b3e0d9232a7acb351c97e11de6304b71642e491eb2688a Jul 14 05:07:18.895091 ip-10-0-136-9 kubenswrapper[2584]: I0714 05:07:18.895059 2584 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/dns-operator-controller-manager-864dd78c4c-dgxt6" Jul 14 05:07:18.958564 ip-10-0-136-9 kubenswrapper[2584]: I0714 05:07:18.958526 2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-jr6zj" event={"ID":"e567720d-9691-47a0-b435-d71eea552638","Type":"ContainerStarted","Data":"b7006196e09439ab0e923c95ba0109da94f4d651bb77bd3c408e5e957e9043b3"} Jul 14 05:07:18.958745 ip-10-0-136-9 kubenswrapper[2584]: I0714 05:07:18.958592 2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-jr6zj" event={"ID":"e567720d-9691-47a0-b435-d71eea552638","Type":"ContainerStarted","Data":"2db0ed6656f60295e6b3e0d9232a7acb351c97e11de6304b71642e491eb2688a"} Jul 14 05:07:18.958745 ip-10-0-136-9 kubenswrapper[2584]: I0714 05:07:18.958627 2584 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-jr6zj" Jul 14 05:07:18.976302 ip-10-0-136-9 kubenswrapper[2584]: I0714 05:07:18.976239 2584 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-jr6zj" podStartSLOduration=1.976221185 podStartE2EDuration="1.976221185s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-14 05:07:17 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-14 05:07:18.975236984 +0000 UTC m=+499.936492689" watchObservedRunningTime="2026-07-14 05:07:18.976221185 +0000 UTC m=+499.937476888" Jul 14 05:07:19.206444 ip-10-0-136-9 kubenswrapper[2584]: I0714 05:07:19.206351 2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-g257n_15609856-4056-487b-acdd-30276263b098/konnectivity-agent/0.log" limit=1024 Jul 14 05:07:19.321445 ip-10-0-136-9 kubenswrapper[2584]: I0714 05:07:19.321398 2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-g257n_15609856-4056-487b-acdd-30276263b098/konnectivity-agent/0.log" limit=1024 Jul 14 05:07:21.618890 ip-10-0-136-9 kubenswrapper[2584]: I0714 05:07:21.618849 2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-g257n_15609856-4056-487b-acdd-30276263b098/konnectivity-agent/0.log" limit=1024 Jul 14 05:07:21.673675 ip-10-0-136-9 kubenswrapper[2584]: I0714 05:07:21.673638 2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-g257n_15609856-4056-487b-acdd-30276263b098/konnectivity-agent/0.log" limit=1024 Jul 14 05:07:27.576711 ip-10-0-136-9 kubenswrapper[2584]: I0714 05:07:27.576680 2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-g257n_15609856-4056-487b-acdd-30276263b098/konnectivity-agent/0.log" limit=1024 Jul 14 05:07:27.636060 ip-10-0-136-9 kubenswrapper[2584]: I0714 05:07:27.636025 2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-g257n_15609856-4056-487b-acdd-30276263b098/konnectivity-agent/0.log" limit=1024 Jul 14 05:07:28.962838 ip-10-0-136-9 kubenswrapper[2584]: I0714 05:07:28.962806 2584 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-74x4l" Jul 14 05:07:28.963262 ip-10-0-136-9 kubenswrapper[2584]: I0714 05:07:28.962882 2584 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-7mw5n" Jul 14 05:07:29.969092 ip-10-0-136-9 kubenswrapper[2584]: I0714 05:07:29.969057 2584 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-jr6zj" Jul 14 05:07:30.025880 ip-10-0-136-9 kubenswrapper[2584]: I0714 05:07:30.021778 2584 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-7mw5n"] Jul 14 05:07:30.025880 ip-10-0-136-9 kubenswrapper[2584]: I0714 05:07:30.022106 2584 kuberuntime_container.go:873] "Killing container with a grace period" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-7mw5n" podUID="0afbd3c9-0952-4fdf-b8b4-5b2109205264" containerName="manager" containerID="cri-o://caccabf5c0c4a625ab7f893369fe8eb687472e88776e59728f239441d66eaec2" gracePeriod=10 Jul 14 05:07:30.293297 ip-10-0-136-9 kubenswrapper[2584]: I0714 05:07:30.293263 2584 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-7mw5n" Jul 14 05:07:30.417438 ip-10-0-136-9 kubenswrapper[2584]: I0714 05:07:30.417392 2584 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-5kqdn\" (UniqueName: \"kubernetes.io/projected/0afbd3c9-0952-4fdf-b8b4-5b2109205264-kube-api-access-5kqdn\") pod \"0afbd3c9-0952-4fdf-b8b4-5b2109205264\" (UID: \"0afbd3c9-0952-4fdf-b8b4-5b2109205264\") " Jul 14 05:07:30.417613 ip-10-0-136-9 kubenswrapper[2584]: I0714 05:07:30.417525 2584 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/0afbd3c9-0952-4fdf-b8b4-5b2109205264-extensions-socket-volume\") pod \"0afbd3c9-0952-4fdf-b8b4-5b2109205264\" (UID: \"0afbd3c9-0952-4fdf-b8b4-5b2109205264\") " Jul 14 05:07:30.417925 ip-10-0-136-9 kubenswrapper[2584]: I0714 05:07:30.417901 2584 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/0afbd3c9-0952-4fdf-b8b4-5b2109205264-extensions-socket-volume" (OuterVolumeSpecName: "extensions-socket-volume") pod "0afbd3c9-0952-4fdf-b8b4-5b2109205264" (UID: "0afbd3c9-0952-4fdf-b8b4-5b2109205264"). InnerVolumeSpecName "extensions-socket-volume". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 14 05:07:30.419600 ip-10-0-136-9 kubenswrapper[2584]: I0714 05:07:30.419578 2584 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/0afbd3c9-0952-4fdf-b8b4-5b2109205264-kube-api-access-5kqdn" (OuterVolumeSpecName: "kube-api-access-5kqdn") pod "0afbd3c9-0952-4fdf-b8b4-5b2109205264" (UID: "0afbd3c9-0952-4fdf-b8b4-5b2109205264"). InnerVolumeSpecName "kube-api-access-5kqdn". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 14 05:07:30.518653 ip-10-0-136-9 kubenswrapper[2584]: I0714 05:07:30.518565 2584 reconciler_common.go:299] "Volume detached for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/0afbd3c9-0952-4fdf-b8b4-5b2109205264-extensions-socket-volume\") on node \"ip-10-0-136-9.ec2.internal\" DevicePath \"\"" Jul 14 05:07:30.518653 ip-10-0-136-9 kubenswrapper[2584]: I0714 05:07:30.518599 2584 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-5kqdn\" (UniqueName: \"kubernetes.io/projected/0afbd3c9-0952-4fdf-b8b4-5b2109205264-kube-api-access-5kqdn\") on node \"ip-10-0-136-9.ec2.internal\" DevicePath \"\"" Jul 14 05:07:31.024540 ip-10-0-136-9 kubenswrapper[2584]: I0714 05:07:31.024501 2584 generic.go:356] "Generic (PLEG): container finished" podID="0afbd3c9-0952-4fdf-b8b4-5b2109205264" containerID="caccabf5c0c4a625ab7f893369fe8eb687472e88776e59728f239441d66eaec2" exitCode=0 Jul 14 05:07:31.024540 ip-10-0-136-9 kubenswrapper[2584]: I0714 05:07:31.024544 2584 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-7mw5n" Jul 14 05:07:31.025017 ip-10-0-136-9 kubenswrapper[2584]: I0714 05:07:31.024580 2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-7mw5n" event={"ID":"0afbd3c9-0952-4fdf-b8b4-5b2109205264","Type":"ContainerDied","Data":"caccabf5c0c4a625ab7f893369fe8eb687472e88776e59728f239441d66eaec2"} Jul 14 05:07:31.025017 ip-10-0-136-9 kubenswrapper[2584]: I0714 05:07:31.024634 2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-7mw5n" event={"ID":"0afbd3c9-0952-4fdf-b8b4-5b2109205264","Type":"ContainerDied","Data":"8825aa03e03d66272e6327c2f44dfb44259175649616722513c439606fcd2b3e"} Jul 14 05:07:31.025017 ip-10-0-136-9 kubenswrapper[2584]: I0714 05:07:31.024658 2584 scope.go:117] "RemoveContainer" containerID="caccabf5c0c4a625ab7f893369fe8eb687472e88776e59728f239441d66eaec2" Jul 14 05:07:31.033999 ip-10-0-136-9 kubenswrapper[2584]: I0714 05:07:31.033820 2584 scope.go:117] "RemoveContainer" containerID="caccabf5c0c4a625ab7f893369fe8eb687472e88776e59728f239441d66eaec2" Jul 14 05:07:31.034143 ip-10-0-136-9 kubenswrapper[2584]: E0714 05:07:31.034126 2584 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"caccabf5c0c4a625ab7f893369fe8eb687472e88776e59728f239441d66eaec2\": container with ID starting with caccabf5c0c4a625ab7f893369fe8eb687472e88776e59728f239441d66eaec2 not found: ID does not exist" containerID="caccabf5c0c4a625ab7f893369fe8eb687472e88776e59728f239441d66eaec2" Jul 14 05:07:31.034183 ip-10-0-136-9 kubenswrapper[2584]: I0714 05:07:31.034155 2584 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"caccabf5c0c4a625ab7f893369fe8eb687472e88776e59728f239441d66eaec2"} err="failed to get container status \"caccabf5c0c4a625ab7f893369fe8eb687472e88776e59728f239441d66eaec2\": rpc error: code = NotFound desc = could not find container \"caccabf5c0c4a625ab7f893369fe8eb687472e88776e59728f239441d66eaec2\": container with ID starting with caccabf5c0c4a625ab7f893369fe8eb687472e88776e59728f239441d66eaec2 not found: ID does not exist" Jul 14 05:07:31.047560 ip-10-0-136-9 kubenswrapper[2584]: I0714 05:07:31.047527 2584 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-7mw5n"] Jul 14 05:07:31.050741 ip-10-0-136-9 kubenswrapper[2584]: I0714 05:07:31.050713 2584 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-7mw5n"] Jul 14 05:07:31.530417 ip-10-0-136-9 kubenswrapper[2584]: I0714 05:07:31.530382 2584 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="0afbd3c9-0952-4fdf-b8b4-5b2109205264" path="/var/lib/kubelet/pods/0afbd3c9-0952-4fdf-b8b4-5b2109205264/volumes" Jul 14 05:07:36.588521 ip-10-0-136-9 kubenswrapper[2584]: I0714 05:07:36.588490 2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-g257n_15609856-4056-487b-acdd-30276263b098/konnectivity-agent/0.log" limit=1024 Jul 14 05:07:36.687362 ip-10-0-136-9 kubenswrapper[2584]: I0714 05:07:36.687325 2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-g257n_15609856-4056-487b-acdd-30276263b098/konnectivity-agent/0.log" limit=1024 Jul 14 05:07:39.583711 ip-10-0-136-9 kubenswrapper[2584]: I0714 05:07:39.583675 2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-g257n_15609856-4056-487b-acdd-30276263b098/konnectivity-agent/0.log" limit=1024 Jul 14 05:07:39.684204 ip-10-0-136-9 kubenswrapper[2584]: I0714 05:07:39.684165 2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-g257n_15609856-4056-487b-acdd-30276263b098/konnectivity-agent/0.log" limit=1024 Jul 14 05:07:42.022359 ip-10-0-136-9 kubenswrapper[2584]: I0714 05:07:42.022318 2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-g257n_15609856-4056-487b-acdd-30276263b098/konnectivity-agent/0.log" limit=1024 Jul 14 05:07:42.084376 ip-10-0-136-9 kubenswrapper[2584]: I0714 05:07:42.084341 2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-g257n_15609856-4056-487b-acdd-30276263b098/konnectivity-agent/0.log" limit=1024 Jul 14 05:07:46.364519 ip-10-0-136-9 kubenswrapper[2584]: I0714 05:07:46.364466 2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-g257n_15609856-4056-487b-acdd-30276263b098/konnectivity-agent/0.log" limit=1024 Jul 14 05:07:46.797917 ip-10-0-136-9 kubenswrapper[2584]: I0714 05:07:46.797822 2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-g257n_15609856-4056-487b-acdd-30276263b098/konnectivity-agent/0.log" limit=1024 Jul 14 05:07:48.294779 ip-10-0-136-9 kubenswrapper[2584]: I0714 05:07:48.294732 2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-g257n_15609856-4056-487b-acdd-30276263b098/konnectivity-agent/0.log" limit=1024 Jul 14 05:07:48.311305 ip-10-0-136-9 kubenswrapper[2584]: I0714 05:07:48.311249 2584 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/limitador-limitador-64c94fd64f-l846x"] Jul 14 05:07:48.311747 ip-10-0-136-9 kubenswrapper[2584]: I0714 05:07:48.311731 2584 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="0afbd3c9-0952-4fdf-b8b4-5b2109205264" containerName="manager" Jul 14 05:07:48.311747 ip-10-0-136-9 kubenswrapper[2584]: I0714 05:07:48.311748 2584 state_mem.go:107] "Deleted CPUSet assignment" podUID="0afbd3c9-0952-4fdf-b8b4-5b2109205264" containerName="manager" Jul 14 05:07:48.311850 ip-10-0-136-9 kubenswrapper[2584]: I0714 05:07:48.311817 2584 memory_manager.go:368] "RemoveStaleState removing state" podUID="0afbd3c9-0952-4fdf-b8b4-5b2109205264" containerName="manager" Jul 14 05:07:48.315834 ip-10-0-136-9 kubenswrapper[2584]: I0714 05:07:48.315791 2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-limitador-64c94fd64f-l846x" Jul 14 05:07:48.318470 ip-10-0-136-9 kubenswrapper[2584]: I0714 05:07:48.318441 2584 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"default-dockercfg-sq87f\"" Jul 14 05:07:48.318470 ip-10-0-136-9 kubenswrapper[2584]: I0714 05:07:48.318441 2584 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"limitador-limits-config-limitador\"" Jul 14 05:07:48.322132 ip-10-0-136-9 kubenswrapper[2584]: I0714 05:07:48.322088 2584 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-64c94fd64f-l846x"] Jul 14 05:07:48.407162 ip-10-0-136-9 kubenswrapper[2584]: I0714 05:07:48.407127 2584 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-64c94fd64f-l846x"] Jul 14 05:07:48.409468 ip-10-0-136-9 kubenswrapper[2584]: I0714 05:07:48.409434 2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-g257n_15609856-4056-487b-acdd-30276263b098/konnectivity-agent/0.log" limit=1024 Jul 14 05:07:48.482871 ip-10-0-136-9 kubenswrapper[2584]: I0714 05:07:48.482829 2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-97fwh\" (UniqueName: \"kubernetes.io/projected/dcd09518-3dc9-47b5-a426-94d1f821f684-kube-api-access-97fwh\") pod \"limitador-limitador-64c94fd64f-l846x\" (UID: \"dcd09518-3dc9-47b5-a426-94d1f821f684\") " pod="kuadrant-system/limitador-limitador-64c94fd64f-l846x" Jul 14 05:07:48.483065 ip-10-0-136-9 kubenswrapper[2584]: I0714 05:07:48.482903 2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-file\" (UniqueName: \"kubernetes.io/configmap/dcd09518-3dc9-47b5-a426-94d1f821f684-config-file\") pod \"limitador-limitador-64c94fd64f-l846x\" (UID: \"dcd09518-3dc9-47b5-a426-94d1f821f684\") " pod="kuadrant-system/limitador-limitador-64c94fd64f-l846x" Jul 14 05:07:48.503338 ip-10-0-136-9 kubenswrapper[2584]: I0714 05:07:48.503301 2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-g257n_15609856-4056-487b-acdd-30276263b098/konnectivity-agent/0.log" limit=1024 Jul 14 05:07:48.583727 ip-10-0-136-9 kubenswrapper[2584]: I0714 05:07:48.583699 2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-97fwh\" (UniqueName: \"kubernetes.io/projected/dcd09518-3dc9-47b5-a426-94d1f821f684-kube-api-access-97fwh\") pod \"limitador-limitador-64c94fd64f-l846x\" (UID: \"dcd09518-3dc9-47b5-a426-94d1f821f684\") " pod="kuadrant-system/limitador-limitador-64c94fd64f-l846x" Jul 14 05:07:48.583881 ip-10-0-136-9 kubenswrapper[2584]: I0714 05:07:48.583756 2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-file\" (UniqueName: \"kubernetes.io/configmap/dcd09518-3dc9-47b5-a426-94d1f821f684-config-file\") pod \"limitador-limitador-64c94fd64f-l846x\" (UID: \"dcd09518-3dc9-47b5-a426-94d1f821f684\") " pod="kuadrant-system/limitador-limitador-64c94fd64f-l846x" Jul 14 05:07:48.584415 ip-10-0-136-9 kubenswrapper[2584]: I0714 05:07:48.584397 2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config-file\" (UniqueName: \"kubernetes.io/configmap/dcd09518-3dc9-47b5-a426-94d1f821f684-config-file\") pod \"limitador-limitador-64c94fd64f-l846x\" (UID: \"dcd09518-3dc9-47b5-a426-94d1f821f684\") " pod="kuadrant-system/limitador-limitador-64c94fd64f-l846x" Jul 14 05:07:48.597050 ip-10-0-136-9 kubenswrapper[2584]: I0714 05:07:48.597021 2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-97fwh\" (UniqueName: \"kubernetes.io/projected/dcd09518-3dc9-47b5-a426-94d1f821f684-kube-api-access-97fwh\") pod \"limitador-limitador-64c94fd64f-l846x\" (UID: \"dcd09518-3dc9-47b5-a426-94d1f821f684\") " pod="kuadrant-system/limitador-limitador-64c94fd64f-l846x" Jul 14 05:07:48.629873 ip-10-0-136-9 kubenswrapper[2584]: I0714 05:07:48.629834 2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-limitador-64c94fd64f-l846x" Jul 14 05:07:48.772132 ip-10-0-136-9 kubenswrapper[2584]: I0714 05:07:48.772106 2584 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-64c94fd64f-l846x"] Jul 14 05:07:48.773856 ip-10-0-136-9 kubenswrapper[2584]: W0714 05:07:48.773828 2584 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poddcd09518_3dc9_47b5_a426_94d1f821f684.slice/crio-2192d4e11ba17d7f2740897c00994ff92e30648693247a4bda558990fcf3d661 WatchSource:0}: Error finding container 2192d4e11ba17d7f2740897c00994ff92e30648693247a4bda558990fcf3d661: Status 404 returned error can't find the container with id 2192d4e11ba17d7f2740897c00994ff92e30648693247a4bda558990fcf3d661 Jul 14 05:07:49.118361 ip-10-0-136-9 kubenswrapper[2584]: I0714 05:07:49.118308 2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-limitador-64c94fd64f-l846x" event={"ID":"dcd09518-3dc9-47b5-a426-94d1f821f684","Type":"ContainerStarted","Data":"2192d4e11ba17d7f2740897c00994ff92e30648693247a4bda558990fcf3d661"} Jul 14 05:07:49.118705 ip-10-0-136-9 kubenswrapper[2584]: I0714 05:07:49.118683 2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-g257n_15609856-4056-487b-acdd-30276263b098/konnectivity-agent/0.log" limit=1024 Jul 14 05:07:49.179772 ip-10-0-136-9 kubenswrapper[2584]: I0714 05:07:49.179736 2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-g257n_15609856-4056-487b-acdd-30276263b098/konnectivity-agent/0.log" limit=1024 Jul 14 05:07:49.308449 ip-10-0-136-9 kubenswrapper[2584]: I0714 05:07:49.308398 2584 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/authorino-75d556bd77-gfv6r"] Jul 14 05:07:49.311374 ip-10-0-136-9 kubenswrapper[2584]: I0714 05:07:49.311353 2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-75d556bd77-gfv6r" Jul 14 05:07:49.313973 ip-10-0-136-9 kubenswrapper[2584]: I0714 05:07:49.313914 2584 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"authorino-authorino-dockercfg-ghbkw\"" Jul 14 05:07:49.318272 ip-10-0-136-9 kubenswrapper[2584]: I0714 05:07:49.318246 2584 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-75d556bd77-gfv6r"] Jul 14 05:07:49.392428 ip-10-0-136-9 kubenswrapper[2584]: I0714 05:07:49.392347 2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-t6fvw\" (UniqueName: \"kubernetes.io/projected/3d2edd4f-889c-49ab-8ff3-cd8ceef96aec-kube-api-access-t6fvw\") pod \"authorino-75d556bd77-gfv6r\" (UID: \"3d2edd4f-889c-49ab-8ff3-cd8ceef96aec\") " pod="kuadrant-system/authorino-75d556bd77-gfv6r" Jul 14 05:07:49.493361 ip-10-0-136-9 kubenswrapper[2584]: I0714 05:07:49.493312 2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-t6fvw\" (UniqueName: \"kubernetes.io/projected/3d2edd4f-889c-49ab-8ff3-cd8ceef96aec-kube-api-access-t6fvw\") pod \"authorino-75d556bd77-gfv6r\" (UID: \"3d2edd4f-889c-49ab-8ff3-cd8ceef96aec\") " pod="kuadrant-system/authorino-75d556bd77-gfv6r" Jul 14 05:07:49.502129 ip-10-0-136-9 kubenswrapper[2584]: I0714 05:07:49.502098 2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-t6fvw\" (UniqueName: \"kubernetes.io/projected/3d2edd4f-889c-49ab-8ff3-cd8ceef96aec-kube-api-access-t6fvw\") pod \"authorino-75d556bd77-gfv6r\" (UID: \"3d2edd4f-889c-49ab-8ff3-cd8ceef96aec\") " pod="kuadrant-system/authorino-75d556bd77-gfv6r" Jul 14 05:07:49.622543 ip-10-0-136-9 kubenswrapper[2584]: I0714 05:07:49.622502 2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-75d556bd77-gfv6r" Jul 14 05:07:49.817435 ip-10-0-136-9 kubenswrapper[2584]: I0714 05:07:49.817374 2584 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-75d556bd77-gfv6r"] Jul 14 05:07:49.820117 ip-10-0-136-9 kubenswrapper[2584]: W0714 05:07:49.820073 2584 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod3d2edd4f_889c_49ab_8ff3_cd8ceef96aec.slice/crio-9df87d16843553dc8cea869d120b5907319aba1e4d81b73ad147c3d85de70c33 WatchSource:0}: Error finding container 9df87d16843553dc8cea869d120b5907319aba1e4d81b73ad147c3d85de70c33: Status 404 returned error can't find the container with id 9df87d16843553dc8cea869d120b5907319aba1e4d81b73ad147c3d85de70c33 Jul 14 05:07:50.126461 ip-10-0-136-9 kubenswrapper[2584]: I0714 05:07:50.126416 2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-75d556bd77-gfv6r" event={"ID":"3d2edd4f-889c-49ab-8ff3-cd8ceef96aec","Type":"ContainerStarted","Data":"9df87d16843553dc8cea869d120b5907319aba1e4d81b73ad147c3d85de70c33"} Jul 14 05:07:54.151647 ip-10-0-136-9 kubenswrapper[2584]: I0714 05:07:54.151610 2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-limitador-64c94fd64f-l846x" event={"ID":"dcd09518-3dc9-47b5-a426-94d1f821f684","Type":"ContainerStarted","Data":"66e3301e39b93bd593209ba97e96c02cf817373c409cc460b08ca32b90b39f17"} Jul 14 05:07:54.152133 ip-10-0-136-9 kubenswrapper[2584]: I0714 05:07:54.151725 2584 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/limitador-limitador-64c94fd64f-l846x" Jul 14 05:07:54.153264 ip-10-0-136-9 kubenswrapper[2584]: I0714 05:07:54.153242 2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-75d556bd77-gfv6r" event={"ID":"3d2edd4f-889c-49ab-8ff3-cd8ceef96aec","Type":"ContainerStarted","Data":"47b90c51160dc0792917ae7cf697fae60a2a4080a75e929b267ca8c8a4318506"} Jul 14 05:07:54.175600 ip-10-0-136-9 kubenswrapper[2584]: I0714 05:07:54.175517 2584 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/limitador-limitador-64c94fd64f-l846x" podStartSLOduration=1.538241239 podStartE2EDuration="6.175485396s" totalImagesPullingTime="4.637244157s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-14 05:07:48 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-14 05:07:54.173868573 +0000 UTC m=+535.135124278" watchObservedRunningTime="2026-07-14 05:07:54.175485396 +0000 UTC m=+535.136741091" Jul 14 05:07:54.187775 ip-10-0-136-9 kubenswrapper[2584]: I0714 05:07:54.187721 2584 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/authorino-75d556bd77-gfv6r" podStartSLOduration=1.595184355 podStartE2EDuration="5.187706762s" totalImagesPullingTime="3.592522407s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-14 05:07:49 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-14 05:07:54.186885174 +0000 UTC m=+535.148140879" watchObservedRunningTime="2026-07-14 05:07:54.187706762 +0000 UTC m=+535.148962465" Jul 14 05:08:04.584638 ip-10-0-136-9 kubenswrapper[2584]: I0714 05:08:04.584600 2584 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/limitador-limitador-64c94fd64f-l846x"] Jul 14 05:08:04.585139 ip-10-0-136-9 kubenswrapper[2584]: I0714 05:08:04.584836 2584 kuberuntime_container.go:873] "Killing container with a grace period" pod="kuadrant-system/limitador-limitador-64c94fd64f-l846x" podUID="dcd09518-3dc9-47b5-a426-94d1f821f684" containerName="limitador" containerID="cri-o://66e3301e39b93bd593209ba97e96c02cf817373c409cc460b08ca32b90b39f17" gracePeriod=30 Jul 14 05:08:04.585555 ip-10-0-136-9 kubenswrapper[2584]: I0714 05:08:04.585535 2584 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/limitador-limitador-64c94fd64f-l846x" Jul 14 05:08:05.134730 ip-10-0-136-9 kubenswrapper[2584]: I0714 05:08:05.134702 2584 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-limitador-64c94fd64f-l846x" Jul 14 05:08:05.207822 ip-10-0-136-9 kubenswrapper[2584]: I0714 05:08:05.207730 2584 generic.go:356] "Generic (PLEG): container finished" podID="dcd09518-3dc9-47b5-a426-94d1f821f684" containerID="66e3301e39b93bd593209ba97e96c02cf817373c409cc460b08ca32b90b39f17" exitCode=0 Jul 14 05:08:05.207822 ip-10-0-136-9 kubenswrapper[2584]: I0714 05:08:05.207775 2584 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-limitador-64c94fd64f-l846x" Jul 14 05:08:05.208041 ip-10-0-136-9 kubenswrapper[2584]: I0714 05:08:05.207817 2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-limitador-64c94fd64f-l846x" event={"ID":"dcd09518-3dc9-47b5-a426-94d1f821f684","Type":"ContainerDied","Data":"66e3301e39b93bd593209ba97e96c02cf817373c409cc460b08ca32b90b39f17"} Jul 14 05:08:05.208041 ip-10-0-136-9 kubenswrapper[2584]: I0714 05:08:05.207869 2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-limitador-64c94fd64f-l846x" event={"ID":"dcd09518-3dc9-47b5-a426-94d1f821f684","Type":"ContainerDied","Data":"2192d4e11ba17d7f2740897c00994ff92e30648693247a4bda558990fcf3d661"} Jul 14 05:08:05.208041 ip-10-0-136-9 kubenswrapper[2584]: I0714 05:08:05.207890 2584 scope.go:117] "RemoveContainer" containerID="66e3301e39b93bd593209ba97e96c02cf817373c409cc460b08ca32b90b39f17" Jul 14 05:08:05.216186 ip-10-0-136-9 kubenswrapper[2584]: I0714 05:08:05.216166 2584 scope.go:117] "RemoveContainer" containerID="66e3301e39b93bd593209ba97e96c02cf817373c409cc460b08ca32b90b39f17" Jul 14 05:08:05.216459 ip-10-0-136-9 kubenswrapper[2584]: E0714 05:08:05.216441 2584 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"66e3301e39b93bd593209ba97e96c02cf817373c409cc460b08ca32b90b39f17\": container with ID starting with 66e3301e39b93bd593209ba97e96c02cf817373c409cc460b08ca32b90b39f17 not found: ID does not exist" containerID="66e3301e39b93bd593209ba97e96c02cf817373c409cc460b08ca32b90b39f17" Jul 14 05:08:05.216496 ip-10-0-136-9 kubenswrapper[2584]: I0714 05:08:05.216471 2584 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"66e3301e39b93bd593209ba97e96c02cf817373c409cc460b08ca32b90b39f17"} err="failed to get container status \"66e3301e39b93bd593209ba97e96c02cf817373c409cc460b08ca32b90b39f17\": rpc error: code = NotFound desc = could not find container \"66e3301e39b93bd593209ba97e96c02cf817373c409cc460b08ca32b90b39f17\": container with ID starting with 66e3301e39b93bd593209ba97e96c02cf817373c409cc460b08ca32b90b39f17 not found: ID does not exist" Jul 14 05:08:05.223833 ip-10-0-136-9 kubenswrapper[2584]: I0714 05:08:05.223809 2584 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"config-file\" (UniqueName: \"kubernetes.io/configmap/dcd09518-3dc9-47b5-a426-94d1f821f684-config-file\") pod \"dcd09518-3dc9-47b5-a426-94d1f821f684\" (UID: \"dcd09518-3dc9-47b5-a426-94d1f821f684\") " Jul 14 05:08:05.223905 ip-10-0-136-9 kubenswrapper[2584]: I0714 05:08:05.223852 2584 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-97fwh\" (UniqueName: \"kubernetes.io/projected/dcd09518-3dc9-47b5-a426-94d1f821f684-kube-api-access-97fwh\") pod \"dcd09518-3dc9-47b5-a426-94d1f821f684\" (UID: \"dcd09518-3dc9-47b5-a426-94d1f821f684\") " Jul 14 05:08:05.224212 ip-10-0-136-9 kubenswrapper[2584]: I0714 05:08:05.224193 2584 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/dcd09518-3dc9-47b5-a426-94d1f821f684-config-file" (OuterVolumeSpecName: "config-file") pod "dcd09518-3dc9-47b5-a426-94d1f821f684" (UID: "dcd09518-3dc9-47b5-a426-94d1f821f684"). InnerVolumeSpecName "config-file". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 14 05:08:05.225903 ip-10-0-136-9 kubenswrapper[2584]: I0714 05:08:05.225875 2584 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/dcd09518-3dc9-47b5-a426-94d1f821f684-kube-api-access-97fwh" (OuterVolumeSpecName: "kube-api-access-97fwh") pod "dcd09518-3dc9-47b5-a426-94d1f821f684" (UID: "dcd09518-3dc9-47b5-a426-94d1f821f684"). InnerVolumeSpecName "kube-api-access-97fwh". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 14 05:08:05.324532 ip-10-0-136-9 kubenswrapper[2584]: I0714 05:08:05.324487 2584 reconciler_common.go:299] "Volume detached for volume \"config-file\" (UniqueName: \"kubernetes.io/configmap/dcd09518-3dc9-47b5-a426-94d1f821f684-config-file\") on node \"ip-10-0-136-9.ec2.internal\" DevicePath \"\"" Jul 14 05:08:05.324532 ip-10-0-136-9 kubenswrapper[2584]: I0714 05:08:05.324521 2584 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-97fwh\" (UniqueName: \"kubernetes.io/projected/dcd09518-3dc9-47b5-a426-94d1f821f684-kube-api-access-97fwh\") on node \"ip-10-0-136-9.ec2.internal\" DevicePath \"\"" Jul 14 05:08:05.530492 ip-10-0-136-9 kubenswrapper[2584]: I0714 05:08:05.530461 2584 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/limitador-limitador-64c94fd64f-l846x"] Jul 14 05:08:05.534436 ip-10-0-136-9 kubenswrapper[2584]: I0714 05:08:05.534402 2584 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/limitador-limitador-64c94fd64f-l846x"] Jul 14 05:08:07.530172 ip-10-0-136-9 kubenswrapper[2584]: I0714 05:08:07.530135 2584 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="dcd09518-3dc9-47b5-a426-94d1f821f684" path="/var/lib/kubelet/pods/dcd09518-3dc9-47b5-a426-94d1f821f684/volumes" Jul 14 05:08:09.545356 ip-10-0-136-9 kubenswrapper[2584]: I0714 05:08:09.545320 2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-g257n_15609856-4056-487b-acdd-30276263b098/konnectivity-agent/0.log" limit=1024 Jul 14 05:08:09.643650 ip-10-0-136-9 kubenswrapper[2584]: I0714 05:08:09.643608 2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-g257n_15609856-4056-487b-acdd-30276263b098/konnectivity-agent/0.log" limit=1024 Jul 14 05:08:09.972689 ip-10-0-136-9 kubenswrapper[2584]: I0714 05:08:09.972660 2584 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/postgres-69fb4594cf-tzgm8"] Jul 14 05:08:09.973064 ip-10-0-136-9 kubenswrapper[2584]: I0714 05:08:09.973051 2584 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="dcd09518-3dc9-47b5-a426-94d1f821f684" containerName="limitador" Jul 14 05:08:09.973124 ip-10-0-136-9 kubenswrapper[2584]: I0714 05:08:09.973066 2584 state_mem.go:107] "Deleted CPUSet assignment" podUID="dcd09518-3dc9-47b5-a426-94d1f821f684" containerName="limitador" Jul 14 05:08:09.973158 ip-10-0-136-9 kubenswrapper[2584]: I0714 05:08:09.973142 2584 memory_manager.go:368] "RemoveStaleState removing state" podUID="dcd09518-3dc9-47b5-a426-94d1f821f684" containerName="limitador" Jul 14 05:08:09.976338 ip-10-0-136-9 kubenswrapper[2584]: I0714 05:08:09.976319 2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/postgres-69fb4594cf-tzgm8" Jul 14 05:08:09.978945 ip-10-0-136-9 kubenswrapper[2584]: I0714 05:08:09.978911 2584 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"postgres-creds\"" Jul 14 05:08:09.979107 ip-10-0-136-9 kubenswrapper[2584]: I0714 05:08:09.979038 2584 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"odh-ai-gateway-infra\"/\"openshift-service-ca.crt\"" Jul 14 05:08:09.979107 ip-10-0-136-9 kubenswrapper[2584]: I0714 05:08:09.979078 2584 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"odh-ai-gateway-infra\"/\"kube-root-ca.crt\"" Jul 14 05:08:09.980129 ip-10-0-136-9 kubenswrapper[2584]: I0714 05:08:09.980114 2584 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"default-dockercfg-7vq6h\"" Jul 14 05:08:09.984949 ip-10-0-136-9 kubenswrapper[2584]: I0714 05:08:09.984915 2584 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/postgres-69fb4594cf-tzgm8"] Jul 14 05:08:10.004748 ip-10-0-136-9 kubenswrapper[2584]: I0714 05:08:10.004709 2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-g257n_15609856-4056-487b-acdd-30276263b098/konnectivity-agent/0.log" limit=1024 Jul 14 05:08:10.056880 ip-10-0-136-9 kubenswrapper[2584]: I0714 05:08:10.056843 2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"data\" (UniqueName: \"kubernetes.io/empty-dir/42f1bd21-c9ee-4341-b101-473d1187ec4a-data\") pod \"postgres-69fb4594cf-tzgm8\" (UID: \"42f1bd21-c9ee-4341-b101-473d1187ec4a\") " pod="odh-ai-gateway-infra/postgres-69fb4594cf-tzgm8" Jul 14 05:08:10.056880 ip-10-0-136-9 kubenswrapper[2584]: I0714 05:08:10.056878 2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-rsk88\" (UniqueName: \"kubernetes.io/projected/42f1bd21-c9ee-4341-b101-473d1187ec4a-kube-api-access-rsk88\") pod \"postgres-69fb4594cf-tzgm8\" (UID: \"42f1bd21-c9ee-4341-b101-473d1187ec4a\") " pod="odh-ai-gateway-infra/postgres-69fb4594cf-tzgm8" Jul 14 05:08:10.157673 ip-10-0-136-9 kubenswrapper[2584]: I0714 05:08:10.157634 2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"data\" (UniqueName: \"kubernetes.io/empty-dir/42f1bd21-c9ee-4341-b101-473d1187ec4a-data\") pod \"postgres-69fb4594cf-tzgm8\" (UID: \"42f1bd21-c9ee-4341-b101-473d1187ec4a\") " pod="odh-ai-gateway-infra/postgres-69fb4594cf-tzgm8" Jul 14 05:08:10.157673 ip-10-0-136-9 kubenswrapper[2584]: I0714 05:08:10.157673 2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-rsk88\" (UniqueName: \"kubernetes.io/projected/42f1bd21-c9ee-4341-b101-473d1187ec4a-kube-api-access-rsk88\") pod \"postgres-69fb4594cf-tzgm8\" (UID: \"42f1bd21-c9ee-4341-b101-473d1187ec4a\") " pod="odh-ai-gateway-infra/postgres-69fb4594cf-tzgm8" Jul 14 05:08:10.158083 ip-10-0-136-9 kubenswrapper[2584]: I0714 05:08:10.158060 2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"data\" (UniqueName: \"kubernetes.io/empty-dir/42f1bd21-c9ee-4341-b101-473d1187ec4a-data\") pod \"postgres-69fb4594cf-tzgm8\" (UID: \"42f1bd21-c9ee-4341-b101-473d1187ec4a\") " pod="odh-ai-gateway-infra/postgres-69fb4594cf-tzgm8" Jul 14 05:08:10.166016 ip-10-0-136-9 kubenswrapper[2584]: I0714 05:08:10.165985 2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-rsk88\" (UniqueName: \"kubernetes.io/projected/42f1bd21-c9ee-4341-b101-473d1187ec4a-kube-api-access-rsk88\") pod \"postgres-69fb4594cf-tzgm8\" (UID: \"42f1bd21-c9ee-4341-b101-473d1187ec4a\") " pod="odh-ai-gateway-infra/postgres-69fb4594cf-tzgm8" Jul 14 05:08:10.288065 ip-10-0-136-9 kubenswrapper[2584]: I0714 05:08:10.287976 2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/postgres-69fb4594cf-tzgm8" Jul 14 05:08:10.424547 ip-10-0-136-9 kubenswrapper[2584]: I0714 05:08:10.424522 2584 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/postgres-69fb4594cf-tzgm8"] Jul 14 05:08:10.426874 ip-10-0-136-9 kubenswrapper[2584]: W0714 05:08:10.426850 2584 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod42f1bd21_c9ee_4341_b101_473d1187ec4a.slice/crio-01ef3566414e4aa35f4b70fbf986cd60d28dad9585d4a0978ec499af5a48d2af WatchSource:0}: Error finding container 01ef3566414e4aa35f4b70fbf986cd60d28dad9585d4a0978ec499af5a48d2af: Status 404 returned error can't find the container with id 01ef3566414e4aa35f4b70fbf986cd60d28dad9585d4a0978ec499af5a48d2af Jul 14 05:08:11.239522 ip-10-0-136-9 kubenswrapper[2584]: I0714 05:08:11.239484 2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/postgres-69fb4594cf-tzgm8" event={"ID":"42f1bd21-c9ee-4341-b101-473d1187ec4a","Type":"ContainerStarted","Data":"01ef3566414e4aa35f4b70fbf986cd60d28dad9585d4a0978ec499af5a48d2af"} Jul 14 05:08:13.373052 ip-10-0-136-9 kubenswrapper[2584]: I0714 05:08:13.372990 2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-g257n_15609856-4056-487b-acdd-30276263b098/konnectivity-agent/0.log" limit=1024 Jul 14 05:08:16.268107 ip-10-0-136-9 kubenswrapper[2584]: I0714 05:08:16.268063 2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/postgres-69fb4594cf-tzgm8" event={"ID":"42f1bd21-c9ee-4341-b101-473d1187ec4a","Type":"ContainerStarted","Data":"dab2840ecefcea6066393588c3d90f8702e85f0a9eded6772d56aabdfd6efcaa"} Jul 14 05:08:16.268498 ip-10-0-136-9 kubenswrapper[2584]: I0714 05:08:16.268192 2584 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/postgres-69fb4594cf-tzgm8" Jul 14 05:08:16.286069 ip-10-0-136-9 kubenswrapper[2584]: I0714 05:08:16.286005 2584 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/postgres-69fb4594cf-tzgm8" podStartSLOduration=2.283113659 podStartE2EDuration="7.285988481s" totalImagesPullingTime="5.002874822s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-14 05:08:09 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-14 05:08:16.283417601 +0000 UTC m=+557.244673316" watchObservedRunningTime="2026-07-14 05:08:16.285988481 +0000 UTC m=+557.247244183" Jul 14 05:08:22.302925 ip-10-0-136-9 kubenswrapper[2584]: I0714 05:08:22.302895 2584 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/postgres-69fb4594cf-tzgm8" Jul 14 05:08:22.630724 ip-10-0-136-9 kubenswrapper[2584]: I0714 05:08:22.630689 2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-g257n_15609856-4056-487b-acdd-30276263b098/konnectivity-agent/0.log" limit=1024 Jul 14 05:08:22.730960 ip-10-0-136-9 kubenswrapper[2584]: I0714 05:08:22.730909 2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-g257n_15609856-4056-487b-acdd-30276263b098/konnectivity-agent/0.log" limit=1024 Jul 14 05:08:23.092791 ip-10-0-136-9 kubenswrapper[2584]: I0714 05:08:23.092753 2584 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/authorino-76877994-9qzh9"] Jul 14 05:08:23.096154 ip-10-0-136-9 kubenswrapper[2584]: I0714 05:08:23.096132 2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-76877994-9qzh9" Jul 14 05:08:23.099178 ip-10-0-136-9 kubenswrapper[2584]: I0714 05:08:23.099148 2584 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"authorino-server-cert\"" Jul 14 05:08:23.104800 ip-10-0-136-9 kubenswrapper[2584]: I0714 05:08:23.104774 2584 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-76877994-9qzh9"] Jul 14 05:08:23.124237 ip-10-0-136-9 kubenswrapper[2584]: I0714 05:08:23.124199 2584 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-76877994-9qzh9"] Jul 14 05:08:23.124500 ip-10-0-136-9 kubenswrapper[2584]: E0714 05:08:23.124479 2584 pod_workers.go:1324] "Error syncing pod, skipping" err="unmounted volumes=[kube-api-access-xqjn2 tls-cert], unattached volumes=[], failed to process volumes=[kube-api-access-xqjn2 tls-cert]: context canceled" pod="kuadrant-system/authorino-76877994-9qzh9" podUID="ebe6c078-30bf-4901-aad7-8fadbacd9716" Jul 14 05:08:23.151456 ip-10-0-136-9 kubenswrapper[2584]: I0714 05:08:23.151416 2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-xqjn2\" (UniqueName: \"kubernetes.io/projected/ebe6c078-30bf-4901-aad7-8fadbacd9716-kube-api-access-xqjn2\") pod \"authorino-76877994-9qzh9\" (UID: \"ebe6c078-30bf-4901-aad7-8fadbacd9716\") " pod="kuadrant-system/authorino-76877994-9qzh9" Jul 14 05:08:23.151649 ip-10-0-136-9 kubenswrapper[2584]: I0714 05:08:23.151491 2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/ebe6c078-30bf-4901-aad7-8fadbacd9716-tls-cert\") pod \"authorino-76877994-9qzh9\" (UID: \"ebe6c078-30bf-4901-aad7-8fadbacd9716\") " pod="kuadrant-system/authorino-76877994-9qzh9" Jul 14 05:08:23.252589 ip-10-0-136-9 kubenswrapper[2584]: I0714 05:08:23.252523 2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/ebe6c078-30bf-4901-aad7-8fadbacd9716-tls-cert\") pod \"authorino-76877994-9qzh9\" (UID: \"ebe6c078-30bf-4901-aad7-8fadbacd9716\") " pod="kuadrant-system/authorino-76877994-9qzh9" Jul 14 05:08:23.252830 ip-10-0-136-9 kubenswrapper[2584]: I0714 05:08:23.252673 2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-xqjn2\" (UniqueName: \"kubernetes.io/projected/ebe6c078-30bf-4901-aad7-8fadbacd9716-kube-api-access-xqjn2\") pod \"authorino-76877994-9qzh9\" (UID: \"ebe6c078-30bf-4901-aad7-8fadbacd9716\") " pod="kuadrant-system/authorino-76877994-9qzh9" Jul 14 05:08:23.255164 ip-10-0-136-9 kubenswrapper[2584]: I0714 05:08:23.255132 2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/ebe6c078-30bf-4901-aad7-8fadbacd9716-tls-cert\") pod \"authorino-76877994-9qzh9\" (UID: \"ebe6c078-30bf-4901-aad7-8fadbacd9716\") " pod="kuadrant-system/authorino-76877994-9qzh9" Jul 14 05:08:23.261383 ip-10-0-136-9 kubenswrapper[2584]: I0714 05:08:23.261352 2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-xqjn2\" (UniqueName: \"kubernetes.io/projected/ebe6c078-30bf-4901-aad7-8fadbacd9716-kube-api-access-xqjn2\") pod \"authorino-76877994-9qzh9\" (UID: \"ebe6c078-30bf-4901-aad7-8fadbacd9716\") " pod="kuadrant-system/authorino-76877994-9qzh9" Jul 14 05:08:23.303014 ip-10-0-136-9 kubenswrapper[2584]: I0714 05:08:23.302916 2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-76877994-9qzh9" Jul 14 05:08:23.310194 ip-10-0-136-9 kubenswrapper[2584]: I0714 05:08:23.310169 2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-76877994-9qzh9" Jul 14 05:08:23.353889 ip-10-0-136-9 kubenswrapper[2584]: I0714 05:08:23.353790 2584 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/ebe6c078-30bf-4901-aad7-8fadbacd9716-tls-cert\") pod \"ebe6c078-30bf-4901-aad7-8fadbacd9716\" (UID: \"ebe6c078-30bf-4901-aad7-8fadbacd9716\") " Jul 14 05:08:23.353889 ip-10-0-136-9 kubenswrapper[2584]: I0714 05:08:23.353870 2584 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-xqjn2\" (UniqueName: \"kubernetes.io/projected/ebe6c078-30bf-4901-aad7-8fadbacd9716-kube-api-access-xqjn2\") pod \"ebe6c078-30bf-4901-aad7-8fadbacd9716\" (UID: \"ebe6c078-30bf-4901-aad7-8fadbacd9716\") " Jul 14 05:08:23.356052 ip-10-0-136-9 kubenswrapper[2584]: I0714 05:08:23.356011 2584 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/ebe6c078-30bf-4901-aad7-8fadbacd9716-tls-cert" (OuterVolumeSpecName: "tls-cert") pod "ebe6c078-30bf-4901-aad7-8fadbacd9716" (UID: "ebe6c078-30bf-4901-aad7-8fadbacd9716"). InnerVolumeSpecName "tls-cert". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 14 05:08:23.356183 ip-10-0-136-9 kubenswrapper[2584]: I0714 05:08:23.356112 2584 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/ebe6c078-30bf-4901-aad7-8fadbacd9716-kube-api-access-xqjn2" (OuterVolumeSpecName: "kube-api-access-xqjn2") pod "ebe6c078-30bf-4901-aad7-8fadbacd9716" (UID: "ebe6c078-30bf-4901-aad7-8fadbacd9716"). InnerVolumeSpecName "kube-api-access-xqjn2". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 14 05:08:23.454438 ip-10-0-136-9 kubenswrapper[2584]: I0714 05:08:23.454392 2584 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-xqjn2\" (UniqueName: \"kubernetes.io/projected/ebe6c078-30bf-4901-aad7-8fadbacd9716-kube-api-access-xqjn2\") on node \"ip-10-0-136-9.ec2.internal\" DevicePath \"\"" Jul 14 05:08:23.454438 ip-10-0-136-9 kubenswrapper[2584]: I0714 05:08:23.454430 2584 reconciler_common.go:299] "Volume detached for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/ebe6c078-30bf-4901-aad7-8fadbacd9716-tls-cert\") on node \"ip-10-0-136-9.ec2.internal\" DevicePath \"\"" Jul 14 05:08:24.308437 ip-10-0-136-9 kubenswrapper[2584]: I0714 05:08:24.308404 2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-76877994-9qzh9" Jul 14 05:08:24.335704 ip-10-0-136-9 kubenswrapper[2584]: I0714 05:08:24.335669 2584 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-76877994-9qzh9"] Jul 14 05:08:24.344296 ip-10-0-136-9 kubenswrapper[2584]: I0714 05:08:24.344266 2584 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/authorino-76877994-9qzh9"] Jul 14 05:08:24.728159 ip-10-0-136-9 kubenswrapper[2584]: I0714 05:08:24.728113 2584 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-75d556bd77-gfv6r"] Jul 14 05:08:24.728390 ip-10-0-136-9 kubenswrapper[2584]: I0714 05:08:24.728359 2584 kuberuntime_container.go:873] "Killing container with a grace period" pod="kuadrant-system/authorino-75d556bd77-gfv6r" podUID="3d2edd4f-889c-49ab-8ff3-cd8ceef96aec" containerName="authorino" containerID="cri-o://47b90c51160dc0792917ae7cf697fae60a2a4080a75e929b267ca8c8a4318506" gracePeriod=30 Jul 14 05:08:24.999926 ip-10-0-136-9 kubenswrapper[2584]: I0714 05:08:24.999894 2584 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-75d556bd77-gfv6r" Jul 14 05:08:25.069642 ip-10-0-136-9 kubenswrapper[2584]: I0714 05:08:25.069600 2584 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-t6fvw\" (UniqueName: \"kubernetes.io/projected/3d2edd4f-889c-49ab-8ff3-cd8ceef96aec-kube-api-access-t6fvw\") pod \"3d2edd4f-889c-49ab-8ff3-cd8ceef96aec\" (UID: \"3d2edd4f-889c-49ab-8ff3-cd8ceef96aec\") " Jul 14 05:08:25.071700 ip-10-0-136-9 kubenswrapper[2584]: I0714 05:08:25.071673 2584 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/3d2edd4f-889c-49ab-8ff3-cd8ceef96aec-kube-api-access-t6fvw" (OuterVolumeSpecName: "kube-api-access-t6fvw") pod "3d2edd4f-889c-49ab-8ff3-cd8ceef96aec" (UID: "3d2edd4f-889c-49ab-8ff3-cd8ceef96aec"). InnerVolumeSpecName "kube-api-access-t6fvw". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 14 05:08:25.170998 ip-10-0-136-9 kubenswrapper[2584]: I0714 05:08:25.170954 2584 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-t6fvw\" (UniqueName: \"kubernetes.io/projected/3d2edd4f-889c-49ab-8ff3-cd8ceef96aec-kube-api-access-t6fvw\") on node \"ip-10-0-136-9.ec2.internal\" DevicePath \"\"" Jul 14 05:08:25.314904 ip-10-0-136-9 kubenswrapper[2584]: I0714 05:08:25.314811 2584 generic.go:356] "Generic (PLEG): container finished" podID="3d2edd4f-889c-49ab-8ff3-cd8ceef96aec" containerID="47b90c51160dc0792917ae7cf697fae60a2a4080a75e929b267ca8c8a4318506" exitCode=0 Jul 14 05:08:25.314904 ip-10-0-136-9 kubenswrapper[2584]: I0714 05:08:25.314855 2584 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-75d556bd77-gfv6r" Jul 14 05:08:25.315443 ip-10-0-136-9 kubenswrapper[2584]: I0714 05:08:25.314896 2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-75d556bd77-gfv6r" event={"ID":"3d2edd4f-889c-49ab-8ff3-cd8ceef96aec","Type":"ContainerDied","Data":"47b90c51160dc0792917ae7cf697fae60a2a4080a75e929b267ca8c8a4318506"} Jul 14 05:08:25.315443 ip-10-0-136-9 kubenswrapper[2584]: I0714 05:08:25.314960 2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-75d556bd77-gfv6r" event={"ID":"3d2edd4f-889c-49ab-8ff3-cd8ceef96aec","Type":"ContainerDied","Data":"9df87d16843553dc8cea869d120b5907319aba1e4d81b73ad147c3d85de70c33"} Jul 14 05:08:25.315443 ip-10-0-136-9 kubenswrapper[2584]: I0714 05:08:25.314980 2584 scope.go:117] "RemoveContainer" containerID="47b90c51160dc0792917ae7cf697fae60a2a4080a75e929b267ca8c8a4318506" Jul 14 05:08:25.325042 ip-10-0-136-9 kubenswrapper[2584]: I0714 05:08:25.325022 2584 scope.go:117] "RemoveContainer" containerID="47b90c51160dc0792917ae7cf697fae60a2a4080a75e929b267ca8c8a4318506" Jul 14 05:08:25.325389 ip-10-0-136-9 kubenswrapper[2584]: E0714 05:08:25.325368 2584 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"47b90c51160dc0792917ae7cf697fae60a2a4080a75e929b267ca8c8a4318506\": container with ID starting with 47b90c51160dc0792917ae7cf697fae60a2a4080a75e929b267ca8c8a4318506 not found: ID does not exist" containerID="47b90c51160dc0792917ae7cf697fae60a2a4080a75e929b267ca8c8a4318506" Jul 14 05:08:25.325453 ip-10-0-136-9 kubenswrapper[2584]: I0714 05:08:25.325398 2584 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"47b90c51160dc0792917ae7cf697fae60a2a4080a75e929b267ca8c8a4318506"} err="failed to get container status \"47b90c51160dc0792917ae7cf697fae60a2a4080a75e929b267ca8c8a4318506\": rpc error: code = NotFound desc = could not find container \"47b90c51160dc0792917ae7cf697fae60a2a4080a75e929b267ca8c8a4318506\": container with ID starting with 47b90c51160dc0792917ae7cf697fae60a2a4080a75e929b267ca8c8a4318506 not found: ID does not exist" Jul 14 05:08:25.340154 ip-10-0-136-9 kubenswrapper[2584]: I0714 05:08:25.340118 2584 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-75d556bd77-gfv6r"] Jul 14 05:08:25.344532 ip-10-0-136-9 kubenswrapper[2584]: I0714 05:08:25.344497 2584 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/authorino-75d556bd77-gfv6r"] Jul 14 05:08:25.530336 ip-10-0-136-9 kubenswrapper[2584]: I0714 05:08:25.530294 2584 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="3d2edd4f-889c-49ab-8ff3-cd8ceef96aec" path="/var/lib/kubelet/pods/3d2edd4f-889c-49ab-8ff3-cd8ceef96aec/volumes" Jul 14 05:08:25.530740 ip-10-0-136-9 kubenswrapper[2584]: I0714 05:08:25.530720 2584 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="ebe6c078-30bf-4901-aad7-8fadbacd9716" path="/var/lib/kubelet/pods/ebe6c078-30bf-4901-aad7-8fadbacd9716/volumes" Jul 14 05:08:29.428345 ip-10-0-136-9 kubenswrapper[2584]: I0714 05:08:29.428299 2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-g257n_15609856-4056-487b-acdd-30276263b098/konnectivity-agent/0.log" limit=1024 Jul 14 05:08:29.435921 ip-10-0-136-9 kubenswrapper[2584]: I0714 05:08:29.435878 2584 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/maas-controller-6bc449465c-sqq8m"] Jul 14 05:08:29.436329 ip-10-0-136-9 kubenswrapper[2584]: I0714 05:08:29.436315 2584 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="3d2edd4f-889c-49ab-8ff3-cd8ceef96aec" containerName="authorino" Jul 14 05:08:29.436370 ip-10-0-136-9 kubenswrapper[2584]: I0714 05:08:29.436331 2584 state_mem.go:107] "Deleted CPUSet assignment" podUID="3d2edd4f-889c-49ab-8ff3-cd8ceef96aec" containerName="authorino" Jul 14 05:08:29.436417 ip-10-0-136-9 kubenswrapper[2584]: I0714 05:08:29.436408 2584 memory_manager.go:368] "RemoveStaleState removing state" podUID="3d2edd4f-889c-49ab-8ff3-cd8ceef96aec" containerName="authorino" Jul 14 05:08:29.527695 ip-10-0-136-9 kubenswrapper[2584]: I0714 05:08:29.527651 2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-g257n_15609856-4056-487b-acdd-30276263b098/konnectivity-agent/0.log" limit=1024 Jul 14 05:08:29.603528 ip-10-0-136-9 kubenswrapper[2584]: I0714 05:08:29.603490 2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-g257n_15609856-4056-487b-acdd-30276263b098/konnectivity-agent/0.log" limit=1024 Jul 14 05:08:29.659416 ip-10-0-136-9 kubenswrapper[2584]: I0714 05:08:29.659378 2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-6bc449465c-sqq8m" Jul 14 05:08:29.662390 ip-10-0-136-9 kubenswrapper[2584]: I0714 05:08:29.662364 2584 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"maas-parameters\"" Jul 14 05:08:29.662549 ip-10-0-136-9 kubenswrapper[2584]: I0714 05:08:29.662364 2584 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"maas-controller-dockercfg-gxk98\"" Jul 14 05:08:29.662549 ip-10-0-136-9 kubenswrapper[2584]: I0714 05:08:29.662364 2584 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"maas-controller-webhook-cert\"" Jul 14 05:08:29.666818 ip-10-0-136-9 kubenswrapper[2584]: I0714 05:08:29.666791 2584 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-controller-6bc449465c-sqq8m"] Jul 14 05:08:29.666970 ip-10-0-136-9 kubenswrapper[2584]: I0714 05:08:29.666844 2584 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/maas-controller-585cdbd87d-vxfrj"] Jul 14 05:08:29.679530 ip-10-0-136-9 kubenswrapper[2584]: I0714 05:08:29.679449 2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-g257n_15609856-4056-487b-acdd-30276263b098/konnectivity-agent/0.log" limit=1024 Jul 14 05:08:29.686713 ip-10-0-136-9 kubenswrapper[2584]: I0714 05:08:29.686684 2584 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-controller-585cdbd87d-vxfrj"] Jul 14 05:08:29.686832 ip-10-0-136-9 kubenswrapper[2584]: I0714 05:08:29.686777 2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-585cdbd87d-vxfrj" Jul 14 05:08:29.709327 ip-10-0-136-9 kubenswrapper[2584]: I0714 05:08:29.709293 2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/4e82cdce-aafb-4f02-8599-95fd167c3108-webhook-cert\") pod \"maas-controller-6bc449465c-sqq8m\" (UID: \"4e82cdce-aafb-4f02-8599-95fd167c3108\") " pod="opendatahub/maas-controller-6bc449465c-sqq8m" Jul 14 05:08:29.709507 ip-10-0-136-9 kubenswrapper[2584]: I0714 05:08:29.709356 2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-498kk\" (UniqueName: \"kubernetes.io/projected/263d4e63-6d20-40be-b791-f7e63709b043-kube-api-access-498kk\") pod \"maas-controller-585cdbd87d-vxfrj\" (UID: \"263d4e63-6d20-40be-b791-f7e63709b043\") " pod="opendatahub/maas-controller-585cdbd87d-vxfrj" Jul 14 05:08:29.709507 ip-10-0-136-9 kubenswrapper[2584]: I0714 05:08:29.709410 2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-gl42z\" (UniqueName: \"kubernetes.io/projected/4e82cdce-aafb-4f02-8599-95fd167c3108-kube-api-access-gl42z\") pod \"maas-controller-6bc449465c-sqq8m\" (UID: \"4e82cdce-aafb-4f02-8599-95fd167c3108\") " pod="opendatahub/maas-controller-6bc449465c-sqq8m" Jul 14 05:08:29.709507 ip-10-0-136-9 kubenswrapper[2584]: I0714 05:08:29.709438 2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/263d4e63-6d20-40be-b791-f7e63709b043-webhook-cert\") pod \"maas-controller-585cdbd87d-vxfrj\" (UID: \"263d4e63-6d20-40be-b791-f7e63709b043\") " pod="opendatahub/maas-controller-585cdbd87d-vxfrj" Jul 14 05:08:29.810353 ip-10-0-136-9 kubenswrapper[2584]: I0714 05:08:29.810314 2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-498kk\" (UniqueName: \"kubernetes.io/projected/263d4e63-6d20-40be-b791-f7e63709b043-kube-api-access-498kk\") pod \"maas-controller-585cdbd87d-vxfrj\" (UID: \"263d4e63-6d20-40be-b791-f7e63709b043\") " pod="opendatahub/maas-controller-585cdbd87d-vxfrj" Jul 14 05:08:29.810520 ip-10-0-136-9 kubenswrapper[2584]: I0714 05:08:29.810362 2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-gl42z\" (UniqueName: \"kubernetes.io/projected/4e82cdce-aafb-4f02-8599-95fd167c3108-kube-api-access-gl42z\") pod \"maas-controller-6bc449465c-sqq8m\" (UID: \"4e82cdce-aafb-4f02-8599-95fd167c3108\") " pod="opendatahub/maas-controller-6bc449465c-sqq8m" Jul 14 05:08:29.810520 ip-10-0-136-9 kubenswrapper[2584]: I0714 05:08:29.810391 2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/263d4e63-6d20-40be-b791-f7e63709b043-webhook-cert\") pod \"maas-controller-585cdbd87d-vxfrj\" (UID: \"263d4e63-6d20-40be-b791-f7e63709b043\") " pod="opendatahub/maas-controller-585cdbd87d-vxfrj" Jul 14 05:08:29.810520 ip-10-0-136-9 kubenswrapper[2584]: I0714 05:08:29.810436 2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/4e82cdce-aafb-4f02-8599-95fd167c3108-webhook-cert\") pod \"maas-controller-6bc449465c-sqq8m\" (UID: \"4e82cdce-aafb-4f02-8599-95fd167c3108\") " pod="opendatahub/maas-controller-6bc449465c-sqq8m" Jul 14 05:08:29.812918 ip-10-0-136-9 kubenswrapper[2584]: I0714 05:08:29.812891 2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/4e82cdce-aafb-4f02-8599-95fd167c3108-webhook-cert\") pod \"maas-controller-6bc449465c-sqq8m\" (UID: \"4e82cdce-aafb-4f02-8599-95fd167c3108\") " pod="opendatahub/maas-controller-6bc449465c-sqq8m" Jul 14 05:08:29.812918 ip-10-0-136-9 kubenswrapper[2584]: I0714 05:08:29.812907 2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/263d4e63-6d20-40be-b791-f7e63709b043-webhook-cert\") pod \"maas-controller-585cdbd87d-vxfrj\" (UID: \"263d4e63-6d20-40be-b791-f7e63709b043\") " pod="opendatahub/maas-controller-585cdbd87d-vxfrj" Jul 14 05:08:29.818312 ip-10-0-136-9 kubenswrapper[2584]: I0714 05:08:29.818287 2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-gl42z\" (UniqueName: \"kubernetes.io/projected/4e82cdce-aafb-4f02-8599-95fd167c3108-kube-api-access-gl42z\") pod \"maas-controller-6bc449465c-sqq8m\" (UID: \"4e82cdce-aafb-4f02-8599-95fd167c3108\") " pod="opendatahub/maas-controller-6bc449465c-sqq8m" Jul 14 05:08:29.818477 ip-10-0-136-9 kubenswrapper[2584]: I0714 05:08:29.818453 2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-498kk\" (UniqueName: \"kubernetes.io/projected/263d4e63-6d20-40be-b791-f7e63709b043-kube-api-access-498kk\") pod \"maas-controller-585cdbd87d-vxfrj\" (UID: \"263d4e63-6d20-40be-b791-f7e63709b043\") " pod="opendatahub/maas-controller-585cdbd87d-vxfrj" Jul 14 05:08:29.971238 ip-10-0-136-9 kubenswrapper[2584]: I0714 05:08:29.971149 2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-6bc449465c-sqq8m" Jul 14 05:08:29.997419 ip-10-0-136-9 kubenswrapper[2584]: I0714 05:08:29.997391 2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-585cdbd87d-vxfrj" Jul 14 05:08:30.140084 ip-10-0-136-9 kubenswrapper[2584]: I0714 05:08:30.140036 2584 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-controller-6bc449465c-sqq8m"] Jul 14 05:08:30.142361 ip-10-0-136-9 kubenswrapper[2584]: W0714 05:08:30.142325 2584 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod4e82cdce_aafb_4f02_8599_95fd167c3108.slice/crio-36ff7c7af68268bf51be4c348e181dc7190a0bc11f871f5d74a7dc9249e5ec2f WatchSource:0}: Error finding container 36ff7c7af68268bf51be4c348e181dc7190a0bc11f871f5d74a7dc9249e5ec2f: Status 404 returned error can't find the container with id 36ff7c7af68268bf51be4c348e181dc7190a0bc11f871f5d74a7dc9249e5ec2f Jul 14 05:08:30.166697 ip-10-0-136-9 kubenswrapper[2584]: I0714 05:08:30.166657 2584 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-controller-585cdbd87d-vxfrj"] Jul 14 05:08:30.168802 ip-10-0-136-9 kubenswrapper[2584]: W0714 05:08:30.168769 2584 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod263d4e63_6d20_40be_b791_f7e63709b043.slice/crio-83d3f041a0b6927a6064aebf027a345c69b262e31b08c7a848dc6e63bceeafb1 WatchSource:0}: Error finding container 83d3f041a0b6927a6064aebf027a345c69b262e31b08c7a848dc6e63bceeafb1: Status 404 returned error can't find the container with id 83d3f041a0b6927a6064aebf027a345c69b262e31b08c7a848dc6e63bceeafb1 Jul 14 05:08:30.341637 ip-10-0-136-9 kubenswrapper[2584]: I0714 05:08:30.341601 2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-585cdbd87d-vxfrj" event={"ID":"263d4e63-6d20-40be-b791-f7e63709b043","Type":"ContainerStarted","Data":"83d3f041a0b6927a6064aebf027a345c69b262e31b08c7a848dc6e63bceeafb1"} Jul 14 05:08:30.342696 ip-10-0-136-9 kubenswrapper[2584]: I0714 05:08:30.342669 2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-6bc449465c-sqq8m" event={"ID":"4e82cdce-aafb-4f02-8599-95fd167c3108","Type":"ContainerStarted","Data":"36ff7c7af68268bf51be4c348e181dc7190a0bc11f871f5d74a7dc9249e5ec2f"} Jul 14 05:08:33.175419 ip-10-0-136-9 kubenswrapper[2584]: I0714 05:08:33.175379 2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-g257n_15609856-4056-487b-acdd-30276263b098/konnectivity-agent/0.log" limit=1024 Jul 14 05:08:33.306495 ip-10-0-136-9 kubenswrapper[2584]: I0714 05:08:33.306395 2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-g257n_15609856-4056-487b-acdd-30276263b098/konnectivity-agent/0.log" limit=1024 Jul 14 05:08:33.362548 ip-10-0-136-9 kubenswrapper[2584]: I0714 05:08:33.362501 2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-6bc449465c-sqq8m" event={"ID":"4e82cdce-aafb-4f02-8599-95fd167c3108","Type":"ContainerStarted","Data":"4f0356492067da9e32368dc31631b02ace5f425c655560d92d6256e2d19d2fb7"} Jul 14 05:08:33.362736 ip-10-0-136-9 kubenswrapper[2584]: I0714 05:08:33.362571 2584 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/maas-controller-6bc449465c-sqq8m" Jul 14 05:08:33.364034 ip-10-0-136-9 kubenswrapper[2584]: I0714 05:08:33.364014 2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-585cdbd87d-vxfrj" event={"ID":"263d4e63-6d20-40be-b791-f7e63709b043","Type":"ContainerStarted","Data":"a9720fe4ffd0045043da7d6ad4f21bf7015ffac700f529702566ebbf1c7e122f"} Jul 14 05:08:33.364100 ip-10-0-136-9 kubenswrapper[2584]: I0714 05:08:33.364059 2584 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/maas-controller-585cdbd87d-vxfrj" Jul 14 05:08:33.400312 ip-10-0-136-9 kubenswrapper[2584]: I0714 05:08:33.400243 2584 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/maas-controller-6bc449465c-sqq8m" podStartSLOduration=1.599821739 podStartE2EDuration="4.400220527s" totalImagesPullingTime="2.800398788s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-14 05:08:29 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-14 05:08:33.396928366 +0000 UTC m=+574.358184074" watchObservedRunningTime="2026-07-14 05:08:33.400220527 +0000 UTC m=+574.361476232" Jul 14 05:08:33.424882 ip-10-0-136-9 kubenswrapper[2584]: I0714 05:08:33.424824 2584 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/maas-controller-585cdbd87d-vxfrj" podStartSLOduration=1.639918583 podStartE2EDuration="4.42480418s" totalImagesPullingTime="2.784885597s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-14 05:08:29 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-14 05:08:33.423367574 +0000 UTC m=+574.384623281" watchObservedRunningTime="2026-07-14 05:08:33.42480418 +0000 UTC m=+574.386059884" Jul 14 05:08:44.371871 ip-10-0-136-9 kubenswrapper[2584]: I0714 05:08:44.371836 2584 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/maas-controller-585cdbd87d-vxfrj" Jul 14 05:08:44.372310 ip-10-0-136-9 kubenswrapper[2584]: I0714 05:08:44.371912 2584 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/maas-controller-6bc449465c-sqq8m" Jul 14 05:08:44.432400 ip-10-0-136-9 kubenswrapper[2584]: I0714 05:08:44.432362 2584 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/maas-controller-6bc449465c-sqq8m"] Jul 14 05:08:44.432614 ip-10-0-136-9 kubenswrapper[2584]: I0714 05:08:44.432564 2584 kuberuntime_container.go:873] "Killing container with a grace period" pod="opendatahub/maas-controller-6bc449465c-sqq8m" podUID="4e82cdce-aafb-4f02-8599-95fd167c3108" containerName="manager" containerID="cri-o://4f0356492067da9e32368dc31631b02ace5f425c655560d92d6256e2d19d2fb7" gracePeriod=30 Jul 14 05:08:44.711701 ip-10-0-136-9 kubenswrapper[2584]: I0714 05:08:44.711669 2584 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-6bc449465c-sqq8m" Jul 14 05:08:44.852445 ip-10-0-136-9 kubenswrapper[2584]: I0714 05:08:44.852405 2584 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-gl42z\" (UniqueName: \"kubernetes.io/projected/4e82cdce-aafb-4f02-8599-95fd167c3108-kube-api-access-gl42z\") pod \"4e82cdce-aafb-4f02-8599-95fd167c3108\" (UID: \"4e82cdce-aafb-4f02-8599-95fd167c3108\") " Jul 14 05:08:44.852658 ip-10-0-136-9 kubenswrapper[2584]: I0714 05:08:44.852511 2584 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/4e82cdce-aafb-4f02-8599-95fd167c3108-webhook-cert\") pod \"4e82cdce-aafb-4f02-8599-95fd167c3108\" (UID: \"4e82cdce-aafb-4f02-8599-95fd167c3108\") " Jul 14 05:08:44.854764 ip-10-0-136-9 kubenswrapper[2584]: I0714 05:08:44.854732 2584 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/4e82cdce-aafb-4f02-8599-95fd167c3108-kube-api-access-gl42z" (OuterVolumeSpecName: "kube-api-access-gl42z") pod "4e82cdce-aafb-4f02-8599-95fd167c3108" (UID: "4e82cdce-aafb-4f02-8599-95fd167c3108"). InnerVolumeSpecName "kube-api-access-gl42z". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 14 05:08:44.854867 ip-10-0-136-9 kubenswrapper[2584]: I0714 05:08:44.854739 2584 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/4e82cdce-aafb-4f02-8599-95fd167c3108-webhook-cert" (OuterVolumeSpecName: "webhook-cert") pod "4e82cdce-aafb-4f02-8599-95fd167c3108" (UID: "4e82cdce-aafb-4f02-8599-95fd167c3108"). InnerVolumeSpecName "webhook-cert". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 14 05:08:44.954125 ip-10-0-136-9 kubenswrapper[2584]: I0714 05:08:44.954026 2584 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-gl42z\" (UniqueName: \"kubernetes.io/projected/4e82cdce-aafb-4f02-8599-95fd167c3108-kube-api-access-gl42z\") on node \"ip-10-0-136-9.ec2.internal\" DevicePath \"\"" Jul 14 05:08:44.954125 ip-10-0-136-9 kubenswrapper[2584]: I0714 05:08:44.954064 2584 reconciler_common.go:299] "Volume detached for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/4e82cdce-aafb-4f02-8599-95fd167c3108-webhook-cert\") on node \"ip-10-0-136-9.ec2.internal\" DevicePath \"\"" Jul 14 05:08:45.433585 ip-10-0-136-9 kubenswrapper[2584]: I0714 05:08:45.433549 2584 generic.go:356] "Generic (PLEG): container finished" podID="4e82cdce-aafb-4f02-8599-95fd167c3108" containerID="4f0356492067da9e32368dc31631b02ace5f425c655560d92d6256e2d19d2fb7" exitCode=0 Jul 14 05:08:45.434050 ip-10-0-136-9 kubenswrapper[2584]: I0714 05:08:45.433639 2584 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-6bc449465c-sqq8m" Jul 14 05:08:45.434050 ip-10-0-136-9 kubenswrapper[2584]: I0714 05:08:45.433685 2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-6bc449465c-sqq8m" event={"ID":"4e82cdce-aafb-4f02-8599-95fd167c3108","Type":"ContainerDied","Data":"4f0356492067da9e32368dc31631b02ace5f425c655560d92d6256e2d19d2fb7"} Jul 14 05:08:45.434050 ip-10-0-136-9 kubenswrapper[2584]: I0714 05:08:45.433743 2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-6bc449465c-sqq8m" event={"ID":"4e82cdce-aafb-4f02-8599-95fd167c3108","Type":"ContainerDied","Data":"36ff7c7af68268bf51be4c348e181dc7190a0bc11f871f5d74a7dc9249e5ec2f"} Jul 14 05:08:45.434050 ip-10-0-136-9 kubenswrapper[2584]: I0714 05:08:45.433776 2584 scope.go:117] "RemoveContainer" containerID="4f0356492067da9e32368dc31631b02ace5f425c655560d92d6256e2d19d2fb7" Jul 14 05:08:45.443533 ip-10-0-136-9 kubenswrapper[2584]: I0714 05:08:45.443514 2584 scope.go:117] "RemoveContainer" containerID="4f0356492067da9e32368dc31631b02ace5f425c655560d92d6256e2d19d2fb7" Jul 14 05:08:45.443862 ip-10-0-136-9 kubenswrapper[2584]: E0714 05:08:45.443844 2584 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"4f0356492067da9e32368dc31631b02ace5f425c655560d92d6256e2d19d2fb7\": container with ID starting with 4f0356492067da9e32368dc31631b02ace5f425c655560d92d6256e2d19d2fb7 not found: ID does not exist" containerID="4f0356492067da9e32368dc31631b02ace5f425c655560d92d6256e2d19d2fb7" Jul 14 05:08:45.443958 ip-10-0-136-9 kubenswrapper[2584]: I0714 05:08:45.443876 2584 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"4f0356492067da9e32368dc31631b02ace5f425c655560d92d6256e2d19d2fb7"} err="failed to get container status \"4f0356492067da9e32368dc31631b02ace5f425c655560d92d6256e2d19d2fb7\": rpc error: code = NotFound desc = could not find container \"4f0356492067da9e32368dc31631b02ace5f425c655560d92d6256e2d19d2fb7\": container with ID starting with 4f0356492067da9e32368dc31631b02ace5f425c655560d92d6256e2d19d2fb7 not found: ID does not exist" Jul 14 05:08:45.458321 ip-10-0-136-9 kubenswrapper[2584]: I0714 05:08:45.458287 2584 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/maas-controller-6bc449465c-sqq8m"] Jul 14 05:08:45.464014 ip-10-0-136-9 kubenswrapper[2584]: I0714 05:08:45.463981 2584 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["opendatahub/maas-controller-6bc449465c-sqq8m"] Jul 14 05:08:45.531322 ip-10-0-136-9 kubenswrapper[2584]: I0714 05:08:45.531261 2584 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="4e82cdce-aafb-4f02-8599-95fd167c3108" path="/var/lib/kubelet/pods/4e82cdce-aafb-4f02-8599-95fd167c3108/volumes" Jul 14 05:08:51.423241 ip-10-0-136-9 kubenswrapper[2584]: I0714 05:08:51.423203 2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-g257n_15609856-4056-487b-acdd-30276263b098/konnectivity-agent/0.log" limit=1024 Jul 14 05:08:55.262857 ip-10-0-136-9 kubenswrapper[2584]: I0714 05:08:55.262811 2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-g257n_15609856-4056-487b-acdd-30276263b098/konnectivity-agent/0.log" limit=1024 Jul 14 05:08:59.429538 ip-10-0-136-9 kubenswrapper[2584]: I0714 05:08:59.429504 2584 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-7866497494-wh846_b0b64988-41ac-4e49-bcfd-a08adebb37f7/console-operator/1.log" Jul 14 05:08:59.432053 ip-10-0-136-9 kubenswrapper[2584]: I0714 05:08:59.432030 2584 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-7866497494-wh846_b0b64988-41ac-4e49-bcfd-a08adebb37f7/console-operator/1.log" Jul 14 05:08:59.440950 ip-10-0-136-9 kubenswrapper[2584]: I0714 05:08:59.436522 2584 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-8llzd_694d0f90-6317-495d-a312-b76a3513730e/ovn-acl-logging/0.log" Jul 14 05:08:59.444996 ip-10-0-136-9 kubenswrapper[2584]: I0714 05:08:59.444972 2584 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-8llzd_694d0f90-6317-495d-a312-b76a3513730e/ovn-acl-logging/0.log" Jul 14 05:09:05.814439 ip-10-0-136-9 kubenswrapper[2584]: I0714 05:09:05.814388 2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-g257n_15609856-4056-487b-acdd-30276263b098/konnectivity-agent/0.log" limit=1024 Jul 14 05:09:05.906742 ip-10-0-136-9 kubenswrapper[2584]: I0714 05:09:05.906706 2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-g257n_15609856-4056-487b-acdd-30276263b098/konnectivity-agent/0.log" limit=1024 Jul 14 05:09:06.302949 ip-10-0-136-9 kubenswrapper[2584]: I0714 05:09:06.302898 2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-g257n_15609856-4056-487b-acdd-30276263b098/konnectivity-agent/0.log" limit=1024 Jul 14 05:09:06.368616 ip-10-0-136-9 kubenswrapper[2584]: I0714 05:09:06.368580 2584 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-f99fd96f7-dsl9x"] Jul 14 05:09:06.369016 ip-10-0-136-9 kubenswrapper[2584]: I0714 05:09:06.368999 2584 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="4e82cdce-aafb-4f02-8599-95fd167c3108" containerName="manager" Jul 14 05:09:06.369116 ip-10-0-136-9 kubenswrapper[2584]: I0714 05:09:06.369018 2584 state_mem.go:107] "Deleted CPUSet assignment" podUID="4e82cdce-aafb-4f02-8599-95fd167c3108" containerName="manager" Jul 14 05:09:06.369116 ip-10-0-136-9 kubenswrapper[2584]: I0714 05:09:06.369102 2584 memory_manager.go:368] "RemoveStaleState removing state" podUID="4e82cdce-aafb-4f02-8599-95fd167c3108" containerName="manager" Jul 14 05:09:06.376001 ip-10-0-136-9 kubenswrapper[2584]: I0714 05:09:06.375977 2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-f99fd96f7-dsl9x" Jul 14 05:09:06.378837 ip-10-0-136-9 kubenswrapper[2584]: I0714 05:09:06.378811 2584 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-dockercfg-9crvm\"" Jul 14 05:09:06.379142 ip-10-0-136-9 kubenswrapper[2584]: I0714 05:09:06.379121 2584 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-serving-cert\"" Jul 14 05:09:06.379960 ip-10-0-136-9 kubenswrapper[2584]: I0714 05:09:06.379909 2584 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-f99fd96f7-dsl9x"] Jul 14 05:09:06.551767 ip-10-0-136-9 kubenswrapper[2584]: I0714 05:09:06.551733 2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-wlvq6\" (UniqueName: \"kubernetes.io/projected/099b7088-de00-4fc8-8605-a7de9176d6f9-kube-api-access-wlvq6\") pod \"maas-api-f99fd96f7-dsl9x\" (UID: \"099b7088-de00-4fc8-8605-a7de9176d6f9\") " pod="odh-ai-gateway-infra/maas-api-f99fd96f7-dsl9x" Jul 14 05:09:06.551967 ip-10-0-136-9 kubenswrapper[2584]: I0714 05:09:06.551802 2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/099b7088-de00-4fc8-8605-a7de9176d6f9-maas-api-tls\") pod \"maas-api-f99fd96f7-dsl9x\" (UID: \"099b7088-de00-4fc8-8605-a7de9176d6f9\") " pod="odh-ai-gateway-infra/maas-api-f99fd96f7-dsl9x" Jul 14 05:09:06.551967 ip-10-0-136-9 kubenswrapper[2584]: I0714 05:09:06.551833 2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/099b7088-de00-4fc8-8605-a7de9176d6f9-openshift-service-ca\") pod \"maas-api-f99fd96f7-dsl9x\" (UID: \"099b7088-de00-4fc8-8605-a7de9176d6f9\") " pod="odh-ai-gateway-infra/maas-api-f99fd96f7-dsl9x" Jul 14 05:09:06.652867 ip-10-0-136-9 kubenswrapper[2584]: I0714 05:09:06.652839 2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-wlvq6\" (UniqueName: \"kubernetes.io/projected/099b7088-de00-4fc8-8605-a7de9176d6f9-kube-api-access-wlvq6\") pod \"maas-api-f99fd96f7-dsl9x\" (UID: \"099b7088-de00-4fc8-8605-a7de9176d6f9\") " pod="odh-ai-gateway-infra/maas-api-f99fd96f7-dsl9x" Jul 14 05:09:06.653121 ip-10-0-136-9 kubenswrapper[2584]: I0714 05:09:06.652914 2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/099b7088-de00-4fc8-8605-a7de9176d6f9-maas-api-tls\") pod \"maas-api-f99fd96f7-dsl9x\" (UID: \"099b7088-de00-4fc8-8605-a7de9176d6f9\") " pod="odh-ai-gateway-infra/maas-api-f99fd96f7-dsl9x" Jul 14 05:09:06.653121 ip-10-0-136-9 kubenswrapper[2584]: I0714 05:09:06.652972 2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/099b7088-de00-4fc8-8605-a7de9176d6f9-openshift-service-ca\") pod \"maas-api-f99fd96f7-dsl9x\" (UID: \"099b7088-de00-4fc8-8605-a7de9176d6f9\") " pod="odh-ai-gateway-infra/maas-api-f99fd96f7-dsl9x" Jul 14 05:09:06.653680 ip-10-0-136-9 kubenswrapper[2584]: I0714 05:09:06.653656 2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/099b7088-de00-4fc8-8605-a7de9176d6f9-openshift-service-ca\") pod \"maas-api-f99fd96f7-dsl9x\" (UID: \"099b7088-de00-4fc8-8605-a7de9176d6f9\") " pod="odh-ai-gateway-infra/maas-api-f99fd96f7-dsl9x" Jul 14 05:09:06.655354 ip-10-0-136-9 kubenswrapper[2584]: I0714 05:09:06.655330 2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/099b7088-de00-4fc8-8605-a7de9176d6f9-maas-api-tls\") pod \"maas-api-f99fd96f7-dsl9x\" (UID: \"099b7088-de00-4fc8-8605-a7de9176d6f9\") " pod="odh-ai-gateway-infra/maas-api-f99fd96f7-dsl9x" Jul 14 05:09:06.660868 ip-10-0-136-9 kubenswrapper[2584]: I0714 05:09:06.660848 2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-wlvq6\" (UniqueName: \"kubernetes.io/projected/099b7088-de00-4fc8-8605-a7de9176d6f9-kube-api-access-wlvq6\") pod \"maas-api-f99fd96f7-dsl9x\" (UID: \"099b7088-de00-4fc8-8605-a7de9176d6f9\") " pod="odh-ai-gateway-infra/maas-api-f99fd96f7-dsl9x" Jul 14 05:09:06.676209 ip-10-0-136-9 kubenswrapper[2584]: I0714 05:09:06.676181 2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-g257n_15609856-4056-487b-acdd-30276263b098/konnectivity-agent/0.log" limit=1024 Jul 14 05:09:06.689000 ip-10-0-136-9 kubenswrapper[2584]: I0714 05:09:06.688980 2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-f99fd96f7-dsl9x" Jul 14 05:09:06.776368 ip-10-0-136-9 kubenswrapper[2584]: I0714 05:09:06.776334 2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-g257n_15609856-4056-487b-acdd-30276263b098/konnectivity-agent/0.log" limit=1024 Jul 14 05:09:06.841122 ip-10-0-136-9 kubenswrapper[2584]: I0714 05:09:06.841034 2584 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-f99fd96f7-dsl9x"] Jul 14 05:09:06.843759 ip-10-0-136-9 kubenswrapper[2584]: W0714 05:09:06.843717 2584 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod099b7088_de00_4fc8_8605_a7de9176d6f9.slice/crio-c2b378b01326abaae7caa43f4e5d2902b797509941dc3003fdbede40c03abb00 WatchSource:0}: Error finding container c2b378b01326abaae7caa43f4e5d2902b797509941dc3003fdbede40c03abb00: Status 404 returned error can't find the container with id c2b378b01326abaae7caa43f4e5d2902b797509941dc3003fdbede40c03abb00 Jul 14 05:09:06.846656 ip-10-0-136-9 kubenswrapper[2584]: I0714 05:09:06.846627 2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-g257n_15609856-4056-487b-acdd-30276263b098/konnectivity-agent/0.log" limit=1024 Jul 14 05:09:06.885666 ip-10-0-136-9 kubenswrapper[2584]: I0714 05:09:06.885638 2584 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-pre-processing-74584bb9f8-5dz6w"] Jul 14 05:09:06.916810 ip-10-0-136-9 kubenswrapper[2584]: I0714 05:09:06.916755 2584 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-74584bb9f8-5dz6w"] Jul 14 05:09:06.916901 ip-10-0-136-9 kubenswrapper[2584]: I0714 05:09:06.916848 2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-74584bb9f8-5dz6w" Jul 14 05:09:06.919430 ip-10-0-136-9 kubenswrapper[2584]: I0714 05:09:06.919407 2584 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"payload-processing-plugins\"" Jul 14 05:09:06.919585 ip-10-0-136-9 kubenswrapper[2584]: I0714 05:09:06.919570 2584 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"payload-processing-dockercfg-hf6pn\"" Jul 14 05:09:07.057478 ip-10-0-136-9 kubenswrapper[2584]: I0714 05:09:07.057443 2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/585a66e2-b97c-4041-97ec-8c31377a9515-plugins-config-volume\") pod \"payload-pre-processing-74584bb9f8-5dz6w\" (UID: \"585a66e2-b97c-4041-97ec-8c31377a9515\") " pod="openshift-ingress/payload-pre-processing-74584bb9f8-5dz6w" Jul 14 05:09:07.057644 ip-10-0-136-9 kubenswrapper[2584]: I0714 05:09:07.057492 2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-vm45w\" (UniqueName: \"kubernetes.io/projected/585a66e2-b97c-4041-97ec-8c31377a9515-kube-api-access-vm45w\") pod \"payload-pre-processing-74584bb9f8-5dz6w\" (UID: \"585a66e2-b97c-4041-97ec-8c31377a9515\") " pod="openshift-ingress/payload-pre-processing-74584bb9f8-5dz6w" Jul 14 05:09:07.158482 ip-10-0-136-9 kubenswrapper[2584]: I0714 05:09:07.158445 2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/585a66e2-b97c-4041-97ec-8c31377a9515-plugins-config-volume\") pod \"payload-pre-processing-74584bb9f8-5dz6w\" (UID: \"585a66e2-b97c-4041-97ec-8c31377a9515\") " pod="openshift-ingress/payload-pre-processing-74584bb9f8-5dz6w" Jul 14 05:09:07.158482 ip-10-0-136-9 kubenswrapper[2584]: I0714 05:09:07.158479 2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-vm45w\" (UniqueName: \"kubernetes.io/projected/585a66e2-b97c-4041-97ec-8c31377a9515-kube-api-access-vm45w\") pod \"payload-pre-processing-74584bb9f8-5dz6w\" (UID: \"585a66e2-b97c-4041-97ec-8c31377a9515\") " pod="openshift-ingress/payload-pre-processing-74584bb9f8-5dz6w" Jul 14 05:09:07.159300 ip-10-0-136-9 kubenswrapper[2584]: I0714 05:09:07.159279 2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/585a66e2-b97c-4041-97ec-8c31377a9515-plugins-config-volume\") pod \"payload-pre-processing-74584bb9f8-5dz6w\" (UID: \"585a66e2-b97c-4041-97ec-8c31377a9515\") " pod="openshift-ingress/payload-pre-processing-74584bb9f8-5dz6w" Jul 14 05:09:07.166686 ip-10-0-136-9 kubenswrapper[2584]: I0714 05:09:07.166664 2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-vm45w\" (UniqueName: \"kubernetes.io/projected/585a66e2-b97c-4041-97ec-8c31377a9515-kube-api-access-vm45w\") pod \"payload-pre-processing-74584bb9f8-5dz6w\" (UID: \"585a66e2-b97c-4041-97ec-8c31377a9515\") " pod="openshift-ingress/payload-pre-processing-74584bb9f8-5dz6w" Jul 14 05:09:07.228598 ip-10-0-136-9 kubenswrapper[2584]: I0714 05:09:07.228549 2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-74584bb9f8-5dz6w" Jul 14 05:09:07.363239 ip-10-0-136-9 kubenswrapper[2584]: I0714 05:09:07.363212 2584 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-74584bb9f8-5dz6w"] Jul 14 05:09:07.364854 ip-10-0-136-9 kubenswrapper[2584]: W0714 05:09:07.364829 2584 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod585a66e2_b97c_4041_97ec_8c31377a9515.slice/crio-d30a0b91d5c959bfc703f58a534c7a4f65de93c3f61e8ecc11c41c314de80ebb WatchSource:0}: Error finding container d30a0b91d5c959bfc703f58a534c7a4f65de93c3f61e8ecc11c41c314de80ebb: Status 404 returned error can't find the container with id d30a0b91d5c959bfc703f58a534c7a4f65de93c3f61e8ecc11c41c314de80ebb Jul 14 05:09:07.542077 ip-10-0-136-9 kubenswrapper[2584]: I0714 05:09:07.542012 2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-74584bb9f8-5dz6w" event={"ID":"585a66e2-b97c-4041-97ec-8c31377a9515","Type":"ContainerStarted","Data":"d30a0b91d5c959bfc703f58a534c7a4f65de93c3f61e8ecc11c41c314de80ebb"} Jul 14 05:09:07.543147 ip-10-0-136-9 kubenswrapper[2584]: I0714 05:09:07.543125 2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-f99fd96f7-dsl9x" event={"ID":"099b7088-de00-4fc8-8605-a7de9176d6f9","Type":"ContainerStarted","Data":"c2b378b01326abaae7caa43f4e5d2902b797509941dc3003fdbede40c03abb00"} Jul 14 05:09:09.554417 ip-10-0-136-9 kubenswrapper[2584]: I0714 05:09:09.554382 2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-74584bb9f8-5dz6w" event={"ID":"585a66e2-b97c-4041-97ec-8c31377a9515","Type":"ContainerStarted","Data":"1b3186001769527843c5062bf1b470c0f37e4cb1a02af30676960ad77cadcab6"} Jul 14 05:09:09.554841 ip-10-0-136-9 kubenswrapper[2584]: I0714 05:09:09.554500 2584 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-pre-processing-74584bb9f8-5dz6w" Jul 14 05:09:09.555962 ip-10-0-136-9 kubenswrapper[2584]: I0714 05:09:09.555916 2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-f99fd96f7-dsl9x" event={"ID":"099b7088-de00-4fc8-8605-a7de9176d6f9","Type":"ContainerStarted","Data":"7678e68218d5b469d9036686281db55e1194d0bcf7e61a73a826004c37e1d4fa"} Jul 14 05:09:09.556054 ip-10-0-136-9 kubenswrapper[2584]: I0714 05:09:09.555979 2584 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/maas-api-f99fd96f7-dsl9x" Jul 14 05:09:09.569682 ip-10-0-136-9 kubenswrapper[2584]: I0714 05:09:09.569639 2584 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-pre-processing-74584bb9f8-5dz6w" podStartSLOduration=2.019373207 podStartE2EDuration="3.569625296s" totalImagesPullingTime="1.550252089s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-14 05:09:06 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-14 05:09:09.569404338 +0000 UTC m=+610.530660045" watchObservedRunningTime="2026-07-14 05:09:09.569625296 +0000 UTC m=+610.530881000" Jul 14 05:09:09.585069 ip-10-0-136-9 kubenswrapper[2584]: I0714 05:09:09.585032 2584 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-f99fd96f7-dsl9x" podStartSLOduration=1.515538185 podStartE2EDuration="3.585020057s" totalImagesPullingTime="2.069481872s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-14 05:09:06 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-14 05:09:09.584273168 +0000 UTC m=+610.545528874" watchObservedRunningTime="2026-07-14 05:09:09.585020057 +0000 UTC m=+610.546275761" Jul 14 05:09:15.565883 ip-10-0-136-9 kubenswrapper[2584]: I0714 05:09:15.565851 2584 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/maas-api-f99fd96f7-dsl9x" Jul 14 05:09:16.603052 ip-10-0-136-9 kubenswrapper[2584]: I0714 05:09:16.603014 2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-g257n_15609856-4056-487b-acdd-30276263b098/konnectivity-agent/0.log" limit=1024 Jul 14 05:09:16.704403 ip-10-0-136-9 kubenswrapper[2584]: I0714 05:09:16.704363 2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-g257n_15609856-4056-487b-acdd-30276263b098/konnectivity-agent/0.log" limit=1024 Jul 14 05:09:20.563180 ip-10-0-136-9 kubenswrapper[2584]: I0714 05:09:20.563064 2584 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-pre-processing-74584bb9f8-5dz6w" Jul 14 05:09:45.688216 ip-10-0-136-9 kubenswrapper[2584]: I0714 05:09:45.688164 2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-g257n_15609856-4056-487b-acdd-30276263b098/konnectivity-agent/0.log" limit=1024 Jul 14 05:09:54.856766 ip-10-0-136-9 kubenswrapper[2584]: I0714 05:09:54.856721 2584 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["llm/e2e-distinct-simulated-kserve-59975d69f9-g8r7q"] Jul 14 05:09:54.860308 ip-10-0-136-9 kubenswrapper[2584]: I0714 05:09:54.860286 2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-distinct-simulated-kserve-59975d69f9-g8r7q" Jul 14 05:09:54.862850 ip-10-0-136-9 kubenswrapper[2584]: I0714 05:09:54.862827 2584 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"llm\"/\"openshift-service-ca.crt\"" Jul 14 05:09:54.863118 ip-10-0-136-9 kubenswrapper[2584]: I0714 05:09:54.863101 2584 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"default-dockercfg-8qw6h\"" Jul 14 05:09:54.863207 ip-10-0-136-9 kubenswrapper[2584]: I0714 05:09:54.863157 2584 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"llm\"/\"kube-root-ca.crt\"" Jul 14 05:09:54.864100 ip-10-0-136-9 kubenswrapper[2584]: I0714 05:09:54.864062 2584 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"e2e-distinct-simulated-kserve-self-signed-certs\"" Jul 14 05:09:54.870002 ip-10-0-136-9 kubenswrapper[2584]: I0714 05:09:54.869979 2584 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-distinct-simulated-kserve-59975d69f9-g8r7q"] Jul 14 05:09:54.877371 ip-10-0-136-9 kubenswrapper[2584]: I0714 05:09:54.877349 2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-g257n_15609856-4056-487b-acdd-30276263b098/konnectivity-agent/0.log" limit=1024 Jul 14 05:09:54.893313 ip-10-0-136-9 kubenswrapper[2584]: I0714 05:09:54.893290 2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/5483f883-3799-487b-b7d8-47d0d91f91ad-tls-certs\") pod \"e2e-distinct-simulated-kserve-59975d69f9-g8r7q\" (UID: \"5483f883-3799-487b-b7d8-47d0d91f91ad\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-g8r7q" Jul 14 05:09:54.893400 ip-10-0-136-9 kubenswrapper[2584]: I0714 05:09:54.893321 2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-svn5r\" (UniqueName: \"kubernetes.io/projected/5483f883-3799-487b-b7d8-47d0d91f91ad-kube-api-access-svn5r\") pod \"e2e-distinct-simulated-kserve-59975d69f9-g8r7q\" (UID: \"5483f883-3799-487b-b7d8-47d0d91f91ad\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-g8r7q" Jul 14 05:09:54.893400 ip-10-0-136-9 kubenswrapper[2584]: I0714 05:09:54.893346 2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/5483f883-3799-487b-b7d8-47d0d91f91ad-tmp-dir\") pod \"e2e-distinct-simulated-kserve-59975d69f9-g8r7q\" (UID: \"5483f883-3799-487b-b7d8-47d0d91f91ad\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-g8r7q" Jul 14 05:09:54.893473 ip-10-0-136-9 kubenswrapper[2584]: I0714 05:09:54.893401 2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/5483f883-3799-487b-b7d8-47d0d91f91ad-dshm\") pod \"e2e-distinct-simulated-kserve-59975d69f9-g8r7q\" (UID: \"5483f883-3799-487b-b7d8-47d0d91f91ad\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-g8r7q" Jul 14 05:09:54.893473 ip-10-0-136-9 kubenswrapper[2584]: I0714 05:09:54.893440 2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/5483f883-3799-487b-b7d8-47d0d91f91ad-home\") pod \"e2e-distinct-simulated-kserve-59975d69f9-g8r7q\" (UID: \"5483f883-3799-487b-b7d8-47d0d91f91ad\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-g8r7q" Jul 14 05:09:54.893537 ip-10-0-136-9 kubenswrapper[2584]: I0714 05:09:54.893472 2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/5483f883-3799-487b-b7d8-47d0d91f91ad-model-cache\") pod \"e2e-distinct-simulated-kserve-59975d69f9-g8r7q\" (UID: \"5483f883-3799-487b-b7d8-47d0d91f91ad\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-g8r7q" Jul 14 05:09:54.994066 ip-10-0-136-9 kubenswrapper[2584]: I0714 05:09:54.994037 2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/5483f883-3799-487b-b7d8-47d0d91f91ad-tls-certs\") pod \"e2e-distinct-simulated-kserve-59975d69f9-g8r7q\" (UID: \"5483f883-3799-487b-b7d8-47d0d91f91ad\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-g8r7q" Jul 14 05:09:54.994202 ip-10-0-136-9 kubenswrapper[2584]: I0714 05:09:54.994072 2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-svn5r\" (UniqueName: \"kubernetes.io/projected/5483f883-3799-487b-b7d8-47d0d91f91ad-kube-api-access-svn5r\") pod \"e2e-distinct-simulated-kserve-59975d69f9-g8r7q\" (UID: \"5483f883-3799-487b-b7d8-47d0d91f91ad\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-g8r7q" Jul 14 05:09:54.994202 ip-10-0-136-9 kubenswrapper[2584]: I0714 05:09:54.994097 2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/5483f883-3799-487b-b7d8-47d0d91f91ad-tmp-dir\") pod \"e2e-distinct-simulated-kserve-59975d69f9-g8r7q\" (UID: \"5483f883-3799-487b-b7d8-47d0d91f91ad\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-g8r7q" Jul 14 05:09:54.994202 ip-10-0-136-9 kubenswrapper[2584]: I0714 05:09:54.994120 2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/5483f883-3799-487b-b7d8-47d0d91f91ad-dshm\") pod \"e2e-distinct-simulated-kserve-59975d69f9-g8r7q\" (UID: \"5483f883-3799-487b-b7d8-47d0d91f91ad\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-g8r7q" Jul 14 05:09:54.994202 ip-10-0-136-9 kubenswrapper[2584]: I0714 05:09:54.994159 2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/5483f883-3799-487b-b7d8-47d0d91f91ad-home\") pod \"e2e-distinct-simulated-kserve-59975d69f9-g8r7q\" (UID: \"5483f883-3799-487b-b7d8-47d0d91f91ad\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-g8r7q" Jul 14 05:09:54.994407 ip-10-0-136-9 kubenswrapper[2584]: I0714 05:09:54.994209 2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/5483f883-3799-487b-b7d8-47d0d91f91ad-model-cache\") pod \"e2e-distinct-simulated-kserve-59975d69f9-g8r7q\" (UID: \"5483f883-3799-487b-b7d8-47d0d91f91ad\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-g8r7q" Jul 14 05:09:54.994471 ip-10-0-136-9 kubenswrapper[2584]: I0714 05:09:54.994452 2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/5483f883-3799-487b-b7d8-47d0d91f91ad-tmp-dir\") pod \"e2e-distinct-simulated-kserve-59975d69f9-g8r7q\" (UID: \"5483f883-3799-487b-b7d8-47d0d91f91ad\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-g8r7q" Jul 14 05:09:54.994593 ip-10-0-136-9 kubenswrapper[2584]: I0714 05:09:54.994571 2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/5483f883-3799-487b-b7d8-47d0d91f91ad-home\") pod \"e2e-distinct-simulated-kserve-59975d69f9-g8r7q\" (UID: \"5483f883-3799-487b-b7d8-47d0d91f91ad\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-g8r7q" Jul 14 05:09:54.994659 ip-10-0-136-9 kubenswrapper[2584]: I0714 05:09:54.994608 2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/5483f883-3799-487b-b7d8-47d0d91f91ad-model-cache\") pod \"e2e-distinct-simulated-kserve-59975d69f9-g8r7q\" (UID: \"5483f883-3799-487b-b7d8-47d0d91f91ad\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-g8r7q" Jul 14 05:09:54.996397 ip-10-0-136-9 kubenswrapper[2584]: I0714 05:09:54.996377 2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/5483f883-3799-487b-b7d8-47d0d91f91ad-dshm\") pod \"e2e-distinct-simulated-kserve-59975d69f9-g8r7q\" (UID: \"5483f883-3799-487b-b7d8-47d0d91f91ad\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-g8r7q" Jul 14 05:09:54.996507 ip-10-0-136-9 kubenswrapper[2584]: I0714 05:09:54.996489 2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/5483f883-3799-487b-b7d8-47d0d91f91ad-tls-certs\") pod \"e2e-distinct-simulated-kserve-59975d69f9-g8r7q\" (UID: \"5483f883-3799-487b-b7d8-47d0d91f91ad\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-g8r7q" Jul 14 05:09:55.002134 ip-10-0-136-9 kubenswrapper[2584]: I0714 05:09:55.002108 2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-svn5r\" (UniqueName: \"kubernetes.io/projected/5483f883-3799-487b-b7d8-47d0d91f91ad-kube-api-access-svn5r\") pod \"e2e-distinct-simulated-kserve-59975d69f9-g8r7q\" (UID: \"5483f883-3799-487b-b7d8-47d0d91f91ad\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-g8r7q" Jul 14 05:09:55.171151 ip-10-0-136-9 kubenswrapper[2584]: I0714 05:09:55.171061 2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-distinct-simulated-kserve-59975d69f9-g8r7q" Jul 14 05:09:55.308776 ip-10-0-136-9 kubenswrapper[2584]: I0714 05:09:55.308751 2584 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-distinct-simulated-kserve-59975d69f9-g8r7q"] Jul 14 05:09:55.310443 ip-10-0-136-9 kubenswrapper[2584]: W0714 05:09:55.310413 2584 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod5483f883_3799_487b_b7d8_47d0d91f91ad.slice/crio-d69025d4cf61cc14629594cc67477d26bc7eba28c30dd316e3b8f4c4d745b777 WatchSource:0}: Error finding container d69025d4cf61cc14629594cc67477d26bc7eba28c30dd316e3b8f4c4d745b777: Status 404 returned error can't find the container with id d69025d4cf61cc14629594cc67477d26bc7eba28c30dd316e3b8f4c4d745b777 Jul 14 05:09:55.782378 ip-10-0-136-9 kubenswrapper[2584]: I0714 05:09:55.782308 2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-distinct-simulated-kserve-59975d69f9-g8r7q" event={"ID":"5483f883-3799-487b-b7d8-47d0d91f91ad","Type":"ContainerStarted","Data":"d69025d4cf61cc14629594cc67477d26bc7eba28c30dd316e3b8f4c4d745b777"} Jul 14 05:09:56.790537 ip-10-0-136-9 kubenswrapper[2584]: I0714 05:09:56.790494 2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-distinct-simulated-kserve-59975d69f9-g8r7q" event={"ID":"5483f883-3799-487b-b7d8-47d0d91f91ad","Type":"ContainerStarted","Data":"044045519fe128a6de63d668e510781f2db216941595b47ca9155ae85d57f4ca"} Jul 14 05:09:56.810465 ip-10-0-136-9 kubenswrapper[2584]: I0714 05:09:56.810403 2584 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="llm/e2e-distinct-simulated-kserve-59975d69f9-g8r7q" podStartSLOduration=1.788788202 podStartE2EDuration="2.810384528s" totalImagesPullingTime="1.021596326s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-14 05:09:54 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-14 05:09:56.80840208 +0000 UTC m=+657.769657797" watchObservedRunningTime="2026-07-14 05:09:56.810384528 +0000 UTC m=+657.771640234" Jul 14 05:10:05.171866 ip-10-0-136-9 kubenswrapper[2584]: I0714 05:10:05.171821 2584 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="llm/e2e-distinct-simulated-kserve-59975d69f9-g8r7q" Jul 14 05:10:05.172402 ip-10-0-136-9 kubenswrapper[2584]: I0714 05:10:05.171893 2584 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="llm/e2e-distinct-simulated-kserve-59975d69f9-g8r7q" Jul 14 05:10:05.184200 ip-10-0-136-9 kubenswrapper[2584]: I0714 05:10:05.184170 2584 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="llm/e2e-distinct-simulated-kserve-59975d69f9-g8r7q" Jul 14 05:10:05.848452 ip-10-0-136-9 kubenswrapper[2584]: I0714 05:10:05.848417 2584 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="llm/e2e-distinct-simulated-kserve-59975d69f9-g8r7q" Jul 14 05:10:11.838813 ip-10-0-136-9 kubenswrapper[2584]: I0714 05:10:11.838776 2584 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["llm/e2e-trlp-test-simulated-kserve-598466548d-dxdf7"] Jul 14 05:10:11.843654 ip-10-0-136-9 kubenswrapper[2584]: I0714 05:10:11.843632 2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-trlp-test-simulated-kserve-598466548d-dxdf7" Jul 14 05:10:11.846232 ip-10-0-136-9 kubenswrapper[2584]: I0714 05:10:11.846207 2584 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"e2e-trlp-test-simulated-kserve-self-signed-certs\"" Jul 14 05:10:11.852755 ip-10-0-136-9 kubenswrapper[2584]: I0714 05:10:11.852718 2584 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-trlp-test-simulated-kserve-598466548d-dxdf7"] Jul 14 05:10:11.859011 ip-10-0-136-9 kubenswrapper[2584]: I0714 05:10:11.858980 2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-g257n_15609856-4056-487b-acdd-30276263b098/konnectivity-agent/0.log" limit=1024 Jul 14 05:10:11.927156 ip-10-0-136-9 kubenswrapper[2584]: I0714 05:10:11.927112 2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/4b1e99ef-1f3f-4997-b512-40e10dae3979-home\") pod \"e2e-trlp-test-simulated-kserve-598466548d-dxdf7\" (UID: \"4b1e99ef-1f3f-4997-b512-40e10dae3979\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-dxdf7" Jul 14 05:10:11.927347 ip-10-0-136-9 kubenswrapper[2584]: I0714 05:10:11.927171 2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/4b1e99ef-1f3f-4997-b512-40e10dae3979-dshm\") pod \"e2e-trlp-test-simulated-kserve-598466548d-dxdf7\" (UID: \"4b1e99ef-1f3f-4997-b512-40e10dae3979\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-dxdf7" Jul 14 05:10:11.927347 ip-10-0-136-9 kubenswrapper[2584]: I0714 05:10:11.927205 2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/4b1e99ef-1f3f-4997-b512-40e10dae3979-tmp-dir\") pod \"e2e-trlp-test-simulated-kserve-598466548d-dxdf7\" (UID: \"4b1e99ef-1f3f-4997-b512-40e10dae3979\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-dxdf7" Jul 14 05:10:11.927347 ip-10-0-136-9 kubenswrapper[2584]: I0714 05:10:11.927245 2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/4b1e99ef-1f3f-4997-b512-40e10dae3979-model-cache\") pod \"e2e-trlp-test-simulated-kserve-598466548d-dxdf7\" (UID: \"4b1e99ef-1f3f-4997-b512-40e10dae3979\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-dxdf7" Jul 14 05:10:11.927347 ip-10-0-136-9 kubenswrapper[2584]: I0714 05:10:11.927275 2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-fd96l\" (UniqueName: \"kubernetes.io/projected/4b1e99ef-1f3f-4997-b512-40e10dae3979-kube-api-access-fd96l\") pod \"e2e-trlp-test-simulated-kserve-598466548d-dxdf7\" (UID: \"4b1e99ef-1f3f-4997-b512-40e10dae3979\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-dxdf7" Jul 14 05:10:11.927347 ip-10-0-136-9 kubenswrapper[2584]: I0714 05:10:11.927304 2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/4b1e99ef-1f3f-4997-b512-40e10dae3979-tls-certs\") pod \"e2e-trlp-test-simulated-kserve-598466548d-dxdf7\" (UID: \"4b1e99ef-1f3f-4997-b512-40e10dae3979\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-dxdf7" Jul 14 05:10:12.028282 ip-10-0-136-9 kubenswrapper[2584]: I0714 05:10:12.028242 2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/4b1e99ef-1f3f-4997-b512-40e10dae3979-home\") pod \"e2e-trlp-test-simulated-kserve-598466548d-dxdf7\" (UID: \"4b1e99ef-1f3f-4997-b512-40e10dae3979\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-dxdf7" Jul 14 05:10:12.028282 ip-10-0-136-9 kubenswrapper[2584]: I0714 05:10:12.028292 2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/4b1e99ef-1f3f-4997-b512-40e10dae3979-dshm\") pod \"e2e-trlp-test-simulated-kserve-598466548d-dxdf7\" (UID: \"4b1e99ef-1f3f-4997-b512-40e10dae3979\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-dxdf7" Jul 14 05:10:12.028538 ip-10-0-136-9 kubenswrapper[2584]: I0714 05:10:12.028308 2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/4b1e99ef-1f3f-4997-b512-40e10dae3979-tmp-dir\") pod \"e2e-trlp-test-simulated-kserve-598466548d-dxdf7\" (UID: \"4b1e99ef-1f3f-4997-b512-40e10dae3979\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-dxdf7" Jul 14 05:10:12.028538 ip-10-0-136-9 kubenswrapper[2584]: I0714 05:10:12.028353 2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/4b1e99ef-1f3f-4997-b512-40e10dae3979-model-cache\") pod \"e2e-trlp-test-simulated-kserve-598466548d-dxdf7\" (UID: \"4b1e99ef-1f3f-4997-b512-40e10dae3979\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-dxdf7" Jul 14 05:10:12.028538 ip-10-0-136-9 kubenswrapper[2584]: I0714 05:10:12.028385 2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-fd96l\" (UniqueName: \"kubernetes.io/projected/4b1e99ef-1f3f-4997-b512-40e10dae3979-kube-api-access-fd96l\") pod \"e2e-trlp-test-simulated-kserve-598466548d-dxdf7\" (UID: \"4b1e99ef-1f3f-4997-b512-40e10dae3979\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-dxdf7" Jul 14 05:10:12.028538 ip-10-0-136-9 kubenswrapper[2584]: I0714 05:10:12.028427 2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/4b1e99ef-1f3f-4997-b512-40e10dae3979-tls-certs\") pod \"e2e-trlp-test-simulated-kserve-598466548d-dxdf7\" (UID: \"4b1e99ef-1f3f-4997-b512-40e10dae3979\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-dxdf7" Jul 14 05:10:12.028867 ip-10-0-136-9 kubenswrapper[2584]: I0714 05:10:12.028797 2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/4b1e99ef-1f3f-4997-b512-40e10dae3979-home\") pod \"e2e-trlp-test-simulated-kserve-598466548d-dxdf7\" (UID: \"4b1e99ef-1f3f-4997-b512-40e10dae3979\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-dxdf7" Jul 14 05:10:12.029010 ip-10-0-136-9 kubenswrapper[2584]: I0714 05:10:12.028915 2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/4b1e99ef-1f3f-4997-b512-40e10dae3979-tmp-dir\") pod \"e2e-trlp-test-simulated-kserve-598466548d-dxdf7\" (UID: \"4b1e99ef-1f3f-4997-b512-40e10dae3979\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-dxdf7" Jul 14 05:10:12.029010 ip-10-0-136-9 kubenswrapper[2584]: I0714 05:10:12.028963 2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/4b1e99ef-1f3f-4997-b512-40e10dae3979-model-cache\") pod \"e2e-trlp-test-simulated-kserve-598466548d-dxdf7\" (UID: \"4b1e99ef-1f3f-4997-b512-40e10dae3979\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-dxdf7" Jul 14 05:10:12.030635 ip-10-0-136-9 kubenswrapper[2584]: I0714 05:10:12.030613 2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/4b1e99ef-1f3f-4997-b512-40e10dae3979-dshm\") pod \"e2e-trlp-test-simulated-kserve-598466548d-dxdf7\" (UID: \"4b1e99ef-1f3f-4997-b512-40e10dae3979\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-dxdf7" Jul 14 05:10:12.030868 ip-10-0-136-9 kubenswrapper[2584]: I0714 05:10:12.030851 2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/4b1e99ef-1f3f-4997-b512-40e10dae3979-tls-certs\") pod \"e2e-trlp-test-simulated-kserve-598466548d-dxdf7\" (UID: \"4b1e99ef-1f3f-4997-b512-40e10dae3979\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-dxdf7" Jul 14 05:10:12.036613 ip-10-0-136-9 kubenswrapper[2584]: I0714 05:10:12.036587 2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-fd96l\" (UniqueName: \"kubernetes.io/projected/4b1e99ef-1f3f-4997-b512-40e10dae3979-kube-api-access-fd96l\") pod \"e2e-trlp-test-simulated-kserve-598466548d-dxdf7\" (UID: \"4b1e99ef-1f3f-4997-b512-40e10dae3979\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-dxdf7" Jul 14 05:10:12.155328 ip-10-0-136-9 kubenswrapper[2584]: I0714 05:10:12.155245 2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-trlp-test-simulated-kserve-598466548d-dxdf7" Jul 14 05:10:12.300132 ip-10-0-136-9 kubenswrapper[2584]: I0714 05:10:12.300104 2584 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-trlp-test-simulated-kserve-598466548d-dxdf7"] Jul 14 05:10:12.303149 ip-10-0-136-9 kubenswrapper[2584]: W0714 05:10:12.303117 2584 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod4b1e99ef_1f3f_4997_b512_40e10dae3979.slice/crio-058d8e5f7aa4eaab4ab079d98ef46940927e1464b15475130b848b5c45dfd90f WatchSource:0}: Error finding container 058d8e5f7aa4eaab4ab079d98ef46940927e1464b15475130b848b5c45dfd90f: Status 404 returned error can't find the container with id 058d8e5f7aa4eaab4ab079d98ef46940927e1464b15475130b848b5c45dfd90f Jul 14 05:10:12.304824 ip-10-0-136-9 kubenswrapper[2584]: I0714 05:10:12.304804 2584 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider Jul 14 05:10:12.883968 ip-10-0-136-9 kubenswrapper[2584]: I0714 05:10:12.883852 2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-trlp-test-simulated-kserve-598466548d-dxdf7" event={"ID":"4b1e99ef-1f3f-4997-b512-40e10dae3979","Type":"ContainerStarted","Data":"c9701d71d5e30888c239ccd9b8a345b9182f1898ec0bc50564e51a303385b8c4"} Jul 14 05:10:12.883968 ip-10-0-136-9 kubenswrapper[2584]: I0714 05:10:12.883909 2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-trlp-test-simulated-kserve-598466548d-dxdf7" event={"ID":"4b1e99ef-1f3f-4997-b512-40e10dae3979","Type":"ContainerStarted","Data":"058d8e5f7aa4eaab4ab079d98ef46940927e1464b15475130b848b5c45dfd90f"} Jul 14 05:10:12.902234 ip-10-0-136-9 kubenswrapper[2584]: I0714 05:10:12.902172 2584 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="llm/e2e-trlp-test-simulated-kserve-598466548d-dxdf7" podStartSLOduration=1.594195695 podStartE2EDuration="1.902155598s" totalImagesPullingTime="307.959903ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-14 05:10:11 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-14 05:10:12.900600835 +0000 UTC m=+673.861856542" watchObservedRunningTime="2026-07-14 05:10:12.902155598 +0000 UTC m=+673.863411302" Jul 14 05:10:14.927615 ip-10-0-136-9 kubenswrapper[2584]: I0714 05:10:14.927578 2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-g257n_15609856-4056-487b-acdd-30276263b098/konnectivity-agent/0.log" limit=1024 Jul 14 05:10:15.136611 ip-10-0-136-9 kubenswrapper[2584]: I0714 05:10:15.136577 2584 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86db85z5d"] Jul 14 05:10:15.140448 ip-10-0-136-9 kubenswrapper[2584]: I0714 05:10:15.140420 2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86db85z5d" Jul 14 05:10:15.142997 ip-10-0-136-9 kubenswrapper[2584]: I0714 05:10:15.142972 2584 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"e2e-unab60ef4d3a239b5143b412cab04acac3-kserve-self-signed-certs\"" Jul 14 05:10:15.150805 ip-10-0-136-9 kubenswrapper[2584]: I0714 05:10:15.150780 2584 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86db85z5d"] Jul 14 05:10:15.156468 ip-10-0-136-9 kubenswrapper[2584]: I0714 05:10:15.156440 2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/44711744-4f8c-4321-a452-af8f75f4dc6f-home\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86db85z5d\" (UID: \"44711744-4f8c-4321-a452-af8f75f4dc6f\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86db85z5d" Jul 14 05:10:15.156577 ip-10-0-136-9 kubenswrapper[2584]: I0714 05:10:15.156477 2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/44711744-4f8c-4321-a452-af8f75f4dc6f-model-cache\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86db85z5d\" (UID: \"44711744-4f8c-4321-a452-af8f75f4dc6f\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86db85z5d" Jul 14 05:10:15.156577 ip-10-0-136-9 kubenswrapper[2584]: I0714 05:10:15.156525 2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/44711744-4f8c-4321-a452-af8f75f4dc6f-dshm\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86db85z5d\" (UID: \"44711744-4f8c-4321-a452-af8f75f4dc6f\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86db85z5d" Jul 14 05:10:15.156577 ip-10-0-136-9 kubenswrapper[2584]: I0714 05:10:15.156544 2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/44711744-4f8c-4321-a452-af8f75f4dc6f-tls-certs\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86db85z5d\" (UID: \"44711744-4f8c-4321-a452-af8f75f4dc6f\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86db85z5d" Jul 14 05:10:15.156577 ip-10-0-136-9 kubenswrapper[2584]: I0714 05:10:15.156573 2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/44711744-4f8c-4321-a452-af8f75f4dc6f-tmp-dir\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86db85z5d\" (UID: \"44711744-4f8c-4321-a452-af8f75f4dc6f\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86db85z5d" Jul 14 05:10:15.156753 ip-10-0-136-9 kubenswrapper[2584]: I0714 05:10:15.156699 2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-rx6pv\" (UniqueName: \"kubernetes.io/projected/44711744-4f8c-4321-a452-af8f75f4dc6f-kube-api-access-rx6pv\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86db85z5d\" (UID: \"44711744-4f8c-4321-a452-af8f75f4dc6f\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86db85z5d" Jul 14 05:10:15.168117 ip-10-0-136-9 kubenswrapper[2584]: I0714 05:10:15.168087 2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-g257n_15609856-4056-487b-acdd-30276263b098/konnectivity-agent/0.log" limit=1024 Jul 14 05:10:15.257244 ip-10-0-136-9 kubenswrapper[2584]: I0714 05:10:15.257142 2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/44711744-4f8c-4321-a452-af8f75f4dc6f-dshm\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86db85z5d\" (UID: \"44711744-4f8c-4321-a452-af8f75f4dc6f\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86db85z5d" Jul 14 05:10:15.257244 ip-10-0-136-9 kubenswrapper[2584]: I0714 05:10:15.257185 2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/44711744-4f8c-4321-a452-af8f75f4dc6f-tls-certs\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86db85z5d\" (UID: \"44711744-4f8c-4321-a452-af8f75f4dc6f\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86db85z5d" Jul 14 05:10:15.257244 ip-10-0-136-9 kubenswrapper[2584]: I0714 05:10:15.257214 2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/44711744-4f8c-4321-a452-af8f75f4dc6f-tmp-dir\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86db85z5d\" (UID: \"44711744-4f8c-4321-a452-af8f75f4dc6f\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86db85z5d" Jul 14 05:10:15.257522 ip-10-0-136-9 kubenswrapper[2584]: I0714 05:10:15.257265 2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-rx6pv\" (UniqueName: \"kubernetes.io/projected/44711744-4f8c-4321-a452-af8f75f4dc6f-kube-api-access-rx6pv\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86db85z5d\" (UID: \"44711744-4f8c-4321-a452-af8f75f4dc6f\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86db85z5d" Jul 14 05:10:15.257522 ip-10-0-136-9 kubenswrapper[2584]: I0714 05:10:15.257320 2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/44711744-4f8c-4321-a452-af8f75f4dc6f-home\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86db85z5d\" (UID: \"44711744-4f8c-4321-a452-af8f75f4dc6f\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86db85z5d" Jul 14 05:10:15.257522 ip-10-0-136-9 kubenswrapper[2584]: I0714 05:10:15.257348 2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/44711744-4f8c-4321-a452-af8f75f4dc6f-model-cache\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86db85z5d\" (UID: \"44711744-4f8c-4321-a452-af8f75f4dc6f\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86db85z5d" Jul 14 05:10:15.257711 ip-10-0-136-9 kubenswrapper[2584]: I0714 05:10:15.257688 2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/44711744-4f8c-4321-a452-af8f75f4dc6f-tmp-dir\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86db85z5d\" (UID: \"44711744-4f8c-4321-a452-af8f75f4dc6f\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86db85z5d" Jul 14 05:10:15.257776 ip-10-0-136-9 kubenswrapper[2584]: I0714 05:10:15.257728 2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/44711744-4f8c-4321-a452-af8f75f4dc6f-model-cache\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86db85z5d\" (UID: \"44711744-4f8c-4321-a452-af8f75f4dc6f\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86db85z5d" Jul 14 05:10:15.257828 ip-10-0-136-9 kubenswrapper[2584]: I0714 05:10:15.257795 2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/44711744-4f8c-4321-a452-af8f75f4dc6f-home\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86db85z5d\" (UID: \"44711744-4f8c-4321-a452-af8f75f4dc6f\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86db85z5d" Jul 14 05:10:15.259408 ip-10-0-136-9 kubenswrapper[2584]: I0714 05:10:15.259381 2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/44711744-4f8c-4321-a452-af8f75f4dc6f-dshm\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86db85z5d\" (UID: \"44711744-4f8c-4321-a452-af8f75f4dc6f\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86db85z5d" Jul 14 05:10:15.259710 ip-10-0-136-9 kubenswrapper[2584]: I0714 05:10:15.259691 2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/44711744-4f8c-4321-a452-af8f75f4dc6f-tls-certs\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86db85z5d\" (UID: \"44711744-4f8c-4321-a452-af8f75f4dc6f\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86db85z5d" Jul 14 05:10:15.265451 ip-10-0-136-9 kubenswrapper[2584]: I0714 05:10:15.265429 2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-rx6pv\" (UniqueName: \"kubernetes.io/projected/44711744-4f8c-4321-a452-af8f75f4dc6f-kube-api-access-rx6pv\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86db85z5d\" (UID: \"44711744-4f8c-4321-a452-af8f75f4dc6f\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86db85z5d" Jul 14 05:10:15.451743 ip-10-0-136-9 kubenswrapper[2584]: I0714 05:10:15.451698 2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86db85z5d" Jul 14 05:10:15.598859 ip-10-0-136-9 kubenswrapper[2584]: I0714 05:10:15.598828 2584 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86db85z5d"] Jul 14 05:10:15.600908 ip-10-0-136-9 kubenswrapper[2584]: W0714 05:10:15.600875 2584 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod44711744_4f8c_4321_a452_af8f75f4dc6f.slice/crio-46f9b1585a3797a6b50b594be6065649eb1b327d8667aab47cda014c50fceff0 WatchSource:0}: Error finding container 46f9b1585a3797a6b50b594be6065649eb1b327d8667aab47cda014c50fceff0: Status 404 returned error can't find the container with id 46f9b1585a3797a6b50b594be6065649eb1b327d8667aab47cda014c50fceff0 Jul 14 05:10:15.902174 ip-10-0-136-9 kubenswrapper[2584]: I0714 05:10:15.902121 2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86db85z5d" event={"ID":"44711744-4f8c-4321-a452-af8f75f4dc6f","Type":"ContainerStarted","Data":"023d7023b612d335c5fc8e885ceadc4cbf46d754555193e932c8adaac2169c43"} Jul 14 05:10:15.902335 ip-10-0-136-9 kubenswrapper[2584]: I0714 05:10:15.902190 2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86db85z5d" event={"ID":"44711744-4f8c-4321-a452-af8f75f4dc6f","Type":"ContainerStarted","Data":"46f9b1585a3797a6b50b594be6065649eb1b327d8667aab47cda014c50fceff0"} Jul 14 05:10:15.918909 ip-10-0-136-9 kubenswrapper[2584]: I0714 05:10:15.918858 2584 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86db85z5d" podStartSLOduration=0.725459086 podStartE2EDuration="918.840639ms" totalImagesPullingTime="193.381553ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-14 05:10:15 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-14 05:10:15.917474286 +0000 UTC m=+676.878729992" watchObservedRunningTime="2026-07-14 05:10:15.918840639 +0000 UTC m=+676.880096344" Jul 14 05:10:21.393725 ip-10-0-136-9 kubenswrapper[2584]: I0714 05:10:21.393686 2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-g257n_15609856-4056-487b-acdd-30276263b098/konnectivity-agent/0.log" limit=1024 Jul 14 05:10:22.155519 ip-10-0-136-9 kubenswrapper[2584]: I0714 05:10:22.155480 2584 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="llm/e2e-trlp-test-simulated-kserve-598466548d-dxdf7" Jul 14 05:10:22.155701 ip-10-0-136-9 kubenswrapper[2584]: I0714 05:10:22.155534 2584 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="llm/e2e-trlp-test-simulated-kserve-598466548d-dxdf7" Jul 14 05:10:22.168376 ip-10-0-136-9 kubenswrapper[2584]: I0714 05:10:22.168350 2584 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="llm/e2e-trlp-test-simulated-kserve-598466548d-dxdf7" Jul 14 05:10:22.948042 ip-10-0-136-9 kubenswrapper[2584]: I0714 05:10:22.948014 2584 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="llm/e2e-trlp-test-simulated-kserve-598466548d-dxdf7" Jul 14 05:10:25.451954 ip-10-0-136-9 kubenswrapper[2584]: I0714 05:10:25.451890 2584 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86db85z5d" Jul 14 05:10:25.452361 ip-10-0-136-9 kubenswrapper[2584]: I0714 05:10:25.451977 2584 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86db85z5d" Jul 14 05:10:25.465050 ip-10-0-136-9 kubenswrapper[2584]: I0714 05:10:25.465019 2584 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86db85z5d" Jul 14 05:10:25.801574 ip-10-0-136-9 kubenswrapper[2584]: I0714 05:10:25.801475 2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-g257n_15609856-4056-487b-acdd-30276263b098/konnectivity-agent/0.log" limit=1024 Jul 14 05:10:25.962494 ip-10-0-136-9 kubenswrapper[2584]: I0714 05:10:25.962465 2584 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86db85z5d" Jul 14 05:11:25.461881 ip-10-0-136-9 kubenswrapper[2584]: I0714 05:11:25.461771 2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-g257n_15609856-4056-487b-acdd-30276263b098/konnectivity-agent/0.log" limit=1024 Jul 14 05:11:25.548222 ip-10-0-136-9 kubenswrapper[2584]: I0714 05:11:25.548166 2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-g257n_15609856-4056-487b-acdd-30276263b098/konnectivity-agent/0.log" limit=1024 Jul 14 05:11:26.663998 ip-10-0-136-9 kubenswrapper[2584]: I0714 05:11:26.663961 2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-g257n_15609856-4056-487b-acdd-30276263b098/konnectivity-agent/0.log" limit=1024 Jul 14 05:11:26.763129 ip-10-0-136-9 kubenswrapper[2584]: I0714 05:11:26.763082 2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-g257n_15609856-4056-487b-acdd-30276263b098/konnectivity-agent/0.log" limit=1024 Jul 14 05:11:32.371396 ip-10-0-136-9 kubenswrapper[2584]: I0714 05:11:32.371361 2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-g257n_15609856-4056-487b-acdd-30276263b098/konnectivity-agent/0.log" limit=1024 Jul 14 05:11:32.438117 ip-10-0-136-9 kubenswrapper[2584]: I0714 05:11:32.438078 2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-g257n_15609856-4056-487b-acdd-30276263b098/konnectivity-agent/0.log" limit=1024 Jul 14 05:13:59.469954 ip-10-0-136-9 kubenswrapper[2584]: I0714 05:13:59.469852 2584 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-7866497494-wh846_b0b64988-41ac-4e49-bcfd-a08adebb37f7/console-operator/1.log" Jul 14 05:13:59.470462 ip-10-0-136-9 kubenswrapper[2584]: I0714 05:13:59.470172 2584 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-7866497494-wh846_b0b64988-41ac-4e49-bcfd-a08adebb37f7/console-operator/1.log" Jul 14 05:13:59.475947 ip-10-0-136-9 kubenswrapper[2584]: I0714 05:13:59.475912 2584 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-8llzd_694d0f90-6317-495d-a312-b76a3513730e/ovn-acl-logging/0.log" Jul 14 05:13:59.476117 ip-10-0-136-9 kubenswrapper[2584]: I0714 05:13:59.476098 2584 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-8llzd_694d0f90-6317-495d-a312-b76a3513730e/ovn-acl-logging/0.log" Jul 14 05:14:00.704977 ip-10-0-136-9 kubenswrapper[2584]: I0714 05:14:00.704948 2584 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_llmisvc-controller-manager-777c6bd7d5-t96wm_92403f10-2422-42d9-8a95-2e103c37b148/manager/0.log" Jul 14 05:14:00.832709 ip-10-0-136-9 kubenswrapper[2584]: I0714 05:14:00.832676 2584 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_maas-controller-585cdbd87d-vxfrj_263d4e63-6d20-40be-b791-f7e63709b043/manager/0.log" Jul 14 05:14:00.955879 ip-10-0-136-9 kubenswrapper[2584]: I0714 05:14:00.955802 2584 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_model-serving-api-54d89bd5fc-fcl6g_678abb7d-9394-4cf0-811c-16ec0ed3e414/server/0.log" Jul 14 05:14:01.083815 ip-10-0-136-9 kubenswrapper[2584]: I0714 05:14:01.083771 2584 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_odh-model-controller-7998c67dc4-7bhln_5d457cd7-f48e-45c0-9d4f-d8a7369aa39c/manager/0.log" Jul 14 05:14:01.347993 ip-10-0-136-9 kubenswrapper[2584]: I0714 05:14:01.347973 2584 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-6d474f5bbf-9zx9p_d09957f3-0d46-4fd6-b16e-d9cdabc8640c/copy-manifests/0.log" Jul 14 05:14:01.360874 ip-10-0-136-9 kubenswrapper[2584]: I0714 05:14:01.360839 2584 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-6d474f5bbf-9zx9p_d09957f3-0d46-4fd6-b16e-d9cdabc8640c/manager/0.log" Jul 14 05:14:01.858561 ip-10-0-136-9 kubenswrapper[2584]: I0714 05:14:01.858528 2584 log.go:25] "Finished parsing log file" path="/var/log/pods/odh-ai-gateway-infra_maas-api-f99fd96f7-dsl9x_099b7088-de00-4fc8-8605-a7de9176d6f9/maas-api/0.log" Jul 14 05:14:01.979582 ip-10-0-136-9 kubenswrapper[2584]: I0714 05:14:01.979552 2584 log.go:25] "Finished parsing log file" path="/var/log/pods/odh-ai-gateway-infra_postgres-69fb4594cf-tzgm8_42f1bd21-c9ee-4341-b101-473d1187ec4a/postgres/0.log" Jul 14 05:14:03.490388 ip-10-0-136-9 kubenswrapper[2584]: I0714 05:14:03.490358 2584 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_authorino-operator-75cc8d5cb7-hkhlt_13b189eb-052f-4108-a70e-49be5e405034/manager/0.log" Jul 14 05:14:03.623334 ip-10-0-136-9 kubenswrapper[2584]: I0714 05:14:03.623303 2584 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_dns-operator-controller-manager-864dd78c4c-dgxt6_0b75b949-775e-4ae8-8541-8fb677845271/manager/0.log" Jul 14 05:14:03.878064 ip-10-0-136-9 kubenswrapper[2584]: I0714 05:14:03.878036 2584 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_kuadrant-operator-catalog-6v6rx_35849b26-d191-4a4d-8e52-2af51c4a8be6/registry-server/0.log" Jul 14 05:14:04.017050 ip-10-0-136-9 kubenswrapper[2584]: I0714 05:14:04.017020 2584 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_kuadrant-operator-controller-manager-86878c769f-jr6zj_e567720d-9691-47a0-b435-d71eea552638/manager/0.log" Jul 14 05:14:04.310414 ip-10-0-136-9 kubenswrapper[2584]: I0714 05:14:04.310302 2584 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_limitador-operator-controller-manager-859d7b78bd-74x4l_82bd2345-69fa-4478-9a0e-3cec1e4d68c9/manager/0.log" Jul 14 05:14:05.055213 ip-10-0-136-9 kubenswrapper[2584]: I0714 05:14:05.055179 2584 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_kube-auth-proxy-5d4dd7888d-x64pt_018b10c5-775d-4180-9f5c-3454b7cab921/kube-auth-proxy/0.log" Jul 14 05:14:05.293045 ip-10-0-136-9 kubenswrapper[2584]: I0714 05:14:05.293013 2584 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-pre-processing-74584bb9f8-5dz6w_585a66e2-b97c-4041-97ec-8c31377a9515/payload-pre-processing/0.log" Jul 14 05:14:05.536003 ip-10-0-136-9 kubenswrapper[2584]: I0714 05:14:05.535965 2584 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_router-default-59f7f8d6b6-mb84v_c9f966c9-5bd6-4602-9a96-ea935895d2d9/router/0.log" Jul 14 05:14:06.006268 ip-10-0-136-9 kubenswrapper[2584]: I0714 05:14:06.006241 2584 log.go:25] "Finished parsing log file" path="/var/log/pods/llm_e2e-distinct-simulated-kserve-59975d69f9-g8r7q_5483f883-3799-487b-b7d8-47d0d91f91ad/main/0.log" Jul 14 05:14:06.128857 ip-10-0-136-9 kubenswrapper[2584]: I0714 05:14:06.128822 2584 log.go:25] "Finished parsing log file" path="/var/log/pods/llm_e2e-trlp-test-simulated-kserve-598466548d-dxdf7_4b1e99ef-1f3f-4997-b512-40e10dae3979/main/0.log" Jul 14 05:14:06.249086 ip-10-0-136-9 kubenswrapper[2584]: I0714 05:14:06.249045 2584 log.go:25] "Finished parsing log file" path="/var/log/pods/llm_e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86db85z5d_44711744-4f8c-4321-a452-af8f75f4dc6f/main/0.log" Jul 14 05:14:10.026258 ip-10-0-136-9 kubenswrapper[2584]: I0714 05:14:10.026221 2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-g257n_15609856-4056-487b-acdd-30276263b098/konnectivity-agent/0.log" limit=1024 Jul 14 05:14:10.079860 ip-10-0-136-9 kubenswrapper[2584]: I0714 05:14:10.079829 2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-g257n_15609856-4056-487b-acdd-30276263b098/konnectivity-agent/0.log" limit=1024 Jul 14 05:14:10.786707 ip-10-0-136-9 kubenswrapper[2584]: I0714 05:14:10.786656 2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-g257n_15609856-4056-487b-acdd-30276263b098/konnectivity-agent/0.log" limit=1024 Jul 14 05:14:10.886255 ip-10-0-136-9 kubenswrapper[2584]: I0714 05:14:10.886205 2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-g257n_15609856-4056-487b-acdd-30276263b098/konnectivity-agent/0.log" limit=1024 Jul 14 05:14:13.539616 ip-10-0-136-9 kubenswrapper[2584]: I0714 05:14:13.539551 2584 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_global-pull-secret-syncer-fb7bm_7078f217-1a51-4d64-a155-e5ca77500f07/global-pull-secret-syncer/0.log" Jul 14 05:14:13.621872 ip-10-0-136-9 kubenswrapper[2584]: I0714 05:14:13.621815 2584 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_konnectivity-agent-g257n_15609856-4056-487b-acdd-30276263b098/konnectivity-agent/0.log" Jul 14 05:14:13.692408 ip-10-0-136-9 kubenswrapper[2584]: I0714 05:14:13.692368 2584 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_kube-apiserver-proxy-ip-10-0-136-9.ec2.internal_93e20c48273b3fa7dacbffda6c635805/haproxy/0.log" Jul 14 05:14:18.391591 ip-10-0-136-9 kubenswrapper[2584]: I0714 05:14:18.391561 2584 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_authorino-operator-75cc8d5cb7-hkhlt_13b189eb-052f-4108-a70e-49be5e405034/manager/0.log" Jul 14 05:14:18.416850 ip-10-0-136-9 kubenswrapper[2584]: I0714 05:14:18.416819 2584 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_dns-operator-controller-manager-864dd78c4c-dgxt6_0b75b949-775e-4ae8-8541-8fb677845271/manager/0.log" Jul 14 05:14:18.491898 ip-10-0-136-9 kubenswrapper[2584]: I0714 05:14:18.491870 2584 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_kuadrant-operator-catalog-6v6rx_35849b26-d191-4a4d-8e52-2af51c4a8be6/registry-server/0.log" Jul 14 05:14:18.531976 ip-10-0-136-9 kubenswrapper[2584]: I0714 05:14:18.531925 2584 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_kuadrant-operator-controller-manager-86878c769f-jr6zj_e567720d-9691-47a0-b435-d71eea552638/manager/0.log" Jul 14 05:14:18.587675 ip-10-0-136-9 kubenswrapper[2584]: I0714 05:14:18.587648 2584 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_limitador-operator-controller-manager-859d7b78bd-74x4l_82bd2345-69fa-4478-9a0e-3cec1e4d68c9/manager/0.log" Jul 14 05:14:20.503452 ip-10-0-136-9 kubenswrapper[2584]: I0714 05:14:20.503420 2584 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_cluster-monitoring-operator-5f7f494dd4-9nsjr_95fdfeab-07ef-4e6d-96cc-2c7056d1c833/cluster-monitoring-operator/0.log" Jul 14 05:14:20.668905 ip-10-0-136-9 kubenswrapper[2584]: I0714 05:14:20.668874 2584 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-7p74v_e8606dd5-f76a-4af0-93ba-b8861980b30c/node-exporter/0.log" Jul 14 05:14:20.688902 ip-10-0-136-9 kubenswrapper[2584]: I0714 05:14:20.688870 2584 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-7p74v_e8606dd5-f76a-4af0-93ba-b8861980b30c/kube-rbac-proxy/0.log" Jul 14 05:14:20.711179 ip-10-0-136-9 kubenswrapper[2584]: I0714 05:14:20.711153 2584 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-7p74v_e8606dd5-f76a-4af0-93ba-b8861980b30c/init-textfile/0.log" Jul 14 05:14:21.278209 ip-10-0-136-9 kubenswrapper[2584]: I0714 05:14:21.278174 2584 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-operator-admission-webhook-77d98bc786-wxbfc_a498d55f-a96d-469a-b15e-995e13d25c5a/prometheus-operator-admission-webhook/0.log" Jul 14 05:14:22.976192 ip-10-0-136-9 kubenswrapper[2584]: I0714 05:14:22.976162 2584 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-network-console_networking-console-plugin-6cf856758c-4bfn6_c27a6d7e-9146-4882-ba72-d2c22c209e03/networking-console-plugin/0.log" Jul 14 05:14:23.620481 ip-10-0-136-9 kubenswrapper[2584]: I0714 05:14:23.620446 2584 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-7866497494-wh846_b0b64988-41ac-4e49-bcfd-a08adebb37f7/console-operator/1.log" Jul 14 05:14:23.624683 ip-10-0-136-9 kubenswrapper[2584]: I0714 05:14:23.624663 2584 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-7866497494-wh846_b0b64988-41ac-4e49-bcfd-a08adebb37f7/console-operator/2.log" Jul 14 05:14:24.173543 ip-10-0-136-9 kubenswrapper[2584]: I0714 05:14:24.173509 2584 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console_downloads-68c9cbb497-ch2f4_5813b135-d940-4fd9-8d37-4dbd772504eb/download-server/0.log" Jul 14 05:14:24.234651 ip-10-0-136-9 kubenswrapper[2584]: I0714 05:14:24.234618 2584 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-must-gather-n7m6n/perf-node-gather-daemonset-66fd7"] Jul 14 05:14:24.238163 ip-10-0-136-9 kubenswrapper[2584]: I0714 05:14:24.238146 2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-n7m6n/perf-node-gather-daemonset-66fd7" Jul 14 05:14:24.240738 ip-10-0-136-9 kubenswrapper[2584]: I0714 05:14:24.240718 2584 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-must-gather-n7m6n\"/\"openshift-service-ca.crt\"" Jul 14 05:14:24.240987 ip-10-0-136-9 kubenswrapper[2584]: I0714 05:14:24.240954 2584 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-must-gather-n7m6n\"/\"kube-root-ca.crt\"" Jul 14 05:14:24.241813 ip-10-0-136-9 kubenswrapper[2584]: I0714 05:14:24.241790 2584 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-must-gather-n7m6n\"/\"default-dockercfg-l2qr6\"" Jul 14 05:14:24.244891 ip-10-0-136-9 kubenswrapper[2584]: I0714 05:14:24.244870 2584 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-n7m6n/perf-node-gather-daemonset-66fd7"] Jul 14 05:14:24.310881 ip-10-0-136-9 kubenswrapper[2584]: I0714 05:14:24.310845 2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-4nxdj\" (UniqueName: \"kubernetes.io/projected/6ca7ea13-1a46-4eaa-9e27-cbb2548294a8-kube-api-access-4nxdj\") pod \"perf-node-gather-daemonset-66fd7\" (UID: \"6ca7ea13-1a46-4eaa-9e27-cbb2548294a8\") " pod="openshift-must-gather-n7m6n/perf-node-gather-daemonset-66fd7" Jul 14 05:14:24.311076 ip-10-0-136-9 kubenswrapper[2584]: I0714 05:14:24.310965 2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/6ca7ea13-1a46-4eaa-9e27-cbb2548294a8-lib-modules\") pod \"perf-node-gather-daemonset-66fd7\" (UID: \"6ca7ea13-1a46-4eaa-9e27-cbb2548294a8\") " pod="openshift-must-gather-n7m6n/perf-node-gather-daemonset-66fd7" Jul 14 05:14:24.311076 ip-10-0-136-9 kubenswrapper[2584]: I0714 05:14:24.310997 2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/6ca7ea13-1a46-4eaa-9e27-cbb2548294a8-sys\") pod \"perf-node-gather-daemonset-66fd7\" (UID: \"6ca7ea13-1a46-4eaa-9e27-cbb2548294a8\") " pod="openshift-must-gather-n7m6n/perf-node-gather-daemonset-66fd7" Jul 14 05:14:24.311195 ip-10-0-136-9 kubenswrapper[2584]: I0714 05:14:24.311083 2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/6ca7ea13-1a46-4eaa-9e27-cbb2548294a8-proc\") pod \"perf-node-gather-daemonset-66fd7\" (UID: \"6ca7ea13-1a46-4eaa-9e27-cbb2548294a8\") " pod="openshift-must-gather-n7m6n/perf-node-gather-daemonset-66fd7" Jul 14 05:14:24.311195 ip-10-0-136-9 kubenswrapper[2584]: I0714 05:14:24.311111 2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/6ca7ea13-1a46-4eaa-9e27-cbb2548294a8-podres\") pod \"perf-node-gather-daemonset-66fd7\" (UID: \"6ca7ea13-1a46-4eaa-9e27-cbb2548294a8\") " pod="openshift-must-gather-n7m6n/perf-node-gather-daemonset-66fd7" Jul 14 05:14:24.411705 ip-10-0-136-9 kubenswrapper[2584]: I0714 05:14:24.411673 2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/6ca7ea13-1a46-4eaa-9e27-cbb2548294a8-lib-modules\") pod \"perf-node-gather-daemonset-66fd7\" (UID: \"6ca7ea13-1a46-4eaa-9e27-cbb2548294a8\") " pod="openshift-must-gather-n7m6n/perf-node-gather-daemonset-66fd7" Jul 14 05:14:24.411705 ip-10-0-136-9 kubenswrapper[2584]: I0714 05:14:24.411706 2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/6ca7ea13-1a46-4eaa-9e27-cbb2548294a8-sys\") pod \"perf-node-gather-daemonset-66fd7\" (UID: \"6ca7ea13-1a46-4eaa-9e27-cbb2548294a8\") " pod="openshift-must-gather-n7m6n/perf-node-gather-daemonset-66fd7" Jul 14 05:14:24.411877 ip-10-0-136-9 kubenswrapper[2584]: I0714 05:14:24.411792 2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/6ca7ea13-1a46-4eaa-9e27-cbb2548294a8-sys\") pod \"perf-node-gather-daemonset-66fd7\" (UID: \"6ca7ea13-1a46-4eaa-9e27-cbb2548294a8\") " pod="openshift-must-gather-n7m6n/perf-node-gather-daemonset-66fd7" Jul 14 05:14:24.411877 ip-10-0-136-9 kubenswrapper[2584]: I0714 05:14:24.411817 2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/6ca7ea13-1a46-4eaa-9e27-cbb2548294a8-proc\") pod \"perf-node-gather-daemonset-66fd7\" (UID: \"6ca7ea13-1a46-4eaa-9e27-cbb2548294a8\") " pod="openshift-must-gather-n7m6n/perf-node-gather-daemonset-66fd7" Jul 14 05:14:24.411877 ip-10-0-136-9 kubenswrapper[2584]: I0714 05:14:24.411833 2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/6ca7ea13-1a46-4eaa-9e27-cbb2548294a8-podres\") pod \"perf-node-gather-daemonset-66fd7\" (UID: \"6ca7ea13-1a46-4eaa-9e27-cbb2548294a8\") " pod="openshift-must-gather-n7m6n/perf-node-gather-daemonset-66fd7" Jul 14 05:14:24.411877 ip-10-0-136-9 kubenswrapper[2584]: I0714 05:14:24.411855 2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-4nxdj\" (UniqueName: \"kubernetes.io/projected/6ca7ea13-1a46-4eaa-9e27-cbb2548294a8-kube-api-access-4nxdj\") pod \"perf-node-gather-daemonset-66fd7\" (UID: \"6ca7ea13-1a46-4eaa-9e27-cbb2548294a8\") " pod="openshift-must-gather-n7m6n/perf-node-gather-daemonset-66fd7" Jul 14 05:14:24.411877 ip-10-0-136-9 kubenswrapper[2584]: I0714 05:14:24.411860 2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/6ca7ea13-1a46-4eaa-9e27-cbb2548294a8-lib-modules\") pod \"perf-node-gather-daemonset-66fd7\" (UID: \"6ca7ea13-1a46-4eaa-9e27-cbb2548294a8\") " pod="openshift-must-gather-n7m6n/perf-node-gather-daemonset-66fd7" Jul 14 05:14:24.412070 ip-10-0-136-9 kubenswrapper[2584]: I0714 05:14:24.411926 2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/6ca7ea13-1a46-4eaa-9e27-cbb2548294a8-proc\") pod \"perf-node-gather-daemonset-66fd7\" (UID: \"6ca7ea13-1a46-4eaa-9e27-cbb2548294a8\") " pod="openshift-must-gather-n7m6n/perf-node-gather-daemonset-66fd7" Jul 14 05:14:24.412070 ip-10-0-136-9 kubenswrapper[2584]: I0714 05:14:24.411960 2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/6ca7ea13-1a46-4eaa-9e27-cbb2548294a8-podres\") pod \"perf-node-gather-daemonset-66fd7\" (UID: \"6ca7ea13-1a46-4eaa-9e27-cbb2548294a8\") " pod="openshift-must-gather-n7m6n/perf-node-gather-daemonset-66fd7" Jul 14 05:14:24.419686 ip-10-0-136-9 kubenswrapper[2584]: I0714 05:14:24.419663 2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-4nxdj\" (UniqueName: \"kubernetes.io/projected/6ca7ea13-1a46-4eaa-9e27-cbb2548294a8-kube-api-access-4nxdj\") pod \"perf-node-gather-daemonset-66fd7\" (UID: \"6ca7ea13-1a46-4eaa-9e27-cbb2548294a8\") " pod="openshift-must-gather-n7m6n/perf-node-gather-daemonset-66fd7" Jul 14 05:14:24.549290 ip-10-0-136-9 kubenswrapper[2584]: I0714 05:14:24.549202 2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-n7m6n/perf-node-gather-daemonset-66fd7" Jul 14 05:14:24.685273 ip-10-0-136-9 kubenswrapper[2584]: I0714 05:14:24.685244 2584 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-n7m6n/perf-node-gather-daemonset-66fd7"] Jul 14 05:14:24.687216 ip-10-0-136-9 kubenswrapper[2584]: W0714 05:14:24.687181 2584 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-pod6ca7ea13_1a46_4eaa_9e27_cbb2548294a8.slice/crio-45b79a8230991f5e209a1d3a93d2c8bbe5f50c9b998e780b9468b0f3665018db WatchSource:0}: Error finding container 45b79a8230991f5e209a1d3a93d2c8bbe5f50c9b998e780b9468b0f3665018db: Status 404 returned error can't find the container with id 45b79a8230991f5e209a1d3a93d2c8bbe5f50c9b998e780b9468b0f3665018db Jul 14 05:14:24.869972 ip-10-0-136-9 kubenswrapper[2584]: I0714 05:14:24.869949 2584 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-cluster-storage-operator_volume-data-source-validator-78495597f6-qblzx_90b386b6-2530-4cde-9a0c-68e324286ba4/volume-data-source-validator/0.log" Jul 14 05:14:25.191172 ip-10-0-136-9 kubenswrapper[2584]: I0714 05:14:25.191080 2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-n7m6n/perf-node-gather-daemonset-66fd7" event={"ID":"6ca7ea13-1a46-4eaa-9e27-cbb2548294a8","Type":"ContainerStarted","Data":"63b1be88a15f0cba7a6c4afcfdbb091501afe072b45c02719909b735661807bf"} Jul 14 05:14:25.191172 ip-10-0-136-9 kubenswrapper[2584]: I0714 05:14:25.191137 2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-n7m6n/perf-node-gather-daemonset-66fd7" event={"ID":"6ca7ea13-1a46-4eaa-9e27-cbb2548294a8","Type":"ContainerStarted","Data":"45b79a8230991f5e209a1d3a93d2c8bbe5f50c9b998e780b9468b0f3665018db"} Jul 14 05:14:25.191572 ip-10-0-136-9 kubenswrapper[2584]: I0714 05:14:25.191162 2584 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-must-gather-n7m6n/perf-node-gather-daemonset-66fd7" Jul 14 05:14:25.209985 ip-10-0-136-9 kubenswrapper[2584]: I0714 05:14:25.209911 2584 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-must-gather-n7m6n/perf-node-gather-daemonset-66fd7" podStartSLOduration=1.209898081 podStartE2EDuration="1.209898081s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-14 05:14:24 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-14 05:14:25.208192893 +0000 UTC m=+926.169448599" watchObservedRunningTime="2026-07-14 05:14:25.209898081 +0000 UTC m=+926.171153785" Jul 14 05:14:26.087804 ip-10-0-136-9 kubenswrapper[2584]: I0714 05:14:26.087775 2584 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_dns-default-gkwjs_d6fb944a-4c2d-4f24-a25b-e5a3067fe627/dns/0.log" Jul 14 05:14:26.108692 ip-10-0-136-9 kubenswrapper[2584]: I0714 05:14:26.108645 2584 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_dns-default-gkwjs_d6fb944a-4c2d-4f24-a25b-e5a3067fe627/kube-rbac-proxy/0.log" Jul 14 05:14:26.176448 ip-10-0-136-9 kubenswrapper[2584]: I0714 05:14:26.176418 2584 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_node-resolver-t5mq8_8986aae0-cba2-493d-8d3e-ccf99b81c90c/dns-node-resolver/0.log" Jul 14 05:14:26.770812 ip-10-0-136-9 kubenswrapper[2584]: I0714 05:14:26.770783 2584 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_node-ca-l8z9r_822d074f-5b43-440a-8521-6cb28777ea8d/node-ca/0.log" Jul 14 05:14:27.755726 ip-10-0-136-9 kubenswrapper[2584]: I0714 05:14:27.755681 2584 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_kube-auth-proxy-5d4dd7888d-x64pt_018b10c5-775d-4180-9f5c-3454b7cab921/kube-auth-proxy/0.log" Jul 14 05:14:27.797551 ip-10-0-136-9 kubenswrapper[2584]: I0714 05:14:27.797502 2584 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-pre-processing-74584bb9f8-5dz6w_585a66e2-b97c-4041-97ec-8c31377a9515/payload-pre-processing/0.log" Jul 14 05:14:27.846150 ip-10-0-136-9 kubenswrapper[2584]: I0714 05:14:27.846104 2584 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_router-default-59f7f8d6b6-mb84v_c9f966c9-5bd6-4602-9a96-ea935895d2d9/router/0.log" Jul 14 05:14:28.410031 ip-10-0-136-9 kubenswrapper[2584]: I0714 05:14:28.410001 2584 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress-canary_ingress-canary-2srpm_344ca47f-b4c4-4592-94f6-93169c9eb55f/serve-healthcheck-canary/0.log" Jul 14 05:14:28.892103 ip-10-0-136-9 kubenswrapper[2584]: I0714 05:14:28.892071 2584 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-operator-68d9dd94cf-wlmqg_32d1dfa7-69ec-4b39-b5c9-154f4774db02/insights-operator/1.log" Jul 14 05:14:28.892103 ip-10-0-136-9 kubenswrapper[2584]: I0714 05:14:28.892068 2584 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-operator-68d9dd94cf-wlmqg_32d1dfa7-69ec-4b39-b5c9-154f4774db02/insights-operator/0.log" Jul 14 05:14:28.980315 ip-10-0-136-9 kubenswrapper[2584]: I0714 05:14:28.980287 2584 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-t6zw8_4e5332d8-9e2c-4660-8546-e026f8f5dd2a/kube-rbac-proxy/0.log" Jul 14 05:14:28.997360 ip-10-0-136-9 kubenswrapper[2584]: I0714 05:14:28.997316 2584 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-t6zw8_4e5332d8-9e2c-4660-8546-e026f8f5dd2a/exporter/0.log" Jul 14 05:14:29.015154 ip-10-0-136-9 kubenswrapper[2584]: I0714 05:14:29.015127 2584 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-t6zw8_4e5332d8-9e2c-4660-8546-e026f8f5dd2a/extractor/0.log" Jul 14 05:14:31.205839 ip-10-0-136-9 kubenswrapper[2584]: I0714 05:14:31.205814 2584 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-must-gather-n7m6n/perf-node-gather-daemonset-66fd7" Jul 14 05:14:31.239169 ip-10-0-136-9 kubenswrapper[2584]: I0714 05:14:31.239142 2584 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_llmisvc-controller-manager-777c6bd7d5-t96wm_92403f10-2422-42d9-8a95-2e103c37b148/manager/0.log" Jul 14 05:14:31.265705 ip-10-0-136-9 kubenswrapper[2584]: I0714 05:14:31.265670 2584 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_maas-controller-585cdbd87d-vxfrj_263d4e63-6d20-40be-b791-f7e63709b043/manager/0.log" Jul 14 05:14:31.282094 ip-10-0-136-9 kubenswrapper[2584]: I0714 05:14:31.282070 2584 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_model-serving-api-54d89bd5fc-fcl6g_678abb7d-9394-4cf0-811c-16ec0ed3e414/server/0.log" Jul 14 05:14:31.323629 ip-10-0-136-9 kubenswrapper[2584]: I0714 05:14:31.323606 2584 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_odh-model-controller-7998c67dc4-7bhln_5d457cd7-f48e-45c0-9d4f-d8a7369aa39c/manager/0.log" Jul 14 05:14:31.407816 ip-10-0-136-9 kubenswrapper[2584]: I0714 05:14:31.407773 2584 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-6d474f5bbf-9zx9p_d09957f3-0d46-4fd6-b16e-d9cdabc8640c/manager/0.log" Jul 14 05:14:31.422561 ip-10-0-136-9 kubenswrapper[2584]: I0714 05:14:31.422537 2584 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-6d474f5bbf-9zx9p_d09957f3-0d46-4fd6-b16e-d9cdabc8640c/copy-manifests/0.log" Jul 14 05:14:34.460819 ip-10-0-136-9 kubenswrapper[2584]: I0714 05:14:34.460790 2584 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_kube-auth-proxy-5d4dd7888d-x64pt_018b10c5-775d-4180-9f5c-3454b7cab921/kube-auth-proxy/0.log" Jul 14 05:14:34.500792 ip-10-0-136-9 kubenswrapper[2584]: I0714 05:14:34.500759 2584 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-pre-processing-74584bb9f8-5dz6w_585a66e2-b97c-4041-97ec-8c31377a9515/payload-pre-processing/0.log" Jul 14 05:14:34.538145 ip-10-0-136-9 kubenswrapper[2584]: I0714 05:14:34.538071 2584 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_router-default-59f7f8d6b6-mb84v_c9f966c9-5bd6-4602-9a96-ea935895d2d9/router/0.log" Jul 14 05:14:35.939403 ip-10-0-136-9 kubenswrapper[2584]: I0714 05:14:35.939373 2584 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_kube-auth-proxy-5d4dd7888d-x64pt_018b10c5-775d-4180-9f5c-3454b7cab921/kube-auth-proxy/0.log" Jul 14 05:14:35.971258 ip-10-0-136-9 kubenswrapper[2584]: I0714 05:14:35.971229 2584 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-pre-processing-74584bb9f8-5dz6w_585a66e2-b97c-4041-97ec-8c31377a9515/payload-pre-processing/0.log" Jul 14 05:14:36.003919 ip-10-0-136-9 kubenswrapper[2584]: I0714 05:14:36.003891 2584 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_router-default-59f7f8d6b6-mb84v_c9f966c9-5bd6-4602-9a96-ea935895d2d9/router/0.log" Jul 14 05:14:37.942269 ip-10-0-136-9 kubenswrapper[2584]: I0714 05:14:37.942240 2584 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-kube-storage-version-migrator_migrator-7f59b54f6c-spbxb_1eaa9a47-a22c-4353-8b21-5a0e1ea21d46/migrator/0.log" Jul 14 05:14:37.959962 ip-10-0-136-9 kubenswrapper[2584]: I0714 05:14:37.959904 2584 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-kube-storage-version-migrator_migrator-7f59b54f6c-spbxb_1eaa9a47-a22c-4353-8b21-5a0e1ea21d46/graceful-termination/0.log" Jul 14 05:14:38.299520 ip-10-0-136-9 kubenswrapper[2584]: I0714 05:14:38.299417 2584 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-kube-storage-version-migrator-operator_kube-storage-version-migrator-operator-799cb7f958-fkfct_15929c2d-1e38-4405-9353-644c191c8c43/kube-storage-version-migrator-operator/1.log" Jul 14 05:14:38.300214 ip-10-0-136-9 kubenswrapper[2584]: I0714 05:14:38.300185 2584 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-kube-storage-version-migrator-operator_kube-storage-version-migrator-operator-799cb7f958-fkfct_15929c2d-1e38-4405-9353-644c191c8c43/kube-storage-version-migrator-operator/0.log" Jul 14 05:14:39.275062 ip-10-0-136-9 kubenswrapper[2584]: I0714 05:14:39.275034 2584 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-48p6x_c0a9d445-38bf-437d-bfbe-b6f937f91140/kube-multus-additional-cni-plugins/0.log" Jul 14 05:14:39.294377 ip-10-0-136-9 kubenswrapper[2584]: I0714 05:14:39.294342 2584 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-48p6x_c0a9d445-38bf-437d-bfbe-b6f937f91140/egress-router-binary-copy/0.log" Jul 14 05:14:39.312309 ip-10-0-136-9 kubenswrapper[2584]: I0714 05:14:39.312278 2584 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-48p6x_c0a9d445-38bf-437d-bfbe-b6f937f91140/cni-plugins/0.log" Jul 14 05:14:39.329622 ip-10-0-136-9 kubenswrapper[2584]: I0714 05:14:39.329591 2584 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-48p6x_c0a9d445-38bf-437d-bfbe-b6f937f91140/bond-cni-plugin/0.log" Jul 14 05:14:39.347860 ip-10-0-136-9 kubenswrapper[2584]: I0714 05:14:39.347834 2584 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-48p6x_c0a9d445-38bf-437d-bfbe-b6f937f91140/routeoverride-cni/0.log" Jul 14 05:14:39.368359 ip-10-0-136-9 kubenswrapper[2584]: I0714 05:14:39.368333 2584 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-48p6x_c0a9d445-38bf-437d-bfbe-b6f937f91140/whereabouts-cni-bincopy/0.log" Jul 14 05:14:39.388516 ip-10-0-136-9 kubenswrapper[2584]: I0714 05:14:39.388481 2584 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-48p6x_c0a9d445-38bf-437d-bfbe-b6f937f91140/whereabouts-cni/0.log" Jul 14 05:14:39.789104 ip-10-0-136-9 kubenswrapper[2584]: I0714 05:14:39.789077 2584 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-s7xsv_562da33b-a2b1-4ac9-a122-8536e8542e41/kube-multus/0.log" Jul 14 05:14:39.830095 ip-10-0-136-9 kubenswrapper[2584]: I0714 05:14:39.830067 2584 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_network-metrics-daemon-7prdk_5d5fe629-46a1-4c48-bab2-32bbaf543c90/network-metrics-daemon/0.log" Jul 14 05:14:39.846742 ip-10-0-136-9 kubenswrapper[2584]: I0714 05:14:39.846716 2584 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_network-metrics-daemon-7prdk_5d5fe629-46a1-4c48-bab2-32bbaf543c90/kube-rbac-proxy/0.log" Jul 14 05:14:40.745372 ip-10-0-136-9 kubenswrapper[2584]: I0714 05:14:40.745339 2584 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-8llzd_694d0f90-6317-495d-a312-b76a3513730e/ovn-controller/0.log" Jul 14 05:14:40.767943 ip-10-0-136-9 kubenswrapper[2584]: I0714 05:14:40.767914 2584 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-8llzd_694d0f90-6317-495d-a312-b76a3513730e/ovn-acl-logging/0.log" Jul 14 05:14:40.768109 ip-10-0-136-9 kubenswrapper[2584]: I0714 05:14:40.767925 2584 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-8llzd_694d0f90-6317-495d-a312-b76a3513730e/ovn-acl-logging/1.log" Jul 14 05:14:40.793124 ip-10-0-136-9 kubenswrapper[2584]: I0714 05:14:40.793095 2584 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-8llzd_694d0f90-6317-495d-a312-b76a3513730e/kube-rbac-proxy-node/0.log" Jul 14 05:14:40.818567 ip-10-0-136-9 kubenswrapper[2584]: I0714 05:14:40.818536 2584 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-8llzd_694d0f90-6317-495d-a312-b76a3513730e/kube-rbac-proxy-ovn-metrics/0.log" Jul 14 05:14:40.839127 ip-10-0-136-9 kubenswrapper[2584]: I0714 05:14:40.839105 2584 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-8llzd_694d0f90-6317-495d-a312-b76a3513730e/northd/0.log" Jul 14 05:14:40.884999 ip-10-0-136-9 kubenswrapper[2584]: I0714 05:14:40.884975 2584 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-8llzd_694d0f90-6317-495d-a312-b76a3513730e/nbdb/0.log" Jul 14 05:14:40.920699 ip-10-0-136-9 kubenswrapper[2584]: I0714 05:14:40.920670 2584 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-8llzd_694d0f90-6317-495d-a312-b76a3513730e/sbdb/0.log" Jul 14 05:14:40.961285 ip-10-0-136-9 kubenswrapper[2584]: I0714 05:14:40.961259 2584 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-8llzd_694d0f90-6317-495d-a312-b76a3513730e/ovnkube-controller/0.log" Jul 14 05:14:42.582459 ip-10-0-136-9 kubenswrapper[2584]: I0714 05:14:42.582428 2584 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-network-diagnostics_network-check-source-869dcfcdcd-d82p2_eca5065c-f705-4c3f-b5d6-d445634581ac/check-endpoints/0.log" Jul 14 05:14:42.728069 ip-10-0-136-9 kubenswrapper[2584]: I0714 05:14:42.728039 2584 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-network-diagnostics_network-check-target-kr4q2_c4902f44-8d7a-4f36-b6e7-0acf7bef5043/network-check-target-container/0.log"