Jul 09 02:32:33.296911 ip-10-0-138-136 systemd[1]: kubelet.service: Failed to load environment files: No such file or directory Jul 09 02:32:33.296922 ip-10-0-138-136 systemd[1]: kubelet.service: Failed to run 'start-pre' task: No such file or directory Jul 09 02:32:33.296929 ip-10-0-138-136 systemd[1]: kubelet.service: Failed with result 'resources'. Jul 09 02:32:33.297129 ip-10-0-138-136 systemd[1]: Failed to start Kubernetes Kubelet. Jul 09 02:32:43.336500 ip-10-0-138-136 systemd[1]: kubelet.service: Failed to schedule restart job: Unit crio.service not found. Jul 09 02:32:43.336517 ip-10-0-138-136 systemd[1]: kubelet.service: Failed with result 'resources'. -- Boot 030c77a39d544bb092773889c590b933 -- Jul 09 02:34:13.941997 ip-10-0-138-136 systemd[1]: Starting Kubernetes Kubelet... Jul 09 02:34:14.452068 ip-10-0-138-136 kubenswrapper[2583]: Flag --container-runtime-endpoint has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information. Jul 09 02:34:14.452068 ip-10-0-138-136 kubenswrapper[2583]: Flag --minimum-container-ttl-duration has been deprecated, Use --eviction-hard or --eviction-soft instead. Will be removed in a future version. Jul 09 02:34:14.452068 ip-10-0-138-136 kubenswrapper[2583]: Flag --volume-plugin-dir has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information. Jul 09 02:34:14.452068 ip-10-0-138-136 kubenswrapper[2583]: Flag --pod-infra-container-image has been deprecated, will be removed in 1.35. Image garbage collector will get sandbox image information from CRI. Jul 09 02:34:14.452068 ip-10-0-138-136 kubenswrapper[2583]: Flag --system-reserved has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information. Jul 09 02:34:14.452068 ip-10-0-138-136 kubenswrapper[2583]: I0709 02:34:14.385416 2583 server.go:213] "--pod-infra-container-image will not be pruned by the image garbage collector in kubelet and should also be set in the remote runtime" Jul 09 02:34:14.452068 ip-10-0-138-136 kubenswrapper[2583]: W0709 02:34:14.390384 2583 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jul 09 02:34:14.452068 ip-10-0-138-136 kubenswrapper[2583]: W0709 02:34:14.390394 2583 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jul 09 02:34:14.452068 ip-10-0-138-136 kubenswrapper[2583]: W0709 02:34:14.390397 2583 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jul 09 02:34:14.452068 ip-10-0-138-136 kubenswrapper[2583]: W0709 02:34:14.390403 2583 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jul 09 02:34:14.452068 ip-10-0-138-136 kubenswrapper[2583]: W0709 02:34:14.390408 2583 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jul 09 02:34:14.452068 ip-10-0-138-136 kubenswrapper[2583]: W0709 02:34:14.390412 2583 feature_gate.go:328] unrecognized feature gate: PinnedImages Jul 09 02:34:14.452068 ip-10-0-138-136 kubenswrapper[2583]: W0709 02:34:14.390415 2583 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jul 09 02:34:14.452068 ip-10-0-138-136 kubenswrapper[2583]: W0709 02:34:14.390417 2583 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jul 09 02:34:14.462631 ip-10-0-138-136 kubenswrapper[2583]: W0709 02:34:14.390420 2583 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jul 09 02:34:14.462631 ip-10-0-138-136 kubenswrapper[2583]: W0709 02:34:14.390423 2583 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jul 09 02:34:14.462631 ip-10-0-138-136 kubenswrapper[2583]: W0709 02:34:14.390426 2583 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jul 09 02:34:14.462631 ip-10-0-138-136 kubenswrapper[2583]: W0709 02:34:14.390428 2583 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jul 09 02:34:14.462631 ip-10-0-138-136 kubenswrapper[2583]: W0709 02:34:14.390431 2583 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jul 09 02:34:14.462631 ip-10-0-138-136 kubenswrapper[2583]: W0709 02:34:14.390433 2583 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jul 09 02:34:14.462631 ip-10-0-138-136 kubenswrapper[2583]: W0709 02:34:14.390436 2583 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jul 09 02:34:14.462631 ip-10-0-138-136 kubenswrapper[2583]: W0709 02:34:14.390439 2583 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jul 09 02:34:14.462631 ip-10-0-138-136 kubenswrapper[2583]: W0709 02:34:14.390441 2583 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jul 09 02:34:14.462631 ip-10-0-138-136 kubenswrapper[2583]: W0709 02:34:14.390444 2583 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jul 09 02:34:14.462631 ip-10-0-138-136 kubenswrapper[2583]: W0709 02:34:14.390447 2583 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jul 09 02:34:14.462631 ip-10-0-138-136 kubenswrapper[2583]: W0709 02:34:14.390450 2583 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jul 09 02:34:14.462631 ip-10-0-138-136 kubenswrapper[2583]: W0709 02:34:14.390453 2583 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jul 09 02:34:14.462631 ip-10-0-138-136 kubenswrapper[2583]: W0709 02:34:14.390456 2583 feature_gate.go:328] unrecognized feature gate: NewOLM Jul 09 02:34:14.462631 ip-10-0-138-136 kubenswrapper[2583]: W0709 02:34:14.390458 2583 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jul 09 02:34:14.462631 ip-10-0-138-136 kubenswrapper[2583]: W0709 02:34:14.390461 2583 feature_gate.go:328] unrecognized feature gate: SignatureStores Jul 09 02:34:14.462631 ip-10-0-138-136 kubenswrapper[2583]: W0709 02:34:14.390464 2583 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jul 09 02:34:14.462631 ip-10-0-138-136 kubenswrapper[2583]: W0709 02:34:14.390466 2583 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jul 09 02:34:14.462631 ip-10-0-138-136 kubenswrapper[2583]: W0709 02:34:14.390470 2583 feature_gate.go:328] unrecognized feature gate: OSStreams Jul 09 02:34:14.462631 ip-10-0-138-136 kubenswrapper[2583]: W0709 02:34:14.390472 2583 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jul 09 02:34:14.464517 ip-10-0-138-136 kubenswrapper[2583]: W0709 02:34:14.390474 2583 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jul 09 02:34:14.464517 ip-10-0-138-136 kubenswrapper[2583]: W0709 02:34:14.390477 2583 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jul 09 02:34:14.464517 ip-10-0-138-136 kubenswrapper[2583]: W0709 02:34:14.390481 2583 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jul 09 02:34:14.464517 ip-10-0-138-136 kubenswrapper[2583]: W0709 02:34:14.390483 2583 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jul 09 02:34:14.464517 ip-10-0-138-136 kubenswrapper[2583]: W0709 02:34:14.390485 2583 feature_gate.go:328] unrecognized feature gate: DualReplica Jul 09 02:34:14.464517 ip-10-0-138-136 kubenswrapper[2583]: W0709 02:34:14.390488 2583 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jul 09 02:34:14.464517 ip-10-0-138-136 kubenswrapper[2583]: W0709 02:34:14.390491 2583 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jul 09 02:34:14.464517 ip-10-0-138-136 kubenswrapper[2583]: W0709 02:34:14.390493 2583 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jul 09 02:34:14.464517 ip-10-0-138-136 kubenswrapper[2583]: W0709 02:34:14.390496 2583 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jul 09 02:34:14.464517 ip-10-0-138-136 kubenswrapper[2583]: W0709 02:34:14.390499 2583 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jul 09 02:34:14.464517 ip-10-0-138-136 kubenswrapper[2583]: W0709 02:34:14.390502 2583 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jul 09 02:34:14.464517 ip-10-0-138-136 kubenswrapper[2583]: W0709 02:34:14.390504 2583 feature_gate.go:328] unrecognized feature gate: EventTTL Jul 09 02:34:14.464517 ip-10-0-138-136 kubenswrapper[2583]: W0709 02:34:14.390507 2583 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jul 09 02:34:14.464517 ip-10-0-138-136 kubenswrapper[2583]: W0709 02:34:14.390509 2583 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jul 09 02:34:14.464517 ip-10-0-138-136 kubenswrapper[2583]: W0709 02:34:14.390512 2583 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jul 09 02:34:14.464517 ip-10-0-138-136 kubenswrapper[2583]: W0709 02:34:14.390515 2583 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jul 09 02:34:14.464517 ip-10-0-138-136 kubenswrapper[2583]: W0709 02:34:14.390517 2583 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jul 09 02:34:14.464517 ip-10-0-138-136 kubenswrapper[2583]: W0709 02:34:14.390520 2583 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jul 09 02:34:14.464517 ip-10-0-138-136 kubenswrapper[2583]: W0709 02:34:14.390522 2583 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jul 09 02:34:14.466890 ip-10-0-138-136 kubenswrapper[2583]: W0709 02:34:14.390524 2583 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jul 09 02:34:14.466890 ip-10-0-138-136 kubenswrapper[2583]: W0709 02:34:14.390527 2583 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jul 09 02:34:14.466890 ip-10-0-138-136 kubenswrapper[2583]: W0709 02:34:14.390529 2583 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jul 09 02:34:14.466890 ip-10-0-138-136 kubenswrapper[2583]: W0709 02:34:14.390532 2583 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jul 09 02:34:14.466890 ip-10-0-138-136 kubenswrapper[2583]: W0709 02:34:14.390536 2583 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jul 09 02:34:14.466890 ip-10-0-138-136 kubenswrapper[2583]: W0709 02:34:14.390539 2583 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jul 09 02:34:14.466890 ip-10-0-138-136 kubenswrapper[2583]: W0709 02:34:14.390542 2583 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jul 09 02:34:14.466890 ip-10-0-138-136 kubenswrapper[2583]: W0709 02:34:14.390545 2583 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jul 09 02:34:14.466890 ip-10-0-138-136 kubenswrapper[2583]: W0709 02:34:14.390548 2583 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jul 09 02:34:14.466890 ip-10-0-138-136 kubenswrapper[2583]: W0709 02:34:14.390550 2583 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jul 09 02:34:14.466890 ip-10-0-138-136 kubenswrapper[2583]: W0709 02:34:14.390553 2583 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jul 09 02:34:14.466890 ip-10-0-138-136 kubenswrapper[2583]: W0709 02:34:14.390555 2583 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jul 09 02:34:14.466890 ip-10-0-138-136 kubenswrapper[2583]: W0709 02:34:14.390558 2583 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jul 09 02:34:14.466890 ip-10-0-138-136 kubenswrapper[2583]: W0709 02:34:14.390561 2583 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jul 09 02:34:14.466890 ip-10-0-138-136 kubenswrapper[2583]: W0709 02:34:14.390563 2583 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jul 09 02:34:14.466890 ip-10-0-138-136 kubenswrapper[2583]: W0709 02:34:14.390567 2583 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jul 09 02:34:14.466890 ip-10-0-138-136 kubenswrapper[2583]: W0709 02:34:14.390569 2583 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jul 09 02:34:14.466890 ip-10-0-138-136 kubenswrapper[2583]: W0709 02:34:14.390571 2583 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jul 09 02:34:14.466890 ip-10-0-138-136 kubenswrapper[2583]: W0709 02:34:14.390575 2583 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jul 09 02:34:14.467174 ip-10-0-138-136 systemd[1]: Started Kubernetes Kubelet. Jul 09 02:34:14.484896 ip-10-0-138-136 kubenswrapper[2583]: W0709 02:34:14.390579 2583 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jul 09 02:34:14.484896 ip-10-0-138-136 kubenswrapper[2583]: W0709 02:34:14.390582 2583 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jul 09 02:34:14.484896 ip-10-0-138-136 kubenswrapper[2583]: W0709 02:34:14.390585 2583 feature_gate.go:328] unrecognized feature gate: Example Jul 09 02:34:14.484896 ip-10-0-138-136 kubenswrapper[2583]: W0709 02:34:14.390588 2583 feature_gate.go:328] unrecognized feature gate: OVNObservability Jul 09 02:34:14.484896 ip-10-0-138-136 kubenswrapper[2583]: W0709 02:34:14.390590 2583 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jul 09 02:34:14.484896 ip-10-0-138-136 kubenswrapper[2583]: W0709 02:34:14.390599 2583 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jul 09 02:34:14.484896 ip-10-0-138-136 kubenswrapper[2583]: W0709 02:34:14.390602 2583 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jul 09 02:34:14.484896 ip-10-0-138-136 kubenswrapper[2583]: W0709 02:34:14.390604 2583 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jul 09 02:34:14.484896 ip-10-0-138-136 kubenswrapper[2583]: W0709 02:34:14.390607 2583 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jul 09 02:34:14.484896 ip-10-0-138-136 kubenswrapper[2583]: W0709 02:34:14.390610 2583 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jul 09 02:34:14.484896 ip-10-0-138-136 kubenswrapper[2583]: W0709 02:34:14.390613 2583 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jul 09 02:34:14.484896 ip-10-0-138-136 kubenswrapper[2583]: W0709 02:34:14.390615 2583 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jul 09 02:34:14.484896 ip-10-0-138-136 kubenswrapper[2583]: W0709 02:34:14.390618 2583 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jul 09 02:34:14.484896 ip-10-0-138-136 kubenswrapper[2583]: W0709 02:34:14.390621 2583 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jul 09 02:34:14.484896 ip-10-0-138-136 kubenswrapper[2583]: W0709 02:34:14.390623 2583 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jul 09 02:34:14.484896 ip-10-0-138-136 kubenswrapper[2583]: W0709 02:34:14.390631 2583 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jul 09 02:34:14.484896 ip-10-0-138-136 kubenswrapper[2583]: W0709 02:34:14.390634 2583 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jul 09 02:34:14.484896 ip-10-0-138-136 kubenswrapper[2583]: W0709 02:34:14.390636 2583 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jul 09 02:34:14.484896 ip-10-0-138-136 kubenswrapper[2583]: W0709 02:34:14.390639 2583 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jul 09 02:34:14.484896 ip-10-0-138-136 kubenswrapper[2583]: W0709 02:34:14.390641 2583 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jul 09 02:34:14.499846 ip-10-0-138-136 kubenswrapper[2583]: W0709 02:34:14.390644 2583 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jul 09 02:34:14.499846 ip-10-0-138-136 kubenswrapper[2583]: W0709 02:34:14.390647 2583 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jul 09 02:34:14.499846 ip-10-0-138-136 kubenswrapper[2583]: W0709 02:34:14.390650 2583 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jul 09 02:34:14.499846 ip-10-0-138-136 kubenswrapper[2583]: W0709 02:34:14.390653 2583 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jul 09 02:34:14.499846 ip-10-0-138-136 kubenswrapper[2583]: W0709 02:34:14.390655 2583 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jul 09 02:34:14.499846 ip-10-0-138-136 kubenswrapper[2583]: W0709 02:34:14.390658 2583 feature_gate.go:328] unrecognized feature gate: Example2 Jul 09 02:34:14.499846 ip-10-0-138-136 kubenswrapper[2583]: W0709 02:34:14.390660 2583 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jul 09 02:34:14.499846 ip-10-0-138-136 kubenswrapper[2583]: W0709 02:34:14.390663 2583 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jul 09 02:34:14.499846 ip-10-0-138-136 kubenswrapper[2583]: W0709 02:34:14.390666 2583 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jul 09 02:34:14.499846 ip-10-0-138-136 kubenswrapper[2583]: W0709 02:34:14.390668 2583 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jul 09 02:34:14.499846 ip-10-0-138-136 kubenswrapper[2583]: W0709 02:34:14.390671 2583 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jul 09 02:34:14.499846 ip-10-0-138-136 kubenswrapper[2583]: W0709 02:34:14.390675 2583 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jul 09 02:34:14.499846 ip-10-0-138-136 kubenswrapper[2583]: W0709 02:34:14.390677 2583 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jul 09 02:34:14.499846 ip-10-0-138-136 kubenswrapper[2583]: W0709 02:34:14.391407 2583 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jul 09 02:34:14.499846 ip-10-0-138-136 kubenswrapper[2583]: W0709 02:34:14.391414 2583 feature_gate.go:328] unrecognized feature gate: Example Jul 09 02:34:14.499846 ip-10-0-138-136 kubenswrapper[2583]: W0709 02:34:14.391416 2583 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jul 09 02:34:14.499846 ip-10-0-138-136 kubenswrapper[2583]: W0709 02:34:14.391419 2583 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jul 09 02:34:14.499846 ip-10-0-138-136 kubenswrapper[2583]: W0709 02:34:14.391422 2583 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jul 09 02:34:14.499846 ip-10-0-138-136 kubenswrapper[2583]: W0709 02:34:14.391425 2583 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jul 09 02:34:14.499846 ip-10-0-138-136 kubenswrapper[2583]: W0709 02:34:14.391428 2583 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jul 09 02:34:14.501784 ip-10-0-138-136 kubenswrapper[2583]: W0709 02:34:14.391431 2583 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jul 09 02:34:14.501784 ip-10-0-138-136 kubenswrapper[2583]: W0709 02:34:14.391433 2583 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jul 09 02:34:14.501784 ip-10-0-138-136 kubenswrapper[2583]: W0709 02:34:14.391436 2583 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jul 09 02:34:14.501784 ip-10-0-138-136 kubenswrapper[2583]: W0709 02:34:14.391438 2583 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jul 09 02:34:14.501784 ip-10-0-138-136 kubenswrapper[2583]: W0709 02:34:14.391441 2583 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jul 09 02:34:14.501784 ip-10-0-138-136 kubenswrapper[2583]: W0709 02:34:14.391443 2583 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jul 09 02:34:14.501784 ip-10-0-138-136 kubenswrapper[2583]: W0709 02:34:14.391445 2583 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jul 09 02:34:14.501784 ip-10-0-138-136 kubenswrapper[2583]: W0709 02:34:14.391448 2583 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jul 09 02:34:14.501784 ip-10-0-138-136 kubenswrapper[2583]: W0709 02:34:14.391450 2583 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jul 09 02:34:14.501784 ip-10-0-138-136 kubenswrapper[2583]: W0709 02:34:14.391453 2583 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jul 09 02:34:14.501784 ip-10-0-138-136 kubenswrapper[2583]: W0709 02:34:14.391455 2583 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jul 09 02:34:14.501784 ip-10-0-138-136 kubenswrapper[2583]: W0709 02:34:14.391458 2583 feature_gate.go:328] unrecognized feature gate: PinnedImages Jul 09 02:34:14.501784 ip-10-0-138-136 kubenswrapper[2583]: W0709 02:34:14.391460 2583 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jul 09 02:34:14.501784 ip-10-0-138-136 kubenswrapper[2583]: W0709 02:34:14.391463 2583 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jul 09 02:34:14.501784 ip-10-0-138-136 kubenswrapper[2583]: W0709 02:34:14.391466 2583 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jul 09 02:34:14.501784 ip-10-0-138-136 kubenswrapper[2583]: W0709 02:34:14.391469 2583 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jul 09 02:34:14.501784 ip-10-0-138-136 kubenswrapper[2583]: W0709 02:34:14.391471 2583 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jul 09 02:34:14.501784 ip-10-0-138-136 kubenswrapper[2583]: W0709 02:34:14.391475 2583 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jul 09 02:34:14.501784 ip-10-0-138-136 kubenswrapper[2583]: W0709 02:34:14.391478 2583 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jul 09 02:34:14.501784 ip-10-0-138-136 kubenswrapper[2583]: W0709 02:34:14.391480 2583 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jul 09 02:34:14.514987 ip-10-0-138-136 kubenswrapper[2583]: W0709 02:34:14.391482 2583 feature_gate.go:328] unrecognized feature gate: OSStreams Jul 09 02:34:14.514987 ip-10-0-138-136 kubenswrapper[2583]: W0709 02:34:14.391485 2583 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jul 09 02:34:14.514987 ip-10-0-138-136 kubenswrapper[2583]: W0709 02:34:14.391488 2583 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jul 09 02:34:14.514987 ip-10-0-138-136 kubenswrapper[2583]: W0709 02:34:14.391491 2583 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jul 09 02:34:14.514987 ip-10-0-138-136 kubenswrapper[2583]: W0709 02:34:14.391494 2583 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jul 09 02:34:14.514987 ip-10-0-138-136 kubenswrapper[2583]: W0709 02:34:14.391496 2583 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jul 09 02:34:14.514987 ip-10-0-138-136 kubenswrapper[2583]: W0709 02:34:14.391499 2583 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jul 09 02:34:14.514987 ip-10-0-138-136 kubenswrapper[2583]: W0709 02:34:14.391502 2583 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jul 09 02:34:14.514987 ip-10-0-138-136 kubenswrapper[2583]: W0709 02:34:14.391504 2583 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jul 09 02:34:14.514987 ip-10-0-138-136 kubenswrapper[2583]: W0709 02:34:14.391507 2583 feature_gate.go:328] unrecognized feature gate: OVNObservability Jul 09 02:34:14.514987 ip-10-0-138-136 kubenswrapper[2583]: W0709 02:34:14.391509 2583 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jul 09 02:34:14.514987 ip-10-0-138-136 kubenswrapper[2583]: W0709 02:34:14.391512 2583 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jul 09 02:34:14.514987 ip-10-0-138-136 kubenswrapper[2583]: W0709 02:34:14.391514 2583 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jul 09 02:34:14.514987 ip-10-0-138-136 kubenswrapper[2583]: W0709 02:34:14.391517 2583 feature_gate.go:328] unrecognized feature gate: NewOLM Jul 09 02:34:14.514987 ip-10-0-138-136 kubenswrapper[2583]: W0709 02:34:14.391519 2583 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jul 09 02:34:14.514987 ip-10-0-138-136 kubenswrapper[2583]: W0709 02:34:14.391522 2583 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jul 09 02:34:14.514987 ip-10-0-138-136 kubenswrapper[2583]: W0709 02:34:14.391524 2583 feature_gate.go:328] unrecognized feature gate: SignatureStores Jul 09 02:34:14.514987 ip-10-0-138-136 kubenswrapper[2583]: W0709 02:34:14.391527 2583 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jul 09 02:34:14.514987 ip-10-0-138-136 kubenswrapper[2583]: W0709 02:34:14.391530 2583 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jul 09 02:34:14.514987 ip-10-0-138-136 kubenswrapper[2583]: W0709 02:34:14.391532 2583 feature_gate.go:328] unrecognized feature gate: Example2 Jul 09 02:34:14.530504 ip-10-0-138-136 kubenswrapper[2583]: W0709 02:34:14.391535 2583 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jul 09 02:34:14.530504 ip-10-0-138-136 kubenswrapper[2583]: W0709 02:34:14.391537 2583 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jul 09 02:34:14.530504 ip-10-0-138-136 kubenswrapper[2583]: W0709 02:34:14.391542 2583 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jul 09 02:34:14.530504 ip-10-0-138-136 kubenswrapper[2583]: W0709 02:34:14.391545 2583 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jul 09 02:34:14.530504 ip-10-0-138-136 kubenswrapper[2583]: W0709 02:34:14.391549 2583 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jul 09 02:34:14.530504 ip-10-0-138-136 kubenswrapper[2583]: W0709 02:34:14.391552 2583 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jul 09 02:34:14.530504 ip-10-0-138-136 kubenswrapper[2583]: W0709 02:34:14.391555 2583 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jul 09 02:34:14.530504 ip-10-0-138-136 kubenswrapper[2583]: W0709 02:34:14.391557 2583 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jul 09 02:34:14.530504 ip-10-0-138-136 kubenswrapper[2583]: W0709 02:34:14.391560 2583 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jul 09 02:34:14.530504 ip-10-0-138-136 kubenswrapper[2583]: W0709 02:34:14.391563 2583 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jul 09 02:34:14.530504 ip-10-0-138-136 kubenswrapper[2583]: W0709 02:34:14.391566 2583 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jul 09 02:34:14.530504 ip-10-0-138-136 kubenswrapper[2583]: W0709 02:34:14.391568 2583 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jul 09 02:34:14.530504 ip-10-0-138-136 kubenswrapper[2583]: W0709 02:34:14.391571 2583 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jul 09 02:34:14.530504 ip-10-0-138-136 kubenswrapper[2583]: W0709 02:34:14.391573 2583 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jul 09 02:34:14.530504 ip-10-0-138-136 kubenswrapper[2583]: W0709 02:34:14.391576 2583 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jul 09 02:34:14.530504 ip-10-0-138-136 kubenswrapper[2583]: W0709 02:34:14.391578 2583 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jul 09 02:34:14.530504 ip-10-0-138-136 kubenswrapper[2583]: W0709 02:34:14.391580 2583 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jul 09 02:34:14.530504 ip-10-0-138-136 kubenswrapper[2583]: W0709 02:34:14.391583 2583 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jul 09 02:34:14.530504 ip-10-0-138-136 kubenswrapper[2583]: W0709 02:34:14.391586 2583 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jul 09 02:34:14.533344 ip-10-0-138-136 kubenswrapper[2583]: W0709 02:34:14.391589 2583 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jul 09 02:34:14.533344 ip-10-0-138-136 kubenswrapper[2583]: W0709 02:34:14.391592 2583 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jul 09 02:34:14.533344 ip-10-0-138-136 kubenswrapper[2583]: W0709 02:34:14.391594 2583 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jul 09 02:34:14.533344 ip-10-0-138-136 kubenswrapper[2583]: W0709 02:34:14.391597 2583 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jul 09 02:34:14.533344 ip-10-0-138-136 kubenswrapper[2583]: W0709 02:34:14.391599 2583 feature_gate.go:328] unrecognized feature gate: DualReplica Jul 09 02:34:14.533344 ip-10-0-138-136 kubenswrapper[2583]: W0709 02:34:14.391602 2583 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jul 09 02:34:14.533344 ip-10-0-138-136 kubenswrapper[2583]: W0709 02:34:14.391605 2583 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jul 09 02:34:14.533344 ip-10-0-138-136 kubenswrapper[2583]: W0709 02:34:14.391607 2583 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jul 09 02:34:14.533344 ip-10-0-138-136 kubenswrapper[2583]: W0709 02:34:14.391610 2583 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jul 09 02:34:14.533344 ip-10-0-138-136 kubenswrapper[2583]: W0709 02:34:14.391612 2583 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jul 09 02:34:14.533344 ip-10-0-138-136 kubenswrapper[2583]: W0709 02:34:14.391617 2583 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jul 09 02:34:14.533344 ip-10-0-138-136 kubenswrapper[2583]: W0709 02:34:14.391621 2583 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jul 09 02:34:14.533344 ip-10-0-138-136 kubenswrapper[2583]: W0709 02:34:14.391624 2583 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jul 09 02:34:14.533344 ip-10-0-138-136 kubenswrapper[2583]: W0709 02:34:14.391627 2583 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jul 09 02:34:14.533344 ip-10-0-138-136 kubenswrapper[2583]: W0709 02:34:14.391630 2583 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jul 09 02:34:14.533344 ip-10-0-138-136 kubenswrapper[2583]: W0709 02:34:14.391634 2583 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jul 09 02:34:14.533344 ip-10-0-138-136 kubenswrapper[2583]: W0709 02:34:14.391637 2583 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jul 09 02:34:14.533344 ip-10-0-138-136 kubenswrapper[2583]: W0709 02:34:14.391640 2583 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jul 09 02:34:14.533344 ip-10-0-138-136 kubenswrapper[2583]: W0709 02:34:14.391643 2583 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jul 09 02:34:14.534350 ip-10-0-138-136 kubenswrapper[2583]: W0709 02:34:14.391645 2583 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jul 09 02:34:14.534350 ip-10-0-138-136 kubenswrapper[2583]: W0709 02:34:14.391647 2583 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jul 09 02:34:14.534350 ip-10-0-138-136 kubenswrapper[2583]: W0709 02:34:14.391650 2583 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jul 09 02:34:14.534350 ip-10-0-138-136 kubenswrapper[2583]: W0709 02:34:14.391653 2583 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jul 09 02:34:14.534350 ip-10-0-138-136 kubenswrapper[2583]: W0709 02:34:14.391656 2583 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jul 09 02:34:14.534350 ip-10-0-138-136 kubenswrapper[2583]: W0709 02:34:14.391659 2583 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jul 09 02:34:14.534350 ip-10-0-138-136 kubenswrapper[2583]: W0709 02:34:14.391661 2583 feature_gate.go:328] unrecognized feature gate: EventTTL Jul 09 02:34:14.534350 ip-10-0-138-136 kubenswrapper[2583]: W0709 02:34:14.391664 2583 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jul 09 02:34:14.534350 ip-10-0-138-136 kubenswrapper[2583]: W0709 02:34:14.391667 2583 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jul 09 02:34:14.534350 ip-10-0-138-136 kubenswrapper[2583]: W0709 02:34:14.391669 2583 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jul 09 02:34:14.534350 ip-10-0-138-136 kubenswrapper[2583]: W0709 02:34:14.391672 2583 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jul 09 02:34:14.534350 ip-10-0-138-136 kubenswrapper[2583]: W0709 02:34:14.391675 2583 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jul 09 02:34:14.534350 ip-10-0-138-136 kubenswrapper[2583]: W0709 02:34:14.391677 2583 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jul 09 02:34:14.534350 ip-10-0-138-136 kubenswrapper[2583]: W0709 02:34:14.391680 2583 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jul 09 02:34:14.534350 ip-10-0-138-136 kubenswrapper[2583]: W0709 02:34:14.392046 2583 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jul 09 02:34:14.534350 ip-10-0-138-136 kubenswrapper[2583]: W0709 02:34:14.392051 2583 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jul 09 02:34:14.534350 ip-10-0-138-136 kubenswrapper[2583]: W0709 02:34:14.392054 2583 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jul 09 02:34:14.534350 ip-10-0-138-136 kubenswrapper[2583]: W0709 02:34:14.392057 2583 feature_gate.go:328] unrecognized feature gate: DualReplica Jul 09 02:34:14.534350 ip-10-0-138-136 kubenswrapper[2583]: W0709 02:34:14.392060 2583 feature_gate.go:328] unrecognized feature gate: OSStreams Jul 09 02:34:14.534350 ip-10-0-138-136 kubenswrapper[2583]: W0709 02:34:14.392062 2583 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jul 09 02:34:14.565004 ip-10-0-138-136 kubenswrapper[2583]: W0709 02:34:14.392065 2583 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jul 09 02:34:14.565004 ip-10-0-138-136 kubenswrapper[2583]: W0709 02:34:14.392067 2583 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jul 09 02:34:14.565004 ip-10-0-138-136 kubenswrapper[2583]: W0709 02:34:14.392070 2583 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jul 09 02:34:14.565004 ip-10-0-138-136 kubenswrapper[2583]: W0709 02:34:14.392072 2583 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jul 09 02:34:14.565004 ip-10-0-138-136 kubenswrapper[2583]: W0709 02:34:14.392075 2583 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jul 09 02:34:14.565004 ip-10-0-138-136 kubenswrapper[2583]: W0709 02:34:14.392078 2583 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jul 09 02:34:14.565004 ip-10-0-138-136 kubenswrapper[2583]: W0709 02:34:14.392081 2583 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jul 09 02:34:14.565004 ip-10-0-138-136 kubenswrapper[2583]: W0709 02:34:14.392084 2583 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jul 09 02:34:14.565004 ip-10-0-138-136 kubenswrapper[2583]: W0709 02:34:14.392086 2583 feature_gate.go:328] unrecognized feature gate: Example2 Jul 09 02:34:14.565004 ip-10-0-138-136 kubenswrapper[2583]: W0709 02:34:14.392089 2583 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jul 09 02:34:14.565004 ip-10-0-138-136 kubenswrapper[2583]: W0709 02:34:14.392092 2583 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jul 09 02:34:14.565004 ip-10-0-138-136 kubenswrapper[2583]: W0709 02:34:14.392094 2583 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jul 09 02:34:14.565004 ip-10-0-138-136 kubenswrapper[2583]: W0709 02:34:14.392097 2583 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jul 09 02:34:14.565004 ip-10-0-138-136 kubenswrapper[2583]: W0709 02:34:14.392100 2583 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jul 09 02:34:14.565004 ip-10-0-138-136 kubenswrapper[2583]: W0709 02:34:14.392106 2583 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jul 09 02:34:14.565004 ip-10-0-138-136 kubenswrapper[2583]: W0709 02:34:14.392109 2583 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jul 09 02:34:14.565004 ip-10-0-138-136 kubenswrapper[2583]: W0709 02:34:14.392111 2583 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jul 09 02:34:14.565004 ip-10-0-138-136 kubenswrapper[2583]: W0709 02:34:14.392115 2583 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jul 09 02:34:14.565004 ip-10-0-138-136 kubenswrapper[2583]: W0709 02:34:14.392119 2583 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jul 09 02:34:14.700744 ip-10-0-138-136 kubenswrapper[2583]: W0709 02:34:14.392122 2583 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jul 09 02:34:14.700744 ip-10-0-138-136 kubenswrapper[2583]: W0709 02:34:14.392125 2583 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jul 09 02:34:14.700744 ip-10-0-138-136 kubenswrapper[2583]: W0709 02:34:14.392128 2583 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jul 09 02:34:14.700744 ip-10-0-138-136 kubenswrapper[2583]: W0709 02:34:14.392130 2583 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jul 09 02:34:14.700744 ip-10-0-138-136 kubenswrapper[2583]: W0709 02:34:14.392133 2583 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jul 09 02:34:14.700744 ip-10-0-138-136 kubenswrapper[2583]: W0709 02:34:14.392135 2583 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jul 09 02:34:14.700744 ip-10-0-138-136 kubenswrapper[2583]: W0709 02:34:14.392138 2583 feature_gate.go:328] unrecognized feature gate: Example Jul 09 02:34:14.700744 ip-10-0-138-136 kubenswrapper[2583]: W0709 02:34:14.392142 2583 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jul 09 02:34:14.700744 ip-10-0-138-136 kubenswrapper[2583]: W0709 02:34:14.392146 2583 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jul 09 02:34:14.700744 ip-10-0-138-136 kubenswrapper[2583]: W0709 02:34:14.392148 2583 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jul 09 02:34:14.700744 ip-10-0-138-136 kubenswrapper[2583]: W0709 02:34:14.392151 2583 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jul 09 02:34:14.700744 ip-10-0-138-136 kubenswrapper[2583]: W0709 02:34:14.392153 2583 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jul 09 02:34:14.700744 ip-10-0-138-136 kubenswrapper[2583]: W0709 02:34:14.392156 2583 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jul 09 02:34:14.700744 ip-10-0-138-136 kubenswrapper[2583]: W0709 02:34:14.392159 2583 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jul 09 02:34:14.700744 ip-10-0-138-136 kubenswrapper[2583]: W0709 02:34:14.392161 2583 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jul 09 02:34:14.700744 ip-10-0-138-136 kubenswrapper[2583]: W0709 02:34:14.392164 2583 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jul 09 02:34:14.700744 ip-10-0-138-136 kubenswrapper[2583]: W0709 02:34:14.392166 2583 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jul 09 02:34:14.700744 ip-10-0-138-136 kubenswrapper[2583]: W0709 02:34:14.392169 2583 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jul 09 02:34:14.700744 ip-10-0-138-136 kubenswrapper[2583]: W0709 02:34:14.392171 2583 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jul 09 02:34:14.700744 ip-10-0-138-136 kubenswrapper[2583]: W0709 02:34:14.392174 2583 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jul 09 02:34:14.702099 ip-10-0-138-136 kubenswrapper[2583]: W0709 02:34:14.392176 2583 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jul 09 02:34:14.702099 ip-10-0-138-136 kubenswrapper[2583]: W0709 02:34:14.392179 2583 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jul 09 02:34:14.702099 ip-10-0-138-136 kubenswrapper[2583]: W0709 02:34:14.392181 2583 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jul 09 02:34:14.702099 ip-10-0-138-136 kubenswrapper[2583]: W0709 02:34:14.392184 2583 feature_gate.go:328] unrecognized feature gate: NewOLM Jul 09 02:34:14.702099 ip-10-0-138-136 kubenswrapper[2583]: W0709 02:34:14.392186 2583 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jul 09 02:34:14.702099 ip-10-0-138-136 kubenswrapper[2583]: W0709 02:34:14.392189 2583 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jul 09 02:34:14.702099 ip-10-0-138-136 kubenswrapper[2583]: W0709 02:34:14.392191 2583 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jul 09 02:34:14.702099 ip-10-0-138-136 kubenswrapper[2583]: W0709 02:34:14.392195 2583 feature_gate.go:328] unrecognized feature gate: PinnedImages Jul 09 02:34:14.702099 ip-10-0-138-136 kubenswrapper[2583]: W0709 02:34:14.392198 2583 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jul 09 02:34:14.702099 ip-10-0-138-136 kubenswrapper[2583]: W0709 02:34:14.392200 2583 feature_gate.go:328] unrecognized feature gate: OVNObservability Jul 09 02:34:14.702099 ip-10-0-138-136 kubenswrapper[2583]: W0709 02:34:14.392203 2583 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jul 09 02:34:14.702099 ip-10-0-138-136 kubenswrapper[2583]: W0709 02:34:14.392205 2583 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jul 09 02:34:14.702099 ip-10-0-138-136 kubenswrapper[2583]: W0709 02:34:14.392208 2583 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jul 09 02:34:14.702099 ip-10-0-138-136 kubenswrapper[2583]: W0709 02:34:14.392211 2583 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jul 09 02:34:14.702099 ip-10-0-138-136 kubenswrapper[2583]: W0709 02:34:14.392213 2583 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jul 09 02:34:14.702099 ip-10-0-138-136 kubenswrapper[2583]: W0709 02:34:14.392216 2583 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jul 09 02:34:14.702099 ip-10-0-138-136 kubenswrapper[2583]: W0709 02:34:14.392218 2583 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jul 09 02:34:14.702099 ip-10-0-138-136 kubenswrapper[2583]: W0709 02:34:14.392221 2583 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jul 09 02:34:14.702099 ip-10-0-138-136 kubenswrapper[2583]: W0709 02:34:14.392223 2583 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jul 09 02:34:14.702099 ip-10-0-138-136 kubenswrapper[2583]: W0709 02:34:14.392228 2583 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jul 09 02:34:14.703318 ip-10-0-138-136 kubenswrapper[2583]: W0709 02:34:14.392230 2583 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jul 09 02:34:14.703318 ip-10-0-138-136 kubenswrapper[2583]: W0709 02:34:14.392232 2583 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jul 09 02:34:14.703318 ip-10-0-138-136 kubenswrapper[2583]: W0709 02:34:14.392235 2583 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jul 09 02:34:14.703318 ip-10-0-138-136 kubenswrapper[2583]: W0709 02:34:14.392237 2583 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jul 09 02:34:14.703318 ip-10-0-138-136 kubenswrapper[2583]: W0709 02:34:14.392240 2583 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jul 09 02:34:14.703318 ip-10-0-138-136 kubenswrapper[2583]: W0709 02:34:14.392245 2583 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jul 09 02:34:14.703318 ip-10-0-138-136 kubenswrapper[2583]: W0709 02:34:14.392248 2583 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jul 09 02:34:14.703318 ip-10-0-138-136 kubenswrapper[2583]: W0709 02:34:14.392250 2583 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jul 09 02:34:14.703318 ip-10-0-138-136 kubenswrapper[2583]: W0709 02:34:14.392252 2583 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jul 09 02:34:14.703318 ip-10-0-138-136 kubenswrapper[2583]: W0709 02:34:14.392255 2583 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jul 09 02:34:14.703318 ip-10-0-138-136 kubenswrapper[2583]: W0709 02:34:14.392257 2583 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jul 09 02:34:14.703318 ip-10-0-138-136 kubenswrapper[2583]: W0709 02:34:14.392260 2583 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jul 09 02:34:14.703318 ip-10-0-138-136 kubenswrapper[2583]: W0709 02:34:14.392262 2583 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jul 09 02:34:14.703318 ip-10-0-138-136 kubenswrapper[2583]: W0709 02:34:14.392264 2583 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jul 09 02:34:14.703318 ip-10-0-138-136 kubenswrapper[2583]: W0709 02:34:14.392267 2583 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jul 09 02:34:14.703318 ip-10-0-138-136 kubenswrapper[2583]: W0709 02:34:14.392270 2583 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jul 09 02:34:14.703318 ip-10-0-138-136 kubenswrapper[2583]: W0709 02:34:14.392274 2583 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jul 09 02:34:14.703318 ip-10-0-138-136 kubenswrapper[2583]: W0709 02:34:14.392277 2583 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jul 09 02:34:14.703318 ip-10-0-138-136 kubenswrapper[2583]: W0709 02:34:14.392279 2583 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jul 09 02:34:14.704212 ip-10-0-138-136 kubenswrapper[2583]: W0709 02:34:14.392283 2583 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jul 09 02:34:14.704212 ip-10-0-138-136 kubenswrapper[2583]: W0709 02:34:14.392285 2583 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jul 09 02:34:14.704212 ip-10-0-138-136 kubenswrapper[2583]: W0709 02:34:14.392289 2583 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jul 09 02:34:14.704212 ip-10-0-138-136 kubenswrapper[2583]: W0709 02:34:14.392292 2583 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jul 09 02:34:14.704212 ip-10-0-138-136 kubenswrapper[2583]: W0709 02:34:14.392295 2583 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jul 09 02:34:14.704212 ip-10-0-138-136 kubenswrapper[2583]: W0709 02:34:14.392298 2583 feature_gate.go:328] unrecognized feature gate: SignatureStores Jul 09 02:34:14.704212 ip-10-0-138-136 kubenswrapper[2583]: W0709 02:34:14.392301 2583 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jul 09 02:34:14.704212 ip-10-0-138-136 kubenswrapper[2583]: W0709 02:34:14.392303 2583 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jul 09 02:34:14.704212 ip-10-0-138-136 kubenswrapper[2583]: W0709 02:34:14.392306 2583 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jul 09 02:34:14.704212 ip-10-0-138-136 kubenswrapper[2583]: W0709 02:34:14.392308 2583 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jul 09 02:34:14.704212 ip-10-0-138-136 kubenswrapper[2583]: W0709 02:34:14.392311 2583 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jul 09 02:34:14.704212 ip-10-0-138-136 kubenswrapper[2583]: W0709 02:34:14.392313 2583 feature_gate.go:328] unrecognized feature gate: EventTTL Jul 09 02:34:14.704212 ip-10-0-138-136 kubenswrapper[2583]: W0709 02:34:14.392317 2583 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jul 09 02:34:14.704212 ip-10-0-138-136 kubenswrapper[2583]: W0709 02:34:14.392319 2583 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jul 09 02:34:14.704212 ip-10-0-138-136 kubenswrapper[2583]: W0709 02:34:14.392323 2583 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jul 09 02:34:14.704212 ip-10-0-138-136 kubenswrapper[2583]: I0709 02:34:14.392387 2583 flags.go:64] FLAG: --address="0.0.0.0" Jul 09 02:34:14.704212 ip-10-0-138-136 kubenswrapper[2583]: I0709 02:34:14.392394 2583 flags.go:64] FLAG: --allowed-unsafe-sysctls="[]" Jul 09 02:34:14.704212 ip-10-0-138-136 kubenswrapper[2583]: I0709 02:34:14.392399 2583 flags.go:64] FLAG: --anonymous-auth="true" Jul 09 02:34:14.704212 ip-10-0-138-136 kubenswrapper[2583]: I0709 02:34:14.392403 2583 flags.go:64] FLAG: --application-metrics-count-limit="100" Jul 09 02:34:14.704212 ip-10-0-138-136 kubenswrapper[2583]: I0709 02:34:14.392407 2583 flags.go:64] FLAG: --authentication-token-webhook="false" Jul 09 02:34:14.704212 ip-10-0-138-136 kubenswrapper[2583]: I0709 02:34:14.392411 2583 flags.go:64] FLAG: --authentication-token-webhook-cache-ttl="2m0s" Jul 09 02:34:14.704833 ip-10-0-138-136 kubenswrapper[2583]: I0709 02:34:14.392415 2583 flags.go:64] FLAG: --authorization-mode="AlwaysAllow" Jul 09 02:34:14.704833 ip-10-0-138-136 kubenswrapper[2583]: I0709 02:34:14.392418 2583 flags.go:64] FLAG: --authorization-webhook-cache-authorized-ttl="5m0s" Jul 09 02:34:14.704833 ip-10-0-138-136 kubenswrapper[2583]: I0709 02:34:14.392421 2583 flags.go:64] FLAG: --authorization-webhook-cache-unauthorized-ttl="30s" Jul 09 02:34:14.704833 ip-10-0-138-136 kubenswrapper[2583]: I0709 02:34:14.392424 2583 flags.go:64] FLAG: --boot-id-file="/proc/sys/kernel/random/boot_id" Jul 09 02:34:14.704833 ip-10-0-138-136 kubenswrapper[2583]: I0709 02:34:14.392427 2583 flags.go:64] FLAG: --bootstrap-kubeconfig="/etc/kubernetes/kubeconfig" Jul 09 02:34:14.704833 ip-10-0-138-136 kubenswrapper[2583]: I0709 02:34:14.392431 2583 flags.go:64] FLAG: --cert-dir="/var/lib/kubelet/pki" Jul 09 02:34:14.704833 ip-10-0-138-136 kubenswrapper[2583]: I0709 02:34:14.392434 2583 flags.go:64] FLAG: --cgroup-driver="cgroupfs" Jul 09 02:34:14.704833 ip-10-0-138-136 kubenswrapper[2583]: I0709 02:34:14.392436 2583 flags.go:64] FLAG: --cgroup-root="" Jul 09 02:34:14.704833 ip-10-0-138-136 kubenswrapper[2583]: I0709 02:34:14.392439 2583 flags.go:64] FLAG: --cgroups-per-qos="true" Jul 09 02:34:14.704833 ip-10-0-138-136 kubenswrapper[2583]: I0709 02:34:14.392442 2583 flags.go:64] FLAG: --client-ca-file="" Jul 09 02:34:14.704833 ip-10-0-138-136 kubenswrapper[2583]: I0709 02:34:14.392445 2583 flags.go:64] FLAG: --cloud-provider="external" Jul 09 02:34:14.704833 ip-10-0-138-136 kubenswrapper[2583]: I0709 02:34:14.392449 2583 flags.go:64] FLAG: --cluster-dns="[]" Jul 09 02:34:14.704833 ip-10-0-138-136 kubenswrapper[2583]: I0709 02:34:14.392454 2583 flags.go:64] FLAG: --cluster-domain="" Jul 09 02:34:14.704833 ip-10-0-138-136 kubenswrapper[2583]: I0709 02:34:14.392456 2583 flags.go:64] FLAG: --config="/etc/kubernetes/kubelet.conf" Jul 09 02:34:14.704833 ip-10-0-138-136 kubenswrapper[2583]: I0709 02:34:14.392459 2583 flags.go:64] FLAG: --config-dir="/etc/openshift/kubelet.conf.d" Jul 09 02:34:14.704833 ip-10-0-138-136 kubenswrapper[2583]: I0709 02:34:14.392462 2583 flags.go:64] FLAG: --container-hints="/etc/cadvisor/container_hints.json" Jul 09 02:34:14.704833 ip-10-0-138-136 kubenswrapper[2583]: I0709 02:34:14.392466 2583 flags.go:64] FLAG: --container-log-max-files="5" Jul 09 02:34:14.704833 ip-10-0-138-136 kubenswrapper[2583]: I0709 02:34:14.392469 2583 flags.go:64] FLAG: --container-log-max-size="10Mi" Jul 09 02:34:14.704833 ip-10-0-138-136 kubenswrapper[2583]: I0709 02:34:14.392472 2583 flags.go:64] FLAG: --container-runtime-endpoint="/var/run/crio/crio.sock" Jul 09 02:34:14.704833 ip-10-0-138-136 kubenswrapper[2583]: I0709 02:34:14.392475 2583 flags.go:64] FLAG: --containerd="/run/containerd/containerd.sock" Jul 09 02:34:14.704833 ip-10-0-138-136 kubenswrapper[2583]: I0709 02:34:14.392478 2583 flags.go:64] FLAG: --containerd-namespace="k8s.io" Jul 09 02:34:14.704833 ip-10-0-138-136 kubenswrapper[2583]: I0709 02:34:14.392481 2583 flags.go:64] FLAG: --contention-profiling="false" Jul 09 02:34:14.704833 ip-10-0-138-136 kubenswrapper[2583]: I0709 02:34:14.392484 2583 flags.go:64] FLAG: --cpu-cfs-quota="true" Jul 09 02:34:14.704833 ip-10-0-138-136 kubenswrapper[2583]: I0709 02:34:14.392488 2583 flags.go:64] FLAG: --cpu-cfs-quota-period="100ms" Jul 09 02:34:14.705508 ip-10-0-138-136 kubenswrapper[2583]: I0709 02:34:14.392491 2583 flags.go:64] FLAG: --cpu-manager-policy="none" Jul 09 02:34:14.705508 ip-10-0-138-136 kubenswrapper[2583]: I0709 02:34:14.392494 2583 flags.go:64] FLAG: --cpu-manager-policy-options="" Jul 09 02:34:14.705508 ip-10-0-138-136 kubenswrapper[2583]: I0709 02:34:14.392498 2583 flags.go:64] FLAG: --cpu-manager-reconcile-period="10s" Jul 09 02:34:14.705508 ip-10-0-138-136 kubenswrapper[2583]: I0709 02:34:14.392501 2583 flags.go:64] FLAG: --enable-controller-attach-detach="true" Jul 09 02:34:14.705508 ip-10-0-138-136 kubenswrapper[2583]: I0709 02:34:14.392504 2583 flags.go:64] FLAG: --enable-debugging-handlers="true" Jul 09 02:34:14.705508 ip-10-0-138-136 kubenswrapper[2583]: I0709 02:34:14.392506 2583 flags.go:64] FLAG: --enable-load-reader="false" Jul 09 02:34:14.705508 ip-10-0-138-136 kubenswrapper[2583]: I0709 02:34:14.392510 2583 flags.go:64] FLAG: --enable-server="true" Jul 09 02:34:14.705508 ip-10-0-138-136 kubenswrapper[2583]: I0709 02:34:14.392513 2583 flags.go:64] FLAG: --enforce-node-allocatable="[pods]" Jul 09 02:34:14.705508 ip-10-0-138-136 kubenswrapper[2583]: I0709 02:34:14.392517 2583 flags.go:64] FLAG: --event-burst="100" Jul 09 02:34:14.705508 ip-10-0-138-136 kubenswrapper[2583]: I0709 02:34:14.392520 2583 flags.go:64] FLAG: --event-qps="50" Jul 09 02:34:14.705508 ip-10-0-138-136 kubenswrapper[2583]: I0709 02:34:14.392523 2583 flags.go:64] FLAG: --event-storage-age-limit="default=0" Jul 09 02:34:14.705508 ip-10-0-138-136 kubenswrapper[2583]: I0709 02:34:14.392526 2583 flags.go:64] FLAG: --event-storage-event-limit="default=0" Jul 09 02:34:14.705508 ip-10-0-138-136 kubenswrapper[2583]: I0709 02:34:14.392529 2583 flags.go:64] FLAG: --eviction-hard="" Jul 09 02:34:14.705508 ip-10-0-138-136 kubenswrapper[2583]: I0709 02:34:14.392533 2583 flags.go:64] FLAG: --eviction-max-pod-grace-period="0" Jul 09 02:34:14.705508 ip-10-0-138-136 kubenswrapper[2583]: I0709 02:34:14.392535 2583 flags.go:64] FLAG: --eviction-minimum-reclaim="" Jul 09 02:34:14.705508 ip-10-0-138-136 kubenswrapper[2583]: I0709 02:34:14.392538 2583 flags.go:64] FLAG: --eviction-pressure-transition-period="5m0s" Jul 09 02:34:14.705508 ip-10-0-138-136 kubenswrapper[2583]: I0709 02:34:14.392541 2583 flags.go:64] FLAG: --eviction-soft="" Jul 09 02:34:14.705508 ip-10-0-138-136 kubenswrapper[2583]: I0709 02:34:14.392544 2583 flags.go:64] FLAG: --eviction-soft-grace-period="" Jul 09 02:34:14.705508 ip-10-0-138-136 kubenswrapper[2583]: I0709 02:34:14.392547 2583 flags.go:64] FLAG: --exit-on-lock-contention="false" Jul 09 02:34:14.705508 ip-10-0-138-136 kubenswrapper[2583]: I0709 02:34:14.392551 2583 flags.go:64] FLAG: --experimental-allocatable-ignore-eviction="false" Jul 09 02:34:14.705508 ip-10-0-138-136 kubenswrapper[2583]: I0709 02:34:14.392554 2583 flags.go:64] FLAG: --experimental-mounter-path="" Jul 09 02:34:14.705508 ip-10-0-138-136 kubenswrapper[2583]: I0709 02:34:14.392557 2583 flags.go:64] FLAG: --fail-cgroupv1="false" Jul 09 02:34:14.705508 ip-10-0-138-136 kubenswrapper[2583]: I0709 02:34:14.392560 2583 flags.go:64] FLAG: --fail-swap-on="true" Jul 09 02:34:14.705508 ip-10-0-138-136 kubenswrapper[2583]: I0709 02:34:14.392562 2583 flags.go:64] FLAG: --feature-gates="" Jul 09 02:34:14.705508 ip-10-0-138-136 kubenswrapper[2583]: I0709 02:34:14.392566 2583 flags.go:64] FLAG: --file-check-frequency="20s" Jul 09 02:34:14.706282 ip-10-0-138-136 kubenswrapper[2583]: I0709 02:34:14.392569 2583 flags.go:64] FLAG: --global-housekeeping-interval="1m0s" Jul 09 02:34:14.706282 ip-10-0-138-136 kubenswrapper[2583]: I0709 02:34:14.392572 2583 flags.go:64] FLAG: --hairpin-mode="promiscuous-bridge" Jul 09 02:34:14.706282 ip-10-0-138-136 kubenswrapper[2583]: I0709 02:34:14.392575 2583 flags.go:64] FLAG: --healthz-bind-address="127.0.0.1" Jul 09 02:34:14.706282 ip-10-0-138-136 kubenswrapper[2583]: I0709 02:34:14.392578 2583 flags.go:64] FLAG: --healthz-port="10248" Jul 09 02:34:14.706282 ip-10-0-138-136 kubenswrapper[2583]: I0709 02:34:14.392581 2583 flags.go:64] FLAG: --help="false" Jul 09 02:34:14.706282 ip-10-0-138-136 kubenswrapper[2583]: I0709 02:34:14.392584 2583 flags.go:64] FLAG: --hostname-override="ip-10-0-138-136.ec2.internal" Jul 09 02:34:14.706282 ip-10-0-138-136 kubenswrapper[2583]: I0709 02:34:14.392588 2583 flags.go:64] FLAG: --housekeeping-interval="10s" Jul 09 02:34:14.706282 ip-10-0-138-136 kubenswrapper[2583]: I0709 02:34:14.392591 2583 flags.go:64] FLAG: --http-check-frequency="20s" Jul 09 02:34:14.706282 ip-10-0-138-136 kubenswrapper[2583]: I0709 02:34:14.392593 2583 flags.go:64] FLAG: --image-credential-provider-bin-dir="/usr/libexec/kubelet-image-credential-provider-plugins" Jul 09 02:34:14.706282 ip-10-0-138-136 kubenswrapper[2583]: I0709 02:34:14.392597 2583 flags.go:64] FLAG: --image-credential-provider-config="/etc/kubernetes/credential-providers/ecr-credential-provider.yaml" Jul 09 02:34:14.706282 ip-10-0-138-136 kubenswrapper[2583]: I0709 02:34:14.392600 2583 flags.go:64] FLAG: --image-gc-high-threshold="85" Jul 09 02:34:14.706282 ip-10-0-138-136 kubenswrapper[2583]: I0709 02:34:14.392603 2583 flags.go:64] FLAG: --image-gc-low-threshold="80" Jul 09 02:34:14.706282 ip-10-0-138-136 kubenswrapper[2583]: I0709 02:34:14.392605 2583 flags.go:64] FLAG: --image-service-endpoint="" Jul 09 02:34:14.706282 ip-10-0-138-136 kubenswrapper[2583]: I0709 02:34:14.392608 2583 flags.go:64] FLAG: --kernel-memcg-notification="false" Jul 09 02:34:14.706282 ip-10-0-138-136 kubenswrapper[2583]: I0709 02:34:14.392611 2583 flags.go:64] FLAG: --kube-api-burst="100" Jul 09 02:34:14.706282 ip-10-0-138-136 kubenswrapper[2583]: I0709 02:34:14.392614 2583 flags.go:64] FLAG: --kube-api-content-type="application/vnd.kubernetes.protobuf" Jul 09 02:34:14.706282 ip-10-0-138-136 kubenswrapper[2583]: I0709 02:34:14.392617 2583 flags.go:64] FLAG: --kube-api-qps="50" Jul 09 02:34:14.706282 ip-10-0-138-136 kubenswrapper[2583]: I0709 02:34:14.392620 2583 flags.go:64] FLAG: --kube-reserved="" Jul 09 02:34:14.706282 ip-10-0-138-136 kubenswrapper[2583]: I0709 02:34:14.392623 2583 flags.go:64] FLAG: --kube-reserved-cgroup="" Jul 09 02:34:14.706282 ip-10-0-138-136 kubenswrapper[2583]: I0709 02:34:14.392625 2583 flags.go:64] FLAG: --kubeconfig="/var/lib/kubelet/kubeconfig" Jul 09 02:34:14.706282 ip-10-0-138-136 kubenswrapper[2583]: I0709 02:34:14.392628 2583 flags.go:64] FLAG: --kubelet-cgroups="" Jul 09 02:34:14.706282 ip-10-0-138-136 kubenswrapper[2583]: I0709 02:34:14.392631 2583 flags.go:64] FLAG: --local-storage-capacity-isolation="true" Jul 09 02:34:14.706282 ip-10-0-138-136 kubenswrapper[2583]: I0709 02:34:14.392634 2583 flags.go:64] FLAG: --lock-file="" Jul 09 02:34:14.706282 ip-10-0-138-136 kubenswrapper[2583]: I0709 02:34:14.392636 2583 flags.go:64] FLAG: --log-cadvisor-usage="false" Jul 09 02:34:14.706988 ip-10-0-138-136 kubenswrapper[2583]: I0709 02:34:14.392639 2583 flags.go:64] FLAG: --log-flush-frequency="5s" Jul 09 02:34:14.706988 ip-10-0-138-136 kubenswrapper[2583]: I0709 02:34:14.392642 2583 flags.go:64] FLAG: --log-json-info-buffer-size="0" Jul 09 02:34:14.706988 ip-10-0-138-136 kubenswrapper[2583]: I0709 02:34:14.392648 2583 flags.go:64] FLAG: --log-json-split-stream="false" Jul 09 02:34:14.706988 ip-10-0-138-136 kubenswrapper[2583]: I0709 02:34:14.392651 2583 flags.go:64] FLAG: --log-text-info-buffer-size="0" Jul 09 02:34:14.706988 ip-10-0-138-136 kubenswrapper[2583]: I0709 02:34:14.392654 2583 flags.go:64] FLAG: --log-text-split-stream="false" Jul 09 02:34:14.706988 ip-10-0-138-136 kubenswrapper[2583]: I0709 02:34:14.392656 2583 flags.go:64] FLAG: --logging-format="text" Jul 09 02:34:14.706988 ip-10-0-138-136 kubenswrapper[2583]: I0709 02:34:14.392659 2583 flags.go:64] FLAG: --machine-id-file="/etc/machine-id,/var/lib/dbus/machine-id" Jul 09 02:34:14.706988 ip-10-0-138-136 kubenswrapper[2583]: I0709 02:34:14.392662 2583 flags.go:64] FLAG: --make-iptables-util-chains="true" Jul 09 02:34:14.706988 ip-10-0-138-136 kubenswrapper[2583]: I0709 02:34:14.392665 2583 flags.go:64] FLAG: --manifest-url="" Jul 09 02:34:14.706988 ip-10-0-138-136 kubenswrapper[2583]: I0709 02:34:14.392668 2583 flags.go:64] FLAG: --manifest-url-header="" Jul 09 02:34:14.706988 ip-10-0-138-136 kubenswrapper[2583]: I0709 02:34:14.392672 2583 flags.go:64] FLAG: --max-housekeeping-interval="15s" Jul 09 02:34:14.706988 ip-10-0-138-136 kubenswrapper[2583]: I0709 02:34:14.392674 2583 flags.go:64] FLAG: --max-open-files="1000000" Jul 09 02:34:14.706988 ip-10-0-138-136 kubenswrapper[2583]: I0709 02:34:14.392678 2583 flags.go:64] FLAG: --max-pods="110" Jul 09 02:34:14.706988 ip-10-0-138-136 kubenswrapper[2583]: I0709 02:34:14.392681 2583 flags.go:64] FLAG: --maximum-dead-containers="-1" Jul 09 02:34:14.706988 ip-10-0-138-136 kubenswrapper[2583]: I0709 02:34:14.392685 2583 flags.go:64] FLAG: --maximum-dead-containers-per-container="1" Jul 09 02:34:14.706988 ip-10-0-138-136 kubenswrapper[2583]: I0709 02:34:14.392688 2583 flags.go:64] FLAG: --memory-manager-policy="None" Jul 09 02:34:14.706988 ip-10-0-138-136 kubenswrapper[2583]: I0709 02:34:14.392690 2583 flags.go:64] FLAG: --minimum-container-ttl-duration="6m0s" Jul 09 02:34:14.706988 ip-10-0-138-136 kubenswrapper[2583]: I0709 02:34:14.392693 2583 flags.go:64] FLAG: --minimum-image-ttl-duration="2m0s" Jul 09 02:34:14.706988 ip-10-0-138-136 kubenswrapper[2583]: I0709 02:34:14.392696 2583 flags.go:64] FLAG: --node-ip="0.0.0.0" Jul 09 02:34:14.706988 ip-10-0-138-136 kubenswrapper[2583]: I0709 02:34:14.392699 2583 flags.go:64] FLAG: --node-labels="node-role.kubernetes.io/worker=,node.openshift.io/os_id=rhel" Jul 09 02:34:14.706988 ip-10-0-138-136 kubenswrapper[2583]: I0709 02:34:14.392706 2583 flags.go:64] FLAG: --node-status-max-images="50" Jul 09 02:34:14.706988 ip-10-0-138-136 kubenswrapper[2583]: I0709 02:34:14.392722 2583 flags.go:64] FLAG: --node-status-update-frequency="10s" Jul 09 02:34:14.706988 ip-10-0-138-136 kubenswrapper[2583]: I0709 02:34:14.392726 2583 flags.go:64] FLAG: --oom-score-adj="-999" Jul 09 02:34:14.706988 ip-10-0-138-136 kubenswrapper[2583]: I0709 02:34:14.392729 2583 flags.go:64] FLAG: --pod-cidr="" Jul 09 02:34:14.707951 ip-10-0-138-136 kubenswrapper[2583]: I0709 02:34:14.392732 2583 flags.go:64] FLAG: --pod-infra-container-image="quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:ce93f6b4197b9c62a26a3131f8057ffe9c9379c5079a4f62e5919b75151394e5" Jul 09 02:34:14.707951 ip-10-0-138-136 kubenswrapper[2583]: I0709 02:34:14.392737 2583 flags.go:64] FLAG: --pod-manifest-path="" Jul 09 02:34:14.707951 ip-10-0-138-136 kubenswrapper[2583]: I0709 02:34:14.392740 2583 flags.go:64] FLAG: --pod-max-pids="-1" Jul 09 02:34:14.707951 ip-10-0-138-136 kubenswrapper[2583]: I0709 02:34:14.392743 2583 flags.go:64] FLAG: --pods-per-core="0" Jul 09 02:34:14.707951 ip-10-0-138-136 kubenswrapper[2583]: I0709 02:34:14.392746 2583 flags.go:64] FLAG: --port="10250" Jul 09 02:34:14.707951 ip-10-0-138-136 kubenswrapper[2583]: I0709 02:34:14.392749 2583 flags.go:64] FLAG: --protect-kernel-defaults="false" Jul 09 02:34:14.707951 ip-10-0-138-136 kubenswrapper[2583]: I0709 02:34:14.392752 2583 flags.go:64] FLAG: --provider-id="aws:///us-east-1a/i-05985966b117f131d" Jul 09 02:34:14.707951 ip-10-0-138-136 kubenswrapper[2583]: I0709 02:34:14.392755 2583 flags.go:64] FLAG: --qos-reserved="" Jul 09 02:34:14.707951 ip-10-0-138-136 kubenswrapper[2583]: I0709 02:34:14.392758 2583 flags.go:64] FLAG: --read-only-port="10255" Jul 09 02:34:14.707951 ip-10-0-138-136 kubenswrapper[2583]: I0709 02:34:14.392760 2583 flags.go:64] FLAG: --register-node="true" Jul 09 02:34:14.707951 ip-10-0-138-136 kubenswrapper[2583]: I0709 02:34:14.392763 2583 flags.go:64] FLAG: --register-with-taints="" Jul 09 02:34:14.707951 ip-10-0-138-136 kubenswrapper[2583]: I0709 02:34:14.392768 2583 flags.go:64] FLAG: --registry-burst="10" Jul 09 02:34:14.707951 ip-10-0-138-136 kubenswrapper[2583]: I0709 02:34:14.392771 2583 flags.go:64] FLAG: --registry-qps="5" Jul 09 02:34:14.707951 ip-10-0-138-136 kubenswrapper[2583]: I0709 02:34:14.392774 2583 flags.go:64] FLAG: --reserved-cpus="" Jul 09 02:34:14.707951 ip-10-0-138-136 kubenswrapper[2583]: I0709 02:34:14.392776 2583 flags.go:64] FLAG: --reserved-memory="" Jul 09 02:34:14.707951 ip-10-0-138-136 kubenswrapper[2583]: I0709 02:34:14.392780 2583 flags.go:64] FLAG: --resolv-conf="/etc/resolv.conf" Jul 09 02:34:14.707951 ip-10-0-138-136 kubenswrapper[2583]: I0709 02:34:14.392783 2583 flags.go:64] FLAG: --root-dir="/var/lib/kubelet" Jul 09 02:34:14.707951 ip-10-0-138-136 kubenswrapper[2583]: I0709 02:34:14.392786 2583 flags.go:64] FLAG: --rotate-certificates="false" Jul 09 02:34:14.707951 ip-10-0-138-136 kubenswrapper[2583]: I0709 02:34:14.392789 2583 flags.go:64] FLAG: --rotate-server-certificates="false" Jul 09 02:34:14.707951 ip-10-0-138-136 kubenswrapper[2583]: I0709 02:34:14.392792 2583 flags.go:64] FLAG: --runonce="false" Jul 09 02:34:14.707951 ip-10-0-138-136 kubenswrapper[2583]: I0709 02:34:14.392794 2583 flags.go:64] FLAG: --runtime-cgroups="/system.slice/crio.service" Jul 09 02:34:14.707951 ip-10-0-138-136 kubenswrapper[2583]: I0709 02:34:14.392797 2583 flags.go:64] FLAG: --runtime-request-timeout="2m0s" Jul 09 02:34:14.707951 ip-10-0-138-136 kubenswrapper[2583]: I0709 02:34:14.392802 2583 flags.go:64] FLAG: --seccomp-default="false" Jul 09 02:34:14.707951 ip-10-0-138-136 kubenswrapper[2583]: I0709 02:34:14.392804 2583 flags.go:64] FLAG: --serialize-image-pulls="true" Jul 09 02:34:14.707951 ip-10-0-138-136 kubenswrapper[2583]: I0709 02:34:14.392807 2583 flags.go:64] FLAG: --storage-driver-buffer-duration="1m0s" Jul 09 02:34:14.708673 ip-10-0-138-136 kubenswrapper[2583]: I0709 02:34:14.392810 2583 flags.go:64] FLAG: --storage-driver-db="cadvisor" Jul 09 02:34:14.708673 ip-10-0-138-136 kubenswrapper[2583]: I0709 02:34:14.392813 2583 flags.go:64] FLAG: --storage-driver-host="localhost:8086" Jul 09 02:34:14.708673 ip-10-0-138-136 kubenswrapper[2583]: I0709 02:34:14.392816 2583 flags.go:64] FLAG: --storage-driver-password="root" Jul 09 02:34:14.708673 ip-10-0-138-136 kubenswrapper[2583]: I0709 02:34:14.392818 2583 flags.go:64] FLAG: --storage-driver-secure="false" Jul 09 02:34:14.708673 ip-10-0-138-136 kubenswrapper[2583]: I0709 02:34:14.392821 2583 flags.go:64] FLAG: --storage-driver-table="stats" Jul 09 02:34:14.708673 ip-10-0-138-136 kubenswrapper[2583]: I0709 02:34:14.392824 2583 flags.go:64] FLAG: --storage-driver-user="root" Jul 09 02:34:14.708673 ip-10-0-138-136 kubenswrapper[2583]: I0709 02:34:14.392827 2583 flags.go:64] FLAG: --streaming-connection-idle-timeout="4h0m0s" Jul 09 02:34:14.708673 ip-10-0-138-136 kubenswrapper[2583]: I0709 02:34:14.392830 2583 flags.go:64] FLAG: --sync-frequency="1m0s" Jul 09 02:34:14.708673 ip-10-0-138-136 kubenswrapper[2583]: I0709 02:34:14.392833 2583 flags.go:64] FLAG: --system-cgroups="" Jul 09 02:34:14.708673 ip-10-0-138-136 kubenswrapper[2583]: I0709 02:34:14.392835 2583 flags.go:64] FLAG: --system-reserved="cpu=500m,ephemeral-storage=1Gi,memory=1Gi" Jul 09 02:34:14.708673 ip-10-0-138-136 kubenswrapper[2583]: I0709 02:34:14.392840 2583 flags.go:64] FLAG: --system-reserved-cgroup="" Jul 09 02:34:14.708673 ip-10-0-138-136 kubenswrapper[2583]: I0709 02:34:14.392843 2583 flags.go:64] FLAG: --tls-cert-file="" Jul 09 02:34:14.708673 ip-10-0-138-136 kubenswrapper[2583]: I0709 02:34:14.392846 2583 flags.go:64] FLAG: --tls-cipher-suites="[]" Jul 09 02:34:14.708673 ip-10-0-138-136 kubenswrapper[2583]: I0709 02:34:14.392850 2583 flags.go:64] FLAG: --tls-min-version="" Jul 09 02:34:14.708673 ip-10-0-138-136 kubenswrapper[2583]: I0709 02:34:14.392853 2583 flags.go:64] FLAG: --tls-private-key-file="" Jul 09 02:34:14.708673 ip-10-0-138-136 kubenswrapper[2583]: I0709 02:34:14.392855 2583 flags.go:64] FLAG: --topology-manager-policy="none" Jul 09 02:34:14.708673 ip-10-0-138-136 kubenswrapper[2583]: I0709 02:34:14.392858 2583 flags.go:64] FLAG: --topology-manager-policy-options="" Jul 09 02:34:14.708673 ip-10-0-138-136 kubenswrapper[2583]: I0709 02:34:14.392861 2583 flags.go:64] FLAG: --topology-manager-scope="container" Jul 09 02:34:14.708673 ip-10-0-138-136 kubenswrapper[2583]: I0709 02:34:14.392866 2583 flags.go:64] FLAG: --v="2" Jul 09 02:34:14.708673 ip-10-0-138-136 kubenswrapper[2583]: I0709 02:34:14.392869 2583 flags.go:64] FLAG: --version="false" Jul 09 02:34:14.708673 ip-10-0-138-136 kubenswrapper[2583]: I0709 02:34:14.392873 2583 flags.go:64] FLAG: --vmodule="" Jul 09 02:34:14.708673 ip-10-0-138-136 kubenswrapper[2583]: I0709 02:34:14.392876 2583 flags.go:64] FLAG: --volume-plugin-dir="/etc/kubernetes/kubelet-plugins/volume/exec" Jul 09 02:34:14.708673 ip-10-0-138-136 kubenswrapper[2583]: I0709 02:34:14.392879 2583 flags.go:64] FLAG: --volume-stats-agg-period="1m0s" Jul 09 02:34:14.708673 ip-10-0-138-136 kubenswrapper[2583]: W0709 02:34:14.392982 2583 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jul 09 02:34:14.708673 ip-10-0-138-136 kubenswrapper[2583]: W0709 02:34:14.392986 2583 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jul 09 02:34:14.814172 ip-10-0-138-136 kubenswrapper[2583]: W0709 02:34:14.392989 2583 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jul 09 02:34:14.814172 ip-10-0-138-136 kubenswrapper[2583]: W0709 02:34:14.392992 2583 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jul 09 02:34:14.814172 ip-10-0-138-136 kubenswrapper[2583]: W0709 02:34:14.392994 2583 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jul 09 02:34:14.814172 ip-10-0-138-136 kubenswrapper[2583]: W0709 02:34:14.392997 2583 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jul 09 02:34:14.814172 ip-10-0-138-136 kubenswrapper[2583]: W0709 02:34:14.393001 2583 feature_gate.go:328] unrecognized feature gate: EventTTL Jul 09 02:34:14.814172 ip-10-0-138-136 kubenswrapper[2583]: W0709 02:34:14.393004 2583 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jul 09 02:34:14.814172 ip-10-0-138-136 kubenswrapper[2583]: W0709 02:34:14.393006 2583 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jul 09 02:34:14.814172 ip-10-0-138-136 kubenswrapper[2583]: W0709 02:34:14.393009 2583 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jul 09 02:34:14.814172 ip-10-0-138-136 kubenswrapper[2583]: W0709 02:34:14.393011 2583 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jul 09 02:34:14.814172 ip-10-0-138-136 kubenswrapper[2583]: W0709 02:34:14.393014 2583 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jul 09 02:34:14.814172 ip-10-0-138-136 kubenswrapper[2583]: W0709 02:34:14.393018 2583 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jul 09 02:34:14.814172 ip-10-0-138-136 kubenswrapper[2583]: W0709 02:34:14.393022 2583 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jul 09 02:34:14.814172 ip-10-0-138-136 kubenswrapper[2583]: W0709 02:34:14.393025 2583 feature_gate.go:328] unrecognized feature gate: NewOLM Jul 09 02:34:14.814172 ip-10-0-138-136 kubenswrapper[2583]: W0709 02:34:14.393027 2583 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jul 09 02:34:14.814172 ip-10-0-138-136 kubenswrapper[2583]: W0709 02:34:14.393030 2583 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jul 09 02:34:14.814172 ip-10-0-138-136 kubenswrapper[2583]: W0709 02:34:14.393032 2583 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jul 09 02:34:14.814172 ip-10-0-138-136 kubenswrapper[2583]: W0709 02:34:14.393035 2583 feature_gate.go:328] unrecognized feature gate: SignatureStores Jul 09 02:34:14.814172 ip-10-0-138-136 kubenswrapper[2583]: W0709 02:34:14.393038 2583 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jul 09 02:34:14.814172 ip-10-0-138-136 kubenswrapper[2583]: W0709 02:34:14.393041 2583 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jul 09 02:34:14.814172 ip-10-0-138-136 kubenswrapper[2583]: W0709 02:34:14.393044 2583 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jul 09 02:34:14.814822 ip-10-0-138-136 kubenswrapper[2583]: W0709 02:34:14.393047 2583 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jul 09 02:34:14.814822 ip-10-0-138-136 kubenswrapper[2583]: W0709 02:34:14.393051 2583 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jul 09 02:34:14.814822 ip-10-0-138-136 kubenswrapper[2583]: W0709 02:34:14.393054 2583 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jul 09 02:34:14.814822 ip-10-0-138-136 kubenswrapper[2583]: W0709 02:34:14.393057 2583 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jul 09 02:34:14.814822 ip-10-0-138-136 kubenswrapper[2583]: W0709 02:34:14.393060 2583 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jul 09 02:34:14.814822 ip-10-0-138-136 kubenswrapper[2583]: W0709 02:34:14.393064 2583 feature_gate.go:328] unrecognized feature gate: Example2 Jul 09 02:34:14.814822 ip-10-0-138-136 kubenswrapper[2583]: W0709 02:34:14.393067 2583 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jul 09 02:34:14.814822 ip-10-0-138-136 kubenswrapper[2583]: W0709 02:34:14.393070 2583 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jul 09 02:34:14.814822 ip-10-0-138-136 kubenswrapper[2583]: W0709 02:34:14.393073 2583 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jul 09 02:34:14.814822 ip-10-0-138-136 kubenswrapper[2583]: W0709 02:34:14.393075 2583 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jul 09 02:34:14.814822 ip-10-0-138-136 kubenswrapper[2583]: W0709 02:34:14.393078 2583 feature_gate.go:328] unrecognized feature gate: Example Jul 09 02:34:14.814822 ip-10-0-138-136 kubenswrapper[2583]: W0709 02:34:14.393081 2583 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jul 09 02:34:14.814822 ip-10-0-138-136 kubenswrapper[2583]: W0709 02:34:14.393084 2583 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jul 09 02:34:14.814822 ip-10-0-138-136 kubenswrapper[2583]: W0709 02:34:14.393086 2583 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jul 09 02:34:14.814822 ip-10-0-138-136 kubenswrapper[2583]: W0709 02:34:14.393088 2583 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jul 09 02:34:14.814822 ip-10-0-138-136 kubenswrapper[2583]: W0709 02:34:14.393091 2583 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jul 09 02:34:14.814822 ip-10-0-138-136 kubenswrapper[2583]: W0709 02:34:14.393095 2583 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jul 09 02:34:14.814822 ip-10-0-138-136 kubenswrapper[2583]: W0709 02:34:14.393098 2583 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jul 09 02:34:14.814822 ip-10-0-138-136 kubenswrapper[2583]: W0709 02:34:14.393101 2583 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jul 09 02:34:14.814822 ip-10-0-138-136 kubenswrapper[2583]: W0709 02:34:14.393103 2583 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jul 09 02:34:14.815404 ip-10-0-138-136 kubenswrapper[2583]: W0709 02:34:14.393106 2583 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jul 09 02:34:14.815404 ip-10-0-138-136 kubenswrapper[2583]: W0709 02:34:14.393108 2583 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jul 09 02:34:14.815404 ip-10-0-138-136 kubenswrapper[2583]: W0709 02:34:14.393111 2583 feature_gate.go:328] unrecognized feature gate: OVNObservability Jul 09 02:34:14.815404 ip-10-0-138-136 kubenswrapper[2583]: W0709 02:34:14.393113 2583 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jul 09 02:34:14.815404 ip-10-0-138-136 kubenswrapper[2583]: W0709 02:34:14.393116 2583 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jul 09 02:34:14.815404 ip-10-0-138-136 kubenswrapper[2583]: W0709 02:34:14.393118 2583 feature_gate.go:328] unrecognized feature gate: OSStreams Jul 09 02:34:14.815404 ip-10-0-138-136 kubenswrapper[2583]: W0709 02:34:14.393121 2583 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jul 09 02:34:14.815404 ip-10-0-138-136 kubenswrapper[2583]: W0709 02:34:14.393123 2583 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jul 09 02:34:14.815404 ip-10-0-138-136 kubenswrapper[2583]: W0709 02:34:14.393126 2583 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jul 09 02:34:14.815404 ip-10-0-138-136 kubenswrapper[2583]: W0709 02:34:14.393129 2583 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jul 09 02:34:14.815404 ip-10-0-138-136 kubenswrapper[2583]: W0709 02:34:14.393131 2583 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jul 09 02:34:14.815404 ip-10-0-138-136 kubenswrapper[2583]: W0709 02:34:14.393134 2583 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jul 09 02:34:14.815404 ip-10-0-138-136 kubenswrapper[2583]: W0709 02:34:14.393136 2583 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jul 09 02:34:14.815404 ip-10-0-138-136 kubenswrapper[2583]: W0709 02:34:14.393139 2583 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jul 09 02:34:14.815404 ip-10-0-138-136 kubenswrapper[2583]: W0709 02:34:14.393141 2583 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jul 09 02:34:14.815404 ip-10-0-138-136 kubenswrapper[2583]: W0709 02:34:14.393144 2583 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jul 09 02:34:14.815404 ip-10-0-138-136 kubenswrapper[2583]: W0709 02:34:14.393146 2583 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jul 09 02:34:14.815404 ip-10-0-138-136 kubenswrapper[2583]: W0709 02:34:14.393150 2583 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jul 09 02:34:14.815404 ip-10-0-138-136 kubenswrapper[2583]: W0709 02:34:14.393153 2583 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jul 09 02:34:14.815404 ip-10-0-138-136 kubenswrapper[2583]: W0709 02:34:14.393156 2583 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jul 09 02:34:14.815989 ip-10-0-138-136 kubenswrapper[2583]: W0709 02:34:14.393158 2583 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jul 09 02:34:14.815989 ip-10-0-138-136 kubenswrapper[2583]: W0709 02:34:14.393161 2583 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jul 09 02:34:14.815989 ip-10-0-138-136 kubenswrapper[2583]: W0709 02:34:14.393163 2583 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jul 09 02:34:14.815989 ip-10-0-138-136 kubenswrapper[2583]: W0709 02:34:14.393166 2583 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jul 09 02:34:14.815989 ip-10-0-138-136 kubenswrapper[2583]: W0709 02:34:14.393168 2583 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jul 09 02:34:14.815989 ip-10-0-138-136 kubenswrapper[2583]: W0709 02:34:14.393170 2583 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jul 09 02:34:14.815989 ip-10-0-138-136 kubenswrapper[2583]: W0709 02:34:14.393173 2583 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jul 09 02:34:14.815989 ip-10-0-138-136 kubenswrapper[2583]: W0709 02:34:14.393176 2583 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jul 09 02:34:14.815989 ip-10-0-138-136 kubenswrapper[2583]: W0709 02:34:14.393180 2583 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jul 09 02:34:14.815989 ip-10-0-138-136 kubenswrapper[2583]: W0709 02:34:14.393183 2583 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jul 09 02:34:14.815989 ip-10-0-138-136 kubenswrapper[2583]: W0709 02:34:14.393185 2583 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jul 09 02:34:14.815989 ip-10-0-138-136 kubenswrapper[2583]: W0709 02:34:14.393187 2583 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jul 09 02:34:14.815989 ip-10-0-138-136 kubenswrapper[2583]: W0709 02:34:14.393190 2583 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jul 09 02:34:14.815989 ip-10-0-138-136 kubenswrapper[2583]: W0709 02:34:14.393192 2583 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jul 09 02:34:14.815989 ip-10-0-138-136 kubenswrapper[2583]: W0709 02:34:14.393195 2583 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jul 09 02:34:14.815989 ip-10-0-138-136 kubenswrapper[2583]: W0709 02:34:14.393198 2583 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jul 09 02:34:14.815989 ip-10-0-138-136 kubenswrapper[2583]: W0709 02:34:14.393200 2583 feature_gate.go:328] unrecognized feature gate: PinnedImages Jul 09 02:34:14.815989 ip-10-0-138-136 kubenswrapper[2583]: W0709 02:34:14.393202 2583 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jul 09 02:34:14.815989 ip-10-0-138-136 kubenswrapper[2583]: W0709 02:34:14.393205 2583 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jul 09 02:34:14.815989 ip-10-0-138-136 kubenswrapper[2583]: W0709 02:34:14.393207 2583 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jul 09 02:34:14.816528 ip-10-0-138-136 kubenswrapper[2583]: W0709 02:34:14.393210 2583 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jul 09 02:34:14.816528 ip-10-0-138-136 kubenswrapper[2583]: W0709 02:34:14.393212 2583 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jul 09 02:34:14.816528 ip-10-0-138-136 kubenswrapper[2583]: W0709 02:34:14.393217 2583 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jul 09 02:34:14.816528 ip-10-0-138-136 kubenswrapper[2583]: W0709 02:34:14.393220 2583 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jul 09 02:34:14.816528 ip-10-0-138-136 kubenswrapper[2583]: W0709 02:34:14.393223 2583 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jul 09 02:34:14.816528 ip-10-0-138-136 kubenswrapper[2583]: W0709 02:34:14.393225 2583 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jul 09 02:34:14.816528 ip-10-0-138-136 kubenswrapper[2583]: W0709 02:34:14.393228 2583 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jul 09 02:34:14.816528 ip-10-0-138-136 kubenswrapper[2583]: W0709 02:34:14.393231 2583 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jul 09 02:34:14.816528 ip-10-0-138-136 kubenswrapper[2583]: W0709 02:34:14.393234 2583 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jul 09 02:34:14.816528 ip-10-0-138-136 kubenswrapper[2583]: W0709 02:34:14.393238 2583 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jul 09 02:34:14.816528 ip-10-0-138-136 kubenswrapper[2583]: W0709 02:34:14.393241 2583 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jul 09 02:34:14.816528 ip-10-0-138-136 kubenswrapper[2583]: W0709 02:34:14.393243 2583 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jul 09 02:34:14.816528 ip-10-0-138-136 kubenswrapper[2583]: W0709 02:34:14.393246 2583 feature_gate.go:328] unrecognized feature gate: DualReplica Jul 09 02:34:14.816528 ip-10-0-138-136 kubenswrapper[2583]: W0709 02:34:14.393249 2583 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jul 09 02:34:14.816528 ip-10-0-138-136 kubenswrapper[2583]: W0709 02:34:14.393251 2583 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jul 09 02:34:14.816528 ip-10-0-138-136 kubenswrapper[2583]: W0709 02:34:14.393253 2583 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jul 09 02:34:14.816528 ip-10-0-138-136 kubenswrapper[2583]: W0709 02:34:14.393256 2583 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jul 09 02:34:14.817041 ip-10-0-138-136 kubenswrapper[2583]: I0709 02:34:14.394000 2583 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]} Jul 09 02:34:14.817041 ip-10-0-138-136 kubenswrapper[2583]: I0709 02:34:14.403934 2583 server.go:529] "Kubelet version" kubeletVersion="v1.34.8" Jul 09 02:34:14.817041 ip-10-0-138-136 kubenswrapper[2583]: I0709 02:34:14.403947 2583 server.go:531] "Golang settings" GOGC="" GOMAXPROCS="" GOTRACEBACK="" Jul 09 02:34:14.817041 ip-10-0-138-136 kubenswrapper[2583]: I0709 02:34:14.403966 2583 watchdog_linux.go:95] "Systemd watchdog is not enabled" Jul 09 02:34:14.817041 ip-10-0-138-136 kubenswrapper[2583]: I0709 02:34:14.403981 2583 watchdog_linux.go:137] "Systemd watchdog is not enabled or the interval is invalid, so health checking will not be started." Jul 09 02:34:14.817041 ip-10-0-138-136 kubenswrapper[2583]: W0709 02:34:14.404037 2583 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jul 09 02:34:14.817041 ip-10-0-138-136 kubenswrapper[2583]: W0709 02:34:14.404042 2583 feature_gate.go:328] unrecognized feature gate: Example Jul 09 02:34:14.817041 ip-10-0-138-136 kubenswrapper[2583]: W0709 02:34:14.404046 2583 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jul 09 02:34:14.817041 ip-10-0-138-136 kubenswrapper[2583]: W0709 02:34:14.404049 2583 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jul 09 02:34:14.817041 ip-10-0-138-136 kubenswrapper[2583]: W0709 02:34:14.404052 2583 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jul 09 02:34:14.817041 ip-10-0-138-136 kubenswrapper[2583]: W0709 02:34:14.404055 2583 feature_gate.go:328] unrecognized feature gate: EventTTL Jul 09 02:34:14.817041 ip-10-0-138-136 kubenswrapper[2583]: W0709 02:34:14.404057 2583 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jul 09 02:34:14.817041 ip-10-0-138-136 kubenswrapper[2583]: W0709 02:34:14.404060 2583 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jul 09 02:34:14.817041 ip-10-0-138-136 kubenswrapper[2583]: W0709 02:34:14.404063 2583 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jul 09 02:34:14.817041 ip-10-0-138-136 kubenswrapper[2583]: W0709 02:34:14.404066 2583 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jul 09 02:34:14.817472 ip-10-0-138-136 kubenswrapper[2583]: W0709 02:34:14.404069 2583 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jul 09 02:34:14.817472 ip-10-0-138-136 kubenswrapper[2583]: W0709 02:34:14.404072 2583 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jul 09 02:34:14.817472 ip-10-0-138-136 kubenswrapper[2583]: W0709 02:34:14.404074 2583 feature_gate.go:328] unrecognized feature gate: PinnedImages Jul 09 02:34:14.817472 ip-10-0-138-136 kubenswrapper[2583]: W0709 02:34:14.404077 2583 feature_gate.go:328] unrecognized feature gate: OVNObservability Jul 09 02:34:14.817472 ip-10-0-138-136 kubenswrapper[2583]: W0709 02:34:14.404079 2583 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jul 09 02:34:14.817472 ip-10-0-138-136 kubenswrapper[2583]: W0709 02:34:14.404082 2583 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jul 09 02:34:14.817472 ip-10-0-138-136 kubenswrapper[2583]: W0709 02:34:14.404085 2583 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jul 09 02:34:14.817472 ip-10-0-138-136 kubenswrapper[2583]: W0709 02:34:14.404087 2583 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jul 09 02:34:14.817472 ip-10-0-138-136 kubenswrapper[2583]: W0709 02:34:14.404090 2583 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jul 09 02:34:14.817472 ip-10-0-138-136 kubenswrapper[2583]: W0709 02:34:14.404092 2583 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jul 09 02:34:14.817472 ip-10-0-138-136 kubenswrapper[2583]: W0709 02:34:14.404095 2583 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jul 09 02:34:14.817472 ip-10-0-138-136 kubenswrapper[2583]: W0709 02:34:14.404097 2583 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jul 09 02:34:14.817472 ip-10-0-138-136 kubenswrapper[2583]: W0709 02:34:14.404100 2583 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jul 09 02:34:14.817472 ip-10-0-138-136 kubenswrapper[2583]: W0709 02:34:14.404102 2583 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jul 09 02:34:14.817472 ip-10-0-138-136 kubenswrapper[2583]: W0709 02:34:14.404105 2583 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jul 09 02:34:14.817472 ip-10-0-138-136 kubenswrapper[2583]: W0709 02:34:14.404107 2583 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jul 09 02:34:14.817472 ip-10-0-138-136 kubenswrapper[2583]: W0709 02:34:14.404111 2583 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jul 09 02:34:14.817472 ip-10-0-138-136 kubenswrapper[2583]: W0709 02:34:14.404114 2583 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jul 09 02:34:14.817472 ip-10-0-138-136 kubenswrapper[2583]: W0709 02:34:14.404116 2583 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jul 09 02:34:14.817472 ip-10-0-138-136 kubenswrapper[2583]: W0709 02:34:14.404119 2583 feature_gate.go:328] unrecognized feature gate: NewOLM Jul 09 02:34:14.818078 ip-10-0-138-136 kubenswrapper[2583]: W0709 02:34:14.404121 2583 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jul 09 02:34:14.818078 ip-10-0-138-136 kubenswrapper[2583]: W0709 02:34:14.404124 2583 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jul 09 02:34:14.818078 ip-10-0-138-136 kubenswrapper[2583]: W0709 02:34:14.404126 2583 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jul 09 02:34:14.818078 ip-10-0-138-136 kubenswrapper[2583]: W0709 02:34:14.404129 2583 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jul 09 02:34:14.818078 ip-10-0-138-136 kubenswrapper[2583]: W0709 02:34:14.404131 2583 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jul 09 02:34:14.818078 ip-10-0-138-136 kubenswrapper[2583]: W0709 02:34:14.404134 2583 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jul 09 02:34:14.818078 ip-10-0-138-136 kubenswrapper[2583]: W0709 02:34:14.404136 2583 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jul 09 02:34:14.818078 ip-10-0-138-136 kubenswrapper[2583]: W0709 02:34:14.404139 2583 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jul 09 02:34:14.818078 ip-10-0-138-136 kubenswrapper[2583]: W0709 02:34:14.404141 2583 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jul 09 02:34:14.818078 ip-10-0-138-136 kubenswrapper[2583]: W0709 02:34:14.404144 2583 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jul 09 02:34:14.818078 ip-10-0-138-136 kubenswrapper[2583]: W0709 02:34:14.404147 2583 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jul 09 02:34:14.818078 ip-10-0-138-136 kubenswrapper[2583]: W0709 02:34:14.404149 2583 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jul 09 02:34:14.818078 ip-10-0-138-136 kubenswrapper[2583]: W0709 02:34:14.404153 2583 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jul 09 02:34:14.818078 ip-10-0-138-136 kubenswrapper[2583]: W0709 02:34:14.404157 2583 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jul 09 02:34:14.818078 ip-10-0-138-136 kubenswrapper[2583]: W0709 02:34:14.404160 2583 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jul 09 02:34:14.818078 ip-10-0-138-136 kubenswrapper[2583]: W0709 02:34:14.404163 2583 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jul 09 02:34:14.818078 ip-10-0-138-136 kubenswrapper[2583]: W0709 02:34:14.404166 2583 feature_gate.go:328] unrecognized feature gate: SignatureStores Jul 09 02:34:14.818078 ip-10-0-138-136 kubenswrapper[2583]: W0709 02:34:14.404170 2583 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jul 09 02:34:14.818078 ip-10-0-138-136 kubenswrapper[2583]: W0709 02:34:14.404172 2583 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jul 09 02:34:14.818586 ip-10-0-138-136 kubenswrapper[2583]: W0709 02:34:14.404175 2583 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jul 09 02:34:14.818586 ip-10-0-138-136 kubenswrapper[2583]: W0709 02:34:14.404178 2583 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jul 09 02:34:14.818586 ip-10-0-138-136 kubenswrapper[2583]: W0709 02:34:14.404181 2583 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jul 09 02:34:14.818586 ip-10-0-138-136 kubenswrapper[2583]: W0709 02:34:14.404183 2583 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jul 09 02:34:14.818586 ip-10-0-138-136 kubenswrapper[2583]: W0709 02:34:14.404186 2583 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jul 09 02:34:14.818586 ip-10-0-138-136 kubenswrapper[2583]: W0709 02:34:14.404188 2583 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jul 09 02:34:14.818586 ip-10-0-138-136 kubenswrapper[2583]: W0709 02:34:14.404191 2583 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jul 09 02:34:14.818586 ip-10-0-138-136 kubenswrapper[2583]: W0709 02:34:14.404193 2583 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jul 09 02:34:14.818586 ip-10-0-138-136 kubenswrapper[2583]: W0709 02:34:14.404196 2583 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jul 09 02:34:14.818586 ip-10-0-138-136 kubenswrapper[2583]: W0709 02:34:14.404200 2583 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jul 09 02:34:14.818586 ip-10-0-138-136 kubenswrapper[2583]: W0709 02:34:14.404204 2583 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jul 09 02:34:14.818586 ip-10-0-138-136 kubenswrapper[2583]: W0709 02:34:14.404206 2583 feature_gate.go:328] unrecognized feature gate: Example2 Jul 09 02:34:14.818586 ip-10-0-138-136 kubenswrapper[2583]: W0709 02:34:14.404209 2583 feature_gate.go:328] unrecognized feature gate: OSStreams Jul 09 02:34:14.818586 ip-10-0-138-136 kubenswrapper[2583]: W0709 02:34:14.404212 2583 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jul 09 02:34:14.818586 ip-10-0-138-136 kubenswrapper[2583]: W0709 02:34:14.404214 2583 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jul 09 02:34:14.818586 ip-10-0-138-136 kubenswrapper[2583]: W0709 02:34:14.404217 2583 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jul 09 02:34:14.818586 ip-10-0-138-136 kubenswrapper[2583]: W0709 02:34:14.404219 2583 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jul 09 02:34:14.818586 ip-10-0-138-136 kubenswrapper[2583]: W0709 02:34:14.404222 2583 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jul 09 02:34:14.818586 ip-10-0-138-136 kubenswrapper[2583]: W0709 02:34:14.404224 2583 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jul 09 02:34:14.819148 ip-10-0-138-136 kubenswrapper[2583]: W0709 02:34:14.404227 2583 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jul 09 02:34:14.819148 ip-10-0-138-136 kubenswrapper[2583]: W0709 02:34:14.404230 2583 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jul 09 02:34:14.819148 ip-10-0-138-136 kubenswrapper[2583]: W0709 02:34:14.404232 2583 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jul 09 02:34:14.819148 ip-10-0-138-136 kubenswrapper[2583]: W0709 02:34:14.404235 2583 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jul 09 02:34:14.819148 ip-10-0-138-136 kubenswrapper[2583]: W0709 02:34:14.404237 2583 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jul 09 02:34:14.819148 ip-10-0-138-136 kubenswrapper[2583]: W0709 02:34:14.404239 2583 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jul 09 02:34:14.819148 ip-10-0-138-136 kubenswrapper[2583]: W0709 02:34:14.404242 2583 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jul 09 02:34:14.819148 ip-10-0-138-136 kubenswrapper[2583]: W0709 02:34:14.404244 2583 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jul 09 02:34:14.819148 ip-10-0-138-136 kubenswrapper[2583]: W0709 02:34:14.404247 2583 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jul 09 02:34:14.819148 ip-10-0-138-136 kubenswrapper[2583]: W0709 02:34:14.404250 2583 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jul 09 02:34:14.819148 ip-10-0-138-136 kubenswrapper[2583]: W0709 02:34:14.404253 2583 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jul 09 02:34:14.819148 ip-10-0-138-136 kubenswrapper[2583]: W0709 02:34:14.404256 2583 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jul 09 02:34:14.819148 ip-10-0-138-136 kubenswrapper[2583]: W0709 02:34:14.404258 2583 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jul 09 02:34:14.819148 ip-10-0-138-136 kubenswrapper[2583]: W0709 02:34:14.404261 2583 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jul 09 02:34:14.819148 ip-10-0-138-136 kubenswrapper[2583]: W0709 02:34:14.404264 2583 feature_gate.go:328] unrecognized feature gate: DualReplica Jul 09 02:34:14.819148 ip-10-0-138-136 kubenswrapper[2583]: W0709 02:34:14.404267 2583 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jul 09 02:34:14.819148 ip-10-0-138-136 kubenswrapper[2583]: W0709 02:34:14.404269 2583 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jul 09 02:34:14.819148 ip-10-0-138-136 kubenswrapper[2583]: W0709 02:34:14.404272 2583 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jul 09 02:34:14.819148 ip-10-0-138-136 kubenswrapper[2583]: W0709 02:34:14.404274 2583 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jul 09 02:34:14.819666 ip-10-0-138-136 kubenswrapper[2583]: W0709 02:34:14.404277 2583 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jul 09 02:34:14.819666 ip-10-0-138-136 kubenswrapper[2583]: W0709 02:34:14.404279 2583 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jul 09 02:34:14.819666 ip-10-0-138-136 kubenswrapper[2583]: W0709 02:34:14.404285 2583 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jul 09 02:34:14.819666 ip-10-0-138-136 kubenswrapper[2583]: W0709 02:34:14.404289 2583 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jul 09 02:34:14.819666 ip-10-0-138-136 kubenswrapper[2583]: W0709 02:34:14.404292 2583 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jul 09 02:34:14.819666 ip-10-0-138-136 kubenswrapper[2583]: W0709 02:34:14.404295 2583 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jul 09 02:34:14.819666 ip-10-0-138-136 kubenswrapper[2583]: W0709 02:34:14.404297 2583 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jul 09 02:34:14.819666 ip-10-0-138-136 kubenswrapper[2583]: W0709 02:34:14.404300 2583 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jul 09 02:34:14.819666 ip-10-0-138-136 kubenswrapper[2583]: W0709 02:34:14.404302 2583 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jul 09 02:34:14.819666 ip-10-0-138-136 kubenswrapper[2583]: W0709 02:34:14.404305 2583 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jul 09 02:34:14.819666 ip-10-0-138-136 kubenswrapper[2583]: W0709 02:34:14.404307 2583 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jul 09 02:34:14.819666 ip-10-0-138-136 kubenswrapper[2583]: W0709 02:34:14.404310 2583 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jul 09 02:34:14.819666 ip-10-0-138-136 kubenswrapper[2583]: I0709 02:34:14.404315 2583 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]} Jul 09 02:34:14.819666 ip-10-0-138-136 kubenswrapper[2583]: W0709 02:34:14.404422 2583 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jul 09 02:34:14.819666 ip-10-0-138-136 kubenswrapper[2583]: W0709 02:34:14.404427 2583 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jul 09 02:34:14.820129 ip-10-0-138-136 kubenswrapper[2583]: W0709 02:34:14.404430 2583 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jul 09 02:34:14.820129 ip-10-0-138-136 kubenswrapper[2583]: W0709 02:34:14.404433 2583 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jul 09 02:34:14.820129 ip-10-0-138-136 kubenswrapper[2583]: W0709 02:34:14.404435 2583 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jul 09 02:34:14.820129 ip-10-0-138-136 kubenswrapper[2583]: W0709 02:34:14.404438 2583 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jul 09 02:34:14.820129 ip-10-0-138-136 kubenswrapper[2583]: W0709 02:34:14.404441 2583 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jul 09 02:34:14.820129 ip-10-0-138-136 kubenswrapper[2583]: W0709 02:34:14.404444 2583 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jul 09 02:34:14.820129 ip-10-0-138-136 kubenswrapper[2583]: W0709 02:34:14.404447 2583 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jul 09 02:34:14.820129 ip-10-0-138-136 kubenswrapper[2583]: W0709 02:34:14.404450 2583 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jul 09 02:34:14.820129 ip-10-0-138-136 kubenswrapper[2583]: W0709 02:34:14.404452 2583 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jul 09 02:34:14.820129 ip-10-0-138-136 kubenswrapper[2583]: W0709 02:34:14.404454 2583 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jul 09 02:34:14.820129 ip-10-0-138-136 kubenswrapper[2583]: W0709 02:34:14.404457 2583 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jul 09 02:34:14.820129 ip-10-0-138-136 kubenswrapper[2583]: W0709 02:34:14.404461 2583 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jul 09 02:34:14.820129 ip-10-0-138-136 kubenswrapper[2583]: W0709 02:34:14.404465 2583 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jul 09 02:34:14.820129 ip-10-0-138-136 kubenswrapper[2583]: W0709 02:34:14.404468 2583 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jul 09 02:34:14.820129 ip-10-0-138-136 kubenswrapper[2583]: W0709 02:34:14.404471 2583 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jul 09 02:34:14.820129 ip-10-0-138-136 kubenswrapper[2583]: W0709 02:34:14.404474 2583 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jul 09 02:34:14.820129 ip-10-0-138-136 kubenswrapper[2583]: W0709 02:34:14.404477 2583 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jul 09 02:34:14.820129 ip-10-0-138-136 kubenswrapper[2583]: W0709 02:34:14.404480 2583 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jul 09 02:34:14.820129 ip-10-0-138-136 kubenswrapper[2583]: W0709 02:34:14.404483 2583 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jul 09 02:34:14.820627 ip-10-0-138-136 kubenswrapper[2583]: W0709 02:34:14.404486 2583 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jul 09 02:34:14.820627 ip-10-0-138-136 kubenswrapper[2583]: W0709 02:34:14.404491 2583 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jul 09 02:34:14.820627 ip-10-0-138-136 kubenswrapper[2583]: W0709 02:34:14.404494 2583 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jul 09 02:34:14.820627 ip-10-0-138-136 kubenswrapper[2583]: W0709 02:34:14.404496 2583 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jul 09 02:34:14.820627 ip-10-0-138-136 kubenswrapper[2583]: W0709 02:34:14.404499 2583 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jul 09 02:34:14.820627 ip-10-0-138-136 kubenswrapper[2583]: W0709 02:34:14.404501 2583 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jul 09 02:34:14.820627 ip-10-0-138-136 kubenswrapper[2583]: W0709 02:34:14.404504 2583 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jul 09 02:34:14.820627 ip-10-0-138-136 kubenswrapper[2583]: W0709 02:34:14.404507 2583 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jul 09 02:34:14.820627 ip-10-0-138-136 kubenswrapper[2583]: W0709 02:34:14.404510 2583 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jul 09 02:34:14.820627 ip-10-0-138-136 kubenswrapper[2583]: W0709 02:34:14.404512 2583 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jul 09 02:34:14.820627 ip-10-0-138-136 kubenswrapper[2583]: W0709 02:34:14.404515 2583 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jul 09 02:34:14.820627 ip-10-0-138-136 kubenswrapper[2583]: W0709 02:34:14.404517 2583 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jul 09 02:34:14.820627 ip-10-0-138-136 kubenswrapper[2583]: W0709 02:34:14.404520 2583 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jul 09 02:34:14.820627 ip-10-0-138-136 kubenswrapper[2583]: W0709 02:34:14.404522 2583 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jul 09 02:34:14.820627 ip-10-0-138-136 kubenswrapper[2583]: W0709 02:34:14.404525 2583 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jul 09 02:34:14.820627 ip-10-0-138-136 kubenswrapper[2583]: W0709 02:34:14.404528 2583 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jul 09 02:34:14.820627 ip-10-0-138-136 kubenswrapper[2583]: W0709 02:34:14.404530 2583 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jul 09 02:34:14.820627 ip-10-0-138-136 kubenswrapper[2583]: W0709 02:34:14.404533 2583 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jul 09 02:34:14.820627 ip-10-0-138-136 kubenswrapper[2583]: W0709 02:34:14.404535 2583 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jul 09 02:34:14.820627 ip-10-0-138-136 kubenswrapper[2583]: W0709 02:34:14.404539 2583 feature_gate.go:328] unrecognized feature gate: NewOLM Jul 09 02:34:14.821240 ip-10-0-138-136 kubenswrapper[2583]: W0709 02:34:14.404542 2583 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jul 09 02:34:14.821240 ip-10-0-138-136 kubenswrapper[2583]: W0709 02:34:14.404544 2583 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jul 09 02:34:14.821240 ip-10-0-138-136 kubenswrapper[2583]: W0709 02:34:14.404547 2583 feature_gate.go:328] unrecognized feature gate: PinnedImages Jul 09 02:34:14.821240 ip-10-0-138-136 kubenswrapper[2583]: W0709 02:34:14.404550 2583 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jul 09 02:34:14.821240 ip-10-0-138-136 kubenswrapper[2583]: W0709 02:34:14.404553 2583 feature_gate.go:328] unrecognized feature gate: OVNObservability Jul 09 02:34:14.821240 ip-10-0-138-136 kubenswrapper[2583]: W0709 02:34:14.404555 2583 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jul 09 02:34:14.821240 ip-10-0-138-136 kubenswrapper[2583]: W0709 02:34:14.404558 2583 feature_gate.go:328] unrecognized feature gate: SignatureStores Jul 09 02:34:14.821240 ip-10-0-138-136 kubenswrapper[2583]: W0709 02:34:14.404560 2583 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jul 09 02:34:14.821240 ip-10-0-138-136 kubenswrapper[2583]: W0709 02:34:14.404563 2583 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jul 09 02:34:14.821240 ip-10-0-138-136 kubenswrapper[2583]: W0709 02:34:14.404565 2583 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jul 09 02:34:14.821240 ip-10-0-138-136 kubenswrapper[2583]: W0709 02:34:14.404568 2583 feature_gate.go:328] unrecognized feature gate: Example2 Jul 09 02:34:14.821240 ip-10-0-138-136 kubenswrapper[2583]: W0709 02:34:14.404571 2583 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jul 09 02:34:14.821240 ip-10-0-138-136 kubenswrapper[2583]: W0709 02:34:14.404573 2583 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jul 09 02:34:14.821240 ip-10-0-138-136 kubenswrapper[2583]: W0709 02:34:14.404578 2583 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jul 09 02:34:14.821240 ip-10-0-138-136 kubenswrapper[2583]: W0709 02:34:14.404580 2583 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jul 09 02:34:14.821240 ip-10-0-138-136 kubenswrapper[2583]: W0709 02:34:14.404583 2583 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jul 09 02:34:14.821240 ip-10-0-138-136 kubenswrapper[2583]: W0709 02:34:14.404585 2583 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jul 09 02:34:14.821240 ip-10-0-138-136 kubenswrapper[2583]: W0709 02:34:14.404588 2583 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jul 09 02:34:14.821240 ip-10-0-138-136 kubenswrapper[2583]: W0709 02:34:14.404590 2583 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jul 09 02:34:14.821240 ip-10-0-138-136 kubenswrapper[2583]: W0709 02:34:14.404593 2583 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jul 09 02:34:14.821792 ip-10-0-138-136 kubenswrapper[2583]: W0709 02:34:14.404596 2583 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jul 09 02:34:14.821792 ip-10-0-138-136 kubenswrapper[2583]: W0709 02:34:14.404598 2583 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jul 09 02:34:14.821792 ip-10-0-138-136 kubenswrapper[2583]: W0709 02:34:14.404601 2583 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jul 09 02:34:14.821792 ip-10-0-138-136 kubenswrapper[2583]: W0709 02:34:14.404603 2583 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jul 09 02:34:14.821792 ip-10-0-138-136 kubenswrapper[2583]: W0709 02:34:14.404606 2583 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jul 09 02:34:14.821792 ip-10-0-138-136 kubenswrapper[2583]: W0709 02:34:14.404608 2583 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jul 09 02:34:14.821792 ip-10-0-138-136 kubenswrapper[2583]: W0709 02:34:14.404611 2583 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jul 09 02:34:14.821792 ip-10-0-138-136 kubenswrapper[2583]: W0709 02:34:14.404613 2583 feature_gate.go:328] unrecognized feature gate: Example Jul 09 02:34:14.821792 ip-10-0-138-136 kubenswrapper[2583]: W0709 02:34:14.404616 2583 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jul 09 02:34:14.821792 ip-10-0-138-136 kubenswrapper[2583]: W0709 02:34:14.404618 2583 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jul 09 02:34:14.821792 ip-10-0-138-136 kubenswrapper[2583]: W0709 02:34:14.404621 2583 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jul 09 02:34:14.821792 ip-10-0-138-136 kubenswrapper[2583]: W0709 02:34:14.404625 2583 feature_gate.go:328] unrecognized feature gate: EventTTL Jul 09 02:34:14.821792 ip-10-0-138-136 kubenswrapper[2583]: W0709 02:34:14.404627 2583 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jul 09 02:34:14.821792 ip-10-0-138-136 kubenswrapper[2583]: W0709 02:34:14.404630 2583 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jul 09 02:34:14.821792 ip-10-0-138-136 kubenswrapper[2583]: W0709 02:34:14.404632 2583 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jul 09 02:34:14.821792 ip-10-0-138-136 kubenswrapper[2583]: W0709 02:34:14.404635 2583 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jul 09 02:34:14.821792 ip-10-0-138-136 kubenswrapper[2583]: W0709 02:34:14.404637 2583 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jul 09 02:34:14.821792 ip-10-0-138-136 kubenswrapper[2583]: W0709 02:34:14.404640 2583 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jul 09 02:34:14.821792 ip-10-0-138-136 kubenswrapper[2583]: W0709 02:34:14.404643 2583 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jul 09 02:34:14.821792 ip-10-0-138-136 kubenswrapper[2583]: W0709 02:34:14.404645 2583 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jul 09 02:34:14.822360 ip-10-0-138-136 kubenswrapper[2583]: W0709 02:34:14.404648 2583 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jul 09 02:34:14.822360 ip-10-0-138-136 kubenswrapper[2583]: W0709 02:34:14.404650 2583 feature_gate.go:328] unrecognized feature gate: DualReplica Jul 09 02:34:14.822360 ip-10-0-138-136 kubenswrapper[2583]: W0709 02:34:14.404653 2583 feature_gate.go:328] unrecognized feature gate: OSStreams Jul 09 02:34:14.822360 ip-10-0-138-136 kubenswrapper[2583]: W0709 02:34:14.404655 2583 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jul 09 02:34:14.822360 ip-10-0-138-136 kubenswrapper[2583]: W0709 02:34:14.404657 2583 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jul 09 02:34:14.822360 ip-10-0-138-136 kubenswrapper[2583]: W0709 02:34:14.404661 2583 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jul 09 02:34:14.822360 ip-10-0-138-136 kubenswrapper[2583]: W0709 02:34:14.404664 2583 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jul 09 02:34:14.822360 ip-10-0-138-136 kubenswrapper[2583]: W0709 02:34:14.404666 2583 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jul 09 02:34:14.822360 ip-10-0-138-136 kubenswrapper[2583]: W0709 02:34:14.404669 2583 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jul 09 02:34:14.822360 ip-10-0-138-136 kubenswrapper[2583]: W0709 02:34:14.404671 2583 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jul 09 02:34:14.822360 ip-10-0-138-136 kubenswrapper[2583]: W0709 02:34:14.404674 2583 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jul 09 02:34:14.822360 ip-10-0-138-136 kubenswrapper[2583]: W0709 02:34:14.404676 2583 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jul 09 02:34:14.822360 ip-10-0-138-136 kubenswrapper[2583]: W0709 02:34:14.404679 2583 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jul 09 02:34:14.822360 ip-10-0-138-136 kubenswrapper[2583]: W0709 02:34:14.404681 2583 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jul 09 02:34:14.822360 ip-10-0-138-136 kubenswrapper[2583]: W0709 02:34:14.404684 2583 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jul 09 02:34:14.822360 ip-10-0-138-136 kubenswrapper[2583]: W0709 02:34:14.404688 2583 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jul 09 02:34:14.822360 ip-10-0-138-136 kubenswrapper[2583]: W0709 02:34:14.404691 2583 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jul 09 02:34:14.822360 ip-10-0-138-136 kubenswrapper[2583]: W0709 02:34:14.404693 2583 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jul 09 02:34:14.822856 ip-10-0-138-136 kubenswrapper[2583]: I0709 02:34:14.404698 2583 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]} Jul 09 02:34:14.822856 ip-10-0-138-136 kubenswrapper[2583]: I0709 02:34:14.404806 2583 server.go:962] "Client rotation is on, will bootstrap in background" Jul 09 02:34:14.822856 ip-10-0-138-136 kubenswrapper[2583]: I0709 02:34:14.408799 2583 bootstrap.go:101] "Use the bootstrap credentials to request a cert, and set kubeconfig to point to the certificate dir" Jul 09 02:34:14.822856 ip-10-0-138-136 kubenswrapper[2583]: I0709 02:34:14.410511 2583 server.go:1019] "Starting client certificate rotation" Jul 09 02:34:14.822856 ip-10-0-138-136 kubenswrapper[2583]: I0709 02:34:14.410606 2583 certificate_manager.go:422] "Certificate rotation is enabled" logger="kubernetes.io/kube-apiserver-client-kubelet" Jul 09 02:34:14.822856 ip-10-0-138-136 kubenswrapper[2583]: I0709 02:34:14.410634 2583 certificate_manager.go:566] "Rotating certificates" logger="kubernetes.io/kube-apiserver-client-kubelet" Jul 09 02:34:14.822856 ip-10-0-138-136 kubenswrapper[2583]: I0709 02:34:14.414059 2583 dynamic_cafile_content.go:123] "Loaded a new CA Bundle and Verifier" name="client-ca-bundle::/etc/kubernetes/kubelet-ca.crt" Jul 09 02:34:14.822856 ip-10-0-138-136 kubenswrapper[2583]: I0709 02:34:14.415120 2583 dynamic_cafile_content.go:161] "Starting controller" name="client-ca-bundle::/etc/kubernetes/kubelet-ca.crt" Jul 09 02:34:14.822856 ip-10-0-138-136 kubenswrapper[2583]: I0709 02:34:14.424856 2583 log.go:25] "Validated CRI v1 runtime API" Jul 09 02:34:14.822856 ip-10-0-138-136 kubenswrapper[2583]: I0709 02:34:14.427211 2583 log.go:25] "Validated CRI v1 image API" Jul 09 02:34:14.822856 ip-10-0-138-136 kubenswrapper[2583]: I0709 02:34:14.428154 2583 server.go:1429] "Using cgroup driver setting received from the CRI runtime" cgroupDriver="systemd" Jul 09 02:34:14.822856 ip-10-0-138-136 kubenswrapper[2583]: I0709 02:34:14.435822 2583 fs.go:135] Filesystem UUIDs: map[75715f20-0707-46c8-94fb-9b69b7815919:/dev/nvme0n1p3 7B77-95E7:/dev/nvme0n1p2 b18a2e3b-0f66-4e61-9dd5-a52a558b545a:/dev/nvme0n1p4] Jul 09 02:34:14.823239 ip-10-0-138-136 kubenswrapper[2583]: I0709 02:34:14.435842 2583 fs.go:136] Filesystem partitions: map[/dev/nvme0n1p3:{mountpoint:/boot major:259 minor:3 fsType:ext4 blockSize:0} /dev/nvme0n1p4:{mountpoint:/var major:259 minor:4 fsType:xfs blockSize:0} /dev/shm:{mountpoint:/dev/shm major:0 minor:22 fsType:tmpfs blockSize:0} /run:{mountpoint:/run major:0 minor:24 fsType:tmpfs blockSize:0} /tmp:{mountpoint:/tmp major:0 minor:31 fsType:tmpfs blockSize:0} composefs_0-33:{mountpoint:/ major:0 minor:33 fsType:overlay blockSize:0}] Jul 09 02:34:14.823239 ip-10-0-138-136 kubenswrapper[2583]: I0709 02:34:14.439669 2583 reflector.go:439] "Caches populated" logger="kubernetes.io/kube-apiserver-client-kubelet" type="*v1.CertificateSigningRequest" reflector="k8s.io/client-go/tools/watch/informerwatcher.go:162" Jul 09 02:34:14.823404 ip-10-0-138-136 kubenswrapper[2583]: I0709 02:34:14.440630 2583 manager.go:216] Machine: {Timestamp:2026-07-09 02:34:14.44017165 +0000 UTC m=+0.372629127 CPUVendorID:GenuineIntel NumCores:8 NumPhysicalCores:4 NumSockets:1 CpuFrequency:3111458 MemoryCapacity:33164500992 SwapCapacity:0 MemoryByType:map[] NVMInfo:{MemoryModeCapacity:0 AppDirectModeCapacity:0 AvgPowerBudget:0} HugePages:[{PageSize:1048576 NumPages:0} {PageSize:2048 NumPages:0}] MachineID:ec298d6b0b4292179885f0abe5cc37bc SystemUUID:ec298d6b-0b42-9217-9885-f0abe5cc37bc BootID:030c77a3-9d54-4bb0-9277-3889c590b933 Filesystems:[{Device:/dev/shm DeviceMajor:0 DeviceMinor:22 Capacity:16582250496 Type:vfs Inodes:4048401 HasInodes:true} {Device:/run DeviceMajor:0 DeviceMinor:24 Capacity:6632902656 Type:vfs Inodes:819200 HasInodes:true} {Device:/dev/nvme0n1p4 DeviceMajor:259 DeviceMinor:4 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:composefs_0-33 DeviceMajor:0 DeviceMinor:33 Capacity:6107136 Type:vfs Inodes:18446744073709551615 HasInodes:true} {Device:/tmp DeviceMajor:0 DeviceMinor:31 Capacity:16582250496 Type:vfs Inodes:1048576 HasInodes:true} {Device:/dev/nvme0n1p3 DeviceMajor:259 DeviceMinor:3 Capacity:366869504 Type:vfs Inodes:98304 HasInodes:true}] DiskMap:map[259:0:{Name:nvme0n1 Major:259 Minor:0 Size:128849018880 Scheduler:none}] NetworkDevices:[{Name:br-ex MacAddress:02:01:11:82:7c:43 Speed:0 Mtu:9001} {Name:ens5 MacAddress:02:01:11:82:7c:43 Speed:0 Mtu:9001} {Name:ovs-system MacAddress:2a:23:65:ad:a6:aa Speed:0 Mtu:1500}] Topology:[{Id:0 Memory:33164500992 HugePages:[{PageSize:1048576 NumPages:0} {PageSize:2048 NumPages:0}] Cores:[{Id:0 Threads:[0 4] Caches:[{Id:0 Size:32768 Type:Data Level:1} {Id:0 Size:32768 Type:Instruction Level:1} {Id:0 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:1 Threads:[1 5] Caches:[{Id:1 Size:32768 Type:Data Level:1} {Id:1 Size:32768 Type:Instruction Level:1} {Id:1 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:2 Threads:[2 6] Caches:[{Id:2 Size:32768 Type:Data Level:1} {Id:2 Size:32768 Type:Instruction Level:1} {Id:2 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:3 Threads:[3 7] Caches:[{Id:3 Size:32768 Type:Data Level:1} {Id:3 Size:32768 Type:Instruction Level:1} {Id:3 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:}] Caches:[{Id:0 Size:37486592 Type:Unified Level:3}] Distances:[10]}] CloudProvider:Unknown InstanceType:Unknown InstanceID:None} Jul 09 02:34:14.823404 ip-10-0-138-136 kubenswrapper[2583]: I0709 02:34:14.440740 2583 manager_no_libpfm.go:29] cAdvisor is build without cgo and/or libpfm support. Perf event counters are not available. Jul 09 02:34:14.823404 ip-10-0-138-136 kubenswrapper[2583]: I0709 02:34:14.440803 2583 manager.go:232] Version: {KernelVersion:5.14.0-570.125.1.el9_6.x86_64 ContainerOsVersion:Red Hat Enterprise Linux CoreOS 9.6.20260630-0 (Plow) DockerVersion: DockerAPIVersion: CadvisorVersion: CadvisorRevision:} Jul 09 02:34:14.823404 ip-10-0-138-136 kubenswrapper[2583]: I0709 02:34:14.444028 2583 container_manager_linux.go:273] "Container manager verified user specified cgroup-root exists" cgroupRoot=[] Jul 09 02:34:14.823404 ip-10-0-138-136 kubenswrapper[2583]: I0709 02:34:14.444046 2583 container_manager_linux.go:278] "Creating Container Manager object based on Node Config" nodeConfig={"NodeName":"ip-10-0-138-136.ec2.internal","RuntimeCgroupsName":"/system.slice/crio.service","SystemCgroupsName":"/system.slice","KubeletCgroupsName":"","KubeletOOMScoreAdj":-999,"ContainerRuntime":"","CgroupsPerQOS":true,"CgroupRoot":"/","CgroupDriver":"systemd","KubeletRootDir":"/var/lib/kubelet","ProtectKernelDefaults":true,"KubeReservedCgroupName":"","SystemReservedCgroupName":"","ReservedSystemCPUs":{},"EnforceNodeAllocatable":{"pods":{}},"KubeReserved":null,"SystemReserved":{"cpu":"500m","ephemeral-storage":"1Gi","memory":"1Gi"},"HardEvictionThresholds":[{"Signal":"imagefs.inodesFree","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.05},"GracePeriod":0,"MinReclaim":null},{"Signal":"memory.available","Operator":"LessThan","Value":{"Quantity":"100Mi","Percentage":0},"GracePeriod":0,"MinReclaim":null},{"Signal":"nodefs.available","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.1},"GracePeriod":0,"MinReclaim":null},{"Signal":"nodefs.inodesFree","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.05},"GracePeriod":0,"MinReclaim":null},{"Signal":"imagefs.available","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.15},"GracePeriod":0,"MinReclaim":null}],"QOSReserved":{},"CPUManagerPolicy":"none","CPUManagerPolicyOptions":null,"TopologyManagerScope":"container","CPUManagerReconcilePeriod":10000000000,"MemoryManagerPolicy":"None","MemoryManagerReservedMemory":null,"PodPidsLimit":4096,"EnforceCPULimits":true,"CPUCFSQuotaPeriod":100000000,"TopologyManagerPolicy":"none","TopologyManagerPolicyOptions":null,"CgroupVersion":2} Jul 09 02:34:14.823404 ip-10-0-138-136 kubenswrapper[2583]: I0709 02:34:14.444884 2583 topology_manager.go:138] "Creating topology manager with none policy" Jul 09 02:34:14.823404 ip-10-0-138-136 kubenswrapper[2583]: I0709 02:34:14.444893 2583 container_manager_linux.go:309] "Creating device plugin manager" Jul 09 02:34:14.823404 ip-10-0-138-136 kubenswrapper[2583]: I0709 02:34:14.444904 2583 manager.go:141] "Creating Device Plugin manager" path="/var/lib/kubelet/device-plugins/kubelet.sock" Jul 09 02:34:14.823404 ip-10-0-138-136 kubenswrapper[2583]: I0709 02:34:14.444917 2583 server.go:74] "Creating device plugin registration server" version="v1beta1" socket="/var/lib/kubelet/device-plugins/kubelet.sock" Jul 09 02:34:14.823404 ip-10-0-138-136 kubenswrapper[2583]: I0709 02:34:14.446955 2583 container_manager_linux.go:318] "Creating Dynamic Resource Allocation (DRA) manager" Jul 09 02:34:14.823404 ip-10-0-138-136 kubenswrapper[2583]: I0709 02:34:14.451678 2583 state_mem.go:36] "Initialized new in-memory state store" Jul 09 02:34:14.823404 ip-10-0-138-136 kubenswrapper[2583]: I0709 02:34:14.451800 2583 server.go:1240] "Using root directory" path="/var/lib/kubelet" Jul 09 02:34:14.823404 ip-10-0-138-136 kubenswrapper[2583]: I0709 02:34:14.452466 2583 kubelet.go:486] "Attempting to sync node with API server" Jul 09 02:34:14.823404 ip-10-0-138-136 kubenswrapper[2583]: I0709 02:34:14.452477 2583 kubelet.go:387] "Adding static pod path" path="/etc/kubernetes/manifests" Jul 09 02:34:14.823404 ip-10-0-138-136 kubenswrapper[2583]: I0709 02:34:14.452495 2583 file.go:69] "Watching path" path="/etc/kubernetes/manifests" Jul 09 02:34:14.823404 ip-10-0-138-136 kubenswrapper[2583]: I0709 02:34:14.452503 2583 kubelet.go:398] "Adding apiserver pod source" Jul 09 02:34:14.823404 ip-10-0-138-136 kubenswrapper[2583]: I0709 02:34:14.452511 2583 apiserver.go:42] "Waiting for node sync before watching apiserver pods" Jul 09 02:34:14.823404 ip-10-0-138-136 kubenswrapper[2583]: I0709 02:34:14.452797 2583 state_mem.go:40] "Initialized new in-memory state store for pod resource information tracking" Jul 09 02:34:14.824210 ip-10-0-138-136 kubenswrapper[2583]: I0709 02:34:14.452811 2583 state_mem.go:40] "Initialized new in-memory state store for pod resource information tracking" Jul 09 02:34:14.824210 ip-10-0-138-136 kubenswrapper[2583]: I0709 02:34:14.457224 2583 kuberuntime_manager.go:301] "Container runtime initialized" containerRuntime="cri-o" version="1.34.8-3.rhaos4.21.git91b4b0b.el9" apiVersion="v1" Jul 09 02:34:14.824210 ip-10-0-138-136 kubenswrapper[2583]: I0709 02:34:14.459560 2583 kubelet.go:960] "Not starting ClusterTrustBundle informer because we are in static kubelet mode or the ClusterTrustBundleProjection featuregate is disabled" Jul 09 02:34:14.824210 ip-10-0-138-136 kubenswrapper[2583]: I0709 02:34:14.459586 2583 kubelet.go:984] "Not starting PodCertificateRequest manager because we are in static kubelet mode or the PodCertificateProjection feature gate is disabled" Jul 09 02:34:14.824210 ip-10-0-138-136 kubenswrapper[2583]: I0709 02:34:14.460950 2583 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/portworx-volume" Jul 09 02:34:14.824210 ip-10-0-138-136 kubenswrapper[2583]: I0709 02:34:14.460975 2583 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/empty-dir" Jul 09 02:34:14.824210 ip-10-0-138-136 kubenswrapper[2583]: I0709 02:34:14.460986 2583 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/git-repo" Jul 09 02:34:14.824210 ip-10-0-138-136 kubenswrapper[2583]: I0709 02:34:14.460995 2583 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/host-path" Jul 09 02:34:14.824210 ip-10-0-138-136 kubenswrapper[2583]: I0709 02:34:14.461007 2583 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/nfs" Jul 09 02:34:14.824210 ip-10-0-138-136 kubenswrapper[2583]: I0709 02:34:14.461015 2583 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/secret" Jul 09 02:34:14.824210 ip-10-0-138-136 kubenswrapper[2583]: I0709 02:34:14.461027 2583 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/iscsi" Jul 09 02:34:14.824210 ip-10-0-138-136 kubenswrapper[2583]: I0709 02:34:14.461037 2583 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/downward-api" Jul 09 02:34:14.824210 ip-10-0-138-136 kubenswrapper[2583]: I0709 02:34:14.461046 2583 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/fc" Jul 09 02:34:14.824210 ip-10-0-138-136 kubenswrapper[2583]: I0709 02:34:14.461051 2583 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/configmap" Jul 09 02:34:14.824210 ip-10-0-138-136 kubenswrapper[2583]: I0709 02:34:14.461059 2583 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/projected" Jul 09 02:34:14.824210 ip-10-0-138-136 kubenswrapper[2583]: I0709 02:34:14.461064 2583 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/local-volume" Jul 09 02:34:14.824210 ip-10-0-138-136 kubenswrapper[2583]: E0709 02:34:14.461020 2583 reflector.go:205] "Failed to watch" err="failed to list *v1.Node: nodes \"ip-10-0-138-136.ec2.internal\" is forbidden: User \"system:anonymous\" cannot list resource \"nodes\" in API group \"\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Node" Jul 09 02:34:14.824210 ip-10-0-138-136 kubenswrapper[2583]: E0709 02:34:14.461020 2583 reflector.go:205] "Failed to watch" err="failed to list *v1.Service: services is forbidden: User \"system:anonymous\" cannot list resource \"services\" in API group \"\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Service" Jul 09 02:34:14.824210 ip-10-0-138-136 kubenswrapper[2583]: I0709 02:34:14.461949 2583 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/csi" Jul 09 02:34:14.824210 ip-10-0-138-136 kubenswrapper[2583]: I0709 02:34:14.461961 2583 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/image" Jul 09 02:34:14.824210 ip-10-0-138-136 kubenswrapper[2583]: I0709 02:34:14.466384 2583 server.go:1268] "Started kubelet" Jul 09 02:34:14.824210 ip-10-0-138-136 kubenswrapper[2583]: I0709 02:34:14.466461 2583 ratelimit.go:56] "Setting rate limiting for endpoint" service="podresources" qps=100 burstTokens=10 Jul 09 02:34:14.824210 ip-10-0-138-136 kubenswrapper[2583]: I0709 02:34:14.466528 2583 server_v1.go:49] "podresources" method="list" useActivePods=true Jul 09 02:34:14.824210 ip-10-0-138-136 kubenswrapper[2583]: I0709 02:34:14.466532 2583 server.go:180] "Starting to listen" address="0.0.0.0" port=10250 Jul 09 02:34:14.824210 ip-10-0-138-136 kubenswrapper[2583]: I0709 02:34:14.466909 2583 csi_plugin.go:990] Failed to contact API server when waiting for CSINode publishing: csinodes.storage.k8s.io "ip-10-0-138-136.ec2.internal" is forbidden: User "system:anonymous" cannot get resource "csinodes" in API group "storage.k8s.io" at the cluster scope Jul 09 02:34:14.824210 ip-10-0-138-136 kubenswrapper[2583]: I0709 02:34:14.468968 2583 server.go:249] "Starting to serve the podresources API" endpoint="unix:/var/lib/kubelet/pod-resources/kubelet.sock" Jul 09 02:34:14.824210 ip-10-0-138-136 kubenswrapper[2583]: I0709 02:34:14.469079 2583 server.go:310] "Adding debug handlers to kubelet server" Jul 09 02:34:14.824210 ip-10-0-138-136 kubenswrapper[2583]: E0709 02:34:14.472213 2583 kubelet.go:1638] "Image garbage collection failed once. Stats initialization may not have completed yet" err="failed to get imageFs info: unable to find data in memory cache" Jul 09 02:34:14.824210 ip-10-0-138-136 kubenswrapper[2583]: E0709 02:34:14.472394 2583 event.go:359] "Server rejected event (will not retry!)" err="events is forbidden: User \"system:anonymous\" cannot create resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-138-136.ec2.internal.18c07e6bee7b02ca default 0 0001-01-01 00:00:00 +0000 UTC map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-138-136.ec2.internal,UID:ip-10-0-138-136.ec2.internal,APIVersion:,ResourceVersion:,FieldPath:,},Reason:Starting,Message:Starting kubelet.,Source:EventSource{Component:kubelet,Host:ip-10-0-138-136.ec2.internal,},FirstTimestamp:2026-07-09 02:34:14.466355914 +0000 UTC m=+0.398813393,LastTimestamp:2026-07-09 02:34:14.466355914 +0000 UTC m=+0.398813393,Count:1,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-138-136.ec2.internal,}" Jul 09 02:34:14.824210 ip-10-0-138-136 kubenswrapper[2583]: I0709 02:34:14.476905 2583 fs_resource_analyzer.go:67] "Starting FS ResourceAnalyzer" Jul 09 02:34:14.824210 ip-10-0-138-136 kubenswrapper[2583]: I0709 02:34:14.476926 2583 certificate_manager.go:422] "Certificate rotation is enabled" logger="kubernetes.io/kubelet-serving" Jul 09 02:34:14.824210 ip-10-0-138-136 kubenswrapper[2583]: E0709 02:34:14.476994 2583 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-138-136.ec2.internal\" not found" Jul 09 02:34:14.824210 ip-10-0-138-136 kubenswrapper[2583]: I0709 02:34:14.477659 2583 desired_state_of_world_populator.go:146] "Desired state populator starts to run" Jul 09 02:34:14.824210 ip-10-0-138-136 kubenswrapper[2583]: I0709 02:34:14.477670 2583 volume_manager.go:311] "The desired_state_of_world populator starts" Jul 09 02:34:14.824210 ip-10-0-138-136 kubenswrapper[2583]: I0709 02:34:14.477699 2583 factory.go:55] Registering systemd factory Jul 09 02:34:14.824210 ip-10-0-138-136 kubenswrapper[2583]: I0709 02:34:14.477734 2583 factory.go:223] Registration of the systemd container factory successfully Jul 09 02:34:14.824210 ip-10-0-138-136 kubenswrapper[2583]: I0709 02:34:14.477700 2583 volume_manager.go:313] "Starting Kubelet Volume Manager" Jul 09 02:34:14.824210 ip-10-0-138-136 kubenswrapper[2583]: I0709 02:34:14.477854 2583 reconstruct.go:97] "Volume reconstruction finished" Jul 09 02:34:14.824210 ip-10-0-138-136 kubenswrapper[2583]: I0709 02:34:14.477862 2583 reconciler.go:29] "Reconciler: start to sync state" Jul 09 02:34:14.824210 ip-10-0-138-136 kubenswrapper[2583]: I0709 02:34:14.477924 2583 factory.go:153] Registering CRI-O factory Jul 09 02:34:14.824210 ip-10-0-138-136 kubenswrapper[2583]: I0709 02:34:14.477937 2583 factory.go:223] Registration of the crio container factory successfully Jul 09 02:34:14.825317 ip-10-0-138-136 kubenswrapper[2583]: I0709 02:34:14.478000 2583 factory.go:221] Registration of the containerd container factory failed: unable to create containerd client: containerd: cannot unix dial containerd api service: dial unix /run/containerd/containerd.sock: connect: no such file or directory Jul 09 02:34:14.825317 ip-10-0-138-136 kubenswrapper[2583]: I0709 02:34:14.478021 2583 factory.go:103] Registering Raw factory Jul 09 02:34:14.825317 ip-10-0-138-136 kubenswrapper[2583]: I0709 02:34:14.478031 2583 manager.go:1196] Started watching for new ooms in manager Jul 09 02:34:14.825317 ip-10-0-138-136 kubenswrapper[2583]: I0709 02:34:14.478369 2583 manager.go:349] Starting recovery of all containers Jul 09 02:34:14.825317 ip-10-0-138-136 kubenswrapper[2583]: E0709 02:34:14.479271 2583 reflector.go:205] "Failed to watch" err="failed to list *v1.CSIDriver: csidrivers.storage.k8s.io is forbidden: User \"system:anonymous\" cannot list resource \"csidrivers\" in API group \"storage.k8s.io\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.CSIDriver" Jul 09 02:34:14.825317 ip-10-0-138-136 kubenswrapper[2583]: E0709 02:34:14.479862 2583 controller.go:145] "Failed to ensure lease exists, will retry" err="leases.coordination.k8s.io \"ip-10-0-138-136.ec2.internal\" is forbidden: User \"system:anonymous\" cannot get resource \"leases\" in API group \"coordination.k8s.io\" in the namespace \"kube-node-lease\"" interval="200ms" Jul 09 02:34:14.825317 ip-10-0-138-136 kubenswrapper[2583]: I0709 02:34:14.487613 2583 csr.go:274] "Certificate signing request is approved, waiting to be issued" logger="kubernetes.io/kube-apiserver-client-kubelet" csr="csr-7l6ld" Jul 09 02:34:14.825317 ip-10-0-138-136 kubenswrapper[2583]: I0709 02:34:14.488673 2583 manager.go:354] Recovery completed Jul 09 02:34:14.825317 ip-10-0-138-136 kubenswrapper[2583]: I0709 02:34:14.493095 2583 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jul 09 02:34:14.825317 ip-10-0-138-136 kubenswrapper[2583]: I0709 02:34:14.494668 2583 csr.go:270] "Certificate signing request is issued" logger="kubernetes.io/kube-apiserver-client-kubelet" csr="csr-7l6ld" Jul 09 02:34:14.825317 ip-10-0-138-136 kubenswrapper[2583]: I0709 02:34:14.494852 2583 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-138-136.ec2.internal" event="NodeHasSufficientMemory" Jul 09 02:34:14.825317 ip-10-0-138-136 kubenswrapper[2583]: I0709 02:34:14.494877 2583 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-138-136.ec2.internal" event="NodeHasNoDiskPressure" Jul 09 02:34:14.825317 ip-10-0-138-136 kubenswrapper[2583]: I0709 02:34:14.494887 2583 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-138-136.ec2.internal" event="NodeHasSufficientPID" Jul 09 02:34:14.825317 ip-10-0-138-136 kubenswrapper[2583]: I0709 02:34:14.495318 2583 cpu_manager.go:222] "Starting CPU manager" policy="none" Jul 09 02:34:14.825317 ip-10-0-138-136 kubenswrapper[2583]: I0709 02:34:14.495328 2583 cpu_manager.go:223] "Reconciling" reconcilePeriod="10s" Jul 09 02:34:14.825317 ip-10-0-138-136 kubenswrapper[2583]: I0709 02:34:14.495333 2583 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jul 09 02:34:14.825317 ip-10-0-138-136 kubenswrapper[2583]: I0709 02:34:14.495341 2583 state_mem.go:36] "Initialized new in-memory state store" Jul 09 02:34:14.825317 ip-10-0-138-136 kubenswrapper[2583]: I0709 02:34:14.495969 2583 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-138-136.ec2.internal" event="NodeHasSufficientMemory" Jul 09 02:34:14.825317 ip-10-0-138-136 kubenswrapper[2583]: I0709 02:34:14.495997 2583 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-138-136.ec2.internal" event="NodeHasNoDiskPressure" Jul 09 02:34:14.825317 ip-10-0-138-136 kubenswrapper[2583]: I0709 02:34:14.496006 2583 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-138-136.ec2.internal" event="NodeHasSufficientPID" Jul 09 02:34:14.825317 ip-10-0-138-136 kubenswrapper[2583]: E0709 02:34:14.496555 2583 event.go:359] "Server rejected event (will not retry!)" err="events is forbidden: User \"system:anonymous\" cannot create resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-138-136.ec2.internal.18c07e6bf02e0698 default 0 0001-01-01 00:00:00 +0000 UTC map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-138-136.ec2.internal,UID:ip-10-0-138-136.ec2.internal,APIVersion:,ResourceVersion:,FieldPath:,},Reason:NodeHasSufficientMemory,Message:Node ip-10-0-138-136.ec2.internal status is now: NodeHasSufficientMemory,Source:EventSource{Component:kubelet,Host:ip-10-0-138-136.ec2.internal,},FirstTimestamp:2026-07-09 02:34:14.494865048 +0000 UTC m=+0.427322527,LastTimestamp:2026-07-09 02:34:14.494865048 +0000 UTC m=+0.427322527,Count:1,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-138-136.ec2.internal,}" Jul 09 02:34:14.825317 ip-10-0-138-136 kubenswrapper[2583]: I0709 02:34:14.497752 2583 policy_none.go:49] "None policy: Start" Jul 09 02:34:14.825317 ip-10-0-138-136 kubenswrapper[2583]: I0709 02:34:14.497767 2583 memory_manager.go:187] "Starting memorymanager" policy="None" Jul 09 02:34:14.825317 ip-10-0-138-136 kubenswrapper[2583]: I0709 02:34:14.497780 2583 state_mem.go:36] "Initializing new in-memory state store" logger="Memory Manager state checkpoint" Jul 09 02:34:14.825317 ip-10-0-138-136 kubenswrapper[2583]: I0709 02:34:14.499994 2583 policy_none.go:47] "Start" Jul 09 02:34:14.825317 ip-10-0-138-136 kubenswrapper[2583]: I0709 02:34:14.568232 2583 manager.go:337] "Starting Device Plugin manager" Jul 09 02:34:14.825317 ip-10-0-138-136 kubenswrapper[2583]: E0709 02:34:14.568345 2583 manager.go:513] "Failed to read data from checkpoint" err="checkpoint is not found" checkpoint="kubelet_internal_checkpoint" Jul 09 02:34:14.825317 ip-10-0-138-136 kubenswrapper[2583]: I0709 02:34:14.568357 2583 server.go:87] "Starting device plugin registration server" Jul 09 02:34:14.825317 ip-10-0-138-136 kubenswrapper[2583]: I0709 02:34:14.568584 2583 eviction_manager.go:189] "Eviction manager: starting control loop" Jul 09 02:34:14.825317 ip-10-0-138-136 kubenswrapper[2583]: I0709 02:34:14.568597 2583 container_log_manager.go:146] "Initializing container log rotate workers" workers=1 monitorPeriod="10s" Jul 09 02:34:14.825317 ip-10-0-138-136 kubenswrapper[2583]: I0709 02:34:14.568698 2583 plugin_watcher.go:51] "Plugin Watcher Start" path="/var/lib/kubelet/plugins_registry" Jul 09 02:34:14.825317 ip-10-0-138-136 kubenswrapper[2583]: I0709 02:34:14.568813 2583 plugin_manager.go:116] "The desired_state_of_world populator (plugin watcher) starts" Jul 09 02:34:14.825317 ip-10-0-138-136 kubenswrapper[2583]: I0709 02:34:14.568822 2583 plugin_manager.go:118] "Starting Kubelet Plugin Manager" Jul 09 02:34:14.825317 ip-10-0-138-136 kubenswrapper[2583]: E0709 02:34:14.570226 2583 eviction_manager.go:267] "eviction manager: failed to check if we have separate container filesystem. Ignoring." err="non-existent label \"crio-containers\"" Jul 09 02:34:14.825317 ip-10-0-138-136 kubenswrapper[2583]: E0709 02:34:14.570276 2583 eviction_manager.go:292] "Eviction manager: failed to get summary stats" err="failed to get node info: node \"ip-10-0-138-136.ec2.internal\" not found" Jul 09 02:34:14.825317 ip-10-0-138-136 kubenswrapper[2583]: I0709 02:34:14.594913 2583 kubelet_network_linux.go:54] "Initialized iptables rules." protocol="IPv4" Jul 09 02:34:14.825317 ip-10-0-138-136 kubenswrapper[2583]: I0709 02:34:14.595966 2583 kubelet_network_linux.go:54] "Initialized iptables rules." protocol="IPv6" Jul 09 02:34:14.825317 ip-10-0-138-136 kubenswrapper[2583]: I0709 02:34:14.596003 2583 status_manager.go:244] "Starting to sync pod status with apiserver" Jul 09 02:34:14.825317 ip-10-0-138-136 kubenswrapper[2583]: I0709 02:34:14.596024 2583 kubelet.go:2448] "Starting kubelet main sync loop" Jul 09 02:34:14.958503 ip-10-0-138-136 kubenswrapper[2583]: E0709 02:34:14.596059 2583 kubelet.go:2472] "Skipping pod synchronization" err="PLEG is not healthy: pleg has yet to be successful" Jul 09 02:34:14.958503 ip-10-0-138-136 kubenswrapper[2583]: I0709 02:34:14.598493 2583 reflector.go:439] "Caches populated" type="*v1.RuntimeClass" reflector="k8s.io/client-go/informers/factory.go:160" Jul 09 02:34:14.958503 ip-10-0-138-136 kubenswrapper[2583]: I0709 02:34:14.669431 2583 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jul 09 02:34:14.958503 ip-10-0-138-136 kubenswrapper[2583]: I0709 02:34:14.670137 2583 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-138-136.ec2.internal" event="NodeHasSufficientMemory" Jul 09 02:34:14.958503 ip-10-0-138-136 kubenswrapper[2583]: I0709 02:34:14.670159 2583 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-138-136.ec2.internal" event="NodeHasNoDiskPressure" Jul 09 02:34:14.958503 ip-10-0-138-136 kubenswrapper[2583]: I0709 02:34:14.670174 2583 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-138-136.ec2.internal" event="NodeHasSufficientPID" Jul 09 02:34:14.958503 ip-10-0-138-136 kubenswrapper[2583]: I0709 02:34:14.670196 2583 kubelet_node_status.go:78] "Attempting to register node" node="ip-10-0-138-136.ec2.internal" Jul 09 02:34:14.958503 ip-10-0-138-136 kubenswrapper[2583]: I0709 02:34:14.679610 2583 kubelet_node_status.go:81] "Successfully registered node" node="ip-10-0-138-136.ec2.internal" Jul 09 02:34:14.958503 ip-10-0-138-136 kubenswrapper[2583]: E0709 02:34:14.679628 2583 kubelet_node_status.go:536] "Error updating node status, will retry" err="error getting node \"ip-10-0-138-136.ec2.internal\": node \"ip-10-0-138-136.ec2.internal\" not found" Jul 09 02:34:14.958503 ip-10-0-138-136 kubenswrapper[2583]: I0709 02:34:14.696210 2583 kubelet.go:2535] "SyncLoop ADD" source="file" pods=["openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-138-136.ec2.internal","kube-system/kube-apiserver-proxy-ip-10-0-138-136.ec2.internal"] Jul 09 02:34:14.958503 ip-10-0-138-136 kubenswrapper[2583]: I0709 02:34:14.696255 2583 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jul 09 02:34:14.958503 ip-10-0-138-136 kubenswrapper[2583]: I0709 02:34:14.697227 2583 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-138-136.ec2.internal" event="NodeHasSufficientMemory" Jul 09 02:34:14.958503 ip-10-0-138-136 kubenswrapper[2583]: I0709 02:34:14.697250 2583 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-138-136.ec2.internal" event="NodeHasNoDiskPressure" Jul 09 02:34:14.958503 ip-10-0-138-136 kubenswrapper[2583]: I0709 02:34:14.697264 2583 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-138-136.ec2.internal" event="NodeHasSufficientPID" Jul 09 02:34:14.958503 ip-10-0-138-136 kubenswrapper[2583]: I0709 02:34:14.699489 2583 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jul 09 02:34:14.958503 ip-10-0-138-136 kubenswrapper[2583]: I0709 02:34:14.699610 2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-138-136.ec2.internal" Jul 09 02:34:14.958503 ip-10-0-138-136 kubenswrapper[2583]: I0709 02:34:14.699635 2583 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jul 09 02:34:14.958503 ip-10-0-138-136 kubenswrapper[2583]: I0709 02:34:14.700191 2583 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-138-136.ec2.internal" event="NodeHasSufficientMemory" Jul 09 02:34:14.958503 ip-10-0-138-136 kubenswrapper[2583]: I0709 02:34:14.700362 2583 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-138-136.ec2.internal" event="NodeHasNoDiskPressure" Jul 09 02:34:14.958503 ip-10-0-138-136 kubenswrapper[2583]: I0709 02:34:14.700576 2583 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-138-136.ec2.internal" event="NodeHasSufficientPID" Jul 09 02:34:14.958503 ip-10-0-138-136 kubenswrapper[2583]: I0709 02:34:14.701328 2583 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-138-136.ec2.internal" event="NodeHasSufficientMemory" Jul 09 02:34:14.958503 ip-10-0-138-136 kubenswrapper[2583]: I0709 02:34:14.701351 2583 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-138-136.ec2.internal" event="NodeHasNoDiskPressure" Jul 09 02:34:14.958503 ip-10-0-138-136 kubenswrapper[2583]: I0709 02:34:14.701365 2583 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-138-136.ec2.internal" event="NodeHasSufficientPID" Jul 09 02:34:14.958503 ip-10-0-138-136 kubenswrapper[2583]: E0709 02:34:14.702057 2583 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-138-136.ec2.internal\" not found" Jul 09 02:34:14.958503 ip-10-0-138-136 kubenswrapper[2583]: I0709 02:34:14.704982 2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/kube-apiserver-proxy-ip-10-0-138-136.ec2.internal" Jul 09 02:34:14.958503 ip-10-0-138-136 kubenswrapper[2583]: I0709 02:34:14.705006 2583 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jul 09 02:34:14.958503 ip-10-0-138-136 kubenswrapper[2583]: I0709 02:34:14.705603 2583 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-138-136.ec2.internal" event="NodeHasSufficientMemory" Jul 09 02:34:14.958503 ip-10-0-138-136 kubenswrapper[2583]: I0709 02:34:14.705625 2583 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-138-136.ec2.internal" event="NodeHasNoDiskPressure" Jul 09 02:34:14.958503 ip-10-0-138-136 kubenswrapper[2583]: I0709 02:34:14.705634 2583 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-138-136.ec2.internal" event="NodeHasSufficientPID" Jul 09 02:34:14.958503 ip-10-0-138-136 kubenswrapper[2583]: E0709 02:34:14.772205 2583 kubelet.go:3244] "No need to create a mirror pod, since failed to get node info from the cluster" err="node \"ip-10-0-138-136.ec2.internal\" not found" node="ip-10-0-138-136.ec2.internal" Jul 09 02:34:14.958503 ip-10-0-138-136 kubenswrapper[2583]: E0709 02:34:14.776427 2583 kubelet.go:3244] "No need to create a mirror pod, since failed to get node info from the cluster" err="node \"ip-10-0-138-136.ec2.internal\" not found" node="ip-10-0-138-136.ec2.internal" Jul 09 02:34:14.958503 ip-10-0-138-136 kubenswrapper[2583]: I0709 02:34:14.779541 2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/1f563ddc813ab6d8fd08536b68d33fae-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-138-136.ec2.internal\" (UID: \"1f563ddc813ab6d8fd08536b68d33fae\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-138-136.ec2.internal" Jul 09 02:34:14.958503 ip-10-0-138-136 kubenswrapper[2583]: I0709 02:34:14.779567 2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/1f563ddc813ab6d8fd08536b68d33fae-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-138-136.ec2.internal\" (UID: \"1f563ddc813ab6d8fd08536b68d33fae\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-138-136.ec2.internal" Jul 09 02:34:14.959464 ip-10-0-138-136 kubenswrapper[2583]: I0709 02:34:14.779589 2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/host-path/04454d06c2f086e47f91e8c63bb8c939-config\") pod \"kube-apiserver-proxy-ip-10-0-138-136.ec2.internal\" (UID: \"04454d06c2f086e47f91e8c63bb8c939\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-138-136.ec2.internal" Jul 09 02:34:14.959464 ip-10-0-138-136 kubenswrapper[2583]: E0709 02:34:14.802130 2583 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-138-136.ec2.internal\" not found" Jul 09 02:34:14.959464 ip-10-0-138-136 kubenswrapper[2583]: I0709 02:34:14.880561 2583 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/1f563ddc813ab6d8fd08536b68d33fae-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-138-136.ec2.internal\" (UID: \"1f563ddc813ab6d8fd08536b68d33fae\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-138-136.ec2.internal" Jul 09 02:34:14.959464 ip-10-0-138-136 kubenswrapper[2583]: I0709 02:34:14.880529 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/1f563ddc813ab6d8fd08536b68d33fae-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-138-136.ec2.internal\" (UID: \"1f563ddc813ab6d8fd08536b68d33fae\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-138-136.ec2.internal" Jul 09 02:34:14.959464 ip-10-0-138-136 kubenswrapper[2583]: I0709 02:34:14.880628 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/1f563ddc813ab6d8fd08536b68d33fae-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-138-136.ec2.internal\" (UID: \"1f563ddc813ab6d8fd08536b68d33fae\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-138-136.ec2.internal" Jul 09 02:34:14.959464 ip-10-0-138-136 kubenswrapper[2583]: I0709 02:34:14.880646 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/host-path/04454d06c2f086e47f91e8c63bb8c939-config\") pod \"kube-apiserver-proxy-ip-10-0-138-136.ec2.internal\" (UID: \"04454d06c2f086e47f91e8c63bb8c939\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-138-136.ec2.internal" Jul 09 02:34:14.959464 ip-10-0-138-136 kubenswrapper[2583]: I0709 02:34:14.880665 2583 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/host-path/04454d06c2f086e47f91e8c63bb8c939-config\") pod \"kube-apiserver-proxy-ip-10-0-138-136.ec2.internal\" (UID: \"04454d06c2f086e47f91e8c63bb8c939\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-138-136.ec2.internal" Jul 09 02:34:14.959464 ip-10-0-138-136 kubenswrapper[2583]: I0709 02:34:14.880690 2583 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/1f563ddc813ab6d8fd08536b68d33fae-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-138-136.ec2.internal\" (UID: \"1f563ddc813ab6d8fd08536b68d33fae\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-138-136.ec2.internal" Jul 09 02:34:14.959464 ip-10-0-138-136 kubenswrapper[2583]: E0709 02:34:14.902636 2583 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-138-136.ec2.internal\" not found" Jul 09 02:34:15.103914 ip-10-0-138-136 kubenswrapper[2583]: E0709 02:34:15.003385 2583 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-138-136.ec2.internal\" not found" Jul 09 02:34:15.103914 ip-10-0-138-136 kubenswrapper[2583]: I0709 02:34:15.075541 2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-138-136.ec2.internal" Jul 09 02:34:15.103914 ip-10-0-138-136 kubenswrapper[2583]: I0709 02:34:15.080281 2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/kube-apiserver-proxy-ip-10-0-138-136.ec2.internal" Jul 09 02:34:15.103914 ip-10-0-138-136 kubenswrapper[2583]: E0709 02:34:15.103768 2583 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-138-136.ec2.internal\" not found" Jul 09 02:34:15.235475 ip-10-0-138-136 kubenswrapper[2583]: E0709 02:34:15.204235 2583 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-138-136.ec2.internal\" not found" Jul 09 02:34:15.398935 ip-10-0-138-136 kubenswrapper[2583]: E0709 02:34:15.304776 2583 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-138-136.ec2.internal\" not found" Jul 09 02:34:15.514756 ip-10-0-138-136 kubenswrapper[2583]: E0709 02:34:15.405240 2583 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-138-136.ec2.internal\" not found" Jul 09 02:34:15.514756 ip-10-0-138-136 kubenswrapper[2583]: I0709 02:34:15.409398 2583 transport.go:147] "Certificate rotation detected, shutting down client connections to start using new credentials" Jul 09 02:34:15.514756 ip-10-0-138-136 kubenswrapper[2583]: I0709 02:34:15.409515 2583 reflector.go:571] "Warning: watch ended with error" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.RuntimeClass" err="very short watch: k8s.io/client-go/informers/factory.go:160: Unexpected watch close - watch lasted less than a second and no items received" Jul 09 02:34:15.514756 ip-10-0-138-136 kubenswrapper[2583]: I0709 02:34:15.497751 2583 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kube-apiserver-client-kubelet" expiration="2028-07-08 02:29:15 +0000 UTC" deadline="2028-01-02 14:37:25.688319265 +0000 UTC" Jul 09 02:34:15.514756 ip-10-0-138-136 kubenswrapper[2583]: I0709 02:34:15.497772 2583 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kube-apiserver-client-kubelet" sleep="13020h3m10.19055012s" Jul 09 02:34:15.514756 ip-10-0-138-136 kubenswrapper[2583]: E0709 02:34:15.505971 2583 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-138-136.ec2.internal\" not found" Jul 09 02:34:15.622137 ip-10-0-138-136 kubenswrapper[2583]: E0709 02:34:15.606973 2583 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-138-136.ec2.internal\" not found" Jul 09 02:34:15.626295 ip-10-0-138-136 kubenswrapper[2583]: I0709 02:34:15.625811 2583 reflector.go:439] "Caches populated" type="*v1.Node" reflector="k8s.io/client-go/informers/factory.go:160" Jul 09 02:34:15.766085 ip-10-0-138-136 kubenswrapper[2583]: I0709 02:34:15.633835 2583 reflector.go:439] "Caches populated" type="*v1.Service" reflector="k8s.io/client-go/informers/factory.go:160" Jul 09 02:34:15.766085 ip-10-0-138-136 kubenswrapper[2583]: I0709 02:34:15.677682 2583 kubelet.go:3248] "Creating a mirror pod for static pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-138-136.ec2.internal" Jul 09 02:34:15.766085 ip-10-0-138-136 kubenswrapper[2583]: I0709 02:34:15.691519 2583 warnings.go:110] "Warning: metadata.name: this is used in the Pod's hostname, which can result in surprising behavior; a DNS label is recommended: [must not contain dots]" Jul 09 02:34:15.766085 ip-10-0-138-136 kubenswrapper[2583]: I0709 02:34:15.692368 2583 kubelet.go:3248] "Creating a mirror pod for static pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-138-136.ec2.internal" Jul 09 02:34:15.766085 ip-10-0-138-136 kubenswrapper[2583]: I0709 02:34:15.699155 2583 warnings.go:110] "Warning: metadata.name: this is used in the Pod's hostname, which can result in surprising behavior; a DNS label is recommended: [must not contain dots]" Jul 09 02:34:15.766085 ip-10-0-138-136 kubenswrapper[2583]: I0709 02:34:15.757889 2583 reflector.go:439] "Caches populated" type="*v1.CSIDriver" reflector="k8s.io/client-go/informers/factory.go:160" Jul 09 02:34:15.921331 ip-10-0-138-136 kubenswrapper[2583]: W0709 02:34:15.845294 2583 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod1f563ddc813ab6d8fd08536b68d33fae.slice/crio-687570c949baf16afa5ca4bd411dd90325cf1e69df196db0f571a981b674ddf8 WatchSource:0}: Error finding container 687570c949baf16afa5ca4bd411dd90325cf1e69df196db0f571a981b674ddf8: Status 404 returned error can't find the container with id 687570c949baf16afa5ca4bd411dd90325cf1e69df196db0f571a981b674ddf8 Jul 09 02:34:15.921331 ip-10-0-138-136 kubenswrapper[2583]: I0709 02:34:15.855035 2583 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider Jul 09 02:34:15.921331 ip-10-0-138-136 kubenswrapper[2583]: W0709 02:34:15.855911 2583 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod04454d06c2f086e47f91e8c63bb8c939.slice/crio-1787886eebf02faa92f70d3e97410a9a3680914a6626062f4022f01a163dde2e WatchSource:0}: Error finding container 1787886eebf02faa92f70d3e97410a9a3680914a6626062f4022f01a163dde2e: Status 404 returned error can't find the container with id 1787886eebf02faa92f70d3e97410a9a3680914a6626062f4022f01a163dde2e Jul 09 02:34:16.477465 ip-10-0-138-136 kubenswrapper[2583]: I0709 02:34:16.446863 2583 reflector.go:439] "Caches populated" type="*v1.RuntimeClass" reflector="k8s.io/client-go/informers/factory.go:160" Jul 09 02:34:16.477465 ip-10-0-138-136 kubenswrapper[2583]: I0709 02:34:16.452948 2583 apiserver.go:52] "Watching apiserver" Jul 09 02:34:16.477465 ip-10-0-138-136 kubenswrapper[2583]: I0709 02:34:16.459044 2583 reflector.go:439] "Caches populated" type="*v1.Pod" reflector="pkg/kubelet/config/apiserver.go:66" Jul 09 02:34:16.477465 ip-10-0-138-136 kubenswrapper[2583]: I0709 02:34:16.459372 2583 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-network-operator/iptables-alerter-hc45j","openshift-ovn-kubernetes/ovnkube-node-6gctz","kube-system/global-pull-secret-syncer-sv26w","kube-system/kube-apiserver-proxy-ip-10-0-138-136.ec2.internal","openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-6k6qn","openshift-dns/node-resolver-5mbtc","openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-138-136.ec2.internal","openshift-multus/multus-additional-cni-plugins-xx7bf","openshift-network-diagnostics/network-check-target-dkblh","kube-system/konnectivity-agent-gszbq","openshift-cluster-node-tuning-operator/tuned-npfjp","openshift-image-registry/node-ca-v86n2","openshift-multus/multus-q69lj","openshift-multus/network-metrics-daemon-rdtdt"] Jul 09 02:34:16.477465 ip-10-0-138-136 kubenswrapper[2583]: I0709 02:34:16.461915 2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/node-ca-v86n2" Jul 09 02:34:16.477465 ip-10-0-138-136 kubenswrapper[2583]: I0709 02:34:16.464207 2583 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"openshift-service-ca.crt\"" Jul 09 02:34:16.477465 ip-10-0-138-136 kubenswrapper[2583]: I0709 02:34:16.464289 2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ovn-kubernetes/ovnkube-node-6gctz" Jul 09 02:34:16.477465 ip-10-0-138-136 kubenswrapper[2583]: I0709 02:34:16.464425 2583 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"kube-root-ca.crt\"" Jul 09 02:34:16.477465 ip-10-0-138-136 kubenswrapper[2583]: I0709 02:34:16.464544 2583 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"image-registry-certificates\"" Jul 09 02:34:16.477465 ip-10-0-138-136 kubenswrapper[2583]: I0709 02:34:16.464628 2583 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"node-ca-dockercfg-mcvwv\"" Jul 09 02:34:16.477465 ip-10-0-138-136 kubenswrapper[2583]: I0709 02:34:16.466402 2583 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"ovnkube-script-lib\"" Jul 09 02:34:16.477465 ip-10-0-138-136 kubenswrapper[2583]: I0709 02:34:16.466528 2583 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"openshift-service-ca.crt\"" Jul 09 02:34:16.477465 ip-10-0-138-136 kubenswrapper[2583]: I0709 02:34:16.466537 2583 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"env-overrides\"" Jul 09 02:34:16.477465 ip-10-0-138-136 kubenswrapper[2583]: I0709 02:34:16.466639 2583 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ovn-kubernetes\"/\"ovn-kubernetes-node-dockercfg-z7zm5\"" Jul 09 02:34:16.477465 ip-10-0-138-136 kubenswrapper[2583]: I0709 02:34:16.466779 2583 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ovn-kubernetes\"/\"ovn-node-metrics-cert\"" Jul 09 02:34:16.477465 ip-10-0-138-136 kubenswrapper[2583]: I0709 02:34:16.466871 2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-sv26w" Jul 09 02:34:16.477465 ip-10-0-138-136 kubenswrapper[2583]: E0709 02:34:16.466950 2583 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-sv26w" podUID="4133cf72-5672-4d5e-b6dd-70e32b953216" Jul 09 02:34:16.477465 ip-10-0-138-136 kubenswrapper[2583]: I0709 02:34:16.466871 2583 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"kube-root-ca.crt\"" Jul 09 02:34:16.477465 ip-10-0-138-136 kubenswrapper[2583]: I0709 02:34:16.467067 2583 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"ovnkube-config\"" Jul 09 02:34:16.477465 ip-10-0-138-136 kubenswrapper[2583]: I0709 02:34:16.469090 2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-operator/iptables-alerter-hc45j" Jul 09 02:34:16.477465 ip-10-0-138-136 kubenswrapper[2583]: I0709 02:34:16.471156 2583 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"openshift-service-ca.crt\"" Jul 09 02:34:16.477465 ip-10-0-138-136 kubenswrapper[2583]: I0709 02:34:16.471196 2583 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"kube-root-ca.crt\"" Jul 09 02:34:16.477465 ip-10-0-138-136 kubenswrapper[2583]: I0709 02:34:16.471553 2583 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-operator\"/\"iptables-alerter-dockercfg-d8brb\"" Jul 09 02:34:16.477465 ip-10-0-138-136 kubenswrapper[2583]: I0709 02:34:16.471784 2583 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"iptables-alerter-script\"" Jul 09 02:34:16.477465 ip-10-0-138-136 kubenswrapper[2583]: I0709 02:34:16.473517 2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-6k6qn" Jul 09 02:34:16.477465 ip-10-0-138-136 kubenswrapper[2583]: I0709 02:34:16.475338 2583 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-csi-drivers\"/\"kube-root-ca.crt\"" Jul 09 02:34:16.477465 ip-10-0-138-136 kubenswrapper[2583]: I0709 02:34:16.475602 2583 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-csi-drivers\"/\"aws-ebs-csi-driver-node-metrics-serving-cert\"" Jul 09 02:34:16.477465 ip-10-0-138-136 kubenswrapper[2583]: I0709 02:34:16.475604 2583 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-csi-drivers\"/\"openshift-service-ca.crt\"" Jul 09 02:34:16.477465 ip-10-0-138-136 kubenswrapper[2583]: I0709 02:34:16.475862 2583 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-csi-drivers\"/\"aws-ebs-csi-driver-node-sa-dockercfg-66z7w\"" Jul 09 02:34:16.477465 ip-10-0-138-136 kubenswrapper[2583]: I0709 02:34:16.475974 2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-rdtdt" Jul 09 02:34:16.477465 ip-10-0-138-136 kubenswrapper[2583]: E0709 02:34:16.476036 2583 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-rdtdt" podUID="71cf0a89-d676-47f4-bf4a-d13d283493fc" Jul 09 02:34:16.479026 ip-10-0-138-136 kubenswrapper[2583]: I0709 02:34:16.478406 2583 certificate_manager.go:566] "Rotating certificates" logger="kubernetes.io/kubelet-serving" Jul 09 02:34:16.479026 ip-10-0-138-136 kubenswrapper[2583]: I0709 02:34:16.479002 2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-q69lj" Jul 09 02:34:16.488038 ip-10-0-138-136 kubenswrapper[2583]: I0709 02:34:16.481438 2583 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"openshift-service-ca.crt\"" Jul 09 02:34:16.488038 ip-10-0-138-136 kubenswrapper[2583]: I0709 02:34:16.481538 2583 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"multus-daemon-config\"" Jul 09 02:34:16.488038 ip-10-0-138-136 kubenswrapper[2583]: I0709 02:34:16.481654 2583 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"default-dockercfg-c8t7j\"" Jul 09 02:34:16.488038 ip-10-0-138-136 kubenswrapper[2583]: I0709 02:34:16.481688 2583 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"cni-copy-resources\"" Jul 09 02:34:16.488038 ip-10-0-138-136 kubenswrapper[2583]: I0709 02:34:16.481745 2583 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"kube-root-ca.crt\"" Jul 09 02:34:16.488038 ip-10-0-138-136 kubenswrapper[2583]: I0709 02:34:16.483061 2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-additional-cni-plugins-xx7bf" Jul 09 02:34:16.488038 ip-10-0-138-136 kubenswrapper[2583]: I0709 02:34:16.485251 2583 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"whereabouts-flatfile-config\"" Jul 09 02:34:16.488038 ip-10-0-138-136 kubenswrapper[2583]: I0709 02:34:16.485743 2583 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"multus-ancillary-tools-dockercfg-fwrm6\"" Jul 09 02:34:16.488038 ip-10-0-138-136 kubenswrapper[2583]: I0709 02:34:16.486056 2583 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"default-cni-sysctl-allowlist\"" Jul 09 02:34:16.488038 ip-10-0-138-136 kubenswrapper[2583]: I0709 02:34:16.487792 2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-dkblh" Jul 09 02:34:16.489707 ip-10-0-138-136 kubenswrapper[2583]: I0709 02:34:16.488275 2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/ab715167-aa61-46be-bbe1-36212c9aa180-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-6gctz\" (UID: \"ab715167-aa61-46be-bbe1-36212c9aa180\") " pod="openshift-ovn-kubernetes/ovnkube-node-6gctz" Jul 09 02:34:16.489707 ip-10-0-138-136 kubenswrapper[2583]: I0709 02:34:16.488317 2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/4133cf72-5672-4d5e-b6dd-70e32b953216-kubelet-config\") pod \"global-pull-secret-syncer-sv26w\" (UID: \"4133cf72-5672-4d5e-b6dd-70e32b953216\") " pod="kube-system/global-pull-secret-syncer-sv26w" Jul 09 02:34:16.489707 ip-10-0-138-136 kubenswrapper[2583]: I0709 02:34:16.488352 2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/9b793225-5bd6-4bf7-a87e-d42bf8c939f7-os-release\") pod \"multus-q69lj\" (UID: \"9b793225-5bd6-4bf7-a87e-d42bf8c939f7\") " pod="openshift-multus/multus-q69lj" Jul 09 02:34:16.489707 ip-10-0-138-136 kubenswrapper[2583]: I0709 02:34:16.488385 2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/9b793225-5bd6-4bf7-a87e-d42bf8c939f7-host-var-lib-cni-bin\") pod \"multus-q69lj\" (UID: \"9b793225-5bd6-4bf7-a87e-d42bf8c939f7\") " pod="openshift-multus/multus-q69lj" Jul 09 02:34:16.489707 ip-10-0-138-136 kubenswrapper[2583]: I0709 02:34:16.488416 2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/9b793225-5bd6-4bf7-a87e-d42bf8c939f7-multus-conf-dir\") pod \"multus-q69lj\" (UID: \"9b793225-5bd6-4bf7-a87e-d42bf8c939f7\") " pod="openshift-multus/multus-q69lj" Jul 09 02:34:16.489707 ip-10-0-138-136 kubenswrapper[2583]: I0709 02:34:16.488445 2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-4szpd\" (UniqueName: \"kubernetes.io/projected/9b793225-5bd6-4bf7-a87e-d42bf8c939f7-kube-api-access-4szpd\") pod \"multus-q69lj\" (UID: \"9b793225-5bd6-4bf7-a87e-d42bf8c939f7\") " pod="openshift-multus/multus-q69lj" Jul 09 02:34:16.489707 ip-10-0-138-136 kubenswrapper[2583]: I0709 02:34:16.488910 2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/ab715167-aa61-46be-bbe1-36212c9aa180-env-overrides\") pod \"ovnkube-node-6gctz\" (UID: \"ab715167-aa61-46be-bbe1-36212c9aa180\") " pod="openshift-ovn-kubernetes/ovnkube-node-6gctz" Jul 09 02:34:16.489707 ip-10-0-138-136 kubenswrapper[2583]: I0709 02:34:16.488964 2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/9b793225-5bd6-4bf7-a87e-d42bf8c939f7-multus-socket-dir-parent\") pod \"multus-q69lj\" (UID: \"9b793225-5bd6-4bf7-a87e-d42bf8c939f7\") " pod="openshift-multus/multus-q69lj" Jul 09 02:34:16.489707 ip-10-0-138-136 kubenswrapper[2583]: E0709 02:34:16.488970 2583 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-dkblh" podUID="d9f05741-1f97-4987-8158-4dbad6b22987" Jul 09 02:34:16.489707 ip-10-0-138-136 kubenswrapper[2583]: I0709 02:34:16.488993 2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/ab715167-aa61-46be-bbe1-36212c9aa180-var-lib-openvswitch\") pod \"ovnkube-node-6gctz\" (UID: \"ab715167-aa61-46be-bbe1-36212c9aa180\") " pod="openshift-ovn-kubernetes/ovnkube-node-6gctz" Jul 09 02:34:16.489707 ip-10-0-138-136 kubenswrapper[2583]: I0709 02:34:16.489021 2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/9b793225-5bd6-4bf7-a87e-d42bf8c939f7-cnibin\") pod \"multus-q69lj\" (UID: \"9b793225-5bd6-4bf7-a87e-d42bf8c939f7\") " pod="openshift-multus/multus-q69lj" Jul 09 02:34:16.489707 ip-10-0-138-136 kubenswrapper[2583]: I0709 02:34:16.489044 2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/9b793225-5bd6-4bf7-a87e-d42bf8c939f7-host-run-k8s-cni-cncf-io\") pod \"multus-q69lj\" (UID: \"9b793225-5bd6-4bf7-a87e-d42bf8c939f7\") " pod="openshift-multus/multus-q69lj" Jul 09 02:34:16.489707 ip-10-0-138-136 kubenswrapper[2583]: I0709 02:34:16.489075 2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/9b793225-5bd6-4bf7-a87e-d42bf8c939f7-host-run-netns\") pod \"multus-q69lj\" (UID: \"9b793225-5bd6-4bf7-a87e-d42bf8c939f7\") " pod="openshift-multus/multus-q69lj" Jul 09 02:34:16.489707 ip-10-0-138-136 kubenswrapper[2583]: I0709 02:34:16.489098 2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/d507ebdd-e329-4392-986f-54b792047f9a-etc-selinux\") pod \"aws-ebs-csi-driver-node-6k6qn\" (UID: \"d507ebdd-e329-4392-986f-54b792047f9a\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-6k6qn" Jul 09 02:34:16.489707 ip-10-0-138-136 kubenswrapper[2583]: I0709 02:34:16.489182 2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/9b793225-5bd6-4bf7-a87e-d42bf8c939f7-host-run-multus-certs\") pod \"multus-q69lj\" (UID: \"9b793225-5bd6-4bf7-a87e-d42bf8c939f7\") " pod="openshift-multus/multus-q69lj" Jul 09 02:34:16.489707 ip-10-0-138-136 kubenswrapper[2583]: I0709 02:34:16.489235 2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/ab715167-aa61-46be-bbe1-36212c9aa180-host-run-netns\") pod \"ovnkube-node-6gctz\" (UID: \"ab715167-aa61-46be-bbe1-36212c9aa180\") " pod="openshift-ovn-kubernetes/ovnkube-node-6gctz" Jul 09 02:34:16.490669 ip-10-0-138-136 kubenswrapper[2583]: I0709 02:34:16.489262 2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/34d08b11-e4c1-4bc4-bd00-2cbfc1720242-host-slash\") pod \"iptables-alerter-hc45j\" (UID: \"34d08b11-e4c1-4bc4-bd00-2cbfc1720242\") " pod="openshift-network-operator/iptables-alerter-hc45j" Jul 09 02:34:16.490669 ip-10-0-138-136 kubenswrapper[2583]: I0709 02:34:16.489287 2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/d507ebdd-e329-4392-986f-54b792047f9a-kubelet-dir\") pod \"aws-ebs-csi-driver-node-6k6qn\" (UID: \"d507ebdd-e329-4392-986f-54b792047f9a\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-6k6qn" Jul 09 02:34:16.490669 ip-10-0-138-136 kubenswrapper[2583]: I0709 02:34:16.489312 2583 reflector.go:439] "Caches populated" logger="kubernetes.io/kubelet-serving" type="*v1.CertificateSigningRequest" reflector="k8s.io/client-go/tools/watch/informerwatcher.go:162" Jul 09 02:34:16.490669 ip-10-0-138-136 kubenswrapper[2583]: I0709 02:34:16.489315 2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/d507ebdd-e329-4392-986f-54b792047f9a-sys-fs\") pod \"aws-ebs-csi-driver-node-6k6qn\" (UID: \"d507ebdd-e329-4392-986f-54b792047f9a\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-6k6qn" Jul 09 02:34:16.490669 ip-10-0-138-136 kubenswrapper[2583]: I0709 02:34:16.489397 2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/9b793225-5bd6-4bf7-a87e-d42bf8c939f7-host-var-lib-cni-multus\") pod \"multus-q69lj\" (UID: \"9b793225-5bd6-4bf7-a87e-d42bf8c939f7\") " pod="openshift-multus/multus-q69lj" Jul 09 02:34:16.490669 ip-10-0-138-136 kubenswrapper[2583]: I0709 02:34:16.489433 2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/9b793225-5bd6-4bf7-a87e-d42bf8c939f7-etc-kubernetes\") pod \"multus-q69lj\" (UID: \"9b793225-5bd6-4bf7-a87e-d42bf8c939f7\") " pod="openshift-multus/multus-q69lj" Jul 09 02:34:16.490669 ip-10-0-138-136 kubenswrapper[2583]: I0709 02:34:16.489482 2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/ab715167-aa61-46be-bbe1-36212c9aa180-run-ovn\") pod \"ovnkube-node-6gctz\" (UID: \"ab715167-aa61-46be-bbe1-36212c9aa180\") " pod="openshift-ovn-kubernetes/ovnkube-node-6gctz" Jul 09 02:34:16.490669 ip-10-0-138-136 kubenswrapper[2583]: I0709 02:34:16.489517 2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/ab715167-aa61-46be-bbe1-36212c9aa180-log-socket\") pod \"ovnkube-node-6gctz\" (UID: \"ab715167-aa61-46be-bbe1-36212c9aa180\") " pod="openshift-ovn-kubernetes/ovnkube-node-6gctz" Jul 09 02:34:16.490669 ip-10-0-138-136 kubenswrapper[2583]: I0709 02:34:16.489555 2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/4133cf72-5672-4d5e-b6dd-70e32b953216-original-pull-secret\") pod \"global-pull-secret-syncer-sv26w\" (UID: \"4133cf72-5672-4d5e-b6dd-70e32b953216\") " pod="kube-system/global-pull-secret-syncer-sv26w" Jul 09 02:34:16.490669 ip-10-0-138-136 kubenswrapper[2583]: I0709 02:34:16.489595 2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/d507ebdd-e329-4392-986f-54b792047f9a-socket-dir\") pod \"aws-ebs-csi-driver-node-6k6qn\" (UID: \"d507ebdd-e329-4392-986f-54b792047f9a\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-6k6qn" Jul 09 02:34:16.490669 ip-10-0-138-136 kubenswrapper[2583]: I0709 02:34:16.489627 2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-fgpjj\" (UniqueName: \"kubernetes.io/projected/d507ebdd-e329-4392-986f-54b792047f9a-kube-api-access-fgpjj\") pod \"aws-ebs-csi-driver-node-6k6qn\" (UID: \"d507ebdd-e329-4392-986f-54b792047f9a\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-6k6qn" Jul 09 02:34:16.490669 ip-10-0-138-136 kubenswrapper[2583]: I0709 02:34:16.489709 2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/9b793225-5bd6-4bf7-a87e-d42bf8c939f7-hostroot\") pod \"multus-q69lj\" (UID: \"9b793225-5bd6-4bf7-a87e-d42bf8c939f7\") " pod="openshift-multus/multus-q69lj" Jul 09 02:34:16.490669 ip-10-0-138-136 kubenswrapper[2583]: I0709 02:34:16.489774 2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/d507ebdd-e329-4392-986f-54b792047f9a-device-dir\") pod \"aws-ebs-csi-driver-node-6k6qn\" (UID: \"d507ebdd-e329-4392-986f-54b792047f9a\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-6k6qn" Jul 09 02:34:16.490669 ip-10-0-138-136 kubenswrapper[2583]: I0709 02:34:16.489815 2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/9b793225-5bd6-4bf7-a87e-d42bf8c939f7-host-var-lib-kubelet\") pod \"multus-q69lj\" (UID: \"9b793225-5bd6-4bf7-a87e-d42bf8c939f7\") " pod="openshift-multus/multus-q69lj" Jul 09 02:34:16.490669 ip-10-0-138-136 kubenswrapper[2583]: I0709 02:34:16.489851 2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/ab715167-aa61-46be-bbe1-36212c9aa180-run-systemd\") pod \"ovnkube-node-6gctz\" (UID: \"ab715167-aa61-46be-bbe1-36212c9aa180\") " pod="openshift-ovn-kubernetes/ovnkube-node-6gctz" Jul 09 02:34:16.490669 ip-10-0-138-136 kubenswrapper[2583]: I0709 02:34:16.489876 2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-dvv5s\" (UniqueName: \"kubernetes.io/projected/ab715167-aa61-46be-bbe1-36212c9aa180-kube-api-access-dvv5s\") pod \"ovnkube-node-6gctz\" (UID: \"ab715167-aa61-46be-bbe1-36212c9aa180\") " pod="openshift-ovn-kubernetes/ovnkube-node-6gctz" Jul 09 02:34:16.490669 ip-10-0-138-136 kubenswrapper[2583]: I0709 02:34:16.489900 2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/9b793225-5bd6-4bf7-a87e-d42bf8c939f7-cni-binary-copy\") pod \"multus-q69lj\" (UID: \"9b793225-5bd6-4bf7-a87e-d42bf8c939f7\") " pod="openshift-multus/multus-q69lj" Jul 09 02:34:16.492576 ip-10-0-138-136 kubenswrapper[2583]: I0709 02:34:16.489923 2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-74bf5\" (UniqueName: \"kubernetes.io/projected/6cdfd2a0-46af-4734-9735-7408f8439c96-kube-api-access-74bf5\") pod \"node-ca-v86n2\" (UID: \"6cdfd2a0-46af-4734-9735-7408f8439c96\") " pod="openshift-image-registry/node-ca-v86n2" Jul 09 02:34:16.492576 ip-10-0-138-136 kubenswrapper[2583]: I0709 02:34:16.489953 2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/ab715167-aa61-46be-bbe1-36212c9aa180-systemd-units\") pod \"ovnkube-node-6gctz\" (UID: \"ab715167-aa61-46be-bbe1-36212c9aa180\") " pod="openshift-ovn-kubernetes/ovnkube-node-6gctz" Jul 09 02:34:16.492576 ip-10-0-138-136 kubenswrapper[2583]: I0709 02:34:16.490033 2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/ab715167-aa61-46be-bbe1-36212c9aa180-node-log\") pod \"ovnkube-node-6gctz\" (UID: \"ab715167-aa61-46be-bbe1-36212c9aa180\") " pod="openshift-ovn-kubernetes/ovnkube-node-6gctz" Jul 09 02:34:16.492576 ip-10-0-138-136 kubenswrapper[2583]: I0709 02:34:16.490071 2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/9b793225-5bd6-4bf7-a87e-d42bf8c939f7-multus-daemon-config\") pod \"multus-q69lj\" (UID: \"9b793225-5bd6-4bf7-a87e-d42bf8c939f7\") " pod="openshift-multus/multus-q69lj" Jul 09 02:34:16.492576 ip-10-0-138-136 kubenswrapper[2583]: I0709 02:34:16.490118 2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/ab715167-aa61-46be-bbe1-36212c9aa180-etc-openvswitch\") pod \"ovnkube-node-6gctz\" (UID: \"ab715167-aa61-46be-bbe1-36212c9aa180\") " pod="openshift-ovn-kubernetes/ovnkube-node-6gctz" Jul 09 02:34:16.492576 ip-10-0-138-136 kubenswrapper[2583]: I0709 02:34:16.490167 2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/ab715167-aa61-46be-bbe1-36212c9aa180-run-openvswitch\") pod \"ovnkube-node-6gctz\" (UID: \"ab715167-aa61-46be-bbe1-36212c9aa180\") " pod="openshift-ovn-kubernetes/ovnkube-node-6gctz" Jul 09 02:34:16.492576 ip-10-0-138-136 kubenswrapper[2583]: I0709 02:34:16.490193 2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/6cdfd2a0-46af-4734-9735-7408f8439c96-serviceca\") pod \"node-ca-v86n2\" (UID: \"6cdfd2a0-46af-4734-9735-7408f8439c96\") " pod="openshift-image-registry/node-ca-v86n2" Jul 09 02:34:16.492576 ip-10-0-138-136 kubenswrapper[2583]: I0709 02:34:16.490217 2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/ab715167-aa61-46be-bbe1-36212c9aa180-host-slash\") pod \"ovnkube-node-6gctz\" (UID: \"ab715167-aa61-46be-bbe1-36212c9aa180\") " pod="openshift-ovn-kubernetes/ovnkube-node-6gctz" Jul 09 02:34:16.492576 ip-10-0-138-136 kubenswrapper[2583]: I0709 02:34:16.490242 2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/ab715167-aa61-46be-bbe1-36212c9aa180-host-cni-bin\") pod \"ovnkube-node-6gctz\" (UID: \"ab715167-aa61-46be-bbe1-36212c9aa180\") " pod="openshift-ovn-kubernetes/ovnkube-node-6gctz" Jul 09 02:34:16.492576 ip-10-0-138-136 kubenswrapper[2583]: I0709 02:34:16.490266 2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/ab715167-aa61-46be-bbe1-36212c9aa180-host-cni-netd\") pod \"ovnkube-node-6gctz\" (UID: \"ab715167-aa61-46be-bbe1-36212c9aa180\") " pod="openshift-ovn-kubernetes/ovnkube-node-6gctz" Jul 09 02:34:16.492576 ip-10-0-138-136 kubenswrapper[2583]: I0709 02:34:16.490295 2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/ab715167-aa61-46be-bbe1-36212c9aa180-ovnkube-script-lib\") pod \"ovnkube-node-6gctz\" (UID: \"ab715167-aa61-46be-bbe1-36212c9aa180\") " pod="openshift-ovn-kubernetes/ovnkube-node-6gctz" Jul 09 02:34:16.492576 ip-10-0-138-136 kubenswrapper[2583]: I0709 02:34:16.490312 2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/4133cf72-5672-4d5e-b6dd-70e32b953216-dbus\") pod \"global-pull-secret-syncer-sv26w\" (UID: \"4133cf72-5672-4d5e-b6dd-70e32b953216\") " pod="kube-system/global-pull-secret-syncer-sv26w" Jul 09 02:34:16.492576 ip-10-0-138-136 kubenswrapper[2583]: I0709 02:34:16.490344 2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/9b793225-5bd6-4bf7-a87e-d42bf8c939f7-multus-cni-dir\") pod \"multus-q69lj\" (UID: \"9b793225-5bd6-4bf7-a87e-d42bf8c939f7\") " pod="openshift-multus/multus-q69lj" Jul 09 02:34:16.492576 ip-10-0-138-136 kubenswrapper[2583]: I0709 02:34:16.490375 2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-89s4s\" (UniqueName: \"kubernetes.io/projected/71cf0a89-d676-47f4-bf4a-d13d283493fc-kube-api-access-89s4s\") pod \"network-metrics-daemon-rdtdt\" (UID: \"71cf0a89-d676-47f4-bf4a-d13d283493fc\") " pod="openshift-multus/network-metrics-daemon-rdtdt" Jul 09 02:34:16.492576 ip-10-0-138-136 kubenswrapper[2583]: I0709 02:34:16.490399 2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/6cdfd2a0-46af-4734-9735-7408f8439c96-host\") pod \"node-ca-v86n2\" (UID: \"6cdfd2a0-46af-4734-9735-7408f8439c96\") " pod="openshift-image-registry/node-ca-v86n2" Jul 09 02:34:16.492576 ip-10-0-138-136 kubenswrapper[2583]: I0709 02:34:16.490427 2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/ab715167-aa61-46be-bbe1-36212c9aa180-host-kubelet\") pod \"ovnkube-node-6gctz\" (UID: \"ab715167-aa61-46be-bbe1-36212c9aa180\") " pod="openshift-ovn-kubernetes/ovnkube-node-6gctz" Jul 09 02:34:16.492576 ip-10-0-138-136 kubenswrapper[2583]: I0709 02:34:16.490455 2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/ab715167-aa61-46be-bbe1-36212c9aa180-ovnkube-config\") pod \"ovnkube-node-6gctz\" (UID: \"ab715167-aa61-46be-bbe1-36212c9aa180\") " pod="openshift-ovn-kubernetes/ovnkube-node-6gctz" Jul 09 02:34:16.493558 ip-10-0-138-136 kubenswrapper[2583]: I0709 02:34:16.490483 2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-zsmfw\" (UniqueName: \"kubernetes.io/projected/34d08b11-e4c1-4bc4-bd00-2cbfc1720242-kube-api-access-zsmfw\") pod \"iptables-alerter-hc45j\" (UID: \"34d08b11-e4c1-4bc4-bd00-2cbfc1720242\") " pod="openshift-network-operator/iptables-alerter-hc45j" Jul 09 02:34:16.493558 ip-10-0-138-136 kubenswrapper[2583]: I0709 02:34:16.490505 2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/d507ebdd-e329-4392-986f-54b792047f9a-registration-dir\") pod \"aws-ebs-csi-driver-node-6k6qn\" (UID: \"d507ebdd-e329-4392-986f-54b792047f9a\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-6k6qn" Jul 09 02:34:16.493558 ip-10-0-138-136 kubenswrapper[2583]: I0709 02:34:16.490540 2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/71cf0a89-d676-47f4-bf4a-d13d283493fc-metrics-certs\") pod \"network-metrics-daemon-rdtdt\" (UID: \"71cf0a89-d676-47f4-bf4a-d13d283493fc\") " pod="openshift-multus/network-metrics-daemon-rdtdt" Jul 09 02:34:16.493558 ip-10-0-138-136 kubenswrapper[2583]: I0709 02:34:16.490567 2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/ab715167-aa61-46be-bbe1-36212c9aa180-ovn-node-metrics-cert\") pod \"ovnkube-node-6gctz\" (UID: \"ab715167-aa61-46be-bbe1-36212c9aa180\") " pod="openshift-ovn-kubernetes/ovnkube-node-6gctz" Jul 09 02:34:16.493558 ip-10-0-138-136 kubenswrapper[2583]: I0709 02:34:16.490594 2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/34d08b11-e4c1-4bc4-bd00-2cbfc1720242-iptables-alerter-script\") pod \"iptables-alerter-hc45j\" (UID: \"34d08b11-e4c1-4bc4-bd00-2cbfc1720242\") " pod="openshift-network-operator/iptables-alerter-hc45j" Jul 09 02:34:16.493558 ip-10-0-138-136 kubenswrapper[2583]: I0709 02:34:16.490620 2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/ab715167-aa61-46be-bbe1-36212c9aa180-host-run-ovn-kubernetes\") pod \"ovnkube-node-6gctz\" (UID: \"ab715167-aa61-46be-bbe1-36212c9aa180\") " pod="openshift-ovn-kubernetes/ovnkube-node-6gctz" Jul 09 02:34:16.493558 ip-10-0-138-136 kubenswrapper[2583]: I0709 02:34:16.490647 2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/9b793225-5bd6-4bf7-a87e-d42bf8c939f7-system-cni-dir\") pod \"multus-q69lj\" (UID: \"9b793225-5bd6-4bf7-a87e-d42bf8c939f7\") " pod="openshift-multus/multus-q69lj" Jul 09 02:34:16.493558 ip-10-0-138-136 kubenswrapper[2583]: I0709 02:34:16.490863 2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/konnectivity-agent-gszbq" Jul 09 02:34:16.493558 ip-10-0-138-136 kubenswrapper[2583]: I0709 02:34:16.492922 2583 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kube-system\"/\"konnectivity-ca-bundle\"" Jul 09 02:34:16.493558 ip-10-0-138-136 kubenswrapper[2583]: I0709 02:34:16.492974 2583 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"default-dockercfg-mdm85\"" Jul 09 02:34:16.493558 ip-10-0-138-136 kubenswrapper[2583]: I0709 02:34:16.493082 2583 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"konnectivity-agent\"" Jul 09 02:34:16.495885 ip-10-0-138-136 kubenswrapper[2583]: I0709 02:34:16.493800 2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-node-tuning-operator/tuned-npfjp" Jul 09 02:34:16.495885 ip-10-0-138-136 kubenswrapper[2583]: I0709 02:34:16.495654 2583 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"openshift-service-ca.crt\"" Jul 09 02:34:16.495885 ip-10-0-138-136 kubenswrapper[2583]: I0709 02:34:16.495824 2583 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"tuned-dockercfg-d67tq\"" Jul 09 02:34:16.500566 ip-10-0-138-136 kubenswrapper[2583]: I0709 02:34:16.496174 2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/node-resolver-5mbtc" Jul 09 02:34:16.500566 ip-10-0-138-136 kubenswrapper[2583]: I0709 02:34:16.496246 2583 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"kube-root-ca.crt\"" Jul 09 02:34:16.500566 ip-10-0-138-136 kubenswrapper[2583]: I0709 02:34:16.498060 2583 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"kube-root-ca.crt\"" Jul 09 02:34:16.500566 ip-10-0-138-136 kubenswrapper[2583]: I0709 02:34:16.498077 2583 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"openshift-service-ca.crt\"" Jul 09 02:34:16.500566 ip-10-0-138-136 kubenswrapper[2583]: I0709 02:34:16.498351 2583 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"node-resolver-dockercfg-ftqjs\"" Jul 09 02:34:16.580807 ip-10-0-138-136 kubenswrapper[2583]: I0709 02:34:16.510055 2583 csr.go:274] "Certificate signing request is approved, waiting to be issued" logger="kubernetes.io/kubelet-serving" csr="csr-2c5xc" Jul 09 02:34:16.580807 ip-10-0-138-136 kubenswrapper[2583]: I0709 02:34:16.518399 2583 csr.go:270] "Certificate signing request is issued" logger="kubernetes.io/kubelet-serving" csr="csr-2c5xc" Jul 09 02:34:16.580807 ip-10-0-138-136 kubenswrapper[2583]: I0709 02:34:16.579095 2583 desired_state_of_world_populator.go:154] "Finished populating initial desired state of world" Jul 09 02:34:16.591261 ip-10-0-138-136 kubenswrapper[2583]: I0709 02:34:16.590845 2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-dmqxq\" (UniqueName: \"kubernetes.io/projected/45541338-f2aa-4712-ba6f-8924e3513372-kube-api-access-dmqxq\") pod \"node-resolver-5mbtc\" (UID: \"45541338-f2aa-4712-ba6f-8924e3513372\") " pod="openshift-dns/node-resolver-5mbtc" Jul 09 02:34:16.591261 ip-10-0-138-136 kubenswrapper[2583]: I0709 02:34:16.590894 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/d507ebdd-e329-4392-986f-54b792047f9a-registration-dir\") pod \"aws-ebs-csi-driver-node-6k6qn\" (UID: \"d507ebdd-e329-4392-986f-54b792047f9a\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-6k6qn" Jul 09 02:34:16.591261 ip-10-0-138-136 kubenswrapper[2583]: I0709 02:34:16.590945 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/71cf0a89-d676-47f4-bf4a-d13d283493fc-metrics-certs\") pod \"network-metrics-daemon-rdtdt\" (UID: \"71cf0a89-d676-47f4-bf4a-d13d283493fc\") " pod="openshift-multus/network-metrics-daemon-rdtdt" Jul 09 02:34:16.591261 ip-10-0-138-136 kubenswrapper[2583]: I0709 02:34:16.590971 2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run\" (UniqueName: \"kubernetes.io/host-path/337d4063-36cf-4452-a1d3-4573f2517730-run\") pod \"tuned-npfjp\" (UID: \"337d4063-36cf-4452-a1d3-4573f2517730\") " pod="openshift-cluster-node-tuning-operator/tuned-npfjp" Jul 09 02:34:16.591261 ip-10-0-138-136 kubenswrapper[2583]: I0709 02:34:16.590997 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/ab715167-aa61-46be-bbe1-36212c9aa180-ovn-node-metrics-cert\") pod \"ovnkube-node-6gctz\" (UID: \"ab715167-aa61-46be-bbe1-36212c9aa180\") " pod="openshift-ovn-kubernetes/ovnkube-node-6gctz" Jul 09 02:34:16.591261 ip-10-0-138-136 kubenswrapper[2583]: I0709 02:34:16.591022 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/34d08b11-e4c1-4bc4-bd00-2cbfc1720242-iptables-alerter-script\") pod \"iptables-alerter-hc45j\" (UID: \"34d08b11-e4c1-4bc4-bd00-2cbfc1720242\") " pod="openshift-network-operator/iptables-alerter-hc45j" Jul 09 02:34:16.591261 ip-10-0-138-136 kubenswrapper[2583]: I0709 02:34:16.591025 2583 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/d507ebdd-e329-4392-986f-54b792047f9a-registration-dir\") pod \"aws-ebs-csi-driver-node-6k6qn\" (UID: \"d507ebdd-e329-4392-986f-54b792047f9a\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-6k6qn" Jul 09 02:34:16.591261 ip-10-0-138-136 kubenswrapper[2583]: I0709 02:34:16.591044 2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/337d4063-36cf-4452-a1d3-4573f2517730-sys\") pod \"tuned-npfjp\" (UID: \"337d4063-36cf-4452-a1d3-4573f2517730\") " pod="openshift-cluster-node-tuning-operator/tuned-npfjp" Jul 09 02:34:16.591261 ip-10-0-138-136 kubenswrapper[2583]: I0709 02:34:16.591070 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/ab715167-aa61-46be-bbe1-36212c9aa180-host-run-ovn-kubernetes\") pod \"ovnkube-node-6gctz\" (UID: \"ab715167-aa61-46be-bbe1-36212c9aa180\") " pod="openshift-ovn-kubernetes/ovnkube-node-6gctz" Jul 09 02:34:16.591261 ip-10-0-138-136 kubenswrapper[2583]: I0709 02:34:16.591093 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/9b793225-5bd6-4bf7-a87e-d42bf8c939f7-system-cni-dir\") pod \"multus-q69lj\" (UID: \"9b793225-5bd6-4bf7-a87e-d42bf8c939f7\") " pod="openshift-multus/multus-q69lj" Jul 09 02:34:16.591261 ip-10-0-138-136 kubenswrapper[2583]: I0709 02:34:16.591115 2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/337d4063-36cf-4452-a1d3-4573f2517730-etc-sysctl-d\") pod \"tuned-npfjp\" (UID: \"337d4063-36cf-4452-a1d3-4573f2517730\") " pod="openshift-cluster-node-tuning-operator/tuned-npfjp" Jul 09 02:34:16.591261 ip-10-0-138-136 kubenswrapper[2583]: I0709 02:34:16.591143 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/ab715167-aa61-46be-bbe1-36212c9aa180-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-6gctz\" (UID: \"ab715167-aa61-46be-bbe1-36212c9aa180\") " pod="openshift-ovn-kubernetes/ovnkube-node-6gctz" Jul 09 02:34:16.591261 ip-10-0-138-136 kubenswrapper[2583]: E0709 02:34:16.591167 2583 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jul 09 02:34:16.591261 ip-10-0-138-136 kubenswrapper[2583]: I0709 02:34:16.591178 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/4133cf72-5672-4d5e-b6dd-70e32b953216-kubelet-config\") pod \"global-pull-secret-syncer-sv26w\" (UID: \"4133cf72-5672-4d5e-b6dd-70e32b953216\") " pod="kube-system/global-pull-secret-syncer-sv26w" Jul 09 02:34:16.591261 ip-10-0-138-136 kubenswrapper[2583]: I0709 02:34:16.591204 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/9b793225-5bd6-4bf7-a87e-d42bf8c939f7-os-release\") pod \"multus-q69lj\" (UID: \"9b793225-5bd6-4bf7-a87e-d42bf8c939f7\") " pod="openshift-multus/multus-q69lj" Jul 09 02:34:16.591261 ip-10-0-138-136 kubenswrapper[2583]: E0709 02:34:16.591235 2583 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/71cf0a89-d676-47f4-bf4a-d13d283493fc-metrics-certs podName:71cf0a89-d676-47f4-bf4a-d13d283493fc nodeName:}" failed. No retries permitted until 2026-07-09 02:34:17.091213799 +0000 UTC m=+3.023671287 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/71cf0a89-d676-47f4-bf4a-d13d283493fc-metrics-certs") pod "network-metrics-daemon-rdtdt" (UID: "71cf0a89-d676-47f4-bf4a-d13d283493fc") : object "openshift-multus"/"metrics-daemon-secret" not registered Jul 09 02:34:16.591261 ip-10-0-138-136 kubenswrapper[2583]: I0709 02:34:16.591254 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/9b793225-5bd6-4bf7-a87e-d42bf8c939f7-host-var-lib-cni-bin\") pod \"multus-q69lj\" (UID: \"9b793225-5bd6-4bf7-a87e-d42bf8c939f7\") " pod="openshift-multus/multus-q69lj" Jul 09 02:34:16.597306 ip-10-0-138-136 kubenswrapper[2583]: I0709 02:34:16.591278 2583 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/9b793225-5bd6-4bf7-a87e-d42bf8c939f7-os-release\") pod \"multus-q69lj\" (UID: \"9b793225-5bd6-4bf7-a87e-d42bf8c939f7\") " pod="openshift-multus/multus-q69lj" Jul 09 02:34:16.597306 ip-10-0-138-136 kubenswrapper[2583]: I0709 02:34:16.591281 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/9b793225-5bd6-4bf7-a87e-d42bf8c939f7-multus-conf-dir\") pod \"multus-q69lj\" (UID: \"9b793225-5bd6-4bf7-a87e-d42bf8c939f7\") " pod="openshift-multus/multus-q69lj" Jul 09 02:34:16.597306 ip-10-0-138-136 kubenswrapper[2583]: I0709 02:34:16.591306 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-4szpd\" (UniqueName: \"kubernetes.io/projected/9b793225-5bd6-4bf7-a87e-d42bf8c939f7-kube-api-access-4szpd\") pod \"multus-q69lj\" (UID: \"9b793225-5bd6-4bf7-a87e-d42bf8c939f7\") " pod="openshift-multus/multus-q69lj" Jul 09 02:34:16.597306 ip-10-0-138-136 kubenswrapper[2583]: I0709 02:34:16.591590 2583 swap_util.go:74] "error creating dir to test if tmpfs noswap is enabled. Assuming not supported" mount path="" error="stat /var/lib/kubelet/plugins/kubernetes.io/empty-dir: no such file or directory" Jul 09 02:34:16.597306 ip-10-0-138-136 kubenswrapper[2583]: I0709 02:34:16.591673 2583 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/9b793225-5bd6-4bf7-a87e-d42bf8c939f7-host-var-lib-cni-bin\") pod \"multus-q69lj\" (UID: \"9b793225-5bd6-4bf7-a87e-d42bf8c939f7\") " pod="openshift-multus/multus-q69lj" Jul 09 02:34:16.597306 ip-10-0-138-136 kubenswrapper[2583]: I0709 02:34:16.591717 2583 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/9b793225-5bd6-4bf7-a87e-d42bf8c939f7-multus-conf-dir\") pod \"multus-q69lj\" (UID: \"9b793225-5bd6-4bf7-a87e-d42bf8c939f7\") " pod="openshift-multus/multus-q69lj" Jul 09 02:34:16.597306 ip-10-0-138-136 kubenswrapper[2583]: I0709 02:34:16.591774 2583 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/9b793225-5bd6-4bf7-a87e-d42bf8c939f7-system-cni-dir\") pod \"multus-q69lj\" (UID: \"9b793225-5bd6-4bf7-a87e-d42bf8c939f7\") " pod="openshift-multus/multus-q69lj" Jul 09 02:34:16.597306 ip-10-0-138-136 kubenswrapper[2583]: I0709 02:34:16.591963 2583 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/ab715167-aa61-46be-bbe1-36212c9aa180-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-6gctz\" (UID: \"ab715167-aa61-46be-bbe1-36212c9aa180\") " pod="openshift-ovn-kubernetes/ovnkube-node-6gctz" Jul 09 02:34:16.597306 ip-10-0-138-136 kubenswrapper[2583]: I0709 02:34:16.591992 2583 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/4133cf72-5672-4d5e-b6dd-70e32b953216-kubelet-config\") pod \"global-pull-secret-syncer-sv26w\" (UID: \"4133cf72-5672-4d5e-b6dd-70e32b953216\") " pod="kube-system/global-pull-secret-syncer-sv26w" Jul 09 02:34:16.597306 ip-10-0-138-136 kubenswrapper[2583]: I0709 02:34:16.592025 2583 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/ab715167-aa61-46be-bbe1-36212c9aa180-host-run-ovn-kubernetes\") pod \"ovnkube-node-6gctz\" (UID: \"ab715167-aa61-46be-bbe1-36212c9aa180\") " pod="openshift-ovn-kubernetes/ovnkube-node-6gctz" Jul 09 02:34:16.597306 ip-10-0-138-136 kubenswrapper[2583]: I0709 02:34:16.592133 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/ab715167-aa61-46be-bbe1-36212c9aa180-env-overrides\") pod \"ovnkube-node-6gctz\" (UID: \"ab715167-aa61-46be-bbe1-36212c9aa180\") " pod="openshift-ovn-kubernetes/ovnkube-node-6gctz" Jul 09 02:34:16.597306 ip-10-0-138-136 kubenswrapper[2583]: I0709 02:34:16.592168 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/9b793225-5bd6-4bf7-a87e-d42bf8c939f7-multus-socket-dir-parent\") pod \"multus-q69lj\" (UID: \"9b793225-5bd6-4bf7-a87e-d42bf8c939f7\") " pod="openshift-multus/multus-q69lj" Jul 09 02:34:16.597306 ip-10-0-138-136 kubenswrapper[2583]: I0709 02:34:16.592209 2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/1ca2fa3a-0931-4ac7-b562-e70c66a22120-cnibin\") pod \"multus-additional-cni-plugins-xx7bf\" (UID: \"1ca2fa3a-0931-4ac7-b562-e70c66a22120\") " pod="openshift-multus/multus-additional-cni-plugins-xx7bf" Jul 09 02:34:16.597306 ip-10-0-138-136 kubenswrapper[2583]: I0709 02:34:16.592236 2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-f9h57\" (UniqueName: \"kubernetes.io/projected/1ca2fa3a-0931-4ac7-b562-e70c66a22120-kube-api-access-f9h57\") pod \"multus-additional-cni-plugins-xx7bf\" (UID: \"1ca2fa3a-0931-4ac7-b562-e70c66a22120\") " pod="openshift-multus/multus-additional-cni-plugins-xx7bf" Jul 09 02:34:16.597306 ip-10-0-138-136 kubenswrapper[2583]: I0709 02:34:16.592264 2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/6d20c3fe-b459-4dbb-86a7-3903e967b424-konnectivity-ca\") pod \"konnectivity-agent-gszbq\" (UID: \"6d20c3fe-b459-4dbb-86a7-3903e967b424\") " pod="kube-system/konnectivity-agent-gszbq" Jul 09 02:34:16.597306 ip-10-0-138-136 kubenswrapper[2583]: I0709 02:34:16.592288 2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/337d4063-36cf-4452-a1d3-4573f2517730-etc-sysconfig\") pod \"tuned-npfjp\" (UID: \"337d4063-36cf-4452-a1d3-4573f2517730\") " pod="openshift-cluster-node-tuning-operator/tuned-npfjp" Jul 09 02:34:16.597306 ip-10-0-138-136 kubenswrapper[2583]: I0709 02:34:16.592312 2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/337d4063-36cf-4452-a1d3-4573f2517730-etc-systemd\") pod \"tuned-npfjp\" (UID: \"337d4063-36cf-4452-a1d3-4573f2517730\") " pod="openshift-cluster-node-tuning-operator/tuned-npfjp" Jul 09 02:34:16.598675 ip-10-0-138-136 kubenswrapper[2583]: I0709 02:34:16.592334 2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/337d4063-36cf-4452-a1d3-4573f2517730-tmp\") pod \"tuned-npfjp\" (UID: \"337d4063-36cf-4452-a1d3-4573f2517730\") " pod="openshift-cluster-node-tuning-operator/tuned-npfjp" Jul 09 02:34:16.598675 ip-10-0-138-136 kubenswrapper[2583]: I0709 02:34:16.592349 2583 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/34d08b11-e4c1-4bc4-bd00-2cbfc1720242-iptables-alerter-script\") pod \"iptables-alerter-hc45j\" (UID: \"34d08b11-e4c1-4bc4-bd00-2cbfc1720242\") " pod="openshift-network-operator/iptables-alerter-hc45j" Jul 09 02:34:16.598675 ip-10-0-138-136 kubenswrapper[2583]: I0709 02:34:16.592361 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/ab715167-aa61-46be-bbe1-36212c9aa180-var-lib-openvswitch\") pod \"ovnkube-node-6gctz\" (UID: \"ab715167-aa61-46be-bbe1-36212c9aa180\") " pod="openshift-ovn-kubernetes/ovnkube-node-6gctz" Jul 09 02:34:16.598675 ip-10-0-138-136 kubenswrapper[2583]: I0709 02:34:16.592387 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/9b793225-5bd6-4bf7-a87e-d42bf8c939f7-cnibin\") pod \"multus-q69lj\" (UID: \"9b793225-5bd6-4bf7-a87e-d42bf8c939f7\") " pod="openshift-multus/multus-q69lj" Jul 09 02:34:16.598675 ip-10-0-138-136 kubenswrapper[2583]: I0709 02:34:16.592412 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/9b793225-5bd6-4bf7-a87e-d42bf8c939f7-host-run-k8s-cni-cncf-io\") pod \"multus-q69lj\" (UID: \"9b793225-5bd6-4bf7-a87e-d42bf8c939f7\") " pod="openshift-multus/multus-q69lj" Jul 09 02:34:16.598675 ip-10-0-138-136 kubenswrapper[2583]: I0709 02:34:16.592435 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/9b793225-5bd6-4bf7-a87e-d42bf8c939f7-host-run-netns\") pod \"multus-q69lj\" (UID: \"9b793225-5bd6-4bf7-a87e-d42bf8c939f7\") " pod="openshift-multus/multus-q69lj" Jul 09 02:34:16.598675 ip-10-0-138-136 kubenswrapper[2583]: I0709 02:34:16.592459 2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/337d4063-36cf-4452-a1d3-4573f2517730-etc-modprobe-d\") pod \"tuned-npfjp\" (UID: \"337d4063-36cf-4452-a1d3-4573f2517730\") " pod="openshift-cluster-node-tuning-operator/tuned-npfjp" Jul 09 02:34:16.598675 ip-10-0-138-136 kubenswrapper[2583]: I0709 02:34:16.592489 2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/337d4063-36cf-4452-a1d3-4573f2517730-etc-sysctl-conf\") pod \"tuned-npfjp\" (UID: \"337d4063-36cf-4452-a1d3-4573f2517730\") " pod="openshift-cluster-node-tuning-operator/tuned-npfjp" Jul 09 02:34:16.598675 ip-10-0-138-136 kubenswrapper[2583]: I0709 02:34:16.592511 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/d507ebdd-e329-4392-986f-54b792047f9a-etc-selinux\") pod \"aws-ebs-csi-driver-node-6k6qn\" (UID: \"d507ebdd-e329-4392-986f-54b792047f9a\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-6k6qn" Jul 09 02:34:16.598675 ip-10-0-138-136 kubenswrapper[2583]: I0709 02:34:16.592519 2583 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/9b793225-5bd6-4bf7-a87e-d42bf8c939f7-multus-socket-dir-parent\") pod \"multus-q69lj\" (UID: \"9b793225-5bd6-4bf7-a87e-d42bf8c939f7\") " pod="openshift-multus/multus-q69lj" Jul 09 02:34:16.598675 ip-10-0-138-136 kubenswrapper[2583]: I0709 02:34:16.592529 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/9b793225-5bd6-4bf7-a87e-d42bf8c939f7-host-run-multus-certs\") pod \"multus-q69lj\" (UID: \"9b793225-5bd6-4bf7-a87e-d42bf8c939f7\") " pod="openshift-multus/multus-q69lj" Jul 09 02:34:16.598675 ip-10-0-138-136 kubenswrapper[2583]: I0709 02:34:16.592553 2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/45541338-f2aa-4712-ba6f-8924e3513372-tmp-dir\") pod \"node-resolver-5mbtc\" (UID: \"45541338-f2aa-4712-ba6f-8924e3513372\") " pod="openshift-dns/node-resolver-5mbtc" Jul 09 02:34:16.598675 ip-10-0-138-136 kubenswrapper[2583]: I0709 02:34:16.592574 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/ab715167-aa61-46be-bbe1-36212c9aa180-host-run-netns\") pod \"ovnkube-node-6gctz\" (UID: \"ab715167-aa61-46be-bbe1-36212c9aa180\") " pod="openshift-ovn-kubernetes/ovnkube-node-6gctz" Jul 09 02:34:16.598675 ip-10-0-138-136 kubenswrapper[2583]: I0709 02:34:16.592590 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/34d08b11-e4c1-4bc4-bd00-2cbfc1720242-host-slash\") pod \"iptables-alerter-hc45j\" (UID: \"34d08b11-e4c1-4bc4-bd00-2cbfc1720242\") " pod="openshift-network-operator/iptables-alerter-hc45j" Jul 09 02:34:16.598675 ip-10-0-138-136 kubenswrapper[2583]: I0709 02:34:16.592605 2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/1ca2fa3a-0931-4ac7-b562-e70c66a22120-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-xx7bf\" (UID: \"1ca2fa3a-0931-4ac7-b562-e70c66a22120\") " pod="openshift-multus/multus-additional-cni-plugins-xx7bf" Jul 09 02:34:16.598675 ip-10-0-138-136 kubenswrapper[2583]: I0709 02:34:16.592620 2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/337d4063-36cf-4452-a1d3-4573f2517730-lib-modules\") pod \"tuned-npfjp\" (UID: \"337d4063-36cf-4452-a1d3-4573f2517730\") " pod="openshift-cluster-node-tuning-operator/tuned-npfjp" Jul 09 02:34:16.598675 ip-10-0-138-136 kubenswrapper[2583]: I0709 02:34:16.592623 2583 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/ab715167-aa61-46be-bbe1-36212c9aa180-var-lib-openvswitch\") pod \"ovnkube-node-6gctz\" (UID: \"ab715167-aa61-46be-bbe1-36212c9aa180\") " pod="openshift-ovn-kubernetes/ovnkube-node-6gctz" Jul 09 02:34:16.601204 ip-10-0-138-136 kubenswrapper[2583]: I0709 02:34:16.592635 2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/337d4063-36cf-4452-a1d3-4573f2517730-var-lib-kubelet\") pod \"tuned-npfjp\" (UID: \"337d4063-36cf-4452-a1d3-4573f2517730\") " pod="openshift-cluster-node-tuning-operator/tuned-npfjp" Jul 09 02:34:16.601204 ip-10-0-138-136 kubenswrapper[2583]: I0709 02:34:16.592653 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/d507ebdd-e329-4392-986f-54b792047f9a-kubelet-dir\") pod \"aws-ebs-csi-driver-node-6k6qn\" (UID: \"d507ebdd-e329-4392-986f-54b792047f9a\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-6k6qn" Jul 09 02:34:16.601204 ip-10-0-138-136 kubenswrapper[2583]: I0709 02:34:16.592671 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/d507ebdd-e329-4392-986f-54b792047f9a-sys-fs\") pod \"aws-ebs-csi-driver-node-6k6qn\" (UID: \"d507ebdd-e329-4392-986f-54b792047f9a\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-6k6qn" Jul 09 02:34:16.601204 ip-10-0-138-136 kubenswrapper[2583]: I0709 02:34:16.592675 2583 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/9b793225-5bd6-4bf7-a87e-d42bf8c939f7-cnibin\") pod \"multus-q69lj\" (UID: \"9b793225-5bd6-4bf7-a87e-d42bf8c939f7\") " pod="openshift-multus/multus-q69lj" Jul 09 02:34:16.601204 ip-10-0-138-136 kubenswrapper[2583]: I0709 02:34:16.592678 2583 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/ab715167-aa61-46be-bbe1-36212c9aa180-env-overrides\") pod \"ovnkube-node-6gctz\" (UID: \"ab715167-aa61-46be-bbe1-36212c9aa180\") " pod="openshift-ovn-kubernetes/ovnkube-node-6gctz" Jul 09 02:34:16.601204 ip-10-0-138-136 kubenswrapper[2583]: I0709 02:34:16.592690 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/9b793225-5bd6-4bf7-a87e-d42bf8c939f7-host-var-lib-cni-multus\") pod \"multus-q69lj\" (UID: \"9b793225-5bd6-4bf7-a87e-d42bf8c939f7\") " pod="openshift-multus/multus-q69lj" Jul 09 02:34:16.601204 ip-10-0-138-136 kubenswrapper[2583]: I0709 02:34:16.592709 2583 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/9b793225-5bd6-4bf7-a87e-d42bf8c939f7-host-run-k8s-cni-cncf-io\") pod \"multus-q69lj\" (UID: \"9b793225-5bd6-4bf7-a87e-d42bf8c939f7\") " pod="openshift-multus/multus-q69lj" Jul 09 02:34:16.601204 ip-10-0-138-136 kubenswrapper[2583]: I0709 02:34:16.592714 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/9b793225-5bd6-4bf7-a87e-d42bf8c939f7-etc-kubernetes\") pod \"multus-q69lj\" (UID: \"9b793225-5bd6-4bf7-a87e-d42bf8c939f7\") " pod="openshift-multus/multus-q69lj" Jul 09 02:34:16.601204 ip-10-0-138-136 kubenswrapper[2583]: I0709 02:34:16.592742 2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/1ca2fa3a-0931-4ac7-b562-e70c66a22120-tuning-conf-dir\") pod \"multus-additional-cni-plugins-xx7bf\" (UID: \"1ca2fa3a-0931-4ac7-b562-e70c66a22120\") " pod="openshift-multus/multus-additional-cni-plugins-xx7bf" Jul 09 02:34:16.601204 ip-10-0-138-136 kubenswrapper[2583]: I0709 02:34:16.592749 2583 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/ab715167-aa61-46be-bbe1-36212c9aa180-host-run-netns\") pod \"ovnkube-node-6gctz\" (UID: \"ab715167-aa61-46be-bbe1-36212c9aa180\") " pod="openshift-ovn-kubernetes/ovnkube-node-6gctz" Jul 09 02:34:16.601204 ip-10-0-138-136 kubenswrapper[2583]: I0709 02:34:16.592766 2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-wwh6x\" (UniqueName: \"kubernetes.io/projected/d9f05741-1f97-4987-8158-4dbad6b22987-kube-api-access-wwh6x\") pod \"network-check-target-dkblh\" (UID: \"d9f05741-1f97-4987-8158-4dbad6b22987\") " pod="openshift-network-diagnostics/network-check-target-dkblh" Jul 09 02:34:16.601204 ip-10-0-138-136 kubenswrapper[2583]: I0709 02:34:16.592802 2583 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/34d08b11-e4c1-4bc4-bd00-2cbfc1720242-host-slash\") pod \"iptables-alerter-hc45j\" (UID: \"34d08b11-e4c1-4bc4-bd00-2cbfc1720242\") " pod="openshift-network-operator/iptables-alerter-hc45j" Jul 09 02:34:16.601204 ip-10-0-138-136 kubenswrapper[2583]: I0709 02:34:16.592809 2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/6d20c3fe-b459-4dbb-86a7-3903e967b424-agent-certs\") pod \"konnectivity-agent-gszbq\" (UID: \"6d20c3fe-b459-4dbb-86a7-3903e967b424\") " pod="kube-system/konnectivity-agent-gszbq" Jul 09 02:34:16.601204 ip-10-0-138-136 kubenswrapper[2583]: I0709 02:34:16.592828 2583 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/d507ebdd-e329-4392-986f-54b792047f9a-etc-selinux\") pod \"aws-ebs-csi-driver-node-6k6qn\" (UID: \"d507ebdd-e329-4392-986f-54b792047f9a\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-6k6qn" Jul 09 02:34:16.601204 ip-10-0-138-136 kubenswrapper[2583]: I0709 02:34:16.592885 2583 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/d507ebdd-e329-4392-986f-54b792047f9a-kubelet-dir\") pod \"aws-ebs-csi-driver-node-6k6qn\" (UID: \"d507ebdd-e329-4392-986f-54b792047f9a\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-6k6qn" Jul 09 02:34:16.601204 ip-10-0-138-136 kubenswrapper[2583]: I0709 02:34:16.592887 2583 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/9b793225-5bd6-4bf7-a87e-d42bf8c939f7-host-var-lib-cni-multus\") pod \"multus-q69lj\" (UID: \"9b793225-5bd6-4bf7-a87e-d42bf8c939f7\") " pod="openshift-multus/multus-q69lj" Jul 09 02:34:16.601204 ip-10-0-138-136 kubenswrapper[2583]: I0709 02:34:16.592898 2583 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/9b793225-5bd6-4bf7-a87e-d42bf8c939f7-host-run-netns\") pod \"multus-q69lj\" (UID: \"9b793225-5bd6-4bf7-a87e-d42bf8c939f7\") " pod="openshift-multus/multus-q69lj" Jul 09 02:34:16.602065 ip-10-0-138-136 kubenswrapper[2583]: I0709 02:34:16.592834 2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/45541338-f2aa-4712-ba6f-8924e3513372-hosts-file\") pod \"node-resolver-5mbtc\" (UID: \"45541338-f2aa-4712-ba6f-8924e3513372\") " pod="openshift-dns/node-resolver-5mbtc" Jul 09 02:34:16.602065 ip-10-0-138-136 kubenswrapper[2583]: I0709 02:34:16.592925 2583 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/d507ebdd-e329-4392-986f-54b792047f9a-sys-fs\") pod \"aws-ebs-csi-driver-node-6k6qn\" (UID: \"d507ebdd-e329-4392-986f-54b792047f9a\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-6k6qn" Jul 09 02:34:16.602065 ip-10-0-138-136 kubenswrapper[2583]: I0709 02:34:16.592951 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/ab715167-aa61-46be-bbe1-36212c9aa180-run-ovn\") pod \"ovnkube-node-6gctz\" (UID: \"ab715167-aa61-46be-bbe1-36212c9aa180\") " pod="openshift-ovn-kubernetes/ovnkube-node-6gctz" Jul 09 02:34:16.602065 ip-10-0-138-136 kubenswrapper[2583]: I0709 02:34:16.592968 2583 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/9b793225-5bd6-4bf7-a87e-d42bf8c939f7-host-run-multus-certs\") pod \"multus-q69lj\" (UID: \"9b793225-5bd6-4bf7-a87e-d42bf8c939f7\") " pod="openshift-multus/multus-q69lj" Jul 09 02:34:16.602065 ip-10-0-138-136 kubenswrapper[2583]: I0709 02:34:16.593016 2583 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/9b793225-5bd6-4bf7-a87e-d42bf8c939f7-etc-kubernetes\") pod \"multus-q69lj\" (UID: \"9b793225-5bd6-4bf7-a87e-d42bf8c939f7\") " pod="openshift-multus/multus-q69lj" Jul 09 02:34:16.602065 ip-10-0-138-136 kubenswrapper[2583]: I0709 02:34:16.593046 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/ab715167-aa61-46be-bbe1-36212c9aa180-log-socket\") pod \"ovnkube-node-6gctz\" (UID: \"ab715167-aa61-46be-bbe1-36212c9aa180\") " pod="openshift-ovn-kubernetes/ovnkube-node-6gctz" Jul 09 02:34:16.602065 ip-10-0-138-136 kubenswrapper[2583]: I0709 02:34:16.593056 2583 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/ab715167-aa61-46be-bbe1-36212c9aa180-run-ovn\") pod \"ovnkube-node-6gctz\" (UID: \"ab715167-aa61-46be-bbe1-36212c9aa180\") " pod="openshift-ovn-kubernetes/ovnkube-node-6gctz" Jul 09 02:34:16.602065 ip-10-0-138-136 kubenswrapper[2583]: I0709 02:34:16.593082 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/4133cf72-5672-4d5e-b6dd-70e32b953216-original-pull-secret\") pod \"global-pull-secret-syncer-sv26w\" (UID: \"4133cf72-5672-4d5e-b6dd-70e32b953216\") " pod="kube-system/global-pull-secret-syncer-sv26w" Jul 09 02:34:16.602065 ip-10-0-138-136 kubenswrapper[2583]: I0709 02:34:16.593110 2583 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/ab715167-aa61-46be-bbe1-36212c9aa180-log-socket\") pod \"ovnkube-node-6gctz\" (UID: \"ab715167-aa61-46be-bbe1-36212c9aa180\") " pod="openshift-ovn-kubernetes/ovnkube-node-6gctz" Jul 09 02:34:16.602065 ip-10-0-138-136 kubenswrapper[2583]: I0709 02:34:16.593157 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/d507ebdd-e329-4392-986f-54b792047f9a-socket-dir\") pod \"aws-ebs-csi-driver-node-6k6qn\" (UID: \"d507ebdd-e329-4392-986f-54b792047f9a\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-6k6qn" Jul 09 02:34:16.602065 ip-10-0-138-136 kubenswrapper[2583]: E0709 02:34:16.593199 2583 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jul 09 02:34:16.602065 ip-10-0-138-136 kubenswrapper[2583]: I0709 02:34:16.593238 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-fgpjj\" (UniqueName: \"kubernetes.io/projected/d507ebdd-e329-4392-986f-54b792047f9a-kube-api-access-fgpjj\") pod \"aws-ebs-csi-driver-node-6k6qn\" (UID: \"d507ebdd-e329-4392-986f-54b792047f9a\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-6k6qn" Jul 09 02:34:16.602065 ip-10-0-138-136 kubenswrapper[2583]: I0709 02:34:16.593329 2583 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/d507ebdd-e329-4392-986f-54b792047f9a-socket-dir\") pod \"aws-ebs-csi-driver-node-6k6qn\" (UID: \"d507ebdd-e329-4392-986f-54b792047f9a\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-6k6qn" Jul 09 02:34:16.602065 ip-10-0-138-136 kubenswrapper[2583]: I0709 02:34:16.593344 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/9b793225-5bd6-4bf7-a87e-d42bf8c939f7-hostroot\") pod \"multus-q69lj\" (UID: \"9b793225-5bd6-4bf7-a87e-d42bf8c939f7\") " pod="openshift-multus/multus-q69lj" Jul 09 02:34:16.602065 ip-10-0-138-136 kubenswrapper[2583]: E0709 02:34:16.593389 2583 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/4133cf72-5672-4d5e-b6dd-70e32b953216-original-pull-secret podName:4133cf72-5672-4d5e-b6dd-70e32b953216 nodeName:}" failed. No retries permitted until 2026-07-09 02:34:17.09337036 +0000 UTC m=+3.025827826 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/4133cf72-5672-4d5e-b6dd-70e32b953216-original-pull-secret") pod "global-pull-secret-syncer-sv26w" (UID: "4133cf72-5672-4d5e-b6dd-70e32b953216") : object "kube-system"/"original-pull-secret" not registered Jul 09 02:34:16.602065 ip-10-0-138-136 kubenswrapper[2583]: I0709 02:34:16.593440 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/d507ebdd-e329-4392-986f-54b792047f9a-device-dir\") pod \"aws-ebs-csi-driver-node-6k6qn\" (UID: \"d507ebdd-e329-4392-986f-54b792047f9a\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-6k6qn" Jul 09 02:34:16.602065 ip-10-0-138-136 kubenswrapper[2583]: I0709 02:34:16.593458 2583 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/9b793225-5bd6-4bf7-a87e-d42bf8c939f7-hostroot\") pod \"multus-q69lj\" (UID: \"9b793225-5bd6-4bf7-a87e-d42bf8c939f7\") " pod="openshift-multus/multus-q69lj" Jul 09 02:34:16.604510 ip-10-0-138-136 kubenswrapper[2583]: I0709 02:34:16.593511 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/9b793225-5bd6-4bf7-a87e-d42bf8c939f7-host-var-lib-kubelet\") pod \"multus-q69lj\" (UID: \"9b793225-5bd6-4bf7-a87e-d42bf8c939f7\") " pod="openshift-multus/multus-q69lj" Jul 09 02:34:16.604510 ip-10-0-138-136 kubenswrapper[2583]: I0709 02:34:16.593540 2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/1ca2fa3a-0931-4ac7-b562-e70c66a22120-system-cni-dir\") pod \"multus-additional-cni-plugins-xx7bf\" (UID: \"1ca2fa3a-0931-4ac7-b562-e70c66a22120\") " pod="openshift-multus/multus-additional-cni-plugins-xx7bf" Jul 09 02:34:16.604510 ip-10-0-138-136 kubenswrapper[2583]: I0709 02:34:16.593567 2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/337d4063-36cf-4452-a1d3-4573f2517730-etc-kubernetes\") pod \"tuned-npfjp\" (UID: \"337d4063-36cf-4452-a1d3-4573f2517730\") " pod="openshift-cluster-node-tuning-operator/tuned-npfjp" Jul 09 02:34:16.604510 ip-10-0-138-136 kubenswrapper[2583]: I0709 02:34:16.593594 2583 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/d507ebdd-e329-4392-986f-54b792047f9a-device-dir\") pod \"aws-ebs-csi-driver-node-6k6qn\" (UID: \"d507ebdd-e329-4392-986f-54b792047f9a\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-6k6qn" Jul 09 02:34:16.604510 ip-10-0-138-136 kubenswrapper[2583]: I0709 02:34:16.593602 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/ab715167-aa61-46be-bbe1-36212c9aa180-run-systemd\") pod \"ovnkube-node-6gctz\" (UID: \"ab715167-aa61-46be-bbe1-36212c9aa180\") " pod="openshift-ovn-kubernetes/ovnkube-node-6gctz" Jul 09 02:34:16.604510 ip-10-0-138-136 kubenswrapper[2583]: I0709 02:34:16.593635 2583 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/ab715167-aa61-46be-bbe1-36212c9aa180-run-systemd\") pod \"ovnkube-node-6gctz\" (UID: \"ab715167-aa61-46be-bbe1-36212c9aa180\") " pod="openshift-ovn-kubernetes/ovnkube-node-6gctz" Jul 09 02:34:16.604510 ip-10-0-138-136 kubenswrapper[2583]: I0709 02:34:16.593672 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-dvv5s\" (UniqueName: \"kubernetes.io/projected/ab715167-aa61-46be-bbe1-36212c9aa180-kube-api-access-dvv5s\") pod \"ovnkube-node-6gctz\" (UID: \"ab715167-aa61-46be-bbe1-36212c9aa180\") " pod="openshift-ovn-kubernetes/ovnkube-node-6gctz" Jul 09 02:34:16.604510 ip-10-0-138-136 kubenswrapper[2583]: I0709 02:34:16.593699 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/9b793225-5bd6-4bf7-a87e-d42bf8c939f7-cni-binary-copy\") pod \"multus-q69lj\" (UID: \"9b793225-5bd6-4bf7-a87e-d42bf8c939f7\") " pod="openshift-multus/multus-q69lj" Jul 09 02:34:16.604510 ip-10-0-138-136 kubenswrapper[2583]: I0709 02:34:16.593725 2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-5dszf\" (UniqueName: \"kubernetes.io/projected/337d4063-36cf-4452-a1d3-4573f2517730-kube-api-access-5dszf\") pod \"tuned-npfjp\" (UID: \"337d4063-36cf-4452-a1d3-4573f2517730\") " pod="openshift-cluster-node-tuning-operator/tuned-npfjp" Jul 09 02:34:16.604510 ip-10-0-138-136 kubenswrapper[2583]: I0709 02:34:16.593748 2583 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/9b793225-5bd6-4bf7-a87e-d42bf8c939f7-host-var-lib-kubelet\") pod \"multus-q69lj\" (UID: \"9b793225-5bd6-4bf7-a87e-d42bf8c939f7\") " pod="openshift-multus/multus-q69lj" Jul 09 02:34:16.604510 ip-10-0-138-136 kubenswrapper[2583]: I0709 02:34:16.593791 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-74bf5\" (UniqueName: \"kubernetes.io/projected/6cdfd2a0-46af-4734-9735-7408f8439c96-kube-api-access-74bf5\") pod \"node-ca-v86n2\" (UID: \"6cdfd2a0-46af-4734-9735-7408f8439c96\") " pod="openshift-image-registry/node-ca-v86n2" Jul 09 02:34:16.604510 ip-10-0-138-136 kubenswrapper[2583]: I0709 02:34:16.593819 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/ab715167-aa61-46be-bbe1-36212c9aa180-systemd-units\") pod \"ovnkube-node-6gctz\" (UID: \"ab715167-aa61-46be-bbe1-36212c9aa180\") " pod="openshift-ovn-kubernetes/ovnkube-node-6gctz" Jul 09 02:34:16.604510 ip-10-0-138-136 kubenswrapper[2583]: I0709 02:34:16.593859 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/ab715167-aa61-46be-bbe1-36212c9aa180-node-log\") pod \"ovnkube-node-6gctz\" (UID: \"ab715167-aa61-46be-bbe1-36212c9aa180\") " pod="openshift-ovn-kubernetes/ovnkube-node-6gctz" Jul 09 02:34:16.604510 ip-10-0-138-136 kubenswrapper[2583]: I0709 02:34:16.593929 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/9b793225-5bd6-4bf7-a87e-d42bf8c939f7-multus-daemon-config\") pod \"multus-q69lj\" (UID: \"9b793225-5bd6-4bf7-a87e-d42bf8c939f7\") " pod="openshift-multus/multus-q69lj" Jul 09 02:34:16.604510 ip-10-0-138-136 kubenswrapper[2583]: I0709 02:34:16.593955 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/ab715167-aa61-46be-bbe1-36212c9aa180-etc-openvswitch\") pod \"ovnkube-node-6gctz\" (UID: \"ab715167-aa61-46be-bbe1-36212c9aa180\") " pod="openshift-ovn-kubernetes/ovnkube-node-6gctz" Jul 09 02:34:16.604510 ip-10-0-138-136 kubenswrapper[2583]: I0709 02:34:16.593981 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/ab715167-aa61-46be-bbe1-36212c9aa180-run-openvswitch\") pod \"ovnkube-node-6gctz\" (UID: \"ab715167-aa61-46be-bbe1-36212c9aa180\") " pod="openshift-ovn-kubernetes/ovnkube-node-6gctz" Jul 09 02:34:16.604510 ip-10-0-138-136 kubenswrapper[2583]: I0709 02:34:16.594010 2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/1ca2fa3a-0931-4ac7-b562-e70c66a22120-os-release\") pod \"multus-additional-cni-plugins-xx7bf\" (UID: \"1ca2fa3a-0931-4ac7-b562-e70c66a22120\") " pod="openshift-multus/multus-additional-cni-plugins-xx7bf" Jul 09 02:34:16.605758 ip-10-0-138-136 kubenswrapper[2583]: I0709 02:34:16.594036 2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/337d4063-36cf-4452-a1d3-4573f2517730-host\") pod \"tuned-npfjp\" (UID: \"337d4063-36cf-4452-a1d3-4573f2517730\") " pod="openshift-cluster-node-tuning-operator/tuned-npfjp" Jul 09 02:34:16.605758 ip-10-0-138-136 kubenswrapper[2583]: I0709 02:34:16.594061 2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/337d4063-36cf-4452-a1d3-4573f2517730-etc-tuned\") pod \"tuned-npfjp\" (UID: \"337d4063-36cf-4452-a1d3-4573f2517730\") " pod="openshift-cluster-node-tuning-operator/tuned-npfjp" Jul 09 02:34:16.605758 ip-10-0-138-136 kubenswrapper[2583]: I0709 02:34:16.594126 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/6cdfd2a0-46af-4734-9735-7408f8439c96-serviceca\") pod \"node-ca-v86n2\" (UID: \"6cdfd2a0-46af-4734-9735-7408f8439c96\") " pod="openshift-image-registry/node-ca-v86n2" Jul 09 02:34:16.605758 ip-10-0-138-136 kubenswrapper[2583]: I0709 02:34:16.594150 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/ab715167-aa61-46be-bbe1-36212c9aa180-host-slash\") pod \"ovnkube-node-6gctz\" (UID: \"ab715167-aa61-46be-bbe1-36212c9aa180\") " pod="openshift-ovn-kubernetes/ovnkube-node-6gctz" Jul 09 02:34:16.605758 ip-10-0-138-136 kubenswrapper[2583]: I0709 02:34:16.594177 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/ab715167-aa61-46be-bbe1-36212c9aa180-host-cni-bin\") pod \"ovnkube-node-6gctz\" (UID: \"ab715167-aa61-46be-bbe1-36212c9aa180\") " pod="openshift-ovn-kubernetes/ovnkube-node-6gctz" Jul 09 02:34:16.605758 ip-10-0-138-136 kubenswrapper[2583]: I0709 02:34:16.594185 2583 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/ab715167-aa61-46be-bbe1-36212c9aa180-systemd-units\") pod \"ovnkube-node-6gctz\" (UID: \"ab715167-aa61-46be-bbe1-36212c9aa180\") " pod="openshift-ovn-kubernetes/ovnkube-node-6gctz" Jul 09 02:34:16.605758 ip-10-0-138-136 kubenswrapper[2583]: I0709 02:34:16.594201 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/ab715167-aa61-46be-bbe1-36212c9aa180-host-cni-netd\") pod \"ovnkube-node-6gctz\" (UID: \"ab715167-aa61-46be-bbe1-36212c9aa180\") " pod="openshift-ovn-kubernetes/ovnkube-node-6gctz" Jul 09 02:34:16.605758 ip-10-0-138-136 kubenswrapper[2583]: I0709 02:34:16.594272 2583 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/9b793225-5bd6-4bf7-a87e-d42bf8c939f7-cni-binary-copy\") pod \"multus-q69lj\" (UID: \"9b793225-5bd6-4bf7-a87e-d42bf8c939f7\") " pod="openshift-multus/multus-q69lj" Jul 09 02:34:16.605758 ip-10-0-138-136 kubenswrapper[2583]: I0709 02:34:16.594332 2583 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/ab715167-aa61-46be-bbe1-36212c9aa180-run-openvswitch\") pod \"ovnkube-node-6gctz\" (UID: \"ab715167-aa61-46be-bbe1-36212c9aa180\") " pod="openshift-ovn-kubernetes/ovnkube-node-6gctz" Jul 09 02:34:16.605758 ip-10-0-138-136 kubenswrapper[2583]: I0709 02:34:16.594379 2583 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/ab715167-aa61-46be-bbe1-36212c9aa180-node-log\") pod \"ovnkube-node-6gctz\" (UID: \"ab715167-aa61-46be-bbe1-36212c9aa180\") " pod="openshift-ovn-kubernetes/ovnkube-node-6gctz" Jul 09 02:34:16.605758 ip-10-0-138-136 kubenswrapper[2583]: I0709 02:34:16.594417 2583 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/ab715167-aa61-46be-bbe1-36212c9aa180-etc-openvswitch\") pod \"ovnkube-node-6gctz\" (UID: \"ab715167-aa61-46be-bbe1-36212c9aa180\") " pod="openshift-ovn-kubernetes/ovnkube-node-6gctz" Jul 09 02:34:16.605758 ip-10-0-138-136 kubenswrapper[2583]: I0709 02:34:16.594446 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/ab715167-aa61-46be-bbe1-36212c9aa180-ovnkube-script-lib\") pod \"ovnkube-node-6gctz\" (UID: \"ab715167-aa61-46be-bbe1-36212c9aa180\") " pod="openshift-ovn-kubernetes/ovnkube-node-6gctz" Jul 09 02:34:16.605758 ip-10-0-138-136 kubenswrapper[2583]: I0709 02:34:16.594480 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/4133cf72-5672-4d5e-b6dd-70e32b953216-dbus\") pod \"global-pull-secret-syncer-sv26w\" (UID: \"4133cf72-5672-4d5e-b6dd-70e32b953216\") " pod="kube-system/global-pull-secret-syncer-sv26w" Jul 09 02:34:16.605758 ip-10-0-138-136 kubenswrapper[2583]: I0709 02:34:16.594521 2583 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/ab715167-aa61-46be-bbe1-36212c9aa180-host-cni-bin\") pod \"ovnkube-node-6gctz\" (UID: \"ab715167-aa61-46be-bbe1-36212c9aa180\") " pod="openshift-ovn-kubernetes/ovnkube-node-6gctz" Jul 09 02:34:16.605758 ip-10-0-138-136 kubenswrapper[2583]: I0709 02:34:16.594543 2583 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/ab715167-aa61-46be-bbe1-36212c9aa180-host-cni-netd\") pod \"ovnkube-node-6gctz\" (UID: \"ab715167-aa61-46be-bbe1-36212c9aa180\") " pod="openshift-ovn-kubernetes/ovnkube-node-6gctz" Jul 09 02:34:16.605758 ip-10-0-138-136 kubenswrapper[2583]: I0709 02:34:16.594820 2583 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/9b793225-5bd6-4bf7-a87e-d42bf8c939f7-multus-daemon-config\") pod \"multus-q69lj\" (UID: \"9b793225-5bd6-4bf7-a87e-d42bf8c939f7\") " pod="openshift-multus/multus-q69lj" Jul 09 02:34:16.605758 ip-10-0-138-136 kubenswrapper[2583]: I0709 02:34:16.594846 2583 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/ab715167-aa61-46be-bbe1-36212c9aa180-host-slash\") pod \"ovnkube-node-6gctz\" (UID: \"ab715167-aa61-46be-bbe1-36212c9aa180\") " pod="openshift-ovn-kubernetes/ovnkube-node-6gctz" Jul 09 02:34:16.605758 ip-10-0-138-136 kubenswrapper[2583]: I0709 02:34:16.594865 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/9b793225-5bd6-4bf7-a87e-d42bf8c939f7-multus-cni-dir\") pod \"multus-q69lj\" (UID: \"9b793225-5bd6-4bf7-a87e-d42bf8c939f7\") " pod="openshift-multus/multus-q69lj" Jul 09 02:34:16.676551 ip-10-0-138-136 kubenswrapper[2583]: I0709 02:34:16.594890 2583 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/6cdfd2a0-46af-4734-9735-7408f8439c96-serviceca\") pod \"node-ca-v86n2\" (UID: \"6cdfd2a0-46af-4734-9735-7408f8439c96\") " pod="openshift-image-registry/node-ca-v86n2" Jul 09 02:34:16.676551 ip-10-0-138-136 kubenswrapper[2583]: I0709 02:34:16.594927 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-89s4s\" (UniqueName: \"kubernetes.io/projected/71cf0a89-d676-47f4-bf4a-d13d283493fc-kube-api-access-89s4s\") pod \"network-metrics-daemon-rdtdt\" (UID: \"71cf0a89-d676-47f4-bf4a-d13d283493fc\") " pod="openshift-multus/network-metrics-daemon-rdtdt" Jul 09 02:34:16.676551 ip-10-0-138-136 kubenswrapper[2583]: I0709 02:34:16.594963 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/6cdfd2a0-46af-4734-9735-7408f8439c96-host\") pod \"node-ca-v86n2\" (UID: \"6cdfd2a0-46af-4734-9735-7408f8439c96\") " pod="openshift-image-registry/node-ca-v86n2" Jul 09 02:34:16.676551 ip-10-0-138-136 kubenswrapper[2583]: I0709 02:34:16.594970 2583 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/9b793225-5bd6-4bf7-a87e-d42bf8c939f7-multus-cni-dir\") pod \"multus-q69lj\" (UID: \"9b793225-5bd6-4bf7-a87e-d42bf8c939f7\") " pod="openshift-multus/multus-q69lj" Jul 09 02:34:16.676551 ip-10-0-138-136 kubenswrapper[2583]: I0709 02:34:16.594970 2583 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/4133cf72-5672-4d5e-b6dd-70e32b953216-dbus\") pod \"global-pull-secret-syncer-sv26w\" (UID: \"4133cf72-5672-4d5e-b6dd-70e32b953216\") " pod="kube-system/global-pull-secret-syncer-sv26w" Jul 09 02:34:16.676551 ip-10-0-138-136 kubenswrapper[2583]: I0709 02:34:16.595007 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/ab715167-aa61-46be-bbe1-36212c9aa180-host-kubelet\") pod \"ovnkube-node-6gctz\" (UID: \"ab715167-aa61-46be-bbe1-36212c9aa180\") " pod="openshift-ovn-kubernetes/ovnkube-node-6gctz" Jul 09 02:34:16.676551 ip-10-0-138-136 kubenswrapper[2583]: I0709 02:34:16.595033 2583 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host\" (UniqueName: \"kubernetes.io/host-path/6cdfd2a0-46af-4734-9735-7408f8439c96-host\") pod \"node-ca-v86n2\" (UID: \"6cdfd2a0-46af-4734-9735-7408f8439c96\") " pod="openshift-image-registry/node-ca-v86n2" Jul 09 02:34:16.676551 ip-10-0-138-136 kubenswrapper[2583]: I0709 02:34:16.595043 2583 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/ab715167-aa61-46be-bbe1-36212c9aa180-ovnkube-script-lib\") pod \"ovnkube-node-6gctz\" (UID: \"ab715167-aa61-46be-bbe1-36212c9aa180\") " pod="openshift-ovn-kubernetes/ovnkube-node-6gctz" Jul 09 02:34:16.676551 ip-10-0-138-136 kubenswrapper[2583]: I0709 02:34:16.595037 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/ab715167-aa61-46be-bbe1-36212c9aa180-ovnkube-config\") pod \"ovnkube-node-6gctz\" (UID: \"ab715167-aa61-46be-bbe1-36212c9aa180\") " pod="openshift-ovn-kubernetes/ovnkube-node-6gctz" Jul 09 02:34:16.676551 ip-10-0-138-136 kubenswrapper[2583]: I0709 02:34:16.595071 2583 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/ab715167-aa61-46be-bbe1-36212c9aa180-host-kubelet\") pod \"ovnkube-node-6gctz\" (UID: \"ab715167-aa61-46be-bbe1-36212c9aa180\") " pod="openshift-ovn-kubernetes/ovnkube-node-6gctz" Jul 09 02:34:16.676551 ip-10-0-138-136 kubenswrapper[2583]: I0709 02:34:16.595095 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-zsmfw\" (UniqueName: \"kubernetes.io/projected/34d08b11-e4c1-4bc4-bd00-2cbfc1720242-kube-api-access-zsmfw\") pod \"iptables-alerter-hc45j\" (UID: \"34d08b11-e4c1-4bc4-bd00-2cbfc1720242\") " pod="openshift-network-operator/iptables-alerter-hc45j" Jul 09 02:34:16.676551 ip-10-0-138-136 kubenswrapper[2583]: I0709 02:34:16.595125 2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/1ca2fa3a-0931-4ac7-b562-e70c66a22120-cni-binary-copy\") pod \"multus-additional-cni-plugins-xx7bf\" (UID: \"1ca2fa3a-0931-4ac7-b562-e70c66a22120\") " pod="openshift-multus/multus-additional-cni-plugins-xx7bf" Jul 09 02:34:16.676551 ip-10-0-138-136 kubenswrapper[2583]: I0709 02:34:16.595197 2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/1ca2fa3a-0931-4ac7-b562-e70c66a22120-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-xx7bf\" (UID: \"1ca2fa3a-0931-4ac7-b562-e70c66a22120\") " pod="openshift-multus/multus-additional-cni-plugins-xx7bf" Jul 09 02:34:16.676551 ip-10-0-138-136 kubenswrapper[2583]: I0709 02:34:16.595564 2583 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/ab715167-aa61-46be-bbe1-36212c9aa180-ovnkube-config\") pod \"ovnkube-node-6gctz\" (UID: \"ab715167-aa61-46be-bbe1-36212c9aa180\") " pod="openshift-ovn-kubernetes/ovnkube-node-6gctz" Jul 09 02:34:16.676551 ip-10-0-138-136 kubenswrapper[2583]: I0709 02:34:16.597828 2583 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/ab715167-aa61-46be-bbe1-36212c9aa180-ovn-node-metrics-cert\") pod \"ovnkube-node-6gctz\" (UID: \"ab715167-aa61-46be-bbe1-36212c9aa180\") " pod="openshift-ovn-kubernetes/ovnkube-node-6gctz" Jul 09 02:34:16.676551 ip-10-0-138-136 kubenswrapper[2583]: I0709 02:34:16.610117 2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-138-136.ec2.internal" event={"ID":"04454d06c2f086e47f91e8c63bb8c939","Type":"ContainerStarted","Data":"1787886eebf02faa92f70d3e97410a9a3680914a6626062f4022f01a163dde2e"} Jul 09 02:34:16.676551 ip-10-0-138-136 kubenswrapper[2583]: I0709 02:34:16.611411 2583 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-dvv5s\" (UniqueName: \"kubernetes.io/projected/ab715167-aa61-46be-bbe1-36212c9aa180-kube-api-access-dvv5s\") pod \"ovnkube-node-6gctz\" (UID: \"ab715167-aa61-46be-bbe1-36212c9aa180\") " pod="openshift-ovn-kubernetes/ovnkube-node-6gctz" Jul 09 02:34:16.677719 ip-10-0-138-136 kubenswrapper[2583]: I0709 02:34:16.611863 2583 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-74bf5\" (UniqueName: \"kubernetes.io/projected/6cdfd2a0-46af-4734-9735-7408f8439c96-kube-api-access-74bf5\") pod \"node-ca-v86n2\" (UID: \"6cdfd2a0-46af-4734-9735-7408f8439c96\") " pod="openshift-image-registry/node-ca-v86n2" Jul 09 02:34:16.677719 ip-10-0-138-136 kubenswrapper[2583]: I0709 02:34:16.611892 2583 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-zsmfw\" (UniqueName: \"kubernetes.io/projected/34d08b11-e4c1-4bc4-bd00-2cbfc1720242-kube-api-access-zsmfw\") pod \"iptables-alerter-hc45j\" (UID: \"34d08b11-e4c1-4bc4-bd00-2cbfc1720242\") " pod="openshift-network-operator/iptables-alerter-hc45j" Jul 09 02:34:16.677719 ip-10-0-138-136 kubenswrapper[2583]: I0709 02:34:16.611931 2583 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-89s4s\" (UniqueName: \"kubernetes.io/projected/71cf0a89-d676-47f4-bf4a-d13d283493fc-kube-api-access-89s4s\") pod \"network-metrics-daemon-rdtdt\" (UID: \"71cf0a89-d676-47f4-bf4a-d13d283493fc\") " pod="openshift-multus/network-metrics-daemon-rdtdt" Jul 09 02:34:16.677719 ip-10-0-138-136 kubenswrapper[2583]: I0709 02:34:16.612272 2583 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-fgpjj\" (UniqueName: \"kubernetes.io/projected/d507ebdd-e329-4392-986f-54b792047f9a-kube-api-access-fgpjj\") pod \"aws-ebs-csi-driver-node-6k6qn\" (UID: \"d507ebdd-e329-4392-986f-54b792047f9a\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-6k6qn" Jul 09 02:34:16.677719 ip-10-0-138-136 kubenswrapper[2583]: I0709 02:34:16.612659 2583 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-4szpd\" (UniqueName: \"kubernetes.io/projected/9b793225-5bd6-4bf7-a87e-d42bf8c939f7-kube-api-access-4szpd\") pod \"multus-q69lj\" (UID: \"9b793225-5bd6-4bf7-a87e-d42bf8c939f7\") " pod="openshift-multus/multus-q69lj" Jul 09 02:34:16.677719 ip-10-0-138-136 kubenswrapper[2583]: I0709 02:34:16.621161 2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-138-136.ec2.internal" event={"ID":"1f563ddc813ab6d8fd08536b68d33fae","Type":"ContainerStarted","Data":"687570c949baf16afa5ca4bd411dd90325cf1e69df196db0f571a981b674ddf8"} Jul 09 02:34:16.748767 ip-10-0-138-136 kubenswrapper[2583]: I0709 02:34:16.695627 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/1ca2fa3a-0931-4ac7-b562-e70c66a22120-cnibin\") pod \"multus-additional-cni-plugins-xx7bf\" (UID: \"1ca2fa3a-0931-4ac7-b562-e70c66a22120\") " pod="openshift-multus/multus-additional-cni-plugins-xx7bf" Jul 09 02:34:16.748767 ip-10-0-138-136 kubenswrapper[2583]: I0709 02:34:16.695659 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-f9h57\" (UniqueName: \"kubernetes.io/projected/1ca2fa3a-0931-4ac7-b562-e70c66a22120-kube-api-access-f9h57\") pod \"multus-additional-cni-plugins-xx7bf\" (UID: \"1ca2fa3a-0931-4ac7-b562-e70c66a22120\") " pod="openshift-multus/multus-additional-cni-plugins-xx7bf" Jul 09 02:34:16.748767 ip-10-0-138-136 kubenswrapper[2583]: I0709 02:34:16.695686 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/6d20c3fe-b459-4dbb-86a7-3903e967b424-konnectivity-ca\") pod \"konnectivity-agent-gszbq\" (UID: \"6d20c3fe-b459-4dbb-86a7-3903e967b424\") " pod="kube-system/konnectivity-agent-gszbq" Jul 09 02:34:16.748767 ip-10-0-138-136 kubenswrapper[2583]: I0709 02:34:16.695707 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/337d4063-36cf-4452-a1d3-4573f2517730-etc-sysconfig\") pod \"tuned-npfjp\" (UID: \"337d4063-36cf-4452-a1d3-4573f2517730\") " pod="openshift-cluster-node-tuning-operator/tuned-npfjp" Jul 09 02:34:16.748767 ip-10-0-138-136 kubenswrapper[2583]: I0709 02:34:16.695722 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/337d4063-36cf-4452-a1d3-4573f2517730-etc-systemd\") pod \"tuned-npfjp\" (UID: \"337d4063-36cf-4452-a1d3-4573f2517730\") " pod="openshift-cluster-node-tuning-operator/tuned-npfjp" Jul 09 02:34:16.748767 ip-10-0-138-136 kubenswrapper[2583]: I0709 02:34:16.695751 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/337d4063-36cf-4452-a1d3-4573f2517730-tmp\") pod \"tuned-npfjp\" (UID: \"337d4063-36cf-4452-a1d3-4573f2517730\") " pod="openshift-cluster-node-tuning-operator/tuned-npfjp" Jul 09 02:34:16.748767 ip-10-0-138-136 kubenswrapper[2583]: I0709 02:34:16.695773 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/337d4063-36cf-4452-a1d3-4573f2517730-etc-modprobe-d\") pod \"tuned-npfjp\" (UID: \"337d4063-36cf-4452-a1d3-4573f2517730\") " pod="openshift-cluster-node-tuning-operator/tuned-npfjp" Jul 09 02:34:16.748767 ip-10-0-138-136 kubenswrapper[2583]: I0709 02:34:16.695794 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/337d4063-36cf-4452-a1d3-4573f2517730-etc-sysctl-conf\") pod \"tuned-npfjp\" (UID: \"337d4063-36cf-4452-a1d3-4573f2517730\") " pod="openshift-cluster-node-tuning-operator/tuned-npfjp" Jul 09 02:34:16.748767 ip-10-0-138-136 kubenswrapper[2583]: I0709 02:34:16.695818 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/45541338-f2aa-4712-ba6f-8924e3513372-tmp-dir\") pod \"node-resolver-5mbtc\" (UID: \"45541338-f2aa-4712-ba6f-8924e3513372\") " pod="openshift-dns/node-resolver-5mbtc" Jul 09 02:34:16.748767 ip-10-0-138-136 kubenswrapper[2583]: I0709 02:34:16.695835 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/1ca2fa3a-0931-4ac7-b562-e70c66a22120-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-xx7bf\" (UID: \"1ca2fa3a-0931-4ac7-b562-e70c66a22120\") " pod="openshift-multus/multus-additional-cni-plugins-xx7bf" Jul 09 02:34:16.748767 ip-10-0-138-136 kubenswrapper[2583]: I0709 02:34:16.695850 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/337d4063-36cf-4452-a1d3-4573f2517730-lib-modules\") pod \"tuned-npfjp\" (UID: \"337d4063-36cf-4452-a1d3-4573f2517730\") " pod="openshift-cluster-node-tuning-operator/tuned-npfjp" Jul 09 02:34:16.748767 ip-10-0-138-136 kubenswrapper[2583]: I0709 02:34:16.695864 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/337d4063-36cf-4452-a1d3-4573f2517730-var-lib-kubelet\") pod \"tuned-npfjp\" (UID: \"337d4063-36cf-4452-a1d3-4573f2517730\") " pod="openshift-cluster-node-tuning-operator/tuned-npfjp" Jul 09 02:34:16.748767 ip-10-0-138-136 kubenswrapper[2583]: I0709 02:34:16.695881 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/1ca2fa3a-0931-4ac7-b562-e70c66a22120-tuning-conf-dir\") pod \"multus-additional-cni-plugins-xx7bf\" (UID: \"1ca2fa3a-0931-4ac7-b562-e70c66a22120\") " pod="openshift-multus/multus-additional-cni-plugins-xx7bf" Jul 09 02:34:16.748767 ip-10-0-138-136 kubenswrapper[2583]: I0709 02:34:16.695897 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-wwh6x\" (UniqueName: \"kubernetes.io/projected/d9f05741-1f97-4987-8158-4dbad6b22987-kube-api-access-wwh6x\") pod \"network-check-target-dkblh\" (UID: \"d9f05741-1f97-4987-8158-4dbad6b22987\") " pod="openshift-network-diagnostics/network-check-target-dkblh" Jul 09 02:34:16.748767 ip-10-0-138-136 kubenswrapper[2583]: I0709 02:34:16.695912 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/6d20c3fe-b459-4dbb-86a7-3903e967b424-agent-certs\") pod \"konnectivity-agent-gszbq\" (UID: \"6d20c3fe-b459-4dbb-86a7-3903e967b424\") " pod="kube-system/konnectivity-agent-gszbq" Jul 09 02:34:16.748767 ip-10-0-138-136 kubenswrapper[2583]: I0709 02:34:16.695927 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/45541338-f2aa-4712-ba6f-8924e3513372-hosts-file\") pod \"node-resolver-5mbtc\" (UID: \"45541338-f2aa-4712-ba6f-8924e3513372\") " pod="openshift-dns/node-resolver-5mbtc" Jul 09 02:34:16.748767 ip-10-0-138-136 kubenswrapper[2583]: I0709 02:34:16.695964 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/1ca2fa3a-0931-4ac7-b562-e70c66a22120-system-cni-dir\") pod \"multus-additional-cni-plugins-xx7bf\" (UID: \"1ca2fa3a-0931-4ac7-b562-e70c66a22120\") " pod="openshift-multus/multus-additional-cni-plugins-xx7bf" Jul 09 02:34:16.756037 ip-10-0-138-136 kubenswrapper[2583]: I0709 02:34:16.695988 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/337d4063-36cf-4452-a1d3-4573f2517730-etc-kubernetes\") pod \"tuned-npfjp\" (UID: \"337d4063-36cf-4452-a1d3-4573f2517730\") " pod="openshift-cluster-node-tuning-operator/tuned-npfjp" Jul 09 02:34:16.756037 ip-10-0-138-136 kubenswrapper[2583]: I0709 02:34:16.696012 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-5dszf\" (UniqueName: \"kubernetes.io/projected/337d4063-36cf-4452-a1d3-4573f2517730-kube-api-access-5dszf\") pod \"tuned-npfjp\" (UID: \"337d4063-36cf-4452-a1d3-4573f2517730\") " pod="openshift-cluster-node-tuning-operator/tuned-npfjp" Jul 09 02:34:16.756037 ip-10-0-138-136 kubenswrapper[2583]: I0709 02:34:16.696032 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/1ca2fa3a-0931-4ac7-b562-e70c66a22120-os-release\") pod \"multus-additional-cni-plugins-xx7bf\" (UID: \"1ca2fa3a-0931-4ac7-b562-e70c66a22120\") " pod="openshift-multus/multus-additional-cni-plugins-xx7bf" Jul 09 02:34:16.756037 ip-10-0-138-136 kubenswrapper[2583]: I0709 02:34:16.696046 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/337d4063-36cf-4452-a1d3-4573f2517730-host\") pod \"tuned-npfjp\" (UID: \"337d4063-36cf-4452-a1d3-4573f2517730\") " pod="openshift-cluster-node-tuning-operator/tuned-npfjp" Jul 09 02:34:16.756037 ip-10-0-138-136 kubenswrapper[2583]: I0709 02:34:16.696061 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/337d4063-36cf-4452-a1d3-4573f2517730-etc-tuned\") pod \"tuned-npfjp\" (UID: \"337d4063-36cf-4452-a1d3-4573f2517730\") " pod="openshift-cluster-node-tuning-operator/tuned-npfjp" Jul 09 02:34:16.756037 ip-10-0-138-136 kubenswrapper[2583]: I0709 02:34:16.696083 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/1ca2fa3a-0931-4ac7-b562-e70c66a22120-cni-binary-copy\") pod \"multus-additional-cni-plugins-xx7bf\" (UID: \"1ca2fa3a-0931-4ac7-b562-e70c66a22120\") " pod="openshift-multus/multus-additional-cni-plugins-xx7bf" Jul 09 02:34:16.756037 ip-10-0-138-136 kubenswrapper[2583]: I0709 02:34:16.696106 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/1ca2fa3a-0931-4ac7-b562-e70c66a22120-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-xx7bf\" (UID: \"1ca2fa3a-0931-4ac7-b562-e70c66a22120\") " pod="openshift-multus/multus-additional-cni-plugins-xx7bf" Jul 09 02:34:16.756037 ip-10-0-138-136 kubenswrapper[2583]: I0709 02:34:16.696123 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-dmqxq\" (UniqueName: \"kubernetes.io/projected/45541338-f2aa-4712-ba6f-8924e3513372-kube-api-access-dmqxq\") pod \"node-resolver-5mbtc\" (UID: \"45541338-f2aa-4712-ba6f-8924e3513372\") " pod="openshift-dns/node-resolver-5mbtc" Jul 09 02:34:16.756037 ip-10-0-138-136 kubenswrapper[2583]: I0709 02:34:16.696145 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run\" (UniqueName: \"kubernetes.io/host-path/337d4063-36cf-4452-a1d3-4573f2517730-run\") pod \"tuned-npfjp\" (UID: \"337d4063-36cf-4452-a1d3-4573f2517730\") " pod="openshift-cluster-node-tuning-operator/tuned-npfjp" Jul 09 02:34:16.756037 ip-10-0-138-136 kubenswrapper[2583]: I0709 02:34:16.696160 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/337d4063-36cf-4452-a1d3-4573f2517730-sys\") pod \"tuned-npfjp\" (UID: \"337d4063-36cf-4452-a1d3-4573f2517730\") " pod="openshift-cluster-node-tuning-operator/tuned-npfjp" Jul 09 02:34:16.756037 ip-10-0-138-136 kubenswrapper[2583]: I0709 02:34:16.696176 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/337d4063-36cf-4452-a1d3-4573f2517730-etc-sysctl-d\") pod \"tuned-npfjp\" (UID: \"337d4063-36cf-4452-a1d3-4573f2517730\") " pod="openshift-cluster-node-tuning-operator/tuned-npfjp" Jul 09 02:34:16.756037 ip-10-0-138-136 kubenswrapper[2583]: I0709 02:34:16.696319 2583 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/337d4063-36cf-4452-a1d3-4573f2517730-etc-sysctl-d\") pod \"tuned-npfjp\" (UID: \"337d4063-36cf-4452-a1d3-4573f2517730\") " pod="openshift-cluster-node-tuning-operator/tuned-npfjp" Jul 09 02:34:16.756037 ip-10-0-138-136 kubenswrapper[2583]: I0709 02:34:16.696353 2583 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/1ca2fa3a-0931-4ac7-b562-e70c66a22120-cnibin\") pod \"multus-additional-cni-plugins-xx7bf\" (UID: \"1ca2fa3a-0931-4ac7-b562-e70c66a22120\") " pod="openshift-multus/multus-additional-cni-plugins-xx7bf" Jul 09 02:34:16.756037 ip-10-0-138-136 kubenswrapper[2583]: I0709 02:34:16.697192 2583 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host\" (UniqueName: \"kubernetes.io/host-path/337d4063-36cf-4452-a1d3-4573f2517730-host\") pod \"tuned-npfjp\" (UID: \"337d4063-36cf-4452-a1d3-4573f2517730\") " pod="openshift-cluster-node-tuning-operator/tuned-npfjp" Jul 09 02:34:16.756037 ip-10-0-138-136 kubenswrapper[2583]: I0709 02:34:16.697226 2583 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/337d4063-36cf-4452-a1d3-4573f2517730-etc-kubernetes\") pod \"tuned-npfjp\" (UID: \"337d4063-36cf-4452-a1d3-4573f2517730\") " pod="openshift-cluster-node-tuning-operator/tuned-npfjp" Jul 09 02:34:16.756037 ip-10-0-138-136 kubenswrapper[2583]: I0709 02:34:16.697296 2583 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/45541338-f2aa-4712-ba6f-8924e3513372-hosts-file\") pod \"node-resolver-5mbtc\" (UID: \"45541338-f2aa-4712-ba6f-8924e3513372\") " pod="openshift-dns/node-resolver-5mbtc" Jul 09 02:34:16.756037 ip-10-0-138-136 kubenswrapper[2583]: I0709 02:34:16.697344 2583 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/1ca2fa3a-0931-4ac7-b562-e70c66a22120-system-cni-dir\") pod \"multus-additional-cni-plugins-xx7bf\" (UID: \"1ca2fa3a-0931-4ac7-b562-e70c66a22120\") " pod="openshift-multus/multus-additional-cni-plugins-xx7bf" Jul 09 02:34:16.757974 ip-10-0-138-136 kubenswrapper[2583]: I0709 02:34:16.697376 2583 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/1ca2fa3a-0931-4ac7-b562-e70c66a22120-os-release\") pod \"multus-additional-cni-plugins-xx7bf\" (UID: \"1ca2fa3a-0931-4ac7-b562-e70c66a22120\") " pod="openshift-multus/multus-additional-cni-plugins-xx7bf" Jul 09 02:34:16.757974 ip-10-0-138-136 kubenswrapper[2583]: I0709 02:34:16.697459 2583 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/337d4063-36cf-4452-a1d3-4573f2517730-etc-sysctl-conf\") pod \"tuned-npfjp\" (UID: \"337d4063-36cf-4452-a1d3-4573f2517730\") " pod="openshift-cluster-node-tuning-operator/tuned-npfjp" Jul 09 02:34:16.757974 ip-10-0-138-136 kubenswrapper[2583]: I0709 02:34:16.697476 2583 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/337d4063-36cf-4452-a1d3-4573f2517730-lib-modules\") pod \"tuned-npfjp\" (UID: \"337d4063-36cf-4452-a1d3-4573f2517730\") " pod="openshift-cluster-node-tuning-operator/tuned-npfjp" Jul 09 02:34:16.757974 ip-10-0-138-136 kubenswrapper[2583]: I0709 02:34:16.697521 2583 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/337d4063-36cf-4452-a1d3-4573f2517730-etc-systemd\") pod \"tuned-npfjp\" (UID: \"337d4063-36cf-4452-a1d3-4573f2517730\") " pod="openshift-cluster-node-tuning-operator/tuned-npfjp" Jul 09 02:34:16.757974 ip-10-0-138-136 kubenswrapper[2583]: I0709 02:34:16.697522 2583 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/337d4063-36cf-4452-a1d3-4573f2517730-etc-sysconfig\") pod \"tuned-npfjp\" (UID: \"337d4063-36cf-4452-a1d3-4573f2517730\") " pod="openshift-cluster-node-tuning-operator/tuned-npfjp" Jul 09 02:34:16.757974 ip-10-0-138-136 kubenswrapper[2583]: I0709 02:34:16.697764 2583 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/45541338-f2aa-4712-ba6f-8924e3513372-tmp-dir\") pod \"node-resolver-5mbtc\" (UID: \"45541338-f2aa-4712-ba6f-8924e3513372\") " pod="openshift-dns/node-resolver-5mbtc" Jul 09 02:34:16.757974 ip-10-0-138-136 kubenswrapper[2583]: I0709 02:34:16.698162 2583 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/337d4063-36cf-4452-a1d3-4573f2517730-etc-modprobe-d\") pod \"tuned-npfjp\" (UID: \"337d4063-36cf-4452-a1d3-4573f2517730\") " pod="openshift-cluster-node-tuning-operator/tuned-npfjp" Jul 09 02:34:16.757974 ip-10-0-138-136 kubenswrapper[2583]: I0709 02:34:16.698266 2583 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/1ca2fa3a-0931-4ac7-b562-e70c66a22120-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-xx7bf\" (UID: \"1ca2fa3a-0931-4ac7-b562-e70c66a22120\") " pod="openshift-multus/multus-additional-cni-plugins-xx7bf" Jul 09 02:34:16.757974 ip-10-0-138-136 kubenswrapper[2583]: I0709 02:34:16.698409 2583 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/1ca2fa3a-0931-4ac7-b562-e70c66a22120-tuning-conf-dir\") pod \"multus-additional-cni-plugins-xx7bf\" (UID: \"1ca2fa3a-0931-4ac7-b562-e70c66a22120\") " pod="openshift-multus/multus-additional-cni-plugins-xx7bf" Jul 09 02:34:16.757974 ip-10-0-138-136 kubenswrapper[2583]: I0709 02:34:16.698471 2583 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/337d4063-36cf-4452-a1d3-4573f2517730-var-lib-kubelet\") pod \"tuned-npfjp\" (UID: \"337d4063-36cf-4452-a1d3-4573f2517730\") " pod="openshift-cluster-node-tuning-operator/tuned-npfjp" Jul 09 02:34:16.757974 ip-10-0-138-136 kubenswrapper[2583]: I0709 02:34:16.698701 2583 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/6d20c3fe-b459-4dbb-86a7-3903e967b424-konnectivity-ca\") pod \"konnectivity-agent-gszbq\" (UID: \"6d20c3fe-b459-4dbb-86a7-3903e967b424\") " pod="kube-system/konnectivity-agent-gszbq" Jul 09 02:34:16.757974 ip-10-0-138-136 kubenswrapper[2583]: I0709 02:34:16.698769 2583 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"run\" (UniqueName: \"kubernetes.io/host-path/337d4063-36cf-4452-a1d3-4573f2517730-run\") pod \"tuned-npfjp\" (UID: \"337d4063-36cf-4452-a1d3-4573f2517730\") " pod="openshift-cluster-node-tuning-operator/tuned-npfjp" Jul 09 02:34:16.757974 ip-10-0-138-136 kubenswrapper[2583]: I0709 02:34:16.698893 2583 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/337d4063-36cf-4452-a1d3-4573f2517730-sys\") pod \"tuned-npfjp\" (UID: \"337d4063-36cf-4452-a1d3-4573f2517730\") " pod="openshift-cluster-node-tuning-operator/tuned-npfjp" Jul 09 02:34:16.757974 ip-10-0-138-136 kubenswrapper[2583]: I0709 02:34:16.699086 2583 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/1ca2fa3a-0931-4ac7-b562-e70c66a22120-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-xx7bf\" (UID: \"1ca2fa3a-0931-4ac7-b562-e70c66a22120\") " pod="openshift-multus/multus-additional-cni-plugins-xx7bf" Jul 09 02:34:16.757974 ip-10-0-138-136 kubenswrapper[2583]: I0709 02:34:16.699422 2583 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/1ca2fa3a-0931-4ac7-b562-e70c66a22120-cni-binary-copy\") pod \"multus-additional-cni-plugins-xx7bf\" (UID: \"1ca2fa3a-0931-4ac7-b562-e70c66a22120\") " pod="openshift-multus/multus-additional-cni-plugins-xx7bf" Jul 09 02:34:16.757974 ip-10-0-138-136 kubenswrapper[2583]: I0709 02:34:16.699893 2583 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/6d20c3fe-b459-4dbb-86a7-3903e967b424-agent-certs\") pod \"konnectivity-agent-gszbq\" (UID: \"6d20c3fe-b459-4dbb-86a7-3903e967b424\") " pod="kube-system/konnectivity-agent-gszbq" Jul 09 02:34:16.757974 ip-10-0-138-136 kubenswrapper[2583]: I0709 02:34:16.701301 2583 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/337d4063-36cf-4452-a1d3-4573f2517730-etc-tuned\") pod \"tuned-npfjp\" (UID: \"337d4063-36cf-4452-a1d3-4573f2517730\") " pod="openshift-cluster-node-tuning-operator/tuned-npfjp" Jul 09 02:34:16.757974 ip-10-0-138-136 kubenswrapper[2583]: I0709 02:34:16.701646 2583 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/337d4063-36cf-4452-a1d3-4573f2517730-tmp\") pod \"tuned-npfjp\" (UID: \"337d4063-36cf-4452-a1d3-4573f2517730\") " pod="openshift-cluster-node-tuning-operator/tuned-npfjp" Jul 09 02:34:16.761503 ip-10-0-138-136 kubenswrapper[2583]: E0709 02:34:16.707340 2583 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jul 09 02:34:16.761503 ip-10-0-138-136 kubenswrapper[2583]: E0709 02:34:16.707366 2583 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jul 09 02:34:16.761503 ip-10-0-138-136 kubenswrapper[2583]: E0709 02:34:16.707381 2583 projected.go:196] Error preparing data for projected volume kube-api-access-wwh6x for pod openshift-network-diagnostics/network-check-target-dkblh: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 09 02:34:16.761503 ip-10-0-138-136 kubenswrapper[2583]: E0709 02:34:16.707488 2583 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/d9f05741-1f97-4987-8158-4dbad6b22987-kube-api-access-wwh6x podName:d9f05741-1f97-4987-8158-4dbad6b22987 nodeName:}" failed. No retries permitted until 2026-07-09 02:34:17.207468657 +0000 UTC m=+3.139926141 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "kube-api-access-wwh6x" (UniqueName: "kubernetes.io/projected/d9f05741-1f97-4987-8158-4dbad6b22987-kube-api-access-wwh6x") pod "network-check-target-dkblh" (UID: "d9f05741-1f97-4987-8158-4dbad6b22987") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 09 02:34:16.761503 ip-10-0-138-136 kubenswrapper[2583]: I0709 02:34:16.711232 2583 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-f9h57\" (UniqueName: \"kubernetes.io/projected/1ca2fa3a-0931-4ac7-b562-e70c66a22120-kube-api-access-f9h57\") pod \"multus-additional-cni-plugins-xx7bf\" (UID: \"1ca2fa3a-0931-4ac7-b562-e70c66a22120\") " pod="openshift-multus/multus-additional-cni-plugins-xx7bf" Jul 09 02:34:16.761503 ip-10-0-138-136 kubenswrapper[2583]: I0709 02:34:16.712850 2583 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-5dszf\" (UniqueName: \"kubernetes.io/projected/337d4063-36cf-4452-a1d3-4573f2517730-kube-api-access-5dszf\") pod \"tuned-npfjp\" (UID: \"337d4063-36cf-4452-a1d3-4573f2517730\") " pod="openshift-cluster-node-tuning-operator/tuned-npfjp" Jul 09 02:34:16.761503 ip-10-0-138-136 kubenswrapper[2583]: I0709 02:34:16.720071 2583 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-dmqxq\" (UniqueName: \"kubernetes.io/projected/45541338-f2aa-4712-ba6f-8924e3513372-kube-api-access-dmqxq\") pod \"node-resolver-5mbtc\" (UID: \"45541338-f2aa-4712-ba6f-8924e3513372\") " pod="openshift-dns/node-resolver-5mbtc" Jul 09 02:34:16.775415 ip-10-0-138-136 kubenswrapper[2583]: I0709 02:34:16.775393 2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/node-ca-v86n2" Jul 09 02:34:16.786150 ip-10-0-138-136 kubenswrapper[2583]: I0709 02:34:16.785994 2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ovn-kubernetes/ovnkube-node-6gctz" Jul 09 02:34:16.846871 ip-10-0-138-136 kubenswrapper[2583]: I0709 02:34:16.846852 2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-operator/iptables-alerter-hc45j" Jul 09 02:34:16.851874 ip-10-0-138-136 kubenswrapper[2583]: I0709 02:34:16.851800 2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-6k6qn" Jul 09 02:34:16.861239 ip-10-0-138-136 kubenswrapper[2583]: W0709 02:34:16.861211 2583 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod34d08b11_e4c1_4bc4_bd00_2cbfc1720242.slice/crio-4e5ab1abb4af91838f9b29abef81770aa84b946cedc020539c6c09ec58780ed7 WatchSource:0}: Error finding container 4e5ab1abb4af91838f9b29abef81770aa84b946cedc020539c6c09ec58780ed7: Status 404 returned error can't find the container with id 4e5ab1abb4af91838f9b29abef81770aa84b946cedc020539c6c09ec58780ed7 Jul 09 02:34:16.862914 ip-10-0-138-136 kubenswrapper[2583]: I0709 02:34:16.862797 2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-q69lj" Jul 09 02:34:16.865641 ip-10-0-138-136 kubenswrapper[2583]: W0709 02:34:16.865614 2583 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podd507ebdd_e329_4392_986f_54b792047f9a.slice/crio-05e4e4e44a8cfc9d10b49fcd0a703f22916eef2dba2893df8ea70004740ef65a WatchSource:0}: Error finding container 05e4e4e44a8cfc9d10b49fcd0a703f22916eef2dba2893df8ea70004740ef65a: Status 404 returned error can't find the container with id 05e4e4e44a8cfc9d10b49fcd0a703f22916eef2dba2893df8ea70004740ef65a Jul 09 02:34:16.871134 ip-10-0-138-136 kubenswrapper[2583]: I0709 02:34:16.871113 2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-additional-cni-plugins-xx7bf" Jul 09 02:34:16.875302 ip-10-0-138-136 kubenswrapper[2583]: W0709 02:34:16.875280 2583 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod9b793225_5bd6_4bf7_a87e_d42bf8c939f7.slice/crio-a6e881de70515bd40a1ab2f7ec551957a37d75ca8bb694ebb545ac5c75f9cf2a WatchSource:0}: Error finding container a6e881de70515bd40a1ab2f7ec551957a37d75ca8bb694ebb545ac5c75f9cf2a: Status 404 returned error can't find the container with id a6e881de70515bd40a1ab2f7ec551957a37d75ca8bb694ebb545ac5c75f9cf2a Jul 09 02:34:16.879082 ip-10-0-138-136 kubenswrapper[2583]: I0709 02:34:16.878979 2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/konnectivity-agent-gszbq" Jul 09 02:34:16.887433 ip-10-0-138-136 kubenswrapper[2583]: I0709 02:34:16.887293 2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-node-tuning-operator/tuned-npfjp" Jul 09 02:34:16.892491 ip-10-0-138-136 kubenswrapper[2583]: W0709 02:34:16.892463 2583 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod1ca2fa3a_0931_4ac7_b562_e70c66a22120.slice/crio-4be7b532af41df4ee7f3bf93448cfbed2b6df5e09ebe3362ee9e20b19fccd244 WatchSource:0}: Error finding container 4be7b532af41df4ee7f3bf93448cfbed2b6df5e09ebe3362ee9e20b19fccd244: Status 404 returned error can't find the container with id 4be7b532af41df4ee7f3bf93448cfbed2b6df5e09ebe3362ee9e20b19fccd244 Jul 09 02:34:16.895240 ip-10-0-138-136 kubenswrapper[2583]: I0709 02:34:16.894886 2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/node-resolver-5mbtc" Jul 09 02:34:16.896626 ip-10-0-138-136 kubenswrapper[2583]: W0709 02:34:16.896601 2583 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod6d20c3fe_b459_4dbb_86a7_3903e967b424.slice/crio-03d623fbcb8d07df422355b2d513fe8910ee6a9e40d8ac5a487fc6a0e11bff2f WatchSource:0}: Error finding container 03d623fbcb8d07df422355b2d513fe8910ee6a9e40d8ac5a487fc6a0e11bff2f: Status 404 returned error can't find the container with id 03d623fbcb8d07df422355b2d513fe8910ee6a9e40d8ac5a487fc6a0e11bff2f Jul 09 02:34:16.899283 ip-10-0-138-136 kubenswrapper[2583]: W0709 02:34:16.899258 2583 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod337d4063_36cf_4452_a1d3_4573f2517730.slice/crio-c58a05dbb2ebc9087280db47afbb7b0878fad6b4696ca6f27052090cacf44e3d WatchSource:0}: Error finding container c58a05dbb2ebc9087280db47afbb7b0878fad6b4696ca6f27052090cacf44e3d: Status 404 returned error can't find the container with id c58a05dbb2ebc9087280db47afbb7b0878fad6b4696ca6f27052090cacf44e3d Jul 09 02:34:16.908577 ip-10-0-138-136 kubenswrapper[2583]: W0709 02:34:16.908553 2583 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod45541338_f2aa_4712_ba6f_8924e3513372.slice/crio-e96c72d83f0353374af66530db542ade2e02516b5608df263618c9efeb5e8f86 WatchSource:0}: Error finding container e96c72d83f0353374af66530db542ade2e02516b5608df263618c9efeb5e8f86: Status 404 returned error can't find the container with id e96c72d83f0353374af66530db542ade2e02516b5608df263618c9efeb5e8f86 Jul 09 02:34:17.099397 ip-10-0-138-136 kubenswrapper[2583]: I0709 02:34:17.099363 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/4133cf72-5672-4d5e-b6dd-70e32b953216-original-pull-secret\") pod \"global-pull-secret-syncer-sv26w\" (UID: \"4133cf72-5672-4d5e-b6dd-70e32b953216\") " pod="kube-system/global-pull-secret-syncer-sv26w" Jul 09 02:34:17.099558 ip-10-0-138-136 kubenswrapper[2583]: I0709 02:34:17.099438 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/71cf0a89-d676-47f4-bf4a-d13d283493fc-metrics-certs\") pod \"network-metrics-daemon-rdtdt\" (UID: \"71cf0a89-d676-47f4-bf4a-d13d283493fc\") " pod="openshift-multus/network-metrics-daemon-rdtdt" Jul 09 02:34:17.099558 ip-10-0-138-136 kubenswrapper[2583]: E0709 02:34:17.099529 2583 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jul 09 02:34:17.099687 ip-10-0-138-136 kubenswrapper[2583]: E0709 02:34:17.099569 2583 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jul 09 02:34:17.099687 ip-10-0-138-136 kubenswrapper[2583]: E0709 02:34:17.099633 2583 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/4133cf72-5672-4d5e-b6dd-70e32b953216-original-pull-secret podName:4133cf72-5672-4d5e-b6dd-70e32b953216 nodeName:}" failed. No retries permitted until 2026-07-09 02:34:18.099605836 +0000 UTC m=+4.032063368 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/4133cf72-5672-4d5e-b6dd-70e32b953216-original-pull-secret") pod "global-pull-secret-syncer-sv26w" (UID: "4133cf72-5672-4d5e-b6dd-70e32b953216") : object "kube-system"/"original-pull-secret" not registered Jul 09 02:34:17.099687 ip-10-0-138-136 kubenswrapper[2583]: E0709 02:34:17.099661 2583 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/71cf0a89-d676-47f4-bf4a-d13d283493fc-metrics-certs podName:71cf0a89-d676-47f4-bf4a-d13d283493fc nodeName:}" failed. No retries permitted until 2026-07-09 02:34:18.099649092 +0000 UTC m=+4.032106565 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/71cf0a89-d676-47f4-bf4a-d13d283493fc-metrics-certs") pod "network-metrics-daemon-rdtdt" (UID: "71cf0a89-d676-47f4-bf4a-d13d283493fc") : object "openshift-multus"/"metrics-daemon-secret" not registered Jul 09 02:34:17.301712 ip-10-0-138-136 kubenswrapper[2583]: I0709 02:34:17.301625 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-wwh6x\" (UniqueName: \"kubernetes.io/projected/d9f05741-1f97-4987-8158-4dbad6b22987-kube-api-access-wwh6x\") pod \"network-check-target-dkblh\" (UID: \"d9f05741-1f97-4987-8158-4dbad6b22987\") " pod="openshift-network-diagnostics/network-check-target-dkblh" Jul 09 02:34:17.301885 ip-10-0-138-136 kubenswrapper[2583]: E0709 02:34:17.301837 2583 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jul 09 02:34:17.301885 ip-10-0-138-136 kubenswrapper[2583]: E0709 02:34:17.301864 2583 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jul 09 02:34:17.301885 ip-10-0-138-136 kubenswrapper[2583]: E0709 02:34:17.301876 2583 projected.go:196] Error preparing data for projected volume kube-api-access-wwh6x for pod openshift-network-diagnostics/network-check-target-dkblh: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 09 02:34:17.302054 ip-10-0-138-136 kubenswrapper[2583]: E0709 02:34:17.301947 2583 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/d9f05741-1f97-4987-8158-4dbad6b22987-kube-api-access-wwh6x podName:d9f05741-1f97-4987-8158-4dbad6b22987 nodeName:}" failed. No retries permitted until 2026-07-09 02:34:18.301925704 +0000 UTC m=+4.234383172 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "kube-api-access-wwh6x" (UniqueName: "kubernetes.io/projected/d9f05741-1f97-4987-8158-4dbad6b22987-kube-api-access-wwh6x") pod "network-check-target-dkblh" (UID: "d9f05741-1f97-4987-8158-4dbad6b22987") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 09 02:34:17.522164 ip-10-0-138-136 kubenswrapper[2583]: I0709 02:34:17.522115 2583 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kubelet-serving" expiration="2028-07-08 02:29:17 +0000 UTC" deadline="2028-02-01 23:24:10.427195821 +0000 UTC" Jul 09 02:34:17.522164 ip-10-0-138-136 kubenswrapper[2583]: I0709 02:34:17.522158 2583 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kubelet-serving" sleep="13748h49m52.905043354s" Jul 09 02:34:17.624773 ip-10-0-138-136 kubenswrapper[2583]: I0709 02:34:17.624676 2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-xx7bf" event={"ID":"1ca2fa3a-0931-4ac7-b562-e70c66a22120","Type":"ContainerStarted","Data":"4be7b532af41df4ee7f3bf93448cfbed2b6df5e09ebe3362ee9e20b19fccd244"} Jul 09 02:34:17.626117 ip-10-0-138-136 kubenswrapper[2583]: I0709 02:34:17.626084 2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-6k6qn" event={"ID":"d507ebdd-e329-4392-986f-54b792047f9a","Type":"ContainerStarted","Data":"05e4e4e44a8cfc9d10b49fcd0a703f22916eef2dba2893df8ea70004740ef65a"} Jul 09 02:34:17.627540 ip-10-0-138-136 kubenswrapper[2583]: I0709 02:34:17.627515 2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-6gctz" event={"ID":"ab715167-aa61-46be-bbe1-36212c9aa180","Type":"ContainerStarted","Data":"43cf189a9c8d827e90788d7378254a3a4793ff98c889e836895a7aeb7e36409c"} Jul 09 02:34:17.628874 ip-10-0-138-136 kubenswrapper[2583]: I0709 02:34:17.628839 2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/node-ca-v86n2" event={"ID":"6cdfd2a0-46af-4734-9735-7408f8439c96","Type":"ContainerStarted","Data":"b0a28183ea89057e4781cb66d8f1fcffbb8dc3e8112ff1ed0a7d41b5c1c27920"} Jul 09 02:34:17.630386 ip-10-0-138-136 kubenswrapper[2583]: I0709 02:34:17.630355 2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-node-tuning-operator/tuned-npfjp" event={"ID":"337d4063-36cf-4452-a1d3-4573f2517730","Type":"ContainerStarted","Data":"c58a05dbb2ebc9087280db47afbb7b0878fad6b4696ca6f27052090cacf44e3d"} Jul 09 02:34:17.632004 ip-10-0-138-136 kubenswrapper[2583]: I0709 02:34:17.631979 2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/konnectivity-agent-gszbq" event={"ID":"6d20c3fe-b459-4dbb-86a7-3903e967b424","Type":"ContainerStarted","Data":"03d623fbcb8d07df422355b2d513fe8910ee6a9e40d8ac5a487fc6a0e11bff2f"} Jul 09 02:34:17.633349 ip-10-0-138-136 kubenswrapper[2583]: I0709 02:34:17.633323 2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-q69lj" event={"ID":"9b793225-5bd6-4bf7-a87e-d42bf8c939f7","Type":"ContainerStarted","Data":"a6e881de70515bd40a1ab2f7ec551957a37d75ca8bb694ebb545ac5c75f9cf2a"} Jul 09 02:34:17.634955 ip-10-0-138-136 kubenswrapper[2583]: I0709 02:34:17.634923 2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-operator/iptables-alerter-hc45j" event={"ID":"34d08b11-e4c1-4bc4-bd00-2cbfc1720242","Type":"ContainerStarted","Data":"4e5ab1abb4af91838f9b29abef81770aa84b946cedc020539c6c09ec58780ed7"} Jul 09 02:34:17.636166 ip-10-0-138-136 kubenswrapper[2583]: I0709 02:34:17.636141 2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/node-resolver-5mbtc" event={"ID":"45541338-f2aa-4712-ba6f-8924e3513372","Type":"ContainerStarted","Data":"e96c72d83f0353374af66530db542ade2e02516b5608df263618c9efeb5e8f86"} Jul 09 02:34:18.107839 ip-10-0-138-136 kubenswrapper[2583]: I0709 02:34:18.107763 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/4133cf72-5672-4d5e-b6dd-70e32b953216-original-pull-secret\") pod \"global-pull-secret-syncer-sv26w\" (UID: \"4133cf72-5672-4d5e-b6dd-70e32b953216\") " pod="kube-system/global-pull-secret-syncer-sv26w" Jul 09 02:34:18.107839 ip-10-0-138-136 kubenswrapper[2583]: I0709 02:34:18.107831 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/71cf0a89-d676-47f4-bf4a-d13d283493fc-metrics-certs\") pod \"network-metrics-daemon-rdtdt\" (UID: \"71cf0a89-d676-47f4-bf4a-d13d283493fc\") " pod="openshift-multus/network-metrics-daemon-rdtdt" Jul 09 02:34:18.108040 ip-10-0-138-136 kubenswrapper[2583]: E0709 02:34:18.107946 2583 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jul 09 02:34:18.108040 ip-10-0-138-136 kubenswrapper[2583]: E0709 02:34:18.108005 2583 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/71cf0a89-d676-47f4-bf4a-d13d283493fc-metrics-certs podName:71cf0a89-d676-47f4-bf4a-d13d283493fc nodeName:}" failed. No retries permitted until 2026-07-09 02:34:20.107985812 +0000 UTC m=+6.040443297 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/71cf0a89-d676-47f4-bf4a-d13d283493fc-metrics-certs") pod "network-metrics-daemon-rdtdt" (UID: "71cf0a89-d676-47f4-bf4a-d13d283493fc") : object "openshift-multus"/"metrics-daemon-secret" not registered Jul 09 02:34:18.108450 ip-10-0-138-136 kubenswrapper[2583]: E0709 02:34:18.108421 2583 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jul 09 02:34:18.108563 ip-10-0-138-136 kubenswrapper[2583]: E0709 02:34:18.108499 2583 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/4133cf72-5672-4d5e-b6dd-70e32b953216-original-pull-secret podName:4133cf72-5672-4d5e-b6dd-70e32b953216 nodeName:}" failed. No retries permitted until 2026-07-09 02:34:20.108480247 +0000 UTC m=+6.040937714 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/4133cf72-5672-4d5e-b6dd-70e32b953216-original-pull-secret") pod "global-pull-secret-syncer-sv26w" (UID: "4133cf72-5672-4d5e-b6dd-70e32b953216") : object "kube-system"/"original-pull-secret" not registered Jul 09 02:34:18.309724 ip-10-0-138-136 kubenswrapper[2583]: I0709 02:34:18.309690 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-wwh6x\" (UniqueName: \"kubernetes.io/projected/d9f05741-1f97-4987-8158-4dbad6b22987-kube-api-access-wwh6x\") pod \"network-check-target-dkblh\" (UID: \"d9f05741-1f97-4987-8158-4dbad6b22987\") " pod="openshift-network-diagnostics/network-check-target-dkblh" Jul 09 02:34:18.309917 ip-10-0-138-136 kubenswrapper[2583]: E0709 02:34:18.309899 2583 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jul 09 02:34:18.309999 ip-10-0-138-136 kubenswrapper[2583]: E0709 02:34:18.309925 2583 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jul 09 02:34:18.309999 ip-10-0-138-136 kubenswrapper[2583]: E0709 02:34:18.309939 2583 projected.go:196] Error preparing data for projected volume kube-api-access-wwh6x for pod openshift-network-diagnostics/network-check-target-dkblh: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 09 02:34:18.310108 ip-10-0-138-136 kubenswrapper[2583]: E0709 02:34:18.310002 2583 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/d9f05741-1f97-4987-8158-4dbad6b22987-kube-api-access-wwh6x podName:d9f05741-1f97-4987-8158-4dbad6b22987 nodeName:}" failed. No retries permitted until 2026-07-09 02:34:20.309982975 +0000 UTC m=+6.242440459 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "kube-api-access-wwh6x" (UniqueName: "kubernetes.io/projected/d9f05741-1f97-4987-8158-4dbad6b22987-kube-api-access-wwh6x") pod "network-check-target-dkblh" (UID: "d9f05741-1f97-4987-8158-4dbad6b22987") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 09 02:34:18.523274 ip-10-0-138-136 kubenswrapper[2583]: I0709 02:34:18.523141 2583 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kubelet-serving" expiration="2028-07-08 02:29:17 +0000 UTC" deadline="2028-01-31 13:27:36.934167645 +0000 UTC" Jul 09 02:34:18.523274 ip-10-0-138-136 kubenswrapper[2583]: I0709 02:34:18.523200 2583 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kubelet-serving" sleep="13714h53m18.41097154s" Jul 09 02:34:18.600197 ip-10-0-138-136 kubenswrapper[2583]: I0709 02:34:18.599332 2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-sv26w" Jul 09 02:34:18.600197 ip-10-0-138-136 kubenswrapper[2583]: E0709 02:34:18.599462 2583 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-sv26w" podUID="4133cf72-5672-4d5e-b6dd-70e32b953216" Jul 09 02:34:18.600197 ip-10-0-138-136 kubenswrapper[2583]: I0709 02:34:18.599910 2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-rdtdt" Jul 09 02:34:18.600197 ip-10-0-138-136 kubenswrapper[2583]: E0709 02:34:18.600017 2583 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-rdtdt" podUID="71cf0a89-d676-47f4-bf4a-d13d283493fc" Jul 09 02:34:18.600197 ip-10-0-138-136 kubenswrapper[2583]: I0709 02:34:18.600088 2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-dkblh" Jul 09 02:34:18.600197 ip-10-0-138-136 kubenswrapper[2583]: E0709 02:34:18.600161 2583 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-dkblh" podUID="d9f05741-1f97-4987-8158-4dbad6b22987" Jul 09 02:34:19.651640 ip-10-0-138-136 kubenswrapper[2583]: I0709 02:34:19.651369 2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-138-136.ec2.internal" event={"ID":"04454d06c2f086e47f91e8c63bb8c939","Type":"ContainerStarted","Data":"2ff7c9bae76d7b37851528566d6252ffd5be35840d5e61d01416d3b39f129372"} Jul 09 02:34:20.126859 ip-10-0-138-136 kubenswrapper[2583]: I0709 02:34:20.126774 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/71cf0a89-d676-47f4-bf4a-d13d283493fc-metrics-certs\") pod \"network-metrics-daemon-rdtdt\" (UID: \"71cf0a89-d676-47f4-bf4a-d13d283493fc\") " pod="openshift-multus/network-metrics-daemon-rdtdt" Jul 09 02:34:20.127029 ip-10-0-138-136 kubenswrapper[2583]: I0709 02:34:20.126860 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/4133cf72-5672-4d5e-b6dd-70e32b953216-original-pull-secret\") pod \"global-pull-secret-syncer-sv26w\" (UID: \"4133cf72-5672-4d5e-b6dd-70e32b953216\") " pod="kube-system/global-pull-secret-syncer-sv26w" Jul 09 02:34:20.127029 ip-10-0-138-136 kubenswrapper[2583]: E0709 02:34:20.126986 2583 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jul 09 02:34:20.127150 ip-10-0-138-136 kubenswrapper[2583]: E0709 02:34:20.127050 2583 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/4133cf72-5672-4d5e-b6dd-70e32b953216-original-pull-secret podName:4133cf72-5672-4d5e-b6dd-70e32b953216 nodeName:}" failed. No retries permitted until 2026-07-09 02:34:24.12702877 +0000 UTC m=+10.059486246 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/4133cf72-5672-4d5e-b6dd-70e32b953216-original-pull-secret") pod "global-pull-secret-syncer-sv26w" (UID: "4133cf72-5672-4d5e-b6dd-70e32b953216") : object "kube-system"/"original-pull-secret" not registered Jul 09 02:34:20.127460 ip-10-0-138-136 kubenswrapper[2583]: E0709 02:34:20.127440 2583 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jul 09 02:34:20.127552 ip-10-0-138-136 kubenswrapper[2583]: E0709 02:34:20.127498 2583 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/71cf0a89-d676-47f4-bf4a-d13d283493fc-metrics-certs podName:71cf0a89-d676-47f4-bf4a-d13d283493fc nodeName:}" failed. No retries permitted until 2026-07-09 02:34:24.127482423 +0000 UTC m=+10.059939892 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/71cf0a89-d676-47f4-bf4a-d13d283493fc-metrics-certs") pod "network-metrics-daemon-rdtdt" (UID: "71cf0a89-d676-47f4-bf4a-d13d283493fc") : object "openshift-multus"/"metrics-daemon-secret" not registered Jul 09 02:34:20.329180 ip-10-0-138-136 kubenswrapper[2583]: I0709 02:34:20.329141 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-wwh6x\" (UniqueName: \"kubernetes.io/projected/d9f05741-1f97-4987-8158-4dbad6b22987-kube-api-access-wwh6x\") pod \"network-check-target-dkblh\" (UID: \"d9f05741-1f97-4987-8158-4dbad6b22987\") " pod="openshift-network-diagnostics/network-check-target-dkblh" Jul 09 02:34:20.329381 ip-10-0-138-136 kubenswrapper[2583]: E0709 02:34:20.329358 2583 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jul 09 02:34:20.329453 ip-10-0-138-136 kubenswrapper[2583]: E0709 02:34:20.329384 2583 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jul 09 02:34:20.329453 ip-10-0-138-136 kubenswrapper[2583]: E0709 02:34:20.329397 2583 projected.go:196] Error preparing data for projected volume kube-api-access-wwh6x for pod openshift-network-diagnostics/network-check-target-dkblh: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 09 02:34:20.329560 ip-10-0-138-136 kubenswrapper[2583]: E0709 02:34:20.329455 2583 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/d9f05741-1f97-4987-8158-4dbad6b22987-kube-api-access-wwh6x podName:d9f05741-1f97-4987-8158-4dbad6b22987 nodeName:}" failed. No retries permitted until 2026-07-09 02:34:24.329436416 +0000 UTC m=+10.261893900 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "kube-api-access-wwh6x" (UniqueName: "kubernetes.io/projected/d9f05741-1f97-4987-8158-4dbad6b22987-kube-api-access-wwh6x") pod "network-check-target-dkblh" (UID: "d9f05741-1f97-4987-8158-4dbad6b22987") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 09 02:34:20.597557 ip-10-0-138-136 kubenswrapper[2583]: I0709 02:34:20.597472 2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-sv26w" Jul 09 02:34:20.597557 ip-10-0-138-136 kubenswrapper[2583]: I0709 02:34:20.597502 2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-rdtdt" Jul 09 02:34:20.597806 ip-10-0-138-136 kubenswrapper[2583]: I0709 02:34:20.597488 2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-dkblh" Jul 09 02:34:20.597806 ip-10-0-138-136 kubenswrapper[2583]: E0709 02:34:20.597614 2583 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-sv26w" podUID="4133cf72-5672-4d5e-b6dd-70e32b953216" Jul 09 02:34:20.597806 ip-10-0-138-136 kubenswrapper[2583]: E0709 02:34:20.597699 2583 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-dkblh" podUID="d9f05741-1f97-4987-8158-4dbad6b22987" Jul 09 02:34:20.597964 ip-10-0-138-136 kubenswrapper[2583]: E0709 02:34:20.597880 2583 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-rdtdt" podUID="71cf0a89-d676-47f4-bf4a-d13d283493fc" Jul 09 02:34:20.658755 ip-10-0-138-136 kubenswrapper[2583]: I0709 02:34:20.658724 2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-138-136.ec2.internal" event={"ID":"1f563ddc813ab6d8fd08536b68d33fae","Type":"ContainerStarted","Data":"c31db854eeb7e7717f5b5a887c180fd20da59128fe6bb257219d5e4045482d03"} Jul 09 02:34:20.674802 ip-10-0-138-136 kubenswrapper[2583]: I0709 02:34:20.674309 2583 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/kube-apiserver-proxy-ip-10-0-138-136.ec2.internal" podStartSLOduration=4.6742904 podStartE2EDuration="4.6742904s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-09 02:34:16 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-09 02:34:19.672944537 +0000 UTC m=+5.605402028" watchObservedRunningTime="2026-07-09 02:34:20.6742904 +0000 UTC m=+6.606747899" Jul 09 02:34:21.663160 ip-10-0-138-136 kubenswrapper[2583]: I0709 02:34:21.663123 2583 generic.go:356] "Generic (PLEG): container finished" podID="1f563ddc813ab6d8fd08536b68d33fae" containerID="c31db854eeb7e7717f5b5a887c180fd20da59128fe6bb257219d5e4045482d03" exitCode=0 Jul 09 02:34:21.663636 ip-10-0-138-136 kubenswrapper[2583]: I0709 02:34:21.663182 2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-138-136.ec2.internal" event={"ID":"1f563ddc813ab6d8fd08536b68d33fae","Type":"ContainerDied","Data":"c31db854eeb7e7717f5b5a887c180fd20da59128fe6bb257219d5e4045482d03"} Jul 09 02:34:22.600569 ip-10-0-138-136 kubenswrapper[2583]: I0709 02:34:22.600537 2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-dkblh" Jul 09 02:34:22.600569 ip-10-0-138-136 kubenswrapper[2583]: I0709 02:34:22.600562 2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-rdtdt" Jul 09 02:34:22.600830 ip-10-0-138-136 kubenswrapper[2583]: I0709 02:34:22.600537 2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-sv26w" Jul 09 02:34:22.600830 ip-10-0-138-136 kubenswrapper[2583]: E0709 02:34:22.600697 2583 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-rdtdt" podUID="71cf0a89-d676-47f4-bf4a-d13d283493fc" Jul 09 02:34:22.600830 ip-10-0-138-136 kubenswrapper[2583]: E0709 02:34:22.600767 2583 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-sv26w" podUID="4133cf72-5672-4d5e-b6dd-70e32b953216" Jul 09 02:34:22.601002 ip-10-0-138-136 kubenswrapper[2583]: E0709 02:34:22.600836 2583 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-dkblh" podUID="d9f05741-1f97-4987-8158-4dbad6b22987" Jul 09 02:34:24.159952 ip-10-0-138-136 kubenswrapper[2583]: I0709 02:34:24.159919 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/4133cf72-5672-4d5e-b6dd-70e32b953216-original-pull-secret\") pod \"global-pull-secret-syncer-sv26w\" (UID: \"4133cf72-5672-4d5e-b6dd-70e32b953216\") " pod="kube-system/global-pull-secret-syncer-sv26w" Jul 09 02:34:24.160410 ip-10-0-138-136 kubenswrapper[2583]: I0709 02:34:24.159981 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/71cf0a89-d676-47f4-bf4a-d13d283493fc-metrics-certs\") pod \"network-metrics-daemon-rdtdt\" (UID: \"71cf0a89-d676-47f4-bf4a-d13d283493fc\") " pod="openshift-multus/network-metrics-daemon-rdtdt" Jul 09 02:34:24.160410 ip-10-0-138-136 kubenswrapper[2583]: E0709 02:34:24.160085 2583 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jul 09 02:34:24.160410 ip-10-0-138-136 kubenswrapper[2583]: E0709 02:34:24.160149 2583 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/4133cf72-5672-4d5e-b6dd-70e32b953216-original-pull-secret podName:4133cf72-5672-4d5e-b6dd-70e32b953216 nodeName:}" failed. No retries permitted until 2026-07-09 02:34:32.160134107 +0000 UTC m=+18.092591575 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/4133cf72-5672-4d5e-b6dd-70e32b953216-original-pull-secret") pod "global-pull-secret-syncer-sv26w" (UID: "4133cf72-5672-4d5e-b6dd-70e32b953216") : object "kube-system"/"original-pull-secret" not registered Jul 09 02:34:24.160410 ip-10-0-138-136 kubenswrapper[2583]: E0709 02:34:24.160085 2583 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jul 09 02:34:24.160410 ip-10-0-138-136 kubenswrapper[2583]: E0709 02:34:24.160192 2583 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/71cf0a89-d676-47f4-bf4a-d13d283493fc-metrics-certs podName:71cf0a89-d676-47f4-bf4a-d13d283493fc nodeName:}" failed. No retries permitted until 2026-07-09 02:34:32.160180351 +0000 UTC m=+18.092637816 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/71cf0a89-d676-47f4-bf4a-d13d283493fc-metrics-certs") pod "network-metrics-daemon-rdtdt" (UID: "71cf0a89-d676-47f4-bf4a-d13d283493fc") : object "openshift-multus"/"metrics-daemon-secret" not registered Jul 09 02:34:24.362503 ip-10-0-138-136 kubenswrapper[2583]: I0709 02:34:24.361803 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-wwh6x\" (UniqueName: \"kubernetes.io/projected/d9f05741-1f97-4987-8158-4dbad6b22987-kube-api-access-wwh6x\") pod \"network-check-target-dkblh\" (UID: \"d9f05741-1f97-4987-8158-4dbad6b22987\") " pod="openshift-network-diagnostics/network-check-target-dkblh" Jul 09 02:34:24.362503 ip-10-0-138-136 kubenswrapper[2583]: E0709 02:34:24.362046 2583 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jul 09 02:34:24.362503 ip-10-0-138-136 kubenswrapper[2583]: E0709 02:34:24.362073 2583 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jul 09 02:34:24.362503 ip-10-0-138-136 kubenswrapper[2583]: E0709 02:34:24.362088 2583 projected.go:196] Error preparing data for projected volume kube-api-access-wwh6x for pod openshift-network-diagnostics/network-check-target-dkblh: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 09 02:34:24.362503 ip-10-0-138-136 kubenswrapper[2583]: E0709 02:34:24.362156 2583 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/d9f05741-1f97-4987-8158-4dbad6b22987-kube-api-access-wwh6x podName:d9f05741-1f97-4987-8158-4dbad6b22987 nodeName:}" failed. No retries permitted until 2026-07-09 02:34:32.362129056 +0000 UTC m=+18.294586528 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "kube-api-access-wwh6x" (UniqueName: "kubernetes.io/projected/d9f05741-1f97-4987-8158-4dbad6b22987-kube-api-access-wwh6x") pod "network-check-target-dkblh" (UID: "d9f05741-1f97-4987-8158-4dbad6b22987") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 09 02:34:24.597942 ip-10-0-138-136 kubenswrapper[2583]: I0709 02:34:24.597864 2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-sv26w" Jul 09 02:34:24.598098 ip-10-0-138-136 kubenswrapper[2583]: I0709 02:34:24.597978 2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-dkblh" Jul 09 02:34:24.598098 ip-10-0-138-136 kubenswrapper[2583]: I0709 02:34:24.598014 2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-rdtdt" Jul 09 02:34:24.598220 ip-10-0-138-136 kubenswrapper[2583]: E0709 02:34:24.598085 2583 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-sv26w" podUID="4133cf72-5672-4d5e-b6dd-70e32b953216" Jul 09 02:34:24.598220 ip-10-0-138-136 kubenswrapper[2583]: E0709 02:34:24.598108 2583 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-rdtdt" podUID="71cf0a89-d676-47f4-bf4a-d13d283493fc" Jul 09 02:34:24.598220 ip-10-0-138-136 kubenswrapper[2583]: E0709 02:34:24.598188 2583 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-dkblh" podUID="d9f05741-1f97-4987-8158-4dbad6b22987" Jul 09 02:34:26.596693 ip-10-0-138-136 kubenswrapper[2583]: I0709 02:34:26.596654 2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-dkblh" Jul 09 02:34:26.597214 ip-10-0-138-136 kubenswrapper[2583]: I0709 02:34:26.596655 2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-rdtdt" Jul 09 02:34:26.597214 ip-10-0-138-136 kubenswrapper[2583]: I0709 02:34:26.596836 2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-sv26w" Jul 09 02:34:26.597214 ip-10-0-138-136 kubenswrapper[2583]: E0709 02:34:26.596803 2583 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-dkblh" podUID="d9f05741-1f97-4987-8158-4dbad6b22987" Jul 09 02:34:26.597214 ip-10-0-138-136 kubenswrapper[2583]: E0709 02:34:26.596946 2583 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-rdtdt" podUID="71cf0a89-d676-47f4-bf4a-d13d283493fc" Jul 09 02:34:26.597214 ip-10-0-138-136 kubenswrapper[2583]: E0709 02:34:26.597031 2583 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-sv26w" podUID="4133cf72-5672-4d5e-b6dd-70e32b953216" Jul 09 02:34:28.598858 ip-10-0-138-136 kubenswrapper[2583]: I0709 02:34:28.598834 2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-sv26w" Jul 09 02:34:28.599275 ip-10-0-138-136 kubenswrapper[2583]: E0709 02:34:28.598962 2583 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-sv26w" podUID="4133cf72-5672-4d5e-b6dd-70e32b953216" Jul 09 02:34:28.599275 ip-10-0-138-136 kubenswrapper[2583]: I0709 02:34:28.599025 2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-dkblh" Jul 09 02:34:28.599275 ip-10-0-138-136 kubenswrapper[2583]: E0709 02:34:28.599099 2583 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-dkblh" podUID="d9f05741-1f97-4987-8158-4dbad6b22987" Jul 09 02:34:28.599275 ip-10-0-138-136 kubenswrapper[2583]: I0709 02:34:28.599153 2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-rdtdt" Jul 09 02:34:28.599275 ip-10-0-138-136 kubenswrapper[2583]: E0709 02:34:28.599242 2583 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-rdtdt" podUID="71cf0a89-d676-47f4-bf4a-d13d283493fc" Jul 09 02:34:28.680210 ip-10-0-138-136 kubenswrapper[2583]: I0709 02:34:28.679933 2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-node-tuning-operator/tuned-npfjp" event={"ID":"337d4063-36cf-4452-a1d3-4573f2517730","Type":"ContainerStarted","Data":"cca70583e736c37a6262ddbe8c92a7b959b4f3509b243cc291af39c3ea5af823"} Jul 09 02:34:28.682172 ip-10-0-138-136 kubenswrapper[2583]: I0709 02:34:28.682122 2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/konnectivity-agent-gszbq" event={"ID":"6d20c3fe-b459-4dbb-86a7-3903e967b424","Type":"ContainerStarted","Data":"86833d9c1ebe222e29af238c69771e49304fa25cd9f5c1c59a2fe256c0682540"} Jul 09 02:34:28.684855 ip-10-0-138-136 kubenswrapper[2583]: I0709 02:34:28.684829 2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-138-136.ec2.internal" event={"ID":"1f563ddc813ab6d8fd08536b68d33fae","Type":"ContainerStarted","Data":"3790ef96dda100cf88f2daae850667e13ac6ace8517b7eb286f0164ebc57f1fe"} Jul 09 02:34:28.687481 ip-10-0-138-136 kubenswrapper[2583]: I0709 02:34:28.687455 2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/node-resolver-5mbtc" event={"ID":"45541338-f2aa-4712-ba6f-8924e3513372","Type":"ContainerStarted","Data":"590ad744281b19ddd52309cb469065192a89be0c901f247097d66cd55fe56cd7"} Jul 09 02:34:28.689095 ip-10-0-138-136 kubenswrapper[2583]: I0709 02:34:28.689071 2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-xx7bf" event={"ID":"1ca2fa3a-0931-4ac7-b562-e70c66a22120","Type":"ContainerStarted","Data":"5da33b9afb7b110ce49f7e60563baa26cc0c9a500db1f1a9ffa60ffd32992d7f"} Jul 09 02:34:28.691553 ip-10-0-138-136 kubenswrapper[2583]: I0709 02:34:28.691531 2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-6k6qn" event={"ID":"d507ebdd-e329-4392-986f-54b792047f9a","Type":"ContainerStarted","Data":"fec9983a03f3c2bf732f8c73e85137f22c279a5d9100187964e62934e2c6a74d"} Jul 09 02:34:28.692990 ip-10-0-138-136 kubenswrapper[2583]: I0709 02:34:28.692969 2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/node-ca-v86n2" event={"ID":"6cdfd2a0-46af-4734-9735-7408f8439c96","Type":"ContainerStarted","Data":"35de1b18d1769df8b3cb96c7c9dcc4470c5ab3b966c865b7fb634ef107bf0004"} Jul 09 02:34:28.701196 ip-10-0-138-136 kubenswrapper[2583]: I0709 02:34:28.701155 2583 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-node-tuning-operator/tuned-npfjp" podStartSLOduration=2.234007981 podStartE2EDuration="13.701143933s" totalImagesPullingTime="11.467135952s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-09 02:34:15 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-09 02:34:28.700873208 +0000 UTC m=+14.633330694" watchObservedRunningTime="2026-07-09 02:34:28.701143933 +0000 UTC m=+14.633601418" Jul 09 02:34:28.716192 ip-10-0-138-136 kubenswrapper[2583]: I0709 02:34:28.716151 2583 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-dns/node-resolver-5mbtc" podStartSLOduration=1.259768762 podStartE2EDuration="12.716138584s" totalImagesPullingTime="11.456369822s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-09 02:34:16 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-09 02:34:28.71557575 +0000 UTC m=+14.648033240" watchObservedRunningTime="2026-07-09 02:34:28.716138584 +0000 UTC m=+14.648596069" Jul 09 02:34:28.736675 ip-10-0-138-136 kubenswrapper[2583]: I0709 02:34:28.736608 2583 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-138-136.ec2.internal" podStartSLOduration=12.736591707 podStartE2EDuration="12.736591707s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-09 02:34:16 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-09 02:34:28.735936498 +0000 UTC m=+14.668393988" watchObservedRunningTime="2026-07-09 02:34:28.736591707 +0000 UTC m=+14.669049194" Jul 09 02:34:28.757360 ip-10-0-138-136 kubenswrapper[2583]: I0709 02:34:28.757314 2583 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-image-registry/node-ca-v86n2" podStartSLOduration=2.456689236 podStartE2EDuration="13.757296531s" totalImagesPullingTime="11.300607295s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-09 02:34:15 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-09 02:34:28.756929493 +0000 UTC m=+14.689386981" watchObservedRunningTime="2026-07-09 02:34:28.757296531 +0000 UTC m=+14.689754018" Jul 09 02:34:29.697677 ip-10-0-138-136 kubenswrapper[2583]: I0709 02:34:29.697595 2583 generic.go:356] "Generic (PLEG): container finished" podID="1ca2fa3a-0931-4ac7-b562-e70c66a22120" containerID="5da33b9afb7b110ce49f7e60563baa26cc0c9a500db1f1a9ffa60ffd32992d7f" exitCode=0 Jul 09 02:34:29.698697 ip-10-0-138-136 kubenswrapper[2583]: I0709 02:34:29.697704 2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-xx7bf" event={"ID":"1ca2fa3a-0931-4ac7-b562-e70c66a22120","Type":"ContainerDied","Data":"5da33b9afb7b110ce49f7e60563baa26cc0c9a500db1f1a9ffa60ffd32992d7f"} Jul 09 02:34:29.718609 ip-10-0-138-136 kubenswrapper[2583]: I0709 02:34:29.718562 2583 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/konnectivity-agent-gszbq" podStartSLOduration=3.782215464 podStartE2EDuration="14.718545759s" totalImagesPullingTime="10.936330295s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-09 02:34:15 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-09 02:34:28.792351161 +0000 UTC m=+14.724808660" watchObservedRunningTime="2026-07-09 02:34:29.718545759 +0000 UTC m=+15.651003247" Jul 09 02:34:30.325736 ip-10-0-138-136 kubenswrapper[2583]: I0709 02:34:30.325668 2583 plugin_watcher.go:194] "Adding socket path or updating timestamp to desired state cache" path="/var/lib/kubelet/plugins_registry/ebs.csi.aws.com-reg.sock" Jul 09 02:34:30.577828 ip-10-0-138-136 kubenswrapper[2583]: I0709 02:34:30.577656 2583 reconciler.go:161] "OperationExecutor.RegisterPlugin started" plugin={"SocketPath":"/var/lib/kubelet/plugins_registry/ebs.csi.aws.com-reg.sock","Timestamp":"2026-07-09T02:34:30.325695918Z","UUID":"511cdb1b-40e4-4b7b-8e80-2d7489d190e7","Handler":null,"Name":"","Endpoint":""} Jul 09 02:34:30.579617 ip-10-0-138-136 kubenswrapper[2583]: I0709 02:34:30.579590 2583 csi_plugin.go:106] kubernetes.io/csi: Trying to validate a new CSI Driver with name: ebs.csi.aws.com endpoint: /var/lib/kubelet/plugins/ebs.csi.aws.com/csi.sock versions: 1.0.0 Jul 09 02:34:30.579747 ip-10-0-138-136 kubenswrapper[2583]: I0709 02:34:30.579637 2583 csi_plugin.go:119] kubernetes.io/csi: Register new plugin with name: ebs.csi.aws.com at endpoint: /var/lib/kubelet/plugins/ebs.csi.aws.com/csi.sock Jul 09 02:34:30.596322 ip-10-0-138-136 kubenswrapper[2583]: I0709 02:34:30.596297 2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-sv26w" Jul 09 02:34:30.596453 ip-10-0-138-136 kubenswrapper[2583]: I0709 02:34:30.596297 2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-dkblh" Jul 09 02:34:30.596453 ip-10-0-138-136 kubenswrapper[2583]: E0709 02:34:30.596412 2583 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-sv26w" podUID="4133cf72-5672-4d5e-b6dd-70e32b953216" Jul 09 02:34:30.596569 ip-10-0-138-136 kubenswrapper[2583]: I0709 02:34:30.596300 2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-rdtdt" Jul 09 02:34:30.596569 ip-10-0-138-136 kubenswrapper[2583]: E0709 02:34:30.596481 2583 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-dkblh" podUID="d9f05741-1f97-4987-8158-4dbad6b22987" Jul 09 02:34:30.596675 ip-10-0-138-136 kubenswrapper[2583]: E0709 02:34:30.596565 2583 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-rdtdt" podUID="71cf0a89-d676-47f4-bf4a-d13d283493fc" Jul 09 02:34:30.702324 ip-10-0-138-136 kubenswrapper[2583]: I0709 02:34:30.702290 2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-6k6qn" event={"ID":"d507ebdd-e329-4392-986f-54b792047f9a","Type":"ContainerStarted","Data":"d2f56350fa0a745eebe42235a42051725e5b13e6e012f2576e9d8ef3f13e2978"} Jul 09 02:34:30.703980 ip-10-0-138-136 kubenswrapper[2583]: I0709 02:34:30.703947 2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-operator/iptables-alerter-hc45j" event={"ID":"34d08b11-e4c1-4bc4-bd00-2cbfc1720242","Type":"ContainerStarted","Data":"64b8ace6ccb5c5587cfb8cee5695302476fe957464bdab8fa5db74bed96a8482"} Jul 09 02:34:32.215977 ip-10-0-138-136 kubenswrapper[2583]: I0709 02:34:32.215946 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/71cf0a89-d676-47f4-bf4a-d13d283493fc-metrics-certs\") pod \"network-metrics-daemon-rdtdt\" (UID: \"71cf0a89-d676-47f4-bf4a-d13d283493fc\") " pod="openshift-multus/network-metrics-daemon-rdtdt" Jul 09 02:34:32.216620 ip-10-0-138-136 kubenswrapper[2583]: I0709 02:34:32.216015 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/4133cf72-5672-4d5e-b6dd-70e32b953216-original-pull-secret\") pod \"global-pull-secret-syncer-sv26w\" (UID: \"4133cf72-5672-4d5e-b6dd-70e32b953216\") " pod="kube-system/global-pull-secret-syncer-sv26w" Jul 09 02:34:32.216620 ip-10-0-138-136 kubenswrapper[2583]: E0709 02:34:32.216123 2583 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jul 09 02:34:32.216620 ip-10-0-138-136 kubenswrapper[2583]: E0709 02:34:32.216194 2583 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/71cf0a89-d676-47f4-bf4a-d13d283493fc-metrics-certs podName:71cf0a89-d676-47f4-bf4a-d13d283493fc nodeName:}" failed. No retries permitted until 2026-07-09 02:34:48.216179094 +0000 UTC m=+34.148636558 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/71cf0a89-d676-47f4-bf4a-d13d283493fc-metrics-certs") pod "network-metrics-daemon-rdtdt" (UID: "71cf0a89-d676-47f4-bf4a-d13d283493fc") : object "openshift-multus"/"metrics-daemon-secret" not registered Jul 09 02:34:32.216620 ip-10-0-138-136 kubenswrapper[2583]: E0709 02:34:32.216123 2583 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jul 09 02:34:32.216620 ip-10-0-138-136 kubenswrapper[2583]: E0709 02:34:32.216394 2583 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/4133cf72-5672-4d5e-b6dd-70e32b953216-original-pull-secret podName:4133cf72-5672-4d5e-b6dd-70e32b953216 nodeName:}" failed. No retries permitted until 2026-07-09 02:34:48.216373141 +0000 UTC m=+34.148830606 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/4133cf72-5672-4d5e-b6dd-70e32b953216-original-pull-secret") pod "global-pull-secret-syncer-sv26w" (UID: "4133cf72-5672-4d5e-b6dd-70e32b953216") : object "kube-system"/"original-pull-secret" not registered Jul 09 02:34:32.402860 ip-10-0-138-136 kubenswrapper[2583]: I0709 02:34:32.402474 2583 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="kube-system/konnectivity-agent-gszbq" Jul 09 02:34:32.403437 ip-10-0-138-136 kubenswrapper[2583]: I0709 02:34:32.403418 2583 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="kube-system/konnectivity-agent-gszbq" Jul 09 02:34:32.418166 ip-10-0-138-136 kubenswrapper[2583]: I0709 02:34:32.417604 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-wwh6x\" (UniqueName: \"kubernetes.io/projected/d9f05741-1f97-4987-8158-4dbad6b22987-kube-api-access-wwh6x\") pod \"network-check-target-dkblh\" (UID: \"d9f05741-1f97-4987-8158-4dbad6b22987\") " pod="openshift-network-diagnostics/network-check-target-dkblh" Jul 09 02:34:32.418166 ip-10-0-138-136 kubenswrapper[2583]: E0709 02:34:32.417815 2583 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jul 09 02:34:32.418166 ip-10-0-138-136 kubenswrapper[2583]: E0709 02:34:32.417835 2583 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jul 09 02:34:32.418166 ip-10-0-138-136 kubenswrapper[2583]: E0709 02:34:32.417855 2583 projected.go:196] Error preparing data for projected volume kube-api-access-wwh6x for pod openshift-network-diagnostics/network-check-target-dkblh: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 09 02:34:32.418166 ip-10-0-138-136 kubenswrapper[2583]: E0709 02:34:32.417915 2583 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/d9f05741-1f97-4987-8158-4dbad6b22987-kube-api-access-wwh6x podName:d9f05741-1f97-4987-8158-4dbad6b22987 nodeName:}" failed. No retries permitted until 2026-07-09 02:34:48.417890772 +0000 UTC m=+34.350348250 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "kube-api-access-wwh6x" (UniqueName: "kubernetes.io/projected/d9f05741-1f97-4987-8158-4dbad6b22987-kube-api-access-wwh6x") pod "network-check-target-dkblh" (UID: "d9f05741-1f97-4987-8158-4dbad6b22987") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 09 02:34:32.418796 ip-10-0-138-136 kubenswrapper[2583]: I0709 02:34:32.418728 2583 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-operator/iptables-alerter-hc45j" podStartSLOduration=5.904323294 podStartE2EDuration="17.41869384s" totalImagesPullingTime="11.514370546s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-09 02:34:15 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-09 02:34:30.717547359 +0000 UTC m=+16.650004843" watchObservedRunningTime="2026-07-09 02:34:32.41869384 +0000 UTC m=+18.351151328" Jul 09 02:34:32.597302 ip-10-0-138-136 kubenswrapper[2583]: I0709 02:34:32.597236 2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-sv26w" Jul 09 02:34:32.597476 ip-10-0-138-136 kubenswrapper[2583]: I0709 02:34:32.597246 2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-rdtdt" Jul 09 02:34:32.597476 ip-10-0-138-136 kubenswrapper[2583]: E0709 02:34:32.597381 2583 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-sv26w" podUID="4133cf72-5672-4d5e-b6dd-70e32b953216" Jul 09 02:34:32.597476 ip-10-0-138-136 kubenswrapper[2583]: I0709 02:34:32.597246 2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-dkblh" Jul 09 02:34:32.597476 ip-10-0-138-136 kubenswrapper[2583]: E0709 02:34:32.597438 2583 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-rdtdt" podUID="71cf0a89-d676-47f4-bf4a-d13d283493fc" Jul 09 02:34:32.597671 ip-10-0-138-136 kubenswrapper[2583]: E0709 02:34:32.597478 2583 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-dkblh" podUID="d9f05741-1f97-4987-8158-4dbad6b22987" Jul 09 02:34:34.597528 ip-10-0-138-136 kubenswrapper[2583]: I0709 02:34:34.597313 2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-sv26w" Jul 09 02:34:34.598024 ip-10-0-138-136 kubenswrapper[2583]: E0709 02:34:34.597629 2583 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-sv26w" podUID="4133cf72-5672-4d5e-b6dd-70e32b953216" Jul 09 02:34:34.598024 ip-10-0-138-136 kubenswrapper[2583]: I0709 02:34:34.597409 2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-rdtdt" Jul 09 02:34:34.598024 ip-10-0-138-136 kubenswrapper[2583]: I0709 02:34:34.597381 2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-dkblh" Jul 09 02:34:34.598024 ip-10-0-138-136 kubenswrapper[2583]: E0709 02:34:34.597782 2583 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-rdtdt" podUID="71cf0a89-d676-47f4-bf4a-d13d283493fc" Jul 09 02:34:34.598024 ip-10-0-138-136 kubenswrapper[2583]: E0709 02:34:34.597857 2583 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-dkblh" podUID="d9f05741-1f97-4987-8158-4dbad6b22987" Jul 09 02:34:35.721877 ip-10-0-138-136 kubenswrapper[2583]: I0709 02:34:35.721844 2583 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kube-system/konnectivity-agent-gszbq" Jul 09 02:34:35.722276 ip-10-0-138-136 kubenswrapper[2583]: I0709 02:34:35.721962 2583 prober_manager.go:312] "Failed to trigger a manual run" probe="Readiness" Jul 09 02:34:35.722467 ip-10-0-138-136 kubenswrapper[2583]: I0709 02:34:35.722442 2583 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kube-system/konnectivity-agent-gszbq" Jul 09 02:34:36.597148 ip-10-0-138-136 kubenswrapper[2583]: I0709 02:34:36.597114 2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-sv26w" Jul 09 02:34:36.597148 ip-10-0-138-136 kubenswrapper[2583]: I0709 02:34:36.597152 2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-rdtdt" Jul 09 02:34:36.597491 ip-10-0-138-136 kubenswrapper[2583]: I0709 02:34:36.597114 2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-dkblh" Jul 09 02:34:36.597491 ip-10-0-138-136 kubenswrapper[2583]: E0709 02:34:36.597220 2583 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-sv26w" podUID="4133cf72-5672-4d5e-b6dd-70e32b953216" Jul 09 02:34:36.597491 ip-10-0-138-136 kubenswrapper[2583]: E0709 02:34:36.597334 2583 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-dkblh" podUID="d9f05741-1f97-4987-8158-4dbad6b22987" Jul 09 02:34:36.597491 ip-10-0-138-136 kubenswrapper[2583]: E0709 02:34:36.597462 2583 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-rdtdt" podUID="71cf0a89-d676-47f4-bf4a-d13d283493fc" Jul 09 02:34:38.597111 ip-10-0-138-136 kubenswrapper[2583]: I0709 02:34:38.597071 2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-rdtdt" Jul 09 02:34:38.597585 ip-10-0-138-136 kubenswrapper[2583]: I0709 02:34:38.597072 2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-dkblh" Jul 09 02:34:38.597585 ip-10-0-138-136 kubenswrapper[2583]: E0709 02:34:38.597180 2583 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-rdtdt" podUID="71cf0a89-d676-47f4-bf4a-d13d283493fc" Jul 09 02:34:38.597585 ip-10-0-138-136 kubenswrapper[2583]: I0709 02:34:38.597082 2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-sv26w" Jul 09 02:34:38.597585 ip-10-0-138-136 kubenswrapper[2583]: E0709 02:34:38.597236 2583 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-dkblh" podUID="d9f05741-1f97-4987-8158-4dbad6b22987" Jul 09 02:34:38.597585 ip-10-0-138-136 kubenswrapper[2583]: E0709 02:34:38.597345 2583 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-sv26w" podUID="4133cf72-5672-4d5e-b6dd-70e32b953216" Jul 09 02:34:40.596851 ip-10-0-138-136 kubenswrapper[2583]: I0709 02:34:40.596822 2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-sv26w" Jul 09 02:34:40.597246 ip-10-0-138-136 kubenswrapper[2583]: I0709 02:34:40.596823 2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-dkblh" Jul 09 02:34:40.597246 ip-10-0-138-136 kubenswrapper[2583]: E0709 02:34:40.596914 2583 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-sv26w" podUID="4133cf72-5672-4d5e-b6dd-70e32b953216" Jul 09 02:34:40.597246 ip-10-0-138-136 kubenswrapper[2583]: I0709 02:34:40.596826 2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-rdtdt" Jul 09 02:34:40.597246 ip-10-0-138-136 kubenswrapper[2583]: E0709 02:34:40.597006 2583 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-dkblh" podUID="d9f05741-1f97-4987-8158-4dbad6b22987" Jul 09 02:34:40.597246 ip-10-0-138-136 kubenswrapper[2583]: E0709 02:34:40.597088 2583 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-rdtdt" podUID="71cf0a89-d676-47f4-bf4a-d13d283493fc" Jul 09 02:34:41.724905 ip-10-0-138-136 kubenswrapper[2583]: I0709 02:34:41.724672 2583 generic.go:356] "Generic (PLEG): container finished" podID="1ca2fa3a-0931-4ac7-b562-e70c66a22120" containerID="95a30cab194bbd46a13a503e6c6272a1750569bf71acf69f9b624e77c0c0f60f" exitCode=0 Jul 09 02:34:41.725289 ip-10-0-138-136 kubenswrapper[2583]: I0709 02:34:41.724755 2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-xx7bf" event={"ID":"1ca2fa3a-0931-4ac7-b562-e70c66a22120","Type":"ContainerDied","Data":"95a30cab194bbd46a13a503e6c6272a1750569bf71acf69f9b624e77c0c0f60f"} Jul 09 02:34:41.727016 ip-10-0-138-136 kubenswrapper[2583]: I0709 02:34:41.726988 2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-6k6qn" event={"ID":"d507ebdd-e329-4392-986f-54b792047f9a","Type":"ContainerStarted","Data":"c46b6a6224b26359d4d989a02e643a730ef8e5c19d17f1a46ea950d3bf27d72f"} Jul 09 02:34:41.730307 ip-10-0-138-136 kubenswrapper[2583]: I0709 02:34:41.730281 2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-6gctz" event={"ID":"ab715167-aa61-46be-bbe1-36212c9aa180","Type":"ContainerStarted","Data":"eaeb257f418bf88301148bd4ed9f24071ec2e9172c20d50d1bcd2c2b6cba0a26"} Jul 09 02:34:41.730418 ip-10-0-138-136 kubenswrapper[2583]: I0709 02:34:41.730402 2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-6gctz" event={"ID":"ab715167-aa61-46be-bbe1-36212c9aa180","Type":"ContainerStarted","Data":"d950f63040122b7a8a29270df156f699f6ffa8b6341102ed727ea44ab593f6e8"} Jul 09 02:34:41.730482 ip-10-0-138-136 kubenswrapper[2583]: I0709 02:34:41.730456 2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-6gctz" event={"ID":"ab715167-aa61-46be-bbe1-36212c9aa180","Type":"ContainerStarted","Data":"f8bd2c0e211202ede916762a486a64bd51701c07bc39feec9e143c1ad3e5a0a4"} Jul 09 02:34:41.730535 ip-10-0-138-136 kubenswrapper[2583]: I0709 02:34:41.730505 2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-6gctz" event={"ID":"ab715167-aa61-46be-bbe1-36212c9aa180","Type":"ContainerStarted","Data":"6e3f0900ff6a2102e4b6c29ef616b1463ffbe6fed37b2e85b303dbc3cc553d5b"} Jul 09 02:34:41.730585 ip-10-0-138-136 kubenswrapper[2583]: I0709 02:34:41.730552 2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-6gctz" event={"ID":"ab715167-aa61-46be-bbe1-36212c9aa180","Type":"ContainerStarted","Data":"d6122826c1ca073a62aad61b5c5b9d227573dcc409ec3688ca2299d6d3016f9d"} Jul 09 02:34:41.731811 ip-10-0-138-136 kubenswrapper[2583]: I0709 02:34:41.731782 2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-q69lj" event={"ID":"9b793225-5bd6-4bf7-a87e-d42bf8c939f7","Type":"ContainerStarted","Data":"34af5275575331fdcf177f4f012127afd20d6b80e75340f6bfe8338c8e12777b"} Jul 09 02:34:41.758910 ip-10-0-138-136 kubenswrapper[2583]: I0709 02:34:41.758870 2583 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-6k6qn" podStartSLOduration=2.705391698 podStartE2EDuration="26.758858307s" totalImagesPullingTime="24.053466609s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-09 02:34:15 +0000 UTC" imagePullSessionsCount=3 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-09 02:34:41.758612918 +0000 UTC m=+27.691070404" watchObservedRunningTime="2026-07-09 02:34:41.758858307 +0000 UTC m=+27.691315790" Jul 09 02:34:41.774524 ip-10-0-138-136 kubenswrapper[2583]: I0709 02:34:41.774475 2583 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/multus-q69lj" podStartSLOduration=2.842538479 podStartE2EDuration="26.774458709s" totalImagesPullingTime="23.93192023s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-09 02:34:15 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-09 02:34:41.774399534 +0000 UTC m=+27.706857020" watchObservedRunningTime="2026-07-09 02:34:41.774458709 +0000 UTC m=+27.706916196" Jul 09 02:34:42.596492 ip-10-0-138-136 kubenswrapper[2583]: I0709 02:34:42.596467 2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-dkblh" Jul 09 02:34:42.596700 ip-10-0-138-136 kubenswrapper[2583]: E0709 02:34:42.596574 2583 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-dkblh" podUID="d9f05741-1f97-4987-8158-4dbad6b22987" Jul 09 02:34:42.596700 ip-10-0-138-136 kubenswrapper[2583]: I0709 02:34:42.596467 2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-sv26w" Jul 09 02:34:42.596700 ip-10-0-138-136 kubenswrapper[2583]: I0709 02:34:42.596594 2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-rdtdt" Jul 09 02:34:42.596873 ip-10-0-138-136 kubenswrapper[2583]: E0709 02:34:42.596664 2583 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-sv26w" podUID="4133cf72-5672-4d5e-b6dd-70e32b953216" Jul 09 02:34:42.596873 ip-10-0-138-136 kubenswrapper[2583]: E0709 02:34:42.596773 2583 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-rdtdt" podUID="71cf0a89-d676-47f4-bf4a-d13d283493fc" Jul 09 02:34:42.737687 ip-10-0-138-136 kubenswrapper[2583]: I0709 02:34:42.737652 2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-6gctz" event={"ID":"ab715167-aa61-46be-bbe1-36212c9aa180","Type":"ContainerStarted","Data":"034c00b395f6d2eb87f19c7c711fc2a275d3264f4c8bd41be5012612994aa9a9"} Jul 09 02:34:43.740943 ip-10-0-138-136 kubenswrapper[2583]: I0709 02:34:43.740917 2583 generic.go:356] "Generic (PLEG): container finished" podID="1ca2fa3a-0931-4ac7-b562-e70c66a22120" containerID="742a8cf45179a7bfb4abbd403ba773c398fe18cccc1b0d990c65a8f4f4d97c95" exitCode=0 Jul 09 02:34:43.741341 ip-10-0-138-136 kubenswrapper[2583]: I0709 02:34:43.740968 2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-xx7bf" event={"ID":"1ca2fa3a-0931-4ac7-b562-e70c66a22120","Type":"ContainerDied","Data":"742a8cf45179a7bfb4abbd403ba773c398fe18cccc1b0d990c65a8f4f4d97c95"} Jul 09 02:34:44.597383 ip-10-0-138-136 kubenswrapper[2583]: I0709 02:34:44.597351 2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-sv26w" Jul 09 02:34:44.597548 ip-10-0-138-136 kubenswrapper[2583]: E0709 02:34:44.597436 2583 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-sv26w" podUID="4133cf72-5672-4d5e-b6dd-70e32b953216" Jul 09 02:34:44.597548 ip-10-0-138-136 kubenswrapper[2583]: I0709 02:34:44.597538 2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-rdtdt" Jul 09 02:34:44.597674 ip-10-0-138-136 kubenswrapper[2583]: E0709 02:34:44.597657 2583 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-rdtdt" podUID="71cf0a89-d676-47f4-bf4a-d13d283493fc" Jul 09 02:34:44.597738 ip-10-0-138-136 kubenswrapper[2583]: I0709 02:34:44.597689 2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-dkblh" Jul 09 02:34:44.597779 ip-10-0-138-136 kubenswrapper[2583]: E0709 02:34:44.597766 2583 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-dkblh" podUID="d9f05741-1f97-4987-8158-4dbad6b22987" Jul 09 02:34:44.746460 ip-10-0-138-136 kubenswrapper[2583]: I0709 02:34:44.746427 2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-6gctz" event={"ID":"ab715167-aa61-46be-bbe1-36212c9aa180","Type":"ContainerStarted","Data":"30559fa4e37d3bcffeacfb032b820ef466bb8df33e3f830eb2ec51c3af453c5a"} Jul 09 02:34:45.751554 ip-10-0-138-136 kubenswrapper[2583]: I0709 02:34:45.751521 2583 generic.go:356] "Generic (PLEG): container finished" podID="1ca2fa3a-0931-4ac7-b562-e70c66a22120" containerID="d2514aef28df2e2d9ddb23a59b9434ddd9b12ce2628c912c8878aecd46d0387b" exitCode=0 Jul 09 02:34:45.752031 ip-10-0-138-136 kubenswrapper[2583]: I0709 02:34:45.751589 2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-xx7bf" event={"ID":"1ca2fa3a-0931-4ac7-b562-e70c66a22120","Type":"ContainerDied","Data":"d2514aef28df2e2d9ddb23a59b9434ddd9b12ce2628c912c8878aecd46d0387b"} Jul 09 02:34:46.596780 ip-10-0-138-136 kubenswrapper[2583]: I0709 02:34:46.596599 2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-sv26w" Jul 09 02:34:46.596935 ip-10-0-138-136 kubenswrapper[2583]: I0709 02:34:46.596607 2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-dkblh" Jul 09 02:34:46.596935 ip-10-0-138-136 kubenswrapper[2583]: E0709 02:34:46.596852 2583 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-sv26w" podUID="4133cf72-5672-4d5e-b6dd-70e32b953216" Jul 09 02:34:46.596935 ip-10-0-138-136 kubenswrapper[2583]: I0709 02:34:46.596615 2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-rdtdt" Jul 09 02:34:46.597043 ip-10-0-138-136 kubenswrapper[2583]: E0709 02:34:46.596937 2583 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-dkblh" podUID="d9f05741-1f97-4987-8158-4dbad6b22987" Jul 09 02:34:46.597043 ip-10-0-138-136 kubenswrapper[2583]: E0709 02:34:46.597032 2583 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-rdtdt" podUID="71cf0a89-d676-47f4-bf4a-d13d283493fc" Jul 09 02:34:46.758116 ip-10-0-138-136 kubenswrapper[2583]: I0709 02:34:46.758080 2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-6gctz" event={"ID":"ab715167-aa61-46be-bbe1-36212c9aa180","Type":"ContainerStarted","Data":"e0c639d06e235d7cd740ee2f94e6da5e8de86d9bd0dabf817068f25938827b56"} Jul 09 02:34:46.758564 ip-10-0-138-136 kubenswrapper[2583]: I0709 02:34:46.758384 2583 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-6gctz" Jul 09 02:34:46.758564 ip-10-0-138-136 kubenswrapper[2583]: I0709 02:34:46.758443 2583 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-6gctz" Jul 09 02:34:46.758564 ip-10-0-138-136 kubenswrapper[2583]: I0709 02:34:46.758491 2583 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-6gctz" Jul 09 02:34:46.774529 ip-10-0-138-136 kubenswrapper[2583]: I0709 02:34:46.774505 2583 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-6gctz" Jul 09 02:34:46.775858 ip-10-0-138-136 kubenswrapper[2583]: I0709 02:34:46.775841 2583 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-6gctz" Jul 09 02:34:46.795348 ip-10-0-138-136 kubenswrapper[2583]: I0709 02:34:46.795312 2583 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ovn-kubernetes/ovnkube-node-6gctz" podStartSLOduration=7.540138616 podStartE2EDuration="31.795298677s" totalImagesPullingTime="24.255160061s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-09 02:34:15 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-09 02:34:46.794775369 +0000 UTC m=+32.727232862" watchObservedRunningTime="2026-07-09 02:34:46.795298677 +0000 UTC m=+32.727756190" Jul 09 02:34:48.037810 ip-10-0-138-136 kubenswrapper[2583]: I0709 02:34:48.037781 2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-target-dkblh"] Jul 09 02:34:48.038233 ip-10-0-138-136 kubenswrapper[2583]: I0709 02:34:48.037952 2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-dkblh" Jul 09 02:34:48.038233 ip-10-0-138-136 kubenswrapper[2583]: E0709 02:34:48.038072 2583 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-dkblh" podUID="d9f05741-1f97-4987-8158-4dbad6b22987" Jul 09 02:34:48.040746 ip-10-0-138-136 kubenswrapper[2583]: I0709 02:34:48.040706 2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-multus/network-metrics-daemon-rdtdt"] Jul 09 02:34:48.040872 ip-10-0-138-136 kubenswrapper[2583]: I0709 02:34:48.040826 2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-rdtdt" Jul 09 02:34:48.040954 ip-10-0-138-136 kubenswrapper[2583]: E0709 02:34:48.040926 2583 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-rdtdt" podUID="71cf0a89-d676-47f4-bf4a-d13d283493fc" Jul 09 02:34:48.043498 ip-10-0-138-136 kubenswrapper[2583]: I0709 02:34:48.043458 2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kube-system/global-pull-secret-syncer-sv26w"] Jul 09 02:34:48.043615 ip-10-0-138-136 kubenswrapper[2583]: I0709 02:34:48.043545 2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-sv26w" Jul 09 02:34:48.043659 ip-10-0-138-136 kubenswrapper[2583]: E0709 02:34:48.043635 2583 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-sv26w" podUID="4133cf72-5672-4d5e-b6dd-70e32b953216" Jul 09 02:34:48.233983 ip-10-0-138-136 kubenswrapper[2583]: I0709 02:34:48.233955 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/4133cf72-5672-4d5e-b6dd-70e32b953216-original-pull-secret\") pod \"global-pull-secret-syncer-sv26w\" (UID: \"4133cf72-5672-4d5e-b6dd-70e32b953216\") " pod="kube-system/global-pull-secret-syncer-sv26w" Jul 09 02:34:48.234121 ip-10-0-138-136 kubenswrapper[2583]: I0709 02:34:48.233993 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/71cf0a89-d676-47f4-bf4a-d13d283493fc-metrics-certs\") pod \"network-metrics-daemon-rdtdt\" (UID: \"71cf0a89-d676-47f4-bf4a-d13d283493fc\") " pod="openshift-multus/network-metrics-daemon-rdtdt" Jul 09 02:34:48.234121 ip-10-0-138-136 kubenswrapper[2583]: E0709 02:34:48.234092 2583 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jul 09 02:34:48.234121 ip-10-0-138-136 kubenswrapper[2583]: E0709 02:34:48.234099 2583 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jul 09 02:34:48.234274 ip-10-0-138-136 kubenswrapper[2583]: E0709 02:34:48.234145 2583 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/71cf0a89-d676-47f4-bf4a-d13d283493fc-metrics-certs podName:71cf0a89-d676-47f4-bf4a-d13d283493fc nodeName:}" failed. No retries permitted until 2026-07-09 02:35:20.234128439 +0000 UTC m=+66.166585907 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/71cf0a89-d676-47f4-bf4a-d13d283493fc-metrics-certs") pod "network-metrics-daemon-rdtdt" (UID: "71cf0a89-d676-47f4-bf4a-d13d283493fc") : object "openshift-multus"/"metrics-daemon-secret" not registered Jul 09 02:34:48.234274 ip-10-0-138-136 kubenswrapper[2583]: E0709 02:34:48.234170 2583 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/4133cf72-5672-4d5e-b6dd-70e32b953216-original-pull-secret podName:4133cf72-5672-4d5e-b6dd-70e32b953216 nodeName:}" failed. No retries permitted until 2026-07-09 02:35:20.234151878 +0000 UTC m=+66.166609350 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/4133cf72-5672-4d5e-b6dd-70e32b953216-original-pull-secret") pod "global-pull-secret-syncer-sv26w" (UID: "4133cf72-5672-4d5e-b6dd-70e32b953216") : object "kube-system"/"original-pull-secret" not registered Jul 09 02:34:48.436095 ip-10-0-138-136 kubenswrapper[2583]: I0709 02:34:48.436011 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-wwh6x\" (UniqueName: \"kubernetes.io/projected/d9f05741-1f97-4987-8158-4dbad6b22987-kube-api-access-wwh6x\") pod \"network-check-target-dkblh\" (UID: \"d9f05741-1f97-4987-8158-4dbad6b22987\") " pod="openshift-network-diagnostics/network-check-target-dkblh" Jul 09 02:34:48.436223 ip-10-0-138-136 kubenswrapper[2583]: E0709 02:34:48.436141 2583 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jul 09 02:34:48.436223 ip-10-0-138-136 kubenswrapper[2583]: E0709 02:34:48.436155 2583 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jul 09 02:34:48.436223 ip-10-0-138-136 kubenswrapper[2583]: E0709 02:34:48.436163 2583 projected.go:196] Error preparing data for projected volume kube-api-access-wwh6x for pod openshift-network-diagnostics/network-check-target-dkblh: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 09 02:34:48.436223 ip-10-0-138-136 kubenswrapper[2583]: E0709 02:34:48.436206 2583 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/d9f05741-1f97-4987-8158-4dbad6b22987-kube-api-access-wwh6x podName:d9f05741-1f97-4987-8158-4dbad6b22987 nodeName:}" failed. No retries permitted until 2026-07-09 02:35:20.436194765 +0000 UTC m=+66.368652229 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "kube-api-access-wwh6x" (UniqueName: "kubernetes.io/projected/d9f05741-1f97-4987-8158-4dbad6b22987-kube-api-access-wwh6x") pod "network-check-target-dkblh" (UID: "d9f05741-1f97-4987-8158-4dbad6b22987") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 09 02:34:49.596429 ip-10-0-138-136 kubenswrapper[2583]: I0709 02:34:49.596398 2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-rdtdt" Jul 09 02:34:49.596429 ip-10-0-138-136 kubenswrapper[2583]: I0709 02:34:49.596429 2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-dkblh" Jul 09 02:34:49.596850 ip-10-0-138-136 kubenswrapper[2583]: E0709 02:34:49.596506 2583 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-rdtdt" podUID="71cf0a89-d676-47f4-bf4a-d13d283493fc" Jul 09 02:34:49.596850 ip-10-0-138-136 kubenswrapper[2583]: E0709 02:34:49.596543 2583 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-dkblh" podUID="d9f05741-1f97-4987-8158-4dbad6b22987" Jul 09 02:34:49.596850 ip-10-0-138-136 kubenswrapper[2583]: I0709 02:34:49.596585 2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-sv26w" Jul 09 02:34:49.596850 ip-10-0-138-136 kubenswrapper[2583]: E0709 02:34:49.596653 2583 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-sv26w" podUID="4133cf72-5672-4d5e-b6dd-70e32b953216" Jul 09 02:34:51.596237 ip-10-0-138-136 kubenswrapper[2583]: I0709 02:34:51.596206 2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-rdtdt" Jul 09 02:34:51.596755 ip-10-0-138-136 kubenswrapper[2583]: I0709 02:34:51.596219 2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-dkblh" Jul 09 02:34:51.596755 ip-10-0-138-136 kubenswrapper[2583]: E0709 02:34:51.596331 2583 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-rdtdt" podUID="71cf0a89-d676-47f4-bf4a-d13d283493fc" Jul 09 02:34:51.596755 ip-10-0-138-136 kubenswrapper[2583]: I0709 02:34:51.596356 2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-sv26w" Jul 09 02:34:51.596755 ip-10-0-138-136 kubenswrapper[2583]: E0709 02:34:51.596452 2583 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-dkblh" podUID="d9f05741-1f97-4987-8158-4dbad6b22987" Jul 09 02:34:51.596755 ip-10-0-138-136 kubenswrapper[2583]: E0709 02:34:51.596526 2583 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-sv26w" podUID="4133cf72-5672-4d5e-b6dd-70e32b953216" Jul 09 02:34:52.774601 ip-10-0-138-136 kubenswrapper[2583]: I0709 02:34:52.774298 2583 generic.go:356] "Generic (PLEG): container finished" podID="1ca2fa3a-0931-4ac7-b562-e70c66a22120" containerID="aa2ddf7282e20f2f3982ea4a6787553cdfc0b8f09ea8a4786c20e7d3e2a0bdd1" exitCode=0 Jul 09 02:34:52.774982 ip-10-0-138-136 kubenswrapper[2583]: I0709 02:34:52.774387 2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-xx7bf" event={"ID":"1ca2fa3a-0931-4ac7-b562-e70c66a22120","Type":"ContainerDied","Data":"aa2ddf7282e20f2f3982ea4a6787553cdfc0b8f09ea8a4786c20e7d3e2a0bdd1"} Jul 09 02:34:53.596945 ip-10-0-138-136 kubenswrapper[2583]: I0709 02:34:53.596914 2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-sv26w" Jul 09 02:34:53.597082 ip-10-0-138-136 kubenswrapper[2583]: I0709 02:34:53.596915 2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-dkblh" Jul 09 02:34:53.597274 ip-10-0-138-136 kubenswrapper[2583]: E0709 02:34:53.597118 2583 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-dkblh" podUID="d9f05741-1f97-4987-8158-4dbad6b22987" Jul 09 02:34:53.597274 ip-10-0-138-136 kubenswrapper[2583]: E0709 02:34:53.597008 2583 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-sv26w" podUID="4133cf72-5672-4d5e-b6dd-70e32b953216" Jul 09 02:34:53.597274 ip-10-0-138-136 kubenswrapper[2583]: I0709 02:34:53.596919 2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-rdtdt" Jul 09 02:34:53.597274 ip-10-0-138-136 kubenswrapper[2583]: E0709 02:34:53.597226 2583 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-rdtdt" podUID="71cf0a89-d676-47f4-bf4a-d13d283493fc" Jul 09 02:34:53.780016 ip-10-0-138-136 kubenswrapper[2583]: I0709 02:34:53.779990 2583 generic.go:356] "Generic (PLEG): container finished" podID="1ca2fa3a-0931-4ac7-b562-e70c66a22120" containerID="6d830883b9f39a4a2b8b9855ae6a847e41122043b1b201dc89055e5f152574cc" exitCode=0 Jul 09 02:34:53.780469 ip-10-0-138-136 kubenswrapper[2583]: I0709 02:34:53.780047 2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-xx7bf" event={"ID":"1ca2fa3a-0931-4ac7-b562-e70c66a22120","Type":"ContainerDied","Data":"6d830883b9f39a4a2b8b9855ae6a847e41122043b1b201dc89055e5f152574cc"} Jul 09 02:34:54.785092 ip-10-0-138-136 kubenswrapper[2583]: I0709 02:34:54.785027 2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-xx7bf" event={"ID":"1ca2fa3a-0931-4ac7-b562-e70c66a22120","Type":"ContainerStarted","Data":"0ece620795da868f7667fb08af98e7a3021782fe3a973c69f5a2bcdf0863f450"} Jul 09 02:34:54.806794 ip-10-0-138-136 kubenswrapper[2583]: I0709 02:34:54.806744 2583 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/multus-additional-cni-plugins-xx7bf" podStartSLOduration=8.239901754 podStartE2EDuration="39.806708524s" totalImagesPullingTime="31.56680677s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-09 02:34:15 +0000 UTC" imagePullSessionsCount=5 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-09 02:34:54.805205528 +0000 UTC m=+40.737663013" watchObservedRunningTime="2026-07-09 02:34:54.806708524 +0000 UTC m=+40.739166010" Jul 09 02:34:54.880664 ip-10-0-138-136 kubenswrapper[2583]: I0709 02:34:54.880643 2583 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-138-136.ec2.internal" event="NodeReady" Jul 09 02:34:54.880799 ip-10-0-138-136 kubenswrapper[2583]: I0709 02:34:54.880753 2583 kubelet_node_status.go:489] "Fast updating node status as it just became ready" Jul 09 02:34:54.927696 ip-10-0-138-136 kubenswrapper[2583]: I0709 02:34:54.926895 2583 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-cluster-storage-operator/volume-data-source-validator-5d456fdbcd-bdg6h"] Jul 09 02:34:54.949163 ip-10-0-138-136 kubenswrapper[2583]: I0709 02:34:54.949120 2583 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-insights/insights-operator-5c847dcfc4-rwvrr"] Jul 09 02:34:54.949286 ip-10-0-138-136 kubenswrapper[2583]: I0709 02:34:54.949206 2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-storage-operator/volume-data-source-validator-5d456fdbcd-bdg6h" Jul 09 02:34:54.951437 ip-10-0-138-136 kubenswrapper[2583]: I0709 02:34:54.951416 2583 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-storage-operator\"/\"volume-data-source-validator-dockercfg-l6nbr\"" Jul 09 02:34:54.951677 ip-10-0-138-136 kubenswrapper[2583]: I0709 02:34:54.951659 2583 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-storage-operator\"/\"openshift-service-ca.crt\"" Jul 09 02:34:54.951677 ip-10-0-138-136 kubenswrapper[2583]: I0709 02:34:54.951671 2583 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-storage-operator\"/\"kube-root-ca.crt\"" Jul 09 02:34:54.965172 ip-10-0-138-136 kubenswrapper[2583]: I0709 02:34:54.965150 2583 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-image-registry/image-registry-59569495f9-rmmlc"] Jul 09 02:34:54.965273 ip-10-0-138-136 kubenswrapper[2583]: I0709 02:34:54.965259 2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-operator-5c847dcfc4-rwvrr" Jul 09 02:34:54.968042 ip-10-0-138-136 kubenswrapper[2583]: I0709 02:34:54.968023 2583 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"openshift-insights-serving-cert\"" Jul 09 02:34:54.968345 ip-10-0-138-136 kubenswrapper[2583]: I0709 02:34:54.968050 2583 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"openshift-service-ca.crt\"" Jul 09 02:34:54.968624 ip-10-0-138-136 kubenswrapper[2583]: I0709 02:34:54.968090 2583 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"service-ca-bundle\"" Jul 09 02:34:54.970931 ip-10-0-138-136 kubenswrapper[2583]: I0709 02:34:54.969283 2583 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"operator-dockercfg-8cpqx\"" Jul 09 02:34:54.970931 ip-10-0-138-136 kubenswrapper[2583]: I0709 02:34:54.969504 2583 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"kube-root-ca.crt\"" Jul 09 02:34:54.983409 ip-10-0-138-136 kubenswrapper[2583]: I0709 02:34:54.983391 2583 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/cluster-monitoring-operator-64786d9cbb-grbsm"] Jul 09 02:34:54.983488 ip-10-0-138-136 kubenswrapper[2583]: I0709 02:34:54.983482 2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-59569495f9-rmmlc" Jul 09 02:34:54.985664 ip-10-0-138-136 kubenswrapper[2583]: I0709 02:34:54.985616 2583 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"image-registry-private-configuration\"" Jul 09 02:34:54.985769 ip-10-0-138-136 kubenswrapper[2583]: I0709 02:34:54.985618 2583 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"registry-dockercfg-v54k9\"" Jul 09 02:34:54.985769 ip-10-0-138-136 kubenswrapper[2583]: I0709 02:34:54.985738 2583 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"image-registry-tls\"" Jul 09 02:34:54.985769 ip-10-0-138-136 kubenswrapper[2583]: I0709 02:34:54.985755 2583 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"installation-pull-secrets\"" Jul 09 02:34:54.987407 ip-10-0-138-136 kubenswrapper[2583]: I0709 02:34:54.987387 2583 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"trusted-ca-bundle\"" Jul 09 02:34:54.991079 ip-10-0-138-136 kubenswrapper[2583]: I0709 02:34:54.991048 2583 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"trusted-ca\"" Jul 09 02:34:54.997322 ip-10-0-138-136 kubenswrapper[2583]: I0709 02:34:54.997305 2583 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console-operator/console-operator-68b757fb67-xpjsj"] Jul 09 02:34:54.997414 ip-10-0-138-136 kubenswrapper[2583]: I0709 02:34:54.997401 2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/cluster-monitoring-operator-64786d9cbb-grbsm" Jul 09 02:34:54.999211 ip-10-0-138-136 kubenswrapper[2583]: I0709 02:34:54.999194 2583 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"cluster-monitoring-operator-tls\"" Jul 09 02:34:54.999516 ip-10-0-138-136 kubenswrapper[2583]: I0709 02:34:54.999499 2583 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"kube-root-ca.crt\"" Jul 09 02:34:54.999580 ip-10-0-138-136 kubenswrapper[2583]: I0709 02:34:54.999524 2583 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"cluster-monitoring-operator-dockercfg-c7n85\"" Jul 09 02:34:54.999924 ip-10-0-138-136 kubenswrapper[2583]: I0709 02:34:54.999911 2583 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"openshift-service-ca.crt\"" Jul 09 02:34:55.000053 ip-10-0-138-136 kubenswrapper[2583]: I0709 02:34:55.000041 2583 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"telemetry-config\"" Jul 09 02:34:55.005492 ip-10-0-138-136 kubenswrapper[2583]: I0709 02:34:55.005470 2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gszbq_6d20c3fe-b459-4dbb-86a7-3903e967b424/konnectivity-agent/0.log" limit=1024 Jul 09 02:34:55.017868 ip-10-0-138-136 kubenswrapper[2583]: I0709 02:34:55.017848 2583 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-cluster-samples-operator/cluster-samples-operator-56fcf86bf-78sff"] Jul 09 02:34:55.017987 ip-10-0-138-136 kubenswrapper[2583]: I0709 02:34:55.017973 2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console-operator/console-operator-68b757fb67-xpjsj" Jul 09 02:34:55.020216 ip-10-0-138-136 kubenswrapper[2583]: I0709 02:34:55.020187 2583 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console-operator\"/\"serving-cert\"" Jul 09 02:34:55.020428 ip-10-0-138-136 kubenswrapper[2583]: I0709 02:34:55.020415 2583 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console-operator\"/\"kube-root-ca.crt\"" Jul 09 02:34:55.020428 ip-10-0-138-136 kubenswrapper[2583]: I0709 02:34:55.020423 2583 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console-operator\"/\"openshift-service-ca.crt\"" Jul 09 02:34:55.020553 ip-10-0-138-136 kubenswrapper[2583]: I0709 02:34:55.020443 2583 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console-operator\"/\"console-operator-dockercfg-xdf66\"" Jul 09 02:34:55.020553 ip-10-0-138-136 kubenswrapper[2583]: I0709 02:34:55.020496 2583 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console-operator\"/\"console-operator-config\"" Jul 09 02:34:55.025740 ip-10-0-138-136 kubenswrapper[2583]: I0709 02:34:55.025706 2583 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console-operator\"/\"trusted-ca\"" Jul 09 02:34:55.041877 ip-10-0-138-136 kubenswrapper[2583]: I0709 02:34:55.041835 2583 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/router-default-6575bfb5cc-2ttlz"] Jul 09 02:34:55.041956 ip-10-0-138-136 kubenswrapper[2583]: I0709 02:34:55.041942 2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-samples-operator/cluster-samples-operator-56fcf86bf-78sff" Jul 09 02:34:55.044212 ip-10-0-138-136 kubenswrapper[2583]: I0709 02:34:55.044194 2583 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-samples-operator\"/\"cluster-samples-operator-dockercfg-jmmhc\"" Jul 09 02:34:55.044281 ip-10-0-138-136 kubenswrapper[2583]: I0709 02:34:55.044217 2583 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-samples-operator\"/\"kube-root-ca.crt\"" Jul 09 02:34:55.044281 ip-10-0-138-136 kubenswrapper[2583]: I0709 02:34:55.044226 2583 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-samples-operator\"/\"openshift-service-ca.crt\"" Jul 09 02:34:55.044376 ip-10-0-138-136 kubenswrapper[2583]: I0709 02:34:55.044280 2583 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-samples-operator\"/\"samples-operator-tls\"" Jul 09 02:34:55.061927 ip-10-0-138-136 kubenswrapper[2583]: I0709 02:34:55.061902 2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-cluster-storage-operator/volume-data-source-validator-5d456fdbcd-bdg6h"] Jul 09 02:34:55.061927 ip-10-0-138-136 kubenswrapper[2583]: I0709 02:34:55.061927 2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console-operator/console-operator-68b757fb67-xpjsj"] Jul 09 02:34:55.062089 ip-10-0-138-136 kubenswrapper[2583]: I0709 02:34:55.061940 2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/cluster-monitoring-operator-64786d9cbb-grbsm"] Jul 09 02:34:55.062089 ip-10-0-138-136 kubenswrapper[2583]: I0709 02:34:55.061955 2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-cluster-samples-operator/cluster-samples-operator-56fcf86bf-78sff"] Jul 09 02:34:55.062089 ip-10-0-138-136 kubenswrapper[2583]: I0709 02:34:55.061979 2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-image-registry/image-registry-59569495f9-rmmlc"] Jul 09 02:34:55.062089 ip-10-0-138-136 kubenswrapper[2583]: I0709 02:34:55.061997 2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-operator-5c847dcfc4-rwvrr"] Jul 09 02:34:55.062089 ip-10-0-138-136 kubenswrapper[2583]: I0709 02:34:55.062023 2583 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-846bf668f7-vls7g"] Jul 09 02:34:55.062089 ip-10-0-138-136 kubenswrapper[2583]: I0709 02:34:55.061996 2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/router-default-6575bfb5cc-2ttlz" Jul 09 02:34:55.064387 ip-10-0-138-136 kubenswrapper[2583]: I0709 02:34:55.064372 2583 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"kube-root-ca.crt\"" Jul 09 02:34:55.064695 ip-10-0-138-136 kubenswrapper[2583]: I0709 02:34:55.064681 2583 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"router-dockercfg-pgkqd\"" Jul 09 02:34:55.064695 ip-10-0-138-136 kubenswrapper[2583]: I0709 02:34:55.064690 2583 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"default-ingress-cert\"" Jul 09 02:34:55.064821 ip-10-0-138-136 kubenswrapper[2583]: I0709 02:34:55.064763 2583 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"router-stats-default\"" Jul 09 02:34:55.064821 ip-10-0-138-136 kubenswrapper[2583]: I0709 02:34:55.064811 2583 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"service-ca-bundle\"" Jul 09 02:34:55.064919 ip-10-0-138-136 kubenswrapper[2583]: I0709 02:34:55.064812 2583 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"router-metrics-certs-default\"" Jul 09 02:34:55.064919 ip-10-0-138-136 kubenswrapper[2583]: I0709 02:34:55.064887 2583 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"openshift-service-ca.crt\"" Jul 09 02:34:55.072001 ip-10-0-138-136 kubenswrapper[2583]: I0709 02:34:55.071985 2583 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-network-console/networking-console-plugin-6bffdf9778-j5xzm"] Jul 09 02:34:55.072094 ip-10-0-138-136 kubenswrapper[2583]: I0709 02:34:55.072082 2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-846bf668f7-vls7g" Jul 09 02:34:55.074005 ip-10-0-138-136 kubenswrapper[2583]: I0709 02:34:55.073985 2583 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-kube-storage-version-migrator-operator\"/\"serving-cert\"" Jul 09 02:34:55.074098 ip-10-0-138-136 kubenswrapper[2583]: I0709 02:34:55.074039 2583 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-kube-storage-version-migrator-operator\"/\"config\"" Jul 09 02:34:55.074098 ip-10-0-138-136 kubenswrapper[2583]: I0709 02:34:55.074054 2583 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-kube-storage-version-migrator-operator\"/\"openshift-service-ca.crt\"" Jul 09 02:34:55.074199 ip-10-0-138-136 kubenswrapper[2583]: I0709 02:34:55.074113 2583 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-kube-storage-version-migrator-operator\"/\"kube-storage-version-migrator-operator-dockercfg-ldfzt\"" Jul 09 02:34:55.074259 ip-10-0-138-136 kubenswrapper[2583]: I0709 02:34:55.074242 2583 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-kube-storage-version-migrator-operator\"/\"kube-root-ca.crt\"" Jul 09 02:34:55.085151 ip-10-0-138-136 kubenswrapper[2583]: I0709 02:34:55.085134 2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/9af4ab52-6748-4090-a7a0-8666391d9bfa-registry-certificates\") pod \"image-registry-59569495f9-rmmlc\" (UID: \"9af4ab52-6748-4090-a7a0-8666391d9bfa\") " pod="openshift-image-registry/image-registry-59569495f9-rmmlc" Jul 09 02:34:55.085255 ip-10-0-138-136 kubenswrapper[2583]: I0709 02:34:55.085168 2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/bb24b378-f56e-46cb-8881-3f44c1a40391-serving-cert\") pod \"insights-operator-5c847dcfc4-rwvrr\" (UID: \"bb24b378-f56e-46cb-8881-3f44c1a40391\") " pod="openshift-insights/insights-operator-5c847dcfc4-rwvrr" Jul 09 02:34:55.085255 ip-10-0-138-136 kubenswrapper[2583]: I0709 02:34:55.085186 2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/a88b1ede-8749-4df5-88d8-494cfd9cfd83-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-64786d9cbb-grbsm\" (UID: \"a88b1ede-8749-4df5-88d8-494cfd9cfd83\") " pod="openshift-monitoring/cluster-monitoring-operator-64786d9cbb-grbsm" Jul 09 02:34:55.085255 ip-10-0-138-136 kubenswrapper[2583]: I0709 02:34:55.085203 2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-m7ds5\" (UniqueName: \"kubernetes.io/projected/bb24b378-f56e-46cb-8881-3f44c1a40391-kube-api-access-m7ds5\") pod \"insights-operator-5c847dcfc4-rwvrr\" (UID: \"bb24b378-f56e-46cb-8881-3f44c1a40391\") " pod="openshift-insights/insights-operator-5c847dcfc4-rwvrr" Jul 09 02:34:55.085255 ip-10-0-138-136 kubenswrapper[2583]: I0709 02:34:55.085218 2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-qjdsb\" (UniqueName: \"kubernetes.io/projected/a88b1ede-8749-4df5-88d8-494cfd9cfd83-kube-api-access-qjdsb\") pod \"cluster-monitoring-operator-64786d9cbb-grbsm\" (UID: \"a88b1ede-8749-4df5-88d8-494cfd9cfd83\") " pod="openshift-monitoring/cluster-monitoring-operator-64786d9cbb-grbsm" Jul 09 02:34:55.085386 ip-10-0-138-136 kubenswrapper[2583]: I0709 02:34:55.085290 2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/9af4ab52-6748-4090-a7a0-8666391d9bfa-registry-tls\") pod \"image-registry-59569495f9-rmmlc\" (UID: \"9af4ab52-6748-4090-a7a0-8666391d9bfa\") " pod="openshift-image-registry/image-registry-59569495f9-rmmlc" Jul 09 02:34:55.085386 ip-10-0-138-136 kubenswrapper[2583]: I0709 02:34:55.085314 2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/bb24b378-f56e-46cb-8881-3f44c1a40391-tmp\") pod \"insights-operator-5c847dcfc4-rwvrr\" (UID: \"bb24b378-f56e-46cb-8881-3f44c1a40391\") " pod="openshift-insights/insights-operator-5c847dcfc4-rwvrr" Jul 09 02:34:55.085386 ip-10-0-138-136 kubenswrapper[2583]: I0709 02:34:55.085333 2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/9af4ab52-6748-4090-a7a0-8666391d9bfa-installation-pull-secrets\") pod \"image-registry-59569495f9-rmmlc\" (UID: \"9af4ab52-6748-4090-a7a0-8666391d9bfa\") " pod="openshift-image-registry/image-registry-59569495f9-rmmlc" Jul 09 02:34:55.085386 ip-10-0-138-136 kubenswrapper[2583]: I0709 02:34:55.085349 2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-xjjfh\" (UniqueName: \"kubernetes.io/projected/c1ea28bb-bfb9-477c-a144-6d7dfd62c073-kube-api-access-xjjfh\") pod \"volume-data-source-validator-5d456fdbcd-bdg6h\" (UID: \"c1ea28bb-bfb9-477c-a144-6d7dfd62c073\") " pod="openshift-cluster-storage-operator/volume-data-source-validator-5d456fdbcd-bdg6h" Jul 09 02:34:55.085386 ip-10-0-138-136 kubenswrapper[2583]: I0709 02:34:55.085373 2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/9af4ab52-6748-4090-a7a0-8666391d9bfa-image-registry-private-configuration\") pod \"image-registry-59569495f9-rmmlc\" (UID: \"9af4ab52-6748-4090-a7a0-8666391d9bfa\") " pod="openshift-image-registry/image-registry-59569495f9-rmmlc" Jul 09 02:34:55.085541 ip-10-0-138-136 kubenswrapper[2583]: I0709 02:34:55.085431 2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/9af4ab52-6748-4090-a7a0-8666391d9bfa-ca-trust-extracted\") pod \"image-registry-59569495f9-rmmlc\" (UID: \"9af4ab52-6748-4090-a7a0-8666391d9bfa\") " pod="openshift-image-registry/image-registry-59569495f9-rmmlc" Jul 09 02:34:55.085541 ip-10-0-138-136 kubenswrapper[2583]: I0709 02:34:55.085450 2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/9af4ab52-6748-4090-a7a0-8666391d9bfa-bound-sa-token\") pod \"image-registry-59569495f9-rmmlc\" (UID: \"9af4ab52-6748-4090-a7a0-8666391d9bfa\") " pod="openshift-image-registry/image-registry-59569495f9-rmmlc" Jul 09 02:34:55.085541 ip-10-0-138-136 kubenswrapper[2583]: I0709 02:34:55.085465 2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/9af4ab52-6748-4090-a7a0-8666391d9bfa-trusted-ca\") pod \"image-registry-59569495f9-rmmlc\" (UID: \"9af4ab52-6748-4090-a7a0-8666391d9bfa\") " pod="openshift-image-registry/image-registry-59569495f9-rmmlc" Jul 09 02:34:55.085541 ip-10-0-138-136 kubenswrapper[2583]: I0709 02:34:55.085481 2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"snapshots\" (UniqueName: \"kubernetes.io/empty-dir/bb24b378-f56e-46cb-8881-3f44c1a40391-snapshots\") pod \"insights-operator-5c847dcfc4-rwvrr\" (UID: \"bb24b378-f56e-46cb-8881-3f44c1a40391\") " pod="openshift-insights/insights-operator-5c847dcfc4-rwvrr" Jul 09 02:34:55.085541 ip-10-0-138-136 kubenswrapper[2583]: I0709 02:34:55.085504 2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/bb24b378-f56e-46cb-8881-3f44c1a40391-trusted-ca-bundle\") pod \"insights-operator-5c847dcfc4-rwvrr\" (UID: \"bb24b378-f56e-46cb-8881-3f44c1a40391\") " pod="openshift-insights/insights-operator-5c847dcfc4-rwvrr" Jul 09 02:34:55.085541 ip-10-0-138-136 kubenswrapper[2583]: I0709 02:34:55.085520 2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/bb24b378-f56e-46cb-8881-3f44c1a40391-service-ca-bundle\") pod \"insights-operator-5c847dcfc4-rwvrr\" (UID: \"bb24b378-f56e-46cb-8881-3f44c1a40391\") " pod="openshift-insights/insights-operator-5c847dcfc4-rwvrr" Jul 09 02:34:55.085541 ip-10-0-138-136 kubenswrapper[2583]: I0709 02:34:55.085537 2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-vstrs\" (UniqueName: \"kubernetes.io/projected/9af4ab52-6748-4090-a7a0-8666391d9bfa-kube-api-access-vstrs\") pod \"image-registry-59569495f9-rmmlc\" (UID: \"9af4ab52-6748-4090-a7a0-8666391d9bfa\") " pod="openshift-image-registry/image-registry-59569495f9-rmmlc" Jul 09 02:34:55.085757 ip-10-0-138-136 kubenswrapper[2583]: I0709 02:34:55.085553 2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"telemetry-config\" (UniqueName: \"kubernetes.io/configmap/a88b1ede-8749-4df5-88d8-494cfd9cfd83-telemetry-config\") pod \"cluster-monitoring-operator-64786d9cbb-grbsm\" (UID: \"a88b1ede-8749-4df5-88d8-494cfd9cfd83\") " pod="openshift-monitoring/cluster-monitoring-operator-64786d9cbb-grbsm" Jul 09 02:34:55.086134 ip-10-0-138-136 kubenswrapper[2583]: I0709 02:34:55.086118 2583 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-dns/dns-default-rwlzs"] Jul 09 02:34:55.086226 ip-10-0-138-136 kubenswrapper[2583]: I0709 02:34:55.086212 2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-console/networking-console-plugin-6bffdf9778-j5xzm" Jul 09 02:34:55.088182 ip-10-0-138-136 kubenswrapper[2583]: I0709 02:34:55.088166 2583 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-console\"/\"networking-console-plugin-cert\"" Jul 09 02:34:55.088277 ip-10-0-138-136 kubenswrapper[2583]: I0709 02:34:55.088174 2583 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-console\"/\"default-dockercfg-svrw7\"" Jul 09 02:34:55.088277 ip-10-0-138-136 kubenswrapper[2583]: I0709 02:34:55.088230 2583 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-console\"/\"networking-console-plugin\"" Jul 09 02:34:55.096337 ip-10-0-138-136 kubenswrapper[2583]: I0709 02:34:55.096319 2583 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-service-ca-operator/service-ca-operator-5d46d9ffd4-p9zgk"] Jul 09 02:34:55.096523 ip-10-0-138-136 kubenswrapper[2583]: I0709 02:34:55.096499 2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-rwlzs" Jul 09 02:34:55.098641 ip-10-0-138-136 kubenswrapper[2583]: I0709 02:34:55.098624 2583 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-dockercfg-jllr5\"" Jul 09 02:34:55.098744 ip-10-0-138-136 kubenswrapper[2583]: I0709 02:34:55.098656 2583 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-default-metrics-tls\"" Jul 09 02:34:55.098744 ip-10-0-138-136 kubenswrapper[2583]: I0709 02:34:55.098672 2583 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"dns-default\"" Jul 09 02:34:55.101863 ip-10-0-138-136 kubenswrapper[2583]: I0709 02:34:55.101845 2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gszbq_6d20c3fe-b459-4dbb-86a7-3903e967b424/konnectivity-agent/0.log" limit=1024 Jul 09 02:34:55.112430 ip-10-0-138-136 kubenswrapper[2583]: I0709 02:34:55.112407 2583 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-network-diagnostics/network-check-source-989f8b8dc-qhcpn"] Jul 09 02:34:55.112520 ip-10-0-138-136 kubenswrapper[2583]: I0709 02:34:55.112505 2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-service-ca-operator/service-ca-operator-5d46d9ffd4-p9zgk" Jul 09 02:34:55.114495 ip-10-0-138-136 kubenswrapper[2583]: I0709 02:34:55.114479 2583 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-service-ca-operator\"/\"serving-cert\"" Jul 09 02:34:55.114964 ip-10-0-138-136 kubenswrapper[2583]: I0709 02:34:55.114940 2583 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-service-ca-operator\"/\"openshift-service-ca.crt\"" Jul 09 02:34:55.115119 ip-10-0-138-136 kubenswrapper[2583]: I0709 02:34:55.115100 2583 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-service-ca-operator\"/\"service-ca-operator-dockercfg-w7xj9\"" Jul 09 02:34:55.115237 ip-10-0-138-136 kubenswrapper[2583]: I0709 02:34:55.115220 2583 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-service-ca-operator\"/\"kube-root-ca.crt\"" Jul 09 02:34:55.115373 ip-10-0-138-136 kubenswrapper[2583]: I0709 02:34:55.115357 2583 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-service-ca-operator\"/\"service-ca-operator-config\"" Jul 09 02:34:55.122477 ip-10-0-138-136 kubenswrapper[2583]: I0709 02:34:55.122461 2583 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress-canary/ingress-canary-dhcrr"] Jul 09 02:34:55.122569 ip-10-0-138-136 kubenswrapper[2583]: I0709 02:34:55.122556 2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-source-989f8b8dc-qhcpn" Jul 09 02:34:55.124930 ip-10-0-138-136 kubenswrapper[2583]: I0709 02:34:55.124799 2583 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"openshift-service-ca.crt\"" Jul 09 02:34:55.124930 ip-10-0-138-136 kubenswrapper[2583]: I0709 02:34:55.124811 2583 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"kube-root-ca.crt\"" Jul 09 02:34:55.124930 ip-10-0-138-136 kubenswrapper[2583]: I0709 02:34:55.124835 2583 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"network-diagnostics-dockercfg-9w5p6\"" Jul 09 02:34:55.134597 ip-10-0-138-136 kubenswrapper[2583]: I0709 02:34:55.134581 2583 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-66ff5df664-dkjgb"] Jul 09 02:34:55.134691 ip-10-0-138-136 kubenswrapper[2583]: I0709 02:34:55.134678 2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress-canary/ingress-canary-dhcrr" Jul 09 02:34:55.136983 ip-10-0-138-136 kubenswrapper[2583]: I0709 02:34:55.136959 2583 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress-canary\"/\"openshift-service-ca.crt\"" Jul 09 02:34:55.137087 ip-10-0-138-136 kubenswrapper[2583]: I0709 02:34:55.136996 2583 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-canary\"/\"canary-serving-cert\"" Jul 09 02:34:55.137087 ip-10-0-138-136 kubenswrapper[2583]: I0709 02:34:55.137008 2583 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-canary\"/\"default-dockercfg-df9xh\"" Jul 09 02:34:55.137087 ip-10-0-138-136 kubenswrapper[2583]: I0709 02:34:55.137037 2583 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress-canary\"/\"kube-root-ca.crt\"" Jul 09 02:34:55.150801 ip-10-0-138-136 kubenswrapper[2583]: I0709 02:34:55.150779 2583 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["open-cluster-management-agent-addon/klusterlet-addon-workmgr-59d6c8b955-md6hq"] Jul 09 02:34:55.150952 ip-10-0-138-136 kubenswrapper[2583]: I0709 02:34:55.150899 2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-66ff5df664-dkjgb" Jul 09 02:34:55.153122 ip-10-0-138-136 kubenswrapper[2583]: I0709 02:34:55.153073 2583 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"open-cluster-management-image-pull-credentials\"" Jul 09 02:34:55.153122 ip-10-0-138-136 kubenswrapper[2583]: I0709 02:34:55.153083 2583 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"open-cluster-management-agent-addon\"/\"openshift-service-ca.crt\"" Jul 09 02:34:55.153122 ip-10-0-138-136 kubenswrapper[2583]: I0709 02:34:55.153079 2583 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"managed-serviceaccount-dockercfg-cdrsq\"" Jul 09 02:34:55.153122 ip-10-0-138-136 kubenswrapper[2583]: I0709 02:34:55.153099 2583 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"open-cluster-management-agent-addon\"/\"kube-root-ca.crt\"" Jul 09 02:34:55.153314 ip-10-0-138-136 kubenswrapper[2583]: I0709 02:34:55.153102 2583 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"managed-serviceaccount-hub-kubeconfig\"" Jul 09 02:34:55.160801 ip-10-0-138-136 kubenswrapper[2583]: I0709 02:34:55.160787 2583 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["open-cluster-management-agent-addon/cluster-proxy-proxy-agent-5f9bc9c474-jgh2b"] Jul 09 02:34:55.160899 ip-10-0-138-136 kubenswrapper[2583]: I0709 02:34:55.160887 2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-59d6c8b955-md6hq" Jul 09 02:34:55.162841 ip-10-0-138-136 kubenswrapper[2583]: I0709 02:34:55.162827 2583 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"work-manager-hub-kubeconfig\"" Jul 09 02:34:55.174998 ip-10-0-138-136 kubenswrapper[2583]: I0709 02:34:55.174968 2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-846bf668f7-vls7g"] Jul 09 02:34:55.174998 ip-10-0-138-136 kubenswrapper[2583]: I0709 02:34:55.174996 2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-source-989f8b8dc-qhcpn"] Jul 09 02:34:55.175159 ip-10-0-138-136 kubenswrapper[2583]: I0709 02:34:55.175010 2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-service-ca-operator/service-ca-operator-5d46d9ffd4-p9zgk"] Jul 09 02:34:55.175159 ip-10-0-138-136 kubenswrapper[2583]: I0709 02:34:55.175023 2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["open-cluster-management-agent-addon/klusterlet-addon-workmgr-59d6c8b955-md6hq"] Jul 09 02:34:55.175159 ip-10-0-138-136 kubenswrapper[2583]: I0709 02:34:55.175040 2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-dns/dns-default-rwlzs"] Jul 09 02:34:55.175159 ip-10-0-138-136 kubenswrapper[2583]: I0709 02:34:55.175064 2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/router-default-6575bfb5cc-2ttlz"] Jul 09 02:34:55.175159 ip-10-0-138-136 kubenswrapper[2583]: I0709 02:34:55.175076 2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["open-cluster-management-agent-addon/cluster-proxy-proxy-agent-5f9bc9c474-jgh2b"] Jul 09 02:34:55.175159 ip-10-0-138-136 kubenswrapper[2583]: I0709 02:34:55.175085 2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-5f9bc9c474-jgh2b" Jul 09 02:34:55.175159 ip-10-0-138-136 kubenswrapper[2583]: I0709 02:34:55.175090 2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-66ff5df664-dkjgb"] Jul 09 02:34:55.175159 ip-10-0-138-136 kubenswrapper[2583]: I0709 02:34:55.175158 2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress-canary/ingress-canary-dhcrr"] Jul 09 02:34:55.175482 ip-10-0-138-136 kubenswrapper[2583]: I0709 02:34:55.175184 2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-console/networking-console-plugin-6bffdf9778-j5xzm"] Jul 09 02:34:55.177305 ip-10-0-138-136 kubenswrapper[2583]: I0709 02:34:55.177288 2583 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"cluster-proxy-ca\"" Jul 09 02:34:55.177398 ip-10-0-138-136 kubenswrapper[2583]: I0709 02:34:55.177308 2583 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"cluster-proxy-hub-kubeconfig\"" Jul 09 02:34:55.177398 ip-10-0-138-136 kubenswrapper[2583]: I0709 02:34:55.177313 2583 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"cluster-proxy-open-cluster-management.io-proxy-agent-signer-client-cert\"" Jul 09 02:34:55.177398 ip-10-0-138-136 kubenswrapper[2583]: I0709 02:34:55.177330 2583 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"cluster-proxy-service-proxy-server-certificates\"" Jul 09 02:34:55.186533 ip-10-0-138-136 kubenswrapper[2583]: I0709 02:34:55.186515 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-xjjfh\" (UniqueName: \"kubernetes.io/projected/c1ea28bb-bfb9-477c-a144-6d7dfd62c073-kube-api-access-xjjfh\") pod \"volume-data-source-validator-5d456fdbcd-bdg6h\" (UID: \"c1ea28bb-bfb9-477c-a144-6d7dfd62c073\") " pod="openshift-cluster-storage-operator/volume-data-source-validator-5d456fdbcd-bdg6h" Jul 09 02:34:55.186626 ip-10-0-138-136 kubenswrapper[2583]: I0709 02:34:55.186546 2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"nginx-conf\" (UniqueName: \"kubernetes.io/configmap/ac99dbf2-7e27-437b-a386-89821f738a52-nginx-conf\") pod \"networking-console-plugin-6bffdf9778-j5xzm\" (UID: \"ac99dbf2-7e27-437b-a386-89821f738a52\") " pod="openshift-network-console/networking-console-plugin-6bffdf9778-j5xzm" Jul 09 02:34:55.186626 ip-10-0-138-136 kubenswrapper[2583]: I0709 02:34:55.186564 2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-b82hs\" (UniqueName: \"kubernetes.io/projected/bd5345b9-08c2-4d1c-a033-a5c458c74773-kube-api-access-b82hs\") pod \"dns-default-rwlzs\" (UID: \"bd5345b9-08c2-4d1c-a033-a5c458c74773\") " pod="openshift-dns/dns-default-rwlzs" Jul 09 02:34:55.186626 ip-10-0-138-136 kubenswrapper[2583]: I0709 02:34:55.186583 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/9af4ab52-6748-4090-a7a0-8666391d9bfa-registry-tls\") pod \"image-registry-59569495f9-rmmlc\" (UID: \"9af4ab52-6748-4090-a7a0-8666391d9bfa\") " pod="openshift-image-registry/image-registry-59569495f9-rmmlc" Jul 09 02:34:55.186626 ip-10-0-138-136 kubenswrapper[2583]: I0709 02:34:55.186604 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/bb24b378-f56e-46cb-8881-3f44c1a40391-tmp\") pod \"insights-operator-5c847dcfc4-rwvrr\" (UID: \"bb24b378-f56e-46cb-8881-3f44c1a40391\") " pod="openshift-insights/insights-operator-5c847dcfc4-rwvrr" Jul 09 02:34:55.186898 ip-10-0-138-136 kubenswrapper[2583]: I0709 02:34:55.186638 2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/9d809968-31d3-4c4d-be19-234664db4a04-serving-cert\") pod \"kube-storage-version-migrator-operator-846bf668f7-vls7g\" (UID: \"9d809968-31d3-4c4d-be19-234664db4a04\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-846bf668f7-vls7g" Jul 09 02:34:55.186898 ip-10-0-138-136 kubenswrapper[2583]: I0709 02:34:55.186669 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/9af4ab52-6748-4090-a7a0-8666391d9bfa-installation-pull-secrets\") pod \"image-registry-59569495f9-rmmlc\" (UID: \"9af4ab52-6748-4090-a7a0-8666391d9bfa\") " pod="openshift-image-registry/image-registry-59569495f9-rmmlc" Jul 09 02:34:55.186898 ip-10-0-138-136 kubenswrapper[2583]: E0709 02:34:55.186692 2583 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found Jul 09 02:34:55.186898 ip-10-0-138-136 kubenswrapper[2583]: E0709 02:34:55.186707 2583 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-59569495f9-rmmlc: secret "image-registry-tls" not found Jul 09 02:34:55.186898 ip-10-0-138-136 kubenswrapper[2583]: I0709 02:34:55.186695 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/9af4ab52-6748-4090-a7a0-8666391d9bfa-image-registry-private-configuration\") pod \"image-registry-59569495f9-rmmlc\" (UID: \"9af4ab52-6748-4090-a7a0-8666391d9bfa\") " pod="openshift-image-registry/image-registry-59569495f9-rmmlc" Jul 09 02:34:55.186898 ip-10-0-138-136 kubenswrapper[2583]: I0709 02:34:55.186768 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/9af4ab52-6748-4090-a7a0-8666391d9bfa-bound-sa-token\") pod \"image-registry-59569495f9-rmmlc\" (UID: \"9af4ab52-6748-4090-a7a0-8666391d9bfa\") " pod="openshift-image-registry/image-registry-59569495f9-rmmlc" Jul 09 02:34:55.186898 ip-10-0-138-136 kubenswrapper[2583]: E0709 02:34:55.186786 2583 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/9af4ab52-6748-4090-a7a0-8666391d9bfa-registry-tls podName:9af4ab52-6748-4090-a7a0-8666391d9bfa nodeName:}" failed. No retries permitted until 2026-07-09 02:34:55.68676668 +0000 UTC m=+41.619224163 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/9af4ab52-6748-4090-a7a0-8666391d9bfa-registry-tls") pod "image-registry-59569495f9-rmmlc" (UID: "9af4ab52-6748-4090-a7a0-8666391d9bfa") : secret "image-registry-tls" not found Jul 09 02:34:55.186898 ip-10-0-138-136 kubenswrapper[2583]: I0709 02:34:55.186818 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-qjdsb\" (UniqueName: \"kubernetes.io/projected/a88b1ede-8749-4df5-88d8-494cfd9cfd83-kube-api-access-qjdsb\") pod \"cluster-monitoring-operator-64786d9cbb-grbsm\" (UID: \"a88b1ede-8749-4df5-88d8-494cfd9cfd83\") " pod="openshift-monitoring/cluster-monitoring-operator-64786d9cbb-grbsm" Jul 09 02:34:55.186898 ip-10-0-138-136 kubenswrapper[2583]: I0709 02:34:55.186859 2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/bd5345b9-08c2-4d1c-a033-a5c458c74773-config-volume\") pod \"dns-default-rwlzs\" (UID: \"bd5345b9-08c2-4d1c-a033-a5c458c74773\") " pod="openshift-dns/dns-default-rwlzs" Jul 09 02:34:55.186898 ip-10-0-138-136 kubenswrapper[2583]: I0709 02:34:55.186887 2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"default-certificate\" (UniqueName: \"kubernetes.io/secret/49f19d77-82e8-419b-a88b-09c9ee4354a8-default-certificate\") pod \"router-default-6575bfb5cc-2ttlz\" (UID: \"49f19d77-82e8-419b-a88b-09c9ee4354a8\") " pod="openshift-ingress/router-default-6575bfb5cc-2ttlz" Jul 09 02:34:55.187312 ip-10-0-138-136 kubenswrapper[2583]: I0709 02:34:55.186951 2583 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/bb24b378-f56e-46cb-8881-3f44c1a40391-tmp\") pod \"insights-operator-5c847dcfc4-rwvrr\" (UID: \"bb24b378-f56e-46cb-8881-3f44c1a40391\") " pod="openshift-insights/insights-operator-5c847dcfc4-rwvrr" Jul 09 02:34:55.187312 ip-10-0-138-136 kubenswrapper[2583]: I0709 02:34:55.187014 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/bb24b378-f56e-46cb-8881-3f44c1a40391-trusted-ca-bundle\") pod \"insights-operator-5c847dcfc4-rwvrr\" (UID: \"bb24b378-f56e-46cb-8881-3f44c1a40391\") " pod="openshift-insights/insights-operator-5c847dcfc4-rwvrr" Jul 09 02:34:55.187312 ip-10-0-138-136 kubenswrapper[2583]: I0709 02:34:55.187039 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/bb24b378-f56e-46cb-8881-3f44c1a40391-service-ca-bundle\") pod \"insights-operator-5c847dcfc4-rwvrr\" (UID: \"bb24b378-f56e-46cb-8881-3f44c1a40391\") " pod="openshift-insights/insights-operator-5c847dcfc4-rwvrr" Jul 09 02:34:55.187312 ip-10-0-138-136 kubenswrapper[2583]: I0709 02:34:55.187068 2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/188e21f3-2ce9-4012-ada2-a46c32d56729-serving-cert\") pod \"console-operator-68b757fb67-xpjsj\" (UID: \"188e21f3-2ce9-4012-ada2-a46c32d56729\") " pod="openshift-console-operator/console-operator-68b757fb67-xpjsj" Jul 09 02:34:55.187312 ip-10-0-138-136 kubenswrapper[2583]: I0709 02:34:55.187083 2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/bd5345b9-08c2-4d1c-a033-a5c458c74773-tmp-dir\") pod \"dns-default-rwlzs\" (UID: \"bd5345b9-08c2-4d1c-a033-a5c458c74773\") " pod="openshift-dns/dns-default-rwlzs" Jul 09 02:34:55.187312 ip-10-0-138-136 kubenswrapper[2583]: I0709 02:34:55.187126 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/a88b1ede-8749-4df5-88d8-494cfd9cfd83-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-64786d9cbb-grbsm\" (UID: \"a88b1ede-8749-4df5-88d8-494cfd9cfd83\") " pod="openshift-monitoring/cluster-monitoring-operator-64786d9cbb-grbsm" Jul 09 02:34:55.187312 ip-10-0-138-136 kubenswrapper[2583]: I0709 02:34:55.187147 2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/9d809968-31d3-4c4d-be19-234664db4a04-config\") pod \"kube-storage-version-migrator-operator-846bf668f7-vls7g\" (UID: \"9d809968-31d3-4c4d-be19-234664db4a04\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-846bf668f7-vls7g" Jul 09 02:34:55.187312 ip-10-0-138-136 kubenswrapper[2583]: I0709 02:34:55.187171 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/bb24b378-f56e-46cb-8881-3f44c1a40391-serving-cert\") pod \"insights-operator-5c847dcfc4-rwvrr\" (UID: \"bb24b378-f56e-46cb-8881-3f44c1a40391\") " pod="openshift-insights/insights-operator-5c847dcfc4-rwvrr" Jul 09 02:34:55.187312 ip-10-0-138-136 kubenswrapper[2583]: I0709 02:34:55.187196 2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-ltbn4\" (UniqueName: \"kubernetes.io/projected/9d809968-31d3-4c4d-be19-234664db4a04-kube-api-access-ltbn4\") pod \"kube-storage-version-migrator-operator-846bf668f7-vls7g\" (UID: \"9d809968-31d3-4c4d-be19-234664db4a04\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-846bf668f7-vls7g" Jul 09 02:34:55.187312 ip-10-0-138-136 kubenswrapper[2583]: I0709 02:34:55.187225 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-m7ds5\" (UniqueName: \"kubernetes.io/projected/bb24b378-f56e-46cb-8881-3f44c1a40391-kube-api-access-m7ds5\") pod \"insights-operator-5c847dcfc4-rwvrr\" (UID: \"bb24b378-f56e-46cb-8881-3f44c1a40391\") " pod="openshift-insights/insights-operator-5c847dcfc4-rwvrr" Jul 09 02:34:55.187312 ip-10-0-138-136 kubenswrapper[2583]: E0709 02:34:55.187235 2583 secret.go:189] Couldn't get secret openshift-monitoring/cluster-monitoring-operator-tls: secret "cluster-monitoring-operator-tls" not found Jul 09 02:34:55.187312 ip-10-0-138-136 kubenswrapper[2583]: I0709 02:34:55.187254 2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/ac99dbf2-7e27-437b-a386-89821f738a52-networking-console-plugin-cert\") pod \"networking-console-plugin-6bffdf9778-j5xzm\" (UID: \"ac99dbf2-7e27-437b-a386-89821f738a52\") " pod="openshift-network-console/networking-console-plugin-6bffdf9778-j5xzm" Jul 09 02:34:55.187312 ip-10-0-138-136 kubenswrapper[2583]: E0709 02:34:55.187297 2583 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/a88b1ede-8749-4df5-88d8-494cfd9cfd83-cluster-monitoring-operator-tls podName:a88b1ede-8749-4df5-88d8-494cfd9cfd83 nodeName:}" failed. No retries permitted until 2026-07-09 02:34:55.68727957 +0000 UTC m=+41.619737049 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "cluster-monitoring-operator-tls" (UniqueName: "kubernetes.io/secret/a88b1ede-8749-4df5-88d8-494cfd9cfd83-cluster-monitoring-operator-tls") pod "cluster-monitoring-operator-64786d9cbb-grbsm" (UID: "a88b1ede-8749-4df5-88d8-494cfd9cfd83") : secret "cluster-monitoring-operator-tls" not found Jul 09 02:34:55.187961 ip-10-0-138-136 kubenswrapper[2583]: I0709 02:34:55.187318 2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/49f19d77-82e8-419b-a88b-09c9ee4354a8-service-ca-bundle\") pod \"router-default-6575bfb5cc-2ttlz\" (UID: \"49f19d77-82e8-419b-a88b-09c9ee4354a8\") " pod="openshift-ingress/router-default-6575bfb5cc-2ttlz" Jul 09 02:34:55.187961 ip-10-0-138-136 kubenswrapper[2583]: I0709 02:34:55.187357 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/9af4ab52-6748-4090-a7a0-8666391d9bfa-ca-trust-extracted\") pod \"image-registry-59569495f9-rmmlc\" (UID: \"9af4ab52-6748-4090-a7a0-8666391d9bfa\") " pod="openshift-image-registry/image-registry-59569495f9-rmmlc" Jul 09 02:34:55.187961 ip-10-0-138-136 kubenswrapper[2583]: I0709 02:34:55.187384 2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/188e21f3-2ce9-4012-ada2-a46c32d56729-trusted-ca\") pod \"console-operator-68b757fb67-xpjsj\" (UID: \"188e21f3-2ce9-4012-ada2-a46c32d56729\") " pod="openshift-console-operator/console-operator-68b757fb67-xpjsj" Jul 09 02:34:55.187961 ip-10-0-138-136 kubenswrapper[2583]: I0709 02:34:55.187409 2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/bd5345b9-08c2-4d1c-a033-a5c458c74773-metrics-tls\") pod \"dns-default-rwlzs\" (UID: \"bd5345b9-08c2-4d1c-a033-a5c458c74773\") " pod="openshift-dns/dns-default-rwlzs" Jul 09 02:34:55.187961 ip-10-0-138-136 kubenswrapper[2583]: I0709 02:34:55.187435 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/9af4ab52-6748-4090-a7a0-8666391d9bfa-trusted-ca\") pod \"image-registry-59569495f9-rmmlc\" (UID: \"9af4ab52-6748-4090-a7a0-8666391d9bfa\") " pod="openshift-image-registry/image-registry-59569495f9-rmmlc" Jul 09 02:34:55.187961 ip-10-0-138-136 kubenswrapper[2583]: I0709 02:34:55.187461 2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-f2xn4\" (UniqueName: \"kubernetes.io/projected/49f19d77-82e8-419b-a88b-09c9ee4354a8-kube-api-access-f2xn4\") pod \"router-default-6575bfb5cc-2ttlz\" (UID: \"49f19d77-82e8-419b-a88b-09c9ee4354a8\") " pod="openshift-ingress/router-default-6575bfb5cc-2ttlz" Jul 09 02:34:55.187961 ip-10-0-138-136 kubenswrapper[2583]: I0709 02:34:55.187486 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"snapshots\" (UniqueName: \"kubernetes.io/empty-dir/bb24b378-f56e-46cb-8881-3f44c1a40391-snapshots\") pod \"insights-operator-5c847dcfc4-rwvrr\" (UID: \"bb24b378-f56e-46cb-8881-3f44c1a40391\") " pod="openshift-insights/insights-operator-5c847dcfc4-rwvrr" Jul 09 02:34:55.187961 ip-10-0-138-136 kubenswrapper[2583]: I0709 02:34:55.187510 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"telemetry-config\" (UniqueName: \"kubernetes.io/configmap/a88b1ede-8749-4df5-88d8-494cfd9cfd83-telemetry-config\") pod \"cluster-monitoring-operator-64786d9cbb-grbsm\" (UID: \"a88b1ede-8749-4df5-88d8-494cfd9cfd83\") " pod="openshift-monitoring/cluster-monitoring-operator-64786d9cbb-grbsm" Jul 09 02:34:55.187961 ip-10-0-138-136 kubenswrapper[2583]: I0709 02:34:55.187538 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-vstrs\" (UniqueName: \"kubernetes.io/projected/9af4ab52-6748-4090-a7a0-8666391d9bfa-kube-api-access-vstrs\") pod \"image-registry-59569495f9-rmmlc\" (UID: \"9af4ab52-6748-4090-a7a0-8666391d9bfa\") " pod="openshift-image-registry/image-registry-59569495f9-rmmlc" Jul 09 02:34:55.187961 ip-10-0-138-136 kubenswrapper[2583]: I0709 02:34:55.187565 2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/188e21f3-2ce9-4012-ada2-a46c32d56729-config\") pod \"console-operator-68b757fb67-xpjsj\" (UID: \"188e21f3-2ce9-4012-ada2-a46c32d56729\") " pod="openshift-console-operator/console-operator-68b757fb67-xpjsj" Jul 09 02:34:55.187961 ip-10-0-138-136 kubenswrapper[2583]: I0709 02:34:55.187589 2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-j6qr5\" (UniqueName: \"kubernetes.io/projected/188e21f3-2ce9-4012-ada2-a46c32d56729-kube-api-access-j6qr5\") pod \"console-operator-68b757fb67-xpjsj\" (UID: \"188e21f3-2ce9-4012-ada2-a46c32d56729\") " pod="openshift-console-operator/console-operator-68b757fb67-xpjsj" Jul 09 02:34:55.187961 ip-10-0-138-136 kubenswrapper[2583]: I0709 02:34:55.187600 2583 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/bb24b378-f56e-46cb-8881-3f44c1a40391-service-ca-bundle\") pod \"insights-operator-5c847dcfc4-rwvrr\" (UID: \"bb24b378-f56e-46cb-8881-3f44c1a40391\") " pod="openshift-insights/insights-operator-5c847dcfc4-rwvrr" Jul 09 02:34:55.187961 ip-10-0-138-136 kubenswrapper[2583]: I0709 02:34:55.187613 2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/49f19d77-82e8-419b-a88b-09c9ee4354a8-metrics-certs\") pod \"router-default-6575bfb5cc-2ttlz\" (UID: \"49f19d77-82e8-419b-a88b-09c9ee4354a8\") " pod="openshift-ingress/router-default-6575bfb5cc-2ttlz" Jul 09 02:34:55.187961 ip-10-0-138-136 kubenswrapper[2583]: I0709 02:34:55.187652 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/9af4ab52-6748-4090-a7a0-8666391d9bfa-registry-certificates\") pod \"image-registry-59569495f9-rmmlc\" (UID: \"9af4ab52-6748-4090-a7a0-8666391d9bfa\") " pod="openshift-image-registry/image-registry-59569495f9-rmmlc" Jul 09 02:34:55.187961 ip-10-0-138-136 kubenswrapper[2583]: I0709 02:34:55.187677 2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/a177d680-6ea3-4b92-80e8-a2a081481d88-samples-operator-tls\") pod \"cluster-samples-operator-56fcf86bf-78sff\" (UID: \"a177d680-6ea3-4b92-80e8-a2a081481d88\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-56fcf86bf-78sff" Jul 09 02:34:55.188557 ip-10-0-138-136 kubenswrapper[2583]: I0709 02:34:55.187706 2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-fsjcq\" (UniqueName: \"kubernetes.io/projected/a177d680-6ea3-4b92-80e8-a2a081481d88-kube-api-access-fsjcq\") pod \"cluster-samples-operator-56fcf86bf-78sff\" (UID: \"a177d680-6ea3-4b92-80e8-a2a081481d88\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-56fcf86bf-78sff" Jul 09 02:34:55.188557 ip-10-0-138-136 kubenswrapper[2583]: I0709 02:34:55.187760 2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"stats-auth\" (UniqueName: \"kubernetes.io/secret/49f19d77-82e8-419b-a88b-09c9ee4354a8-stats-auth\") pod \"router-default-6575bfb5cc-2ttlz\" (UID: \"49f19d77-82e8-419b-a88b-09c9ee4354a8\") " pod="openshift-ingress/router-default-6575bfb5cc-2ttlz" Jul 09 02:34:55.188557 ip-10-0-138-136 kubenswrapper[2583]: I0709 02:34:55.187929 2583 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/bb24b378-f56e-46cb-8881-3f44c1a40391-trusted-ca-bundle\") pod \"insights-operator-5c847dcfc4-rwvrr\" (UID: \"bb24b378-f56e-46cb-8881-3f44c1a40391\") " pod="openshift-insights/insights-operator-5c847dcfc4-rwvrr" Jul 09 02:34:55.188557 ip-10-0-138-136 kubenswrapper[2583]: I0709 02:34:55.188279 2583 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/9af4ab52-6748-4090-a7a0-8666391d9bfa-ca-trust-extracted\") pod \"image-registry-59569495f9-rmmlc\" (UID: \"9af4ab52-6748-4090-a7a0-8666391d9bfa\") " pod="openshift-image-registry/image-registry-59569495f9-rmmlc" Jul 09 02:34:55.188557 ip-10-0-138-136 kubenswrapper[2583]: I0709 02:34:55.188297 2583 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/9af4ab52-6748-4090-a7a0-8666391d9bfa-registry-certificates\") pod \"image-registry-59569495f9-rmmlc\" (UID: \"9af4ab52-6748-4090-a7a0-8666391d9bfa\") " pod="openshift-image-registry/image-registry-59569495f9-rmmlc" Jul 09 02:34:55.188557 ip-10-0-138-136 kubenswrapper[2583]: I0709 02:34:55.188358 2583 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"snapshots\" (UniqueName: \"kubernetes.io/empty-dir/bb24b378-f56e-46cb-8881-3f44c1a40391-snapshots\") pod \"insights-operator-5c847dcfc4-rwvrr\" (UID: \"bb24b378-f56e-46cb-8881-3f44c1a40391\") " pod="openshift-insights/insights-operator-5c847dcfc4-rwvrr" Jul 09 02:34:55.188557 ip-10-0-138-136 kubenswrapper[2583]: I0709 02:34:55.188445 2583 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/9af4ab52-6748-4090-a7a0-8666391d9bfa-trusted-ca\") pod \"image-registry-59569495f9-rmmlc\" (UID: \"9af4ab52-6748-4090-a7a0-8666391d9bfa\") " pod="openshift-image-registry/image-registry-59569495f9-rmmlc" Jul 09 02:34:55.189146 ip-10-0-138-136 kubenswrapper[2583]: I0709 02:34:55.189054 2583 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"telemetry-config\" (UniqueName: \"kubernetes.io/configmap/a88b1ede-8749-4df5-88d8-494cfd9cfd83-telemetry-config\") pod \"cluster-monitoring-operator-64786d9cbb-grbsm\" (UID: \"a88b1ede-8749-4df5-88d8-494cfd9cfd83\") " pod="openshift-monitoring/cluster-monitoring-operator-64786d9cbb-grbsm" Jul 09 02:34:55.191171 ip-10-0-138-136 kubenswrapper[2583]: I0709 02:34:55.191152 2583 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/bb24b378-f56e-46cb-8881-3f44c1a40391-serving-cert\") pod \"insights-operator-5c847dcfc4-rwvrr\" (UID: \"bb24b378-f56e-46cb-8881-3f44c1a40391\") " pod="openshift-insights/insights-operator-5c847dcfc4-rwvrr" Jul 09 02:34:55.191258 ip-10-0-138-136 kubenswrapper[2583]: I0709 02:34:55.191201 2583 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/9af4ab52-6748-4090-a7a0-8666391d9bfa-installation-pull-secrets\") pod \"image-registry-59569495f9-rmmlc\" (UID: \"9af4ab52-6748-4090-a7a0-8666391d9bfa\") " pod="openshift-image-registry/image-registry-59569495f9-rmmlc" Jul 09 02:34:55.191258 ip-10-0-138-136 kubenswrapper[2583]: I0709 02:34:55.191214 2583 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/9af4ab52-6748-4090-a7a0-8666391d9bfa-image-registry-private-configuration\") pod \"image-registry-59569495f9-rmmlc\" (UID: \"9af4ab52-6748-4090-a7a0-8666391d9bfa\") " pod="openshift-image-registry/image-registry-59569495f9-rmmlc" Jul 09 02:34:55.197243 ip-10-0-138-136 kubenswrapper[2583]: I0709 02:34:55.197203 2583 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-qjdsb\" (UniqueName: \"kubernetes.io/projected/a88b1ede-8749-4df5-88d8-494cfd9cfd83-kube-api-access-qjdsb\") pod \"cluster-monitoring-operator-64786d9cbb-grbsm\" (UID: \"a88b1ede-8749-4df5-88d8-494cfd9cfd83\") " pod="openshift-monitoring/cluster-monitoring-operator-64786d9cbb-grbsm" Jul 09 02:34:55.197821 ip-10-0-138-136 kubenswrapper[2583]: I0709 02:34:55.197797 2583 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/9af4ab52-6748-4090-a7a0-8666391d9bfa-bound-sa-token\") pod \"image-registry-59569495f9-rmmlc\" (UID: \"9af4ab52-6748-4090-a7a0-8666391d9bfa\") " pod="openshift-image-registry/image-registry-59569495f9-rmmlc" Jul 09 02:34:55.197939 ip-10-0-138-136 kubenswrapper[2583]: I0709 02:34:55.197799 2583 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-xjjfh\" (UniqueName: \"kubernetes.io/projected/c1ea28bb-bfb9-477c-a144-6d7dfd62c073-kube-api-access-xjjfh\") pod \"volume-data-source-validator-5d456fdbcd-bdg6h\" (UID: \"c1ea28bb-bfb9-477c-a144-6d7dfd62c073\") " pod="openshift-cluster-storage-operator/volume-data-source-validator-5d456fdbcd-bdg6h" Jul 09 02:34:55.198234 ip-10-0-138-136 kubenswrapper[2583]: I0709 02:34:55.198200 2583 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-vstrs\" (UniqueName: \"kubernetes.io/projected/9af4ab52-6748-4090-a7a0-8666391d9bfa-kube-api-access-vstrs\") pod \"image-registry-59569495f9-rmmlc\" (UID: \"9af4ab52-6748-4090-a7a0-8666391d9bfa\") " pod="openshift-image-registry/image-registry-59569495f9-rmmlc" Jul 09 02:34:55.198583 ip-10-0-138-136 kubenswrapper[2583]: I0709 02:34:55.198568 2583 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-m7ds5\" (UniqueName: \"kubernetes.io/projected/bb24b378-f56e-46cb-8881-3f44c1a40391-kube-api-access-m7ds5\") pod \"insights-operator-5c847dcfc4-rwvrr\" (UID: \"bb24b378-f56e-46cb-8881-3f44c1a40391\") " pod="openshift-insights/insights-operator-5c847dcfc4-rwvrr" Jul 09 02:34:55.260310 ip-10-0-138-136 kubenswrapper[2583]: I0709 02:34:55.260292 2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-storage-operator/volume-data-source-validator-5d456fdbcd-bdg6h" Jul 09 02:34:55.276483 ip-10-0-138-136 kubenswrapper[2583]: I0709 02:34:55.276465 2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-operator-5c847dcfc4-rwvrr" Jul 09 02:34:55.288731 ip-10-0-138-136 kubenswrapper[2583]: I0709 02:34:55.288691 2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/6dedc04e-aa0e-4c21-829e-c0a6619b5c22-serving-cert\") pod \"service-ca-operator-5d46d9ffd4-p9zgk\" (UID: \"6dedc04e-aa0e-4c21-829e-c0a6619b5c22\") " pod="openshift-service-ca-operator/service-ca-operator-5d46d9ffd4-p9zgk" Jul 09 02:34:55.288819 ip-10-0-138-136 kubenswrapper[2583]: I0709 02:34:55.288741 2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"klusterlet-config\" (UniqueName: \"kubernetes.io/secret/615d072a-9a99-488d-b868-51de840150f0-klusterlet-config\") pod \"klusterlet-addon-workmgr-59d6c8b955-md6hq\" (UID: \"615d072a-9a99-488d-b868-51de840150f0\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-59d6c8b955-md6hq" Jul 09 02:34:55.288819 ip-10-0-138-136 kubenswrapper[2583]: I0709 02:34:55.288787 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-ltbn4\" (UniqueName: \"kubernetes.io/projected/9d809968-31d3-4c4d-be19-234664db4a04-kube-api-access-ltbn4\") pod \"kube-storage-version-migrator-operator-846bf668f7-vls7g\" (UID: \"9d809968-31d3-4c4d-be19-234664db4a04\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-846bf668f7-vls7g" Jul 09 02:34:55.288819 ip-10-0-138-136 kubenswrapper[2583]: I0709 02:34:55.288813 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/ac99dbf2-7e27-437b-a386-89821f738a52-networking-console-plugin-cert\") pod \"networking-console-plugin-6bffdf9778-j5xzm\" (UID: \"ac99dbf2-7e27-437b-a386-89821f738a52\") " pod="openshift-network-console/networking-console-plugin-6bffdf9778-j5xzm" Jul 09 02:34:55.288978 ip-10-0-138-136 kubenswrapper[2583]: E0709 02:34:55.288866 2583 secret.go:189] Couldn't get secret openshift-network-console/networking-console-plugin-cert: secret "networking-console-plugin-cert" not found Jul 09 02:34:55.288978 ip-10-0-138-136 kubenswrapper[2583]: E0709 02:34:55.288904 2583 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/ac99dbf2-7e27-437b-a386-89821f738a52-networking-console-plugin-cert podName:ac99dbf2-7e27-437b-a386-89821f738a52 nodeName:}" failed. No retries permitted until 2026-07-09 02:34:55.788888855 +0000 UTC m=+41.721346318 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "networking-console-plugin-cert" (UniqueName: "kubernetes.io/secret/ac99dbf2-7e27-437b-a386-89821f738a52-networking-console-plugin-cert") pod "networking-console-plugin-6bffdf9778-j5xzm" (UID: "ac99dbf2-7e27-437b-a386-89821f738a52") : secret "networking-console-plugin-cert" not found Jul 09 02:34:55.288978 ip-10-0-138-136 kubenswrapper[2583]: I0709 02:34:55.288918 2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-2xhhc\" (UniqueName: \"kubernetes.io/projected/325f97fc-73c3-48ba-b98c-75b19f491201-kube-api-access-2xhhc\") pod \"cluster-proxy-proxy-agent-5f9bc9c474-jgh2b\" (UID: \"325f97fc-73c3-48ba-b98c-75b19f491201\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-5f9bc9c474-jgh2b" Jul 09 02:34:55.288978 ip-10-0-138-136 kubenswrapper[2583]: I0709 02:34:55.288936 2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hub-kubeconfig\" (UniqueName: \"kubernetes.io/secret/325f97fc-73c3-48ba-b98c-75b19f491201-hub-kubeconfig\") pod \"cluster-proxy-proxy-agent-5f9bc9c474-jgh2b\" (UID: \"325f97fc-73c3-48ba-b98c-75b19f491201\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-5f9bc9c474-jgh2b" Jul 09 02:34:55.288978 ip-10-0-138-136 kubenswrapper[2583]: I0709 02:34:55.288956 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/49f19d77-82e8-419b-a88b-09c9ee4354a8-service-ca-bundle\") pod \"router-default-6575bfb5cc-2ttlz\" (UID: \"49f19d77-82e8-419b-a88b-09c9ee4354a8\") " pod="openshift-ingress/router-default-6575bfb5cc-2ttlz" Jul 09 02:34:55.289173 ip-10-0-138-136 kubenswrapper[2583]: I0709 02:34:55.288979 2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-z2hdm\" (UniqueName: \"kubernetes.io/projected/6dedc04e-aa0e-4c21-829e-c0a6619b5c22-kube-api-access-z2hdm\") pod \"service-ca-operator-5d46d9ffd4-p9zgk\" (UID: \"6dedc04e-aa0e-4c21-829e-c0a6619b5c22\") " pod="openshift-service-ca-operator/service-ca-operator-5d46d9ffd4-p9zgk" Jul 09 02:34:55.289173 ip-10-0-138-136 kubenswrapper[2583]: I0709 02:34:55.289019 2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-hl56v\" (UniqueName: \"kubernetes.io/projected/42025b60-40d4-453f-aaae-74cb3e1a3cdb-kube-api-access-hl56v\") pod \"ingress-canary-dhcrr\" (UID: \"42025b60-40d4-453f-aaae-74cb3e1a3cdb\") " pod="openshift-ingress-canary/ingress-canary-dhcrr" Jul 09 02:34:55.289173 ip-10-0-138-136 kubenswrapper[2583]: I0709 02:34:55.289045 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/188e21f3-2ce9-4012-ada2-a46c32d56729-trusted-ca\") pod \"console-operator-68b757fb67-xpjsj\" (UID: \"188e21f3-2ce9-4012-ada2-a46c32d56729\") " pod="openshift-console-operator/console-operator-68b757fb67-xpjsj" Jul 09 02:34:55.289173 ip-10-0-138-136 kubenswrapper[2583]: I0709 02:34:55.289071 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/bd5345b9-08c2-4d1c-a033-a5c458c74773-metrics-tls\") pod \"dns-default-rwlzs\" (UID: \"bd5345b9-08c2-4d1c-a033-a5c458c74773\") " pod="openshift-dns/dns-default-rwlzs" Jul 09 02:34:55.289173 ip-10-0-138-136 kubenswrapper[2583]: E0709 02:34:55.289092 2583 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/49f19d77-82e8-419b-a88b-09c9ee4354a8-service-ca-bundle podName:49f19d77-82e8-419b-a88b-09c9ee4354a8 nodeName:}" failed. No retries permitted until 2026-07-09 02:34:55.789069199 +0000 UTC m=+41.721526681 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "service-ca-bundle" (UniqueName: "kubernetes.io/configmap/49f19d77-82e8-419b-a88b-09c9ee4354a8-service-ca-bundle") pod "router-default-6575bfb5cc-2ttlz" (UID: "49f19d77-82e8-419b-a88b-09c9ee4354a8") : configmap references non-existent config key: service-ca.crt Jul 09 02:34:55.289173 ip-10-0-138-136 kubenswrapper[2583]: I0709 02:34:55.289125 2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/42025b60-40d4-453f-aaae-74cb3e1a3cdb-cert\") pod \"ingress-canary-dhcrr\" (UID: \"42025b60-40d4-453f-aaae-74cb3e1a3cdb\") " pod="openshift-ingress-canary/ingress-canary-dhcrr" Jul 09 02:34:55.289173 ip-10-0-138-136 kubenswrapper[2583]: E0709 02:34:55.289140 2583 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jul 09 02:34:55.289173 ip-10-0-138-136 kubenswrapper[2583]: I0709 02:34:55.289153 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-f2xn4\" (UniqueName: \"kubernetes.io/projected/49f19d77-82e8-419b-a88b-09c9ee4354a8-kube-api-access-f2xn4\") pod \"router-default-6575bfb5cc-2ttlz\" (UID: \"49f19d77-82e8-419b-a88b-09c9ee4354a8\") " pod="openshift-ingress/router-default-6575bfb5cc-2ttlz" Jul 09 02:34:55.289173 ip-10-0-138-136 kubenswrapper[2583]: I0709 02:34:55.289169 2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-gkhzx\" (UniqueName: \"kubernetes.io/projected/704da9c8-d824-4233-8115-4ddd077c9a7e-kube-api-access-gkhzx\") pod \"network-check-source-989f8b8dc-qhcpn\" (UID: \"704da9c8-d824-4233-8115-4ddd077c9a7e\") " pod="openshift-network-diagnostics/network-check-source-989f8b8dc-qhcpn" Jul 09 02:34:55.289427 ip-10-0-138-136 kubenswrapper[2583]: E0709 02:34:55.289178 2583 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/bd5345b9-08c2-4d1c-a033-a5c458c74773-metrics-tls podName:bd5345b9-08c2-4d1c-a033-a5c458c74773 nodeName:}" failed. No retries permitted until 2026-07-09 02:34:55.789166042 +0000 UTC m=+41.721623512 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/bd5345b9-08c2-4d1c-a033-a5c458c74773-metrics-tls") pod "dns-default-rwlzs" (UID: "bd5345b9-08c2-4d1c-a033-a5c458c74773") : secret "dns-default-metrics-tls" not found Jul 09 02:34:55.289427 ip-10-0-138-136 kubenswrapper[2583]: I0709 02:34:55.289220 2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/615d072a-9a99-488d-b868-51de840150f0-tmp\") pod \"klusterlet-addon-workmgr-59d6c8b955-md6hq\" (UID: \"615d072a-9a99-488d-b868-51de840150f0\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-59d6c8b955-md6hq" Jul 09 02:34:55.289427 ip-10-0-138-136 kubenswrapper[2583]: I0709 02:34:55.289248 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/188e21f3-2ce9-4012-ada2-a46c32d56729-config\") pod \"console-operator-68b757fb67-xpjsj\" (UID: \"188e21f3-2ce9-4012-ada2-a46c32d56729\") " pod="openshift-console-operator/console-operator-68b757fb67-xpjsj" Jul 09 02:34:55.289427 ip-10-0-138-136 kubenswrapper[2583]: I0709 02:34:55.289275 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-j6qr5\" (UniqueName: \"kubernetes.io/projected/188e21f3-2ce9-4012-ada2-a46c32d56729-kube-api-access-j6qr5\") pod \"console-operator-68b757fb67-xpjsj\" (UID: \"188e21f3-2ce9-4012-ada2-a46c32d56729\") " pod="openshift-console-operator/console-operator-68b757fb67-xpjsj" Jul 09 02:34:55.289427 ip-10-0-138-136 kubenswrapper[2583]: I0709 02:34:55.289303 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/49f19d77-82e8-419b-a88b-09c9ee4354a8-metrics-certs\") pod \"router-default-6575bfb5cc-2ttlz\" (UID: \"49f19d77-82e8-419b-a88b-09c9ee4354a8\") " pod="openshift-ingress/router-default-6575bfb5cc-2ttlz" Jul 09 02:34:55.289427 ip-10-0-138-136 kubenswrapper[2583]: I0709 02:34:55.289333 2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-proxy-server-cert\" (UniqueName: \"kubernetes.io/secret/325f97fc-73c3-48ba-b98c-75b19f491201-service-proxy-server-cert\") pod \"cluster-proxy-proxy-agent-5f9bc9c474-jgh2b\" (UID: \"325f97fc-73c3-48ba-b98c-75b19f491201\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-5f9bc9c474-jgh2b" Jul 09 02:34:55.289427 ip-10-0-138-136 kubenswrapper[2583]: I0709 02:34:55.289361 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/a177d680-6ea3-4b92-80e8-a2a081481d88-samples-operator-tls\") pod \"cluster-samples-operator-56fcf86bf-78sff\" (UID: \"a177d680-6ea3-4b92-80e8-a2a081481d88\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-56fcf86bf-78sff" Jul 09 02:34:55.289427 ip-10-0-138-136 kubenswrapper[2583]: I0709 02:34:55.289386 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-fsjcq\" (UniqueName: \"kubernetes.io/projected/a177d680-6ea3-4b92-80e8-a2a081481d88-kube-api-access-fsjcq\") pod \"cluster-samples-operator-56fcf86bf-78sff\" (UID: \"a177d680-6ea3-4b92-80e8-a2a081481d88\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-56fcf86bf-78sff" Jul 09 02:34:55.289427 ip-10-0-138-136 kubenswrapper[2583]: I0709 02:34:55.289411 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"stats-auth\" (UniqueName: \"kubernetes.io/secret/49f19d77-82e8-419b-a88b-09c9ee4354a8-stats-auth\") pod \"router-default-6575bfb5cc-2ttlz\" (UID: \"49f19d77-82e8-419b-a88b-09c9ee4354a8\") " pod="openshift-ingress/router-default-6575bfb5cc-2ttlz" Jul 09 02:34:55.290223 ip-10-0-138-136 kubenswrapper[2583]: I0709 02:34:55.289434 2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ca\" (UniqueName: \"kubernetes.io/secret/325f97fc-73c3-48ba-b98c-75b19f491201-ca\") pod \"cluster-proxy-proxy-agent-5f9bc9c474-jgh2b\" (UID: \"325f97fc-73c3-48ba-b98c-75b19f491201\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-5f9bc9c474-jgh2b" Jul 09 02:34:55.290223 ip-10-0-138-136 kubenswrapper[2583]: I0709 02:34:55.289463 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"nginx-conf\" (UniqueName: \"kubernetes.io/configmap/ac99dbf2-7e27-437b-a386-89821f738a52-nginx-conf\") pod \"networking-console-plugin-6bffdf9778-j5xzm\" (UID: \"ac99dbf2-7e27-437b-a386-89821f738a52\") " pod="openshift-network-console/networking-console-plugin-6bffdf9778-j5xzm" Jul 09 02:34:55.290223 ip-10-0-138-136 kubenswrapper[2583]: I0709 02:34:55.289489 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-b82hs\" (UniqueName: \"kubernetes.io/projected/bd5345b9-08c2-4d1c-a033-a5c458c74773-kube-api-access-b82hs\") pod \"dns-default-rwlzs\" (UID: \"bd5345b9-08c2-4d1c-a033-a5c458c74773\") " pod="openshift-dns/dns-default-rwlzs" Jul 09 02:34:55.290223 ip-10-0-138-136 kubenswrapper[2583]: I0709 02:34:55.289528 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/9d809968-31d3-4c4d-be19-234664db4a04-serving-cert\") pod \"kube-storage-version-migrator-operator-846bf668f7-vls7g\" (UID: \"9d809968-31d3-4c4d-be19-234664db4a04\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-846bf668f7-vls7g" Jul 09 02:34:55.290223 ip-10-0-138-136 kubenswrapper[2583]: I0709 02:34:55.289553 2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hub\" (UniqueName: \"kubernetes.io/secret/325f97fc-73c3-48ba-b98c-75b19f491201-hub\") pod \"cluster-proxy-proxy-agent-5f9bc9c474-jgh2b\" (UID: \"325f97fc-73c3-48ba-b98c-75b19f491201\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-5f9bc9c474-jgh2b" Jul 09 02:34:55.290223 ip-10-0-138-136 kubenswrapper[2583]: E0709 02:34:55.289570 2583 secret.go:189] Couldn't get secret openshift-cluster-samples-operator/samples-operator-tls: secret "samples-operator-tls" not found Jul 09 02:34:55.290223 ip-10-0-138-136 kubenswrapper[2583]: E0709 02:34:55.289589 2583 secret.go:189] Couldn't get secret openshift-ingress/router-metrics-certs-default: secret "router-metrics-certs-default" not found Jul 09 02:34:55.290223 ip-10-0-138-136 kubenswrapper[2583]: I0709 02:34:55.289624 2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hub-kubeconfig\" (UniqueName: \"kubernetes.io/secret/d6c67672-fec5-43e0-92cd-c55eaeba1337-hub-kubeconfig\") pod \"managed-serviceaccount-addon-agent-66ff5df664-dkjgb\" (UID: \"d6c67672-fec5-43e0-92cd-c55eaeba1337\") " pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-66ff5df664-dkjgb" Jul 09 02:34:55.290223 ip-10-0-138-136 kubenswrapper[2583]: E0709 02:34:55.289653 2583 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/49f19d77-82e8-419b-a88b-09c9ee4354a8-metrics-certs podName:49f19d77-82e8-419b-a88b-09c9ee4354a8 nodeName:}" failed. No retries permitted until 2026-07-09 02:34:55.78963827 +0000 UTC m=+41.722095746 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/49f19d77-82e8-419b-a88b-09c9ee4354a8-metrics-certs") pod "router-default-6575bfb5cc-2ttlz" (UID: "49f19d77-82e8-419b-a88b-09c9ee4354a8") : secret "router-metrics-certs-default" not found Jul 09 02:34:55.290223 ip-10-0-138-136 kubenswrapper[2583]: E0709 02:34:55.289685 2583 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/a177d680-6ea3-4b92-80e8-a2a081481d88-samples-operator-tls podName:a177d680-6ea3-4b92-80e8-a2a081481d88 nodeName:}" failed. No retries permitted until 2026-07-09 02:34:55.789673727 +0000 UTC m=+41.722131203 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "samples-operator-tls" (UniqueName: "kubernetes.io/secret/a177d680-6ea3-4b92-80e8-a2a081481d88-samples-operator-tls") pod "cluster-samples-operator-56fcf86bf-78sff" (UID: "a177d680-6ea3-4b92-80e8-a2a081481d88") : secret "samples-operator-tls" not found Jul 09 02:34:55.290223 ip-10-0-138-136 kubenswrapper[2583]: I0709 02:34:55.289822 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/bd5345b9-08c2-4d1c-a033-a5c458c74773-config-volume\") pod \"dns-default-rwlzs\" (UID: \"bd5345b9-08c2-4d1c-a033-a5c458c74773\") " pod="openshift-dns/dns-default-rwlzs" Jul 09 02:34:55.290223 ip-10-0-138-136 kubenswrapper[2583]: I0709 02:34:55.289853 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"default-certificate\" (UniqueName: \"kubernetes.io/secret/49f19d77-82e8-419b-a88b-09c9ee4354a8-default-certificate\") pod \"router-default-6575bfb5cc-2ttlz\" (UID: \"49f19d77-82e8-419b-a88b-09c9ee4354a8\") " pod="openshift-ingress/router-default-6575bfb5cc-2ttlz" Jul 09 02:34:55.290223 ip-10-0-138-136 kubenswrapper[2583]: I0709 02:34:55.289884 2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/6dedc04e-aa0e-4c21-829e-c0a6619b5c22-config\") pod \"service-ca-operator-5d46d9ffd4-p9zgk\" (UID: \"6dedc04e-aa0e-4c21-829e-c0a6619b5c22\") " pod="openshift-service-ca-operator/service-ca-operator-5d46d9ffd4-p9zgk" Jul 09 02:34:55.290223 ip-10-0-138-136 kubenswrapper[2583]: I0709 02:34:55.289906 2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-xd9mm\" (UniqueName: \"kubernetes.io/projected/615d072a-9a99-488d-b868-51de840150f0-kube-api-access-xd9mm\") pod \"klusterlet-addon-workmgr-59d6c8b955-md6hq\" (UID: \"615d072a-9a99-488d-b868-51de840150f0\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-59d6c8b955-md6hq" Jul 09 02:34:55.290223 ip-10-0-138-136 kubenswrapper[2583]: I0709 02:34:55.289939 2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-b7gqf\" (UniqueName: \"kubernetes.io/projected/d6c67672-fec5-43e0-92cd-c55eaeba1337-kube-api-access-b7gqf\") pod \"managed-serviceaccount-addon-agent-66ff5df664-dkjgb\" (UID: \"d6c67672-fec5-43e0-92cd-c55eaeba1337\") " pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-66ff5df664-dkjgb" Jul 09 02:34:55.290990 ip-10-0-138-136 kubenswrapper[2583]: I0709 02:34:55.289973 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/188e21f3-2ce9-4012-ada2-a46c32d56729-serving-cert\") pod \"console-operator-68b757fb67-xpjsj\" (UID: \"188e21f3-2ce9-4012-ada2-a46c32d56729\") " pod="openshift-console-operator/console-operator-68b757fb67-xpjsj" Jul 09 02:34:55.290990 ip-10-0-138-136 kubenswrapper[2583]: I0709 02:34:55.289997 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/bd5345b9-08c2-4d1c-a033-a5c458c74773-tmp-dir\") pod \"dns-default-rwlzs\" (UID: \"bd5345b9-08c2-4d1c-a033-a5c458c74773\") " pod="openshift-dns/dns-default-rwlzs" Jul 09 02:34:55.290990 ip-10-0-138-136 kubenswrapper[2583]: I0709 02:34:55.290020 2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"additional-service-ca\" (UniqueName: \"kubernetes.io/configmap/325f97fc-73c3-48ba-b98c-75b19f491201-additional-service-ca\") pod \"cluster-proxy-proxy-agent-5f9bc9c474-jgh2b\" (UID: \"325f97fc-73c3-48ba-b98c-75b19f491201\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-5f9bc9c474-jgh2b" Jul 09 02:34:55.290990 ip-10-0-138-136 kubenswrapper[2583]: I0709 02:34:55.290059 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/9d809968-31d3-4c4d-be19-234664db4a04-config\") pod \"kube-storage-version-migrator-operator-846bf668f7-vls7g\" (UID: \"9d809968-31d3-4c4d-be19-234664db4a04\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-846bf668f7-vls7g" Jul 09 02:34:55.290990 ip-10-0-138-136 kubenswrapper[2583]: I0709 02:34:55.289856 2583 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/configmap/188e21f3-2ce9-4012-ada2-a46c32d56729-config\") pod \"console-operator-68b757fb67-xpjsj\" (UID: \"188e21f3-2ce9-4012-ada2-a46c32d56729\") " pod="openshift-console-operator/console-operator-68b757fb67-xpjsj" Jul 09 02:34:55.290990 ip-10-0-138-136 kubenswrapper[2583]: I0709 02:34:55.290185 2583 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"nginx-conf\" (UniqueName: \"kubernetes.io/configmap/ac99dbf2-7e27-437b-a386-89821f738a52-nginx-conf\") pod \"networking-console-plugin-6bffdf9778-j5xzm\" (UID: \"ac99dbf2-7e27-437b-a386-89821f738a52\") " pod="openshift-network-console/networking-console-plugin-6bffdf9778-j5xzm" Jul 09 02:34:55.290990 ip-10-0-138-136 kubenswrapper[2583]: I0709 02:34:55.290419 2583 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/bd5345b9-08c2-4d1c-a033-a5c458c74773-config-volume\") pod \"dns-default-rwlzs\" (UID: \"bd5345b9-08c2-4d1c-a033-a5c458c74773\") " pod="openshift-dns/dns-default-rwlzs" Jul 09 02:34:55.290990 ip-10-0-138-136 kubenswrapper[2583]: I0709 02:34:55.290442 2583 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/bd5345b9-08c2-4d1c-a033-a5c458c74773-tmp-dir\") pod \"dns-default-rwlzs\" (UID: \"bd5345b9-08c2-4d1c-a033-a5c458c74773\") " pod="openshift-dns/dns-default-rwlzs" Jul 09 02:34:55.290990 ip-10-0-138-136 kubenswrapper[2583]: I0709 02:34:55.290599 2583 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/configmap/9d809968-31d3-4c4d-be19-234664db4a04-config\") pod \"kube-storage-version-migrator-operator-846bf668f7-vls7g\" (UID: \"9d809968-31d3-4c4d-be19-234664db4a04\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-846bf668f7-vls7g" Jul 09 02:34:55.291967 ip-10-0-138-136 kubenswrapper[2583]: I0709 02:34:55.291910 2583 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"stats-auth\" (UniqueName: \"kubernetes.io/secret/49f19d77-82e8-419b-a88b-09c9ee4354a8-stats-auth\") pod \"router-default-6575bfb5cc-2ttlz\" (UID: \"49f19d77-82e8-419b-a88b-09c9ee4354a8\") " pod="openshift-ingress/router-default-6575bfb5cc-2ttlz" Jul 09 02:34:55.292319 ip-10-0-138-136 kubenswrapper[2583]: I0709 02:34:55.292301 2583 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"default-certificate\" (UniqueName: \"kubernetes.io/secret/49f19d77-82e8-419b-a88b-09c9ee4354a8-default-certificate\") pod \"router-default-6575bfb5cc-2ttlz\" (UID: \"49f19d77-82e8-419b-a88b-09c9ee4354a8\") " pod="openshift-ingress/router-default-6575bfb5cc-2ttlz" Jul 09 02:34:55.292649 ip-10-0-138-136 kubenswrapper[2583]: I0709 02:34:55.292623 2583 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/9d809968-31d3-4c4d-be19-234664db4a04-serving-cert\") pod \"kube-storage-version-migrator-operator-846bf668f7-vls7g\" (UID: \"9d809968-31d3-4c4d-be19-234664db4a04\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-846bf668f7-vls7g" Jul 09 02:34:55.292701 ip-10-0-138-136 kubenswrapper[2583]: I0709 02:34:55.292684 2583 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/188e21f3-2ce9-4012-ada2-a46c32d56729-serving-cert\") pod \"console-operator-68b757fb67-xpjsj\" (UID: \"188e21f3-2ce9-4012-ada2-a46c32d56729\") " pod="openshift-console-operator/console-operator-68b757fb67-xpjsj" Jul 09 02:34:55.297853 ip-10-0-138-136 kubenswrapper[2583]: I0709 02:34:55.297833 2583 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-b82hs\" (UniqueName: \"kubernetes.io/projected/bd5345b9-08c2-4d1c-a033-a5c458c74773-kube-api-access-b82hs\") pod \"dns-default-rwlzs\" (UID: \"bd5345b9-08c2-4d1c-a033-a5c458c74773\") " pod="openshift-dns/dns-default-rwlzs" Jul 09 02:34:55.297945 ip-10-0-138-136 kubenswrapper[2583]: I0709 02:34:55.297877 2583 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-j6qr5\" (UniqueName: \"kubernetes.io/projected/188e21f3-2ce9-4012-ada2-a46c32d56729-kube-api-access-j6qr5\") pod \"console-operator-68b757fb67-xpjsj\" (UID: \"188e21f3-2ce9-4012-ada2-a46c32d56729\") " pod="openshift-console-operator/console-operator-68b757fb67-xpjsj" Jul 09 02:34:55.298052 ip-10-0-138-136 kubenswrapper[2583]: I0709 02:34:55.298032 2583 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-f2xn4\" (UniqueName: \"kubernetes.io/projected/49f19d77-82e8-419b-a88b-09c9ee4354a8-kube-api-access-f2xn4\") pod \"router-default-6575bfb5cc-2ttlz\" (UID: \"49f19d77-82e8-419b-a88b-09c9ee4354a8\") " pod="openshift-ingress/router-default-6575bfb5cc-2ttlz" Jul 09 02:34:55.298303 ip-10-0-138-136 kubenswrapper[2583]: I0709 02:34:55.298276 2583 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-fsjcq\" (UniqueName: \"kubernetes.io/projected/a177d680-6ea3-4b92-80e8-a2a081481d88-kube-api-access-fsjcq\") pod \"cluster-samples-operator-56fcf86bf-78sff\" (UID: \"a177d680-6ea3-4b92-80e8-a2a081481d88\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-56fcf86bf-78sff" Jul 09 02:34:55.298811 ip-10-0-138-136 kubenswrapper[2583]: I0709 02:34:55.298772 2583 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-ltbn4\" (UniqueName: \"kubernetes.io/projected/9d809968-31d3-4c4d-be19-234664db4a04-kube-api-access-ltbn4\") pod \"kube-storage-version-migrator-operator-846bf668f7-vls7g\" (UID: \"9d809968-31d3-4c4d-be19-234664db4a04\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-846bf668f7-vls7g" Jul 09 02:34:55.301090 ip-10-0-138-136 kubenswrapper[2583]: I0709 02:34:55.301072 2583 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/188e21f3-2ce9-4012-ada2-a46c32d56729-trusted-ca\") pod \"console-operator-68b757fb67-xpjsj\" (UID: \"188e21f3-2ce9-4012-ada2-a46c32d56729\") " pod="openshift-console-operator/console-operator-68b757fb67-xpjsj" Jul 09 02:34:55.327402 ip-10-0-138-136 kubenswrapper[2583]: I0709 02:34:55.327380 2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console-operator/console-operator-68b757fb67-xpjsj" Jul 09 02:34:55.379809 ip-10-0-138-136 kubenswrapper[2583]: I0709 02:34:55.379334 2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-846bf668f7-vls7g" Jul 09 02:34:55.394208 ip-10-0-138-136 kubenswrapper[2583]: I0709 02:34:55.391471 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/42025b60-40d4-453f-aaae-74cb3e1a3cdb-cert\") pod \"ingress-canary-dhcrr\" (UID: \"42025b60-40d4-453f-aaae-74cb3e1a3cdb\") " pod="openshift-ingress-canary/ingress-canary-dhcrr" Jul 09 02:34:55.394208 ip-10-0-138-136 kubenswrapper[2583]: I0709 02:34:55.391512 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-gkhzx\" (UniqueName: \"kubernetes.io/projected/704da9c8-d824-4233-8115-4ddd077c9a7e-kube-api-access-gkhzx\") pod \"network-check-source-989f8b8dc-qhcpn\" (UID: \"704da9c8-d824-4233-8115-4ddd077c9a7e\") " pod="openshift-network-diagnostics/network-check-source-989f8b8dc-qhcpn" Jul 09 02:34:55.394208 ip-10-0-138-136 kubenswrapper[2583]: I0709 02:34:55.391546 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/615d072a-9a99-488d-b868-51de840150f0-tmp\") pod \"klusterlet-addon-workmgr-59d6c8b955-md6hq\" (UID: \"615d072a-9a99-488d-b868-51de840150f0\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-59d6c8b955-md6hq" Jul 09 02:34:55.394208 ip-10-0-138-136 kubenswrapper[2583]: I0709 02:34:55.391594 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-proxy-server-cert\" (UniqueName: \"kubernetes.io/secret/325f97fc-73c3-48ba-b98c-75b19f491201-service-proxy-server-cert\") pod \"cluster-proxy-proxy-agent-5f9bc9c474-jgh2b\" (UID: \"325f97fc-73c3-48ba-b98c-75b19f491201\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-5f9bc9c474-jgh2b" Jul 09 02:34:55.394208 ip-10-0-138-136 kubenswrapper[2583]: I0709 02:34:55.391637 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ca\" (UniqueName: \"kubernetes.io/secret/325f97fc-73c3-48ba-b98c-75b19f491201-ca\") pod \"cluster-proxy-proxy-agent-5f9bc9c474-jgh2b\" (UID: \"325f97fc-73c3-48ba-b98c-75b19f491201\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-5f9bc9c474-jgh2b" Jul 09 02:34:55.394208 ip-10-0-138-136 kubenswrapper[2583]: I0709 02:34:55.391686 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hub\" (UniqueName: \"kubernetes.io/secret/325f97fc-73c3-48ba-b98c-75b19f491201-hub\") pod \"cluster-proxy-proxy-agent-5f9bc9c474-jgh2b\" (UID: \"325f97fc-73c3-48ba-b98c-75b19f491201\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-5f9bc9c474-jgh2b" Jul 09 02:34:55.394208 ip-10-0-138-136 kubenswrapper[2583]: I0709 02:34:55.392513 2583 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/615d072a-9a99-488d-b868-51de840150f0-tmp\") pod \"klusterlet-addon-workmgr-59d6c8b955-md6hq\" (UID: \"615d072a-9a99-488d-b868-51de840150f0\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-59d6c8b955-md6hq" Jul 09 02:34:55.397722 ip-10-0-138-136 kubenswrapper[2583]: I0709 02:34:55.395671 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hub-kubeconfig\" (UniqueName: \"kubernetes.io/secret/d6c67672-fec5-43e0-92cd-c55eaeba1337-hub-kubeconfig\") pod \"managed-serviceaccount-addon-agent-66ff5df664-dkjgb\" (UID: \"d6c67672-fec5-43e0-92cd-c55eaeba1337\") " pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-66ff5df664-dkjgb" Jul 09 02:34:55.397722 ip-10-0-138-136 kubenswrapper[2583]: I0709 02:34:55.395752 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/6dedc04e-aa0e-4c21-829e-c0a6619b5c22-config\") pod \"service-ca-operator-5d46d9ffd4-p9zgk\" (UID: \"6dedc04e-aa0e-4c21-829e-c0a6619b5c22\") " pod="openshift-service-ca-operator/service-ca-operator-5d46d9ffd4-p9zgk" Jul 09 02:34:55.397722 ip-10-0-138-136 kubenswrapper[2583]: I0709 02:34:55.395782 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-xd9mm\" (UniqueName: \"kubernetes.io/projected/615d072a-9a99-488d-b868-51de840150f0-kube-api-access-xd9mm\") pod \"klusterlet-addon-workmgr-59d6c8b955-md6hq\" (UID: \"615d072a-9a99-488d-b868-51de840150f0\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-59d6c8b955-md6hq" Jul 09 02:34:55.397722 ip-10-0-138-136 kubenswrapper[2583]: I0709 02:34:55.395817 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-b7gqf\" (UniqueName: \"kubernetes.io/projected/d6c67672-fec5-43e0-92cd-c55eaeba1337-kube-api-access-b7gqf\") pod \"managed-serviceaccount-addon-agent-66ff5df664-dkjgb\" (UID: \"d6c67672-fec5-43e0-92cd-c55eaeba1337\") " pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-66ff5df664-dkjgb" Jul 09 02:34:55.397722 ip-10-0-138-136 kubenswrapper[2583]: I0709 02:34:55.395853 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"additional-service-ca\" (UniqueName: \"kubernetes.io/configmap/325f97fc-73c3-48ba-b98c-75b19f491201-additional-service-ca\") pod \"cluster-proxy-proxy-agent-5f9bc9c474-jgh2b\" (UID: \"325f97fc-73c3-48ba-b98c-75b19f491201\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-5f9bc9c474-jgh2b" Jul 09 02:34:55.397722 ip-10-0-138-136 kubenswrapper[2583]: I0709 02:34:55.395900 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/6dedc04e-aa0e-4c21-829e-c0a6619b5c22-serving-cert\") pod \"service-ca-operator-5d46d9ffd4-p9zgk\" (UID: \"6dedc04e-aa0e-4c21-829e-c0a6619b5c22\") " pod="openshift-service-ca-operator/service-ca-operator-5d46d9ffd4-p9zgk" Jul 09 02:34:55.397722 ip-10-0-138-136 kubenswrapper[2583]: I0709 02:34:55.395927 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"klusterlet-config\" (UniqueName: \"kubernetes.io/secret/615d072a-9a99-488d-b868-51de840150f0-klusterlet-config\") pod \"klusterlet-addon-workmgr-59d6c8b955-md6hq\" (UID: \"615d072a-9a99-488d-b868-51de840150f0\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-59d6c8b955-md6hq" Jul 09 02:34:55.397722 ip-10-0-138-136 kubenswrapper[2583]: I0709 02:34:55.395992 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-2xhhc\" (UniqueName: \"kubernetes.io/projected/325f97fc-73c3-48ba-b98c-75b19f491201-kube-api-access-2xhhc\") pod \"cluster-proxy-proxy-agent-5f9bc9c474-jgh2b\" (UID: \"325f97fc-73c3-48ba-b98c-75b19f491201\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-5f9bc9c474-jgh2b" Jul 09 02:34:55.397722 ip-10-0-138-136 kubenswrapper[2583]: I0709 02:34:55.396021 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hub-kubeconfig\" (UniqueName: \"kubernetes.io/secret/325f97fc-73c3-48ba-b98c-75b19f491201-hub-kubeconfig\") pod \"cluster-proxy-proxy-agent-5f9bc9c474-jgh2b\" (UID: \"325f97fc-73c3-48ba-b98c-75b19f491201\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-5f9bc9c474-jgh2b" Jul 09 02:34:55.397722 ip-10-0-138-136 kubenswrapper[2583]: I0709 02:34:55.396064 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-z2hdm\" (UniqueName: \"kubernetes.io/projected/6dedc04e-aa0e-4c21-829e-c0a6619b5c22-kube-api-access-z2hdm\") pod \"service-ca-operator-5d46d9ffd4-p9zgk\" (UID: \"6dedc04e-aa0e-4c21-829e-c0a6619b5c22\") " pod="openshift-service-ca-operator/service-ca-operator-5d46d9ffd4-p9zgk" Jul 09 02:34:55.397722 ip-10-0-138-136 kubenswrapper[2583]: I0709 02:34:55.396100 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-hl56v\" (UniqueName: \"kubernetes.io/projected/42025b60-40d4-453f-aaae-74cb3e1a3cdb-kube-api-access-hl56v\") pod \"ingress-canary-dhcrr\" (UID: \"42025b60-40d4-453f-aaae-74cb3e1a3cdb\") " pod="openshift-ingress-canary/ingress-canary-dhcrr" Jul 09 02:34:55.398692 ip-10-0-138-136 kubenswrapper[2583]: I0709 02:34:55.398010 2583 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/configmap/6dedc04e-aa0e-4c21-829e-c0a6619b5c22-config\") pod \"service-ca-operator-5d46d9ffd4-p9zgk\" (UID: \"6dedc04e-aa0e-4c21-829e-c0a6619b5c22\") " pod="openshift-service-ca-operator/service-ca-operator-5d46d9ffd4-p9zgk" Jul 09 02:34:55.403009 ip-10-0-138-136 kubenswrapper[2583]: I0709 02:34:55.399046 2583 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"additional-service-ca\" (UniqueName: \"kubernetes.io/configmap/325f97fc-73c3-48ba-b98c-75b19f491201-additional-service-ca\") pod \"cluster-proxy-proxy-agent-5f9bc9c474-jgh2b\" (UID: \"325f97fc-73c3-48ba-b98c-75b19f491201\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-5f9bc9c474-jgh2b" Jul 09 02:34:55.410549 ip-10-0-138-136 kubenswrapper[2583]: I0709 02:34:55.409595 2583 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-hl56v\" (UniqueName: \"kubernetes.io/projected/42025b60-40d4-453f-aaae-74cb3e1a3cdb-kube-api-access-hl56v\") pod \"ingress-canary-dhcrr\" (UID: \"42025b60-40d4-453f-aaae-74cb3e1a3cdb\") " pod="openshift-ingress-canary/ingress-canary-dhcrr" Jul 09 02:34:55.410549 ip-10-0-138-136 kubenswrapper[2583]: I0709 02:34:55.409680 2583 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"hub\" (UniqueName: \"kubernetes.io/secret/325f97fc-73c3-48ba-b98c-75b19f491201-hub\") pod \"cluster-proxy-proxy-agent-5f9bc9c474-jgh2b\" (UID: \"325f97fc-73c3-48ba-b98c-75b19f491201\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-5f9bc9c474-jgh2b" Jul 09 02:34:55.410549 ip-10-0-138-136 kubenswrapper[2583]: I0709 02:34:55.410276 2583 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-gkhzx\" (UniqueName: \"kubernetes.io/projected/704da9c8-d824-4233-8115-4ddd077c9a7e-kube-api-access-gkhzx\") pod \"network-check-source-989f8b8dc-qhcpn\" (UID: \"704da9c8-d824-4233-8115-4ddd077c9a7e\") " pod="openshift-network-diagnostics/network-check-source-989f8b8dc-qhcpn" Jul 09 02:34:55.410549 ip-10-0-138-136 kubenswrapper[2583]: I0709 02:34:55.410285 2583 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"klusterlet-config\" (UniqueName: \"kubernetes.io/secret/615d072a-9a99-488d-b868-51de840150f0-klusterlet-config\") pod \"klusterlet-addon-workmgr-59d6c8b955-md6hq\" (UID: \"615d072a-9a99-488d-b868-51de840150f0\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-59d6c8b955-md6hq" Jul 09 02:34:55.413878 ip-10-0-138-136 kubenswrapper[2583]: I0709 02:34:55.411187 2583 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/42025b60-40d4-453f-aaae-74cb3e1a3cdb-cert\") pod \"ingress-canary-dhcrr\" (UID: \"42025b60-40d4-453f-aaae-74cb3e1a3cdb\") " pod="openshift-ingress-canary/ingress-canary-dhcrr" Jul 09 02:34:55.413878 ip-10-0-138-136 kubenswrapper[2583]: I0709 02:34:55.411213 2583 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ca\" (UniqueName: \"kubernetes.io/secret/325f97fc-73c3-48ba-b98c-75b19f491201-ca\") pod \"cluster-proxy-proxy-agent-5f9bc9c474-jgh2b\" (UID: \"325f97fc-73c3-48ba-b98c-75b19f491201\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-5f9bc9c474-jgh2b" Jul 09 02:34:55.413878 ip-10-0-138-136 kubenswrapper[2583]: I0709 02:34:55.411249 2583 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/6dedc04e-aa0e-4c21-829e-c0a6619b5c22-serving-cert\") pod \"service-ca-operator-5d46d9ffd4-p9zgk\" (UID: \"6dedc04e-aa0e-4c21-829e-c0a6619b5c22\") " pod="openshift-service-ca-operator/service-ca-operator-5d46d9ffd4-p9zgk" Jul 09 02:34:55.413878 ip-10-0-138-136 kubenswrapper[2583]: I0709 02:34:55.411307 2583 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"hub-kubeconfig\" (UniqueName: \"kubernetes.io/secret/d6c67672-fec5-43e0-92cd-c55eaeba1337-hub-kubeconfig\") pod \"managed-serviceaccount-addon-agent-66ff5df664-dkjgb\" (UID: \"d6c67672-fec5-43e0-92cd-c55eaeba1337\") " pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-66ff5df664-dkjgb" Jul 09 02:34:55.413878 ip-10-0-138-136 kubenswrapper[2583]: I0709 02:34:55.412892 2583 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-b7gqf\" (UniqueName: \"kubernetes.io/projected/d6c67672-fec5-43e0-92cd-c55eaeba1337-kube-api-access-b7gqf\") pod \"managed-serviceaccount-addon-agent-66ff5df664-dkjgb\" (UID: \"d6c67672-fec5-43e0-92cd-c55eaeba1337\") " pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-66ff5df664-dkjgb" Jul 09 02:34:55.413878 ip-10-0-138-136 kubenswrapper[2583]: I0709 02:34:55.413562 2583 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"hub-kubeconfig\" (UniqueName: \"kubernetes.io/secret/325f97fc-73c3-48ba-b98c-75b19f491201-hub-kubeconfig\") pod \"cluster-proxy-proxy-agent-5f9bc9c474-jgh2b\" (UID: \"325f97fc-73c3-48ba-b98c-75b19f491201\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-5f9bc9c474-jgh2b" Jul 09 02:34:55.414314 ip-10-0-138-136 kubenswrapper[2583]: I0709 02:34:55.414291 2583 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"service-proxy-server-cert\" (UniqueName: \"kubernetes.io/secret/325f97fc-73c3-48ba-b98c-75b19f491201-service-proxy-server-cert\") pod \"cluster-proxy-proxy-agent-5f9bc9c474-jgh2b\" (UID: \"325f97fc-73c3-48ba-b98c-75b19f491201\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-5f9bc9c474-jgh2b" Jul 09 02:34:55.428489 ip-10-0-138-136 kubenswrapper[2583]: I0709 02:34:55.428466 2583 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-xd9mm\" (UniqueName: \"kubernetes.io/projected/615d072a-9a99-488d-b868-51de840150f0-kube-api-access-xd9mm\") pod \"klusterlet-addon-workmgr-59d6c8b955-md6hq\" (UID: \"615d072a-9a99-488d-b868-51de840150f0\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-59d6c8b955-md6hq" Jul 09 02:34:55.430139 ip-10-0-138-136 kubenswrapper[2583]: I0709 02:34:55.429925 2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-source-989f8b8dc-qhcpn" Jul 09 02:34:55.430821 ip-10-0-138-136 kubenswrapper[2583]: I0709 02:34:55.430636 2583 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-z2hdm\" (UniqueName: \"kubernetes.io/projected/6dedc04e-aa0e-4c21-829e-c0a6619b5c22-kube-api-access-z2hdm\") pod \"service-ca-operator-5d46d9ffd4-p9zgk\" (UID: \"6dedc04e-aa0e-4c21-829e-c0a6619b5c22\") " pod="openshift-service-ca-operator/service-ca-operator-5d46d9ffd4-p9zgk" Jul 09 02:34:55.431309 ip-10-0-138-136 kubenswrapper[2583]: I0709 02:34:55.431264 2583 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-2xhhc\" (UniqueName: \"kubernetes.io/projected/325f97fc-73c3-48ba-b98c-75b19f491201-kube-api-access-2xhhc\") pod \"cluster-proxy-proxy-agent-5f9bc9c474-jgh2b\" (UID: \"325f97fc-73c3-48ba-b98c-75b19f491201\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-5f9bc9c474-jgh2b" Jul 09 02:34:55.453766 ip-10-0-138-136 kubenswrapper[2583]: I0709 02:34:55.450338 2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress-canary/ingress-canary-dhcrr" Jul 09 02:34:55.474033 ip-10-0-138-136 kubenswrapper[2583]: I0709 02:34:55.474008 2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-66ff5df664-dkjgb" Jul 09 02:34:55.477502 ip-10-0-138-136 kubenswrapper[2583]: I0709 02:34:55.477384 2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-59d6c8b955-md6hq" Jul 09 02:34:55.484606 ip-10-0-138-136 kubenswrapper[2583]: I0709 02:34:55.484537 2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-5f9bc9c474-jgh2b" Jul 09 02:34:55.503118 ip-10-0-138-136 kubenswrapper[2583]: I0709 02:34:55.503001 2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-operator-5c847dcfc4-rwvrr"] Jul 09 02:34:55.524784 ip-10-0-138-136 kubenswrapper[2583]: W0709 02:34:55.517097 2583 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podbb24b378_f56e_46cb_8881_3f44c1a40391.slice/crio-ce7822142976a58e93b045e39cb34e340b9699fce5b28f2affd6aea3f96dff9a WatchSource:0}: Error finding container ce7822142976a58e93b045e39cb34e340b9699fce5b28f2affd6aea3f96dff9a: Status 404 returned error can't find the container with id ce7822142976a58e93b045e39cb34e340b9699fce5b28f2affd6aea3f96dff9a Jul 09 02:34:55.533754 ip-10-0-138-136 kubenswrapper[2583]: I0709 02:34:55.532396 2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console-operator/console-operator-68b757fb67-xpjsj"] Jul 09 02:34:55.535388 ip-10-0-138-136 kubenswrapper[2583]: I0709 02:34:55.534091 2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-cluster-storage-operator/volume-data-source-validator-5d456fdbcd-bdg6h"] Jul 09 02:34:55.549090 ip-10-0-138-136 kubenswrapper[2583]: W0709 02:34:55.545089 2583 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podc1ea28bb_bfb9_477c_a144_6d7dfd62c073.slice/crio-b8681056a6b529758d857c76bee693ce117f80f9d73dafd6bc27e5dbc63dd924 WatchSource:0}: Error finding container b8681056a6b529758d857c76bee693ce117f80f9d73dafd6bc27e5dbc63dd924: Status 404 returned error can't find the container with id b8681056a6b529758d857c76bee693ce117f80f9d73dafd6bc27e5dbc63dd924 Jul 09 02:34:55.598421 ip-10-0-138-136 kubenswrapper[2583]: I0709 02:34:55.596776 2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-rdtdt" Jul 09 02:34:55.598421 ip-10-0-138-136 kubenswrapper[2583]: I0709 02:34:55.597261 2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-dkblh" Jul 09 02:34:55.598421 ip-10-0-138-136 kubenswrapper[2583]: I0709 02:34:55.597707 2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-sv26w" Jul 09 02:34:55.600578 ip-10-0-138-136 kubenswrapper[2583]: I0709 02:34:55.599803 2583 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"default-dockercfg-9ptb2\"" Jul 09 02:34:55.600578 ip-10-0-138-136 kubenswrapper[2583]: I0709 02:34:55.599930 2583 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-secret\"" Jul 09 02:34:55.600578 ip-10-0-138-136 kubenswrapper[2583]: I0709 02:34:55.600072 2583 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-sa-dockercfg-w8vs7\"" Jul 09 02:34:55.600578 ip-10-0-138-136 kubenswrapper[2583]: I0709 02:34:55.600289 2583 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"original-pull-secret\"" Jul 09 02:34:55.609248 ip-10-0-138-136 kubenswrapper[2583]: I0709 02:34:55.608822 2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-846bf668f7-vls7g"] Jul 09 02:34:55.617818 ip-10-0-138-136 kubenswrapper[2583]: W0709 02:34:55.617498 2583 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod9d809968_31d3_4c4d_be19_234664db4a04.slice/crio-52ee4bb2b04f4536a73703f6d0b3a320b76ee43bd4c598857cefe8b94d52b6e2 WatchSource:0}: Error finding container 52ee4bb2b04f4536a73703f6d0b3a320b76ee43bd4c598857cefe8b94d52b6e2: Status 404 returned error can't find the container with id 52ee4bb2b04f4536a73703f6d0b3a320b76ee43bd4c598857cefe8b94d52b6e2 Jul 09 02:34:55.679019 ip-10-0-138-136 kubenswrapper[2583]: I0709 02:34:55.678992 2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress-canary/ingress-canary-dhcrr"] Jul 09 02:34:55.679450 ip-10-0-138-136 kubenswrapper[2583]: I0709 02:34:55.679429 2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["open-cluster-management-agent-addon/klusterlet-addon-workmgr-59d6c8b955-md6hq"] Jul 09 02:34:55.681903 ip-10-0-138-136 kubenswrapper[2583]: W0709 02:34:55.681877 2583 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod615d072a_9a99_488d_b868_51de840150f0.slice/crio-cdfe4ab60e43587ad10455299eff84e16c1e70bb85838c0eacdae4b3f63628e3 WatchSource:0}: Error finding container cdfe4ab60e43587ad10455299eff84e16c1e70bb85838c0eacdae4b3f63628e3: Status 404 returned error can't find the container with id cdfe4ab60e43587ad10455299eff84e16c1e70bb85838c0eacdae4b3f63628e3 Jul 09 02:34:55.683331 ip-10-0-138-136 kubenswrapper[2583]: W0709 02:34:55.683304 2583 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod42025b60_40d4_453f_aaae_74cb3e1a3cdb.slice/crio-45153f50d62cb8ea686e12db3de0722846fde747ea343c29dc7a2b5d6828c314 WatchSource:0}: Error finding container 45153f50d62cb8ea686e12db3de0722846fde747ea343c29dc7a2b5d6828c314: Status 404 returned error can't find the container with id 45153f50d62cb8ea686e12db3de0722846fde747ea343c29dc7a2b5d6828c314 Jul 09 02:34:55.690677 ip-10-0-138-136 kubenswrapper[2583]: I0709 02:34:55.690653 2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-66ff5df664-dkjgb"] Jul 09 02:34:55.693844 ip-10-0-138-136 kubenswrapper[2583]: W0709 02:34:55.693822 2583 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-podd6c67672_fec5_43e0_92cd_c55eaeba1337.slice/crio-4106efabe7eca8671b42dffa5144eff49daff3da48695a79c100f0611806bbeb WatchSource:0}: Error finding container 4106efabe7eca8671b42dffa5144eff49daff3da48695a79c100f0611806bbeb: Status 404 returned error can't find the container with id 4106efabe7eca8671b42dffa5144eff49daff3da48695a79c100f0611806bbeb Jul 09 02:34:55.693935 ip-10-0-138-136 kubenswrapper[2583]: I0709 02:34:55.693920 2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-source-989f8b8dc-qhcpn"] Jul 09 02:34:55.697089 ip-10-0-138-136 kubenswrapper[2583]: W0709 02:34:55.697068 2583 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod704da9c8_d824_4233_8115_4ddd077c9a7e.slice/crio-04bdf351848508123e5db7a219fd9382588a9ae0a90f2cf506c29bba2a4b226d WatchSource:0}: Error finding container 04bdf351848508123e5db7a219fd9382588a9ae0a90f2cf506c29bba2a4b226d: Status 404 returned error can't find the container with id 04bdf351848508123e5db7a219fd9382588a9ae0a90f2cf506c29bba2a4b226d Jul 09 02:34:55.700289 ip-10-0-138-136 kubenswrapper[2583]: I0709 02:34:55.700267 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/a88b1ede-8749-4df5-88d8-494cfd9cfd83-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-64786d9cbb-grbsm\" (UID: \"a88b1ede-8749-4df5-88d8-494cfd9cfd83\") " pod="openshift-monitoring/cluster-monitoring-operator-64786d9cbb-grbsm" Jul 09 02:34:55.700461 ip-10-0-138-136 kubenswrapper[2583]: I0709 02:34:55.700383 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/9af4ab52-6748-4090-a7a0-8666391d9bfa-registry-tls\") pod \"image-registry-59569495f9-rmmlc\" (UID: \"9af4ab52-6748-4090-a7a0-8666391d9bfa\") " pod="openshift-image-registry/image-registry-59569495f9-rmmlc" Jul 09 02:34:55.700461 ip-10-0-138-136 kubenswrapper[2583]: E0709 02:34:55.700412 2583 secret.go:189] Couldn't get secret openshift-monitoring/cluster-monitoring-operator-tls: secret "cluster-monitoring-operator-tls" not found Jul 09 02:34:55.700565 ip-10-0-138-136 kubenswrapper[2583]: E0709 02:34:55.700467 2583 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/a88b1ede-8749-4df5-88d8-494cfd9cfd83-cluster-monitoring-operator-tls podName:a88b1ede-8749-4df5-88d8-494cfd9cfd83 nodeName:}" failed. No retries permitted until 2026-07-09 02:34:56.700448753 +0000 UTC m=+42.632906236 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "cluster-monitoring-operator-tls" (UniqueName: "kubernetes.io/secret/a88b1ede-8749-4df5-88d8-494cfd9cfd83-cluster-monitoring-operator-tls") pod "cluster-monitoring-operator-64786d9cbb-grbsm" (UID: "a88b1ede-8749-4df5-88d8-494cfd9cfd83") : secret "cluster-monitoring-operator-tls" not found Jul 09 02:34:55.700565 ip-10-0-138-136 kubenswrapper[2583]: E0709 02:34:55.700519 2583 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found Jul 09 02:34:55.700565 ip-10-0-138-136 kubenswrapper[2583]: E0709 02:34:55.700531 2583 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-59569495f9-rmmlc: secret "image-registry-tls" not found Jul 09 02:34:55.700764 ip-10-0-138-136 kubenswrapper[2583]: E0709 02:34:55.700590 2583 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/9af4ab52-6748-4090-a7a0-8666391d9bfa-registry-tls podName:9af4ab52-6748-4090-a7a0-8666391d9bfa nodeName:}" failed. No retries permitted until 2026-07-09 02:34:56.700561117 +0000 UTC m=+42.633018583 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/9af4ab52-6748-4090-a7a0-8666391d9bfa-registry-tls") pod "image-registry-59569495f9-rmmlc" (UID: "9af4ab52-6748-4090-a7a0-8666391d9bfa") : secret "image-registry-tls" not found Jul 09 02:34:55.719000 ip-10-0-138-136 kubenswrapper[2583]: I0709 02:34:55.718983 2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["open-cluster-management-agent-addon/cluster-proxy-proxy-agent-5f9bc9c474-jgh2b"] Jul 09 02:34:55.721006 ip-10-0-138-136 kubenswrapper[2583]: I0709 02:34:55.720992 2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-service-ca-operator/service-ca-operator-5d46d9ffd4-p9zgk" Jul 09 02:34:55.721098 ip-10-0-138-136 kubenswrapper[2583]: W0709 02:34:55.721080 2583 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod325f97fc_73c3_48ba_b98c_75b19f491201.slice/crio-28a40d4b69e21e1ca5b4bb63996f47241cd5a05d272471e8405101b9edca3fea WatchSource:0}: Error finding container 28a40d4b69e21e1ca5b4bb63996f47241cd5a05d272471e8405101b9edca3fea: Status 404 returned error can't find the container with id 28a40d4b69e21e1ca5b4bb63996f47241cd5a05d272471e8405101b9edca3fea Jul 09 02:34:55.789646 ip-10-0-138-136 kubenswrapper[2583]: I0709 02:34:55.789590 2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-operator-5c847dcfc4-rwvrr" event={"ID":"bb24b378-f56e-46cb-8881-3f44c1a40391","Type":"ContainerStarted","Data":"ce7822142976a58e93b045e39cb34e340b9699fce5b28f2affd6aea3f96dff9a"} Jul 09 02:34:55.791024 ip-10-0-138-136 kubenswrapper[2583]: I0709 02:34:55.790995 2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-5f9bc9c474-jgh2b" event={"ID":"325f97fc-73c3-48ba-b98c-75b19f491201","Type":"ContainerStarted","Data":"28a40d4b69e21e1ca5b4bb63996f47241cd5a05d272471e8405101b9edca3fea"} Jul 09 02:34:55.792377 ip-10-0-138-136 kubenswrapper[2583]: I0709 02:34:55.792356 2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress-canary/ingress-canary-dhcrr" event={"ID":"42025b60-40d4-453f-aaae-74cb3e1a3cdb","Type":"ContainerStarted","Data":"45153f50d62cb8ea686e12db3de0722846fde747ea343c29dc7a2b5d6828c314"} Jul 09 02:34:55.793625 ip-10-0-138-136 kubenswrapper[2583]: I0709 02:34:55.793596 2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-846bf668f7-vls7g" event={"ID":"9d809968-31d3-4c4d-be19-234664db4a04","Type":"ContainerStarted","Data":"52ee4bb2b04f4536a73703f6d0b3a320b76ee43bd4c598857cefe8b94d52b6e2"} Jul 09 02:34:55.796137 ip-10-0-138-136 kubenswrapper[2583]: I0709 02:34:55.796116 2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console-operator/console-operator-68b757fb67-xpjsj" event={"ID":"188e21f3-2ce9-4012-ada2-a46c32d56729","Type":"ContainerStarted","Data":"783f06f7493a49a940020e54885a341b9bb1c3574f481b2d59610051811c3dd2"} Jul 09 02:34:55.797692 ip-10-0-138-136 kubenswrapper[2583]: I0709 02:34:55.797669 2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-storage-operator/volume-data-source-validator-5d456fdbcd-bdg6h" event={"ID":"c1ea28bb-bfb9-477c-a144-6d7dfd62c073","Type":"ContainerStarted","Data":"b8681056a6b529758d857c76bee693ce117f80f9d73dafd6bc27e5dbc63dd924"} Jul 09 02:34:55.798704 ip-10-0-138-136 kubenswrapper[2583]: I0709 02:34:55.798685 2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-66ff5df664-dkjgb" event={"ID":"d6c67672-fec5-43e0-92cd-c55eaeba1337","Type":"ContainerStarted","Data":"4106efabe7eca8671b42dffa5144eff49daff3da48695a79c100f0611806bbeb"} Jul 09 02:34:55.799847 ip-10-0-138-136 kubenswrapper[2583]: I0709 02:34:55.799799 2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-source-989f8b8dc-qhcpn" event={"ID":"704da9c8-d824-4233-8115-4ddd077c9a7e","Type":"ContainerStarted","Data":"04bdf351848508123e5db7a219fd9382588a9ae0a90f2cf506c29bba2a4b226d"} Jul 09 02:34:55.800818 ip-10-0-138-136 kubenswrapper[2583]: I0709 02:34:55.800798 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/49f19d77-82e8-419b-a88b-09c9ee4354a8-metrics-certs\") pod \"router-default-6575bfb5cc-2ttlz\" (UID: \"49f19d77-82e8-419b-a88b-09c9ee4354a8\") " pod="openshift-ingress/router-default-6575bfb5cc-2ttlz" Jul 09 02:34:55.800939 ip-10-0-138-136 kubenswrapper[2583]: E0709 02:34:55.800894 2583 secret.go:189] Couldn't get secret openshift-ingress/router-metrics-certs-default: secret "router-metrics-certs-default" not found Jul 09 02:34:55.801049 ip-10-0-138-136 kubenswrapper[2583]: I0709 02:34:55.800953 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/a177d680-6ea3-4b92-80e8-a2a081481d88-samples-operator-tls\") pod \"cluster-samples-operator-56fcf86bf-78sff\" (UID: \"a177d680-6ea3-4b92-80e8-a2a081481d88\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-56fcf86bf-78sff" Jul 09 02:34:55.801049 ip-10-0-138-136 kubenswrapper[2583]: I0709 02:34:55.800891 2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-59d6c8b955-md6hq" event={"ID":"615d072a-9a99-488d-b868-51de840150f0","Type":"ContainerStarted","Data":"cdfe4ab60e43587ad10455299eff84e16c1e70bb85838c0eacdae4b3f63628e3"} Jul 09 02:34:55.801049 ip-10-0-138-136 kubenswrapper[2583]: E0709 02:34:55.801002 2583 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/49f19d77-82e8-419b-a88b-09c9ee4354a8-metrics-certs podName:49f19d77-82e8-419b-a88b-09c9ee4354a8 nodeName:}" failed. No retries permitted until 2026-07-09 02:34:56.800980932 +0000 UTC m=+42.733438407 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/49f19d77-82e8-419b-a88b-09c9ee4354a8-metrics-certs") pod "router-default-6575bfb5cc-2ttlz" (UID: "49f19d77-82e8-419b-a88b-09c9ee4354a8") : secret "router-metrics-certs-default" not found Jul 09 02:34:55.801195 ip-10-0-138-136 kubenswrapper[2583]: E0709 02:34:55.801053 2583 secret.go:189] Couldn't get secret openshift-cluster-samples-operator/samples-operator-tls: secret "samples-operator-tls" not found Jul 09 02:34:55.801356 ip-10-0-138-136 kubenswrapper[2583]: E0709 02:34:55.801339 2583 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/a177d680-6ea3-4b92-80e8-a2a081481d88-samples-operator-tls podName:a177d680-6ea3-4b92-80e8-a2a081481d88 nodeName:}" failed. No retries permitted until 2026-07-09 02:34:56.80131934 +0000 UTC m=+42.733776815 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "samples-operator-tls" (UniqueName: "kubernetes.io/secret/a177d680-6ea3-4b92-80e8-a2a081481d88-samples-operator-tls") pod "cluster-samples-operator-56fcf86bf-78sff" (UID: "a177d680-6ea3-4b92-80e8-a2a081481d88") : secret "samples-operator-tls" not found Jul 09 02:34:55.801527 ip-10-0-138-136 kubenswrapper[2583]: I0709 02:34:55.801503 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/ac99dbf2-7e27-437b-a386-89821f738a52-networking-console-plugin-cert\") pod \"networking-console-plugin-6bffdf9778-j5xzm\" (UID: \"ac99dbf2-7e27-437b-a386-89821f738a52\") " pod="openshift-network-console/networking-console-plugin-6bffdf9778-j5xzm" Jul 09 02:34:55.801616 ip-10-0-138-136 kubenswrapper[2583]: I0709 02:34:55.801546 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/49f19d77-82e8-419b-a88b-09c9ee4354a8-service-ca-bundle\") pod \"router-default-6575bfb5cc-2ttlz\" (UID: \"49f19d77-82e8-419b-a88b-09c9ee4354a8\") " pod="openshift-ingress/router-default-6575bfb5cc-2ttlz" Jul 09 02:34:55.801616 ip-10-0-138-136 kubenswrapper[2583]: I0709 02:34:55.801578 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/bd5345b9-08c2-4d1c-a033-a5c458c74773-metrics-tls\") pod \"dns-default-rwlzs\" (UID: \"bd5345b9-08c2-4d1c-a033-a5c458c74773\") " pod="openshift-dns/dns-default-rwlzs" Jul 09 02:34:55.801692 ip-10-0-138-136 kubenswrapper[2583]: E0709 02:34:55.801642 2583 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/49f19d77-82e8-419b-a88b-09c9ee4354a8-service-ca-bundle podName:49f19d77-82e8-419b-a88b-09c9ee4354a8 nodeName:}" failed. No retries permitted until 2026-07-09 02:34:56.801627352 +0000 UTC m=+42.734084832 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "service-ca-bundle" (UniqueName: "kubernetes.io/configmap/49f19d77-82e8-419b-a88b-09c9ee4354a8-service-ca-bundle") pod "router-default-6575bfb5cc-2ttlz" (UID: "49f19d77-82e8-419b-a88b-09c9ee4354a8") : configmap references non-existent config key: service-ca.crt Jul 09 02:34:55.801692 ip-10-0-138-136 kubenswrapper[2583]: E0709 02:34:55.801649 2583 secret.go:189] Couldn't get secret openshift-network-console/networking-console-plugin-cert: secret "networking-console-plugin-cert" not found Jul 09 02:34:55.801692 ip-10-0-138-136 kubenswrapper[2583]: E0709 02:34:55.801667 2583 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jul 09 02:34:55.801692 ip-10-0-138-136 kubenswrapper[2583]: E0709 02:34:55.801687 2583 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/ac99dbf2-7e27-437b-a386-89821f738a52-networking-console-plugin-cert podName:ac99dbf2-7e27-437b-a386-89821f738a52 nodeName:}" failed. No retries permitted until 2026-07-09 02:34:56.801676286 +0000 UTC m=+42.734133774 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "networking-console-plugin-cert" (UniqueName: "kubernetes.io/secret/ac99dbf2-7e27-437b-a386-89821f738a52-networking-console-plugin-cert") pod "networking-console-plugin-6bffdf9778-j5xzm" (UID: "ac99dbf2-7e27-437b-a386-89821f738a52") : secret "networking-console-plugin-cert" not found Jul 09 02:34:55.801835 ip-10-0-138-136 kubenswrapper[2583]: E0709 02:34:55.801703 2583 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/bd5345b9-08c2-4d1c-a033-a5c458c74773-metrics-tls podName:bd5345b9-08c2-4d1c-a033-a5c458c74773 nodeName:}" failed. No retries permitted until 2026-07-09 02:34:56.801694325 +0000 UTC m=+42.734151789 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/bd5345b9-08c2-4d1c-a033-a5c458c74773-metrics-tls") pod "dns-default-rwlzs" (UID: "bd5345b9-08c2-4d1c-a033-a5c458c74773") : secret "dns-default-metrics-tls" not found Jul 09 02:34:55.862789 ip-10-0-138-136 kubenswrapper[2583]: I0709 02:34:55.862764 2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-service-ca-operator/service-ca-operator-5d46d9ffd4-p9zgk"] Jul 09 02:34:55.865824 ip-10-0-138-136 kubenswrapper[2583]: W0709 02:34:55.865801 2583 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod6dedc04e_aa0e_4c21_829e_c0a6619b5c22.slice/crio-bb9ef0007ddc274305c75cf3568c9d5bf483129fada645dda91bd4aef2a558c5 WatchSource:0}: Error finding container bb9ef0007ddc274305c75cf3568c9d5bf483129fada645dda91bd4aef2a558c5: Status 404 returned error can't find the container with id bb9ef0007ddc274305c75cf3568c9d5bf483129fada645dda91bd4aef2a558c5 Jul 09 02:34:56.667696 ip-10-0-138-136 kubenswrapper[2583]: I0709 02:34:56.667632 2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gszbq_6d20c3fe-b459-4dbb-86a7-3903e967b424/konnectivity-agent/0.log" limit=1024 Jul 09 02:34:56.711181 ip-10-0-138-136 kubenswrapper[2583]: I0709 02:34:56.710320 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/9af4ab52-6748-4090-a7a0-8666391d9bfa-registry-tls\") pod \"image-registry-59569495f9-rmmlc\" (UID: \"9af4ab52-6748-4090-a7a0-8666391d9bfa\") " pod="openshift-image-registry/image-registry-59569495f9-rmmlc" Jul 09 02:34:56.711181 ip-10-0-138-136 kubenswrapper[2583]: I0709 02:34:56.710412 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/a88b1ede-8749-4df5-88d8-494cfd9cfd83-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-64786d9cbb-grbsm\" (UID: \"a88b1ede-8749-4df5-88d8-494cfd9cfd83\") " pod="openshift-monitoring/cluster-monitoring-operator-64786d9cbb-grbsm" Jul 09 02:34:56.711181 ip-10-0-138-136 kubenswrapper[2583]: E0709 02:34:56.710583 2583 secret.go:189] Couldn't get secret openshift-monitoring/cluster-monitoring-operator-tls: secret "cluster-monitoring-operator-tls" not found Jul 09 02:34:56.711181 ip-10-0-138-136 kubenswrapper[2583]: E0709 02:34:56.710660 2583 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/a88b1ede-8749-4df5-88d8-494cfd9cfd83-cluster-monitoring-operator-tls podName:a88b1ede-8749-4df5-88d8-494cfd9cfd83 nodeName:}" failed. No retries permitted until 2026-07-09 02:34:58.710639415 +0000 UTC m=+44.643096885 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "cluster-monitoring-operator-tls" (UniqueName: "kubernetes.io/secret/a88b1ede-8749-4df5-88d8-494cfd9cfd83-cluster-monitoring-operator-tls") pod "cluster-monitoring-operator-64786d9cbb-grbsm" (UID: "a88b1ede-8749-4df5-88d8-494cfd9cfd83") : secret "cluster-monitoring-operator-tls" not found Jul 09 02:34:56.711181 ip-10-0-138-136 kubenswrapper[2583]: E0709 02:34:56.711070 2583 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found Jul 09 02:34:56.711181 ip-10-0-138-136 kubenswrapper[2583]: E0709 02:34:56.711086 2583 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-59569495f9-rmmlc: secret "image-registry-tls" not found Jul 09 02:34:56.711181 ip-10-0-138-136 kubenswrapper[2583]: E0709 02:34:56.711151 2583 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/9af4ab52-6748-4090-a7a0-8666391d9bfa-registry-tls podName:9af4ab52-6748-4090-a7a0-8666391d9bfa nodeName:}" failed. No retries permitted until 2026-07-09 02:34:58.711136043 +0000 UTC m=+44.643593509 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/9af4ab52-6748-4090-a7a0-8666391d9bfa-registry-tls") pod "image-registry-59569495f9-rmmlc" (UID: "9af4ab52-6748-4090-a7a0-8666391d9bfa") : secret "image-registry-tls" not found Jul 09 02:34:56.768850 ip-10-0-138-136 kubenswrapper[2583]: I0709 02:34:56.768805 2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gszbq_6d20c3fe-b459-4dbb-86a7-3903e967b424/konnectivity-agent/0.log" limit=1024 Jul 09 02:34:56.807470 ip-10-0-138-136 kubenswrapper[2583]: I0709 02:34:56.807402 2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-service-ca-operator/service-ca-operator-5d46d9ffd4-p9zgk" event={"ID":"6dedc04e-aa0e-4c21-829e-c0a6619b5c22","Type":"ContainerStarted","Data":"bb9ef0007ddc274305c75cf3568c9d5bf483129fada645dda91bd4aef2a558c5"} Jul 09 02:34:56.812169 ip-10-0-138-136 kubenswrapper[2583]: I0709 02:34:56.810981 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/ac99dbf2-7e27-437b-a386-89821f738a52-networking-console-plugin-cert\") pod \"networking-console-plugin-6bffdf9778-j5xzm\" (UID: \"ac99dbf2-7e27-437b-a386-89821f738a52\") " pod="openshift-network-console/networking-console-plugin-6bffdf9778-j5xzm" Jul 09 02:34:56.812169 ip-10-0-138-136 kubenswrapper[2583]: I0709 02:34:56.811029 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/49f19d77-82e8-419b-a88b-09c9ee4354a8-service-ca-bundle\") pod \"router-default-6575bfb5cc-2ttlz\" (UID: \"49f19d77-82e8-419b-a88b-09c9ee4354a8\") " pod="openshift-ingress/router-default-6575bfb5cc-2ttlz" Jul 09 02:34:56.812169 ip-10-0-138-136 kubenswrapper[2583]: I0709 02:34:56.811077 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/bd5345b9-08c2-4d1c-a033-a5c458c74773-metrics-tls\") pod \"dns-default-rwlzs\" (UID: \"bd5345b9-08c2-4d1c-a033-a5c458c74773\") " pod="openshift-dns/dns-default-rwlzs" Jul 09 02:34:56.812169 ip-10-0-138-136 kubenswrapper[2583]: I0709 02:34:56.811125 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/49f19d77-82e8-419b-a88b-09c9ee4354a8-metrics-certs\") pod \"router-default-6575bfb5cc-2ttlz\" (UID: \"49f19d77-82e8-419b-a88b-09c9ee4354a8\") " pod="openshift-ingress/router-default-6575bfb5cc-2ttlz" Jul 09 02:34:56.812169 ip-10-0-138-136 kubenswrapper[2583]: I0709 02:34:56.811159 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/a177d680-6ea3-4b92-80e8-a2a081481d88-samples-operator-tls\") pod \"cluster-samples-operator-56fcf86bf-78sff\" (UID: \"a177d680-6ea3-4b92-80e8-a2a081481d88\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-56fcf86bf-78sff" Jul 09 02:34:56.812169 ip-10-0-138-136 kubenswrapper[2583]: E0709 02:34:56.811386 2583 secret.go:189] Couldn't get secret openshift-cluster-samples-operator/samples-operator-tls: secret "samples-operator-tls" not found Jul 09 02:34:56.812169 ip-10-0-138-136 kubenswrapper[2583]: E0709 02:34:56.811452 2583 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/a177d680-6ea3-4b92-80e8-a2a081481d88-samples-operator-tls podName:a177d680-6ea3-4b92-80e8-a2a081481d88 nodeName:}" failed. No retries permitted until 2026-07-09 02:34:58.811433619 +0000 UTC m=+44.743891098 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "samples-operator-tls" (UniqueName: "kubernetes.io/secret/a177d680-6ea3-4b92-80e8-a2a081481d88-samples-operator-tls") pod "cluster-samples-operator-56fcf86bf-78sff" (UID: "a177d680-6ea3-4b92-80e8-a2a081481d88") : secret "samples-operator-tls" not found Jul 09 02:34:56.812169 ip-10-0-138-136 kubenswrapper[2583]: E0709 02:34:56.811848 2583 secret.go:189] Couldn't get secret openshift-network-console/networking-console-plugin-cert: secret "networking-console-plugin-cert" not found Jul 09 02:34:56.812169 ip-10-0-138-136 kubenswrapper[2583]: E0709 02:34:56.811899 2583 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/ac99dbf2-7e27-437b-a386-89821f738a52-networking-console-plugin-cert podName:ac99dbf2-7e27-437b-a386-89821f738a52 nodeName:}" failed. No retries permitted until 2026-07-09 02:34:58.811882225 +0000 UTC m=+44.744339693 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "networking-console-plugin-cert" (UniqueName: "kubernetes.io/secret/ac99dbf2-7e27-437b-a386-89821f738a52-networking-console-plugin-cert") pod "networking-console-plugin-6bffdf9778-j5xzm" (UID: "ac99dbf2-7e27-437b-a386-89821f738a52") : secret "networking-console-plugin-cert" not found Jul 09 02:34:56.812169 ip-10-0-138-136 kubenswrapper[2583]: E0709 02:34:56.811986 2583 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/49f19d77-82e8-419b-a88b-09c9ee4354a8-service-ca-bundle podName:49f19d77-82e8-419b-a88b-09c9ee4354a8 nodeName:}" failed. No retries permitted until 2026-07-09 02:34:58.811975266 +0000 UTC m=+44.744432732 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "service-ca-bundle" (UniqueName: "kubernetes.io/configmap/49f19d77-82e8-419b-a88b-09c9ee4354a8-service-ca-bundle") pod "router-default-6575bfb5cc-2ttlz" (UID: "49f19d77-82e8-419b-a88b-09c9ee4354a8") : configmap references non-existent config key: service-ca.crt Jul 09 02:34:56.812169 ip-10-0-138-136 kubenswrapper[2583]: E0709 02:34:56.812041 2583 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jul 09 02:34:56.812169 ip-10-0-138-136 kubenswrapper[2583]: E0709 02:34:56.812069 2583 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/bd5345b9-08c2-4d1c-a033-a5c458c74773-metrics-tls podName:bd5345b9-08c2-4d1c-a033-a5c458c74773 nodeName:}" failed. No retries permitted until 2026-07-09 02:34:58.812059672 +0000 UTC m=+44.744517142 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/bd5345b9-08c2-4d1c-a033-a5c458c74773-metrics-tls") pod "dns-default-rwlzs" (UID: "bd5345b9-08c2-4d1c-a033-a5c458c74773") : secret "dns-default-metrics-tls" not found Jul 09 02:34:56.812169 ip-10-0-138-136 kubenswrapper[2583]: E0709 02:34:56.812113 2583 secret.go:189] Couldn't get secret openshift-ingress/router-metrics-certs-default: secret "router-metrics-certs-default" not found Jul 09 02:34:56.812169 ip-10-0-138-136 kubenswrapper[2583]: E0709 02:34:56.812141 2583 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/49f19d77-82e8-419b-a88b-09c9ee4354a8-metrics-certs podName:49f19d77-82e8-419b-a88b-09c9ee4354a8 nodeName:}" failed. No retries permitted until 2026-07-09 02:34:58.812132483 +0000 UTC m=+44.744589951 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/49f19d77-82e8-419b-a88b-09c9ee4354a8-metrics-certs") pod "router-default-6575bfb5cc-2ttlz" (UID: "49f19d77-82e8-419b-a88b-09c9ee4354a8") : secret "router-metrics-certs-default" not found Jul 09 02:34:56.866547 ip-10-0-138-136 kubenswrapper[2583]: I0709 02:34:56.866462 2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gszbq_6d20c3fe-b459-4dbb-86a7-3903e967b424/konnectivity-agent/0.log" limit=1024 Jul 09 02:34:56.967266 ip-10-0-138-136 kubenswrapper[2583]: I0709 02:34:56.967176 2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gszbq_6d20c3fe-b459-4dbb-86a7-3903e967b424/konnectivity-agent/0.log" limit=1024 Jul 09 02:34:57.068271 ip-10-0-138-136 kubenswrapper[2583]: I0709 02:34:57.068217 2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gszbq_6d20c3fe-b459-4dbb-86a7-3903e967b424/konnectivity-agent/0.log" limit=1024 Jul 09 02:34:57.413299 ip-10-0-138-136 kubenswrapper[2583]: I0709 02:34:57.413211 2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gszbq_6d20c3fe-b459-4dbb-86a7-3903e967b424/konnectivity-agent/0.log" limit=1024 Jul 09 02:34:57.519170 ip-10-0-138-136 kubenswrapper[2583]: I0709 02:34:57.518983 2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gszbq_6d20c3fe-b459-4dbb-86a7-3903e967b424/konnectivity-agent/0.log" limit=1024 Jul 09 02:34:58.735682 ip-10-0-138-136 kubenswrapper[2583]: I0709 02:34:58.734563 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/9af4ab52-6748-4090-a7a0-8666391d9bfa-registry-tls\") pod \"image-registry-59569495f9-rmmlc\" (UID: \"9af4ab52-6748-4090-a7a0-8666391d9bfa\") " pod="openshift-image-registry/image-registry-59569495f9-rmmlc" Jul 09 02:34:58.735682 ip-10-0-138-136 kubenswrapper[2583]: I0709 02:34:58.734900 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/a88b1ede-8749-4df5-88d8-494cfd9cfd83-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-64786d9cbb-grbsm\" (UID: \"a88b1ede-8749-4df5-88d8-494cfd9cfd83\") " pod="openshift-monitoring/cluster-monitoring-operator-64786d9cbb-grbsm" Jul 09 02:34:58.735682 ip-10-0-138-136 kubenswrapper[2583]: E0709 02:34:58.735132 2583 secret.go:189] Couldn't get secret openshift-monitoring/cluster-monitoring-operator-tls: secret "cluster-monitoring-operator-tls" not found Jul 09 02:34:58.735682 ip-10-0-138-136 kubenswrapper[2583]: E0709 02:34:58.735196 2583 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/a88b1ede-8749-4df5-88d8-494cfd9cfd83-cluster-monitoring-operator-tls podName:a88b1ede-8749-4df5-88d8-494cfd9cfd83 nodeName:}" failed. No retries permitted until 2026-07-09 02:35:02.73517799 +0000 UTC m=+48.667635458 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "cluster-monitoring-operator-tls" (UniqueName: "kubernetes.io/secret/a88b1ede-8749-4df5-88d8-494cfd9cfd83-cluster-monitoring-operator-tls") pod "cluster-monitoring-operator-64786d9cbb-grbsm" (UID: "a88b1ede-8749-4df5-88d8-494cfd9cfd83") : secret "cluster-monitoring-operator-tls" not found Jul 09 02:34:58.735682 ip-10-0-138-136 kubenswrapper[2583]: E0709 02:34:58.735591 2583 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found Jul 09 02:34:58.735682 ip-10-0-138-136 kubenswrapper[2583]: E0709 02:34:58.735605 2583 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-59569495f9-rmmlc: secret "image-registry-tls" not found Jul 09 02:34:58.735682 ip-10-0-138-136 kubenswrapper[2583]: E0709 02:34:58.735647 2583 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/9af4ab52-6748-4090-a7a0-8666391d9bfa-registry-tls podName:9af4ab52-6748-4090-a7a0-8666391d9bfa nodeName:}" failed. No retries permitted until 2026-07-09 02:35:02.735631506 +0000 UTC m=+48.668088974 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/9af4ab52-6748-4090-a7a0-8666391d9bfa-registry-tls") pod "image-registry-59569495f9-rmmlc" (UID: "9af4ab52-6748-4090-a7a0-8666391d9bfa") : secret "image-registry-tls" not found Jul 09 02:34:58.835909 ip-10-0-138-136 kubenswrapper[2583]: I0709 02:34:58.835876 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/ac99dbf2-7e27-437b-a386-89821f738a52-networking-console-plugin-cert\") pod \"networking-console-plugin-6bffdf9778-j5xzm\" (UID: \"ac99dbf2-7e27-437b-a386-89821f738a52\") " pod="openshift-network-console/networking-console-plugin-6bffdf9778-j5xzm" Jul 09 02:34:58.836067 ip-10-0-138-136 kubenswrapper[2583]: I0709 02:34:58.835929 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/49f19d77-82e8-419b-a88b-09c9ee4354a8-service-ca-bundle\") pod \"router-default-6575bfb5cc-2ttlz\" (UID: \"49f19d77-82e8-419b-a88b-09c9ee4354a8\") " pod="openshift-ingress/router-default-6575bfb5cc-2ttlz" Jul 09 02:34:58.836067 ip-10-0-138-136 kubenswrapper[2583]: I0709 02:34:58.835967 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/bd5345b9-08c2-4d1c-a033-a5c458c74773-metrics-tls\") pod \"dns-default-rwlzs\" (UID: \"bd5345b9-08c2-4d1c-a033-a5c458c74773\") " pod="openshift-dns/dns-default-rwlzs" Jul 09 02:34:58.836067 ip-10-0-138-136 kubenswrapper[2583]: I0709 02:34:58.836005 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/49f19d77-82e8-419b-a88b-09c9ee4354a8-metrics-certs\") pod \"router-default-6575bfb5cc-2ttlz\" (UID: \"49f19d77-82e8-419b-a88b-09c9ee4354a8\") " pod="openshift-ingress/router-default-6575bfb5cc-2ttlz" Jul 09 02:34:58.836067 ip-10-0-138-136 kubenswrapper[2583]: I0709 02:34:58.836038 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/a177d680-6ea3-4b92-80e8-a2a081481d88-samples-operator-tls\") pod \"cluster-samples-operator-56fcf86bf-78sff\" (UID: \"a177d680-6ea3-4b92-80e8-a2a081481d88\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-56fcf86bf-78sff" Jul 09 02:34:58.836339 ip-10-0-138-136 kubenswrapper[2583]: E0709 02:34:58.836322 2583 secret.go:189] Couldn't get secret openshift-cluster-samples-operator/samples-operator-tls: secret "samples-operator-tls" not found Jul 09 02:34:58.836508 ip-10-0-138-136 kubenswrapper[2583]: E0709 02:34:58.836494 2583 secret.go:189] Couldn't get secret openshift-network-console/networking-console-plugin-cert: secret "networking-console-plugin-cert" not found Jul 09 02:34:58.836589 ip-10-0-138-136 kubenswrapper[2583]: E0709 02:34:58.836566 2583 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jul 09 02:34:58.836643 ip-10-0-138-136 kubenswrapper[2583]: E0709 02:34:58.836630 2583 secret.go:189] Couldn't get secret openshift-ingress/router-metrics-certs-default: secret "router-metrics-certs-default" not found Jul 09 02:34:58.836811 ip-10-0-138-136 kubenswrapper[2583]: E0709 02:34:58.836726 2583 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/a177d680-6ea3-4b92-80e8-a2a081481d88-samples-operator-tls podName:a177d680-6ea3-4b92-80e8-a2a081481d88 nodeName:}" failed. No retries permitted until 2026-07-09 02:35:02.836368318 +0000 UTC m=+48.768825790 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "samples-operator-tls" (UniqueName: "kubernetes.io/secret/a177d680-6ea3-4b92-80e8-a2a081481d88-samples-operator-tls") pod "cluster-samples-operator-56fcf86bf-78sff" (UID: "a177d680-6ea3-4b92-80e8-a2a081481d88") : secret "samples-operator-tls" not found Jul 09 02:34:58.836811 ip-10-0-138-136 kubenswrapper[2583]: E0709 02:34:58.836763 2583 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/49f19d77-82e8-419b-a88b-09c9ee4354a8-service-ca-bundle podName:49f19d77-82e8-419b-a88b-09c9ee4354a8 nodeName:}" failed. No retries permitted until 2026-07-09 02:35:02.83675053 +0000 UTC m=+48.769208000 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "service-ca-bundle" (UniqueName: "kubernetes.io/configmap/49f19d77-82e8-419b-a88b-09c9ee4354a8-service-ca-bundle") pod "router-default-6575bfb5cc-2ttlz" (UID: "49f19d77-82e8-419b-a88b-09c9ee4354a8") : configmap references non-existent config key: service-ca.crt Jul 09 02:34:58.836811 ip-10-0-138-136 kubenswrapper[2583]: E0709 02:34:58.836777 2583 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/ac99dbf2-7e27-437b-a386-89821f738a52-networking-console-plugin-cert podName:ac99dbf2-7e27-437b-a386-89821f738a52 nodeName:}" failed. No retries permitted until 2026-07-09 02:35:02.836768909 +0000 UTC m=+48.769226373 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "networking-console-plugin-cert" (UniqueName: "kubernetes.io/secret/ac99dbf2-7e27-437b-a386-89821f738a52-networking-console-plugin-cert") pod "networking-console-plugin-6bffdf9778-j5xzm" (UID: "ac99dbf2-7e27-437b-a386-89821f738a52") : secret "networking-console-plugin-cert" not found Jul 09 02:34:58.836811 ip-10-0-138-136 kubenswrapper[2583]: E0709 02:34:58.836790 2583 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/bd5345b9-08c2-4d1c-a033-a5c458c74773-metrics-tls podName:bd5345b9-08c2-4d1c-a033-a5c458c74773 nodeName:}" failed. No retries permitted until 2026-07-09 02:35:02.836782877 +0000 UTC m=+48.769240343 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/bd5345b9-08c2-4d1c-a033-a5c458c74773-metrics-tls") pod "dns-default-rwlzs" (UID: "bd5345b9-08c2-4d1c-a033-a5c458c74773") : secret "dns-default-metrics-tls" not found Jul 09 02:34:58.836811 ip-10-0-138-136 kubenswrapper[2583]: E0709 02:34:58.836802 2583 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/49f19d77-82e8-419b-a88b-09c9ee4354a8-metrics-certs podName:49f19d77-82e8-419b-a88b-09c9ee4354a8 nodeName:}" failed. No retries permitted until 2026-07-09 02:35:02.836796255 +0000 UTC m=+48.769253719 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/49f19d77-82e8-419b-a88b-09c9ee4354a8-metrics-certs") pod "router-default-6575bfb5cc-2ttlz" (UID: "49f19d77-82e8-419b-a88b-09c9ee4354a8") : secret "router-metrics-certs-default" not found Jul 09 02:34:58.853291 ip-10-0-138-136 kubenswrapper[2583]: I0709 02:34:58.853255 2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-storage-operator/volume-data-source-validator-5d456fdbcd-bdg6h" event={"ID":"c1ea28bb-bfb9-477c-a144-6d7dfd62c073","Type":"ContainerStarted","Data":"f720bd9d59323d4eb8c816aa9bfc9c9a2ad6b5063dabb7808c62b6964df4f08a"} Jul 09 02:34:58.868015 ip-10-0-138-136 kubenswrapper[2583]: I0709 02:34:58.867939 2583 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-storage-operator/volume-data-source-validator-5d456fdbcd-bdg6h" podStartSLOduration=38.343160209 podStartE2EDuration="40.867919874s" totalImagesPullingTime="2.524759665s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-09 02:34:18 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-09 02:34:58.866846605 +0000 UTC m=+44.799304091" watchObservedRunningTime="2026-07-09 02:34:58.867919874 +0000 UTC m=+44.800377362" Jul 09 02:34:58.953211 ip-10-0-138-136 kubenswrapper[2583]: I0709 02:34:58.952914 2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gszbq_6d20c3fe-b459-4dbb-86a7-3903e967b424/konnectivity-agent/0.log" limit=1024 Jul 09 02:34:59.050049 ip-10-0-138-136 kubenswrapper[2583]: I0709 02:34:59.049847 2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gszbq_6d20c3fe-b459-4dbb-86a7-3903e967b424/konnectivity-agent/0.log" limit=1024 Jul 09 02:35:01.346474 ip-10-0-138-136 kubenswrapper[2583]: I0709 02:35:01.346438 2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gszbq_6d20c3fe-b459-4dbb-86a7-3903e967b424/konnectivity-agent/0.log" limit=1024 Jul 09 02:35:01.403090 ip-10-0-138-136 kubenswrapper[2583]: I0709 02:35:01.403062 2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gszbq_6d20c3fe-b459-4dbb-86a7-3903e967b424/konnectivity-agent/0.log" limit=1024 Jul 09 02:35:02.047561 ip-10-0-138-136 kubenswrapper[2583]: I0709 02:35:02.047517 2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gszbq_6d20c3fe-b459-4dbb-86a7-3903e967b424/konnectivity-agent/0.log" limit=1024 Jul 09 02:35:02.148139 ip-10-0-138-136 kubenswrapper[2583]: I0709 02:35:02.148101 2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gszbq_6d20c3fe-b459-4dbb-86a7-3903e967b424/konnectivity-agent/0.log" limit=1024 Jul 09 02:35:02.777811 ip-10-0-138-136 kubenswrapper[2583]: I0709 02:35:02.777778 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/a88b1ede-8749-4df5-88d8-494cfd9cfd83-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-64786d9cbb-grbsm\" (UID: \"a88b1ede-8749-4df5-88d8-494cfd9cfd83\") " pod="openshift-monitoring/cluster-monitoring-operator-64786d9cbb-grbsm" Jul 09 02:35:02.778329 ip-10-0-138-136 kubenswrapper[2583]: I0709 02:35:02.777918 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/9af4ab52-6748-4090-a7a0-8666391d9bfa-registry-tls\") pod \"image-registry-59569495f9-rmmlc\" (UID: \"9af4ab52-6748-4090-a7a0-8666391d9bfa\") " pod="openshift-image-registry/image-registry-59569495f9-rmmlc" Jul 09 02:35:02.778329 ip-10-0-138-136 kubenswrapper[2583]: E0709 02:35:02.777922 2583 secret.go:189] Couldn't get secret openshift-monitoring/cluster-monitoring-operator-tls: secret "cluster-monitoring-operator-tls" not found Jul 09 02:35:02.778329 ip-10-0-138-136 kubenswrapper[2583]: E0709 02:35:02.777988 2583 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found Jul 09 02:35:02.778329 ip-10-0-138-136 kubenswrapper[2583]: E0709 02:35:02.778008 2583 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-59569495f9-rmmlc: secret "image-registry-tls" not found Jul 09 02:35:02.778329 ip-10-0-138-136 kubenswrapper[2583]: E0709 02:35:02.778010 2583 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/a88b1ede-8749-4df5-88d8-494cfd9cfd83-cluster-monitoring-operator-tls podName:a88b1ede-8749-4df5-88d8-494cfd9cfd83 nodeName:}" failed. No retries permitted until 2026-07-09 02:35:10.777990706 +0000 UTC m=+56.710448172 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "cluster-monitoring-operator-tls" (UniqueName: "kubernetes.io/secret/a88b1ede-8749-4df5-88d8-494cfd9cfd83-cluster-monitoring-operator-tls") pod "cluster-monitoring-operator-64786d9cbb-grbsm" (UID: "a88b1ede-8749-4df5-88d8-494cfd9cfd83") : secret "cluster-monitoring-operator-tls" not found Jul 09 02:35:02.778329 ip-10-0-138-136 kubenswrapper[2583]: E0709 02:35:02.778071 2583 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/9af4ab52-6748-4090-a7a0-8666391d9bfa-registry-tls podName:9af4ab52-6748-4090-a7a0-8666391d9bfa nodeName:}" failed. No retries permitted until 2026-07-09 02:35:10.778054221 +0000 UTC m=+56.710511692 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/9af4ab52-6748-4090-a7a0-8666391d9bfa-registry-tls") pod "image-registry-59569495f9-rmmlc" (UID: "9af4ab52-6748-4090-a7a0-8666391d9bfa") : secret "image-registry-tls" not found Jul 09 02:35:02.878431 ip-10-0-138-136 kubenswrapper[2583]: I0709 02:35:02.878403 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/49f19d77-82e8-419b-a88b-09c9ee4354a8-metrics-certs\") pod \"router-default-6575bfb5cc-2ttlz\" (UID: \"49f19d77-82e8-419b-a88b-09c9ee4354a8\") " pod="openshift-ingress/router-default-6575bfb5cc-2ttlz" Jul 09 02:35:02.878558 ip-10-0-138-136 kubenswrapper[2583]: I0709 02:35:02.878452 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/a177d680-6ea3-4b92-80e8-a2a081481d88-samples-operator-tls\") pod \"cluster-samples-operator-56fcf86bf-78sff\" (UID: \"a177d680-6ea3-4b92-80e8-a2a081481d88\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-56fcf86bf-78sff" Jul 09 02:35:02.878602 ip-10-0-138-136 kubenswrapper[2583]: I0709 02:35:02.878559 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/ac99dbf2-7e27-437b-a386-89821f738a52-networking-console-plugin-cert\") pod \"networking-console-plugin-6bffdf9778-j5xzm\" (UID: \"ac99dbf2-7e27-437b-a386-89821f738a52\") " pod="openshift-network-console/networking-console-plugin-6bffdf9778-j5xzm" Jul 09 02:35:02.878602 ip-10-0-138-136 kubenswrapper[2583]: E0709 02:35:02.878570 2583 secret.go:189] Couldn't get secret openshift-ingress/router-metrics-certs-default: secret "router-metrics-certs-default" not found Jul 09 02:35:02.878602 ip-10-0-138-136 kubenswrapper[2583]: I0709 02:35:02.878595 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/49f19d77-82e8-419b-a88b-09c9ee4354a8-service-ca-bundle\") pod \"router-default-6575bfb5cc-2ttlz\" (UID: \"49f19d77-82e8-419b-a88b-09c9ee4354a8\") " pod="openshift-ingress/router-default-6575bfb5cc-2ttlz" Jul 09 02:35:02.878740 ip-10-0-138-136 kubenswrapper[2583]: E0709 02:35:02.878626 2583 secret.go:189] Couldn't get secret openshift-cluster-samples-operator/samples-operator-tls: secret "samples-operator-tls" not found Jul 09 02:35:02.878740 ip-10-0-138-136 kubenswrapper[2583]: E0709 02:35:02.878631 2583 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/49f19d77-82e8-419b-a88b-09c9ee4354a8-metrics-certs podName:49f19d77-82e8-419b-a88b-09c9ee4354a8 nodeName:}" failed. No retries permitted until 2026-07-09 02:35:10.87861206 +0000 UTC m=+56.811069527 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/49f19d77-82e8-419b-a88b-09c9ee4354a8-metrics-certs") pod "router-default-6575bfb5cc-2ttlz" (UID: "49f19d77-82e8-419b-a88b-09c9ee4354a8") : secret "router-metrics-certs-default" not found Jul 09 02:35:02.878740 ip-10-0-138-136 kubenswrapper[2583]: E0709 02:35:02.878691 2583 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/a177d680-6ea3-4b92-80e8-a2a081481d88-samples-operator-tls podName:a177d680-6ea3-4b92-80e8-a2a081481d88 nodeName:}" failed. No retries permitted until 2026-07-09 02:35:10.878674777 +0000 UTC m=+56.811132252 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "samples-operator-tls" (UniqueName: "kubernetes.io/secret/a177d680-6ea3-4b92-80e8-a2a081481d88-samples-operator-tls") pod "cluster-samples-operator-56fcf86bf-78sff" (UID: "a177d680-6ea3-4b92-80e8-a2a081481d88") : secret "samples-operator-tls" not found Jul 09 02:35:02.878740 ip-10-0-138-136 kubenswrapper[2583]: E0709 02:35:02.878726 2583 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/49f19d77-82e8-419b-a88b-09c9ee4354a8-service-ca-bundle podName:49f19d77-82e8-419b-a88b-09c9ee4354a8 nodeName:}" failed. No retries permitted until 2026-07-09 02:35:10.878699547 +0000 UTC m=+56.811157019 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "service-ca-bundle" (UniqueName: "kubernetes.io/configmap/49f19d77-82e8-419b-a88b-09c9ee4354a8-service-ca-bundle") pod "router-default-6575bfb5cc-2ttlz" (UID: "49f19d77-82e8-419b-a88b-09c9ee4354a8") : configmap references non-existent config key: service-ca.crt Jul 09 02:35:02.878955 ip-10-0-138-136 kubenswrapper[2583]: E0709 02:35:02.878748 2583 secret.go:189] Couldn't get secret openshift-network-console/networking-console-plugin-cert: secret "networking-console-plugin-cert" not found Jul 09 02:35:02.878955 ip-10-0-138-136 kubenswrapper[2583]: I0709 02:35:02.878753 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/bd5345b9-08c2-4d1c-a033-a5c458c74773-metrics-tls\") pod \"dns-default-rwlzs\" (UID: \"bd5345b9-08c2-4d1c-a033-a5c458c74773\") " pod="openshift-dns/dns-default-rwlzs" Jul 09 02:35:02.878955 ip-10-0-138-136 kubenswrapper[2583]: E0709 02:35:02.878783 2583 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/ac99dbf2-7e27-437b-a386-89821f738a52-networking-console-plugin-cert podName:ac99dbf2-7e27-437b-a386-89821f738a52 nodeName:}" failed. No retries permitted until 2026-07-09 02:35:10.878770747 +0000 UTC m=+56.811228211 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "networking-console-plugin-cert" (UniqueName: "kubernetes.io/secret/ac99dbf2-7e27-437b-a386-89821f738a52-networking-console-plugin-cert") pod "networking-console-plugin-6bffdf9778-j5xzm" (UID: "ac99dbf2-7e27-437b-a386-89821f738a52") : secret "networking-console-plugin-cert" not found Jul 09 02:35:02.878955 ip-10-0-138-136 kubenswrapper[2583]: E0709 02:35:02.878850 2583 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jul 09 02:35:02.878955 ip-10-0-138-136 kubenswrapper[2583]: E0709 02:35:02.878889 2583 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/bd5345b9-08c2-4d1c-a033-a5c458c74773-metrics-tls podName:bd5345b9-08c2-4d1c-a033-a5c458c74773 nodeName:}" failed. No retries permitted until 2026-07-09 02:35:10.878879355 +0000 UTC m=+56.811336820 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/bd5345b9-08c2-4d1c-a033-a5c458c74773-metrics-tls") pod "dns-default-rwlzs" (UID: "bd5345b9-08c2-4d1c-a033-a5c458c74773") : secret "dns-default-metrics-tls" not found Jul 09 02:35:09.374162 ip-10-0-138-136 kubenswrapper[2583]: I0709 02:35:09.374079 2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gszbq_6d20c3fe-b459-4dbb-86a7-3903e967b424/konnectivity-agent/0.log" limit=1024 Jul 09 02:35:09.477105 ip-10-0-138-136 kubenswrapper[2583]: I0709 02:35:09.477025 2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gszbq_6d20c3fe-b459-4dbb-86a7-3903e967b424/konnectivity-agent/0.log" limit=1024 Jul 09 02:35:09.887225 ip-10-0-138-136 kubenswrapper[2583]: I0709 02:35:09.887193 2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-59d6c8b955-md6hq" event={"ID":"615d072a-9a99-488d-b868-51de840150f0","Type":"ContainerStarted","Data":"9e162ddc85c19a838451a616f2d39b231439fe95a85d46bb8f9a97cc4bfa3eec"} Jul 09 02:35:09.887658 ip-10-0-138-136 kubenswrapper[2583]: I0709 02:35:09.887474 2583 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-59d6c8b955-md6hq" Jul 09 02:35:09.889419 ip-10-0-138-136 kubenswrapper[2583]: I0709 02:35:09.889204 2583 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-59d6c8b955-md6hq" Jul 09 02:35:09.889419 ip-10-0-138-136 kubenswrapper[2583]: I0709 02:35:09.889379 2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-service-ca-operator/service-ca-operator-5d46d9ffd4-p9zgk" event={"ID":"6dedc04e-aa0e-4c21-829e-c0a6619b5c22","Type":"ContainerStarted","Data":"ca041bf215f03e52b863c93a8c526693c1cf3028bab77c294ff5c3f5f22143aa"} Jul 09 02:35:09.891008 ip-10-0-138-136 kubenswrapper[2583]: I0709 02:35:09.890988 2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-operator-5c847dcfc4-rwvrr" event={"ID":"bb24b378-f56e-46cb-8881-3f44c1a40391","Type":"ContainerStarted","Data":"dfa6c27d7f727a378a41e146e3933b6b46603186413521dee76670c6e24ea666"} Jul 09 02:35:09.893370 ip-10-0-138-136 kubenswrapper[2583]: I0709 02:35:09.893345 2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-5f9bc9c474-jgh2b" event={"ID":"325f97fc-73c3-48ba-b98c-75b19f491201","Type":"ContainerStarted","Data":"19af068e9f867d00ce5f3f6498d71e8c1959f58d2f6d447d11850565591b9c4e"} Jul 09 02:35:09.893464 ip-10-0-138-136 kubenswrapper[2583]: I0709 02:35:09.893381 2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-5f9bc9c474-jgh2b" event={"ID":"325f97fc-73c3-48ba-b98c-75b19f491201","Type":"ContainerStarted","Data":"b6e574c896bd7891886b02cf6a1ef164669b8956c2c0a9c8a2f8e676dca547e0"} Jul 09 02:35:09.893464 ip-10-0-138-136 kubenswrapper[2583]: I0709 02:35:09.893398 2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-5f9bc9c474-jgh2b" event={"ID":"325f97fc-73c3-48ba-b98c-75b19f491201","Type":"ContainerStarted","Data":"c9e2eee8c00a31ffe4746784cd6bc6661e5ddbdb013138536ada5e8e5dcf2776"} Jul 09 02:35:09.895066 ip-10-0-138-136 kubenswrapper[2583]: I0709 02:35:09.895036 2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress-canary/ingress-canary-dhcrr" event={"ID":"42025b60-40d4-453f-aaae-74cb3e1a3cdb","Type":"ContainerStarted","Data":"76e95b09f99e8602b0b0c99f9bf35dcff0eab2969df31618196f42507186d42a"} Jul 09 02:35:09.896813 ip-10-0-138-136 kubenswrapper[2583]: I0709 02:35:09.896576 2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-846bf668f7-vls7g" event={"ID":"9d809968-31d3-4c4d-be19-234664db4a04","Type":"ContainerStarted","Data":"cfbba10f595be98af16c381cf49a0ae9363a12aca7494e0805e8d4925585c936"} Jul 09 02:35:09.898298 ip-10-0-138-136 kubenswrapper[2583]: I0709 02:35:09.898279 2583 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-68b757fb67-xpjsj_188e21f3-2ce9-4012-ada2-a46c32d56729/console-operator/0.log" Jul 09 02:35:09.898397 ip-10-0-138-136 kubenswrapper[2583]: I0709 02:35:09.898314 2583 generic.go:356] "Generic (PLEG): container finished" podID="188e21f3-2ce9-4012-ada2-a46c32d56729" containerID="f8f5c3ff75529945b0e2a69c6a682b082c18bba693b8d62558fc96f0a9a973ee" exitCode=255 Jul 09 02:35:09.898457 ip-10-0-138-136 kubenswrapper[2583]: I0709 02:35:09.898399 2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console-operator/console-operator-68b757fb67-xpjsj" event={"ID":"188e21f3-2ce9-4012-ada2-a46c32d56729","Type":"ContainerDied","Data":"f8f5c3ff75529945b0e2a69c6a682b082c18bba693b8d62558fc96f0a9a973ee"} Jul 09 02:35:09.898888 ip-10-0-138-136 kubenswrapper[2583]: I0709 02:35:09.898629 2583 scope.go:117] "RemoveContainer" containerID="f8f5c3ff75529945b0e2a69c6a682b082c18bba693b8d62558fc96f0a9a973ee" Jul 09 02:35:09.900191 ip-10-0-138-136 kubenswrapper[2583]: I0709 02:35:09.900162 2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-66ff5df664-dkjgb" event={"ID":"d6c67672-fec5-43e0-92cd-c55eaeba1337","Type":"ContainerStarted","Data":"9f6d625f7d505ad5405ffbb665fc99b1b3a9a5dc60652045a7df44a00dab2f60"} Jul 09 02:35:09.902093 ip-10-0-138-136 kubenswrapper[2583]: I0709 02:35:09.902072 2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-source-989f8b8dc-qhcpn" event={"ID":"704da9c8-d824-4233-8115-4ddd077c9a7e","Type":"ContainerStarted","Data":"8ca14498117b83bd6a20e4931ec1288665f6b7d441a62593d39ea6a46c779441"} Jul 09 02:35:09.905882 ip-10-0-138-136 kubenswrapper[2583]: I0709 02:35:09.905601 2583 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-59d6c8b955-md6hq" podStartSLOduration=6.425080827 podStartE2EDuration="19.905586277s" totalImagesPullingTime="13.48050545s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-09 02:34:50 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-09 02:35:09.904786377 +0000 UTC m=+55.837243864" watchObservedRunningTime="2026-07-09 02:35:09.905586277 +0000 UTC m=+55.838043764" Jul 09 02:35:09.938518 ip-10-0-138-136 kubenswrapper[2583]: I0709 02:35:09.937687 2583 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress-canary/ingress-canary-dhcrr" podStartSLOduration=2.46035251 podStartE2EDuration="15.93767403s" totalImagesPullingTime="13.47732152s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-09 02:34:54 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-09 02:35:09.92158563 +0000 UTC m=+55.854043117" watchObservedRunningTime="2026-07-09 02:35:09.93767403 +0000 UTC m=+55.870131518" Jul 09 02:35:09.957352 ip-10-0-138-136 kubenswrapper[2583]: I0709 02:35:09.956306 2583 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-66ff5df664-dkjgb" podStartSLOduration=6.479075549 podStartE2EDuration="19.956291452s" totalImagesPullingTime="13.477215903s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-09 02:34:50 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-09 02:35:09.955872098 +0000 UTC m=+55.888329586" watchObservedRunningTime="2026-07-09 02:35:09.956291452 +0000 UTC m=+55.888748940" Jul 09 02:35:09.974887 ip-10-0-138-136 kubenswrapper[2583]: I0709 02:35:09.974014 2583 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-service-ca-operator/service-ca-operator-5d46d9ffd4-p9zgk" podStartSLOduration=35.679016471 podStartE2EDuration="48.973996361s" totalImagesPullingTime="13.29497989s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-09 02:34:21 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-09 02:35:09.973153795 +0000 UTC m=+55.905611279" watchObservedRunningTime="2026-07-09 02:35:09.973996361 +0000 UTC m=+55.906453828" Jul 09 02:35:09.990017 ip-10-0-138-136 kubenswrapper[2583]: I0709 02:35:09.988894 2583 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-insights/insights-operator-5c847dcfc4-rwvrr" podStartSLOduration=38.34699613 podStartE2EDuration="51.988877996s" totalImagesPullingTime="13.641881866s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-09 02:34:18 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-09 02:35:09.988637506 +0000 UTC m=+55.921094997" watchObservedRunningTime="2026-07-09 02:35:09.988877996 +0000 UTC m=+55.921335483" Jul 09 02:35:10.072640 ip-10-0-138-136 kubenswrapper[2583]: I0709 02:35:10.067275 2583 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-846bf668f7-vls7g" podStartSLOduration=37.525549257 podStartE2EDuration="51.067247734s" totalImagesPullingTime="13.541698477s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-09 02:34:19 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-09 02:35:10.027534686 +0000 UTC m=+55.959992174" watchObservedRunningTime="2026-07-09 02:35:10.067247734 +0000 UTC m=+55.999705222" Jul 09 02:35:10.072640 ip-10-0-138-136 kubenswrapper[2583]: I0709 02:35:10.068405 2583 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-diagnostics/network-check-source-989f8b8dc-qhcpn" podStartSLOduration=34.602851618 podStartE2EDuration="48.068392934s" totalImagesPullingTime="13.465541316s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-09 02:34:22 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-09 02:35:10.062454897 +0000 UTC m=+55.994912384" watchObservedRunningTime="2026-07-09 02:35:10.068392934 +0000 UTC m=+56.000850426" Jul 09 02:35:10.094199 ip-10-0-138-136 kubenswrapper[2583]: I0709 02:35:10.094154 2583 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-5f9bc9c474-jgh2b" podStartSLOduration=6.653490624 podStartE2EDuration="20.094135274s" totalImagesPullingTime="13.44064465s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-09 02:34:50 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-09 02:35:10.093088404 +0000 UTC m=+56.025545891" watchObservedRunningTime="2026-07-09 02:35:10.094135274 +0000 UTC m=+56.026592762" Jul 09 02:35:10.553839 ip-10-0-138-136 kubenswrapper[2583]: I0709 02:35:10.553805 2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gszbq_6d20c3fe-b459-4dbb-86a7-3903e967b424/konnectivity-agent/0.log" limit=1024 Jul 09 02:35:10.645635 ip-10-0-138-136 kubenswrapper[2583]: I0709 02:35:10.645603 2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gszbq_6d20c3fe-b459-4dbb-86a7-3903e967b424/konnectivity-agent/0.log" limit=1024 Jul 09 02:35:10.710104 ip-10-0-138-136 kubenswrapper[2583]: I0709 02:35:10.710077 2583 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-insights/insights-runtime-extractor-x4vq7"] Jul 09 02:35:10.732122 ip-10-0-138-136 kubenswrapper[2583]: I0709 02:35:10.732058 2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-runtime-extractor-x4vq7"] Jul 09 02:35:10.732280 ip-10-0-138-136 kubenswrapper[2583]: I0709 02:35:10.732178 2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-runtime-extractor-x4vq7" Jul 09 02:35:10.734073 ip-10-0-138-136 kubenswrapper[2583]: I0709 02:35:10.734046 2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gszbq_6d20c3fe-b459-4dbb-86a7-3903e967b424/konnectivity-agent/0.log" limit=1024 Jul 09 02:35:10.734791 ip-10-0-138-136 kubenswrapper[2583]: I0709 02:35:10.734773 2583 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-tls\"" Jul 09 02:35:10.734886 ip-10-0-138-136 kubenswrapper[2583]: I0709 02:35:10.734785 2583 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"kube-rbac-proxy\"" Jul 09 02:35:10.734980 ip-10-0-138-136 kubenswrapper[2583]: I0709 02:35:10.734963 2583 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-sa-dockercfg-xhqgt\"" Jul 09 02:35:10.794700 ip-10-0-138-136 kubenswrapper[2583]: I0709 02:35:10.794680 2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gszbq_6d20c3fe-b459-4dbb-86a7-3903e967b424/konnectivity-agent/0.log" limit=1024 Jul 09 02:35:10.848874 ip-10-0-138-136 kubenswrapper[2583]: I0709 02:35:10.848818 2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/d2160d90-2c9d-4bbb-a8ca-a989931a42e3-data-volume\") pod \"insights-runtime-extractor-x4vq7\" (UID: \"d2160d90-2c9d-4bbb-a8ca-a989931a42e3\") " pod="openshift-insights/insights-runtime-extractor-x4vq7" Jul 09 02:35:10.848958 ip-10-0-138-136 kubenswrapper[2583]: I0709 02:35:10.848871 2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-fmlhl\" (UniqueName: \"kubernetes.io/projected/d2160d90-2c9d-4bbb-a8ca-a989931a42e3-kube-api-access-fmlhl\") pod \"insights-runtime-extractor-x4vq7\" (UID: \"d2160d90-2c9d-4bbb-a8ca-a989931a42e3\") " pod="openshift-insights/insights-runtime-extractor-x4vq7" Jul 09 02:35:10.848958 ip-10-0-138-136 kubenswrapper[2583]: I0709 02:35:10.848934 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/9af4ab52-6748-4090-a7a0-8666391d9bfa-registry-tls\") pod \"image-registry-59569495f9-rmmlc\" (UID: \"9af4ab52-6748-4090-a7a0-8666391d9bfa\") " pod="openshift-image-registry/image-registry-59569495f9-rmmlc" Jul 09 02:35:10.849035 ip-10-0-138-136 kubenswrapper[2583]: E0709 02:35:10.849026 2583 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found Jul 09 02:35:10.849075 ip-10-0-138-136 kubenswrapper[2583]: E0709 02:35:10.849039 2583 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-59569495f9-rmmlc: secret "image-registry-tls" not found Jul 09 02:35:10.849075 ip-10-0-138-136 kubenswrapper[2583]: I0709 02:35:10.849045 2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/d2160d90-2c9d-4bbb-a8ca-a989931a42e3-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-x4vq7\" (UID: \"d2160d90-2c9d-4bbb-a8ca-a989931a42e3\") " pod="openshift-insights/insights-runtime-extractor-x4vq7" Jul 09 02:35:10.849189 ip-10-0-138-136 kubenswrapper[2583]: E0709 02:35:10.849084 2583 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/9af4ab52-6748-4090-a7a0-8666391d9bfa-registry-tls podName:9af4ab52-6748-4090-a7a0-8666391d9bfa nodeName:}" failed. No retries permitted until 2026-07-09 02:35:26.84906804 +0000 UTC m=+72.781525514 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/9af4ab52-6748-4090-a7a0-8666391d9bfa-registry-tls") pod "image-registry-59569495f9-rmmlc" (UID: "9af4ab52-6748-4090-a7a0-8666391d9bfa") : secret "image-registry-tls" not found Jul 09 02:35:10.849189 ip-10-0-138-136 kubenswrapper[2583]: I0709 02:35:10.849127 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/a88b1ede-8749-4df5-88d8-494cfd9cfd83-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-64786d9cbb-grbsm\" (UID: \"a88b1ede-8749-4df5-88d8-494cfd9cfd83\") " pod="openshift-monitoring/cluster-monitoring-operator-64786d9cbb-grbsm" Jul 09 02:35:10.849189 ip-10-0-138-136 kubenswrapper[2583]: I0709 02:35:10.849173 2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/d2160d90-2c9d-4bbb-a8ca-a989931a42e3-crio-socket\") pod \"insights-runtime-extractor-x4vq7\" (UID: \"d2160d90-2c9d-4bbb-a8ca-a989931a42e3\") " pod="openshift-insights/insights-runtime-extractor-x4vq7" Jul 09 02:35:10.849305 ip-10-0-138-136 kubenswrapper[2583]: I0709 02:35:10.849225 2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/d2160d90-2c9d-4bbb-a8ca-a989931a42e3-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-x4vq7\" (UID: \"d2160d90-2c9d-4bbb-a8ca-a989931a42e3\") " pod="openshift-insights/insights-runtime-extractor-x4vq7" Jul 09 02:35:10.849305 ip-10-0-138-136 kubenswrapper[2583]: E0709 02:35:10.849282 2583 secret.go:189] Couldn't get secret openshift-monitoring/cluster-monitoring-operator-tls: secret "cluster-monitoring-operator-tls" not found Jul 09 02:35:10.849369 ip-10-0-138-136 kubenswrapper[2583]: E0709 02:35:10.849334 2583 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/a88b1ede-8749-4df5-88d8-494cfd9cfd83-cluster-monitoring-operator-tls podName:a88b1ede-8749-4df5-88d8-494cfd9cfd83 nodeName:}" failed. No retries permitted until 2026-07-09 02:35:26.849320561 +0000 UTC m=+72.781778030 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "cluster-monitoring-operator-tls" (UniqueName: "kubernetes.io/secret/a88b1ede-8749-4df5-88d8-494cfd9cfd83-cluster-monitoring-operator-tls") pod "cluster-monitoring-operator-64786d9cbb-grbsm" (UID: "a88b1ede-8749-4df5-88d8-494cfd9cfd83") : secret "cluster-monitoring-operator-tls" not found Jul 09 02:35:10.907530 ip-10-0-138-136 kubenswrapper[2583]: I0709 02:35:10.907507 2583 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-68b757fb67-xpjsj_188e21f3-2ce9-4012-ada2-a46c32d56729/console-operator/1.log" Jul 09 02:35:10.907955 ip-10-0-138-136 kubenswrapper[2583]: I0709 02:35:10.907939 2583 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-68b757fb67-xpjsj_188e21f3-2ce9-4012-ada2-a46c32d56729/console-operator/0.log" Jul 09 02:35:10.908047 ip-10-0-138-136 kubenswrapper[2583]: I0709 02:35:10.907979 2583 generic.go:356] "Generic (PLEG): container finished" podID="188e21f3-2ce9-4012-ada2-a46c32d56729" containerID="673e746a886dad207b61389fc42d0ea0e27f21da07bafd5dfe4aca21dfa72138" exitCode=255 Jul 09 02:35:10.908110 ip-10-0-138-136 kubenswrapper[2583]: I0709 02:35:10.908088 2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console-operator/console-operator-68b757fb67-xpjsj" event={"ID":"188e21f3-2ce9-4012-ada2-a46c32d56729","Type":"ContainerDied","Data":"673e746a886dad207b61389fc42d0ea0e27f21da07bafd5dfe4aca21dfa72138"} Jul 09 02:35:10.908164 ip-10-0-138-136 kubenswrapper[2583]: I0709 02:35:10.908142 2583 scope.go:117] "RemoveContainer" containerID="f8f5c3ff75529945b0e2a69c6a682b082c18bba693b8d62558fc96f0a9a973ee" Jul 09 02:35:10.908672 ip-10-0-138-136 kubenswrapper[2583]: I0709 02:35:10.908408 2583 scope.go:117] "RemoveContainer" containerID="673e746a886dad207b61389fc42d0ea0e27f21da07bafd5dfe4aca21dfa72138" Jul 09 02:35:10.908672 ip-10-0-138-136 kubenswrapper[2583]: E0709 02:35:10.908576 2583 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"console-operator\" with CrashLoopBackOff: \"back-off 10s restarting failed container=console-operator pod=console-operator-68b757fb67-xpjsj_openshift-console-operator(188e21f3-2ce9-4012-ada2-a46c32d56729)\"" pod="openshift-console-operator/console-operator-68b757fb67-xpjsj" podUID="188e21f3-2ce9-4012-ada2-a46c32d56729" Jul 09 02:35:10.950599 ip-10-0-138-136 kubenswrapper[2583]: I0709 02:35:10.950579 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/d2160d90-2c9d-4bbb-a8ca-a989931a42e3-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-x4vq7\" (UID: \"d2160d90-2c9d-4bbb-a8ca-a989931a42e3\") " pod="openshift-insights/insights-runtime-extractor-x4vq7" Jul 09 02:35:10.950688 ip-10-0-138-136 kubenswrapper[2583]: I0709 02:35:10.950625 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/d2160d90-2c9d-4bbb-a8ca-a989931a42e3-crio-socket\") pod \"insights-runtime-extractor-x4vq7\" (UID: \"d2160d90-2c9d-4bbb-a8ca-a989931a42e3\") " pod="openshift-insights/insights-runtime-extractor-x4vq7" Jul 09 02:35:10.950688 ip-10-0-138-136 kubenswrapper[2583]: I0709 02:35:10.950646 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/ac99dbf2-7e27-437b-a386-89821f738a52-networking-console-plugin-cert\") pod \"networking-console-plugin-6bffdf9778-j5xzm\" (UID: \"ac99dbf2-7e27-437b-a386-89821f738a52\") " pod="openshift-network-console/networking-console-plugin-6bffdf9778-j5xzm" Jul 09 02:35:10.950688 ip-10-0-138-136 kubenswrapper[2583]: I0709 02:35:10.950667 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/49f19d77-82e8-419b-a88b-09c9ee4354a8-service-ca-bundle\") pod \"router-default-6575bfb5cc-2ttlz\" (UID: \"49f19d77-82e8-419b-a88b-09c9ee4354a8\") " pod="openshift-ingress/router-default-6575bfb5cc-2ttlz" Jul 09 02:35:10.950688 ip-10-0-138-136 kubenswrapper[2583]: I0709 02:35:10.950686 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/d2160d90-2c9d-4bbb-a8ca-a989931a42e3-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-x4vq7\" (UID: \"d2160d90-2c9d-4bbb-a8ca-a989931a42e3\") " pod="openshift-insights/insights-runtime-extractor-x4vq7" Jul 09 02:35:10.950923 ip-10-0-138-136 kubenswrapper[2583]: E0709 02:35:10.950703 2583 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found Jul 09 02:35:10.950923 ip-10-0-138-136 kubenswrapper[2583]: I0709 02:35:10.950737 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/bd5345b9-08c2-4d1c-a033-a5c458c74773-metrics-tls\") pod \"dns-default-rwlzs\" (UID: \"bd5345b9-08c2-4d1c-a033-a5c458c74773\") " pod="openshift-dns/dns-default-rwlzs" Jul 09 02:35:10.950923 ip-10-0-138-136 kubenswrapper[2583]: I0709 02:35:10.950753 2583 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/d2160d90-2c9d-4bbb-a8ca-a989931a42e3-crio-socket\") pod \"insights-runtime-extractor-x4vq7\" (UID: \"d2160d90-2c9d-4bbb-a8ca-a989931a42e3\") " pod="openshift-insights/insights-runtime-extractor-x4vq7" Jul 09 02:35:10.950923 ip-10-0-138-136 kubenswrapper[2583]: E0709 02:35:10.950776 2583 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/d2160d90-2c9d-4bbb-a8ca-a989931a42e3-kube-rbac-proxy-cm podName:d2160d90-2c9d-4bbb-a8ca-a989931a42e3 nodeName:}" failed. No retries permitted until 2026-07-09 02:35:11.450757937 +0000 UTC m=+57.383215405 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/d2160d90-2c9d-4bbb-a8ca-a989931a42e3-kube-rbac-proxy-cm") pod "insights-runtime-extractor-x4vq7" (UID: "d2160d90-2c9d-4bbb-a8ca-a989931a42e3") : configmap "kube-rbac-proxy" not found Jul 09 02:35:10.950923 ip-10-0-138-136 kubenswrapper[2583]: I0709 02:35:10.950799 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/49f19d77-82e8-419b-a88b-09c9ee4354a8-metrics-certs\") pod \"router-default-6575bfb5cc-2ttlz\" (UID: \"49f19d77-82e8-419b-a88b-09c9ee4354a8\") " pod="openshift-ingress/router-default-6575bfb5cc-2ttlz" Jul 09 02:35:10.950923 ip-10-0-138-136 kubenswrapper[2583]: E0709 02:35:10.950806 2583 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found Jul 09 02:35:10.950923 ip-10-0-138-136 kubenswrapper[2583]: E0709 02:35:10.950826 2583 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jul 09 02:35:10.950923 ip-10-0-138-136 kubenswrapper[2583]: I0709 02:35:10.950834 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/d2160d90-2c9d-4bbb-a8ca-a989931a42e3-data-volume\") pod \"insights-runtime-extractor-x4vq7\" (UID: \"d2160d90-2c9d-4bbb-a8ca-a989931a42e3\") " pod="openshift-insights/insights-runtime-extractor-x4vq7" Jul 09 02:35:10.950923 ip-10-0-138-136 kubenswrapper[2583]: E0709 02:35:10.950857 2583 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/d2160d90-2c9d-4bbb-a8ca-a989931a42e3-insights-runtime-extractor-tls podName:d2160d90-2c9d-4bbb-a8ca-a989931a42e3 nodeName:}" failed. No retries permitted until 2026-07-09 02:35:11.45084136 +0000 UTC m=+57.383298832 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/d2160d90-2c9d-4bbb-a8ca-a989931a42e3-insights-runtime-extractor-tls") pod "insights-runtime-extractor-x4vq7" (UID: "d2160d90-2c9d-4bbb-a8ca-a989931a42e3") : secret "insights-runtime-extractor-tls" not found Jul 09 02:35:10.950923 ip-10-0-138-136 kubenswrapper[2583]: E0709 02:35:10.950868 2583 secret.go:189] Couldn't get secret openshift-ingress/router-metrics-certs-default: secret "router-metrics-certs-default" not found Jul 09 02:35:10.950923 ip-10-0-138-136 kubenswrapper[2583]: E0709 02:35:10.950878 2583 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/bd5345b9-08c2-4d1c-a033-a5c458c74773-metrics-tls podName:bd5345b9-08c2-4d1c-a033-a5c458c74773 nodeName:}" failed. No retries permitted until 2026-07-09 02:35:26.95086921 +0000 UTC m=+72.883326679 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/bd5345b9-08c2-4d1c-a033-a5c458c74773-metrics-tls") pod "dns-default-rwlzs" (UID: "bd5345b9-08c2-4d1c-a033-a5c458c74773") : secret "dns-default-metrics-tls" not found Jul 09 02:35:10.950923 ip-10-0-138-136 kubenswrapper[2583]: E0709 02:35:10.950910 2583 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/49f19d77-82e8-419b-a88b-09c9ee4354a8-service-ca-bundle podName:49f19d77-82e8-419b-a88b-09c9ee4354a8 nodeName:}" failed. No retries permitted until 2026-07-09 02:35:26.950893714 +0000 UTC m=+72.883351181 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "service-ca-bundle" (UniqueName: "kubernetes.io/configmap/49f19d77-82e8-419b-a88b-09c9ee4354a8-service-ca-bundle") pod "router-default-6575bfb5cc-2ttlz" (UID: "49f19d77-82e8-419b-a88b-09c9ee4354a8") : configmap references non-existent config key: service-ca.crt Jul 09 02:35:10.951334 ip-10-0-138-136 kubenswrapper[2583]: E0709 02:35:10.950936 2583 secret.go:189] Couldn't get secret openshift-network-console/networking-console-plugin-cert: secret "networking-console-plugin-cert" not found Jul 09 02:35:10.951334 ip-10-0-138-136 kubenswrapper[2583]: E0709 02:35:10.950946 2583 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/49f19d77-82e8-419b-a88b-09c9ee4354a8-metrics-certs podName:49f19d77-82e8-419b-a88b-09c9ee4354a8 nodeName:}" failed. No retries permitted until 2026-07-09 02:35:26.950939402 +0000 UTC m=+72.883396866 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/49f19d77-82e8-419b-a88b-09c9ee4354a8-metrics-certs") pod "router-default-6575bfb5cc-2ttlz" (UID: "49f19d77-82e8-419b-a88b-09c9ee4354a8") : secret "router-metrics-certs-default" not found Jul 09 02:35:10.951334 ip-10-0-138-136 kubenswrapper[2583]: I0709 02:35:10.950960 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/a177d680-6ea3-4b92-80e8-a2a081481d88-samples-operator-tls\") pod \"cluster-samples-operator-56fcf86bf-78sff\" (UID: \"a177d680-6ea3-4b92-80e8-a2a081481d88\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-56fcf86bf-78sff" Jul 09 02:35:10.951334 ip-10-0-138-136 kubenswrapper[2583]: E0709 02:35:10.950972 2583 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/ac99dbf2-7e27-437b-a386-89821f738a52-networking-console-plugin-cert podName:ac99dbf2-7e27-437b-a386-89821f738a52 nodeName:}" failed. No retries permitted until 2026-07-09 02:35:26.95096001 +0000 UTC m=+72.883417480 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "networking-console-plugin-cert" (UniqueName: "kubernetes.io/secret/ac99dbf2-7e27-437b-a386-89821f738a52-networking-console-plugin-cert") pod "networking-console-plugin-6bffdf9778-j5xzm" (UID: "ac99dbf2-7e27-437b-a386-89821f738a52") : secret "networking-console-plugin-cert" not found Jul 09 02:35:10.951334 ip-10-0-138-136 kubenswrapper[2583]: I0709 02:35:10.951002 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-fmlhl\" (UniqueName: \"kubernetes.io/projected/d2160d90-2c9d-4bbb-a8ca-a989931a42e3-kube-api-access-fmlhl\") pod \"insights-runtime-extractor-x4vq7\" (UID: \"d2160d90-2c9d-4bbb-a8ca-a989931a42e3\") " pod="openshift-insights/insights-runtime-extractor-x4vq7" Jul 09 02:35:10.951334 ip-10-0-138-136 kubenswrapper[2583]: E0709 02:35:10.951011 2583 secret.go:189] Couldn't get secret openshift-cluster-samples-operator/samples-operator-tls: secret "samples-operator-tls" not found Jul 09 02:35:10.951334 ip-10-0-138-136 kubenswrapper[2583]: E0709 02:35:10.951040 2583 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/a177d680-6ea3-4b92-80e8-a2a081481d88-samples-operator-tls podName:a177d680-6ea3-4b92-80e8-a2a081481d88 nodeName:}" failed. No retries permitted until 2026-07-09 02:35:26.951033506 +0000 UTC m=+72.883490970 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "samples-operator-tls" (UniqueName: "kubernetes.io/secret/a177d680-6ea3-4b92-80e8-a2a081481d88-samples-operator-tls") pod "cluster-samples-operator-56fcf86bf-78sff" (UID: "a177d680-6ea3-4b92-80e8-a2a081481d88") : secret "samples-operator-tls" not found Jul 09 02:35:10.951334 ip-10-0-138-136 kubenswrapper[2583]: I0709 02:35:10.951109 2583 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/d2160d90-2c9d-4bbb-a8ca-a989931a42e3-data-volume\") pod \"insights-runtime-extractor-x4vq7\" (UID: \"d2160d90-2c9d-4bbb-a8ca-a989931a42e3\") " pod="openshift-insights/insights-runtime-extractor-x4vq7" Jul 09 02:35:10.959628 ip-10-0-138-136 kubenswrapper[2583]: I0709 02:35:10.959605 2583 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-fmlhl\" (UniqueName: \"kubernetes.io/projected/d2160d90-2c9d-4bbb-a8ca-a989931a42e3-kube-api-access-fmlhl\") pod \"insights-runtime-extractor-x4vq7\" (UID: \"d2160d90-2c9d-4bbb-a8ca-a989931a42e3\") " pod="openshift-insights/insights-runtime-extractor-x4vq7" Jul 09 02:35:11.266519 ip-10-0-138-136 kubenswrapper[2583]: I0709 02:35:11.266484 2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gszbq_6d20c3fe-b459-4dbb-86a7-3903e967b424/konnectivity-agent/0.log" limit=1024 Jul 09 02:35:11.365212 ip-10-0-138-136 kubenswrapper[2583]: I0709 02:35:11.365179 2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gszbq_6d20c3fe-b459-4dbb-86a7-3903e967b424/konnectivity-agent/0.log" limit=1024 Jul 09 02:35:11.455385 ip-10-0-138-136 kubenswrapper[2583]: I0709 02:35:11.455358 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/d2160d90-2c9d-4bbb-a8ca-a989931a42e3-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-x4vq7\" (UID: \"d2160d90-2c9d-4bbb-a8ca-a989931a42e3\") " pod="openshift-insights/insights-runtime-extractor-x4vq7" Jul 09 02:35:11.455516 ip-10-0-138-136 kubenswrapper[2583]: E0709 02:35:11.455498 2583 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found Jul 09 02:35:11.455558 ip-10-0-138-136 kubenswrapper[2583]: I0709 02:35:11.455522 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/d2160d90-2c9d-4bbb-a8ca-a989931a42e3-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-x4vq7\" (UID: \"d2160d90-2c9d-4bbb-a8ca-a989931a42e3\") " pod="openshift-insights/insights-runtime-extractor-x4vq7" Jul 09 02:35:11.455558 ip-10-0-138-136 kubenswrapper[2583]: E0709 02:35:11.455555 2583 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/d2160d90-2c9d-4bbb-a8ca-a989931a42e3-insights-runtime-extractor-tls podName:d2160d90-2c9d-4bbb-a8ca-a989931a42e3 nodeName:}" failed. No retries permitted until 2026-07-09 02:35:12.455541081 +0000 UTC m=+58.387998545 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/d2160d90-2c9d-4bbb-a8ca-a989931a42e3-insights-runtime-extractor-tls") pod "insights-runtime-extractor-x4vq7" (UID: "d2160d90-2c9d-4bbb-a8ca-a989931a42e3") : secret "insights-runtime-extractor-tls" not found Jul 09 02:35:11.455628 ip-10-0-138-136 kubenswrapper[2583]: E0709 02:35:11.455580 2583 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found Jul 09 02:35:11.455660 ip-10-0-138-136 kubenswrapper[2583]: E0709 02:35:11.455641 2583 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/d2160d90-2c9d-4bbb-a8ca-a989931a42e3-kube-rbac-proxy-cm podName:d2160d90-2c9d-4bbb-a8ca-a989931a42e3 nodeName:}" failed. No retries permitted until 2026-07-09 02:35:12.455626849 +0000 UTC m=+58.388084314 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/d2160d90-2c9d-4bbb-a8ca-a989931a42e3-kube-rbac-proxy-cm") pod "insights-runtime-extractor-x4vq7" (UID: "d2160d90-2c9d-4bbb-a8ca-a989931a42e3") : configmap "kube-rbac-proxy" not found Jul 09 02:35:11.902525 ip-10-0-138-136 kubenswrapper[2583]: I0709 02:35:11.902506 2583 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_node-resolver-5mbtc_45541338-f2aa-4712-ba6f-8924e3513372/dns-node-resolver/0.log" Jul 09 02:35:11.912578 ip-10-0-138-136 kubenswrapper[2583]: I0709 02:35:11.912559 2583 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-68b757fb67-xpjsj_188e21f3-2ce9-4012-ada2-a46c32d56729/console-operator/1.log" Jul 09 02:35:11.912920 ip-10-0-138-136 kubenswrapper[2583]: I0709 02:35:11.912905 2583 scope.go:117] "RemoveContainer" containerID="673e746a886dad207b61389fc42d0ea0e27f21da07bafd5dfe4aca21dfa72138" Jul 09 02:35:11.913062 ip-10-0-138-136 kubenswrapper[2583]: E0709 02:35:11.913046 2583 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"console-operator\" with CrashLoopBackOff: \"back-off 10s restarting failed container=console-operator pod=console-operator-68b757fb67-xpjsj_openshift-console-operator(188e21f3-2ce9-4012-ada2-a46c32d56729)\"" pod="openshift-console-operator/console-operator-68b757fb67-xpjsj" podUID="188e21f3-2ce9-4012-ada2-a46c32d56729" Jul 09 02:35:12.266913 ip-10-0-138-136 kubenswrapper[2583]: I0709 02:35:12.266888 2583 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-kube-storage-version-migrator/migrator-d57d58cc9-628pm"] Jul 09 02:35:12.269611 ip-10-0-138-136 kubenswrapper[2583]: I0709 02:35:12.269595 2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-kube-storage-version-migrator/migrator-d57d58cc9-628pm" Jul 09 02:35:12.271837 ip-10-0-138-136 kubenswrapper[2583]: I0709 02:35:12.271815 2583 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-kube-storage-version-migrator\"/\"openshift-service-ca.crt\"" Jul 09 02:35:12.271924 ip-10-0-138-136 kubenswrapper[2583]: I0709 02:35:12.271869 2583 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-kube-storage-version-migrator\"/\"kube-root-ca.crt\"" Jul 09 02:35:12.271976 ip-10-0-138-136 kubenswrapper[2583]: I0709 02:35:12.271940 2583 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-kube-storage-version-migrator\"/\"kube-storage-version-migrator-sa-dockercfg-ttvck\"" Jul 09 02:35:12.280768 ip-10-0-138-136 kubenswrapper[2583]: I0709 02:35:12.280740 2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-kube-storage-version-migrator/migrator-d57d58cc9-628pm"] Jul 09 02:35:12.304210 ip-10-0-138-136 kubenswrapper[2583]: I0709 02:35:12.304185 2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gszbq_6d20c3fe-b459-4dbb-86a7-3903e967b424/konnectivity-agent/0.log" limit=1024 Jul 09 02:35:12.359367 ip-10-0-138-136 kubenswrapper[2583]: I0709 02:35:12.359341 2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gszbq_6d20c3fe-b459-4dbb-86a7-3903e967b424/konnectivity-agent/0.log" limit=1024 Jul 09 02:35:12.363428 ip-10-0-138-136 kubenswrapper[2583]: I0709 02:35:12.363408 2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-vw7hg\" (UniqueName: \"kubernetes.io/projected/482ea868-d31a-40b3-b758-26cf59df2b42-kube-api-access-vw7hg\") pod \"migrator-d57d58cc9-628pm\" (UID: \"482ea868-d31a-40b3-b758-26cf59df2b42\") " pod="openshift-kube-storage-version-migrator/migrator-d57d58cc9-628pm" Jul 09 02:35:12.463985 ip-10-0-138-136 kubenswrapper[2583]: I0709 02:35:12.463954 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/d2160d90-2c9d-4bbb-a8ca-a989931a42e3-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-x4vq7\" (UID: \"d2160d90-2c9d-4bbb-a8ca-a989931a42e3\") " pod="openshift-insights/insights-runtime-extractor-x4vq7" Jul 09 02:35:12.464074 ip-10-0-138-136 kubenswrapper[2583]: I0709 02:35:12.464038 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/d2160d90-2c9d-4bbb-a8ca-a989931a42e3-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-x4vq7\" (UID: \"d2160d90-2c9d-4bbb-a8ca-a989931a42e3\") " pod="openshift-insights/insights-runtime-extractor-x4vq7" Jul 09 02:35:12.464074 ip-10-0-138-136 kubenswrapper[2583]: I0709 02:35:12.464057 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-vw7hg\" (UniqueName: \"kubernetes.io/projected/482ea868-d31a-40b3-b758-26cf59df2b42-kube-api-access-vw7hg\") pod \"migrator-d57d58cc9-628pm\" (UID: \"482ea868-d31a-40b3-b758-26cf59df2b42\") " pod="openshift-kube-storage-version-migrator/migrator-d57d58cc9-628pm" Jul 09 02:35:12.464074 ip-10-0-138-136 kubenswrapper[2583]: E0709 02:35:12.464059 2583 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found Jul 09 02:35:12.464173 ip-10-0-138-136 kubenswrapper[2583]: E0709 02:35:12.464112 2583 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/d2160d90-2c9d-4bbb-a8ca-a989931a42e3-kube-rbac-proxy-cm podName:d2160d90-2c9d-4bbb-a8ca-a989931a42e3 nodeName:}" failed. No retries permitted until 2026-07-09 02:35:14.464095561 +0000 UTC m=+60.396553024 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/d2160d90-2c9d-4bbb-a8ca-a989931a42e3-kube-rbac-proxy-cm") pod "insights-runtime-extractor-x4vq7" (UID: "d2160d90-2c9d-4bbb-a8ca-a989931a42e3") : configmap "kube-rbac-proxy" not found Jul 09 02:35:12.464173 ip-10-0-138-136 kubenswrapper[2583]: E0709 02:35:12.464164 2583 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found Jul 09 02:35:12.464242 ip-10-0-138-136 kubenswrapper[2583]: E0709 02:35:12.464212 2583 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/d2160d90-2c9d-4bbb-a8ca-a989931a42e3-insights-runtime-extractor-tls podName:d2160d90-2c9d-4bbb-a8ca-a989931a42e3 nodeName:}" failed. No retries permitted until 2026-07-09 02:35:14.464198405 +0000 UTC m=+60.396655882 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/d2160d90-2c9d-4bbb-a8ca-a989931a42e3-insights-runtime-extractor-tls") pod "insights-runtime-extractor-x4vq7" (UID: "d2160d90-2c9d-4bbb-a8ca-a989931a42e3") : secret "insights-runtime-extractor-tls" not found Jul 09 02:35:12.478486 ip-10-0-138-136 kubenswrapper[2583]: I0709 02:35:12.478461 2583 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-vw7hg\" (UniqueName: \"kubernetes.io/projected/482ea868-d31a-40b3-b758-26cf59df2b42-kube-api-access-vw7hg\") pod \"migrator-d57d58cc9-628pm\" (UID: \"482ea868-d31a-40b3-b758-26cf59df2b42\") " pod="openshift-kube-storage-version-migrator/migrator-d57d58cc9-628pm" Jul 09 02:35:12.579328 ip-10-0-138-136 kubenswrapper[2583]: I0709 02:35:12.579280 2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-kube-storage-version-migrator/migrator-d57d58cc9-628pm" Jul 09 02:35:12.701543 ip-10-0-138-136 kubenswrapper[2583]: I0709 02:35:12.701516 2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-kube-storage-version-migrator/migrator-d57d58cc9-628pm"] Jul 09 02:35:12.704558 ip-10-0-138-136 kubenswrapper[2583]: W0709 02:35:12.704526 2583 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod482ea868_d31a_40b3_b758_26cf59df2b42.slice/crio-49faf49be06f49781ac3cbb469ce2d22002e1a16ba8ae675bdab9373bb2e9e54 WatchSource:0}: Error finding container 49faf49be06f49781ac3cbb469ce2d22002e1a16ba8ae675bdab9373bb2e9e54: Status 404 returned error can't find the container with id 49faf49be06f49781ac3cbb469ce2d22002e1a16ba8ae675bdab9373bb2e9e54 Jul 09 02:35:12.849121 ip-10-0-138-136 kubenswrapper[2583]: I0709 02:35:12.849048 2583 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-service-ca/service-ca-758f599c5-7fjb8"] Jul 09 02:35:12.851594 ip-10-0-138-136 kubenswrapper[2583]: I0709 02:35:12.851579 2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-service-ca/service-ca-758f599c5-7fjb8" Jul 09 02:35:12.853853 ip-10-0-138-136 kubenswrapper[2583]: I0709 02:35:12.853832 2583 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-service-ca\"/\"kube-root-ca.crt\"" Jul 09 02:35:12.853992 ip-10-0-138-136 kubenswrapper[2583]: I0709 02:35:12.853832 2583 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-service-ca\"/\"signing-cabundle\"" Jul 09 02:35:12.854161 ip-10-0-138-136 kubenswrapper[2583]: I0709 02:35:12.854137 2583 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-service-ca\"/\"signing-key\"" Jul 09 02:35:12.854494 ip-10-0-138-136 kubenswrapper[2583]: I0709 02:35:12.854476 2583 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-service-ca\"/\"openshift-service-ca.crt\"" Jul 09 02:35:12.854601 ip-10-0-138-136 kubenswrapper[2583]: I0709 02:35:12.854494 2583 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-service-ca\"/\"service-ca-dockercfg-s96kq\"" Jul 09 02:35:12.855320 ip-10-0-138-136 kubenswrapper[2583]: I0709 02:35:12.855294 2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gszbq_6d20c3fe-b459-4dbb-86a7-3903e967b424/konnectivity-agent/0.log" limit=1024 Jul 09 02:35:12.860871 ip-10-0-138-136 kubenswrapper[2583]: I0709 02:35:12.860842 2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-service-ca/service-ca-758f599c5-7fjb8"] Jul 09 02:35:12.911370 ip-10-0-138-136 kubenswrapper[2583]: I0709 02:35:12.911347 2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gszbq_6d20c3fe-b459-4dbb-86a7-3903e967b424/konnectivity-agent/0.log" limit=1024 Jul 09 02:35:12.916574 ip-10-0-138-136 kubenswrapper[2583]: I0709 02:35:12.916555 2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator/migrator-d57d58cc9-628pm" event={"ID":"482ea868-d31a-40b3-b758-26cf59df2b42","Type":"ContainerStarted","Data":"49faf49be06f49781ac3cbb469ce2d22002e1a16ba8ae675bdab9373bb2e9e54"} Jul 09 02:35:12.969142 ip-10-0-138-136 kubenswrapper[2583]: I0709 02:35:12.969122 2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"signing-key\" (UniqueName: \"kubernetes.io/secret/3e9d2c87-d28d-4a76-ba91-7a4ba461bb62-signing-key\") pod \"service-ca-758f599c5-7fjb8\" (UID: \"3e9d2c87-d28d-4a76-ba91-7a4ba461bb62\") " pod="openshift-service-ca/service-ca-758f599c5-7fjb8" Jul 09 02:35:12.969250 ip-10-0-138-136 kubenswrapper[2583]: I0709 02:35:12.969233 2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"signing-cabundle\" (UniqueName: \"kubernetes.io/configmap/3e9d2c87-d28d-4a76-ba91-7a4ba461bb62-signing-cabundle\") pod \"service-ca-758f599c5-7fjb8\" (UID: \"3e9d2c87-d28d-4a76-ba91-7a4ba461bb62\") " pod="openshift-service-ca/service-ca-758f599c5-7fjb8" Jul 09 02:35:12.969312 ip-10-0-138-136 kubenswrapper[2583]: I0709 02:35:12.969301 2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-ncqh7\" (UniqueName: \"kubernetes.io/projected/3e9d2c87-d28d-4a76-ba91-7a4ba461bb62-kube-api-access-ncqh7\") pod \"service-ca-758f599c5-7fjb8\" (UID: \"3e9d2c87-d28d-4a76-ba91-7a4ba461bb62\") " pod="openshift-service-ca/service-ca-758f599c5-7fjb8" Jul 09 02:35:13.069723 ip-10-0-138-136 kubenswrapper[2583]: I0709 02:35:13.069694 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"signing-key\" (UniqueName: \"kubernetes.io/secret/3e9d2c87-d28d-4a76-ba91-7a4ba461bb62-signing-key\") pod \"service-ca-758f599c5-7fjb8\" (UID: \"3e9d2c87-d28d-4a76-ba91-7a4ba461bb62\") " pod="openshift-service-ca/service-ca-758f599c5-7fjb8" Jul 09 02:35:13.069844 ip-10-0-138-136 kubenswrapper[2583]: I0709 02:35:13.069829 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"signing-cabundle\" (UniqueName: \"kubernetes.io/configmap/3e9d2c87-d28d-4a76-ba91-7a4ba461bb62-signing-cabundle\") pod \"service-ca-758f599c5-7fjb8\" (UID: \"3e9d2c87-d28d-4a76-ba91-7a4ba461bb62\") " pod="openshift-service-ca/service-ca-758f599c5-7fjb8" Jul 09 02:35:13.069940 ip-10-0-138-136 kubenswrapper[2583]: I0709 02:35:13.069927 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-ncqh7\" (UniqueName: \"kubernetes.io/projected/3e9d2c87-d28d-4a76-ba91-7a4ba461bb62-kube-api-access-ncqh7\") pod \"service-ca-758f599c5-7fjb8\" (UID: \"3e9d2c87-d28d-4a76-ba91-7a4ba461bb62\") " pod="openshift-service-ca/service-ca-758f599c5-7fjb8" Jul 09 02:35:13.070416 ip-10-0-138-136 kubenswrapper[2583]: I0709 02:35:13.070395 2583 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"signing-cabundle\" (UniqueName: \"kubernetes.io/configmap/3e9d2c87-d28d-4a76-ba91-7a4ba461bb62-signing-cabundle\") pod \"service-ca-758f599c5-7fjb8\" (UID: \"3e9d2c87-d28d-4a76-ba91-7a4ba461bb62\") " pod="openshift-service-ca/service-ca-758f599c5-7fjb8" Jul 09 02:35:13.071958 ip-10-0-138-136 kubenswrapper[2583]: I0709 02:35:13.071939 2583 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"signing-key\" (UniqueName: \"kubernetes.io/secret/3e9d2c87-d28d-4a76-ba91-7a4ba461bb62-signing-key\") pod \"service-ca-758f599c5-7fjb8\" (UID: \"3e9d2c87-d28d-4a76-ba91-7a4ba461bb62\") " pod="openshift-service-ca/service-ca-758f599c5-7fjb8" Jul 09 02:35:13.078033 ip-10-0-138-136 kubenswrapper[2583]: I0709 02:35:13.078012 2583 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-ncqh7\" (UniqueName: \"kubernetes.io/projected/3e9d2c87-d28d-4a76-ba91-7a4ba461bb62-kube-api-access-ncqh7\") pod \"service-ca-758f599c5-7fjb8\" (UID: \"3e9d2c87-d28d-4a76-ba91-7a4ba461bb62\") " pod="openshift-service-ca/service-ca-758f599c5-7fjb8" Jul 09 02:35:13.101886 ip-10-0-138-136 kubenswrapper[2583]: I0709 02:35:13.101846 2583 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_node-ca-v86n2_6cdfd2a0-46af-4734-9735-7408f8439c96/node-ca/0.log" Jul 09 02:35:13.160886 ip-10-0-138-136 kubenswrapper[2583]: I0709 02:35:13.160867 2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-service-ca/service-ca-758f599c5-7fjb8" Jul 09 02:35:13.276673 ip-10-0-138-136 kubenswrapper[2583]: I0709 02:35:13.276647 2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-service-ca/service-ca-758f599c5-7fjb8"] Jul 09 02:35:13.280732 ip-10-0-138-136 kubenswrapper[2583]: W0709 02:35:13.280693 2583 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod3e9d2c87_d28d_4a76_ba91_7a4ba461bb62.slice/crio-d809306a7d8670e0c40fd69be3bbbbee2ce96e33b0ed03d75fa8a069e220e764 WatchSource:0}: Error finding container d809306a7d8670e0c40fd69be3bbbbee2ce96e33b0ed03d75fa8a069e220e764: Status 404 returned error can't find the container with id d809306a7d8670e0c40fd69be3bbbbee2ce96e33b0ed03d75fa8a069e220e764 Jul 09 02:35:13.502621 ip-10-0-138-136 kubenswrapper[2583]: I0709 02:35:13.502598 2583 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress-canary_ingress-canary-dhcrr_42025b60-40d4-453f-aaae-74cb3e1a3cdb/serve-healthcheck-canary/0.log" Jul 09 02:35:13.727831 ip-10-0-138-136 kubenswrapper[2583]: I0709 02:35:13.727803 2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gszbq_6d20c3fe-b459-4dbb-86a7-3903e967b424/konnectivity-agent/0.log" limit=1024 Jul 09 02:35:13.921895 ip-10-0-138-136 kubenswrapper[2583]: I0709 02:35:13.921814 2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-service-ca/service-ca-758f599c5-7fjb8" event={"ID":"3e9d2c87-d28d-4a76-ba91-7a4ba461bb62","Type":"ContainerStarted","Data":"c6ecb9a55910404f7a27a77dc198caf10ac28dea6b2b8e4f0789f8bc0cdb8d59"} Jul 09 02:35:13.921895 ip-10-0-138-136 kubenswrapper[2583]: I0709 02:35:13.921868 2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-service-ca/service-ca-758f599c5-7fjb8" event={"ID":"3e9d2c87-d28d-4a76-ba91-7a4ba461bb62","Type":"ContainerStarted","Data":"d809306a7d8670e0c40fd69be3bbbbee2ce96e33b0ed03d75fa8a069e220e764"} Jul 09 02:35:13.940729 ip-10-0-138-136 kubenswrapper[2583]: I0709 02:35:13.940635 2583 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-service-ca/service-ca-758f599c5-7fjb8" podStartSLOduration=1.940617462 podStartE2EDuration="1.940617462s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-09 02:35:12 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-09 02:35:13.940582172 +0000 UTC m=+59.873039659" watchObservedRunningTime="2026-07-09 02:35:13.940617462 +0000 UTC m=+59.873074948" Jul 09 02:35:14.484089 ip-10-0-138-136 kubenswrapper[2583]: I0709 02:35:14.484065 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/d2160d90-2c9d-4bbb-a8ca-a989931a42e3-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-x4vq7\" (UID: \"d2160d90-2c9d-4bbb-a8ca-a989931a42e3\") " pod="openshift-insights/insights-runtime-extractor-x4vq7" Jul 09 02:35:14.484185 ip-10-0-138-136 kubenswrapper[2583]: I0709 02:35:14.484145 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/d2160d90-2c9d-4bbb-a8ca-a989931a42e3-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-x4vq7\" (UID: \"d2160d90-2c9d-4bbb-a8ca-a989931a42e3\") " pod="openshift-insights/insights-runtime-extractor-x4vq7" Jul 09 02:35:14.484230 ip-10-0-138-136 kubenswrapper[2583]: E0709 02:35:14.484203 2583 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found Jul 09 02:35:14.484281 ip-10-0-138-136 kubenswrapper[2583]: E0709 02:35:14.484270 2583 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/d2160d90-2c9d-4bbb-a8ca-a989931a42e3-kube-rbac-proxy-cm podName:d2160d90-2c9d-4bbb-a8ca-a989931a42e3 nodeName:}" failed. No retries permitted until 2026-07-09 02:35:18.48425044 +0000 UTC m=+64.416707922 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/d2160d90-2c9d-4bbb-a8ca-a989931a42e3-kube-rbac-proxy-cm") pod "insights-runtime-extractor-x4vq7" (UID: "d2160d90-2c9d-4bbb-a8ca-a989931a42e3") : configmap "kube-rbac-proxy" not found Jul 09 02:35:14.484325 ip-10-0-138-136 kubenswrapper[2583]: E0709 02:35:14.484293 2583 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found Jul 09 02:35:14.484361 ip-10-0-138-136 kubenswrapper[2583]: E0709 02:35:14.484352 2583 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/d2160d90-2c9d-4bbb-a8ca-a989931a42e3-insights-runtime-extractor-tls podName:d2160d90-2c9d-4bbb-a8ca-a989931a42e3 nodeName:}" failed. No retries permitted until 2026-07-09 02:35:18.484338606 +0000 UTC m=+64.416796084 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/d2160d90-2c9d-4bbb-a8ca-a989931a42e3-insights-runtime-extractor-tls") pod "insights-runtime-extractor-x4vq7" (UID: "d2160d90-2c9d-4bbb-a8ca-a989931a42e3") : secret "insights-runtime-extractor-tls" not found Jul 09 02:35:14.926357 ip-10-0-138-136 kubenswrapper[2583]: I0709 02:35:14.926319 2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator/migrator-d57d58cc9-628pm" event={"ID":"482ea868-d31a-40b3-b758-26cf59df2b42","Type":"ContainerStarted","Data":"4c66911a9ca7fbf1644279827e41081a79ac10593a72165cf6b06ff94c1fde22"} Jul 09 02:35:14.926765 ip-10-0-138-136 kubenswrapper[2583]: I0709 02:35:14.926377 2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator/migrator-d57d58cc9-628pm" event={"ID":"482ea868-d31a-40b3-b758-26cf59df2b42","Type":"ContainerStarted","Data":"22a7efc0086fee55ace15f8dc5f9fa356e56ff5424c45e4041132ca735e1cbfd"} Jul 09 02:35:14.940677 ip-10-0-138-136 kubenswrapper[2583]: I0709 02:35:14.940632 2583 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-kube-storage-version-migrator/migrator-d57d58cc9-628pm" podStartSLOduration=1.317939349 podStartE2EDuration="2.940614513s" totalImagesPullingTime="1.622675164s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-09 02:35:12 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-09 02:35:14.93992534 +0000 UTC m=+60.872382825" watchObservedRunningTime="2026-07-09 02:35:14.940614513 +0000 UTC m=+60.873072002" Jul 09 02:35:15.170010 ip-10-0-138-136 kubenswrapper[2583]: I0709 02:35:15.169950 2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gszbq_6d20c3fe-b459-4dbb-86a7-3903e967b424/konnectivity-agent/0.log" limit=1024 Jul 09 02:35:15.272084 ip-10-0-138-136 kubenswrapper[2583]: I0709 02:35:15.272035 2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gszbq_6d20c3fe-b459-4dbb-86a7-3903e967b424/konnectivity-agent/0.log" limit=1024 Jul 09 02:35:15.327835 ip-10-0-138-136 kubenswrapper[2583]: I0709 02:35:15.327809 2583 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console-operator/console-operator-68b757fb67-xpjsj" Jul 09 02:35:15.327976 ip-10-0-138-136 kubenswrapper[2583]: I0709 02:35:15.327920 2583 kubelet.go:2654] "SyncLoop (probe)" probe="liveness" status="unhealthy" pod="openshift-console-operator/console-operator-68b757fb67-xpjsj" Jul 09 02:35:15.328327 ip-10-0-138-136 kubenswrapper[2583]: I0709 02:35:15.328314 2583 scope.go:117] "RemoveContainer" containerID="673e746a886dad207b61389fc42d0ea0e27f21da07bafd5dfe4aca21dfa72138" Jul 09 02:35:15.328522 ip-10-0-138-136 kubenswrapper[2583]: E0709 02:35:15.328502 2583 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"console-operator\" with CrashLoopBackOff: \"back-off 10s restarting failed container=console-operator pod=console-operator-68b757fb67-xpjsj_openshift-console-operator(188e21f3-2ce9-4012-ada2-a46c32d56729)\"" pod="openshift-console-operator/console-operator-68b757fb67-xpjsj" podUID="188e21f3-2ce9-4012-ada2-a46c32d56729" Jul 09 02:35:15.469027 ip-10-0-138-136 kubenswrapper[2583]: I0709 02:35:15.468996 2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gszbq_6d20c3fe-b459-4dbb-86a7-3903e967b424/konnectivity-agent/0.log" limit=1024 Jul 09 02:35:15.569668 ip-10-0-138-136 kubenswrapper[2583]: I0709 02:35:15.569605 2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gszbq_6d20c3fe-b459-4dbb-86a7-3903e967b424/konnectivity-agent/0.log" limit=1024 Jul 09 02:35:15.669127 ip-10-0-138-136 kubenswrapper[2583]: I0709 02:35:15.669102 2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gszbq_6d20c3fe-b459-4dbb-86a7-3903e967b424/konnectivity-agent/0.log" limit=1024 Jul 09 02:35:15.763583 ip-10-0-138-136 kubenswrapper[2583]: I0709 02:35:15.763556 2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gszbq_6d20c3fe-b459-4dbb-86a7-3903e967b424/konnectivity-agent/0.log" limit=1024 Jul 09 02:35:15.874767 ip-10-0-138-136 kubenswrapper[2583]: I0709 02:35:15.871628 2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gszbq_6d20c3fe-b459-4dbb-86a7-3903e967b424/konnectivity-agent/0.log" limit=1024 Jul 09 02:35:16.695675 ip-10-0-138-136 kubenswrapper[2583]: I0709 02:35:16.695645 2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gszbq_6d20c3fe-b459-4dbb-86a7-3903e967b424/konnectivity-agent/0.log" limit=1024 Jul 09 02:35:17.088282 ip-10-0-138-136 kubenswrapper[2583]: I0709 02:35:17.088250 2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gszbq_6d20c3fe-b459-4dbb-86a7-3903e967b424/konnectivity-agent/0.log" limit=1024 Jul 09 02:35:17.279771 ip-10-0-138-136 kubenswrapper[2583]: I0709 02:35:17.279694 2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gszbq_6d20c3fe-b459-4dbb-86a7-3903e967b424/konnectivity-agent/0.log" limit=1024 Jul 09 02:35:17.480680 ip-10-0-138-136 kubenswrapper[2583]: I0709 02:35:17.480610 2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gszbq_6d20c3fe-b459-4dbb-86a7-3903e967b424/konnectivity-agent/0.log" limit=1024 Jul 09 02:35:17.680915 ip-10-0-138-136 kubenswrapper[2583]: I0709 02:35:17.680889 2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gszbq_6d20c3fe-b459-4dbb-86a7-3903e967b424/konnectivity-agent/0.log" limit=1024 Jul 09 02:35:17.877725 ip-10-0-138-136 kubenswrapper[2583]: I0709 02:35:17.877680 2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gszbq_6d20c3fe-b459-4dbb-86a7-3903e967b424/konnectivity-agent/0.log" limit=1024 Jul 09 02:35:18.116423 ip-10-0-138-136 kubenswrapper[2583]: I0709 02:35:18.116388 2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gszbq_6d20c3fe-b459-4dbb-86a7-3903e967b424/konnectivity-agent/0.log" limit=1024 Jul 09 02:35:18.518973 ip-10-0-138-136 kubenswrapper[2583]: I0709 02:35:18.518941 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/d2160d90-2c9d-4bbb-a8ca-a989931a42e3-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-x4vq7\" (UID: \"d2160d90-2c9d-4bbb-a8ca-a989931a42e3\") " pod="openshift-insights/insights-runtime-extractor-x4vq7" Jul 09 02:35:18.519128 ip-10-0-138-136 kubenswrapper[2583]: I0709 02:35:18.519025 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/d2160d90-2c9d-4bbb-a8ca-a989931a42e3-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-x4vq7\" (UID: \"d2160d90-2c9d-4bbb-a8ca-a989931a42e3\") " pod="openshift-insights/insights-runtime-extractor-x4vq7" Jul 09 02:35:18.519128 ip-10-0-138-136 kubenswrapper[2583]: E0709 02:35:18.519057 2583 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found Jul 09 02:35:18.519128 ip-10-0-138-136 kubenswrapper[2583]: E0709 02:35:18.519113 2583 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/d2160d90-2c9d-4bbb-a8ca-a989931a42e3-kube-rbac-proxy-cm podName:d2160d90-2c9d-4bbb-a8ca-a989931a42e3 nodeName:}" failed. No retries permitted until 2026-07-09 02:35:26.519099255 +0000 UTC m=+72.451556719 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/d2160d90-2c9d-4bbb-a8ca-a989931a42e3-kube-rbac-proxy-cm") pod "insights-runtime-extractor-x4vq7" (UID: "d2160d90-2c9d-4bbb-a8ca-a989931a42e3") : configmap "kube-rbac-proxy" not found Jul 09 02:35:18.519270 ip-10-0-138-136 kubenswrapper[2583]: E0709 02:35:18.519144 2583 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found Jul 09 02:35:18.519270 ip-10-0-138-136 kubenswrapper[2583]: E0709 02:35:18.519198 2583 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/d2160d90-2c9d-4bbb-a8ca-a989931a42e3-insights-runtime-extractor-tls podName:d2160d90-2c9d-4bbb-a8ca-a989931a42e3 nodeName:}" failed. No retries permitted until 2026-07-09 02:35:26.519186386 +0000 UTC m=+72.451643849 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/d2160d90-2c9d-4bbb-a8ca-a989931a42e3-insights-runtime-extractor-tls") pod "insights-runtime-extractor-x4vq7" (UID: "d2160d90-2c9d-4bbb-a8ca-a989931a42e3") : secret "insights-runtime-extractor-tls" not found Jul 09 02:35:18.774252 ip-10-0-138-136 kubenswrapper[2583]: I0709 02:35:18.774184 2583 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-6gctz" Jul 09 02:35:18.873258 ip-10-0-138-136 kubenswrapper[2583]: I0709 02:35:18.873209 2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gszbq_6d20c3fe-b459-4dbb-86a7-3903e967b424/konnectivity-agent/0.log" limit=1024 Jul 09 02:35:18.974192 ip-10-0-138-136 kubenswrapper[2583]: I0709 02:35:18.974164 2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gszbq_6d20c3fe-b459-4dbb-86a7-3903e967b424/konnectivity-agent/0.log" limit=1024 Jul 09 02:35:19.074327 ip-10-0-138-136 kubenswrapper[2583]: I0709 02:35:19.074268 2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gszbq_6d20c3fe-b459-4dbb-86a7-3903e967b424/konnectivity-agent/0.log" limit=1024 Jul 09 02:35:19.175019 ip-10-0-138-136 kubenswrapper[2583]: I0709 02:35:19.174998 2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gszbq_6d20c3fe-b459-4dbb-86a7-3903e967b424/konnectivity-agent/0.log" limit=1024 Jul 09 02:35:19.479551 ip-10-0-138-136 kubenswrapper[2583]: I0709 02:35:19.479485 2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gszbq_6d20c3fe-b459-4dbb-86a7-3903e967b424/konnectivity-agent/0.log" limit=1024 Jul 09 02:35:19.673489 ip-10-0-138-136 kubenswrapper[2583]: I0709 02:35:19.673463 2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gszbq_6d20c3fe-b459-4dbb-86a7-3903e967b424/konnectivity-agent/0.log" limit=1024 Jul 09 02:35:19.732886 ip-10-0-138-136 kubenswrapper[2583]: I0709 02:35:19.732859 2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gszbq_6d20c3fe-b459-4dbb-86a7-3903e967b424/konnectivity-agent/0.log" limit=1024 Jul 09 02:35:20.333426 ip-10-0-138-136 kubenswrapper[2583]: I0709 02:35:20.333400 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/4133cf72-5672-4d5e-b6dd-70e32b953216-original-pull-secret\") pod \"global-pull-secret-syncer-sv26w\" (UID: \"4133cf72-5672-4d5e-b6dd-70e32b953216\") " pod="kube-system/global-pull-secret-syncer-sv26w" Jul 09 02:35:20.333809 ip-10-0-138-136 kubenswrapper[2583]: I0709 02:35:20.333458 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/71cf0a89-d676-47f4-bf4a-d13d283493fc-metrics-certs\") pod \"network-metrics-daemon-rdtdt\" (UID: \"71cf0a89-d676-47f4-bf4a-d13d283493fc\") " pod="openshift-multus/network-metrics-daemon-rdtdt" Jul 09 02:35:20.335818 ip-10-0-138-136 kubenswrapper[2583]: I0709 02:35:20.335798 2583 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-secret\"" Jul 09 02:35:20.335916 ip-10-0-138-136 kubenswrapper[2583]: I0709 02:35:20.335850 2583 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"original-pull-secret\"" Jul 09 02:35:20.344639 ip-10-0-138-136 kubenswrapper[2583]: E0709 02:35:20.344621 2583 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: secret "metrics-daemon-secret" not found Jul 09 02:35:20.344738 ip-10-0-138-136 kubenswrapper[2583]: E0709 02:35:20.344686 2583 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/71cf0a89-d676-47f4-bf4a-d13d283493fc-metrics-certs podName:71cf0a89-d676-47f4-bf4a-d13d283493fc nodeName:}" failed. No retries permitted until 2026-07-09 02:36:24.344667913 +0000 UTC m=+130.277125381 (durationBeforeRetry 1m4s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/71cf0a89-d676-47f4-bf4a-d13d283493fc-metrics-certs") pod "network-metrics-daemon-rdtdt" (UID: "71cf0a89-d676-47f4-bf4a-d13d283493fc") : secret "metrics-daemon-secret" not found Jul 09 02:35:20.346622 ip-10-0-138-136 kubenswrapper[2583]: I0709 02:35:20.346603 2583 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/4133cf72-5672-4d5e-b6dd-70e32b953216-original-pull-secret\") pod \"global-pull-secret-syncer-sv26w\" (UID: \"4133cf72-5672-4d5e-b6dd-70e32b953216\") " pod="kube-system/global-pull-secret-syncer-sv26w" Jul 09 02:35:20.535920 ip-10-0-138-136 kubenswrapper[2583]: I0709 02:35:20.535895 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-wwh6x\" (UniqueName: \"kubernetes.io/projected/d9f05741-1f97-4987-8158-4dbad6b22987-kube-api-access-wwh6x\") pod \"network-check-target-dkblh\" (UID: \"d9f05741-1f97-4987-8158-4dbad6b22987\") " pod="openshift-network-diagnostics/network-check-target-dkblh" Jul 09 02:35:20.538217 ip-10-0-138-136 kubenswrapper[2583]: I0709 02:35:20.538198 2583 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-wwh6x\" (UniqueName: \"kubernetes.io/projected/d9f05741-1f97-4987-8158-4dbad6b22987-kube-api-access-wwh6x\") pod \"network-check-target-dkblh\" (UID: \"d9f05741-1f97-4987-8158-4dbad6b22987\") " pod="openshift-network-diagnostics/network-check-target-dkblh" Jul 09 02:35:20.543962 ip-10-0-138-136 kubenswrapper[2583]: I0709 02:35:20.543945 2583 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"default-dockercfg-9ptb2\"" Jul 09 02:35:20.549502 ip-10-0-138-136 kubenswrapper[2583]: I0709 02:35:20.549488 2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-sv26w" Jul 09 02:35:20.552637 ip-10-0-138-136 kubenswrapper[2583]: I0709 02:35:20.552620 2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-dkblh" Jul 09 02:35:20.705639 ip-10-0-138-136 kubenswrapper[2583]: I0709 02:35:20.705608 2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-target-dkblh"] Jul 09 02:35:20.708789 ip-10-0-138-136 kubenswrapper[2583]: W0709 02:35:20.708743 2583 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podd9f05741_1f97_4987_8158_4dbad6b22987.slice/crio-0b9c55e6ca6d8b27f71e231b73f4f9e56a5f24f0a9689c1e61f7aa1e9d22aa92 WatchSource:0}: Error finding container 0b9c55e6ca6d8b27f71e231b73f4f9e56a5f24f0a9689c1e61f7aa1e9d22aa92: Status 404 returned error can't find the container with id 0b9c55e6ca6d8b27f71e231b73f4f9e56a5f24f0a9689c1e61f7aa1e9d22aa92 Jul 09 02:35:20.721908 ip-10-0-138-136 kubenswrapper[2583]: I0709 02:35:20.721885 2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kube-system/global-pull-secret-syncer-sv26w"] Jul 09 02:35:20.725179 ip-10-0-138-136 kubenswrapper[2583]: W0709 02:35:20.725157 2583 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod4133cf72_5672_4d5e_b6dd_70e32b953216.slice/crio-5b963d7543a43eee8f0b6b494b0b2af4be440d28a828e3ad1cb4f08f352e53fb WatchSource:0}: Error finding container 5b963d7543a43eee8f0b6b494b0b2af4be440d28a828e3ad1cb4f08f352e53fb: Status 404 returned error can't find the container with id 5b963d7543a43eee8f0b6b494b0b2af4be440d28a828e3ad1cb4f08f352e53fb Jul 09 02:35:20.947315 ip-10-0-138-136 kubenswrapper[2583]: I0709 02:35:20.947254 2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-target-dkblh" event={"ID":"d9f05741-1f97-4987-8158-4dbad6b22987","Type":"ContainerStarted","Data":"5bdb43ecb30defc9e6fcdca1f49747240e2d7a24ae5912ff136c3e10216f69c6"} Jul 09 02:35:20.947315 ip-10-0-138-136 kubenswrapper[2583]: I0709 02:35:20.947299 2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-target-dkblh" event={"ID":"d9f05741-1f97-4987-8158-4dbad6b22987","Type":"ContainerStarted","Data":"0b9c55e6ca6d8b27f71e231b73f4f9e56a5f24f0a9689c1e61f7aa1e9d22aa92"} Jul 09 02:35:20.947498 ip-10-0-138-136 kubenswrapper[2583]: I0709 02:35:20.947360 2583 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-network-diagnostics/network-check-target-dkblh" Jul 09 02:35:20.948533 ip-10-0-138-136 kubenswrapper[2583]: I0709 02:35:20.948515 2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/global-pull-secret-syncer-sv26w" event={"ID":"4133cf72-5672-4d5e-b6dd-70e32b953216","Type":"ContainerStarted","Data":"5b963d7543a43eee8f0b6b494b0b2af4be440d28a828e3ad1cb4f08f352e53fb"} Jul 09 02:35:20.962270 ip-10-0-138-136 kubenswrapper[2583]: I0709 02:35:20.962226 2583 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-diagnostics/network-check-target-dkblh" podStartSLOduration=65.962213327 podStartE2EDuration="1m5.962213327s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-09 02:34:15 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-09 02:35:20.961360229 +0000 UTC m=+66.893817715" watchObservedRunningTime="2026-07-09 02:35:20.962213327 +0000 UTC m=+66.894670813" Jul 09 02:35:25.965624 ip-10-0-138-136 kubenswrapper[2583]: I0709 02:35:25.965587 2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/global-pull-secret-syncer-sv26w" event={"ID":"4133cf72-5672-4d5e-b6dd-70e32b953216","Type":"ContainerStarted","Data":"c9e7e92207954499a580c98f9dfeaaf865cc77f224ce5ae179f7565b1a94c90d"} Jul 09 02:35:25.980135 ip-10-0-138-136 kubenswrapper[2583]: I0709 02:35:25.980089 2583 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/global-pull-secret-syncer-sv26w" podStartSLOduration=65.952200457 podStartE2EDuration="1m10.980048768s" totalImagesPullingTime="5.027848311s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-09 02:34:15 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-09 02:35:25.978775188 +0000 UTC m=+71.911232674" watchObservedRunningTime="2026-07-09 02:35:25.980048768 +0000 UTC m=+71.912506254" Jul 09 02:35:26.595978 ip-10-0-138-136 kubenswrapper[2583]: I0709 02:35:26.595944 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/d2160d90-2c9d-4bbb-a8ca-a989931a42e3-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-x4vq7\" (UID: \"d2160d90-2c9d-4bbb-a8ca-a989931a42e3\") " pod="openshift-insights/insights-runtime-extractor-x4vq7" Jul 09 02:35:26.596193 ip-10-0-138-136 kubenswrapper[2583]: I0709 02:35:26.596045 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/d2160d90-2c9d-4bbb-a8ca-a989931a42e3-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-x4vq7\" (UID: \"d2160d90-2c9d-4bbb-a8ca-a989931a42e3\") " pod="openshift-insights/insights-runtime-extractor-x4vq7" Jul 09 02:35:26.596492 ip-10-0-138-136 kubenswrapper[2583]: I0709 02:35:26.596470 2583 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/d2160d90-2c9d-4bbb-a8ca-a989931a42e3-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-x4vq7\" (UID: \"d2160d90-2c9d-4bbb-a8ca-a989931a42e3\") " pod="openshift-insights/insights-runtime-extractor-x4vq7" Jul 09 02:35:26.598471 ip-10-0-138-136 kubenswrapper[2583]: I0709 02:35:26.598449 2583 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/d2160d90-2c9d-4bbb-a8ca-a989931a42e3-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-x4vq7\" (UID: \"d2160d90-2c9d-4bbb-a8ca-a989931a42e3\") " pod="openshift-insights/insights-runtime-extractor-x4vq7" Jul 09 02:35:26.644379 ip-10-0-138-136 kubenswrapper[2583]: I0709 02:35:26.644352 2583 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-sa-dockercfg-xhqgt\"" Jul 09 02:35:26.653046 ip-10-0-138-136 kubenswrapper[2583]: I0709 02:35:26.653024 2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-runtime-extractor-x4vq7" Jul 09 02:35:26.777437 ip-10-0-138-136 kubenswrapper[2583]: I0709 02:35:26.777362 2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-runtime-extractor-x4vq7"] Jul 09 02:35:26.779750 ip-10-0-138-136 kubenswrapper[2583]: W0709 02:35:26.779724 2583 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podd2160d90_2c9d_4bbb_a8ca_a989931a42e3.slice/crio-d0194a10c84a648eb68aeb8787b713d81423d61ae0e22b861190e825ac67f1ff WatchSource:0}: Error finding container d0194a10c84a648eb68aeb8787b713d81423d61ae0e22b861190e825ac67f1ff: Status 404 returned error can't find the container with id d0194a10c84a648eb68aeb8787b713d81423d61ae0e22b861190e825ac67f1ff Jul 09 02:35:26.899200 ip-10-0-138-136 kubenswrapper[2583]: I0709 02:35:26.899139 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/9af4ab52-6748-4090-a7a0-8666391d9bfa-registry-tls\") pod \"image-registry-59569495f9-rmmlc\" (UID: \"9af4ab52-6748-4090-a7a0-8666391d9bfa\") " pod="openshift-image-registry/image-registry-59569495f9-rmmlc" Jul 09 02:35:26.899200 ip-10-0-138-136 kubenswrapper[2583]: I0709 02:35:26.899188 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/a88b1ede-8749-4df5-88d8-494cfd9cfd83-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-64786d9cbb-grbsm\" (UID: \"a88b1ede-8749-4df5-88d8-494cfd9cfd83\") " pod="openshift-monitoring/cluster-monitoring-operator-64786d9cbb-grbsm" Jul 09 02:35:26.901320 ip-10-0-138-136 kubenswrapper[2583]: I0709 02:35:26.901296 2583 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/a88b1ede-8749-4df5-88d8-494cfd9cfd83-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-64786d9cbb-grbsm\" (UID: \"a88b1ede-8749-4df5-88d8-494cfd9cfd83\") " pod="openshift-monitoring/cluster-monitoring-operator-64786d9cbb-grbsm" Jul 09 02:35:26.901395 ip-10-0-138-136 kubenswrapper[2583]: I0709 02:35:26.901356 2583 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/9af4ab52-6748-4090-a7a0-8666391d9bfa-registry-tls\") pod \"image-registry-59569495f9-rmmlc\" (UID: \"9af4ab52-6748-4090-a7a0-8666391d9bfa\") " pod="openshift-image-registry/image-registry-59569495f9-rmmlc" Jul 09 02:35:26.969391 ip-10-0-138-136 kubenswrapper[2583]: I0709 02:35:26.969367 2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-x4vq7" event={"ID":"d2160d90-2c9d-4bbb-a8ca-a989931a42e3","Type":"ContainerStarted","Data":"d0194a10c84a648eb68aeb8787b713d81423d61ae0e22b861190e825ac67f1ff"} Jul 09 02:35:27.000576 ip-10-0-138-136 kubenswrapper[2583]: I0709 02:35:27.000553 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/bd5345b9-08c2-4d1c-a033-a5c458c74773-metrics-tls\") pod \"dns-default-rwlzs\" (UID: \"bd5345b9-08c2-4d1c-a033-a5c458c74773\") " pod="openshift-dns/dns-default-rwlzs" Jul 09 02:35:27.000661 ip-10-0-138-136 kubenswrapper[2583]: I0709 02:35:27.000586 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/49f19d77-82e8-419b-a88b-09c9ee4354a8-metrics-certs\") pod \"router-default-6575bfb5cc-2ttlz\" (UID: \"49f19d77-82e8-419b-a88b-09c9ee4354a8\") " pod="openshift-ingress/router-default-6575bfb5cc-2ttlz" Jul 09 02:35:27.000661 ip-10-0-138-136 kubenswrapper[2583]: I0709 02:35:27.000608 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/a177d680-6ea3-4b92-80e8-a2a081481d88-samples-operator-tls\") pod \"cluster-samples-operator-56fcf86bf-78sff\" (UID: \"a177d680-6ea3-4b92-80e8-a2a081481d88\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-56fcf86bf-78sff" Jul 09 02:35:27.000661 ip-10-0-138-136 kubenswrapper[2583]: I0709 02:35:27.000657 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/ac99dbf2-7e27-437b-a386-89821f738a52-networking-console-plugin-cert\") pod \"networking-console-plugin-6bffdf9778-j5xzm\" (UID: \"ac99dbf2-7e27-437b-a386-89821f738a52\") " pod="openshift-network-console/networking-console-plugin-6bffdf9778-j5xzm" Jul 09 02:35:27.000836 ip-10-0-138-136 kubenswrapper[2583]: I0709 02:35:27.000675 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/49f19d77-82e8-419b-a88b-09c9ee4354a8-service-ca-bundle\") pod \"router-default-6575bfb5cc-2ttlz\" (UID: \"49f19d77-82e8-419b-a88b-09c9ee4354a8\") " pod="openshift-ingress/router-default-6575bfb5cc-2ttlz" Jul 09 02:35:27.001325 ip-10-0-138-136 kubenswrapper[2583]: I0709 02:35:27.001249 2583 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/49f19d77-82e8-419b-a88b-09c9ee4354a8-service-ca-bundle\") pod \"router-default-6575bfb5cc-2ttlz\" (UID: \"49f19d77-82e8-419b-a88b-09c9ee4354a8\") " pod="openshift-ingress/router-default-6575bfb5cc-2ttlz" Jul 09 02:35:27.002744 ip-10-0-138-136 kubenswrapper[2583]: I0709 02:35:27.002708 2583 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/49f19d77-82e8-419b-a88b-09c9ee4354a8-metrics-certs\") pod \"router-default-6575bfb5cc-2ttlz\" (UID: \"49f19d77-82e8-419b-a88b-09c9ee4354a8\") " pod="openshift-ingress/router-default-6575bfb5cc-2ttlz" Jul 09 02:35:27.002826 ip-10-0-138-136 kubenswrapper[2583]: I0709 02:35:27.002731 2583 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/bd5345b9-08c2-4d1c-a033-a5c458c74773-metrics-tls\") pod \"dns-default-rwlzs\" (UID: \"bd5345b9-08c2-4d1c-a033-a5c458c74773\") " pod="openshift-dns/dns-default-rwlzs" Jul 09 02:35:27.003303 ip-10-0-138-136 kubenswrapper[2583]: I0709 02:35:27.003283 2583 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/ac99dbf2-7e27-437b-a386-89821f738a52-networking-console-plugin-cert\") pod \"networking-console-plugin-6bffdf9778-j5xzm\" (UID: \"ac99dbf2-7e27-437b-a386-89821f738a52\") " pod="openshift-network-console/networking-console-plugin-6bffdf9778-j5xzm" Jul 09 02:35:27.003391 ip-10-0-138-136 kubenswrapper[2583]: I0709 02:35:27.003371 2583 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/a177d680-6ea3-4b92-80e8-a2a081481d88-samples-operator-tls\") pod \"cluster-samples-operator-56fcf86bf-78sff\" (UID: \"a177d680-6ea3-4b92-80e8-a2a081481d88\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-56fcf86bf-78sff" Jul 09 02:35:27.094855 ip-10-0-138-136 kubenswrapper[2583]: I0709 02:35:27.094836 2583 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"registry-dockercfg-v54k9\"" Jul 09 02:35:27.103831 ip-10-0-138-136 kubenswrapper[2583]: I0709 02:35:27.103814 2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-59569495f9-rmmlc" Jul 09 02:35:27.106826 ip-10-0-138-136 kubenswrapper[2583]: I0709 02:35:27.106807 2583 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"cluster-monitoring-operator-dockercfg-c7n85\"" Jul 09 02:35:27.115480 ip-10-0-138-136 kubenswrapper[2583]: I0709 02:35:27.115463 2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/cluster-monitoring-operator-64786d9cbb-grbsm" Jul 09 02:35:27.151997 ip-10-0-138-136 kubenswrapper[2583]: I0709 02:35:27.151910 2583 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-samples-operator\"/\"cluster-samples-operator-dockercfg-jmmhc\"" Jul 09 02:35:27.162499 ip-10-0-138-136 kubenswrapper[2583]: I0709 02:35:27.161130 2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-samples-operator/cluster-samples-operator-56fcf86bf-78sff" Jul 09 02:35:27.171882 ip-10-0-138-136 kubenswrapper[2583]: I0709 02:35:27.171859 2583 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"router-dockercfg-pgkqd\"" Jul 09 02:35:27.179620 ip-10-0-138-136 kubenswrapper[2583]: I0709 02:35:27.179599 2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/router-default-6575bfb5cc-2ttlz" Jul 09 02:35:27.196646 ip-10-0-138-136 kubenswrapper[2583]: I0709 02:35:27.196619 2583 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-console\"/\"default-dockercfg-svrw7\"" Jul 09 02:35:27.205164 ip-10-0-138-136 kubenswrapper[2583]: I0709 02:35:27.204934 2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-console/networking-console-plugin-6bffdf9778-j5xzm" Jul 09 02:35:27.207029 ip-10-0-138-136 kubenswrapper[2583]: I0709 02:35:27.206979 2583 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-dockercfg-jllr5\"" Jul 09 02:35:27.216516 ip-10-0-138-136 kubenswrapper[2583]: I0709 02:35:27.216085 2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-rwlzs" Jul 09 02:35:27.262744 ip-10-0-138-136 kubenswrapper[2583]: I0709 02:35:27.261495 2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-image-registry/image-registry-59569495f9-rmmlc"] Jul 09 02:35:27.278944 ip-10-0-138-136 kubenswrapper[2583]: W0709 02:35:27.278906 2583 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod9af4ab52_6748_4090_a7a0_8666391d9bfa.slice/crio-1b86d0c5bc103d727ff7526bb81d3e5bdc38d746f3435c3f9498240a581bfe3e WatchSource:0}: Error finding container 1b86d0c5bc103d727ff7526bb81d3e5bdc38d746f3435c3f9498240a581bfe3e: Status 404 returned error can't find the container with id 1b86d0c5bc103d727ff7526bb81d3e5bdc38d746f3435c3f9498240a581bfe3e Jul 09 02:35:27.286037 ip-10-0-138-136 kubenswrapper[2583]: I0709 02:35:27.285962 2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/cluster-monitoring-operator-64786d9cbb-grbsm"] Jul 09 02:35:27.376557 ip-10-0-138-136 kubenswrapper[2583]: I0709 02:35:27.376476 2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-cluster-samples-operator/cluster-samples-operator-56fcf86bf-78sff"] Jul 09 02:35:27.421673 ip-10-0-138-136 kubenswrapper[2583]: I0709 02:35:27.421644 2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/router-default-6575bfb5cc-2ttlz"] Jul 09 02:35:27.442797 ip-10-0-138-136 kubenswrapper[2583]: I0709 02:35:27.442090 2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-console/networking-console-plugin-6bffdf9778-j5xzm"] Jul 09 02:35:27.444461 ip-10-0-138-136 kubenswrapper[2583]: W0709 02:35:27.444234 2583 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podac99dbf2_7e27_437b_a386_89821f738a52.slice/crio-19f2afa0d65dadc89232310a946cd9be96d8b009cfbcd610c4b4a0751bd449e7 WatchSource:0}: Error finding container 19f2afa0d65dadc89232310a946cd9be96d8b009cfbcd610c4b4a0751bd449e7: Status 404 returned error can't find the container with id 19f2afa0d65dadc89232310a946cd9be96d8b009cfbcd610c4b4a0751bd449e7 Jul 09 02:35:27.459306 ip-10-0-138-136 kubenswrapper[2583]: I0709 02:35:27.459285 2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-dns/dns-default-rwlzs"] Jul 09 02:35:27.464087 ip-10-0-138-136 kubenswrapper[2583]: W0709 02:35:27.464066 2583 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podbd5345b9_08c2_4d1c_a033_a5c458c74773.slice/crio-8beb2401a2be12d0c449f364cc6da494e59423b91500ce463de44c80d49c69d9 WatchSource:0}: Error finding container 8beb2401a2be12d0c449f364cc6da494e59423b91500ce463de44c80d49c69d9: Status 404 returned error can't find the container with id 8beb2401a2be12d0c449f364cc6da494e59423b91500ce463de44c80d49c69d9 Jul 09 02:35:27.597075 ip-10-0-138-136 kubenswrapper[2583]: I0709 02:35:27.597044 2583 scope.go:117] "RemoveContainer" containerID="673e746a886dad207b61389fc42d0ea0e27f21da07bafd5dfe4aca21dfa72138" Jul 09 02:35:27.980291 ip-10-0-138-136 kubenswrapper[2583]: I0709 02:35:27.979938 2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-console/networking-console-plugin-6bffdf9778-j5xzm" event={"ID":"ac99dbf2-7e27-437b-a386-89821f738a52","Type":"ContainerStarted","Data":"19f2afa0d65dadc89232310a946cd9be96d8b009cfbcd610c4b4a0751bd449e7"} Jul 09 02:35:27.983771 ip-10-0-138-136 kubenswrapper[2583]: I0709 02:35:27.983005 2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/router-default-6575bfb5cc-2ttlz" event={"ID":"49f19d77-82e8-419b-a88b-09c9ee4354a8","Type":"ContainerStarted","Data":"1fe66357aa77a6ece873f482349fcf02aacf6420b716ec1e9ac3410e15ab6a73"} Jul 09 02:35:27.983771 ip-10-0-138-136 kubenswrapper[2583]: I0709 02:35:27.983060 2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/router-default-6575bfb5cc-2ttlz" event={"ID":"49f19d77-82e8-419b-a88b-09c9ee4354a8","Type":"ContainerStarted","Data":"60e2b71d8e2d6437593fd83fa3ad123af6114d75edd72a06556b1178a4cd056e"} Jul 09 02:35:27.985738 ip-10-0-138-136 kubenswrapper[2583]: I0709 02:35:27.985673 2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/cluster-monitoring-operator-64786d9cbb-grbsm" event={"ID":"a88b1ede-8749-4df5-88d8-494cfd9cfd83","Type":"ContainerStarted","Data":"a51b05b0dc2ebf6f9e3ee62273364876499120d4eb94eba2f1c3509736a2c7dc"} Jul 09 02:35:27.988161 ip-10-0-138-136 kubenswrapper[2583]: I0709 02:35:27.988126 2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-rwlzs" event={"ID":"bd5345b9-08c2-4d1c-a033-a5c458c74773","Type":"ContainerStarted","Data":"8beb2401a2be12d0c449f364cc6da494e59423b91500ce463de44c80d49c69d9"} Jul 09 02:35:27.990922 ip-10-0-138-136 kubenswrapper[2583]: I0709 02:35:27.990890 2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-59569495f9-rmmlc" event={"ID":"9af4ab52-6748-4090-a7a0-8666391d9bfa","Type":"ContainerStarted","Data":"1ebbc8fc474ad56365090b179eb5557e95a1bfbfb0651b7b90e97216f3cee3a4"} Jul 09 02:35:27.991040 ip-10-0-138-136 kubenswrapper[2583]: I0709 02:35:27.990932 2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-59569495f9-rmmlc" event={"ID":"9af4ab52-6748-4090-a7a0-8666391d9bfa","Type":"ContainerStarted","Data":"1b86d0c5bc103d727ff7526bb81d3e5bdc38d746f3435c3f9498240a581bfe3e"} Jul 09 02:35:27.991313 ip-10-0-138-136 kubenswrapper[2583]: I0709 02:35:27.991259 2583 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-image-registry/image-registry-59569495f9-rmmlc" Jul 09 02:35:27.994114 ip-10-0-138-136 kubenswrapper[2583]: I0709 02:35:27.994095 2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-samples-operator/cluster-samples-operator-56fcf86bf-78sff" event={"ID":"a177d680-6ea3-4b92-80e8-a2a081481d88","Type":"ContainerStarted","Data":"30eb757c9002caa8095912b971ee59bb89b9c8dab5e6b5c05222fb22c58b341b"} Jul 09 02:35:27.997344 ip-10-0-138-136 kubenswrapper[2583]: I0709 02:35:27.996853 2583 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-68b757fb67-xpjsj_188e21f3-2ce9-4012-ada2-a46c32d56729/console-operator/1.log" Jul 09 02:35:27.997344 ip-10-0-138-136 kubenswrapper[2583]: I0709 02:35:27.996895 2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console-operator/console-operator-68b757fb67-xpjsj" event={"ID":"188e21f3-2ce9-4012-ada2-a46c32d56729","Type":"ContainerStarted","Data":"d353ebea72b97f49dab9c3951b0948e44cffc5688e170af7b6afcc230693d75e"} Jul 09 02:35:27.997344 ip-10-0-138-136 kubenswrapper[2583]: I0709 02:35:27.997253 2583 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console-operator/console-operator-68b757fb67-xpjsj" Jul 09 02:35:28.002499 ip-10-0-138-136 kubenswrapper[2583]: I0709 02:35:28.002046 2583 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/router-default-6575bfb5cc-2ttlz" podStartSLOduration=70.002031321 podStartE2EDuration="1m10.002031321s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-09 02:34:18 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-09 02:35:28.000734837 +0000 UTC m=+73.933192327" watchObservedRunningTime="2026-07-09 02:35:28.002031321 +0000 UTC m=+73.934488808" Jul 09 02:35:28.016028 ip-10-0-138-136 kubenswrapper[2583]: I0709 02:35:28.015774 2583 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console-operator/console-operator-68b757fb67-xpjsj" podStartSLOduration=56.959611798 podStartE2EDuration="1m10.015758376s" totalImagesPullingTime="13.056146578s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-09 02:34:18 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-09 02:35:28.015256477 +0000 UTC m=+73.947713965" watchObservedRunningTime="2026-07-09 02:35:28.015758376 +0000 UTC m=+73.948215863" Jul 09 02:35:28.034237 ip-10-0-138-136 kubenswrapper[2583]: I0709 02:35:28.032460 2583 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-image-registry/image-registry-59569495f9-rmmlc" podStartSLOduration=73.032445275 podStartE2EDuration="1m13.032445275s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-09 02:34:15 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-09 02:35:28.031640127 +0000 UTC m=+73.964097658" watchObservedRunningTime="2026-07-09 02:35:28.032445275 +0000 UTC m=+73.964902762" Jul 09 02:35:28.180705 ip-10-0-138-136 kubenswrapper[2583]: I0709 02:35:28.180676 2583 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/router-default-6575bfb5cc-2ttlz" Jul 09 02:35:28.184153 ip-10-0-138-136 kubenswrapper[2583]: I0709 02:35:28.183964 2583 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/router-default-6575bfb5cc-2ttlz" Jul 09 02:35:28.566081 ip-10-0-138-136 kubenswrapper[2583]: I0709 02:35:28.565869 2583 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console-operator/console-operator-68b757fb67-xpjsj" Jul 09 02:35:29.005501 ip-10-0-138-136 kubenswrapper[2583]: I0709 02:35:29.005394 2583 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/router-default-6575bfb5cc-2ttlz" Jul 09 02:35:29.007923 ip-10-0-138-136 kubenswrapper[2583]: I0709 02:35:29.006761 2583 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/router-default-6575bfb5cc-2ttlz" Jul 09 02:35:33.029436 ip-10-0-138-136 kubenswrapper[2583]: I0709 02:35:33.029394 2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-rwlzs" event={"ID":"bd5345b9-08c2-4d1c-a033-a5c458c74773","Type":"ContainerStarted","Data":"f9551dc746e103e0d68a4729fb243a1518f6ef71f2f8ae9bb8ca16330e892aba"} Jul 09 02:35:33.034778 ip-10-0-138-136 kubenswrapper[2583]: I0709 02:35:33.034681 2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-samples-operator/cluster-samples-operator-56fcf86bf-78sff" event={"ID":"a177d680-6ea3-4b92-80e8-a2a081481d88","Type":"ContainerStarted","Data":"b55246e85d9e1c2cdc8c65a711644926d2a130f9227cc136d7c5ea5788a8a97f"} Jul 09 02:35:33.037253 ip-10-0-138-136 kubenswrapper[2583]: I0709 02:35:33.037218 2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-x4vq7" event={"ID":"d2160d90-2c9d-4bbb-a8ca-a989931a42e3","Type":"ContainerStarted","Data":"70d6951ba034830203d0b13a40765ed416d009b00b445cd0c5dfa4ef7668aa72"} Jul 09 02:35:33.039026 ip-10-0-138-136 kubenswrapper[2583]: I0709 02:35:33.039001 2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-console/networking-console-plugin-6bffdf9778-j5xzm" event={"ID":"ac99dbf2-7e27-437b-a386-89821f738a52","Type":"ContainerStarted","Data":"56828ed0a43760ecd96250c7b268a3972c696a8cd1193cc31e15f6fa900a143e"} Jul 09 02:35:33.045317 ip-10-0-138-136 kubenswrapper[2583]: I0709 02:35:33.045244 2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/cluster-monitoring-operator-64786d9cbb-grbsm" event={"ID":"a88b1ede-8749-4df5-88d8-494cfd9cfd83","Type":"ContainerStarted","Data":"0980f9bfdce552e3163b6ca595cb29c4e81f5d910d6f2052b0a37a524b741cc1"} Jul 09 02:35:33.055920 ip-10-0-138-136 kubenswrapper[2583]: I0709 02:35:33.055879 2583 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-console/networking-console-plugin-6bffdf9778-j5xzm" podStartSLOduration=39.661411385 podStartE2EDuration="45.055865763s" totalImagesPullingTime="5.394454378s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-09 02:34:48 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-09 02:35:33.054042299 +0000 UTC m=+78.986499791" watchObservedRunningTime="2026-07-09 02:35:33.055865763 +0000 UTC m=+78.988323227" Jul 09 02:35:33.069907 ip-10-0-138-136 kubenswrapper[2583]: I0709 02:35:33.069566 2583 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/cluster-monitoring-operator-64786d9cbb-grbsm" podStartSLOduration=69.539828665 podStartE2EDuration="1m15.069548252s" totalImagesPullingTime="5.529719587s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-09 02:34:18 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-09 02:35:33.06851565 +0000 UTC m=+79.000973148" watchObservedRunningTime="2026-07-09 02:35:33.069548252 +0000 UTC m=+79.002005739" Jul 09 02:35:34.050456 ip-10-0-138-136 kubenswrapper[2583]: I0709 02:35:34.050424 2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-rwlzs" event={"ID":"bd5345b9-08c2-4d1c-a033-a5c458c74773","Type":"ContainerStarted","Data":"7d042856ece04efd52ca2a38aef1cafa401f1f5c34d3fd52d40cae3d76733b9e"} Jul 09 02:35:34.050840 ip-10-0-138-136 kubenswrapper[2583]: I0709 02:35:34.050546 2583 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-dns/dns-default-rwlzs" Jul 09 02:35:34.056628 ip-10-0-138-136 kubenswrapper[2583]: I0709 02:35:34.056584 2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-samples-operator/cluster-samples-operator-56fcf86bf-78sff" event={"ID":"a177d680-6ea3-4b92-80e8-a2a081481d88","Type":"ContainerStarted","Data":"59fb61eae00e5bf9a5e20cca83c45d9b7316017de189181a6889eadfd888cb86"} Jul 09 02:35:34.058424 ip-10-0-138-136 kubenswrapper[2583]: I0709 02:35:34.058396 2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-x4vq7" event={"ID":"d2160d90-2c9d-4bbb-a8ca-a989931a42e3","Type":"ContainerStarted","Data":"14c857776ac723fd1aae5cd57677d040bf3d9ee187724de8aac82a340f7fae40"} Jul 09 02:35:34.067550 ip-10-0-138-136 kubenswrapper[2583]: I0709 02:35:34.067512 2583 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-dns/dns-default-rwlzs" podStartSLOduration=34.697088988 podStartE2EDuration="40.067499458s" totalImagesPullingTime="5.37041047s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-09 02:34:54 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-09 02:35:34.065651425 +0000 UTC m=+79.998108911" watchObservedRunningTime="2026-07-09 02:35:34.067499458 +0000 UTC m=+79.999956943" Jul 09 02:35:34.081225 ip-10-0-138-136 kubenswrapper[2583]: I0709 02:35:34.081187 2583 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-samples-operator/cluster-samples-operator-56fcf86bf-78sff" podStartSLOduration=70.695941507 podStartE2EDuration="1m16.081174885s" totalImagesPullingTime="5.385233378s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-09 02:34:18 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-09 02:35:34.079804725 +0000 UTC m=+80.012262212" watchObservedRunningTime="2026-07-09 02:35:34.081174885 +0000 UTC m=+80.013632365" Jul 09 02:35:36.883640 ip-10-0-138-136 kubenswrapper[2583]: I0709 02:35:36.883605 2583 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console/downloads-685bfb5f64-5dwm9"] Jul 09 02:35:36.898325 ip-10-0-138-136 kubenswrapper[2583]: I0709 02:35:36.898299 2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/downloads-685bfb5f64-5dwm9" Jul 09 02:35:36.900759 ip-10-0-138-136 kubenswrapper[2583]: I0709 02:35:36.900430 2583 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"openshift-service-ca.crt\"" Jul 09 02:35:36.900759 ip-10-0-138-136 kubenswrapper[2583]: I0709 02:35:36.900525 2583 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"kube-root-ca.crt\"" Jul 09 02:35:36.900759 ip-10-0-138-136 kubenswrapper[2583]: I0709 02:35:36.900617 2583 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"default-dockercfg-q6sp7\"" Jul 09 02:35:36.900936 ip-10-0-138-136 kubenswrapper[2583]: I0709 02:35:36.900820 2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/downloads-685bfb5f64-5dwm9"] Jul 09 02:35:36.919913 ip-10-0-138-136 kubenswrapper[2583]: I0709 02:35:36.919894 2583 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console/console-685c668687-g6tbb"] Jul 09 02:35:36.943821 ip-10-0-138-136 kubenswrapper[2583]: I0709 02:35:36.943798 2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-685c668687-g6tbb" Jul 09 02:35:36.946936 ip-10-0-138-136 kubenswrapper[2583]: I0709 02:35:36.946915 2583 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-dockercfg-qtkvb\"" Jul 09 02:35:36.947044 ip-10-0-138-136 kubenswrapper[2583]: I0709 02:35:36.946966 2583 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-serving-cert\"" Jul 09 02:35:36.947161 ip-10-0-138-136 kubenswrapper[2583]: I0709 02:35:36.947144 2583 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"service-ca\"" Jul 09 02:35:36.947230 ip-10-0-138-136 kubenswrapper[2583]: I0709 02:35:36.947216 2583 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"console-config\"" Jul 09 02:35:36.947266 ip-10-0-138-136 kubenswrapper[2583]: I0709 02:35:36.947221 2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-685c668687-g6tbb"] Jul 09 02:35:36.949403 ip-10-0-138-136 kubenswrapper[2583]: I0709 02:35:36.949383 2583 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"oauth-serving-cert\"" Jul 09 02:35:36.949496 ip-10-0-138-136 kubenswrapper[2583]: I0709 02:35:36.949465 2583 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-oauth-config\"" Jul 09 02:35:36.990332 ip-10-0-138-136 kubenswrapper[2583]: I0709 02:35:36.990306 2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-krkqb\" (UniqueName: \"kubernetes.io/projected/5b71dc06-285e-4368-a793-2615514cfc97-kube-api-access-krkqb\") pod \"console-685c668687-g6tbb\" (UID: \"5b71dc06-285e-4368-a793-2615514cfc97\") " pod="openshift-console/console-685c668687-g6tbb" Jul 09 02:35:36.990427 ip-10-0-138-136 kubenswrapper[2583]: I0709 02:35:36.990349 2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/5b71dc06-285e-4368-a793-2615514cfc97-console-oauth-config\") pod \"console-685c668687-g6tbb\" (UID: \"5b71dc06-285e-4368-a793-2615514cfc97\") " pod="openshift-console/console-685c668687-g6tbb" Jul 09 02:35:36.990427 ip-10-0-138-136 kubenswrapper[2583]: I0709 02:35:36.990375 2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/5b71dc06-285e-4368-a793-2615514cfc97-service-ca\") pod \"console-685c668687-g6tbb\" (UID: \"5b71dc06-285e-4368-a793-2615514cfc97\") " pod="openshift-console/console-685c668687-g6tbb" Jul 09 02:35:36.990538 ip-10-0-138-136 kubenswrapper[2583]: I0709 02:35:36.990483 2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/5b71dc06-285e-4368-a793-2615514cfc97-console-config\") pod \"console-685c668687-g6tbb\" (UID: \"5b71dc06-285e-4368-a793-2615514cfc97\") " pod="openshift-console/console-685c668687-g6tbb" Jul 09 02:35:36.990538 ip-10-0-138-136 kubenswrapper[2583]: I0709 02:35:36.990522 2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/5b71dc06-285e-4368-a793-2615514cfc97-console-serving-cert\") pod \"console-685c668687-g6tbb\" (UID: \"5b71dc06-285e-4368-a793-2615514cfc97\") " pod="openshift-console/console-685c668687-g6tbb" Jul 09 02:35:36.990644 ip-10-0-138-136 kubenswrapper[2583]: I0709 02:35:36.990590 2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-np84r\" (UniqueName: \"kubernetes.io/projected/4952f4bb-5769-47fd-8c16-5b57eefd01cd-kube-api-access-np84r\") pod \"downloads-685bfb5f64-5dwm9\" (UID: \"4952f4bb-5769-47fd-8c16-5b57eefd01cd\") " pod="openshift-console/downloads-685bfb5f64-5dwm9" Jul 09 02:35:36.990644 ip-10-0-138-136 kubenswrapper[2583]: I0709 02:35:36.990623 2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/5b71dc06-285e-4368-a793-2615514cfc97-oauth-serving-cert\") pod \"console-685c668687-g6tbb\" (UID: \"5b71dc06-285e-4368-a793-2615514cfc97\") " pod="openshift-console/console-685c668687-g6tbb" Jul 09 02:35:36.997678 ip-10-0-138-136 kubenswrapper[2583]: I0709 02:35:36.997658 2583 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/prometheus-operator-admission-webhook-d559d66d5-kzbtm"] Jul 09 02:35:37.023967 ip-10-0-138-136 kubenswrapper[2583]: I0709 02:35:37.023948 2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-operator-admission-webhook-d559d66d5-kzbtm"] Jul 09 02:35:37.024068 ip-10-0-138-136 kubenswrapper[2583]: I0709 02:35:37.023986 2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-operator-admission-webhook-d559d66d5-kzbtm" Jul 09 02:35:37.026015 ip-10-0-138-136 kubenswrapper[2583]: I0709 02:35:37.025995 2583 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-operator-admission-webhook-tls\"" Jul 09 02:35:37.026110 ip-10-0-138-136 kubenswrapper[2583]: I0709 02:35:37.026022 2583 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-operator-admission-webhook-dockercfg-whbmc\"" Jul 09 02:35:37.073319 ip-10-0-138-136 kubenswrapper[2583]: I0709 02:35:37.073293 2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-x4vq7" event={"ID":"d2160d90-2c9d-4bbb-a8ca-a989931a42e3","Type":"ContainerStarted","Data":"a40d82adb5641396421d39d5b05fc9b33b8c540ffba346ddc473b3cde235d423"} Jul 09 02:35:37.091265 ip-10-0-138-136 kubenswrapper[2583]: I0709 02:35:37.091239 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/5b71dc06-285e-4368-a793-2615514cfc97-console-oauth-config\") pod \"console-685c668687-g6tbb\" (UID: \"5b71dc06-285e-4368-a793-2615514cfc97\") " pod="openshift-console/console-685c668687-g6tbb" Jul 09 02:35:37.091377 ip-10-0-138-136 kubenswrapper[2583]: I0709 02:35:37.091270 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/5b71dc06-285e-4368-a793-2615514cfc97-service-ca\") pod \"console-685c668687-g6tbb\" (UID: \"5b71dc06-285e-4368-a793-2615514cfc97\") " pod="openshift-console/console-685c668687-g6tbb" Jul 09 02:35:37.091377 ip-10-0-138-136 kubenswrapper[2583]: I0709 02:35:37.091316 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/5b71dc06-285e-4368-a793-2615514cfc97-console-config\") pod \"console-685c668687-g6tbb\" (UID: \"5b71dc06-285e-4368-a793-2615514cfc97\") " pod="openshift-console/console-685c668687-g6tbb" Jul 09 02:35:37.091377 ip-10-0-138-136 kubenswrapper[2583]: I0709 02:35:37.091343 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/5b71dc06-285e-4368-a793-2615514cfc97-console-serving-cert\") pod \"console-685c668687-g6tbb\" (UID: \"5b71dc06-285e-4368-a793-2615514cfc97\") " pod="openshift-console/console-685c668687-g6tbb" Jul 09 02:35:37.091529 ip-10-0-138-136 kubenswrapper[2583]: I0709 02:35:37.091404 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-np84r\" (UniqueName: \"kubernetes.io/projected/4952f4bb-5769-47fd-8c16-5b57eefd01cd-kube-api-access-np84r\") pod \"downloads-685bfb5f64-5dwm9\" (UID: \"4952f4bb-5769-47fd-8c16-5b57eefd01cd\") " pod="openshift-console/downloads-685bfb5f64-5dwm9" Jul 09 02:35:37.091529 ip-10-0-138-136 kubenswrapper[2583]: I0709 02:35:37.091440 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/5b71dc06-285e-4368-a793-2615514cfc97-oauth-serving-cert\") pod \"console-685c668687-g6tbb\" (UID: \"5b71dc06-285e-4368-a793-2615514cfc97\") " pod="openshift-console/console-685c668687-g6tbb" Jul 09 02:35:37.091529 ip-10-0-138-136 kubenswrapper[2583]: I0709 02:35:37.091519 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-krkqb\" (UniqueName: \"kubernetes.io/projected/5b71dc06-285e-4368-a793-2615514cfc97-kube-api-access-krkqb\") pod \"console-685c668687-g6tbb\" (UID: \"5b71dc06-285e-4368-a793-2615514cfc97\") " pod="openshift-console/console-685c668687-g6tbb" Jul 09 02:35:37.091677 ip-10-0-138-136 kubenswrapper[2583]: I0709 02:35:37.091557 2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certificates\" (UniqueName: \"kubernetes.io/secret/489f4f32-dd84-4500-a8d1-792d96423821-tls-certificates\") pod \"prometheus-operator-admission-webhook-d559d66d5-kzbtm\" (UID: \"489f4f32-dd84-4500-a8d1-792d96423821\") " pod="openshift-monitoring/prometheus-operator-admission-webhook-d559d66d5-kzbtm" Jul 09 02:35:37.092171 ip-10-0-138-136 kubenswrapper[2583]: I0709 02:35:37.092142 2583 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/5b71dc06-285e-4368-a793-2615514cfc97-service-ca\") pod \"console-685c668687-g6tbb\" (UID: \"5b71dc06-285e-4368-a793-2615514cfc97\") " pod="openshift-console/console-685c668687-g6tbb" Jul 09 02:35:37.092262 ip-10-0-138-136 kubenswrapper[2583]: I0709 02:35:37.092238 2583 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/5b71dc06-285e-4368-a793-2615514cfc97-console-config\") pod \"console-685c668687-g6tbb\" (UID: \"5b71dc06-285e-4368-a793-2615514cfc97\") " pod="openshift-console/console-685c668687-g6tbb" Jul 09 02:35:37.092464 ip-10-0-138-136 kubenswrapper[2583]: I0709 02:35:37.092443 2583 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/5b71dc06-285e-4368-a793-2615514cfc97-oauth-serving-cert\") pod \"console-685c668687-g6tbb\" (UID: \"5b71dc06-285e-4368-a793-2615514cfc97\") " pod="openshift-console/console-685c668687-g6tbb" Jul 09 02:35:37.093660 ip-10-0-138-136 kubenswrapper[2583]: I0709 02:35:37.093641 2583 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/5b71dc06-285e-4368-a793-2615514cfc97-console-oauth-config\") pod \"console-685c668687-g6tbb\" (UID: \"5b71dc06-285e-4368-a793-2615514cfc97\") " pod="openshift-console/console-685c668687-g6tbb" Jul 09 02:35:37.093799 ip-10-0-138-136 kubenswrapper[2583]: I0709 02:35:37.093784 2583 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/5b71dc06-285e-4368-a793-2615514cfc97-console-serving-cert\") pod \"console-685c668687-g6tbb\" (UID: \"5b71dc06-285e-4368-a793-2615514cfc97\") " pod="openshift-console/console-685c668687-g6tbb" Jul 09 02:35:37.095276 ip-10-0-138-136 kubenswrapper[2583]: I0709 02:35:37.095230 2583 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-insights/insights-runtime-extractor-x4vq7" podStartSLOduration=17.661135197 podStartE2EDuration="27.095212736s" totalImagesPullingTime="9.434077539s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-09 02:35:10 +0000 UTC" imagePullSessionsCount=3 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-09 02:35:37.094562408 +0000 UTC m=+83.027019894" watchObservedRunningTime="2026-07-09 02:35:37.095212736 +0000 UTC m=+83.027670224" Jul 09 02:35:37.106700 ip-10-0-138-136 kubenswrapper[2583]: I0709 02:35:37.106676 2583 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-np84r\" (UniqueName: \"kubernetes.io/projected/4952f4bb-5769-47fd-8c16-5b57eefd01cd-kube-api-access-np84r\") pod \"downloads-685bfb5f64-5dwm9\" (UID: \"4952f4bb-5769-47fd-8c16-5b57eefd01cd\") " pod="openshift-console/downloads-685bfb5f64-5dwm9" Jul 09 02:35:37.111503 ip-10-0-138-136 kubenswrapper[2583]: I0709 02:35:37.111454 2583 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-krkqb\" (UniqueName: \"kubernetes.io/projected/5b71dc06-285e-4368-a793-2615514cfc97-kube-api-access-krkqb\") pod \"console-685c668687-g6tbb\" (UID: \"5b71dc06-285e-4368-a793-2615514cfc97\") " pod="openshift-console/console-685c668687-g6tbb" Jul 09 02:35:37.192154 ip-10-0-138-136 kubenswrapper[2583]: I0709 02:35:37.192069 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certificates\" (UniqueName: \"kubernetes.io/secret/489f4f32-dd84-4500-a8d1-792d96423821-tls-certificates\") pod \"prometheus-operator-admission-webhook-d559d66d5-kzbtm\" (UID: \"489f4f32-dd84-4500-a8d1-792d96423821\") " pod="openshift-monitoring/prometheus-operator-admission-webhook-d559d66d5-kzbtm" Jul 09 02:35:37.194148 ip-10-0-138-136 kubenswrapper[2583]: I0709 02:35:37.194130 2583 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-certificates\" (UniqueName: \"kubernetes.io/secret/489f4f32-dd84-4500-a8d1-792d96423821-tls-certificates\") pod \"prometheus-operator-admission-webhook-d559d66d5-kzbtm\" (UID: \"489f4f32-dd84-4500-a8d1-792d96423821\") " pod="openshift-monitoring/prometheus-operator-admission-webhook-d559d66d5-kzbtm" Jul 09 02:35:37.210030 ip-10-0-138-136 kubenswrapper[2583]: I0709 02:35:37.210007 2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/downloads-685bfb5f64-5dwm9" Jul 09 02:35:37.253699 ip-10-0-138-136 kubenswrapper[2583]: I0709 02:35:37.253673 2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-685c668687-g6tbb" Jul 09 02:35:37.333173 ip-10-0-138-136 kubenswrapper[2583]: I0709 02:35:37.333137 2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-operator-admission-webhook-d559d66d5-kzbtm" Jul 09 02:35:37.378946 ip-10-0-138-136 kubenswrapper[2583]: I0709 02:35:37.378916 2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/downloads-685bfb5f64-5dwm9"] Jul 09 02:35:37.385209 ip-10-0-138-136 kubenswrapper[2583]: W0709 02:35:37.385179 2583 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod4952f4bb_5769_47fd_8c16_5b57eefd01cd.slice/crio-508353a1c33311beb51968d7c6f7ac1867ab3a9aead55da9ccb024d60687e0a8 WatchSource:0}: Error finding container 508353a1c33311beb51968d7c6f7ac1867ab3a9aead55da9ccb024d60687e0a8: Status 404 returned error can't find the container with id 508353a1c33311beb51968d7c6f7ac1867ab3a9aead55da9ccb024d60687e0a8 Jul 09 02:35:37.427102 ip-10-0-138-136 kubenswrapper[2583]: I0709 02:35:37.427066 2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-685c668687-g6tbb"] Jul 09 02:35:37.430023 ip-10-0-138-136 kubenswrapper[2583]: W0709 02:35:37.429996 2583 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod5b71dc06_285e_4368_a793_2615514cfc97.slice/crio-eb2cd0ac5ae2b7ec67af106805cb6bc5452ce77b846c9c2ce166aa940a401b6c WatchSource:0}: Error finding container eb2cd0ac5ae2b7ec67af106805cb6bc5452ce77b846c9c2ce166aa940a401b6c: Status 404 returned error can't find the container with id eb2cd0ac5ae2b7ec67af106805cb6bc5452ce77b846c9c2ce166aa940a401b6c Jul 09 02:35:37.496245 ip-10-0-138-136 kubenswrapper[2583]: I0709 02:35:37.496218 2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-operator-admission-webhook-d559d66d5-kzbtm"] Jul 09 02:35:37.498395 ip-10-0-138-136 kubenswrapper[2583]: W0709 02:35:37.498369 2583 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod489f4f32_dd84_4500_a8d1_792d96423821.slice/crio-fcfd333673c8783a11f2ea5828b828a47091503ca44fbb18a2707261d860e367 WatchSource:0}: Error finding container fcfd333673c8783a11f2ea5828b828a47091503ca44fbb18a2707261d860e367: Status 404 returned error can't find the container with id fcfd333673c8783a11f2ea5828b828a47091503ca44fbb18a2707261d860e367 Jul 09 02:35:38.079490 ip-10-0-138-136 kubenswrapper[2583]: I0709 02:35:38.079452 2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-operator-admission-webhook-d559d66d5-kzbtm" event={"ID":"489f4f32-dd84-4500-a8d1-792d96423821","Type":"ContainerStarted","Data":"fcfd333673c8783a11f2ea5828b828a47091503ca44fbb18a2707261d860e367"} Jul 09 02:35:38.080987 ip-10-0-138-136 kubenswrapper[2583]: I0709 02:35:38.080962 2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-685c668687-g6tbb" event={"ID":"5b71dc06-285e-4368-a793-2615514cfc97","Type":"ContainerStarted","Data":"eb2cd0ac5ae2b7ec67af106805cb6bc5452ce77b846c9c2ce166aa940a401b6c"} Jul 09 02:35:38.082312 ip-10-0-138-136 kubenswrapper[2583]: I0709 02:35:38.082283 2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/downloads-685bfb5f64-5dwm9" event={"ID":"4952f4bb-5769-47fd-8c16-5b57eefd01cd","Type":"ContainerStarted","Data":"508353a1c33311beb51968d7c6f7ac1867ab3a9aead55da9ccb024d60687e0a8"} Jul 09 02:35:41.098072 ip-10-0-138-136 kubenswrapper[2583]: I0709 02:35:41.098004 2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-operator-admission-webhook-d559d66d5-kzbtm" event={"ID":"489f4f32-dd84-4500-a8d1-792d96423821","Type":"ContainerStarted","Data":"2fd5056a6365ec0e796265d2926feec269cda4e71392e4d72afbf4df32ca970b"} Jul 09 02:35:41.098448 ip-10-0-138-136 kubenswrapper[2583]: I0709 02:35:41.098092 2583 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-monitoring/prometheus-operator-admission-webhook-d559d66d5-kzbtm" Jul 09 02:35:41.102819 ip-10-0-138-136 kubenswrapper[2583]: I0709 02:35:41.102798 2583 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-monitoring/prometheus-operator-admission-webhook-d559d66d5-kzbtm" Jul 09 02:35:41.113030 ip-10-0-138-136 kubenswrapper[2583]: I0709 02:35:41.112988 2583 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/prometheus-operator-admission-webhook-d559d66d5-kzbtm" podStartSLOduration=3.141998459 podStartE2EDuration="5.11297447s" totalImagesPullingTime="1.970976011s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-09 02:35:36 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-09 02:35:41.11176764 +0000 UTC m=+87.044225126" watchObservedRunningTime="2026-07-09 02:35:41.11297447 +0000 UTC m=+87.045431955" Jul 09 02:35:41.489782 ip-10-0-138-136 kubenswrapper[2583]: I0709 02:35:41.489753 2583 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/prometheus-operator-567f7b8b7c-bqgxx"] Jul 09 02:35:41.500824 ip-10-0-138-136 kubenswrapper[2583]: I0709 02:35:41.500801 2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-operator-567f7b8b7c-bqgxx" Jul 09 02:35:41.503455 ip-10-0-138-136 kubenswrapper[2583]: I0709 02:35:41.503258 2583 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-operator-tls\"" Jul 09 02:35:41.503455 ip-10-0-138-136 kubenswrapper[2583]: I0709 02:35:41.503322 2583 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-operator-kube-rbac-proxy-config\"" Jul 09 02:35:41.503455 ip-10-0-138-136 kubenswrapper[2583]: I0709 02:35:41.503340 2583 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-operator-dockercfg-7bj9l\"" Jul 09 02:35:41.503455 ip-10-0-138-136 kubenswrapper[2583]: I0709 02:35:41.503378 2583 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"metrics-client-ca\"" Jul 09 02:35:41.503959 ip-10-0-138-136 kubenswrapper[2583]: I0709 02:35:41.503938 2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-operator-567f7b8b7c-bqgxx"] Jul 09 02:35:41.528733 ip-10-0-138-136 kubenswrapper[2583]: I0709 02:35:41.528077 2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/869740c4-79d1-4b1b-a988-c5df63339dc7-metrics-client-ca\") pod \"prometheus-operator-567f7b8b7c-bqgxx\" (UID: \"869740c4-79d1-4b1b-a988-c5df63339dc7\") " pod="openshift-monitoring/prometheus-operator-567f7b8b7c-bqgxx" Jul 09 02:35:41.528733 ip-10-0-138-136 kubenswrapper[2583]: I0709 02:35:41.528125 2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-operator-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/869740c4-79d1-4b1b-a988-c5df63339dc7-prometheus-operator-kube-rbac-proxy-config\") pod \"prometheus-operator-567f7b8b7c-bqgxx\" (UID: \"869740c4-79d1-4b1b-a988-c5df63339dc7\") " pod="openshift-monitoring/prometheus-operator-567f7b8b7c-bqgxx" Jul 09 02:35:41.528733 ip-10-0-138-136 kubenswrapper[2583]: I0709 02:35:41.528156 2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-operator-tls\" (UniqueName: \"kubernetes.io/secret/869740c4-79d1-4b1b-a988-c5df63339dc7-prometheus-operator-tls\") pod \"prometheus-operator-567f7b8b7c-bqgxx\" (UID: \"869740c4-79d1-4b1b-a988-c5df63339dc7\") " pod="openshift-monitoring/prometheus-operator-567f7b8b7c-bqgxx" Jul 09 02:35:41.528733 ip-10-0-138-136 kubenswrapper[2583]: I0709 02:35:41.528205 2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-cv24t\" (UniqueName: \"kubernetes.io/projected/869740c4-79d1-4b1b-a988-c5df63339dc7-kube-api-access-cv24t\") pod \"prometheus-operator-567f7b8b7c-bqgxx\" (UID: \"869740c4-79d1-4b1b-a988-c5df63339dc7\") " pod="openshift-monitoring/prometheus-operator-567f7b8b7c-bqgxx" Jul 09 02:35:41.629690 ip-10-0-138-136 kubenswrapper[2583]: I0709 02:35:41.629660 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/869740c4-79d1-4b1b-a988-c5df63339dc7-metrics-client-ca\") pod \"prometheus-operator-567f7b8b7c-bqgxx\" (UID: \"869740c4-79d1-4b1b-a988-c5df63339dc7\") " pod="openshift-monitoring/prometheus-operator-567f7b8b7c-bqgxx" Jul 09 02:35:41.629819 ip-10-0-138-136 kubenswrapper[2583]: I0709 02:35:41.629701 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-operator-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/869740c4-79d1-4b1b-a988-c5df63339dc7-prometheus-operator-kube-rbac-proxy-config\") pod \"prometheus-operator-567f7b8b7c-bqgxx\" (UID: \"869740c4-79d1-4b1b-a988-c5df63339dc7\") " pod="openshift-monitoring/prometheus-operator-567f7b8b7c-bqgxx" Jul 09 02:35:41.629819 ip-10-0-138-136 kubenswrapper[2583]: I0709 02:35:41.629751 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-operator-tls\" (UniqueName: \"kubernetes.io/secret/869740c4-79d1-4b1b-a988-c5df63339dc7-prometheus-operator-tls\") pod \"prometheus-operator-567f7b8b7c-bqgxx\" (UID: \"869740c4-79d1-4b1b-a988-c5df63339dc7\") " pod="openshift-monitoring/prometheus-operator-567f7b8b7c-bqgxx" Jul 09 02:35:41.629819 ip-10-0-138-136 kubenswrapper[2583]: I0709 02:35:41.629789 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-cv24t\" (UniqueName: \"kubernetes.io/projected/869740c4-79d1-4b1b-a988-c5df63339dc7-kube-api-access-cv24t\") pod \"prometheus-operator-567f7b8b7c-bqgxx\" (UID: \"869740c4-79d1-4b1b-a988-c5df63339dc7\") " pod="openshift-monitoring/prometheus-operator-567f7b8b7c-bqgxx" Jul 09 02:35:41.629983 ip-10-0-138-136 kubenswrapper[2583]: E0709 02:35:41.629899 2583 secret.go:189] Couldn't get secret openshift-monitoring/prometheus-operator-tls: secret "prometheus-operator-tls" not found Jul 09 02:35:41.629983 ip-10-0-138-136 kubenswrapper[2583]: E0709 02:35:41.629973 2583 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/869740c4-79d1-4b1b-a988-c5df63339dc7-prometheus-operator-tls podName:869740c4-79d1-4b1b-a988-c5df63339dc7 nodeName:}" failed. No retries permitted until 2026-07-09 02:35:42.129952744 +0000 UTC m=+88.062410222 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "prometheus-operator-tls" (UniqueName: "kubernetes.io/secret/869740c4-79d1-4b1b-a988-c5df63339dc7-prometheus-operator-tls") pod "prometheus-operator-567f7b8b7c-bqgxx" (UID: "869740c4-79d1-4b1b-a988-c5df63339dc7") : secret "prometheus-operator-tls" not found Jul 09 02:35:41.630387 ip-10-0-138-136 kubenswrapper[2583]: I0709 02:35:41.630369 2583 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/869740c4-79d1-4b1b-a988-c5df63339dc7-metrics-client-ca\") pod \"prometheus-operator-567f7b8b7c-bqgxx\" (UID: \"869740c4-79d1-4b1b-a988-c5df63339dc7\") " pod="openshift-monitoring/prometheus-operator-567f7b8b7c-bqgxx" Jul 09 02:35:41.632386 ip-10-0-138-136 kubenswrapper[2583]: I0709 02:35:41.632363 2583 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"prometheus-operator-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/869740c4-79d1-4b1b-a988-c5df63339dc7-prometheus-operator-kube-rbac-proxy-config\") pod \"prometheus-operator-567f7b8b7c-bqgxx\" (UID: \"869740c4-79d1-4b1b-a988-c5df63339dc7\") " pod="openshift-monitoring/prometheus-operator-567f7b8b7c-bqgxx" Jul 09 02:35:41.638643 ip-10-0-138-136 kubenswrapper[2583]: I0709 02:35:41.638601 2583 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-cv24t\" (UniqueName: \"kubernetes.io/projected/869740c4-79d1-4b1b-a988-c5df63339dc7-kube-api-access-cv24t\") pod \"prometheus-operator-567f7b8b7c-bqgxx\" (UID: \"869740c4-79d1-4b1b-a988-c5df63339dc7\") " pod="openshift-monitoring/prometheus-operator-567f7b8b7c-bqgxx" Jul 09 02:35:42.066156 ip-10-0-138-136 kubenswrapper[2583]: I0709 02:35:42.066109 2583 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console/console-848fbd7f6b-6sxwq"] Jul 09 02:35:42.089616 ip-10-0-138-136 kubenswrapper[2583]: I0709 02:35:42.089593 2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-848fbd7f6b-6sxwq"] Jul 09 02:35:42.089767 ip-10-0-138-136 kubenswrapper[2583]: I0709 02:35:42.089679 2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-848fbd7f6b-6sxwq" Jul 09 02:35:42.096433 ip-10-0-138-136 kubenswrapper[2583]: I0709 02:35:42.096410 2583 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"trusted-ca-bundle\"" Jul 09 02:35:42.102850 ip-10-0-138-136 kubenswrapper[2583]: I0709 02:35:42.102828 2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-685c668687-g6tbb" event={"ID":"5b71dc06-285e-4368-a793-2615514cfc97","Type":"ContainerStarted","Data":"c67a2edca5d82ec1fab114e7ada2d87f1b451ec88bdc39fbdf63b171739127b5"} Jul 09 02:35:42.122792 ip-10-0-138-136 kubenswrapper[2583]: I0709 02:35:42.122754 2583 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console/console-685c668687-g6tbb" podStartSLOduration=2.37249638 podStartE2EDuration="6.122741126s" totalImagesPullingTime="3.750244746s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-09 02:35:36 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-09 02:35:42.121831706 +0000 UTC m=+88.054289192" watchObservedRunningTime="2026-07-09 02:35:42.122741126 +0000 UTC m=+88.055198611" Jul 09 02:35:42.133327 ip-10-0-138-136 kubenswrapper[2583]: I0709 02:35:42.133298 2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/cdbc01a1-9cc0-4bb8-bd92-469c266bf8ff-console-config\") pod \"console-848fbd7f6b-6sxwq\" (UID: \"cdbc01a1-9cc0-4bb8-bd92-469c266bf8ff\") " pod="openshift-console/console-848fbd7f6b-6sxwq" Jul 09 02:35:42.133437 ip-10-0-138-136 kubenswrapper[2583]: I0709 02:35:42.133334 2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/cdbc01a1-9cc0-4bb8-bd92-469c266bf8ff-service-ca\") pod \"console-848fbd7f6b-6sxwq\" (UID: \"cdbc01a1-9cc0-4bb8-bd92-469c266bf8ff\") " pod="openshift-console/console-848fbd7f6b-6sxwq" Jul 09 02:35:42.133564 ip-10-0-138-136 kubenswrapper[2583]: I0709 02:35:42.133542 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-operator-tls\" (UniqueName: \"kubernetes.io/secret/869740c4-79d1-4b1b-a988-c5df63339dc7-prometheus-operator-tls\") pod \"prometheus-operator-567f7b8b7c-bqgxx\" (UID: \"869740c4-79d1-4b1b-a988-c5df63339dc7\") " pod="openshift-monitoring/prometheus-operator-567f7b8b7c-bqgxx" Jul 09 02:35:42.133623 ip-10-0-138-136 kubenswrapper[2583]: I0709 02:35:42.133596 2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/cdbc01a1-9cc0-4bb8-bd92-469c266bf8ff-trusted-ca-bundle\") pod \"console-848fbd7f6b-6sxwq\" (UID: \"cdbc01a1-9cc0-4bb8-bd92-469c266bf8ff\") " pod="openshift-console/console-848fbd7f6b-6sxwq" Jul 09 02:35:42.133824 ip-10-0-138-136 kubenswrapper[2583]: I0709 02:35:42.133707 2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-qhb65\" (UniqueName: \"kubernetes.io/projected/cdbc01a1-9cc0-4bb8-bd92-469c266bf8ff-kube-api-access-qhb65\") pod \"console-848fbd7f6b-6sxwq\" (UID: \"cdbc01a1-9cc0-4bb8-bd92-469c266bf8ff\") " pod="openshift-console/console-848fbd7f6b-6sxwq" Jul 09 02:35:42.133824 ip-10-0-138-136 kubenswrapper[2583]: I0709 02:35:42.133775 2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/cdbc01a1-9cc0-4bb8-bd92-469c266bf8ff-console-oauth-config\") pod \"console-848fbd7f6b-6sxwq\" (UID: \"cdbc01a1-9cc0-4bb8-bd92-469c266bf8ff\") " pod="openshift-console/console-848fbd7f6b-6sxwq" Jul 09 02:35:42.133824 ip-10-0-138-136 kubenswrapper[2583]: I0709 02:35:42.133808 2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/cdbc01a1-9cc0-4bb8-bd92-469c266bf8ff-oauth-serving-cert\") pod \"console-848fbd7f6b-6sxwq\" (UID: \"cdbc01a1-9cc0-4bb8-bd92-469c266bf8ff\") " pod="openshift-console/console-848fbd7f6b-6sxwq" Jul 09 02:35:42.133999 ip-10-0-138-136 kubenswrapper[2583]: I0709 02:35:42.133895 2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/cdbc01a1-9cc0-4bb8-bd92-469c266bf8ff-console-serving-cert\") pod \"console-848fbd7f6b-6sxwq\" (UID: \"cdbc01a1-9cc0-4bb8-bd92-469c266bf8ff\") " pod="openshift-console/console-848fbd7f6b-6sxwq" Jul 09 02:35:42.136065 ip-10-0-138-136 kubenswrapper[2583]: I0709 02:35:42.136045 2583 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"prometheus-operator-tls\" (UniqueName: \"kubernetes.io/secret/869740c4-79d1-4b1b-a988-c5df63339dc7-prometheus-operator-tls\") pod \"prometheus-operator-567f7b8b7c-bqgxx\" (UID: \"869740c4-79d1-4b1b-a988-c5df63339dc7\") " pod="openshift-monitoring/prometheus-operator-567f7b8b7c-bqgxx" Jul 09 02:35:42.235143 ip-10-0-138-136 kubenswrapper[2583]: I0709 02:35:42.235117 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/cdbc01a1-9cc0-4bb8-bd92-469c266bf8ff-trusted-ca-bundle\") pod \"console-848fbd7f6b-6sxwq\" (UID: \"cdbc01a1-9cc0-4bb8-bd92-469c266bf8ff\") " pod="openshift-console/console-848fbd7f6b-6sxwq" Jul 09 02:35:42.235327 ip-10-0-138-136 kubenswrapper[2583]: I0709 02:35:42.235149 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-qhb65\" (UniqueName: \"kubernetes.io/projected/cdbc01a1-9cc0-4bb8-bd92-469c266bf8ff-kube-api-access-qhb65\") pod \"console-848fbd7f6b-6sxwq\" (UID: \"cdbc01a1-9cc0-4bb8-bd92-469c266bf8ff\") " pod="openshift-console/console-848fbd7f6b-6sxwq" Jul 09 02:35:42.235327 ip-10-0-138-136 kubenswrapper[2583]: I0709 02:35:42.235167 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/cdbc01a1-9cc0-4bb8-bd92-469c266bf8ff-console-oauth-config\") pod \"console-848fbd7f6b-6sxwq\" (UID: \"cdbc01a1-9cc0-4bb8-bd92-469c266bf8ff\") " pod="openshift-console/console-848fbd7f6b-6sxwq" Jul 09 02:35:42.235327 ip-10-0-138-136 kubenswrapper[2583]: I0709 02:35:42.235296 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/cdbc01a1-9cc0-4bb8-bd92-469c266bf8ff-oauth-serving-cert\") pod \"console-848fbd7f6b-6sxwq\" (UID: \"cdbc01a1-9cc0-4bb8-bd92-469c266bf8ff\") " pod="openshift-console/console-848fbd7f6b-6sxwq" Jul 09 02:35:42.235505 ip-10-0-138-136 kubenswrapper[2583]: I0709 02:35:42.235350 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/cdbc01a1-9cc0-4bb8-bd92-469c266bf8ff-console-serving-cert\") pod \"console-848fbd7f6b-6sxwq\" (UID: \"cdbc01a1-9cc0-4bb8-bd92-469c266bf8ff\") " pod="openshift-console/console-848fbd7f6b-6sxwq" Jul 09 02:35:42.235505 ip-10-0-138-136 kubenswrapper[2583]: I0709 02:35:42.235431 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/cdbc01a1-9cc0-4bb8-bd92-469c266bf8ff-console-config\") pod \"console-848fbd7f6b-6sxwq\" (UID: \"cdbc01a1-9cc0-4bb8-bd92-469c266bf8ff\") " pod="openshift-console/console-848fbd7f6b-6sxwq" Jul 09 02:35:42.235505 ip-10-0-138-136 kubenswrapper[2583]: I0709 02:35:42.235456 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/cdbc01a1-9cc0-4bb8-bd92-469c266bf8ff-service-ca\") pod \"console-848fbd7f6b-6sxwq\" (UID: \"cdbc01a1-9cc0-4bb8-bd92-469c266bf8ff\") " pod="openshift-console/console-848fbd7f6b-6sxwq" Jul 09 02:35:42.236185 ip-10-0-138-136 kubenswrapper[2583]: I0709 02:35:42.236139 2583 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/cdbc01a1-9cc0-4bb8-bd92-469c266bf8ff-console-config\") pod \"console-848fbd7f6b-6sxwq\" (UID: \"cdbc01a1-9cc0-4bb8-bd92-469c266bf8ff\") " pod="openshift-console/console-848fbd7f6b-6sxwq" Jul 09 02:35:42.236291 ip-10-0-138-136 kubenswrapper[2583]: I0709 02:35:42.236182 2583 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/cdbc01a1-9cc0-4bb8-bd92-469c266bf8ff-oauth-serving-cert\") pod \"console-848fbd7f6b-6sxwq\" (UID: \"cdbc01a1-9cc0-4bb8-bd92-469c266bf8ff\") " pod="openshift-console/console-848fbd7f6b-6sxwq" Jul 09 02:35:42.236291 ip-10-0-138-136 kubenswrapper[2583]: I0709 02:35:42.236208 2583 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/cdbc01a1-9cc0-4bb8-bd92-469c266bf8ff-trusted-ca-bundle\") pod \"console-848fbd7f6b-6sxwq\" (UID: \"cdbc01a1-9cc0-4bb8-bd92-469c266bf8ff\") " pod="openshift-console/console-848fbd7f6b-6sxwq" Jul 09 02:35:42.236402 ip-10-0-138-136 kubenswrapper[2583]: I0709 02:35:42.236334 2583 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/cdbc01a1-9cc0-4bb8-bd92-469c266bf8ff-service-ca\") pod \"console-848fbd7f6b-6sxwq\" (UID: \"cdbc01a1-9cc0-4bb8-bd92-469c266bf8ff\") " pod="openshift-console/console-848fbd7f6b-6sxwq" Jul 09 02:35:42.237960 ip-10-0-138-136 kubenswrapper[2583]: I0709 02:35:42.237934 2583 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/cdbc01a1-9cc0-4bb8-bd92-469c266bf8ff-console-oauth-config\") pod \"console-848fbd7f6b-6sxwq\" (UID: \"cdbc01a1-9cc0-4bb8-bd92-469c266bf8ff\") " pod="openshift-console/console-848fbd7f6b-6sxwq" Jul 09 02:35:42.238162 ip-10-0-138-136 kubenswrapper[2583]: I0709 02:35:42.238142 2583 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/cdbc01a1-9cc0-4bb8-bd92-469c266bf8ff-console-serving-cert\") pod \"console-848fbd7f6b-6sxwq\" (UID: \"cdbc01a1-9cc0-4bb8-bd92-469c266bf8ff\") " pod="openshift-console/console-848fbd7f6b-6sxwq" Jul 09 02:35:42.243800 ip-10-0-138-136 kubenswrapper[2583]: I0709 02:35:42.243773 2583 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-qhb65\" (UniqueName: \"kubernetes.io/projected/cdbc01a1-9cc0-4bb8-bd92-469c266bf8ff-kube-api-access-qhb65\") pod \"console-848fbd7f6b-6sxwq\" (UID: \"cdbc01a1-9cc0-4bb8-bd92-469c266bf8ff\") " pod="openshift-console/console-848fbd7f6b-6sxwq" Jul 09 02:35:42.400561 ip-10-0-138-136 kubenswrapper[2583]: I0709 02:35:42.400505 2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-848fbd7f6b-6sxwq" Jul 09 02:35:42.424428 ip-10-0-138-136 kubenswrapper[2583]: I0709 02:35:42.424408 2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-operator-567f7b8b7c-bqgxx" Jul 09 02:35:42.574010 ip-10-0-138-136 kubenswrapper[2583]: I0709 02:35:42.573959 2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-848fbd7f6b-6sxwq"] Jul 09 02:35:42.577497 ip-10-0-138-136 kubenswrapper[2583]: W0709 02:35:42.577472 2583 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podcdbc01a1_9cc0_4bb8_bd92_469c266bf8ff.slice/crio-e5e6476ed14f72a846b049792a14ed17bcdfc35368890a3c33e134295065d23d WatchSource:0}: Error finding container e5e6476ed14f72a846b049792a14ed17bcdfc35368890a3c33e134295065d23d: Status 404 returned error can't find the container with id e5e6476ed14f72a846b049792a14ed17bcdfc35368890a3c33e134295065d23d Jul 09 02:35:42.604500 ip-10-0-138-136 kubenswrapper[2583]: I0709 02:35:42.604481 2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-operator-567f7b8b7c-bqgxx"] Jul 09 02:35:42.605267 ip-10-0-138-136 kubenswrapper[2583]: W0709 02:35:42.605246 2583 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod869740c4_79d1_4b1b_a988_c5df63339dc7.slice/crio-def47f15737b436d2809b2a03f43dff4ce3c4c87a229d6fdbc7287c09dcda534 WatchSource:0}: Error finding container def47f15737b436d2809b2a03f43dff4ce3c4c87a229d6fdbc7287c09dcda534: Status 404 returned error can't find the container with id def47f15737b436d2809b2a03f43dff4ce3c4c87a229d6fdbc7287c09dcda534 Jul 09 02:35:43.109734 ip-10-0-138-136 kubenswrapper[2583]: I0709 02:35:43.109679 2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-848fbd7f6b-6sxwq" event={"ID":"cdbc01a1-9cc0-4bb8-bd92-469c266bf8ff","Type":"ContainerStarted","Data":"de61e171290884f76000ab209a176cd78a54000751ddea7b0f42a81df1163457"} Jul 09 02:35:43.110147 ip-10-0-138-136 kubenswrapper[2583]: I0709 02:35:43.109762 2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-848fbd7f6b-6sxwq" event={"ID":"cdbc01a1-9cc0-4bb8-bd92-469c266bf8ff","Type":"ContainerStarted","Data":"e5e6476ed14f72a846b049792a14ed17bcdfc35368890a3c33e134295065d23d"} Jul 09 02:35:43.111351 ip-10-0-138-136 kubenswrapper[2583]: I0709 02:35:43.111311 2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-operator-567f7b8b7c-bqgxx" event={"ID":"869740c4-79d1-4b1b-a988-c5df63339dc7","Type":"ContainerStarted","Data":"def47f15737b436d2809b2a03f43dff4ce3c4c87a229d6fdbc7287c09dcda534"} Jul 09 02:35:43.126824 ip-10-0-138-136 kubenswrapper[2583]: I0709 02:35:43.126726 2583 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console/console-848fbd7f6b-6sxwq" podStartSLOduration=1.126691343 podStartE2EDuration="1.126691343s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-09 02:35:42 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-09 02:35:43.126019519 +0000 UTC m=+89.058477016" watchObservedRunningTime="2026-07-09 02:35:43.126691343 +0000 UTC m=+89.059148830" Jul 09 02:35:44.065278 ip-10-0-138-136 kubenswrapper[2583]: I0709 02:35:44.065245 2583 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-dns/dns-default-rwlzs" Jul 09 02:35:45.122623 ip-10-0-138-136 kubenswrapper[2583]: I0709 02:35:45.122591 2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-operator-567f7b8b7c-bqgxx" event={"ID":"869740c4-79d1-4b1b-a988-c5df63339dc7","Type":"ContainerStarted","Data":"ca768b2cffbfc76f90ee54d3f08bb9d9cde6c65c91aa7eadead996fc3040b785"} Jul 09 02:35:45.123000 ip-10-0-138-136 kubenswrapper[2583]: I0709 02:35:45.122641 2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-operator-567f7b8b7c-bqgxx" event={"ID":"869740c4-79d1-4b1b-a988-c5df63339dc7","Type":"ContainerStarted","Data":"9f0bce4736e95d9c63989e4f51f3e8ab6e09a2c2939aa1dec65b1f9ae96eae99"} Jul 09 02:35:45.141050 ip-10-0-138-136 kubenswrapper[2583]: I0709 02:35:45.140985 2583 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/prometheus-operator-567f7b8b7c-bqgxx" podStartSLOduration=2.295914813 podStartE2EDuration="4.140966198s" totalImagesPullingTime="1.845051385s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-09 02:35:41 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-09 02:35:45.139324836 +0000 UTC m=+91.071782323" watchObservedRunningTime="2026-07-09 02:35:45.140966198 +0000 UTC m=+91.073423685" Jul 09 02:35:46.876527 ip-10-0-138-136 kubenswrapper[2583]: I0709 02:35:46.876498 2583 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/node-exporter-bjkjp"] Jul 09 02:35:46.880816 ip-10-0-138-136 kubenswrapper[2583]: I0709 02:35:46.880793 2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/node-exporter-bjkjp" Jul 09 02:35:46.883061 ip-10-0-138-136 kubenswrapper[2583]: I0709 02:35:46.883028 2583 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-dockercfg-w9bpf\"" Jul 09 02:35:46.883734 ip-10-0-138-136 kubenswrapper[2583]: I0709 02:35:46.883343 2583 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-kube-rbac-proxy-config\"" Jul 09 02:35:46.883734 ip-10-0-138-136 kubenswrapper[2583]: I0709 02:35:46.883551 2583 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-tls\"" Jul 09 02:35:46.883912 ip-10-0-138-136 kubenswrapper[2583]: I0709 02:35:46.883822 2583 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"node-exporter-accelerators-collector-config\"" Jul 09 02:35:46.974041 ip-10-0-138-136 kubenswrapper[2583]: I0709 02:35:46.974012 2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/7daf9287-62fb-400f-a264-62c525638de9-sys\") pod \"node-exporter-bjkjp\" (UID: \"7daf9287-62fb-400f-a264-62c525638de9\") " pod="openshift-monitoring/node-exporter-bjkjp" Jul 09 02:35:46.974144 ip-10-0-138-136 kubenswrapper[2583]: I0709 02:35:46.974059 2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/7daf9287-62fb-400f-a264-62c525638de9-node-exporter-textfile\") pod \"node-exporter-bjkjp\" (UID: \"7daf9287-62fb-400f-a264-62c525638de9\") " pod="openshift-monitoring/node-exporter-bjkjp" Jul 09 02:35:46.974144 ip-10-0-138-136 kubenswrapper[2583]: I0709 02:35:46.974095 2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-hffkn\" (UniqueName: \"kubernetes.io/projected/7daf9287-62fb-400f-a264-62c525638de9-kube-api-access-hffkn\") pod \"node-exporter-bjkjp\" (UID: \"7daf9287-62fb-400f-a264-62c525638de9\") " pod="openshift-monitoring/node-exporter-bjkjp" Jul 09 02:35:46.974263 ip-10-0-138-136 kubenswrapper[2583]: I0709 02:35:46.974144 2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/7daf9287-62fb-400f-a264-62c525638de9-node-exporter-accelerators-collector-config\") pod \"node-exporter-bjkjp\" (UID: \"7daf9287-62fb-400f-a264-62c525638de9\") " pod="openshift-monitoring/node-exporter-bjkjp" Jul 09 02:35:46.974263 ip-10-0-138-136 kubenswrapper[2583]: I0709 02:35:46.974191 2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"root\" (UniqueName: \"kubernetes.io/host-path/7daf9287-62fb-400f-a264-62c525638de9-root\") pod \"node-exporter-bjkjp\" (UID: \"7daf9287-62fb-400f-a264-62c525638de9\") " pod="openshift-monitoring/node-exporter-bjkjp" Jul 09 02:35:46.974263 ip-10-0-138-136 kubenswrapper[2583]: I0709 02:35:46.974215 2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/7daf9287-62fb-400f-a264-62c525638de9-node-exporter-wtmp\") pod \"node-exporter-bjkjp\" (UID: \"7daf9287-62fb-400f-a264-62c525638de9\") " pod="openshift-monitoring/node-exporter-bjkjp" Jul 09 02:35:46.974417 ip-10-0-138-136 kubenswrapper[2583]: I0709 02:35:46.974272 2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/7daf9287-62fb-400f-a264-62c525638de9-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-bjkjp\" (UID: \"7daf9287-62fb-400f-a264-62c525638de9\") " pod="openshift-monitoring/node-exporter-bjkjp" Jul 09 02:35:46.974417 ip-10-0-138-136 kubenswrapper[2583]: I0709 02:35:46.974305 2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/7daf9287-62fb-400f-a264-62c525638de9-node-exporter-tls\") pod \"node-exporter-bjkjp\" (UID: \"7daf9287-62fb-400f-a264-62c525638de9\") " pod="openshift-monitoring/node-exporter-bjkjp" Jul 09 02:35:46.974417 ip-10-0-138-136 kubenswrapper[2583]: I0709 02:35:46.974339 2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/7daf9287-62fb-400f-a264-62c525638de9-metrics-client-ca\") pod \"node-exporter-bjkjp\" (UID: \"7daf9287-62fb-400f-a264-62c525638de9\") " pod="openshift-monitoring/node-exporter-bjkjp" Jul 09 02:35:47.076736 ip-10-0-138-136 kubenswrapper[2583]: I0709 02:35:47.076063 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/7daf9287-62fb-400f-a264-62c525638de9-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-bjkjp\" (UID: \"7daf9287-62fb-400f-a264-62c525638de9\") " pod="openshift-monitoring/node-exporter-bjkjp" Jul 09 02:35:47.076736 ip-10-0-138-136 kubenswrapper[2583]: I0709 02:35:47.076110 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/7daf9287-62fb-400f-a264-62c525638de9-node-exporter-tls\") pod \"node-exporter-bjkjp\" (UID: \"7daf9287-62fb-400f-a264-62c525638de9\") " pod="openshift-monitoring/node-exporter-bjkjp" Jul 09 02:35:47.076736 ip-10-0-138-136 kubenswrapper[2583]: I0709 02:35:47.076148 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/7daf9287-62fb-400f-a264-62c525638de9-metrics-client-ca\") pod \"node-exporter-bjkjp\" (UID: \"7daf9287-62fb-400f-a264-62c525638de9\") " pod="openshift-monitoring/node-exporter-bjkjp" Jul 09 02:35:47.076736 ip-10-0-138-136 kubenswrapper[2583]: I0709 02:35:47.076207 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/7daf9287-62fb-400f-a264-62c525638de9-sys\") pod \"node-exporter-bjkjp\" (UID: \"7daf9287-62fb-400f-a264-62c525638de9\") " pod="openshift-monitoring/node-exporter-bjkjp" Jul 09 02:35:47.076736 ip-10-0-138-136 kubenswrapper[2583]: I0709 02:35:47.076240 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/7daf9287-62fb-400f-a264-62c525638de9-node-exporter-textfile\") pod \"node-exporter-bjkjp\" (UID: \"7daf9287-62fb-400f-a264-62c525638de9\") " pod="openshift-monitoring/node-exporter-bjkjp" Jul 09 02:35:47.076736 ip-10-0-138-136 kubenswrapper[2583]: I0709 02:35:47.076277 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-hffkn\" (UniqueName: \"kubernetes.io/projected/7daf9287-62fb-400f-a264-62c525638de9-kube-api-access-hffkn\") pod \"node-exporter-bjkjp\" (UID: \"7daf9287-62fb-400f-a264-62c525638de9\") " pod="openshift-monitoring/node-exporter-bjkjp" Jul 09 02:35:47.076736 ip-10-0-138-136 kubenswrapper[2583]: I0709 02:35:47.076300 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/7daf9287-62fb-400f-a264-62c525638de9-node-exporter-accelerators-collector-config\") pod \"node-exporter-bjkjp\" (UID: \"7daf9287-62fb-400f-a264-62c525638de9\") " pod="openshift-monitoring/node-exporter-bjkjp" Jul 09 02:35:47.076736 ip-10-0-138-136 kubenswrapper[2583]: I0709 02:35:47.076343 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"root\" (UniqueName: \"kubernetes.io/host-path/7daf9287-62fb-400f-a264-62c525638de9-root\") pod \"node-exporter-bjkjp\" (UID: \"7daf9287-62fb-400f-a264-62c525638de9\") " pod="openshift-monitoring/node-exporter-bjkjp" Jul 09 02:35:47.076736 ip-10-0-138-136 kubenswrapper[2583]: I0709 02:35:47.076365 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/7daf9287-62fb-400f-a264-62c525638de9-node-exporter-wtmp\") pod \"node-exporter-bjkjp\" (UID: \"7daf9287-62fb-400f-a264-62c525638de9\") " pod="openshift-monitoring/node-exporter-bjkjp" Jul 09 02:35:47.076736 ip-10-0-138-136 kubenswrapper[2583]: I0709 02:35:47.076525 2583 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/7daf9287-62fb-400f-a264-62c525638de9-node-exporter-wtmp\") pod \"node-exporter-bjkjp\" (UID: \"7daf9287-62fb-400f-a264-62c525638de9\") " pod="openshift-monitoring/node-exporter-bjkjp" Jul 09 02:35:47.077321 ip-10-0-138-136 kubenswrapper[2583]: E0709 02:35:47.076904 2583 secret.go:189] Couldn't get secret openshift-monitoring/node-exporter-tls: secret "node-exporter-tls" not found Jul 09 02:35:47.077321 ip-10-0-138-136 kubenswrapper[2583]: E0709 02:35:47.076969 2583 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/7daf9287-62fb-400f-a264-62c525638de9-node-exporter-tls podName:7daf9287-62fb-400f-a264-62c525638de9 nodeName:}" failed. No retries permitted until 2026-07-09 02:35:47.576949675 +0000 UTC m=+93.509407145 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "node-exporter-tls" (UniqueName: "kubernetes.io/secret/7daf9287-62fb-400f-a264-62c525638de9-node-exporter-tls") pod "node-exporter-bjkjp" (UID: "7daf9287-62fb-400f-a264-62c525638de9") : secret "node-exporter-tls" not found Jul 09 02:35:47.077984 ip-10-0-138-136 kubenswrapper[2583]: I0709 02:35:47.077771 2583 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/7daf9287-62fb-400f-a264-62c525638de9-sys\") pod \"node-exporter-bjkjp\" (UID: \"7daf9287-62fb-400f-a264-62c525638de9\") " pod="openshift-monitoring/node-exporter-bjkjp" Jul 09 02:35:47.077984 ip-10-0-138-136 kubenswrapper[2583]: I0709 02:35:47.077885 2583 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"root\" (UniqueName: \"kubernetes.io/host-path/7daf9287-62fb-400f-a264-62c525638de9-root\") pod \"node-exporter-bjkjp\" (UID: \"7daf9287-62fb-400f-a264-62c525638de9\") " pod="openshift-monitoring/node-exporter-bjkjp" Jul 09 02:35:47.079452 ip-10-0-138-136 kubenswrapper[2583]: I0709 02:35:47.078750 2583 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/7daf9287-62fb-400f-a264-62c525638de9-node-exporter-textfile\") pod \"node-exporter-bjkjp\" (UID: \"7daf9287-62fb-400f-a264-62c525638de9\") " pod="openshift-monitoring/node-exporter-bjkjp" Jul 09 02:35:47.079452 ip-10-0-138-136 kubenswrapper[2583]: I0709 02:35:47.079409 2583 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/7daf9287-62fb-400f-a264-62c525638de9-node-exporter-accelerators-collector-config\") pod \"node-exporter-bjkjp\" (UID: \"7daf9287-62fb-400f-a264-62c525638de9\") " pod="openshift-monitoring/node-exporter-bjkjp" Jul 09 02:35:47.079597 ip-10-0-138-136 kubenswrapper[2583]: I0709 02:35:47.079536 2583 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/7daf9287-62fb-400f-a264-62c525638de9-metrics-client-ca\") pod \"node-exporter-bjkjp\" (UID: \"7daf9287-62fb-400f-a264-62c525638de9\") " pod="openshift-monitoring/node-exporter-bjkjp" Jul 09 02:35:47.081828 ip-10-0-138-136 kubenswrapper[2583]: I0709 02:35:47.081783 2583 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/7daf9287-62fb-400f-a264-62c525638de9-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-bjkjp\" (UID: \"7daf9287-62fb-400f-a264-62c525638de9\") " pod="openshift-monitoring/node-exporter-bjkjp" Jul 09 02:35:47.086141 ip-10-0-138-136 kubenswrapper[2583]: I0709 02:35:47.086107 2583 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-hffkn\" (UniqueName: \"kubernetes.io/projected/7daf9287-62fb-400f-a264-62c525638de9-kube-api-access-hffkn\") pod \"node-exporter-bjkjp\" (UID: \"7daf9287-62fb-400f-a264-62c525638de9\") " pod="openshift-monitoring/node-exporter-bjkjp" Jul 09 02:35:47.109874 ip-10-0-138-136 kubenswrapper[2583]: I0709 02:35:47.109847 2583 patch_prober.go:28] interesting pod/image-registry-59569495f9-rmmlc container/registry namespace/openshift-image-registry: Liveness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body={"errors":[{"code":"UNAVAILABLE","message":"service unavailable","detail":"health check failed: please see /debug/health"}]} Jul 09 02:35:47.109980 ip-10-0-138-136 kubenswrapper[2583]: I0709 02:35:47.109895 2583 prober.go:120] "Probe failed" probeType="Liveness" pod="openshift-image-registry/image-registry-59569495f9-rmmlc" podUID="9af4ab52-6748-4090-a7a0-8666391d9bfa" containerName="registry" probeResult="failure" output="HTTP probe failed with statuscode: 503" Jul 09 02:35:47.254888 ip-10-0-138-136 kubenswrapper[2583]: I0709 02:35:47.254862 2583 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/console-685c668687-g6tbb" Jul 09 02:35:47.255023 ip-10-0-138-136 kubenswrapper[2583]: I0709 02:35:47.254923 2583 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-console/console-685c668687-g6tbb" Jul 09 02:35:47.261391 ip-10-0-138-136 kubenswrapper[2583]: I0709 02:35:47.261360 2583 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-console/console-685c668687-g6tbb" Jul 09 02:35:47.580955 ip-10-0-138-136 kubenswrapper[2583]: I0709 02:35:47.580881 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/7daf9287-62fb-400f-a264-62c525638de9-node-exporter-tls\") pod \"node-exporter-bjkjp\" (UID: \"7daf9287-62fb-400f-a264-62c525638de9\") " pod="openshift-monitoring/node-exporter-bjkjp" Jul 09 02:35:47.583526 ip-10-0-138-136 kubenswrapper[2583]: I0709 02:35:47.583501 2583 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/7daf9287-62fb-400f-a264-62c525638de9-node-exporter-tls\") pod \"node-exporter-bjkjp\" (UID: \"7daf9287-62fb-400f-a264-62c525638de9\") " pod="openshift-monitoring/node-exporter-bjkjp" Jul 09 02:35:47.794215 ip-10-0-138-136 kubenswrapper[2583]: I0709 02:35:47.794045 2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/node-exporter-bjkjp" Jul 09 02:35:47.810649 ip-10-0-138-136 kubenswrapper[2583]: W0709 02:35:47.810381 2583 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod7daf9287_62fb_400f_a264_62c525638de9.slice/crio-39c61d40f95eaa30718ec075bcd6ebd5a1e142bc6cb278f41b732001f664c08f WatchSource:0}: Error finding container 39c61d40f95eaa30718ec075bcd6ebd5a1e142bc6cb278f41b732001f664c08f: Status 404 returned error can't find the container with id 39c61d40f95eaa30718ec075bcd6ebd5a1e142bc6cb278f41b732001f664c08f Jul 09 02:35:48.139232 ip-10-0-138-136 kubenswrapper[2583]: I0709 02:35:48.139193 2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-bjkjp" event={"ID":"7daf9287-62fb-400f-a264-62c525638de9","Type":"ContainerStarted","Data":"39c61d40f95eaa30718ec075bcd6ebd5a1e142bc6cb278f41b732001f664c08f"} Jul 09 02:35:48.143846 ip-10-0-138-136 kubenswrapper[2583]: I0709 02:35:48.143823 2583 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console/console-685c668687-g6tbb" Jul 09 02:35:49.010740 ip-10-0-138-136 kubenswrapper[2583]: I0709 02:35:49.010696 2583 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-image-registry/image-registry-59569495f9-rmmlc" Jul 09 02:35:49.145483 ip-10-0-138-136 kubenswrapper[2583]: I0709 02:35:49.145451 2583 generic.go:356] "Generic (PLEG): container finished" podID="7daf9287-62fb-400f-a264-62c525638de9" containerID="2ea7122689610697aaf17d88f84f577c3bf831fbf78567a2b8b897af57141f0b" exitCode=0 Jul 09 02:35:49.145918 ip-10-0-138-136 kubenswrapper[2583]: I0709 02:35:49.145539 2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-bjkjp" event={"ID":"7daf9287-62fb-400f-a264-62c525638de9","Type":"ContainerDied","Data":"2ea7122689610697aaf17d88f84f577c3bf831fbf78567a2b8b897af57141f0b"} Jul 09 02:35:50.154105 ip-10-0-138-136 kubenswrapper[2583]: I0709 02:35:50.154067 2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-bjkjp" event={"ID":"7daf9287-62fb-400f-a264-62c525638de9","Type":"ContainerStarted","Data":"5b43e68c27692a80bf7cfe591b2035f1a0e5f580453469c78ec2c4391862d00c"} Jul 09 02:35:50.154501 ip-10-0-138-136 kubenswrapper[2583]: I0709 02:35:50.154165 2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-bjkjp" event={"ID":"7daf9287-62fb-400f-a264-62c525638de9","Type":"ContainerStarted","Data":"ea9247f891698ab0d5d0e9c15972528b2f70d05691c6165a4bf974a68b0a4c81"} Jul 09 02:35:50.173070 ip-10-0-138-136 kubenswrapper[2583]: I0709 02:35:50.173012 2583 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/node-exporter-bjkjp" podStartSLOduration=2.968755224 podStartE2EDuration="4.172994396s" totalImagesPullingTime="1.128584036s" totalInitContainerRuntime="75.655136ms" isStatefulPod=true podCreationTimestamp="2026-07-09 02:35:46 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-09 02:35:50.171902858 +0000 UTC m=+96.104360345" watchObservedRunningTime="2026-07-09 02:35:50.172994396 +0000 UTC m=+96.105451886" Jul 09 02:35:51.954401 ip-10-0-138-136 kubenswrapper[2583]: I0709 02:35:51.954368 2583 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-network-diagnostics/network-check-target-dkblh" Jul 09 02:35:52.400876 ip-10-0-138-136 kubenswrapper[2583]: I0709 02:35:52.400844 2583 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-console/console-848fbd7f6b-6sxwq" Jul 09 02:35:52.401050 ip-10-0-138-136 kubenswrapper[2583]: I0709 02:35:52.400911 2583 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/console-848fbd7f6b-6sxwq" Jul 09 02:35:52.405591 ip-10-0-138-136 kubenswrapper[2583]: I0709 02:35:52.405566 2583 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-console/console-848fbd7f6b-6sxwq" Jul 09 02:35:52.872661 ip-10-0-138-136 kubenswrapper[2583]: I0709 02:35:52.872589 2583 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-848fbd7f6b-6sxwq"] Jul 09 02:35:52.902467 ip-10-0-138-136 kubenswrapper[2583]: I0709 02:35:52.902426 2583 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console/console-5f6f6645cf-wqslf"] Jul 09 02:35:52.907169 ip-10-0-138-136 kubenswrapper[2583]: I0709 02:35:52.907144 2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-5f6f6645cf-wqslf" Jul 09 02:35:52.916477 ip-10-0-138-136 kubenswrapper[2583]: I0709 02:35:52.916421 2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-5f6f6645cf-wqslf"] Jul 09 02:35:53.027335 ip-10-0-138-136 kubenswrapper[2583]: I0709 02:35:53.027306 2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/9d75f511-b76b-4f36-9a0a-c83074c1ad1a-service-ca\") pod \"console-5f6f6645cf-wqslf\" (UID: \"9d75f511-b76b-4f36-9a0a-c83074c1ad1a\") " pod="openshift-console/console-5f6f6645cf-wqslf" Jul 09 02:35:53.027796 ip-10-0-138-136 kubenswrapper[2583]: I0709 02:35:53.027353 2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/9d75f511-b76b-4f36-9a0a-c83074c1ad1a-console-config\") pod \"console-5f6f6645cf-wqslf\" (UID: \"9d75f511-b76b-4f36-9a0a-c83074c1ad1a\") " pod="openshift-console/console-5f6f6645cf-wqslf" Jul 09 02:35:53.027796 ip-10-0-138-136 kubenswrapper[2583]: I0709 02:35:53.027436 2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/9d75f511-b76b-4f36-9a0a-c83074c1ad1a-trusted-ca-bundle\") pod \"console-5f6f6645cf-wqslf\" (UID: \"9d75f511-b76b-4f36-9a0a-c83074c1ad1a\") " pod="openshift-console/console-5f6f6645cf-wqslf" Jul 09 02:35:53.027796 ip-10-0-138-136 kubenswrapper[2583]: I0709 02:35:53.027464 2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-jbk4z\" (UniqueName: \"kubernetes.io/projected/9d75f511-b76b-4f36-9a0a-c83074c1ad1a-kube-api-access-jbk4z\") pod \"console-5f6f6645cf-wqslf\" (UID: \"9d75f511-b76b-4f36-9a0a-c83074c1ad1a\") " pod="openshift-console/console-5f6f6645cf-wqslf" Jul 09 02:35:53.027796 ip-10-0-138-136 kubenswrapper[2583]: I0709 02:35:53.027496 2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/9d75f511-b76b-4f36-9a0a-c83074c1ad1a-console-oauth-config\") pod \"console-5f6f6645cf-wqslf\" (UID: \"9d75f511-b76b-4f36-9a0a-c83074c1ad1a\") " pod="openshift-console/console-5f6f6645cf-wqslf" Jul 09 02:35:53.027796 ip-10-0-138-136 kubenswrapper[2583]: I0709 02:35:53.027561 2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/9d75f511-b76b-4f36-9a0a-c83074c1ad1a-console-serving-cert\") pod \"console-5f6f6645cf-wqslf\" (UID: \"9d75f511-b76b-4f36-9a0a-c83074c1ad1a\") " pod="openshift-console/console-5f6f6645cf-wqslf" Jul 09 02:35:53.027796 ip-10-0-138-136 kubenswrapper[2583]: I0709 02:35:53.027585 2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/9d75f511-b76b-4f36-9a0a-c83074c1ad1a-oauth-serving-cert\") pod \"console-5f6f6645cf-wqslf\" (UID: \"9d75f511-b76b-4f36-9a0a-c83074c1ad1a\") " pod="openshift-console/console-5f6f6645cf-wqslf" Jul 09 02:35:53.130191 ip-10-0-138-136 kubenswrapper[2583]: I0709 02:35:53.129503 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/9d75f511-b76b-4f36-9a0a-c83074c1ad1a-console-config\") pod \"console-5f6f6645cf-wqslf\" (UID: \"9d75f511-b76b-4f36-9a0a-c83074c1ad1a\") " pod="openshift-console/console-5f6f6645cf-wqslf" Jul 09 02:35:53.130191 ip-10-0-138-136 kubenswrapper[2583]: I0709 02:35:53.129575 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/9d75f511-b76b-4f36-9a0a-c83074c1ad1a-trusted-ca-bundle\") pod \"console-5f6f6645cf-wqslf\" (UID: \"9d75f511-b76b-4f36-9a0a-c83074c1ad1a\") " pod="openshift-console/console-5f6f6645cf-wqslf" Jul 09 02:35:53.130191 ip-10-0-138-136 kubenswrapper[2583]: I0709 02:35:53.129601 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-jbk4z\" (UniqueName: \"kubernetes.io/projected/9d75f511-b76b-4f36-9a0a-c83074c1ad1a-kube-api-access-jbk4z\") pod \"console-5f6f6645cf-wqslf\" (UID: \"9d75f511-b76b-4f36-9a0a-c83074c1ad1a\") " pod="openshift-console/console-5f6f6645cf-wqslf" Jul 09 02:35:53.130191 ip-10-0-138-136 kubenswrapper[2583]: I0709 02:35:53.129643 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/9d75f511-b76b-4f36-9a0a-c83074c1ad1a-console-oauth-config\") pod \"console-5f6f6645cf-wqslf\" (UID: \"9d75f511-b76b-4f36-9a0a-c83074c1ad1a\") " pod="openshift-console/console-5f6f6645cf-wqslf" Jul 09 02:35:53.130191 ip-10-0-138-136 kubenswrapper[2583]: I0709 02:35:53.129731 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/9d75f511-b76b-4f36-9a0a-c83074c1ad1a-console-serving-cert\") pod \"console-5f6f6645cf-wqslf\" (UID: \"9d75f511-b76b-4f36-9a0a-c83074c1ad1a\") " pod="openshift-console/console-5f6f6645cf-wqslf" Jul 09 02:35:53.138732 ip-10-0-138-136 kubenswrapper[2583]: I0709 02:35:53.130331 2583 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/9d75f511-b76b-4f36-9a0a-c83074c1ad1a-console-config\") pod \"console-5f6f6645cf-wqslf\" (UID: \"9d75f511-b76b-4f36-9a0a-c83074c1ad1a\") " pod="openshift-console/console-5f6f6645cf-wqslf" Jul 09 02:35:53.138732 ip-10-0-138-136 kubenswrapper[2583]: I0709 02:35:53.130362 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/9d75f511-b76b-4f36-9a0a-c83074c1ad1a-oauth-serving-cert\") pod \"console-5f6f6645cf-wqslf\" (UID: \"9d75f511-b76b-4f36-9a0a-c83074c1ad1a\") " pod="openshift-console/console-5f6f6645cf-wqslf" Jul 09 02:35:53.138732 ip-10-0-138-136 kubenswrapper[2583]: I0709 02:35:53.132170 2583 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/9d75f511-b76b-4f36-9a0a-c83074c1ad1a-trusted-ca-bundle\") pod \"console-5f6f6645cf-wqslf\" (UID: \"9d75f511-b76b-4f36-9a0a-c83074c1ad1a\") " pod="openshift-console/console-5f6f6645cf-wqslf" Jul 09 02:35:53.138732 ip-10-0-138-136 kubenswrapper[2583]: I0709 02:35:53.132463 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/9d75f511-b76b-4f36-9a0a-c83074c1ad1a-service-ca\") pod \"console-5f6f6645cf-wqslf\" (UID: \"9d75f511-b76b-4f36-9a0a-c83074c1ad1a\") " pod="openshift-console/console-5f6f6645cf-wqslf" Jul 09 02:35:53.138732 ip-10-0-138-136 kubenswrapper[2583]: I0709 02:35:53.132745 2583 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/9d75f511-b76b-4f36-9a0a-c83074c1ad1a-oauth-serving-cert\") pod \"console-5f6f6645cf-wqslf\" (UID: \"9d75f511-b76b-4f36-9a0a-c83074c1ad1a\") " pod="openshift-console/console-5f6f6645cf-wqslf" Jul 09 02:35:53.138732 ip-10-0-138-136 kubenswrapper[2583]: I0709 02:35:53.133176 2583 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/9d75f511-b76b-4f36-9a0a-c83074c1ad1a-service-ca\") pod \"console-5f6f6645cf-wqslf\" (UID: \"9d75f511-b76b-4f36-9a0a-c83074c1ad1a\") " pod="openshift-console/console-5f6f6645cf-wqslf" Jul 09 02:35:53.138732 ip-10-0-138-136 kubenswrapper[2583]: I0709 02:35:53.133239 2583 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/9d75f511-b76b-4f36-9a0a-c83074c1ad1a-console-oauth-config\") pod \"console-5f6f6645cf-wqslf\" (UID: \"9d75f511-b76b-4f36-9a0a-c83074c1ad1a\") " pod="openshift-console/console-5f6f6645cf-wqslf" Jul 09 02:35:53.138732 ip-10-0-138-136 kubenswrapper[2583]: I0709 02:35:53.137987 2583 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-jbk4z\" (UniqueName: \"kubernetes.io/projected/9d75f511-b76b-4f36-9a0a-c83074c1ad1a-kube-api-access-jbk4z\") pod \"console-5f6f6645cf-wqslf\" (UID: \"9d75f511-b76b-4f36-9a0a-c83074c1ad1a\") " pod="openshift-console/console-5f6f6645cf-wqslf" Jul 09 02:35:53.140332 ip-10-0-138-136 kubenswrapper[2583]: I0709 02:35:53.140294 2583 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/9d75f511-b76b-4f36-9a0a-c83074c1ad1a-console-serving-cert\") pod \"console-5f6f6645cf-wqslf\" (UID: \"9d75f511-b76b-4f36-9a0a-c83074c1ad1a\") " pod="openshift-console/console-5f6f6645cf-wqslf" Jul 09 02:35:53.179063 ip-10-0-138-136 kubenswrapper[2583]: I0709 02:35:53.179029 2583 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console/console-848fbd7f6b-6sxwq" Jul 09 02:35:53.219075 ip-10-0-138-136 kubenswrapper[2583]: I0709 02:35:53.218931 2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-5f6f6645cf-wqslf" Jul 09 02:36:00.385277 ip-10-0-138-136 kubenswrapper[2583]: I0709 02:36:00.385241 2583 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-5f6f6645cf-wqslf"] Jul 09 02:36:00.418782 ip-10-0-138-136 kubenswrapper[2583]: I0709 02:36:00.418756 2583 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console/console-667b8f5fd5-6qgr2"] Jul 09 02:36:00.499648 ip-10-0-138-136 kubenswrapper[2583]: I0709 02:36:00.499620 2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-667b8f5fd5-6qgr2"] Jul 09 02:36:00.499838 ip-10-0-138-136 kubenswrapper[2583]: I0709 02:36:00.499749 2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-667b8f5fd5-6qgr2" Jul 09 02:36:00.605893 ip-10-0-138-136 kubenswrapper[2583]: I0709 02:36:00.605784 2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/ca05c9ce-00b8-4182-acd6-556801a4e1df-service-ca\") pod \"console-667b8f5fd5-6qgr2\" (UID: \"ca05c9ce-00b8-4182-acd6-556801a4e1df\") " pod="openshift-console/console-667b8f5fd5-6qgr2" Jul 09 02:36:00.605893 ip-10-0-138-136 kubenswrapper[2583]: I0709 02:36:00.605860 2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/ca05c9ce-00b8-4182-acd6-556801a4e1df-console-serving-cert\") pod \"console-667b8f5fd5-6qgr2\" (UID: \"ca05c9ce-00b8-4182-acd6-556801a4e1df\") " pod="openshift-console/console-667b8f5fd5-6qgr2" Jul 09 02:36:00.606240 ip-10-0-138-136 kubenswrapper[2583]: I0709 02:36:00.606204 2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-jl86f\" (UniqueName: \"kubernetes.io/projected/ca05c9ce-00b8-4182-acd6-556801a4e1df-kube-api-access-jl86f\") pod \"console-667b8f5fd5-6qgr2\" (UID: \"ca05c9ce-00b8-4182-acd6-556801a4e1df\") " pod="openshift-console/console-667b8f5fd5-6qgr2" Jul 09 02:36:00.606448 ip-10-0-138-136 kubenswrapper[2583]: I0709 02:36:00.606415 2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/ca05c9ce-00b8-4182-acd6-556801a4e1df-trusted-ca-bundle\") pod \"console-667b8f5fd5-6qgr2\" (UID: \"ca05c9ce-00b8-4182-acd6-556801a4e1df\") " pod="openshift-console/console-667b8f5fd5-6qgr2" Jul 09 02:36:00.606551 ip-10-0-138-136 kubenswrapper[2583]: I0709 02:36:00.606512 2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/ca05c9ce-00b8-4182-acd6-556801a4e1df-oauth-serving-cert\") pod \"console-667b8f5fd5-6qgr2\" (UID: \"ca05c9ce-00b8-4182-acd6-556801a4e1df\") " pod="openshift-console/console-667b8f5fd5-6qgr2" Jul 09 02:36:00.606641 ip-10-0-138-136 kubenswrapper[2583]: I0709 02:36:00.606571 2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/ca05c9ce-00b8-4182-acd6-556801a4e1df-console-config\") pod \"console-667b8f5fd5-6qgr2\" (UID: \"ca05c9ce-00b8-4182-acd6-556801a4e1df\") " pod="openshift-console/console-667b8f5fd5-6qgr2" Jul 09 02:36:00.606820 ip-10-0-138-136 kubenswrapper[2583]: I0709 02:36:00.606694 2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/ca05c9ce-00b8-4182-acd6-556801a4e1df-console-oauth-config\") pod \"console-667b8f5fd5-6qgr2\" (UID: \"ca05c9ce-00b8-4182-acd6-556801a4e1df\") " pod="openshift-console/console-667b8f5fd5-6qgr2" Jul 09 02:36:00.678065 ip-10-0-138-136 kubenswrapper[2583]: I0709 02:36:00.678027 2583 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-5f6f6645cf-wqslf"] Jul 09 02:36:00.680287 ip-10-0-138-136 kubenswrapper[2583]: W0709 02:36:00.680255 2583 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod9d75f511_b76b_4f36_9a0a_c83074c1ad1a.slice/crio-e5c73aedd8fd215a8ac9259c26eb1e1f9e668ee8937ab057d1bef50f2cb8811e WatchSource:0}: Error finding container e5c73aedd8fd215a8ac9259c26eb1e1f9e668ee8937ab057d1bef50f2cb8811e: Status 404 returned error can't find the container with id e5c73aedd8fd215a8ac9259c26eb1e1f9e668ee8937ab057d1bef50f2cb8811e Jul 09 02:36:00.707970 ip-10-0-138-136 kubenswrapper[2583]: I0709 02:36:00.707946 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/ca05c9ce-00b8-4182-acd6-556801a4e1df-console-oauth-config\") pod \"console-667b8f5fd5-6qgr2\" (UID: \"ca05c9ce-00b8-4182-acd6-556801a4e1df\") " pod="openshift-console/console-667b8f5fd5-6qgr2" Jul 09 02:36:00.708212 ip-10-0-138-136 kubenswrapper[2583]: I0709 02:36:00.708188 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/ca05c9ce-00b8-4182-acd6-556801a4e1df-service-ca\") pod \"console-667b8f5fd5-6qgr2\" (UID: \"ca05c9ce-00b8-4182-acd6-556801a4e1df\") " pod="openshift-console/console-667b8f5fd5-6qgr2" Jul 09 02:36:00.708315 ip-10-0-138-136 kubenswrapper[2583]: I0709 02:36:00.708244 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/ca05c9ce-00b8-4182-acd6-556801a4e1df-console-serving-cert\") pod \"console-667b8f5fd5-6qgr2\" (UID: \"ca05c9ce-00b8-4182-acd6-556801a4e1df\") " pod="openshift-console/console-667b8f5fd5-6qgr2" Jul 09 02:36:00.708315 ip-10-0-138-136 kubenswrapper[2583]: I0709 02:36:00.708278 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-jl86f\" (UniqueName: \"kubernetes.io/projected/ca05c9ce-00b8-4182-acd6-556801a4e1df-kube-api-access-jl86f\") pod \"console-667b8f5fd5-6qgr2\" (UID: \"ca05c9ce-00b8-4182-acd6-556801a4e1df\") " pod="openshift-console/console-667b8f5fd5-6qgr2" Jul 09 02:36:00.708431 ip-10-0-138-136 kubenswrapper[2583]: I0709 02:36:00.708334 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/ca05c9ce-00b8-4182-acd6-556801a4e1df-trusted-ca-bundle\") pod \"console-667b8f5fd5-6qgr2\" (UID: \"ca05c9ce-00b8-4182-acd6-556801a4e1df\") " pod="openshift-console/console-667b8f5fd5-6qgr2" Jul 09 02:36:00.708431 ip-10-0-138-136 kubenswrapper[2583]: I0709 02:36:00.708385 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/ca05c9ce-00b8-4182-acd6-556801a4e1df-oauth-serving-cert\") pod \"console-667b8f5fd5-6qgr2\" (UID: \"ca05c9ce-00b8-4182-acd6-556801a4e1df\") " pod="openshift-console/console-667b8f5fd5-6qgr2" Jul 09 02:36:00.708538 ip-10-0-138-136 kubenswrapper[2583]: I0709 02:36:00.708428 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/ca05c9ce-00b8-4182-acd6-556801a4e1df-console-config\") pod \"console-667b8f5fd5-6qgr2\" (UID: \"ca05c9ce-00b8-4182-acd6-556801a4e1df\") " pod="openshift-console/console-667b8f5fd5-6qgr2" Jul 09 02:36:00.708933 ip-10-0-138-136 kubenswrapper[2583]: I0709 02:36:00.708911 2583 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/ca05c9ce-00b8-4182-acd6-556801a4e1df-service-ca\") pod \"console-667b8f5fd5-6qgr2\" (UID: \"ca05c9ce-00b8-4182-acd6-556801a4e1df\") " pod="openshift-console/console-667b8f5fd5-6qgr2" Jul 09 02:36:00.709167 ip-10-0-138-136 kubenswrapper[2583]: I0709 02:36:00.709144 2583 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/ca05c9ce-00b8-4182-acd6-556801a4e1df-console-config\") pod \"console-667b8f5fd5-6qgr2\" (UID: \"ca05c9ce-00b8-4182-acd6-556801a4e1df\") " pod="openshift-console/console-667b8f5fd5-6qgr2" Jul 09 02:36:00.709255 ip-10-0-138-136 kubenswrapper[2583]: I0709 02:36:00.709183 2583 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/ca05c9ce-00b8-4182-acd6-556801a4e1df-trusted-ca-bundle\") pod \"console-667b8f5fd5-6qgr2\" (UID: \"ca05c9ce-00b8-4182-acd6-556801a4e1df\") " pod="openshift-console/console-667b8f5fd5-6qgr2" Jul 09 02:36:00.709255 ip-10-0-138-136 kubenswrapper[2583]: I0709 02:36:00.709198 2583 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/ca05c9ce-00b8-4182-acd6-556801a4e1df-oauth-serving-cert\") pod \"console-667b8f5fd5-6qgr2\" (UID: \"ca05c9ce-00b8-4182-acd6-556801a4e1df\") " pod="openshift-console/console-667b8f5fd5-6qgr2" Jul 09 02:36:00.710391 ip-10-0-138-136 kubenswrapper[2583]: I0709 02:36:00.710372 2583 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/ca05c9ce-00b8-4182-acd6-556801a4e1df-console-oauth-config\") pod \"console-667b8f5fd5-6qgr2\" (UID: \"ca05c9ce-00b8-4182-acd6-556801a4e1df\") " pod="openshift-console/console-667b8f5fd5-6qgr2" Jul 09 02:36:00.710559 ip-10-0-138-136 kubenswrapper[2583]: I0709 02:36:00.710542 2583 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/ca05c9ce-00b8-4182-acd6-556801a4e1df-console-serving-cert\") pod \"console-667b8f5fd5-6qgr2\" (UID: \"ca05c9ce-00b8-4182-acd6-556801a4e1df\") " pod="openshift-console/console-667b8f5fd5-6qgr2" Jul 09 02:36:00.716898 ip-10-0-138-136 kubenswrapper[2583]: I0709 02:36:00.716876 2583 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-jl86f\" (UniqueName: \"kubernetes.io/projected/ca05c9ce-00b8-4182-acd6-556801a4e1df-kube-api-access-jl86f\") pod \"console-667b8f5fd5-6qgr2\" (UID: \"ca05c9ce-00b8-4182-acd6-556801a4e1df\") " pod="openshift-console/console-667b8f5fd5-6qgr2" Jul 09 02:36:00.810790 ip-10-0-138-136 kubenswrapper[2583]: I0709 02:36:00.810766 2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-667b8f5fd5-6qgr2" Jul 09 02:36:00.997900 ip-10-0-138-136 kubenswrapper[2583]: I0709 02:36:00.997024 2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-667b8f5fd5-6qgr2"] Jul 09 02:36:00.999006 ip-10-0-138-136 kubenswrapper[2583]: W0709 02:36:00.998975 2583 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podca05c9ce_00b8_4182_acd6_556801a4e1df.slice/crio-3239a823c087eab612e0f2d7d83540e60a4e18c908e173ce648d4c7a80bf611e WatchSource:0}: Error finding container 3239a823c087eab612e0f2d7d83540e60a4e18c908e173ce648d4c7a80bf611e: Status 404 returned error can't find the container with id 3239a823c087eab612e0f2d7d83540e60a4e18c908e173ce648d4c7a80bf611e Jul 09 02:36:01.220366 ip-10-0-138-136 kubenswrapper[2583]: I0709 02:36:01.220282 2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-667b8f5fd5-6qgr2" event={"ID":"ca05c9ce-00b8-4182-acd6-556801a4e1df","Type":"ContainerStarted","Data":"2f4781858d3fc269442bc219a5fdfe74751a4656926aca1fabc6d9613590ed17"} Jul 09 02:36:01.220538 ip-10-0-138-136 kubenswrapper[2583]: I0709 02:36:01.220371 2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-667b8f5fd5-6qgr2" event={"ID":"ca05c9ce-00b8-4182-acd6-556801a4e1df","Type":"ContainerStarted","Data":"3239a823c087eab612e0f2d7d83540e60a4e18c908e173ce648d4c7a80bf611e"} Jul 09 02:36:01.222106 ip-10-0-138-136 kubenswrapper[2583]: I0709 02:36:01.222071 2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-5f6f6645cf-wqslf" event={"ID":"9d75f511-b76b-4f36-9a0a-c83074c1ad1a","Type":"ContainerStarted","Data":"6810e5d86ff5602e62b59d55197ca9327a9fc77e304aa3961790a9bf8ea5d1d7"} Jul 09 02:36:01.222236 ip-10-0-138-136 kubenswrapper[2583]: I0709 02:36:01.222130 2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-5f6f6645cf-wqslf" event={"ID":"9d75f511-b76b-4f36-9a0a-c83074c1ad1a","Type":"ContainerStarted","Data":"e5c73aedd8fd215a8ac9259c26eb1e1f9e668ee8937ab057d1bef50f2cb8811e"} Jul 09 02:36:01.224263 ip-10-0-138-136 kubenswrapper[2583]: I0709 02:36:01.223799 2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/downloads-685bfb5f64-5dwm9" event={"ID":"4952f4bb-5769-47fd-8c16-5b57eefd01cd","Type":"ContainerStarted","Data":"62f13a64c29aa89d637cb9eee71bfc246a52a8b8bb4de4e4923aa8bea19d978b"} Jul 09 02:36:01.224263 ip-10-0-138-136 kubenswrapper[2583]: I0709 02:36:01.224162 2583 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/downloads-685bfb5f64-5dwm9" Jul 09 02:36:01.225571 ip-10-0-138-136 kubenswrapper[2583]: I0709 02:36:01.225543 2583 patch_prober.go:28] interesting pod/downloads-685bfb5f64-5dwm9 container/download-server namespace/openshift-console: Readiness probe status=failure output="Get \"http://10.132.0.25:8080/\": dial tcp 10.132.0.25:8080: connect: connection refused" start-of-body= Jul 09 02:36:01.225672 ip-10-0-138-136 kubenswrapper[2583]: I0709 02:36:01.225588 2583 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-console/downloads-685bfb5f64-5dwm9" podUID="4952f4bb-5769-47fd-8c16-5b57eefd01cd" containerName="download-server" probeResult="failure" output="Get \"http://10.132.0.25:8080/\": dial tcp 10.132.0.25:8080: connect: connection refused" Jul 09 02:36:01.242385 ip-10-0-138-136 kubenswrapper[2583]: I0709 02:36:01.242341 2583 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console/console-667b8f5fd5-6qgr2" podStartSLOduration=1.2423278070000001 podStartE2EDuration="1.242327807s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-09 02:36:00 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-09 02:36:01.240740812 +0000 UTC m=+107.173198298" watchObservedRunningTime="2026-07-09 02:36:01.242327807 +0000 UTC m=+107.174785270" Jul 09 02:36:01.320490 ip-10-0-138-136 kubenswrapper[2583]: I0709 02:36:01.320441 2583 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console/downloads-685bfb5f64-5dwm9" podStartSLOduration=1.812026022 podStartE2EDuration="25.320426818s" totalImagesPullingTime="23.508400796s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-09 02:35:36 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-09 02:36:01.282649334 +0000 UTC m=+107.215106819" watchObservedRunningTime="2026-07-09 02:36:01.320426818 +0000 UTC m=+107.252884375" Jul 09 02:36:01.320674 ip-10-0-138-136 kubenswrapper[2583]: I0709 02:36:01.320516 2583 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console/console-5f6f6645cf-wqslf" podStartSLOduration=9.320510439 podStartE2EDuration="9.320510439s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-09 02:35:52 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-09 02:36:01.319435331 +0000 UTC m=+107.251892819" watchObservedRunningTime="2026-07-09 02:36:01.320510439 +0000 UTC m=+107.252967926" Jul 09 02:36:02.248367 ip-10-0-138-136 kubenswrapper[2583]: I0709 02:36:02.248338 2583 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console/downloads-685bfb5f64-5dwm9" Jul 09 02:36:03.219662 ip-10-0-138-136 kubenswrapper[2583]: I0709 02:36:03.219612 2583 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/console-5f6f6645cf-wqslf" Jul 09 02:36:05.885541 ip-10-0-138-136 kubenswrapper[2583]: I0709 02:36:05.885506 2583 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-image-registry/image-registry-59569495f9-rmmlc"] Jul 09 02:36:10.811770 ip-10-0-138-136 kubenswrapper[2583]: I0709 02:36:10.811736 2583 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/console-667b8f5fd5-6qgr2" Jul 09 02:36:10.812379 ip-10-0-138-136 kubenswrapper[2583]: I0709 02:36:10.811796 2583 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-console/console-667b8f5fd5-6qgr2" Jul 09 02:36:10.817253 ip-10-0-138-136 kubenswrapper[2583]: I0709 02:36:10.817226 2583 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-console/console-667b8f5fd5-6qgr2" Jul 09 02:36:11.276626 ip-10-0-138-136 kubenswrapper[2583]: I0709 02:36:11.276599 2583 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console/console-667b8f5fd5-6qgr2" Jul 09 02:36:11.322793 ip-10-0-138-136 kubenswrapper[2583]: I0709 02:36:11.322767 2583 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-685c668687-g6tbb"] Jul 09 02:36:19.203433 ip-10-0-138-136 kubenswrapper[2583]: I0709 02:36:19.203368 2583 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-console/console-848fbd7f6b-6sxwq" podUID="cdbc01a1-9cc0-4bb8-bd92-469c266bf8ff" containerName="console" containerID="cri-o://de61e171290884f76000ab209a176cd78a54000751ddea7b0f42a81df1163457" gracePeriod=15 Jul 09 02:36:19.492182 ip-10-0-138-136 kubenswrapper[2583]: I0709 02:36:19.492156 2583 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-848fbd7f6b-6sxwq" Jul 09 02:36:19.572061 ip-10-0-138-136 kubenswrapper[2583]: I0709 02:36:19.572034 2583 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/cdbc01a1-9cc0-4bb8-bd92-469c266bf8ff-oauth-serving-cert\") pod \"cdbc01a1-9cc0-4bb8-bd92-469c266bf8ff\" (UID: \"cdbc01a1-9cc0-4bb8-bd92-469c266bf8ff\") " Jul 09 02:36:19.572184 ip-10-0-138-136 kubenswrapper[2583]: I0709 02:36:19.572082 2583 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/cdbc01a1-9cc0-4bb8-bd92-469c266bf8ff-service-ca\") pod \"cdbc01a1-9cc0-4bb8-bd92-469c266bf8ff\" (UID: \"cdbc01a1-9cc0-4bb8-bd92-469c266bf8ff\") " Jul 09 02:36:19.572184 ip-10-0-138-136 kubenswrapper[2583]: I0709 02:36:19.572110 2583 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/cdbc01a1-9cc0-4bb8-bd92-469c266bf8ff-console-config\") pod \"cdbc01a1-9cc0-4bb8-bd92-469c266bf8ff\" (UID: \"cdbc01a1-9cc0-4bb8-bd92-469c266bf8ff\") " Jul 09 02:36:19.572184 ip-10-0-138-136 kubenswrapper[2583]: I0709 02:36:19.572124 2583 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/cdbc01a1-9cc0-4bb8-bd92-469c266bf8ff-trusted-ca-bundle\") pod \"cdbc01a1-9cc0-4bb8-bd92-469c266bf8ff\" (UID: \"cdbc01a1-9cc0-4bb8-bd92-469c266bf8ff\") " Jul 09 02:36:19.572184 ip-10-0-138-136 kubenswrapper[2583]: I0709 02:36:19.572150 2583 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-qhb65\" (UniqueName: \"kubernetes.io/projected/cdbc01a1-9cc0-4bb8-bd92-469c266bf8ff-kube-api-access-qhb65\") pod \"cdbc01a1-9cc0-4bb8-bd92-469c266bf8ff\" (UID: \"cdbc01a1-9cc0-4bb8-bd92-469c266bf8ff\") " Jul 09 02:36:19.572390 ip-10-0-138-136 kubenswrapper[2583]: I0709 02:36:19.572349 2583 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/cdbc01a1-9cc0-4bb8-bd92-469c266bf8ff-console-oauth-config\") pod \"cdbc01a1-9cc0-4bb8-bd92-469c266bf8ff\" (UID: \"cdbc01a1-9cc0-4bb8-bd92-469c266bf8ff\") " Jul 09 02:36:19.572445 ip-10-0-138-136 kubenswrapper[2583]: I0709 02:36:19.572437 2583 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/cdbc01a1-9cc0-4bb8-bd92-469c266bf8ff-console-serving-cert\") pod \"cdbc01a1-9cc0-4bb8-bd92-469c266bf8ff\" (UID: \"cdbc01a1-9cc0-4bb8-bd92-469c266bf8ff\") " Jul 09 02:36:19.572494 ip-10-0-138-136 kubenswrapper[2583]: I0709 02:36:19.572447 2583 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/cdbc01a1-9cc0-4bb8-bd92-469c266bf8ff-oauth-serving-cert" (OuterVolumeSpecName: "oauth-serving-cert") pod "cdbc01a1-9cc0-4bb8-bd92-469c266bf8ff" (UID: "cdbc01a1-9cc0-4bb8-bd92-469c266bf8ff"). InnerVolumeSpecName "oauth-serving-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 09 02:36:19.572766 ip-10-0-138-136 kubenswrapper[2583]: I0709 02:36:19.572562 2583 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/cdbc01a1-9cc0-4bb8-bd92-469c266bf8ff-console-config" (OuterVolumeSpecName: "console-config") pod "cdbc01a1-9cc0-4bb8-bd92-469c266bf8ff" (UID: "cdbc01a1-9cc0-4bb8-bd92-469c266bf8ff"). InnerVolumeSpecName "console-config". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 09 02:36:19.572766 ip-10-0-138-136 kubenswrapper[2583]: I0709 02:36:19.572597 2583 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/cdbc01a1-9cc0-4bb8-bd92-469c266bf8ff-trusted-ca-bundle" (OuterVolumeSpecName: "trusted-ca-bundle") pod "cdbc01a1-9cc0-4bb8-bd92-469c266bf8ff" (UID: "cdbc01a1-9cc0-4bb8-bd92-469c266bf8ff"). InnerVolumeSpecName "trusted-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 09 02:36:19.572766 ip-10-0-138-136 kubenswrapper[2583]: I0709 02:36:19.572610 2583 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/cdbc01a1-9cc0-4bb8-bd92-469c266bf8ff-service-ca" (OuterVolumeSpecName: "service-ca") pod "cdbc01a1-9cc0-4bb8-bd92-469c266bf8ff" (UID: "cdbc01a1-9cc0-4bb8-bd92-469c266bf8ff"). InnerVolumeSpecName "service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 09 02:36:19.572980 ip-10-0-138-136 kubenswrapper[2583]: I0709 02:36:19.572795 2583 reconciler_common.go:299] "Volume detached for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/cdbc01a1-9cc0-4bb8-bd92-469c266bf8ff-oauth-serving-cert\") on node \"ip-10-0-138-136.ec2.internal\" DevicePath \"\"" Jul 09 02:36:19.572980 ip-10-0-138-136 kubenswrapper[2583]: I0709 02:36:19.572816 2583 reconciler_common.go:299] "Volume detached for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/cdbc01a1-9cc0-4bb8-bd92-469c266bf8ff-service-ca\") on node \"ip-10-0-138-136.ec2.internal\" DevicePath \"\"" Jul 09 02:36:19.572980 ip-10-0-138-136 kubenswrapper[2583]: I0709 02:36:19.572828 2583 reconciler_common.go:299] "Volume detached for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/cdbc01a1-9cc0-4bb8-bd92-469c266bf8ff-console-config\") on node \"ip-10-0-138-136.ec2.internal\" DevicePath \"\"" Jul 09 02:36:19.572980 ip-10-0-138-136 kubenswrapper[2583]: I0709 02:36:19.572839 2583 reconciler_common.go:299] "Volume detached for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/cdbc01a1-9cc0-4bb8-bd92-469c266bf8ff-trusted-ca-bundle\") on node \"ip-10-0-138-136.ec2.internal\" DevicePath \"\"" Jul 09 02:36:19.574415 ip-10-0-138-136 kubenswrapper[2583]: I0709 02:36:19.574391 2583 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/cdbc01a1-9cc0-4bb8-bd92-469c266bf8ff-console-oauth-config" (OuterVolumeSpecName: "console-oauth-config") pod "cdbc01a1-9cc0-4bb8-bd92-469c266bf8ff" (UID: "cdbc01a1-9cc0-4bb8-bd92-469c266bf8ff"). InnerVolumeSpecName "console-oauth-config". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 09 02:36:19.574513 ip-10-0-138-136 kubenswrapper[2583]: I0709 02:36:19.574407 2583 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/cdbc01a1-9cc0-4bb8-bd92-469c266bf8ff-console-serving-cert" (OuterVolumeSpecName: "console-serving-cert") pod "cdbc01a1-9cc0-4bb8-bd92-469c266bf8ff" (UID: "cdbc01a1-9cc0-4bb8-bd92-469c266bf8ff"). InnerVolumeSpecName "console-serving-cert". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 09 02:36:19.574513 ip-10-0-138-136 kubenswrapper[2583]: I0709 02:36:19.574444 2583 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/cdbc01a1-9cc0-4bb8-bd92-469c266bf8ff-kube-api-access-qhb65" (OuterVolumeSpecName: "kube-api-access-qhb65") pod "cdbc01a1-9cc0-4bb8-bd92-469c266bf8ff" (UID: "cdbc01a1-9cc0-4bb8-bd92-469c266bf8ff"). InnerVolumeSpecName "kube-api-access-qhb65". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 09 02:36:19.673326 ip-10-0-138-136 kubenswrapper[2583]: I0709 02:36:19.673305 2583 reconciler_common.go:299] "Volume detached for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/cdbc01a1-9cc0-4bb8-bd92-469c266bf8ff-console-serving-cert\") on node \"ip-10-0-138-136.ec2.internal\" DevicePath \"\"" Jul 09 02:36:19.673326 ip-10-0-138-136 kubenswrapper[2583]: I0709 02:36:19.673325 2583 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-qhb65\" (UniqueName: \"kubernetes.io/projected/cdbc01a1-9cc0-4bb8-bd92-469c266bf8ff-kube-api-access-qhb65\") on node \"ip-10-0-138-136.ec2.internal\" DevicePath \"\"" Jul 09 02:36:19.673451 ip-10-0-138-136 kubenswrapper[2583]: I0709 02:36:19.673335 2583 reconciler_common.go:299] "Volume detached for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/cdbc01a1-9cc0-4bb8-bd92-469c266bf8ff-console-oauth-config\") on node \"ip-10-0-138-136.ec2.internal\" DevicePath \"\"" Jul 09 02:36:20.313434 ip-10-0-138-136 kubenswrapper[2583]: I0709 02:36:20.313409 2583 generic.go:356] "Generic (PLEG): container finished" podID="cdbc01a1-9cc0-4bb8-bd92-469c266bf8ff" containerID="de61e171290884f76000ab209a176cd78a54000751ddea7b0f42a81df1163457" exitCode=0 Jul 09 02:36:20.313782 ip-10-0-138-136 kubenswrapper[2583]: I0709 02:36:20.313461 2583 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-848fbd7f6b-6sxwq" Jul 09 02:36:20.313782 ip-10-0-138-136 kubenswrapper[2583]: I0709 02:36:20.313488 2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-848fbd7f6b-6sxwq" event={"ID":"cdbc01a1-9cc0-4bb8-bd92-469c266bf8ff","Type":"ContainerDied","Data":"de61e171290884f76000ab209a176cd78a54000751ddea7b0f42a81df1163457"} Jul 09 02:36:20.313782 ip-10-0-138-136 kubenswrapper[2583]: I0709 02:36:20.313539 2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-848fbd7f6b-6sxwq" event={"ID":"cdbc01a1-9cc0-4bb8-bd92-469c266bf8ff","Type":"ContainerDied","Data":"e5e6476ed14f72a846b049792a14ed17bcdfc35368890a3c33e134295065d23d"} Jul 09 02:36:20.313782 ip-10-0-138-136 kubenswrapper[2583]: I0709 02:36:20.313571 2583 scope.go:117] "RemoveContainer" containerID="de61e171290884f76000ab209a176cd78a54000751ddea7b0f42a81df1163457" Jul 09 02:36:20.315231 ip-10-0-138-136 kubenswrapper[2583]: I0709 02:36:20.315209 2583 generic.go:356] "Generic (PLEG): container finished" podID="bb24b378-f56e-46cb-8881-3f44c1a40391" containerID="dfa6c27d7f727a378a41e146e3933b6b46603186413521dee76670c6e24ea666" exitCode=0 Jul 09 02:36:20.315318 ip-10-0-138-136 kubenswrapper[2583]: I0709 02:36:20.315264 2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-operator-5c847dcfc4-rwvrr" event={"ID":"bb24b378-f56e-46cb-8881-3f44c1a40391","Type":"ContainerDied","Data":"dfa6c27d7f727a378a41e146e3933b6b46603186413521dee76670c6e24ea666"} Jul 09 02:36:20.315664 ip-10-0-138-136 kubenswrapper[2583]: I0709 02:36:20.315646 2583 scope.go:117] "RemoveContainer" containerID="dfa6c27d7f727a378a41e146e3933b6b46603186413521dee76670c6e24ea666" Jul 09 02:36:20.322827 ip-10-0-138-136 kubenswrapper[2583]: I0709 02:36:20.322810 2583 scope.go:117] "RemoveContainer" containerID="de61e171290884f76000ab209a176cd78a54000751ddea7b0f42a81df1163457" Jul 09 02:36:20.323087 ip-10-0-138-136 kubenswrapper[2583]: E0709 02:36:20.323063 2583 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"de61e171290884f76000ab209a176cd78a54000751ddea7b0f42a81df1163457\": container with ID starting with de61e171290884f76000ab209a176cd78a54000751ddea7b0f42a81df1163457 not found: ID does not exist" containerID="de61e171290884f76000ab209a176cd78a54000751ddea7b0f42a81df1163457" Jul 09 02:36:20.323174 ip-10-0-138-136 kubenswrapper[2583]: I0709 02:36:20.323095 2583 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"de61e171290884f76000ab209a176cd78a54000751ddea7b0f42a81df1163457"} err="failed to get container status \"de61e171290884f76000ab209a176cd78a54000751ddea7b0f42a81df1163457\": rpc error: code = NotFound desc = could not find container \"de61e171290884f76000ab209a176cd78a54000751ddea7b0f42a81df1163457\": container with ID starting with de61e171290884f76000ab209a176cd78a54000751ddea7b0f42a81df1163457 not found: ID does not exist" Jul 09 02:36:20.344941 ip-10-0-138-136 kubenswrapper[2583]: I0709 02:36:20.344916 2583 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-848fbd7f6b-6sxwq"] Jul 09 02:36:20.355439 ip-10-0-138-136 kubenswrapper[2583]: I0709 02:36:20.355419 2583 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-console/console-848fbd7f6b-6sxwq"] Jul 09 02:36:20.602749 ip-10-0-138-136 kubenswrapper[2583]: I0709 02:36:20.602706 2583 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="cdbc01a1-9cc0-4bb8-bd92-469c266bf8ff" path="/var/lib/kubelet/pods/cdbc01a1-9cc0-4bb8-bd92-469c266bf8ff/volumes" Jul 09 02:36:21.227754 ip-10-0-138-136 kubenswrapper[2583]: I0709 02:36:21.227703 2583 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_router-default-6575bfb5cc-2ttlz_49f19d77-82e8-419b-a88b-09c9ee4354a8/router/0.log" Jul 09 02:36:21.238369 ip-10-0-138-136 kubenswrapper[2583]: I0709 02:36:21.238345 2583 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress-canary_ingress-canary-dhcrr_42025b60-40d4-453f-aaae-74cb3e1a3cdb/serve-healthcheck-canary/0.log" Jul 09 02:36:21.321586 ip-10-0-138-136 kubenswrapper[2583]: I0709 02:36:21.321565 2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-operator-5c847dcfc4-rwvrr" event={"ID":"bb24b378-f56e-46cb-8881-3f44c1a40391","Type":"ContainerStarted","Data":"3e80968b4d97298df9abd54b29b2b1822897a9116cdfc8b9fc404b679f0a7c96"} Jul 09 02:36:24.408695 ip-10-0-138-136 kubenswrapper[2583]: I0709 02:36:24.408653 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/71cf0a89-d676-47f4-bf4a-d13d283493fc-metrics-certs\") pod \"network-metrics-daemon-rdtdt\" (UID: \"71cf0a89-d676-47f4-bf4a-d13d283493fc\") " pod="openshift-multus/network-metrics-daemon-rdtdt" Jul 09 02:36:24.411094 ip-10-0-138-136 kubenswrapper[2583]: I0709 02:36:24.411072 2583 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/71cf0a89-d676-47f4-bf4a-d13d283493fc-metrics-certs\") pod \"network-metrics-daemon-rdtdt\" (UID: \"71cf0a89-d676-47f4-bf4a-d13d283493fc\") " pod="openshift-multus/network-metrics-daemon-rdtdt" Jul 09 02:36:24.434253 ip-10-0-138-136 kubenswrapper[2583]: I0709 02:36:24.434227 2583 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-sa-dockercfg-w8vs7\"" Jul 09 02:36:24.442821 ip-10-0-138-136 kubenswrapper[2583]: I0709 02:36:24.442804 2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-rdtdt" Jul 09 02:36:24.587156 ip-10-0-138-136 kubenswrapper[2583]: I0709 02:36:24.587085 2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-multus/network-metrics-daemon-rdtdt"] Jul 09 02:36:24.589410 ip-10-0-138-136 kubenswrapper[2583]: W0709 02:36:24.589382 2583 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod71cf0a89_d676_47f4_bf4a_d13d283493fc.slice/crio-eaad6ca0bdff07bdce1d1613c72386c90e390ffcce34176bc1392d26658805a2 WatchSource:0}: Error finding container eaad6ca0bdff07bdce1d1613c72386c90e390ffcce34176bc1392d26658805a2: Status 404 returned error can't find the container with id eaad6ca0bdff07bdce1d1613c72386c90e390ffcce34176bc1392d26658805a2 Jul 09 02:36:25.344044 ip-10-0-138-136 kubenswrapper[2583]: I0709 02:36:25.344001 2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-rdtdt" event={"ID":"71cf0a89-d676-47f4-bf4a-d13d283493fc","Type":"ContainerStarted","Data":"eaad6ca0bdff07bdce1d1613c72386c90e390ffcce34176bc1392d26658805a2"} Jul 09 02:36:26.244831 ip-10-0-138-136 kubenswrapper[2583]: I0709 02:36:26.244777 2583 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-console/console-5f6f6645cf-wqslf" podUID="9d75f511-b76b-4f36-9a0a-c83074c1ad1a" containerName="console" containerID="cri-o://6810e5d86ff5602e62b59d55197ca9327a9fc77e304aa3961790a9bf8ea5d1d7" gracePeriod=15 Jul 09 02:36:26.349836 ip-10-0-138-136 kubenswrapper[2583]: I0709 02:36:26.349804 2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-rdtdt" event={"ID":"71cf0a89-d676-47f4-bf4a-d13d283493fc","Type":"ContainerStarted","Data":"27959b4e3ca8a1e6679cea801c068b07ea1b71a62e568785d78b36791d285936"} Jul 09 02:36:26.559515 ip-10-0-138-136 kubenswrapper[2583]: I0709 02:36:26.559488 2583 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-5f6f6645cf-wqslf" Jul 09 02:36:26.624436 ip-10-0-138-136 kubenswrapper[2583]: I0709 02:36:26.624411 2583 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/9d75f511-b76b-4f36-9a0a-c83074c1ad1a-console-config\") pod \"9d75f511-b76b-4f36-9a0a-c83074c1ad1a\" (UID: \"9d75f511-b76b-4f36-9a0a-c83074c1ad1a\") " Jul 09 02:36:26.624531 ip-10-0-138-136 kubenswrapper[2583]: I0709 02:36:26.624439 2583 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/9d75f511-b76b-4f36-9a0a-c83074c1ad1a-console-oauth-config\") pod \"9d75f511-b76b-4f36-9a0a-c83074c1ad1a\" (UID: \"9d75f511-b76b-4f36-9a0a-c83074c1ad1a\") " Jul 09 02:36:26.624531 ip-10-0-138-136 kubenswrapper[2583]: I0709 02:36:26.624464 2583 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/9d75f511-b76b-4f36-9a0a-c83074c1ad1a-trusted-ca-bundle\") pod \"9d75f511-b76b-4f36-9a0a-c83074c1ad1a\" (UID: \"9d75f511-b76b-4f36-9a0a-c83074c1ad1a\") " Jul 09 02:36:26.624531 ip-10-0-138-136 kubenswrapper[2583]: I0709 02:36:26.624501 2583 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-jbk4z\" (UniqueName: \"kubernetes.io/projected/9d75f511-b76b-4f36-9a0a-c83074c1ad1a-kube-api-access-jbk4z\") pod \"9d75f511-b76b-4f36-9a0a-c83074c1ad1a\" (UID: \"9d75f511-b76b-4f36-9a0a-c83074c1ad1a\") " Jul 09 02:36:26.624643 ip-10-0-138-136 kubenswrapper[2583]: I0709 02:36:26.624557 2583 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/9d75f511-b76b-4f36-9a0a-c83074c1ad1a-service-ca\") pod \"9d75f511-b76b-4f36-9a0a-c83074c1ad1a\" (UID: \"9d75f511-b76b-4f36-9a0a-c83074c1ad1a\") " Jul 09 02:36:26.624643 ip-10-0-138-136 kubenswrapper[2583]: I0709 02:36:26.624608 2583 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/9d75f511-b76b-4f36-9a0a-c83074c1ad1a-oauth-serving-cert\") pod \"9d75f511-b76b-4f36-9a0a-c83074c1ad1a\" (UID: \"9d75f511-b76b-4f36-9a0a-c83074c1ad1a\") " Jul 09 02:36:26.624768 ip-10-0-138-136 kubenswrapper[2583]: I0709 02:36:26.624648 2583 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/9d75f511-b76b-4f36-9a0a-c83074c1ad1a-console-serving-cert\") pod \"9d75f511-b76b-4f36-9a0a-c83074c1ad1a\" (UID: \"9d75f511-b76b-4f36-9a0a-c83074c1ad1a\") " Jul 09 02:36:26.624954 ip-10-0-138-136 kubenswrapper[2583]: I0709 02:36:26.624919 2583 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/9d75f511-b76b-4f36-9a0a-c83074c1ad1a-trusted-ca-bundle" (OuterVolumeSpecName: "trusted-ca-bundle") pod "9d75f511-b76b-4f36-9a0a-c83074c1ad1a" (UID: "9d75f511-b76b-4f36-9a0a-c83074c1ad1a"). InnerVolumeSpecName "trusted-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 09 02:36:26.625066 ip-10-0-138-136 kubenswrapper[2583]: I0709 02:36:26.625015 2583 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/9d75f511-b76b-4f36-9a0a-c83074c1ad1a-service-ca" (OuterVolumeSpecName: "service-ca") pod "9d75f511-b76b-4f36-9a0a-c83074c1ad1a" (UID: "9d75f511-b76b-4f36-9a0a-c83074c1ad1a"). InnerVolumeSpecName "service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 09 02:36:26.625066 ip-10-0-138-136 kubenswrapper[2583]: I0709 02:36:26.625024 2583 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/9d75f511-b76b-4f36-9a0a-c83074c1ad1a-oauth-serving-cert" (OuterVolumeSpecName: "oauth-serving-cert") pod "9d75f511-b76b-4f36-9a0a-c83074c1ad1a" (UID: "9d75f511-b76b-4f36-9a0a-c83074c1ad1a"). InnerVolumeSpecName "oauth-serving-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 09 02:36:26.625163 ip-10-0-138-136 kubenswrapper[2583]: I0709 02:36:26.625116 2583 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/9d75f511-b76b-4f36-9a0a-c83074c1ad1a-console-config" (OuterVolumeSpecName: "console-config") pod "9d75f511-b76b-4f36-9a0a-c83074c1ad1a" (UID: "9d75f511-b76b-4f36-9a0a-c83074c1ad1a"). InnerVolumeSpecName "console-config". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 09 02:36:26.626521 ip-10-0-138-136 kubenswrapper[2583]: I0709 02:36:26.626492 2583 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/9d75f511-b76b-4f36-9a0a-c83074c1ad1a-console-oauth-config" (OuterVolumeSpecName: "console-oauth-config") pod "9d75f511-b76b-4f36-9a0a-c83074c1ad1a" (UID: "9d75f511-b76b-4f36-9a0a-c83074c1ad1a"). InnerVolumeSpecName "console-oauth-config". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 09 02:36:26.626617 ip-10-0-138-136 kubenswrapper[2583]: I0709 02:36:26.626550 2583 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/9d75f511-b76b-4f36-9a0a-c83074c1ad1a-console-serving-cert" (OuterVolumeSpecName: "console-serving-cert") pod "9d75f511-b76b-4f36-9a0a-c83074c1ad1a" (UID: "9d75f511-b76b-4f36-9a0a-c83074c1ad1a"). InnerVolumeSpecName "console-serving-cert". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 09 02:36:26.626617 ip-10-0-138-136 kubenswrapper[2583]: I0709 02:36:26.626563 2583 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/9d75f511-b76b-4f36-9a0a-c83074c1ad1a-kube-api-access-jbk4z" (OuterVolumeSpecName: "kube-api-access-jbk4z") pod "9d75f511-b76b-4f36-9a0a-c83074c1ad1a" (UID: "9d75f511-b76b-4f36-9a0a-c83074c1ad1a"). InnerVolumeSpecName "kube-api-access-jbk4z". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 09 02:36:26.725730 ip-10-0-138-136 kubenswrapper[2583]: I0709 02:36:26.725657 2583 reconciler_common.go:299] "Volume detached for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/9d75f511-b76b-4f36-9a0a-c83074c1ad1a-console-config\") on node \"ip-10-0-138-136.ec2.internal\" DevicePath \"\"" Jul 09 02:36:26.725730 ip-10-0-138-136 kubenswrapper[2583]: I0709 02:36:26.725676 2583 reconciler_common.go:299] "Volume detached for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/9d75f511-b76b-4f36-9a0a-c83074c1ad1a-console-oauth-config\") on node \"ip-10-0-138-136.ec2.internal\" DevicePath \"\"" Jul 09 02:36:26.725730 ip-10-0-138-136 kubenswrapper[2583]: I0709 02:36:26.725687 2583 reconciler_common.go:299] "Volume detached for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/9d75f511-b76b-4f36-9a0a-c83074c1ad1a-trusted-ca-bundle\") on node \"ip-10-0-138-136.ec2.internal\" DevicePath \"\"" Jul 09 02:36:26.725730 ip-10-0-138-136 kubenswrapper[2583]: I0709 02:36:26.725696 2583 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-jbk4z\" (UniqueName: \"kubernetes.io/projected/9d75f511-b76b-4f36-9a0a-c83074c1ad1a-kube-api-access-jbk4z\") on node \"ip-10-0-138-136.ec2.internal\" DevicePath \"\"" Jul 09 02:36:26.725730 ip-10-0-138-136 kubenswrapper[2583]: I0709 02:36:26.725705 2583 reconciler_common.go:299] "Volume detached for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/9d75f511-b76b-4f36-9a0a-c83074c1ad1a-service-ca\") on node \"ip-10-0-138-136.ec2.internal\" DevicePath \"\"" Jul 09 02:36:26.725730 ip-10-0-138-136 kubenswrapper[2583]: I0709 02:36:26.725731 2583 reconciler_common.go:299] "Volume detached for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/9d75f511-b76b-4f36-9a0a-c83074c1ad1a-oauth-serving-cert\") on node \"ip-10-0-138-136.ec2.internal\" DevicePath \"\"" Jul 09 02:36:26.725979 ip-10-0-138-136 kubenswrapper[2583]: I0709 02:36:26.725739 2583 reconciler_common.go:299] "Volume detached for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/9d75f511-b76b-4f36-9a0a-c83074c1ad1a-console-serving-cert\") on node \"ip-10-0-138-136.ec2.internal\" DevicePath \"\"" Jul 09 02:36:27.355865 ip-10-0-138-136 kubenswrapper[2583]: I0709 02:36:27.355831 2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-rdtdt" event={"ID":"71cf0a89-d676-47f4-bf4a-d13d283493fc","Type":"ContainerStarted","Data":"af7a5773ed09350bf51b661e19991e8309c38520ed7a1a7c442d5926e62ecd39"} Jul 09 02:36:27.357070 ip-10-0-138-136 kubenswrapper[2583]: I0709 02:36:27.357048 2583 generic.go:356] "Generic (PLEG): container finished" podID="9d75f511-b76b-4f36-9a0a-c83074c1ad1a" containerID="6810e5d86ff5602e62b59d55197ca9327a9fc77e304aa3961790a9bf8ea5d1d7" exitCode=0 Jul 09 02:36:27.357186 ip-10-0-138-136 kubenswrapper[2583]: I0709 02:36:27.357097 2583 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-5f6f6645cf-wqslf" Jul 09 02:36:27.357186 ip-10-0-138-136 kubenswrapper[2583]: I0709 02:36:27.357130 2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-5f6f6645cf-wqslf" event={"ID":"9d75f511-b76b-4f36-9a0a-c83074c1ad1a","Type":"ContainerDied","Data":"6810e5d86ff5602e62b59d55197ca9327a9fc77e304aa3961790a9bf8ea5d1d7"} Jul 09 02:36:27.357186 ip-10-0-138-136 kubenswrapper[2583]: I0709 02:36:27.357170 2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-5f6f6645cf-wqslf" event={"ID":"9d75f511-b76b-4f36-9a0a-c83074c1ad1a","Type":"ContainerDied","Data":"e5c73aedd8fd215a8ac9259c26eb1e1f9e668ee8937ab057d1bef50f2cb8811e"} Jul 09 02:36:27.357349 ip-10-0-138-136 kubenswrapper[2583]: I0709 02:36:27.357190 2583 scope.go:117] "RemoveContainer" containerID="6810e5d86ff5602e62b59d55197ca9327a9fc77e304aa3961790a9bf8ea5d1d7" Jul 09 02:36:27.365429 ip-10-0-138-136 kubenswrapper[2583]: I0709 02:36:27.365413 2583 scope.go:117] "RemoveContainer" containerID="6810e5d86ff5602e62b59d55197ca9327a9fc77e304aa3961790a9bf8ea5d1d7" Jul 09 02:36:27.365658 ip-10-0-138-136 kubenswrapper[2583]: E0709 02:36:27.365640 2583 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"6810e5d86ff5602e62b59d55197ca9327a9fc77e304aa3961790a9bf8ea5d1d7\": container with ID starting with 6810e5d86ff5602e62b59d55197ca9327a9fc77e304aa3961790a9bf8ea5d1d7 not found: ID does not exist" containerID="6810e5d86ff5602e62b59d55197ca9327a9fc77e304aa3961790a9bf8ea5d1d7" Jul 09 02:36:27.365696 ip-10-0-138-136 kubenswrapper[2583]: I0709 02:36:27.365664 2583 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"6810e5d86ff5602e62b59d55197ca9327a9fc77e304aa3961790a9bf8ea5d1d7"} err="failed to get container status \"6810e5d86ff5602e62b59d55197ca9327a9fc77e304aa3961790a9bf8ea5d1d7\": rpc error: code = NotFound desc = could not find container \"6810e5d86ff5602e62b59d55197ca9327a9fc77e304aa3961790a9bf8ea5d1d7\": container with ID starting with 6810e5d86ff5602e62b59d55197ca9327a9fc77e304aa3961790a9bf8ea5d1d7 not found: ID does not exist" Jul 09 02:36:27.372096 ip-10-0-138-136 kubenswrapper[2583]: I0709 02:36:27.372061 2583 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/network-metrics-daemon-rdtdt" podStartSLOduration=130.841532987 podStartE2EDuration="2m12.372048471s" totalImagesPullingTime="1.530515484s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-09 02:34:15 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-09 02:36:27.371572134 +0000 UTC m=+133.304029624" watchObservedRunningTime="2026-07-09 02:36:27.372048471 +0000 UTC m=+133.304505957" Jul 09 02:36:27.389611 ip-10-0-138-136 kubenswrapper[2583]: I0709 02:36:27.389591 2583 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-5f6f6645cf-wqslf"] Jul 09 02:36:27.395530 ip-10-0-138-136 kubenswrapper[2583]: I0709 02:36:27.395509 2583 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-console/console-5f6f6645cf-wqslf"] Jul 09 02:36:28.601737 ip-10-0-138-136 kubenswrapper[2583]: I0709 02:36:28.601692 2583 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="9d75f511-b76b-4f36-9a0a-c83074c1ad1a" path="/var/lib/kubelet/pods/9d75f511-b76b-4f36-9a0a-c83074c1ad1a/volumes" Jul 09 02:36:30.914571 ip-10-0-138-136 kubenswrapper[2583]: I0709 02:36:30.914503 2583 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-image-registry/image-registry-59569495f9-rmmlc" podUID="9af4ab52-6748-4090-a7a0-8666391d9bfa" containerName="registry" containerID="cri-o://1ebbc8fc474ad56365090b179eb5557e95a1bfbfb0651b7b90e97216f3cee3a4" gracePeriod=30 Jul 09 02:36:31.192409 ip-10-0-138-136 kubenswrapper[2583]: I0709 02:36:31.192352 2583 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-59569495f9-rmmlc" Jul 09 02:36:31.261883 ip-10-0-138-136 kubenswrapper[2583]: I0709 02:36:31.261857 2583 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/9af4ab52-6748-4090-a7a0-8666391d9bfa-image-registry-private-configuration\") pod \"9af4ab52-6748-4090-a7a0-8666391d9bfa\" (UID: \"9af4ab52-6748-4090-a7a0-8666391d9bfa\") " Jul 09 02:36:31.261998 ip-10-0-138-136 kubenswrapper[2583]: I0709 02:36:31.261887 2583 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-vstrs\" (UniqueName: \"kubernetes.io/projected/9af4ab52-6748-4090-a7a0-8666391d9bfa-kube-api-access-vstrs\") pod \"9af4ab52-6748-4090-a7a0-8666391d9bfa\" (UID: \"9af4ab52-6748-4090-a7a0-8666391d9bfa\") " Jul 09 02:36:31.261998 ip-10-0-138-136 kubenswrapper[2583]: I0709 02:36:31.261909 2583 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/9af4ab52-6748-4090-a7a0-8666391d9bfa-bound-sa-token\") pod \"9af4ab52-6748-4090-a7a0-8666391d9bfa\" (UID: \"9af4ab52-6748-4090-a7a0-8666391d9bfa\") " Jul 09 02:36:31.261998 ip-10-0-138-136 kubenswrapper[2583]: I0709 02:36:31.261939 2583 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/9af4ab52-6748-4090-a7a0-8666391d9bfa-registry-tls\") pod \"9af4ab52-6748-4090-a7a0-8666391d9bfa\" (UID: \"9af4ab52-6748-4090-a7a0-8666391d9bfa\") " Jul 09 02:36:31.261998 ip-10-0-138-136 kubenswrapper[2583]: I0709 02:36:31.261974 2583 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/9af4ab52-6748-4090-a7a0-8666391d9bfa-trusted-ca\") pod \"9af4ab52-6748-4090-a7a0-8666391d9bfa\" (UID: \"9af4ab52-6748-4090-a7a0-8666391d9bfa\") " Jul 09 02:36:31.261998 ip-10-0-138-136 kubenswrapper[2583]: I0709 02:36:31.261999 2583 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/9af4ab52-6748-4090-a7a0-8666391d9bfa-registry-certificates\") pod \"9af4ab52-6748-4090-a7a0-8666391d9bfa\" (UID: \"9af4ab52-6748-4090-a7a0-8666391d9bfa\") " Jul 09 02:36:31.262246 ip-10-0-138-136 kubenswrapper[2583]: I0709 02:36:31.262017 2583 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/9af4ab52-6748-4090-a7a0-8666391d9bfa-ca-trust-extracted\") pod \"9af4ab52-6748-4090-a7a0-8666391d9bfa\" (UID: \"9af4ab52-6748-4090-a7a0-8666391d9bfa\") " Jul 09 02:36:31.262246 ip-10-0-138-136 kubenswrapper[2583]: I0709 02:36:31.262037 2583 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/9af4ab52-6748-4090-a7a0-8666391d9bfa-installation-pull-secrets\") pod \"9af4ab52-6748-4090-a7a0-8666391d9bfa\" (UID: \"9af4ab52-6748-4090-a7a0-8666391d9bfa\") " Jul 09 02:36:31.262508 ip-10-0-138-136 kubenswrapper[2583]: I0709 02:36:31.262419 2583 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/9af4ab52-6748-4090-a7a0-8666391d9bfa-registry-certificates" (OuterVolumeSpecName: "registry-certificates") pod "9af4ab52-6748-4090-a7a0-8666391d9bfa" (UID: "9af4ab52-6748-4090-a7a0-8666391d9bfa"). InnerVolumeSpecName "registry-certificates". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 09 02:36:31.262508 ip-10-0-138-136 kubenswrapper[2583]: I0709 02:36:31.262457 2583 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/9af4ab52-6748-4090-a7a0-8666391d9bfa-trusted-ca" (OuterVolumeSpecName: "trusted-ca") pod "9af4ab52-6748-4090-a7a0-8666391d9bfa" (UID: "9af4ab52-6748-4090-a7a0-8666391d9bfa"). InnerVolumeSpecName "trusted-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 09 02:36:31.264525 ip-10-0-138-136 kubenswrapper[2583]: I0709 02:36:31.264494 2583 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/9af4ab52-6748-4090-a7a0-8666391d9bfa-registry-tls" (OuterVolumeSpecName: "registry-tls") pod "9af4ab52-6748-4090-a7a0-8666391d9bfa" (UID: "9af4ab52-6748-4090-a7a0-8666391d9bfa"). InnerVolumeSpecName "registry-tls". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 09 02:36:31.264911 ip-10-0-138-136 kubenswrapper[2583]: I0709 02:36:31.264884 2583 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/9af4ab52-6748-4090-a7a0-8666391d9bfa-installation-pull-secrets" (OuterVolumeSpecName: "installation-pull-secrets") pod "9af4ab52-6748-4090-a7a0-8666391d9bfa" (UID: "9af4ab52-6748-4090-a7a0-8666391d9bfa"). InnerVolumeSpecName "installation-pull-secrets". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 09 02:36:31.264911 ip-10-0-138-136 kubenswrapper[2583]: I0709 02:36:31.264896 2583 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/9af4ab52-6748-4090-a7a0-8666391d9bfa-bound-sa-token" (OuterVolumeSpecName: "bound-sa-token") pod "9af4ab52-6748-4090-a7a0-8666391d9bfa" (UID: "9af4ab52-6748-4090-a7a0-8666391d9bfa"). InnerVolumeSpecName "bound-sa-token". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 09 02:36:31.265010 ip-10-0-138-136 kubenswrapper[2583]: I0709 02:36:31.264975 2583 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/9af4ab52-6748-4090-a7a0-8666391d9bfa-kube-api-access-vstrs" (OuterVolumeSpecName: "kube-api-access-vstrs") pod "9af4ab52-6748-4090-a7a0-8666391d9bfa" (UID: "9af4ab52-6748-4090-a7a0-8666391d9bfa"). InnerVolumeSpecName "kube-api-access-vstrs". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 09 02:36:31.265146 ip-10-0-138-136 kubenswrapper[2583]: I0709 02:36:31.265124 2583 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/9af4ab52-6748-4090-a7a0-8666391d9bfa-image-registry-private-configuration" (OuterVolumeSpecName: "image-registry-private-configuration") pod "9af4ab52-6748-4090-a7a0-8666391d9bfa" (UID: "9af4ab52-6748-4090-a7a0-8666391d9bfa"). InnerVolumeSpecName "image-registry-private-configuration". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 09 02:36:31.272867 ip-10-0-138-136 kubenswrapper[2583]: I0709 02:36:31.272841 2583 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/9af4ab52-6748-4090-a7a0-8666391d9bfa-ca-trust-extracted" (OuterVolumeSpecName: "ca-trust-extracted") pod "9af4ab52-6748-4090-a7a0-8666391d9bfa" (UID: "9af4ab52-6748-4090-a7a0-8666391d9bfa"). InnerVolumeSpecName "ca-trust-extracted". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 09 02:36:31.363385 ip-10-0-138-136 kubenswrapper[2583]: I0709 02:36:31.363343 2583 reconciler_common.go:299] "Volume detached for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/9af4ab52-6748-4090-a7a0-8666391d9bfa-trusted-ca\") on node \"ip-10-0-138-136.ec2.internal\" DevicePath \"\"" Jul 09 02:36:31.363385 ip-10-0-138-136 kubenswrapper[2583]: I0709 02:36:31.363380 2583 reconciler_common.go:299] "Volume detached for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/9af4ab52-6748-4090-a7a0-8666391d9bfa-registry-certificates\") on node \"ip-10-0-138-136.ec2.internal\" DevicePath \"\"" Jul 09 02:36:31.363584 ip-10-0-138-136 kubenswrapper[2583]: I0709 02:36:31.363395 2583 reconciler_common.go:299] "Volume detached for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/9af4ab52-6748-4090-a7a0-8666391d9bfa-ca-trust-extracted\") on node \"ip-10-0-138-136.ec2.internal\" DevicePath \"\"" Jul 09 02:36:31.363584 ip-10-0-138-136 kubenswrapper[2583]: I0709 02:36:31.363410 2583 reconciler_common.go:299] "Volume detached for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/9af4ab52-6748-4090-a7a0-8666391d9bfa-installation-pull-secrets\") on node \"ip-10-0-138-136.ec2.internal\" DevicePath \"\"" Jul 09 02:36:31.363584 ip-10-0-138-136 kubenswrapper[2583]: I0709 02:36:31.363425 2583 reconciler_common.go:299] "Volume detached for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/9af4ab52-6748-4090-a7a0-8666391d9bfa-image-registry-private-configuration\") on node \"ip-10-0-138-136.ec2.internal\" DevicePath \"\"" Jul 09 02:36:31.363584 ip-10-0-138-136 kubenswrapper[2583]: I0709 02:36:31.363439 2583 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-vstrs\" (UniqueName: \"kubernetes.io/projected/9af4ab52-6748-4090-a7a0-8666391d9bfa-kube-api-access-vstrs\") on node \"ip-10-0-138-136.ec2.internal\" DevicePath \"\"" Jul 09 02:36:31.363584 ip-10-0-138-136 kubenswrapper[2583]: I0709 02:36:31.363451 2583 reconciler_common.go:299] "Volume detached for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/9af4ab52-6748-4090-a7a0-8666391d9bfa-bound-sa-token\") on node \"ip-10-0-138-136.ec2.internal\" DevicePath \"\"" Jul 09 02:36:31.363584 ip-10-0-138-136 kubenswrapper[2583]: I0709 02:36:31.363465 2583 reconciler_common.go:299] "Volume detached for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/9af4ab52-6748-4090-a7a0-8666391d9bfa-registry-tls\") on node \"ip-10-0-138-136.ec2.internal\" DevicePath \"\"" Jul 09 02:36:31.380977 ip-10-0-138-136 kubenswrapper[2583]: I0709 02:36:31.380949 2583 generic.go:356] "Generic (PLEG): container finished" podID="9d809968-31d3-4c4d-be19-234664db4a04" containerID="cfbba10f595be98af16c381cf49a0ae9363a12aca7494e0805e8d4925585c936" exitCode=0 Jul 09 02:36:31.381108 ip-10-0-138-136 kubenswrapper[2583]: I0709 02:36:31.381026 2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-846bf668f7-vls7g" event={"ID":"9d809968-31d3-4c4d-be19-234664db4a04","Type":"ContainerDied","Data":"cfbba10f595be98af16c381cf49a0ae9363a12aca7494e0805e8d4925585c936"} Jul 09 02:36:31.381414 ip-10-0-138-136 kubenswrapper[2583]: I0709 02:36:31.381398 2583 scope.go:117] "RemoveContainer" containerID="cfbba10f595be98af16c381cf49a0ae9363a12aca7494e0805e8d4925585c936" Jul 09 02:36:31.382526 ip-10-0-138-136 kubenswrapper[2583]: I0709 02:36:31.382504 2583 generic.go:356] "Generic (PLEG): container finished" podID="9af4ab52-6748-4090-a7a0-8666391d9bfa" containerID="1ebbc8fc474ad56365090b179eb5557e95a1bfbfb0651b7b90e97216f3cee3a4" exitCode=0 Jul 09 02:36:31.382614 ip-10-0-138-136 kubenswrapper[2583]: I0709 02:36:31.382555 2583 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-59569495f9-rmmlc" Jul 09 02:36:31.382614 ip-10-0-138-136 kubenswrapper[2583]: I0709 02:36:31.382558 2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-59569495f9-rmmlc" event={"ID":"9af4ab52-6748-4090-a7a0-8666391d9bfa","Type":"ContainerDied","Data":"1ebbc8fc474ad56365090b179eb5557e95a1bfbfb0651b7b90e97216f3cee3a4"} Jul 09 02:36:31.382614 ip-10-0-138-136 kubenswrapper[2583]: I0709 02:36:31.382600 2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-59569495f9-rmmlc" event={"ID":"9af4ab52-6748-4090-a7a0-8666391d9bfa","Type":"ContainerDied","Data":"1b86d0c5bc103d727ff7526bb81d3e5bdc38d746f3435c3f9498240a581bfe3e"} Jul 09 02:36:31.383333 ip-10-0-138-136 kubenswrapper[2583]: I0709 02:36:31.382625 2583 scope.go:117] "RemoveContainer" containerID="1ebbc8fc474ad56365090b179eb5557e95a1bfbfb0651b7b90e97216f3cee3a4" Jul 09 02:36:31.392340 ip-10-0-138-136 kubenswrapper[2583]: I0709 02:36:31.392323 2583 scope.go:117] "RemoveContainer" containerID="1ebbc8fc474ad56365090b179eb5557e95a1bfbfb0651b7b90e97216f3cee3a4" Jul 09 02:36:31.392733 ip-10-0-138-136 kubenswrapper[2583]: E0709 02:36:31.392689 2583 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"1ebbc8fc474ad56365090b179eb5557e95a1bfbfb0651b7b90e97216f3cee3a4\": container with ID starting with 1ebbc8fc474ad56365090b179eb5557e95a1bfbfb0651b7b90e97216f3cee3a4 not found: ID does not exist" containerID="1ebbc8fc474ad56365090b179eb5557e95a1bfbfb0651b7b90e97216f3cee3a4" Jul 09 02:36:31.392846 ip-10-0-138-136 kubenswrapper[2583]: I0709 02:36:31.392742 2583 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"1ebbc8fc474ad56365090b179eb5557e95a1bfbfb0651b7b90e97216f3cee3a4"} err="failed to get container status \"1ebbc8fc474ad56365090b179eb5557e95a1bfbfb0651b7b90e97216f3cee3a4\": rpc error: code = NotFound desc = could not find container \"1ebbc8fc474ad56365090b179eb5557e95a1bfbfb0651b7b90e97216f3cee3a4\": container with ID starting with 1ebbc8fc474ad56365090b179eb5557e95a1bfbfb0651b7b90e97216f3cee3a4 not found: ID does not exist" Jul 09 02:36:31.438314 ip-10-0-138-136 kubenswrapper[2583]: I0709 02:36:31.438289 2583 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-image-registry/image-registry-59569495f9-rmmlc"] Jul 09 02:36:31.445667 ip-10-0-138-136 kubenswrapper[2583]: I0709 02:36:31.445617 2583 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-image-registry/image-registry-59569495f9-rmmlc"] Jul 09 02:36:32.391880 ip-10-0-138-136 kubenswrapper[2583]: I0709 02:36:32.391468 2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-846bf668f7-vls7g" event={"ID":"9d809968-31d3-4c4d-be19-234664db4a04","Type":"ContainerStarted","Data":"3427985ac72279380ba926ffc46807f3927428ea5e5525596ea252929c21c06b"} Jul 09 02:36:32.602731 ip-10-0-138-136 kubenswrapper[2583]: I0709 02:36:32.602686 2583 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="9af4ab52-6748-4090-a7a0-8666391d9bfa" path="/var/lib/kubelet/pods/9af4ab52-6748-4090-a7a0-8666391d9bfa/volumes" Jul 09 02:36:36.345015 ip-10-0-138-136 kubenswrapper[2583]: I0709 02:36:36.344973 2583 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-console/console-685c668687-g6tbb" podUID="5b71dc06-285e-4368-a793-2615514cfc97" containerName="console" containerID="cri-o://c67a2edca5d82ec1fab114e7ada2d87f1b451ec88bdc39fbdf63b171739127b5" gracePeriod=15 Jul 09 02:36:36.620686 ip-10-0-138-136 kubenswrapper[2583]: I0709 02:36:36.620652 2583 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-685c668687-g6tbb" Jul 09 02:36:36.710942 ip-10-0-138-136 kubenswrapper[2583]: I0709 02:36:36.710917 2583 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/5b71dc06-285e-4368-a793-2615514cfc97-oauth-serving-cert\") pod \"5b71dc06-285e-4368-a793-2615514cfc97\" (UID: \"5b71dc06-285e-4368-a793-2615514cfc97\") " Jul 09 02:36:36.711108 ip-10-0-138-136 kubenswrapper[2583]: I0709 02:36:36.710961 2583 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/5b71dc06-285e-4368-a793-2615514cfc97-console-serving-cert\") pod \"5b71dc06-285e-4368-a793-2615514cfc97\" (UID: \"5b71dc06-285e-4368-a793-2615514cfc97\") " Jul 09 02:36:36.711108 ip-10-0-138-136 kubenswrapper[2583]: I0709 02:36:36.711018 2583 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-krkqb\" (UniqueName: \"kubernetes.io/projected/5b71dc06-285e-4368-a793-2615514cfc97-kube-api-access-krkqb\") pod \"5b71dc06-285e-4368-a793-2615514cfc97\" (UID: \"5b71dc06-285e-4368-a793-2615514cfc97\") " Jul 09 02:36:36.711108 ip-10-0-138-136 kubenswrapper[2583]: I0709 02:36:36.711038 2583 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/5b71dc06-285e-4368-a793-2615514cfc97-service-ca\") pod \"5b71dc06-285e-4368-a793-2615514cfc97\" (UID: \"5b71dc06-285e-4368-a793-2615514cfc97\") " Jul 09 02:36:36.711108 ip-10-0-138-136 kubenswrapper[2583]: I0709 02:36:36.711057 2583 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/5b71dc06-285e-4368-a793-2615514cfc97-console-config\") pod \"5b71dc06-285e-4368-a793-2615514cfc97\" (UID: \"5b71dc06-285e-4368-a793-2615514cfc97\") " Jul 09 02:36:36.711108 ip-10-0-138-136 kubenswrapper[2583]: I0709 02:36:36.711074 2583 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/5b71dc06-285e-4368-a793-2615514cfc97-console-oauth-config\") pod \"5b71dc06-285e-4368-a793-2615514cfc97\" (UID: \"5b71dc06-285e-4368-a793-2615514cfc97\") " Jul 09 02:36:36.711404 ip-10-0-138-136 kubenswrapper[2583]: I0709 02:36:36.711374 2583 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/5b71dc06-285e-4368-a793-2615514cfc97-oauth-serving-cert" (OuterVolumeSpecName: "oauth-serving-cert") pod "5b71dc06-285e-4368-a793-2615514cfc97" (UID: "5b71dc06-285e-4368-a793-2615514cfc97"). InnerVolumeSpecName "oauth-serving-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 09 02:36:36.711460 ip-10-0-138-136 kubenswrapper[2583]: I0709 02:36:36.711427 2583 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/5b71dc06-285e-4368-a793-2615514cfc97-console-config" (OuterVolumeSpecName: "console-config") pod "5b71dc06-285e-4368-a793-2615514cfc97" (UID: "5b71dc06-285e-4368-a793-2615514cfc97"). InnerVolumeSpecName "console-config". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 09 02:36:36.711460 ip-10-0-138-136 kubenswrapper[2583]: I0709 02:36:36.711445 2583 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/5b71dc06-285e-4368-a793-2615514cfc97-service-ca" (OuterVolumeSpecName: "service-ca") pod "5b71dc06-285e-4368-a793-2615514cfc97" (UID: "5b71dc06-285e-4368-a793-2615514cfc97"). InnerVolumeSpecName "service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 09 02:36:36.713096 ip-10-0-138-136 kubenswrapper[2583]: I0709 02:36:36.713069 2583 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/5b71dc06-285e-4368-a793-2615514cfc97-console-serving-cert" (OuterVolumeSpecName: "console-serving-cert") pod "5b71dc06-285e-4368-a793-2615514cfc97" (UID: "5b71dc06-285e-4368-a793-2615514cfc97"). InnerVolumeSpecName "console-serving-cert". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 09 02:36:36.713207 ip-10-0-138-136 kubenswrapper[2583]: I0709 02:36:36.713173 2583 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/5b71dc06-285e-4368-a793-2615514cfc97-console-oauth-config" (OuterVolumeSpecName: "console-oauth-config") pod "5b71dc06-285e-4368-a793-2615514cfc97" (UID: "5b71dc06-285e-4368-a793-2615514cfc97"). InnerVolumeSpecName "console-oauth-config". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 09 02:36:36.713248 ip-10-0-138-136 kubenswrapper[2583]: I0709 02:36:36.713186 2583 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/5b71dc06-285e-4368-a793-2615514cfc97-kube-api-access-krkqb" (OuterVolumeSpecName: "kube-api-access-krkqb") pod "5b71dc06-285e-4368-a793-2615514cfc97" (UID: "5b71dc06-285e-4368-a793-2615514cfc97"). InnerVolumeSpecName "kube-api-access-krkqb". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 09 02:36:36.812338 ip-10-0-138-136 kubenswrapper[2583]: I0709 02:36:36.812312 2583 reconciler_common.go:299] "Volume detached for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/5b71dc06-285e-4368-a793-2615514cfc97-oauth-serving-cert\") on node \"ip-10-0-138-136.ec2.internal\" DevicePath \"\"" Jul 09 02:36:36.812338 ip-10-0-138-136 kubenswrapper[2583]: I0709 02:36:36.812336 2583 reconciler_common.go:299] "Volume detached for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/5b71dc06-285e-4368-a793-2615514cfc97-console-serving-cert\") on node \"ip-10-0-138-136.ec2.internal\" DevicePath \"\"" Jul 09 02:36:36.812465 ip-10-0-138-136 kubenswrapper[2583]: I0709 02:36:36.812346 2583 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-krkqb\" (UniqueName: \"kubernetes.io/projected/5b71dc06-285e-4368-a793-2615514cfc97-kube-api-access-krkqb\") on node \"ip-10-0-138-136.ec2.internal\" DevicePath \"\"" Jul 09 02:36:36.812465 ip-10-0-138-136 kubenswrapper[2583]: I0709 02:36:36.812366 2583 reconciler_common.go:299] "Volume detached for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/5b71dc06-285e-4368-a793-2615514cfc97-service-ca\") on node \"ip-10-0-138-136.ec2.internal\" DevicePath \"\"" Jul 09 02:36:36.812465 ip-10-0-138-136 kubenswrapper[2583]: I0709 02:36:36.812375 2583 reconciler_common.go:299] "Volume detached for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/5b71dc06-285e-4368-a793-2615514cfc97-console-config\") on node \"ip-10-0-138-136.ec2.internal\" DevicePath \"\"" Jul 09 02:36:36.812465 ip-10-0-138-136 kubenswrapper[2583]: I0709 02:36:36.812383 2583 reconciler_common.go:299] "Volume detached for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/5b71dc06-285e-4368-a793-2615514cfc97-console-oauth-config\") on node \"ip-10-0-138-136.ec2.internal\" DevicePath \"\"" Jul 09 02:36:37.418419 ip-10-0-138-136 kubenswrapper[2583]: I0709 02:36:37.418385 2583 generic.go:356] "Generic (PLEG): container finished" podID="5b71dc06-285e-4368-a793-2615514cfc97" containerID="c67a2edca5d82ec1fab114e7ada2d87f1b451ec88bdc39fbdf63b171739127b5" exitCode=0 Jul 09 02:36:37.418784 ip-10-0-138-136 kubenswrapper[2583]: I0709 02:36:37.418423 2583 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-685c668687-g6tbb" Jul 09 02:36:37.418784 ip-10-0-138-136 kubenswrapper[2583]: I0709 02:36:37.418453 2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-685c668687-g6tbb" event={"ID":"5b71dc06-285e-4368-a793-2615514cfc97","Type":"ContainerDied","Data":"c67a2edca5d82ec1fab114e7ada2d87f1b451ec88bdc39fbdf63b171739127b5"} Jul 09 02:36:37.418784 ip-10-0-138-136 kubenswrapper[2583]: I0709 02:36:37.418504 2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-685c668687-g6tbb" event={"ID":"5b71dc06-285e-4368-a793-2615514cfc97","Type":"ContainerDied","Data":"eb2cd0ac5ae2b7ec67af106805cb6bc5452ce77b846c9c2ce166aa940a401b6c"} Jul 09 02:36:37.418784 ip-10-0-138-136 kubenswrapper[2583]: I0709 02:36:37.418532 2583 scope.go:117] "RemoveContainer" containerID="c67a2edca5d82ec1fab114e7ada2d87f1b451ec88bdc39fbdf63b171739127b5" Jul 09 02:36:37.427462 ip-10-0-138-136 kubenswrapper[2583]: I0709 02:36:37.427446 2583 scope.go:117] "RemoveContainer" containerID="c67a2edca5d82ec1fab114e7ada2d87f1b451ec88bdc39fbdf63b171739127b5" Jul 09 02:36:37.427706 ip-10-0-138-136 kubenswrapper[2583]: E0709 02:36:37.427689 2583 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"c67a2edca5d82ec1fab114e7ada2d87f1b451ec88bdc39fbdf63b171739127b5\": container with ID starting with c67a2edca5d82ec1fab114e7ada2d87f1b451ec88bdc39fbdf63b171739127b5 not found: ID does not exist" containerID="c67a2edca5d82ec1fab114e7ada2d87f1b451ec88bdc39fbdf63b171739127b5" Jul 09 02:36:37.427844 ip-10-0-138-136 kubenswrapper[2583]: I0709 02:36:37.427733 2583 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"c67a2edca5d82ec1fab114e7ada2d87f1b451ec88bdc39fbdf63b171739127b5"} err="failed to get container status \"c67a2edca5d82ec1fab114e7ada2d87f1b451ec88bdc39fbdf63b171739127b5\": rpc error: code = NotFound desc = could not find container \"c67a2edca5d82ec1fab114e7ada2d87f1b451ec88bdc39fbdf63b171739127b5\": container with ID starting with c67a2edca5d82ec1fab114e7ada2d87f1b451ec88bdc39fbdf63b171739127b5 not found: ID does not exist" Jul 09 02:36:37.438808 ip-10-0-138-136 kubenswrapper[2583]: I0709 02:36:37.438786 2583 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-685c668687-g6tbb"] Jul 09 02:36:37.446082 ip-10-0-138-136 kubenswrapper[2583]: I0709 02:36:37.446062 2583 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-console/console-685c668687-g6tbb"] Jul 09 02:36:38.606206 ip-10-0-138-136 kubenswrapper[2583]: I0709 02:36:38.606174 2583 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="5b71dc06-285e-4368-a793-2615514cfc97" path="/var/lib/kubelet/pods/5b71dc06-285e-4368-a793-2615514cfc97/volumes" Jul 09 02:36:40.435188 ip-10-0-138-136 kubenswrapper[2583]: I0709 02:36:40.435115 2583 generic.go:356] "Generic (PLEG): container finished" podID="6dedc04e-aa0e-4c21-829e-c0a6619b5c22" containerID="ca041bf215f03e52b863c93a8c526693c1cf3028bab77c294ff5c3f5f22143aa" exitCode=0 Jul 09 02:36:40.435489 ip-10-0-138-136 kubenswrapper[2583]: I0709 02:36:40.435192 2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-service-ca-operator/service-ca-operator-5d46d9ffd4-p9zgk" event={"ID":"6dedc04e-aa0e-4c21-829e-c0a6619b5c22","Type":"ContainerDied","Data":"ca041bf215f03e52b863c93a8c526693c1cf3028bab77c294ff5c3f5f22143aa"} Jul 09 02:36:40.435533 ip-10-0-138-136 kubenswrapper[2583]: I0709 02:36:40.435495 2583 scope.go:117] "RemoveContainer" containerID="ca041bf215f03e52b863c93a8c526693c1cf3028bab77c294ff5c3f5f22143aa" Jul 09 02:36:41.441865 ip-10-0-138-136 kubenswrapper[2583]: I0709 02:36:41.441831 2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-service-ca-operator/service-ca-operator-5d46d9ffd4-p9zgk" event={"ID":"6dedc04e-aa0e-4c21-829e-c0a6619b5c22","Type":"ContainerStarted","Data":"fc548ecec358d6778ec1f44facc1d4895802f629ac8ad3d354790792044cfc31"} Jul 09 02:36:45.486160 ip-10-0-138-136 kubenswrapper[2583]: I0709 02:36:45.486111 2583 prober.go:120] "Probe failed" probeType="Liveness" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-5f9bc9c474-jgh2b" podUID="325f97fc-73c3-48ba-b98c-75b19f491201" containerName="service-proxy" probeResult="failure" output="HTTP probe failed with statuscode: 500" Jul 09 02:36:55.486143 ip-10-0-138-136 kubenswrapper[2583]: I0709 02:36:55.486100 2583 prober.go:120] "Probe failed" probeType="Liveness" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-5f9bc9c474-jgh2b" podUID="325f97fc-73c3-48ba-b98c-75b19f491201" containerName="service-proxy" probeResult="failure" output="HTTP probe failed with statuscode: 500" Jul 09 02:37:05.485808 ip-10-0-138-136 kubenswrapper[2583]: I0709 02:37:05.485762 2583 prober.go:120] "Probe failed" probeType="Liveness" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-5f9bc9c474-jgh2b" podUID="325f97fc-73c3-48ba-b98c-75b19f491201" containerName="service-proxy" probeResult="failure" output="HTTP probe failed with statuscode: 500" Jul 09 02:37:05.486285 ip-10-0-138-136 kubenswrapper[2583]: I0709 02:37:05.485843 2583 kubelet.go:2654] "SyncLoop (probe)" probe="liveness" status="unhealthy" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-5f9bc9c474-jgh2b" Jul 09 02:37:05.486332 ip-10-0-138-136 kubenswrapper[2583]: I0709 02:37:05.486290 2583 kuberuntime_manager.go:1192] "Message for Container of pod" containerName="service-proxy" containerStatusID={"Type":"cri-o","ID":"19af068e9f867d00ce5f3f6498d71e8c1959f58d2f6d447d11850565591b9c4e"} pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-5f9bc9c474-jgh2b" containerMessage="Container service-proxy failed liveness probe, will be restarted" Jul 09 02:37:05.486371 ip-10-0-138-136 kubenswrapper[2583]: I0709 02:37:05.486329 2583 kuberuntime_container.go:872] "Killing container with a grace period" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-5f9bc9c474-jgh2b" podUID="325f97fc-73c3-48ba-b98c-75b19f491201" containerName="service-proxy" containerID="cri-o://19af068e9f867d00ce5f3f6498d71e8c1959f58d2f6d447d11850565591b9c4e" gracePeriod=30 Jul 09 02:37:06.560782 ip-10-0-138-136 kubenswrapper[2583]: I0709 02:37:06.560738 2583 generic.go:356] "Generic (PLEG): container finished" podID="325f97fc-73c3-48ba-b98c-75b19f491201" containerID="19af068e9f867d00ce5f3f6498d71e8c1959f58d2f6d447d11850565591b9c4e" exitCode=2 Jul 09 02:37:06.560782 ip-10-0-138-136 kubenswrapper[2583]: I0709 02:37:06.560752 2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-5f9bc9c474-jgh2b" event={"ID":"325f97fc-73c3-48ba-b98c-75b19f491201","Type":"ContainerDied","Data":"19af068e9f867d00ce5f3f6498d71e8c1959f58d2f6d447d11850565591b9c4e"} Jul 09 02:37:06.561224 ip-10-0-138-136 kubenswrapper[2583]: I0709 02:37:06.560810 2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-5f9bc9c474-jgh2b" event={"ID":"325f97fc-73c3-48ba-b98c-75b19f491201","Type":"ContainerStarted","Data":"c2709daf0d813a6722acd8156739e47260fc3b7f1b91123e56954ce83fafb4c9"} Jul 09 02:37:09.479904 ip-10-0-138-136 kubenswrapper[2583]: I0709 02:37:09.479829 2583 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console/console-777f74b468-pmfr6"] Jul 09 02:37:09.480270 ip-10-0-138-136 kubenswrapper[2583]: I0709 02:37:09.480192 2583 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="9af4ab52-6748-4090-a7a0-8666391d9bfa" containerName="registry" Jul 09 02:37:09.480270 ip-10-0-138-136 kubenswrapper[2583]: I0709 02:37:09.480207 2583 state_mem.go:107] "Deleted CPUSet assignment" podUID="9af4ab52-6748-4090-a7a0-8666391d9bfa" containerName="registry" Jul 09 02:37:09.480270 ip-10-0-138-136 kubenswrapper[2583]: I0709 02:37:09.480218 2583 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="9d75f511-b76b-4f36-9a0a-c83074c1ad1a" containerName="console" Jul 09 02:37:09.480270 ip-10-0-138-136 kubenswrapper[2583]: I0709 02:37:09.480224 2583 state_mem.go:107] "Deleted CPUSet assignment" podUID="9d75f511-b76b-4f36-9a0a-c83074c1ad1a" containerName="console" Jul 09 02:37:09.480270 ip-10-0-138-136 kubenswrapper[2583]: I0709 02:37:09.480239 2583 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="5b71dc06-285e-4368-a793-2615514cfc97" containerName="console" Jul 09 02:37:09.480270 ip-10-0-138-136 kubenswrapper[2583]: I0709 02:37:09.480246 2583 state_mem.go:107] "Deleted CPUSet assignment" podUID="5b71dc06-285e-4368-a793-2615514cfc97" containerName="console" Jul 09 02:37:09.480270 ip-10-0-138-136 kubenswrapper[2583]: I0709 02:37:09.480258 2583 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="cdbc01a1-9cc0-4bb8-bd92-469c266bf8ff" containerName="console" Jul 09 02:37:09.480270 ip-10-0-138-136 kubenswrapper[2583]: I0709 02:37:09.480264 2583 state_mem.go:107] "Deleted CPUSet assignment" podUID="cdbc01a1-9cc0-4bb8-bd92-469c266bf8ff" containerName="console" Jul 09 02:37:09.480569 ip-10-0-138-136 kubenswrapper[2583]: I0709 02:37:09.480320 2583 memory_manager.go:368] "RemoveStaleState removing state" podUID="9af4ab52-6748-4090-a7a0-8666391d9bfa" containerName="registry" Jul 09 02:37:09.480569 ip-10-0-138-136 kubenswrapper[2583]: I0709 02:37:09.480330 2583 memory_manager.go:368] "RemoveStaleState removing state" podUID="5b71dc06-285e-4368-a793-2615514cfc97" containerName="console" Jul 09 02:37:09.480569 ip-10-0-138-136 kubenswrapper[2583]: I0709 02:37:09.480336 2583 memory_manager.go:368] "RemoveStaleState removing state" podUID="cdbc01a1-9cc0-4bb8-bd92-469c266bf8ff" containerName="console" Jul 09 02:37:09.480569 ip-10-0-138-136 kubenswrapper[2583]: I0709 02:37:09.480342 2583 memory_manager.go:368] "RemoveStaleState removing state" podUID="9d75f511-b76b-4f36-9a0a-c83074c1ad1a" containerName="console" Jul 09 02:37:09.483432 ip-10-0-138-136 kubenswrapper[2583]: I0709 02:37:09.483412 2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-777f74b468-pmfr6" Jul 09 02:37:09.494373 ip-10-0-138-136 kubenswrapper[2583]: I0709 02:37:09.494347 2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-777f74b468-pmfr6"] Jul 09 02:37:09.646984 ip-10-0-138-136 kubenswrapper[2583]: I0709 02:37:09.646951 2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/7ec83270-d90c-427f-9955-0ab588bc64d7-service-ca\") pod \"console-777f74b468-pmfr6\" (UID: \"7ec83270-d90c-427f-9955-0ab588bc64d7\") " pod="openshift-console/console-777f74b468-pmfr6" Jul 09 02:37:09.647142 ip-10-0-138-136 kubenswrapper[2583]: I0709 02:37:09.646991 2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/7ec83270-d90c-427f-9955-0ab588bc64d7-console-serving-cert\") pod \"console-777f74b468-pmfr6\" (UID: \"7ec83270-d90c-427f-9955-0ab588bc64d7\") " pod="openshift-console/console-777f74b468-pmfr6" Jul 09 02:37:09.647142 ip-10-0-138-136 kubenswrapper[2583]: I0709 02:37:09.647034 2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/7ec83270-d90c-427f-9955-0ab588bc64d7-oauth-serving-cert\") pod \"console-777f74b468-pmfr6\" (UID: \"7ec83270-d90c-427f-9955-0ab588bc64d7\") " pod="openshift-console/console-777f74b468-pmfr6" Jul 09 02:37:09.647142 ip-10-0-138-136 kubenswrapper[2583]: I0709 02:37:09.647057 2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/7ec83270-d90c-427f-9955-0ab588bc64d7-console-oauth-config\") pod \"console-777f74b468-pmfr6\" (UID: \"7ec83270-d90c-427f-9955-0ab588bc64d7\") " pod="openshift-console/console-777f74b468-pmfr6" Jul 09 02:37:09.647142 ip-10-0-138-136 kubenswrapper[2583]: I0709 02:37:09.647092 2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/7ec83270-d90c-427f-9955-0ab588bc64d7-console-config\") pod \"console-777f74b468-pmfr6\" (UID: \"7ec83270-d90c-427f-9955-0ab588bc64d7\") " pod="openshift-console/console-777f74b468-pmfr6" Jul 09 02:37:09.647142 ip-10-0-138-136 kubenswrapper[2583]: I0709 02:37:09.647140 2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-p86vr\" (UniqueName: \"kubernetes.io/projected/7ec83270-d90c-427f-9955-0ab588bc64d7-kube-api-access-p86vr\") pod \"console-777f74b468-pmfr6\" (UID: \"7ec83270-d90c-427f-9955-0ab588bc64d7\") " pod="openshift-console/console-777f74b468-pmfr6" Jul 09 02:37:09.647339 ip-10-0-138-136 kubenswrapper[2583]: I0709 02:37:09.647178 2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/7ec83270-d90c-427f-9955-0ab588bc64d7-trusted-ca-bundle\") pod \"console-777f74b468-pmfr6\" (UID: \"7ec83270-d90c-427f-9955-0ab588bc64d7\") " pod="openshift-console/console-777f74b468-pmfr6" Jul 09 02:37:09.748446 ip-10-0-138-136 kubenswrapper[2583]: I0709 02:37:09.748417 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/7ec83270-d90c-427f-9955-0ab588bc64d7-service-ca\") pod \"console-777f74b468-pmfr6\" (UID: \"7ec83270-d90c-427f-9955-0ab588bc64d7\") " pod="openshift-console/console-777f74b468-pmfr6" Jul 09 02:37:09.748578 ip-10-0-138-136 kubenswrapper[2583]: I0709 02:37:09.748456 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/7ec83270-d90c-427f-9955-0ab588bc64d7-console-serving-cert\") pod \"console-777f74b468-pmfr6\" (UID: \"7ec83270-d90c-427f-9955-0ab588bc64d7\") " pod="openshift-console/console-777f74b468-pmfr6" Jul 09 02:37:09.748578 ip-10-0-138-136 kubenswrapper[2583]: I0709 02:37:09.748493 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/7ec83270-d90c-427f-9955-0ab588bc64d7-oauth-serving-cert\") pod \"console-777f74b468-pmfr6\" (UID: \"7ec83270-d90c-427f-9955-0ab588bc64d7\") " pod="openshift-console/console-777f74b468-pmfr6" Jul 09 02:37:09.748578 ip-10-0-138-136 kubenswrapper[2583]: I0709 02:37:09.748519 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/7ec83270-d90c-427f-9955-0ab588bc64d7-console-oauth-config\") pod \"console-777f74b468-pmfr6\" (UID: \"7ec83270-d90c-427f-9955-0ab588bc64d7\") " pod="openshift-console/console-777f74b468-pmfr6" Jul 09 02:37:09.748578 ip-10-0-138-136 kubenswrapper[2583]: I0709 02:37:09.748544 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/7ec83270-d90c-427f-9955-0ab588bc64d7-console-config\") pod \"console-777f74b468-pmfr6\" (UID: \"7ec83270-d90c-427f-9955-0ab588bc64d7\") " pod="openshift-console/console-777f74b468-pmfr6" Jul 09 02:37:09.748578 ip-10-0-138-136 kubenswrapper[2583]: I0709 02:37:09.748573 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-p86vr\" (UniqueName: \"kubernetes.io/projected/7ec83270-d90c-427f-9955-0ab588bc64d7-kube-api-access-p86vr\") pod \"console-777f74b468-pmfr6\" (UID: \"7ec83270-d90c-427f-9955-0ab588bc64d7\") " pod="openshift-console/console-777f74b468-pmfr6" Jul 09 02:37:09.748878 ip-10-0-138-136 kubenswrapper[2583]: I0709 02:37:09.748603 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/7ec83270-d90c-427f-9955-0ab588bc64d7-trusted-ca-bundle\") pod \"console-777f74b468-pmfr6\" (UID: \"7ec83270-d90c-427f-9955-0ab588bc64d7\") " pod="openshift-console/console-777f74b468-pmfr6" Jul 09 02:37:09.749327 ip-10-0-138-136 kubenswrapper[2583]: I0709 02:37:09.749298 2583 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/7ec83270-d90c-427f-9955-0ab588bc64d7-oauth-serving-cert\") pod \"console-777f74b468-pmfr6\" (UID: \"7ec83270-d90c-427f-9955-0ab588bc64d7\") " pod="openshift-console/console-777f74b468-pmfr6" Jul 09 02:37:09.749433 ip-10-0-138-136 kubenswrapper[2583]: I0709 02:37:09.749298 2583 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/7ec83270-d90c-427f-9955-0ab588bc64d7-console-config\") pod \"console-777f74b468-pmfr6\" (UID: \"7ec83270-d90c-427f-9955-0ab588bc64d7\") " pod="openshift-console/console-777f74b468-pmfr6" Jul 09 02:37:09.749433 ip-10-0-138-136 kubenswrapper[2583]: I0709 02:37:09.749386 2583 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/7ec83270-d90c-427f-9955-0ab588bc64d7-service-ca\") pod \"console-777f74b468-pmfr6\" (UID: \"7ec83270-d90c-427f-9955-0ab588bc64d7\") " pod="openshift-console/console-777f74b468-pmfr6" Jul 09 02:37:09.749607 ip-10-0-138-136 kubenswrapper[2583]: I0709 02:37:09.749586 2583 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/7ec83270-d90c-427f-9955-0ab588bc64d7-trusted-ca-bundle\") pod \"console-777f74b468-pmfr6\" (UID: \"7ec83270-d90c-427f-9955-0ab588bc64d7\") " pod="openshift-console/console-777f74b468-pmfr6" Jul 09 02:37:09.751527 ip-10-0-138-136 kubenswrapper[2583]: I0709 02:37:09.751500 2583 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/7ec83270-d90c-427f-9955-0ab588bc64d7-console-serving-cert\") pod \"console-777f74b468-pmfr6\" (UID: \"7ec83270-d90c-427f-9955-0ab588bc64d7\") " pod="openshift-console/console-777f74b468-pmfr6" Jul 09 02:37:09.751527 ip-10-0-138-136 kubenswrapper[2583]: I0709 02:37:09.751519 2583 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/7ec83270-d90c-427f-9955-0ab588bc64d7-console-oauth-config\") pod \"console-777f74b468-pmfr6\" (UID: \"7ec83270-d90c-427f-9955-0ab588bc64d7\") " pod="openshift-console/console-777f74b468-pmfr6" Jul 09 02:37:09.756165 ip-10-0-138-136 kubenswrapper[2583]: I0709 02:37:09.756146 2583 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-p86vr\" (UniqueName: \"kubernetes.io/projected/7ec83270-d90c-427f-9955-0ab588bc64d7-kube-api-access-p86vr\") pod \"console-777f74b468-pmfr6\" (UID: \"7ec83270-d90c-427f-9955-0ab588bc64d7\") " pod="openshift-console/console-777f74b468-pmfr6" Jul 09 02:37:09.794160 ip-10-0-138-136 kubenswrapper[2583]: I0709 02:37:09.794140 2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-777f74b468-pmfr6" Jul 09 02:37:09.923068 ip-10-0-138-136 kubenswrapper[2583]: I0709 02:37:09.923043 2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-777f74b468-pmfr6"] Jul 09 02:37:09.925028 ip-10-0-138-136 kubenswrapper[2583]: W0709 02:37:09.924989 2583 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod7ec83270_d90c_427f_9955_0ab588bc64d7.slice/crio-fa43ce05ea255224e31e62be171c3e687fc8de85b50ee048890756aba71a1480 WatchSource:0}: Error finding container fa43ce05ea255224e31e62be171c3e687fc8de85b50ee048890756aba71a1480: Status 404 returned error can't find the container with id fa43ce05ea255224e31e62be171c3e687fc8de85b50ee048890756aba71a1480 Jul 09 02:37:10.580847 ip-10-0-138-136 kubenswrapper[2583]: I0709 02:37:10.580803 2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-777f74b468-pmfr6" event={"ID":"7ec83270-d90c-427f-9955-0ab588bc64d7","Type":"ContainerStarted","Data":"8ad79e803a1ec734ba458cd185d8d0ac85a229b30bc946a61f8b331acbdd2dc1"} Jul 09 02:37:10.581299 ip-10-0-138-136 kubenswrapper[2583]: I0709 02:37:10.580865 2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-777f74b468-pmfr6" event={"ID":"7ec83270-d90c-427f-9955-0ab588bc64d7","Type":"ContainerStarted","Data":"fa43ce05ea255224e31e62be171c3e687fc8de85b50ee048890756aba71a1480"} Jul 09 02:37:10.597296 ip-10-0-138-136 kubenswrapper[2583]: I0709 02:37:10.597238 2583 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console/console-777f74b468-pmfr6" podStartSLOduration=1.597221712 podStartE2EDuration="1.597221712s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-09 02:37:09 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-09 02:37:10.596493515 +0000 UTC m=+176.528950997" watchObservedRunningTime="2026-07-09 02:37:10.597221712 +0000 UTC m=+176.529679198" Jul 09 02:37:19.794989 ip-10-0-138-136 kubenswrapper[2583]: I0709 02:37:19.794945 2583 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-console/console-777f74b468-pmfr6" Jul 09 02:37:19.795512 ip-10-0-138-136 kubenswrapper[2583]: I0709 02:37:19.795013 2583 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/console-777f74b468-pmfr6" Jul 09 02:37:19.799589 ip-10-0-138-136 kubenswrapper[2583]: I0709 02:37:19.799567 2583 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-console/console-777f74b468-pmfr6" Jul 09 02:37:20.630285 ip-10-0-138-136 kubenswrapper[2583]: I0709 02:37:20.630250 2583 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console/console-777f74b468-pmfr6" Jul 09 02:37:20.677008 ip-10-0-138-136 kubenswrapper[2583]: I0709 02:37:20.676970 2583 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-667b8f5fd5-6qgr2"] Jul 09 02:37:45.702300 ip-10-0-138-136 kubenswrapper[2583]: I0709 02:37:45.702224 2583 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-console/console-667b8f5fd5-6qgr2" podUID="ca05c9ce-00b8-4182-acd6-556801a4e1df" containerName="console" containerID="cri-o://2f4781858d3fc269442bc219a5fdfe74751a4656926aca1fabc6d9613590ed17" gracePeriod=15 Jul 09 02:37:45.967142 ip-10-0-138-136 kubenswrapper[2583]: I0709 02:37:45.967117 2583 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-667b8f5fd5-6qgr2" Jul 09 02:37:46.011054 ip-10-0-138-136 kubenswrapper[2583]: I0709 02:37:46.011014 2583 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/ca05c9ce-00b8-4182-acd6-556801a4e1df-console-oauth-config\") pod \"ca05c9ce-00b8-4182-acd6-556801a4e1df\" (UID: \"ca05c9ce-00b8-4182-acd6-556801a4e1df\") " Jul 09 02:37:46.011232 ip-10-0-138-136 kubenswrapper[2583]: I0709 02:37:46.011070 2583 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-jl86f\" (UniqueName: \"kubernetes.io/projected/ca05c9ce-00b8-4182-acd6-556801a4e1df-kube-api-access-jl86f\") pod \"ca05c9ce-00b8-4182-acd6-556801a4e1df\" (UID: \"ca05c9ce-00b8-4182-acd6-556801a4e1df\") " Jul 09 02:37:46.011232 ip-10-0-138-136 kubenswrapper[2583]: I0709 02:37:46.011110 2583 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/ca05c9ce-00b8-4182-acd6-556801a4e1df-service-ca\") pod \"ca05c9ce-00b8-4182-acd6-556801a4e1df\" (UID: \"ca05c9ce-00b8-4182-acd6-556801a4e1df\") " Jul 09 02:37:46.011232 ip-10-0-138-136 kubenswrapper[2583]: I0709 02:37:46.011139 2583 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/ca05c9ce-00b8-4182-acd6-556801a4e1df-console-config\") pod \"ca05c9ce-00b8-4182-acd6-556801a4e1df\" (UID: \"ca05c9ce-00b8-4182-acd6-556801a4e1df\") " Jul 09 02:37:46.011232 ip-10-0-138-136 kubenswrapper[2583]: I0709 02:37:46.011176 2583 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/ca05c9ce-00b8-4182-acd6-556801a4e1df-oauth-serving-cert\") pod \"ca05c9ce-00b8-4182-acd6-556801a4e1df\" (UID: \"ca05c9ce-00b8-4182-acd6-556801a4e1df\") " Jul 09 02:37:46.011232 ip-10-0-138-136 kubenswrapper[2583]: I0709 02:37:46.011204 2583 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/ca05c9ce-00b8-4182-acd6-556801a4e1df-trusted-ca-bundle\") pod \"ca05c9ce-00b8-4182-acd6-556801a4e1df\" (UID: \"ca05c9ce-00b8-4182-acd6-556801a4e1df\") " Jul 09 02:37:46.011503 ip-10-0-138-136 kubenswrapper[2583]: I0709 02:37:46.011237 2583 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/ca05c9ce-00b8-4182-acd6-556801a4e1df-console-serving-cert\") pod \"ca05c9ce-00b8-4182-acd6-556801a4e1df\" (UID: \"ca05c9ce-00b8-4182-acd6-556801a4e1df\") " Jul 09 02:37:46.011849 ip-10-0-138-136 kubenswrapper[2583]: I0709 02:37:46.011811 2583 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/ca05c9ce-00b8-4182-acd6-556801a4e1df-service-ca" (OuterVolumeSpecName: "service-ca") pod "ca05c9ce-00b8-4182-acd6-556801a4e1df" (UID: "ca05c9ce-00b8-4182-acd6-556801a4e1df"). InnerVolumeSpecName "service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 09 02:37:46.012240 ip-10-0-138-136 kubenswrapper[2583]: I0709 02:37:46.012178 2583 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/ca05c9ce-00b8-4182-acd6-556801a4e1df-oauth-serving-cert" (OuterVolumeSpecName: "oauth-serving-cert") pod "ca05c9ce-00b8-4182-acd6-556801a4e1df" (UID: "ca05c9ce-00b8-4182-acd6-556801a4e1df"). InnerVolumeSpecName "oauth-serving-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 09 02:37:46.012240 ip-10-0-138-136 kubenswrapper[2583]: I0709 02:37:46.012205 2583 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/ca05c9ce-00b8-4182-acd6-556801a4e1df-console-config" (OuterVolumeSpecName: "console-config") pod "ca05c9ce-00b8-4182-acd6-556801a4e1df" (UID: "ca05c9ce-00b8-4182-acd6-556801a4e1df"). InnerVolumeSpecName "console-config". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 09 02:37:46.012600 ip-10-0-138-136 kubenswrapper[2583]: I0709 02:37:46.012565 2583 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/ca05c9ce-00b8-4182-acd6-556801a4e1df-trusted-ca-bundle" (OuterVolumeSpecName: "trusted-ca-bundle") pod "ca05c9ce-00b8-4182-acd6-556801a4e1df" (UID: "ca05c9ce-00b8-4182-acd6-556801a4e1df"). InnerVolumeSpecName "trusted-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 09 02:37:46.012735 ip-10-0-138-136 kubenswrapper[2583]: I0709 02:37:46.012652 2583 reconciler_common.go:299] "Volume detached for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/ca05c9ce-00b8-4182-acd6-556801a4e1df-service-ca\") on node \"ip-10-0-138-136.ec2.internal\" DevicePath \"\"" Jul 09 02:37:46.018823 ip-10-0-138-136 kubenswrapper[2583]: I0709 02:37:46.014064 2583 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/ca05c9ce-00b8-4182-acd6-556801a4e1df-console-serving-cert" (OuterVolumeSpecName: "console-serving-cert") pod "ca05c9ce-00b8-4182-acd6-556801a4e1df" (UID: "ca05c9ce-00b8-4182-acd6-556801a4e1df"). InnerVolumeSpecName "console-serving-cert". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 09 02:37:46.018823 ip-10-0-138-136 kubenswrapper[2583]: I0709 02:37:46.014133 2583 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/ca05c9ce-00b8-4182-acd6-556801a4e1df-kube-api-access-jl86f" (OuterVolumeSpecName: "kube-api-access-jl86f") pod "ca05c9ce-00b8-4182-acd6-556801a4e1df" (UID: "ca05c9ce-00b8-4182-acd6-556801a4e1df"). InnerVolumeSpecName "kube-api-access-jl86f". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 09 02:37:46.018973 ip-10-0-138-136 kubenswrapper[2583]: I0709 02:37:46.018886 2583 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/ca05c9ce-00b8-4182-acd6-556801a4e1df-console-oauth-config" (OuterVolumeSpecName: "console-oauth-config") pod "ca05c9ce-00b8-4182-acd6-556801a4e1df" (UID: "ca05c9ce-00b8-4182-acd6-556801a4e1df"). InnerVolumeSpecName "console-oauth-config". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 09 02:37:46.113535 ip-10-0-138-136 kubenswrapper[2583]: I0709 02:37:46.113487 2583 reconciler_common.go:299] "Volume detached for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/ca05c9ce-00b8-4182-acd6-556801a4e1df-console-oauth-config\") on node \"ip-10-0-138-136.ec2.internal\" DevicePath \"\"" Jul 09 02:37:46.113535 ip-10-0-138-136 kubenswrapper[2583]: I0709 02:37:46.113534 2583 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-jl86f\" (UniqueName: \"kubernetes.io/projected/ca05c9ce-00b8-4182-acd6-556801a4e1df-kube-api-access-jl86f\") on node \"ip-10-0-138-136.ec2.internal\" DevicePath \"\"" Jul 09 02:37:46.113775 ip-10-0-138-136 kubenswrapper[2583]: I0709 02:37:46.113551 2583 reconciler_common.go:299] "Volume detached for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/ca05c9ce-00b8-4182-acd6-556801a4e1df-console-config\") on node \"ip-10-0-138-136.ec2.internal\" DevicePath \"\"" Jul 09 02:37:46.113775 ip-10-0-138-136 kubenswrapper[2583]: I0709 02:37:46.113566 2583 reconciler_common.go:299] "Volume detached for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/ca05c9ce-00b8-4182-acd6-556801a4e1df-oauth-serving-cert\") on node \"ip-10-0-138-136.ec2.internal\" DevicePath \"\"" Jul 09 02:37:46.113775 ip-10-0-138-136 kubenswrapper[2583]: I0709 02:37:46.113581 2583 reconciler_common.go:299] "Volume detached for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/ca05c9ce-00b8-4182-acd6-556801a4e1df-trusted-ca-bundle\") on node \"ip-10-0-138-136.ec2.internal\" DevicePath \"\"" Jul 09 02:37:46.113775 ip-10-0-138-136 kubenswrapper[2583]: I0709 02:37:46.113613 2583 reconciler_common.go:299] "Volume detached for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/ca05c9ce-00b8-4182-acd6-556801a4e1df-console-serving-cert\") on node \"ip-10-0-138-136.ec2.internal\" DevicePath \"\"" Jul 09 02:37:46.736061 ip-10-0-138-136 kubenswrapper[2583]: I0709 02:37:46.736026 2583 generic.go:356] "Generic (PLEG): container finished" podID="ca05c9ce-00b8-4182-acd6-556801a4e1df" containerID="2f4781858d3fc269442bc219a5fdfe74751a4656926aca1fabc6d9613590ed17" exitCode=0 Jul 09 02:37:46.736491 ip-10-0-138-136 kubenswrapper[2583]: I0709 02:37:46.736100 2583 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-667b8f5fd5-6qgr2" Jul 09 02:37:46.736491 ip-10-0-138-136 kubenswrapper[2583]: I0709 02:37:46.736111 2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-667b8f5fd5-6qgr2" event={"ID":"ca05c9ce-00b8-4182-acd6-556801a4e1df","Type":"ContainerDied","Data":"2f4781858d3fc269442bc219a5fdfe74751a4656926aca1fabc6d9613590ed17"} Jul 09 02:37:46.736491 ip-10-0-138-136 kubenswrapper[2583]: I0709 02:37:46.736167 2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-667b8f5fd5-6qgr2" event={"ID":"ca05c9ce-00b8-4182-acd6-556801a4e1df","Type":"ContainerDied","Data":"3239a823c087eab612e0f2d7d83540e60a4e18c908e173ce648d4c7a80bf611e"} Jul 09 02:37:46.736491 ip-10-0-138-136 kubenswrapper[2583]: I0709 02:37:46.736189 2583 scope.go:117] "RemoveContainer" containerID="2f4781858d3fc269442bc219a5fdfe74751a4656926aca1fabc6d9613590ed17" Jul 09 02:37:46.744817 ip-10-0-138-136 kubenswrapper[2583]: I0709 02:37:46.744796 2583 scope.go:117] "RemoveContainer" containerID="2f4781858d3fc269442bc219a5fdfe74751a4656926aca1fabc6d9613590ed17" Jul 09 02:37:46.745108 ip-10-0-138-136 kubenswrapper[2583]: E0709 02:37:46.745085 2583 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"2f4781858d3fc269442bc219a5fdfe74751a4656926aca1fabc6d9613590ed17\": container with ID starting with 2f4781858d3fc269442bc219a5fdfe74751a4656926aca1fabc6d9613590ed17 not found: ID does not exist" containerID="2f4781858d3fc269442bc219a5fdfe74751a4656926aca1fabc6d9613590ed17" Jul 09 02:37:46.745163 ip-10-0-138-136 kubenswrapper[2583]: I0709 02:37:46.745117 2583 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"2f4781858d3fc269442bc219a5fdfe74751a4656926aca1fabc6d9613590ed17"} err="failed to get container status \"2f4781858d3fc269442bc219a5fdfe74751a4656926aca1fabc6d9613590ed17\": rpc error: code = NotFound desc = could not find container \"2f4781858d3fc269442bc219a5fdfe74751a4656926aca1fabc6d9613590ed17\": container with ID starting with 2f4781858d3fc269442bc219a5fdfe74751a4656926aca1fabc6d9613590ed17 not found: ID does not exist" Jul 09 02:37:46.752479 ip-10-0-138-136 kubenswrapper[2583]: I0709 02:37:46.752454 2583 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-667b8f5fd5-6qgr2"] Jul 09 02:37:46.756271 ip-10-0-138-136 kubenswrapper[2583]: I0709 02:37:46.756249 2583 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-console/console-667b8f5fd5-6qgr2"] Jul 09 02:37:48.601654 ip-10-0-138-136 kubenswrapper[2583]: I0709 02:37:48.601620 2583 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="ca05c9ce-00b8-4182-acd6-556801a4e1df" path="/var/lib/kubelet/pods/ca05c9ce-00b8-4182-acd6-556801a4e1df/volumes" Jul 09 02:38:58.885824 ip-10-0-138-136 kubenswrapper[2583]: I0709 02:38:58.885789 2583 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-75df5ddb9c-7vqjd"] Jul 09 02:38:58.886247 ip-10-0-138-136 kubenswrapper[2583]: I0709 02:38:58.886126 2583 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="ca05c9ce-00b8-4182-acd6-556801a4e1df" containerName="console" Jul 09 02:38:58.886247 ip-10-0-138-136 kubenswrapper[2583]: I0709 02:38:58.886137 2583 state_mem.go:107] "Deleted CPUSet assignment" podUID="ca05c9ce-00b8-4182-acd6-556801a4e1df" containerName="console" Jul 09 02:38:58.886247 ip-10-0-138-136 kubenswrapper[2583]: I0709 02:38:58.886202 2583 memory_manager.go:368] "RemoveStaleState removing state" podUID="ca05c9ce-00b8-4182-acd6-556801a4e1df" containerName="console" Jul 09 02:38:58.889405 ip-10-0-138-136 kubenswrapper[2583]: I0709 02:38:58.889376 2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/opendatahub-operator-controller-manager-75df5ddb9c-7vqjd" Jul 09 02:38:58.892871 ip-10-0-138-136 kubenswrapper[2583]: I0709 02:38:58.892846 2583 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-manager-dockercfg-d59qt\"" Jul 09 02:38:58.892999 ip-10-0-138-136 kubenswrapper[2583]: I0709 02:38:58.892984 2583 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-webhook-cert\"" Jul 09 02:38:58.893095 ip-10-0-138-136 kubenswrapper[2583]: I0709 02:38:58.893079 2583 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-manager-service-cert\"" Jul 09 02:38:58.893265 ip-10-0-138-136 kubenswrapper[2583]: I0709 02:38:58.893252 2583 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"openshift-service-ca.crt\"" Jul 09 02:38:58.893600 ip-10-0-138-136 kubenswrapper[2583]: I0709 02:38:58.893587 2583 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"kube-root-ca.crt\"" Jul 09 02:38:58.903409 ip-10-0-138-136 kubenswrapper[2583]: I0709 02:38:58.903381 2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-75df5ddb9c-7vqjd"] Jul 09 02:38:59.000546 ip-10-0-138-136 kubenswrapper[2583]: I0709 02:38:59.000510 2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/addd875a-34b8-4179-b2fe-07eb377f16d2-manifests\") pod \"opendatahub-operator-controller-manager-75df5ddb9c-7vqjd\" (UID: \"addd875a-34b8-4179-b2fe-07eb377f16d2\") " pod="opendatahub/opendatahub-operator-controller-manager-75df5ddb9c-7vqjd" Jul 09 02:38:59.000546 ip-10-0-138-136 kubenswrapper[2583]: I0709 02:38:59.000550 2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-qxprt\" (UniqueName: \"kubernetes.io/projected/addd875a-34b8-4179-b2fe-07eb377f16d2-kube-api-access-qxprt\") pod \"opendatahub-operator-controller-manager-75df5ddb9c-7vqjd\" (UID: \"addd875a-34b8-4179-b2fe-07eb377f16d2\") " pod="opendatahub/opendatahub-operator-controller-manager-75df5ddb9c-7vqjd" Jul 09 02:38:59.000811 ip-10-0-138-136 kubenswrapper[2583]: I0709 02:38:59.000580 2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/addd875a-34b8-4179-b2fe-07eb377f16d2-webhook-cert\") pod \"opendatahub-operator-controller-manager-75df5ddb9c-7vqjd\" (UID: \"addd875a-34b8-4179-b2fe-07eb377f16d2\") " pod="opendatahub/opendatahub-operator-controller-manager-75df5ddb9c-7vqjd" Jul 09 02:38:59.000811 ip-10-0-138-136 kubenswrapper[2583]: I0709 02:38:59.000669 2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/addd875a-34b8-4179-b2fe-07eb377f16d2-apiservice-cert\") pod \"opendatahub-operator-controller-manager-75df5ddb9c-7vqjd\" (UID: \"addd875a-34b8-4179-b2fe-07eb377f16d2\") " pod="opendatahub/opendatahub-operator-controller-manager-75df5ddb9c-7vqjd" Jul 09 02:38:59.000811 ip-10-0-138-136 kubenswrapper[2583]: I0709 02:38:59.000737 2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/addd875a-34b8-4179-b2fe-07eb377f16d2-tmp\") pod \"opendatahub-operator-controller-manager-75df5ddb9c-7vqjd\" (UID: \"addd875a-34b8-4179-b2fe-07eb377f16d2\") " pod="opendatahub/opendatahub-operator-controller-manager-75df5ddb9c-7vqjd" Jul 09 02:38:59.102007 ip-10-0-138-136 kubenswrapper[2583]: I0709 02:38:59.101950 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/addd875a-34b8-4179-b2fe-07eb377f16d2-tmp\") pod \"opendatahub-operator-controller-manager-75df5ddb9c-7vqjd\" (UID: \"addd875a-34b8-4179-b2fe-07eb377f16d2\") " pod="opendatahub/opendatahub-operator-controller-manager-75df5ddb9c-7vqjd" Jul 09 02:38:59.102250 ip-10-0-138-136 kubenswrapper[2583]: I0709 02:38:59.102041 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/addd875a-34b8-4179-b2fe-07eb377f16d2-manifests\") pod \"opendatahub-operator-controller-manager-75df5ddb9c-7vqjd\" (UID: \"addd875a-34b8-4179-b2fe-07eb377f16d2\") " pod="opendatahub/opendatahub-operator-controller-manager-75df5ddb9c-7vqjd" Jul 09 02:38:59.102250 ip-10-0-138-136 kubenswrapper[2583]: I0709 02:38:59.102065 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-qxprt\" (UniqueName: \"kubernetes.io/projected/addd875a-34b8-4179-b2fe-07eb377f16d2-kube-api-access-qxprt\") pod \"opendatahub-operator-controller-manager-75df5ddb9c-7vqjd\" (UID: \"addd875a-34b8-4179-b2fe-07eb377f16d2\") " pod="opendatahub/opendatahub-operator-controller-manager-75df5ddb9c-7vqjd" Jul 09 02:38:59.102250 ip-10-0-138-136 kubenswrapper[2583]: I0709 02:38:59.102089 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/addd875a-34b8-4179-b2fe-07eb377f16d2-webhook-cert\") pod \"opendatahub-operator-controller-manager-75df5ddb9c-7vqjd\" (UID: \"addd875a-34b8-4179-b2fe-07eb377f16d2\") " pod="opendatahub/opendatahub-operator-controller-manager-75df5ddb9c-7vqjd" Jul 09 02:38:59.102250 ip-10-0-138-136 kubenswrapper[2583]: I0709 02:38:59.102124 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/addd875a-34b8-4179-b2fe-07eb377f16d2-apiservice-cert\") pod \"opendatahub-operator-controller-manager-75df5ddb9c-7vqjd\" (UID: \"addd875a-34b8-4179-b2fe-07eb377f16d2\") " pod="opendatahub/opendatahub-operator-controller-manager-75df5ddb9c-7vqjd" Jul 09 02:38:59.102514 ip-10-0-138-136 kubenswrapper[2583]: I0709 02:38:59.102490 2583 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/addd875a-34b8-4179-b2fe-07eb377f16d2-manifests\") pod \"opendatahub-operator-controller-manager-75df5ddb9c-7vqjd\" (UID: \"addd875a-34b8-4179-b2fe-07eb377f16d2\") " pod="opendatahub/opendatahub-operator-controller-manager-75df5ddb9c-7vqjd" Jul 09 02:38:59.104445 ip-10-0-138-136 kubenswrapper[2583]: I0709 02:38:59.104408 2583 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/addd875a-34b8-4179-b2fe-07eb377f16d2-tmp\") pod \"opendatahub-operator-controller-manager-75df5ddb9c-7vqjd\" (UID: \"addd875a-34b8-4179-b2fe-07eb377f16d2\") " pod="opendatahub/opendatahub-operator-controller-manager-75df5ddb9c-7vqjd" Jul 09 02:38:59.104569 ip-10-0-138-136 kubenswrapper[2583]: I0709 02:38:59.104533 2583 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/addd875a-34b8-4179-b2fe-07eb377f16d2-webhook-cert\") pod \"opendatahub-operator-controller-manager-75df5ddb9c-7vqjd\" (UID: \"addd875a-34b8-4179-b2fe-07eb377f16d2\") " pod="opendatahub/opendatahub-operator-controller-manager-75df5ddb9c-7vqjd" Jul 09 02:38:59.104668 ip-10-0-138-136 kubenswrapper[2583]: I0709 02:38:59.104651 2583 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/addd875a-34b8-4179-b2fe-07eb377f16d2-apiservice-cert\") pod \"opendatahub-operator-controller-manager-75df5ddb9c-7vqjd\" (UID: \"addd875a-34b8-4179-b2fe-07eb377f16d2\") " pod="opendatahub/opendatahub-operator-controller-manager-75df5ddb9c-7vqjd" Jul 09 02:38:59.115676 ip-10-0-138-136 kubenswrapper[2583]: I0709 02:38:59.115643 2583 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-qxprt\" (UniqueName: \"kubernetes.io/projected/addd875a-34b8-4179-b2fe-07eb377f16d2-kube-api-access-qxprt\") pod \"opendatahub-operator-controller-manager-75df5ddb9c-7vqjd\" (UID: \"addd875a-34b8-4179-b2fe-07eb377f16d2\") " pod="opendatahub/opendatahub-operator-controller-manager-75df5ddb9c-7vqjd" Jul 09 02:38:59.199989 ip-10-0-138-136 kubenswrapper[2583]: I0709 02:38:59.199877 2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/opendatahub-operator-controller-manager-75df5ddb9c-7vqjd" Jul 09 02:38:59.338576 ip-10-0-138-136 kubenswrapper[2583]: I0709 02:38:59.338541 2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-75df5ddb9c-7vqjd"] Jul 09 02:38:59.342342 ip-10-0-138-136 kubenswrapper[2583]: W0709 02:38:59.342307 2583 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podaddd875a_34b8_4179_b2fe_07eb377f16d2.slice/crio-6c0fd296c2b1ed67da50238ef1c498b289ebc618f98744ce72f51a73a2de6f88 WatchSource:0}: Error finding container 6c0fd296c2b1ed67da50238ef1c498b289ebc618f98744ce72f51a73a2de6f88: Status 404 returned error can't find the container with id 6c0fd296c2b1ed67da50238ef1c498b289ebc618f98744ce72f51a73a2de6f88 Jul 09 02:39:00.045855 ip-10-0-138-136 kubenswrapper[2583]: I0709 02:39:00.045814 2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-75df5ddb9c-7vqjd" event={"ID":"addd875a-34b8-4179-b2fe-07eb377f16d2","Type":"ContainerStarted","Data":"6c0fd296c2b1ed67da50238ef1c498b289ebc618f98744ce72f51a73a2de6f88"} Jul 09 02:39:03.061786 ip-10-0-138-136 kubenswrapper[2583]: I0709 02:39:03.061752 2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-75df5ddb9c-7vqjd" event={"ID":"addd875a-34b8-4179-b2fe-07eb377f16d2","Type":"ContainerStarted","Data":"1886e8fd61420dc0abf501504447c06a9b5f09efbf16e229270283a9fd23a4cf"} Jul 09 02:39:04.068641 ip-10-0-138-136 kubenswrapper[2583]: I0709 02:39:04.068606 2583 generic.go:356] "Generic (PLEG): container finished" podID="addd875a-34b8-4179-b2fe-07eb377f16d2" containerID="1886e8fd61420dc0abf501504447c06a9b5f09efbf16e229270283a9fd23a4cf" exitCode=0 Jul 09 02:39:04.069054 ip-10-0-138-136 kubenswrapper[2583]: I0709 02:39:04.068699 2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-75df5ddb9c-7vqjd" event={"ID":"addd875a-34b8-4179-b2fe-07eb377f16d2","Type":"ContainerDied","Data":"1886e8fd61420dc0abf501504447c06a9b5f09efbf16e229270283a9fd23a4cf"} Jul 09 02:39:05.075424 ip-10-0-138-136 kubenswrapper[2583]: I0709 02:39:05.075381 2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-75df5ddb9c-7vqjd" event={"ID":"addd875a-34b8-4179-b2fe-07eb377f16d2","Type":"ContainerStarted","Data":"a8a94e763847213f6696015d1fbc9dd2a9622ae31d8acdcdb984c593b04b6e1c"} Jul 09 02:39:05.075895 ip-10-0-138-136 kubenswrapper[2583]: I0709 02:39:05.075510 2583 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/opendatahub-operator-controller-manager-75df5ddb9c-7vqjd" Jul 09 02:39:05.097027 ip-10-0-138-136 kubenswrapper[2583]: I0709 02:39:05.096971 2583 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/opendatahub-operator-controller-manager-75df5ddb9c-7vqjd" podStartSLOduration=2.499419412 podStartE2EDuration="7.096952463s" totalImagesPullingTime="3.506869007s" totalInitContainerRuntime="1.090664044s" isStatefulPod=false podCreationTimestamp="2026-07-09 02:38:58 +0000 UTC" imagePullSessionsCount=2 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-09 02:39:05.095666877 +0000 UTC m=+291.028124363" watchObservedRunningTime="2026-07-09 02:39:05.096952463 +0000 UTC m=+291.029409948" Jul 09 02:39:14.493043 ip-10-0-138-136 kubenswrapper[2583]: I0709 02:39:14.493008 2583 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-68b757fb67-xpjsj_188e21f3-2ce9-4012-ada2-a46c32d56729/console-operator/1.log" Jul 09 02:39:14.497541 ip-10-0-138-136 kubenswrapper[2583]: I0709 02:39:14.497515 2583 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-68b757fb67-xpjsj_188e21f3-2ce9-4012-ada2-a46c32d56729/console-operator/1.log" Jul 09 02:39:14.504596 ip-10-0-138-136 kubenswrapper[2583]: I0709 02:39:14.504569 2583 kubelet.go:1648] "Image garbage collection succeeded" Jul 09 02:39:16.082470 ip-10-0-138-136 kubenswrapper[2583]: I0709 02:39:16.082431 2583 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/opendatahub-operator-controller-manager-75df5ddb9c-7vqjd" Jul 09 02:39:25.658246 ip-10-0-138-136 kubenswrapper[2583]: I0709 02:39:25.658215 2583 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-lws-operator/lws-controller-manager-7c74f5f585-g95ch"] Jul 09 02:39:25.661296 ip-10-0-138-136 kubenswrapper[2583]: I0709 02:39:25.661280 2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-lws-operator/lws-controller-manager-7c74f5f585-g95ch" Jul 09 02:39:25.663430 ip-10-0-138-136 kubenswrapper[2583]: I0709 02:39:25.663407 2583 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-lws-operator\"/\"lws-manager-config\"" Jul 09 02:39:25.664231 ip-10-0-138-136 kubenswrapper[2583]: I0709 02:39:25.664078 2583 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-lws-operator\"/\"kube-root-ca.crt\"" Jul 09 02:39:25.664231 ip-10-0-138-136 kubenswrapper[2583]: I0709 02:39:25.664116 2583 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-lws-operator\"/\"lws-controller-manager-dockercfg-mr9qn\"" Jul 09 02:39:25.664231 ip-10-0-138-136 kubenswrapper[2583]: I0709 02:39:25.664137 2583 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-lws-operator\"/\"webhook-server-cert\"" Jul 09 02:39:25.664231 ip-10-0-138-136 kubenswrapper[2583]: I0709 02:39:25.664174 2583 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-lws-operator\"/\"openshift-service-ca.crt\"" Jul 09 02:39:25.664437 ip-10-0-138-136 kubenswrapper[2583]: I0709 02:39:25.664335 2583 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-lws-operator\"/\"metrics-server-cert\"" Jul 09 02:39:25.669560 ip-10-0-138-136 kubenswrapper[2583]: I0709 02:39:25.669540 2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-lws-operator/lws-controller-manager-7c74f5f585-g95ch"] Jul 09 02:39:25.822893 ip-10-0-138-136 kubenswrapper[2583]: I0709 02:39:25.822860 2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-bk576\" (UniqueName: \"kubernetes.io/projected/a9b51085-b15c-40be-8157-86c4f904879c-kube-api-access-bk576\") pod \"lws-controller-manager-7c74f5f585-g95ch\" (UID: \"a9b51085-b15c-40be-8157-86c4f904879c\") " pod="openshift-lws-operator/lws-controller-manager-7c74f5f585-g95ch" Jul 09 02:39:25.823084 ip-10-0-138-136 kubenswrapper[2583]: I0709 02:39:25.823066 2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/a9b51085-b15c-40be-8157-86c4f904879c-cert\") pod \"lws-controller-manager-7c74f5f585-g95ch\" (UID: \"a9b51085-b15c-40be-8157-86c4f904879c\") " pod="openshift-lws-operator/lws-controller-manager-7c74f5f585-g95ch" Jul 09 02:39:25.823231 ip-10-0-138-136 kubenswrapper[2583]: I0709 02:39:25.823218 2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"manager-config\" (UniqueName: \"kubernetes.io/configmap/a9b51085-b15c-40be-8157-86c4f904879c-manager-config\") pod \"lws-controller-manager-7c74f5f585-g95ch\" (UID: \"a9b51085-b15c-40be-8157-86c4f904879c\") " pod="openshift-lws-operator/lws-controller-manager-7c74f5f585-g95ch" Jul 09 02:39:25.823365 ip-10-0-138-136 kubenswrapper[2583]: I0709 02:39:25.823353 2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-cert\" (UniqueName: \"kubernetes.io/secret/a9b51085-b15c-40be-8157-86c4f904879c-metrics-cert\") pod \"lws-controller-manager-7c74f5f585-g95ch\" (UID: \"a9b51085-b15c-40be-8157-86c4f904879c\") " pod="openshift-lws-operator/lws-controller-manager-7c74f5f585-g95ch" Jul 09 02:39:25.924336 ip-10-0-138-136 kubenswrapper[2583]: I0709 02:39:25.924212 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-bk576\" (UniqueName: \"kubernetes.io/projected/a9b51085-b15c-40be-8157-86c4f904879c-kube-api-access-bk576\") pod \"lws-controller-manager-7c74f5f585-g95ch\" (UID: \"a9b51085-b15c-40be-8157-86c4f904879c\") " pod="openshift-lws-operator/lws-controller-manager-7c74f5f585-g95ch" Jul 09 02:39:25.924336 ip-10-0-138-136 kubenswrapper[2583]: I0709 02:39:25.924270 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/a9b51085-b15c-40be-8157-86c4f904879c-cert\") pod \"lws-controller-manager-7c74f5f585-g95ch\" (UID: \"a9b51085-b15c-40be-8157-86c4f904879c\") " pod="openshift-lws-operator/lws-controller-manager-7c74f5f585-g95ch" Jul 09 02:39:25.924336 ip-10-0-138-136 kubenswrapper[2583]: I0709 02:39:25.924313 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"manager-config\" (UniqueName: \"kubernetes.io/configmap/a9b51085-b15c-40be-8157-86c4f904879c-manager-config\") pod \"lws-controller-manager-7c74f5f585-g95ch\" (UID: \"a9b51085-b15c-40be-8157-86c4f904879c\") " pod="openshift-lws-operator/lws-controller-manager-7c74f5f585-g95ch" Jul 09 02:39:25.924640 ip-10-0-138-136 kubenswrapper[2583]: I0709 02:39:25.924357 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-cert\" (UniqueName: \"kubernetes.io/secret/a9b51085-b15c-40be-8157-86c4f904879c-metrics-cert\") pod \"lws-controller-manager-7c74f5f585-g95ch\" (UID: \"a9b51085-b15c-40be-8157-86c4f904879c\") " pod="openshift-lws-operator/lws-controller-manager-7c74f5f585-g95ch" Jul 09 02:39:25.925161 ip-10-0-138-136 kubenswrapper[2583]: I0709 02:39:25.925134 2583 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"manager-config\" (UniqueName: \"kubernetes.io/configmap/a9b51085-b15c-40be-8157-86c4f904879c-manager-config\") pod \"lws-controller-manager-7c74f5f585-g95ch\" (UID: \"a9b51085-b15c-40be-8157-86c4f904879c\") " pod="openshift-lws-operator/lws-controller-manager-7c74f5f585-g95ch" Jul 09 02:39:25.926811 ip-10-0-138-136 kubenswrapper[2583]: I0709 02:39:25.926781 2583 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/a9b51085-b15c-40be-8157-86c4f904879c-cert\") pod \"lws-controller-manager-7c74f5f585-g95ch\" (UID: \"a9b51085-b15c-40be-8157-86c4f904879c\") " pod="openshift-lws-operator/lws-controller-manager-7c74f5f585-g95ch" Jul 09 02:39:25.927044 ip-10-0-138-136 kubenswrapper[2583]: I0709 02:39:25.927012 2583 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-cert\" (UniqueName: \"kubernetes.io/secret/a9b51085-b15c-40be-8157-86c4f904879c-metrics-cert\") pod \"lws-controller-manager-7c74f5f585-g95ch\" (UID: \"a9b51085-b15c-40be-8157-86c4f904879c\") " pod="openshift-lws-operator/lws-controller-manager-7c74f5f585-g95ch" Jul 09 02:39:25.932177 ip-10-0-138-136 kubenswrapper[2583]: I0709 02:39:25.932155 2583 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-bk576\" (UniqueName: \"kubernetes.io/projected/a9b51085-b15c-40be-8157-86c4f904879c-kube-api-access-bk576\") pod \"lws-controller-manager-7c74f5f585-g95ch\" (UID: \"a9b51085-b15c-40be-8157-86c4f904879c\") " pod="openshift-lws-operator/lws-controller-manager-7c74f5f585-g95ch" Jul 09 02:39:25.971063 ip-10-0-138-136 kubenswrapper[2583]: I0709 02:39:25.971011 2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-lws-operator/lws-controller-manager-7c74f5f585-g95ch" Jul 09 02:39:26.120807 ip-10-0-138-136 kubenswrapper[2583]: I0709 02:39:26.120770 2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-lws-operator/lws-controller-manager-7c74f5f585-g95ch"] Jul 09 02:39:26.124919 ip-10-0-138-136 kubenswrapper[2583]: I0709 02:39:26.124896 2583 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider Jul 09 02:39:26.171379 ip-10-0-138-136 kubenswrapper[2583]: I0709 02:39:26.171332 2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-lws-operator/lws-controller-manager-7c74f5f585-g95ch" event={"ID":"a9b51085-b15c-40be-8157-86c4f904879c","Type":"ContainerStarted","Data":"ba3aa2806c9fcc9dcba629e128c52a912da327de90f0c827e6274349899cb9b1"} Jul 09 02:39:29.188668 ip-10-0-138-136 kubenswrapper[2583]: I0709 02:39:29.188589 2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-lws-operator/lws-controller-manager-7c74f5f585-g95ch" event={"ID":"a9b51085-b15c-40be-8157-86c4f904879c","Type":"ContainerStarted","Data":"911cefb6a17ddfe74a0f65e2a2b723b60c0f13a9c73b26e8362866ca2c98bdda"} Jul 09 02:39:29.189121 ip-10-0-138-136 kubenswrapper[2583]: I0709 02:39:29.188682 2583 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-lws-operator/lws-controller-manager-7c74f5f585-g95ch" Jul 09 02:39:29.258576 ip-10-0-138-136 kubenswrapper[2583]: I0709 02:39:29.258524 2583 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-lws-operator/lws-controller-manager-7c74f5f585-g95ch" podStartSLOduration=1.46533007 podStartE2EDuration="4.258507178s" totalImagesPullingTime="2.793177108s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-09 02:39:25 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-09 02:39:29.254134638 +0000 UTC m=+315.186592125" watchObservedRunningTime="2026-07-09 02:39:29.258507178 +0000 UTC m=+315.190964665" Jul 09 02:39:29.723137 ip-10-0-138-136 kubenswrapper[2583]: I0709 02:39:29.723107 2583 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/kserve-controller-manager-d6f4b65b8-8nz2f"] Jul 09 02:39:29.726394 ip-10-0-138-136 kubenswrapper[2583]: I0709 02:39:29.726373 2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/kserve-controller-manager-d6f4b65b8-8nz2f" Jul 09 02:39:29.729449 ip-10-0-138-136 kubenswrapper[2583]: I0709 02:39:29.729430 2583 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"kserve-webhook-server-cert\"" Jul 09 02:39:29.729563 ip-10-0-138-136 kubenswrapper[2583]: I0709 02:39:29.729451 2583 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"kserve-controller-manager-dockercfg-wqcg6\"" Jul 09 02:39:29.738089 ip-10-0-138-136 kubenswrapper[2583]: I0709 02:39:29.738061 2583 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/llmisvc-controller-manager-777c6bd7d5-x8kkg"] Jul 09 02:39:29.741100 ip-10-0-138-136 kubenswrapper[2583]: I0709 02:39:29.741083 2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-x8kkg" Jul 09 02:39:29.743579 ip-10-0-138-136 kubenswrapper[2583]: I0709 02:39:29.743556 2583 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"llmisvc-webhook-server-cert\"" Jul 09 02:39:29.743726 ip-10-0-138-136 kubenswrapper[2583]: I0709 02:39:29.743685 2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/kserve-controller-manager-d6f4b65b8-8nz2f"] Jul 09 02:39:29.743899 ip-10-0-138-136 kubenswrapper[2583]: I0709 02:39:29.743743 2583 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"llmisvc-controller-manager-dockercfg-f9vxg\"" Jul 09 02:39:29.761486 ip-10-0-138-136 kubenswrapper[2583]: I0709 02:39:29.761464 2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/llmisvc-controller-manager-777c6bd7d5-x8kkg"] Jul 09 02:39:29.861040 ip-10-0-138-136 kubenswrapper[2583]: I0709 02:39:29.860991 2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/16abf7a1-5d49-42f8-99d1-301d35e2bf2e-cert\") pod \"kserve-controller-manager-d6f4b65b8-8nz2f\" (UID: \"16abf7a1-5d49-42f8-99d1-301d35e2bf2e\") " pod="opendatahub/kserve-controller-manager-d6f4b65b8-8nz2f" Jul 09 02:39:29.861222 ip-10-0-138-136 kubenswrapper[2583]: I0709 02:39:29.861111 2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-kqd22\" (UniqueName: \"kubernetes.io/projected/628cfe58-d957-468b-a7bf-76ba45800999-kube-api-access-kqd22\") pod \"llmisvc-controller-manager-777c6bd7d5-x8kkg\" (UID: \"628cfe58-d957-468b-a7bf-76ba45800999\") " pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-x8kkg" Jul 09 02:39:29.861222 ip-10-0-138-136 kubenswrapper[2583]: I0709 02:39:29.861213 2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/628cfe58-d957-468b-a7bf-76ba45800999-cert\") pod \"llmisvc-controller-manager-777c6bd7d5-x8kkg\" (UID: \"628cfe58-d957-468b-a7bf-76ba45800999\") " pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-x8kkg" Jul 09 02:39:29.861300 ip-10-0-138-136 kubenswrapper[2583]: I0709 02:39:29.861280 2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-s52fq\" (UniqueName: \"kubernetes.io/projected/16abf7a1-5d49-42f8-99d1-301d35e2bf2e-kube-api-access-s52fq\") pod \"kserve-controller-manager-d6f4b65b8-8nz2f\" (UID: \"16abf7a1-5d49-42f8-99d1-301d35e2bf2e\") " pod="opendatahub/kserve-controller-manager-d6f4b65b8-8nz2f" Jul 09 02:39:29.962356 ip-10-0-138-136 kubenswrapper[2583]: I0709 02:39:29.962323 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/628cfe58-d957-468b-a7bf-76ba45800999-cert\") pod \"llmisvc-controller-manager-777c6bd7d5-x8kkg\" (UID: \"628cfe58-d957-468b-a7bf-76ba45800999\") " pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-x8kkg" Jul 09 02:39:29.962538 ip-10-0-138-136 kubenswrapper[2583]: I0709 02:39:29.962374 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-s52fq\" (UniqueName: \"kubernetes.io/projected/16abf7a1-5d49-42f8-99d1-301d35e2bf2e-kube-api-access-s52fq\") pod \"kserve-controller-manager-d6f4b65b8-8nz2f\" (UID: \"16abf7a1-5d49-42f8-99d1-301d35e2bf2e\") " pod="opendatahub/kserve-controller-manager-d6f4b65b8-8nz2f" Jul 09 02:39:29.962538 ip-10-0-138-136 kubenswrapper[2583]: I0709 02:39:29.962502 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/16abf7a1-5d49-42f8-99d1-301d35e2bf2e-cert\") pod \"kserve-controller-manager-d6f4b65b8-8nz2f\" (UID: \"16abf7a1-5d49-42f8-99d1-301d35e2bf2e\") " pod="opendatahub/kserve-controller-manager-d6f4b65b8-8nz2f" Jul 09 02:39:29.962656 ip-10-0-138-136 kubenswrapper[2583]: E0709 02:39:29.962583 2583 secret.go:189] Couldn't get secret opendatahub/kserve-webhook-server-cert: secret "kserve-webhook-server-cert" not found Jul 09 02:39:29.962656 ip-10-0-138-136 kubenswrapper[2583]: I0709 02:39:29.962594 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-kqd22\" (UniqueName: \"kubernetes.io/projected/628cfe58-d957-468b-a7bf-76ba45800999-kube-api-access-kqd22\") pod \"llmisvc-controller-manager-777c6bd7d5-x8kkg\" (UID: \"628cfe58-d957-468b-a7bf-76ba45800999\") " pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-x8kkg" Jul 09 02:39:29.962656 ip-10-0-138-136 kubenswrapper[2583]: E0709 02:39:29.962644 2583 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/16abf7a1-5d49-42f8-99d1-301d35e2bf2e-cert podName:16abf7a1-5d49-42f8-99d1-301d35e2bf2e nodeName:}" failed. No retries permitted until 2026-07-09 02:39:30.46262411 +0000 UTC m=+316.395081577 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "cert" (UniqueName: "kubernetes.io/secret/16abf7a1-5d49-42f8-99d1-301d35e2bf2e-cert") pod "kserve-controller-manager-d6f4b65b8-8nz2f" (UID: "16abf7a1-5d49-42f8-99d1-301d35e2bf2e") : secret "kserve-webhook-server-cert" not found Jul 09 02:39:29.964957 ip-10-0-138-136 kubenswrapper[2583]: I0709 02:39:29.964927 2583 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/628cfe58-d957-468b-a7bf-76ba45800999-cert\") pod \"llmisvc-controller-manager-777c6bd7d5-x8kkg\" (UID: \"628cfe58-d957-468b-a7bf-76ba45800999\") " pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-x8kkg" Jul 09 02:39:29.977864 ip-10-0-138-136 kubenswrapper[2583]: I0709 02:39:29.977807 2583 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-kqd22\" (UniqueName: \"kubernetes.io/projected/628cfe58-d957-468b-a7bf-76ba45800999-kube-api-access-kqd22\") pod \"llmisvc-controller-manager-777c6bd7d5-x8kkg\" (UID: \"628cfe58-d957-468b-a7bf-76ba45800999\") " pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-x8kkg" Jul 09 02:39:29.982539 ip-10-0-138-136 kubenswrapper[2583]: I0709 02:39:29.982516 2583 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-s52fq\" (UniqueName: \"kubernetes.io/projected/16abf7a1-5d49-42f8-99d1-301d35e2bf2e-kube-api-access-s52fq\") pod \"kserve-controller-manager-d6f4b65b8-8nz2f\" (UID: \"16abf7a1-5d49-42f8-99d1-301d35e2bf2e\") " pod="opendatahub/kserve-controller-manager-d6f4b65b8-8nz2f" Jul 09 02:39:30.053377 ip-10-0-138-136 kubenswrapper[2583]: I0709 02:39:30.053339 2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-x8kkg" Jul 09 02:39:30.165669 ip-10-0-138-136 kubenswrapper[2583]: I0709 02:39:30.165113 2583 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4jzfbc"] Jul 09 02:39:30.169510 ip-10-0-138-136 kubenswrapper[2583]: I0709 02:39:30.169483 2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4jzfbc" Jul 09 02:39:30.172884 ip-10-0-138-136 kubenswrapper[2583]: I0709 02:39:30.172672 2583 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"data-science-gateway-data-science-gateway-class-dockercfg-w892n\"" Jul 09 02:39:30.173077 ip-10-0-138-136 kubenswrapper[2583]: I0709 02:39:30.173032 2583 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"openshift-gw-ca-root-cert\"" Jul 09 02:39:30.192696 ip-10-0-138-136 kubenswrapper[2583]: I0709 02:39:30.192132 2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4jzfbc"] Jul 09 02:39:30.247511 ip-10-0-138-136 kubenswrapper[2583]: I0709 02:39:30.247446 2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/llmisvc-controller-manager-777c6bd7d5-x8kkg"] Jul 09 02:39:30.250171 ip-10-0-138-136 kubenswrapper[2583]: W0709 02:39:30.250126 2583 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-pod628cfe58_d957_468b_a7bf_76ba45800999.slice/crio-0e545ff1a5645d6f29f60723963be2a6352eb96592443c0267fb13cae4d39acc WatchSource:0}: Error finding container 0e545ff1a5645d6f29f60723963be2a6352eb96592443c0267fb13cae4d39acc: Status 404 returned error can't find the container with id 0e545ff1a5645d6f29f60723963be2a6352eb96592443c0267fb13cae4d39acc Jul 09 02:39:30.266736 ip-10-0-138-136 kubenswrapper[2583]: I0709 02:39:30.266677 2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/c13f6261-b1d7-4f9a-9558-ab4f300de9b0-istiod-ca-cert\") pod \"data-science-gateway-data-science-gateway-class-6576859cf4jzfbc\" (UID: \"c13f6261-b1d7-4f9a-9558-ab4f300de9b0\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4jzfbc" Jul 09 02:39:30.266736 ip-10-0-138-136 kubenswrapper[2583]: I0709 02:39:30.266732 2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/c13f6261-b1d7-4f9a-9558-ab4f300de9b0-istio-token\") pod \"data-science-gateway-data-science-gateway-class-6576859cf4jzfbc\" (UID: \"c13f6261-b1d7-4f9a-9558-ab4f300de9b0\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4jzfbc" Jul 09 02:39:30.267003 ip-10-0-138-136 kubenswrapper[2583]: I0709 02:39:30.266821 2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/c13f6261-b1d7-4f9a-9558-ab4f300de9b0-istio-envoy\") pod \"data-science-gateway-data-science-gateway-class-6576859cf4jzfbc\" (UID: \"c13f6261-b1d7-4f9a-9558-ab4f300de9b0\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4jzfbc" Jul 09 02:39:30.267003 ip-10-0-138-136 kubenswrapper[2583]: I0709 02:39:30.266859 2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/c13f6261-b1d7-4f9a-9558-ab4f300de9b0-workload-certs\") pod \"data-science-gateway-data-science-gateway-class-6576859cf4jzfbc\" (UID: \"c13f6261-b1d7-4f9a-9558-ab4f300de9b0\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4jzfbc" Jul 09 02:39:30.267003 ip-10-0-138-136 kubenswrapper[2583]: I0709 02:39:30.266913 2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/c13f6261-b1d7-4f9a-9558-ab4f300de9b0-istio-podinfo\") pod \"data-science-gateway-data-science-gateway-class-6576859cf4jzfbc\" (UID: \"c13f6261-b1d7-4f9a-9558-ab4f300de9b0\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4jzfbc" Jul 09 02:39:30.267003 ip-10-0-138-136 kubenswrapper[2583]: I0709 02:39:30.266943 2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/c13f6261-b1d7-4f9a-9558-ab4f300de9b0-credential-socket\") pod \"data-science-gateway-data-science-gateway-class-6576859cf4jzfbc\" (UID: \"c13f6261-b1d7-4f9a-9558-ab4f300de9b0\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4jzfbc" Jul 09 02:39:30.267003 ip-10-0-138-136 kubenswrapper[2583]: I0709 02:39:30.266979 2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/c13f6261-b1d7-4f9a-9558-ab4f300de9b0-workload-socket\") pod \"data-science-gateway-data-science-gateway-class-6576859cf4jzfbc\" (UID: \"c13f6261-b1d7-4f9a-9558-ab4f300de9b0\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4jzfbc" Jul 09 02:39:30.267003 ip-10-0-138-136 kubenswrapper[2583]: I0709 02:39:30.266997 2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/c13f6261-b1d7-4f9a-9558-ab4f300de9b0-istio-data\") pod \"data-science-gateway-data-science-gateway-class-6576859cf4jzfbc\" (UID: \"c13f6261-b1d7-4f9a-9558-ab4f300de9b0\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4jzfbc" Jul 09 02:39:30.267383 ip-10-0-138-136 kubenswrapper[2583]: I0709 02:39:30.267014 2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-v2fp4\" (UniqueName: \"kubernetes.io/projected/c13f6261-b1d7-4f9a-9558-ab4f300de9b0-kube-api-access-v2fp4\") pod \"data-science-gateway-data-science-gateway-class-6576859cf4jzfbc\" (UID: \"c13f6261-b1d7-4f9a-9558-ab4f300de9b0\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4jzfbc" Jul 09 02:39:30.368136 ip-10-0-138-136 kubenswrapper[2583]: I0709 02:39:30.368093 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/c13f6261-b1d7-4f9a-9558-ab4f300de9b0-workload-certs\") pod \"data-science-gateway-data-science-gateway-class-6576859cf4jzfbc\" (UID: \"c13f6261-b1d7-4f9a-9558-ab4f300de9b0\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4jzfbc" Jul 09 02:39:30.368330 ip-10-0-138-136 kubenswrapper[2583]: I0709 02:39:30.368163 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/c13f6261-b1d7-4f9a-9558-ab4f300de9b0-istio-podinfo\") pod \"data-science-gateway-data-science-gateway-class-6576859cf4jzfbc\" (UID: \"c13f6261-b1d7-4f9a-9558-ab4f300de9b0\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4jzfbc" Jul 09 02:39:30.368330 ip-10-0-138-136 kubenswrapper[2583]: I0709 02:39:30.368204 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/c13f6261-b1d7-4f9a-9558-ab4f300de9b0-credential-socket\") pod \"data-science-gateway-data-science-gateway-class-6576859cf4jzfbc\" (UID: \"c13f6261-b1d7-4f9a-9558-ab4f300de9b0\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4jzfbc" Jul 09 02:39:30.368502 ip-10-0-138-136 kubenswrapper[2583]: I0709 02:39:30.368476 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/c13f6261-b1d7-4f9a-9558-ab4f300de9b0-workload-socket\") pod \"data-science-gateway-data-science-gateway-class-6576859cf4jzfbc\" (UID: \"c13f6261-b1d7-4f9a-9558-ab4f300de9b0\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4jzfbc" Jul 09 02:39:30.368704 ip-10-0-138-136 kubenswrapper[2583]: I0709 02:39:30.368582 2583 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/c13f6261-b1d7-4f9a-9558-ab4f300de9b0-workload-certs\") pod \"data-science-gateway-data-science-gateway-class-6576859cf4jzfbc\" (UID: \"c13f6261-b1d7-4f9a-9558-ab4f300de9b0\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4jzfbc" Jul 09 02:39:30.368778 ip-10-0-138-136 kubenswrapper[2583]: I0709 02:39:30.368614 2583 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/c13f6261-b1d7-4f9a-9558-ab4f300de9b0-credential-socket\") pod \"data-science-gateway-data-science-gateway-class-6576859cf4jzfbc\" (UID: \"c13f6261-b1d7-4f9a-9558-ab4f300de9b0\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4jzfbc" Jul 09 02:39:30.368778 ip-10-0-138-136 kubenswrapper[2583]: I0709 02:39:30.368688 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/c13f6261-b1d7-4f9a-9558-ab4f300de9b0-istio-data\") pod \"data-science-gateway-data-science-gateway-class-6576859cf4jzfbc\" (UID: \"c13f6261-b1d7-4f9a-9558-ab4f300de9b0\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4jzfbc" Jul 09 02:39:30.368878 ip-10-0-138-136 kubenswrapper[2583]: I0709 02:39:30.368784 2583 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/c13f6261-b1d7-4f9a-9558-ab4f300de9b0-workload-socket\") pod \"data-science-gateway-data-science-gateway-class-6576859cf4jzfbc\" (UID: \"c13f6261-b1d7-4f9a-9558-ab4f300de9b0\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4jzfbc" Jul 09 02:39:30.368878 ip-10-0-138-136 kubenswrapper[2583]: I0709 02:39:30.368788 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-v2fp4\" (UniqueName: \"kubernetes.io/projected/c13f6261-b1d7-4f9a-9558-ab4f300de9b0-kube-api-access-v2fp4\") pod \"data-science-gateway-data-science-gateway-class-6576859cf4jzfbc\" (UID: \"c13f6261-b1d7-4f9a-9558-ab4f300de9b0\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4jzfbc" Jul 09 02:39:30.368974 ip-10-0-138-136 kubenswrapper[2583]: I0709 02:39:30.368916 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/c13f6261-b1d7-4f9a-9558-ab4f300de9b0-istiod-ca-cert\") pod \"data-science-gateway-data-science-gateway-class-6576859cf4jzfbc\" (UID: \"c13f6261-b1d7-4f9a-9558-ab4f300de9b0\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4jzfbc" Jul 09 02:39:30.368974 ip-10-0-138-136 kubenswrapper[2583]: I0709 02:39:30.368930 2583 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/c13f6261-b1d7-4f9a-9558-ab4f300de9b0-istio-data\") pod \"data-science-gateway-data-science-gateway-class-6576859cf4jzfbc\" (UID: \"c13f6261-b1d7-4f9a-9558-ab4f300de9b0\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4jzfbc" Jul 09 02:39:30.368974 ip-10-0-138-136 kubenswrapper[2583]: I0709 02:39:30.368950 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/c13f6261-b1d7-4f9a-9558-ab4f300de9b0-istio-token\") pod \"data-science-gateway-data-science-gateway-class-6576859cf4jzfbc\" (UID: \"c13f6261-b1d7-4f9a-9558-ab4f300de9b0\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4jzfbc" Jul 09 02:39:30.369149 ip-10-0-138-136 kubenswrapper[2583]: I0709 02:39:30.369004 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/c13f6261-b1d7-4f9a-9558-ab4f300de9b0-istio-envoy\") pod \"data-science-gateway-data-science-gateway-class-6576859cf4jzfbc\" (UID: \"c13f6261-b1d7-4f9a-9558-ab4f300de9b0\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4jzfbc" Jul 09 02:39:30.370159 ip-10-0-138-136 kubenswrapper[2583]: I0709 02:39:30.370131 2583 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/c13f6261-b1d7-4f9a-9558-ab4f300de9b0-istiod-ca-cert\") pod \"data-science-gateway-data-science-gateway-class-6576859cf4jzfbc\" (UID: \"c13f6261-b1d7-4f9a-9558-ab4f300de9b0\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4jzfbc" Jul 09 02:39:30.371213 ip-10-0-138-136 kubenswrapper[2583]: I0709 02:39:30.371190 2583 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/c13f6261-b1d7-4f9a-9558-ab4f300de9b0-istio-envoy\") pod \"data-science-gateway-data-science-gateway-class-6576859cf4jzfbc\" (UID: \"c13f6261-b1d7-4f9a-9558-ab4f300de9b0\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4jzfbc" Jul 09 02:39:30.371340 ip-10-0-138-136 kubenswrapper[2583]: I0709 02:39:30.371313 2583 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/c13f6261-b1d7-4f9a-9558-ab4f300de9b0-istio-podinfo\") pod \"data-science-gateway-data-science-gateway-class-6576859cf4jzfbc\" (UID: \"c13f6261-b1d7-4f9a-9558-ab4f300de9b0\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4jzfbc" Jul 09 02:39:30.379273 ip-10-0-138-136 kubenswrapper[2583]: I0709 02:39:30.379240 2583 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/c13f6261-b1d7-4f9a-9558-ab4f300de9b0-istio-token\") pod \"data-science-gateway-data-science-gateway-class-6576859cf4jzfbc\" (UID: \"c13f6261-b1d7-4f9a-9558-ab4f300de9b0\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4jzfbc" Jul 09 02:39:30.379806 ip-10-0-138-136 kubenswrapper[2583]: I0709 02:39:30.379783 2583 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-v2fp4\" (UniqueName: \"kubernetes.io/projected/c13f6261-b1d7-4f9a-9558-ab4f300de9b0-kube-api-access-v2fp4\") pod \"data-science-gateway-data-science-gateway-class-6576859cf4jzfbc\" (UID: \"c13f6261-b1d7-4f9a-9558-ab4f300de9b0\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4jzfbc" Jul 09 02:39:30.470508 ip-10-0-138-136 kubenswrapper[2583]: I0709 02:39:30.470463 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/16abf7a1-5d49-42f8-99d1-301d35e2bf2e-cert\") pod \"kserve-controller-manager-d6f4b65b8-8nz2f\" (UID: \"16abf7a1-5d49-42f8-99d1-301d35e2bf2e\") " pod="opendatahub/kserve-controller-manager-d6f4b65b8-8nz2f" Jul 09 02:39:30.473075 ip-10-0-138-136 kubenswrapper[2583]: I0709 02:39:30.473043 2583 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/16abf7a1-5d49-42f8-99d1-301d35e2bf2e-cert\") pod \"kserve-controller-manager-d6f4b65b8-8nz2f\" (UID: \"16abf7a1-5d49-42f8-99d1-301d35e2bf2e\") " pod="opendatahub/kserve-controller-manager-d6f4b65b8-8nz2f" Jul 09 02:39:30.519189 ip-10-0-138-136 kubenswrapper[2583]: I0709 02:39:30.519089 2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4jzfbc" Jul 09 02:39:30.636296 ip-10-0-138-136 kubenswrapper[2583]: I0709 02:39:30.636266 2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/kserve-controller-manager-d6f4b65b8-8nz2f" Jul 09 02:39:30.678756 ip-10-0-138-136 kubenswrapper[2583]: I0709 02:39:30.678674 2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4jzfbc"] Jul 09 02:39:30.680988 ip-10-0-138-136 kubenswrapper[2583]: W0709 02:39:30.680964 2583 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podc13f6261_b1d7_4f9a_9558_ab4f300de9b0.slice/crio-7fb33fd307c61d5fa11b901a41b45dc1f3dcc1def5bb2515cb363c514ad4ce86 WatchSource:0}: Error finding container 7fb33fd307c61d5fa11b901a41b45dc1f3dcc1def5bb2515cb363c514ad4ce86: Status 404 returned error can't find the container with id 7fb33fd307c61d5fa11b901a41b45dc1f3dcc1def5bb2515cb363c514ad4ce86 Jul 09 02:39:30.776738 ip-10-0-138-136 kubenswrapper[2583]: I0709 02:39:30.776693 2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/kserve-controller-manager-d6f4b65b8-8nz2f"] Jul 09 02:39:30.779404 ip-10-0-138-136 kubenswrapper[2583]: W0709 02:39:30.779339 2583 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod16abf7a1_5d49_42f8_99d1_301d35e2bf2e.slice/crio-cdc85cbe3ffe66e44273189dd889368b68b0b7657e2a9baa83e3a89ec7a05bdc WatchSource:0}: Error finding container cdc85cbe3ffe66e44273189dd889368b68b0b7657e2a9baa83e3a89ec7a05bdc: Status 404 returned error can't find the container with id cdc85cbe3ffe66e44273189dd889368b68b0b7657e2a9baa83e3a89ec7a05bdc Jul 09 02:39:31.223544 ip-10-0-138-136 kubenswrapper[2583]: I0709 02:39:31.223455 2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/kserve-controller-manager-d6f4b65b8-8nz2f" event={"ID":"16abf7a1-5d49-42f8-99d1-301d35e2bf2e","Type":"ContainerStarted","Data":"cdc85cbe3ffe66e44273189dd889368b68b0b7657e2a9baa83e3a89ec7a05bdc"} Jul 09 02:39:31.224819 ip-10-0-138-136 kubenswrapper[2583]: I0709 02:39:31.224745 2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4jzfbc" event={"ID":"c13f6261-b1d7-4f9a-9558-ab4f300de9b0","Type":"ContainerStarted","Data":"7fb33fd307c61d5fa11b901a41b45dc1f3dcc1def5bb2515cb363c514ad4ce86"} Jul 09 02:39:31.225932 ip-10-0-138-136 kubenswrapper[2583]: I0709 02:39:31.225904 2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-x8kkg" event={"ID":"628cfe58-d957-468b-a7bf-76ba45800999","Type":"ContainerStarted","Data":"0e545ff1a5645d6f29f60723963be2a6352eb96592443c0267fb13cae4d39acc"} Jul 09 02:39:34.977336 ip-10-0-138-136 kubenswrapper[2583]: I0709 02:39:34.977283 2583 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236232Ki","pods":"250"} Jul 09 02:39:34.977753 ip-10-0-138-136 kubenswrapper[2583]: I0709 02:39:34.977383 2583 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236232Ki","pods":"250"} Jul 09 02:39:34.977753 ip-10-0-138-136 kubenswrapper[2583]: I0709 02:39:34.977426 2583 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236232Ki","pods":"250"} Jul 09 02:39:35.251206 ip-10-0-138-136 kubenswrapper[2583]: I0709 02:39:35.251163 2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/kserve-controller-manager-d6f4b65b8-8nz2f" event={"ID":"16abf7a1-5d49-42f8-99d1-301d35e2bf2e","Type":"ContainerStarted","Data":"1066bb9c3837c6f6a84ebb0c94ed56acd30525b5d3153914a6fc0bdd98e7d9e9"} Jul 09 02:39:35.251410 ip-10-0-138-136 kubenswrapper[2583]: I0709 02:39:35.251318 2583 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/kserve-controller-manager-d6f4b65b8-8nz2f" Jul 09 02:39:35.252811 ip-10-0-138-136 kubenswrapper[2583]: I0709 02:39:35.252786 2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4jzfbc" event={"ID":"c13f6261-b1d7-4f9a-9558-ab4f300de9b0","Type":"ContainerStarted","Data":"05d25222322b6c0e90e6719baee3acbab789b1b2d3df4dac3b31d3831d5eb7d4"} Jul 09 02:39:35.254340 ip-10-0-138-136 kubenswrapper[2583]: I0709 02:39:35.254319 2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-x8kkg" event={"ID":"628cfe58-d957-468b-a7bf-76ba45800999","Type":"ContainerStarted","Data":"26f49632479be3aac2d26433be6cdd84bf5f537186b50b002c02fb302cb26581"} Jul 09 02:39:35.255136 ip-10-0-138-136 kubenswrapper[2583]: I0709 02:39:35.255051 2583 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-x8kkg" Jul 09 02:39:35.271750 ip-10-0-138-136 kubenswrapper[2583]: I0709 02:39:35.271671 2583 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/kserve-controller-manager-d6f4b65b8-8nz2f" podStartSLOduration=2.071563067 podStartE2EDuration="6.271653439s" totalImagesPullingTime="4.200090372s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-09 02:39:29 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-09 02:39:35.269290515 +0000 UTC m=+321.201747998" watchObservedRunningTime="2026-07-09 02:39:35.271653439 +0000 UTC m=+321.204110925" Jul 09 02:39:35.288391 ip-10-0-138-136 kubenswrapper[2583]: I0709 02:39:35.288328 2583 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-x8kkg" podStartSLOduration=1.5608184010000001 podStartE2EDuration="6.288310749s" totalImagesPullingTime="4.727492348s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-09 02:39:29 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-09 02:39:35.287573498 +0000 UTC m=+321.220031021" watchObservedRunningTime="2026-07-09 02:39:35.288310749 +0000 UTC m=+321.220768286" Jul 09 02:39:35.312105 ip-10-0-138-136 kubenswrapper[2583]: I0709 02:39:35.312046 2583 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4jzfbc" podStartSLOduration=1.018143886 podStartE2EDuration="5.312026492s" totalImagesPullingTime="4.293882606s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-09 02:39:30 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-09 02:39:35.310827111 +0000 UTC m=+321.243284598" watchObservedRunningTime="2026-07-09 02:39:35.312026492 +0000 UTC m=+321.244483979" Jul 09 02:39:35.519536 ip-10-0-138-136 kubenswrapper[2583]: I0709 02:39:35.519441 2583 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4jzfbc" Jul 09 02:39:36.525474 ip-10-0-138-136 kubenswrapper[2583]: I0709 02:39:36.525445 2583 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4jzfbc" Jul 09 02:39:37.263626 ip-10-0-138-136 kubenswrapper[2583]: I0709 02:39:37.263594 2583 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4jzfbc" Jul 09 02:39:37.264519 ip-10-0-138-136 kubenswrapper[2583]: I0709 02:39:37.264501 2583 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4jzfbc" Jul 09 02:39:40.220695 ip-10-0-138-136 kubenswrapper[2583]: I0709 02:39:40.220660 2583 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-lws-operator/lws-controller-manager-7c74f5f585-g95ch" Jul 09 02:40:06.260967 ip-10-0-138-136 kubenswrapper[2583]: I0709 02:40:06.260930 2583 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-x8kkg" Jul 09 02:40:06.264144 ip-10-0-138-136 kubenswrapper[2583]: I0709 02:40:06.264119 2583 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/kserve-controller-manager-d6f4b65b8-8nz2f" Jul 09 02:41:03.958631 ip-10-0-138-136 kubenswrapper[2583]: I0709 02:41:03.958594 2583 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console/console-b8f649c79-zmp6r"] Jul 09 02:41:03.962506 ip-10-0-138-136 kubenswrapper[2583]: I0709 02:41:03.962474 2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-b8f649c79-zmp6r" Jul 09 02:41:03.972734 ip-10-0-138-136 kubenswrapper[2583]: I0709 02:41:03.972676 2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-b8f649c79-zmp6r"] Jul 09 02:41:04.087759 ip-10-0-138-136 kubenswrapper[2583]: I0709 02:41:04.087700 2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/1662e0aa-0c4a-495e-807c-dc7e0abdbd50-console-oauth-config\") pod \"console-b8f649c79-zmp6r\" (UID: \"1662e0aa-0c4a-495e-807c-dc7e0abdbd50\") " pod="openshift-console/console-b8f649c79-zmp6r" Jul 09 02:41:04.087903 ip-10-0-138-136 kubenswrapper[2583]: I0709 02:41:04.087806 2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/1662e0aa-0c4a-495e-807c-dc7e0abdbd50-service-ca\") pod \"console-b8f649c79-zmp6r\" (UID: \"1662e0aa-0c4a-495e-807c-dc7e0abdbd50\") " pod="openshift-console/console-b8f649c79-zmp6r" Jul 09 02:41:04.087903 ip-10-0-138-136 kubenswrapper[2583]: I0709 02:41:04.087832 2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/1662e0aa-0c4a-495e-807c-dc7e0abdbd50-oauth-serving-cert\") pod \"console-b8f649c79-zmp6r\" (UID: \"1662e0aa-0c4a-495e-807c-dc7e0abdbd50\") " pod="openshift-console/console-b8f649c79-zmp6r" Jul 09 02:41:04.087903 ip-10-0-138-136 kubenswrapper[2583]: I0709 02:41:04.087859 2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-qgnmp\" (UniqueName: \"kubernetes.io/projected/1662e0aa-0c4a-495e-807c-dc7e0abdbd50-kube-api-access-qgnmp\") pod \"console-b8f649c79-zmp6r\" (UID: \"1662e0aa-0c4a-495e-807c-dc7e0abdbd50\") " pod="openshift-console/console-b8f649c79-zmp6r" Jul 09 02:41:04.088027 ip-10-0-138-136 kubenswrapper[2583]: I0709 02:41:04.087950 2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/1662e0aa-0c4a-495e-807c-dc7e0abdbd50-trusted-ca-bundle\") pod \"console-b8f649c79-zmp6r\" (UID: \"1662e0aa-0c4a-495e-807c-dc7e0abdbd50\") " pod="openshift-console/console-b8f649c79-zmp6r" Jul 09 02:41:04.088027 ip-10-0-138-136 kubenswrapper[2583]: I0709 02:41:04.087977 2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/1662e0aa-0c4a-495e-807c-dc7e0abdbd50-console-config\") pod \"console-b8f649c79-zmp6r\" (UID: \"1662e0aa-0c4a-495e-807c-dc7e0abdbd50\") " pod="openshift-console/console-b8f649c79-zmp6r" Jul 09 02:41:04.088027 ip-10-0-138-136 kubenswrapper[2583]: I0709 02:41:04.088013 2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/1662e0aa-0c4a-495e-807c-dc7e0abdbd50-console-serving-cert\") pod \"console-b8f649c79-zmp6r\" (UID: \"1662e0aa-0c4a-495e-807c-dc7e0abdbd50\") " pod="openshift-console/console-b8f649c79-zmp6r" Jul 09 02:41:04.188852 ip-10-0-138-136 kubenswrapper[2583]: I0709 02:41:04.188825 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/1662e0aa-0c4a-495e-807c-dc7e0abdbd50-trusted-ca-bundle\") pod \"console-b8f649c79-zmp6r\" (UID: \"1662e0aa-0c4a-495e-807c-dc7e0abdbd50\") " pod="openshift-console/console-b8f649c79-zmp6r" Jul 09 02:41:04.188852 ip-10-0-138-136 kubenswrapper[2583]: I0709 02:41:04.188855 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/1662e0aa-0c4a-495e-807c-dc7e0abdbd50-console-config\") pod \"console-b8f649c79-zmp6r\" (UID: \"1662e0aa-0c4a-495e-807c-dc7e0abdbd50\") " pod="openshift-console/console-b8f649c79-zmp6r" Jul 09 02:41:04.189013 ip-10-0-138-136 kubenswrapper[2583]: I0709 02:41:04.188944 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/1662e0aa-0c4a-495e-807c-dc7e0abdbd50-console-serving-cert\") pod \"console-b8f649c79-zmp6r\" (UID: \"1662e0aa-0c4a-495e-807c-dc7e0abdbd50\") " pod="openshift-console/console-b8f649c79-zmp6r" Jul 09 02:41:04.189013 ip-10-0-138-136 kubenswrapper[2583]: I0709 02:41:04.188996 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/1662e0aa-0c4a-495e-807c-dc7e0abdbd50-console-oauth-config\") pod \"console-b8f649c79-zmp6r\" (UID: \"1662e0aa-0c4a-495e-807c-dc7e0abdbd50\") " pod="openshift-console/console-b8f649c79-zmp6r" Jul 09 02:41:04.189118 ip-10-0-138-136 kubenswrapper[2583]: I0709 02:41:04.189025 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/1662e0aa-0c4a-495e-807c-dc7e0abdbd50-service-ca\") pod \"console-b8f649c79-zmp6r\" (UID: \"1662e0aa-0c4a-495e-807c-dc7e0abdbd50\") " pod="openshift-console/console-b8f649c79-zmp6r" Jul 09 02:41:04.189118 ip-10-0-138-136 kubenswrapper[2583]: I0709 02:41:04.189043 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/1662e0aa-0c4a-495e-807c-dc7e0abdbd50-oauth-serving-cert\") pod \"console-b8f649c79-zmp6r\" (UID: \"1662e0aa-0c4a-495e-807c-dc7e0abdbd50\") " pod="openshift-console/console-b8f649c79-zmp6r" Jul 09 02:41:04.189118 ip-10-0-138-136 kubenswrapper[2583]: I0709 02:41:04.189062 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-qgnmp\" (UniqueName: \"kubernetes.io/projected/1662e0aa-0c4a-495e-807c-dc7e0abdbd50-kube-api-access-qgnmp\") pod \"console-b8f649c79-zmp6r\" (UID: \"1662e0aa-0c4a-495e-807c-dc7e0abdbd50\") " pod="openshift-console/console-b8f649c79-zmp6r" Jul 09 02:41:04.189599 ip-10-0-138-136 kubenswrapper[2583]: I0709 02:41:04.189576 2583 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/1662e0aa-0c4a-495e-807c-dc7e0abdbd50-console-config\") pod \"console-b8f649c79-zmp6r\" (UID: \"1662e0aa-0c4a-495e-807c-dc7e0abdbd50\") " pod="openshift-console/console-b8f649c79-zmp6r" Jul 09 02:41:04.189773 ip-10-0-138-136 kubenswrapper[2583]: I0709 02:41:04.189683 2583 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/1662e0aa-0c4a-495e-807c-dc7e0abdbd50-service-ca\") pod \"console-b8f649c79-zmp6r\" (UID: \"1662e0aa-0c4a-495e-807c-dc7e0abdbd50\") " pod="openshift-console/console-b8f649c79-zmp6r" Jul 09 02:41:04.189849 ip-10-0-138-136 kubenswrapper[2583]: I0709 02:41:04.189755 2583 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/1662e0aa-0c4a-495e-807c-dc7e0abdbd50-trusted-ca-bundle\") pod \"console-b8f649c79-zmp6r\" (UID: \"1662e0aa-0c4a-495e-807c-dc7e0abdbd50\") " pod="openshift-console/console-b8f649c79-zmp6r" Jul 09 02:41:04.189849 ip-10-0-138-136 kubenswrapper[2583]: I0709 02:41:04.189781 2583 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/1662e0aa-0c4a-495e-807c-dc7e0abdbd50-oauth-serving-cert\") pod \"console-b8f649c79-zmp6r\" (UID: \"1662e0aa-0c4a-495e-807c-dc7e0abdbd50\") " pod="openshift-console/console-b8f649c79-zmp6r" Jul 09 02:41:04.191358 ip-10-0-138-136 kubenswrapper[2583]: I0709 02:41:04.191332 2583 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/1662e0aa-0c4a-495e-807c-dc7e0abdbd50-console-oauth-config\") pod \"console-b8f649c79-zmp6r\" (UID: \"1662e0aa-0c4a-495e-807c-dc7e0abdbd50\") " pod="openshift-console/console-b8f649c79-zmp6r" Jul 09 02:41:04.191507 ip-10-0-138-136 kubenswrapper[2583]: I0709 02:41:04.191488 2583 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/1662e0aa-0c4a-495e-807c-dc7e0abdbd50-console-serving-cert\") pod \"console-b8f649c79-zmp6r\" (UID: \"1662e0aa-0c4a-495e-807c-dc7e0abdbd50\") " pod="openshift-console/console-b8f649c79-zmp6r" Jul 09 02:41:04.196727 ip-10-0-138-136 kubenswrapper[2583]: I0709 02:41:04.196695 2583 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-qgnmp\" (UniqueName: \"kubernetes.io/projected/1662e0aa-0c4a-495e-807c-dc7e0abdbd50-kube-api-access-qgnmp\") pod \"console-b8f649c79-zmp6r\" (UID: \"1662e0aa-0c4a-495e-807c-dc7e0abdbd50\") " pod="openshift-console/console-b8f649c79-zmp6r" Jul 09 02:41:04.274749 ip-10-0-138-136 kubenswrapper[2583]: I0709 02:41:04.274702 2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-b8f649c79-zmp6r" Jul 09 02:41:04.412491 ip-10-0-138-136 kubenswrapper[2583]: I0709 02:41:04.412466 2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-b8f649c79-zmp6r"] Jul 09 02:41:04.680759 ip-10-0-138-136 kubenswrapper[2583]: I0709 02:41:04.680658 2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-b8f649c79-zmp6r" event={"ID":"1662e0aa-0c4a-495e-807c-dc7e0abdbd50","Type":"ContainerStarted","Data":"f7c713d296668e75fcf80d61b55fdf653936b62440826e927642b119dfc91c03"} Jul 09 02:41:04.680759 ip-10-0-138-136 kubenswrapper[2583]: I0709 02:41:04.680741 2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-b8f649c79-zmp6r" event={"ID":"1662e0aa-0c4a-495e-807c-dc7e0abdbd50","Type":"ContainerStarted","Data":"21057370a9de3e9f2c038beae508de2bae026039ff0818ed6bc6703fd866803e"} Jul 09 02:41:04.701963 ip-10-0-138-136 kubenswrapper[2583]: I0709 02:41:04.701919 2583 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console/console-b8f649c79-zmp6r" podStartSLOduration=1.7019049819999998 podStartE2EDuration="1.701904982s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-09 02:41:03 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-09 02:41:04.700520803 +0000 UTC m=+410.632978292" watchObservedRunningTime="2026-07-09 02:41:04.701904982 +0000 UTC m=+410.634362544" Jul 09 02:41:14.275759 ip-10-0-138-136 kubenswrapper[2583]: I0709 02:41:14.275705 2583 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/console-b8f649c79-zmp6r" Jul 09 02:41:14.276168 ip-10-0-138-136 kubenswrapper[2583]: I0709 02:41:14.275804 2583 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-console/console-b8f649c79-zmp6r" Jul 09 02:41:14.280971 ip-10-0-138-136 kubenswrapper[2583]: I0709 02:41:14.280947 2583 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-console/console-b8f649c79-zmp6r" Jul 09 02:41:14.737317 ip-10-0-138-136 kubenswrapper[2583]: I0709 02:41:14.737291 2583 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console/console-b8f649c79-zmp6r" Jul 09 02:41:14.781154 ip-10-0-138-136 kubenswrapper[2583]: I0709 02:41:14.781121 2583 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-777f74b468-pmfr6"] Jul 09 02:41:39.808047 ip-10-0-138-136 kubenswrapper[2583]: I0709 02:41:39.807961 2583 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-console/console-777f74b468-pmfr6" podUID="7ec83270-d90c-427f-9955-0ab588bc64d7" containerName="console" containerID="cri-o://8ad79e803a1ec734ba458cd185d8d0ac85a229b30bc946a61f8b331acbdd2dc1" gracePeriod=15 Jul 09 02:41:40.051525 ip-10-0-138-136 kubenswrapper[2583]: I0709 02:41:40.051502 2583 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-777f74b468-pmfr6" Jul 09 02:41:40.154444 ip-10-0-138-136 kubenswrapper[2583]: I0709 02:41:40.154376 2583 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/7ec83270-d90c-427f-9955-0ab588bc64d7-console-oauth-config\") pod \"7ec83270-d90c-427f-9955-0ab588bc64d7\" (UID: \"7ec83270-d90c-427f-9955-0ab588bc64d7\") " Jul 09 02:41:40.154444 ip-10-0-138-136 kubenswrapper[2583]: I0709 02:41:40.154426 2583 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/7ec83270-d90c-427f-9955-0ab588bc64d7-console-config\") pod \"7ec83270-d90c-427f-9955-0ab588bc64d7\" (UID: \"7ec83270-d90c-427f-9955-0ab588bc64d7\") " Jul 09 02:41:40.154643 ip-10-0-138-136 kubenswrapper[2583]: I0709 02:41:40.154450 2583 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/7ec83270-d90c-427f-9955-0ab588bc64d7-oauth-serving-cert\") pod \"7ec83270-d90c-427f-9955-0ab588bc64d7\" (UID: \"7ec83270-d90c-427f-9955-0ab588bc64d7\") " Jul 09 02:41:40.154643 ip-10-0-138-136 kubenswrapper[2583]: I0709 02:41:40.154492 2583 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/7ec83270-d90c-427f-9955-0ab588bc64d7-trusted-ca-bundle\") pod \"7ec83270-d90c-427f-9955-0ab588bc64d7\" (UID: \"7ec83270-d90c-427f-9955-0ab588bc64d7\") " Jul 09 02:41:40.154643 ip-10-0-138-136 kubenswrapper[2583]: I0709 02:41:40.154528 2583 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/7ec83270-d90c-427f-9955-0ab588bc64d7-service-ca\") pod \"7ec83270-d90c-427f-9955-0ab588bc64d7\" (UID: \"7ec83270-d90c-427f-9955-0ab588bc64d7\") " Jul 09 02:41:40.154643 ip-10-0-138-136 kubenswrapper[2583]: I0709 02:41:40.154556 2583 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-p86vr\" (UniqueName: \"kubernetes.io/projected/7ec83270-d90c-427f-9955-0ab588bc64d7-kube-api-access-p86vr\") pod \"7ec83270-d90c-427f-9955-0ab588bc64d7\" (UID: \"7ec83270-d90c-427f-9955-0ab588bc64d7\") " Jul 09 02:41:40.154643 ip-10-0-138-136 kubenswrapper[2583]: I0709 02:41:40.154591 2583 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/7ec83270-d90c-427f-9955-0ab588bc64d7-console-serving-cert\") pod \"7ec83270-d90c-427f-9955-0ab588bc64d7\" (UID: \"7ec83270-d90c-427f-9955-0ab588bc64d7\") " Jul 09 02:41:40.154953 ip-10-0-138-136 kubenswrapper[2583]: I0709 02:41:40.154927 2583 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/7ec83270-d90c-427f-9955-0ab588bc64d7-console-config" (OuterVolumeSpecName: "console-config") pod "7ec83270-d90c-427f-9955-0ab588bc64d7" (UID: "7ec83270-d90c-427f-9955-0ab588bc64d7"). InnerVolumeSpecName "console-config". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 09 02:41:40.155040 ip-10-0-138-136 kubenswrapper[2583]: I0709 02:41:40.154933 2583 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/7ec83270-d90c-427f-9955-0ab588bc64d7-oauth-serving-cert" (OuterVolumeSpecName: "oauth-serving-cert") pod "7ec83270-d90c-427f-9955-0ab588bc64d7" (UID: "7ec83270-d90c-427f-9955-0ab588bc64d7"). InnerVolumeSpecName "oauth-serving-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 09 02:41:40.155040 ip-10-0-138-136 kubenswrapper[2583]: I0709 02:41:40.154964 2583 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/7ec83270-d90c-427f-9955-0ab588bc64d7-service-ca" (OuterVolumeSpecName: "service-ca") pod "7ec83270-d90c-427f-9955-0ab588bc64d7" (UID: "7ec83270-d90c-427f-9955-0ab588bc64d7"). InnerVolumeSpecName "service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 09 02:41:40.155135 ip-10-0-138-136 kubenswrapper[2583]: I0709 02:41:40.155083 2583 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/7ec83270-d90c-427f-9955-0ab588bc64d7-trusted-ca-bundle" (OuterVolumeSpecName: "trusted-ca-bundle") pod "7ec83270-d90c-427f-9955-0ab588bc64d7" (UID: "7ec83270-d90c-427f-9955-0ab588bc64d7"). InnerVolumeSpecName "trusted-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 09 02:41:40.156693 ip-10-0-138-136 kubenswrapper[2583]: I0709 02:41:40.156670 2583 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/7ec83270-d90c-427f-9955-0ab588bc64d7-console-oauth-config" (OuterVolumeSpecName: "console-oauth-config") pod "7ec83270-d90c-427f-9955-0ab588bc64d7" (UID: "7ec83270-d90c-427f-9955-0ab588bc64d7"). InnerVolumeSpecName "console-oauth-config". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 09 02:41:40.156693 ip-10-0-138-136 kubenswrapper[2583]: I0709 02:41:40.156682 2583 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/7ec83270-d90c-427f-9955-0ab588bc64d7-kube-api-access-p86vr" (OuterVolumeSpecName: "kube-api-access-p86vr") pod "7ec83270-d90c-427f-9955-0ab588bc64d7" (UID: "7ec83270-d90c-427f-9955-0ab588bc64d7"). InnerVolumeSpecName "kube-api-access-p86vr". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 09 02:41:40.156818 ip-10-0-138-136 kubenswrapper[2583]: I0709 02:41:40.156723 2583 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/7ec83270-d90c-427f-9955-0ab588bc64d7-console-serving-cert" (OuterVolumeSpecName: "console-serving-cert") pod "7ec83270-d90c-427f-9955-0ab588bc64d7" (UID: "7ec83270-d90c-427f-9955-0ab588bc64d7"). InnerVolumeSpecName "console-serving-cert". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 09 02:41:40.255984 ip-10-0-138-136 kubenswrapper[2583]: I0709 02:41:40.255960 2583 reconciler_common.go:299] "Volume detached for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/7ec83270-d90c-427f-9955-0ab588bc64d7-console-config\") on node \"ip-10-0-138-136.ec2.internal\" DevicePath \"\"" Jul 09 02:41:40.255984 ip-10-0-138-136 kubenswrapper[2583]: I0709 02:41:40.255982 2583 reconciler_common.go:299] "Volume detached for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/7ec83270-d90c-427f-9955-0ab588bc64d7-oauth-serving-cert\") on node \"ip-10-0-138-136.ec2.internal\" DevicePath \"\"" Jul 09 02:41:40.256111 ip-10-0-138-136 kubenswrapper[2583]: I0709 02:41:40.255991 2583 reconciler_common.go:299] "Volume detached for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/7ec83270-d90c-427f-9955-0ab588bc64d7-trusted-ca-bundle\") on node \"ip-10-0-138-136.ec2.internal\" DevicePath \"\"" Jul 09 02:41:40.256111 ip-10-0-138-136 kubenswrapper[2583]: I0709 02:41:40.255999 2583 reconciler_common.go:299] "Volume detached for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/7ec83270-d90c-427f-9955-0ab588bc64d7-service-ca\") on node \"ip-10-0-138-136.ec2.internal\" DevicePath \"\"" Jul 09 02:41:40.256111 ip-10-0-138-136 kubenswrapper[2583]: I0709 02:41:40.256008 2583 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-p86vr\" (UniqueName: \"kubernetes.io/projected/7ec83270-d90c-427f-9955-0ab588bc64d7-kube-api-access-p86vr\") on node \"ip-10-0-138-136.ec2.internal\" DevicePath \"\"" Jul 09 02:41:40.256111 ip-10-0-138-136 kubenswrapper[2583]: I0709 02:41:40.256017 2583 reconciler_common.go:299] "Volume detached for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/7ec83270-d90c-427f-9955-0ab588bc64d7-console-serving-cert\") on node \"ip-10-0-138-136.ec2.internal\" DevicePath \"\"" Jul 09 02:41:40.256111 ip-10-0-138-136 kubenswrapper[2583]: I0709 02:41:40.256025 2583 reconciler_common.go:299] "Volume detached for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/7ec83270-d90c-427f-9955-0ab588bc64d7-console-oauth-config\") on node \"ip-10-0-138-136.ec2.internal\" DevicePath \"\"" Jul 09 02:41:40.854385 ip-10-0-138-136 kubenswrapper[2583]: I0709 02:41:40.854354 2583 generic.go:356] "Generic (PLEG): container finished" podID="7ec83270-d90c-427f-9955-0ab588bc64d7" containerID="8ad79e803a1ec734ba458cd185d8d0ac85a229b30bc946a61f8b331acbdd2dc1" exitCode=0 Jul 09 02:41:40.854774 ip-10-0-138-136 kubenswrapper[2583]: I0709 02:41:40.854398 2583 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-777f74b468-pmfr6" Jul 09 02:41:40.854774 ip-10-0-138-136 kubenswrapper[2583]: I0709 02:41:40.854411 2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-777f74b468-pmfr6" event={"ID":"7ec83270-d90c-427f-9955-0ab588bc64d7","Type":"ContainerDied","Data":"8ad79e803a1ec734ba458cd185d8d0ac85a229b30bc946a61f8b331acbdd2dc1"} Jul 09 02:41:40.854774 ip-10-0-138-136 kubenswrapper[2583]: I0709 02:41:40.854449 2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-777f74b468-pmfr6" event={"ID":"7ec83270-d90c-427f-9955-0ab588bc64d7","Type":"ContainerDied","Data":"fa43ce05ea255224e31e62be171c3e687fc8de85b50ee048890756aba71a1480"} Jul 09 02:41:40.854774 ip-10-0-138-136 kubenswrapper[2583]: I0709 02:41:40.854468 2583 scope.go:117] "RemoveContainer" containerID="8ad79e803a1ec734ba458cd185d8d0ac85a229b30bc946a61f8b331acbdd2dc1" Jul 09 02:41:40.863560 ip-10-0-138-136 kubenswrapper[2583]: I0709 02:41:40.863539 2583 scope.go:117] "RemoveContainer" containerID="8ad79e803a1ec734ba458cd185d8d0ac85a229b30bc946a61f8b331acbdd2dc1" Jul 09 02:41:40.863877 ip-10-0-138-136 kubenswrapper[2583]: E0709 02:41:40.863855 2583 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"8ad79e803a1ec734ba458cd185d8d0ac85a229b30bc946a61f8b331acbdd2dc1\": container with ID starting with 8ad79e803a1ec734ba458cd185d8d0ac85a229b30bc946a61f8b331acbdd2dc1 not found: ID does not exist" containerID="8ad79e803a1ec734ba458cd185d8d0ac85a229b30bc946a61f8b331acbdd2dc1" Jul 09 02:41:40.863950 ip-10-0-138-136 kubenswrapper[2583]: I0709 02:41:40.863886 2583 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"8ad79e803a1ec734ba458cd185d8d0ac85a229b30bc946a61f8b331acbdd2dc1"} err="failed to get container status \"8ad79e803a1ec734ba458cd185d8d0ac85a229b30bc946a61f8b331acbdd2dc1\": rpc error: code = NotFound desc = could not find container \"8ad79e803a1ec734ba458cd185d8d0ac85a229b30bc946a61f8b331acbdd2dc1\": container with ID starting with 8ad79e803a1ec734ba458cd185d8d0ac85a229b30bc946a61f8b331acbdd2dc1 not found: ID does not exist" Jul 09 02:41:40.869135 ip-10-0-138-136 kubenswrapper[2583]: I0709 02:41:40.869112 2583 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-777f74b468-pmfr6"] Jul 09 02:41:40.872984 ip-10-0-138-136 kubenswrapper[2583]: I0709 02:41:40.872963 2583 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-console/console-777f74b468-pmfr6"] Jul 09 02:41:42.602488 ip-10-0-138-136 kubenswrapper[2583]: I0709 02:41:42.602450 2583 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="7ec83270-d90c-427f-9955-0ab588bc64d7" path="/var/lib/kubelet/pods/7ec83270-d90c-427f-9955-0ab588bc64d7/volumes" Jul 09 02:41:52.247655 ip-10-0-138-136 kubenswrapper[2583]: I0709 02:41:52.247615 2583 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-vpc97"] Jul 09 02:41:52.248753 ip-10-0-138-136 kubenswrapper[2583]: I0709 02:41:52.248705 2583 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="7ec83270-d90c-427f-9955-0ab588bc64d7" containerName="console" Jul 09 02:41:52.248753 ip-10-0-138-136 kubenswrapper[2583]: I0709 02:41:52.248752 2583 state_mem.go:107] "Deleted CPUSet assignment" podUID="7ec83270-d90c-427f-9955-0ab588bc64d7" containerName="console" Jul 09 02:41:52.248925 ip-10-0-138-136 kubenswrapper[2583]: I0709 02:41:52.248854 2583 memory_manager.go:368] "RemoveStaleState removing state" podUID="7ec83270-d90c-427f-9955-0ab588bc64d7" containerName="console" Jul 09 02:41:52.253620 ip-10-0-138-136 kubenswrapper[2583]: I0709 02:41:52.253595 2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-vpc97" Jul 09 02:41:52.255747 ip-10-0-138-136 kubenswrapper[2583]: I0709 02:41:52.255700 2583 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"maas-default-gateway-openshift-default-dockercfg-4mvkm\"" Jul 09 02:41:52.262683 ip-10-0-138-136 kubenswrapper[2583]: I0709 02:41:52.262652 2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-vpc97"] Jul 09 02:41:52.340466 ip-10-0-138-136 kubenswrapper[2583]: I0709 02:41:52.340444 2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/438605c5-c5d5-45c4-833b-7217e9314705-workload-socket\") pod \"maas-default-gateway-openshift-default-56654dcf7-vpc97\" (UID: \"438605c5-c5d5-45c4-833b-7217e9314705\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-vpc97" Jul 09 02:41:52.340576 ip-10-0-138-136 kubenswrapper[2583]: I0709 02:41:52.340477 2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/438605c5-c5d5-45c4-833b-7217e9314705-istiod-ca-cert\") pod \"maas-default-gateway-openshift-default-56654dcf7-vpc97\" (UID: \"438605c5-c5d5-45c4-833b-7217e9314705\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-vpc97" Jul 09 02:41:52.340576 ip-10-0-138-136 kubenswrapper[2583]: I0709 02:41:52.340515 2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/438605c5-c5d5-45c4-833b-7217e9314705-istio-data\") pod \"maas-default-gateway-openshift-default-56654dcf7-vpc97\" (UID: \"438605c5-c5d5-45c4-833b-7217e9314705\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-vpc97" Jul 09 02:41:52.340703 ip-10-0-138-136 kubenswrapper[2583]: I0709 02:41:52.340589 2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/438605c5-c5d5-45c4-833b-7217e9314705-istio-podinfo\") pod \"maas-default-gateway-openshift-default-56654dcf7-vpc97\" (UID: \"438605c5-c5d5-45c4-833b-7217e9314705\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-vpc97" Jul 09 02:41:52.340703 ip-10-0-138-136 kubenswrapper[2583]: I0709 02:41:52.340642 2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/438605c5-c5d5-45c4-833b-7217e9314705-istio-token\") pod \"maas-default-gateway-openshift-default-56654dcf7-vpc97\" (UID: \"438605c5-c5d5-45c4-833b-7217e9314705\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-vpc97" Jul 09 02:41:52.340703 ip-10-0-138-136 kubenswrapper[2583]: I0709 02:41:52.340671 2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/438605c5-c5d5-45c4-833b-7217e9314705-credential-socket\") pod \"maas-default-gateway-openshift-default-56654dcf7-vpc97\" (UID: \"438605c5-c5d5-45c4-833b-7217e9314705\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-vpc97" Jul 09 02:41:52.340703 ip-10-0-138-136 kubenswrapper[2583]: I0709 02:41:52.340699 2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-mwr4f\" (UniqueName: \"kubernetes.io/projected/438605c5-c5d5-45c4-833b-7217e9314705-kube-api-access-mwr4f\") pod \"maas-default-gateway-openshift-default-56654dcf7-vpc97\" (UID: \"438605c5-c5d5-45c4-833b-7217e9314705\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-vpc97" Jul 09 02:41:52.340939 ip-10-0-138-136 kubenswrapper[2583]: I0709 02:41:52.340764 2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/438605c5-c5d5-45c4-833b-7217e9314705-workload-certs\") pod \"maas-default-gateway-openshift-default-56654dcf7-vpc97\" (UID: \"438605c5-c5d5-45c4-833b-7217e9314705\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-vpc97" Jul 09 02:41:52.340939 ip-10-0-138-136 kubenswrapper[2583]: I0709 02:41:52.340860 2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/438605c5-c5d5-45c4-833b-7217e9314705-istio-envoy\") pod \"maas-default-gateway-openshift-default-56654dcf7-vpc97\" (UID: \"438605c5-c5d5-45c4-833b-7217e9314705\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-vpc97" Jul 09 02:41:52.441247 ip-10-0-138-136 kubenswrapper[2583]: I0709 02:41:52.441225 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/438605c5-c5d5-45c4-833b-7217e9314705-istio-envoy\") pod \"maas-default-gateway-openshift-default-56654dcf7-vpc97\" (UID: \"438605c5-c5d5-45c4-833b-7217e9314705\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-vpc97" Jul 09 02:41:52.441363 ip-10-0-138-136 kubenswrapper[2583]: I0709 02:41:52.441270 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/438605c5-c5d5-45c4-833b-7217e9314705-workload-socket\") pod \"maas-default-gateway-openshift-default-56654dcf7-vpc97\" (UID: \"438605c5-c5d5-45c4-833b-7217e9314705\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-vpc97" Jul 09 02:41:52.441363 ip-10-0-138-136 kubenswrapper[2583]: I0709 02:41:52.441299 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/438605c5-c5d5-45c4-833b-7217e9314705-istiod-ca-cert\") pod \"maas-default-gateway-openshift-default-56654dcf7-vpc97\" (UID: \"438605c5-c5d5-45c4-833b-7217e9314705\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-vpc97" Jul 09 02:41:52.441363 ip-10-0-138-136 kubenswrapper[2583]: I0709 02:41:52.441342 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/438605c5-c5d5-45c4-833b-7217e9314705-istio-data\") pod \"maas-default-gateway-openshift-default-56654dcf7-vpc97\" (UID: \"438605c5-c5d5-45c4-833b-7217e9314705\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-vpc97" Jul 09 02:41:52.441531 ip-10-0-138-136 kubenswrapper[2583]: I0709 02:41:52.441377 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/438605c5-c5d5-45c4-833b-7217e9314705-istio-podinfo\") pod \"maas-default-gateway-openshift-default-56654dcf7-vpc97\" (UID: \"438605c5-c5d5-45c4-833b-7217e9314705\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-vpc97" Jul 09 02:41:52.441531 ip-10-0-138-136 kubenswrapper[2583]: I0709 02:41:52.441424 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/438605c5-c5d5-45c4-833b-7217e9314705-istio-token\") pod \"maas-default-gateway-openshift-default-56654dcf7-vpc97\" (UID: \"438605c5-c5d5-45c4-833b-7217e9314705\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-vpc97" Jul 09 02:41:52.441531 ip-10-0-138-136 kubenswrapper[2583]: I0709 02:41:52.441454 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/438605c5-c5d5-45c4-833b-7217e9314705-credential-socket\") pod \"maas-default-gateway-openshift-default-56654dcf7-vpc97\" (UID: \"438605c5-c5d5-45c4-833b-7217e9314705\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-vpc97" Jul 09 02:41:52.441531 ip-10-0-138-136 kubenswrapper[2583]: I0709 02:41:52.441479 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-mwr4f\" (UniqueName: \"kubernetes.io/projected/438605c5-c5d5-45c4-833b-7217e9314705-kube-api-access-mwr4f\") pod \"maas-default-gateway-openshift-default-56654dcf7-vpc97\" (UID: \"438605c5-c5d5-45c4-833b-7217e9314705\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-vpc97" Jul 09 02:41:52.441531 ip-10-0-138-136 kubenswrapper[2583]: I0709 02:41:52.441507 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/438605c5-c5d5-45c4-833b-7217e9314705-workload-certs\") pod \"maas-default-gateway-openshift-default-56654dcf7-vpc97\" (UID: \"438605c5-c5d5-45c4-833b-7217e9314705\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-vpc97" Jul 09 02:41:52.441805 ip-10-0-138-136 kubenswrapper[2583]: I0709 02:41:52.441699 2583 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/438605c5-c5d5-45c4-833b-7217e9314705-istio-data\") pod \"maas-default-gateway-openshift-default-56654dcf7-vpc97\" (UID: \"438605c5-c5d5-45c4-833b-7217e9314705\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-vpc97" Jul 09 02:41:52.441915 ip-10-0-138-136 kubenswrapper[2583]: I0709 02:41:52.441890 2583 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/438605c5-c5d5-45c4-833b-7217e9314705-credential-socket\") pod \"maas-default-gateway-openshift-default-56654dcf7-vpc97\" (UID: \"438605c5-c5d5-45c4-833b-7217e9314705\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-vpc97" Jul 09 02:41:52.442003 ip-10-0-138-136 kubenswrapper[2583]: I0709 02:41:52.441963 2583 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/438605c5-c5d5-45c4-833b-7217e9314705-workload-socket\") pod \"maas-default-gateway-openshift-default-56654dcf7-vpc97\" (UID: \"438605c5-c5d5-45c4-833b-7217e9314705\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-vpc97" Jul 09 02:41:52.442165 ip-10-0-138-136 kubenswrapper[2583]: I0709 02:41:52.442143 2583 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/438605c5-c5d5-45c4-833b-7217e9314705-istiod-ca-cert\") pod \"maas-default-gateway-openshift-default-56654dcf7-vpc97\" (UID: \"438605c5-c5d5-45c4-833b-7217e9314705\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-vpc97" Jul 09 02:41:52.442373 ip-10-0-138-136 kubenswrapper[2583]: I0709 02:41:52.442355 2583 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/438605c5-c5d5-45c4-833b-7217e9314705-workload-certs\") pod \"maas-default-gateway-openshift-default-56654dcf7-vpc97\" (UID: \"438605c5-c5d5-45c4-833b-7217e9314705\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-vpc97" Jul 09 02:41:52.443567 ip-10-0-138-136 kubenswrapper[2583]: I0709 02:41:52.443539 2583 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/438605c5-c5d5-45c4-833b-7217e9314705-istio-envoy\") pod \"maas-default-gateway-openshift-default-56654dcf7-vpc97\" (UID: \"438605c5-c5d5-45c4-833b-7217e9314705\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-vpc97" Jul 09 02:41:52.443907 ip-10-0-138-136 kubenswrapper[2583]: I0709 02:41:52.443889 2583 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/438605c5-c5d5-45c4-833b-7217e9314705-istio-podinfo\") pod \"maas-default-gateway-openshift-default-56654dcf7-vpc97\" (UID: \"438605c5-c5d5-45c4-833b-7217e9314705\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-vpc97" Jul 09 02:41:52.448958 ip-10-0-138-136 kubenswrapper[2583]: I0709 02:41:52.448938 2583 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-mwr4f\" (UniqueName: \"kubernetes.io/projected/438605c5-c5d5-45c4-833b-7217e9314705-kube-api-access-mwr4f\") pod \"maas-default-gateway-openshift-default-56654dcf7-vpc97\" (UID: \"438605c5-c5d5-45c4-833b-7217e9314705\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-vpc97" Jul 09 02:41:52.449052 ip-10-0-138-136 kubenswrapper[2583]: I0709 02:41:52.448984 2583 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/438605c5-c5d5-45c4-833b-7217e9314705-istio-token\") pod \"maas-default-gateway-openshift-default-56654dcf7-vpc97\" (UID: \"438605c5-c5d5-45c4-833b-7217e9314705\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-vpc97" Jul 09 02:41:52.565464 ip-10-0-138-136 kubenswrapper[2583]: I0709 02:41:52.565402 2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-vpc97" Jul 09 02:41:52.702172 ip-10-0-138-136 kubenswrapper[2583]: I0709 02:41:52.702147 2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-vpc97"] Jul 09 02:41:52.704150 ip-10-0-138-136 kubenswrapper[2583]: W0709 02:41:52.704123 2583 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod438605c5_c5d5_45c4_833b_7217e9314705.slice/crio-5fe40a72f4f1814e758e654f25e9f4270a5b48cbe203098f1e02a5493aa6df2a WatchSource:0}: Error finding container 5fe40a72f4f1814e758e654f25e9f4270a5b48cbe203098f1e02a5493aa6df2a: Status 404 returned error can't find the container with id 5fe40a72f4f1814e758e654f25e9f4270a5b48cbe203098f1e02a5493aa6df2a Jul 09 02:41:52.706182 ip-10-0-138-136 kubenswrapper[2583]: I0709 02:41:52.706150 2583 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236232Ki","pods":"250"} Jul 09 02:41:52.706275 ip-10-0-138-136 kubenswrapper[2583]: I0709 02:41:52.706208 2583 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236232Ki","pods":"250"} Jul 09 02:41:52.706275 ip-10-0-138-136 kubenswrapper[2583]: I0709 02:41:52.706235 2583 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236232Ki","pods":"250"} Jul 09 02:41:52.921322 ip-10-0-138-136 kubenswrapper[2583]: I0709 02:41:52.921230 2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-vpc97" event={"ID":"438605c5-c5d5-45c4-833b-7217e9314705","Type":"ContainerStarted","Data":"67646049b5771ec00a96211be7f78fc54f3dd34095e948c44f626f263ba6983c"} Jul 09 02:41:52.921322 ip-10-0-138-136 kubenswrapper[2583]: I0709 02:41:52.921315 2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-vpc97" event={"ID":"438605c5-c5d5-45c4-833b-7217e9314705","Type":"ContainerStarted","Data":"5fe40a72f4f1814e758e654f25e9f4270a5b48cbe203098f1e02a5493aa6df2a"} Jul 09 02:41:52.943245 ip-10-0-138-136 kubenswrapper[2583]: I0709 02:41:52.943185 2583 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-vpc97" podStartSLOduration=0.943164607 podStartE2EDuration="943.164607ms" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-09 02:41:52 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-09 02:41:52.939951512 +0000 UTC m=+458.872408999" watchObservedRunningTime="2026-07-09 02:41:52.943164607 +0000 UTC m=+458.875622095" Jul 09 02:41:53.565700 ip-10-0-138-136 kubenswrapper[2583]: I0709 02:41:53.565668 2583 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-vpc97" Jul 09 02:41:53.570362 ip-10-0-138-136 kubenswrapper[2583]: I0709 02:41:53.570336 2583 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-vpc97" Jul 09 02:41:53.925766 ip-10-0-138-136 kubenswrapper[2583]: I0709 02:41:53.925671 2583 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-vpc97" Jul 09 02:41:53.926699 ip-10-0-138-136 kubenswrapper[2583]: I0709 02:41:53.926683 2583 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-vpc97" Jul 09 02:43:29.388634 ip-10-0-138-136 kubenswrapper[2583]: I0709 02:43:29.388593 2583 generic.go:356] "Generic (PLEG): container finished" podID="438605c5-c5d5-45c4-833b-7217e9314705" containerID="67646049b5771ec00a96211be7f78fc54f3dd34095e948c44f626f263ba6983c" exitCode=0 Jul 09 02:43:29.389109 ip-10-0-138-136 kubenswrapper[2583]: I0709 02:43:29.388645 2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-vpc97" event={"ID":"438605c5-c5d5-45c4-833b-7217e9314705","Type":"ContainerDied","Data":"67646049b5771ec00a96211be7f78fc54f3dd34095e948c44f626f263ba6983c"} Jul 09 02:43:29.389109 ip-10-0-138-136 kubenswrapper[2583]: I0709 02:43:29.389053 2583 scope.go:117] "RemoveContainer" containerID="67646049b5771ec00a96211be7f78fc54f3dd34095e948c44f626f263ba6983c" Jul 09 02:43:29.390168 ip-10-0-138-136 kubenswrapper[2583]: I0709 02:43:29.390127 2583 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236232Ki","pods":"250"} Jul 09 02:43:29.390283 ip-10-0-138-136 kubenswrapper[2583]: I0709 02:43:29.390231 2583 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236232Ki","pods":"250"} Jul 09 02:43:29.390347 ip-10-0-138-136 kubenswrapper[2583]: I0709 02:43:29.390289 2583 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236232Ki","pods":"250"} Jul 09 02:43:30.395653 ip-10-0-138-136 kubenswrapper[2583]: I0709 02:43:30.395620 2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-vpc97" event={"ID":"438605c5-c5d5-45c4-833b-7217e9314705","Type":"ContainerStarted","Data":"a9de3ec2ff5bb14e4f3db16cd49840091a1a78c366e90b8656abd7b7d2b4839d"} Jul 09 02:43:30.566228 ip-10-0-138-136 kubenswrapper[2583]: I0709 02:43:30.566196 2583 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-vpc97" Jul 09 02:43:30.566537 ip-10-0-138-136 kubenswrapper[2583]: I0709 02:43:30.566516 2583 patch_prober.go:28] interesting pod/maas-default-gateway-openshift-default-56654dcf7-vpc97 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.39:15021/healthz/ready\": dial tcp 10.132.0.39:15021: connect: connection refused" start-of-body= Jul 09 02:43:30.566596 ip-10-0-138-136 kubenswrapper[2583]: I0709 02:43:30.566565 2583 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-vpc97" podUID="438605c5-c5d5-45c4-833b-7217e9314705" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.39:15021/healthz/ready\": dial tcp 10.132.0.39:15021: connect: connection refused" Jul 09 02:43:31.566085 ip-10-0-138-136 kubenswrapper[2583]: I0709 02:43:31.566052 2583 patch_prober.go:28] interesting pod/maas-default-gateway-openshift-default-56654dcf7-vpc97 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.39:15021/healthz/ready\": dial tcp 10.132.0.39:15021: connect: connection refused" start-of-body= Jul 09 02:43:31.566459 ip-10-0-138-136 kubenswrapper[2583]: I0709 02:43:31.566108 2583 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-vpc97" podUID="438605c5-c5d5-45c4-833b-7217e9314705" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.39:15021/healthz/ready\": dial tcp 10.132.0.39:15021: connect: connection refused" Jul 09 02:43:32.566107 ip-10-0-138-136 kubenswrapper[2583]: I0709 02:43:32.566072 2583 patch_prober.go:28] interesting pod/maas-default-gateway-openshift-default-56654dcf7-vpc97 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.39:15021/healthz/ready\": dial tcp 10.132.0.39:15021: connect: connection refused" start-of-body= Jul 09 02:43:32.566486 ip-10-0-138-136 kubenswrapper[2583]: I0709 02:43:32.566124 2583 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-vpc97" podUID="438605c5-c5d5-45c4-833b-7217e9314705" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.39:15021/healthz/ready\": dial tcp 10.132.0.39:15021: connect: connection refused" Jul 09 02:43:33.565962 ip-10-0-138-136 kubenswrapper[2583]: I0709 02:43:33.565929 2583 patch_prober.go:28] interesting pod/maas-default-gateway-openshift-default-56654dcf7-vpc97 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.39:15021/healthz/ready\": dial tcp 10.132.0.39:15021: connect: connection refused" start-of-body= Jul 09 02:43:33.566112 ip-10-0-138-136 kubenswrapper[2583]: I0709 02:43:33.565979 2583 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-vpc97" podUID="438605c5-c5d5-45c4-833b-7217e9314705" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.39:15021/healthz/ready\": dial tcp 10.132.0.39:15021: connect: connection refused" Jul 09 02:43:34.569856 ip-10-0-138-136 kubenswrapper[2583]: I0709 02:43:34.569827 2583 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-vpc97" Jul 09 02:43:34.570223 ip-10-0-138-136 kubenswrapper[2583]: I0709 02:43:34.570091 2583 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-vpc97" Jul 09 02:43:34.570834 ip-10-0-138-136 kubenswrapper[2583]: I0709 02:43:34.570815 2583 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-vpc97" Jul 09 02:44:04.767301 ip-10-0-138-136 kubenswrapper[2583]: I0709 02:44:04.767264 2583 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-l5pmn"] Jul 09 02:44:04.771469 ip-10-0-138-136 kubenswrapper[2583]: I0709 02:44:04.771449 2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-l5pmn" Jul 09 02:44:04.774233 ip-10-0-138-136 kubenswrapper[2583]: I0709 02:44:04.774211 2583 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"llm\"/\"kube-root-ca.crt\"" Jul 09 02:44:04.774233 ip-10-0-138-136 kubenswrapper[2583]: I0709 02:44:04.774221 2583 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"default-dockercfg-vnpf7\"" Jul 09 02:44:04.774432 ip-10-0-138-136 kubenswrapper[2583]: I0709 02:44:04.774214 2583 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"llm\"/\"openshift-service-ca.crt\"" Jul 09 02:44:04.774432 ip-10-0-138-136 kubenswrapper[2583]: I0709 02:44:04.774214 2583 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"e2e-distinct-2-simulated-kserve-self-signed-certs\"" Jul 09 02:44:04.780239 ip-10-0-138-136 kubenswrapper[2583]: I0709 02:44:04.780181 2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-l5pmn"] Jul 09 02:44:04.796706 ip-10-0-138-136 kubenswrapper[2583]: I0709 02:44:04.796681 2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/19da2ac8-d8f8-4d55-8e97-09940d2ac33e-model-cache\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-l5pmn\" (UID: \"19da2ac8-d8f8-4d55-8e97-09940d2ac33e\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-l5pmn" Jul 09 02:44:04.796826 ip-10-0-138-136 kubenswrapper[2583]: I0709 02:44:04.796740 2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/19da2ac8-d8f8-4d55-8e97-09940d2ac33e-tmp-dir\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-l5pmn\" (UID: \"19da2ac8-d8f8-4d55-8e97-09940d2ac33e\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-l5pmn" Jul 09 02:44:04.796826 ip-10-0-138-136 kubenswrapper[2583]: I0709 02:44:04.796777 2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/19da2ac8-d8f8-4d55-8e97-09940d2ac33e-home\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-l5pmn\" (UID: \"19da2ac8-d8f8-4d55-8e97-09940d2ac33e\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-l5pmn" Jul 09 02:44:04.796826 ip-10-0-138-136 kubenswrapper[2583]: I0709 02:44:04.796801 2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-gbv6l\" (UniqueName: \"kubernetes.io/projected/19da2ac8-d8f8-4d55-8e97-09940d2ac33e-kube-api-access-gbv6l\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-l5pmn\" (UID: \"19da2ac8-d8f8-4d55-8e97-09940d2ac33e\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-l5pmn" Jul 09 02:44:04.796990 ip-10-0-138-136 kubenswrapper[2583]: I0709 02:44:04.796843 2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/19da2ac8-d8f8-4d55-8e97-09940d2ac33e-dshm\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-l5pmn\" (UID: \"19da2ac8-d8f8-4d55-8e97-09940d2ac33e\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-l5pmn" Jul 09 02:44:04.796990 ip-10-0-138-136 kubenswrapper[2583]: I0709 02:44:04.796922 2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/19da2ac8-d8f8-4d55-8e97-09940d2ac33e-tls-certs\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-l5pmn\" (UID: \"19da2ac8-d8f8-4d55-8e97-09940d2ac33e\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-l5pmn" Jul 09 02:44:04.897851 ip-10-0-138-136 kubenswrapper[2583]: I0709 02:44:04.897822 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/19da2ac8-d8f8-4d55-8e97-09940d2ac33e-model-cache\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-l5pmn\" (UID: \"19da2ac8-d8f8-4d55-8e97-09940d2ac33e\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-l5pmn" Jul 09 02:44:04.897851 ip-10-0-138-136 kubenswrapper[2583]: I0709 02:44:04.897852 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/19da2ac8-d8f8-4d55-8e97-09940d2ac33e-tmp-dir\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-l5pmn\" (UID: \"19da2ac8-d8f8-4d55-8e97-09940d2ac33e\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-l5pmn" Jul 09 02:44:04.897993 ip-10-0-138-136 kubenswrapper[2583]: I0709 02:44:04.897869 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/19da2ac8-d8f8-4d55-8e97-09940d2ac33e-home\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-l5pmn\" (UID: \"19da2ac8-d8f8-4d55-8e97-09940d2ac33e\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-l5pmn" Jul 09 02:44:04.897993 ip-10-0-138-136 kubenswrapper[2583]: I0709 02:44:04.897886 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-gbv6l\" (UniqueName: \"kubernetes.io/projected/19da2ac8-d8f8-4d55-8e97-09940d2ac33e-kube-api-access-gbv6l\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-l5pmn\" (UID: \"19da2ac8-d8f8-4d55-8e97-09940d2ac33e\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-l5pmn" Jul 09 02:44:04.897993 ip-10-0-138-136 kubenswrapper[2583]: I0709 02:44:04.897903 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/19da2ac8-d8f8-4d55-8e97-09940d2ac33e-dshm\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-l5pmn\" (UID: \"19da2ac8-d8f8-4d55-8e97-09940d2ac33e\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-l5pmn" Jul 09 02:44:04.897993 ip-10-0-138-136 kubenswrapper[2583]: I0709 02:44:04.897938 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/19da2ac8-d8f8-4d55-8e97-09940d2ac33e-tls-certs\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-l5pmn\" (UID: \"19da2ac8-d8f8-4d55-8e97-09940d2ac33e\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-l5pmn" Jul 09 02:44:04.898266 ip-10-0-138-136 kubenswrapper[2583]: I0709 02:44:04.898246 2583 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/19da2ac8-d8f8-4d55-8e97-09940d2ac33e-model-cache\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-l5pmn\" (UID: \"19da2ac8-d8f8-4d55-8e97-09940d2ac33e\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-l5pmn" Jul 09 02:44:04.898306 ip-10-0-138-136 kubenswrapper[2583]: I0709 02:44:04.898289 2583 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/19da2ac8-d8f8-4d55-8e97-09940d2ac33e-tmp-dir\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-l5pmn\" (UID: \"19da2ac8-d8f8-4d55-8e97-09940d2ac33e\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-l5pmn" Jul 09 02:44:04.898340 ip-10-0-138-136 kubenswrapper[2583]: I0709 02:44:04.898302 2583 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/19da2ac8-d8f8-4d55-8e97-09940d2ac33e-home\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-l5pmn\" (UID: \"19da2ac8-d8f8-4d55-8e97-09940d2ac33e\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-l5pmn" Jul 09 02:44:04.900239 ip-10-0-138-136 kubenswrapper[2583]: I0709 02:44:04.900220 2583 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/19da2ac8-d8f8-4d55-8e97-09940d2ac33e-dshm\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-l5pmn\" (UID: \"19da2ac8-d8f8-4d55-8e97-09940d2ac33e\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-l5pmn" Jul 09 02:44:04.900404 ip-10-0-138-136 kubenswrapper[2583]: I0709 02:44:04.900388 2583 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/19da2ac8-d8f8-4d55-8e97-09940d2ac33e-tls-certs\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-l5pmn\" (UID: \"19da2ac8-d8f8-4d55-8e97-09940d2ac33e\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-l5pmn" Jul 09 02:44:04.904993 ip-10-0-138-136 kubenswrapper[2583]: I0709 02:44:04.904972 2583 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-gbv6l\" (UniqueName: \"kubernetes.io/projected/19da2ac8-d8f8-4d55-8e97-09940d2ac33e-kube-api-access-gbv6l\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-l5pmn\" (UID: \"19da2ac8-d8f8-4d55-8e97-09940d2ac33e\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-l5pmn" Jul 09 02:44:05.085527 ip-10-0-138-136 kubenswrapper[2583]: I0709 02:44:05.085449 2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-l5pmn" Jul 09 02:44:05.216940 ip-10-0-138-136 kubenswrapper[2583]: I0709 02:44:05.216915 2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-l5pmn"] Jul 09 02:44:05.219185 ip-10-0-138-136 kubenswrapper[2583]: W0709 02:44:05.219154 2583 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod19da2ac8_d8f8_4d55_8e97_09940d2ac33e.slice/crio-313f2b4c8f8b3da07376fc18ca78df4a64c6978c30cc17c55110bb0e909ab8b8 WatchSource:0}: Error finding container 313f2b4c8f8b3da07376fc18ca78df4a64c6978c30cc17c55110bb0e909ab8b8: Status 404 returned error can't find the container with id 313f2b4c8f8b3da07376fc18ca78df4a64c6978c30cc17c55110bb0e909ab8b8 Jul 09 02:44:05.569028 ip-10-0-138-136 kubenswrapper[2583]: I0709 02:44:05.568964 2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-l5pmn" event={"ID":"19da2ac8-d8f8-4d55-8e97-09940d2ac33e","Type":"ContainerStarted","Data":"313f2b4c8f8b3da07376fc18ca78df4a64c6978c30cc17c55110bb0e909ab8b8"} Jul 09 02:44:06.575090 ip-10-0-138-136 kubenswrapper[2583]: I0709 02:44:06.574993 2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-l5pmn" event={"ID":"19da2ac8-d8f8-4d55-8e97-09940d2ac33e","Type":"ContainerStarted","Data":"42eda4b4f277839cfaf990ac6021cce02e51e6239d2cd7fb983e4f7b211b35ce"} Jul 09 02:44:06.590997 ip-10-0-138-136 kubenswrapper[2583]: I0709 02:44:06.590948 2583 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-l5pmn" podStartSLOduration=1.489547953 podStartE2EDuration="2.590933244s" totalImagesPullingTime="1.101385291s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-09 02:44:04 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-09 02:44:06.590023341 +0000 UTC m=+592.522480829" watchObservedRunningTime="2026-07-09 02:44:06.590933244 +0000 UTC m=+592.523390730" Jul 09 02:44:14.528473 ip-10-0-138-136 kubenswrapper[2583]: I0709 02:44:14.528446 2583 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-68b757fb67-xpjsj_188e21f3-2ce9-4012-ada2-a46c32d56729/console-operator/1.log" Jul 09 02:44:14.530421 ip-10-0-138-136 kubenswrapper[2583]: I0709 02:44:14.530399 2583 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-68b757fb67-xpjsj_188e21f3-2ce9-4012-ada2-a46c32d56729/console-operator/1.log" Jul 09 02:44:15.086077 ip-10-0-138-136 kubenswrapper[2583]: I0709 02:44:15.086049 2583 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-l5pmn" Jul 09 02:44:15.086225 ip-10-0-138-136 kubenswrapper[2583]: I0709 02:44:15.086132 2583 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-l5pmn" Jul 09 02:44:15.099236 ip-10-0-138-136 kubenswrapper[2583]: I0709 02:44:15.099212 2583 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-l5pmn" Jul 09 02:44:15.626746 ip-10-0-138-136 kubenswrapper[2583]: I0709 02:44:15.626723 2583 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-l5pmn" Jul 09 02:44:23.282287 ip-10-0-138-136 kubenswrapper[2583]: I0709 02:44:23.282251 2583 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["llm/e2e-trlp-test-simulated-kserve-598466548d-mnmjq"] Jul 09 02:44:23.286340 ip-10-0-138-136 kubenswrapper[2583]: I0709 02:44:23.286314 2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-trlp-test-simulated-kserve-598466548d-mnmjq" Jul 09 02:44:23.289829 ip-10-0-138-136 kubenswrapper[2583]: I0709 02:44:23.289808 2583 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"e2e-trlp-test-simulated-kserve-self-signed-certs\"" Jul 09 02:44:23.295752 ip-10-0-138-136 kubenswrapper[2583]: I0709 02:44:23.295699 2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-trlp-test-simulated-kserve-598466548d-mnmjq"] Jul 09 02:44:23.348840 ip-10-0-138-136 kubenswrapper[2583]: I0709 02:44:23.348799 2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/d701f6c0-2693-4eb5-a448-e3ad8946d8ac-dshm\") pod \"e2e-trlp-test-simulated-kserve-598466548d-mnmjq\" (UID: \"d701f6c0-2693-4eb5-a448-e3ad8946d8ac\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-mnmjq" Jul 09 02:44:23.349037 ip-10-0-138-136 kubenswrapper[2583]: I0709 02:44:23.348849 2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/d701f6c0-2693-4eb5-a448-e3ad8946d8ac-model-cache\") pod \"e2e-trlp-test-simulated-kserve-598466548d-mnmjq\" (UID: \"d701f6c0-2693-4eb5-a448-e3ad8946d8ac\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-mnmjq" Jul 09 02:44:23.349037 ip-10-0-138-136 kubenswrapper[2583]: I0709 02:44:23.348946 2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/d701f6c0-2693-4eb5-a448-e3ad8946d8ac-tls-certs\") pod \"e2e-trlp-test-simulated-kserve-598466548d-mnmjq\" (UID: \"d701f6c0-2693-4eb5-a448-e3ad8946d8ac\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-mnmjq" Jul 09 02:44:23.349037 ip-10-0-138-136 kubenswrapper[2583]: I0709 02:44:23.348999 2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/d701f6c0-2693-4eb5-a448-e3ad8946d8ac-home\") pod \"e2e-trlp-test-simulated-kserve-598466548d-mnmjq\" (UID: \"d701f6c0-2693-4eb5-a448-e3ad8946d8ac\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-mnmjq" Jul 09 02:44:23.349037 ip-10-0-138-136 kubenswrapper[2583]: I0709 02:44:23.349021 2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/d701f6c0-2693-4eb5-a448-e3ad8946d8ac-tmp-dir\") pod \"e2e-trlp-test-simulated-kserve-598466548d-mnmjq\" (UID: \"d701f6c0-2693-4eb5-a448-e3ad8946d8ac\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-mnmjq" Jul 09 02:44:23.349191 ip-10-0-138-136 kubenswrapper[2583]: I0709 02:44:23.349095 2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-gsnlm\" (UniqueName: \"kubernetes.io/projected/d701f6c0-2693-4eb5-a448-e3ad8946d8ac-kube-api-access-gsnlm\") pod \"e2e-trlp-test-simulated-kserve-598466548d-mnmjq\" (UID: \"d701f6c0-2693-4eb5-a448-e3ad8946d8ac\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-mnmjq" Jul 09 02:44:23.450145 ip-10-0-138-136 kubenswrapper[2583]: I0709 02:44:23.450107 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/d701f6c0-2693-4eb5-a448-e3ad8946d8ac-home\") pod \"e2e-trlp-test-simulated-kserve-598466548d-mnmjq\" (UID: \"d701f6c0-2693-4eb5-a448-e3ad8946d8ac\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-mnmjq" Jul 09 02:44:23.450145 ip-10-0-138-136 kubenswrapper[2583]: I0709 02:44:23.450146 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/d701f6c0-2693-4eb5-a448-e3ad8946d8ac-tmp-dir\") pod \"e2e-trlp-test-simulated-kserve-598466548d-mnmjq\" (UID: \"d701f6c0-2693-4eb5-a448-e3ad8946d8ac\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-mnmjq" Jul 09 02:44:23.450382 ip-10-0-138-136 kubenswrapper[2583]: I0709 02:44:23.450172 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-gsnlm\" (UniqueName: \"kubernetes.io/projected/d701f6c0-2693-4eb5-a448-e3ad8946d8ac-kube-api-access-gsnlm\") pod \"e2e-trlp-test-simulated-kserve-598466548d-mnmjq\" (UID: \"d701f6c0-2693-4eb5-a448-e3ad8946d8ac\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-mnmjq" Jul 09 02:44:23.450382 ip-10-0-138-136 kubenswrapper[2583]: I0709 02:44:23.450213 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/d701f6c0-2693-4eb5-a448-e3ad8946d8ac-dshm\") pod \"e2e-trlp-test-simulated-kserve-598466548d-mnmjq\" (UID: \"d701f6c0-2693-4eb5-a448-e3ad8946d8ac\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-mnmjq" Jul 09 02:44:23.450382 ip-10-0-138-136 kubenswrapper[2583]: I0709 02:44:23.450233 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/d701f6c0-2693-4eb5-a448-e3ad8946d8ac-model-cache\") pod \"e2e-trlp-test-simulated-kserve-598466548d-mnmjq\" (UID: \"d701f6c0-2693-4eb5-a448-e3ad8946d8ac\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-mnmjq" Jul 09 02:44:23.450382 ip-10-0-138-136 kubenswrapper[2583]: I0709 02:44:23.450296 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/d701f6c0-2693-4eb5-a448-e3ad8946d8ac-tls-certs\") pod \"e2e-trlp-test-simulated-kserve-598466548d-mnmjq\" (UID: \"d701f6c0-2693-4eb5-a448-e3ad8946d8ac\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-mnmjq" Jul 09 02:44:23.450591 ip-10-0-138-136 kubenswrapper[2583]: I0709 02:44:23.450560 2583 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/d701f6c0-2693-4eb5-a448-e3ad8946d8ac-home\") pod \"e2e-trlp-test-simulated-kserve-598466548d-mnmjq\" (UID: \"d701f6c0-2693-4eb5-a448-e3ad8946d8ac\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-mnmjq" Jul 09 02:44:23.450650 ip-10-0-138-136 kubenswrapper[2583]: I0709 02:44:23.450634 2583 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/d701f6c0-2693-4eb5-a448-e3ad8946d8ac-tmp-dir\") pod \"e2e-trlp-test-simulated-kserve-598466548d-mnmjq\" (UID: \"d701f6c0-2693-4eb5-a448-e3ad8946d8ac\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-mnmjq" Jul 09 02:44:23.450694 ip-10-0-138-136 kubenswrapper[2583]: I0709 02:44:23.450655 2583 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/d701f6c0-2693-4eb5-a448-e3ad8946d8ac-model-cache\") pod \"e2e-trlp-test-simulated-kserve-598466548d-mnmjq\" (UID: \"d701f6c0-2693-4eb5-a448-e3ad8946d8ac\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-mnmjq" Jul 09 02:44:23.452665 ip-10-0-138-136 kubenswrapper[2583]: I0709 02:44:23.452635 2583 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/d701f6c0-2693-4eb5-a448-e3ad8946d8ac-dshm\") pod \"e2e-trlp-test-simulated-kserve-598466548d-mnmjq\" (UID: \"d701f6c0-2693-4eb5-a448-e3ad8946d8ac\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-mnmjq" Jul 09 02:44:23.452935 ip-10-0-138-136 kubenswrapper[2583]: I0709 02:44:23.452919 2583 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/d701f6c0-2693-4eb5-a448-e3ad8946d8ac-tls-certs\") pod \"e2e-trlp-test-simulated-kserve-598466548d-mnmjq\" (UID: \"d701f6c0-2693-4eb5-a448-e3ad8946d8ac\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-mnmjq" Jul 09 02:44:23.457795 ip-10-0-138-136 kubenswrapper[2583]: I0709 02:44:23.457775 2583 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-gsnlm\" (UniqueName: \"kubernetes.io/projected/d701f6c0-2693-4eb5-a448-e3ad8946d8ac-kube-api-access-gsnlm\") pod \"e2e-trlp-test-simulated-kserve-598466548d-mnmjq\" (UID: \"d701f6c0-2693-4eb5-a448-e3ad8946d8ac\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-mnmjq" Jul 09 02:44:23.597953 ip-10-0-138-136 kubenswrapper[2583]: I0709 02:44:23.597852 2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-trlp-test-simulated-kserve-598466548d-mnmjq" Jul 09 02:44:23.728803 ip-10-0-138-136 kubenswrapper[2583]: I0709 02:44:23.728776 2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-trlp-test-simulated-kserve-598466548d-mnmjq"] Jul 09 02:44:23.730649 ip-10-0-138-136 kubenswrapper[2583]: W0709 02:44:23.730622 2583 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podd701f6c0_2693_4eb5_a448_e3ad8946d8ac.slice/crio-224e0ebb745a1eb1ab1a3cff855c4f5cfb31a9c6a280aa8d582ab9cf43874a18 WatchSource:0}: Error finding container 224e0ebb745a1eb1ab1a3cff855c4f5cfb31a9c6a280aa8d582ab9cf43874a18: Status 404 returned error can't find the container with id 224e0ebb745a1eb1ab1a3cff855c4f5cfb31a9c6a280aa8d582ab9cf43874a18 Jul 09 02:44:24.663456 ip-10-0-138-136 kubenswrapper[2583]: I0709 02:44:24.663418 2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-trlp-test-simulated-kserve-598466548d-mnmjq" event={"ID":"d701f6c0-2693-4eb5-a448-e3ad8946d8ac","Type":"ContainerStarted","Data":"b622c23873a159c2bc46e4a8313b18ff1ce2fd167047eef4bf80caf18ade1040"} Jul 09 02:44:24.663879 ip-10-0-138-136 kubenswrapper[2583]: I0709 02:44:24.663468 2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-trlp-test-simulated-kserve-598466548d-mnmjq" event={"ID":"d701f6c0-2693-4eb5-a448-e3ad8946d8ac","Type":"ContainerStarted","Data":"224e0ebb745a1eb1ab1a3cff855c4f5cfb31a9c6a280aa8d582ab9cf43874a18"} Jul 09 02:44:24.680272 ip-10-0-138-136 kubenswrapper[2583]: I0709 02:44:24.680222 2583 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="llm/e2e-trlp-test-simulated-kserve-598466548d-mnmjq" podStartSLOduration=1.525067243 podStartE2EDuration="1.680204117s" totalImagesPullingTime="155.136874ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-09 02:44:23 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-09 02:44:24.678465122 +0000 UTC m=+610.610922622" watchObservedRunningTime="2026-07-09 02:44:24.680204117 +0000 UTC m=+610.612661603" Jul 09 02:44:33.598703 ip-10-0-138-136 kubenswrapper[2583]: I0709 02:44:33.598667 2583 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="llm/e2e-trlp-test-simulated-kserve-598466548d-mnmjq" Jul 09 02:44:33.598703 ip-10-0-138-136 kubenswrapper[2583]: I0709 02:44:33.598727 2583 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="llm/e2e-trlp-test-simulated-kserve-598466548d-mnmjq" Jul 09 02:44:33.611789 ip-10-0-138-136 kubenswrapper[2583]: I0709 02:44:33.611759 2583 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="llm/e2e-trlp-test-simulated-kserve-598466548d-mnmjq" Jul 09 02:44:33.716966 ip-10-0-138-136 kubenswrapper[2583]: I0709 02:44:33.716939 2583 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="llm/e2e-trlp-test-simulated-kserve-598466548d-mnmjq" Jul 09 02:44:45.979284 ip-10-0-138-136 kubenswrapper[2583]: I0709 02:44:45.979196 2583 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["llm/facebook-opt-125m-simulated-kserve-74b68447df-8f4tj"] Jul 09 02:44:45.983121 ip-10-0-138-136 kubenswrapper[2583]: I0709 02:44:45.983098 2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-8f4tj" Jul 09 02:44:45.985060 ip-10-0-138-136 kubenswrapper[2583]: I0709 02:44:45.985042 2583 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"facebook-opt-125m-simulated-kserve-self-signed-certs\"" Jul 09 02:44:45.990019 ip-10-0-138-136 kubenswrapper[2583]: I0709 02:44:45.989998 2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/facebook-opt-125m-simulated-kserve-74b68447df-8f4tj"] Jul 09 02:44:46.132000 ip-10-0-138-136 kubenswrapper[2583]: I0709 02:44:46.131967 2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-q99gl\" (UniqueName: \"kubernetes.io/projected/f92f788f-4dc7-4964-86ec-afdb697712a2-kube-api-access-q99gl\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-8f4tj\" (UID: \"f92f788f-4dc7-4964-86ec-afdb697712a2\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-8f4tj" Jul 09 02:44:46.132128 ip-10-0-138-136 kubenswrapper[2583]: I0709 02:44:46.132028 2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/f92f788f-4dc7-4964-86ec-afdb697712a2-home\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-8f4tj\" (UID: \"f92f788f-4dc7-4964-86ec-afdb697712a2\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-8f4tj" Jul 09 02:44:46.132128 ip-10-0-138-136 kubenswrapper[2583]: I0709 02:44:46.132114 2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/f92f788f-4dc7-4964-86ec-afdb697712a2-model-cache\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-8f4tj\" (UID: \"f92f788f-4dc7-4964-86ec-afdb697712a2\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-8f4tj" Jul 09 02:44:46.132209 ip-10-0-138-136 kubenswrapper[2583]: I0709 02:44:46.132157 2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/f92f788f-4dc7-4964-86ec-afdb697712a2-tmp-dir\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-8f4tj\" (UID: \"f92f788f-4dc7-4964-86ec-afdb697712a2\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-8f4tj" Jul 09 02:44:46.132209 ip-10-0-138-136 kubenswrapper[2583]: I0709 02:44:46.132190 2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/f92f788f-4dc7-4964-86ec-afdb697712a2-dshm\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-8f4tj\" (UID: \"f92f788f-4dc7-4964-86ec-afdb697712a2\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-8f4tj" Jul 09 02:44:46.132282 ip-10-0-138-136 kubenswrapper[2583]: I0709 02:44:46.132266 2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/f92f788f-4dc7-4964-86ec-afdb697712a2-tls-certs\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-8f4tj\" (UID: \"f92f788f-4dc7-4964-86ec-afdb697712a2\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-8f4tj" Jul 09 02:44:46.233428 ip-10-0-138-136 kubenswrapper[2583]: I0709 02:44:46.233404 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/f92f788f-4dc7-4964-86ec-afdb697712a2-dshm\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-8f4tj\" (UID: \"f92f788f-4dc7-4964-86ec-afdb697712a2\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-8f4tj" Jul 09 02:44:46.233549 ip-10-0-138-136 kubenswrapper[2583]: I0709 02:44:46.233457 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/f92f788f-4dc7-4964-86ec-afdb697712a2-tls-certs\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-8f4tj\" (UID: \"f92f788f-4dc7-4964-86ec-afdb697712a2\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-8f4tj" Jul 09 02:44:46.233549 ip-10-0-138-136 kubenswrapper[2583]: I0709 02:44:46.233488 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-q99gl\" (UniqueName: \"kubernetes.io/projected/f92f788f-4dc7-4964-86ec-afdb697712a2-kube-api-access-q99gl\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-8f4tj\" (UID: \"f92f788f-4dc7-4964-86ec-afdb697712a2\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-8f4tj" Jul 09 02:44:46.233549 ip-10-0-138-136 kubenswrapper[2583]: I0709 02:44:46.233517 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/f92f788f-4dc7-4964-86ec-afdb697712a2-home\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-8f4tj\" (UID: \"f92f788f-4dc7-4964-86ec-afdb697712a2\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-8f4tj" Jul 09 02:44:46.233701 ip-10-0-138-136 kubenswrapper[2583]: I0709 02:44:46.233556 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/f92f788f-4dc7-4964-86ec-afdb697712a2-model-cache\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-8f4tj\" (UID: \"f92f788f-4dc7-4964-86ec-afdb697712a2\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-8f4tj" Jul 09 02:44:46.233701 ip-10-0-138-136 kubenswrapper[2583]: I0709 02:44:46.233592 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/f92f788f-4dc7-4964-86ec-afdb697712a2-tmp-dir\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-8f4tj\" (UID: \"f92f788f-4dc7-4964-86ec-afdb697712a2\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-8f4tj" Jul 09 02:44:46.233975 ip-10-0-138-136 kubenswrapper[2583]: I0709 02:44:46.233949 2583 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/f92f788f-4dc7-4964-86ec-afdb697712a2-home\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-8f4tj\" (UID: \"f92f788f-4dc7-4964-86ec-afdb697712a2\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-8f4tj" Jul 09 02:44:46.233975 ip-10-0-138-136 kubenswrapper[2583]: I0709 02:44:46.233965 2583 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/f92f788f-4dc7-4964-86ec-afdb697712a2-model-cache\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-8f4tj\" (UID: \"f92f788f-4dc7-4964-86ec-afdb697712a2\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-8f4tj" Jul 09 02:44:46.234089 ip-10-0-138-136 kubenswrapper[2583]: I0709 02:44:46.234004 2583 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/f92f788f-4dc7-4964-86ec-afdb697712a2-tmp-dir\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-8f4tj\" (UID: \"f92f788f-4dc7-4964-86ec-afdb697712a2\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-8f4tj" Jul 09 02:44:46.235679 ip-10-0-138-136 kubenswrapper[2583]: I0709 02:44:46.235660 2583 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/f92f788f-4dc7-4964-86ec-afdb697712a2-dshm\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-8f4tj\" (UID: \"f92f788f-4dc7-4964-86ec-afdb697712a2\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-8f4tj" Jul 09 02:44:46.236109 ip-10-0-138-136 kubenswrapper[2583]: I0709 02:44:46.236089 2583 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/f92f788f-4dc7-4964-86ec-afdb697712a2-tls-certs\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-8f4tj\" (UID: \"f92f788f-4dc7-4964-86ec-afdb697712a2\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-8f4tj" Jul 09 02:44:46.241150 ip-10-0-138-136 kubenswrapper[2583]: I0709 02:44:46.241129 2583 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-q99gl\" (UniqueName: \"kubernetes.io/projected/f92f788f-4dc7-4964-86ec-afdb697712a2-kube-api-access-q99gl\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-8f4tj\" (UID: \"f92f788f-4dc7-4964-86ec-afdb697712a2\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-8f4tj" Jul 09 02:44:46.294429 ip-10-0-138-136 kubenswrapper[2583]: I0709 02:44:46.294408 2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-8f4tj" Jul 09 02:44:46.630253 ip-10-0-138-136 kubenswrapper[2583]: I0709 02:44:46.630223 2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/facebook-opt-125m-simulated-kserve-74b68447df-8f4tj"] Jul 09 02:44:46.632044 ip-10-0-138-136 kubenswrapper[2583]: W0709 02:44:46.632015 2583 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podf92f788f_4dc7_4964_86ec_afdb697712a2.slice/crio-e8bb1eb198a933bf65d5366f180ec178e92d605c4b75079cc9d5162c64c6fae2 WatchSource:0}: Error finding container e8bb1eb198a933bf65d5366f180ec178e92d605c4b75079cc9d5162c64c6fae2: Status 404 returned error can't find the container with id e8bb1eb198a933bf65d5366f180ec178e92d605c4b75079cc9d5162c64c6fae2 Jul 09 02:44:46.633745 ip-10-0-138-136 kubenswrapper[2583]: I0709 02:44:46.633728 2583 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider Jul 09 02:44:46.767587 ip-10-0-138-136 kubenswrapper[2583]: I0709 02:44:46.767557 2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-8f4tj" event={"ID":"f92f788f-4dc7-4964-86ec-afdb697712a2","Type":"ContainerStarted","Data":"e8bb1eb198a933bf65d5366f180ec178e92d605c4b75079cc9d5162c64c6fae2"} Jul 09 02:44:47.773890 ip-10-0-138-136 kubenswrapper[2583]: I0709 02:44:47.773859 2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-8f4tj" event={"ID":"f92f788f-4dc7-4964-86ec-afdb697712a2","Type":"ContainerStarted","Data":"6980a96cdd8412856d01dcbd19aadeef15d9b3c1d2a05f0061e346ef53b6cb0c"} Jul 09 02:44:47.793393 ip-10-0-138-136 kubenswrapper[2583]: I0709 02:44:47.793344 2583 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-8f4tj" podStartSLOduration=2.614383487 podStartE2EDuration="2.793328993s" totalImagesPullingTime="178.945506ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-09 02:44:45 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-09 02:44:47.7909008 +0000 UTC m=+633.723358286" watchObservedRunningTime="2026-07-09 02:44:47.793328993 +0000 UTC m=+633.725786479" Jul 09 02:44:50.976386 ip-10-0-138-136 kubenswrapper[2583]: I0709 02:44:50.976354 2583 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-tsfvh"] Jul 09 02:44:50.980235 ip-10-0-138-136 kubenswrapper[2583]: I0709 02:44:50.980208 2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-tsfvh" Jul 09 02:44:50.982510 ip-10-0-138-136 kubenswrapper[2583]: I0709 02:44:50.982483 2583 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"premium-simulated-simulated-premium-kserve-self-signed-certs\"" Jul 09 02:44:50.990284 ip-10-0-138-136 kubenswrapper[2583]: I0709 02:44:50.990261 2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-tsfvh"] Jul 09 02:44:51.067698 ip-10-0-138-136 kubenswrapper[2583]: I0709 02:44:51.067673 2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-2szb7\" (UniqueName: \"kubernetes.io/projected/dace10e5-09c2-4f96-85c5-acd7450ca55b-kube-api-access-2szb7\") pod \"premium-simulated-simulated-premium-kserve-5fc6fb456f-tsfvh\" (UID: \"dace10e5-09c2-4f96-85c5-acd7450ca55b\") " pod="llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-tsfvh" Jul 09 02:44:51.067833 ip-10-0-138-136 kubenswrapper[2583]: I0709 02:44:51.067706 2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/dace10e5-09c2-4f96-85c5-acd7450ca55b-home\") pod \"premium-simulated-simulated-premium-kserve-5fc6fb456f-tsfvh\" (UID: \"dace10e5-09c2-4f96-85c5-acd7450ca55b\") " pod="llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-tsfvh" Jul 09 02:44:51.067877 ip-10-0-138-136 kubenswrapper[2583]: I0709 02:44:51.067835 2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/dace10e5-09c2-4f96-85c5-acd7450ca55b-tls-certs\") pod \"premium-simulated-simulated-premium-kserve-5fc6fb456f-tsfvh\" (UID: \"dace10e5-09c2-4f96-85c5-acd7450ca55b\") " pod="llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-tsfvh" Jul 09 02:44:51.067915 ip-10-0-138-136 kubenswrapper[2583]: I0709 02:44:51.067882 2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/dace10e5-09c2-4f96-85c5-acd7450ca55b-model-cache\") pod \"premium-simulated-simulated-premium-kserve-5fc6fb456f-tsfvh\" (UID: \"dace10e5-09c2-4f96-85c5-acd7450ca55b\") " pod="llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-tsfvh" Jul 09 02:44:51.067950 ip-10-0-138-136 kubenswrapper[2583]: I0709 02:44:51.067929 2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/dace10e5-09c2-4f96-85c5-acd7450ca55b-tmp-dir\") pod \"premium-simulated-simulated-premium-kserve-5fc6fb456f-tsfvh\" (UID: \"dace10e5-09c2-4f96-85c5-acd7450ca55b\") " pod="llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-tsfvh" Jul 09 02:44:51.067997 ip-10-0-138-136 kubenswrapper[2583]: I0709 02:44:51.067957 2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/dace10e5-09c2-4f96-85c5-acd7450ca55b-dshm\") pod \"premium-simulated-simulated-premium-kserve-5fc6fb456f-tsfvh\" (UID: \"dace10e5-09c2-4f96-85c5-acd7450ca55b\") " pod="llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-tsfvh" Jul 09 02:44:51.168926 ip-10-0-138-136 kubenswrapper[2583]: I0709 02:44:51.168892 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/dace10e5-09c2-4f96-85c5-acd7450ca55b-tls-certs\") pod \"premium-simulated-simulated-premium-kserve-5fc6fb456f-tsfvh\" (UID: \"dace10e5-09c2-4f96-85c5-acd7450ca55b\") " pod="llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-tsfvh" Jul 09 02:44:51.169054 ip-10-0-138-136 kubenswrapper[2583]: I0709 02:44:51.168977 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/dace10e5-09c2-4f96-85c5-acd7450ca55b-model-cache\") pod \"premium-simulated-simulated-premium-kserve-5fc6fb456f-tsfvh\" (UID: \"dace10e5-09c2-4f96-85c5-acd7450ca55b\") " pod="llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-tsfvh" Jul 09 02:44:51.169121 ip-10-0-138-136 kubenswrapper[2583]: I0709 02:44:51.169071 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/dace10e5-09c2-4f96-85c5-acd7450ca55b-tmp-dir\") pod \"premium-simulated-simulated-premium-kserve-5fc6fb456f-tsfvh\" (UID: \"dace10e5-09c2-4f96-85c5-acd7450ca55b\") " pod="llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-tsfvh" Jul 09 02:44:51.169121 ip-10-0-138-136 kubenswrapper[2583]: I0709 02:44:51.169108 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/dace10e5-09c2-4f96-85c5-acd7450ca55b-dshm\") pod \"premium-simulated-simulated-premium-kserve-5fc6fb456f-tsfvh\" (UID: \"dace10e5-09c2-4f96-85c5-acd7450ca55b\") " pod="llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-tsfvh" Jul 09 02:44:51.169229 ip-10-0-138-136 kubenswrapper[2583]: I0709 02:44:51.169161 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-2szb7\" (UniqueName: \"kubernetes.io/projected/dace10e5-09c2-4f96-85c5-acd7450ca55b-kube-api-access-2szb7\") pod \"premium-simulated-simulated-premium-kserve-5fc6fb456f-tsfvh\" (UID: \"dace10e5-09c2-4f96-85c5-acd7450ca55b\") " pod="llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-tsfvh" Jul 09 02:44:51.169229 ip-10-0-138-136 kubenswrapper[2583]: I0709 02:44:51.169190 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/dace10e5-09c2-4f96-85c5-acd7450ca55b-home\") pod \"premium-simulated-simulated-premium-kserve-5fc6fb456f-tsfvh\" (UID: \"dace10e5-09c2-4f96-85c5-acd7450ca55b\") " pod="llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-tsfvh" Jul 09 02:44:51.169480 ip-10-0-138-136 kubenswrapper[2583]: I0709 02:44:51.169452 2583 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/dace10e5-09c2-4f96-85c5-acd7450ca55b-model-cache\") pod \"premium-simulated-simulated-premium-kserve-5fc6fb456f-tsfvh\" (UID: \"dace10e5-09c2-4f96-85c5-acd7450ca55b\") " pod="llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-tsfvh" Jul 09 02:44:51.169592 ip-10-0-138-136 kubenswrapper[2583]: I0709 02:44:51.169533 2583 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/dace10e5-09c2-4f96-85c5-acd7450ca55b-tmp-dir\") pod \"premium-simulated-simulated-premium-kserve-5fc6fb456f-tsfvh\" (UID: \"dace10e5-09c2-4f96-85c5-acd7450ca55b\") " pod="llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-tsfvh" Jul 09 02:44:51.169656 ip-10-0-138-136 kubenswrapper[2583]: I0709 02:44:51.169585 2583 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/dace10e5-09c2-4f96-85c5-acd7450ca55b-home\") pod \"premium-simulated-simulated-premium-kserve-5fc6fb456f-tsfvh\" (UID: \"dace10e5-09c2-4f96-85c5-acd7450ca55b\") " pod="llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-tsfvh" Jul 09 02:44:51.171798 ip-10-0-138-136 kubenswrapper[2583]: I0709 02:44:51.171776 2583 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/dace10e5-09c2-4f96-85c5-acd7450ca55b-dshm\") pod \"premium-simulated-simulated-premium-kserve-5fc6fb456f-tsfvh\" (UID: \"dace10e5-09c2-4f96-85c5-acd7450ca55b\") " pod="llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-tsfvh" Jul 09 02:44:51.171892 ip-10-0-138-136 kubenswrapper[2583]: I0709 02:44:51.171826 2583 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/dace10e5-09c2-4f96-85c5-acd7450ca55b-tls-certs\") pod \"premium-simulated-simulated-premium-kserve-5fc6fb456f-tsfvh\" (UID: \"dace10e5-09c2-4f96-85c5-acd7450ca55b\") " pod="llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-tsfvh" Jul 09 02:44:51.176442 ip-10-0-138-136 kubenswrapper[2583]: I0709 02:44:51.176423 2583 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-2szb7\" (UniqueName: \"kubernetes.io/projected/dace10e5-09c2-4f96-85c5-acd7450ca55b-kube-api-access-2szb7\") pod \"premium-simulated-simulated-premium-kserve-5fc6fb456f-tsfvh\" (UID: \"dace10e5-09c2-4f96-85c5-acd7450ca55b\") " pod="llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-tsfvh" Jul 09 02:44:51.291254 ip-10-0-138-136 kubenswrapper[2583]: I0709 02:44:51.291229 2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-tsfvh" Jul 09 02:44:51.419151 ip-10-0-138-136 kubenswrapper[2583]: I0709 02:44:51.419124 2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-tsfvh"] Jul 09 02:44:51.420817 ip-10-0-138-136 kubenswrapper[2583]: W0709 02:44:51.420784 2583 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-poddace10e5_09c2_4f96_85c5_acd7450ca55b.slice/crio-dfe3080fc03252ecb1ddf7bb1a922eb56eea658d1dd68ad9129ecd9d56ad90c9 WatchSource:0}: Error finding container dfe3080fc03252ecb1ddf7bb1a922eb56eea658d1dd68ad9129ecd9d56ad90c9: Status 404 returned error can't find the container with id dfe3080fc03252ecb1ddf7bb1a922eb56eea658d1dd68ad9129ecd9d56ad90c9 Jul 09 02:44:51.793794 ip-10-0-138-136 kubenswrapper[2583]: I0709 02:44:51.793752 2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-tsfvh" event={"ID":"dace10e5-09c2-4f96-85c5-acd7450ca55b","Type":"ContainerStarted","Data":"c78b7a0a0936401229247d9bf85fe221ff1305e4da3c257ec20f4d259545890c"} Jul 09 02:44:51.793947 ip-10-0-138-136 kubenswrapper[2583]: I0709 02:44:51.793803 2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-tsfvh" event={"ID":"dace10e5-09c2-4f96-85c5-acd7450ca55b","Type":"ContainerStarted","Data":"dfe3080fc03252ecb1ddf7bb1a922eb56eea658d1dd68ad9129ecd9d56ad90c9"} Jul 09 02:44:51.811285 ip-10-0-138-136 kubenswrapper[2583]: I0709 02:44:51.811241 2583 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-tsfvh" podStartSLOduration=1.6484315170000001 podStartE2EDuration="1.811224352s" totalImagesPullingTime="162.792835ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-09 02:44:50 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-09 02:44:51.810000451 +0000 UTC m=+637.742457940" watchObservedRunningTime="2026-07-09 02:44:51.811224352 +0000 UTC m=+637.743681838" Jul 09 02:44:56.294773 ip-10-0-138-136 kubenswrapper[2583]: I0709 02:44:56.294737 2583 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-8f4tj" Jul 09 02:44:56.295278 ip-10-0-138-136 kubenswrapper[2583]: I0709 02:44:56.294804 2583 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-8f4tj" Jul 09 02:44:56.306855 ip-10-0-138-136 kubenswrapper[2583]: I0709 02:44:56.306827 2583 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-8f4tj" Jul 09 02:44:56.834478 ip-10-0-138-136 kubenswrapper[2583]: I0709 02:44:56.834450 2583 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-8f4tj" Jul 09 02:45:01.291861 ip-10-0-138-136 kubenswrapper[2583]: I0709 02:45:01.291831 2583 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-tsfvh" Jul 09 02:45:01.292228 ip-10-0-138-136 kubenswrapper[2583]: I0709 02:45:01.291874 2583 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-tsfvh" Jul 09 02:45:01.310310 ip-10-0-138-136 kubenswrapper[2583]: I0709 02:45:01.310286 2583 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-tsfvh" Jul 09 02:45:01.855898 ip-10-0-138-136 kubenswrapper[2583]: I0709 02:45:01.855867 2583 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-tsfvh" Jul 09 02:49:14.562298 ip-10-0-138-136 kubenswrapper[2583]: I0709 02:49:14.562221 2583 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-68b757fb67-xpjsj_188e21f3-2ce9-4012-ada2-a46c32d56729/console-operator/1.log" Jul 09 02:49:14.564857 ip-10-0-138-136 kubenswrapper[2583]: I0709 02:49:14.562424 2583 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-68b757fb67-xpjsj_188e21f3-2ce9-4012-ada2-a46c32d56729/console-operator/1.log" Jul 09 02:54:14.592706 ip-10-0-138-136 kubenswrapper[2583]: I0709 02:54:14.592593 2583 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-68b757fb67-xpjsj_188e21f3-2ce9-4012-ada2-a46c32d56729/console-operator/1.log" Jul 09 02:54:14.592706 ip-10-0-138-136 kubenswrapper[2583]: I0709 02:54:14.592661 2583 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-68b757fb67-xpjsj_188e21f3-2ce9-4012-ada2-a46c32d56729/console-operator/1.log" Jul 09 02:59:14.629642 ip-10-0-138-136 kubenswrapper[2583]: I0709 02:59:14.629507 2583 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-68b757fb67-xpjsj_188e21f3-2ce9-4012-ada2-a46c32d56729/console-operator/1.log" Jul 09 02:59:14.633661 ip-10-0-138-136 kubenswrapper[2583]: I0709 02:59:14.630419 2583 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-68b757fb67-xpjsj_188e21f3-2ce9-4012-ada2-a46c32d56729/console-operator/1.log" Jul 09 03:04:14.659892 ip-10-0-138-136 kubenswrapper[2583]: I0709 03:04:14.659792 2583 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-68b757fb67-xpjsj_188e21f3-2ce9-4012-ada2-a46c32d56729/console-operator/1.log" Jul 09 03:04:14.665776 ip-10-0-138-136 kubenswrapper[2583]: I0709 03:04:14.662009 2583 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-68b757fb67-xpjsj_188e21f3-2ce9-4012-ada2-a46c32d56729/console-operator/1.log" Jul 09 03:05:08.222398 ip-10-0-138-136 kubenswrapper[2583]: I0709 03:05:08.222362 2583 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-ait-44d03cda-openshift-default-84dcb45449-w8x4n"] Jul 09 03:05:08.225906 ip-10-0-138-136 kubenswrapper[2583]: I0709 03:05:08.225889 2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ait-44d03cda-openshift-default-84dcb45449-w8x4n" Jul 09 03:05:08.228010 ip-10-0-138-136 kubenswrapper[2583]: I0709 03:05:08.227989 2583 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-ait-44d03cda-openshift-default-dockercfg-98hdf\"" Jul 09 03:05:08.265903 ip-10-0-138-136 kubenswrapper[2583]: I0709 03:05:08.265882 2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-ait-44d03cda-openshift-default-84dcb45449-w8x4n"] Jul 09 03:05:08.350453 ip-10-0-138-136 kubenswrapper[2583]: I0709 03:05:08.350423 2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-lq259\" (UniqueName: \"kubernetes.io/projected/f4cd554b-ed76-46a8-a599-0ed075e3c3dd-kube-api-access-lq259\") pod \"e2e-ait-44d03cda-openshift-default-84dcb45449-w8x4n\" (UID: \"f4cd554b-ed76-46a8-a599-0ed075e3c3dd\") " pod="openshift-ingress/e2e-ait-44d03cda-openshift-default-84dcb45449-w8x4n" Jul 09 03:05:08.350596 ip-10-0-138-136 kubenswrapper[2583]: I0709 03:05:08.350463 2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/f4cd554b-ed76-46a8-a599-0ed075e3c3dd-istiod-ca-cert\") pod \"e2e-ait-44d03cda-openshift-default-84dcb45449-w8x4n\" (UID: \"f4cd554b-ed76-46a8-a599-0ed075e3c3dd\") " pod="openshift-ingress/e2e-ait-44d03cda-openshift-default-84dcb45449-w8x4n" Jul 09 03:05:08.350596 ip-10-0-138-136 kubenswrapper[2583]: I0709 03:05:08.350533 2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/f4cd554b-ed76-46a8-a599-0ed075e3c3dd-workload-certs\") pod \"e2e-ait-44d03cda-openshift-default-84dcb45449-w8x4n\" (UID: \"f4cd554b-ed76-46a8-a599-0ed075e3c3dd\") " pod="openshift-ingress/e2e-ait-44d03cda-openshift-default-84dcb45449-w8x4n" Jul 09 03:05:08.350680 ip-10-0-138-136 kubenswrapper[2583]: I0709 03:05:08.350608 2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/f4cd554b-ed76-46a8-a599-0ed075e3c3dd-istio-token\") pod \"e2e-ait-44d03cda-openshift-default-84dcb45449-w8x4n\" (UID: \"f4cd554b-ed76-46a8-a599-0ed075e3c3dd\") " pod="openshift-ingress/e2e-ait-44d03cda-openshift-default-84dcb45449-w8x4n" Jul 09 03:05:08.350680 ip-10-0-138-136 kubenswrapper[2583]: I0709 03:05:08.350636 2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/f4cd554b-ed76-46a8-a599-0ed075e3c3dd-istio-data\") pod \"e2e-ait-44d03cda-openshift-default-84dcb45449-w8x4n\" (UID: \"f4cd554b-ed76-46a8-a599-0ed075e3c3dd\") " pod="openshift-ingress/e2e-ait-44d03cda-openshift-default-84dcb45449-w8x4n" Jul 09 03:05:08.350680 ip-10-0-138-136 kubenswrapper[2583]: I0709 03:05:08.350656 2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/f4cd554b-ed76-46a8-a599-0ed075e3c3dd-credential-socket\") pod \"e2e-ait-44d03cda-openshift-default-84dcb45449-w8x4n\" (UID: \"f4cd554b-ed76-46a8-a599-0ed075e3c3dd\") " pod="openshift-ingress/e2e-ait-44d03cda-openshift-default-84dcb45449-w8x4n" Jul 09 03:05:08.350822 ip-10-0-138-136 kubenswrapper[2583]: I0709 03:05:08.350765 2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/f4cd554b-ed76-46a8-a599-0ed075e3c3dd-istio-podinfo\") pod \"e2e-ait-44d03cda-openshift-default-84dcb45449-w8x4n\" (UID: \"f4cd554b-ed76-46a8-a599-0ed075e3c3dd\") " pod="openshift-ingress/e2e-ait-44d03cda-openshift-default-84dcb45449-w8x4n" Jul 09 03:05:08.350822 ip-10-0-138-136 kubenswrapper[2583]: I0709 03:05:08.350792 2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/f4cd554b-ed76-46a8-a599-0ed075e3c3dd-workload-socket\") pod \"e2e-ait-44d03cda-openshift-default-84dcb45449-w8x4n\" (UID: \"f4cd554b-ed76-46a8-a599-0ed075e3c3dd\") " pod="openshift-ingress/e2e-ait-44d03cda-openshift-default-84dcb45449-w8x4n" Jul 09 03:05:08.350822 ip-10-0-138-136 kubenswrapper[2583]: I0709 03:05:08.350807 2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/f4cd554b-ed76-46a8-a599-0ed075e3c3dd-istio-envoy\") pod \"e2e-ait-44d03cda-openshift-default-84dcb45449-w8x4n\" (UID: \"f4cd554b-ed76-46a8-a599-0ed075e3c3dd\") " pod="openshift-ingress/e2e-ait-44d03cda-openshift-default-84dcb45449-w8x4n" Jul 09 03:05:08.452060 ip-10-0-138-136 kubenswrapper[2583]: I0709 03:05:08.452030 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-lq259\" (UniqueName: \"kubernetes.io/projected/f4cd554b-ed76-46a8-a599-0ed075e3c3dd-kube-api-access-lq259\") pod \"e2e-ait-44d03cda-openshift-default-84dcb45449-w8x4n\" (UID: \"f4cd554b-ed76-46a8-a599-0ed075e3c3dd\") " pod="openshift-ingress/e2e-ait-44d03cda-openshift-default-84dcb45449-w8x4n" Jul 09 03:05:08.452160 ip-10-0-138-136 kubenswrapper[2583]: I0709 03:05:08.452079 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/f4cd554b-ed76-46a8-a599-0ed075e3c3dd-istiod-ca-cert\") pod \"e2e-ait-44d03cda-openshift-default-84dcb45449-w8x4n\" (UID: \"f4cd554b-ed76-46a8-a599-0ed075e3c3dd\") " pod="openshift-ingress/e2e-ait-44d03cda-openshift-default-84dcb45449-w8x4n" Jul 09 03:05:08.452160 ip-10-0-138-136 kubenswrapper[2583]: I0709 03:05:08.452116 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/f4cd554b-ed76-46a8-a599-0ed075e3c3dd-workload-certs\") pod \"e2e-ait-44d03cda-openshift-default-84dcb45449-w8x4n\" (UID: \"f4cd554b-ed76-46a8-a599-0ed075e3c3dd\") " pod="openshift-ingress/e2e-ait-44d03cda-openshift-default-84dcb45449-w8x4n" Jul 09 03:05:08.452160 ip-10-0-138-136 kubenswrapper[2583]: I0709 03:05:08.452135 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/f4cd554b-ed76-46a8-a599-0ed075e3c3dd-istio-token\") pod \"e2e-ait-44d03cda-openshift-default-84dcb45449-w8x4n\" (UID: \"f4cd554b-ed76-46a8-a599-0ed075e3c3dd\") " pod="openshift-ingress/e2e-ait-44d03cda-openshift-default-84dcb45449-w8x4n" Jul 09 03:05:08.452160 ip-10-0-138-136 kubenswrapper[2583]: I0709 03:05:08.452151 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/f4cd554b-ed76-46a8-a599-0ed075e3c3dd-istio-data\") pod \"e2e-ait-44d03cda-openshift-default-84dcb45449-w8x4n\" (UID: \"f4cd554b-ed76-46a8-a599-0ed075e3c3dd\") " pod="openshift-ingress/e2e-ait-44d03cda-openshift-default-84dcb45449-w8x4n" Jul 09 03:05:08.452354 ip-10-0-138-136 kubenswrapper[2583]: I0709 03:05:08.452167 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/f4cd554b-ed76-46a8-a599-0ed075e3c3dd-credential-socket\") pod \"e2e-ait-44d03cda-openshift-default-84dcb45449-w8x4n\" (UID: \"f4cd554b-ed76-46a8-a599-0ed075e3c3dd\") " pod="openshift-ingress/e2e-ait-44d03cda-openshift-default-84dcb45449-w8x4n" Jul 09 03:05:08.452354 ip-10-0-138-136 kubenswrapper[2583]: I0709 03:05:08.452190 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/f4cd554b-ed76-46a8-a599-0ed075e3c3dd-istio-podinfo\") pod \"e2e-ait-44d03cda-openshift-default-84dcb45449-w8x4n\" (UID: \"f4cd554b-ed76-46a8-a599-0ed075e3c3dd\") " pod="openshift-ingress/e2e-ait-44d03cda-openshift-default-84dcb45449-w8x4n" Jul 09 03:05:08.452354 ip-10-0-138-136 kubenswrapper[2583]: I0709 03:05:08.452214 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/f4cd554b-ed76-46a8-a599-0ed075e3c3dd-workload-socket\") pod \"e2e-ait-44d03cda-openshift-default-84dcb45449-w8x4n\" (UID: \"f4cd554b-ed76-46a8-a599-0ed075e3c3dd\") " pod="openshift-ingress/e2e-ait-44d03cda-openshift-default-84dcb45449-w8x4n" Jul 09 03:05:08.452674 ip-10-0-138-136 kubenswrapper[2583]: I0709 03:05:08.452510 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/f4cd554b-ed76-46a8-a599-0ed075e3c3dd-istio-envoy\") pod \"e2e-ait-44d03cda-openshift-default-84dcb45449-w8x4n\" (UID: \"f4cd554b-ed76-46a8-a599-0ed075e3c3dd\") " pod="openshift-ingress/e2e-ait-44d03cda-openshift-default-84dcb45449-w8x4n" Jul 09 03:05:08.452674 ip-10-0-138-136 kubenswrapper[2583]: I0709 03:05:08.452529 2583 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/f4cd554b-ed76-46a8-a599-0ed075e3c3dd-workload-certs\") pod \"e2e-ait-44d03cda-openshift-default-84dcb45449-w8x4n\" (UID: \"f4cd554b-ed76-46a8-a599-0ed075e3c3dd\") " pod="openshift-ingress/e2e-ait-44d03cda-openshift-default-84dcb45449-w8x4n" Jul 09 03:05:08.452674 ip-10-0-138-136 kubenswrapper[2583]: I0709 03:05:08.452613 2583 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/f4cd554b-ed76-46a8-a599-0ed075e3c3dd-workload-socket\") pod \"e2e-ait-44d03cda-openshift-default-84dcb45449-w8x4n\" (UID: \"f4cd554b-ed76-46a8-a599-0ed075e3c3dd\") " pod="openshift-ingress/e2e-ait-44d03cda-openshift-default-84dcb45449-w8x4n" Jul 09 03:05:08.452674 ip-10-0-138-136 kubenswrapper[2583]: I0709 03:05:08.452650 2583 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/f4cd554b-ed76-46a8-a599-0ed075e3c3dd-credential-socket\") pod \"e2e-ait-44d03cda-openshift-default-84dcb45449-w8x4n\" (UID: \"f4cd554b-ed76-46a8-a599-0ed075e3c3dd\") " pod="openshift-ingress/e2e-ait-44d03cda-openshift-default-84dcb45449-w8x4n" Jul 09 03:05:08.452887 ip-10-0-138-136 kubenswrapper[2583]: I0709 03:05:08.452731 2583 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/f4cd554b-ed76-46a8-a599-0ed075e3c3dd-istio-data\") pod \"e2e-ait-44d03cda-openshift-default-84dcb45449-w8x4n\" (UID: \"f4cd554b-ed76-46a8-a599-0ed075e3c3dd\") " pod="openshift-ingress/e2e-ait-44d03cda-openshift-default-84dcb45449-w8x4n" Jul 09 03:05:08.452887 ip-10-0-138-136 kubenswrapper[2583]: I0709 03:05:08.452880 2583 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/f4cd554b-ed76-46a8-a599-0ed075e3c3dd-istiod-ca-cert\") pod \"e2e-ait-44d03cda-openshift-default-84dcb45449-w8x4n\" (UID: \"f4cd554b-ed76-46a8-a599-0ed075e3c3dd\") " pod="openshift-ingress/e2e-ait-44d03cda-openshift-default-84dcb45449-w8x4n" Jul 09 03:05:08.454559 ip-10-0-138-136 kubenswrapper[2583]: I0709 03:05:08.454540 2583 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/f4cd554b-ed76-46a8-a599-0ed075e3c3dd-istio-envoy\") pod \"e2e-ait-44d03cda-openshift-default-84dcb45449-w8x4n\" (UID: \"f4cd554b-ed76-46a8-a599-0ed075e3c3dd\") " pod="openshift-ingress/e2e-ait-44d03cda-openshift-default-84dcb45449-w8x4n" Jul 09 03:05:08.454706 ip-10-0-138-136 kubenswrapper[2583]: I0709 03:05:08.454670 2583 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/f4cd554b-ed76-46a8-a599-0ed075e3c3dd-istio-podinfo\") pod \"e2e-ait-44d03cda-openshift-default-84dcb45449-w8x4n\" (UID: \"f4cd554b-ed76-46a8-a599-0ed075e3c3dd\") " pod="openshift-ingress/e2e-ait-44d03cda-openshift-default-84dcb45449-w8x4n" Jul 09 03:05:08.461160 ip-10-0-138-136 kubenswrapper[2583]: I0709 03:05:08.461138 2583 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-lq259\" (UniqueName: \"kubernetes.io/projected/f4cd554b-ed76-46a8-a599-0ed075e3c3dd-kube-api-access-lq259\") pod \"e2e-ait-44d03cda-openshift-default-84dcb45449-w8x4n\" (UID: \"f4cd554b-ed76-46a8-a599-0ed075e3c3dd\") " pod="openshift-ingress/e2e-ait-44d03cda-openshift-default-84dcb45449-w8x4n" Jul 09 03:05:08.461348 ip-10-0-138-136 kubenswrapper[2583]: I0709 03:05:08.461330 2583 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/f4cd554b-ed76-46a8-a599-0ed075e3c3dd-istio-token\") pod \"e2e-ait-44d03cda-openshift-default-84dcb45449-w8x4n\" (UID: \"f4cd554b-ed76-46a8-a599-0ed075e3c3dd\") " pod="openshift-ingress/e2e-ait-44d03cda-openshift-default-84dcb45449-w8x4n" Jul 09 03:05:08.536597 ip-10-0-138-136 kubenswrapper[2583]: I0709 03:05:08.536567 2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ait-44d03cda-openshift-default-84dcb45449-w8x4n" Jul 09 03:05:08.877634 ip-10-0-138-136 kubenswrapper[2583]: I0709 03:05:08.877606 2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-ait-44d03cda-openshift-default-84dcb45449-w8x4n"] Jul 09 03:05:08.879343 ip-10-0-138-136 kubenswrapper[2583]: W0709 03:05:08.879313 2583 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podf4cd554b_ed76_46a8_a599_0ed075e3c3dd.slice/crio-00b99130ee3af05dfd3f728775ea4720d5e09ad9d0c69f85626c693bf9780ce6 WatchSource:0}: Error finding container 00b99130ee3af05dfd3f728775ea4720d5e09ad9d0c69f85626c693bf9780ce6: Status 404 returned error can't find the container with id 00b99130ee3af05dfd3f728775ea4720d5e09ad9d0c69f85626c693bf9780ce6 Jul 09 03:05:08.881397 ip-10-0-138-136 kubenswrapper[2583]: I0709 03:05:08.881363 2583 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236232Ki","pods":"250"} Jul 09 03:05:08.881492 ip-10-0-138-136 kubenswrapper[2583]: I0709 03:05:08.881442 2583 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236232Ki","pods":"250"} Jul 09 03:05:08.881492 ip-10-0-138-136 kubenswrapper[2583]: I0709 03:05:08.881472 2583 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236232Ki","pods":"250"} Jul 09 03:05:09.866452 ip-10-0-138-136 kubenswrapper[2583]: I0709 03:05:09.866418 2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ait-44d03cda-openshift-default-84dcb45449-w8x4n" event={"ID":"f4cd554b-ed76-46a8-a599-0ed075e3c3dd","Type":"ContainerStarted","Data":"08927a11008ad525c3afdadc6dfe77a881ccdbda18b6c6e70bbbe2be8694a783"} Jul 09 03:05:09.866836 ip-10-0-138-136 kubenswrapper[2583]: I0709 03:05:09.866469 2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ait-44d03cda-openshift-default-84dcb45449-w8x4n" event={"ID":"f4cd554b-ed76-46a8-a599-0ed075e3c3dd","Type":"ContainerStarted","Data":"00b99130ee3af05dfd3f728775ea4720d5e09ad9d0c69f85626c693bf9780ce6"} Jul 09 03:05:09.888742 ip-10-0-138-136 kubenswrapper[2583]: I0709 03:05:09.888654 2583 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-ait-44d03cda-openshift-default-84dcb45449-w8x4n" podStartSLOduration=1.888633922 podStartE2EDuration="1.888633922s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-09 03:05:08 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-09 03:05:09.887280536 +0000 UTC m=+1855.819738025" watchObservedRunningTime="2026-07-09 03:05:09.888633922 +0000 UTC m=+1855.821091409" Jul 09 03:05:10.537695 ip-10-0-138-136 kubenswrapper[2583]: I0709 03:05:10.537661 2583 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-ait-44d03cda-openshift-default-84dcb45449-w8x4n" Jul 09 03:05:10.542206 ip-10-0-138-136 kubenswrapper[2583]: I0709 03:05:10.542180 2583 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-ait-44d03cda-openshift-default-84dcb45449-w8x4n" Jul 09 03:05:10.870700 ip-10-0-138-136 kubenswrapper[2583]: I0709 03:05:10.870627 2583 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-ait-44d03cda-openshift-default-84dcb45449-w8x4n" Jul 09 03:05:10.871564 ip-10-0-138-136 kubenswrapper[2583]: I0709 03:05:10.871545 2583 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-ait-44d03cda-openshift-default-84dcb45449-w8x4n" Jul 09 03:05:14.674226 ip-10-0-138-136 kubenswrapper[2583]: I0709 03:05:14.674193 2583 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-ait-44d03cda-openshift-default-84dcb45449-w8x4n"] Jul 09 03:05:14.674609 ip-10-0-138-136 kubenswrapper[2583]: I0709 03:05:14.674360 2583 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-ingress/e2e-ait-44d03cda-openshift-default-84dcb45449-w8x4n" podUID="f4cd554b-ed76-46a8-a599-0ed075e3c3dd" containerName="istio-proxy" containerID="cri-o://08927a11008ad525c3afdadc6dfe77a881ccdbda18b6c6e70bbbe2be8694a783" gracePeriod=30 Jul 09 03:05:19.921653 ip-10-0-138-136 kubenswrapper[2583]: I0709 03:05:19.921623 2583 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ait-44d03cda-openshift-default-84dcb45449-w8x4n" Jul 09 03:05:19.924037 ip-10-0-138-136 kubenswrapper[2583]: I0709 03:05:19.924015 2583 generic.go:356] "Generic (PLEG): container finished" podID="f4cd554b-ed76-46a8-a599-0ed075e3c3dd" containerID="08927a11008ad525c3afdadc6dfe77a881ccdbda18b6c6e70bbbe2be8694a783" exitCode=0 Jul 09 03:05:19.924141 ip-10-0-138-136 kubenswrapper[2583]: I0709 03:05:19.924062 2583 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ait-44d03cda-openshift-default-84dcb45449-w8x4n" Jul 09 03:05:19.924141 ip-10-0-138-136 kubenswrapper[2583]: I0709 03:05:19.924075 2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ait-44d03cda-openshift-default-84dcb45449-w8x4n" event={"ID":"f4cd554b-ed76-46a8-a599-0ed075e3c3dd","Type":"ContainerDied","Data":"08927a11008ad525c3afdadc6dfe77a881ccdbda18b6c6e70bbbe2be8694a783"} Jul 09 03:05:19.924141 ip-10-0-138-136 kubenswrapper[2583]: I0709 03:05:19.924119 2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ait-44d03cda-openshift-default-84dcb45449-w8x4n" event={"ID":"f4cd554b-ed76-46a8-a599-0ed075e3c3dd","Type":"ContainerDied","Data":"00b99130ee3af05dfd3f728775ea4720d5e09ad9d0c69f85626c693bf9780ce6"} Jul 09 03:05:19.924253 ip-10-0-138-136 kubenswrapper[2583]: I0709 03:05:19.924143 2583 scope.go:117] "RemoveContainer" containerID="08927a11008ad525c3afdadc6dfe77a881ccdbda18b6c6e70bbbe2be8694a783" Jul 09 03:05:19.932683 ip-10-0-138-136 kubenswrapper[2583]: I0709 03:05:19.932664 2583 scope.go:117] "RemoveContainer" containerID="08927a11008ad525c3afdadc6dfe77a881ccdbda18b6c6e70bbbe2be8694a783" Jul 09 03:05:19.932948 ip-10-0-138-136 kubenswrapper[2583]: E0709 03:05:19.932924 2583 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"08927a11008ad525c3afdadc6dfe77a881ccdbda18b6c6e70bbbe2be8694a783\": container with ID starting with 08927a11008ad525c3afdadc6dfe77a881ccdbda18b6c6e70bbbe2be8694a783 not found: ID does not exist" containerID="08927a11008ad525c3afdadc6dfe77a881ccdbda18b6c6e70bbbe2be8694a783" Jul 09 03:05:19.933042 ip-10-0-138-136 kubenswrapper[2583]: I0709 03:05:19.932959 2583 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"08927a11008ad525c3afdadc6dfe77a881ccdbda18b6c6e70bbbe2be8694a783"} err="failed to get container status \"08927a11008ad525c3afdadc6dfe77a881ccdbda18b6c6e70bbbe2be8694a783\": rpc error: code = NotFound desc = could not find container \"08927a11008ad525c3afdadc6dfe77a881ccdbda18b6c6e70bbbe2be8694a783\": container with ID starting with 08927a11008ad525c3afdadc6dfe77a881ccdbda18b6c6e70bbbe2be8694a783 not found: ID does not exist" Jul 09 03:05:20.055197 ip-10-0-138-136 kubenswrapper[2583]: I0709 03:05:20.055176 2583 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/f4cd554b-ed76-46a8-a599-0ed075e3c3dd-workload-certs\") pod \"f4cd554b-ed76-46a8-a599-0ed075e3c3dd\" (UID: \"f4cd554b-ed76-46a8-a599-0ed075e3c3dd\") " Jul 09 03:05:20.055316 ip-10-0-138-136 kubenswrapper[2583]: I0709 03:05:20.055225 2583 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/f4cd554b-ed76-46a8-a599-0ed075e3c3dd-istio-token\") pod \"f4cd554b-ed76-46a8-a599-0ed075e3c3dd\" (UID: \"f4cd554b-ed76-46a8-a599-0ed075e3c3dd\") " Jul 09 03:05:20.055316 ip-10-0-138-136 kubenswrapper[2583]: I0709 03:05:20.055262 2583 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/f4cd554b-ed76-46a8-a599-0ed075e3c3dd-istiod-ca-cert\") pod \"f4cd554b-ed76-46a8-a599-0ed075e3c3dd\" (UID: \"f4cd554b-ed76-46a8-a599-0ed075e3c3dd\") " Jul 09 03:05:20.055316 ip-10-0-138-136 kubenswrapper[2583]: I0709 03:05:20.055282 2583 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/f4cd554b-ed76-46a8-a599-0ed075e3c3dd-workload-socket\") pod \"f4cd554b-ed76-46a8-a599-0ed075e3c3dd\" (UID: \"f4cd554b-ed76-46a8-a599-0ed075e3c3dd\") " Jul 09 03:05:20.055423 ip-10-0-138-136 kubenswrapper[2583]: I0709 03:05:20.055321 2583 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/f4cd554b-ed76-46a8-a599-0ed075e3c3dd-istio-podinfo\") pod \"f4cd554b-ed76-46a8-a599-0ed075e3c3dd\" (UID: \"f4cd554b-ed76-46a8-a599-0ed075e3c3dd\") " Jul 09 03:05:20.055423 ip-10-0-138-136 kubenswrapper[2583]: I0709 03:05:20.055367 2583 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-lq259\" (UniqueName: \"kubernetes.io/projected/f4cd554b-ed76-46a8-a599-0ed075e3c3dd-kube-api-access-lq259\") pod \"f4cd554b-ed76-46a8-a599-0ed075e3c3dd\" (UID: \"f4cd554b-ed76-46a8-a599-0ed075e3c3dd\") " Jul 09 03:05:20.055423 ip-10-0-138-136 kubenswrapper[2583]: I0709 03:05:20.055394 2583 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/f4cd554b-ed76-46a8-a599-0ed075e3c3dd-istio-envoy\") pod \"f4cd554b-ed76-46a8-a599-0ed075e3c3dd\" (UID: \"f4cd554b-ed76-46a8-a599-0ed075e3c3dd\") " Jul 09 03:05:20.055587 ip-10-0-138-136 kubenswrapper[2583]: I0709 03:05:20.055437 2583 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/f4cd554b-ed76-46a8-a599-0ed075e3c3dd-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "f4cd554b-ed76-46a8-a599-0ed075e3c3dd" (UID: "f4cd554b-ed76-46a8-a599-0ed075e3c3dd"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 09 03:05:20.055587 ip-10-0-138-136 kubenswrapper[2583]: I0709 03:05:20.055503 2583 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/f4cd554b-ed76-46a8-a599-0ed075e3c3dd-istio-data\") pod \"f4cd554b-ed76-46a8-a599-0ed075e3c3dd\" (UID: \"f4cd554b-ed76-46a8-a599-0ed075e3c3dd\") " Jul 09 03:05:20.055587 ip-10-0-138-136 kubenswrapper[2583]: I0709 03:05:20.055568 2583 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/f4cd554b-ed76-46a8-a599-0ed075e3c3dd-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "f4cd554b-ed76-46a8-a599-0ed075e3c3dd" (UID: "f4cd554b-ed76-46a8-a599-0ed075e3c3dd"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 09 03:05:20.055784 ip-10-0-138-136 kubenswrapper[2583]: I0709 03:05:20.055588 2583 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/f4cd554b-ed76-46a8-a599-0ed075e3c3dd-credential-socket\") pod \"f4cd554b-ed76-46a8-a599-0ed075e3c3dd\" (UID: \"f4cd554b-ed76-46a8-a599-0ed075e3c3dd\") " Jul 09 03:05:20.055784 ip-10-0-138-136 kubenswrapper[2583]: I0709 03:05:20.055671 2583 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/f4cd554b-ed76-46a8-a599-0ed075e3c3dd-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "f4cd554b-ed76-46a8-a599-0ed075e3c3dd" (UID: "f4cd554b-ed76-46a8-a599-0ed075e3c3dd"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 09 03:05:20.055895 ip-10-0-138-136 kubenswrapper[2583]: I0709 03:05:20.055790 2583 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/f4cd554b-ed76-46a8-a599-0ed075e3c3dd-istio-data" (OuterVolumeSpecName: "istio-data") pod "f4cd554b-ed76-46a8-a599-0ed075e3c3dd" (UID: "f4cd554b-ed76-46a8-a599-0ed075e3c3dd"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 09 03:05:20.055956 ip-10-0-138-136 kubenswrapper[2583]: I0709 03:05:20.055894 2583 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/f4cd554b-ed76-46a8-a599-0ed075e3c3dd-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "f4cd554b-ed76-46a8-a599-0ed075e3c3dd" (UID: "f4cd554b-ed76-46a8-a599-0ed075e3c3dd"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 09 03:05:20.056081 ip-10-0-138-136 kubenswrapper[2583]: I0709 03:05:20.056061 2583 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/f4cd554b-ed76-46a8-a599-0ed075e3c3dd-istiod-ca-cert\") on node \"ip-10-0-138-136.ec2.internal\" DevicePath \"\"" Jul 09 03:05:20.056134 ip-10-0-138-136 kubenswrapper[2583]: I0709 03:05:20.056089 2583 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/f4cd554b-ed76-46a8-a599-0ed075e3c3dd-workload-socket\") on node \"ip-10-0-138-136.ec2.internal\" DevicePath \"\"" Jul 09 03:05:20.056134 ip-10-0-138-136 kubenswrapper[2583]: I0709 03:05:20.056105 2583 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/f4cd554b-ed76-46a8-a599-0ed075e3c3dd-istio-data\") on node \"ip-10-0-138-136.ec2.internal\" DevicePath \"\"" Jul 09 03:05:20.056134 ip-10-0-138-136 kubenswrapper[2583]: I0709 03:05:20.056120 2583 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/f4cd554b-ed76-46a8-a599-0ed075e3c3dd-credential-socket\") on node \"ip-10-0-138-136.ec2.internal\" DevicePath \"\"" Jul 09 03:05:20.056238 ip-10-0-138-136 kubenswrapper[2583]: I0709 03:05:20.056134 2583 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/f4cd554b-ed76-46a8-a599-0ed075e3c3dd-workload-certs\") on node \"ip-10-0-138-136.ec2.internal\" DevicePath \"\"" Jul 09 03:05:20.057543 ip-10-0-138-136 kubenswrapper[2583]: I0709 03:05:20.057517 2583 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/f4cd554b-ed76-46a8-a599-0ed075e3c3dd-istio-token" (OuterVolumeSpecName: "istio-token") pod "f4cd554b-ed76-46a8-a599-0ed075e3c3dd" (UID: "f4cd554b-ed76-46a8-a599-0ed075e3c3dd"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 09 03:05:20.057646 ip-10-0-138-136 kubenswrapper[2583]: I0709 03:05:20.057591 2583 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/f4cd554b-ed76-46a8-a599-0ed075e3c3dd-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "f4cd554b-ed76-46a8-a599-0ed075e3c3dd" (UID: "f4cd554b-ed76-46a8-a599-0ed075e3c3dd"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 09 03:05:20.057897 ip-10-0-138-136 kubenswrapper[2583]: I0709 03:05:20.057877 2583 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/f4cd554b-ed76-46a8-a599-0ed075e3c3dd-kube-api-access-lq259" (OuterVolumeSpecName: "kube-api-access-lq259") pod "f4cd554b-ed76-46a8-a599-0ed075e3c3dd" (UID: "f4cd554b-ed76-46a8-a599-0ed075e3c3dd"). InnerVolumeSpecName "kube-api-access-lq259". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 09 03:05:20.057959 ip-10-0-138-136 kubenswrapper[2583]: I0709 03:05:20.057898 2583 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/f4cd554b-ed76-46a8-a599-0ed075e3c3dd-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "f4cd554b-ed76-46a8-a599-0ed075e3c3dd" (UID: "f4cd554b-ed76-46a8-a599-0ed075e3c3dd"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue "" Jul 09 03:05:20.156695 ip-10-0-138-136 kubenswrapper[2583]: I0709 03:05:20.156664 2583 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/f4cd554b-ed76-46a8-a599-0ed075e3c3dd-istio-envoy\") on node \"ip-10-0-138-136.ec2.internal\" DevicePath \"\"" Jul 09 03:05:20.156695 ip-10-0-138-136 kubenswrapper[2583]: I0709 03:05:20.156690 2583 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/f4cd554b-ed76-46a8-a599-0ed075e3c3dd-istio-token\") on node \"ip-10-0-138-136.ec2.internal\" DevicePath \"\"" Jul 09 03:05:20.156873 ip-10-0-138-136 kubenswrapper[2583]: I0709 03:05:20.156703 2583 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/f4cd554b-ed76-46a8-a599-0ed075e3c3dd-istio-podinfo\") on node \"ip-10-0-138-136.ec2.internal\" DevicePath \"\"" Jul 09 03:05:20.156873 ip-10-0-138-136 kubenswrapper[2583]: I0709 03:05:20.156729 2583 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-lq259\" (UniqueName: \"kubernetes.io/projected/f4cd554b-ed76-46a8-a599-0ed075e3c3dd-kube-api-access-lq259\") on node \"ip-10-0-138-136.ec2.internal\" DevicePath \"\"" Jul 09 03:05:20.245199 ip-10-0-138-136 kubenswrapper[2583]: I0709 03:05:20.245171 2583 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-ait-44d03cda-openshift-default-84dcb45449-w8x4n"] Jul 09 03:05:20.249152 ip-10-0-138-136 kubenswrapper[2583]: I0709 03:05:20.249130 2583 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-ait-44d03cda-openshift-default-84dcb45449-w8x4n"] Jul 09 03:05:20.606990 ip-10-0-138-136 kubenswrapper[2583]: I0709 03:05:20.606961 2583 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="f4cd554b-ed76-46a8-a599-0ed075e3c3dd" path="/var/lib/kubelet/pods/f4cd554b-ed76-46a8-a599-0ed075e3c3dd/volumes" Jul 09 03:05:20.634417 ip-10-0-138-136 kubenswrapper[2583]: I0709 03:05:20.634301 2583 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-ait-3c64f6ee-openshift-default-6f6bc5bf87-dldzh"] Jul 09 03:05:20.634907 ip-10-0-138-136 kubenswrapper[2583]: I0709 03:05:20.634887 2583 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="f4cd554b-ed76-46a8-a599-0ed075e3c3dd" containerName="istio-proxy" Jul 09 03:05:20.635074 ip-10-0-138-136 kubenswrapper[2583]: I0709 03:05:20.635061 2583 state_mem.go:107] "Deleted CPUSet assignment" podUID="f4cd554b-ed76-46a8-a599-0ed075e3c3dd" containerName="istio-proxy" Jul 09 03:05:20.635309 ip-10-0-138-136 kubenswrapper[2583]: I0709 03:05:20.635297 2583 memory_manager.go:368] "RemoveStaleState removing state" podUID="f4cd554b-ed76-46a8-a599-0ed075e3c3dd" containerName="istio-proxy" Jul 09 03:05:20.640235 ip-10-0-138-136 kubenswrapper[2583]: I0709 03:05:20.640215 2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ait-3c64f6ee-openshift-default-6f6bc5bf87-dldzh" Jul 09 03:05:20.642723 ip-10-0-138-136 kubenswrapper[2583]: I0709 03:05:20.642691 2583 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-ait-3c64f6ee-openshift-default-dockercfg-5rq6k\"" Jul 09 03:05:20.650359 ip-10-0-138-136 kubenswrapper[2583]: I0709 03:05:20.650338 2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-ait-3c64f6ee-openshift-default-6f6bc5bf87-dldzh"] Jul 09 03:05:20.762325 ip-10-0-138-136 kubenswrapper[2583]: I0709 03:05:20.762299 2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-zbrxk\" (UniqueName: \"kubernetes.io/projected/1b51ff79-7125-4d60-9cfe-5cb1e1a88a3e-kube-api-access-zbrxk\") pod \"e2e-ait-3c64f6ee-openshift-default-6f6bc5bf87-dldzh\" (UID: \"1b51ff79-7125-4d60-9cfe-5cb1e1a88a3e\") " pod="openshift-ingress/e2e-ait-3c64f6ee-openshift-default-6f6bc5bf87-dldzh" Jul 09 03:05:20.762472 ip-10-0-138-136 kubenswrapper[2583]: I0709 03:05:20.762337 2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/1b51ff79-7125-4d60-9cfe-5cb1e1a88a3e-credential-socket\") pod \"e2e-ait-3c64f6ee-openshift-default-6f6bc5bf87-dldzh\" (UID: \"1b51ff79-7125-4d60-9cfe-5cb1e1a88a3e\") " pod="openshift-ingress/e2e-ait-3c64f6ee-openshift-default-6f6bc5bf87-dldzh" Jul 09 03:05:20.762472 ip-10-0-138-136 kubenswrapper[2583]: I0709 03:05:20.762367 2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/1b51ff79-7125-4d60-9cfe-5cb1e1a88a3e-istio-data\") pod \"e2e-ait-3c64f6ee-openshift-default-6f6bc5bf87-dldzh\" (UID: \"1b51ff79-7125-4d60-9cfe-5cb1e1a88a3e\") " pod="openshift-ingress/e2e-ait-3c64f6ee-openshift-default-6f6bc5bf87-dldzh" Jul 09 03:05:20.762472 ip-10-0-138-136 kubenswrapper[2583]: I0709 03:05:20.762443 2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/1b51ff79-7125-4d60-9cfe-5cb1e1a88a3e-workload-socket\") pod \"e2e-ait-3c64f6ee-openshift-default-6f6bc5bf87-dldzh\" (UID: \"1b51ff79-7125-4d60-9cfe-5cb1e1a88a3e\") " pod="openshift-ingress/e2e-ait-3c64f6ee-openshift-default-6f6bc5bf87-dldzh" Jul 09 03:05:20.762611 ip-10-0-138-136 kubenswrapper[2583]: I0709 03:05:20.762479 2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/1b51ff79-7125-4d60-9cfe-5cb1e1a88a3e-istio-token\") pod \"e2e-ait-3c64f6ee-openshift-default-6f6bc5bf87-dldzh\" (UID: \"1b51ff79-7125-4d60-9cfe-5cb1e1a88a3e\") " pod="openshift-ingress/e2e-ait-3c64f6ee-openshift-default-6f6bc5bf87-dldzh" Jul 09 03:05:20.762611 ip-10-0-138-136 kubenswrapper[2583]: I0709 03:05:20.762501 2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/1b51ff79-7125-4d60-9cfe-5cb1e1a88a3e-istio-envoy\") pod \"e2e-ait-3c64f6ee-openshift-default-6f6bc5bf87-dldzh\" (UID: \"1b51ff79-7125-4d60-9cfe-5cb1e1a88a3e\") " pod="openshift-ingress/e2e-ait-3c64f6ee-openshift-default-6f6bc5bf87-dldzh" Jul 09 03:05:20.762611 ip-10-0-138-136 kubenswrapper[2583]: I0709 03:05:20.762518 2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/1b51ff79-7125-4d60-9cfe-5cb1e1a88a3e-istiod-ca-cert\") pod \"e2e-ait-3c64f6ee-openshift-default-6f6bc5bf87-dldzh\" (UID: \"1b51ff79-7125-4d60-9cfe-5cb1e1a88a3e\") " pod="openshift-ingress/e2e-ait-3c64f6ee-openshift-default-6f6bc5bf87-dldzh" Jul 09 03:05:20.762611 ip-10-0-138-136 kubenswrapper[2583]: I0709 03:05:20.762569 2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/1b51ff79-7125-4d60-9cfe-5cb1e1a88a3e-workload-certs\") pod \"e2e-ait-3c64f6ee-openshift-default-6f6bc5bf87-dldzh\" (UID: \"1b51ff79-7125-4d60-9cfe-5cb1e1a88a3e\") " pod="openshift-ingress/e2e-ait-3c64f6ee-openshift-default-6f6bc5bf87-dldzh" Jul 09 03:05:20.762611 ip-10-0-138-136 kubenswrapper[2583]: I0709 03:05:20.762603 2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/1b51ff79-7125-4d60-9cfe-5cb1e1a88a3e-istio-podinfo\") pod \"e2e-ait-3c64f6ee-openshift-default-6f6bc5bf87-dldzh\" (UID: \"1b51ff79-7125-4d60-9cfe-5cb1e1a88a3e\") " pod="openshift-ingress/e2e-ait-3c64f6ee-openshift-default-6f6bc5bf87-dldzh" Jul 09 03:05:20.863155 ip-10-0-138-136 kubenswrapper[2583]: I0709 03:05:20.863094 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/1b51ff79-7125-4d60-9cfe-5cb1e1a88a3e-istio-token\") pod \"e2e-ait-3c64f6ee-openshift-default-6f6bc5bf87-dldzh\" (UID: \"1b51ff79-7125-4d60-9cfe-5cb1e1a88a3e\") " pod="openshift-ingress/e2e-ait-3c64f6ee-openshift-default-6f6bc5bf87-dldzh" Jul 09 03:05:20.863155 ip-10-0-138-136 kubenswrapper[2583]: I0709 03:05:20.863129 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/1b51ff79-7125-4d60-9cfe-5cb1e1a88a3e-istio-envoy\") pod \"e2e-ait-3c64f6ee-openshift-default-6f6bc5bf87-dldzh\" (UID: \"1b51ff79-7125-4d60-9cfe-5cb1e1a88a3e\") " pod="openshift-ingress/e2e-ait-3c64f6ee-openshift-default-6f6bc5bf87-dldzh" Jul 09 03:05:20.863155 ip-10-0-138-136 kubenswrapper[2583]: I0709 03:05:20.863146 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/1b51ff79-7125-4d60-9cfe-5cb1e1a88a3e-istiod-ca-cert\") pod \"e2e-ait-3c64f6ee-openshift-default-6f6bc5bf87-dldzh\" (UID: \"1b51ff79-7125-4d60-9cfe-5cb1e1a88a3e\") " pod="openshift-ingress/e2e-ait-3c64f6ee-openshift-default-6f6bc5bf87-dldzh" Jul 09 03:05:20.863384 ip-10-0-138-136 kubenswrapper[2583]: I0709 03:05:20.863164 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/1b51ff79-7125-4d60-9cfe-5cb1e1a88a3e-workload-certs\") pod \"e2e-ait-3c64f6ee-openshift-default-6f6bc5bf87-dldzh\" (UID: \"1b51ff79-7125-4d60-9cfe-5cb1e1a88a3e\") " pod="openshift-ingress/e2e-ait-3c64f6ee-openshift-default-6f6bc5bf87-dldzh" Jul 09 03:05:20.863384 ip-10-0-138-136 kubenswrapper[2583]: I0709 03:05:20.863194 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/1b51ff79-7125-4d60-9cfe-5cb1e1a88a3e-istio-podinfo\") pod \"e2e-ait-3c64f6ee-openshift-default-6f6bc5bf87-dldzh\" (UID: \"1b51ff79-7125-4d60-9cfe-5cb1e1a88a3e\") " pod="openshift-ingress/e2e-ait-3c64f6ee-openshift-default-6f6bc5bf87-dldzh" Jul 09 03:05:20.863384 ip-10-0-138-136 kubenswrapper[2583]: I0709 03:05:20.863236 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-zbrxk\" (UniqueName: \"kubernetes.io/projected/1b51ff79-7125-4d60-9cfe-5cb1e1a88a3e-kube-api-access-zbrxk\") pod \"e2e-ait-3c64f6ee-openshift-default-6f6bc5bf87-dldzh\" (UID: \"1b51ff79-7125-4d60-9cfe-5cb1e1a88a3e\") " pod="openshift-ingress/e2e-ait-3c64f6ee-openshift-default-6f6bc5bf87-dldzh" Jul 09 03:05:20.863384 ip-10-0-138-136 kubenswrapper[2583]: I0709 03:05:20.863271 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/1b51ff79-7125-4d60-9cfe-5cb1e1a88a3e-credential-socket\") pod \"e2e-ait-3c64f6ee-openshift-default-6f6bc5bf87-dldzh\" (UID: \"1b51ff79-7125-4d60-9cfe-5cb1e1a88a3e\") " pod="openshift-ingress/e2e-ait-3c64f6ee-openshift-default-6f6bc5bf87-dldzh" Jul 09 03:05:20.863384 ip-10-0-138-136 kubenswrapper[2583]: I0709 03:05:20.863315 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/1b51ff79-7125-4d60-9cfe-5cb1e1a88a3e-istio-data\") pod \"e2e-ait-3c64f6ee-openshift-default-6f6bc5bf87-dldzh\" (UID: \"1b51ff79-7125-4d60-9cfe-5cb1e1a88a3e\") " pod="openshift-ingress/e2e-ait-3c64f6ee-openshift-default-6f6bc5bf87-dldzh" Jul 09 03:05:20.863384 ip-10-0-138-136 kubenswrapper[2583]: I0709 03:05:20.863372 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/1b51ff79-7125-4d60-9cfe-5cb1e1a88a3e-workload-socket\") pod \"e2e-ait-3c64f6ee-openshift-default-6f6bc5bf87-dldzh\" (UID: \"1b51ff79-7125-4d60-9cfe-5cb1e1a88a3e\") " pod="openshift-ingress/e2e-ait-3c64f6ee-openshift-default-6f6bc5bf87-dldzh" Jul 09 03:05:20.863744 ip-10-0-138-136 kubenswrapper[2583]: I0709 03:05:20.863653 2583 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/1b51ff79-7125-4d60-9cfe-5cb1e1a88a3e-workload-certs\") pod \"e2e-ait-3c64f6ee-openshift-default-6f6bc5bf87-dldzh\" (UID: \"1b51ff79-7125-4d60-9cfe-5cb1e1a88a3e\") " pod="openshift-ingress/e2e-ait-3c64f6ee-openshift-default-6f6bc5bf87-dldzh" Jul 09 03:05:20.863744 ip-10-0-138-136 kubenswrapper[2583]: I0709 03:05:20.863704 2583 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/1b51ff79-7125-4d60-9cfe-5cb1e1a88a3e-credential-socket\") pod \"e2e-ait-3c64f6ee-openshift-default-6f6bc5bf87-dldzh\" (UID: \"1b51ff79-7125-4d60-9cfe-5cb1e1a88a3e\") " pod="openshift-ingress/e2e-ait-3c64f6ee-openshift-default-6f6bc5bf87-dldzh" Jul 09 03:05:20.863828 ip-10-0-138-136 kubenswrapper[2583]: I0709 03:05:20.863769 2583 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/1b51ff79-7125-4d60-9cfe-5cb1e1a88a3e-workload-socket\") pod \"e2e-ait-3c64f6ee-openshift-default-6f6bc5bf87-dldzh\" (UID: \"1b51ff79-7125-4d60-9cfe-5cb1e1a88a3e\") " pod="openshift-ingress/e2e-ait-3c64f6ee-openshift-default-6f6bc5bf87-dldzh" Jul 09 03:05:20.863861 ip-10-0-138-136 kubenswrapper[2583]: I0709 03:05:20.863817 2583 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/1b51ff79-7125-4d60-9cfe-5cb1e1a88a3e-istio-data\") pod \"e2e-ait-3c64f6ee-openshift-default-6f6bc5bf87-dldzh\" (UID: \"1b51ff79-7125-4d60-9cfe-5cb1e1a88a3e\") " pod="openshift-ingress/e2e-ait-3c64f6ee-openshift-default-6f6bc5bf87-dldzh" Jul 09 03:05:20.863984 ip-10-0-138-136 kubenswrapper[2583]: I0709 03:05:20.863962 2583 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/1b51ff79-7125-4d60-9cfe-5cb1e1a88a3e-istiod-ca-cert\") pod \"e2e-ait-3c64f6ee-openshift-default-6f6bc5bf87-dldzh\" (UID: \"1b51ff79-7125-4d60-9cfe-5cb1e1a88a3e\") " pod="openshift-ingress/e2e-ait-3c64f6ee-openshift-default-6f6bc5bf87-dldzh" Jul 09 03:05:20.865742 ip-10-0-138-136 kubenswrapper[2583]: I0709 03:05:20.865693 2583 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/1b51ff79-7125-4d60-9cfe-5cb1e1a88a3e-istio-envoy\") pod \"e2e-ait-3c64f6ee-openshift-default-6f6bc5bf87-dldzh\" (UID: \"1b51ff79-7125-4d60-9cfe-5cb1e1a88a3e\") " pod="openshift-ingress/e2e-ait-3c64f6ee-openshift-default-6f6bc5bf87-dldzh" Jul 09 03:05:20.865896 ip-10-0-138-136 kubenswrapper[2583]: I0709 03:05:20.865880 2583 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/1b51ff79-7125-4d60-9cfe-5cb1e1a88a3e-istio-podinfo\") pod \"e2e-ait-3c64f6ee-openshift-default-6f6bc5bf87-dldzh\" (UID: \"1b51ff79-7125-4d60-9cfe-5cb1e1a88a3e\") " pod="openshift-ingress/e2e-ait-3c64f6ee-openshift-default-6f6bc5bf87-dldzh" Jul 09 03:05:20.870113 ip-10-0-138-136 kubenswrapper[2583]: I0709 03:05:20.870093 2583 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/1b51ff79-7125-4d60-9cfe-5cb1e1a88a3e-istio-token\") pod \"e2e-ait-3c64f6ee-openshift-default-6f6bc5bf87-dldzh\" (UID: \"1b51ff79-7125-4d60-9cfe-5cb1e1a88a3e\") " pod="openshift-ingress/e2e-ait-3c64f6ee-openshift-default-6f6bc5bf87-dldzh" Jul 09 03:05:20.870398 ip-10-0-138-136 kubenswrapper[2583]: I0709 03:05:20.870381 2583 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-zbrxk\" (UniqueName: \"kubernetes.io/projected/1b51ff79-7125-4d60-9cfe-5cb1e1a88a3e-kube-api-access-zbrxk\") pod \"e2e-ait-3c64f6ee-openshift-default-6f6bc5bf87-dldzh\" (UID: \"1b51ff79-7125-4d60-9cfe-5cb1e1a88a3e\") " pod="openshift-ingress/e2e-ait-3c64f6ee-openshift-default-6f6bc5bf87-dldzh" Jul 09 03:05:20.951996 ip-10-0-138-136 kubenswrapper[2583]: I0709 03:05:20.951974 2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ait-3c64f6ee-openshift-default-6f6bc5bf87-dldzh" Jul 09 03:05:21.086664 ip-10-0-138-136 kubenswrapper[2583]: I0709 03:05:21.086639 2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-ait-3c64f6ee-openshift-default-6f6bc5bf87-dldzh"] Jul 09 03:05:21.089053 ip-10-0-138-136 kubenswrapper[2583]: W0709 03:05:21.089027 2583 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod1b51ff79_7125_4d60_9cfe_5cb1e1a88a3e.slice/crio-44bf3cf6e5ae0c0dae0cd492d47a099228bd9ff97434635cf03aca96ac6f79c8 WatchSource:0}: Error finding container 44bf3cf6e5ae0c0dae0cd492d47a099228bd9ff97434635cf03aca96ac6f79c8: Status 404 returned error can't find the container with id 44bf3cf6e5ae0c0dae0cd492d47a099228bd9ff97434635cf03aca96ac6f79c8 Jul 09 03:05:21.091647 ip-10-0-138-136 kubenswrapper[2583]: I0709 03:05:21.091607 2583 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236232Ki","pods":"250"} Jul 09 03:05:21.091754 ip-10-0-138-136 kubenswrapper[2583]: I0709 03:05:21.091703 2583 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236232Ki","pods":"250"} Jul 09 03:05:21.091801 ip-10-0-138-136 kubenswrapper[2583]: I0709 03:05:21.091770 2583 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236232Ki","pods":"250"} Jul 09 03:05:21.937961 ip-10-0-138-136 kubenswrapper[2583]: I0709 03:05:21.937919 2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ait-3c64f6ee-openshift-default-6f6bc5bf87-dldzh" event={"ID":"1b51ff79-7125-4d60-9cfe-5cb1e1a88a3e","Type":"ContainerStarted","Data":"3ad066df35823055859b56b5609da57fd75a61471444b16861a12b186aa75ce7"} Jul 09 03:05:21.938141 ip-10-0-138-136 kubenswrapper[2583]: I0709 03:05:21.937985 2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ait-3c64f6ee-openshift-default-6f6bc5bf87-dldzh" event={"ID":"1b51ff79-7125-4d60-9cfe-5cb1e1a88a3e","Type":"ContainerStarted","Data":"44bf3cf6e5ae0c0dae0cd492d47a099228bd9ff97434635cf03aca96ac6f79c8"} Jul 09 03:05:21.952394 ip-10-0-138-136 kubenswrapper[2583]: I0709 03:05:21.952368 2583 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-ait-3c64f6ee-openshift-default-6f6bc5bf87-dldzh" Jul 09 03:05:21.959471 ip-10-0-138-136 kubenswrapper[2583]: I0709 03:05:21.959426 2583 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-ait-3c64f6ee-openshift-default-6f6bc5bf87-dldzh" podStartSLOduration=1.959412087 podStartE2EDuration="1.959412087s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-09 03:05:20 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-09 03:05:21.957591506 +0000 UTC m=+1867.890048992" watchObservedRunningTime="2026-07-09 03:05:21.959412087 +0000 UTC m=+1867.891869631" Jul 09 03:05:22.957206 ip-10-0-138-136 kubenswrapper[2583]: I0709 03:05:22.957156 2583 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-ait-3c64f6ee-openshift-default-6f6bc5bf87-dldzh" Jul 09 03:05:23.947765 ip-10-0-138-136 kubenswrapper[2583]: I0709 03:05:23.947736 2583 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-ait-3c64f6ee-openshift-default-6f6bc5bf87-dldzh" Jul 09 03:05:23.948645 ip-10-0-138-136 kubenswrapper[2583]: I0709 03:05:23.948626 2583 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-ait-3c64f6ee-openshift-default-6f6bc5bf87-dldzh" Jul 09 03:05:27.839869 ip-10-0-138-136 kubenswrapper[2583]: I0709 03:05:27.839831 2583 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-ait-3c64f6ee-openshift-default-6f6bc5bf87-dldzh"] Jul 09 03:05:27.840294 ip-10-0-138-136 kubenswrapper[2583]: I0709 03:05:27.840076 2583 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-ingress/e2e-ait-3c64f6ee-openshift-default-6f6bc5bf87-dldzh" podUID="1b51ff79-7125-4d60-9cfe-5cb1e1a88a3e" containerName="istio-proxy" containerID="cri-o://3ad066df35823055859b56b5609da57fd75a61471444b16861a12b186aa75ce7" gracePeriod=30 Jul 09 03:05:32.996219 ip-10-0-138-136 kubenswrapper[2583]: I0709 03:05:32.996179 2583 generic.go:356] "Generic (PLEG): container finished" podID="1b51ff79-7125-4d60-9cfe-5cb1e1a88a3e" containerID="3ad066df35823055859b56b5609da57fd75a61471444b16861a12b186aa75ce7" exitCode=0 Jul 09 03:05:32.996541 ip-10-0-138-136 kubenswrapper[2583]: I0709 03:05:32.996249 2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ait-3c64f6ee-openshift-default-6f6bc5bf87-dldzh" event={"ID":"1b51ff79-7125-4d60-9cfe-5cb1e1a88a3e","Type":"ContainerDied","Data":"3ad066df35823055859b56b5609da57fd75a61471444b16861a12b186aa75ce7"} Jul 09 03:05:33.095854 ip-10-0-138-136 kubenswrapper[2583]: I0709 03:05:33.095831 2583 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ait-3c64f6ee-openshift-default-6f6bc5bf87-dldzh" Jul 09 03:05:33.166500 ip-10-0-138-136 kubenswrapper[2583]: I0709 03:05:33.166433 2583 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/1b51ff79-7125-4d60-9cfe-5cb1e1a88a3e-istio-envoy\") pod \"1b51ff79-7125-4d60-9cfe-5cb1e1a88a3e\" (UID: \"1b51ff79-7125-4d60-9cfe-5cb1e1a88a3e\") " Jul 09 03:05:33.166500 ip-10-0-138-136 kubenswrapper[2583]: I0709 03:05:33.166477 2583 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/1b51ff79-7125-4d60-9cfe-5cb1e1a88a3e-workload-socket\") pod \"1b51ff79-7125-4d60-9cfe-5cb1e1a88a3e\" (UID: \"1b51ff79-7125-4d60-9cfe-5cb1e1a88a3e\") " Jul 09 03:05:33.166500 ip-10-0-138-136 kubenswrapper[2583]: I0709 03:05:33.166499 2583 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/1b51ff79-7125-4d60-9cfe-5cb1e1a88a3e-credential-socket\") pod \"1b51ff79-7125-4d60-9cfe-5cb1e1a88a3e\" (UID: \"1b51ff79-7125-4d60-9cfe-5cb1e1a88a3e\") " Jul 09 03:05:33.166788 ip-10-0-138-136 kubenswrapper[2583]: I0709 03:05:33.166543 2583 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/1b51ff79-7125-4d60-9cfe-5cb1e1a88a3e-istiod-ca-cert\") pod \"1b51ff79-7125-4d60-9cfe-5cb1e1a88a3e\" (UID: \"1b51ff79-7125-4d60-9cfe-5cb1e1a88a3e\") " Jul 09 03:05:33.166788 ip-10-0-138-136 kubenswrapper[2583]: I0709 03:05:33.166569 2583 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/1b51ff79-7125-4d60-9cfe-5cb1e1a88a3e-istio-podinfo\") pod \"1b51ff79-7125-4d60-9cfe-5cb1e1a88a3e\" (UID: \"1b51ff79-7125-4d60-9cfe-5cb1e1a88a3e\") " Jul 09 03:05:33.166788 ip-10-0-138-136 kubenswrapper[2583]: I0709 03:05:33.166595 2583 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/1b51ff79-7125-4d60-9cfe-5cb1e1a88a3e-istio-data\") pod \"1b51ff79-7125-4d60-9cfe-5cb1e1a88a3e\" (UID: \"1b51ff79-7125-4d60-9cfe-5cb1e1a88a3e\") " Jul 09 03:05:33.166788 ip-10-0-138-136 kubenswrapper[2583]: I0709 03:05:33.166737 2583 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/1b51ff79-7125-4d60-9cfe-5cb1e1a88a3e-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "1b51ff79-7125-4d60-9cfe-5cb1e1a88a3e" (UID: "1b51ff79-7125-4d60-9cfe-5cb1e1a88a3e"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 09 03:05:33.167001 ip-10-0-138-136 kubenswrapper[2583]: I0709 03:05:33.166865 2583 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/1b51ff79-7125-4d60-9cfe-5cb1e1a88a3e-istio-token\") pod \"1b51ff79-7125-4d60-9cfe-5cb1e1a88a3e\" (UID: \"1b51ff79-7125-4d60-9cfe-5cb1e1a88a3e\") " Jul 09 03:05:33.167001 ip-10-0-138-136 kubenswrapper[2583]: I0709 03:05:33.166872 2583 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/1b51ff79-7125-4d60-9cfe-5cb1e1a88a3e-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "1b51ff79-7125-4d60-9cfe-5cb1e1a88a3e" (UID: "1b51ff79-7125-4d60-9cfe-5cb1e1a88a3e"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 09 03:05:33.167001 ip-10-0-138-136 kubenswrapper[2583]: I0709 03:05:33.166883 2583 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/1b51ff79-7125-4d60-9cfe-5cb1e1a88a3e-istio-data" (OuterVolumeSpecName: "istio-data") pod "1b51ff79-7125-4d60-9cfe-5cb1e1a88a3e" (UID: "1b51ff79-7125-4d60-9cfe-5cb1e1a88a3e"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 09 03:05:33.167001 ip-10-0-138-136 kubenswrapper[2583]: I0709 03:05:33.166924 2583 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-zbrxk\" (UniqueName: \"kubernetes.io/projected/1b51ff79-7125-4d60-9cfe-5cb1e1a88a3e-kube-api-access-zbrxk\") pod \"1b51ff79-7125-4d60-9cfe-5cb1e1a88a3e\" (UID: \"1b51ff79-7125-4d60-9cfe-5cb1e1a88a3e\") " Jul 09 03:05:33.167001 ip-10-0-138-136 kubenswrapper[2583]: I0709 03:05:33.166943 2583 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/1b51ff79-7125-4d60-9cfe-5cb1e1a88a3e-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "1b51ff79-7125-4d60-9cfe-5cb1e1a88a3e" (UID: "1b51ff79-7125-4d60-9cfe-5cb1e1a88a3e"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 09 03:05:33.167001 ip-10-0-138-136 kubenswrapper[2583]: I0709 03:05:33.166966 2583 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/1b51ff79-7125-4d60-9cfe-5cb1e1a88a3e-workload-certs\") pod \"1b51ff79-7125-4d60-9cfe-5cb1e1a88a3e\" (UID: \"1b51ff79-7125-4d60-9cfe-5cb1e1a88a3e\") " Jul 09 03:05:33.167324 ip-10-0-138-136 kubenswrapper[2583]: I0709 03:05:33.167208 2583 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/1b51ff79-7125-4d60-9cfe-5cb1e1a88a3e-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "1b51ff79-7125-4d60-9cfe-5cb1e1a88a3e" (UID: "1b51ff79-7125-4d60-9cfe-5cb1e1a88a3e"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 09 03:05:33.167380 ip-10-0-138-136 kubenswrapper[2583]: I0709 03:05:33.167342 2583 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/1b51ff79-7125-4d60-9cfe-5cb1e1a88a3e-workload-certs\") on node \"ip-10-0-138-136.ec2.internal\" DevicePath \"\"" Jul 09 03:05:33.167380 ip-10-0-138-136 kubenswrapper[2583]: I0709 03:05:33.167362 2583 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/1b51ff79-7125-4d60-9cfe-5cb1e1a88a3e-workload-socket\") on node \"ip-10-0-138-136.ec2.internal\" DevicePath \"\"" Jul 09 03:05:33.167380 ip-10-0-138-136 kubenswrapper[2583]: I0709 03:05:33.167377 2583 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/1b51ff79-7125-4d60-9cfe-5cb1e1a88a3e-credential-socket\") on node \"ip-10-0-138-136.ec2.internal\" DevicePath \"\"" Jul 09 03:05:33.167529 ip-10-0-138-136 kubenswrapper[2583]: I0709 03:05:33.167391 2583 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/1b51ff79-7125-4d60-9cfe-5cb1e1a88a3e-istiod-ca-cert\") on node \"ip-10-0-138-136.ec2.internal\" DevicePath \"\"" Jul 09 03:05:33.167529 ip-10-0-138-136 kubenswrapper[2583]: I0709 03:05:33.167405 2583 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/1b51ff79-7125-4d60-9cfe-5cb1e1a88a3e-istio-data\") on node \"ip-10-0-138-136.ec2.internal\" DevicePath \"\"" Jul 09 03:05:33.168965 ip-10-0-138-136 kubenswrapper[2583]: I0709 03:05:33.168934 2583 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/1b51ff79-7125-4d60-9cfe-5cb1e1a88a3e-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "1b51ff79-7125-4d60-9cfe-5cb1e1a88a3e" (UID: "1b51ff79-7125-4d60-9cfe-5cb1e1a88a3e"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 09 03:05:33.169097 ip-10-0-138-136 kubenswrapper[2583]: I0709 03:05:33.168982 2583 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/1b51ff79-7125-4d60-9cfe-5cb1e1a88a3e-kube-api-access-zbrxk" (OuterVolumeSpecName: "kube-api-access-zbrxk") pod "1b51ff79-7125-4d60-9cfe-5cb1e1a88a3e" (UID: "1b51ff79-7125-4d60-9cfe-5cb1e1a88a3e"). InnerVolumeSpecName "kube-api-access-zbrxk". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 09 03:05:33.169149 ip-10-0-138-136 kubenswrapper[2583]: I0709 03:05:33.169133 2583 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/1b51ff79-7125-4d60-9cfe-5cb1e1a88a3e-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "1b51ff79-7125-4d60-9cfe-5cb1e1a88a3e" (UID: "1b51ff79-7125-4d60-9cfe-5cb1e1a88a3e"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue "" Jul 09 03:05:33.169278 ip-10-0-138-136 kubenswrapper[2583]: I0709 03:05:33.169259 2583 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/1b51ff79-7125-4d60-9cfe-5cb1e1a88a3e-istio-token" (OuterVolumeSpecName: "istio-token") pod "1b51ff79-7125-4d60-9cfe-5cb1e1a88a3e" (UID: "1b51ff79-7125-4d60-9cfe-5cb1e1a88a3e"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 09 03:05:33.268460 ip-10-0-138-136 kubenswrapper[2583]: I0709 03:05:33.268436 2583 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/1b51ff79-7125-4d60-9cfe-5cb1e1a88a3e-istio-podinfo\") on node \"ip-10-0-138-136.ec2.internal\" DevicePath \"\"" Jul 09 03:05:33.268460 ip-10-0-138-136 kubenswrapper[2583]: I0709 03:05:33.268458 2583 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/1b51ff79-7125-4d60-9cfe-5cb1e1a88a3e-istio-token\") on node \"ip-10-0-138-136.ec2.internal\" DevicePath \"\"" Jul 09 03:05:33.268607 ip-10-0-138-136 kubenswrapper[2583]: I0709 03:05:33.268468 2583 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-zbrxk\" (UniqueName: \"kubernetes.io/projected/1b51ff79-7125-4d60-9cfe-5cb1e1a88a3e-kube-api-access-zbrxk\") on node \"ip-10-0-138-136.ec2.internal\" DevicePath \"\"" Jul 09 03:05:33.268607 ip-10-0-138-136 kubenswrapper[2583]: I0709 03:05:33.268477 2583 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/1b51ff79-7125-4d60-9cfe-5cb1e1a88a3e-istio-envoy\") on node \"ip-10-0-138-136.ec2.internal\" DevicePath \"\"" Jul 09 03:05:33.697347 ip-10-0-138-136 kubenswrapper[2583]: I0709 03:05:33.697316 2583 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-derive-35ef5376-openshift-default-6b57d96c9f-sl7bq"] Jul 09 03:05:33.697727 ip-10-0-138-136 kubenswrapper[2583]: I0709 03:05:33.697703 2583 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="1b51ff79-7125-4d60-9cfe-5cb1e1a88a3e" containerName="istio-proxy" Jul 09 03:05:33.697727 ip-10-0-138-136 kubenswrapper[2583]: I0709 03:05:33.697728 2583 state_mem.go:107] "Deleted CPUSet assignment" podUID="1b51ff79-7125-4d60-9cfe-5cb1e1a88a3e" containerName="istio-proxy" Jul 09 03:05:33.697854 ip-10-0-138-136 kubenswrapper[2583]: I0709 03:05:33.697805 2583 memory_manager.go:368] "RemoveStaleState removing state" podUID="1b51ff79-7125-4d60-9cfe-5cb1e1a88a3e" containerName="istio-proxy" Jul 09 03:05:33.701163 ip-10-0-138-136 kubenswrapper[2583]: I0709 03:05:33.701142 2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-derive-35ef5376-openshift-default-6b57d96c9f-sl7bq" Jul 09 03:05:33.703340 ip-10-0-138-136 kubenswrapper[2583]: I0709 03:05:33.703318 2583 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-derive-35ef5376-openshift-default-dockercfg-c6vgb\"" Jul 09 03:05:33.712873 ip-10-0-138-136 kubenswrapper[2583]: I0709 03:05:33.712854 2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-derive-35ef5376-openshift-default-6b57d96c9f-sl7bq"] Jul 09 03:05:33.773843 ip-10-0-138-136 kubenswrapper[2583]: I0709 03:05:33.773820 2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/cf301d09-7aa3-45b5-964f-6c236791d7c1-credential-socket\") pod \"e2e-derive-35ef5376-openshift-default-6b57d96c9f-sl7bq\" (UID: \"cf301d09-7aa3-45b5-964f-6c236791d7c1\") " pod="openshift-ingress/e2e-derive-35ef5376-openshift-default-6b57d96c9f-sl7bq" Jul 09 03:05:33.773937 ip-10-0-138-136 kubenswrapper[2583]: I0709 03:05:33.773864 2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/cf301d09-7aa3-45b5-964f-6c236791d7c1-workload-certs\") pod \"e2e-derive-35ef5376-openshift-default-6b57d96c9f-sl7bq\" (UID: \"cf301d09-7aa3-45b5-964f-6c236791d7c1\") " pod="openshift-ingress/e2e-derive-35ef5376-openshift-default-6b57d96c9f-sl7bq" Jul 09 03:05:33.773937 ip-10-0-138-136 kubenswrapper[2583]: I0709 03:05:33.773890 2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/cf301d09-7aa3-45b5-964f-6c236791d7c1-workload-socket\") pod \"e2e-derive-35ef5376-openshift-default-6b57d96c9f-sl7bq\" (UID: \"cf301d09-7aa3-45b5-964f-6c236791d7c1\") " pod="openshift-ingress/e2e-derive-35ef5376-openshift-default-6b57d96c9f-sl7bq" Jul 09 03:05:33.774011 ip-10-0-138-136 kubenswrapper[2583]: I0709 03:05:33.773963 2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/cf301d09-7aa3-45b5-964f-6c236791d7c1-istio-data\") pod \"e2e-derive-35ef5376-openshift-default-6b57d96c9f-sl7bq\" (UID: \"cf301d09-7aa3-45b5-964f-6c236791d7c1\") " pod="openshift-ingress/e2e-derive-35ef5376-openshift-default-6b57d96c9f-sl7bq" Jul 09 03:05:33.774011 ip-10-0-138-136 kubenswrapper[2583]: I0709 03:05:33.773995 2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/cf301d09-7aa3-45b5-964f-6c236791d7c1-istio-token\") pod \"e2e-derive-35ef5376-openshift-default-6b57d96c9f-sl7bq\" (UID: \"cf301d09-7aa3-45b5-964f-6c236791d7c1\") " pod="openshift-ingress/e2e-derive-35ef5376-openshift-default-6b57d96c9f-sl7bq" Jul 09 03:05:33.774075 ip-10-0-138-136 kubenswrapper[2583]: I0709 03:05:33.774037 2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/cf301d09-7aa3-45b5-964f-6c236791d7c1-istiod-ca-cert\") pod \"e2e-derive-35ef5376-openshift-default-6b57d96c9f-sl7bq\" (UID: \"cf301d09-7aa3-45b5-964f-6c236791d7c1\") " pod="openshift-ingress/e2e-derive-35ef5376-openshift-default-6b57d96c9f-sl7bq" Jul 09 03:05:33.774075 ip-10-0-138-136 kubenswrapper[2583]: I0709 03:05:33.774065 2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/cf301d09-7aa3-45b5-964f-6c236791d7c1-istio-envoy\") pod \"e2e-derive-35ef5376-openshift-default-6b57d96c9f-sl7bq\" (UID: \"cf301d09-7aa3-45b5-964f-6c236791d7c1\") " pod="openshift-ingress/e2e-derive-35ef5376-openshift-default-6b57d96c9f-sl7bq" Jul 09 03:05:33.774143 ip-10-0-138-136 kubenswrapper[2583]: I0709 03:05:33.774088 2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/cf301d09-7aa3-45b5-964f-6c236791d7c1-istio-podinfo\") pod \"e2e-derive-35ef5376-openshift-default-6b57d96c9f-sl7bq\" (UID: \"cf301d09-7aa3-45b5-964f-6c236791d7c1\") " pod="openshift-ingress/e2e-derive-35ef5376-openshift-default-6b57d96c9f-sl7bq" Jul 09 03:05:33.774143 ip-10-0-138-136 kubenswrapper[2583]: I0709 03:05:33.774105 2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-crrhr\" (UniqueName: \"kubernetes.io/projected/cf301d09-7aa3-45b5-964f-6c236791d7c1-kube-api-access-crrhr\") pod \"e2e-derive-35ef5376-openshift-default-6b57d96c9f-sl7bq\" (UID: \"cf301d09-7aa3-45b5-964f-6c236791d7c1\") " pod="openshift-ingress/e2e-derive-35ef5376-openshift-default-6b57d96c9f-sl7bq" Jul 09 03:05:33.874607 ip-10-0-138-136 kubenswrapper[2583]: I0709 03:05:33.874581 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/cf301d09-7aa3-45b5-964f-6c236791d7c1-istio-data\") pod \"e2e-derive-35ef5376-openshift-default-6b57d96c9f-sl7bq\" (UID: \"cf301d09-7aa3-45b5-964f-6c236791d7c1\") " pod="openshift-ingress/e2e-derive-35ef5376-openshift-default-6b57d96c9f-sl7bq" Jul 09 03:05:33.874706 ip-10-0-138-136 kubenswrapper[2583]: I0709 03:05:33.874613 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/cf301d09-7aa3-45b5-964f-6c236791d7c1-istio-token\") pod \"e2e-derive-35ef5376-openshift-default-6b57d96c9f-sl7bq\" (UID: \"cf301d09-7aa3-45b5-964f-6c236791d7c1\") " pod="openshift-ingress/e2e-derive-35ef5376-openshift-default-6b57d96c9f-sl7bq" Jul 09 03:05:33.874706 ip-10-0-138-136 kubenswrapper[2583]: I0709 03:05:33.874640 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/cf301d09-7aa3-45b5-964f-6c236791d7c1-istiod-ca-cert\") pod \"e2e-derive-35ef5376-openshift-default-6b57d96c9f-sl7bq\" (UID: \"cf301d09-7aa3-45b5-964f-6c236791d7c1\") " pod="openshift-ingress/e2e-derive-35ef5376-openshift-default-6b57d96c9f-sl7bq" Jul 09 03:05:33.874706 ip-10-0-138-136 kubenswrapper[2583]: I0709 03:05:33.874662 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/cf301d09-7aa3-45b5-964f-6c236791d7c1-istio-envoy\") pod \"e2e-derive-35ef5376-openshift-default-6b57d96c9f-sl7bq\" (UID: \"cf301d09-7aa3-45b5-964f-6c236791d7c1\") " pod="openshift-ingress/e2e-derive-35ef5376-openshift-default-6b57d96c9f-sl7bq" Jul 09 03:05:33.874891 ip-10-0-138-136 kubenswrapper[2583]: I0709 03:05:33.874796 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/cf301d09-7aa3-45b5-964f-6c236791d7c1-istio-podinfo\") pod \"e2e-derive-35ef5376-openshift-default-6b57d96c9f-sl7bq\" (UID: \"cf301d09-7aa3-45b5-964f-6c236791d7c1\") " pod="openshift-ingress/e2e-derive-35ef5376-openshift-default-6b57d96c9f-sl7bq" Jul 09 03:05:33.874891 ip-10-0-138-136 kubenswrapper[2583]: I0709 03:05:33.874836 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-crrhr\" (UniqueName: \"kubernetes.io/projected/cf301d09-7aa3-45b5-964f-6c236791d7c1-kube-api-access-crrhr\") pod \"e2e-derive-35ef5376-openshift-default-6b57d96c9f-sl7bq\" (UID: \"cf301d09-7aa3-45b5-964f-6c236791d7c1\") " pod="openshift-ingress/e2e-derive-35ef5376-openshift-default-6b57d96c9f-sl7bq" Jul 09 03:05:33.874992 ip-10-0-138-136 kubenswrapper[2583]: I0709 03:05:33.874887 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/cf301d09-7aa3-45b5-964f-6c236791d7c1-credential-socket\") pod \"e2e-derive-35ef5376-openshift-default-6b57d96c9f-sl7bq\" (UID: \"cf301d09-7aa3-45b5-964f-6c236791d7c1\") " pod="openshift-ingress/e2e-derive-35ef5376-openshift-default-6b57d96c9f-sl7bq" Jul 09 03:05:33.874992 ip-10-0-138-136 kubenswrapper[2583]: I0709 03:05:33.874954 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/cf301d09-7aa3-45b5-964f-6c236791d7c1-workload-certs\") pod \"e2e-derive-35ef5376-openshift-default-6b57d96c9f-sl7bq\" (UID: \"cf301d09-7aa3-45b5-964f-6c236791d7c1\") " pod="openshift-ingress/e2e-derive-35ef5376-openshift-default-6b57d96c9f-sl7bq" Jul 09 03:05:33.875105 ip-10-0-138-136 kubenswrapper[2583]: I0709 03:05:33.875000 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/cf301d09-7aa3-45b5-964f-6c236791d7c1-workload-socket\") pod \"e2e-derive-35ef5376-openshift-default-6b57d96c9f-sl7bq\" (UID: \"cf301d09-7aa3-45b5-964f-6c236791d7c1\") " pod="openshift-ingress/e2e-derive-35ef5376-openshift-default-6b57d96c9f-sl7bq" Jul 09 03:05:33.875105 ip-10-0-138-136 kubenswrapper[2583]: I0709 03:05:33.875037 2583 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/cf301d09-7aa3-45b5-964f-6c236791d7c1-istio-data\") pod \"e2e-derive-35ef5376-openshift-default-6b57d96c9f-sl7bq\" (UID: \"cf301d09-7aa3-45b5-964f-6c236791d7c1\") " pod="openshift-ingress/e2e-derive-35ef5376-openshift-default-6b57d96c9f-sl7bq" Jul 09 03:05:33.875339 ip-10-0-138-136 kubenswrapper[2583]: I0709 03:05:33.875310 2583 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/cf301d09-7aa3-45b5-964f-6c236791d7c1-credential-socket\") pod \"e2e-derive-35ef5376-openshift-default-6b57d96c9f-sl7bq\" (UID: \"cf301d09-7aa3-45b5-964f-6c236791d7c1\") " pod="openshift-ingress/e2e-derive-35ef5376-openshift-default-6b57d96c9f-sl7bq" Jul 09 03:05:33.875438 ip-10-0-138-136 kubenswrapper[2583]: I0709 03:05:33.875347 2583 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/cf301d09-7aa3-45b5-964f-6c236791d7c1-workload-certs\") pod \"e2e-derive-35ef5376-openshift-default-6b57d96c9f-sl7bq\" (UID: \"cf301d09-7aa3-45b5-964f-6c236791d7c1\") " pod="openshift-ingress/e2e-derive-35ef5376-openshift-default-6b57d96c9f-sl7bq" Jul 09 03:05:33.875438 ip-10-0-138-136 kubenswrapper[2583]: I0709 03:05:33.875408 2583 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/cf301d09-7aa3-45b5-964f-6c236791d7c1-workload-socket\") pod \"e2e-derive-35ef5376-openshift-default-6b57d96c9f-sl7bq\" (UID: \"cf301d09-7aa3-45b5-964f-6c236791d7c1\") " pod="openshift-ingress/e2e-derive-35ef5376-openshift-default-6b57d96c9f-sl7bq" Jul 09 03:05:33.875438 ip-10-0-138-136 kubenswrapper[2583]: I0709 03:05:33.875416 2583 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/cf301d09-7aa3-45b5-964f-6c236791d7c1-istiod-ca-cert\") pod \"e2e-derive-35ef5376-openshift-default-6b57d96c9f-sl7bq\" (UID: \"cf301d09-7aa3-45b5-964f-6c236791d7c1\") " pod="openshift-ingress/e2e-derive-35ef5376-openshift-default-6b57d96c9f-sl7bq" Jul 09 03:05:33.877001 ip-10-0-138-136 kubenswrapper[2583]: I0709 03:05:33.876973 2583 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/cf301d09-7aa3-45b5-964f-6c236791d7c1-istio-envoy\") pod \"e2e-derive-35ef5376-openshift-default-6b57d96c9f-sl7bq\" (UID: \"cf301d09-7aa3-45b5-964f-6c236791d7c1\") " pod="openshift-ingress/e2e-derive-35ef5376-openshift-default-6b57d96c9f-sl7bq" Jul 09 03:05:33.877187 ip-10-0-138-136 kubenswrapper[2583]: I0709 03:05:33.877169 2583 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/cf301d09-7aa3-45b5-964f-6c236791d7c1-istio-podinfo\") pod \"e2e-derive-35ef5376-openshift-default-6b57d96c9f-sl7bq\" (UID: \"cf301d09-7aa3-45b5-964f-6c236791d7c1\") " pod="openshift-ingress/e2e-derive-35ef5376-openshift-default-6b57d96c9f-sl7bq" Jul 09 03:05:33.882580 ip-10-0-138-136 kubenswrapper[2583]: I0709 03:05:33.882552 2583 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-crrhr\" (UniqueName: \"kubernetes.io/projected/cf301d09-7aa3-45b5-964f-6c236791d7c1-kube-api-access-crrhr\") pod \"e2e-derive-35ef5376-openshift-default-6b57d96c9f-sl7bq\" (UID: \"cf301d09-7aa3-45b5-964f-6c236791d7c1\") " pod="openshift-ingress/e2e-derive-35ef5376-openshift-default-6b57d96c9f-sl7bq" Jul 09 03:05:33.882663 ip-10-0-138-136 kubenswrapper[2583]: I0709 03:05:33.882647 2583 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/cf301d09-7aa3-45b5-964f-6c236791d7c1-istio-token\") pod \"e2e-derive-35ef5376-openshift-default-6b57d96c9f-sl7bq\" (UID: \"cf301d09-7aa3-45b5-964f-6c236791d7c1\") " pod="openshift-ingress/e2e-derive-35ef5376-openshift-default-6b57d96c9f-sl7bq" Jul 09 03:05:34.002024 ip-10-0-138-136 kubenswrapper[2583]: I0709 03:05:34.002002 2583 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ait-3c64f6ee-openshift-default-6f6bc5bf87-dldzh" Jul 09 03:05:34.002376 ip-10-0-138-136 kubenswrapper[2583]: I0709 03:05:34.002038 2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ait-3c64f6ee-openshift-default-6f6bc5bf87-dldzh" event={"ID":"1b51ff79-7125-4d60-9cfe-5cb1e1a88a3e","Type":"ContainerDied","Data":"44bf3cf6e5ae0c0dae0cd492d47a099228bd9ff97434635cf03aca96ac6f79c8"} Jul 09 03:05:34.002376 ip-10-0-138-136 kubenswrapper[2583]: I0709 03:05:34.002095 2583 scope.go:117] "RemoveContainer" containerID="3ad066df35823055859b56b5609da57fd75a61471444b16861a12b186aa75ce7" Jul 09 03:05:34.013808 ip-10-0-138-136 kubenswrapper[2583]: I0709 03:05:34.013793 2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-derive-35ef5376-openshift-default-6b57d96c9f-sl7bq" Jul 09 03:05:34.028829 ip-10-0-138-136 kubenswrapper[2583]: I0709 03:05:34.028795 2583 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-ait-3c64f6ee-openshift-default-6f6bc5bf87-dldzh"] Jul 09 03:05:34.032024 ip-10-0-138-136 kubenswrapper[2583]: I0709 03:05:34.031990 2583 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-ait-3c64f6ee-openshift-default-6f6bc5bf87-dldzh"] Jul 09 03:05:34.150070 ip-10-0-138-136 kubenswrapper[2583]: I0709 03:05:34.150040 2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-derive-35ef5376-openshift-default-6b57d96c9f-sl7bq"] Jul 09 03:05:34.151364 ip-10-0-138-136 kubenswrapper[2583]: W0709 03:05:34.151338 2583 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podcf301d09_7aa3_45b5_964f_6c236791d7c1.slice/crio-bf032178138b7d3e41ea0458d3166ed49f6e55ec10c3b23d8d07a5b7b619f7c3 WatchSource:0}: Error finding container bf032178138b7d3e41ea0458d3166ed49f6e55ec10c3b23d8d07a5b7b619f7c3: Status 404 returned error can't find the container with id bf032178138b7d3e41ea0458d3166ed49f6e55ec10c3b23d8d07a5b7b619f7c3 Jul 09 03:05:34.156395 ip-10-0-138-136 kubenswrapper[2583]: I0709 03:05:34.156361 2583 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236232Ki","pods":"250"} Jul 09 03:05:34.156487 ip-10-0-138-136 kubenswrapper[2583]: I0709 03:05:34.156428 2583 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236232Ki","pods":"250"} Jul 09 03:05:34.156487 ip-10-0-138-136 kubenswrapper[2583]: I0709 03:05:34.156462 2583 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236232Ki","pods":"250"} Jul 09 03:05:34.611308 ip-10-0-138-136 kubenswrapper[2583]: I0709 03:05:34.611264 2583 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="1b51ff79-7125-4d60-9cfe-5cb1e1a88a3e" path="/var/lib/kubelet/pods/1b51ff79-7125-4d60-9cfe-5cb1e1a88a3e/volumes" Jul 09 03:05:35.010646 ip-10-0-138-136 kubenswrapper[2583]: I0709 03:05:35.010611 2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-derive-35ef5376-openshift-default-6b57d96c9f-sl7bq" event={"ID":"cf301d09-7aa3-45b5-964f-6c236791d7c1","Type":"ContainerStarted","Data":"9e631eea6a4863da9e12894c52bc1fc54e77b46ff1c3be23c4a01984876009ac"} Jul 09 03:05:35.011126 ip-10-0-138-136 kubenswrapper[2583]: I0709 03:05:35.010672 2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-derive-35ef5376-openshift-default-6b57d96c9f-sl7bq" event={"ID":"cf301d09-7aa3-45b5-964f-6c236791d7c1","Type":"ContainerStarted","Data":"bf032178138b7d3e41ea0458d3166ed49f6e55ec10c3b23d8d07a5b7b619f7c3"} Jul 09 03:05:35.013997 ip-10-0-138-136 kubenswrapper[2583]: I0709 03:05:35.013972 2583 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-derive-35ef5376-openshift-default-6b57d96c9f-sl7bq" Jul 09 03:05:35.019004 ip-10-0-138-136 kubenswrapper[2583]: I0709 03:05:35.018982 2583 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-derive-35ef5376-openshift-default-6b57d96c9f-sl7bq" Jul 09 03:05:35.031418 ip-10-0-138-136 kubenswrapper[2583]: I0709 03:05:35.031360 2583 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-derive-35ef5376-openshift-default-6b57d96c9f-sl7bq" podStartSLOduration=2.031342438 podStartE2EDuration="2.031342438s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-09 03:05:33 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-09 03:05:35.028769962 +0000 UTC m=+1880.961227450" watchObservedRunningTime="2026-07-09 03:05:35.031342438 +0000 UTC m=+1880.963799925" Jul 09 03:05:36.016312 ip-10-0-138-136 kubenswrapper[2583]: I0709 03:05:36.016277 2583 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-derive-35ef5376-openshift-default-6b57d96c9f-sl7bq" Jul 09 03:05:36.017235 ip-10-0-138-136 kubenswrapper[2583]: I0709 03:05:36.017219 2583 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-derive-35ef5376-openshift-default-6b57d96c9f-sl7bq" Jul 09 03:05:39.458567 ip-10-0-138-136 kubenswrapper[2583]: I0709 03:05:39.458529 2583 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-derive-35ef5376-openshift-default-6b57d96c9f-sl7bq"] Jul 09 03:05:39.459313 ip-10-0-138-136 kubenswrapper[2583]: I0709 03:05:39.458761 2583 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-ingress/e2e-derive-35ef5376-openshift-default-6b57d96c9f-sl7bq" podUID="cf301d09-7aa3-45b5-964f-6c236791d7c1" containerName="istio-proxy" containerID="cri-o://9e631eea6a4863da9e12894c52bc1fc54e77b46ff1c3be23c4a01984876009ac" gracePeriod=30 Jul 09 03:05:45.917784 ip-10-0-138-136 kubenswrapper[2583]: I0709 03:05:45.917758 2583 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-derive-35ef5376-openshift-default-6b57d96c9f-sl7bq" Jul 09 03:05:45.995897 ip-10-0-138-136 kubenswrapper[2583]: I0709 03:05:45.995869 2583 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/cf301d09-7aa3-45b5-964f-6c236791d7c1-workload-certs\") pod \"cf301d09-7aa3-45b5-964f-6c236791d7c1\" (UID: \"cf301d09-7aa3-45b5-964f-6c236791d7c1\") " Jul 09 03:05:45.996045 ip-10-0-138-136 kubenswrapper[2583]: I0709 03:05:45.995916 2583 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/cf301d09-7aa3-45b5-964f-6c236791d7c1-istio-data\") pod \"cf301d09-7aa3-45b5-964f-6c236791d7c1\" (UID: \"cf301d09-7aa3-45b5-964f-6c236791d7c1\") " Jul 09 03:05:45.996045 ip-10-0-138-136 kubenswrapper[2583]: I0709 03:05:45.995964 2583 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-crrhr\" (UniqueName: \"kubernetes.io/projected/cf301d09-7aa3-45b5-964f-6c236791d7c1-kube-api-access-crrhr\") pod \"cf301d09-7aa3-45b5-964f-6c236791d7c1\" (UID: \"cf301d09-7aa3-45b5-964f-6c236791d7c1\") " Jul 09 03:05:45.996045 ip-10-0-138-136 kubenswrapper[2583]: I0709 03:05:45.996004 2583 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/cf301d09-7aa3-45b5-964f-6c236791d7c1-workload-socket\") pod \"cf301d09-7aa3-45b5-964f-6c236791d7c1\" (UID: \"cf301d09-7aa3-45b5-964f-6c236791d7c1\") " Jul 09 03:05:45.996216 ip-10-0-138-136 kubenswrapper[2583]: I0709 03:05:45.996060 2583 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/cf301d09-7aa3-45b5-964f-6c236791d7c1-istio-token\") pod \"cf301d09-7aa3-45b5-964f-6c236791d7c1\" (UID: \"cf301d09-7aa3-45b5-964f-6c236791d7c1\") " Jul 09 03:05:45.996216 ip-10-0-138-136 kubenswrapper[2583]: I0709 03:05:45.996092 2583 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/cf301d09-7aa3-45b5-964f-6c236791d7c1-istio-envoy\") pod \"cf301d09-7aa3-45b5-964f-6c236791d7c1\" (UID: \"cf301d09-7aa3-45b5-964f-6c236791d7c1\") " Jul 09 03:05:45.996216 ip-10-0-138-136 kubenswrapper[2583]: I0709 03:05:45.996127 2583 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/cf301d09-7aa3-45b5-964f-6c236791d7c1-istio-podinfo\") pod \"cf301d09-7aa3-45b5-964f-6c236791d7c1\" (UID: \"cf301d09-7aa3-45b5-964f-6c236791d7c1\") " Jul 09 03:05:45.996216 ip-10-0-138-136 kubenswrapper[2583]: I0709 03:05:45.996126 2583 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/cf301d09-7aa3-45b5-964f-6c236791d7c1-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "cf301d09-7aa3-45b5-964f-6c236791d7c1" (UID: "cf301d09-7aa3-45b5-964f-6c236791d7c1"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 09 03:05:45.996216 ip-10-0-138-136 kubenswrapper[2583]: I0709 03:05:45.996182 2583 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/cf301d09-7aa3-45b5-964f-6c236791d7c1-istiod-ca-cert\") pod \"cf301d09-7aa3-45b5-964f-6c236791d7c1\" (UID: \"cf301d09-7aa3-45b5-964f-6c236791d7c1\") " Jul 09 03:05:45.996461 ip-10-0-138-136 kubenswrapper[2583]: I0709 03:05:45.996231 2583 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/cf301d09-7aa3-45b5-964f-6c236791d7c1-credential-socket\") pod \"cf301d09-7aa3-45b5-964f-6c236791d7c1\" (UID: \"cf301d09-7aa3-45b5-964f-6c236791d7c1\") " Jul 09 03:05:45.996461 ip-10-0-138-136 kubenswrapper[2583]: I0709 03:05:45.996366 2583 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/cf301d09-7aa3-45b5-964f-6c236791d7c1-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "cf301d09-7aa3-45b5-964f-6c236791d7c1" (UID: "cf301d09-7aa3-45b5-964f-6c236791d7c1"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 09 03:05:45.996601 ip-10-0-138-136 kubenswrapper[2583]: I0709 03:05:45.996579 2583 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/cf301d09-7aa3-45b5-964f-6c236791d7c1-workload-certs\") on node \"ip-10-0-138-136.ec2.internal\" DevicePath \"\"" Jul 09 03:05:45.996601 ip-10-0-138-136 kubenswrapper[2583]: I0709 03:05:45.996522 2583 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/cf301d09-7aa3-45b5-964f-6c236791d7c1-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "cf301d09-7aa3-45b5-964f-6c236791d7c1" (UID: "cf301d09-7aa3-45b5-964f-6c236791d7c1"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 09 03:05:45.996698 ip-10-0-138-136 kubenswrapper[2583]: I0709 03:05:45.996604 2583 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/cf301d09-7aa3-45b5-964f-6c236791d7c1-workload-socket\") on node \"ip-10-0-138-136.ec2.internal\" DevicePath \"\"" Jul 09 03:05:45.996698 ip-10-0-138-136 kubenswrapper[2583]: I0709 03:05:45.996595 2583 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/cf301d09-7aa3-45b5-964f-6c236791d7c1-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "cf301d09-7aa3-45b5-964f-6c236791d7c1" (UID: "cf301d09-7aa3-45b5-964f-6c236791d7c1"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 09 03:05:45.996945 ip-10-0-138-136 kubenswrapper[2583]: I0709 03:05:45.996921 2583 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/cf301d09-7aa3-45b5-964f-6c236791d7c1-istio-data" (OuterVolumeSpecName: "istio-data") pod "cf301d09-7aa3-45b5-964f-6c236791d7c1" (UID: "cf301d09-7aa3-45b5-964f-6c236791d7c1"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 09 03:05:45.998241 ip-10-0-138-136 kubenswrapper[2583]: I0709 03:05:45.998217 2583 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/cf301d09-7aa3-45b5-964f-6c236791d7c1-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "cf301d09-7aa3-45b5-964f-6c236791d7c1" (UID: "cf301d09-7aa3-45b5-964f-6c236791d7c1"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 09 03:05:45.998502 ip-10-0-138-136 kubenswrapper[2583]: I0709 03:05:45.998477 2583 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/cf301d09-7aa3-45b5-964f-6c236791d7c1-kube-api-access-crrhr" (OuterVolumeSpecName: "kube-api-access-crrhr") pod "cf301d09-7aa3-45b5-964f-6c236791d7c1" (UID: "cf301d09-7aa3-45b5-964f-6c236791d7c1"). InnerVolumeSpecName "kube-api-access-crrhr". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 09 03:05:45.998656 ip-10-0-138-136 kubenswrapper[2583]: I0709 03:05:45.998631 2583 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/cf301d09-7aa3-45b5-964f-6c236791d7c1-istio-token" (OuterVolumeSpecName: "istio-token") pod "cf301d09-7aa3-45b5-964f-6c236791d7c1" (UID: "cf301d09-7aa3-45b5-964f-6c236791d7c1"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 09 03:05:45.998701 ip-10-0-138-136 kubenswrapper[2583]: I0709 03:05:45.998682 2583 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/cf301d09-7aa3-45b5-964f-6c236791d7c1-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "cf301d09-7aa3-45b5-964f-6c236791d7c1" (UID: "cf301d09-7aa3-45b5-964f-6c236791d7c1"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue "" Jul 09 03:05:46.074805 ip-10-0-138-136 kubenswrapper[2583]: I0709 03:05:46.074776 2583 generic.go:356] "Generic (PLEG): container finished" podID="cf301d09-7aa3-45b5-964f-6c236791d7c1" containerID="9e631eea6a4863da9e12894c52bc1fc54e77b46ff1c3be23c4a01984876009ac" exitCode=0 Jul 09 03:05:46.074918 ip-10-0-138-136 kubenswrapper[2583]: I0709 03:05:46.074828 2583 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-derive-35ef5376-openshift-default-6b57d96c9f-sl7bq" Jul 09 03:05:46.074918 ip-10-0-138-136 kubenswrapper[2583]: I0709 03:05:46.074841 2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-derive-35ef5376-openshift-default-6b57d96c9f-sl7bq" event={"ID":"cf301d09-7aa3-45b5-964f-6c236791d7c1","Type":"ContainerDied","Data":"9e631eea6a4863da9e12894c52bc1fc54e77b46ff1c3be23c4a01984876009ac"} Jul 09 03:05:46.074918 ip-10-0-138-136 kubenswrapper[2583]: I0709 03:05:46.074891 2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-derive-35ef5376-openshift-default-6b57d96c9f-sl7bq" event={"ID":"cf301d09-7aa3-45b5-964f-6c236791d7c1","Type":"ContainerDied","Data":"bf032178138b7d3e41ea0458d3166ed49f6e55ec10c3b23d8d07a5b7b619f7c3"} Jul 09 03:05:46.075058 ip-10-0-138-136 kubenswrapper[2583]: I0709 03:05:46.074921 2583 scope.go:117] "RemoveContainer" containerID="9e631eea6a4863da9e12894c52bc1fc54e77b46ff1c3be23c4a01984876009ac" Jul 09 03:05:46.084219 ip-10-0-138-136 kubenswrapper[2583]: I0709 03:05:46.084157 2583 scope.go:117] "RemoveContainer" containerID="9e631eea6a4863da9e12894c52bc1fc54e77b46ff1c3be23c4a01984876009ac" Jul 09 03:05:46.084454 ip-10-0-138-136 kubenswrapper[2583]: E0709 03:05:46.084433 2583 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"9e631eea6a4863da9e12894c52bc1fc54e77b46ff1c3be23c4a01984876009ac\": container with ID starting with 9e631eea6a4863da9e12894c52bc1fc54e77b46ff1c3be23c4a01984876009ac not found: ID does not exist" containerID="9e631eea6a4863da9e12894c52bc1fc54e77b46ff1c3be23c4a01984876009ac" Jul 09 03:05:46.084535 ip-10-0-138-136 kubenswrapper[2583]: I0709 03:05:46.084463 2583 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"9e631eea6a4863da9e12894c52bc1fc54e77b46ff1c3be23c4a01984876009ac"} err="failed to get container status \"9e631eea6a4863da9e12894c52bc1fc54e77b46ff1c3be23c4a01984876009ac\": rpc error: code = NotFound desc = could not find container \"9e631eea6a4863da9e12894c52bc1fc54e77b46ff1c3be23c4a01984876009ac\": container with ID starting with 9e631eea6a4863da9e12894c52bc1fc54e77b46ff1c3be23c4a01984876009ac not found: ID does not exist" Jul 09 03:05:46.097114 ip-10-0-138-136 kubenswrapper[2583]: I0709 03:05:46.097093 2583 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-derive-35ef5376-openshift-default-6b57d96c9f-sl7bq"] Jul 09 03:05:46.097367 ip-10-0-138-136 kubenswrapper[2583]: I0709 03:05:46.097348 2583 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-crrhr\" (UniqueName: \"kubernetes.io/projected/cf301d09-7aa3-45b5-964f-6c236791d7c1-kube-api-access-crrhr\") on node \"ip-10-0-138-136.ec2.internal\" DevicePath \"\"" Jul 09 03:05:46.097411 ip-10-0-138-136 kubenswrapper[2583]: I0709 03:05:46.097371 2583 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/cf301d09-7aa3-45b5-964f-6c236791d7c1-istio-token\") on node \"ip-10-0-138-136.ec2.internal\" DevicePath \"\"" Jul 09 03:05:46.097411 ip-10-0-138-136 kubenswrapper[2583]: I0709 03:05:46.097380 2583 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/cf301d09-7aa3-45b5-964f-6c236791d7c1-istio-envoy\") on node \"ip-10-0-138-136.ec2.internal\" DevicePath \"\"" Jul 09 03:05:46.097411 ip-10-0-138-136 kubenswrapper[2583]: I0709 03:05:46.097389 2583 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/cf301d09-7aa3-45b5-964f-6c236791d7c1-istio-podinfo\") on node \"ip-10-0-138-136.ec2.internal\" DevicePath \"\"" Jul 09 03:05:46.097411 ip-10-0-138-136 kubenswrapper[2583]: I0709 03:05:46.097396 2583 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/cf301d09-7aa3-45b5-964f-6c236791d7c1-istiod-ca-cert\") on node \"ip-10-0-138-136.ec2.internal\" DevicePath \"\"" Jul 09 03:05:46.097411 ip-10-0-138-136 kubenswrapper[2583]: I0709 03:05:46.097405 2583 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/cf301d09-7aa3-45b5-964f-6c236791d7c1-credential-socket\") on node \"ip-10-0-138-136.ec2.internal\" DevicePath \"\"" Jul 09 03:05:46.097566 ip-10-0-138-136 kubenswrapper[2583]: I0709 03:05:46.097412 2583 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/cf301d09-7aa3-45b5-964f-6c236791d7c1-istio-data\") on node \"ip-10-0-138-136.ec2.internal\" DevicePath \"\"" Jul 09 03:05:46.100875 ip-10-0-138-136 kubenswrapper[2583]: I0709 03:05:46.100856 2583 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-derive-35ef5376-openshift-default-6b57d96c9f-sl7bq"] Jul 09 03:05:46.603570 ip-10-0-138-136 kubenswrapper[2583]: I0709 03:05:46.603537 2583 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="cf301d09-7aa3-45b5-964f-6c236791d7c1" path="/var/lib/kubelet/pods/cf301d09-7aa3-45b5-964f-6c236791d7c1/volumes" Jul 09 03:07:19.518339 ip-10-0-138-136 kubenswrapper[2583]: I0709 03:07:19.518258 2583 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-mt-9099fcfd-openshift-default-6c75b98867-76h7x"] Jul 09 03:07:19.518909 ip-10-0-138-136 kubenswrapper[2583]: I0709 03:07:19.518847 2583 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="cf301d09-7aa3-45b5-964f-6c236791d7c1" containerName="istio-proxy" Jul 09 03:07:19.518909 ip-10-0-138-136 kubenswrapper[2583]: I0709 03:07:19.518868 2583 state_mem.go:107] "Deleted CPUSet assignment" podUID="cf301d09-7aa3-45b5-964f-6c236791d7c1" containerName="istio-proxy" Jul 09 03:07:19.519037 ip-10-0-138-136 kubenswrapper[2583]: I0709 03:07:19.518968 2583 memory_manager.go:368] "RemoveStaleState removing state" podUID="cf301d09-7aa3-45b5-964f-6c236791d7c1" containerName="istio-proxy" Jul 09 03:07:19.522304 ip-10-0-138-136 kubenswrapper[2583]: I0709 03:07:19.522282 2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-mt-9099fcfd-openshift-default-6c75b98867-76h7x" Jul 09 03:07:19.524416 ip-10-0-138-136 kubenswrapper[2583]: I0709 03:07:19.524393 2583 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-mt-9099fcfd-openshift-default-dockercfg-k2sts\"" Jul 09 03:07:19.542725 ip-10-0-138-136 kubenswrapper[2583]: I0709 03:07:19.542683 2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-mt-9099fcfd-openshift-default-6c75b98867-76h7x"] Jul 09 03:07:19.547585 ip-10-0-138-136 kubenswrapper[2583]: I0709 03:07:19.547557 2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/f73f771a-4b08-498e-adda-434a272fac2e-workload-certs\") pod \"e2e-mt-9099fcfd-openshift-default-6c75b98867-76h7x\" (UID: \"f73f771a-4b08-498e-adda-434a272fac2e\") " pod="openshift-ingress/e2e-mt-9099fcfd-openshift-default-6c75b98867-76h7x" Jul 09 03:07:19.547684 ip-10-0-138-136 kubenswrapper[2583]: I0709 03:07:19.547601 2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/f73f771a-4b08-498e-adda-434a272fac2e-istio-podinfo\") pod \"e2e-mt-9099fcfd-openshift-default-6c75b98867-76h7x\" (UID: \"f73f771a-4b08-498e-adda-434a272fac2e\") " pod="openshift-ingress/e2e-mt-9099fcfd-openshift-default-6c75b98867-76h7x" Jul 09 03:07:19.547684 ip-10-0-138-136 kubenswrapper[2583]: I0709 03:07:19.547664 2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/f73f771a-4b08-498e-adda-434a272fac2e-istio-token\") pod \"e2e-mt-9099fcfd-openshift-default-6c75b98867-76h7x\" (UID: \"f73f771a-4b08-498e-adda-434a272fac2e\") " pod="openshift-ingress/e2e-mt-9099fcfd-openshift-default-6c75b98867-76h7x" Jul 09 03:07:19.547837 ip-10-0-138-136 kubenswrapper[2583]: I0709 03:07:19.547698 2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/f73f771a-4b08-498e-adda-434a272fac2e-istio-envoy\") pod \"e2e-mt-9099fcfd-openshift-default-6c75b98867-76h7x\" (UID: \"f73f771a-4b08-498e-adda-434a272fac2e\") " pod="openshift-ingress/e2e-mt-9099fcfd-openshift-default-6c75b98867-76h7x" Jul 09 03:07:19.547837 ip-10-0-138-136 kubenswrapper[2583]: I0709 03:07:19.547788 2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/f73f771a-4b08-498e-adda-434a272fac2e-istiod-ca-cert\") pod \"e2e-mt-9099fcfd-openshift-default-6c75b98867-76h7x\" (UID: \"f73f771a-4b08-498e-adda-434a272fac2e\") " pod="openshift-ingress/e2e-mt-9099fcfd-openshift-default-6c75b98867-76h7x" Jul 09 03:07:19.547945 ip-10-0-138-136 kubenswrapper[2583]: I0709 03:07:19.547839 2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/f73f771a-4b08-498e-adda-434a272fac2e-istio-data\") pod \"e2e-mt-9099fcfd-openshift-default-6c75b98867-76h7x\" (UID: \"f73f771a-4b08-498e-adda-434a272fac2e\") " pod="openshift-ingress/e2e-mt-9099fcfd-openshift-default-6c75b98867-76h7x" Jul 09 03:07:19.547945 ip-10-0-138-136 kubenswrapper[2583]: I0709 03:07:19.547867 2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/f73f771a-4b08-498e-adda-434a272fac2e-credential-socket\") pod \"e2e-mt-9099fcfd-openshift-default-6c75b98867-76h7x\" (UID: \"f73f771a-4b08-498e-adda-434a272fac2e\") " pod="openshift-ingress/e2e-mt-9099fcfd-openshift-default-6c75b98867-76h7x" Jul 09 03:07:19.547945 ip-10-0-138-136 kubenswrapper[2583]: I0709 03:07:19.547909 2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-hknpt\" (UniqueName: \"kubernetes.io/projected/f73f771a-4b08-498e-adda-434a272fac2e-kube-api-access-hknpt\") pod \"e2e-mt-9099fcfd-openshift-default-6c75b98867-76h7x\" (UID: \"f73f771a-4b08-498e-adda-434a272fac2e\") " pod="openshift-ingress/e2e-mt-9099fcfd-openshift-default-6c75b98867-76h7x" Jul 09 03:07:19.548061 ip-10-0-138-136 kubenswrapper[2583]: I0709 03:07:19.547987 2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/f73f771a-4b08-498e-adda-434a272fac2e-workload-socket\") pod \"e2e-mt-9099fcfd-openshift-default-6c75b98867-76h7x\" (UID: \"f73f771a-4b08-498e-adda-434a272fac2e\") " pod="openshift-ingress/e2e-mt-9099fcfd-openshift-default-6c75b98867-76h7x" Jul 09 03:07:19.648541 ip-10-0-138-136 kubenswrapper[2583]: I0709 03:07:19.648506 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/f73f771a-4b08-498e-adda-434a272fac2e-istio-data\") pod \"e2e-mt-9099fcfd-openshift-default-6c75b98867-76h7x\" (UID: \"f73f771a-4b08-498e-adda-434a272fac2e\") " pod="openshift-ingress/e2e-mt-9099fcfd-openshift-default-6c75b98867-76h7x" Jul 09 03:07:19.648541 ip-10-0-138-136 kubenswrapper[2583]: I0709 03:07:19.648540 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/f73f771a-4b08-498e-adda-434a272fac2e-credential-socket\") pod \"e2e-mt-9099fcfd-openshift-default-6c75b98867-76h7x\" (UID: \"f73f771a-4b08-498e-adda-434a272fac2e\") " pod="openshift-ingress/e2e-mt-9099fcfd-openshift-default-6c75b98867-76h7x" Jul 09 03:07:19.648761 ip-10-0-138-136 kubenswrapper[2583]: I0709 03:07:19.648668 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-hknpt\" (UniqueName: \"kubernetes.io/projected/f73f771a-4b08-498e-adda-434a272fac2e-kube-api-access-hknpt\") pod \"e2e-mt-9099fcfd-openshift-default-6c75b98867-76h7x\" (UID: \"f73f771a-4b08-498e-adda-434a272fac2e\") " pod="openshift-ingress/e2e-mt-9099fcfd-openshift-default-6c75b98867-76h7x" Jul 09 03:07:19.648761 ip-10-0-138-136 kubenswrapper[2583]: I0709 03:07:19.648749 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/f73f771a-4b08-498e-adda-434a272fac2e-workload-socket\") pod \"e2e-mt-9099fcfd-openshift-default-6c75b98867-76h7x\" (UID: \"f73f771a-4b08-498e-adda-434a272fac2e\") " pod="openshift-ingress/e2e-mt-9099fcfd-openshift-default-6c75b98867-76h7x" Jul 09 03:07:19.648869 ip-10-0-138-136 kubenswrapper[2583]: I0709 03:07:19.648800 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/f73f771a-4b08-498e-adda-434a272fac2e-workload-certs\") pod \"e2e-mt-9099fcfd-openshift-default-6c75b98867-76h7x\" (UID: \"f73f771a-4b08-498e-adda-434a272fac2e\") " pod="openshift-ingress/e2e-mt-9099fcfd-openshift-default-6c75b98867-76h7x" Jul 09 03:07:19.648869 ip-10-0-138-136 kubenswrapper[2583]: I0709 03:07:19.648832 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/f73f771a-4b08-498e-adda-434a272fac2e-istio-podinfo\") pod \"e2e-mt-9099fcfd-openshift-default-6c75b98867-76h7x\" (UID: \"f73f771a-4b08-498e-adda-434a272fac2e\") " pod="openshift-ingress/e2e-mt-9099fcfd-openshift-default-6c75b98867-76h7x" Jul 09 03:07:19.648972 ip-10-0-138-136 kubenswrapper[2583]: I0709 03:07:19.648891 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/f73f771a-4b08-498e-adda-434a272fac2e-istio-token\") pod \"e2e-mt-9099fcfd-openshift-default-6c75b98867-76h7x\" (UID: \"f73f771a-4b08-498e-adda-434a272fac2e\") " pod="openshift-ingress/e2e-mt-9099fcfd-openshift-default-6c75b98867-76h7x" Jul 09 03:07:19.648972 ip-10-0-138-136 kubenswrapper[2583]: I0709 03:07:19.648914 2583 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/f73f771a-4b08-498e-adda-434a272fac2e-istio-data\") pod \"e2e-mt-9099fcfd-openshift-default-6c75b98867-76h7x\" (UID: \"f73f771a-4b08-498e-adda-434a272fac2e\") " pod="openshift-ingress/e2e-mt-9099fcfd-openshift-default-6c75b98867-76h7x" Jul 09 03:07:19.648972 ip-10-0-138-136 kubenswrapper[2583]: I0709 03:07:19.648921 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/f73f771a-4b08-498e-adda-434a272fac2e-istio-envoy\") pod \"e2e-mt-9099fcfd-openshift-default-6c75b98867-76h7x\" (UID: \"f73f771a-4b08-498e-adda-434a272fac2e\") " pod="openshift-ingress/e2e-mt-9099fcfd-openshift-default-6c75b98867-76h7x" Jul 09 03:07:19.648972 ip-10-0-138-136 kubenswrapper[2583]: I0709 03:07:19.648964 2583 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/f73f771a-4b08-498e-adda-434a272fac2e-credential-socket\") pod \"e2e-mt-9099fcfd-openshift-default-6c75b98867-76h7x\" (UID: \"f73f771a-4b08-498e-adda-434a272fac2e\") " pod="openshift-ingress/e2e-mt-9099fcfd-openshift-default-6c75b98867-76h7x" Jul 09 03:07:19.649186 ip-10-0-138-136 kubenswrapper[2583]: I0709 03:07:19.648997 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/f73f771a-4b08-498e-adda-434a272fac2e-istiod-ca-cert\") pod \"e2e-mt-9099fcfd-openshift-default-6c75b98867-76h7x\" (UID: \"f73f771a-4b08-498e-adda-434a272fac2e\") " pod="openshift-ingress/e2e-mt-9099fcfd-openshift-default-6c75b98867-76h7x" Jul 09 03:07:19.649186 ip-10-0-138-136 kubenswrapper[2583]: I0709 03:07:19.649111 2583 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/f73f771a-4b08-498e-adda-434a272fac2e-workload-certs\") pod \"e2e-mt-9099fcfd-openshift-default-6c75b98867-76h7x\" (UID: \"f73f771a-4b08-498e-adda-434a272fac2e\") " pod="openshift-ingress/e2e-mt-9099fcfd-openshift-default-6c75b98867-76h7x" Jul 09 03:07:19.649305 ip-10-0-138-136 kubenswrapper[2583]: I0709 03:07:19.649216 2583 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/f73f771a-4b08-498e-adda-434a272fac2e-workload-socket\") pod \"e2e-mt-9099fcfd-openshift-default-6c75b98867-76h7x\" (UID: \"f73f771a-4b08-498e-adda-434a272fac2e\") " pod="openshift-ingress/e2e-mt-9099fcfd-openshift-default-6c75b98867-76h7x" Jul 09 03:07:19.649625 ip-10-0-138-136 kubenswrapper[2583]: I0709 03:07:19.649608 2583 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/f73f771a-4b08-498e-adda-434a272fac2e-istiod-ca-cert\") pod \"e2e-mt-9099fcfd-openshift-default-6c75b98867-76h7x\" (UID: \"f73f771a-4b08-498e-adda-434a272fac2e\") " pod="openshift-ingress/e2e-mt-9099fcfd-openshift-default-6c75b98867-76h7x" Jul 09 03:07:19.651165 ip-10-0-138-136 kubenswrapper[2583]: I0709 03:07:19.651143 2583 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/f73f771a-4b08-498e-adda-434a272fac2e-istio-envoy\") pod \"e2e-mt-9099fcfd-openshift-default-6c75b98867-76h7x\" (UID: \"f73f771a-4b08-498e-adda-434a272fac2e\") " pod="openshift-ingress/e2e-mt-9099fcfd-openshift-default-6c75b98867-76h7x" Jul 09 03:07:19.651263 ip-10-0-138-136 kubenswrapper[2583]: I0709 03:07:19.651246 2583 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/f73f771a-4b08-498e-adda-434a272fac2e-istio-podinfo\") pod \"e2e-mt-9099fcfd-openshift-default-6c75b98867-76h7x\" (UID: \"f73f771a-4b08-498e-adda-434a272fac2e\") " pod="openshift-ingress/e2e-mt-9099fcfd-openshift-default-6c75b98867-76h7x" Jul 09 03:07:19.656101 ip-10-0-138-136 kubenswrapper[2583]: I0709 03:07:19.656076 2583 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/f73f771a-4b08-498e-adda-434a272fac2e-istio-token\") pod \"e2e-mt-9099fcfd-openshift-default-6c75b98867-76h7x\" (UID: \"f73f771a-4b08-498e-adda-434a272fac2e\") " pod="openshift-ingress/e2e-mt-9099fcfd-openshift-default-6c75b98867-76h7x" Jul 09 03:07:19.656637 ip-10-0-138-136 kubenswrapper[2583]: I0709 03:07:19.656621 2583 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-hknpt\" (UniqueName: \"kubernetes.io/projected/f73f771a-4b08-498e-adda-434a272fac2e-kube-api-access-hknpt\") pod \"e2e-mt-9099fcfd-openshift-default-6c75b98867-76h7x\" (UID: \"f73f771a-4b08-498e-adda-434a272fac2e\") " pod="openshift-ingress/e2e-mt-9099fcfd-openshift-default-6c75b98867-76h7x" Jul 09 03:07:19.835626 ip-10-0-138-136 kubenswrapper[2583]: I0709 03:07:19.835558 2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-mt-9099fcfd-openshift-default-6c75b98867-76h7x" Jul 09 03:07:19.968551 ip-10-0-138-136 kubenswrapper[2583]: I0709 03:07:19.968528 2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-mt-9099fcfd-openshift-default-6c75b98867-76h7x"] Jul 09 03:07:19.971131 ip-10-0-138-136 kubenswrapper[2583]: W0709 03:07:19.971101 2583 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podf73f771a_4b08_498e_adda_434a272fac2e.slice/crio-25a3ba7fd2aa4e355644e1c38707863bb3a47617b00ac83345dfdb36c3eb30ab WatchSource:0}: Error finding container 25a3ba7fd2aa4e355644e1c38707863bb3a47617b00ac83345dfdb36c3eb30ab: Status 404 returned error can't find the container with id 25a3ba7fd2aa4e355644e1c38707863bb3a47617b00ac83345dfdb36c3eb30ab Jul 09 03:07:19.973340 ip-10-0-138-136 kubenswrapper[2583]: I0709 03:07:19.973306 2583 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236232Ki","pods":"250"} Jul 09 03:07:19.973421 ip-10-0-138-136 kubenswrapper[2583]: I0709 03:07:19.973373 2583 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236232Ki","pods":"250"} Jul 09 03:07:19.973421 ip-10-0-138-136 kubenswrapper[2583]: I0709 03:07:19.973400 2583 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236232Ki","pods":"250"} Jul 09 03:07:20.563632 ip-10-0-138-136 kubenswrapper[2583]: I0709 03:07:20.563593 2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-mt-9099fcfd-openshift-default-6c75b98867-76h7x" event={"ID":"f73f771a-4b08-498e-adda-434a272fac2e","Type":"ContainerStarted","Data":"0756b9e2b63584e032894e61725d4e94b9f8b4529ac4f9a59b0447b08369a894"} Jul 09 03:07:20.564129 ip-10-0-138-136 kubenswrapper[2583]: I0709 03:07:20.563645 2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-mt-9099fcfd-openshift-default-6c75b98867-76h7x" event={"ID":"f73f771a-4b08-498e-adda-434a272fac2e","Type":"ContainerStarted","Data":"25a3ba7fd2aa4e355644e1c38707863bb3a47617b00ac83345dfdb36c3eb30ab"} Jul 09 03:07:20.582762 ip-10-0-138-136 kubenswrapper[2583]: I0709 03:07:20.582702 2583 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-mt-9099fcfd-openshift-default-6c75b98867-76h7x" podStartSLOduration=1.5826854190000001 podStartE2EDuration="1.582685419s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-09 03:07:19 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-09 03:07:20.581330353 +0000 UTC m=+1986.513787839" watchObservedRunningTime="2026-07-09 03:07:20.582685419 +0000 UTC m=+1986.515142905" Jul 09 03:07:20.836483 ip-10-0-138-136 kubenswrapper[2583]: I0709 03:07:20.836409 2583 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-mt-9099fcfd-openshift-default-6c75b98867-76h7x" Jul 09 03:07:21.840393 ip-10-0-138-136 kubenswrapper[2583]: I0709 03:07:21.840364 2583 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-mt-9099fcfd-openshift-default-6c75b98867-76h7x" Jul 09 03:07:22.573875 ip-10-0-138-136 kubenswrapper[2583]: I0709 03:07:22.573839 2583 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-mt-9099fcfd-openshift-default-6c75b98867-76h7x" Jul 09 03:07:22.574664 ip-10-0-138-136 kubenswrapper[2583]: I0709 03:07:22.574647 2583 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-mt-9099fcfd-openshift-default-6c75b98867-76h7x" Jul 09 03:09:14.689437 ip-10-0-138-136 kubenswrapper[2583]: I0709 03:09:14.689407 2583 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-68b757fb67-xpjsj_188e21f3-2ce9-4012-ada2-a46c32d56729/console-operator/1.log" Jul 09 03:09:14.694348 ip-10-0-138-136 kubenswrapper[2583]: I0709 03:09:14.694327 2583 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-68b757fb67-xpjsj_188e21f3-2ce9-4012-ada2-a46c32d56729/console-operator/1.log" Jul 09 03:10:38.400172 ip-10-0-138-136 kubenswrapper[2583]: I0709 03:10:38.400078 2583 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-mt-9099fcfd-openshift-default-6c75b98867-76h7x"] Jul 09 03:10:38.400796 ip-10-0-138-136 kubenswrapper[2583]: I0709 03:10:38.400361 2583 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-ingress/e2e-mt-9099fcfd-openshift-default-6c75b98867-76h7x" podUID="f73f771a-4b08-498e-adda-434a272fac2e" containerName="istio-proxy" containerID="cri-o://0756b9e2b63584e032894e61725d4e94b9f8b4529ac4f9a59b0447b08369a894" gracePeriod=30 Jul 09 03:10:43.561222 ip-10-0-138-136 kubenswrapper[2583]: I0709 03:10:43.561183 2583 generic.go:356] "Generic (PLEG): container finished" podID="f73f771a-4b08-498e-adda-434a272fac2e" containerID="0756b9e2b63584e032894e61725d4e94b9f8b4529ac4f9a59b0447b08369a894" exitCode=0 Jul 09 03:10:43.561222 ip-10-0-138-136 kubenswrapper[2583]: I0709 03:10:43.561233 2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-mt-9099fcfd-openshift-default-6c75b98867-76h7x" event={"ID":"f73f771a-4b08-498e-adda-434a272fac2e","Type":"ContainerDied","Data":"0756b9e2b63584e032894e61725d4e94b9f8b4529ac4f9a59b0447b08369a894"} Jul 09 03:10:43.663213 ip-10-0-138-136 kubenswrapper[2583]: I0709 03:10:43.663146 2583 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-mt-9099fcfd-openshift-default-6c75b98867-76h7x" Jul 09 03:10:43.684154 ip-10-0-138-136 kubenswrapper[2583]: I0709 03:10:43.684128 2583 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/f73f771a-4b08-498e-adda-434a272fac2e-istio-data\") pod \"f73f771a-4b08-498e-adda-434a272fac2e\" (UID: \"f73f771a-4b08-498e-adda-434a272fac2e\") " Jul 09 03:10:43.684305 ip-10-0-138-136 kubenswrapper[2583]: I0709 03:10:43.684181 2583 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-hknpt\" (UniqueName: \"kubernetes.io/projected/f73f771a-4b08-498e-adda-434a272fac2e-kube-api-access-hknpt\") pod \"f73f771a-4b08-498e-adda-434a272fac2e\" (UID: \"f73f771a-4b08-498e-adda-434a272fac2e\") " Jul 09 03:10:43.684305 ip-10-0-138-136 kubenswrapper[2583]: I0709 03:10:43.684210 2583 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/f73f771a-4b08-498e-adda-434a272fac2e-istio-podinfo\") pod \"f73f771a-4b08-498e-adda-434a272fac2e\" (UID: \"f73f771a-4b08-498e-adda-434a272fac2e\") " Jul 09 03:10:43.684305 ip-10-0-138-136 kubenswrapper[2583]: I0709 03:10:43.684300 2583 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/f73f771a-4b08-498e-adda-434a272fac2e-workload-socket\") pod \"f73f771a-4b08-498e-adda-434a272fac2e\" (UID: \"f73f771a-4b08-498e-adda-434a272fac2e\") " Jul 09 03:10:43.684474 ip-10-0-138-136 kubenswrapper[2583]: I0709 03:10:43.684344 2583 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/f73f771a-4b08-498e-adda-434a272fac2e-istiod-ca-cert\") pod \"f73f771a-4b08-498e-adda-434a272fac2e\" (UID: \"f73f771a-4b08-498e-adda-434a272fac2e\") " Jul 09 03:10:43.684474 ip-10-0-138-136 kubenswrapper[2583]: I0709 03:10:43.684413 2583 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/f73f771a-4b08-498e-adda-434a272fac2e-istio-data" (OuterVolumeSpecName: "istio-data") pod "f73f771a-4b08-498e-adda-434a272fac2e" (UID: "f73f771a-4b08-498e-adda-434a272fac2e"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 09 03:10:43.684474 ip-10-0-138-136 kubenswrapper[2583]: I0709 03:10:43.684454 2583 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/f73f771a-4b08-498e-adda-434a272fac2e-istio-token\") pod \"f73f771a-4b08-498e-adda-434a272fac2e\" (UID: \"f73f771a-4b08-498e-adda-434a272fac2e\") " Jul 09 03:10:43.684631 ip-10-0-138-136 kubenswrapper[2583]: I0709 03:10:43.684486 2583 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/f73f771a-4b08-498e-adda-434a272fac2e-workload-certs\") pod \"f73f771a-4b08-498e-adda-434a272fac2e\" (UID: \"f73f771a-4b08-498e-adda-434a272fac2e\") " Jul 09 03:10:43.684631 ip-10-0-138-136 kubenswrapper[2583]: I0709 03:10:43.684513 2583 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/f73f771a-4b08-498e-adda-434a272fac2e-credential-socket\") pod \"f73f771a-4b08-498e-adda-434a272fac2e\" (UID: \"f73f771a-4b08-498e-adda-434a272fac2e\") " Jul 09 03:10:43.684631 ip-10-0-138-136 kubenswrapper[2583]: I0709 03:10:43.684590 2583 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/f73f771a-4b08-498e-adda-434a272fac2e-istio-envoy\") pod \"f73f771a-4b08-498e-adda-434a272fac2e\" (UID: \"f73f771a-4b08-498e-adda-434a272fac2e\") " Jul 09 03:10:43.684631 ip-10-0-138-136 kubenswrapper[2583]: I0709 03:10:43.684618 2583 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/f73f771a-4b08-498e-adda-434a272fac2e-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "f73f771a-4b08-498e-adda-434a272fac2e" (UID: "f73f771a-4b08-498e-adda-434a272fac2e"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 09 03:10:43.685559 ip-10-0-138-136 kubenswrapper[2583]: I0709 03:10:43.684704 2583 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/f73f771a-4b08-498e-adda-434a272fac2e-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "f73f771a-4b08-498e-adda-434a272fac2e" (UID: "f73f771a-4b08-498e-adda-434a272fac2e"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 09 03:10:43.685559 ip-10-0-138-136 kubenswrapper[2583]: I0709 03:10:43.684851 2583 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/f73f771a-4b08-498e-adda-434a272fac2e-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "f73f771a-4b08-498e-adda-434a272fac2e" (UID: "f73f771a-4b08-498e-adda-434a272fac2e"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 09 03:10:43.685559 ip-10-0-138-136 kubenswrapper[2583]: I0709 03:10:43.684967 2583 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/f73f771a-4b08-498e-adda-434a272fac2e-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "f73f771a-4b08-498e-adda-434a272fac2e" (UID: "f73f771a-4b08-498e-adda-434a272fac2e"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 09 03:10:43.685559 ip-10-0-138-136 kubenswrapper[2583]: I0709 03:10:43.685034 2583 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/f73f771a-4b08-498e-adda-434a272fac2e-workload-socket\") on node \"ip-10-0-138-136.ec2.internal\" DevicePath \"\"" Jul 09 03:10:43.685559 ip-10-0-138-136 kubenswrapper[2583]: I0709 03:10:43.685052 2583 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/f73f771a-4b08-498e-adda-434a272fac2e-istiod-ca-cert\") on node \"ip-10-0-138-136.ec2.internal\" DevicePath \"\"" Jul 09 03:10:43.685559 ip-10-0-138-136 kubenswrapper[2583]: I0709 03:10:43.685065 2583 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/f73f771a-4b08-498e-adda-434a272fac2e-workload-certs\") on node \"ip-10-0-138-136.ec2.internal\" DevicePath \"\"" Jul 09 03:10:43.685559 ip-10-0-138-136 kubenswrapper[2583]: I0709 03:10:43.685076 2583 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/f73f771a-4b08-498e-adda-434a272fac2e-istio-data\") on node \"ip-10-0-138-136.ec2.internal\" DevicePath \"\"" Jul 09 03:10:43.686824 ip-10-0-138-136 kubenswrapper[2583]: I0709 03:10:43.686795 2583 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/f73f771a-4b08-498e-adda-434a272fac2e-kube-api-access-hknpt" (OuterVolumeSpecName: "kube-api-access-hknpt") pod "f73f771a-4b08-498e-adda-434a272fac2e" (UID: "f73f771a-4b08-498e-adda-434a272fac2e"). InnerVolumeSpecName "kube-api-access-hknpt". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 09 03:10:43.686996 ip-10-0-138-136 kubenswrapper[2583]: I0709 03:10:43.686963 2583 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/f73f771a-4b08-498e-adda-434a272fac2e-istio-token" (OuterVolumeSpecName: "istio-token") pod "f73f771a-4b08-498e-adda-434a272fac2e" (UID: "f73f771a-4b08-498e-adda-434a272fac2e"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 09 03:10:43.687119 ip-10-0-138-136 kubenswrapper[2583]: I0709 03:10:43.687101 2583 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/f73f771a-4b08-498e-adda-434a272fac2e-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "f73f771a-4b08-498e-adda-434a272fac2e" (UID: "f73f771a-4b08-498e-adda-434a272fac2e"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 09 03:10:43.687549 ip-10-0-138-136 kubenswrapper[2583]: I0709 03:10:43.687521 2583 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/f73f771a-4b08-498e-adda-434a272fac2e-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "f73f771a-4b08-498e-adda-434a272fac2e" (UID: "f73f771a-4b08-498e-adda-434a272fac2e"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue "" Jul 09 03:10:43.785702 ip-10-0-138-136 kubenswrapper[2583]: I0709 03:10:43.785667 2583 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-hknpt\" (UniqueName: \"kubernetes.io/projected/f73f771a-4b08-498e-adda-434a272fac2e-kube-api-access-hknpt\") on node \"ip-10-0-138-136.ec2.internal\" DevicePath \"\"" Jul 09 03:10:43.785702 ip-10-0-138-136 kubenswrapper[2583]: I0709 03:10:43.785697 2583 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/f73f771a-4b08-498e-adda-434a272fac2e-istio-podinfo\") on node \"ip-10-0-138-136.ec2.internal\" DevicePath \"\"" Jul 09 03:10:43.785702 ip-10-0-138-136 kubenswrapper[2583]: I0709 03:10:43.785706 2583 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/f73f771a-4b08-498e-adda-434a272fac2e-istio-token\") on node \"ip-10-0-138-136.ec2.internal\" DevicePath \"\"" Jul 09 03:10:43.785968 ip-10-0-138-136 kubenswrapper[2583]: I0709 03:10:43.785735 2583 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/f73f771a-4b08-498e-adda-434a272fac2e-credential-socket\") on node \"ip-10-0-138-136.ec2.internal\" DevicePath \"\"" Jul 09 03:10:43.785968 ip-10-0-138-136 kubenswrapper[2583]: I0709 03:10:43.785743 2583 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/f73f771a-4b08-498e-adda-434a272fac2e-istio-envoy\") on node \"ip-10-0-138-136.ec2.internal\" DevicePath \"\"" Jul 09 03:10:44.567407 ip-10-0-138-136 kubenswrapper[2583]: I0709 03:10:44.567373 2583 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-mt-9099fcfd-openshift-default-6c75b98867-76h7x" Jul 09 03:10:44.567859 ip-10-0-138-136 kubenswrapper[2583]: I0709 03:10:44.567372 2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-mt-9099fcfd-openshift-default-6c75b98867-76h7x" event={"ID":"f73f771a-4b08-498e-adda-434a272fac2e","Type":"ContainerDied","Data":"25a3ba7fd2aa4e355644e1c38707863bb3a47617b00ac83345dfdb36c3eb30ab"} Jul 09 03:10:44.567859 ip-10-0-138-136 kubenswrapper[2583]: I0709 03:10:44.567520 2583 scope.go:117] "RemoveContainer" containerID="0756b9e2b63584e032894e61725d4e94b9f8b4529ac4f9a59b0447b08369a894" Jul 09 03:10:44.588466 ip-10-0-138-136 kubenswrapper[2583]: I0709 03:10:44.588437 2583 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-mt-9099fcfd-openshift-default-6c75b98867-76h7x"] Jul 09 03:10:44.592003 ip-10-0-138-136 kubenswrapper[2583]: I0709 03:10:44.591977 2583 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-mt-9099fcfd-openshift-default-6c75b98867-76h7x"] Jul 09 03:10:44.603313 ip-10-0-138-136 kubenswrapper[2583]: I0709 03:10:44.603285 2583 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="f73f771a-4b08-498e-adda-434a272fac2e" path="/var/lib/kubelet/pods/f73f771a-4b08-498e-adda-434a272fac2e/volumes" Jul 09 03:10:57.648155 ip-10-0-138-136 kubenswrapper[2583]: I0709 03:10:57.648123 2583 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-mt-28444007-openshift-default-6559d9f9-f6gl9"] Jul 09 03:10:57.650588 ip-10-0-138-136 kubenswrapper[2583]: I0709 03:10:57.648521 2583 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="f73f771a-4b08-498e-adda-434a272fac2e" containerName="istio-proxy" Jul 09 03:10:57.650588 ip-10-0-138-136 kubenswrapper[2583]: I0709 03:10:57.648532 2583 state_mem.go:107] "Deleted CPUSet assignment" podUID="f73f771a-4b08-498e-adda-434a272fac2e" containerName="istio-proxy" Jul 09 03:10:57.650588 ip-10-0-138-136 kubenswrapper[2583]: I0709 03:10:57.648619 2583 memory_manager.go:368] "RemoveStaleState removing state" podUID="f73f771a-4b08-498e-adda-434a272fac2e" containerName="istio-proxy" Jul 09 03:10:57.651567 ip-10-0-138-136 kubenswrapper[2583]: I0709 03:10:57.651551 2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-mt-28444007-openshift-default-6559d9f9-f6gl9" Jul 09 03:10:57.653697 ip-10-0-138-136 kubenswrapper[2583]: I0709 03:10:57.653674 2583 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-mt-28444007-openshift-default-dockercfg-v6rdg\"" Jul 09 03:10:57.665232 ip-10-0-138-136 kubenswrapper[2583]: I0709 03:10:57.665203 2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-mt-28444007-openshift-default-6559d9f9-f6gl9"] Jul 09 03:10:57.718476 ip-10-0-138-136 kubenswrapper[2583]: I0709 03:10:57.718443 2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/adaff86a-d6de-4b46-b25b-10adb35daa0f-istio-data\") pod \"e2e-mt-28444007-openshift-default-6559d9f9-f6gl9\" (UID: \"adaff86a-d6de-4b46-b25b-10adb35daa0f\") " pod="openshift-ingress/e2e-mt-28444007-openshift-default-6559d9f9-f6gl9" Jul 09 03:10:57.718599 ip-10-0-138-136 kubenswrapper[2583]: I0709 03:10:57.718485 2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/adaff86a-d6de-4b46-b25b-10adb35daa0f-istio-token\") pod \"e2e-mt-28444007-openshift-default-6559d9f9-f6gl9\" (UID: \"adaff86a-d6de-4b46-b25b-10adb35daa0f\") " pod="openshift-ingress/e2e-mt-28444007-openshift-default-6559d9f9-f6gl9" Jul 09 03:10:57.718599 ip-10-0-138-136 kubenswrapper[2583]: I0709 03:10:57.718543 2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/adaff86a-d6de-4b46-b25b-10adb35daa0f-workload-certs\") pod \"e2e-mt-28444007-openshift-default-6559d9f9-f6gl9\" (UID: \"adaff86a-d6de-4b46-b25b-10adb35daa0f\") " pod="openshift-ingress/e2e-mt-28444007-openshift-default-6559d9f9-f6gl9" Jul 09 03:10:57.718599 ip-10-0-138-136 kubenswrapper[2583]: I0709 03:10:57.718589 2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/adaff86a-d6de-4b46-b25b-10adb35daa0f-istio-podinfo\") pod \"e2e-mt-28444007-openshift-default-6559d9f9-f6gl9\" (UID: \"adaff86a-d6de-4b46-b25b-10adb35daa0f\") " pod="openshift-ingress/e2e-mt-28444007-openshift-default-6559d9f9-f6gl9" Jul 09 03:10:57.718835 ip-10-0-138-136 kubenswrapper[2583]: I0709 03:10:57.718629 2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/adaff86a-d6de-4b46-b25b-10adb35daa0f-istio-envoy\") pod \"e2e-mt-28444007-openshift-default-6559d9f9-f6gl9\" (UID: \"adaff86a-d6de-4b46-b25b-10adb35daa0f\") " pod="openshift-ingress/e2e-mt-28444007-openshift-default-6559d9f9-f6gl9" Jul 09 03:10:57.718835 ip-10-0-138-136 kubenswrapper[2583]: I0709 03:10:57.718664 2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/adaff86a-d6de-4b46-b25b-10adb35daa0f-workload-socket\") pod \"e2e-mt-28444007-openshift-default-6559d9f9-f6gl9\" (UID: \"adaff86a-d6de-4b46-b25b-10adb35daa0f\") " pod="openshift-ingress/e2e-mt-28444007-openshift-default-6559d9f9-f6gl9" Jul 09 03:10:57.718835 ip-10-0-138-136 kubenswrapper[2583]: I0709 03:10:57.718769 2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/adaff86a-d6de-4b46-b25b-10adb35daa0f-credential-socket\") pod \"e2e-mt-28444007-openshift-default-6559d9f9-f6gl9\" (UID: \"adaff86a-d6de-4b46-b25b-10adb35daa0f\") " pod="openshift-ingress/e2e-mt-28444007-openshift-default-6559d9f9-f6gl9" Jul 09 03:10:57.718835 ip-10-0-138-136 kubenswrapper[2583]: I0709 03:10:57.718797 2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-wd95g\" (UniqueName: \"kubernetes.io/projected/adaff86a-d6de-4b46-b25b-10adb35daa0f-kube-api-access-wd95g\") pod \"e2e-mt-28444007-openshift-default-6559d9f9-f6gl9\" (UID: \"adaff86a-d6de-4b46-b25b-10adb35daa0f\") " pod="openshift-ingress/e2e-mt-28444007-openshift-default-6559d9f9-f6gl9" Jul 09 03:10:57.719016 ip-10-0-138-136 kubenswrapper[2583]: I0709 03:10:57.718888 2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/adaff86a-d6de-4b46-b25b-10adb35daa0f-istiod-ca-cert\") pod \"e2e-mt-28444007-openshift-default-6559d9f9-f6gl9\" (UID: \"adaff86a-d6de-4b46-b25b-10adb35daa0f\") " pod="openshift-ingress/e2e-mt-28444007-openshift-default-6559d9f9-f6gl9" Jul 09 03:10:57.819623 ip-10-0-138-136 kubenswrapper[2583]: I0709 03:10:57.819585 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/adaff86a-d6de-4b46-b25b-10adb35daa0f-istiod-ca-cert\") pod \"e2e-mt-28444007-openshift-default-6559d9f9-f6gl9\" (UID: \"adaff86a-d6de-4b46-b25b-10adb35daa0f\") " pod="openshift-ingress/e2e-mt-28444007-openshift-default-6559d9f9-f6gl9" Jul 09 03:10:57.819860 ip-10-0-138-136 kubenswrapper[2583]: I0709 03:10:57.819634 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/adaff86a-d6de-4b46-b25b-10adb35daa0f-istio-data\") pod \"e2e-mt-28444007-openshift-default-6559d9f9-f6gl9\" (UID: \"adaff86a-d6de-4b46-b25b-10adb35daa0f\") " pod="openshift-ingress/e2e-mt-28444007-openshift-default-6559d9f9-f6gl9" Jul 09 03:10:57.819860 ip-10-0-138-136 kubenswrapper[2583]: I0709 03:10:57.819658 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/adaff86a-d6de-4b46-b25b-10adb35daa0f-istio-token\") pod \"e2e-mt-28444007-openshift-default-6559d9f9-f6gl9\" (UID: \"adaff86a-d6de-4b46-b25b-10adb35daa0f\") " pod="openshift-ingress/e2e-mt-28444007-openshift-default-6559d9f9-f6gl9" Jul 09 03:10:57.819860 ip-10-0-138-136 kubenswrapper[2583]: I0709 03:10:57.819684 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/adaff86a-d6de-4b46-b25b-10adb35daa0f-workload-certs\") pod \"e2e-mt-28444007-openshift-default-6559d9f9-f6gl9\" (UID: \"adaff86a-d6de-4b46-b25b-10adb35daa0f\") " pod="openshift-ingress/e2e-mt-28444007-openshift-default-6559d9f9-f6gl9" Jul 09 03:10:57.819860 ip-10-0-138-136 kubenswrapper[2583]: I0709 03:10:57.819740 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/adaff86a-d6de-4b46-b25b-10adb35daa0f-istio-podinfo\") pod \"e2e-mt-28444007-openshift-default-6559d9f9-f6gl9\" (UID: \"adaff86a-d6de-4b46-b25b-10adb35daa0f\") " pod="openshift-ingress/e2e-mt-28444007-openshift-default-6559d9f9-f6gl9" Jul 09 03:10:57.819860 ip-10-0-138-136 kubenswrapper[2583]: I0709 03:10:57.819782 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/adaff86a-d6de-4b46-b25b-10adb35daa0f-istio-envoy\") pod \"e2e-mt-28444007-openshift-default-6559d9f9-f6gl9\" (UID: \"adaff86a-d6de-4b46-b25b-10adb35daa0f\") " pod="openshift-ingress/e2e-mt-28444007-openshift-default-6559d9f9-f6gl9" Jul 09 03:10:57.819860 ip-10-0-138-136 kubenswrapper[2583]: I0709 03:10:57.819818 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/adaff86a-d6de-4b46-b25b-10adb35daa0f-workload-socket\") pod \"e2e-mt-28444007-openshift-default-6559d9f9-f6gl9\" (UID: \"adaff86a-d6de-4b46-b25b-10adb35daa0f\") " pod="openshift-ingress/e2e-mt-28444007-openshift-default-6559d9f9-f6gl9" Jul 09 03:10:57.820192 ip-10-0-138-136 kubenswrapper[2583]: I0709 03:10:57.819900 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/adaff86a-d6de-4b46-b25b-10adb35daa0f-credential-socket\") pod \"e2e-mt-28444007-openshift-default-6559d9f9-f6gl9\" (UID: \"adaff86a-d6de-4b46-b25b-10adb35daa0f\") " pod="openshift-ingress/e2e-mt-28444007-openshift-default-6559d9f9-f6gl9" Jul 09 03:10:57.820192 ip-10-0-138-136 kubenswrapper[2583]: I0709 03:10:57.819925 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-wd95g\" (UniqueName: \"kubernetes.io/projected/adaff86a-d6de-4b46-b25b-10adb35daa0f-kube-api-access-wd95g\") pod \"e2e-mt-28444007-openshift-default-6559d9f9-f6gl9\" (UID: \"adaff86a-d6de-4b46-b25b-10adb35daa0f\") " pod="openshift-ingress/e2e-mt-28444007-openshift-default-6559d9f9-f6gl9" Jul 09 03:10:57.820192 ip-10-0-138-136 kubenswrapper[2583]: I0709 03:10:57.820099 2583 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/adaff86a-d6de-4b46-b25b-10adb35daa0f-istio-data\") pod \"e2e-mt-28444007-openshift-default-6559d9f9-f6gl9\" (UID: \"adaff86a-d6de-4b46-b25b-10adb35daa0f\") " pod="openshift-ingress/e2e-mt-28444007-openshift-default-6559d9f9-f6gl9" Jul 09 03:10:57.820355 ip-10-0-138-136 kubenswrapper[2583]: I0709 03:10:57.820184 2583 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/adaff86a-d6de-4b46-b25b-10adb35daa0f-workload-certs\") pod \"e2e-mt-28444007-openshift-default-6559d9f9-f6gl9\" (UID: \"adaff86a-d6de-4b46-b25b-10adb35daa0f\") " pod="openshift-ingress/e2e-mt-28444007-openshift-default-6559d9f9-f6gl9" Jul 09 03:10:57.820355 ip-10-0-138-136 kubenswrapper[2583]: I0709 03:10:57.820292 2583 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/adaff86a-d6de-4b46-b25b-10adb35daa0f-workload-socket\") pod \"e2e-mt-28444007-openshift-default-6559d9f9-f6gl9\" (UID: \"adaff86a-d6de-4b46-b25b-10adb35daa0f\") " pod="openshift-ingress/e2e-mt-28444007-openshift-default-6559d9f9-f6gl9" Jul 09 03:10:57.820485 ip-10-0-138-136 kubenswrapper[2583]: I0709 03:10:57.820462 2583 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/adaff86a-d6de-4b46-b25b-10adb35daa0f-istiod-ca-cert\") pod \"e2e-mt-28444007-openshift-default-6559d9f9-f6gl9\" (UID: \"adaff86a-d6de-4b46-b25b-10adb35daa0f\") " pod="openshift-ingress/e2e-mt-28444007-openshift-default-6559d9f9-f6gl9" Jul 09 03:10:57.820533 ip-10-0-138-136 kubenswrapper[2583]: I0709 03:10:57.820466 2583 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/adaff86a-d6de-4b46-b25b-10adb35daa0f-credential-socket\") pod \"e2e-mt-28444007-openshift-default-6559d9f9-f6gl9\" (UID: \"adaff86a-d6de-4b46-b25b-10adb35daa0f\") " pod="openshift-ingress/e2e-mt-28444007-openshift-default-6559d9f9-f6gl9" Jul 09 03:10:57.822186 ip-10-0-138-136 kubenswrapper[2583]: I0709 03:10:57.822163 2583 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/adaff86a-d6de-4b46-b25b-10adb35daa0f-istio-envoy\") pod \"e2e-mt-28444007-openshift-default-6559d9f9-f6gl9\" (UID: \"adaff86a-d6de-4b46-b25b-10adb35daa0f\") " pod="openshift-ingress/e2e-mt-28444007-openshift-default-6559d9f9-f6gl9" Jul 09 03:10:57.822431 ip-10-0-138-136 kubenswrapper[2583]: I0709 03:10:57.822409 2583 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/adaff86a-d6de-4b46-b25b-10adb35daa0f-istio-podinfo\") pod \"e2e-mt-28444007-openshift-default-6559d9f9-f6gl9\" (UID: \"adaff86a-d6de-4b46-b25b-10adb35daa0f\") " pod="openshift-ingress/e2e-mt-28444007-openshift-default-6559d9f9-f6gl9" Jul 09 03:10:57.827432 ip-10-0-138-136 kubenswrapper[2583]: I0709 03:10:57.827400 2583 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/adaff86a-d6de-4b46-b25b-10adb35daa0f-istio-token\") pod \"e2e-mt-28444007-openshift-default-6559d9f9-f6gl9\" (UID: \"adaff86a-d6de-4b46-b25b-10adb35daa0f\") " pod="openshift-ingress/e2e-mt-28444007-openshift-default-6559d9f9-f6gl9" Jul 09 03:10:57.827550 ip-10-0-138-136 kubenswrapper[2583]: I0709 03:10:57.827532 2583 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-wd95g\" (UniqueName: \"kubernetes.io/projected/adaff86a-d6de-4b46-b25b-10adb35daa0f-kube-api-access-wd95g\") pod \"e2e-mt-28444007-openshift-default-6559d9f9-f6gl9\" (UID: \"adaff86a-d6de-4b46-b25b-10adb35daa0f\") " pod="openshift-ingress/e2e-mt-28444007-openshift-default-6559d9f9-f6gl9" Jul 09 03:10:57.962286 ip-10-0-138-136 kubenswrapper[2583]: I0709 03:10:57.962203 2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-mt-28444007-openshift-default-6559d9f9-f6gl9" Jul 09 03:10:58.117072 ip-10-0-138-136 kubenswrapper[2583]: I0709 03:10:58.114090 2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-mt-28444007-openshift-default-6559d9f9-f6gl9"] Jul 09 03:10:58.122006 ip-10-0-138-136 kubenswrapper[2583]: W0709 03:10:58.121978 2583 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podadaff86a_d6de_4b46_b25b_10adb35daa0f.slice/crio-7b9e624fa0c99030b9c6159729e615cb8d1299002cf55a56bd1f9cba1b482adf WatchSource:0}: Error finding container 7b9e624fa0c99030b9c6159729e615cb8d1299002cf55a56bd1f9cba1b482adf: Status 404 returned error can't find the container with id 7b9e624fa0c99030b9c6159729e615cb8d1299002cf55a56bd1f9cba1b482adf Jul 09 03:10:58.124223 ip-10-0-138-136 kubenswrapper[2583]: I0709 03:10:58.124180 2583 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236232Ki","pods":"250"} Jul 09 03:10:58.124307 ip-10-0-138-136 kubenswrapper[2583]: I0709 03:10:58.124275 2583 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236232Ki","pods":"250"} Jul 09 03:10:58.124346 ip-10-0-138-136 kubenswrapper[2583]: I0709 03:10:58.124320 2583 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236232Ki","pods":"250"} Jul 09 03:10:58.637682 ip-10-0-138-136 kubenswrapper[2583]: I0709 03:10:58.637642 2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-mt-28444007-openshift-default-6559d9f9-f6gl9" event={"ID":"adaff86a-d6de-4b46-b25b-10adb35daa0f","Type":"ContainerStarted","Data":"693f6c0d46d043511d0f0824b40a6021d41e0646afe80d7fef3b5c5f0f6018b8"} Jul 09 03:10:58.637918 ip-10-0-138-136 kubenswrapper[2583]: I0709 03:10:58.637733 2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-mt-28444007-openshift-default-6559d9f9-f6gl9" event={"ID":"adaff86a-d6de-4b46-b25b-10adb35daa0f","Type":"ContainerStarted","Data":"7b9e624fa0c99030b9c6159729e615cb8d1299002cf55a56bd1f9cba1b482adf"} Jul 09 03:10:58.657349 ip-10-0-138-136 kubenswrapper[2583]: I0709 03:10:58.657296 2583 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-mt-28444007-openshift-default-6559d9f9-f6gl9" podStartSLOduration=1.657280471 podStartE2EDuration="1.657280471s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-09 03:10:57 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-09 03:10:58.655041697 +0000 UTC m=+2204.587499206" watchObservedRunningTime="2026-07-09 03:10:58.657280471 +0000 UTC m=+2204.589737957" Jul 09 03:10:58.963173 ip-10-0-138-136 kubenswrapper[2583]: I0709 03:10:58.963085 2583 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-mt-28444007-openshift-default-6559d9f9-f6gl9" Jul 09 03:10:59.968313 ip-10-0-138-136 kubenswrapper[2583]: I0709 03:10:59.968281 2583 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-mt-28444007-openshift-default-6559d9f9-f6gl9" Jul 09 03:11:00.646430 ip-10-0-138-136 kubenswrapper[2583]: I0709 03:11:00.646401 2583 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-mt-28444007-openshift-default-6559d9f9-f6gl9" Jul 09 03:11:00.647226 ip-10-0-138-136 kubenswrapper[2583]: I0709 03:11:00.647202 2583 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-mt-28444007-openshift-default-6559d9f9-f6gl9" Jul 09 03:11:15.647368 ip-10-0-138-136 kubenswrapper[2583]: I0709 03:11:15.647328 2583 patch_prober.go:28] interesting pod/e2e-mt-28444007-openshift-default-6559d9f9-f6gl9 container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="Get \"http://10.132.0.48:15021/healthz/ready\": dial tcp 10.132.0.48:15021: connect: connection refused" start-of-body= Jul 09 03:11:15.647886 ip-10-0-138-136 kubenswrapper[2583]: I0709 03:11:15.647393 2583 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/e2e-mt-28444007-openshift-default-6559d9f9-f6gl9" podUID="adaff86a-d6de-4b46-b25b-10adb35daa0f" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.48:15021/healthz/ready\": dial tcp 10.132.0.48:15021: connect: connection refused" Jul 09 03:11:15.727038 ip-10-0-138-136 kubenswrapper[2583]: I0709 03:11:15.727006 2583 generic.go:356] "Generic (PLEG): container finished" podID="adaff86a-d6de-4b46-b25b-10adb35daa0f" containerID="693f6c0d46d043511d0f0824b40a6021d41e0646afe80d7fef3b5c5f0f6018b8" exitCode=0 Jul 09 03:11:15.727213 ip-10-0-138-136 kubenswrapper[2583]: I0709 03:11:15.727081 2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-mt-28444007-openshift-default-6559d9f9-f6gl9" event={"ID":"adaff86a-d6de-4b46-b25b-10adb35daa0f","Type":"ContainerDied","Data":"693f6c0d46d043511d0f0824b40a6021d41e0646afe80d7fef3b5c5f0f6018b8"} Jul 09 03:11:15.727537 ip-10-0-138-136 kubenswrapper[2583]: I0709 03:11:15.727520 2583 scope.go:117] "RemoveContainer" containerID="693f6c0d46d043511d0f0824b40a6021d41e0646afe80d7fef3b5c5f0f6018b8" Jul 09 03:11:15.728657 ip-10-0-138-136 kubenswrapper[2583]: I0709 03:11:15.728623 2583 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236232Ki","pods":"250"} Jul 09 03:11:15.728743 ip-10-0-138-136 kubenswrapper[2583]: I0709 03:11:15.728726 2583 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236232Ki","pods":"250"} Jul 09 03:11:15.728791 ip-10-0-138-136 kubenswrapper[2583]: I0709 03:11:15.728776 2583 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236232Ki","pods":"250"} Jul 09 03:11:16.737984 ip-10-0-138-136 kubenswrapper[2583]: I0709 03:11:16.737944 2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-mt-28444007-openshift-default-6559d9f9-f6gl9" event={"ID":"adaff86a-d6de-4b46-b25b-10adb35daa0f","Type":"ContainerStarted","Data":"a80780ff3f7a6419224636e0e0beb40f42320e3a1b5b27a868234122228aa975"} Jul 09 03:11:16.962941 ip-10-0-138-136 kubenswrapper[2583]: I0709 03:11:16.962903 2583 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-mt-28444007-openshift-default-6559d9f9-f6gl9" Jul 09 03:11:16.963247 ip-10-0-138-136 kubenswrapper[2583]: I0709 03:11:16.963220 2583 patch_prober.go:28] interesting pod/e2e-mt-28444007-openshift-default-6559d9f9-f6gl9 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.48:15021/healthz/ready\": dial tcp 10.132.0.48:15021: connect: connection refused" start-of-body= Jul 09 03:11:16.963295 ip-10-0-138-136 kubenswrapper[2583]: I0709 03:11:16.963276 2583 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-mt-28444007-openshift-default-6559d9f9-f6gl9" podUID="adaff86a-d6de-4b46-b25b-10adb35daa0f" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.48:15021/healthz/ready\": dial tcp 10.132.0.48:15021: connect: connection refused" Jul 09 03:11:17.962881 ip-10-0-138-136 kubenswrapper[2583]: I0709 03:11:17.962843 2583 patch_prober.go:28] interesting pod/e2e-mt-28444007-openshift-default-6559d9f9-f6gl9 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.48:15021/healthz/ready\": dial tcp 10.132.0.48:15021: connect: connection refused" start-of-body= Jul 09 03:11:17.963287 ip-10-0-138-136 kubenswrapper[2583]: I0709 03:11:17.962904 2583 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-mt-28444007-openshift-default-6559d9f9-f6gl9" podUID="adaff86a-d6de-4b46-b25b-10adb35daa0f" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.48:15021/healthz/ready\": dial tcp 10.132.0.48:15021: connect: connection refused" Jul 09 03:11:18.963058 ip-10-0-138-136 kubenswrapper[2583]: I0709 03:11:18.963017 2583 patch_prober.go:28] interesting pod/e2e-mt-28444007-openshift-default-6559d9f9-f6gl9 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.48:15021/healthz/ready\": dial tcp 10.132.0.48:15021: connect: connection refused" start-of-body= Jul 09 03:11:18.963476 ip-10-0-138-136 kubenswrapper[2583]: I0709 03:11:18.963083 2583 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-mt-28444007-openshift-default-6559d9f9-f6gl9" podUID="adaff86a-d6de-4b46-b25b-10adb35daa0f" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.48:15021/healthz/ready\": dial tcp 10.132.0.48:15021: connect: connection refused" Jul 09 03:11:19.962679 ip-10-0-138-136 kubenswrapper[2583]: I0709 03:11:19.962641 2583 patch_prober.go:28] interesting pod/e2e-mt-28444007-openshift-default-6559d9f9-f6gl9 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.48:15021/healthz/ready\": dial tcp 10.132.0.48:15021: connect: connection refused" start-of-body= Jul 09 03:11:19.962851 ip-10-0-138-136 kubenswrapper[2583]: I0709 03:11:19.962702 2583 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-mt-28444007-openshift-default-6559d9f9-f6gl9" podUID="adaff86a-d6de-4b46-b25b-10adb35daa0f" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.48:15021/healthz/ready\": dial tcp 10.132.0.48:15021: connect: connection refused" Jul 09 03:11:20.967113 ip-10-0-138-136 kubenswrapper[2583]: I0709 03:11:20.967085 2583 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-mt-28444007-openshift-default-6559d9f9-f6gl9" Jul 09 03:11:20.967486 ip-10-0-138-136 kubenswrapper[2583]: I0709 03:11:20.967365 2583 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-mt-28444007-openshift-default-6559d9f9-f6gl9" Jul 09 03:11:20.968164 ip-10-0-138-136 kubenswrapper[2583]: I0709 03:11:20.968141 2583 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-mt-28444007-openshift-default-6559d9f9-f6gl9" Jul 09 03:12:36.306613 ip-10-0-138-136 kubenswrapper[2583]: I0709 03:12:36.306580 2583 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-mt-28444007-openshift-default-6559d9f9-f6gl9"] Jul 09 03:12:36.307204 ip-10-0-138-136 kubenswrapper[2583]: I0709 03:12:36.306807 2583 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-ingress/e2e-mt-28444007-openshift-default-6559d9f9-f6gl9" podUID="adaff86a-d6de-4b46-b25b-10adb35daa0f" containerName="istio-proxy" containerID="cri-o://a80780ff3f7a6419224636e0e0beb40f42320e3a1b5b27a868234122228aa975" gracePeriod=30 Jul 09 03:12:41.576189 ip-10-0-138-136 kubenswrapper[2583]: I0709 03:12:41.576111 2583 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-mt-28444007-openshift-default-6559d9f9-f6gl9" Jul 09 03:12:41.620235 ip-10-0-138-136 kubenswrapper[2583]: I0709 03:12:41.620198 2583 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/adaff86a-d6de-4b46-b25b-10adb35daa0f-istio-podinfo\") pod \"adaff86a-d6de-4b46-b25b-10adb35daa0f\" (UID: \"adaff86a-d6de-4b46-b25b-10adb35daa0f\") " Jul 09 03:12:41.620436 ip-10-0-138-136 kubenswrapper[2583]: I0709 03:12:41.620260 2583 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/adaff86a-d6de-4b46-b25b-10adb35daa0f-workload-socket\") pod \"adaff86a-d6de-4b46-b25b-10adb35daa0f\" (UID: \"adaff86a-d6de-4b46-b25b-10adb35daa0f\") " Jul 09 03:12:41.620436 ip-10-0-138-136 kubenswrapper[2583]: I0709 03:12:41.620291 2583 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/adaff86a-d6de-4b46-b25b-10adb35daa0f-istio-data\") pod \"adaff86a-d6de-4b46-b25b-10adb35daa0f\" (UID: \"adaff86a-d6de-4b46-b25b-10adb35daa0f\") " Jul 09 03:12:41.620436 ip-10-0-138-136 kubenswrapper[2583]: I0709 03:12:41.620326 2583 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/adaff86a-d6de-4b46-b25b-10adb35daa0f-credential-socket\") pod \"adaff86a-d6de-4b46-b25b-10adb35daa0f\" (UID: \"adaff86a-d6de-4b46-b25b-10adb35daa0f\") " Jul 09 03:12:41.620436 ip-10-0-138-136 kubenswrapper[2583]: I0709 03:12:41.620359 2583 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/adaff86a-d6de-4b46-b25b-10adb35daa0f-istiod-ca-cert\") pod \"adaff86a-d6de-4b46-b25b-10adb35daa0f\" (UID: \"adaff86a-d6de-4b46-b25b-10adb35daa0f\") " Jul 09 03:12:41.620436 ip-10-0-138-136 kubenswrapper[2583]: I0709 03:12:41.620396 2583 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/adaff86a-d6de-4b46-b25b-10adb35daa0f-workload-certs\") pod \"adaff86a-d6de-4b46-b25b-10adb35daa0f\" (UID: \"adaff86a-d6de-4b46-b25b-10adb35daa0f\") " Jul 09 03:12:41.620436 ip-10-0-138-136 kubenswrapper[2583]: I0709 03:12:41.620431 2583 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/adaff86a-d6de-4b46-b25b-10adb35daa0f-istio-token\") pod \"adaff86a-d6de-4b46-b25b-10adb35daa0f\" (UID: \"adaff86a-d6de-4b46-b25b-10adb35daa0f\") " Jul 09 03:12:41.620795 ip-10-0-138-136 kubenswrapper[2583]: I0709 03:12:41.620467 2583 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-wd95g\" (UniqueName: \"kubernetes.io/projected/adaff86a-d6de-4b46-b25b-10adb35daa0f-kube-api-access-wd95g\") pod \"adaff86a-d6de-4b46-b25b-10adb35daa0f\" (UID: \"adaff86a-d6de-4b46-b25b-10adb35daa0f\") " Jul 09 03:12:41.620795 ip-10-0-138-136 kubenswrapper[2583]: I0709 03:12:41.620526 2583 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/adaff86a-d6de-4b46-b25b-10adb35daa0f-istio-envoy\") pod \"adaff86a-d6de-4b46-b25b-10adb35daa0f\" (UID: \"adaff86a-d6de-4b46-b25b-10adb35daa0f\") " Jul 09 03:12:41.620795 ip-10-0-138-136 kubenswrapper[2583]: I0709 03:12:41.620611 2583 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/adaff86a-d6de-4b46-b25b-10adb35daa0f-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "adaff86a-d6de-4b46-b25b-10adb35daa0f" (UID: "adaff86a-d6de-4b46-b25b-10adb35daa0f"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 09 03:12:41.620795 ip-10-0-138-136 kubenswrapper[2583]: I0709 03:12:41.620631 2583 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/adaff86a-d6de-4b46-b25b-10adb35daa0f-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "adaff86a-d6de-4b46-b25b-10adb35daa0f" (UID: "adaff86a-d6de-4b46-b25b-10adb35daa0f"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 09 03:12:41.620795 ip-10-0-138-136 kubenswrapper[2583]: I0709 03:12:41.620650 2583 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/adaff86a-d6de-4b46-b25b-10adb35daa0f-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "adaff86a-d6de-4b46-b25b-10adb35daa0f" (UID: "adaff86a-d6de-4b46-b25b-10adb35daa0f"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 09 03:12:41.621081 ip-10-0-138-136 kubenswrapper[2583]: I0709 03:12:41.620935 2583 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/adaff86a-d6de-4b46-b25b-10adb35daa0f-workload-socket\") on node \"ip-10-0-138-136.ec2.internal\" DevicePath \"\"" Jul 09 03:12:41.621081 ip-10-0-138-136 kubenswrapper[2583]: I0709 03:12:41.620958 2583 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/adaff86a-d6de-4b46-b25b-10adb35daa0f-credential-socket\") on node \"ip-10-0-138-136.ec2.internal\" DevicePath \"\"" Jul 09 03:12:41.621081 ip-10-0-138-136 kubenswrapper[2583]: I0709 03:12:41.620973 2583 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/adaff86a-d6de-4b46-b25b-10adb35daa0f-workload-certs\") on node \"ip-10-0-138-136.ec2.internal\" DevicePath \"\"" Jul 09 03:12:41.621482 ip-10-0-138-136 kubenswrapper[2583]: I0709 03:12:41.621362 2583 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/adaff86a-d6de-4b46-b25b-10adb35daa0f-istio-data" (OuterVolumeSpecName: "istio-data") pod "adaff86a-d6de-4b46-b25b-10adb35daa0f" (UID: "adaff86a-d6de-4b46-b25b-10adb35daa0f"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 09 03:12:41.621789 ip-10-0-138-136 kubenswrapper[2583]: I0709 03:12:41.621756 2583 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/adaff86a-d6de-4b46-b25b-10adb35daa0f-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "adaff86a-d6de-4b46-b25b-10adb35daa0f" (UID: "adaff86a-d6de-4b46-b25b-10adb35daa0f"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 09 03:12:41.622633 ip-10-0-138-136 kubenswrapper[2583]: I0709 03:12:41.622608 2583 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/adaff86a-d6de-4b46-b25b-10adb35daa0f-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "adaff86a-d6de-4b46-b25b-10adb35daa0f" (UID: "adaff86a-d6de-4b46-b25b-10adb35daa0f"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue "" Jul 09 03:12:41.622908 ip-10-0-138-136 kubenswrapper[2583]: I0709 03:12:41.622885 2583 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/adaff86a-d6de-4b46-b25b-10adb35daa0f-kube-api-access-wd95g" (OuterVolumeSpecName: "kube-api-access-wd95g") pod "adaff86a-d6de-4b46-b25b-10adb35daa0f" (UID: "adaff86a-d6de-4b46-b25b-10adb35daa0f"). InnerVolumeSpecName "kube-api-access-wd95g". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 09 03:12:41.622991 ip-10-0-138-136 kubenswrapper[2583]: I0709 03:12:41.622947 2583 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/adaff86a-d6de-4b46-b25b-10adb35daa0f-istio-token" (OuterVolumeSpecName: "istio-token") pod "adaff86a-d6de-4b46-b25b-10adb35daa0f" (UID: "adaff86a-d6de-4b46-b25b-10adb35daa0f"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 09 03:12:41.623152 ip-10-0-138-136 kubenswrapper[2583]: I0709 03:12:41.623137 2583 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/adaff86a-d6de-4b46-b25b-10adb35daa0f-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "adaff86a-d6de-4b46-b25b-10adb35daa0f" (UID: "adaff86a-d6de-4b46-b25b-10adb35daa0f"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 09 03:12:41.722127 ip-10-0-138-136 kubenswrapper[2583]: I0709 03:12:41.722089 2583 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/adaff86a-d6de-4b46-b25b-10adb35daa0f-istio-podinfo\") on node \"ip-10-0-138-136.ec2.internal\" DevicePath \"\"" Jul 09 03:12:41.722127 ip-10-0-138-136 kubenswrapper[2583]: I0709 03:12:41.722121 2583 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/adaff86a-d6de-4b46-b25b-10adb35daa0f-istio-data\") on node \"ip-10-0-138-136.ec2.internal\" DevicePath \"\"" Jul 09 03:12:41.722127 ip-10-0-138-136 kubenswrapper[2583]: I0709 03:12:41.722130 2583 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/adaff86a-d6de-4b46-b25b-10adb35daa0f-istiod-ca-cert\") on node \"ip-10-0-138-136.ec2.internal\" DevicePath \"\"" Jul 09 03:12:41.722127 ip-10-0-138-136 kubenswrapper[2583]: I0709 03:12:41.722140 2583 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/adaff86a-d6de-4b46-b25b-10adb35daa0f-istio-token\") on node \"ip-10-0-138-136.ec2.internal\" DevicePath \"\"" Jul 09 03:12:41.722396 ip-10-0-138-136 kubenswrapper[2583]: I0709 03:12:41.722149 2583 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-wd95g\" (UniqueName: \"kubernetes.io/projected/adaff86a-d6de-4b46-b25b-10adb35daa0f-kube-api-access-wd95g\") on node \"ip-10-0-138-136.ec2.internal\" DevicePath \"\"" Jul 09 03:12:41.722396 ip-10-0-138-136 kubenswrapper[2583]: I0709 03:12:41.722157 2583 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/adaff86a-d6de-4b46-b25b-10adb35daa0f-istio-envoy\") on node \"ip-10-0-138-136.ec2.internal\" DevicePath \"\"" Jul 09 03:12:42.172464 ip-10-0-138-136 kubenswrapper[2583]: I0709 03:12:42.172431 2583 generic.go:356] "Generic (PLEG): container finished" podID="adaff86a-d6de-4b46-b25b-10adb35daa0f" containerID="a80780ff3f7a6419224636e0e0beb40f42320e3a1b5b27a868234122228aa975" exitCode=0 Jul 09 03:12:42.172656 ip-10-0-138-136 kubenswrapper[2583]: I0709 03:12:42.172483 2583 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-mt-28444007-openshift-default-6559d9f9-f6gl9" Jul 09 03:12:42.172656 ip-10-0-138-136 kubenswrapper[2583]: I0709 03:12:42.172522 2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-mt-28444007-openshift-default-6559d9f9-f6gl9" event={"ID":"adaff86a-d6de-4b46-b25b-10adb35daa0f","Type":"ContainerDied","Data":"a80780ff3f7a6419224636e0e0beb40f42320e3a1b5b27a868234122228aa975"} Jul 09 03:12:42.172656 ip-10-0-138-136 kubenswrapper[2583]: I0709 03:12:42.172591 2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-mt-28444007-openshift-default-6559d9f9-f6gl9" event={"ID":"adaff86a-d6de-4b46-b25b-10adb35daa0f","Type":"ContainerDied","Data":"7b9e624fa0c99030b9c6159729e615cb8d1299002cf55a56bd1f9cba1b482adf"} Jul 09 03:12:42.172656 ip-10-0-138-136 kubenswrapper[2583]: I0709 03:12:42.172621 2583 scope.go:117] "RemoveContainer" containerID="a80780ff3f7a6419224636e0e0beb40f42320e3a1b5b27a868234122228aa975" Jul 09 03:12:42.182111 ip-10-0-138-136 kubenswrapper[2583]: I0709 03:12:42.182093 2583 scope.go:117] "RemoveContainer" containerID="693f6c0d46d043511d0f0824b40a6021d41e0646afe80d7fef3b5c5f0f6018b8" Jul 09 03:12:42.189833 ip-10-0-138-136 kubenswrapper[2583]: I0709 03:12:42.189818 2583 scope.go:117] "RemoveContainer" containerID="a80780ff3f7a6419224636e0e0beb40f42320e3a1b5b27a868234122228aa975" Jul 09 03:12:42.190072 ip-10-0-138-136 kubenswrapper[2583]: E0709 03:12:42.190055 2583 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"a80780ff3f7a6419224636e0e0beb40f42320e3a1b5b27a868234122228aa975\": container with ID starting with a80780ff3f7a6419224636e0e0beb40f42320e3a1b5b27a868234122228aa975 not found: ID does not exist" containerID="a80780ff3f7a6419224636e0e0beb40f42320e3a1b5b27a868234122228aa975" Jul 09 03:12:42.190131 ip-10-0-138-136 kubenswrapper[2583]: I0709 03:12:42.190078 2583 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"a80780ff3f7a6419224636e0e0beb40f42320e3a1b5b27a868234122228aa975"} err="failed to get container status \"a80780ff3f7a6419224636e0e0beb40f42320e3a1b5b27a868234122228aa975\": rpc error: code = NotFound desc = could not find container \"a80780ff3f7a6419224636e0e0beb40f42320e3a1b5b27a868234122228aa975\": container with ID starting with a80780ff3f7a6419224636e0e0beb40f42320e3a1b5b27a868234122228aa975 not found: ID does not exist" Jul 09 03:12:42.190131 ip-10-0-138-136 kubenswrapper[2583]: I0709 03:12:42.190093 2583 scope.go:117] "RemoveContainer" containerID="693f6c0d46d043511d0f0824b40a6021d41e0646afe80d7fef3b5c5f0f6018b8" Jul 09 03:12:42.190284 ip-10-0-138-136 kubenswrapper[2583]: E0709 03:12:42.190270 2583 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"693f6c0d46d043511d0f0824b40a6021d41e0646afe80d7fef3b5c5f0f6018b8\": container with ID starting with 693f6c0d46d043511d0f0824b40a6021d41e0646afe80d7fef3b5c5f0f6018b8 not found: ID does not exist" containerID="693f6c0d46d043511d0f0824b40a6021d41e0646afe80d7fef3b5c5f0f6018b8" Jul 09 03:12:42.190327 ip-10-0-138-136 kubenswrapper[2583]: I0709 03:12:42.190287 2583 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"693f6c0d46d043511d0f0824b40a6021d41e0646afe80d7fef3b5c5f0f6018b8"} err="failed to get container status \"693f6c0d46d043511d0f0824b40a6021d41e0646afe80d7fef3b5c5f0f6018b8\": rpc error: code = NotFound desc = could not find container \"693f6c0d46d043511d0f0824b40a6021d41e0646afe80d7fef3b5c5f0f6018b8\": container with ID starting with 693f6c0d46d043511d0f0824b40a6021d41e0646afe80d7fef3b5c5f0f6018b8 not found: ID does not exist" Jul 09 03:12:42.194196 ip-10-0-138-136 kubenswrapper[2583]: I0709 03:12:42.194174 2583 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-mt-28444007-openshift-default-6559d9f9-f6gl9"] Jul 09 03:12:42.199948 ip-10-0-138-136 kubenswrapper[2583]: I0709 03:12:42.199926 2583 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-mt-28444007-openshift-default-6559d9f9-f6gl9"] Jul 09 03:12:42.603408 ip-10-0-138-136 kubenswrapper[2583]: I0709 03:12:42.603372 2583 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="adaff86a-d6de-4b46-b25b-10adb35daa0f" path="/var/lib/kubelet/pods/adaff86a-d6de-4b46-b25b-10adb35daa0f/volumes" Jul 09 03:13:30.470636 ip-10-0-138-136 kubenswrapper[2583]: I0709 03:13:30.470605 2583 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-inf-a-cf3835-openshift-default-65f9bd477c-zsvfv"] Jul 09 03:13:30.471218 ip-10-0-138-136 kubenswrapper[2583]: I0709 03:13:30.470993 2583 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="adaff86a-d6de-4b46-b25b-10adb35daa0f" containerName="istio-proxy" Jul 09 03:13:30.471218 ip-10-0-138-136 kubenswrapper[2583]: I0709 03:13:30.471005 2583 state_mem.go:107] "Deleted CPUSet assignment" podUID="adaff86a-d6de-4b46-b25b-10adb35daa0f" containerName="istio-proxy" Jul 09 03:13:30.471218 ip-10-0-138-136 kubenswrapper[2583]: I0709 03:13:30.471027 2583 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="adaff86a-d6de-4b46-b25b-10adb35daa0f" containerName="istio-proxy" Jul 09 03:13:30.471218 ip-10-0-138-136 kubenswrapper[2583]: I0709 03:13:30.471032 2583 state_mem.go:107] "Deleted CPUSet assignment" podUID="adaff86a-d6de-4b46-b25b-10adb35daa0f" containerName="istio-proxy" Jul 09 03:13:30.471218 ip-10-0-138-136 kubenswrapper[2583]: I0709 03:13:30.471088 2583 memory_manager.go:368] "RemoveStaleState removing state" podUID="adaff86a-d6de-4b46-b25b-10adb35daa0f" containerName="istio-proxy" Jul 09 03:13:30.471218 ip-10-0-138-136 kubenswrapper[2583]: I0709 03:13:30.471094 2583 memory_manager.go:368] "RemoveStaleState removing state" podUID="adaff86a-d6de-4b46-b25b-10adb35daa0f" containerName="istio-proxy" Jul 09 03:13:30.474170 ip-10-0-138-136 kubenswrapper[2583]: I0709 03:13:30.474153 2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-inf-a-cf3835-openshift-default-65f9bd477c-zsvfv" Jul 09 03:13:30.476363 ip-10-0-138-136 kubenswrapper[2583]: I0709 03:13:30.476342 2583 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-inf-a-cf3835-openshift-default-dockercfg-5j6sf\"" Jul 09 03:13:30.484239 ip-10-0-138-136 kubenswrapper[2583]: I0709 03:13:30.484213 2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-inf-a-cf3835-openshift-default-65f9bd477c-zsvfv"] Jul 09 03:13:30.588312 ip-10-0-138-136 kubenswrapper[2583]: I0709 03:13:30.588278 2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/12a9288f-ba86-4315-8f0e-829d04a8f7cb-workload-socket\") pod \"e2e-inf-a-cf3835-openshift-default-65f9bd477c-zsvfv\" (UID: \"12a9288f-ba86-4315-8f0e-829d04a8f7cb\") " pod="openshift-ingress/e2e-inf-a-cf3835-openshift-default-65f9bd477c-zsvfv" Jul 09 03:13:30.588312 ip-10-0-138-136 kubenswrapper[2583]: I0709 03:13:30.588321 2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/12a9288f-ba86-4315-8f0e-829d04a8f7cb-istio-data\") pod \"e2e-inf-a-cf3835-openshift-default-65f9bd477c-zsvfv\" (UID: \"12a9288f-ba86-4315-8f0e-829d04a8f7cb\") " pod="openshift-ingress/e2e-inf-a-cf3835-openshift-default-65f9bd477c-zsvfv" Jul 09 03:13:30.588547 ip-10-0-138-136 kubenswrapper[2583]: I0709 03:13:30.588421 2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/12a9288f-ba86-4315-8f0e-829d04a8f7cb-istio-podinfo\") pod \"e2e-inf-a-cf3835-openshift-default-65f9bd477c-zsvfv\" (UID: \"12a9288f-ba86-4315-8f0e-829d04a8f7cb\") " pod="openshift-ingress/e2e-inf-a-cf3835-openshift-default-65f9bd477c-zsvfv" Jul 09 03:13:30.588547 ip-10-0-138-136 kubenswrapper[2583]: I0709 03:13:30.588481 2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/12a9288f-ba86-4315-8f0e-829d04a8f7cb-istio-envoy\") pod \"e2e-inf-a-cf3835-openshift-default-65f9bd477c-zsvfv\" (UID: \"12a9288f-ba86-4315-8f0e-829d04a8f7cb\") " pod="openshift-ingress/e2e-inf-a-cf3835-openshift-default-65f9bd477c-zsvfv" Jul 09 03:13:30.588547 ip-10-0-138-136 kubenswrapper[2583]: I0709 03:13:30.588504 2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/12a9288f-ba86-4315-8f0e-829d04a8f7cb-workload-certs\") pod \"e2e-inf-a-cf3835-openshift-default-65f9bd477c-zsvfv\" (UID: \"12a9288f-ba86-4315-8f0e-829d04a8f7cb\") " pod="openshift-ingress/e2e-inf-a-cf3835-openshift-default-65f9bd477c-zsvfv" Jul 09 03:13:30.588547 ip-10-0-138-136 kubenswrapper[2583]: I0709 03:13:30.588529 2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-m5wgd\" (UniqueName: \"kubernetes.io/projected/12a9288f-ba86-4315-8f0e-829d04a8f7cb-kube-api-access-m5wgd\") pod \"e2e-inf-a-cf3835-openshift-default-65f9bd477c-zsvfv\" (UID: \"12a9288f-ba86-4315-8f0e-829d04a8f7cb\") " pod="openshift-ingress/e2e-inf-a-cf3835-openshift-default-65f9bd477c-zsvfv" Jul 09 03:13:30.588748 ip-10-0-138-136 kubenswrapper[2583]: I0709 03:13:30.588559 2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/12a9288f-ba86-4315-8f0e-829d04a8f7cb-istiod-ca-cert\") pod \"e2e-inf-a-cf3835-openshift-default-65f9bd477c-zsvfv\" (UID: \"12a9288f-ba86-4315-8f0e-829d04a8f7cb\") " pod="openshift-ingress/e2e-inf-a-cf3835-openshift-default-65f9bd477c-zsvfv" Jul 09 03:13:30.588748 ip-10-0-138-136 kubenswrapper[2583]: I0709 03:13:30.588609 2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/12a9288f-ba86-4315-8f0e-829d04a8f7cb-istio-token\") pod \"e2e-inf-a-cf3835-openshift-default-65f9bd477c-zsvfv\" (UID: \"12a9288f-ba86-4315-8f0e-829d04a8f7cb\") " pod="openshift-ingress/e2e-inf-a-cf3835-openshift-default-65f9bd477c-zsvfv" Jul 09 03:13:30.588748 ip-10-0-138-136 kubenswrapper[2583]: I0709 03:13:30.588648 2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/12a9288f-ba86-4315-8f0e-829d04a8f7cb-credential-socket\") pod \"e2e-inf-a-cf3835-openshift-default-65f9bd477c-zsvfv\" (UID: \"12a9288f-ba86-4315-8f0e-829d04a8f7cb\") " pod="openshift-ingress/e2e-inf-a-cf3835-openshift-default-65f9bd477c-zsvfv" Jul 09 03:13:30.689726 ip-10-0-138-136 kubenswrapper[2583]: I0709 03:13:30.689683 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/12a9288f-ba86-4315-8f0e-829d04a8f7cb-istio-podinfo\") pod \"e2e-inf-a-cf3835-openshift-default-65f9bd477c-zsvfv\" (UID: \"12a9288f-ba86-4315-8f0e-829d04a8f7cb\") " pod="openshift-ingress/e2e-inf-a-cf3835-openshift-default-65f9bd477c-zsvfv" Jul 09 03:13:30.689934 ip-10-0-138-136 kubenswrapper[2583]: I0709 03:13:30.689751 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/12a9288f-ba86-4315-8f0e-829d04a8f7cb-istio-envoy\") pod \"e2e-inf-a-cf3835-openshift-default-65f9bd477c-zsvfv\" (UID: \"12a9288f-ba86-4315-8f0e-829d04a8f7cb\") " pod="openshift-ingress/e2e-inf-a-cf3835-openshift-default-65f9bd477c-zsvfv" Jul 09 03:13:30.689934 ip-10-0-138-136 kubenswrapper[2583]: I0709 03:13:30.689772 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/12a9288f-ba86-4315-8f0e-829d04a8f7cb-workload-certs\") pod \"e2e-inf-a-cf3835-openshift-default-65f9bd477c-zsvfv\" (UID: \"12a9288f-ba86-4315-8f0e-829d04a8f7cb\") " pod="openshift-ingress/e2e-inf-a-cf3835-openshift-default-65f9bd477c-zsvfv" Jul 09 03:13:30.689934 ip-10-0-138-136 kubenswrapper[2583]: I0709 03:13:30.689791 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-m5wgd\" (UniqueName: \"kubernetes.io/projected/12a9288f-ba86-4315-8f0e-829d04a8f7cb-kube-api-access-m5wgd\") pod \"e2e-inf-a-cf3835-openshift-default-65f9bd477c-zsvfv\" (UID: \"12a9288f-ba86-4315-8f0e-829d04a8f7cb\") " pod="openshift-ingress/e2e-inf-a-cf3835-openshift-default-65f9bd477c-zsvfv" Jul 09 03:13:30.689934 ip-10-0-138-136 kubenswrapper[2583]: I0709 03:13:30.689832 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/12a9288f-ba86-4315-8f0e-829d04a8f7cb-istiod-ca-cert\") pod \"e2e-inf-a-cf3835-openshift-default-65f9bd477c-zsvfv\" (UID: \"12a9288f-ba86-4315-8f0e-829d04a8f7cb\") " pod="openshift-ingress/e2e-inf-a-cf3835-openshift-default-65f9bd477c-zsvfv" Jul 09 03:13:30.689934 ip-10-0-138-136 kubenswrapper[2583]: I0709 03:13:30.689856 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/12a9288f-ba86-4315-8f0e-829d04a8f7cb-istio-token\") pod \"e2e-inf-a-cf3835-openshift-default-65f9bd477c-zsvfv\" (UID: \"12a9288f-ba86-4315-8f0e-829d04a8f7cb\") " pod="openshift-ingress/e2e-inf-a-cf3835-openshift-default-65f9bd477c-zsvfv" Jul 09 03:13:30.689934 ip-10-0-138-136 kubenswrapper[2583]: I0709 03:13:30.689913 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/12a9288f-ba86-4315-8f0e-829d04a8f7cb-credential-socket\") pod \"e2e-inf-a-cf3835-openshift-default-65f9bd477c-zsvfv\" (UID: \"12a9288f-ba86-4315-8f0e-829d04a8f7cb\") " pod="openshift-ingress/e2e-inf-a-cf3835-openshift-default-65f9bd477c-zsvfv" Jul 09 03:13:30.690291 ip-10-0-138-136 kubenswrapper[2583]: I0709 03:13:30.689972 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/12a9288f-ba86-4315-8f0e-829d04a8f7cb-workload-socket\") pod \"e2e-inf-a-cf3835-openshift-default-65f9bd477c-zsvfv\" (UID: \"12a9288f-ba86-4315-8f0e-829d04a8f7cb\") " pod="openshift-ingress/e2e-inf-a-cf3835-openshift-default-65f9bd477c-zsvfv" Jul 09 03:13:30.690291 ip-10-0-138-136 kubenswrapper[2583]: I0709 03:13:30.690004 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/12a9288f-ba86-4315-8f0e-829d04a8f7cb-istio-data\") pod \"e2e-inf-a-cf3835-openshift-default-65f9bd477c-zsvfv\" (UID: \"12a9288f-ba86-4315-8f0e-829d04a8f7cb\") " pod="openshift-ingress/e2e-inf-a-cf3835-openshift-default-65f9bd477c-zsvfv" Jul 09 03:13:30.690391 ip-10-0-138-136 kubenswrapper[2583]: I0709 03:13:30.690319 2583 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/12a9288f-ba86-4315-8f0e-829d04a8f7cb-credential-socket\") pod \"e2e-inf-a-cf3835-openshift-default-65f9bd477c-zsvfv\" (UID: \"12a9288f-ba86-4315-8f0e-829d04a8f7cb\") " pod="openshift-ingress/e2e-inf-a-cf3835-openshift-default-65f9bd477c-zsvfv" Jul 09 03:13:30.690544 ip-10-0-138-136 kubenswrapper[2583]: I0709 03:13:30.690520 2583 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/12a9288f-ba86-4315-8f0e-829d04a8f7cb-istio-data\") pod \"e2e-inf-a-cf3835-openshift-default-65f9bd477c-zsvfv\" (UID: \"12a9288f-ba86-4315-8f0e-829d04a8f7cb\") " pod="openshift-ingress/e2e-inf-a-cf3835-openshift-default-65f9bd477c-zsvfv" Jul 09 03:13:30.690604 ip-10-0-138-136 kubenswrapper[2583]: I0709 03:13:30.690562 2583 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/12a9288f-ba86-4315-8f0e-829d04a8f7cb-workload-certs\") pod \"e2e-inf-a-cf3835-openshift-default-65f9bd477c-zsvfv\" (UID: \"12a9288f-ba86-4315-8f0e-829d04a8f7cb\") " pod="openshift-ingress/e2e-inf-a-cf3835-openshift-default-65f9bd477c-zsvfv" Jul 09 03:13:30.690661 ip-10-0-138-136 kubenswrapper[2583]: I0709 03:13:30.690620 2583 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/12a9288f-ba86-4315-8f0e-829d04a8f7cb-workload-socket\") pod \"e2e-inf-a-cf3835-openshift-default-65f9bd477c-zsvfv\" (UID: \"12a9288f-ba86-4315-8f0e-829d04a8f7cb\") " pod="openshift-ingress/e2e-inf-a-cf3835-openshift-default-65f9bd477c-zsvfv" Jul 09 03:13:30.691043 ip-10-0-138-136 kubenswrapper[2583]: I0709 03:13:30.691017 2583 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/12a9288f-ba86-4315-8f0e-829d04a8f7cb-istiod-ca-cert\") pod \"e2e-inf-a-cf3835-openshift-default-65f9bd477c-zsvfv\" (UID: \"12a9288f-ba86-4315-8f0e-829d04a8f7cb\") " pod="openshift-ingress/e2e-inf-a-cf3835-openshift-default-65f9bd477c-zsvfv" Jul 09 03:13:30.692323 ip-10-0-138-136 kubenswrapper[2583]: I0709 03:13:30.692302 2583 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/12a9288f-ba86-4315-8f0e-829d04a8f7cb-istio-envoy\") pod \"e2e-inf-a-cf3835-openshift-default-65f9bd477c-zsvfv\" (UID: \"12a9288f-ba86-4315-8f0e-829d04a8f7cb\") " pod="openshift-ingress/e2e-inf-a-cf3835-openshift-default-65f9bd477c-zsvfv" Jul 09 03:13:30.692424 ip-10-0-138-136 kubenswrapper[2583]: I0709 03:13:30.692342 2583 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/12a9288f-ba86-4315-8f0e-829d04a8f7cb-istio-podinfo\") pod \"e2e-inf-a-cf3835-openshift-default-65f9bd477c-zsvfv\" (UID: \"12a9288f-ba86-4315-8f0e-829d04a8f7cb\") " pod="openshift-ingress/e2e-inf-a-cf3835-openshift-default-65f9bd477c-zsvfv" Jul 09 03:13:30.697472 ip-10-0-138-136 kubenswrapper[2583]: I0709 03:13:30.697449 2583 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/12a9288f-ba86-4315-8f0e-829d04a8f7cb-istio-token\") pod \"e2e-inf-a-cf3835-openshift-default-65f9bd477c-zsvfv\" (UID: \"12a9288f-ba86-4315-8f0e-829d04a8f7cb\") " pod="openshift-ingress/e2e-inf-a-cf3835-openshift-default-65f9bd477c-zsvfv" Jul 09 03:13:30.697755 ip-10-0-138-136 kubenswrapper[2583]: I0709 03:13:30.697705 2583 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-m5wgd\" (UniqueName: \"kubernetes.io/projected/12a9288f-ba86-4315-8f0e-829d04a8f7cb-kube-api-access-m5wgd\") pod \"e2e-inf-a-cf3835-openshift-default-65f9bd477c-zsvfv\" (UID: \"12a9288f-ba86-4315-8f0e-829d04a8f7cb\") " pod="openshift-ingress/e2e-inf-a-cf3835-openshift-default-65f9bd477c-zsvfv" Jul 09 03:13:30.785567 ip-10-0-138-136 kubenswrapper[2583]: I0709 03:13:30.785539 2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-inf-a-cf3835-openshift-default-65f9bd477c-zsvfv" Jul 09 03:13:30.923869 ip-10-0-138-136 kubenswrapper[2583]: I0709 03:13:30.923799 2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-inf-a-cf3835-openshift-default-65f9bd477c-zsvfv"] Jul 09 03:13:30.926271 ip-10-0-138-136 kubenswrapper[2583]: W0709 03:13:30.926230 2583 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod12a9288f_ba86_4315_8f0e_829d04a8f7cb.slice/crio-08d1c4e7669c28ea3418ef73f7e2e7e9f85837b904f40fcefb3abc9e071f37c2 WatchSource:0}: Error finding container 08d1c4e7669c28ea3418ef73f7e2e7e9f85837b904f40fcefb3abc9e071f37c2: Status 404 returned error can't find the container with id 08d1c4e7669c28ea3418ef73f7e2e7e9f85837b904f40fcefb3abc9e071f37c2 Jul 09 03:13:30.928418 ip-10-0-138-136 kubenswrapper[2583]: I0709 03:13:30.928385 2583 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236232Ki","pods":"250"} Jul 09 03:13:30.928497 ip-10-0-138-136 kubenswrapper[2583]: I0709 03:13:30.928452 2583 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236232Ki","pods":"250"} Jul 09 03:13:30.928497 ip-10-0-138-136 kubenswrapper[2583]: I0709 03:13:30.928486 2583 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236232Ki","pods":"250"} Jul 09 03:13:31.415596 ip-10-0-138-136 kubenswrapper[2583]: I0709 03:13:31.415560 2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-inf-a-cf3835-openshift-default-65f9bd477c-zsvfv" event={"ID":"12a9288f-ba86-4315-8f0e-829d04a8f7cb","Type":"ContainerStarted","Data":"adee891b6889a1fa27ecbb76d1dc3ceef5fb1ecda4a9df7b07b209cdb018bf88"} Jul 09 03:13:31.415767 ip-10-0-138-136 kubenswrapper[2583]: I0709 03:13:31.415617 2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-inf-a-cf3835-openshift-default-65f9bd477c-zsvfv" event={"ID":"12a9288f-ba86-4315-8f0e-829d04a8f7cb","Type":"ContainerStarted","Data":"08d1c4e7669c28ea3418ef73f7e2e7e9f85837b904f40fcefb3abc9e071f37c2"} Jul 09 03:13:31.439735 ip-10-0-138-136 kubenswrapper[2583]: I0709 03:13:31.435427 2583 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-inf-a-cf3835-openshift-default-65f9bd477c-zsvfv" podStartSLOduration=1.435406637 podStartE2EDuration="1.435406637s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-09 03:13:30 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-09 03:13:31.432654275 +0000 UTC m=+2357.365111774" watchObservedRunningTime="2026-07-09 03:13:31.435406637 +0000 UTC m=+2357.367864125" Jul 09 03:13:31.786103 ip-10-0-138-136 kubenswrapper[2583]: I0709 03:13:31.786068 2583 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-inf-a-cf3835-openshift-default-65f9bd477c-zsvfv" Jul 09 03:13:31.791143 ip-10-0-138-136 kubenswrapper[2583]: I0709 03:13:31.791107 2583 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-inf-a-cf3835-openshift-default-65f9bd477c-zsvfv" Jul 09 03:13:32.421006 ip-10-0-138-136 kubenswrapper[2583]: I0709 03:13:32.420978 2583 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-inf-a-cf3835-openshift-default-65f9bd477c-zsvfv" Jul 09 03:13:32.421922 ip-10-0-138-136 kubenswrapper[2583]: I0709 03:13:32.421903 2583 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-inf-a-cf3835-openshift-default-65f9bd477c-zsvfv" Jul 09 03:13:48.462887 ip-10-0-138-136 kubenswrapper[2583]: I0709 03:13:48.462845 2583 patch_prober.go:28] interesting pod/e2e-inf-a-cf3835-openshift-default-65f9bd477c-zsvfv container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="Get \"http://10.132.0.49:15021/healthz/ready\": context deadline exceeded (Client.Timeout exceeded while awaiting headers)" start-of-body= Jul 09 03:13:48.463436 ip-10-0-138-136 kubenswrapper[2583]: I0709 03:13:48.462918 2583 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/e2e-inf-a-cf3835-openshift-default-65f9bd477c-zsvfv" podUID="12a9288f-ba86-4315-8f0e-829d04a8f7cb" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.49:15021/healthz/ready\": context deadline exceeded (Client.Timeout exceeded while awaiting headers)" Jul 09 03:13:49.517981 ip-10-0-138-136 kubenswrapper[2583]: I0709 03:13:49.517945 2583 generic.go:356] "Generic (PLEG): container finished" podID="12a9288f-ba86-4315-8f0e-829d04a8f7cb" containerID="adee891b6889a1fa27ecbb76d1dc3ceef5fb1ecda4a9df7b07b209cdb018bf88" exitCode=0 Jul 09 03:13:49.518387 ip-10-0-138-136 kubenswrapper[2583]: I0709 03:13:49.518011 2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-inf-a-cf3835-openshift-default-65f9bd477c-zsvfv" event={"ID":"12a9288f-ba86-4315-8f0e-829d04a8f7cb","Type":"ContainerDied","Data":"adee891b6889a1fa27ecbb76d1dc3ceef5fb1ecda4a9df7b07b209cdb018bf88"} Jul 09 03:13:49.518480 ip-10-0-138-136 kubenswrapper[2583]: I0709 03:13:49.518464 2583 scope.go:117] "RemoveContainer" containerID="adee891b6889a1fa27ecbb76d1dc3ceef5fb1ecda4a9df7b07b209cdb018bf88" Jul 09 03:13:49.519603 ip-10-0-138-136 kubenswrapper[2583]: I0709 03:13:49.519574 2583 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236232Ki","pods":"250"} Jul 09 03:13:49.519663 ip-10-0-138-136 kubenswrapper[2583]: I0709 03:13:49.519642 2583 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236232Ki","pods":"250"} Jul 09 03:13:49.519707 ip-10-0-138-136 kubenswrapper[2583]: I0709 03:13:49.519677 2583 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236232Ki","pods":"250"} Jul 09 03:13:50.524343 ip-10-0-138-136 kubenswrapper[2583]: I0709 03:13:50.524310 2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-inf-a-cf3835-openshift-default-65f9bd477c-zsvfv" event={"ID":"12a9288f-ba86-4315-8f0e-829d04a8f7cb","Type":"ContainerStarted","Data":"a9f45e04cd9fcab100414354e354c6b21f6417a286198798a3f50c38c35ee43b"} Jul 09 03:13:50.786330 ip-10-0-138-136 kubenswrapper[2583]: I0709 03:13:50.786236 2583 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-inf-a-cf3835-openshift-default-65f9bd477c-zsvfv" Jul 09 03:13:50.786575 ip-10-0-138-136 kubenswrapper[2583]: I0709 03:13:50.786552 2583 patch_prober.go:28] interesting pod/e2e-inf-a-cf3835-openshift-default-65f9bd477c-zsvfv container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.49:15021/healthz/ready\": dial tcp 10.132.0.49:15021: connect: connection refused" start-of-body= Jul 09 03:13:50.786662 ip-10-0-138-136 kubenswrapper[2583]: I0709 03:13:50.786602 2583 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-inf-a-cf3835-openshift-default-65f9bd477c-zsvfv" podUID="12a9288f-ba86-4315-8f0e-829d04a8f7cb" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.49:15021/healthz/ready\": dial tcp 10.132.0.49:15021: connect: connection refused" Jul 09 03:13:51.786157 ip-10-0-138-136 kubenswrapper[2583]: I0709 03:13:51.786123 2583 patch_prober.go:28] interesting pod/e2e-inf-a-cf3835-openshift-default-65f9bd477c-zsvfv container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.49:15021/healthz/ready\": dial tcp 10.132.0.49:15021: connect: connection refused" start-of-body= Jul 09 03:13:51.786535 ip-10-0-138-136 kubenswrapper[2583]: I0709 03:13:51.786182 2583 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-inf-a-cf3835-openshift-default-65f9bd477c-zsvfv" podUID="12a9288f-ba86-4315-8f0e-829d04a8f7cb" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.49:15021/healthz/ready\": dial tcp 10.132.0.49:15021: connect: connection refused" Jul 09 03:13:52.786886 ip-10-0-138-136 kubenswrapper[2583]: I0709 03:13:52.786851 2583 patch_prober.go:28] interesting pod/e2e-inf-a-cf3835-openshift-default-65f9bd477c-zsvfv container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.49:15021/healthz/ready\": dial tcp 10.132.0.49:15021: connect: connection refused" start-of-body= Jul 09 03:13:52.787276 ip-10-0-138-136 kubenswrapper[2583]: I0709 03:13:52.786907 2583 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-inf-a-cf3835-openshift-default-65f9bd477c-zsvfv" podUID="12a9288f-ba86-4315-8f0e-829d04a8f7cb" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.49:15021/healthz/ready\": dial tcp 10.132.0.49:15021: connect: connection refused" Jul 09 03:13:53.786150 ip-10-0-138-136 kubenswrapper[2583]: I0709 03:13:53.786110 2583 patch_prober.go:28] interesting pod/e2e-inf-a-cf3835-openshift-default-65f9bd477c-zsvfv container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.49:15021/healthz/ready\": dial tcp 10.132.0.49:15021: connect: connection refused" start-of-body= Jul 09 03:13:53.786308 ip-10-0-138-136 kubenswrapper[2583]: I0709 03:13:53.786174 2583 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-inf-a-cf3835-openshift-default-65f9bd477c-zsvfv" podUID="12a9288f-ba86-4315-8f0e-829d04a8f7cb" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.49:15021/healthz/ready\": dial tcp 10.132.0.49:15021: connect: connection refused" Jul 09 03:13:54.789861 ip-10-0-138-136 kubenswrapper[2583]: I0709 03:13:54.789832 2583 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-inf-a-cf3835-openshift-default-65f9bd477c-zsvfv" Jul 09 03:13:54.790268 ip-10-0-138-136 kubenswrapper[2583]: I0709 03:13:54.790216 2583 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-inf-a-cf3835-openshift-default-65f9bd477c-zsvfv" Jul 09 03:13:54.790878 ip-10-0-138-136 kubenswrapper[2583]: I0709 03:13:54.790857 2583 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-inf-a-cf3835-openshift-default-65f9bd477c-zsvfv" Jul 09 03:14:14.718360 ip-10-0-138-136 kubenswrapper[2583]: I0709 03:14:14.718331 2583 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-68b757fb67-xpjsj_188e21f3-2ce9-4012-ada2-a46c32d56729/console-operator/1.log" Jul 09 03:14:14.724967 ip-10-0-138-136 kubenswrapper[2583]: I0709 03:14:14.724946 2583 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-68b757fb67-xpjsj_188e21f3-2ce9-4012-ada2-a46c32d56729/console-operator/1.log" Jul 09 03:15:42.767656 ip-10-0-138-136 kubenswrapper[2583]: I0709 03:15:42.767623 2583 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-inf-a-cf3835-openshift-default-65f9bd477c-zsvfv"] Jul 09 03:15:42.768167 ip-10-0-138-136 kubenswrapper[2583]: I0709 03:15:42.767871 2583 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-ingress/e2e-inf-a-cf3835-openshift-default-65f9bd477c-zsvfv" podUID="12a9288f-ba86-4315-8f0e-829d04a8f7cb" containerName="istio-proxy" containerID="cri-o://a9f45e04cd9fcab100414354e354c6b21f6417a286198798a3f50c38c35ee43b" gracePeriod=30 Jul 09 03:15:48.033563 ip-10-0-138-136 kubenswrapper[2583]: I0709 03:15:48.033502 2583 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-inf-a-cf3835-openshift-default-65f9bd477c-zsvfv" Jul 09 03:15:48.116075 ip-10-0-138-136 kubenswrapper[2583]: I0709 03:15:48.116043 2583 generic.go:356] "Generic (PLEG): container finished" podID="12a9288f-ba86-4315-8f0e-829d04a8f7cb" containerID="a9f45e04cd9fcab100414354e354c6b21f6417a286198798a3f50c38c35ee43b" exitCode=0 Jul 09 03:15:48.116232 ip-10-0-138-136 kubenswrapper[2583]: I0709 03:15:48.116089 2583 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-inf-a-cf3835-openshift-default-65f9bd477c-zsvfv" Jul 09 03:15:48.116232 ip-10-0-138-136 kubenswrapper[2583]: I0709 03:15:48.116114 2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-inf-a-cf3835-openshift-default-65f9bd477c-zsvfv" event={"ID":"12a9288f-ba86-4315-8f0e-829d04a8f7cb","Type":"ContainerDied","Data":"a9f45e04cd9fcab100414354e354c6b21f6417a286198798a3f50c38c35ee43b"} Jul 09 03:15:48.116232 ip-10-0-138-136 kubenswrapper[2583]: I0709 03:15:48.116181 2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-inf-a-cf3835-openshift-default-65f9bd477c-zsvfv" event={"ID":"12a9288f-ba86-4315-8f0e-829d04a8f7cb","Type":"ContainerDied","Data":"08d1c4e7669c28ea3418ef73f7e2e7e9f85837b904f40fcefb3abc9e071f37c2"} Jul 09 03:15:48.116232 ip-10-0-138-136 kubenswrapper[2583]: I0709 03:15:48.116204 2583 scope.go:117] "RemoveContainer" containerID="a9f45e04cd9fcab100414354e354c6b21f6417a286198798a3f50c38c35ee43b" Jul 09 03:15:48.124776 ip-10-0-138-136 kubenswrapper[2583]: I0709 03:15:48.124758 2583 scope.go:117] "RemoveContainer" containerID="adee891b6889a1fa27ecbb76d1dc3ceef5fb1ecda4a9df7b07b209cdb018bf88" Jul 09 03:15:48.132724 ip-10-0-138-136 kubenswrapper[2583]: I0709 03:15:48.132698 2583 scope.go:117] "RemoveContainer" containerID="a9f45e04cd9fcab100414354e354c6b21f6417a286198798a3f50c38c35ee43b" Jul 09 03:15:48.132992 ip-10-0-138-136 kubenswrapper[2583]: E0709 03:15:48.132971 2583 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"a9f45e04cd9fcab100414354e354c6b21f6417a286198798a3f50c38c35ee43b\": container with ID starting with a9f45e04cd9fcab100414354e354c6b21f6417a286198798a3f50c38c35ee43b not found: ID does not exist" containerID="a9f45e04cd9fcab100414354e354c6b21f6417a286198798a3f50c38c35ee43b" Jul 09 03:15:48.133040 ip-10-0-138-136 kubenswrapper[2583]: I0709 03:15:48.133001 2583 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"a9f45e04cd9fcab100414354e354c6b21f6417a286198798a3f50c38c35ee43b"} err="failed to get container status \"a9f45e04cd9fcab100414354e354c6b21f6417a286198798a3f50c38c35ee43b\": rpc error: code = NotFound desc = could not find container \"a9f45e04cd9fcab100414354e354c6b21f6417a286198798a3f50c38c35ee43b\": container with ID starting with a9f45e04cd9fcab100414354e354c6b21f6417a286198798a3f50c38c35ee43b not found: ID does not exist" Jul 09 03:15:48.133040 ip-10-0-138-136 kubenswrapper[2583]: I0709 03:15:48.133017 2583 scope.go:117] "RemoveContainer" containerID="adee891b6889a1fa27ecbb76d1dc3ceef5fb1ecda4a9df7b07b209cdb018bf88" Jul 09 03:15:48.133225 ip-10-0-138-136 kubenswrapper[2583]: E0709 03:15:48.133211 2583 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"adee891b6889a1fa27ecbb76d1dc3ceef5fb1ecda4a9df7b07b209cdb018bf88\": container with ID starting with adee891b6889a1fa27ecbb76d1dc3ceef5fb1ecda4a9df7b07b209cdb018bf88 not found: ID does not exist" containerID="adee891b6889a1fa27ecbb76d1dc3ceef5fb1ecda4a9df7b07b209cdb018bf88" Jul 09 03:15:48.133265 ip-10-0-138-136 kubenswrapper[2583]: I0709 03:15:48.133227 2583 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"adee891b6889a1fa27ecbb76d1dc3ceef5fb1ecda4a9df7b07b209cdb018bf88"} err="failed to get container status \"adee891b6889a1fa27ecbb76d1dc3ceef5fb1ecda4a9df7b07b209cdb018bf88\": rpc error: code = NotFound desc = could not find container \"adee891b6889a1fa27ecbb76d1dc3ceef5fb1ecda4a9df7b07b209cdb018bf88\": container with ID starting with adee891b6889a1fa27ecbb76d1dc3ceef5fb1ecda4a9df7b07b209cdb018bf88 not found: ID does not exist" Jul 09 03:15:48.205762 ip-10-0-138-136 kubenswrapper[2583]: I0709 03:15:48.205706 2583 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/12a9288f-ba86-4315-8f0e-829d04a8f7cb-istio-data\") pod \"12a9288f-ba86-4315-8f0e-829d04a8f7cb\" (UID: \"12a9288f-ba86-4315-8f0e-829d04a8f7cb\") " Jul 09 03:15:48.205917 ip-10-0-138-136 kubenswrapper[2583]: I0709 03:15:48.205780 2583 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-m5wgd\" (UniqueName: \"kubernetes.io/projected/12a9288f-ba86-4315-8f0e-829d04a8f7cb-kube-api-access-m5wgd\") pod \"12a9288f-ba86-4315-8f0e-829d04a8f7cb\" (UID: \"12a9288f-ba86-4315-8f0e-829d04a8f7cb\") " Jul 09 03:15:48.205917 ip-10-0-138-136 kubenswrapper[2583]: I0709 03:15:48.205817 2583 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/12a9288f-ba86-4315-8f0e-829d04a8f7cb-istio-podinfo\") pod \"12a9288f-ba86-4315-8f0e-829d04a8f7cb\" (UID: \"12a9288f-ba86-4315-8f0e-829d04a8f7cb\") " Jul 09 03:15:48.205917 ip-10-0-138-136 kubenswrapper[2583]: I0709 03:15:48.205835 2583 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/12a9288f-ba86-4315-8f0e-829d04a8f7cb-istio-envoy\") pod \"12a9288f-ba86-4315-8f0e-829d04a8f7cb\" (UID: \"12a9288f-ba86-4315-8f0e-829d04a8f7cb\") " Jul 09 03:15:48.205917 ip-10-0-138-136 kubenswrapper[2583]: I0709 03:15:48.205875 2583 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/12a9288f-ba86-4315-8f0e-829d04a8f7cb-istiod-ca-cert\") pod \"12a9288f-ba86-4315-8f0e-829d04a8f7cb\" (UID: \"12a9288f-ba86-4315-8f0e-829d04a8f7cb\") " Jul 09 03:15:48.205917 ip-10-0-138-136 kubenswrapper[2583]: I0709 03:15:48.205903 2583 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/12a9288f-ba86-4315-8f0e-829d04a8f7cb-credential-socket\") pod \"12a9288f-ba86-4315-8f0e-829d04a8f7cb\" (UID: \"12a9288f-ba86-4315-8f0e-829d04a8f7cb\") " Jul 09 03:15:48.206177 ip-10-0-138-136 kubenswrapper[2583]: I0709 03:15:48.205925 2583 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/12a9288f-ba86-4315-8f0e-829d04a8f7cb-istio-token\") pod \"12a9288f-ba86-4315-8f0e-829d04a8f7cb\" (UID: \"12a9288f-ba86-4315-8f0e-829d04a8f7cb\") " Jul 09 03:15:48.206177 ip-10-0-138-136 kubenswrapper[2583]: I0709 03:15:48.205999 2583 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/12a9288f-ba86-4315-8f0e-829d04a8f7cb-workload-socket\") pod \"12a9288f-ba86-4315-8f0e-829d04a8f7cb\" (UID: \"12a9288f-ba86-4315-8f0e-829d04a8f7cb\") " Jul 09 03:15:48.206177 ip-10-0-138-136 kubenswrapper[2583]: I0709 03:15:48.206049 2583 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/12a9288f-ba86-4315-8f0e-829d04a8f7cb-workload-certs\") pod \"12a9288f-ba86-4315-8f0e-829d04a8f7cb\" (UID: \"12a9288f-ba86-4315-8f0e-829d04a8f7cb\") " Jul 09 03:15:48.206335 ip-10-0-138-136 kubenswrapper[2583]: I0709 03:15:48.206226 2583 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/12a9288f-ba86-4315-8f0e-829d04a8f7cb-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "12a9288f-ba86-4315-8f0e-829d04a8f7cb" (UID: "12a9288f-ba86-4315-8f0e-829d04a8f7cb"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 09 03:15:48.206398 ip-10-0-138-136 kubenswrapper[2583]: I0709 03:15:48.206339 2583 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/12a9288f-ba86-4315-8f0e-829d04a8f7cb-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "12a9288f-ba86-4315-8f0e-829d04a8f7cb" (UID: "12a9288f-ba86-4315-8f0e-829d04a8f7cb"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 09 03:15:48.206477 ip-10-0-138-136 kubenswrapper[2583]: I0709 03:15:48.206448 2583 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/12a9288f-ba86-4315-8f0e-829d04a8f7cb-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "12a9288f-ba86-4315-8f0e-829d04a8f7cb" (UID: "12a9288f-ba86-4315-8f0e-829d04a8f7cb"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 09 03:15:48.206603 ip-10-0-138-136 kubenswrapper[2583]: I0709 03:15:48.206486 2583 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/12a9288f-ba86-4315-8f0e-829d04a8f7cb-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "12a9288f-ba86-4315-8f0e-829d04a8f7cb" (UID: "12a9288f-ba86-4315-8f0e-829d04a8f7cb"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 09 03:15:48.206603 ip-10-0-138-136 kubenswrapper[2583]: I0709 03:15:48.206507 2583 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/12a9288f-ba86-4315-8f0e-829d04a8f7cb-istiod-ca-cert\") on node \"ip-10-0-138-136.ec2.internal\" DevicePath \"\"" Jul 09 03:15:48.206603 ip-10-0-138-136 kubenswrapper[2583]: I0709 03:15:48.206530 2583 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/12a9288f-ba86-4315-8f0e-829d04a8f7cb-credential-socket\") on node \"ip-10-0-138-136.ec2.internal\" DevicePath \"\"" Jul 09 03:15:48.206811 ip-10-0-138-136 kubenswrapper[2583]: I0709 03:15:48.206640 2583 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/12a9288f-ba86-4315-8f0e-829d04a8f7cb-istio-data" (OuterVolumeSpecName: "istio-data") pod "12a9288f-ba86-4315-8f0e-829d04a8f7cb" (UID: "12a9288f-ba86-4315-8f0e-829d04a8f7cb"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 09 03:15:48.208155 ip-10-0-138-136 kubenswrapper[2583]: I0709 03:15:48.208124 2583 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/12a9288f-ba86-4315-8f0e-829d04a8f7cb-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "12a9288f-ba86-4315-8f0e-829d04a8f7cb" (UID: "12a9288f-ba86-4315-8f0e-829d04a8f7cb"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 09 03:15:48.208264 ip-10-0-138-136 kubenswrapper[2583]: I0709 03:15:48.208226 2583 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/12a9288f-ba86-4315-8f0e-829d04a8f7cb-istio-token" (OuterVolumeSpecName: "istio-token") pod "12a9288f-ba86-4315-8f0e-829d04a8f7cb" (UID: "12a9288f-ba86-4315-8f0e-829d04a8f7cb"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 09 03:15:48.208320 ip-10-0-138-136 kubenswrapper[2583]: I0709 03:15:48.208257 2583 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/12a9288f-ba86-4315-8f0e-829d04a8f7cb-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "12a9288f-ba86-4315-8f0e-829d04a8f7cb" (UID: "12a9288f-ba86-4315-8f0e-829d04a8f7cb"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue "" Jul 09 03:15:48.208482 ip-10-0-138-136 kubenswrapper[2583]: I0709 03:15:48.208464 2583 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/12a9288f-ba86-4315-8f0e-829d04a8f7cb-kube-api-access-m5wgd" (OuterVolumeSpecName: "kube-api-access-m5wgd") pod "12a9288f-ba86-4315-8f0e-829d04a8f7cb" (UID: "12a9288f-ba86-4315-8f0e-829d04a8f7cb"). InnerVolumeSpecName "kube-api-access-m5wgd". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 09 03:15:48.307544 ip-10-0-138-136 kubenswrapper[2583]: I0709 03:15:48.307470 2583 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/12a9288f-ba86-4315-8f0e-829d04a8f7cb-istio-podinfo\") on node \"ip-10-0-138-136.ec2.internal\" DevicePath \"\"" Jul 09 03:15:48.307544 ip-10-0-138-136 kubenswrapper[2583]: I0709 03:15:48.307496 2583 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/12a9288f-ba86-4315-8f0e-829d04a8f7cb-istio-envoy\") on node \"ip-10-0-138-136.ec2.internal\" DevicePath \"\"" Jul 09 03:15:48.307544 ip-10-0-138-136 kubenswrapper[2583]: I0709 03:15:48.307510 2583 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/12a9288f-ba86-4315-8f0e-829d04a8f7cb-istio-token\") on node \"ip-10-0-138-136.ec2.internal\" DevicePath \"\"" Jul 09 03:15:48.307544 ip-10-0-138-136 kubenswrapper[2583]: I0709 03:15:48.307524 2583 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/12a9288f-ba86-4315-8f0e-829d04a8f7cb-workload-socket\") on node \"ip-10-0-138-136.ec2.internal\" DevicePath \"\"" Jul 09 03:15:48.307544 ip-10-0-138-136 kubenswrapper[2583]: I0709 03:15:48.307537 2583 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/12a9288f-ba86-4315-8f0e-829d04a8f7cb-workload-certs\") on node \"ip-10-0-138-136.ec2.internal\" DevicePath \"\"" Jul 09 03:15:48.307822 ip-10-0-138-136 kubenswrapper[2583]: I0709 03:15:48.307549 2583 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/12a9288f-ba86-4315-8f0e-829d04a8f7cb-istio-data\") on node \"ip-10-0-138-136.ec2.internal\" DevicePath \"\"" Jul 09 03:15:48.307822 ip-10-0-138-136 kubenswrapper[2583]: I0709 03:15:48.307561 2583 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-m5wgd\" (UniqueName: \"kubernetes.io/projected/12a9288f-ba86-4315-8f0e-829d04a8f7cb-kube-api-access-m5wgd\") on node \"ip-10-0-138-136.ec2.internal\" DevicePath \"\"" Jul 09 03:15:48.439041 ip-10-0-138-136 kubenswrapper[2583]: I0709 03:15:48.439016 2583 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-inf-a-cf3835-openshift-default-65f9bd477c-zsvfv"] Jul 09 03:15:48.440767 ip-10-0-138-136 kubenswrapper[2583]: I0709 03:15:48.440748 2583 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-inf-a-cf3835-openshift-default-65f9bd477c-zsvfv"] Jul 09 03:15:48.603071 ip-10-0-138-136 kubenswrapper[2583]: I0709 03:15:48.602983 2583 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="12a9288f-ba86-4315-8f0e-829d04a8f7cb" path="/var/lib/kubelet/pods/12a9288f-ba86-4315-8f0e-829d04a8f7cb/volumes" Jul 09 03:19:14.749404 ip-10-0-138-136 kubenswrapper[2583]: I0709 03:19:14.749375 2583 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-68b757fb67-xpjsj_188e21f3-2ce9-4012-ada2-a46c32d56729/console-operator/1.log" Jul 09 03:19:14.757158 ip-10-0-138-136 kubenswrapper[2583]: I0709 03:19:14.757131 2583 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-68b757fb67-xpjsj_188e21f3-2ce9-4012-ada2-a46c32d56729/console-operator/1.log" Jul 09 03:19:14.884689 ip-10-0-138-136 kubenswrapper[2583]: I0709 03:19:14.884665 2583 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_kserve-controller-manager-d6f4b65b8-8nz2f_16abf7a1-5d49-42f8-99d1-301d35e2bf2e/manager/0.log" Jul 09 03:19:15.001569 ip-10-0-138-136 kubenswrapper[2583]: I0709 03:19:15.001509 2583 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_llmisvc-controller-manager-777c6bd7d5-x8kkg_628cfe58-d957-468b-a7bf-76ba45800999/manager/0.log" Jul 09 03:19:15.485215 ip-10-0-138-136 kubenswrapper[2583]: I0709 03:19:15.485193 2583 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-75df5ddb9c-7vqjd_addd875a-34b8-4179-b2fe-07eb377f16d2/copy-manifests/0.log" Jul 09 03:19:15.492069 ip-10-0-138-136 kubenswrapper[2583]: I0709 03:19:15.492050 2583 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-75df5ddb9c-7vqjd_addd875a-34b8-4179-b2fe-07eb377f16d2/manager/0.log" Jul 09 03:19:18.149568 ip-10-0-138-136 kubenswrapper[2583]: I0709 03:19:18.149489 2583 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_data-science-gateway-data-science-gateway-class-6576859cf4jzfbc_c13f6261-b1d7-4f9a-9558-ab4f300de9b0/istio-proxy/0.log" Jul 09 03:19:18.602574 ip-10-0-138-136 kubenswrapper[2583]: I0709 03:19:18.602537 2583 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_maas-default-gateway-openshift-default-56654dcf7-vpc97_438605c5-c5d5-45c4-833b-7217e9314705/istio-proxy/1.log" Jul 09 03:19:18.951473 ip-10-0-138-136 kubenswrapper[2583]: I0709 03:19:18.951402 2583 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_router-default-6575bfb5cc-2ttlz_49f19d77-82e8-419b-a88b-09c9ee4354a8/router/0.log" Jul 09 03:19:19.288601 ip-10-0-138-136 kubenswrapper[2583]: I0709 03:19:19.288576 2583 log.go:25] "Finished parsing log file" path="/var/log/pods/llm_e2e-distinct-2-simulated-kserve-67d8d5d6d-l5pmn_19da2ac8-d8f8-4d55-8e97-09940d2ac33e/main/0.log" Jul 09 03:19:19.504887 ip-10-0-138-136 kubenswrapper[2583]: I0709 03:19:19.504860 2583 log.go:25] "Finished parsing log file" path="/var/log/pods/llm_e2e-trlp-test-simulated-kserve-598466548d-mnmjq_d701f6c0-2693-4eb5-a448-e3ad8946d8ac/main/0.log" Jul 09 03:19:19.724549 ip-10-0-138-136 kubenswrapper[2583]: I0709 03:19:19.724487 2583 log.go:25] "Finished parsing log file" path="/var/log/pods/llm_facebook-opt-125m-simulated-kserve-74b68447df-8f4tj_f92f788f-4dc7-4964-86ec-afdb697712a2/main/0.log" Jul 09 03:19:19.830424 ip-10-0-138-136 kubenswrapper[2583]: I0709 03:19:19.830396 2583 log.go:25] "Finished parsing log file" path="/var/log/pods/llm_premium-simulated-simulated-premium-kserve-5fc6fb456f-tsfvh_dace10e5-09c2-4f96-85c5-acd7450ca55b/main/0.log" Jul 09 03:19:26.697033 ip-10-0-138-136 kubenswrapper[2583]: I0709 03:19:26.697005 2583 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_global-pull-secret-syncer-sv26w_4133cf72-5672-4d5e-b6dd-70e32b953216/global-pull-secret-syncer/0.log" Jul 09 03:19:26.859975 ip-10-0-138-136 kubenswrapper[2583]: I0709 03:19:26.859951 2583 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_konnectivity-agent-gszbq_6d20c3fe-b459-4dbb-86a7-3903e967b424/konnectivity-agent/0.log" Jul 09 03:19:26.971023 ip-10-0-138-136 kubenswrapper[2583]: I0709 03:19:26.970967 2583 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_kube-apiserver-proxy-ip-10-0-138-136.ec2.internal_04454d06c2f086e47f91e8c63bb8c939/haproxy/0.log" Jul 09 03:19:34.714303 ip-10-0-138-136 kubenswrapper[2583]: I0709 03:19:34.714245 2583 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_cluster-monitoring-operator-64786d9cbb-grbsm_a88b1ede-8749-4df5-88d8-494cfd9cfd83/cluster-monitoring-operator/0.log" Jul 09 03:19:34.880090 ip-10-0-138-136 kubenswrapper[2583]: I0709 03:19:34.880063 2583 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-bjkjp_7daf9287-62fb-400f-a264-62c525638de9/node-exporter/0.log" Jul 09 03:19:34.899239 ip-10-0-138-136 kubenswrapper[2583]: I0709 03:19:34.899204 2583 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-bjkjp_7daf9287-62fb-400f-a264-62c525638de9/kube-rbac-proxy/0.log" Jul 09 03:19:34.918132 ip-10-0-138-136 kubenswrapper[2583]: I0709 03:19:34.918113 2583 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-bjkjp_7daf9287-62fb-400f-a264-62c525638de9/init-textfile/0.log" Jul 09 03:19:35.345041 ip-10-0-138-136 kubenswrapper[2583]: I0709 03:19:35.345016 2583 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-operator-567f7b8b7c-bqgxx_869740c4-79d1-4b1b-a988-c5df63339dc7/prometheus-operator/0.log" Jul 09 03:19:35.363307 ip-10-0-138-136 kubenswrapper[2583]: I0709 03:19:35.363289 2583 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-operator-567f7b8b7c-bqgxx_869740c4-79d1-4b1b-a988-c5df63339dc7/kube-rbac-proxy/0.log" Jul 09 03:19:35.388493 ip-10-0-138-136 kubenswrapper[2583]: I0709 03:19:35.388474 2583 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-operator-admission-webhook-d559d66d5-kzbtm_489f4f32-dd84-4500-a8d1-792d96423821/prometheus-operator-admission-webhook/0.log" Jul 09 03:19:36.758306 ip-10-0-138-136 kubenswrapper[2583]: I0709 03:19:36.758275 2583 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-network-console_networking-console-plugin-6bffdf9778-j5xzm_ac99dbf2-7e27-437b-a386-89821f738a52/networking-console-plugin/0.log" Jul 09 03:19:36.933060 ip-10-0-138-136 kubenswrapper[2583]: I0709 03:19:36.933031 2583 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-must-gather-9jjkg/perf-node-gather-daemonset-wxz7z"] Jul 09 03:19:36.933396 ip-10-0-138-136 kubenswrapper[2583]: I0709 03:19:36.933384 2583 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="12a9288f-ba86-4315-8f0e-829d04a8f7cb" containerName="istio-proxy" Jul 09 03:19:36.933441 ip-10-0-138-136 kubenswrapper[2583]: I0709 03:19:36.933398 2583 state_mem.go:107] "Deleted CPUSet assignment" podUID="12a9288f-ba86-4315-8f0e-829d04a8f7cb" containerName="istio-proxy" Jul 09 03:19:36.933482 ip-10-0-138-136 kubenswrapper[2583]: I0709 03:19:36.933473 2583 memory_manager.go:368] "RemoveStaleState removing state" podUID="12a9288f-ba86-4315-8f0e-829d04a8f7cb" containerName="istio-proxy" Jul 09 03:19:36.933518 ip-10-0-138-136 kubenswrapper[2583]: I0709 03:19:36.933484 2583 memory_manager.go:368] "RemoveStaleState removing state" podUID="12a9288f-ba86-4315-8f0e-829d04a8f7cb" containerName="istio-proxy" Jul 09 03:19:36.936520 ip-10-0-138-136 kubenswrapper[2583]: I0709 03:19:36.936503 2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-9jjkg/perf-node-gather-daemonset-wxz7z" Jul 09 03:19:36.938429 ip-10-0-138-136 kubenswrapper[2583]: I0709 03:19:36.938409 2583 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-must-gather-9jjkg\"/\"kube-root-ca.crt\"" Jul 09 03:19:36.939052 ip-10-0-138-136 kubenswrapper[2583]: I0709 03:19:36.939032 2583 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-must-gather-9jjkg\"/\"openshift-service-ca.crt\"" Jul 09 03:19:36.939165 ip-10-0-138-136 kubenswrapper[2583]: I0709 03:19:36.939063 2583 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-must-gather-9jjkg\"/\"default-dockercfg-84tvq\"" Jul 09 03:19:36.945253 ip-10-0-138-136 kubenswrapper[2583]: I0709 03:19:36.945228 2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-9jjkg/perf-node-gather-daemonset-wxz7z"] Jul 09 03:19:37.125324 ip-10-0-138-136 kubenswrapper[2583]: I0709 03:19:37.125253 2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-ld5d2\" (UniqueName: \"kubernetes.io/projected/72160596-1418-4d54-ba31-1f0d1934c1b5-kube-api-access-ld5d2\") pod \"perf-node-gather-daemonset-wxz7z\" (UID: \"72160596-1418-4d54-ba31-1f0d1934c1b5\") " pod="openshift-must-gather-9jjkg/perf-node-gather-daemonset-wxz7z" Jul 09 03:19:37.125324 ip-10-0-138-136 kubenswrapper[2583]: I0709 03:19:37.125300 2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/72160596-1418-4d54-ba31-1f0d1934c1b5-podres\") pod \"perf-node-gather-daemonset-wxz7z\" (UID: \"72160596-1418-4d54-ba31-1f0d1934c1b5\") " pod="openshift-must-gather-9jjkg/perf-node-gather-daemonset-wxz7z" Jul 09 03:19:37.125500 ip-10-0-138-136 kubenswrapper[2583]: I0709 03:19:37.125377 2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/72160596-1418-4d54-ba31-1f0d1934c1b5-lib-modules\") pod \"perf-node-gather-daemonset-wxz7z\" (UID: \"72160596-1418-4d54-ba31-1f0d1934c1b5\") " pod="openshift-must-gather-9jjkg/perf-node-gather-daemonset-wxz7z" Jul 09 03:19:37.125500 ip-10-0-138-136 kubenswrapper[2583]: I0709 03:19:37.125415 2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/72160596-1418-4d54-ba31-1f0d1934c1b5-proc\") pod \"perf-node-gather-daemonset-wxz7z\" (UID: \"72160596-1418-4d54-ba31-1f0d1934c1b5\") " pod="openshift-must-gather-9jjkg/perf-node-gather-daemonset-wxz7z" Jul 09 03:19:37.125500 ip-10-0-138-136 kubenswrapper[2583]: I0709 03:19:37.125448 2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/72160596-1418-4d54-ba31-1f0d1934c1b5-sys\") pod \"perf-node-gather-daemonset-wxz7z\" (UID: \"72160596-1418-4d54-ba31-1f0d1934c1b5\") " pod="openshift-must-gather-9jjkg/perf-node-gather-daemonset-wxz7z" Jul 09 03:19:37.226501 ip-10-0-138-136 kubenswrapper[2583]: I0709 03:19:37.226478 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/72160596-1418-4d54-ba31-1f0d1934c1b5-lib-modules\") pod \"perf-node-gather-daemonset-wxz7z\" (UID: \"72160596-1418-4d54-ba31-1f0d1934c1b5\") " pod="openshift-must-gather-9jjkg/perf-node-gather-daemonset-wxz7z" Jul 09 03:19:37.226609 ip-10-0-138-136 kubenswrapper[2583]: I0709 03:19:37.226509 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/72160596-1418-4d54-ba31-1f0d1934c1b5-proc\") pod \"perf-node-gather-daemonset-wxz7z\" (UID: \"72160596-1418-4d54-ba31-1f0d1934c1b5\") " pod="openshift-must-gather-9jjkg/perf-node-gather-daemonset-wxz7z" Jul 09 03:19:37.226609 ip-10-0-138-136 kubenswrapper[2583]: I0709 03:19:37.226531 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/72160596-1418-4d54-ba31-1f0d1934c1b5-sys\") pod \"perf-node-gather-daemonset-wxz7z\" (UID: \"72160596-1418-4d54-ba31-1f0d1934c1b5\") " pod="openshift-must-gather-9jjkg/perf-node-gather-daemonset-wxz7z" Jul 09 03:19:37.226609 ip-10-0-138-136 kubenswrapper[2583]: I0709 03:19:37.226568 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-ld5d2\" (UniqueName: \"kubernetes.io/projected/72160596-1418-4d54-ba31-1f0d1934c1b5-kube-api-access-ld5d2\") pod \"perf-node-gather-daemonset-wxz7z\" (UID: \"72160596-1418-4d54-ba31-1f0d1934c1b5\") " pod="openshift-must-gather-9jjkg/perf-node-gather-daemonset-wxz7z" Jul 09 03:19:37.226609 ip-10-0-138-136 kubenswrapper[2583]: I0709 03:19:37.226606 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/72160596-1418-4d54-ba31-1f0d1934c1b5-podres\") pod \"perf-node-gather-daemonset-wxz7z\" (UID: \"72160596-1418-4d54-ba31-1f0d1934c1b5\") " pod="openshift-must-gather-9jjkg/perf-node-gather-daemonset-wxz7z" Jul 09 03:19:37.226818 ip-10-0-138-136 kubenswrapper[2583]: I0709 03:19:37.226609 2583 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/72160596-1418-4d54-ba31-1f0d1934c1b5-proc\") pod \"perf-node-gather-daemonset-wxz7z\" (UID: \"72160596-1418-4d54-ba31-1f0d1934c1b5\") " pod="openshift-must-gather-9jjkg/perf-node-gather-daemonset-wxz7z" Jul 09 03:19:37.226818 ip-10-0-138-136 kubenswrapper[2583]: I0709 03:19:37.226626 2583 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/72160596-1418-4d54-ba31-1f0d1934c1b5-sys\") pod \"perf-node-gather-daemonset-wxz7z\" (UID: \"72160596-1418-4d54-ba31-1f0d1934c1b5\") " pod="openshift-must-gather-9jjkg/perf-node-gather-daemonset-wxz7z" Jul 09 03:19:37.226818 ip-10-0-138-136 kubenswrapper[2583]: I0709 03:19:37.226672 2583 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/72160596-1418-4d54-ba31-1f0d1934c1b5-lib-modules\") pod \"perf-node-gather-daemonset-wxz7z\" (UID: \"72160596-1418-4d54-ba31-1f0d1934c1b5\") " pod="openshift-must-gather-9jjkg/perf-node-gather-daemonset-wxz7z" Jul 09 03:19:37.226818 ip-10-0-138-136 kubenswrapper[2583]: I0709 03:19:37.226760 2583 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/72160596-1418-4d54-ba31-1f0d1934c1b5-podres\") pod \"perf-node-gather-daemonset-wxz7z\" (UID: \"72160596-1418-4d54-ba31-1f0d1934c1b5\") " pod="openshift-must-gather-9jjkg/perf-node-gather-daemonset-wxz7z" Jul 09 03:19:37.234145 ip-10-0-138-136 kubenswrapper[2583]: I0709 03:19:37.234124 2583 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-ld5d2\" (UniqueName: \"kubernetes.io/projected/72160596-1418-4d54-ba31-1f0d1934c1b5-kube-api-access-ld5d2\") pod \"perf-node-gather-daemonset-wxz7z\" (UID: \"72160596-1418-4d54-ba31-1f0d1934c1b5\") " pod="openshift-must-gather-9jjkg/perf-node-gather-daemonset-wxz7z" Jul 09 03:19:37.246500 ip-10-0-138-136 kubenswrapper[2583]: I0709 03:19:37.246483 2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-9jjkg/perf-node-gather-daemonset-wxz7z" Jul 09 03:19:37.376116 ip-10-0-138-136 kubenswrapper[2583]: I0709 03:19:37.376091 2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-9jjkg/perf-node-gather-daemonset-wxz7z"] Jul 09 03:19:37.378064 ip-10-0-138-136 kubenswrapper[2583]: W0709 03:19:37.378036 2583 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-pod72160596_1418_4d54_ba31_1f0d1934c1b5.slice/crio-e26fb1e46098b766a2d8a9cd64db8d52d705ddce6ddbd9e3a8e6a9021d1bd76b WatchSource:0}: Error finding container e26fb1e46098b766a2d8a9cd64db8d52d705ddce6ddbd9e3a8e6a9021d1bd76b: Status 404 returned error can't find the container with id e26fb1e46098b766a2d8a9cd64db8d52d705ddce6ddbd9e3a8e6a9021d1bd76b Jul 09 03:19:37.417400 ip-10-0-138-136 kubenswrapper[2583]: I0709 03:19:37.417377 2583 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-68b757fb67-xpjsj_188e21f3-2ce9-4012-ada2-a46c32d56729/console-operator/1.log" Jul 09 03:19:37.422141 ip-10-0-138-136 kubenswrapper[2583]: I0709 03:19:37.422118 2583 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-68b757fb67-xpjsj_188e21f3-2ce9-4012-ada2-a46c32d56729/console-operator/2.log" Jul 09 03:19:37.941332 ip-10-0-138-136 kubenswrapper[2583]: I0709 03:19:37.941308 2583 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console_console-b8f649c79-zmp6r_1662e0aa-0c4a-495e-807c-dc7e0abdbd50/console/0.log" Jul 09 03:19:37.978378 ip-10-0-138-136 kubenswrapper[2583]: I0709 03:19:37.978353 2583 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console_downloads-685bfb5f64-5dwm9_4952f4bb-5769-47fd-8c16-5b57eefd01cd/download-server/0.log" Jul 09 03:19:38.259270 ip-10-0-138-136 kubenswrapper[2583]: I0709 03:19:38.259244 2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-9jjkg/perf-node-gather-daemonset-wxz7z" event={"ID":"72160596-1418-4d54-ba31-1f0d1934c1b5","Type":"ContainerStarted","Data":"0830534010c25afc4256760493c8f3041fa9d6668bdc843341359dfc2ddfc98a"} Jul 09 03:19:38.259420 ip-10-0-138-136 kubenswrapper[2583]: I0709 03:19:38.259324 2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-9jjkg/perf-node-gather-daemonset-wxz7z" event={"ID":"72160596-1418-4d54-ba31-1f0d1934c1b5","Type":"ContainerStarted","Data":"e26fb1e46098b766a2d8a9cd64db8d52d705ddce6ddbd9e3a8e6a9021d1bd76b"} Jul 09 03:19:38.259420 ip-10-0-138-136 kubenswrapper[2583]: I0709 03:19:38.259365 2583 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-must-gather-9jjkg/perf-node-gather-daemonset-wxz7z" Jul 09 03:19:38.274247 ip-10-0-138-136 kubenswrapper[2583]: I0709 03:19:38.274196 2583 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-must-gather-9jjkg/perf-node-gather-daemonset-wxz7z" podStartSLOduration=2.274182019 podStartE2EDuration="2.274182019s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-09 03:19:36 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-09 03:19:38.273745483 +0000 UTC m=+2724.206202971" watchObservedRunningTime="2026-07-09 03:19:38.274182019 +0000 UTC m=+2724.206639504" Jul 09 03:19:38.555003 ip-10-0-138-136 kubenswrapper[2583]: I0709 03:19:38.554930 2583 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-cluster-storage-operator_volume-data-source-validator-5d456fdbcd-bdg6h_c1ea28bb-bfb9-477c-a144-6d7dfd62c073/volume-data-source-validator/0.log" Jul 09 03:19:39.661156 ip-10-0-138-136 kubenswrapper[2583]: I0709 03:19:39.661113 2583 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_dns-default-rwlzs_bd5345b9-08c2-4d1c-a033-a5c458c74773/dns/0.log" Jul 09 03:19:39.680696 ip-10-0-138-136 kubenswrapper[2583]: I0709 03:19:39.680671 2583 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_dns-default-rwlzs_bd5345b9-08c2-4d1c-a033-a5c458c74773/kube-rbac-proxy/0.log" Jul 09 03:19:39.725000 ip-10-0-138-136 kubenswrapper[2583]: I0709 03:19:39.724981 2583 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_node-resolver-5mbtc_45541338-f2aa-4712-ba6f-8924e3513372/dns-node-resolver/0.log" Jul 09 03:19:40.344644 ip-10-0-138-136 kubenswrapper[2583]: I0709 03:19:40.344619 2583 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_node-ca-v86n2_6cdfd2a0-46af-4734-9735-7408f8439c96/node-ca/0.log" Jul 09 03:19:41.277378 ip-10-0-138-136 kubenswrapper[2583]: I0709 03:19:41.277347 2583 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_data-science-gateway-data-science-gateway-class-6576859cf4jzfbc_c13f6261-b1d7-4f9a-9558-ab4f300de9b0/istio-proxy/0.log" Jul 09 03:19:41.486014 ip-10-0-138-136 kubenswrapper[2583]: I0709 03:19:41.485990 2583 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_maas-default-gateway-openshift-default-56654dcf7-vpc97_438605c5-c5d5-45c4-833b-7217e9314705/istio-proxy/0.log" Jul 09 03:19:41.519042 ip-10-0-138-136 kubenswrapper[2583]: I0709 03:19:41.519017 2583 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_maas-default-gateway-openshift-default-56654dcf7-vpc97_438605c5-c5d5-45c4-833b-7217e9314705/istio-proxy/1.log" Jul 09 03:19:41.661296 ip-10-0-138-136 kubenswrapper[2583]: I0709 03:19:41.661227 2583 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_router-default-6575bfb5cc-2ttlz_49f19d77-82e8-419b-a88b-09c9ee4354a8/router/0.log" Jul 09 03:19:42.337200 ip-10-0-138-136 kubenswrapper[2583]: I0709 03:19:42.337174 2583 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress-canary_ingress-canary-dhcrr_42025b60-40d4-453f-aaae-74cb3e1a3cdb/serve-healthcheck-canary/0.log" Jul 09 03:19:42.840928 ip-10-0-138-136 kubenswrapper[2583]: I0709 03:19:42.840897 2583 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-operator-5c847dcfc4-rwvrr_bb24b378-f56e-46cb-8881-3f44c1a40391/insights-operator/0.log" Jul 09 03:19:42.841691 ip-10-0-138-136 kubenswrapper[2583]: I0709 03:19:42.841675 2583 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-operator-5c847dcfc4-rwvrr_bb24b378-f56e-46cb-8881-3f44c1a40391/insights-operator/1.log" Jul 09 03:19:42.929594 ip-10-0-138-136 kubenswrapper[2583]: I0709 03:19:42.929570 2583 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-x4vq7_d2160d90-2c9d-4bbb-a8ca-a989931a42e3/kube-rbac-proxy/0.log" Jul 09 03:19:42.949506 ip-10-0-138-136 kubenswrapper[2583]: I0709 03:19:42.949487 2583 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-x4vq7_d2160d90-2c9d-4bbb-a8ca-a989931a42e3/exporter/0.log" Jul 09 03:19:42.969242 ip-10-0-138-136 kubenswrapper[2583]: I0709 03:19:42.969223 2583 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-x4vq7_d2160d90-2c9d-4bbb-a8ca-a989931a42e3/extractor/0.log" Jul 09 03:19:44.276479 ip-10-0-138-136 kubenswrapper[2583]: I0709 03:19:44.276450 2583 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-must-gather-9jjkg/perf-node-gather-daemonset-wxz7z" Jul 09 03:19:45.158271 ip-10-0-138-136 kubenswrapper[2583]: I0709 03:19:45.158237 2583 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_kserve-controller-manager-d6f4b65b8-8nz2f_16abf7a1-5d49-42f8-99d1-301d35e2bf2e/manager/0.log" Jul 09 03:19:45.254504 ip-10-0-138-136 kubenswrapper[2583]: I0709 03:19:45.254476 2583 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_llmisvc-controller-manager-777c6bd7d5-x8kkg_628cfe58-d957-468b-a7bf-76ba45800999/manager/0.log" Jul 09 03:19:45.508592 ip-10-0-138-136 kubenswrapper[2583]: I0709 03:19:45.508568 2583 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-75df5ddb9c-7vqjd_addd875a-34b8-4179-b2fe-07eb377f16d2/manager/0.log" Jul 09 03:19:45.529756 ip-10-0-138-136 kubenswrapper[2583]: I0709 03:19:45.529735 2583 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-75df5ddb9c-7vqjd_addd875a-34b8-4179-b2fe-07eb377f16d2/copy-manifests/0.log" Jul 09 03:19:47.103430 ip-10-0-138-136 kubenswrapper[2583]: I0709 03:19:47.103404 2583 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-lws-operator_lws-controller-manager-7c74f5f585-g95ch_a9b51085-b15c-40be-8157-86c4f904879c/manager/0.log" Jul 09 03:19:48.217243 ip-10-0-138-136 kubenswrapper[2583]: I0709 03:19:48.217220 2583 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_data-science-gateway-data-science-gateway-class-6576859cf4jzfbc_c13f6261-b1d7-4f9a-9558-ab4f300de9b0/istio-proxy/0.log" Jul 09 03:19:48.381706 ip-10-0-138-136 kubenswrapper[2583]: I0709 03:19:48.381629 2583 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_maas-default-gateway-openshift-default-56654dcf7-vpc97_438605c5-c5d5-45c4-833b-7217e9314705/istio-proxy/0.log" Jul 09 03:19:48.408922 ip-10-0-138-136 kubenswrapper[2583]: I0709 03:19:48.408903 2583 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_maas-default-gateway-openshift-default-56654dcf7-vpc97_438605c5-c5d5-45c4-833b-7217e9314705/istio-proxy/1.log" Jul 09 03:19:48.538439 ip-10-0-138-136 kubenswrapper[2583]: I0709 03:19:48.538414 2583 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_router-default-6575bfb5cc-2ttlz_49f19d77-82e8-419b-a88b-09c9ee4354a8/router/0.log" Jul 09 03:19:49.689395 ip-10-0-138-136 kubenswrapper[2583]: I0709 03:19:49.689368 2583 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_data-science-gateway-data-science-gateway-class-6576859cf4jzfbc_c13f6261-b1d7-4f9a-9558-ab4f300de9b0/istio-proxy/0.log" Jul 09 03:19:49.860608 ip-10-0-138-136 kubenswrapper[2583]: I0709 03:19:49.860576 2583 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_maas-default-gateway-openshift-default-56654dcf7-vpc97_438605c5-c5d5-45c4-833b-7217e9314705/istio-proxy/0.log" Jul 09 03:19:49.886821 ip-10-0-138-136 kubenswrapper[2583]: I0709 03:19:49.886795 2583 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_maas-default-gateway-openshift-default-56654dcf7-vpc97_438605c5-c5d5-45c4-833b-7217e9314705/istio-proxy/1.log" Jul 09 03:19:50.012404 ip-10-0-138-136 kubenswrapper[2583]: I0709 03:19:50.012379 2583 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_router-default-6575bfb5cc-2ttlz_49f19d77-82e8-419b-a88b-09c9ee4354a8/router/0.log" Jul 09 03:19:52.161432 ip-10-0-138-136 kubenswrapper[2583]: I0709 03:19:52.161403 2583 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-kube-storage-version-migrator_migrator-d57d58cc9-628pm_482ea868-d31a-40b3-b758-26cf59df2b42/migrator/0.log" Jul 09 03:19:52.179776 ip-10-0-138-136 kubenswrapper[2583]: I0709 03:19:52.179754 2583 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-kube-storage-version-migrator_migrator-d57d58cc9-628pm_482ea868-d31a-40b3-b758-26cf59df2b42/graceful-termination/0.log" Jul 09 03:19:52.516914 ip-10-0-138-136 kubenswrapper[2583]: I0709 03:19:52.516890 2583 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-kube-storage-version-migrator-operator_kube-storage-version-migrator-operator-846bf668f7-vls7g_9d809968-31d3-4c4d-be19-234664db4a04/kube-storage-version-migrator-operator/1.log" Jul 09 03:19:52.517667 ip-10-0-138-136 kubenswrapper[2583]: I0709 03:19:52.517644 2583 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-kube-storage-version-migrator-operator_kube-storage-version-migrator-operator-846bf668f7-vls7g_9d809968-31d3-4c4d-be19-234664db4a04/kube-storage-version-migrator-operator/0.log" Jul 09 03:19:53.794032 ip-10-0-138-136 kubenswrapper[2583]: I0709 03:19:53.794005 2583 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-xx7bf_1ca2fa3a-0931-4ac7-b562-e70c66a22120/kube-multus-additional-cni-plugins/0.log" Jul 09 03:19:53.812985 ip-10-0-138-136 kubenswrapper[2583]: I0709 03:19:53.812957 2583 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-xx7bf_1ca2fa3a-0931-4ac7-b562-e70c66a22120/egress-router-binary-copy/0.log" Jul 09 03:19:53.831942 ip-10-0-138-136 kubenswrapper[2583]: I0709 03:19:53.831919 2583 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-xx7bf_1ca2fa3a-0931-4ac7-b562-e70c66a22120/cni-plugins/0.log" Jul 09 03:19:53.854019 ip-10-0-138-136 kubenswrapper[2583]: I0709 03:19:53.853997 2583 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-xx7bf_1ca2fa3a-0931-4ac7-b562-e70c66a22120/bond-cni-plugin/0.log" Jul 09 03:19:53.874206 ip-10-0-138-136 kubenswrapper[2583]: I0709 03:19:53.874187 2583 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-xx7bf_1ca2fa3a-0931-4ac7-b562-e70c66a22120/routeoverride-cni/0.log" Jul 09 03:19:53.893120 ip-10-0-138-136 kubenswrapper[2583]: I0709 03:19:53.893099 2583 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-xx7bf_1ca2fa3a-0931-4ac7-b562-e70c66a22120/whereabouts-cni-bincopy/0.log" Jul 09 03:19:53.912055 ip-10-0-138-136 kubenswrapper[2583]: I0709 03:19:53.912035 2583 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-xx7bf_1ca2fa3a-0931-4ac7-b562-e70c66a22120/whereabouts-cni/0.log" Jul 09 03:19:54.095933 ip-10-0-138-136 kubenswrapper[2583]: I0709 03:19:54.095879 2583 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-q69lj_9b793225-5bd6-4bf7-a87e-d42bf8c939f7/kube-multus/0.log" Jul 09 03:19:54.198876 ip-10-0-138-136 kubenswrapper[2583]: I0709 03:19:54.198854 2583 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_network-metrics-daemon-rdtdt_71cf0a89-d676-47f4-bf4a-d13d283493fc/network-metrics-daemon/0.log" Jul 09 03:19:54.216261 ip-10-0-138-136 kubenswrapper[2583]: I0709 03:19:54.216244 2583 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_network-metrics-daemon-rdtdt_71cf0a89-d676-47f4-bf4a-d13d283493fc/kube-rbac-proxy/0.log"