Jul 13 02:54:50.980742 ip-10-0-134-52 systemd[1]: kubelet.service: Failed to load environment files: No such file or directory Jul 13 02:54:50.980753 ip-10-0-134-52 systemd[1]: kubelet.service: Failed to run 'start-pre' task: No such file or directory Jul 13 02:54:50.980759 ip-10-0-134-52 systemd[1]: kubelet.service: Failed with result 'resources'. Jul 13 02:54:50.980966 ip-10-0-134-52 systemd[1]: Failed to start Kubernetes Kubelet. Jul 13 02:55:02.278437 ip-10-0-134-52 systemd[1]: kubelet.service: Failed to schedule restart job: Unit crio.service not found. Jul 13 02:55:02.278452 ip-10-0-134-52 systemd[1]: kubelet.service: Failed with result 'resources'. -- Boot c351b474013942de88b7e7173d363233 -- Jul 13 02:56:57.495594 ip-10-0-134-52 systemd[1]: Starting Kubernetes Kubelet... Jul 13 02:56:57.841544 ip-10-0-134-52 kubenswrapper[2558]: Flag --container-runtime-endpoint has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information. Jul 13 02:56:57.841544 ip-10-0-134-52 kubenswrapper[2558]: Flag --minimum-container-ttl-duration has been deprecated, Use --eviction-hard or --eviction-soft instead. Will be removed in a future version. Jul 13 02:56:57.841544 ip-10-0-134-52 kubenswrapper[2558]: Flag --volume-plugin-dir has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information. Jul 13 02:56:57.841544 ip-10-0-134-52 kubenswrapper[2558]: Flag --pod-infra-container-image has been deprecated, will be removed in 1.35. Image garbage collector will get sandbox image information from CRI. Jul 13 02:56:57.841544 ip-10-0-134-52 kubenswrapper[2558]: Flag --system-reserved has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information. Jul 13 02:56:57.842395 ip-10-0-134-52 kubenswrapper[2558]: I0713 02:56:57.842306 2558 server.go:213] "--pod-infra-container-image will not be pruned by the image garbage collector in kubelet and should also be set in the remote runtime" Jul 13 02:56:57.847955 ip-10-0-134-52 kubenswrapper[2558]: W0713 02:56:57.847939 2558 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jul 13 02:56:57.847955 ip-10-0-134-52 kubenswrapper[2558]: W0713 02:56:57.847954 2558 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jul 13 02:56:57.848018 ip-10-0-134-52 kubenswrapper[2558]: W0713 02:56:57.847959 2558 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jul 13 02:56:57.848018 ip-10-0-134-52 kubenswrapper[2558]: W0713 02:56:57.847963 2558 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jul 13 02:56:57.848018 ip-10-0-134-52 kubenswrapper[2558]: W0713 02:56:57.847966 2558 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jul 13 02:56:57.848018 ip-10-0-134-52 kubenswrapper[2558]: W0713 02:56:57.847969 2558 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jul 13 02:56:57.848018 ip-10-0-134-52 kubenswrapper[2558]: W0713 02:56:57.847972 2558 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jul 13 02:56:57.848018 ip-10-0-134-52 kubenswrapper[2558]: W0713 02:56:57.847975 2558 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jul 13 02:56:57.848018 ip-10-0-134-52 kubenswrapper[2558]: W0713 02:56:57.847979 2558 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jul 13 02:56:57.848018 ip-10-0-134-52 kubenswrapper[2558]: W0713 02:56:57.847982 2558 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jul 13 02:56:57.848018 ip-10-0-134-52 kubenswrapper[2558]: W0713 02:56:57.847985 2558 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jul 13 02:56:57.848018 ip-10-0-134-52 kubenswrapper[2558]: W0713 02:56:57.847988 2558 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jul 13 02:56:57.848018 ip-10-0-134-52 kubenswrapper[2558]: W0713 02:56:57.847990 2558 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jul 13 02:56:57.848018 ip-10-0-134-52 kubenswrapper[2558]: W0713 02:56:57.847993 2558 feature_gate.go:328] unrecognized feature gate: EventTTL Jul 13 02:56:57.848018 ip-10-0-134-52 kubenswrapper[2558]: W0713 02:56:57.847996 2558 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jul 13 02:56:57.848018 ip-10-0-134-52 kubenswrapper[2558]: W0713 02:56:57.847998 2558 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jul 13 02:56:57.848018 ip-10-0-134-52 kubenswrapper[2558]: W0713 02:56:57.848001 2558 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jul 13 02:56:57.848018 ip-10-0-134-52 kubenswrapper[2558]: W0713 02:56:57.848004 2558 feature_gate.go:328] unrecognized feature gate: DualReplica Jul 13 02:56:57.848018 ip-10-0-134-52 kubenswrapper[2558]: W0713 02:56:57.848006 2558 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jul 13 02:56:57.848018 ip-10-0-134-52 kubenswrapper[2558]: W0713 02:56:57.848009 2558 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jul 13 02:56:57.848018 ip-10-0-134-52 kubenswrapper[2558]: W0713 02:56:57.848021 2558 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jul 13 02:56:57.848018 ip-10-0-134-52 kubenswrapper[2558]: W0713 02:56:57.848024 2558 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jul 13 02:56:57.848544 ip-10-0-134-52 kubenswrapper[2558]: W0713 02:56:57.848027 2558 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jul 13 02:56:57.848544 ip-10-0-134-52 kubenswrapper[2558]: W0713 02:56:57.848030 2558 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jul 13 02:56:57.848544 ip-10-0-134-52 kubenswrapper[2558]: W0713 02:56:57.848033 2558 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jul 13 02:56:57.848544 ip-10-0-134-52 kubenswrapper[2558]: W0713 02:56:57.848035 2558 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jul 13 02:56:57.848544 ip-10-0-134-52 kubenswrapper[2558]: W0713 02:56:57.848038 2558 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jul 13 02:56:57.848544 ip-10-0-134-52 kubenswrapper[2558]: W0713 02:56:57.848040 2558 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jul 13 02:56:57.848544 ip-10-0-134-52 kubenswrapper[2558]: W0713 02:56:57.848043 2558 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jul 13 02:56:57.848544 ip-10-0-134-52 kubenswrapper[2558]: W0713 02:56:57.848045 2558 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jul 13 02:56:57.848544 ip-10-0-134-52 kubenswrapper[2558]: W0713 02:56:57.848047 2558 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jul 13 02:56:57.848544 ip-10-0-134-52 kubenswrapper[2558]: W0713 02:56:57.848050 2558 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jul 13 02:56:57.848544 ip-10-0-134-52 kubenswrapper[2558]: W0713 02:56:57.848052 2558 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jul 13 02:56:57.848544 ip-10-0-134-52 kubenswrapper[2558]: W0713 02:56:57.848054 2558 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jul 13 02:56:57.848544 ip-10-0-134-52 kubenswrapper[2558]: W0713 02:56:57.848057 2558 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jul 13 02:56:57.848544 ip-10-0-134-52 kubenswrapper[2558]: W0713 02:56:57.848059 2558 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jul 13 02:56:57.848544 ip-10-0-134-52 kubenswrapper[2558]: W0713 02:56:57.848062 2558 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jul 13 02:56:57.848544 ip-10-0-134-52 kubenswrapper[2558]: W0713 02:56:57.848064 2558 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jul 13 02:56:57.848544 ip-10-0-134-52 kubenswrapper[2558]: W0713 02:56:57.848067 2558 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jul 13 02:56:57.848544 ip-10-0-134-52 kubenswrapper[2558]: W0713 02:56:57.848069 2558 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jul 13 02:56:57.848544 ip-10-0-134-52 kubenswrapper[2558]: W0713 02:56:57.848072 2558 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jul 13 02:56:57.848544 ip-10-0-134-52 kubenswrapper[2558]: W0713 02:56:57.848074 2558 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jul 13 02:56:57.849014 ip-10-0-134-52 kubenswrapper[2558]: W0713 02:56:57.848076 2558 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jul 13 02:56:57.849014 ip-10-0-134-52 kubenswrapper[2558]: W0713 02:56:57.848079 2558 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jul 13 02:56:57.849014 ip-10-0-134-52 kubenswrapper[2558]: W0713 02:56:57.848081 2558 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jul 13 02:56:57.849014 ip-10-0-134-52 kubenswrapper[2558]: W0713 02:56:57.848084 2558 feature_gate.go:328] unrecognized feature gate: OSStreams Jul 13 02:56:57.849014 ip-10-0-134-52 kubenswrapper[2558]: W0713 02:56:57.848086 2558 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jul 13 02:56:57.849014 ip-10-0-134-52 kubenswrapper[2558]: W0713 02:56:57.848089 2558 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jul 13 02:56:57.849014 ip-10-0-134-52 kubenswrapper[2558]: W0713 02:56:57.848091 2558 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jul 13 02:56:57.849014 ip-10-0-134-52 kubenswrapper[2558]: W0713 02:56:57.848094 2558 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jul 13 02:56:57.849014 ip-10-0-134-52 kubenswrapper[2558]: W0713 02:56:57.848096 2558 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jul 13 02:56:57.849014 ip-10-0-134-52 kubenswrapper[2558]: W0713 02:56:57.848100 2558 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jul 13 02:56:57.849014 ip-10-0-134-52 kubenswrapper[2558]: W0713 02:56:57.848102 2558 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jul 13 02:56:57.849014 ip-10-0-134-52 kubenswrapper[2558]: W0713 02:56:57.848106 2558 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jul 13 02:56:57.849014 ip-10-0-134-52 kubenswrapper[2558]: W0713 02:56:57.848110 2558 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jul 13 02:56:57.849014 ip-10-0-134-52 kubenswrapper[2558]: W0713 02:56:57.848114 2558 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jul 13 02:56:57.849014 ip-10-0-134-52 kubenswrapper[2558]: W0713 02:56:57.848117 2558 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jul 13 02:56:57.849014 ip-10-0-134-52 kubenswrapper[2558]: W0713 02:56:57.848119 2558 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jul 13 02:56:57.849014 ip-10-0-134-52 kubenswrapper[2558]: W0713 02:56:57.848122 2558 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jul 13 02:56:57.849014 ip-10-0-134-52 kubenswrapper[2558]: W0713 02:56:57.848125 2558 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jul 13 02:56:57.849014 ip-10-0-134-52 kubenswrapper[2558]: W0713 02:56:57.848127 2558 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jul 13 02:56:57.849014 ip-10-0-134-52 kubenswrapper[2558]: W0713 02:56:57.848130 2558 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jul 13 02:56:57.849534 ip-10-0-134-52 kubenswrapper[2558]: W0713 02:56:57.848132 2558 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jul 13 02:56:57.849534 ip-10-0-134-52 kubenswrapper[2558]: W0713 02:56:57.848135 2558 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jul 13 02:56:57.849534 ip-10-0-134-52 kubenswrapper[2558]: W0713 02:56:57.848137 2558 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jul 13 02:56:57.849534 ip-10-0-134-52 kubenswrapper[2558]: W0713 02:56:57.848140 2558 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jul 13 02:56:57.849534 ip-10-0-134-52 kubenswrapper[2558]: W0713 02:56:57.848142 2558 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jul 13 02:56:57.849534 ip-10-0-134-52 kubenswrapper[2558]: W0713 02:56:57.848145 2558 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jul 13 02:56:57.849534 ip-10-0-134-52 kubenswrapper[2558]: W0713 02:56:57.848147 2558 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jul 13 02:56:57.849534 ip-10-0-134-52 kubenswrapper[2558]: W0713 02:56:57.848150 2558 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jul 13 02:56:57.849534 ip-10-0-134-52 kubenswrapper[2558]: W0713 02:56:57.848152 2558 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jul 13 02:56:57.849534 ip-10-0-134-52 kubenswrapper[2558]: W0713 02:56:57.848155 2558 feature_gate.go:328] unrecognized feature gate: Example2 Jul 13 02:56:57.849534 ip-10-0-134-52 kubenswrapper[2558]: W0713 02:56:57.848158 2558 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jul 13 02:56:57.849534 ip-10-0-134-52 kubenswrapper[2558]: W0713 02:56:57.848160 2558 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jul 13 02:56:57.849534 ip-10-0-134-52 kubenswrapper[2558]: W0713 02:56:57.848164 2558 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jul 13 02:56:57.849534 ip-10-0-134-52 kubenswrapper[2558]: W0713 02:56:57.848166 2558 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jul 13 02:56:57.849534 ip-10-0-134-52 kubenswrapper[2558]: W0713 02:56:57.848169 2558 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jul 13 02:56:57.849534 ip-10-0-134-52 kubenswrapper[2558]: W0713 02:56:57.848172 2558 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jul 13 02:56:57.849534 ip-10-0-134-52 kubenswrapper[2558]: W0713 02:56:57.848174 2558 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jul 13 02:56:57.849534 ip-10-0-134-52 kubenswrapper[2558]: W0713 02:56:57.848176 2558 feature_gate.go:328] unrecognized feature gate: NewOLM Jul 13 02:56:57.849534 ip-10-0-134-52 kubenswrapper[2558]: W0713 02:56:57.848179 2558 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jul 13 02:56:57.849534 ip-10-0-134-52 kubenswrapper[2558]: W0713 02:56:57.848181 2558 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jul 13 02:56:57.849998 ip-10-0-134-52 kubenswrapper[2558]: W0713 02:56:57.848184 2558 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jul 13 02:56:57.849998 ip-10-0-134-52 kubenswrapper[2558]: W0713 02:56:57.848187 2558 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jul 13 02:56:57.849998 ip-10-0-134-52 kubenswrapper[2558]: W0713 02:56:57.848191 2558 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jul 13 02:56:57.849998 ip-10-0-134-52 kubenswrapper[2558]: W0713 02:56:57.848194 2558 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jul 13 02:56:57.849998 ip-10-0-134-52 kubenswrapper[2558]: W0713 02:56:57.848197 2558 feature_gate.go:328] unrecognized feature gate: PinnedImages Jul 13 02:56:57.849998 ip-10-0-134-52 kubenswrapper[2558]: W0713 02:56:57.848200 2558 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jul 13 02:56:57.849998 ip-10-0-134-52 kubenswrapper[2558]: W0713 02:56:57.848204 2558 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jul 13 02:56:57.849998 ip-10-0-134-52 kubenswrapper[2558]: W0713 02:56:57.848208 2558 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jul 13 02:56:57.849998 ip-10-0-134-52 kubenswrapper[2558]: W0713 02:56:57.848211 2558 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jul 13 02:56:57.849998 ip-10-0-134-52 kubenswrapper[2558]: W0713 02:56:57.848214 2558 feature_gate.go:328] unrecognized feature gate: OVNObservability Jul 13 02:56:57.849998 ip-10-0-134-52 kubenswrapper[2558]: W0713 02:56:57.848217 2558 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jul 13 02:56:57.849998 ip-10-0-134-52 kubenswrapper[2558]: W0713 02:56:57.848219 2558 feature_gate.go:328] unrecognized feature gate: SignatureStores Jul 13 02:56:57.849998 ip-10-0-134-52 kubenswrapper[2558]: W0713 02:56:57.848222 2558 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jul 13 02:56:57.849998 ip-10-0-134-52 kubenswrapper[2558]: W0713 02:56:57.848225 2558 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jul 13 02:56:57.849998 ip-10-0-134-52 kubenswrapper[2558]: W0713 02:56:57.848228 2558 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jul 13 02:56:57.849998 ip-10-0-134-52 kubenswrapper[2558]: W0713 02:56:57.848230 2558 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jul 13 02:56:57.849998 ip-10-0-134-52 kubenswrapper[2558]: W0713 02:56:57.848232 2558 feature_gate.go:328] unrecognized feature gate: Example Jul 13 02:56:57.849998 ip-10-0-134-52 kubenswrapper[2558]: W0713 02:56:57.849752 2558 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jul 13 02:56:57.849998 ip-10-0-134-52 kubenswrapper[2558]: W0713 02:56:57.849759 2558 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jul 13 02:56:57.850478 ip-10-0-134-52 kubenswrapper[2558]: W0713 02:56:57.849763 2558 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jul 13 02:56:57.850478 ip-10-0-134-52 kubenswrapper[2558]: W0713 02:56:57.849767 2558 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jul 13 02:56:57.850478 ip-10-0-134-52 kubenswrapper[2558]: W0713 02:56:57.849770 2558 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jul 13 02:56:57.850478 ip-10-0-134-52 kubenswrapper[2558]: W0713 02:56:57.849776 2558 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jul 13 02:56:57.850478 ip-10-0-134-52 kubenswrapper[2558]: W0713 02:56:57.849779 2558 feature_gate.go:328] unrecognized feature gate: NewOLM Jul 13 02:56:57.850478 ip-10-0-134-52 kubenswrapper[2558]: W0713 02:56:57.849782 2558 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jul 13 02:56:57.850478 ip-10-0-134-52 kubenswrapper[2558]: W0713 02:56:57.849784 2558 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jul 13 02:56:57.850478 ip-10-0-134-52 kubenswrapper[2558]: W0713 02:56:57.849787 2558 feature_gate.go:328] unrecognized feature gate: SignatureStores Jul 13 02:56:57.850478 ip-10-0-134-52 kubenswrapper[2558]: W0713 02:56:57.849790 2558 feature_gate.go:328] unrecognized feature gate: Example Jul 13 02:56:57.850478 ip-10-0-134-52 kubenswrapper[2558]: W0713 02:56:57.849792 2558 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jul 13 02:56:57.850478 ip-10-0-134-52 kubenswrapper[2558]: W0713 02:56:57.849795 2558 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jul 13 02:56:57.850478 ip-10-0-134-52 kubenswrapper[2558]: W0713 02:56:57.849798 2558 feature_gate.go:328] unrecognized feature gate: Example2 Jul 13 02:56:57.850478 ip-10-0-134-52 kubenswrapper[2558]: W0713 02:56:57.849800 2558 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jul 13 02:56:57.850478 ip-10-0-134-52 kubenswrapper[2558]: W0713 02:56:57.849803 2558 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jul 13 02:56:57.850478 ip-10-0-134-52 kubenswrapper[2558]: W0713 02:56:57.849805 2558 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jul 13 02:56:57.850478 ip-10-0-134-52 kubenswrapper[2558]: W0713 02:56:57.849807 2558 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jul 13 02:56:57.850478 ip-10-0-134-52 kubenswrapper[2558]: W0713 02:56:57.849810 2558 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jul 13 02:56:57.850478 ip-10-0-134-52 kubenswrapper[2558]: W0713 02:56:57.849812 2558 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jul 13 02:56:57.850478 ip-10-0-134-52 kubenswrapper[2558]: W0713 02:56:57.849816 2558 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jul 13 02:56:57.850478 ip-10-0-134-52 kubenswrapper[2558]: W0713 02:56:57.849819 2558 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jul 13 02:56:57.850984 ip-10-0-134-52 kubenswrapper[2558]: W0713 02:56:57.849821 2558 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jul 13 02:56:57.850984 ip-10-0-134-52 kubenswrapper[2558]: W0713 02:56:57.849824 2558 feature_gate.go:328] unrecognized feature gate: OVNObservability Jul 13 02:56:57.850984 ip-10-0-134-52 kubenswrapper[2558]: W0713 02:56:57.849826 2558 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jul 13 02:56:57.850984 ip-10-0-134-52 kubenswrapper[2558]: W0713 02:56:57.849829 2558 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jul 13 02:56:57.850984 ip-10-0-134-52 kubenswrapper[2558]: W0713 02:56:57.849831 2558 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jul 13 02:56:57.850984 ip-10-0-134-52 kubenswrapper[2558]: W0713 02:56:57.849834 2558 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jul 13 02:56:57.850984 ip-10-0-134-52 kubenswrapper[2558]: W0713 02:56:57.849837 2558 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jul 13 02:56:57.850984 ip-10-0-134-52 kubenswrapper[2558]: W0713 02:56:57.849839 2558 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jul 13 02:56:57.850984 ip-10-0-134-52 kubenswrapper[2558]: W0713 02:56:57.849842 2558 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jul 13 02:56:57.850984 ip-10-0-134-52 kubenswrapper[2558]: W0713 02:56:57.849844 2558 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jul 13 02:56:57.850984 ip-10-0-134-52 kubenswrapper[2558]: W0713 02:56:57.849846 2558 feature_gate.go:328] unrecognized feature gate: DualReplica Jul 13 02:56:57.850984 ip-10-0-134-52 kubenswrapper[2558]: W0713 02:56:57.849849 2558 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jul 13 02:56:57.850984 ip-10-0-134-52 kubenswrapper[2558]: W0713 02:56:57.849851 2558 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jul 13 02:56:57.850984 ip-10-0-134-52 kubenswrapper[2558]: W0713 02:56:57.849854 2558 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jul 13 02:56:57.850984 ip-10-0-134-52 kubenswrapper[2558]: W0713 02:56:57.849856 2558 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jul 13 02:56:57.850984 ip-10-0-134-52 kubenswrapper[2558]: W0713 02:56:57.849859 2558 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jul 13 02:56:57.850984 ip-10-0-134-52 kubenswrapper[2558]: W0713 02:56:57.849862 2558 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jul 13 02:56:57.850984 ip-10-0-134-52 kubenswrapper[2558]: W0713 02:56:57.849864 2558 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jul 13 02:56:57.850984 ip-10-0-134-52 kubenswrapper[2558]: W0713 02:56:57.849867 2558 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jul 13 02:56:57.850984 ip-10-0-134-52 kubenswrapper[2558]: W0713 02:56:57.849869 2558 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jul 13 02:56:57.851481 ip-10-0-134-52 kubenswrapper[2558]: W0713 02:56:57.849872 2558 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jul 13 02:56:57.851481 ip-10-0-134-52 kubenswrapper[2558]: W0713 02:56:57.849874 2558 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jul 13 02:56:57.851481 ip-10-0-134-52 kubenswrapper[2558]: W0713 02:56:57.849877 2558 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jul 13 02:56:57.851481 ip-10-0-134-52 kubenswrapper[2558]: W0713 02:56:57.849879 2558 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jul 13 02:56:57.851481 ip-10-0-134-52 kubenswrapper[2558]: W0713 02:56:57.849882 2558 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jul 13 02:56:57.851481 ip-10-0-134-52 kubenswrapper[2558]: W0713 02:56:57.849884 2558 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jul 13 02:56:57.851481 ip-10-0-134-52 kubenswrapper[2558]: W0713 02:56:57.849887 2558 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jul 13 02:56:57.851481 ip-10-0-134-52 kubenswrapper[2558]: W0713 02:56:57.849889 2558 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jul 13 02:56:57.851481 ip-10-0-134-52 kubenswrapper[2558]: W0713 02:56:57.849891 2558 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jul 13 02:56:57.851481 ip-10-0-134-52 kubenswrapper[2558]: W0713 02:56:57.849894 2558 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jul 13 02:56:57.851481 ip-10-0-134-52 kubenswrapper[2558]: W0713 02:56:57.849900 2558 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jul 13 02:56:57.851481 ip-10-0-134-52 kubenswrapper[2558]: W0713 02:56:57.849904 2558 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jul 13 02:56:57.851481 ip-10-0-134-52 kubenswrapper[2558]: W0713 02:56:57.849907 2558 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jul 13 02:56:57.851481 ip-10-0-134-52 kubenswrapper[2558]: W0713 02:56:57.849910 2558 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jul 13 02:56:57.851481 ip-10-0-134-52 kubenswrapper[2558]: W0713 02:56:57.849912 2558 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jul 13 02:56:57.851481 ip-10-0-134-52 kubenswrapper[2558]: W0713 02:56:57.849915 2558 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jul 13 02:56:57.851481 ip-10-0-134-52 kubenswrapper[2558]: W0713 02:56:57.849917 2558 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jul 13 02:56:57.851481 ip-10-0-134-52 kubenswrapper[2558]: W0713 02:56:57.849920 2558 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jul 13 02:56:57.851481 ip-10-0-134-52 kubenswrapper[2558]: W0713 02:56:57.849923 2558 feature_gate.go:328] unrecognized feature gate: OSStreams Jul 13 02:56:57.851946 ip-10-0-134-52 kubenswrapper[2558]: W0713 02:56:57.849925 2558 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jul 13 02:56:57.851946 ip-10-0-134-52 kubenswrapper[2558]: W0713 02:56:57.849927 2558 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jul 13 02:56:57.851946 ip-10-0-134-52 kubenswrapper[2558]: W0713 02:56:57.849930 2558 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jul 13 02:56:57.851946 ip-10-0-134-52 kubenswrapper[2558]: W0713 02:56:57.849933 2558 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jul 13 02:56:57.851946 ip-10-0-134-52 kubenswrapper[2558]: W0713 02:56:57.849935 2558 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jul 13 02:56:57.851946 ip-10-0-134-52 kubenswrapper[2558]: W0713 02:56:57.849937 2558 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jul 13 02:56:57.851946 ip-10-0-134-52 kubenswrapper[2558]: W0713 02:56:57.849940 2558 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jul 13 02:56:57.851946 ip-10-0-134-52 kubenswrapper[2558]: W0713 02:56:57.849942 2558 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jul 13 02:56:57.851946 ip-10-0-134-52 kubenswrapper[2558]: W0713 02:56:57.849945 2558 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jul 13 02:56:57.851946 ip-10-0-134-52 kubenswrapper[2558]: W0713 02:56:57.849947 2558 feature_gate.go:328] unrecognized feature gate: EventTTL Jul 13 02:56:57.851946 ip-10-0-134-52 kubenswrapper[2558]: W0713 02:56:57.849950 2558 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jul 13 02:56:57.851946 ip-10-0-134-52 kubenswrapper[2558]: W0713 02:56:57.849953 2558 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jul 13 02:56:57.851946 ip-10-0-134-52 kubenswrapper[2558]: W0713 02:56:57.849955 2558 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jul 13 02:56:57.851946 ip-10-0-134-52 kubenswrapper[2558]: W0713 02:56:57.849957 2558 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jul 13 02:56:57.851946 ip-10-0-134-52 kubenswrapper[2558]: W0713 02:56:57.849960 2558 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jul 13 02:56:57.851946 ip-10-0-134-52 kubenswrapper[2558]: W0713 02:56:57.849962 2558 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jul 13 02:56:57.851946 ip-10-0-134-52 kubenswrapper[2558]: W0713 02:56:57.849965 2558 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jul 13 02:56:57.851946 ip-10-0-134-52 kubenswrapper[2558]: W0713 02:56:57.849967 2558 feature_gate.go:328] unrecognized feature gate: PinnedImages Jul 13 02:56:57.851946 ip-10-0-134-52 kubenswrapper[2558]: W0713 02:56:57.849972 2558 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jul 13 02:56:57.851946 ip-10-0-134-52 kubenswrapper[2558]: W0713 02:56:57.849975 2558 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jul 13 02:56:57.852454 ip-10-0-134-52 kubenswrapper[2558]: W0713 02:56:57.849977 2558 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jul 13 02:56:57.852454 ip-10-0-134-52 kubenswrapper[2558]: W0713 02:56:57.849980 2558 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jul 13 02:56:57.852454 ip-10-0-134-52 kubenswrapper[2558]: W0713 02:56:57.849982 2558 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jul 13 02:56:57.852454 ip-10-0-134-52 kubenswrapper[2558]: W0713 02:56:57.849985 2558 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jul 13 02:56:57.852454 ip-10-0-134-52 kubenswrapper[2558]: W0713 02:56:57.849988 2558 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jul 13 02:56:57.852454 ip-10-0-134-52 kubenswrapper[2558]: W0713 02:56:57.849990 2558 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jul 13 02:56:57.852454 ip-10-0-134-52 kubenswrapper[2558]: W0713 02:56:57.849993 2558 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jul 13 02:56:57.852454 ip-10-0-134-52 kubenswrapper[2558]: W0713 02:56:57.849995 2558 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jul 13 02:56:57.852454 ip-10-0-134-52 kubenswrapper[2558]: W0713 02:56:57.849997 2558 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jul 13 02:56:57.852454 ip-10-0-134-52 kubenswrapper[2558]: W0713 02:56:57.850002 2558 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jul 13 02:56:57.852454 ip-10-0-134-52 kubenswrapper[2558]: W0713 02:56:57.850005 2558 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jul 13 02:56:57.852454 ip-10-0-134-52 kubenswrapper[2558]: W0713 02:56:57.850008 2558 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jul 13 02:56:57.852454 ip-10-0-134-52 kubenswrapper[2558]: W0713 02:56:57.850011 2558 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jul 13 02:56:57.852454 ip-10-0-134-52 kubenswrapper[2558]: W0713 02:56:57.850014 2558 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jul 13 02:56:57.852454 ip-10-0-134-52 kubenswrapper[2558]: W0713 02:56:57.850017 2558 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jul 13 02:56:57.852454 ip-10-0-134-52 kubenswrapper[2558]: W0713 02:56:57.850020 2558 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jul 13 02:56:57.852454 ip-10-0-134-52 kubenswrapper[2558]: W0713 02:56:57.850022 2558 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jul 13 02:56:57.852454 ip-10-0-134-52 kubenswrapper[2558]: W0713 02:56:57.850026 2558 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jul 13 02:56:57.852454 ip-10-0-134-52 kubenswrapper[2558]: W0713 02:56:57.850391 2558 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jul 13 02:56:57.852906 ip-10-0-134-52 kubenswrapper[2558]: W0713 02:56:57.850396 2558 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jul 13 02:56:57.852906 ip-10-0-134-52 kubenswrapper[2558]: W0713 02:56:57.850400 2558 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jul 13 02:56:57.852906 ip-10-0-134-52 kubenswrapper[2558]: W0713 02:56:57.850403 2558 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jul 13 02:56:57.852906 ip-10-0-134-52 kubenswrapper[2558]: W0713 02:56:57.850407 2558 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jul 13 02:56:57.852906 ip-10-0-134-52 kubenswrapper[2558]: W0713 02:56:57.850410 2558 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jul 13 02:56:57.852906 ip-10-0-134-52 kubenswrapper[2558]: W0713 02:56:57.850413 2558 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jul 13 02:56:57.852906 ip-10-0-134-52 kubenswrapper[2558]: W0713 02:56:57.850415 2558 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jul 13 02:56:57.852906 ip-10-0-134-52 kubenswrapper[2558]: W0713 02:56:57.850418 2558 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jul 13 02:56:57.852906 ip-10-0-134-52 kubenswrapper[2558]: W0713 02:56:57.850421 2558 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jul 13 02:56:57.852906 ip-10-0-134-52 kubenswrapper[2558]: W0713 02:56:57.850423 2558 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jul 13 02:56:57.852906 ip-10-0-134-52 kubenswrapper[2558]: W0713 02:56:57.850426 2558 feature_gate.go:328] unrecognized feature gate: DualReplica Jul 13 02:56:57.852906 ip-10-0-134-52 kubenswrapper[2558]: W0713 02:56:57.850429 2558 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jul 13 02:56:57.852906 ip-10-0-134-52 kubenswrapper[2558]: W0713 02:56:57.850432 2558 feature_gate.go:328] unrecognized feature gate: SignatureStores Jul 13 02:56:57.852906 ip-10-0-134-52 kubenswrapper[2558]: W0713 02:56:57.850434 2558 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jul 13 02:56:57.852906 ip-10-0-134-52 kubenswrapper[2558]: W0713 02:56:57.850437 2558 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jul 13 02:56:57.852906 ip-10-0-134-52 kubenswrapper[2558]: W0713 02:56:57.850440 2558 feature_gate.go:328] unrecognized feature gate: Example Jul 13 02:56:57.852906 ip-10-0-134-52 kubenswrapper[2558]: W0713 02:56:57.850443 2558 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jul 13 02:56:57.852906 ip-10-0-134-52 kubenswrapper[2558]: W0713 02:56:57.850446 2558 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jul 13 02:56:57.852906 ip-10-0-134-52 kubenswrapper[2558]: W0713 02:56:57.850448 2558 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jul 13 02:56:57.852906 ip-10-0-134-52 kubenswrapper[2558]: W0713 02:56:57.850451 2558 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jul 13 02:56:57.852906 ip-10-0-134-52 kubenswrapper[2558]: W0713 02:56:57.850453 2558 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jul 13 02:56:57.853423 ip-10-0-134-52 kubenswrapper[2558]: W0713 02:56:57.850456 2558 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jul 13 02:56:57.853423 ip-10-0-134-52 kubenswrapper[2558]: W0713 02:56:57.850458 2558 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jul 13 02:56:57.853423 ip-10-0-134-52 kubenswrapper[2558]: W0713 02:56:57.850461 2558 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jul 13 02:56:57.853423 ip-10-0-134-52 kubenswrapper[2558]: W0713 02:56:57.850463 2558 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jul 13 02:56:57.853423 ip-10-0-134-52 kubenswrapper[2558]: W0713 02:56:57.850465 2558 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jul 13 02:56:57.853423 ip-10-0-134-52 kubenswrapper[2558]: W0713 02:56:57.850468 2558 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jul 13 02:56:57.853423 ip-10-0-134-52 kubenswrapper[2558]: W0713 02:56:57.850470 2558 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jul 13 02:56:57.853423 ip-10-0-134-52 kubenswrapper[2558]: W0713 02:56:57.850473 2558 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jul 13 02:56:57.853423 ip-10-0-134-52 kubenswrapper[2558]: W0713 02:56:57.850476 2558 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jul 13 02:56:57.853423 ip-10-0-134-52 kubenswrapper[2558]: W0713 02:56:57.850478 2558 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jul 13 02:56:57.853423 ip-10-0-134-52 kubenswrapper[2558]: W0713 02:56:57.850481 2558 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jul 13 02:56:57.853423 ip-10-0-134-52 kubenswrapper[2558]: W0713 02:56:57.850483 2558 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jul 13 02:56:57.853423 ip-10-0-134-52 kubenswrapper[2558]: W0713 02:56:57.850486 2558 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jul 13 02:56:57.853423 ip-10-0-134-52 kubenswrapper[2558]: W0713 02:56:57.850489 2558 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jul 13 02:56:57.853423 ip-10-0-134-52 kubenswrapper[2558]: W0713 02:56:57.850492 2558 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jul 13 02:56:57.853423 ip-10-0-134-52 kubenswrapper[2558]: W0713 02:56:57.850495 2558 feature_gate.go:328] unrecognized feature gate: OSStreams Jul 13 02:56:57.853423 ip-10-0-134-52 kubenswrapper[2558]: W0713 02:56:57.850497 2558 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jul 13 02:56:57.853423 ip-10-0-134-52 kubenswrapper[2558]: W0713 02:56:57.850500 2558 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jul 13 02:56:57.853423 ip-10-0-134-52 kubenswrapper[2558]: W0713 02:56:57.850503 2558 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jul 13 02:56:57.853423 ip-10-0-134-52 kubenswrapper[2558]: W0713 02:56:57.850505 2558 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jul 13 02:56:57.853907 ip-10-0-134-52 kubenswrapper[2558]: W0713 02:56:57.850508 2558 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jul 13 02:56:57.853907 ip-10-0-134-52 kubenswrapper[2558]: W0713 02:56:57.850510 2558 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jul 13 02:56:57.853907 ip-10-0-134-52 kubenswrapper[2558]: W0713 02:56:57.850514 2558 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jul 13 02:56:57.853907 ip-10-0-134-52 kubenswrapper[2558]: W0713 02:56:57.850517 2558 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jul 13 02:56:57.853907 ip-10-0-134-52 kubenswrapper[2558]: W0713 02:56:57.850519 2558 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jul 13 02:56:57.853907 ip-10-0-134-52 kubenswrapper[2558]: W0713 02:56:57.850522 2558 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jul 13 02:56:57.853907 ip-10-0-134-52 kubenswrapper[2558]: W0713 02:56:57.850524 2558 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jul 13 02:56:57.853907 ip-10-0-134-52 kubenswrapper[2558]: W0713 02:56:57.850527 2558 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jul 13 02:56:57.853907 ip-10-0-134-52 kubenswrapper[2558]: W0713 02:56:57.850529 2558 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jul 13 02:56:57.853907 ip-10-0-134-52 kubenswrapper[2558]: W0713 02:56:57.850532 2558 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jul 13 02:56:57.853907 ip-10-0-134-52 kubenswrapper[2558]: W0713 02:56:57.850534 2558 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jul 13 02:56:57.853907 ip-10-0-134-52 kubenswrapper[2558]: W0713 02:56:57.850536 2558 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jul 13 02:56:57.853907 ip-10-0-134-52 kubenswrapper[2558]: W0713 02:56:57.850539 2558 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jul 13 02:56:57.853907 ip-10-0-134-52 kubenswrapper[2558]: W0713 02:56:57.850541 2558 feature_gate.go:328] unrecognized feature gate: EventTTL Jul 13 02:56:57.853907 ip-10-0-134-52 kubenswrapper[2558]: W0713 02:56:57.850544 2558 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jul 13 02:56:57.853907 ip-10-0-134-52 kubenswrapper[2558]: W0713 02:56:57.850546 2558 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jul 13 02:56:57.853907 ip-10-0-134-52 kubenswrapper[2558]: W0713 02:56:57.850548 2558 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jul 13 02:56:57.853907 ip-10-0-134-52 kubenswrapper[2558]: W0713 02:56:57.850551 2558 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jul 13 02:56:57.853907 ip-10-0-134-52 kubenswrapper[2558]: W0713 02:56:57.850553 2558 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jul 13 02:56:57.853907 ip-10-0-134-52 kubenswrapper[2558]: W0713 02:56:57.850555 2558 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jul 13 02:56:57.854412 ip-10-0-134-52 kubenswrapper[2558]: W0713 02:56:57.850558 2558 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jul 13 02:56:57.854412 ip-10-0-134-52 kubenswrapper[2558]: W0713 02:56:57.850560 2558 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jul 13 02:56:57.854412 ip-10-0-134-52 kubenswrapper[2558]: W0713 02:56:57.850563 2558 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jul 13 02:56:57.854412 ip-10-0-134-52 kubenswrapper[2558]: W0713 02:56:57.850565 2558 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jul 13 02:56:57.854412 ip-10-0-134-52 kubenswrapper[2558]: W0713 02:56:57.850568 2558 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jul 13 02:56:57.854412 ip-10-0-134-52 kubenswrapper[2558]: W0713 02:56:57.850570 2558 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jul 13 02:56:57.854412 ip-10-0-134-52 kubenswrapper[2558]: W0713 02:56:57.850572 2558 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jul 13 02:56:57.854412 ip-10-0-134-52 kubenswrapper[2558]: W0713 02:56:57.850575 2558 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jul 13 02:56:57.854412 ip-10-0-134-52 kubenswrapper[2558]: W0713 02:56:57.850578 2558 feature_gate.go:328] unrecognized feature gate: PinnedImages Jul 13 02:56:57.854412 ip-10-0-134-52 kubenswrapper[2558]: W0713 02:56:57.850581 2558 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jul 13 02:56:57.854412 ip-10-0-134-52 kubenswrapper[2558]: W0713 02:56:57.850584 2558 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jul 13 02:56:57.854412 ip-10-0-134-52 kubenswrapper[2558]: W0713 02:56:57.850586 2558 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jul 13 02:56:57.854412 ip-10-0-134-52 kubenswrapper[2558]: W0713 02:56:57.850589 2558 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jul 13 02:56:57.854412 ip-10-0-134-52 kubenswrapper[2558]: W0713 02:56:57.850593 2558 feature_gate.go:328] unrecognized feature gate: Example2 Jul 13 02:56:57.854412 ip-10-0-134-52 kubenswrapper[2558]: W0713 02:56:57.850595 2558 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jul 13 02:56:57.854412 ip-10-0-134-52 kubenswrapper[2558]: W0713 02:56:57.850600 2558 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jul 13 02:56:57.854412 ip-10-0-134-52 kubenswrapper[2558]: W0713 02:56:57.850603 2558 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jul 13 02:56:57.854412 ip-10-0-134-52 kubenswrapper[2558]: W0713 02:56:57.850605 2558 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jul 13 02:56:57.854412 ip-10-0-134-52 kubenswrapper[2558]: W0713 02:56:57.850608 2558 feature_gate.go:328] unrecognized feature gate: NewOLM Jul 13 02:56:57.854876 ip-10-0-134-52 kubenswrapper[2558]: W0713 02:56:57.850611 2558 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jul 13 02:56:57.854876 ip-10-0-134-52 kubenswrapper[2558]: W0713 02:56:57.850613 2558 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jul 13 02:56:57.854876 ip-10-0-134-52 kubenswrapper[2558]: W0713 02:56:57.850616 2558 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jul 13 02:56:57.854876 ip-10-0-134-52 kubenswrapper[2558]: W0713 02:56:57.850618 2558 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jul 13 02:56:57.854876 ip-10-0-134-52 kubenswrapper[2558]: W0713 02:56:57.850621 2558 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jul 13 02:56:57.854876 ip-10-0-134-52 kubenswrapper[2558]: W0713 02:56:57.850623 2558 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jul 13 02:56:57.854876 ip-10-0-134-52 kubenswrapper[2558]: W0713 02:56:57.850626 2558 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jul 13 02:56:57.854876 ip-10-0-134-52 kubenswrapper[2558]: W0713 02:56:57.850630 2558 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jul 13 02:56:57.854876 ip-10-0-134-52 kubenswrapper[2558]: W0713 02:56:57.850634 2558 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jul 13 02:56:57.854876 ip-10-0-134-52 kubenswrapper[2558]: W0713 02:56:57.850637 2558 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jul 13 02:56:57.854876 ip-10-0-134-52 kubenswrapper[2558]: W0713 02:56:57.850640 2558 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jul 13 02:56:57.854876 ip-10-0-134-52 kubenswrapper[2558]: W0713 02:56:57.850643 2558 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jul 13 02:56:57.854876 ip-10-0-134-52 kubenswrapper[2558]: W0713 02:56:57.850646 2558 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jul 13 02:56:57.854876 ip-10-0-134-52 kubenswrapper[2558]: W0713 02:56:57.850649 2558 feature_gate.go:328] unrecognized feature gate: OVNObservability Jul 13 02:56:57.854876 ip-10-0-134-52 kubenswrapper[2558]: W0713 02:56:57.850652 2558 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jul 13 02:56:57.854876 ip-10-0-134-52 kubenswrapper[2558]: W0713 02:56:57.850654 2558 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jul 13 02:56:57.854876 ip-10-0-134-52 kubenswrapper[2558]: W0713 02:56:57.850658 2558 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jul 13 02:56:57.854876 ip-10-0-134-52 kubenswrapper[2558]: W0713 02:56:57.850661 2558 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jul 13 02:56:57.854876 ip-10-0-134-52 kubenswrapper[2558]: I0713 02:56:57.850730 2558 flags.go:64] FLAG: --address="0.0.0.0" Jul 13 02:56:57.855350 ip-10-0-134-52 kubenswrapper[2558]: I0713 02:56:57.850740 2558 flags.go:64] FLAG: --allowed-unsafe-sysctls="[]" Jul 13 02:56:57.855350 ip-10-0-134-52 kubenswrapper[2558]: I0713 02:56:57.850748 2558 flags.go:64] FLAG: --anonymous-auth="true" Jul 13 02:56:57.855350 ip-10-0-134-52 kubenswrapper[2558]: I0713 02:56:57.850754 2558 flags.go:64] FLAG: --application-metrics-count-limit="100" Jul 13 02:56:57.855350 ip-10-0-134-52 kubenswrapper[2558]: I0713 02:56:57.850761 2558 flags.go:64] FLAG: --authentication-token-webhook="false" Jul 13 02:56:57.855350 ip-10-0-134-52 kubenswrapper[2558]: I0713 02:56:57.850766 2558 flags.go:64] FLAG: --authentication-token-webhook-cache-ttl="2m0s" Jul 13 02:56:57.855350 ip-10-0-134-52 kubenswrapper[2558]: I0713 02:56:57.850773 2558 flags.go:64] FLAG: --authorization-mode="AlwaysAllow" Jul 13 02:56:57.855350 ip-10-0-134-52 kubenswrapper[2558]: I0713 02:56:57.850779 2558 flags.go:64] FLAG: --authorization-webhook-cache-authorized-ttl="5m0s" Jul 13 02:56:57.855350 ip-10-0-134-52 kubenswrapper[2558]: I0713 02:56:57.850782 2558 flags.go:64] FLAG: --authorization-webhook-cache-unauthorized-ttl="30s" Jul 13 02:56:57.855350 ip-10-0-134-52 kubenswrapper[2558]: I0713 02:56:57.850785 2558 flags.go:64] FLAG: --boot-id-file="/proc/sys/kernel/random/boot_id" Jul 13 02:56:57.855350 ip-10-0-134-52 kubenswrapper[2558]: I0713 02:56:57.850790 2558 flags.go:64] FLAG: --bootstrap-kubeconfig="/etc/kubernetes/kubeconfig" Jul 13 02:56:57.855350 ip-10-0-134-52 kubenswrapper[2558]: I0713 02:56:57.850793 2558 flags.go:64] FLAG: --cert-dir="/var/lib/kubelet/pki" Jul 13 02:56:57.855350 ip-10-0-134-52 kubenswrapper[2558]: I0713 02:56:57.850796 2558 flags.go:64] FLAG: --cgroup-driver="cgroupfs" Jul 13 02:56:57.855350 ip-10-0-134-52 kubenswrapper[2558]: I0713 02:56:57.850798 2558 flags.go:64] FLAG: --cgroup-root="" Jul 13 02:56:57.855350 ip-10-0-134-52 kubenswrapper[2558]: I0713 02:56:57.850801 2558 flags.go:64] FLAG: --cgroups-per-qos="true" Jul 13 02:56:57.855350 ip-10-0-134-52 kubenswrapper[2558]: I0713 02:56:57.850804 2558 flags.go:64] FLAG: --client-ca-file="" Jul 13 02:56:57.855350 ip-10-0-134-52 kubenswrapper[2558]: I0713 02:56:57.850807 2558 flags.go:64] FLAG: --cloud-provider="external" Jul 13 02:56:57.855350 ip-10-0-134-52 kubenswrapper[2558]: I0713 02:56:57.850810 2558 flags.go:64] FLAG: --cluster-dns="[]" Jul 13 02:56:57.855350 ip-10-0-134-52 kubenswrapper[2558]: I0713 02:56:57.850815 2558 flags.go:64] FLAG: --cluster-domain="" Jul 13 02:56:57.855350 ip-10-0-134-52 kubenswrapper[2558]: I0713 02:56:57.850818 2558 flags.go:64] FLAG: --config="/etc/kubernetes/kubelet.conf" Jul 13 02:56:57.855350 ip-10-0-134-52 kubenswrapper[2558]: I0713 02:56:57.850821 2558 flags.go:64] FLAG: --config-dir="/etc/openshift/kubelet.conf.d" Jul 13 02:56:57.855350 ip-10-0-134-52 kubenswrapper[2558]: I0713 02:56:57.850824 2558 flags.go:64] FLAG: --container-hints="/etc/cadvisor/container_hints.json" Jul 13 02:56:57.855350 ip-10-0-134-52 kubenswrapper[2558]: I0713 02:56:57.850827 2558 flags.go:64] FLAG: --container-log-max-files="5" Jul 13 02:56:57.855350 ip-10-0-134-52 kubenswrapper[2558]: I0713 02:56:57.850830 2558 flags.go:64] FLAG: --container-log-max-size="10Mi" Jul 13 02:56:57.855350 ip-10-0-134-52 kubenswrapper[2558]: I0713 02:56:57.850833 2558 flags.go:64] FLAG: --container-runtime-endpoint="/var/run/crio/crio.sock" Jul 13 02:56:57.855931 ip-10-0-134-52 kubenswrapper[2558]: I0713 02:56:57.850836 2558 flags.go:64] FLAG: --containerd="/run/containerd/containerd.sock" Jul 13 02:56:57.855931 ip-10-0-134-52 kubenswrapper[2558]: I0713 02:56:57.850839 2558 flags.go:64] FLAG: --containerd-namespace="k8s.io" Jul 13 02:56:57.855931 ip-10-0-134-52 kubenswrapper[2558]: I0713 02:56:57.850842 2558 flags.go:64] FLAG: --contention-profiling="false" Jul 13 02:56:57.855931 ip-10-0-134-52 kubenswrapper[2558]: I0713 02:56:57.850845 2558 flags.go:64] FLAG: --cpu-cfs-quota="true" Jul 13 02:56:57.855931 ip-10-0-134-52 kubenswrapper[2558]: I0713 02:56:57.850848 2558 flags.go:64] FLAG: --cpu-cfs-quota-period="100ms" Jul 13 02:56:57.855931 ip-10-0-134-52 kubenswrapper[2558]: I0713 02:56:57.850851 2558 flags.go:64] FLAG: --cpu-manager-policy="none" Jul 13 02:56:57.855931 ip-10-0-134-52 kubenswrapper[2558]: I0713 02:56:57.850854 2558 flags.go:64] FLAG: --cpu-manager-policy-options="" Jul 13 02:56:57.855931 ip-10-0-134-52 kubenswrapper[2558]: I0713 02:56:57.850858 2558 flags.go:64] FLAG: --cpu-manager-reconcile-period="10s" Jul 13 02:56:57.855931 ip-10-0-134-52 kubenswrapper[2558]: I0713 02:56:57.850861 2558 flags.go:64] FLAG: --enable-controller-attach-detach="true" Jul 13 02:56:57.855931 ip-10-0-134-52 kubenswrapper[2558]: I0713 02:56:57.850864 2558 flags.go:64] FLAG: --enable-debugging-handlers="true" Jul 13 02:56:57.855931 ip-10-0-134-52 kubenswrapper[2558]: I0713 02:56:57.850866 2558 flags.go:64] FLAG: --enable-load-reader="false" Jul 13 02:56:57.855931 ip-10-0-134-52 kubenswrapper[2558]: I0713 02:56:57.850869 2558 flags.go:64] FLAG: --enable-server="true" Jul 13 02:56:57.855931 ip-10-0-134-52 kubenswrapper[2558]: I0713 02:56:57.850873 2558 flags.go:64] FLAG: --enforce-node-allocatable="[pods]" Jul 13 02:56:57.855931 ip-10-0-134-52 kubenswrapper[2558]: I0713 02:56:57.850877 2558 flags.go:64] FLAG: --event-burst="100" Jul 13 02:56:57.855931 ip-10-0-134-52 kubenswrapper[2558]: I0713 02:56:57.850880 2558 flags.go:64] FLAG: --event-qps="50" Jul 13 02:56:57.855931 ip-10-0-134-52 kubenswrapper[2558]: I0713 02:56:57.850883 2558 flags.go:64] FLAG: --event-storage-age-limit="default=0" Jul 13 02:56:57.855931 ip-10-0-134-52 kubenswrapper[2558]: I0713 02:56:57.850886 2558 flags.go:64] FLAG: --event-storage-event-limit="default=0" Jul 13 02:56:57.855931 ip-10-0-134-52 kubenswrapper[2558]: I0713 02:56:57.850890 2558 flags.go:64] FLAG: --eviction-hard="" Jul 13 02:56:57.855931 ip-10-0-134-52 kubenswrapper[2558]: I0713 02:56:57.850894 2558 flags.go:64] FLAG: --eviction-max-pod-grace-period="0" Jul 13 02:56:57.855931 ip-10-0-134-52 kubenswrapper[2558]: I0713 02:56:57.850896 2558 flags.go:64] FLAG: --eviction-minimum-reclaim="" Jul 13 02:56:57.855931 ip-10-0-134-52 kubenswrapper[2558]: I0713 02:56:57.850899 2558 flags.go:64] FLAG: --eviction-pressure-transition-period="5m0s" Jul 13 02:56:57.855931 ip-10-0-134-52 kubenswrapper[2558]: I0713 02:56:57.850902 2558 flags.go:64] FLAG: --eviction-soft="" Jul 13 02:56:57.855931 ip-10-0-134-52 kubenswrapper[2558]: I0713 02:56:57.850905 2558 flags.go:64] FLAG: --eviction-soft-grace-period="" Jul 13 02:56:57.855931 ip-10-0-134-52 kubenswrapper[2558]: I0713 02:56:57.850907 2558 flags.go:64] FLAG: --exit-on-lock-contention="false" Jul 13 02:56:57.855931 ip-10-0-134-52 kubenswrapper[2558]: I0713 02:56:57.850910 2558 flags.go:64] FLAG: --experimental-allocatable-ignore-eviction="false" Jul 13 02:56:57.856607 ip-10-0-134-52 kubenswrapper[2558]: I0713 02:56:57.850913 2558 flags.go:64] FLAG: --experimental-mounter-path="" Jul 13 02:56:57.856607 ip-10-0-134-52 kubenswrapper[2558]: I0713 02:56:57.850916 2558 flags.go:64] FLAG: --fail-cgroupv1="false" Jul 13 02:56:57.856607 ip-10-0-134-52 kubenswrapper[2558]: I0713 02:56:57.850919 2558 flags.go:64] FLAG: --fail-swap-on="true" Jul 13 02:56:57.856607 ip-10-0-134-52 kubenswrapper[2558]: I0713 02:56:57.850921 2558 flags.go:64] FLAG: --feature-gates="" Jul 13 02:56:57.856607 ip-10-0-134-52 kubenswrapper[2558]: I0713 02:56:57.850925 2558 flags.go:64] FLAG: --file-check-frequency="20s" Jul 13 02:56:57.856607 ip-10-0-134-52 kubenswrapper[2558]: I0713 02:56:57.850928 2558 flags.go:64] FLAG: --global-housekeeping-interval="1m0s" Jul 13 02:56:57.856607 ip-10-0-134-52 kubenswrapper[2558]: I0713 02:56:57.850930 2558 flags.go:64] FLAG: --hairpin-mode="promiscuous-bridge" Jul 13 02:56:57.856607 ip-10-0-134-52 kubenswrapper[2558]: I0713 02:56:57.850933 2558 flags.go:64] FLAG: --healthz-bind-address="127.0.0.1" Jul 13 02:56:57.856607 ip-10-0-134-52 kubenswrapper[2558]: I0713 02:56:57.850936 2558 flags.go:64] FLAG: --healthz-port="10248" Jul 13 02:56:57.856607 ip-10-0-134-52 kubenswrapper[2558]: I0713 02:56:57.850939 2558 flags.go:64] FLAG: --help="false" Jul 13 02:56:57.856607 ip-10-0-134-52 kubenswrapper[2558]: I0713 02:56:57.850941 2558 flags.go:64] FLAG: --hostname-override="ip-10-0-134-52.ec2.internal" Jul 13 02:56:57.856607 ip-10-0-134-52 kubenswrapper[2558]: I0713 02:56:57.850944 2558 flags.go:64] FLAG: --housekeeping-interval="10s" Jul 13 02:56:57.856607 ip-10-0-134-52 kubenswrapper[2558]: I0713 02:56:57.850947 2558 flags.go:64] FLAG: --http-check-frequency="20s" Jul 13 02:56:57.856607 ip-10-0-134-52 kubenswrapper[2558]: I0713 02:56:57.850950 2558 flags.go:64] FLAG: --image-credential-provider-bin-dir="/usr/libexec/kubelet-image-credential-provider-plugins" Jul 13 02:56:57.856607 ip-10-0-134-52 kubenswrapper[2558]: I0713 02:56:57.850953 2558 flags.go:64] FLAG: --image-credential-provider-config="/etc/kubernetes/credential-providers/ecr-credential-provider.yaml" Jul 13 02:56:57.856607 ip-10-0-134-52 kubenswrapper[2558]: I0713 02:56:57.850956 2558 flags.go:64] FLAG: --image-gc-high-threshold="85" Jul 13 02:56:57.856607 ip-10-0-134-52 kubenswrapper[2558]: I0713 02:56:57.850959 2558 flags.go:64] FLAG: --image-gc-low-threshold="80" Jul 13 02:56:57.856607 ip-10-0-134-52 kubenswrapper[2558]: I0713 02:56:57.850961 2558 flags.go:64] FLAG: --image-service-endpoint="" Jul 13 02:56:57.856607 ip-10-0-134-52 kubenswrapper[2558]: I0713 02:56:57.850964 2558 flags.go:64] FLAG: --kernel-memcg-notification="false" Jul 13 02:56:57.856607 ip-10-0-134-52 kubenswrapper[2558]: I0713 02:56:57.850967 2558 flags.go:64] FLAG: --kube-api-burst="100" Jul 13 02:56:57.856607 ip-10-0-134-52 kubenswrapper[2558]: I0713 02:56:57.850970 2558 flags.go:64] FLAG: --kube-api-content-type="application/vnd.kubernetes.protobuf" Jul 13 02:56:57.856607 ip-10-0-134-52 kubenswrapper[2558]: I0713 02:56:57.850973 2558 flags.go:64] FLAG: --kube-api-qps="50" Jul 13 02:56:57.856607 ip-10-0-134-52 kubenswrapper[2558]: I0713 02:56:57.850976 2558 flags.go:64] FLAG: --kube-reserved="" Jul 13 02:56:57.856607 ip-10-0-134-52 kubenswrapper[2558]: I0713 02:56:57.850978 2558 flags.go:64] FLAG: --kube-reserved-cgroup="" Jul 13 02:56:57.857237 ip-10-0-134-52 kubenswrapper[2558]: I0713 02:56:57.850982 2558 flags.go:64] FLAG: --kubeconfig="/var/lib/kubelet/kubeconfig" Jul 13 02:56:57.857237 ip-10-0-134-52 kubenswrapper[2558]: I0713 02:56:57.850985 2558 flags.go:64] FLAG: --kubelet-cgroups="" Jul 13 02:56:57.857237 ip-10-0-134-52 kubenswrapper[2558]: I0713 02:56:57.850990 2558 flags.go:64] FLAG: --local-storage-capacity-isolation="true" Jul 13 02:56:57.857237 ip-10-0-134-52 kubenswrapper[2558]: I0713 02:56:57.850993 2558 flags.go:64] FLAG: --lock-file="" Jul 13 02:56:57.857237 ip-10-0-134-52 kubenswrapper[2558]: I0713 02:56:57.850995 2558 flags.go:64] FLAG: --log-cadvisor-usage="false" Jul 13 02:56:57.857237 ip-10-0-134-52 kubenswrapper[2558]: I0713 02:56:57.850998 2558 flags.go:64] FLAG: --log-flush-frequency="5s" Jul 13 02:56:57.857237 ip-10-0-134-52 kubenswrapper[2558]: I0713 02:56:57.851001 2558 flags.go:64] FLAG: --log-json-info-buffer-size="0" Jul 13 02:56:57.857237 ip-10-0-134-52 kubenswrapper[2558]: I0713 02:56:57.851007 2558 flags.go:64] FLAG: --log-json-split-stream="false" Jul 13 02:56:57.857237 ip-10-0-134-52 kubenswrapper[2558]: I0713 02:56:57.851010 2558 flags.go:64] FLAG: --log-text-info-buffer-size="0" Jul 13 02:56:57.857237 ip-10-0-134-52 kubenswrapper[2558]: I0713 02:56:57.851013 2558 flags.go:64] FLAG: --log-text-split-stream="false" Jul 13 02:56:57.857237 ip-10-0-134-52 kubenswrapper[2558]: I0713 02:56:57.851015 2558 flags.go:64] FLAG: --logging-format="text" Jul 13 02:56:57.857237 ip-10-0-134-52 kubenswrapper[2558]: I0713 02:56:57.851018 2558 flags.go:64] FLAG: --machine-id-file="/etc/machine-id,/var/lib/dbus/machine-id" Jul 13 02:56:57.857237 ip-10-0-134-52 kubenswrapper[2558]: I0713 02:56:57.851021 2558 flags.go:64] FLAG: --make-iptables-util-chains="true" Jul 13 02:56:57.857237 ip-10-0-134-52 kubenswrapper[2558]: I0713 02:56:57.851024 2558 flags.go:64] FLAG: --manifest-url="" Jul 13 02:56:57.857237 ip-10-0-134-52 kubenswrapper[2558]: I0713 02:56:57.851027 2558 flags.go:64] FLAG: --manifest-url-header="" Jul 13 02:56:57.857237 ip-10-0-134-52 kubenswrapper[2558]: I0713 02:56:57.851031 2558 flags.go:64] FLAG: --max-housekeeping-interval="15s" Jul 13 02:56:57.857237 ip-10-0-134-52 kubenswrapper[2558]: I0713 02:56:57.851033 2558 flags.go:64] FLAG: --max-open-files="1000000" Jul 13 02:56:57.857237 ip-10-0-134-52 kubenswrapper[2558]: I0713 02:56:57.851037 2558 flags.go:64] FLAG: --max-pods="110" Jul 13 02:56:57.857237 ip-10-0-134-52 kubenswrapper[2558]: I0713 02:56:57.851040 2558 flags.go:64] FLAG: --maximum-dead-containers="-1" Jul 13 02:56:57.857237 ip-10-0-134-52 kubenswrapper[2558]: I0713 02:56:57.851043 2558 flags.go:64] FLAG: --maximum-dead-containers-per-container="1" Jul 13 02:56:57.857237 ip-10-0-134-52 kubenswrapper[2558]: I0713 02:56:57.851046 2558 flags.go:64] FLAG: --memory-manager-policy="None" Jul 13 02:56:57.857237 ip-10-0-134-52 kubenswrapper[2558]: I0713 02:56:57.851048 2558 flags.go:64] FLAG: --minimum-container-ttl-duration="6m0s" Jul 13 02:56:57.857237 ip-10-0-134-52 kubenswrapper[2558]: I0713 02:56:57.851051 2558 flags.go:64] FLAG: --minimum-image-ttl-duration="2m0s" Jul 13 02:56:57.857237 ip-10-0-134-52 kubenswrapper[2558]: I0713 02:56:57.851054 2558 flags.go:64] FLAG: --node-ip="0.0.0.0" Jul 13 02:56:57.857237 ip-10-0-134-52 kubenswrapper[2558]: I0713 02:56:57.851057 2558 flags.go:64] FLAG: --node-labels="node-role.kubernetes.io/worker=,node.openshift.io/os_id=rhel" Jul 13 02:56:57.857848 ip-10-0-134-52 kubenswrapper[2558]: I0713 02:56:57.851064 2558 flags.go:64] FLAG: --node-status-max-images="50" Jul 13 02:56:57.857848 ip-10-0-134-52 kubenswrapper[2558]: I0713 02:56:57.851066 2558 flags.go:64] FLAG: --node-status-update-frequency="10s" Jul 13 02:56:57.857848 ip-10-0-134-52 kubenswrapper[2558]: I0713 02:56:57.851069 2558 flags.go:64] FLAG: --oom-score-adj="-999" Jul 13 02:56:57.857848 ip-10-0-134-52 kubenswrapper[2558]: I0713 02:56:57.851072 2558 flags.go:64] FLAG: --pod-cidr="" Jul 13 02:56:57.857848 ip-10-0-134-52 kubenswrapper[2558]: I0713 02:56:57.851075 2558 flags.go:64] FLAG: --pod-infra-container-image="quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:b04c0b1f73af4d021dd8f0b51bfeb302c24482c093de5f2c43654ab56c506926" Jul 13 02:56:57.857848 ip-10-0-134-52 kubenswrapper[2558]: I0713 02:56:57.851080 2558 flags.go:64] FLAG: --pod-manifest-path="" Jul 13 02:56:57.857848 ip-10-0-134-52 kubenswrapper[2558]: I0713 02:56:57.851083 2558 flags.go:64] FLAG: --pod-max-pids="-1" Jul 13 02:56:57.857848 ip-10-0-134-52 kubenswrapper[2558]: I0713 02:56:57.851086 2558 flags.go:64] FLAG: --pods-per-core="0" Jul 13 02:56:57.857848 ip-10-0-134-52 kubenswrapper[2558]: I0713 02:56:57.851090 2558 flags.go:64] FLAG: --port="10250" Jul 13 02:56:57.857848 ip-10-0-134-52 kubenswrapper[2558]: I0713 02:56:57.851094 2558 flags.go:64] FLAG: --protect-kernel-defaults="false" Jul 13 02:56:57.857848 ip-10-0-134-52 kubenswrapper[2558]: I0713 02:56:57.851097 2558 flags.go:64] FLAG: --provider-id="aws:///us-east-1a/i-03456127f6b21597f" Jul 13 02:56:57.857848 ip-10-0-134-52 kubenswrapper[2558]: I0713 02:56:57.851100 2558 flags.go:64] FLAG: --qos-reserved="" Jul 13 02:56:57.857848 ip-10-0-134-52 kubenswrapper[2558]: I0713 02:56:57.851102 2558 flags.go:64] FLAG: --read-only-port="10255" Jul 13 02:56:57.857848 ip-10-0-134-52 kubenswrapper[2558]: I0713 02:56:57.851105 2558 flags.go:64] FLAG: --register-node="true" Jul 13 02:56:57.857848 ip-10-0-134-52 kubenswrapper[2558]: I0713 02:56:57.851108 2558 flags.go:64] FLAG: --register-with-taints="" Jul 13 02:56:57.857848 ip-10-0-134-52 kubenswrapper[2558]: I0713 02:56:57.851112 2558 flags.go:64] FLAG: --registry-burst="10" Jul 13 02:56:57.857848 ip-10-0-134-52 kubenswrapper[2558]: I0713 02:56:57.851114 2558 flags.go:64] FLAG: --registry-qps="5" Jul 13 02:56:57.857848 ip-10-0-134-52 kubenswrapper[2558]: I0713 02:56:57.851117 2558 flags.go:64] FLAG: --reserved-cpus="" Jul 13 02:56:57.857848 ip-10-0-134-52 kubenswrapper[2558]: I0713 02:56:57.851120 2558 flags.go:64] FLAG: --reserved-memory="" Jul 13 02:56:57.857848 ip-10-0-134-52 kubenswrapper[2558]: I0713 02:56:57.851124 2558 flags.go:64] FLAG: --resolv-conf="/etc/resolv.conf" Jul 13 02:56:57.857848 ip-10-0-134-52 kubenswrapper[2558]: I0713 02:56:57.851127 2558 flags.go:64] FLAG: --root-dir="/var/lib/kubelet" Jul 13 02:56:57.857848 ip-10-0-134-52 kubenswrapper[2558]: I0713 02:56:57.851130 2558 flags.go:64] FLAG: --rotate-certificates="false" Jul 13 02:56:57.857848 ip-10-0-134-52 kubenswrapper[2558]: I0713 02:56:57.851132 2558 flags.go:64] FLAG: --rotate-server-certificates="false" Jul 13 02:56:57.857848 ip-10-0-134-52 kubenswrapper[2558]: I0713 02:56:57.851135 2558 flags.go:64] FLAG: --runonce="false" Jul 13 02:56:57.857848 ip-10-0-134-52 kubenswrapper[2558]: I0713 02:56:57.851138 2558 flags.go:64] FLAG: --runtime-cgroups="/system.slice/crio.service" Jul 13 02:56:57.858467 ip-10-0-134-52 kubenswrapper[2558]: I0713 02:56:57.851141 2558 flags.go:64] FLAG: --runtime-request-timeout="2m0s" Jul 13 02:56:57.858467 ip-10-0-134-52 kubenswrapper[2558]: I0713 02:56:57.851144 2558 flags.go:64] FLAG: --seccomp-default="false" Jul 13 02:56:57.858467 ip-10-0-134-52 kubenswrapper[2558]: I0713 02:56:57.851147 2558 flags.go:64] FLAG: --serialize-image-pulls="true" Jul 13 02:56:57.858467 ip-10-0-134-52 kubenswrapper[2558]: I0713 02:56:57.851149 2558 flags.go:64] FLAG: --storage-driver-buffer-duration="1m0s" Jul 13 02:56:57.858467 ip-10-0-134-52 kubenswrapper[2558]: I0713 02:56:57.851152 2558 flags.go:64] FLAG: --storage-driver-db="cadvisor" Jul 13 02:56:57.858467 ip-10-0-134-52 kubenswrapper[2558]: I0713 02:56:57.851155 2558 flags.go:64] FLAG: --storage-driver-host="localhost:8086" Jul 13 02:56:57.858467 ip-10-0-134-52 kubenswrapper[2558]: I0713 02:56:57.851158 2558 flags.go:64] FLAG: --storage-driver-password="root" Jul 13 02:56:57.858467 ip-10-0-134-52 kubenswrapper[2558]: I0713 02:56:57.851160 2558 flags.go:64] FLAG: --storage-driver-secure="false" Jul 13 02:56:57.858467 ip-10-0-134-52 kubenswrapper[2558]: I0713 02:56:57.851163 2558 flags.go:64] FLAG: --storage-driver-table="stats" Jul 13 02:56:57.858467 ip-10-0-134-52 kubenswrapper[2558]: I0713 02:56:57.851166 2558 flags.go:64] FLAG: --storage-driver-user="root" Jul 13 02:56:57.858467 ip-10-0-134-52 kubenswrapper[2558]: I0713 02:56:57.851168 2558 flags.go:64] FLAG: --streaming-connection-idle-timeout="4h0m0s" Jul 13 02:56:57.858467 ip-10-0-134-52 kubenswrapper[2558]: I0713 02:56:57.851171 2558 flags.go:64] FLAG: --sync-frequency="1m0s" Jul 13 02:56:57.858467 ip-10-0-134-52 kubenswrapper[2558]: I0713 02:56:57.851177 2558 flags.go:64] FLAG: --system-cgroups="" Jul 13 02:56:57.858467 ip-10-0-134-52 kubenswrapper[2558]: I0713 02:56:57.851180 2558 flags.go:64] FLAG: --system-reserved="cpu=500m,ephemeral-storage=1Gi,memory=1Gi" Jul 13 02:56:57.858467 ip-10-0-134-52 kubenswrapper[2558]: I0713 02:56:57.851185 2558 flags.go:64] FLAG: --system-reserved-cgroup="" Jul 13 02:56:57.858467 ip-10-0-134-52 kubenswrapper[2558]: I0713 02:56:57.851189 2558 flags.go:64] FLAG: --tls-cert-file="" Jul 13 02:56:57.858467 ip-10-0-134-52 kubenswrapper[2558]: I0713 02:56:57.851192 2558 flags.go:64] FLAG: --tls-cipher-suites="[]" Jul 13 02:56:57.858467 ip-10-0-134-52 kubenswrapper[2558]: I0713 02:56:57.851196 2558 flags.go:64] FLAG: --tls-min-version="" Jul 13 02:56:57.858467 ip-10-0-134-52 kubenswrapper[2558]: I0713 02:56:57.851199 2558 flags.go:64] FLAG: --tls-private-key-file="" Jul 13 02:56:57.858467 ip-10-0-134-52 kubenswrapper[2558]: I0713 02:56:57.851201 2558 flags.go:64] FLAG: --topology-manager-policy="none" Jul 13 02:56:57.858467 ip-10-0-134-52 kubenswrapper[2558]: I0713 02:56:57.851204 2558 flags.go:64] FLAG: --topology-manager-policy-options="" Jul 13 02:56:57.858467 ip-10-0-134-52 kubenswrapper[2558]: I0713 02:56:57.851207 2558 flags.go:64] FLAG: --topology-manager-scope="container" Jul 13 02:56:57.858467 ip-10-0-134-52 kubenswrapper[2558]: I0713 02:56:57.851210 2558 flags.go:64] FLAG: --v="2" Jul 13 02:56:57.858467 ip-10-0-134-52 kubenswrapper[2558]: I0713 02:56:57.851213 2558 flags.go:64] FLAG: --version="false" Jul 13 02:56:57.858467 ip-10-0-134-52 kubenswrapper[2558]: I0713 02:56:57.851217 2558 flags.go:64] FLAG: --vmodule="" Jul 13 02:56:57.859074 ip-10-0-134-52 kubenswrapper[2558]: I0713 02:56:57.851221 2558 flags.go:64] FLAG: --volume-plugin-dir="/etc/kubernetes/kubelet-plugins/volume/exec" Jul 13 02:56:57.859074 ip-10-0-134-52 kubenswrapper[2558]: I0713 02:56:57.851224 2558 flags.go:64] FLAG: --volume-stats-agg-period="1m0s" Jul 13 02:56:57.859074 ip-10-0-134-52 kubenswrapper[2558]: W0713 02:56:57.851350 2558 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jul 13 02:56:57.859074 ip-10-0-134-52 kubenswrapper[2558]: W0713 02:56:57.851354 2558 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jul 13 02:56:57.859074 ip-10-0-134-52 kubenswrapper[2558]: W0713 02:56:57.851358 2558 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jul 13 02:56:57.859074 ip-10-0-134-52 kubenswrapper[2558]: W0713 02:56:57.851361 2558 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jul 13 02:56:57.859074 ip-10-0-134-52 kubenswrapper[2558]: W0713 02:56:57.851364 2558 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jul 13 02:56:57.859074 ip-10-0-134-52 kubenswrapper[2558]: W0713 02:56:57.851366 2558 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jul 13 02:56:57.859074 ip-10-0-134-52 kubenswrapper[2558]: W0713 02:56:57.851369 2558 feature_gate.go:328] unrecognized feature gate: PinnedImages Jul 13 02:56:57.859074 ip-10-0-134-52 kubenswrapper[2558]: W0713 02:56:57.851371 2558 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jul 13 02:56:57.859074 ip-10-0-134-52 kubenswrapper[2558]: W0713 02:56:57.851374 2558 feature_gate.go:328] unrecognized feature gate: OVNObservability Jul 13 02:56:57.859074 ip-10-0-134-52 kubenswrapper[2558]: W0713 02:56:57.851376 2558 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jul 13 02:56:57.859074 ip-10-0-134-52 kubenswrapper[2558]: W0713 02:56:57.851379 2558 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jul 13 02:56:57.859074 ip-10-0-134-52 kubenswrapper[2558]: W0713 02:56:57.851381 2558 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jul 13 02:56:57.859074 ip-10-0-134-52 kubenswrapper[2558]: W0713 02:56:57.851384 2558 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jul 13 02:56:57.859074 ip-10-0-134-52 kubenswrapper[2558]: W0713 02:56:57.851386 2558 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jul 13 02:56:57.859074 ip-10-0-134-52 kubenswrapper[2558]: W0713 02:56:57.851389 2558 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jul 13 02:56:57.859074 ip-10-0-134-52 kubenswrapper[2558]: W0713 02:56:57.851391 2558 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jul 13 02:56:57.859074 ip-10-0-134-52 kubenswrapper[2558]: W0713 02:56:57.851394 2558 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jul 13 02:56:57.859074 ip-10-0-134-52 kubenswrapper[2558]: W0713 02:56:57.851397 2558 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jul 13 02:56:57.859643 ip-10-0-134-52 kubenswrapper[2558]: W0713 02:56:57.851400 2558 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jul 13 02:56:57.859643 ip-10-0-134-52 kubenswrapper[2558]: W0713 02:56:57.851403 2558 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jul 13 02:56:57.859643 ip-10-0-134-52 kubenswrapper[2558]: W0713 02:56:57.851406 2558 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jul 13 02:56:57.859643 ip-10-0-134-52 kubenswrapper[2558]: W0713 02:56:57.851410 2558 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jul 13 02:56:57.859643 ip-10-0-134-52 kubenswrapper[2558]: W0713 02:56:57.851413 2558 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jul 13 02:56:57.859643 ip-10-0-134-52 kubenswrapper[2558]: W0713 02:56:57.851415 2558 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jul 13 02:56:57.859643 ip-10-0-134-52 kubenswrapper[2558]: W0713 02:56:57.851418 2558 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jul 13 02:56:57.859643 ip-10-0-134-52 kubenswrapper[2558]: W0713 02:56:57.851421 2558 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jul 13 02:56:57.859643 ip-10-0-134-52 kubenswrapper[2558]: W0713 02:56:57.851423 2558 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jul 13 02:56:57.859643 ip-10-0-134-52 kubenswrapper[2558]: W0713 02:56:57.851426 2558 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jul 13 02:56:57.859643 ip-10-0-134-52 kubenswrapper[2558]: W0713 02:56:57.851428 2558 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jul 13 02:56:57.859643 ip-10-0-134-52 kubenswrapper[2558]: W0713 02:56:57.851431 2558 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jul 13 02:56:57.859643 ip-10-0-134-52 kubenswrapper[2558]: W0713 02:56:57.851433 2558 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jul 13 02:56:57.859643 ip-10-0-134-52 kubenswrapper[2558]: W0713 02:56:57.851436 2558 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jul 13 02:56:57.859643 ip-10-0-134-52 kubenswrapper[2558]: W0713 02:56:57.851439 2558 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jul 13 02:56:57.859643 ip-10-0-134-52 kubenswrapper[2558]: W0713 02:56:57.851441 2558 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jul 13 02:56:57.859643 ip-10-0-134-52 kubenswrapper[2558]: W0713 02:56:57.851445 2558 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jul 13 02:56:57.859643 ip-10-0-134-52 kubenswrapper[2558]: W0713 02:56:57.851448 2558 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jul 13 02:56:57.859643 ip-10-0-134-52 kubenswrapper[2558]: W0713 02:56:57.851451 2558 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jul 13 02:56:57.860137 ip-10-0-134-52 kubenswrapper[2558]: W0713 02:56:57.851453 2558 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jul 13 02:56:57.860137 ip-10-0-134-52 kubenswrapper[2558]: W0713 02:56:57.851456 2558 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jul 13 02:56:57.860137 ip-10-0-134-52 kubenswrapper[2558]: W0713 02:56:57.851459 2558 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jul 13 02:56:57.860137 ip-10-0-134-52 kubenswrapper[2558]: W0713 02:56:57.851461 2558 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jul 13 02:56:57.860137 ip-10-0-134-52 kubenswrapper[2558]: W0713 02:56:57.851464 2558 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jul 13 02:56:57.860137 ip-10-0-134-52 kubenswrapper[2558]: W0713 02:56:57.851466 2558 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jul 13 02:56:57.860137 ip-10-0-134-52 kubenswrapper[2558]: W0713 02:56:57.851469 2558 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jul 13 02:56:57.860137 ip-10-0-134-52 kubenswrapper[2558]: W0713 02:56:57.851471 2558 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jul 13 02:56:57.860137 ip-10-0-134-52 kubenswrapper[2558]: W0713 02:56:57.851474 2558 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jul 13 02:56:57.860137 ip-10-0-134-52 kubenswrapper[2558]: W0713 02:56:57.851476 2558 feature_gate.go:328] unrecognized feature gate: OSStreams Jul 13 02:56:57.860137 ip-10-0-134-52 kubenswrapper[2558]: W0713 02:56:57.851479 2558 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jul 13 02:56:57.860137 ip-10-0-134-52 kubenswrapper[2558]: W0713 02:56:57.851481 2558 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jul 13 02:56:57.860137 ip-10-0-134-52 kubenswrapper[2558]: W0713 02:56:57.851484 2558 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jul 13 02:56:57.860137 ip-10-0-134-52 kubenswrapper[2558]: W0713 02:56:57.851487 2558 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jul 13 02:56:57.860137 ip-10-0-134-52 kubenswrapper[2558]: W0713 02:56:57.851490 2558 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jul 13 02:56:57.860137 ip-10-0-134-52 kubenswrapper[2558]: W0713 02:56:57.851493 2558 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jul 13 02:56:57.860137 ip-10-0-134-52 kubenswrapper[2558]: W0713 02:56:57.851497 2558 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jul 13 02:56:57.860137 ip-10-0-134-52 kubenswrapper[2558]: W0713 02:56:57.851499 2558 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jul 13 02:56:57.860137 ip-10-0-134-52 kubenswrapper[2558]: W0713 02:56:57.851502 2558 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jul 13 02:56:57.860137 ip-10-0-134-52 kubenswrapper[2558]: W0713 02:56:57.851504 2558 feature_gate.go:328] unrecognized feature gate: EventTTL Jul 13 02:56:57.860634 ip-10-0-134-52 kubenswrapper[2558]: W0713 02:56:57.851507 2558 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jul 13 02:56:57.860634 ip-10-0-134-52 kubenswrapper[2558]: W0713 02:56:57.851509 2558 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jul 13 02:56:57.860634 ip-10-0-134-52 kubenswrapper[2558]: W0713 02:56:57.851511 2558 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jul 13 02:56:57.860634 ip-10-0-134-52 kubenswrapper[2558]: W0713 02:56:57.851514 2558 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jul 13 02:56:57.860634 ip-10-0-134-52 kubenswrapper[2558]: W0713 02:56:57.851516 2558 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jul 13 02:56:57.860634 ip-10-0-134-52 kubenswrapper[2558]: W0713 02:56:57.851519 2558 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jul 13 02:56:57.860634 ip-10-0-134-52 kubenswrapper[2558]: W0713 02:56:57.851521 2558 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jul 13 02:56:57.860634 ip-10-0-134-52 kubenswrapper[2558]: W0713 02:56:57.851523 2558 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jul 13 02:56:57.860634 ip-10-0-134-52 kubenswrapper[2558]: W0713 02:56:57.851526 2558 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jul 13 02:56:57.860634 ip-10-0-134-52 kubenswrapper[2558]: W0713 02:56:57.851528 2558 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jul 13 02:56:57.860634 ip-10-0-134-52 kubenswrapper[2558]: W0713 02:56:57.851530 2558 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jul 13 02:56:57.860634 ip-10-0-134-52 kubenswrapper[2558]: W0713 02:56:57.851533 2558 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jul 13 02:56:57.860634 ip-10-0-134-52 kubenswrapper[2558]: W0713 02:56:57.851535 2558 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jul 13 02:56:57.860634 ip-10-0-134-52 kubenswrapper[2558]: W0713 02:56:57.851538 2558 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jul 13 02:56:57.860634 ip-10-0-134-52 kubenswrapper[2558]: W0713 02:56:57.851540 2558 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jul 13 02:56:57.860634 ip-10-0-134-52 kubenswrapper[2558]: W0713 02:56:57.851543 2558 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jul 13 02:56:57.860634 ip-10-0-134-52 kubenswrapper[2558]: W0713 02:56:57.851545 2558 feature_gate.go:328] unrecognized feature gate: Example2 Jul 13 02:56:57.860634 ip-10-0-134-52 kubenswrapper[2558]: W0713 02:56:57.851547 2558 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jul 13 02:56:57.860634 ip-10-0-134-52 kubenswrapper[2558]: W0713 02:56:57.851550 2558 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jul 13 02:56:57.860634 ip-10-0-134-52 kubenswrapper[2558]: W0713 02:56:57.851553 2558 feature_gate.go:328] unrecognized feature gate: DualReplica Jul 13 02:56:57.861128 ip-10-0-134-52 kubenswrapper[2558]: W0713 02:56:57.851555 2558 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jul 13 02:56:57.861128 ip-10-0-134-52 kubenswrapper[2558]: W0713 02:56:57.851558 2558 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jul 13 02:56:57.861128 ip-10-0-134-52 kubenswrapper[2558]: W0713 02:56:57.851560 2558 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jul 13 02:56:57.861128 ip-10-0-134-52 kubenswrapper[2558]: W0713 02:56:57.851562 2558 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jul 13 02:56:57.861128 ip-10-0-134-52 kubenswrapper[2558]: W0713 02:56:57.851566 2558 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jul 13 02:56:57.861128 ip-10-0-134-52 kubenswrapper[2558]: W0713 02:56:57.851569 2558 feature_gate.go:328] unrecognized feature gate: Example Jul 13 02:56:57.861128 ip-10-0-134-52 kubenswrapper[2558]: W0713 02:56:57.851572 2558 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jul 13 02:56:57.861128 ip-10-0-134-52 kubenswrapper[2558]: W0713 02:56:57.851575 2558 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jul 13 02:56:57.861128 ip-10-0-134-52 kubenswrapper[2558]: W0713 02:56:57.851578 2558 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jul 13 02:56:57.861128 ip-10-0-134-52 kubenswrapper[2558]: W0713 02:56:57.851581 2558 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jul 13 02:56:57.861128 ip-10-0-134-52 kubenswrapper[2558]: W0713 02:56:57.851584 2558 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jul 13 02:56:57.861128 ip-10-0-134-52 kubenswrapper[2558]: W0713 02:56:57.851588 2558 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jul 13 02:56:57.861128 ip-10-0-134-52 kubenswrapper[2558]: W0713 02:56:57.851591 2558 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jul 13 02:56:57.861128 ip-10-0-134-52 kubenswrapper[2558]: W0713 02:56:57.851594 2558 feature_gate.go:328] unrecognized feature gate: NewOLM Jul 13 02:56:57.861128 ip-10-0-134-52 kubenswrapper[2558]: W0713 02:56:57.851597 2558 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jul 13 02:56:57.861128 ip-10-0-134-52 kubenswrapper[2558]: W0713 02:56:57.851599 2558 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jul 13 02:56:57.861128 ip-10-0-134-52 kubenswrapper[2558]: W0713 02:56:57.851602 2558 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jul 13 02:56:57.861128 ip-10-0-134-52 kubenswrapper[2558]: W0713 02:56:57.851605 2558 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jul 13 02:56:57.861128 ip-10-0-134-52 kubenswrapper[2558]: W0713 02:56:57.851607 2558 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jul 13 02:56:57.861648 ip-10-0-134-52 kubenswrapper[2558]: W0713 02:56:57.851609 2558 feature_gate.go:328] unrecognized feature gate: SignatureStores Jul 13 02:56:57.861648 ip-10-0-134-52 kubenswrapper[2558]: W0713 02:56:57.851612 2558 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jul 13 02:56:57.861648 ip-10-0-134-52 kubenswrapper[2558]: W0713 02:56:57.851614 2558 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jul 13 02:56:57.861648 ip-10-0-134-52 kubenswrapper[2558]: I0713 02:56:57.852219 2558 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]} Jul 13 02:56:57.861648 ip-10-0-134-52 kubenswrapper[2558]: I0713 02:56:57.858223 2558 server.go:529] "Kubelet version" kubeletVersion="v1.34.9" Jul 13 02:56:57.861648 ip-10-0-134-52 kubenswrapper[2558]: I0713 02:56:57.858237 2558 server.go:531] "Golang settings" GOGC="" GOMAXPROCS="" GOTRACEBACK="" Jul 13 02:56:57.861648 ip-10-0-134-52 kubenswrapper[2558]: I0713 02:56:57.858254 2558 watchdog_linux.go:95] "Systemd watchdog is not enabled" Jul 13 02:56:57.861648 ip-10-0-134-52 kubenswrapper[2558]: I0713 02:56:57.858262 2558 watchdog_linux.go:137] "Systemd watchdog is not enabled or the interval is invalid, so health checking will not be started." Jul 13 02:56:57.861648 ip-10-0-134-52 kubenswrapper[2558]: W0713 02:56:57.858315 2558 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jul 13 02:56:57.861648 ip-10-0-134-52 kubenswrapper[2558]: W0713 02:56:57.858320 2558 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jul 13 02:56:57.861648 ip-10-0-134-52 kubenswrapper[2558]: W0713 02:56:57.858323 2558 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jul 13 02:56:57.861648 ip-10-0-134-52 kubenswrapper[2558]: W0713 02:56:57.858340 2558 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jul 13 02:56:57.861648 ip-10-0-134-52 kubenswrapper[2558]: W0713 02:56:57.858343 2558 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jul 13 02:56:57.861648 ip-10-0-134-52 kubenswrapper[2558]: W0713 02:56:57.858346 2558 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jul 13 02:56:57.862001 ip-10-0-134-52 kubenswrapper[2558]: W0713 02:56:57.858349 2558 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jul 13 02:56:57.862001 ip-10-0-134-52 kubenswrapper[2558]: W0713 02:56:57.858352 2558 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jul 13 02:56:57.862001 ip-10-0-134-52 kubenswrapper[2558]: W0713 02:56:57.858355 2558 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jul 13 02:56:57.862001 ip-10-0-134-52 kubenswrapper[2558]: W0713 02:56:57.858357 2558 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jul 13 02:56:57.862001 ip-10-0-134-52 kubenswrapper[2558]: W0713 02:56:57.858360 2558 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jul 13 02:56:57.862001 ip-10-0-134-52 kubenswrapper[2558]: W0713 02:56:57.858362 2558 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jul 13 02:56:57.862001 ip-10-0-134-52 kubenswrapper[2558]: W0713 02:56:57.858366 2558 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jul 13 02:56:57.862001 ip-10-0-134-52 kubenswrapper[2558]: W0713 02:56:57.858368 2558 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jul 13 02:56:57.862001 ip-10-0-134-52 kubenswrapper[2558]: W0713 02:56:57.858371 2558 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jul 13 02:56:57.862001 ip-10-0-134-52 kubenswrapper[2558]: W0713 02:56:57.858374 2558 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jul 13 02:56:57.862001 ip-10-0-134-52 kubenswrapper[2558]: W0713 02:56:57.858376 2558 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jul 13 02:56:57.862001 ip-10-0-134-52 kubenswrapper[2558]: W0713 02:56:57.858379 2558 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jul 13 02:56:57.862001 ip-10-0-134-52 kubenswrapper[2558]: W0713 02:56:57.858382 2558 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jul 13 02:56:57.862001 ip-10-0-134-52 kubenswrapper[2558]: W0713 02:56:57.858384 2558 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jul 13 02:56:57.862001 ip-10-0-134-52 kubenswrapper[2558]: W0713 02:56:57.858387 2558 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jul 13 02:56:57.862001 ip-10-0-134-52 kubenswrapper[2558]: W0713 02:56:57.858389 2558 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jul 13 02:56:57.862001 ip-10-0-134-52 kubenswrapper[2558]: W0713 02:56:57.858392 2558 feature_gate.go:328] unrecognized feature gate: OSStreams Jul 13 02:56:57.862001 ip-10-0-134-52 kubenswrapper[2558]: W0713 02:56:57.858394 2558 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jul 13 02:56:57.862001 ip-10-0-134-52 kubenswrapper[2558]: W0713 02:56:57.858397 2558 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jul 13 02:56:57.862001 ip-10-0-134-52 kubenswrapper[2558]: W0713 02:56:57.858399 2558 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jul 13 02:56:57.862599 ip-10-0-134-52 kubenswrapper[2558]: W0713 02:56:57.858402 2558 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jul 13 02:56:57.862599 ip-10-0-134-52 kubenswrapper[2558]: W0713 02:56:57.858405 2558 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jul 13 02:56:57.862599 ip-10-0-134-52 kubenswrapper[2558]: W0713 02:56:57.858407 2558 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jul 13 02:56:57.862599 ip-10-0-134-52 kubenswrapper[2558]: W0713 02:56:57.858411 2558 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jul 13 02:56:57.862599 ip-10-0-134-52 kubenswrapper[2558]: W0713 02:56:57.858414 2558 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jul 13 02:56:57.862599 ip-10-0-134-52 kubenswrapper[2558]: W0713 02:56:57.858416 2558 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jul 13 02:56:57.862599 ip-10-0-134-52 kubenswrapper[2558]: W0713 02:56:57.858419 2558 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jul 13 02:56:57.862599 ip-10-0-134-52 kubenswrapper[2558]: W0713 02:56:57.858421 2558 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jul 13 02:56:57.862599 ip-10-0-134-52 kubenswrapper[2558]: W0713 02:56:57.858424 2558 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jul 13 02:56:57.862599 ip-10-0-134-52 kubenswrapper[2558]: W0713 02:56:57.858426 2558 feature_gate.go:328] unrecognized feature gate: OVNObservability Jul 13 02:56:57.862599 ip-10-0-134-52 kubenswrapper[2558]: W0713 02:56:57.858429 2558 feature_gate.go:328] unrecognized feature gate: SignatureStores Jul 13 02:56:57.862599 ip-10-0-134-52 kubenswrapper[2558]: W0713 02:56:57.858433 2558 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jul 13 02:56:57.862599 ip-10-0-134-52 kubenswrapper[2558]: W0713 02:56:57.858437 2558 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jul 13 02:56:57.862599 ip-10-0-134-52 kubenswrapper[2558]: W0713 02:56:57.858440 2558 feature_gate.go:328] unrecognized feature gate: NewOLM Jul 13 02:56:57.862599 ip-10-0-134-52 kubenswrapper[2558]: W0713 02:56:57.858443 2558 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jul 13 02:56:57.862599 ip-10-0-134-52 kubenswrapper[2558]: W0713 02:56:57.858446 2558 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jul 13 02:56:57.862599 ip-10-0-134-52 kubenswrapper[2558]: W0713 02:56:57.858448 2558 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jul 13 02:56:57.862599 ip-10-0-134-52 kubenswrapper[2558]: W0713 02:56:57.858451 2558 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jul 13 02:56:57.862599 ip-10-0-134-52 kubenswrapper[2558]: W0713 02:56:57.858453 2558 feature_gate.go:328] unrecognized feature gate: PinnedImages Jul 13 02:56:57.862599 ip-10-0-134-52 kubenswrapper[2558]: W0713 02:56:57.858457 2558 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jul 13 02:56:57.863189 ip-10-0-134-52 kubenswrapper[2558]: W0713 02:56:57.858461 2558 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jul 13 02:56:57.863189 ip-10-0-134-52 kubenswrapper[2558]: W0713 02:56:57.858465 2558 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jul 13 02:56:57.863189 ip-10-0-134-52 kubenswrapper[2558]: W0713 02:56:57.858468 2558 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jul 13 02:56:57.863189 ip-10-0-134-52 kubenswrapper[2558]: W0713 02:56:57.858470 2558 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jul 13 02:56:57.863189 ip-10-0-134-52 kubenswrapper[2558]: W0713 02:56:57.858473 2558 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jul 13 02:56:57.863189 ip-10-0-134-52 kubenswrapper[2558]: W0713 02:56:57.858476 2558 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jul 13 02:56:57.863189 ip-10-0-134-52 kubenswrapper[2558]: W0713 02:56:57.858478 2558 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jul 13 02:56:57.863189 ip-10-0-134-52 kubenswrapper[2558]: W0713 02:56:57.858482 2558 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jul 13 02:56:57.863189 ip-10-0-134-52 kubenswrapper[2558]: W0713 02:56:57.858486 2558 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jul 13 02:56:57.863189 ip-10-0-134-52 kubenswrapper[2558]: W0713 02:56:57.858489 2558 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jul 13 02:56:57.863189 ip-10-0-134-52 kubenswrapper[2558]: W0713 02:56:57.858491 2558 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jul 13 02:56:57.863189 ip-10-0-134-52 kubenswrapper[2558]: W0713 02:56:57.858494 2558 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jul 13 02:56:57.863189 ip-10-0-134-52 kubenswrapper[2558]: W0713 02:56:57.858497 2558 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jul 13 02:56:57.863189 ip-10-0-134-52 kubenswrapper[2558]: W0713 02:56:57.858499 2558 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jul 13 02:56:57.863189 ip-10-0-134-52 kubenswrapper[2558]: W0713 02:56:57.858502 2558 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jul 13 02:56:57.863189 ip-10-0-134-52 kubenswrapper[2558]: W0713 02:56:57.858505 2558 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jul 13 02:56:57.863189 ip-10-0-134-52 kubenswrapper[2558]: W0713 02:56:57.858508 2558 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jul 13 02:56:57.863189 ip-10-0-134-52 kubenswrapper[2558]: W0713 02:56:57.858511 2558 feature_gate.go:328] unrecognized feature gate: Example Jul 13 02:56:57.863958 ip-10-0-134-52 kubenswrapper[2558]: W0713 02:56:57.858514 2558 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jul 13 02:56:57.863958 ip-10-0-134-52 kubenswrapper[2558]: W0713 02:56:57.858516 2558 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jul 13 02:56:57.863958 ip-10-0-134-52 kubenswrapper[2558]: W0713 02:56:57.858519 2558 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jul 13 02:56:57.863958 ip-10-0-134-52 kubenswrapper[2558]: W0713 02:56:57.858522 2558 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jul 13 02:56:57.863958 ip-10-0-134-52 kubenswrapper[2558]: W0713 02:56:57.858524 2558 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jul 13 02:56:57.863958 ip-10-0-134-52 kubenswrapper[2558]: W0713 02:56:57.858527 2558 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jul 13 02:56:57.863958 ip-10-0-134-52 kubenswrapper[2558]: W0713 02:56:57.858529 2558 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jul 13 02:56:57.863958 ip-10-0-134-52 kubenswrapper[2558]: W0713 02:56:57.858532 2558 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jul 13 02:56:57.863958 ip-10-0-134-52 kubenswrapper[2558]: W0713 02:56:57.858535 2558 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jul 13 02:56:57.863958 ip-10-0-134-52 kubenswrapper[2558]: W0713 02:56:57.858537 2558 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jul 13 02:56:57.863958 ip-10-0-134-52 kubenswrapper[2558]: W0713 02:56:57.858539 2558 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jul 13 02:56:57.863958 ip-10-0-134-52 kubenswrapper[2558]: W0713 02:56:57.858542 2558 feature_gate.go:328] unrecognized feature gate: EventTTL Jul 13 02:56:57.863958 ip-10-0-134-52 kubenswrapper[2558]: W0713 02:56:57.858544 2558 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jul 13 02:56:57.863958 ip-10-0-134-52 kubenswrapper[2558]: W0713 02:56:57.858547 2558 feature_gate.go:328] unrecognized feature gate: Example2 Jul 13 02:56:57.863958 ip-10-0-134-52 kubenswrapper[2558]: W0713 02:56:57.858550 2558 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jul 13 02:56:57.863958 ip-10-0-134-52 kubenswrapper[2558]: W0713 02:56:57.858552 2558 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jul 13 02:56:57.863958 ip-10-0-134-52 kubenswrapper[2558]: W0713 02:56:57.858555 2558 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jul 13 02:56:57.863958 ip-10-0-134-52 kubenswrapper[2558]: W0713 02:56:57.858557 2558 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jul 13 02:56:57.863958 ip-10-0-134-52 kubenswrapper[2558]: W0713 02:56:57.858559 2558 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jul 13 02:56:57.863958 ip-10-0-134-52 kubenswrapper[2558]: W0713 02:56:57.858562 2558 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jul 13 02:56:57.864590 ip-10-0-134-52 kubenswrapper[2558]: W0713 02:56:57.858564 2558 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jul 13 02:56:57.864590 ip-10-0-134-52 kubenswrapper[2558]: W0713 02:56:57.858567 2558 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jul 13 02:56:57.864590 ip-10-0-134-52 kubenswrapper[2558]: W0713 02:56:57.858570 2558 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jul 13 02:56:57.864590 ip-10-0-134-52 kubenswrapper[2558]: W0713 02:56:57.858572 2558 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jul 13 02:56:57.864590 ip-10-0-134-52 kubenswrapper[2558]: W0713 02:56:57.858575 2558 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jul 13 02:56:57.864590 ip-10-0-134-52 kubenswrapper[2558]: W0713 02:56:57.858577 2558 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jul 13 02:56:57.864590 ip-10-0-134-52 kubenswrapper[2558]: W0713 02:56:57.858580 2558 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jul 13 02:56:57.864590 ip-10-0-134-52 kubenswrapper[2558]: W0713 02:56:57.858582 2558 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jul 13 02:56:57.864590 ip-10-0-134-52 kubenswrapper[2558]: W0713 02:56:57.858584 2558 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jul 13 02:56:57.864590 ip-10-0-134-52 kubenswrapper[2558]: W0713 02:56:57.858587 2558 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jul 13 02:56:57.864590 ip-10-0-134-52 kubenswrapper[2558]: W0713 02:56:57.858590 2558 feature_gate.go:328] unrecognized feature gate: DualReplica Jul 13 02:56:57.864590 ip-10-0-134-52 kubenswrapper[2558]: W0713 02:56:57.858593 2558 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jul 13 02:56:57.864590 ip-10-0-134-52 kubenswrapper[2558]: W0713 02:56:57.858595 2558 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jul 13 02:56:57.864590 ip-10-0-134-52 kubenswrapper[2558]: W0713 02:56:57.858598 2558 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jul 13 02:56:57.864590 ip-10-0-134-52 kubenswrapper[2558]: W0713 02:56:57.858600 2558 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jul 13 02:56:57.864981 ip-10-0-134-52 kubenswrapper[2558]: I0713 02:56:57.858605 2558 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]} Jul 13 02:56:57.864981 ip-10-0-134-52 kubenswrapper[2558]: W0713 02:56:57.858712 2558 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jul 13 02:56:57.864981 ip-10-0-134-52 kubenswrapper[2558]: W0713 02:56:57.858716 2558 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jul 13 02:56:57.864981 ip-10-0-134-52 kubenswrapper[2558]: W0713 02:56:57.858719 2558 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jul 13 02:56:57.864981 ip-10-0-134-52 kubenswrapper[2558]: W0713 02:56:57.858723 2558 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jul 13 02:56:57.864981 ip-10-0-134-52 kubenswrapper[2558]: W0713 02:56:57.858727 2558 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jul 13 02:56:57.864981 ip-10-0-134-52 kubenswrapper[2558]: W0713 02:56:57.858730 2558 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jul 13 02:56:57.864981 ip-10-0-134-52 kubenswrapper[2558]: W0713 02:56:57.858733 2558 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jul 13 02:56:57.864981 ip-10-0-134-52 kubenswrapper[2558]: W0713 02:56:57.858736 2558 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jul 13 02:56:57.864981 ip-10-0-134-52 kubenswrapper[2558]: W0713 02:56:57.858738 2558 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jul 13 02:56:57.864981 ip-10-0-134-52 kubenswrapper[2558]: W0713 02:56:57.858741 2558 feature_gate.go:328] unrecognized feature gate: Example2 Jul 13 02:56:57.864981 ip-10-0-134-52 kubenswrapper[2558]: W0713 02:56:57.858744 2558 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jul 13 02:56:57.864981 ip-10-0-134-52 kubenswrapper[2558]: W0713 02:56:57.858747 2558 feature_gate.go:328] unrecognized feature gate: OVNObservability Jul 13 02:56:57.864981 ip-10-0-134-52 kubenswrapper[2558]: W0713 02:56:57.858750 2558 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jul 13 02:56:57.865552 ip-10-0-134-52 kubenswrapper[2558]: W0713 02:56:57.858752 2558 feature_gate.go:328] unrecognized feature gate: DualReplica Jul 13 02:56:57.865552 ip-10-0-134-52 kubenswrapper[2558]: W0713 02:56:57.858755 2558 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jul 13 02:56:57.865552 ip-10-0-134-52 kubenswrapper[2558]: W0713 02:56:57.858757 2558 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jul 13 02:56:57.865552 ip-10-0-134-52 kubenswrapper[2558]: W0713 02:56:57.858760 2558 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jul 13 02:56:57.865552 ip-10-0-134-52 kubenswrapper[2558]: W0713 02:56:57.858762 2558 feature_gate.go:328] unrecognized feature gate: NewOLM Jul 13 02:56:57.865552 ip-10-0-134-52 kubenswrapper[2558]: W0713 02:56:57.858764 2558 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jul 13 02:56:57.865552 ip-10-0-134-52 kubenswrapper[2558]: W0713 02:56:57.858767 2558 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jul 13 02:56:57.865552 ip-10-0-134-52 kubenswrapper[2558]: W0713 02:56:57.858769 2558 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jul 13 02:56:57.865552 ip-10-0-134-52 kubenswrapper[2558]: W0713 02:56:57.858772 2558 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jul 13 02:56:57.865552 ip-10-0-134-52 kubenswrapper[2558]: W0713 02:56:57.858774 2558 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jul 13 02:56:57.865552 ip-10-0-134-52 kubenswrapper[2558]: W0713 02:56:57.858777 2558 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jul 13 02:56:57.865552 ip-10-0-134-52 kubenswrapper[2558]: W0713 02:56:57.858779 2558 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jul 13 02:56:57.865552 ip-10-0-134-52 kubenswrapper[2558]: W0713 02:56:57.858781 2558 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jul 13 02:56:57.865552 ip-10-0-134-52 kubenswrapper[2558]: W0713 02:56:57.858784 2558 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jul 13 02:56:57.865552 ip-10-0-134-52 kubenswrapper[2558]: W0713 02:56:57.858786 2558 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jul 13 02:56:57.865552 ip-10-0-134-52 kubenswrapper[2558]: W0713 02:56:57.858789 2558 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jul 13 02:56:57.865552 ip-10-0-134-52 kubenswrapper[2558]: W0713 02:56:57.858791 2558 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jul 13 02:56:57.865552 ip-10-0-134-52 kubenswrapper[2558]: W0713 02:56:57.858794 2558 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jul 13 02:56:57.865552 ip-10-0-134-52 kubenswrapper[2558]: W0713 02:56:57.858796 2558 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jul 13 02:56:57.865552 ip-10-0-134-52 kubenswrapper[2558]: W0713 02:56:57.858799 2558 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jul 13 02:56:57.866087 ip-10-0-134-52 kubenswrapper[2558]: W0713 02:56:57.858801 2558 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jul 13 02:56:57.866087 ip-10-0-134-52 kubenswrapper[2558]: W0713 02:56:57.858804 2558 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jul 13 02:56:57.866087 ip-10-0-134-52 kubenswrapper[2558]: W0713 02:56:57.858806 2558 feature_gate.go:328] unrecognized feature gate: SignatureStores Jul 13 02:56:57.866087 ip-10-0-134-52 kubenswrapper[2558]: W0713 02:56:57.858808 2558 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jul 13 02:56:57.866087 ip-10-0-134-52 kubenswrapper[2558]: W0713 02:56:57.858811 2558 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jul 13 02:56:57.866087 ip-10-0-134-52 kubenswrapper[2558]: W0713 02:56:57.858813 2558 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jul 13 02:56:57.866087 ip-10-0-134-52 kubenswrapper[2558]: W0713 02:56:57.858816 2558 feature_gate.go:328] unrecognized feature gate: OSStreams Jul 13 02:56:57.866087 ip-10-0-134-52 kubenswrapper[2558]: W0713 02:56:57.858818 2558 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jul 13 02:56:57.866087 ip-10-0-134-52 kubenswrapper[2558]: W0713 02:56:57.858820 2558 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jul 13 02:56:57.866087 ip-10-0-134-52 kubenswrapper[2558]: W0713 02:56:57.858823 2558 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jul 13 02:56:57.866087 ip-10-0-134-52 kubenswrapper[2558]: W0713 02:56:57.858825 2558 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jul 13 02:56:57.866087 ip-10-0-134-52 kubenswrapper[2558]: W0713 02:56:57.858828 2558 feature_gate.go:328] unrecognized feature gate: Example Jul 13 02:56:57.866087 ip-10-0-134-52 kubenswrapper[2558]: W0713 02:56:57.858831 2558 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jul 13 02:56:57.866087 ip-10-0-134-52 kubenswrapper[2558]: W0713 02:56:57.858833 2558 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jul 13 02:56:57.866087 ip-10-0-134-52 kubenswrapper[2558]: W0713 02:56:57.858836 2558 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jul 13 02:56:57.866087 ip-10-0-134-52 kubenswrapper[2558]: W0713 02:56:57.858838 2558 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jul 13 02:56:57.866087 ip-10-0-134-52 kubenswrapper[2558]: W0713 02:56:57.858840 2558 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jul 13 02:56:57.866087 ip-10-0-134-52 kubenswrapper[2558]: W0713 02:56:57.858843 2558 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jul 13 02:56:57.866087 ip-10-0-134-52 kubenswrapper[2558]: W0713 02:56:57.858845 2558 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jul 13 02:56:57.866087 ip-10-0-134-52 kubenswrapper[2558]: W0713 02:56:57.858848 2558 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jul 13 02:56:57.866581 ip-10-0-134-52 kubenswrapper[2558]: W0713 02:56:57.858850 2558 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jul 13 02:56:57.866581 ip-10-0-134-52 kubenswrapper[2558]: W0713 02:56:57.858853 2558 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jul 13 02:56:57.866581 ip-10-0-134-52 kubenswrapper[2558]: W0713 02:56:57.858855 2558 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jul 13 02:56:57.866581 ip-10-0-134-52 kubenswrapper[2558]: W0713 02:56:57.858858 2558 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jul 13 02:56:57.866581 ip-10-0-134-52 kubenswrapper[2558]: W0713 02:56:57.858861 2558 feature_gate.go:328] unrecognized feature gate: PinnedImages Jul 13 02:56:57.866581 ip-10-0-134-52 kubenswrapper[2558]: W0713 02:56:57.858863 2558 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jul 13 02:56:57.866581 ip-10-0-134-52 kubenswrapper[2558]: W0713 02:56:57.858866 2558 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jul 13 02:56:57.866581 ip-10-0-134-52 kubenswrapper[2558]: W0713 02:56:57.858868 2558 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jul 13 02:56:57.866581 ip-10-0-134-52 kubenswrapper[2558]: W0713 02:56:57.858871 2558 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jul 13 02:56:57.866581 ip-10-0-134-52 kubenswrapper[2558]: W0713 02:56:57.858873 2558 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jul 13 02:56:57.866581 ip-10-0-134-52 kubenswrapper[2558]: W0713 02:56:57.858876 2558 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jul 13 02:56:57.866581 ip-10-0-134-52 kubenswrapper[2558]: W0713 02:56:57.858878 2558 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jul 13 02:56:57.866581 ip-10-0-134-52 kubenswrapper[2558]: W0713 02:56:57.858880 2558 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jul 13 02:56:57.866581 ip-10-0-134-52 kubenswrapper[2558]: W0713 02:56:57.858883 2558 feature_gate.go:328] unrecognized feature gate: EventTTL Jul 13 02:56:57.866581 ip-10-0-134-52 kubenswrapper[2558]: W0713 02:56:57.858885 2558 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jul 13 02:56:57.866581 ip-10-0-134-52 kubenswrapper[2558]: W0713 02:56:57.858889 2558 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jul 13 02:56:57.866581 ip-10-0-134-52 kubenswrapper[2558]: W0713 02:56:57.858892 2558 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jul 13 02:56:57.866581 ip-10-0-134-52 kubenswrapper[2558]: W0713 02:56:57.858895 2558 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jul 13 02:56:57.866581 ip-10-0-134-52 kubenswrapper[2558]: W0713 02:56:57.858898 2558 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jul 13 02:56:57.866581 ip-10-0-134-52 kubenswrapper[2558]: W0713 02:56:57.858901 2558 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jul 13 02:56:57.867087 ip-10-0-134-52 kubenswrapper[2558]: W0713 02:56:57.858903 2558 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jul 13 02:56:57.867087 ip-10-0-134-52 kubenswrapper[2558]: W0713 02:56:57.858906 2558 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jul 13 02:56:57.867087 ip-10-0-134-52 kubenswrapper[2558]: W0713 02:56:57.858909 2558 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jul 13 02:56:57.867087 ip-10-0-134-52 kubenswrapper[2558]: W0713 02:56:57.858912 2558 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jul 13 02:56:57.867087 ip-10-0-134-52 kubenswrapper[2558]: W0713 02:56:57.858914 2558 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jul 13 02:56:57.867087 ip-10-0-134-52 kubenswrapper[2558]: W0713 02:56:57.858917 2558 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jul 13 02:56:57.867087 ip-10-0-134-52 kubenswrapper[2558]: W0713 02:56:57.858920 2558 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jul 13 02:56:57.867087 ip-10-0-134-52 kubenswrapper[2558]: W0713 02:56:57.858923 2558 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jul 13 02:56:57.867087 ip-10-0-134-52 kubenswrapper[2558]: W0713 02:56:57.858926 2558 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jul 13 02:56:57.867087 ip-10-0-134-52 kubenswrapper[2558]: W0713 02:56:57.858930 2558 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jul 13 02:56:57.867087 ip-10-0-134-52 kubenswrapper[2558]: W0713 02:56:57.858933 2558 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jul 13 02:56:57.867087 ip-10-0-134-52 kubenswrapper[2558]: W0713 02:56:57.858935 2558 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jul 13 02:56:57.867087 ip-10-0-134-52 kubenswrapper[2558]: W0713 02:56:57.858938 2558 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jul 13 02:56:57.867087 ip-10-0-134-52 kubenswrapper[2558]: W0713 02:56:57.858940 2558 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jul 13 02:56:57.867087 ip-10-0-134-52 kubenswrapper[2558]: W0713 02:56:57.858943 2558 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jul 13 02:56:57.867087 ip-10-0-134-52 kubenswrapper[2558]: W0713 02:56:57.858945 2558 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jul 13 02:56:57.867087 ip-10-0-134-52 kubenswrapper[2558]: W0713 02:56:57.858948 2558 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jul 13 02:56:57.867087 ip-10-0-134-52 kubenswrapper[2558]: W0713 02:56:57.858950 2558 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jul 13 02:56:57.867087 ip-10-0-134-52 kubenswrapper[2558]: W0713 02:56:57.858953 2558 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jul 13 02:56:57.867087 ip-10-0-134-52 kubenswrapper[2558]: W0713 02:56:57.858955 2558 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jul 13 02:56:57.867622 ip-10-0-134-52 kubenswrapper[2558]: W0713 02:56:57.858958 2558 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jul 13 02:56:57.867622 ip-10-0-134-52 kubenswrapper[2558]: W0713 02:56:57.858960 2558 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jul 13 02:56:57.867622 ip-10-0-134-52 kubenswrapper[2558]: W0713 02:56:57.858963 2558 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jul 13 02:56:57.867622 ip-10-0-134-52 kubenswrapper[2558]: W0713 02:56:57.858965 2558 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jul 13 02:56:57.867622 ip-10-0-134-52 kubenswrapper[2558]: W0713 02:56:57.858968 2558 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jul 13 02:56:57.867622 ip-10-0-134-52 kubenswrapper[2558]: W0713 02:56:57.858970 2558 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jul 13 02:56:57.867622 ip-10-0-134-52 kubenswrapper[2558]: I0713 02:56:57.858975 2558 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]} Jul 13 02:56:57.867622 ip-10-0-134-52 kubenswrapper[2558]: I0713 02:56:57.859069 2558 server.go:962] "Client rotation is on, will bootstrap in background" Jul 13 02:56:57.867622 ip-10-0-134-52 kubenswrapper[2558]: I0713 02:56:57.860920 2558 bootstrap.go:101] "Use the bootstrap credentials to request a cert, and set kubeconfig to point to the certificate dir" Jul 13 02:56:57.867622 ip-10-0-134-52 kubenswrapper[2558]: I0713 02:56:57.862138 2558 server.go:1019] "Starting client certificate rotation" Jul 13 02:56:57.867622 ip-10-0-134-52 kubenswrapper[2558]: I0713 02:56:57.862249 2558 certificate_manager.go:422] "Certificate rotation is enabled" logger="kubernetes.io/kube-apiserver-client-kubelet" Jul 13 02:56:57.867622 ip-10-0-134-52 kubenswrapper[2558]: I0713 02:56:57.862289 2558 certificate_manager.go:566] "Rotating certificates" logger="kubernetes.io/kube-apiserver-client-kubelet" Jul 13 02:56:57.867622 ip-10-0-134-52 kubenswrapper[2558]: I0713 02:56:57.864503 2558 dynamic_cafile_content.go:123] "Loaded a new CA Bundle and Verifier" name="client-ca-bundle::/etc/kubernetes/kubelet-ca.crt" Jul 13 02:56:57.868122 ip-10-0-134-52 kubenswrapper[2558]: I0713 02:56:57.867650 2558 dynamic_cafile_content.go:161] "Starting controller" name="client-ca-bundle::/etc/kubernetes/kubelet-ca.crt" Jul 13 02:56:57.876690 ip-10-0-134-52 kubenswrapper[2558]: I0713 02:56:57.876675 2558 log.go:25] "Validated CRI v1 runtime API" Jul 13 02:56:57.880386 ip-10-0-134-52 kubenswrapper[2558]: I0713 02:56:57.880370 2558 log.go:25] "Validated CRI v1 image API" Jul 13 02:56:57.881195 ip-10-0-134-52 kubenswrapper[2558]: I0713 02:56:57.881161 2558 server.go:1429] "Using cgroup driver setting received from the CRI runtime" cgroupDriver="systemd" Jul 13 02:56:57.883937 ip-10-0-134-52 kubenswrapper[2558]: I0713 02:56:57.883916 2558 fs.go:135] Filesystem UUIDs: map[3edcadd2-0b44-49fd-8579-f00d040255be:/dev/nvme0n1p3 7B77-95E7:/dev/nvme0n1p2 8f59530e-f81a-4d7a-b976-2d9c65531a45:/dev/nvme0n1p4] Jul 13 02:56:57.883987 ip-10-0-134-52 kubenswrapper[2558]: I0713 02:56:57.883938 2558 fs.go:136] Filesystem partitions: map[/dev/nvme0n1p3:{mountpoint:/boot major:259 minor:3 fsType:ext4 blockSize:0} /dev/nvme0n1p4:{mountpoint:/var major:259 minor:4 fsType:xfs blockSize:0} /dev/shm:{mountpoint:/dev/shm major:0 minor:22 fsType:tmpfs blockSize:0} /run:{mountpoint:/run major:0 minor:24 fsType:tmpfs blockSize:0} /tmp:{mountpoint:/tmp major:0 minor:31 fsType:tmpfs blockSize:0} composefs_0-33:{mountpoint:/ major:0 minor:33 fsType:overlay blockSize:0}] Jul 13 02:56:57.888545 ip-10-0-134-52 kubenswrapper[2558]: I0713 02:56:57.888444 2558 manager.go:216] Machine: {Timestamp:2026-07-13 02:56:57.887370743 +0000 UTC m=+0.287971200 CPUVendorID:GenuineIntel NumCores:8 NumPhysicalCores:4 NumSockets:1 CpuFrequency:3104129 MemoryCapacity:32812175360 SwapCapacity:0 MemoryByType:map[] NVMInfo:{MemoryModeCapacity:0 AppDirectModeCapacity:0 AvgPowerBudget:0} HugePages:[{PageSize:1048576 NumPages:0} {PageSize:2048 NumPages:0}] MachineID:ec2e0fd5079fa79765de00fd2c062f66 SystemUUID:ec2e0fd5-079f-a797-65de-00fd2c062f66 BootID:c351b474-0139-42de-88b7-e7173d363233 Filesystems:[{Device:/dev/nvme0n1p4 DeviceMajor:259 DeviceMinor:4 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:composefs_0-33 DeviceMajor:0 DeviceMinor:33 Capacity:6107136 Type:vfs Inodes:18446744073709551615 HasInodes:true} {Device:/tmp DeviceMajor:0 DeviceMinor:31 Capacity:16406089728 Type:vfs Inodes:1048576 HasInodes:true} {Device:/dev/nvme0n1p3 DeviceMajor:259 DeviceMinor:3 Capacity:366869504 Type:vfs Inodes:98304 HasInodes:true} {Device:/dev/shm DeviceMajor:0 DeviceMinor:22 Capacity:16406085632 Type:vfs Inodes:4005392 HasInodes:true} {Device:/run DeviceMajor:0 DeviceMinor:24 Capacity:6562435072 Type:vfs Inodes:819200 HasInodes:true}] DiskMap:map[259:0:{Name:nvme0n1 Major:259 Minor:0 Size:128849018880 Scheduler:none}] NetworkDevices:[{Name:br-ex MacAddress:02:c1:15:f9:2c:c9 Speed:0 Mtu:9001} {Name:ens5 MacAddress:02:c1:15:f9:2c:c9 Speed:0 Mtu:9001} {Name:ovs-system MacAddress:52:97:42:68:d3:68 Speed:0 Mtu:1500}] Topology:[{Id:0 Memory:32812175360 HugePages:[{PageSize:1048576 NumPages:0} {PageSize:2048 NumPages:0}] Cores:[{Id:0 Threads:[0 4] Caches:[{Id:0 Size:32768 Type:Data Level:1} {Id:0 Size:32768 Type:Instruction Level:1} {Id:0 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:1 Threads:[1 5] Caches:[{Id:1 Size:32768 Type:Data Level:1} {Id:1 Size:32768 Type:Instruction Level:1} {Id:1 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:2 Threads:[2 6] Caches:[{Id:2 Size:32768 Type:Data Level:1} {Id:2 Size:32768 Type:Instruction Level:1} {Id:2 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:3 Threads:[3 7] Caches:[{Id:3 Size:32768 Type:Data Level:1} {Id:3 Size:32768 Type:Instruction Level:1} {Id:3 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:}] Caches:[{Id:0 Size:34603008 Type:Unified Level:3}] Distances:[10]}] CloudProvider:Unknown InstanceType:Unknown InstanceID:None} Jul 13 02:56:57.888545 ip-10-0-134-52 kubenswrapper[2558]: I0713 02:56:57.888544 2558 manager_no_libpfm.go:29] cAdvisor is build without cgo and/or libpfm support. Perf event counters are not available. Jul 13 02:56:57.888652 ip-10-0-134-52 kubenswrapper[2558]: I0713 02:56:57.888611 2558 manager.go:232] Version: {KernelVersion:5.14.0-570.126.1.el9_6.x86_64 ContainerOsVersion:Red Hat Enterprise Linux CoreOS 9.6.20260702-0 (Plow) DockerVersion: DockerAPIVersion: CadvisorVersion: CadvisorRevision:} Jul 13 02:56:57.891659 ip-10-0-134-52 kubenswrapper[2558]: I0713 02:56:57.891636 2558 container_manager_linux.go:273] "Container manager verified user specified cgroup-root exists" cgroupRoot=[] Jul 13 02:56:57.891787 ip-10-0-134-52 kubenswrapper[2558]: I0713 02:56:57.891663 2558 container_manager_linux.go:278] "Creating Container Manager object based on Node Config" nodeConfig={"NodeName":"ip-10-0-134-52.ec2.internal","RuntimeCgroupsName":"/system.slice/crio.service","SystemCgroupsName":"/system.slice","KubeletCgroupsName":"","KubeletOOMScoreAdj":-999,"ContainerRuntime":"","CgroupsPerQOS":true,"CgroupRoot":"/","CgroupDriver":"systemd","KubeletRootDir":"/var/lib/kubelet","ProtectKernelDefaults":true,"KubeReservedCgroupName":"","SystemReservedCgroupName":"","ReservedSystemCPUs":{},"EnforceNodeAllocatable":{"pods":{}},"KubeReserved":null,"SystemReserved":{"cpu":"500m","ephemeral-storage":"1Gi","memory":"1Gi"},"HardEvictionThresholds":[{"Signal":"nodefs.available","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.1},"GracePeriod":0,"MinReclaim":null},{"Signal":"nodefs.inodesFree","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.05},"GracePeriod":0,"MinReclaim":null},{"Signal":"imagefs.available","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.15},"GracePeriod":0,"MinReclaim":null},{"Signal":"imagefs.inodesFree","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.05},"GracePeriod":0,"MinReclaim":null},{"Signal":"memory.available","Operator":"LessThan","Value":{"Quantity":"100Mi","Percentage":0},"GracePeriod":0,"MinReclaim":null}],"QOSReserved":{},"CPUManagerPolicy":"none","CPUManagerPolicyOptions":null,"TopologyManagerScope":"container","CPUManagerReconcilePeriod":10000000000,"MemoryManagerPolicy":"None","MemoryManagerReservedMemory":null,"PodPidsLimit":4096,"EnforceCPULimits":true,"CPUCFSQuotaPeriod":100000000,"TopologyManagerPolicy":"none","TopologyManagerPolicyOptions":null,"CgroupVersion":2} Jul 13 02:56:57.892362 ip-10-0-134-52 kubenswrapper[2558]: I0713 02:56:57.892352 2558 topology_manager.go:138] "Creating topology manager with none policy" Jul 13 02:56:57.892403 ip-10-0-134-52 kubenswrapper[2558]: I0713 02:56:57.892364 2558 container_manager_linux.go:309] "Creating device plugin manager" Jul 13 02:56:57.892403 ip-10-0-134-52 kubenswrapper[2558]: I0713 02:56:57.892371 2558 manager.go:141] "Creating Device Plugin manager" path="/var/lib/kubelet/device-plugins/kubelet.sock" Jul 13 02:56:57.893542 ip-10-0-134-52 kubenswrapper[2558]: I0713 02:56:57.893531 2558 server.go:74] "Creating device plugin registration server" version="v1beta1" socket="/var/lib/kubelet/device-plugins/kubelet.sock" Jul 13 02:56:57.894262 ip-10-0-134-52 kubenswrapper[2558]: I0713 02:56:57.894252 2558 container_manager_linux.go:318] "Creating Dynamic Resource Allocation (DRA) manager" Jul 13 02:56:57.897979 ip-10-0-134-52 kubenswrapper[2558]: I0713 02:56:57.897968 2558 state_mem.go:36] "Initialized new in-memory state store" Jul 13 02:56:57.898095 ip-10-0-134-52 kubenswrapper[2558]: I0713 02:56:57.898086 2558 server.go:1240] "Using root directory" path="/var/lib/kubelet" Jul 13 02:56:57.898133 ip-10-0-134-52 kubenswrapper[2558]: I0713 02:56:57.898115 2558 kubelet.go:486] "Attempting to sync node with API server" Jul 13 02:56:57.898133 ip-10-0-134-52 kubenswrapper[2558]: I0713 02:56:57.898125 2558 kubelet.go:387] "Adding static pod path" path="/etc/kubernetes/manifests" Jul 13 02:56:57.898218 ip-10-0-134-52 kubenswrapper[2558]: I0713 02:56:57.898138 2558 file.go:69] "Watching path" path="/etc/kubernetes/manifests" Jul 13 02:56:57.898218 ip-10-0-134-52 kubenswrapper[2558]: I0713 02:56:57.898148 2558 kubelet.go:398] "Adding apiserver pod source" Jul 13 02:56:57.898218 ip-10-0-134-52 kubenswrapper[2558]: I0713 02:56:57.898158 2558 apiserver.go:42] "Waiting for node sync before watching apiserver pods" Jul 13 02:56:57.898535 ip-10-0-134-52 kubenswrapper[2558]: I0713 02:56:57.898521 2558 state_mem.go:40] "Initialized new in-memory state store for pod resource information tracking" Jul 13 02:56:57.898585 ip-10-0-134-52 kubenswrapper[2558]: I0713 02:56:57.898550 2558 state_mem.go:40] "Initialized new in-memory state store for pod resource information tracking" Jul 13 02:56:57.900168 ip-10-0-134-52 kubenswrapper[2558]: I0713 02:56:57.900152 2558 reflector.go:439] "Caches populated" logger="kubernetes.io/kube-apiserver-client-kubelet" type="*v1.CertificateSigningRequest" reflector="k8s.io/client-go/tools/watch/informerwatcher.go:162" Jul 13 02:56:57.900774 ip-10-0-134-52 kubenswrapper[2558]: I0713 02:56:57.900758 2558 kuberuntime_manager.go:301] "Container runtime initialized" containerRuntime="cri-o" version="1.34.10-2.rhaos4.21.git83ee25b.el9" apiVersion="v1" Jul 13 02:56:57.902035 ip-10-0-134-52 kubenswrapper[2558]: I0713 02:56:57.902015 2558 kubelet.go:960] "Not starting ClusterTrustBundle informer because we are in static kubelet mode or the ClusterTrustBundleProjection featuregate is disabled" Jul 13 02:56:57.902129 ip-10-0-134-52 kubenswrapper[2558]: I0713 02:56:57.902063 2558 kubelet.go:984] "Not starting PodCertificateRequest manager because we are in static kubelet mode or the PodCertificateProjection feature gate is disabled" Jul 13 02:56:57.902665 ip-10-0-134-52 kubenswrapper[2558]: I0713 02:56:57.902650 2558 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/portworx-volume" Jul 13 02:56:57.902697 ip-10-0-134-52 kubenswrapper[2558]: I0713 02:56:57.902672 2558 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/empty-dir" Jul 13 02:56:57.902697 ip-10-0-134-52 kubenswrapper[2558]: I0713 02:56:57.902679 2558 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/git-repo" Jul 13 02:56:57.902697 ip-10-0-134-52 kubenswrapper[2558]: I0713 02:56:57.902684 2558 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/host-path" Jul 13 02:56:57.902697 ip-10-0-134-52 kubenswrapper[2558]: I0713 02:56:57.902692 2558 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/nfs" Jul 13 02:56:57.902697 ip-10-0-134-52 kubenswrapper[2558]: I0713 02:56:57.902698 2558 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/secret" Jul 13 02:56:57.902834 ip-10-0-134-52 kubenswrapper[2558]: I0713 02:56:57.902761 2558 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/iscsi" Jul 13 02:56:57.902834 ip-10-0-134-52 kubenswrapper[2558]: I0713 02:56:57.902768 2558 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/downward-api" Jul 13 02:56:57.902834 ip-10-0-134-52 kubenswrapper[2558]: I0713 02:56:57.902774 2558 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/fc" Jul 13 02:56:57.902834 ip-10-0-134-52 kubenswrapper[2558]: I0713 02:56:57.902786 2558 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/configmap" Jul 13 02:56:57.902834 ip-10-0-134-52 kubenswrapper[2558]: I0713 02:56:57.902798 2558 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/projected" Jul 13 02:56:57.902834 ip-10-0-134-52 kubenswrapper[2558]: I0713 02:56:57.902805 2558 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/local-volume" Jul 13 02:56:57.904114 ip-10-0-134-52 kubenswrapper[2558]: I0713 02:56:57.904102 2558 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/csi" Jul 13 02:56:57.904114 ip-10-0-134-52 kubenswrapper[2558]: I0713 02:56:57.904114 2558 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/image" Jul 13 02:56:57.907097 ip-10-0-134-52 kubenswrapper[2558]: I0713 02:56:57.907060 2558 server.go:1268] "Started kubelet" Jul 13 02:56:57.907173 ip-10-0-134-52 kubenswrapper[2558]: I0713 02:56:57.907139 2558 server.go:180] "Starting to listen" address="0.0.0.0" port=10250 Jul 13 02:56:57.907601 ip-10-0-134-52 kubenswrapper[2558]: I0713 02:56:57.907233 2558 ratelimit.go:56] "Setting rate limiting for endpoint" service="podresources" qps=100 burstTokens=10 Jul 13 02:56:57.907601 ip-10-0-134-52 kubenswrapper[2558]: I0713 02:56:57.907483 2558 server_v1.go:49] "podresources" method="list" useActivePods=true Jul 13 02:56:57.908029 ip-10-0-134-52 systemd[1]: Started Kubernetes Kubelet. Jul 13 02:56:57.911043 ip-10-0-134-52 kubenswrapper[2558]: I0713 02:56:57.911019 2558 server.go:249] "Starting to serve the podresources API" endpoint="unix:/var/lib/kubelet/pod-resources/kubelet.sock" Jul 13 02:56:57.911172 ip-10-0-134-52 kubenswrapper[2558]: E0713 02:56:57.911020 2558 reflector.go:205] "Failed to watch" err="failed to list *v1.Service: services is forbidden: User \"system:anonymous\" cannot list resource \"services\" in API group \"\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Service" Jul 13 02:56:57.911375 ip-10-0-134-52 kubenswrapper[2558]: E0713 02:56:57.911343 2558 reflector.go:205] "Failed to watch" err="failed to list *v1.Node: nodes \"ip-10-0-134-52.ec2.internal\" is forbidden: User \"system:anonymous\" cannot list resource \"nodes\" in API group \"\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Node" Jul 13 02:56:57.911575 ip-10-0-134-52 kubenswrapper[2558]: I0713 02:56:57.911546 2558 csi_plugin.go:990] Failed to contact API server when waiting for CSINode publishing: csinodes.storage.k8s.io "ip-10-0-134-52.ec2.internal" is forbidden: User "system:anonymous" cannot get resource "csinodes" in API group "storage.k8s.io" at the cluster scope Jul 13 02:56:57.914355 ip-10-0-134-52 kubenswrapper[2558]: E0713 02:56:57.913460 2558 kubelet.go:1638] "Image garbage collection failed once. Stats initialization may not have completed yet" err="failed to get imageFs info: unable to find data in memory cache" Jul 13 02:56:57.914355 ip-10-0-134-52 kubenswrapper[2558]: I0713 02:56:57.913752 2558 server.go:310] "Adding debug handlers to kubelet server" Jul 13 02:56:57.916667 ip-10-0-134-52 kubenswrapper[2558]: I0713 02:56:57.916644 2558 fs_resource_analyzer.go:67] "Starting FS ResourceAnalyzer" Jul 13 02:56:57.916779 ip-10-0-134-52 kubenswrapper[2558]: E0713 02:56:57.916760 2558 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-134-52.ec2.internal\" not found" Jul 13 02:56:57.917098 ip-10-0-134-52 kubenswrapper[2558]: I0713 02:56:57.916646 2558 certificate_manager.go:422] "Certificate rotation is enabled" logger="kubernetes.io/kubelet-serving" Jul 13 02:56:57.917264 ip-10-0-134-52 kubenswrapper[2558]: I0713 02:56:57.917250 2558 desired_state_of_world_populator.go:146] "Desired state populator starts to run" Jul 13 02:56:57.917352 ip-10-0-134-52 kubenswrapper[2558]: I0713 02:56:57.917263 2558 volume_manager.go:311] "The desired_state_of_world populator starts" Jul 13 02:56:57.917352 ip-10-0-134-52 kubenswrapper[2558]: I0713 02:56:57.917279 2558 volume_manager.go:313] "Starting Kubelet Volume Manager" Jul 13 02:56:57.917444 ip-10-0-134-52 kubenswrapper[2558]: I0713 02:56:57.917383 2558 reconstruct.go:97] "Volume reconstruction finished" Jul 13 02:56:57.917444 ip-10-0-134-52 kubenswrapper[2558]: I0713 02:56:57.917391 2558 reconciler.go:29] "Reconciler: start to sync state" Jul 13 02:56:57.917533 ip-10-0-134-52 kubenswrapper[2558]: I0713 02:56:57.917486 2558 factory.go:55] Registering systemd factory Jul 13 02:56:57.917533 ip-10-0-134-52 kubenswrapper[2558]: I0713 02:56:57.917503 2558 factory.go:223] Registration of the systemd container factory successfully Jul 13 02:56:57.917787 ip-10-0-134-52 kubenswrapper[2558]: I0713 02:56:57.917761 2558 factory.go:153] Registering CRI-O factory Jul 13 02:56:57.917787 ip-10-0-134-52 kubenswrapper[2558]: I0713 02:56:57.917779 2558 factory.go:223] Registration of the crio container factory successfully Jul 13 02:56:57.917908 ip-10-0-134-52 kubenswrapper[2558]: I0713 02:56:57.917829 2558 factory.go:221] Registration of the containerd container factory failed: unable to create containerd client: containerd: cannot unix dial containerd api service: dial unix /run/containerd/containerd.sock: connect: no such file or directory Jul 13 02:56:57.917908 ip-10-0-134-52 kubenswrapper[2558]: I0713 02:56:57.917852 2558 factory.go:103] Registering Raw factory Jul 13 02:56:57.917908 ip-10-0-134-52 kubenswrapper[2558]: I0713 02:56:57.917865 2558 manager.go:1196] Started watching for new ooms in manager Jul 13 02:56:57.918349 ip-10-0-134-52 kubenswrapper[2558]: I0713 02:56:57.918317 2558 manager.go:349] Starting recovery of all containers Jul 13 02:56:57.918652 ip-10-0-134-52 kubenswrapper[2558]: E0713 02:56:57.917734 2558 event.go:359] "Server rejected event (will not retry!)" err="events is forbidden: User \"system:anonymous\" cannot create resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-134-52.ec2.internal.18c1b9fba71cae13 default 0 0001-01-01 00:00:00 +0000 UTC map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-134-52.ec2.internal,UID:ip-10-0-134-52.ec2.internal,APIVersion:,ResourceVersion:,FieldPath:,},Reason:Starting,Message:Starting kubelet.,Source:EventSource{Component:kubelet,Host:ip-10-0-134-52.ec2.internal,},FirstTimestamp:2026-07-13 02:56:57.907031571 +0000 UTC m=+0.307632029,LastTimestamp:2026-07-13 02:56:57.907031571 +0000 UTC m=+0.307632029,Count:1,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-134-52.ec2.internal,}" Jul 13 02:56:57.928246 ip-10-0-134-52 kubenswrapper[2558]: I0713 02:56:57.928230 2558 manager.go:354] Recovery completed Jul 13 02:56:57.928776 ip-10-0-134-52 kubenswrapper[2558]: E0713 02:56:57.928746 2558 reflector.go:205] "Failed to watch" err="failed to list *v1.CSIDriver: csidrivers.storage.k8s.io is forbidden: User \"system:anonymous\" cannot list resource \"csidrivers\" in API group \"storage.k8s.io\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.CSIDriver" Jul 13 02:56:57.928860 ip-10-0-134-52 kubenswrapper[2558]: E0713 02:56:57.928760 2558 controller.go:145] "Failed to ensure lease exists, will retry" err="leases.coordination.k8s.io \"ip-10-0-134-52.ec2.internal\" is forbidden: User \"system:anonymous\" cannot get resource \"leases\" in API group \"coordination.k8s.io\" in the namespace \"kube-node-lease\"" interval="200ms" Jul 13 02:56:57.932408 ip-10-0-134-52 kubenswrapper[2558]: I0713 02:56:57.932393 2558 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jul 13 02:56:57.934248 ip-10-0-134-52 kubenswrapper[2558]: I0713 02:56:57.934227 2558 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-134-52.ec2.internal" event="NodeHasSufficientMemory" Jul 13 02:56:57.934317 ip-10-0-134-52 kubenswrapper[2558]: I0713 02:56:57.934260 2558 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-134-52.ec2.internal" event="NodeHasNoDiskPressure" Jul 13 02:56:57.934317 ip-10-0-134-52 kubenswrapper[2558]: I0713 02:56:57.934270 2558 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-134-52.ec2.internal" event="NodeHasSufficientPID" Jul 13 02:56:57.935177 ip-10-0-134-52 kubenswrapper[2558]: I0713 02:56:57.935162 2558 cpu_manager.go:222] "Starting CPU manager" policy="none" Jul 13 02:56:57.935177 ip-10-0-134-52 kubenswrapper[2558]: I0713 02:56:57.935174 2558 cpu_manager.go:223] "Reconciling" reconcilePeriod="10s" Jul 13 02:56:57.935284 ip-10-0-134-52 kubenswrapper[2558]: I0713 02:56:57.935182 2558 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jul 13 02:56:57.935284 ip-10-0-134-52 kubenswrapper[2558]: I0713 02:56:57.935189 2558 state_mem.go:36] "Initialized new in-memory state store" Jul 13 02:56:57.935867 ip-10-0-134-52 kubenswrapper[2558]: I0713 02:56:57.935852 2558 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-134-52.ec2.internal" event="NodeHasSufficientMemory" Jul 13 02:56:57.935974 ip-10-0-134-52 kubenswrapper[2558]: I0713 02:56:57.935885 2558 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-134-52.ec2.internal" event="NodeHasNoDiskPressure" Jul 13 02:56:57.935974 ip-10-0-134-52 kubenswrapper[2558]: I0713 02:56:57.935900 2558 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-134-52.ec2.internal" event="NodeHasSufficientPID" Jul 13 02:56:57.937298 ip-10-0-134-52 kubenswrapper[2558]: I0713 02:56:57.937282 2558 policy_none.go:49] "None policy: Start" Jul 13 02:56:57.937379 ip-10-0-134-52 kubenswrapper[2558]: I0713 02:56:57.937305 2558 memory_manager.go:187] "Starting memorymanager" policy="None" Jul 13 02:56:57.937379 ip-10-0-134-52 kubenswrapper[2558]: I0713 02:56:57.937321 2558 state_mem.go:36] "Initializing new in-memory state store" logger="Memory Manager state checkpoint" Jul 13 02:56:57.937555 ip-10-0-134-52 kubenswrapper[2558]: E0713 02:56:57.937492 2558 event.go:359] "Server rejected event (will not retry!)" err="events is forbidden: User \"system:anonymous\" cannot create resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-134-52.ec2.internal.18c1b9fba8bbf975 default 0 0001-01-01 00:00:00 +0000 UTC map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-134-52.ec2.internal,UID:ip-10-0-134-52.ec2.internal,APIVersion:,ResourceVersion:,FieldPath:,},Reason:NodeHasSufficientMemory,Message:Node ip-10-0-134-52.ec2.internal status is now: NodeHasSufficientMemory,Source:EventSource{Component:kubelet,Host:ip-10-0-134-52.ec2.internal,},FirstTimestamp:2026-07-13 02:56:57.934248309 +0000 UTC m=+0.334848766,LastTimestamp:2026-07-13 02:56:57.934248309 +0000 UTC m=+0.334848766,Count:1,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-134-52.ec2.internal,}" Jul 13 02:56:57.939296 ip-10-0-134-52 kubenswrapper[2558]: I0713 02:56:57.939285 2558 policy_none.go:47] "Start" Jul 13 02:56:57.946844 ip-10-0-134-52 kubenswrapper[2558]: E0713 02:56:57.946780 2558 event.go:359] "Server rejected event (will not retry!)" err="events is forbidden: User \"system:anonymous\" cannot create resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-134-52.ec2.internal.18c1b9fba8bc3bbc default 0 0001-01-01 00:00:00 +0000 UTC map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-134-52.ec2.internal,UID:ip-10-0-134-52.ec2.internal,APIVersion:,ResourceVersion:,FieldPath:,},Reason:NodeHasNoDiskPressure,Message:Node ip-10-0-134-52.ec2.internal status is now: NodeHasNoDiskPressure,Source:EventSource{Component:kubelet,Host:ip-10-0-134-52.ec2.internal,},FirstTimestamp:2026-07-13 02:56:57.934265276 +0000 UTC m=+0.334865733,LastTimestamp:2026-07-13 02:56:57.934265276 +0000 UTC m=+0.334865733,Count:1,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-134-52.ec2.internal,}" Jul 13 02:56:57.956708 ip-10-0-134-52 kubenswrapper[2558]: I0713 02:56:57.956688 2558 csr.go:274] "Certificate signing request is approved, waiting to be issued" logger="kubernetes.io/kube-apiserver-client-kubelet" csr="csr-r4gzn" Jul 13 02:56:57.958917 ip-10-0-134-52 kubenswrapper[2558]: E0713 02:56:57.958860 2558 event.go:359] "Server rejected event (will not retry!)" err="events is forbidden: User \"system:anonymous\" cannot create resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-134-52.ec2.internal.18c1b9fba8bc5f47 default 0 0001-01-01 00:00:00 +0000 UTC map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-134-52.ec2.internal,UID:ip-10-0-134-52.ec2.internal,APIVersion:,ResourceVersion:,FieldPath:,},Reason:NodeHasSufficientPID,Message:Node ip-10-0-134-52.ec2.internal status is now: NodeHasSufficientPID,Source:EventSource{Component:kubelet,Host:ip-10-0-134-52.ec2.internal,},FirstTimestamp:2026-07-13 02:56:57.934274375 +0000 UTC m=+0.334874832,LastTimestamp:2026-07-13 02:56:57.934274375 +0000 UTC m=+0.334874832,Count:1,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-134-52.ec2.internal,}" Jul 13 02:56:57.970323 ip-10-0-134-52 kubenswrapper[2558]: E0713 02:56:57.970263 2558 event.go:359] "Server rejected event (will not retry!)" err="events \"ip-10-0-134-52.ec2.internal.18c1b9fba8bbf975\" is forbidden: User \"system:anonymous\" cannot patch resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-134-52.ec2.internal.18c1b9fba8bbf975 default 0 0001-01-01 00:00:00 +0000 UTC map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-134-52.ec2.internal,UID:ip-10-0-134-52.ec2.internal,APIVersion:,ResourceVersion:,FieldPath:,},Reason:NodeHasSufficientMemory,Message:Node ip-10-0-134-52.ec2.internal status is now: NodeHasSufficientMemory,Source:EventSource{Component:kubelet,Host:ip-10-0-134-52.ec2.internal,},FirstTimestamp:2026-07-13 02:56:57.934248309 +0000 UTC m=+0.334848766,LastTimestamp:2026-07-13 02:56:57.93586913 +0000 UTC m=+0.336469595,Count:2,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-134-52.ec2.internal,}" Jul 13 02:56:57.972642 ip-10-0-134-52 kubenswrapper[2558]: I0713 02:56:57.972626 2558 csr.go:270] "Certificate signing request is issued" logger="kubernetes.io/kube-apiserver-client-kubelet" csr="csr-r4gzn" Jul 13 02:56:57.976848 ip-10-0-134-52 kubenswrapper[2558]: I0713 02:56:57.976835 2558 manager.go:337] "Starting Device Plugin manager" Jul 13 02:56:57.976918 ip-10-0-134-52 kubenswrapper[2558]: E0713 02:56:57.976862 2558 manager.go:513] "Failed to read data from checkpoint" err="checkpoint is not found" checkpoint="kubelet_internal_checkpoint" Jul 13 02:56:57.976918 ip-10-0-134-52 kubenswrapper[2558]: I0713 02:56:57.976871 2558 server.go:87] "Starting device plugin registration server" Jul 13 02:56:57.977073 ip-10-0-134-52 kubenswrapper[2558]: I0713 02:56:57.977062 2558 eviction_manager.go:189] "Eviction manager: starting control loop" Jul 13 02:56:57.977123 ip-10-0-134-52 kubenswrapper[2558]: I0713 02:56:57.977075 2558 container_log_manager.go:146] "Initializing container log rotate workers" workers=1 monitorPeriod="10s" Jul 13 02:56:57.977192 ip-10-0-134-52 kubenswrapper[2558]: I0713 02:56:57.977176 2558 plugin_watcher.go:51] "Plugin Watcher Start" path="/var/lib/kubelet/plugins_registry" Jul 13 02:56:57.977288 ip-10-0-134-52 kubenswrapper[2558]: I0713 02:56:57.977250 2558 plugin_manager.go:116] "The desired_state_of_world populator (plugin watcher) starts" Jul 13 02:56:57.977288 ip-10-0-134-52 kubenswrapper[2558]: I0713 02:56:57.977259 2558 plugin_manager.go:118] "Starting Kubelet Plugin Manager" Jul 13 02:56:57.977757 ip-10-0-134-52 kubenswrapper[2558]: E0713 02:56:57.977738 2558 eviction_manager.go:267] "eviction manager: failed to check if we have separate container filesystem. Ignoring." err="non-existent label \"crio-containers\"" Jul 13 02:56:57.977820 ip-10-0-134-52 kubenswrapper[2558]: E0713 02:56:57.977790 2558 eviction_manager.go:292] "Eviction manager: failed to get summary stats" err="failed to get node info: node \"ip-10-0-134-52.ec2.internal\" not found" Jul 13 02:56:58.077812 ip-10-0-134-52 kubenswrapper[2558]: I0713 02:56:58.077792 2558 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jul 13 02:56:58.079874 ip-10-0-134-52 kubenswrapper[2558]: I0713 02:56:58.078534 2558 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-134-52.ec2.internal" event="NodeHasSufficientMemory" Jul 13 02:56:58.079874 ip-10-0-134-52 kubenswrapper[2558]: I0713 02:56:58.078562 2558 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-134-52.ec2.internal" event="NodeHasNoDiskPressure" Jul 13 02:56:58.079874 ip-10-0-134-52 kubenswrapper[2558]: I0713 02:56:58.078572 2558 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-134-52.ec2.internal" event="NodeHasSufficientPID" Jul 13 02:56:58.079874 ip-10-0-134-52 kubenswrapper[2558]: I0713 02:56:58.078594 2558 kubelet_node_status.go:78] "Attempting to register node" node="ip-10-0-134-52.ec2.internal" Jul 13 02:56:58.085292 ip-10-0-134-52 kubenswrapper[2558]: I0713 02:56:58.085261 2558 kubelet_network_linux.go:54] "Initialized iptables rules." protocol="IPv4" Jul 13 02:56:58.086520 ip-10-0-134-52 kubenswrapper[2558]: I0713 02:56:58.086502 2558 kubelet_network_linux.go:54] "Initialized iptables rules." protocol="IPv6" Jul 13 02:56:58.086571 ip-10-0-134-52 kubenswrapper[2558]: I0713 02:56:58.086551 2558 status_manager.go:244] "Starting to sync pod status with apiserver" Jul 13 02:56:58.086604 ip-10-0-134-52 kubenswrapper[2558]: I0713 02:56:58.086575 2558 kubelet.go:2448] "Starting kubelet main sync loop" Jul 13 02:56:58.086649 ip-10-0-134-52 kubenswrapper[2558]: E0713 02:56:58.086613 2558 kubelet.go:2472] "Skipping pod synchronization" err="PLEG is not healthy: pleg has yet to be successful" Jul 13 02:56:58.087557 ip-10-0-134-52 kubenswrapper[2558]: I0713 02:56:58.087542 2558 kubelet_node_status.go:81] "Successfully registered node" node="ip-10-0-134-52.ec2.internal" Jul 13 02:56:58.087662 ip-10-0-134-52 kubenswrapper[2558]: E0713 02:56:58.087565 2558 kubelet_node_status.go:536] "Error updating node status, will retry" err="error getting node \"ip-10-0-134-52.ec2.internal\": node \"ip-10-0-134-52.ec2.internal\" not found" Jul 13 02:56:58.089354 ip-10-0-134-52 kubenswrapper[2558]: I0713 02:56:58.089339 2558 reflector.go:439] "Caches populated" type="*v1.RuntimeClass" reflector="k8s.io/client-go/informers/factory.go:160" Jul 13 02:56:58.143960 ip-10-0-134-52 kubenswrapper[2558]: E0713 02:56:58.143905 2558 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-134-52.ec2.internal\" not found" Jul 13 02:56:58.187636 ip-10-0-134-52 kubenswrapper[2558]: I0713 02:56:58.187600 2558 kubelet.go:2535] "SyncLoop ADD" source="file" pods=["openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-134-52.ec2.internal","kube-system/kube-apiserver-proxy-ip-10-0-134-52.ec2.internal"] Jul 13 02:56:58.187734 ip-10-0-134-52 kubenswrapper[2558]: I0713 02:56:58.187682 2558 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jul 13 02:56:58.188498 ip-10-0-134-52 kubenswrapper[2558]: I0713 02:56:58.188478 2558 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-134-52.ec2.internal" event="NodeHasSufficientMemory" Jul 13 02:56:58.188568 ip-10-0-134-52 kubenswrapper[2558]: I0713 02:56:58.188508 2558 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-134-52.ec2.internal" event="NodeHasNoDiskPressure" Jul 13 02:56:58.188568 ip-10-0-134-52 kubenswrapper[2558]: I0713 02:56:58.188519 2558 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-134-52.ec2.internal" event="NodeHasSufficientPID" Jul 13 02:56:58.190774 ip-10-0-134-52 kubenswrapper[2558]: I0713 02:56:58.190762 2558 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jul 13 02:56:58.190933 ip-10-0-134-52 kubenswrapper[2558]: I0713 02:56:58.190919 2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-134-52.ec2.internal" Jul 13 02:56:58.190967 ip-10-0-134-52 kubenswrapper[2558]: I0713 02:56:58.190957 2558 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jul 13 02:56:58.191481 ip-10-0-134-52 kubenswrapper[2558]: I0713 02:56:58.191465 2558 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-134-52.ec2.internal" event="NodeHasSufficientMemory" Jul 13 02:56:58.191548 ip-10-0-134-52 kubenswrapper[2558]: I0713 02:56:58.191498 2558 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-134-52.ec2.internal" event="NodeHasNoDiskPressure" Jul 13 02:56:58.191548 ip-10-0-134-52 kubenswrapper[2558]: I0713 02:56:58.191508 2558 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-134-52.ec2.internal" event="NodeHasSufficientPID" Jul 13 02:56:58.191611 ip-10-0-134-52 kubenswrapper[2558]: I0713 02:56:58.191466 2558 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-134-52.ec2.internal" event="NodeHasSufficientMemory" Jul 13 02:56:58.191611 ip-10-0-134-52 kubenswrapper[2558]: I0713 02:56:58.191567 2558 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-134-52.ec2.internal" event="NodeHasNoDiskPressure" Jul 13 02:56:58.191611 ip-10-0-134-52 kubenswrapper[2558]: I0713 02:56:58.191581 2558 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-134-52.ec2.internal" event="NodeHasSufficientPID" Jul 13 02:56:58.193722 ip-10-0-134-52 kubenswrapper[2558]: I0713 02:56:58.193708 2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/kube-apiserver-proxy-ip-10-0-134-52.ec2.internal" Jul 13 02:56:58.193762 ip-10-0-134-52 kubenswrapper[2558]: I0713 02:56:58.193735 2558 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jul 13 02:56:58.194417 ip-10-0-134-52 kubenswrapper[2558]: I0713 02:56:58.194399 2558 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-134-52.ec2.internal" event="NodeHasSufficientMemory" Jul 13 02:56:58.194499 ip-10-0-134-52 kubenswrapper[2558]: I0713 02:56:58.194428 2558 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-134-52.ec2.internal" event="NodeHasNoDiskPressure" Jul 13 02:56:58.194499 ip-10-0-134-52 kubenswrapper[2558]: I0713 02:56:58.194442 2558 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-134-52.ec2.internal" event="NodeHasSufficientPID" Jul 13 02:56:58.209887 ip-10-0-134-52 kubenswrapper[2558]: E0713 02:56:58.209862 2558 kubelet.go:3244] "No need to create a mirror pod, since failed to get node info from the cluster" err="node \"ip-10-0-134-52.ec2.internal\" not found" node="ip-10-0-134-52.ec2.internal" Jul 13 02:56:58.214153 ip-10-0-134-52 kubenswrapper[2558]: E0713 02:56:58.214136 2558 kubelet.go:3244] "No need to create a mirror pod, since failed to get node info from the cluster" err="node \"ip-10-0-134-52.ec2.internal\" not found" node="ip-10-0-134-52.ec2.internal" Jul 13 02:56:58.244739 ip-10-0-134-52 kubenswrapper[2558]: E0713 02:56:58.244721 2558 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-134-52.ec2.internal\" not found" Jul 13 02:56:58.318946 ip-10-0-134-52 kubenswrapper[2558]: I0713 02:56:58.318925 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/98adcf0180580c6711a29c73caa90e67-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-134-52.ec2.internal\" (UID: \"98adcf0180580c6711a29c73caa90e67\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-134-52.ec2.internal" Jul 13 02:56:58.319006 ip-10-0-134-52 kubenswrapper[2558]: I0713 02:56:58.318963 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/98adcf0180580c6711a29c73caa90e67-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-134-52.ec2.internal\" (UID: \"98adcf0180580c6711a29c73caa90e67\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-134-52.ec2.internal" Jul 13 02:56:58.319006 ip-10-0-134-52 kubenswrapper[2558]: I0713 02:56:58.318981 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/host-path/c2b195f03ef2d8abb371e44a8b3b8700-config\") pod \"kube-apiserver-proxy-ip-10-0-134-52.ec2.internal\" (UID: \"c2b195f03ef2d8abb371e44a8b3b8700\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-134-52.ec2.internal" Jul 13 02:56:58.345068 ip-10-0-134-52 kubenswrapper[2558]: E0713 02:56:58.345048 2558 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-134-52.ec2.internal\" not found" Jul 13 02:56:58.419760 ip-10-0-134-52 kubenswrapper[2558]: I0713 02:56:58.419708 2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/host-path/c2b195f03ef2d8abb371e44a8b3b8700-config\") pod \"kube-apiserver-proxy-ip-10-0-134-52.ec2.internal\" (UID: \"c2b195f03ef2d8abb371e44a8b3b8700\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-134-52.ec2.internal" Jul 13 02:56:58.419760 ip-10-0-134-52 kubenswrapper[2558]: I0713 02:56:58.419742 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/host-path/c2b195f03ef2d8abb371e44a8b3b8700-config\") pod \"kube-apiserver-proxy-ip-10-0-134-52.ec2.internal\" (UID: \"c2b195f03ef2d8abb371e44a8b3b8700\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-134-52.ec2.internal" Jul 13 02:56:58.419848 ip-10-0-134-52 kubenswrapper[2558]: I0713 02:56:58.419778 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/98adcf0180580c6711a29c73caa90e67-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-134-52.ec2.internal\" (UID: \"98adcf0180580c6711a29c73caa90e67\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-134-52.ec2.internal" Jul 13 02:56:58.419848 ip-10-0-134-52 kubenswrapper[2558]: I0713 02:56:58.419795 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/98adcf0180580c6711a29c73caa90e67-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-134-52.ec2.internal\" (UID: \"98adcf0180580c6711a29c73caa90e67\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-134-52.ec2.internal" Jul 13 02:56:58.419848 ip-10-0-134-52 kubenswrapper[2558]: I0713 02:56:58.419833 2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/98adcf0180580c6711a29c73caa90e67-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-134-52.ec2.internal\" (UID: \"98adcf0180580c6711a29c73caa90e67\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-134-52.ec2.internal" Jul 13 02:56:58.419941 ip-10-0-134-52 kubenswrapper[2558]: I0713 02:56:58.419870 2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/98adcf0180580c6711a29c73caa90e67-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-134-52.ec2.internal\" (UID: \"98adcf0180580c6711a29c73caa90e67\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-134-52.ec2.internal" Jul 13 02:56:58.445802 ip-10-0-134-52 kubenswrapper[2558]: E0713 02:56:58.445771 2558 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-134-52.ec2.internal\" not found" Jul 13 02:56:58.511963 ip-10-0-134-52 kubenswrapper[2558]: I0713 02:56:58.511944 2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-134-52.ec2.internal" Jul 13 02:56:58.516665 ip-10-0-134-52 kubenswrapper[2558]: I0713 02:56:58.516500 2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/kube-apiserver-proxy-ip-10-0-134-52.ec2.internal" Jul 13 02:56:58.546296 ip-10-0-134-52 kubenswrapper[2558]: E0713 02:56:58.546274 2558 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-134-52.ec2.internal\" not found" Jul 13 02:56:58.646774 ip-10-0-134-52 kubenswrapper[2558]: E0713 02:56:58.646739 2558 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-134-52.ec2.internal\" not found" Jul 13 02:56:58.747354 ip-10-0-134-52 kubenswrapper[2558]: E0713 02:56:58.747285 2558 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-134-52.ec2.internal\" not found" Jul 13 02:56:58.847763 ip-10-0-134-52 kubenswrapper[2558]: E0713 02:56:58.847732 2558 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-134-52.ec2.internal\" not found" Jul 13 02:56:58.862265 ip-10-0-134-52 kubenswrapper[2558]: I0713 02:56:58.862242 2558 transport.go:147] "Certificate rotation detected, shutting down client connections to start using new credentials" Jul 13 02:56:58.862442 ip-10-0-134-52 kubenswrapper[2558]: I0713 02:56:58.862409 2558 reflector.go:571] "Warning: watch ended with error" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.RuntimeClass" err="very short watch: k8s.io/client-go/informers/factory.go:160: Unexpected watch close - watch lasted less than a second and no items received" Jul 13 02:56:58.948652 ip-10-0-134-52 kubenswrapper[2558]: E0713 02:56:58.948628 2558 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-134-52.ec2.internal\" not found" Jul 13 02:56:58.977513 ip-10-0-134-52 kubenswrapper[2558]: I0713 02:56:58.977478 2558 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kube-apiserver-client-kubelet" expiration="2028-07-12 02:51:58 +0000 UTC" deadline="2028-02-06 00:53:14.554114762 +0000 UTC" Jul 13 02:56:58.977513 ip-10-0-134-52 kubenswrapper[2558]: I0713 02:56:58.977510 2558 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kube-apiserver-client-kubelet" sleep="13749h56m15.576610866s" Jul 13 02:56:59.049130 ip-10-0-134-52 kubenswrapper[2558]: E0713 02:56:59.049073 2558 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-134-52.ec2.internal\" not found" Jul 13 02:56:59.079579 ip-10-0-134-52 kubenswrapper[2558]: W0713 02:56:59.079548 2558 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod98adcf0180580c6711a29c73caa90e67.slice/crio-94bdb0a6d526705607af6c6f71fee00bd366b896f397ee662447951d804145a4 WatchSource:0}: Error finding container 94bdb0a6d526705607af6c6f71fee00bd366b896f397ee662447951d804145a4: Status 404 returned error can't find the container with id 94bdb0a6d526705607af6c6f71fee00bd366b896f397ee662447951d804145a4 Jul 13 02:56:59.087915 ip-10-0-134-52 kubenswrapper[2558]: I0713 02:56:59.087893 2558 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider Jul 13 02:56:59.092116 ip-10-0-134-52 kubenswrapper[2558]: I0713 02:56:59.092069 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-134-52.ec2.internal" event={"ID":"98adcf0180580c6711a29c73caa90e67","Type":"ContainerStarted","Data":"94bdb0a6d526705607af6c6f71fee00bd366b896f397ee662447951d804145a4"} Jul 13 02:56:59.095942 ip-10-0-134-52 kubenswrapper[2558]: W0713 02:56:59.095917 2558 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podc2b195f03ef2d8abb371e44a8b3b8700.slice/crio-b7c72cec35f104683bab66d76b9038eb8e1f960bc2f0e2fce13a875cbc20ba1f WatchSource:0}: Error finding container b7c72cec35f104683bab66d76b9038eb8e1f960bc2f0e2fce13a875cbc20ba1f: Status 404 returned error can't find the container with id b7c72cec35f104683bab66d76b9038eb8e1f960bc2f0e2fce13a875cbc20ba1f Jul 13 02:56:59.111176 ip-10-0-134-52 kubenswrapper[2558]: I0713 02:56:59.111151 2558 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jul 13 02:56:59.112428 ip-10-0-134-52 kubenswrapper[2558]: I0713 02:56:59.112398 2558 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-134-52.ec2.internal" event="NodeHasSufficientMemory" Jul 13 02:56:59.112428 ip-10-0-134-52 kubenswrapper[2558]: I0713 02:56:59.112426 2558 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-134-52.ec2.internal" event="NodeHasNoDiskPressure" Jul 13 02:56:59.112545 ip-10-0-134-52 kubenswrapper[2558]: I0713 02:56:59.112444 2558 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-134-52.ec2.internal" event="NodeHasSufficientPID" Jul 13 02:56:59.149223 ip-10-0-134-52 kubenswrapper[2558]: E0713 02:56:59.149198 2558 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-134-52.ec2.internal\" not found" Jul 13 02:56:59.250481 ip-10-0-134-52 kubenswrapper[2558]: E0713 02:56:59.250454 2558 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-134-52.ec2.internal\" not found" Jul 13 02:56:59.290617 ip-10-0-134-52 kubenswrapper[2558]: I0713 02:56:59.290595 2558 reflector.go:439] "Caches populated" type="*v1.Service" reflector="k8s.io/client-go/informers/factory.go:160" Jul 13 02:56:59.346638 ip-10-0-134-52 kubenswrapper[2558]: I0713 02:56:59.346579 2558 reflector.go:439] "Caches populated" type="*v1.Node" reflector="k8s.io/client-go/informers/factory.go:160" Jul 13 02:56:59.417429 ip-10-0-134-52 kubenswrapper[2558]: I0713 02:56:59.417403 2558 kubelet.go:3248] "Creating a mirror pod for static pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-134-52.ec2.internal" Jul 13 02:56:59.434100 ip-10-0-134-52 kubenswrapper[2558]: I0713 02:56:59.434078 2558 warnings.go:110] "Warning: metadata.name: this is used in the Pod's hostname, which can result in surprising behavior; a DNS label is recommended: [must not contain dots]" Jul 13 02:56:59.435072 ip-10-0-134-52 kubenswrapper[2558]: I0713 02:56:59.435059 2558 kubelet.go:3248] "Creating a mirror pod for static pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-134-52.ec2.internal" Jul 13 02:56:59.444793 ip-10-0-134-52 kubenswrapper[2558]: I0713 02:56:59.444771 2558 warnings.go:110] "Warning: metadata.name: this is used in the Pod's hostname, which can result in surprising behavior; a DNS label is recommended: [must not contain dots]" Jul 13 02:56:59.482880 ip-10-0-134-52 kubenswrapper[2558]: I0713 02:56:59.482861 2558 reflector.go:439] "Caches populated" type="*v1.CSIDriver" reflector="k8s.io/client-go/informers/factory.go:160" Jul 13 02:56:59.900065 ip-10-0-134-52 kubenswrapper[2558]: I0713 02:56:59.900028 2558 apiserver.go:52] "Watching apiserver" Jul 13 02:56:59.910228 ip-10-0-134-52 kubenswrapper[2558]: I0713 02:56:59.910039 2558 reflector.go:439] "Caches populated" type="*v1.Pod" reflector="pkg/kubelet/config/apiserver.go:66" Jul 13 02:56:59.911556 ip-10-0-134-52 kubenswrapper[2558]: I0713 02:56:59.911528 2558 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kube-system/kube-apiserver-proxy-ip-10-0-134-52.ec2.internal","openshift-cluster-node-tuning-operator/tuned-z7fz9","openshift-dns/node-resolver-ndddr","openshift-image-registry/node-ca-wpn4b","openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-134-52.ec2.internal","openshift-multus/multus-dvqmz","openshift-multus/network-metrics-daemon-jt47w","openshift-network-diagnostics/network-check-target-fdbpv","kube-system/global-pull-secret-syncer-hf6cl","kube-system/konnectivity-agent-pf2f6","openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-bxvd8","openshift-multus/multus-additional-cni-plugins-scthx","openshift-network-operator/iptables-alerter-px6ng","openshift-ovn-kubernetes/ovnkube-node-7m9bp"] Jul 13 02:56:59.914460 ip-10-0-134-52 kubenswrapper[2558]: I0713 02:56:59.914437 2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-dvqmz" Jul 13 02:56:59.916954 ip-10-0-134-52 kubenswrapper[2558]: I0713 02:56:59.916932 2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-node-tuning-operator/tuned-z7fz9" Jul 13 02:56:59.917586 ip-10-0-134-52 kubenswrapper[2558]: I0713 02:56:59.917568 2558 certificate_manager.go:566] "Rotating certificates" logger="kubernetes.io/kubelet-serving" Jul 13 02:56:59.919454 ip-10-0-134-52 kubenswrapper[2558]: I0713 02:56:59.919428 2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-additional-cni-plugins-scthx" Jul 13 02:56:59.921855 ip-10-0-134-52 kubenswrapper[2558]: I0713 02:56:59.921835 2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/node-ca-wpn4b" Jul 13 02:56:59.923495 ip-10-0-134-52 kubenswrapper[2558]: I0713 02:56:59.923474 2558 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"cni-copy-resources\"" Jul 13 02:56:59.923920 ip-10-0-134-52 kubenswrapper[2558]: I0713 02:56:59.923895 2558 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"kube-root-ca.crt\"" Jul 13 02:56:59.924209 ip-10-0-134-52 kubenswrapper[2558]: I0713 02:56:59.924189 2558 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"openshift-service-ca.crt\"" Jul 13 02:56:59.924479 ip-10-0-134-52 kubenswrapper[2558]: I0713 02:56:59.924451 2558 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"default-cni-sysctl-allowlist\"" Jul 13 02:56:59.924682 ip-10-0-134-52 kubenswrapper[2558]: I0713 02:56:59.924667 2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-bxvd8" Jul 13 02:56:59.927641 ip-10-0-134-52 kubenswrapper[2558]: I0713 02:56:59.927616 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/e81648db-3aac-4493-99c2-af21b4fcf2b5-cni-binary-copy\") pod \"multus-dvqmz\" (UID: \"e81648db-3aac-4493-99c2-af21b4fcf2b5\") " pod="openshift-multus/multus-dvqmz" Jul 13 02:56:59.927746 ip-10-0-134-52 kubenswrapper[2558]: I0713 02:56:59.927655 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/e81648db-3aac-4493-99c2-af21b4fcf2b5-multus-conf-dir\") pod \"multus-dvqmz\" (UID: \"e81648db-3aac-4493-99c2-af21b4fcf2b5\") " pod="openshift-multus/multus-dvqmz" Jul 13 02:56:59.927746 ip-10-0-134-52 kubenswrapper[2558]: I0713 02:56:59.927684 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/93624b2e-1256-406d-892b-456a2b2cd0db-etc-sysconfig\") pod \"tuned-z7fz9\" (UID: \"93624b2e-1256-406d-892b-456a2b2cd0db\") " pod="openshift-cluster-node-tuning-operator/tuned-z7fz9" Jul 13 02:56:59.927746 ip-10-0-134-52 kubenswrapper[2558]: I0713 02:56:59.927709 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/93624b2e-1256-406d-892b-456a2b2cd0db-etc-systemd\") pod \"tuned-z7fz9\" (UID: \"93624b2e-1256-406d-892b-456a2b2cd0db\") " pod="openshift-cluster-node-tuning-operator/tuned-z7fz9" Jul 13 02:56:59.927746 ip-10-0-134-52 kubenswrapper[2558]: I0713 02:56:59.927734 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/93624b2e-1256-406d-892b-456a2b2cd0db-etc-kubernetes\") pod \"tuned-z7fz9\" (UID: \"93624b2e-1256-406d-892b-456a2b2cd0db\") " pod="openshift-cluster-node-tuning-operator/tuned-z7fz9" Jul 13 02:56:59.927961 ip-10-0-134-52 kubenswrapper[2558]: I0713 02:56:59.927759 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/16e70418-d340-4604-b23d-6e6bd736b72f-cnibin\") pod \"multus-additional-cni-plugins-scthx\" (UID: \"16e70418-d340-4604-b23d-6e6bd736b72f\") " pod="openshift-multus/multus-additional-cni-plugins-scthx" Jul 13 02:56:59.927961 ip-10-0-134-52 kubenswrapper[2558]: I0713 02:56:59.927786 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/e81648db-3aac-4493-99c2-af21b4fcf2b5-hostroot\") pod \"multus-dvqmz\" (UID: \"e81648db-3aac-4493-99c2-af21b4fcf2b5\") " pod="openshift-multus/multus-dvqmz" Jul 13 02:56:59.927961 ip-10-0-134-52 kubenswrapper[2558]: I0713 02:56:59.927810 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-2jchk\" (UniqueName: \"kubernetes.io/projected/e81648db-3aac-4493-99c2-af21b4fcf2b5-kube-api-access-2jchk\") pod \"multus-dvqmz\" (UID: \"e81648db-3aac-4493-99c2-af21b4fcf2b5\") " pod="openshift-multus/multus-dvqmz" Jul 13 02:56:59.927961 ip-10-0-134-52 kubenswrapper[2558]: I0713 02:56:59.927837 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/93624b2e-1256-406d-892b-456a2b2cd0db-etc-modprobe-d\") pod \"tuned-z7fz9\" (UID: \"93624b2e-1256-406d-892b-456a2b2cd0db\") " pod="openshift-cluster-node-tuning-operator/tuned-z7fz9" Jul 13 02:56:59.927961 ip-10-0-134-52 kubenswrapper[2558]: I0713 02:56:59.927861 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/93624b2e-1256-406d-892b-456a2b2cd0db-etc-sysctl-d\") pod \"tuned-z7fz9\" (UID: \"93624b2e-1256-406d-892b-456a2b2cd0db\") " pod="openshift-cluster-node-tuning-operator/tuned-z7fz9" Jul 13 02:56:59.927961 ip-10-0-134-52 kubenswrapper[2558]: I0713 02:56:59.927885 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/e81648db-3aac-4493-99c2-af21b4fcf2b5-host-run-k8s-cni-cncf-io\") pod \"multus-dvqmz\" (UID: \"e81648db-3aac-4493-99c2-af21b4fcf2b5\") " pod="openshift-multus/multus-dvqmz" Jul 13 02:56:59.927961 ip-10-0-134-52 kubenswrapper[2558]: I0713 02:56:59.927910 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/e81648db-3aac-4493-99c2-af21b4fcf2b5-host-run-netns\") pod \"multus-dvqmz\" (UID: \"e81648db-3aac-4493-99c2-af21b4fcf2b5\") " pod="openshift-multus/multus-dvqmz" Jul 13 02:56:59.927961 ip-10-0-134-52 kubenswrapper[2558]: I0713 02:56:59.927932 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/93624b2e-1256-406d-892b-456a2b2cd0db-sys\") pod \"tuned-z7fz9\" (UID: \"93624b2e-1256-406d-892b-456a2b2cd0db\") " pod="openshift-cluster-node-tuning-operator/tuned-z7fz9" Jul 13 02:56:59.927961 ip-10-0-134-52 kubenswrapper[2558]: I0713 02:56:59.927955 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/93624b2e-1256-406d-892b-456a2b2cd0db-host\") pod \"tuned-z7fz9\" (UID: \"93624b2e-1256-406d-892b-456a2b2cd0db\") " pod="openshift-cluster-node-tuning-operator/tuned-z7fz9" Jul 13 02:56:59.928391 ip-10-0-134-52 kubenswrapper[2558]: I0713 02:56:59.927979 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/16e70418-d340-4604-b23d-6e6bd736b72f-os-release\") pod \"multus-additional-cni-plugins-scthx\" (UID: \"16e70418-d340-4604-b23d-6e6bd736b72f\") " pod="openshift-multus/multus-additional-cni-plugins-scthx" Jul 13 02:56:59.928391 ip-10-0-134-52 kubenswrapper[2558]: I0713 02:56:59.928002 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/e81648db-3aac-4493-99c2-af21b4fcf2b5-host-var-lib-kubelet\") pod \"multus-dvqmz\" (UID: \"e81648db-3aac-4493-99c2-af21b4fcf2b5\") " pod="openshift-multus/multus-dvqmz" Jul 13 02:56:59.928391 ip-10-0-134-52 kubenswrapper[2558]: I0713 02:56:59.928025 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/e81648db-3aac-4493-99c2-af21b4fcf2b5-etc-kubernetes\") pod \"multus-dvqmz\" (UID: \"e81648db-3aac-4493-99c2-af21b4fcf2b5\") " pod="openshift-multus/multus-dvqmz" Jul 13 02:56:59.928391 ip-10-0-134-52 kubenswrapper[2558]: I0713 02:56:59.928053 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/e81648db-3aac-4493-99c2-af21b4fcf2b5-os-release\") pod \"multus-dvqmz\" (UID: \"e81648db-3aac-4493-99c2-af21b4fcf2b5\") " pod="openshift-multus/multus-dvqmz" Jul 13 02:56:59.928391 ip-10-0-134-52 kubenswrapper[2558]: I0713 02:56:59.928079 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/e81648db-3aac-4493-99c2-af21b4fcf2b5-multus-socket-dir-parent\") pod \"multus-dvqmz\" (UID: \"e81648db-3aac-4493-99c2-af21b4fcf2b5\") " pod="openshift-multus/multus-dvqmz" Jul 13 02:56:59.928391 ip-10-0-134-52 kubenswrapper[2558]: I0713 02:56:59.928103 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/e81648db-3aac-4493-99c2-af21b4fcf2b5-host-var-lib-cni-bin\") pod \"multus-dvqmz\" (UID: \"e81648db-3aac-4493-99c2-af21b4fcf2b5\") " pod="openshift-multus/multus-dvqmz" Jul 13 02:56:59.928391 ip-10-0-134-52 kubenswrapper[2558]: I0713 02:56:59.928129 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/e81648db-3aac-4493-99c2-af21b4fcf2b5-host-run-multus-certs\") pod \"multus-dvqmz\" (UID: \"e81648db-3aac-4493-99c2-af21b4fcf2b5\") " pod="openshift-multus/multus-dvqmz" Jul 13 02:56:59.928391 ip-10-0-134-52 kubenswrapper[2558]: I0713 02:56:59.928153 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/93624b2e-1256-406d-892b-456a2b2cd0db-etc-tuned\") pod \"tuned-z7fz9\" (UID: \"93624b2e-1256-406d-892b-456a2b2cd0db\") " pod="openshift-cluster-node-tuning-operator/tuned-z7fz9" Jul 13 02:56:59.928391 ip-10-0-134-52 kubenswrapper[2558]: I0713 02:56:59.928177 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/16e70418-d340-4604-b23d-6e6bd736b72f-cni-binary-copy\") pod \"multus-additional-cni-plugins-scthx\" (UID: \"16e70418-d340-4604-b23d-6e6bd736b72f\") " pod="openshift-multus/multus-additional-cni-plugins-scthx" Jul 13 02:56:59.928391 ip-10-0-134-52 kubenswrapper[2558]: I0713 02:56:59.928208 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-kg2w8\" (UniqueName: \"kubernetes.io/projected/16e70418-d340-4604-b23d-6e6bd736b72f-kube-api-access-kg2w8\") pod \"multus-additional-cni-plugins-scthx\" (UID: \"16e70418-d340-4604-b23d-6e6bd736b72f\") " pod="openshift-multus/multus-additional-cni-plugins-scthx" Jul 13 02:56:59.928391 ip-10-0-134-52 kubenswrapper[2558]: I0713 02:56:59.928243 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/e81648db-3aac-4493-99c2-af21b4fcf2b5-multus-daemon-config\") pod \"multus-dvqmz\" (UID: \"e81648db-3aac-4493-99c2-af21b4fcf2b5\") " pod="openshift-multus/multus-dvqmz" Jul 13 02:56:59.928391 ip-10-0-134-52 kubenswrapper[2558]: I0713 02:56:59.928267 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/93624b2e-1256-406d-892b-456a2b2cd0db-etc-sysctl-conf\") pod \"tuned-z7fz9\" (UID: \"93624b2e-1256-406d-892b-456a2b2cd0db\") " pod="openshift-cluster-node-tuning-operator/tuned-z7fz9" Jul 13 02:56:59.928391 ip-10-0-134-52 kubenswrapper[2558]: I0713 02:56:59.928291 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/93624b2e-1256-406d-892b-456a2b2cd0db-var-lib-kubelet\") pod \"tuned-z7fz9\" (UID: \"93624b2e-1256-406d-892b-456a2b2cd0db\") " pod="openshift-cluster-node-tuning-operator/tuned-z7fz9" Jul 13 02:56:59.928391 ip-10-0-134-52 kubenswrapper[2558]: I0713 02:56:59.928316 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/16e70418-d340-4604-b23d-6e6bd736b72f-tuning-conf-dir\") pod \"multus-additional-cni-plugins-scthx\" (UID: \"16e70418-d340-4604-b23d-6e6bd736b72f\") " pod="openshift-multus/multus-additional-cni-plugins-scthx" Jul 13 02:56:59.928391 ip-10-0-134-52 kubenswrapper[2558]: I0713 02:56:59.928343 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/16e70418-d340-4604-b23d-6e6bd736b72f-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-scthx\" (UID: \"16e70418-d340-4604-b23d-6e6bd736b72f\") " pod="openshift-multus/multus-additional-cni-plugins-scthx" Jul 13 02:56:59.928391 ip-10-0-134-52 kubenswrapper[2558]: I0713 02:56:59.928369 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/16e70418-d340-4604-b23d-6e6bd736b72f-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-scthx\" (UID: \"16e70418-d340-4604-b23d-6e6bd736b72f\") " pod="openshift-multus/multus-additional-cni-plugins-scthx" Jul 13 02:56:59.929284 ip-10-0-134-52 kubenswrapper[2558]: I0713 02:56:59.928393 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/e81648db-3aac-4493-99c2-af21b4fcf2b5-cnibin\") pod \"multus-dvqmz\" (UID: \"e81648db-3aac-4493-99c2-af21b4fcf2b5\") " pod="openshift-multus/multus-dvqmz" Jul 13 02:56:59.929284 ip-10-0-134-52 kubenswrapper[2558]: I0713 02:56:59.928442 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/e81648db-3aac-4493-99c2-af21b4fcf2b5-host-var-lib-cni-multus\") pod \"multus-dvqmz\" (UID: \"e81648db-3aac-4493-99c2-af21b4fcf2b5\") " pod="openshift-multus/multus-dvqmz" Jul 13 02:56:59.929284 ip-10-0-134-52 kubenswrapper[2558]: I0713 02:56:59.928466 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run\" (UniqueName: \"kubernetes.io/host-path/93624b2e-1256-406d-892b-456a2b2cd0db-run\") pod \"tuned-z7fz9\" (UID: \"93624b2e-1256-406d-892b-456a2b2cd0db\") " pod="openshift-cluster-node-tuning-operator/tuned-z7fz9" Jul 13 02:56:59.929284 ip-10-0-134-52 kubenswrapper[2558]: I0713 02:56:59.928490 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/93624b2e-1256-406d-892b-456a2b2cd0db-lib-modules\") pod \"tuned-z7fz9\" (UID: \"93624b2e-1256-406d-892b-456a2b2cd0db\") " pod="openshift-cluster-node-tuning-operator/tuned-z7fz9" Jul 13 02:56:59.929284 ip-10-0-134-52 kubenswrapper[2558]: I0713 02:56:59.928516 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/93624b2e-1256-406d-892b-456a2b2cd0db-tmp\") pod \"tuned-z7fz9\" (UID: \"93624b2e-1256-406d-892b-456a2b2cd0db\") " pod="openshift-cluster-node-tuning-operator/tuned-z7fz9" Jul 13 02:56:59.929284 ip-10-0-134-52 kubenswrapper[2558]: I0713 02:56:59.928540 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-nr2r6\" (UniqueName: \"kubernetes.io/projected/93624b2e-1256-406d-892b-456a2b2cd0db-kube-api-access-nr2r6\") pod \"tuned-z7fz9\" (UID: \"93624b2e-1256-406d-892b-456a2b2cd0db\") " pod="openshift-cluster-node-tuning-operator/tuned-z7fz9" Jul 13 02:56:59.929284 ip-10-0-134-52 kubenswrapper[2558]: I0713 02:56:59.928569 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/16e70418-d340-4604-b23d-6e6bd736b72f-system-cni-dir\") pod \"multus-additional-cni-plugins-scthx\" (UID: \"16e70418-d340-4604-b23d-6e6bd736b72f\") " pod="openshift-multus/multus-additional-cni-plugins-scthx" Jul 13 02:56:59.929284 ip-10-0-134-52 kubenswrapper[2558]: I0713 02:56:59.928601 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/e81648db-3aac-4493-99c2-af21b4fcf2b5-system-cni-dir\") pod \"multus-dvqmz\" (UID: \"e81648db-3aac-4493-99c2-af21b4fcf2b5\") " pod="openshift-multus/multus-dvqmz" Jul 13 02:56:59.929284 ip-10-0-134-52 kubenswrapper[2558]: I0713 02:56:59.928628 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/e81648db-3aac-4493-99c2-af21b4fcf2b5-multus-cni-dir\") pod \"multus-dvqmz\" (UID: \"e81648db-3aac-4493-99c2-af21b4fcf2b5\") " pod="openshift-multus/multus-dvqmz" Jul 13 02:56:59.929284 ip-10-0-134-52 kubenswrapper[2558]: I0713 02:56:59.929060 2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-jt47w" Jul 13 02:56:59.929284 ip-10-0-134-52 kubenswrapper[2558]: E0713 02:56:59.929136 2558 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-jt47w" podUID="72ebddc5-a4ff-4e56-a65d-508775d02170" Jul 13 02:56:59.930916 ip-10-0-134-52 kubenswrapper[2558]: I0713 02:56:59.930897 2558 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"whereabouts-flatfile-config\"" Jul 13 02:56:59.931262 ip-10-0-134-52 kubenswrapper[2558]: I0713 02:56:59.931246 2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"default-dockercfg-qkqbj\"" Jul 13 02:56:59.931514 ip-10-0-134-52 kubenswrapper[2558]: I0713 02:56:59.931498 2558 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"openshift-service-ca.crt\"" Jul 13 02:56:59.931701 ip-10-0-134-52 kubenswrapper[2558]: I0713 02:56:59.931684 2558 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"multus-daemon-config\"" Jul 13 02:56:59.932012 ip-10-0-134-52 kubenswrapper[2558]: I0713 02:56:59.931996 2558 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"kube-root-ca.crt\"" Jul 13 02:56:59.932706 ip-10-0-134-52 kubenswrapper[2558]: I0713 02:56:59.932241 2558 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"openshift-service-ca.crt\"" Jul 13 02:56:59.932706 ip-10-0-134-52 kubenswrapper[2558]: I0713 02:56:59.932505 2558 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"image-registry-certificates\"" Jul 13 02:56:59.932862 ip-10-0-134-52 kubenswrapper[2558]: I0713 02:56:59.932749 2558 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"kube-root-ca.crt\"" Jul 13 02:56:59.932972 ip-10-0-134-52 kubenswrapper[2558]: I0713 02:56:59.932954 2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"tuned-dockercfg-v2j4p\"" Jul 13 02:56:59.933204 ip-10-0-134-52 kubenswrapper[2558]: I0713 02:56:59.933187 2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"node-ca-dockercfg-bqzp9\"" Jul 13 02:56:59.933467 ip-10-0-134-52 kubenswrapper[2558]: I0713 02:56:59.933435 2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"multus-ancillary-tools-dockercfg-4zdpb\"" Jul 13 02:56:59.935490 ip-10-0-134-52 kubenswrapper[2558]: I0713 02:56:59.933944 2558 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-csi-drivers\"/\"openshift-service-ca.crt\"" Jul 13 02:56:59.935490 ip-10-0-134-52 kubenswrapper[2558]: I0713 02:56:59.935095 2558 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-csi-drivers\"/\"kube-root-ca.crt\"" Jul 13 02:56:59.935635 ip-10-0-134-52 kubenswrapper[2558]: I0713 02:56:59.935609 2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-csi-drivers\"/\"aws-ebs-csi-driver-node-metrics-serving-cert\"" Jul 13 02:56:59.935864 ip-10-0-134-52 kubenswrapper[2558]: I0713 02:56:59.935833 2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-csi-drivers\"/\"aws-ebs-csi-driver-node-sa-dockercfg-llz4s\"" Jul 13 02:56:59.936164 ip-10-0-134-52 kubenswrapper[2558]: I0713 02:56:59.936143 2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-fdbpv" Jul 13 02:56:59.936240 ip-10-0-134-52 kubenswrapper[2558]: E0713 02:56:59.936208 2558 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-fdbpv" podUID="17234e1a-e139-4f9e-88fd-c679510cd0fb" Jul 13 02:56:59.936479 ip-10-0-134-52 kubenswrapper[2558]: I0713 02:56:59.936455 2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-hf6cl" Jul 13 02:56:59.936569 ip-10-0-134-52 kubenswrapper[2558]: E0713 02:56:59.936513 2558 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-hf6cl" podUID="5b3dc970-19d3-43e8-9a7b-4062feb75c3e" Jul 13 02:56:59.937317 ip-10-0-134-52 kubenswrapper[2558]: I0713 02:56:59.937257 2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/konnectivity-agent-pf2f6" Jul 13 02:56:59.939579 ip-10-0-134-52 kubenswrapper[2558]: I0713 02:56:59.939561 2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/node-resolver-ndddr" Jul 13 02:56:59.940837 ip-10-0-134-52 kubenswrapper[2558]: I0713 02:56:59.940820 2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"default-dockercfg-fx2tx\"" Jul 13 02:56:59.941030 ip-10-0-134-52 kubenswrapper[2558]: I0713 02:56:59.941010 2558 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kube-system\"/\"konnectivity-ca-bundle\"" Jul 13 02:56:59.941249 ip-10-0-134-52 kubenswrapper[2558]: I0713 02:56:59.941234 2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"konnectivity-agent\"" Jul 13 02:56:59.942288 ip-10-0-134-52 kubenswrapper[2558]: I0713 02:56:59.942272 2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-operator/iptables-alerter-px6ng" Jul 13 02:56:59.942825 ip-10-0-134-52 kubenswrapper[2558]: I0713 02:56:59.942809 2558 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"kube-root-ca.crt\"" Jul 13 02:56:59.943496 ip-10-0-134-52 kubenswrapper[2558]: I0713 02:56:59.943440 2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"node-resolver-dockercfg-kjln6\"" Jul 13 02:56:59.943618 ip-10-0-134-52 kubenswrapper[2558]: I0713 02:56:59.943556 2558 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"openshift-service-ca.crt\"" Jul 13 02:56:59.944998 ip-10-0-134-52 kubenswrapper[2558]: I0713 02:56:59.944971 2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ovn-kubernetes/ovnkube-node-7m9bp" Jul 13 02:56:59.950773 ip-10-0-134-52 kubenswrapper[2558]: I0713 02:56:59.950751 2558 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"openshift-service-ca.crt\"" Jul 13 02:56:59.953270 ip-10-0-134-52 kubenswrapper[2558]: I0713 02:56:59.952173 2558 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"openshift-service-ca.crt\"" Jul 13 02:56:59.953270 ip-10-0-134-52 kubenswrapper[2558]: I0713 02:56:59.952687 2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ovn-kubernetes\"/\"ovn-kubernetes-node-dockercfg-fgtkk\"" Jul 13 02:56:59.953270 ip-10-0-134-52 kubenswrapper[2558]: I0713 02:56:59.952798 2558 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"kube-root-ca.crt\"" Jul 13 02:56:59.953270 ip-10-0-134-52 kubenswrapper[2558]: I0713 02:56:59.952915 2558 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"kube-root-ca.crt\"" Jul 13 02:56:59.953270 ip-10-0-134-52 kubenswrapper[2558]: I0713 02:56:59.953089 2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-operator\"/\"iptables-alerter-dockercfg-xn85p\"" Jul 13 02:56:59.953270 ip-10-0-134-52 kubenswrapper[2558]: I0713 02:56:59.953157 2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ovn-kubernetes\"/\"ovn-node-metrics-cert\"" Jul 13 02:56:59.953646 ip-10-0-134-52 kubenswrapper[2558]: I0713 02:56:59.953334 2558 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"ovnkube-config\"" Jul 13 02:56:59.953646 ip-10-0-134-52 kubenswrapper[2558]: I0713 02:56:59.953425 2558 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"ovnkube-script-lib\"" Jul 13 02:56:59.953646 ip-10-0-134-52 kubenswrapper[2558]: I0713 02:56:59.953600 2558 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"iptables-alerter-script\"" Jul 13 02:56:59.953801 ip-10-0-134-52 kubenswrapper[2558]: I0713 02:56:59.953712 2558 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"env-overrides\"" Jul 13 02:56:59.966966 ip-10-0-134-52 kubenswrapper[2558]: I0713 02:56:59.966715 2558 reflector.go:439] "Caches populated" logger="kubernetes.io/kubelet-serving" type="*v1.CertificateSigningRequest" reflector="k8s.io/client-go/tools/watch/informerwatcher.go:162" Jul 13 02:57:00.018755 ip-10-0-134-52 kubenswrapper[2558]: I0713 02:57:00.018732 2558 desired_state_of_world_populator.go:154] "Finished populating initial desired state of world" Jul 13 02:57:00.025173 ip-10-0-134-52 kubenswrapper[2558]: I0713 02:57:00.025151 2558 csr.go:274] "Certificate signing request is approved, waiting to be issued" logger="kubernetes.io/kubelet-serving" csr="csr-56psh" Jul 13 02:57:00.028825 ip-10-0-134-52 kubenswrapper[2558]: I0713 02:57:00.028785 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/fc1d702b-774e-4b93-a862-8ada20c10ce4-kubelet-dir\") pod \"aws-ebs-csi-driver-node-bxvd8\" (UID: \"fc1d702b-774e-4b93-a862-8ada20c10ce4\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-bxvd8" Jul 13 02:57:00.028924 ip-10-0-134-52 kubenswrapper[2558]: I0713 02:57:00.028836 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/e81648db-3aac-4493-99c2-af21b4fcf2b5-os-release\") pod \"multus-dvqmz\" (UID: \"e81648db-3aac-4493-99c2-af21b4fcf2b5\") " pod="openshift-multus/multus-dvqmz" Jul 13 02:57:00.028924 ip-10-0-134-52 kubenswrapper[2558]: I0713 02:57:00.028867 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/e81648db-3aac-4493-99c2-af21b4fcf2b5-multus-socket-dir-parent\") pod \"multus-dvqmz\" (UID: \"e81648db-3aac-4493-99c2-af21b4fcf2b5\") " pod="openshift-multus/multus-dvqmz" Jul 13 02:57:00.028924 ip-10-0-134-52 kubenswrapper[2558]: I0713 02:57:00.028897 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/e81648db-3aac-4493-99c2-af21b4fcf2b5-host-var-lib-cni-bin\") pod \"multus-dvqmz\" (UID: \"e81648db-3aac-4493-99c2-af21b4fcf2b5\") " pod="openshift-multus/multus-dvqmz" Jul 13 02:57:00.029067 ip-10-0-134-52 kubenswrapper[2558]: I0713 02:57:00.028926 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/e81648db-3aac-4493-99c2-af21b4fcf2b5-host-run-multus-certs\") pod \"multus-dvqmz\" (UID: \"e81648db-3aac-4493-99c2-af21b4fcf2b5\") " pod="openshift-multus/multus-dvqmz" Jul 13 02:57:00.029067 ip-10-0-134-52 kubenswrapper[2558]: I0713 02:57:00.028940 2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/e81648db-3aac-4493-99c2-af21b4fcf2b5-os-release\") pod \"multus-dvqmz\" (UID: \"e81648db-3aac-4493-99c2-af21b4fcf2b5\") " pod="openshift-multus/multus-dvqmz" Jul 13 02:57:00.029067 ip-10-0-134-52 kubenswrapper[2558]: I0713 02:57:00.028967 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/16e70418-d340-4604-b23d-6e6bd736b72f-cni-binary-copy\") pod \"multus-additional-cni-plugins-scthx\" (UID: \"16e70418-d340-4604-b23d-6e6bd736b72f\") " pod="openshift-multus/multus-additional-cni-plugins-scthx" Jul 13 02:57:00.029067 ip-10-0-134-52 kubenswrapper[2558]: I0713 02:57:00.028991 2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/e81648db-3aac-4493-99c2-af21b4fcf2b5-host-var-lib-cni-bin\") pod \"multus-dvqmz\" (UID: \"e81648db-3aac-4493-99c2-af21b4fcf2b5\") " pod="openshift-multus/multus-dvqmz" Jul 13 02:57:00.029067 ip-10-0-134-52 kubenswrapper[2558]: I0713 02:57:00.028995 2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/e81648db-3aac-4493-99c2-af21b4fcf2b5-host-run-multus-certs\") pod \"multus-dvqmz\" (UID: \"e81648db-3aac-4493-99c2-af21b4fcf2b5\") " pod="openshift-multus/multus-dvqmz" Jul 13 02:57:00.029067 ip-10-0-134-52 kubenswrapper[2558]: I0713 02:57:00.028995 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-kg2w8\" (UniqueName: \"kubernetes.io/projected/16e70418-d340-4604-b23d-6e6bd736b72f-kube-api-access-kg2w8\") pod \"multus-additional-cni-plugins-scthx\" (UID: \"16e70418-d340-4604-b23d-6e6bd736b72f\") " pod="openshift-multus/multus-additional-cni-plugins-scthx" Jul 13 02:57:00.029067 ip-10-0-134-52 kubenswrapper[2558]: I0713 02:57:00.028993 2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/e81648db-3aac-4493-99c2-af21b4fcf2b5-multus-socket-dir-parent\") pod \"multus-dvqmz\" (UID: \"e81648db-3aac-4493-99c2-af21b4fcf2b5\") " pod="openshift-multus/multus-dvqmz" Jul 13 02:57:00.029308 ip-10-0-134-52 kubenswrapper[2558]: I0713 02:57:00.029139 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-lf99x\" (UniqueName: \"kubernetes.io/projected/e4bb1d1b-35fa-47b2-af3d-ec01bff3f7c0-kube-api-access-lf99x\") pod \"node-ca-wpn4b\" (UID: \"e4bb1d1b-35fa-47b2-af3d-ec01bff3f7c0\") " pod="openshift-image-registry/node-ca-wpn4b" Jul 13 02:57:00.029308 ip-10-0-134-52 kubenswrapper[2558]: I0713 02:57:00.029176 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/16e70418-d340-4604-b23d-6e6bd736b72f-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-scthx\" (UID: \"16e70418-d340-4604-b23d-6e6bd736b72f\") " pod="openshift-multus/multus-additional-cni-plugins-scthx" Jul 13 02:57:00.029308 ip-10-0-134-52 kubenswrapper[2558]: I0713 02:57:00.029209 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/16e70418-d340-4604-b23d-6e6bd736b72f-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-scthx\" (UID: \"16e70418-d340-4604-b23d-6e6bd736b72f\") " pod="openshift-multus/multus-additional-cni-plugins-scthx" Jul 13 02:57:00.029308 ip-10-0-134-52 kubenswrapper[2558]: I0713 02:57:00.029237 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/d7c10797-d1f7-4e82-bd2b-f81f851f1407-host-kubelet\") pod \"ovnkube-node-7m9bp\" (UID: \"d7c10797-d1f7-4e82-bd2b-f81f851f1407\") " pod="openshift-ovn-kubernetes/ovnkube-node-7m9bp" Jul 13 02:57:00.029308 ip-10-0-134-52 kubenswrapper[2558]: I0713 02:57:00.029266 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-zq5pf\" (UniqueName: \"kubernetes.io/projected/d7c10797-d1f7-4e82-bd2b-f81f851f1407-kube-api-access-zq5pf\") pod \"ovnkube-node-7m9bp\" (UID: \"d7c10797-d1f7-4e82-bd2b-f81f851f1407\") " pod="openshift-ovn-kubernetes/ovnkube-node-7m9bp" Jul 13 02:57:00.029308 ip-10-0-134-52 kubenswrapper[2558]: I0713 02:57:00.029292 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/93624b2e-1256-406d-892b-456a2b2cd0db-lib-modules\") pod \"tuned-z7fz9\" (UID: \"93624b2e-1256-406d-892b-456a2b2cd0db\") " pod="openshift-cluster-node-tuning-operator/tuned-z7fz9" Jul 13 02:57:00.029709 ip-10-0-134-52 kubenswrapper[2558]: I0713 02:57:00.029316 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/93624b2e-1256-406d-892b-456a2b2cd0db-tmp\") pod \"tuned-z7fz9\" (UID: \"93624b2e-1256-406d-892b-456a2b2cd0db\") " pod="openshift-cluster-node-tuning-operator/tuned-z7fz9" Jul 13 02:57:00.029709 ip-10-0-134-52 kubenswrapper[2558]: I0713 02:57:00.029341 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-nr2r6\" (UniqueName: \"kubernetes.io/projected/93624b2e-1256-406d-892b-456a2b2cd0db-kube-api-access-nr2r6\") pod \"tuned-z7fz9\" (UID: \"93624b2e-1256-406d-892b-456a2b2cd0db\") " pod="openshift-cluster-node-tuning-operator/tuned-z7fz9" Jul 13 02:57:00.029709 ip-10-0-134-52 kubenswrapper[2558]: I0713 02:57:00.029397 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/16e70418-d340-4604-b23d-6e6bd736b72f-system-cni-dir\") pod \"multus-additional-cni-plugins-scthx\" (UID: \"16e70418-d340-4604-b23d-6e6bd736b72f\") " pod="openshift-multus/multus-additional-cni-plugins-scthx" Jul 13 02:57:00.029709 ip-10-0-134-52 kubenswrapper[2558]: I0713 02:57:00.029420 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/e81648db-3aac-4493-99c2-af21b4fcf2b5-multus-conf-dir\") pod \"multus-dvqmz\" (UID: \"e81648db-3aac-4493-99c2-af21b4fcf2b5\") " pod="openshift-multus/multus-dvqmz" Jul 13 02:57:00.029709 ip-10-0-134-52 kubenswrapper[2558]: I0713 02:57:00.029447 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/93624b2e-1256-406d-892b-456a2b2cd0db-etc-systemd\") pod \"tuned-z7fz9\" (UID: \"93624b2e-1256-406d-892b-456a2b2cd0db\") " pod="openshift-cluster-node-tuning-operator/tuned-z7fz9" Jul 13 02:57:00.029709 ip-10-0-134-52 kubenswrapper[2558]: I0713 02:57:00.029467 2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/93624b2e-1256-406d-892b-456a2b2cd0db-lib-modules\") pod \"tuned-z7fz9\" (UID: \"93624b2e-1256-406d-892b-456a2b2cd0db\") " pod="openshift-cluster-node-tuning-operator/tuned-z7fz9" Jul 13 02:57:00.029709 ip-10-0-134-52 kubenswrapper[2558]: I0713 02:57:00.029496 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-rk8np\" (UniqueName: \"kubernetes.io/projected/fc1d702b-774e-4b93-a862-8ada20c10ce4-kube-api-access-rk8np\") pod \"aws-ebs-csi-driver-node-bxvd8\" (UID: \"fc1d702b-774e-4b93-a862-8ada20c10ce4\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-bxvd8" Jul 13 02:57:00.029709 ip-10-0-134-52 kubenswrapper[2558]: I0713 02:57:00.029524 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/5b3dc970-19d3-43e8-9a7b-4062feb75c3e-original-pull-secret\") pod \"global-pull-secret-syncer-hf6cl\" (UID: \"5b3dc970-19d3-43e8-9a7b-4062feb75c3e\") " pod="kube-system/global-pull-secret-syncer-hf6cl" Jul 13 02:57:00.029709 ip-10-0-134-52 kubenswrapper[2558]: I0713 02:57:00.029557 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/d7c10797-d1f7-4e82-bd2b-f81f851f1407-var-lib-openvswitch\") pod \"ovnkube-node-7m9bp\" (UID: \"d7c10797-d1f7-4e82-bd2b-f81f851f1407\") " pod="openshift-ovn-kubernetes/ovnkube-node-7m9bp" Jul 13 02:57:00.029709 ip-10-0-134-52 kubenswrapper[2558]: I0713 02:57:00.029584 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/d7c10797-d1f7-4e82-bd2b-f81f851f1407-log-socket\") pod \"ovnkube-node-7m9bp\" (UID: \"d7c10797-d1f7-4e82-bd2b-f81f851f1407\") " pod="openshift-ovn-kubernetes/ovnkube-node-7m9bp" Jul 13 02:57:00.029709 ip-10-0-134-52 kubenswrapper[2558]: I0713 02:57:00.029610 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/16e70418-d340-4604-b23d-6e6bd736b72f-cnibin\") pod \"multus-additional-cni-plugins-scthx\" (UID: \"16e70418-d340-4604-b23d-6e6bd736b72f\") " pod="openshift-multus/multus-additional-cni-plugins-scthx" Jul 13 02:57:00.029709 ip-10-0-134-52 kubenswrapper[2558]: I0713 02:57:00.029637 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/e81648db-3aac-4493-99c2-af21b4fcf2b5-hostroot\") pod \"multus-dvqmz\" (UID: \"e81648db-3aac-4493-99c2-af21b4fcf2b5\") " pod="openshift-multus/multus-dvqmz" Jul 13 02:57:00.029709 ip-10-0-134-52 kubenswrapper[2558]: I0713 02:57:00.029642 2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/16e70418-d340-4604-b23d-6e6bd736b72f-cni-binary-copy\") pod \"multus-additional-cni-plugins-scthx\" (UID: \"16e70418-d340-4604-b23d-6e6bd736b72f\") " pod="openshift-multus/multus-additional-cni-plugins-scthx" Jul 13 02:57:00.029709 ip-10-0-134-52 kubenswrapper[2558]: I0713 02:57:00.029662 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-2jchk\" (UniqueName: \"kubernetes.io/projected/e81648db-3aac-4493-99c2-af21b4fcf2b5-kube-api-access-2jchk\") pod \"multus-dvqmz\" (UID: \"e81648db-3aac-4493-99c2-af21b4fcf2b5\") " pod="openshift-multus/multus-dvqmz" Jul 13 02:57:00.030335 ip-10-0-134-52 kubenswrapper[2558]: I0713 02:57:00.029724 2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/16e70418-d340-4604-b23d-6e6bd736b72f-system-cni-dir\") pod \"multus-additional-cni-plugins-scthx\" (UID: \"16e70418-d340-4604-b23d-6e6bd736b72f\") " pod="openshift-multus/multus-additional-cni-plugins-scthx" Jul 13 02:57:00.030335 ip-10-0-134-52 kubenswrapper[2558]: I0713 02:57:00.029731 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-f6cnb\" (UniqueName: \"kubernetes.io/projected/17234e1a-e139-4f9e-88fd-c679510cd0fb-kube-api-access-f6cnb\") pod \"network-check-target-fdbpv\" (UID: \"17234e1a-e139-4f9e-88fd-c679510cd0fb\") " pod="openshift-network-diagnostics/network-check-target-fdbpv" Jul 13 02:57:00.030335 ip-10-0-134-52 kubenswrapper[2558]: I0713 02:57:00.029742 2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/16e70418-d340-4604-b23d-6e6bd736b72f-cnibin\") pod \"multus-additional-cni-plugins-scthx\" (UID: \"16e70418-d340-4604-b23d-6e6bd736b72f\") " pod="openshift-multus/multus-additional-cni-plugins-scthx" Jul 13 02:57:00.030335 ip-10-0-134-52 kubenswrapper[2558]: I0713 02:57:00.029783 2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/e81648db-3aac-4493-99c2-af21b4fcf2b5-multus-conf-dir\") pod \"multus-dvqmz\" (UID: \"e81648db-3aac-4493-99c2-af21b4fcf2b5\") " pod="openshift-multus/multus-dvqmz" Jul 13 02:57:00.030335 ip-10-0-134-52 kubenswrapper[2558]: I0713 02:57:00.029785 2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/16e70418-d340-4604-b23d-6e6bd736b72f-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-scthx\" (UID: \"16e70418-d340-4604-b23d-6e6bd736b72f\") " pod="openshift-multus/multus-additional-cni-plugins-scthx" Jul 13 02:57:00.030335 ip-10-0-134-52 kubenswrapper[2558]: I0713 02:57:00.029785 2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/16e70418-d340-4604-b23d-6e6bd736b72f-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-scthx\" (UID: \"16e70418-d340-4604-b23d-6e6bd736b72f\") " pod="openshift-multus/multus-additional-cni-plugins-scthx" Jul 13 02:57:00.030335 ip-10-0-134-52 kubenswrapper[2558]: I0713 02:57:00.029760 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/84e7b9a8-6c63-4aeb-8249-5aae103cf5cc-tmp-dir\") pod \"node-resolver-ndddr\" (UID: \"84e7b9a8-6c63-4aeb-8249-5aae103cf5cc\") " pod="openshift-dns/node-resolver-ndddr" Jul 13 02:57:00.030335 ip-10-0-134-52 kubenswrapper[2558]: I0713 02:57:00.029836 2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/e81648db-3aac-4493-99c2-af21b4fcf2b5-hostroot\") pod \"multus-dvqmz\" (UID: \"e81648db-3aac-4493-99c2-af21b4fcf2b5\") " pod="openshift-multus/multus-dvqmz" Jul 13 02:57:00.030335 ip-10-0-134-52 kubenswrapper[2558]: I0713 02:57:00.029810 2558 swap_util.go:74] "error creating dir to test if tmpfs noswap is enabled. Assuming not supported" mount path="" error="stat /var/lib/kubelet/plugins/kubernetes.io/empty-dir: no such file or directory" Jul 13 02:57:00.030335 ip-10-0-134-52 kubenswrapper[2558]: I0713 02:57:00.029892 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/e81648db-3aac-4493-99c2-af21b4fcf2b5-host-run-k8s-cni-cncf-io\") pod \"multus-dvqmz\" (UID: \"e81648db-3aac-4493-99c2-af21b4fcf2b5\") " pod="openshift-multus/multus-dvqmz" Jul 13 02:57:00.030335 ip-10-0-134-52 kubenswrapper[2558]: I0713 02:57:00.029925 2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/e81648db-3aac-4493-99c2-af21b4fcf2b5-host-run-k8s-cni-cncf-io\") pod \"multus-dvqmz\" (UID: \"e81648db-3aac-4493-99c2-af21b4fcf2b5\") " pod="openshift-multus/multus-dvqmz" Jul 13 02:57:00.030335 ip-10-0-134-52 kubenswrapper[2558]: I0713 02:57:00.029927 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/e81648db-3aac-4493-99c2-af21b4fcf2b5-host-run-netns\") pod \"multus-dvqmz\" (UID: \"e81648db-3aac-4493-99c2-af21b4fcf2b5\") " pod="openshift-multus/multus-dvqmz" Jul 13 02:57:00.030335 ip-10-0-134-52 kubenswrapper[2558]: I0713 02:57:00.029961 2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/e81648db-3aac-4493-99c2-af21b4fcf2b5-host-run-netns\") pod \"multus-dvqmz\" (UID: \"e81648db-3aac-4493-99c2-af21b4fcf2b5\") " pod="openshift-multus/multus-dvqmz" Jul 13 02:57:00.030335 ip-10-0-134-52 kubenswrapper[2558]: I0713 02:57:00.029962 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/fe52b12d-b43c-483f-8b5b-155c4330c953-agent-certs\") pod \"konnectivity-agent-pf2f6\" (UID: \"fe52b12d-b43c-483f-8b5b-155c4330c953\") " pod="kube-system/konnectivity-agent-pf2f6" Jul 13 02:57:00.030335 ip-10-0-134-52 kubenswrapper[2558]: I0713 02:57:00.029990 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-444fv\" (UniqueName: \"kubernetes.io/projected/84e7b9a8-6c63-4aeb-8249-5aae103cf5cc-kube-api-access-444fv\") pod \"node-resolver-ndddr\" (UID: \"84e7b9a8-6c63-4aeb-8249-5aae103cf5cc\") " pod="openshift-dns/node-resolver-ndddr" Jul 13 02:57:00.030335 ip-10-0-134-52 kubenswrapper[2558]: I0713 02:57:00.029848 2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/93624b2e-1256-406d-892b-456a2b2cd0db-etc-systemd\") pod \"tuned-z7fz9\" (UID: \"93624b2e-1256-406d-892b-456a2b2cd0db\") " pod="openshift-cluster-node-tuning-operator/tuned-z7fz9" Jul 13 02:57:00.030335 ip-10-0-134-52 kubenswrapper[2558]: I0713 02:57:00.030009 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-647vn\" (UniqueName: \"kubernetes.io/projected/346339f5-1f30-46a0-a2aa-1ef007576943-kube-api-access-647vn\") pod \"iptables-alerter-px6ng\" (UID: \"346339f5-1f30-46a0-a2aa-1ef007576943\") " pod="openshift-network-operator/iptables-alerter-px6ng" Jul 13 02:57:00.031144 ip-10-0-134-52 kubenswrapper[2558]: I0713 02:57:00.030027 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/d7c10797-d1f7-4e82-bd2b-f81f851f1407-run-openvswitch\") pod \"ovnkube-node-7m9bp\" (UID: \"d7c10797-d1f7-4e82-bd2b-f81f851f1407\") " pod="openshift-ovn-kubernetes/ovnkube-node-7m9bp" Jul 13 02:57:00.031144 ip-10-0-134-52 kubenswrapper[2558]: I0713 02:57:00.030043 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/e81648db-3aac-4493-99c2-af21b4fcf2b5-etc-kubernetes\") pod \"multus-dvqmz\" (UID: \"e81648db-3aac-4493-99c2-af21b4fcf2b5\") " pod="openshift-multus/multus-dvqmz" Jul 13 02:57:00.031144 ip-10-0-134-52 kubenswrapper[2558]: I0713 02:57:00.030059 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/e4bb1d1b-35fa-47b2-af3d-ec01bff3f7c0-serviceca\") pod \"node-ca-wpn4b\" (UID: \"e4bb1d1b-35fa-47b2-af3d-ec01bff3f7c0\") " pod="openshift-image-registry/node-ca-wpn4b" Jul 13 02:57:00.031144 ip-10-0-134-52 kubenswrapper[2558]: I0713 02:57:00.030074 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-49cnb\" (UniqueName: \"kubernetes.io/projected/72ebddc5-a4ff-4e56-a65d-508775d02170-kube-api-access-49cnb\") pod \"network-metrics-daemon-jt47w\" (UID: \"72ebddc5-a4ff-4e56-a65d-508775d02170\") " pod="openshift-multus/network-metrics-daemon-jt47w" Jul 13 02:57:00.031144 ip-10-0-134-52 kubenswrapper[2558]: I0713 02:57:00.030092 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/5b3dc970-19d3-43e8-9a7b-4062feb75c3e-kubelet-config\") pod \"global-pull-secret-syncer-hf6cl\" (UID: \"5b3dc970-19d3-43e8-9a7b-4062feb75c3e\") " pod="kube-system/global-pull-secret-syncer-hf6cl" Jul 13 02:57:00.031144 ip-10-0-134-52 kubenswrapper[2558]: I0713 02:57:00.030149 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/d7c10797-d1f7-4e82-bd2b-f81f851f1407-systemd-units\") pod \"ovnkube-node-7m9bp\" (UID: \"d7c10797-d1f7-4e82-bd2b-f81f851f1407\") " pod="openshift-ovn-kubernetes/ovnkube-node-7m9bp" Jul 13 02:57:00.031144 ip-10-0-134-52 kubenswrapper[2558]: I0713 02:57:00.030174 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/d7c10797-d1f7-4e82-bd2b-f81f851f1407-env-overrides\") pod \"ovnkube-node-7m9bp\" (UID: \"d7c10797-d1f7-4e82-bd2b-f81f851f1407\") " pod="openshift-ovn-kubernetes/ovnkube-node-7m9bp" Jul 13 02:57:00.031144 ip-10-0-134-52 kubenswrapper[2558]: I0713 02:57:00.030172 2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/e81648db-3aac-4493-99c2-af21b4fcf2b5-etc-kubernetes\") pod \"multus-dvqmz\" (UID: \"e81648db-3aac-4493-99c2-af21b4fcf2b5\") " pod="openshift-multus/multus-dvqmz" Jul 13 02:57:00.031144 ip-10-0-134-52 kubenswrapper[2558]: I0713 02:57:00.030199 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/fc1d702b-774e-4b93-a862-8ada20c10ce4-registration-dir\") pod \"aws-ebs-csi-driver-node-bxvd8\" (UID: \"fc1d702b-774e-4b93-a862-8ada20c10ce4\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-bxvd8" Jul 13 02:57:00.031144 ip-10-0-134-52 kubenswrapper[2558]: I0713 02:57:00.030228 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/93624b2e-1256-406d-892b-456a2b2cd0db-etc-tuned\") pod \"tuned-z7fz9\" (UID: \"93624b2e-1256-406d-892b-456a2b2cd0db\") " pod="openshift-cluster-node-tuning-operator/tuned-z7fz9" Jul 13 02:57:00.031144 ip-10-0-134-52 kubenswrapper[2558]: I0713 02:57:00.030250 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/d7c10797-d1f7-4e82-bd2b-f81f851f1407-host-cni-netd\") pod \"ovnkube-node-7m9bp\" (UID: \"d7c10797-d1f7-4e82-bd2b-f81f851f1407\") " pod="openshift-ovn-kubernetes/ovnkube-node-7m9bp" Jul 13 02:57:00.031144 ip-10-0-134-52 kubenswrapper[2558]: I0713 02:57:00.030362 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/fe52b12d-b43c-483f-8b5b-155c4330c953-konnectivity-ca\") pod \"konnectivity-agent-pf2f6\" (UID: \"fe52b12d-b43c-483f-8b5b-155c4330c953\") " pod="kube-system/konnectivity-agent-pf2f6" Jul 13 02:57:00.031144 ip-10-0-134-52 kubenswrapper[2558]: I0713 02:57:00.030394 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/e81648db-3aac-4493-99c2-af21b4fcf2b5-multus-daemon-config\") pod \"multus-dvqmz\" (UID: \"e81648db-3aac-4493-99c2-af21b4fcf2b5\") " pod="openshift-multus/multus-dvqmz" Jul 13 02:57:00.031144 ip-10-0-134-52 kubenswrapper[2558]: I0713 02:57:00.030418 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/93624b2e-1256-406d-892b-456a2b2cd0db-etc-sysctl-conf\") pod \"tuned-z7fz9\" (UID: \"93624b2e-1256-406d-892b-456a2b2cd0db\") " pod="openshift-cluster-node-tuning-operator/tuned-z7fz9" Jul 13 02:57:00.031144 ip-10-0-134-52 kubenswrapper[2558]: I0713 02:57:00.030437 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/93624b2e-1256-406d-892b-456a2b2cd0db-var-lib-kubelet\") pod \"tuned-z7fz9\" (UID: \"93624b2e-1256-406d-892b-456a2b2cd0db\") " pod="openshift-cluster-node-tuning-operator/tuned-z7fz9" Jul 13 02:57:00.031144 ip-10-0-134-52 kubenswrapper[2558]: I0713 02:57:00.030458 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/16e70418-d340-4604-b23d-6e6bd736b72f-tuning-conf-dir\") pod \"multus-additional-cni-plugins-scthx\" (UID: \"16e70418-d340-4604-b23d-6e6bd736b72f\") " pod="openshift-multus/multus-additional-cni-plugins-scthx" Jul 13 02:57:00.031144 ip-10-0-134-52 kubenswrapper[2558]: I0713 02:57:00.030493 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/d7c10797-d1f7-4e82-bd2b-f81f851f1407-run-systemd\") pod \"ovnkube-node-7m9bp\" (UID: \"d7c10797-d1f7-4e82-bd2b-f81f851f1407\") " pod="openshift-ovn-kubernetes/ovnkube-node-7m9bp" Jul 13 02:57:00.032000 ip-10-0-134-52 kubenswrapper[2558]: I0713 02:57:00.030509 2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/93624b2e-1256-406d-892b-456a2b2cd0db-var-lib-kubelet\") pod \"tuned-z7fz9\" (UID: \"93624b2e-1256-406d-892b-456a2b2cd0db\") " pod="openshift-cluster-node-tuning-operator/tuned-z7fz9" Jul 13 02:57:00.032000 ip-10-0-134-52 kubenswrapper[2558]: I0713 02:57:00.030525 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/d7c10797-d1f7-4e82-bd2b-f81f851f1407-node-log\") pod \"ovnkube-node-7m9bp\" (UID: \"d7c10797-d1f7-4e82-bd2b-f81f851f1407\") " pod="openshift-ovn-kubernetes/ovnkube-node-7m9bp" Jul 13 02:57:00.032000 ip-10-0-134-52 kubenswrapper[2558]: I0713 02:57:00.030552 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/d7c10797-d1f7-4e82-bd2b-f81f851f1407-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-7m9bp\" (UID: \"d7c10797-d1f7-4e82-bd2b-f81f851f1407\") " pod="openshift-ovn-kubernetes/ovnkube-node-7m9bp" Jul 13 02:57:00.032000 ip-10-0-134-52 kubenswrapper[2558]: I0713 02:57:00.030584 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/e81648db-3aac-4493-99c2-af21b4fcf2b5-cnibin\") pod \"multus-dvqmz\" (UID: \"e81648db-3aac-4493-99c2-af21b4fcf2b5\") " pod="openshift-multus/multus-dvqmz" Jul 13 02:57:00.032000 ip-10-0-134-52 kubenswrapper[2558]: I0713 02:57:00.030599 2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/93624b2e-1256-406d-892b-456a2b2cd0db-etc-sysctl-conf\") pod \"tuned-z7fz9\" (UID: \"93624b2e-1256-406d-892b-456a2b2cd0db\") " pod="openshift-cluster-node-tuning-operator/tuned-z7fz9" Jul 13 02:57:00.032000 ip-10-0-134-52 kubenswrapper[2558]: I0713 02:57:00.030620 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/e81648db-3aac-4493-99c2-af21b4fcf2b5-host-var-lib-cni-multus\") pod \"multus-dvqmz\" (UID: \"e81648db-3aac-4493-99c2-af21b4fcf2b5\") " pod="openshift-multus/multus-dvqmz" Jul 13 02:57:00.032000 ip-10-0-134-52 kubenswrapper[2558]: I0713 02:57:00.030647 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run\" (UniqueName: \"kubernetes.io/host-path/93624b2e-1256-406d-892b-456a2b2cd0db-run\") pod \"tuned-z7fz9\" (UID: \"93624b2e-1256-406d-892b-456a2b2cd0db\") " pod="openshift-cluster-node-tuning-operator/tuned-z7fz9" Jul 13 02:57:00.032000 ip-10-0-134-52 kubenswrapper[2558]: I0713 02:57:00.030669 2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/16e70418-d340-4604-b23d-6e6bd736b72f-tuning-conf-dir\") pod \"multus-additional-cni-plugins-scthx\" (UID: \"16e70418-d340-4604-b23d-6e6bd736b72f\") " pod="openshift-multus/multus-additional-cni-plugins-scthx" Jul 13 02:57:00.032000 ip-10-0-134-52 kubenswrapper[2558]: I0713 02:57:00.030681 2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"run\" (UniqueName: \"kubernetes.io/host-path/93624b2e-1256-406d-892b-456a2b2cd0db-run\") pod \"tuned-z7fz9\" (UID: \"93624b2e-1256-406d-892b-456a2b2cd0db\") " pod="openshift-cluster-node-tuning-operator/tuned-z7fz9" Jul 13 02:57:00.032000 ip-10-0-134-52 kubenswrapper[2558]: I0713 02:57:00.030720 2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/e81648db-3aac-4493-99c2-af21b4fcf2b5-cnibin\") pod \"multus-dvqmz\" (UID: \"e81648db-3aac-4493-99c2-af21b4fcf2b5\") " pod="openshift-multus/multus-dvqmz" Jul 13 02:57:00.032000 ip-10-0-134-52 kubenswrapper[2558]: I0713 02:57:00.030735 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/e4bb1d1b-35fa-47b2-af3d-ec01bff3f7c0-host\") pod \"node-ca-wpn4b\" (UID: \"e4bb1d1b-35fa-47b2-af3d-ec01bff3f7c0\") " pod="openshift-image-registry/node-ca-wpn4b" Jul 13 02:57:00.032000 ip-10-0-134-52 kubenswrapper[2558]: I0713 02:57:00.030755 2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/e81648db-3aac-4493-99c2-af21b4fcf2b5-host-var-lib-cni-multus\") pod \"multus-dvqmz\" (UID: \"e81648db-3aac-4493-99c2-af21b4fcf2b5\") " pod="openshift-multus/multus-dvqmz" Jul 13 02:57:00.032000 ip-10-0-134-52 kubenswrapper[2558]: I0713 02:57:00.030795 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/fc1d702b-774e-4b93-a862-8ada20c10ce4-socket-dir\") pod \"aws-ebs-csi-driver-node-bxvd8\" (UID: \"fc1d702b-774e-4b93-a862-8ada20c10ce4\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-bxvd8" Jul 13 02:57:00.032000 ip-10-0-134-52 kubenswrapper[2558]: I0713 02:57:00.030838 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/84e7b9a8-6c63-4aeb-8249-5aae103cf5cc-hosts-file\") pod \"node-resolver-ndddr\" (UID: \"84e7b9a8-6c63-4aeb-8249-5aae103cf5cc\") " pod="openshift-dns/node-resolver-ndddr" Jul 13 02:57:00.032000 ip-10-0-134-52 kubenswrapper[2558]: I0713 02:57:00.030869 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/d7c10797-d1f7-4e82-bd2b-f81f851f1407-host-run-netns\") pod \"ovnkube-node-7m9bp\" (UID: \"d7c10797-d1f7-4e82-bd2b-f81f851f1407\") " pod="openshift-ovn-kubernetes/ovnkube-node-7m9bp" Jul 13 02:57:00.032000 ip-10-0-134-52 kubenswrapper[2558]: I0713 02:57:00.030894 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/d7c10797-d1f7-4e82-bd2b-f81f851f1407-ovnkube-config\") pod \"ovnkube-node-7m9bp\" (UID: \"d7c10797-d1f7-4e82-bd2b-f81f851f1407\") " pod="openshift-ovn-kubernetes/ovnkube-node-7m9bp" Jul 13 02:57:00.032000 ip-10-0-134-52 kubenswrapper[2558]: I0713 02:57:00.030937 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/e81648db-3aac-4493-99c2-af21b4fcf2b5-system-cni-dir\") pod \"multus-dvqmz\" (UID: \"e81648db-3aac-4493-99c2-af21b4fcf2b5\") " pod="openshift-multus/multus-dvqmz" Jul 13 02:57:00.032616 ip-10-0-134-52 kubenswrapper[2558]: I0713 02:57:00.030966 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/e81648db-3aac-4493-99c2-af21b4fcf2b5-multus-cni-dir\") pod \"multus-dvqmz\" (UID: \"e81648db-3aac-4493-99c2-af21b4fcf2b5\") " pod="openshift-multus/multus-dvqmz" Jul 13 02:57:00.032616 ip-10-0-134-52 kubenswrapper[2558]: I0713 02:57:00.031037 2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/e81648db-3aac-4493-99c2-af21b4fcf2b5-multus-cni-dir\") pod \"multus-dvqmz\" (UID: \"e81648db-3aac-4493-99c2-af21b4fcf2b5\") " pod="openshift-multus/multus-dvqmz" Jul 13 02:57:00.032616 ip-10-0-134-52 kubenswrapper[2558]: I0713 02:57:00.031015 2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/e81648db-3aac-4493-99c2-af21b4fcf2b5-system-cni-dir\") pod \"multus-dvqmz\" (UID: \"e81648db-3aac-4493-99c2-af21b4fcf2b5\") " pod="openshift-multus/multus-dvqmz" Jul 13 02:57:00.032616 ip-10-0-134-52 kubenswrapper[2558]: I0713 02:57:00.031078 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/e81648db-3aac-4493-99c2-af21b4fcf2b5-cni-binary-copy\") pod \"multus-dvqmz\" (UID: \"e81648db-3aac-4493-99c2-af21b4fcf2b5\") " pod="openshift-multus/multus-dvqmz" Jul 13 02:57:00.032616 ip-10-0-134-52 kubenswrapper[2558]: I0713 02:57:00.031105 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/93624b2e-1256-406d-892b-456a2b2cd0db-etc-sysconfig\") pod \"tuned-z7fz9\" (UID: \"93624b2e-1256-406d-892b-456a2b2cd0db\") " pod="openshift-cluster-node-tuning-operator/tuned-z7fz9" Jul 13 02:57:00.032616 ip-10-0-134-52 kubenswrapper[2558]: I0713 02:57:00.031132 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/fc1d702b-774e-4b93-a862-8ada20c10ce4-device-dir\") pod \"aws-ebs-csi-driver-node-bxvd8\" (UID: \"fc1d702b-774e-4b93-a862-8ada20c10ce4\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-bxvd8" Jul 13 02:57:00.032616 ip-10-0-134-52 kubenswrapper[2558]: I0713 02:57:00.031158 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/fc1d702b-774e-4b93-a862-8ada20c10ce4-sys-fs\") pod \"aws-ebs-csi-driver-node-bxvd8\" (UID: \"fc1d702b-774e-4b93-a862-8ada20c10ce4\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-bxvd8" Jul 13 02:57:00.032616 ip-10-0-134-52 kubenswrapper[2558]: I0713 02:57:00.031163 2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/93624b2e-1256-406d-892b-456a2b2cd0db-etc-sysconfig\") pod \"tuned-z7fz9\" (UID: \"93624b2e-1256-406d-892b-456a2b2cd0db\") " pod="openshift-cluster-node-tuning-operator/tuned-z7fz9" Jul 13 02:57:00.032616 ip-10-0-134-52 kubenswrapper[2558]: I0713 02:57:00.031175 2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/e81648db-3aac-4493-99c2-af21b4fcf2b5-multus-daemon-config\") pod \"multus-dvqmz\" (UID: \"e81648db-3aac-4493-99c2-af21b4fcf2b5\") " pod="openshift-multus/multus-dvqmz" Jul 13 02:57:00.032616 ip-10-0-134-52 kubenswrapper[2558]: I0713 02:57:00.031187 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/d7c10797-d1f7-4e82-bd2b-f81f851f1407-etc-openvswitch\") pod \"ovnkube-node-7m9bp\" (UID: \"d7c10797-d1f7-4e82-bd2b-f81f851f1407\") " pod="openshift-ovn-kubernetes/ovnkube-node-7m9bp" Jul 13 02:57:00.032616 ip-10-0-134-52 kubenswrapper[2558]: I0713 02:57:00.031228 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/d7c10797-d1f7-4e82-bd2b-f81f851f1407-run-ovn\") pod \"ovnkube-node-7m9bp\" (UID: \"d7c10797-d1f7-4e82-bd2b-f81f851f1407\") " pod="openshift-ovn-kubernetes/ovnkube-node-7m9bp" Jul 13 02:57:00.032616 ip-10-0-134-52 kubenswrapper[2558]: I0713 02:57:00.031262 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/93624b2e-1256-406d-892b-456a2b2cd0db-etc-kubernetes\") pod \"tuned-z7fz9\" (UID: \"93624b2e-1256-406d-892b-456a2b2cd0db\") " pod="openshift-cluster-node-tuning-operator/tuned-z7fz9" Jul 13 02:57:00.032616 ip-10-0-134-52 kubenswrapper[2558]: I0713 02:57:00.031299 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/72ebddc5-a4ff-4e56-a65d-508775d02170-metrics-certs\") pod \"network-metrics-daemon-jt47w\" (UID: \"72ebddc5-a4ff-4e56-a65d-508775d02170\") " pod="openshift-multus/network-metrics-daemon-jt47w" Jul 13 02:57:00.032616 ip-10-0-134-52 kubenswrapper[2558]: I0713 02:57:00.031308 2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/93624b2e-1256-406d-892b-456a2b2cd0db-etc-kubernetes\") pod \"tuned-z7fz9\" (UID: \"93624b2e-1256-406d-892b-456a2b2cd0db\") " pod="openshift-cluster-node-tuning-operator/tuned-z7fz9" Jul 13 02:57:00.032616 ip-10-0-134-52 kubenswrapper[2558]: I0713 02:57:00.031354 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/346339f5-1f30-46a0-a2aa-1ef007576943-iptables-alerter-script\") pod \"iptables-alerter-px6ng\" (UID: \"346339f5-1f30-46a0-a2aa-1ef007576943\") " pod="openshift-network-operator/iptables-alerter-px6ng" Jul 13 02:57:00.032616 ip-10-0-134-52 kubenswrapper[2558]: I0713 02:57:00.031385 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/d7c10797-d1f7-4e82-bd2b-f81f851f1407-host-run-ovn-kubernetes\") pod \"ovnkube-node-7m9bp\" (UID: \"d7c10797-d1f7-4e82-bd2b-f81f851f1407\") " pod="openshift-ovn-kubernetes/ovnkube-node-7m9bp" Jul 13 02:57:00.032616 ip-10-0-134-52 kubenswrapper[2558]: I0713 02:57:00.031409 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/d7c10797-d1f7-4e82-bd2b-f81f851f1407-ovnkube-script-lib\") pod \"ovnkube-node-7m9bp\" (UID: \"d7c10797-d1f7-4e82-bd2b-f81f851f1407\") " pod="openshift-ovn-kubernetes/ovnkube-node-7m9bp" Jul 13 02:57:00.033741 ip-10-0-134-52 kubenswrapper[2558]: I0713 02:57:00.031439 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/93624b2e-1256-406d-892b-456a2b2cd0db-etc-modprobe-d\") pod \"tuned-z7fz9\" (UID: \"93624b2e-1256-406d-892b-456a2b2cd0db\") " pod="openshift-cluster-node-tuning-operator/tuned-z7fz9" Jul 13 02:57:00.033741 ip-10-0-134-52 kubenswrapper[2558]: I0713 02:57:00.031475 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/93624b2e-1256-406d-892b-456a2b2cd0db-etc-sysctl-d\") pod \"tuned-z7fz9\" (UID: \"93624b2e-1256-406d-892b-456a2b2cd0db\") " pod="openshift-cluster-node-tuning-operator/tuned-z7fz9" Jul 13 02:57:00.033741 ip-10-0-134-52 kubenswrapper[2558]: I0713 02:57:00.031537 2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/93624b2e-1256-406d-892b-456a2b2cd0db-etc-modprobe-d\") pod \"tuned-z7fz9\" (UID: \"93624b2e-1256-406d-892b-456a2b2cd0db\") " pod="openshift-cluster-node-tuning-operator/tuned-z7fz9" Jul 13 02:57:00.033741 ip-10-0-134-52 kubenswrapper[2558]: I0713 02:57:00.031567 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/fc1d702b-774e-4b93-a862-8ada20c10ce4-etc-selinux\") pod \"aws-ebs-csi-driver-node-bxvd8\" (UID: \"fc1d702b-774e-4b93-a862-8ada20c10ce4\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-bxvd8" Jul 13 02:57:00.033741 ip-10-0-134-52 kubenswrapper[2558]: I0713 02:57:00.031585 2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/93624b2e-1256-406d-892b-456a2b2cd0db-etc-sysctl-d\") pod \"tuned-z7fz9\" (UID: \"93624b2e-1256-406d-892b-456a2b2cd0db\") " pod="openshift-cluster-node-tuning-operator/tuned-z7fz9" Jul 13 02:57:00.033741 ip-10-0-134-52 kubenswrapper[2558]: I0713 02:57:00.031589 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/5b3dc970-19d3-43e8-9a7b-4062feb75c3e-dbus\") pod \"global-pull-secret-syncer-hf6cl\" (UID: \"5b3dc970-19d3-43e8-9a7b-4062feb75c3e\") " pod="kube-system/global-pull-secret-syncer-hf6cl" Jul 13 02:57:00.033741 ip-10-0-134-52 kubenswrapper[2558]: I0713 02:57:00.031627 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/346339f5-1f30-46a0-a2aa-1ef007576943-host-slash\") pod \"iptables-alerter-px6ng\" (UID: \"346339f5-1f30-46a0-a2aa-1ef007576943\") " pod="openshift-network-operator/iptables-alerter-px6ng" Jul 13 02:57:00.033741 ip-10-0-134-52 kubenswrapper[2558]: I0713 02:57:00.031655 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/93624b2e-1256-406d-892b-456a2b2cd0db-sys\") pod \"tuned-z7fz9\" (UID: \"93624b2e-1256-406d-892b-456a2b2cd0db\") " pod="openshift-cluster-node-tuning-operator/tuned-z7fz9" Jul 13 02:57:00.033741 ip-10-0-134-52 kubenswrapper[2558]: I0713 02:57:00.031682 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/93624b2e-1256-406d-892b-456a2b2cd0db-host\") pod \"tuned-z7fz9\" (UID: \"93624b2e-1256-406d-892b-456a2b2cd0db\") " pod="openshift-cluster-node-tuning-operator/tuned-z7fz9" Jul 13 02:57:00.033741 ip-10-0-134-52 kubenswrapper[2558]: I0713 02:57:00.031711 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/16e70418-d340-4604-b23d-6e6bd736b72f-os-release\") pod \"multus-additional-cni-plugins-scthx\" (UID: \"16e70418-d340-4604-b23d-6e6bd736b72f\") " pod="openshift-multus/multus-additional-cni-plugins-scthx" Jul 13 02:57:00.033741 ip-10-0-134-52 kubenswrapper[2558]: I0713 02:57:00.031742 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/d7c10797-d1f7-4e82-bd2b-f81f851f1407-host-slash\") pod \"ovnkube-node-7m9bp\" (UID: \"d7c10797-d1f7-4e82-bd2b-f81f851f1407\") " pod="openshift-ovn-kubernetes/ovnkube-node-7m9bp" Jul 13 02:57:00.033741 ip-10-0-134-52 kubenswrapper[2558]: I0713 02:57:00.031748 2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/93624b2e-1256-406d-892b-456a2b2cd0db-sys\") pod \"tuned-z7fz9\" (UID: \"93624b2e-1256-406d-892b-456a2b2cd0db\") " pod="openshift-cluster-node-tuning-operator/tuned-z7fz9" Jul 13 02:57:00.033741 ip-10-0-134-52 kubenswrapper[2558]: I0713 02:57:00.031770 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/d7c10797-d1f7-4e82-bd2b-f81f851f1407-host-cni-bin\") pod \"ovnkube-node-7m9bp\" (UID: \"d7c10797-d1f7-4e82-bd2b-f81f851f1407\") " pod="openshift-ovn-kubernetes/ovnkube-node-7m9bp" Jul 13 02:57:00.033741 ip-10-0-134-52 kubenswrapper[2558]: I0713 02:57:00.031788 2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host\" (UniqueName: \"kubernetes.io/host-path/93624b2e-1256-406d-892b-456a2b2cd0db-host\") pod \"tuned-z7fz9\" (UID: \"93624b2e-1256-406d-892b-456a2b2cd0db\") " pod="openshift-cluster-node-tuning-operator/tuned-z7fz9" Jul 13 02:57:00.033741 ip-10-0-134-52 kubenswrapper[2558]: I0713 02:57:00.031797 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/d7c10797-d1f7-4e82-bd2b-f81f851f1407-ovn-node-metrics-cert\") pod \"ovnkube-node-7m9bp\" (UID: \"d7c10797-d1f7-4e82-bd2b-f81f851f1407\") " pod="openshift-ovn-kubernetes/ovnkube-node-7m9bp" Jul 13 02:57:00.033741 ip-10-0-134-52 kubenswrapper[2558]: I0713 02:57:00.031827 2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/16e70418-d340-4604-b23d-6e6bd736b72f-os-release\") pod \"multus-additional-cni-plugins-scthx\" (UID: \"16e70418-d340-4604-b23d-6e6bd736b72f\") " pod="openshift-multus/multus-additional-cni-plugins-scthx" Jul 13 02:57:00.033741 ip-10-0-134-52 kubenswrapper[2558]: I0713 02:57:00.031867 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/e81648db-3aac-4493-99c2-af21b4fcf2b5-host-var-lib-kubelet\") pod \"multus-dvqmz\" (UID: \"e81648db-3aac-4493-99c2-af21b4fcf2b5\") " pod="openshift-multus/multus-dvqmz" Jul 13 02:57:00.034593 ip-10-0-134-52 kubenswrapper[2558]: I0713 02:57:00.031912 2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/e81648db-3aac-4493-99c2-af21b4fcf2b5-host-var-lib-kubelet\") pod \"multus-dvqmz\" (UID: \"e81648db-3aac-4493-99c2-af21b4fcf2b5\") " pod="openshift-multus/multus-dvqmz" Jul 13 02:57:00.034593 ip-10-0-134-52 kubenswrapper[2558]: I0713 02:57:00.031998 2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/e81648db-3aac-4493-99c2-af21b4fcf2b5-cni-binary-copy\") pod \"multus-dvqmz\" (UID: \"e81648db-3aac-4493-99c2-af21b4fcf2b5\") " pod="openshift-multus/multus-dvqmz" Jul 13 02:57:00.034593 ip-10-0-134-52 kubenswrapper[2558]: I0713 02:57:00.033308 2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/93624b2e-1256-406d-892b-456a2b2cd0db-tmp\") pod \"tuned-z7fz9\" (UID: \"93624b2e-1256-406d-892b-456a2b2cd0db\") " pod="openshift-cluster-node-tuning-operator/tuned-z7fz9" Jul 13 02:57:00.034685 ip-10-0-134-52 kubenswrapper[2558]: I0713 02:57:00.034629 2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/93624b2e-1256-406d-892b-456a2b2cd0db-etc-tuned\") pod \"tuned-z7fz9\" (UID: \"93624b2e-1256-406d-892b-456a2b2cd0db\") " pod="openshift-cluster-node-tuning-operator/tuned-z7fz9" Jul 13 02:57:00.035846 ip-10-0-134-52 kubenswrapper[2558]: I0713 02:57:00.035826 2558 csr.go:270] "Certificate signing request is issued" logger="kubernetes.io/kubelet-serving" csr="csr-56psh" Jul 13 02:57:00.048865 ip-10-0-134-52 kubenswrapper[2558]: I0713 02:57:00.048834 2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-kg2w8\" (UniqueName: \"kubernetes.io/projected/16e70418-d340-4604-b23d-6e6bd736b72f-kube-api-access-kg2w8\") pod \"multus-additional-cni-plugins-scthx\" (UID: \"16e70418-d340-4604-b23d-6e6bd736b72f\") " pod="openshift-multus/multus-additional-cni-plugins-scthx" Jul 13 02:57:00.052067 ip-10-0-134-52 kubenswrapper[2558]: I0713 02:57:00.052044 2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-nr2r6\" (UniqueName: \"kubernetes.io/projected/93624b2e-1256-406d-892b-456a2b2cd0db-kube-api-access-nr2r6\") pod \"tuned-z7fz9\" (UID: \"93624b2e-1256-406d-892b-456a2b2cd0db\") " pod="openshift-cluster-node-tuning-operator/tuned-z7fz9" Jul 13 02:57:00.057840 ip-10-0-134-52 kubenswrapper[2558]: I0713 02:57:00.057818 2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-2jchk\" (UniqueName: \"kubernetes.io/projected/e81648db-3aac-4493-99c2-af21b4fcf2b5-kube-api-access-2jchk\") pod \"multus-dvqmz\" (UID: \"e81648db-3aac-4493-99c2-af21b4fcf2b5\") " pod="openshift-multus/multus-dvqmz" Jul 13 02:57:00.095196 ip-10-0-134-52 kubenswrapper[2558]: I0713 02:57:00.095171 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-134-52.ec2.internal" event={"ID":"c2b195f03ef2d8abb371e44a8b3b8700","Type":"ContainerStarted","Data":"b7c72cec35f104683bab66d76b9038eb8e1f960bc2f0e2fce13a875cbc20ba1f"} Jul 13 02:57:00.133175 ip-10-0-134-52 kubenswrapper[2558]: I0713 02:57:00.133148 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-f6cnb\" (UniqueName: \"kubernetes.io/projected/17234e1a-e139-4f9e-88fd-c679510cd0fb-kube-api-access-f6cnb\") pod \"network-check-target-fdbpv\" (UID: \"17234e1a-e139-4f9e-88fd-c679510cd0fb\") " pod="openshift-network-diagnostics/network-check-target-fdbpv" Jul 13 02:57:00.133290 ip-10-0-134-52 kubenswrapper[2558]: I0713 02:57:00.133187 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/84e7b9a8-6c63-4aeb-8249-5aae103cf5cc-tmp-dir\") pod \"node-resolver-ndddr\" (UID: \"84e7b9a8-6c63-4aeb-8249-5aae103cf5cc\") " pod="openshift-dns/node-resolver-ndddr" Jul 13 02:57:00.133290 ip-10-0-134-52 kubenswrapper[2558]: I0713 02:57:00.133215 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/fe52b12d-b43c-483f-8b5b-155c4330c953-agent-certs\") pod \"konnectivity-agent-pf2f6\" (UID: \"fe52b12d-b43c-483f-8b5b-155c4330c953\") " pod="kube-system/konnectivity-agent-pf2f6" Jul 13 02:57:00.133290 ip-10-0-134-52 kubenswrapper[2558]: I0713 02:57:00.133283 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-444fv\" (UniqueName: \"kubernetes.io/projected/84e7b9a8-6c63-4aeb-8249-5aae103cf5cc-kube-api-access-444fv\") pod \"node-resolver-ndddr\" (UID: \"84e7b9a8-6c63-4aeb-8249-5aae103cf5cc\") " pod="openshift-dns/node-resolver-ndddr" Jul 13 02:57:00.133461 ip-10-0-134-52 kubenswrapper[2558]: I0713 02:57:00.133309 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-647vn\" (UniqueName: \"kubernetes.io/projected/346339f5-1f30-46a0-a2aa-1ef007576943-kube-api-access-647vn\") pod \"iptables-alerter-px6ng\" (UID: \"346339f5-1f30-46a0-a2aa-1ef007576943\") " pod="openshift-network-operator/iptables-alerter-px6ng" Jul 13 02:57:00.133461 ip-10-0-134-52 kubenswrapper[2558]: I0713 02:57:00.133333 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/d7c10797-d1f7-4e82-bd2b-f81f851f1407-run-openvswitch\") pod \"ovnkube-node-7m9bp\" (UID: \"d7c10797-d1f7-4e82-bd2b-f81f851f1407\") " pod="openshift-ovn-kubernetes/ovnkube-node-7m9bp" Jul 13 02:57:00.133461 ip-10-0-134-52 kubenswrapper[2558]: I0713 02:57:00.133378 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/e4bb1d1b-35fa-47b2-af3d-ec01bff3f7c0-serviceca\") pod \"node-ca-wpn4b\" (UID: \"e4bb1d1b-35fa-47b2-af3d-ec01bff3f7c0\") " pod="openshift-image-registry/node-ca-wpn4b" Jul 13 02:57:00.133461 ip-10-0-134-52 kubenswrapper[2558]: I0713 02:57:00.133402 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-49cnb\" (UniqueName: \"kubernetes.io/projected/72ebddc5-a4ff-4e56-a65d-508775d02170-kube-api-access-49cnb\") pod \"network-metrics-daemon-jt47w\" (UID: \"72ebddc5-a4ff-4e56-a65d-508775d02170\") " pod="openshift-multus/network-metrics-daemon-jt47w" Jul 13 02:57:00.133461 ip-10-0-134-52 kubenswrapper[2558]: I0713 02:57:00.133427 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/5b3dc970-19d3-43e8-9a7b-4062feb75c3e-kubelet-config\") pod \"global-pull-secret-syncer-hf6cl\" (UID: \"5b3dc970-19d3-43e8-9a7b-4062feb75c3e\") " pod="kube-system/global-pull-secret-syncer-hf6cl" Jul 13 02:57:00.133461 ip-10-0-134-52 kubenswrapper[2558]: I0713 02:57:00.133450 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/d7c10797-d1f7-4e82-bd2b-f81f851f1407-systemd-units\") pod \"ovnkube-node-7m9bp\" (UID: \"d7c10797-d1f7-4e82-bd2b-f81f851f1407\") " pod="openshift-ovn-kubernetes/ovnkube-node-7m9bp" Jul 13 02:57:00.133644 ip-10-0-134-52 kubenswrapper[2558]: I0713 02:57:00.133472 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/d7c10797-d1f7-4e82-bd2b-f81f851f1407-env-overrides\") pod \"ovnkube-node-7m9bp\" (UID: \"d7c10797-d1f7-4e82-bd2b-f81f851f1407\") " pod="openshift-ovn-kubernetes/ovnkube-node-7m9bp" Jul 13 02:57:00.133644 ip-10-0-134-52 kubenswrapper[2558]: I0713 02:57:00.133497 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/fc1d702b-774e-4b93-a862-8ada20c10ce4-registration-dir\") pod \"aws-ebs-csi-driver-node-bxvd8\" (UID: \"fc1d702b-774e-4b93-a862-8ada20c10ce4\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-bxvd8" Jul 13 02:57:00.133644 ip-10-0-134-52 kubenswrapper[2558]: I0713 02:57:00.133522 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/d7c10797-d1f7-4e82-bd2b-f81f851f1407-host-cni-netd\") pod \"ovnkube-node-7m9bp\" (UID: \"d7c10797-d1f7-4e82-bd2b-f81f851f1407\") " pod="openshift-ovn-kubernetes/ovnkube-node-7m9bp" Jul 13 02:57:00.133644 ip-10-0-134-52 kubenswrapper[2558]: I0713 02:57:00.133530 2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/84e7b9a8-6c63-4aeb-8249-5aae103cf5cc-tmp-dir\") pod \"node-resolver-ndddr\" (UID: \"84e7b9a8-6c63-4aeb-8249-5aae103cf5cc\") " pod="openshift-dns/node-resolver-ndddr" Jul 13 02:57:00.133644 ip-10-0-134-52 kubenswrapper[2558]: I0713 02:57:00.133549 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/fe52b12d-b43c-483f-8b5b-155c4330c953-konnectivity-ca\") pod \"konnectivity-agent-pf2f6\" (UID: \"fe52b12d-b43c-483f-8b5b-155c4330c953\") " pod="kube-system/konnectivity-agent-pf2f6" Jul 13 02:57:00.133644 ip-10-0-134-52 kubenswrapper[2558]: I0713 02:57:00.133598 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/d7c10797-d1f7-4e82-bd2b-f81f851f1407-run-systemd\") pod \"ovnkube-node-7m9bp\" (UID: \"d7c10797-d1f7-4e82-bd2b-f81f851f1407\") " pod="openshift-ovn-kubernetes/ovnkube-node-7m9bp" Jul 13 02:57:00.133644 ip-10-0-134-52 kubenswrapper[2558]: I0713 02:57:00.133629 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/d7c10797-d1f7-4e82-bd2b-f81f851f1407-node-log\") pod \"ovnkube-node-7m9bp\" (UID: \"d7c10797-d1f7-4e82-bd2b-f81f851f1407\") " pod="openshift-ovn-kubernetes/ovnkube-node-7m9bp" Jul 13 02:57:00.133882 ip-10-0-134-52 kubenswrapper[2558]: I0713 02:57:00.133656 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/d7c10797-d1f7-4e82-bd2b-f81f851f1407-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-7m9bp\" (UID: \"d7c10797-d1f7-4e82-bd2b-f81f851f1407\") " pod="openshift-ovn-kubernetes/ovnkube-node-7m9bp" Jul 13 02:57:00.133882 ip-10-0-134-52 kubenswrapper[2558]: I0713 02:57:00.133686 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/e4bb1d1b-35fa-47b2-af3d-ec01bff3f7c0-host\") pod \"node-ca-wpn4b\" (UID: \"e4bb1d1b-35fa-47b2-af3d-ec01bff3f7c0\") " pod="openshift-image-registry/node-ca-wpn4b" Jul 13 02:57:00.133882 ip-10-0-134-52 kubenswrapper[2558]: I0713 02:57:00.133712 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/fc1d702b-774e-4b93-a862-8ada20c10ce4-socket-dir\") pod \"aws-ebs-csi-driver-node-bxvd8\" (UID: \"fc1d702b-774e-4b93-a862-8ada20c10ce4\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-bxvd8" Jul 13 02:57:00.133882 ip-10-0-134-52 kubenswrapper[2558]: I0713 02:57:00.133736 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/84e7b9a8-6c63-4aeb-8249-5aae103cf5cc-hosts-file\") pod \"node-resolver-ndddr\" (UID: \"84e7b9a8-6c63-4aeb-8249-5aae103cf5cc\") " pod="openshift-dns/node-resolver-ndddr" Jul 13 02:57:00.133882 ip-10-0-134-52 kubenswrapper[2558]: I0713 02:57:00.133761 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/d7c10797-d1f7-4e82-bd2b-f81f851f1407-host-run-netns\") pod \"ovnkube-node-7m9bp\" (UID: \"d7c10797-d1f7-4e82-bd2b-f81f851f1407\") " pod="openshift-ovn-kubernetes/ovnkube-node-7m9bp" Jul 13 02:57:00.133882 ip-10-0-134-52 kubenswrapper[2558]: I0713 02:57:00.133787 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/d7c10797-d1f7-4e82-bd2b-f81f851f1407-ovnkube-config\") pod \"ovnkube-node-7m9bp\" (UID: \"d7c10797-d1f7-4e82-bd2b-f81f851f1407\") " pod="openshift-ovn-kubernetes/ovnkube-node-7m9bp" Jul 13 02:57:00.133882 ip-10-0-134-52 kubenswrapper[2558]: I0713 02:57:00.133816 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/fc1d702b-774e-4b93-a862-8ada20c10ce4-device-dir\") pod \"aws-ebs-csi-driver-node-bxvd8\" (UID: \"fc1d702b-774e-4b93-a862-8ada20c10ce4\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-bxvd8" Jul 13 02:57:00.133882 ip-10-0-134-52 kubenswrapper[2558]: I0713 02:57:00.133842 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/fc1d702b-774e-4b93-a862-8ada20c10ce4-sys-fs\") pod \"aws-ebs-csi-driver-node-bxvd8\" (UID: \"fc1d702b-774e-4b93-a862-8ada20c10ce4\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-bxvd8" Jul 13 02:57:00.133882 ip-10-0-134-52 kubenswrapper[2558]: I0713 02:57:00.133866 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/d7c10797-d1f7-4e82-bd2b-f81f851f1407-etc-openvswitch\") pod \"ovnkube-node-7m9bp\" (UID: \"d7c10797-d1f7-4e82-bd2b-f81f851f1407\") " pod="openshift-ovn-kubernetes/ovnkube-node-7m9bp" Jul 13 02:57:00.134338 ip-10-0-134-52 kubenswrapper[2558]: I0713 02:57:00.133893 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/d7c10797-d1f7-4e82-bd2b-f81f851f1407-run-ovn\") pod \"ovnkube-node-7m9bp\" (UID: \"d7c10797-d1f7-4e82-bd2b-f81f851f1407\") " pod="openshift-ovn-kubernetes/ovnkube-node-7m9bp" Jul 13 02:57:00.134338 ip-10-0-134-52 kubenswrapper[2558]: I0713 02:57:00.133941 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/72ebddc5-a4ff-4e56-a65d-508775d02170-metrics-certs\") pod \"network-metrics-daemon-jt47w\" (UID: \"72ebddc5-a4ff-4e56-a65d-508775d02170\") " pod="openshift-multus/network-metrics-daemon-jt47w" Jul 13 02:57:00.134338 ip-10-0-134-52 kubenswrapper[2558]: I0713 02:57:00.133962 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/346339f5-1f30-46a0-a2aa-1ef007576943-iptables-alerter-script\") pod \"iptables-alerter-px6ng\" (UID: \"346339f5-1f30-46a0-a2aa-1ef007576943\") " pod="openshift-network-operator/iptables-alerter-px6ng" Jul 13 02:57:00.134338 ip-10-0-134-52 kubenswrapper[2558]: I0713 02:57:00.133955 2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/fc1d702b-774e-4b93-a862-8ada20c10ce4-socket-dir\") pod \"aws-ebs-csi-driver-node-bxvd8\" (UID: \"fc1d702b-774e-4b93-a862-8ada20c10ce4\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-bxvd8" Jul 13 02:57:00.134338 ip-10-0-134-52 kubenswrapper[2558]: I0713 02:57:00.133987 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/d7c10797-d1f7-4e82-bd2b-f81f851f1407-host-run-ovn-kubernetes\") pod \"ovnkube-node-7m9bp\" (UID: \"d7c10797-d1f7-4e82-bd2b-f81f851f1407\") " pod="openshift-ovn-kubernetes/ovnkube-node-7m9bp" Jul 13 02:57:00.134338 ip-10-0-134-52 kubenswrapper[2558]: I0713 02:57:00.133988 2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/5b3dc970-19d3-43e8-9a7b-4062feb75c3e-kubelet-config\") pod \"global-pull-secret-syncer-hf6cl\" (UID: \"5b3dc970-19d3-43e8-9a7b-4062feb75c3e\") " pod="kube-system/global-pull-secret-syncer-hf6cl" Jul 13 02:57:00.134338 ip-10-0-134-52 kubenswrapper[2558]: I0713 02:57:00.134006 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/d7c10797-d1f7-4e82-bd2b-f81f851f1407-ovnkube-script-lib\") pod \"ovnkube-node-7m9bp\" (UID: \"d7c10797-d1f7-4e82-bd2b-f81f851f1407\") " pod="openshift-ovn-kubernetes/ovnkube-node-7m9bp" Jul 13 02:57:00.134338 ip-10-0-134-52 kubenswrapper[2558]: I0713 02:57:00.134035 2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/d7c10797-d1f7-4e82-bd2b-f81f851f1407-run-systemd\") pod \"ovnkube-node-7m9bp\" (UID: \"d7c10797-d1f7-4e82-bd2b-f81f851f1407\") " pod="openshift-ovn-kubernetes/ovnkube-node-7m9bp" Jul 13 02:57:00.134338 ip-10-0-134-52 kubenswrapper[2558]: I0713 02:57:00.134084 2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host\" (UniqueName: \"kubernetes.io/host-path/e4bb1d1b-35fa-47b2-af3d-ec01bff3f7c0-host\") pod \"node-ca-wpn4b\" (UID: \"e4bb1d1b-35fa-47b2-af3d-ec01bff3f7c0\") " pod="openshift-image-registry/node-ca-wpn4b" Jul 13 02:57:00.134338 ip-10-0-134-52 kubenswrapper[2558]: I0713 02:57:00.134123 2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/d7c10797-d1f7-4e82-bd2b-f81f851f1407-node-log\") pod \"ovnkube-node-7m9bp\" (UID: \"d7c10797-d1f7-4e82-bd2b-f81f851f1407\") " pod="openshift-ovn-kubernetes/ovnkube-node-7m9bp" Jul 13 02:57:00.134338 ip-10-0-134-52 kubenswrapper[2558]: I0713 02:57:00.134125 2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/fe52b12d-b43c-483f-8b5b-155c4330c953-konnectivity-ca\") pod \"konnectivity-agent-pf2f6\" (UID: \"fe52b12d-b43c-483f-8b5b-155c4330c953\") " pod="kube-system/konnectivity-agent-pf2f6" Jul 13 02:57:00.134338 ip-10-0-134-52 kubenswrapper[2558]: I0713 02:57:00.134168 2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/d7c10797-d1f7-4e82-bd2b-f81f851f1407-host-cni-netd\") pod \"ovnkube-node-7m9bp\" (UID: \"d7c10797-d1f7-4e82-bd2b-f81f851f1407\") " pod="openshift-ovn-kubernetes/ovnkube-node-7m9bp" Jul 13 02:57:00.134338 ip-10-0-134-52 kubenswrapper[2558]: I0713 02:57:00.134245 2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/fc1d702b-774e-4b93-a862-8ada20c10ce4-registration-dir\") pod \"aws-ebs-csi-driver-node-bxvd8\" (UID: \"fc1d702b-774e-4b93-a862-8ada20c10ce4\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-bxvd8" Jul 13 02:57:00.134338 ip-10-0-134-52 kubenswrapper[2558]: I0713 02:57:00.134274 2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/d7c10797-d1f7-4e82-bd2b-f81f851f1407-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-7m9bp\" (UID: \"d7c10797-d1f7-4e82-bd2b-f81f851f1407\") " pod="openshift-ovn-kubernetes/ovnkube-node-7m9bp" Jul 13 02:57:00.135063 ip-10-0-134-52 kubenswrapper[2558]: I0713 02:57:00.134360 2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/84e7b9a8-6c63-4aeb-8249-5aae103cf5cc-hosts-file\") pod \"node-resolver-ndddr\" (UID: \"84e7b9a8-6c63-4aeb-8249-5aae103cf5cc\") " pod="openshift-dns/node-resolver-ndddr" Jul 13 02:57:00.135063 ip-10-0-134-52 kubenswrapper[2558]: I0713 02:57:00.134428 2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/d7c10797-d1f7-4e82-bd2b-f81f851f1407-host-run-netns\") pod \"ovnkube-node-7m9bp\" (UID: \"d7c10797-d1f7-4e82-bd2b-f81f851f1407\") " pod="openshift-ovn-kubernetes/ovnkube-node-7m9bp" Jul 13 02:57:00.135063 ip-10-0-134-52 kubenswrapper[2558]: E0713 02:57:00.134382 2558 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jul 13 02:57:00.135063 ip-10-0-134-52 kubenswrapper[2558]: I0713 02:57:00.134458 2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/d7c10797-d1f7-4e82-bd2b-f81f851f1407-run-ovn\") pod \"ovnkube-node-7m9bp\" (UID: \"d7c10797-d1f7-4e82-bd2b-f81f851f1407\") " pod="openshift-ovn-kubernetes/ovnkube-node-7m9bp" Jul 13 02:57:00.135063 ip-10-0-134-52 kubenswrapper[2558]: E0713 02:57:00.134501 2558 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/72ebddc5-a4ff-4e56-a65d-508775d02170-metrics-certs podName:72ebddc5-a4ff-4e56-a65d-508775d02170 nodeName:}" failed. No retries permitted until 2026-07-13 02:57:00.63447952 +0000 UTC m=+3.035079983 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/72ebddc5-a4ff-4e56-a65d-508775d02170-metrics-certs") pod "network-metrics-daemon-jt47w" (UID: "72ebddc5-a4ff-4e56-a65d-508775d02170") : object "openshift-multus"/"metrics-daemon-secret" not registered Jul 13 02:57:00.135063 ip-10-0-134-52 kubenswrapper[2558]: I0713 02:57:00.134506 2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/d7c10797-d1f7-4e82-bd2b-f81f851f1407-ovnkube-script-lib\") pod \"ovnkube-node-7m9bp\" (UID: \"d7c10797-d1f7-4e82-bd2b-f81f851f1407\") " pod="openshift-ovn-kubernetes/ovnkube-node-7m9bp" Jul 13 02:57:00.135063 ip-10-0-134-52 kubenswrapper[2558]: I0713 02:57:00.134377 2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/d7c10797-d1f7-4e82-bd2b-f81f851f1407-env-overrides\") pod \"ovnkube-node-7m9bp\" (UID: \"d7c10797-d1f7-4e82-bd2b-f81f851f1407\") " pod="openshift-ovn-kubernetes/ovnkube-node-7m9bp" Jul 13 02:57:00.135063 ip-10-0-134-52 kubenswrapper[2558]: I0713 02:57:00.134529 2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/fc1d702b-774e-4b93-a862-8ada20c10ce4-sys-fs\") pod \"aws-ebs-csi-driver-node-bxvd8\" (UID: \"fc1d702b-774e-4b93-a862-8ada20c10ce4\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-bxvd8" Jul 13 02:57:00.135063 ip-10-0-134-52 kubenswrapper[2558]: I0713 02:57:00.134562 2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/d7c10797-d1f7-4e82-bd2b-f81f851f1407-systemd-units\") pod \"ovnkube-node-7m9bp\" (UID: \"d7c10797-d1f7-4e82-bd2b-f81f851f1407\") " pod="openshift-ovn-kubernetes/ovnkube-node-7m9bp" Jul 13 02:57:00.135063 ip-10-0-134-52 kubenswrapper[2558]: I0713 02:57:00.134559 2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/d7c10797-d1f7-4e82-bd2b-f81f851f1407-etc-openvswitch\") pod \"ovnkube-node-7m9bp\" (UID: \"d7c10797-d1f7-4e82-bd2b-f81f851f1407\") " pod="openshift-ovn-kubernetes/ovnkube-node-7m9bp" Jul 13 02:57:00.135063 ip-10-0-134-52 kubenswrapper[2558]: I0713 02:57:00.134582 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/fc1d702b-774e-4b93-a862-8ada20c10ce4-etc-selinux\") pod \"aws-ebs-csi-driver-node-bxvd8\" (UID: \"fc1d702b-774e-4b93-a862-8ada20c10ce4\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-bxvd8" Jul 13 02:57:00.135063 ip-10-0-134-52 kubenswrapper[2558]: I0713 02:57:00.134582 2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/e4bb1d1b-35fa-47b2-af3d-ec01bff3f7c0-serviceca\") pod \"node-ca-wpn4b\" (UID: \"e4bb1d1b-35fa-47b2-af3d-ec01bff3f7c0\") " pod="openshift-image-registry/node-ca-wpn4b" Jul 13 02:57:00.135063 ip-10-0-134-52 kubenswrapper[2558]: I0713 02:57:00.134647 2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/d7c10797-d1f7-4e82-bd2b-f81f851f1407-host-run-ovn-kubernetes\") pod \"ovnkube-node-7m9bp\" (UID: \"d7c10797-d1f7-4e82-bd2b-f81f851f1407\") " pod="openshift-ovn-kubernetes/ovnkube-node-7m9bp" Jul 13 02:57:00.135063 ip-10-0-134-52 kubenswrapper[2558]: I0713 02:57:00.134656 2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/fc1d702b-774e-4b93-a862-8ada20c10ce4-device-dir\") pod \"aws-ebs-csi-driver-node-bxvd8\" (UID: \"fc1d702b-774e-4b93-a862-8ada20c10ce4\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-bxvd8" Jul 13 02:57:00.135063 ip-10-0-134-52 kubenswrapper[2558]: I0713 02:57:00.134659 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/5b3dc970-19d3-43e8-9a7b-4062feb75c3e-dbus\") pod \"global-pull-secret-syncer-hf6cl\" (UID: \"5b3dc970-19d3-43e8-9a7b-4062feb75c3e\") " pod="kube-system/global-pull-secret-syncer-hf6cl" Jul 13 02:57:00.135063 ip-10-0-134-52 kubenswrapper[2558]: I0713 02:57:00.134700 2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/d7c10797-d1f7-4e82-bd2b-f81f851f1407-run-openvswitch\") pod \"ovnkube-node-7m9bp\" (UID: \"d7c10797-d1f7-4e82-bd2b-f81f851f1407\") " pod="openshift-ovn-kubernetes/ovnkube-node-7m9bp" Jul 13 02:57:00.135063 ip-10-0-134-52 kubenswrapper[2558]: I0713 02:57:00.134737 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/346339f5-1f30-46a0-a2aa-1ef007576943-host-slash\") pod \"iptables-alerter-px6ng\" (UID: \"346339f5-1f30-46a0-a2aa-1ef007576943\") " pod="openshift-network-operator/iptables-alerter-px6ng" Jul 13 02:57:00.136097 ip-10-0-134-52 kubenswrapper[2558]: I0713 02:57:00.134771 2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/346339f5-1f30-46a0-a2aa-1ef007576943-host-slash\") pod \"iptables-alerter-px6ng\" (UID: \"346339f5-1f30-46a0-a2aa-1ef007576943\") " pod="openshift-network-operator/iptables-alerter-px6ng" Jul 13 02:57:00.136097 ip-10-0-134-52 kubenswrapper[2558]: I0713 02:57:00.134782 2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/fc1d702b-774e-4b93-a862-8ada20c10ce4-etc-selinux\") pod \"aws-ebs-csi-driver-node-bxvd8\" (UID: \"fc1d702b-774e-4b93-a862-8ada20c10ce4\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-bxvd8" Jul 13 02:57:00.136097 ip-10-0-134-52 kubenswrapper[2558]: I0713 02:57:00.134783 2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/5b3dc970-19d3-43e8-9a7b-4062feb75c3e-dbus\") pod \"global-pull-secret-syncer-hf6cl\" (UID: \"5b3dc970-19d3-43e8-9a7b-4062feb75c3e\") " pod="kube-system/global-pull-secret-syncer-hf6cl" Jul 13 02:57:00.136097 ip-10-0-134-52 kubenswrapper[2558]: I0713 02:57:00.134788 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/d7c10797-d1f7-4e82-bd2b-f81f851f1407-host-slash\") pod \"ovnkube-node-7m9bp\" (UID: \"d7c10797-d1f7-4e82-bd2b-f81f851f1407\") " pod="openshift-ovn-kubernetes/ovnkube-node-7m9bp" Jul 13 02:57:00.136097 ip-10-0-134-52 kubenswrapper[2558]: I0713 02:57:00.134818 2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/d7c10797-d1f7-4e82-bd2b-f81f851f1407-host-slash\") pod \"ovnkube-node-7m9bp\" (UID: \"d7c10797-d1f7-4e82-bd2b-f81f851f1407\") " pod="openshift-ovn-kubernetes/ovnkube-node-7m9bp" Jul 13 02:57:00.136097 ip-10-0-134-52 kubenswrapper[2558]: I0713 02:57:00.134821 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/d7c10797-d1f7-4e82-bd2b-f81f851f1407-host-cni-bin\") pod \"ovnkube-node-7m9bp\" (UID: \"d7c10797-d1f7-4e82-bd2b-f81f851f1407\") " pod="openshift-ovn-kubernetes/ovnkube-node-7m9bp" Jul 13 02:57:00.136097 ip-10-0-134-52 kubenswrapper[2558]: I0713 02:57:00.134851 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/d7c10797-d1f7-4e82-bd2b-f81f851f1407-ovn-node-metrics-cert\") pod \"ovnkube-node-7m9bp\" (UID: \"d7c10797-d1f7-4e82-bd2b-f81f851f1407\") " pod="openshift-ovn-kubernetes/ovnkube-node-7m9bp" Jul 13 02:57:00.136097 ip-10-0-134-52 kubenswrapper[2558]: I0713 02:57:00.134857 2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/d7c10797-d1f7-4e82-bd2b-f81f851f1407-host-cni-bin\") pod \"ovnkube-node-7m9bp\" (UID: \"d7c10797-d1f7-4e82-bd2b-f81f851f1407\") " pod="openshift-ovn-kubernetes/ovnkube-node-7m9bp" Jul 13 02:57:00.136097 ip-10-0-134-52 kubenswrapper[2558]: I0713 02:57:00.134887 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/fc1d702b-774e-4b93-a862-8ada20c10ce4-kubelet-dir\") pod \"aws-ebs-csi-driver-node-bxvd8\" (UID: \"fc1d702b-774e-4b93-a862-8ada20c10ce4\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-bxvd8" Jul 13 02:57:00.136097 ip-10-0-134-52 kubenswrapper[2558]: I0713 02:57:00.134924 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-lf99x\" (UniqueName: \"kubernetes.io/projected/e4bb1d1b-35fa-47b2-af3d-ec01bff3f7c0-kube-api-access-lf99x\") pod \"node-ca-wpn4b\" (UID: \"e4bb1d1b-35fa-47b2-af3d-ec01bff3f7c0\") " pod="openshift-image-registry/node-ca-wpn4b" Jul 13 02:57:00.136097 ip-10-0-134-52 kubenswrapper[2558]: I0713 02:57:00.134950 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/d7c10797-d1f7-4e82-bd2b-f81f851f1407-host-kubelet\") pod \"ovnkube-node-7m9bp\" (UID: \"d7c10797-d1f7-4e82-bd2b-f81f851f1407\") " pod="openshift-ovn-kubernetes/ovnkube-node-7m9bp" Jul 13 02:57:00.136097 ip-10-0-134-52 kubenswrapper[2558]: I0713 02:57:00.134965 2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/fc1d702b-774e-4b93-a862-8ada20c10ce4-kubelet-dir\") pod \"aws-ebs-csi-driver-node-bxvd8\" (UID: \"fc1d702b-774e-4b93-a862-8ada20c10ce4\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-bxvd8" Jul 13 02:57:00.136097 ip-10-0-134-52 kubenswrapper[2558]: I0713 02:57:00.134976 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-zq5pf\" (UniqueName: \"kubernetes.io/projected/d7c10797-d1f7-4e82-bd2b-f81f851f1407-kube-api-access-zq5pf\") pod \"ovnkube-node-7m9bp\" (UID: \"d7c10797-d1f7-4e82-bd2b-f81f851f1407\") " pod="openshift-ovn-kubernetes/ovnkube-node-7m9bp" Jul 13 02:57:00.136097 ip-10-0-134-52 kubenswrapper[2558]: I0713 02:57:00.134974 2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/346339f5-1f30-46a0-a2aa-1ef007576943-iptables-alerter-script\") pod \"iptables-alerter-px6ng\" (UID: \"346339f5-1f30-46a0-a2aa-1ef007576943\") " pod="openshift-network-operator/iptables-alerter-px6ng" Jul 13 02:57:00.136097 ip-10-0-134-52 kubenswrapper[2558]: I0713 02:57:00.135060 2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/d7c10797-d1f7-4e82-bd2b-f81f851f1407-host-kubelet\") pod \"ovnkube-node-7m9bp\" (UID: \"d7c10797-d1f7-4e82-bd2b-f81f851f1407\") " pod="openshift-ovn-kubernetes/ovnkube-node-7m9bp" Jul 13 02:57:00.136097 ip-10-0-134-52 kubenswrapper[2558]: I0713 02:57:00.135105 2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/d7c10797-d1f7-4e82-bd2b-f81f851f1407-ovnkube-config\") pod \"ovnkube-node-7m9bp\" (UID: \"d7c10797-d1f7-4e82-bd2b-f81f851f1407\") " pod="openshift-ovn-kubernetes/ovnkube-node-7m9bp" Jul 13 02:57:00.136097 ip-10-0-134-52 kubenswrapper[2558]: I0713 02:57:00.135170 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-rk8np\" (UniqueName: \"kubernetes.io/projected/fc1d702b-774e-4b93-a862-8ada20c10ce4-kube-api-access-rk8np\") pod \"aws-ebs-csi-driver-node-bxvd8\" (UID: \"fc1d702b-774e-4b93-a862-8ada20c10ce4\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-bxvd8" Jul 13 02:57:00.137032 ip-10-0-134-52 kubenswrapper[2558]: I0713 02:57:00.135217 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/5b3dc970-19d3-43e8-9a7b-4062feb75c3e-original-pull-secret\") pod \"global-pull-secret-syncer-hf6cl\" (UID: \"5b3dc970-19d3-43e8-9a7b-4062feb75c3e\") " pod="kube-system/global-pull-secret-syncer-hf6cl" Jul 13 02:57:00.137032 ip-10-0-134-52 kubenswrapper[2558]: I0713 02:57:00.135233 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/d7c10797-d1f7-4e82-bd2b-f81f851f1407-var-lib-openvswitch\") pod \"ovnkube-node-7m9bp\" (UID: \"d7c10797-d1f7-4e82-bd2b-f81f851f1407\") " pod="openshift-ovn-kubernetes/ovnkube-node-7m9bp" Jul 13 02:57:00.137032 ip-10-0-134-52 kubenswrapper[2558]: I0713 02:57:00.135248 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/d7c10797-d1f7-4e82-bd2b-f81f851f1407-log-socket\") pod \"ovnkube-node-7m9bp\" (UID: \"d7c10797-d1f7-4e82-bd2b-f81f851f1407\") " pod="openshift-ovn-kubernetes/ovnkube-node-7m9bp" Jul 13 02:57:00.137032 ip-10-0-134-52 kubenswrapper[2558]: I0713 02:57:00.135312 2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/d7c10797-d1f7-4e82-bd2b-f81f851f1407-log-socket\") pod \"ovnkube-node-7m9bp\" (UID: \"d7c10797-d1f7-4e82-bd2b-f81f851f1407\") " pod="openshift-ovn-kubernetes/ovnkube-node-7m9bp" Jul 13 02:57:00.137032 ip-10-0-134-52 kubenswrapper[2558]: I0713 02:57:00.135370 2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/d7c10797-d1f7-4e82-bd2b-f81f851f1407-var-lib-openvswitch\") pod \"ovnkube-node-7m9bp\" (UID: \"d7c10797-d1f7-4e82-bd2b-f81f851f1407\") " pod="openshift-ovn-kubernetes/ovnkube-node-7m9bp" Jul 13 02:57:00.137032 ip-10-0-134-52 kubenswrapper[2558]: E0713 02:57:00.135387 2558 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jul 13 02:57:00.137032 ip-10-0-134-52 kubenswrapper[2558]: E0713 02:57:00.135462 2558 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/5b3dc970-19d3-43e8-9a7b-4062feb75c3e-original-pull-secret podName:5b3dc970-19d3-43e8-9a7b-4062feb75c3e nodeName:}" failed. No retries permitted until 2026-07-13 02:57:00.635445246 +0000 UTC m=+3.036045693 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/5b3dc970-19d3-43e8-9a7b-4062feb75c3e-original-pull-secret") pod "global-pull-secret-syncer-hf6cl" (UID: "5b3dc970-19d3-43e8-9a7b-4062feb75c3e") : object "kube-system"/"original-pull-secret" not registered Jul 13 02:57:00.138141 ip-10-0-134-52 kubenswrapper[2558]: I0713 02:57:00.138099 2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/fe52b12d-b43c-483f-8b5b-155c4330c953-agent-certs\") pod \"konnectivity-agent-pf2f6\" (UID: \"fe52b12d-b43c-483f-8b5b-155c4330c953\") " pod="kube-system/konnectivity-agent-pf2f6" Jul 13 02:57:00.139677 ip-10-0-134-52 kubenswrapper[2558]: I0713 02:57:00.139653 2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/d7c10797-d1f7-4e82-bd2b-f81f851f1407-ovn-node-metrics-cert\") pod \"ovnkube-node-7m9bp\" (UID: \"d7c10797-d1f7-4e82-bd2b-f81f851f1407\") " pod="openshift-ovn-kubernetes/ovnkube-node-7m9bp" Jul 13 02:57:00.143503 ip-10-0-134-52 kubenswrapper[2558]: E0713 02:57:00.143359 2558 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jul 13 02:57:00.143503 ip-10-0-134-52 kubenswrapper[2558]: E0713 02:57:00.143387 2558 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jul 13 02:57:00.143503 ip-10-0-134-52 kubenswrapper[2558]: E0713 02:57:00.143403 2558 projected.go:196] Error preparing data for projected volume kube-api-access-f6cnb for pod openshift-network-diagnostics/network-check-target-fdbpv: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 13 02:57:00.143503 ip-10-0-134-52 kubenswrapper[2558]: E0713 02:57:00.143465 2558 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/17234e1a-e139-4f9e-88fd-c679510cd0fb-kube-api-access-f6cnb podName:17234e1a-e139-4f9e-88fd-c679510cd0fb nodeName:}" failed. No retries permitted until 2026-07-13 02:57:00.643445576 +0000 UTC m=+3.044046040 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "kube-api-access-f6cnb" (UniqueName: "kubernetes.io/projected/17234e1a-e139-4f9e-88fd-c679510cd0fb-kube-api-access-f6cnb") pod "network-check-target-fdbpv" (UID: "17234e1a-e139-4f9e-88fd-c679510cd0fb") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 13 02:57:00.144378 ip-10-0-134-52 kubenswrapper[2558]: I0713 02:57:00.144342 2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-lf99x\" (UniqueName: \"kubernetes.io/projected/e4bb1d1b-35fa-47b2-af3d-ec01bff3f7c0-kube-api-access-lf99x\") pod \"node-ca-wpn4b\" (UID: \"e4bb1d1b-35fa-47b2-af3d-ec01bff3f7c0\") " pod="openshift-image-registry/node-ca-wpn4b" Jul 13 02:57:00.145461 ip-10-0-134-52 kubenswrapper[2558]: I0713 02:57:00.145438 2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-49cnb\" (UniqueName: \"kubernetes.io/projected/72ebddc5-a4ff-4e56-a65d-508775d02170-kube-api-access-49cnb\") pod \"network-metrics-daemon-jt47w\" (UID: \"72ebddc5-a4ff-4e56-a65d-508775d02170\") " pod="openshift-multus/network-metrics-daemon-jt47w" Jul 13 02:57:00.145560 ip-10-0-134-52 kubenswrapper[2558]: I0713 02:57:00.145496 2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-647vn\" (UniqueName: \"kubernetes.io/projected/346339f5-1f30-46a0-a2aa-1ef007576943-kube-api-access-647vn\") pod \"iptables-alerter-px6ng\" (UID: \"346339f5-1f30-46a0-a2aa-1ef007576943\") " pod="openshift-network-operator/iptables-alerter-px6ng" Jul 13 02:57:00.146086 ip-10-0-134-52 kubenswrapper[2558]: I0713 02:57:00.146058 2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-444fv\" (UniqueName: \"kubernetes.io/projected/84e7b9a8-6c63-4aeb-8249-5aae103cf5cc-kube-api-access-444fv\") pod \"node-resolver-ndddr\" (UID: \"84e7b9a8-6c63-4aeb-8249-5aae103cf5cc\") " pod="openshift-dns/node-resolver-ndddr" Jul 13 02:57:00.148482 ip-10-0-134-52 kubenswrapper[2558]: I0713 02:57:00.148462 2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-zq5pf\" (UniqueName: \"kubernetes.io/projected/d7c10797-d1f7-4e82-bd2b-f81f851f1407-kube-api-access-zq5pf\") pod \"ovnkube-node-7m9bp\" (UID: \"d7c10797-d1f7-4e82-bd2b-f81f851f1407\") " pod="openshift-ovn-kubernetes/ovnkube-node-7m9bp" Jul 13 02:57:00.148566 ip-10-0-134-52 kubenswrapper[2558]: I0713 02:57:00.148531 2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-rk8np\" (UniqueName: \"kubernetes.io/projected/fc1d702b-774e-4b93-a862-8ada20c10ce4-kube-api-access-rk8np\") pod \"aws-ebs-csi-driver-node-bxvd8\" (UID: \"fc1d702b-774e-4b93-a862-8ada20c10ce4\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-bxvd8" Jul 13 02:57:00.244522 ip-10-0-134-52 kubenswrapper[2558]: I0713 02:57:00.244452 2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-dvqmz" Jul 13 02:57:00.246004 ip-10-0-134-52 kubenswrapper[2558]: I0713 02:57:00.245981 2558 reflector.go:439] "Caches populated" type="*v1.RuntimeClass" reflector="k8s.io/client-go/informers/factory.go:160" Jul 13 02:57:00.263728 ip-10-0-134-52 kubenswrapper[2558]: I0713 02:57:00.263704 2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-node-tuning-operator/tuned-z7fz9" Jul 13 02:57:00.269147 ip-10-0-134-52 kubenswrapper[2558]: I0713 02:57:00.269126 2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-additional-cni-plugins-scthx" Jul 13 02:57:00.276041 ip-10-0-134-52 kubenswrapper[2558]: I0713 02:57:00.276023 2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/node-ca-wpn4b" Jul 13 02:57:00.284947 ip-10-0-134-52 kubenswrapper[2558]: I0713 02:57:00.284925 2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-bxvd8" Jul 13 02:57:00.293735 ip-10-0-134-52 kubenswrapper[2558]: I0713 02:57:00.293716 2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/konnectivity-agent-pf2f6" Jul 13 02:57:00.302490 ip-10-0-134-52 kubenswrapper[2558]: I0713 02:57:00.302471 2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/node-resolver-ndddr" Jul 13 02:57:00.313252 ip-10-0-134-52 kubenswrapper[2558]: I0713 02:57:00.313232 2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-operator/iptables-alerter-px6ng" Jul 13 02:57:00.320236 ip-10-0-134-52 kubenswrapper[2558]: I0713 02:57:00.320220 2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ovn-kubernetes/ovnkube-node-7m9bp" Jul 13 02:57:00.639216 ip-10-0-134-52 kubenswrapper[2558]: I0713 02:57:00.639132 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/72ebddc5-a4ff-4e56-a65d-508775d02170-metrics-certs\") pod \"network-metrics-daemon-jt47w\" (UID: \"72ebddc5-a4ff-4e56-a65d-508775d02170\") " pod="openshift-multus/network-metrics-daemon-jt47w" Jul 13 02:57:00.639216 ip-10-0-134-52 kubenswrapper[2558]: I0713 02:57:00.639197 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/5b3dc970-19d3-43e8-9a7b-4062feb75c3e-original-pull-secret\") pod \"global-pull-secret-syncer-hf6cl\" (UID: \"5b3dc970-19d3-43e8-9a7b-4062feb75c3e\") " pod="kube-system/global-pull-secret-syncer-hf6cl" Jul 13 02:57:00.639476 ip-10-0-134-52 kubenswrapper[2558]: E0713 02:57:00.639332 2558 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jul 13 02:57:00.639476 ip-10-0-134-52 kubenswrapper[2558]: E0713 02:57:00.639427 2558 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/5b3dc970-19d3-43e8-9a7b-4062feb75c3e-original-pull-secret podName:5b3dc970-19d3-43e8-9a7b-4062feb75c3e nodeName:}" failed. No retries permitted until 2026-07-13 02:57:01.639404515 +0000 UTC m=+4.040004960 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/5b3dc970-19d3-43e8-9a7b-4062feb75c3e-original-pull-secret") pod "global-pull-secret-syncer-hf6cl" (UID: "5b3dc970-19d3-43e8-9a7b-4062feb75c3e") : object "kube-system"/"original-pull-secret" not registered Jul 13 02:57:00.640013 ip-10-0-134-52 kubenswrapper[2558]: E0713 02:57:00.639992 2558 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jul 13 02:57:00.640110 ip-10-0-134-52 kubenswrapper[2558]: E0713 02:57:00.640040 2558 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/72ebddc5-a4ff-4e56-a65d-508775d02170-metrics-certs podName:72ebddc5-a4ff-4e56-a65d-508775d02170 nodeName:}" failed. No retries permitted until 2026-07-13 02:57:01.640027614 +0000 UTC m=+4.040628058 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/72ebddc5-a4ff-4e56-a65d-508775d02170-metrics-certs") pod "network-metrics-daemon-jt47w" (UID: "72ebddc5-a4ff-4e56-a65d-508775d02170") : object "openshift-multus"/"metrics-daemon-secret" not registered Jul 13 02:57:00.739852 ip-10-0-134-52 kubenswrapper[2558]: I0713 02:57:00.739822 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-f6cnb\" (UniqueName: \"kubernetes.io/projected/17234e1a-e139-4f9e-88fd-c679510cd0fb-kube-api-access-f6cnb\") pod \"network-check-target-fdbpv\" (UID: \"17234e1a-e139-4f9e-88fd-c679510cd0fb\") " pod="openshift-network-diagnostics/network-check-target-fdbpv" Jul 13 02:57:00.739993 ip-10-0-134-52 kubenswrapper[2558]: E0713 02:57:00.739943 2558 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jul 13 02:57:00.739993 ip-10-0-134-52 kubenswrapper[2558]: E0713 02:57:00.739960 2558 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jul 13 02:57:00.739993 ip-10-0-134-52 kubenswrapper[2558]: E0713 02:57:00.739970 2558 projected.go:196] Error preparing data for projected volume kube-api-access-f6cnb for pod openshift-network-diagnostics/network-check-target-fdbpv: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 13 02:57:00.740130 ip-10-0-134-52 kubenswrapper[2558]: E0713 02:57:00.740019 2558 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/17234e1a-e139-4f9e-88fd-c679510cd0fb-kube-api-access-f6cnb podName:17234e1a-e139-4f9e-88fd-c679510cd0fb nodeName:}" failed. No retries permitted until 2026-07-13 02:57:01.740006742 +0000 UTC m=+4.140607191 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "kube-api-access-f6cnb" (UniqueName: "kubernetes.io/projected/17234e1a-e139-4f9e-88fd-c679510cd0fb-kube-api-access-f6cnb") pod "network-check-target-fdbpv" (UID: "17234e1a-e139-4f9e-88fd-c679510cd0fb") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 13 02:57:01.038938 ip-10-0-134-52 kubenswrapper[2558]: I0713 02:57:01.038832 2558 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kubelet-serving" expiration="2028-07-12 02:52:00 +0000 UTC" deadline="2028-02-15 23:10:44.946482424 +0000 UTC" Jul 13 02:57:01.038938 ip-10-0-134-52 kubenswrapper[2558]: I0713 02:57:01.038889 2558 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kubelet-serving" sleep="13988h13m43.907603954s" Jul 13 02:57:01.193500 ip-10-0-134-52 kubenswrapper[2558]: W0713 02:57:01.193467 2558 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod16e70418_d340_4604_b23d_6e6bd736b72f.slice/crio-be20d1dfd67abe5d3da1b7b4b71774d829949d47c2ff7551950bd3cca63c3815 WatchSource:0}: Error finding container be20d1dfd67abe5d3da1b7b4b71774d829949d47c2ff7551950bd3cca63c3815: Status 404 returned error can't find the container with id be20d1dfd67abe5d3da1b7b4b71774d829949d47c2ff7551950bd3cca63c3815 Jul 13 02:57:01.194816 ip-10-0-134-52 kubenswrapper[2558]: W0713 02:57:01.194789 2558 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podd7c10797_d1f7_4e82_bd2b_f81f851f1407.slice/crio-6a53fcf9c3e25b345192b846eddd5ac025f623e589b5945cd96cf3e1a043787c WatchSource:0}: Error finding container 6a53fcf9c3e25b345192b846eddd5ac025f623e589b5945cd96cf3e1a043787c: Status 404 returned error can't find the container with id 6a53fcf9c3e25b345192b846eddd5ac025f623e589b5945cd96cf3e1a043787c Jul 13 02:57:01.196494 ip-10-0-134-52 kubenswrapper[2558]: W0713 02:57:01.196469 2558 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod93624b2e_1256_406d_892b_456a2b2cd0db.slice/crio-a5ccca7b4b72856576fc086dadea32a1f3797a223ff314e19255133ce2d2aae8 WatchSource:0}: Error finding container a5ccca7b4b72856576fc086dadea32a1f3797a223ff314e19255133ce2d2aae8: Status 404 returned error can't find the container with id a5ccca7b4b72856576fc086dadea32a1f3797a223ff314e19255133ce2d2aae8 Jul 13 02:57:01.199506 ip-10-0-134-52 kubenswrapper[2558]: W0713 02:57:01.199268 2558 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podfc1d702b_774e_4b93_a862_8ada20c10ce4.slice/crio-59618e42d4fc761cb23f8f765b984cc0b08c78fa650e395516bc04ee5e70c2f2 WatchSource:0}: Error finding container 59618e42d4fc761cb23f8f765b984cc0b08c78fa650e395516bc04ee5e70c2f2: Status 404 returned error can't find the container with id 59618e42d4fc761cb23f8f765b984cc0b08c78fa650e395516bc04ee5e70c2f2 Jul 13 02:57:01.201853 ip-10-0-134-52 kubenswrapper[2558]: W0713 02:57:01.201815 2558 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pode4bb1d1b_35fa_47b2_af3d_ec01bff3f7c0.slice/crio-cb5cab9b2865cade1f1e3cc3451a47cee2a12d1a752d2c0f5a0460f439994fed WatchSource:0}: Error finding container cb5cab9b2865cade1f1e3cc3451a47cee2a12d1a752d2c0f5a0460f439994fed: Status 404 returned error can't find the container with id cb5cab9b2865cade1f1e3cc3451a47cee2a12d1a752d2c0f5a0460f439994fed Jul 13 02:57:01.202562 ip-10-0-134-52 kubenswrapper[2558]: W0713 02:57:01.202537 2558 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pode81648db_3aac_4493_99c2_af21b4fcf2b5.slice/crio-2ab5d72db4b996580ae2f443c55ec7f5c8d5e39f0722e841abb71107b850e29a WatchSource:0}: Error finding container 2ab5d72db4b996580ae2f443c55ec7f5c8d5e39f0722e841abb71107b850e29a: Status 404 returned error can't find the container with id 2ab5d72db4b996580ae2f443c55ec7f5c8d5e39f0722e841abb71107b850e29a Jul 13 02:57:01.204228 ip-10-0-134-52 kubenswrapper[2558]: W0713 02:57:01.204204 2558 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod346339f5_1f30_46a0_a2aa_1ef007576943.slice/crio-32acab30e7549104f125a1e733effc1c33900f6b82b1b125c444304598943df4 WatchSource:0}: Error finding container 32acab30e7549104f125a1e733effc1c33900f6b82b1b125c444304598943df4: Status 404 returned error can't find the container with id 32acab30e7549104f125a1e733effc1c33900f6b82b1b125c444304598943df4 Jul 13 02:57:01.205779 ip-10-0-134-52 kubenswrapper[2558]: W0713 02:57:01.205633 2558 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod84e7b9a8_6c63_4aeb_8249_5aae103cf5cc.slice/crio-4a982f6da185e9f7f4a00bb3673e263d4d25dc842aa81f60c899cc0ad488f430 WatchSource:0}: Error finding container 4a982f6da185e9f7f4a00bb3673e263d4d25dc842aa81f60c899cc0ad488f430: Status 404 returned error can't find the container with id 4a982f6da185e9f7f4a00bb3673e263d4d25dc842aa81f60c899cc0ad488f430 Jul 13 02:57:01.241530 ip-10-0-134-52 kubenswrapper[2558]: W0713 02:57:01.241455 2558 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podfe52b12d_b43c_483f_8b5b_155c4330c953.slice/crio-2f40b6a0d40a8c2c84403b7db5b04ffde5da3e9a31e5b7564f78cab2bff04bf4 WatchSource:0}: Error finding container 2f40b6a0d40a8c2c84403b7db5b04ffde5da3e9a31e5b7564f78cab2bff04bf4: Status 404 returned error can't find the container with id 2f40b6a0d40a8c2c84403b7db5b04ffde5da3e9a31e5b7564f78cab2bff04bf4 Jul 13 02:57:01.647062 ip-10-0-134-52 kubenswrapper[2558]: I0713 02:57:01.646766 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/5b3dc970-19d3-43e8-9a7b-4062feb75c3e-original-pull-secret\") pod \"global-pull-secret-syncer-hf6cl\" (UID: \"5b3dc970-19d3-43e8-9a7b-4062feb75c3e\") " pod="kube-system/global-pull-secret-syncer-hf6cl" Jul 13 02:57:01.647198 ip-10-0-134-52 kubenswrapper[2558]: I0713 02:57:01.647073 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/72ebddc5-a4ff-4e56-a65d-508775d02170-metrics-certs\") pod \"network-metrics-daemon-jt47w\" (UID: \"72ebddc5-a4ff-4e56-a65d-508775d02170\") " pod="openshift-multus/network-metrics-daemon-jt47w" Jul 13 02:57:01.647198 ip-10-0-134-52 kubenswrapper[2558]: E0713 02:57:01.646928 2558 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jul 13 02:57:01.647198 ip-10-0-134-52 kubenswrapper[2558]: E0713 02:57:01.647160 2558 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/5b3dc970-19d3-43e8-9a7b-4062feb75c3e-original-pull-secret podName:5b3dc970-19d3-43e8-9a7b-4062feb75c3e nodeName:}" failed. No retries permitted until 2026-07-13 02:57:03.647140224 +0000 UTC m=+6.047740676 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/5b3dc970-19d3-43e8-9a7b-4062feb75c3e-original-pull-secret") pod "global-pull-secret-syncer-hf6cl" (UID: "5b3dc970-19d3-43e8-9a7b-4062feb75c3e") : object "kube-system"/"original-pull-secret" not registered Jul 13 02:57:01.647198 ip-10-0-134-52 kubenswrapper[2558]: E0713 02:57:01.647177 2558 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jul 13 02:57:01.647395 ip-10-0-134-52 kubenswrapper[2558]: E0713 02:57:01.647212 2558 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/72ebddc5-a4ff-4e56-a65d-508775d02170-metrics-certs podName:72ebddc5-a4ff-4e56-a65d-508775d02170 nodeName:}" failed. No retries permitted until 2026-07-13 02:57:03.647200995 +0000 UTC m=+6.047801441 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/72ebddc5-a4ff-4e56-a65d-508775d02170-metrics-certs") pod "network-metrics-daemon-jt47w" (UID: "72ebddc5-a4ff-4e56-a65d-508775d02170") : object "openshift-multus"/"metrics-daemon-secret" not registered Jul 13 02:57:01.748331 ip-10-0-134-52 kubenswrapper[2558]: I0713 02:57:01.748287 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-f6cnb\" (UniqueName: \"kubernetes.io/projected/17234e1a-e139-4f9e-88fd-c679510cd0fb-kube-api-access-f6cnb\") pod \"network-check-target-fdbpv\" (UID: \"17234e1a-e139-4f9e-88fd-c679510cd0fb\") " pod="openshift-network-diagnostics/network-check-target-fdbpv" Jul 13 02:57:01.748523 ip-10-0-134-52 kubenswrapper[2558]: E0713 02:57:01.748509 2558 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jul 13 02:57:01.748595 ip-10-0-134-52 kubenswrapper[2558]: E0713 02:57:01.748531 2558 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jul 13 02:57:01.748595 ip-10-0-134-52 kubenswrapper[2558]: E0713 02:57:01.748546 2558 projected.go:196] Error preparing data for projected volume kube-api-access-f6cnb for pod openshift-network-diagnostics/network-check-target-fdbpv: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 13 02:57:01.748693 ip-10-0-134-52 kubenswrapper[2558]: E0713 02:57:01.748608 2558 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/17234e1a-e139-4f9e-88fd-c679510cd0fb-kube-api-access-f6cnb podName:17234e1a-e139-4f9e-88fd-c679510cd0fb nodeName:}" failed. No retries permitted until 2026-07-13 02:57:03.748588582 +0000 UTC m=+6.149189051 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "kube-api-access-f6cnb" (UniqueName: "kubernetes.io/projected/17234e1a-e139-4f9e-88fd-c679510cd0fb-kube-api-access-f6cnb") pod "network-check-target-fdbpv" (UID: "17234e1a-e139-4f9e-88fd-c679510cd0fb") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 13 02:57:02.039939 ip-10-0-134-52 kubenswrapper[2558]: I0713 02:57:02.039793 2558 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kubelet-serving" expiration="2028-07-12 02:52:00 +0000 UTC" deadline="2028-01-02 07:44:35.488617384 +0000 UTC" Jul 13 02:57:02.039939 ip-10-0-134-52 kubenswrapper[2558]: I0713 02:57:02.039859 2558 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kubelet-serving" sleep="12916h47m33.448763183s" Jul 13 02:57:02.089514 ip-10-0-134-52 kubenswrapper[2558]: I0713 02:57:02.088548 2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-fdbpv" Jul 13 02:57:02.089514 ip-10-0-134-52 kubenswrapper[2558]: E0713 02:57:02.088703 2558 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-fdbpv" podUID="17234e1a-e139-4f9e-88fd-c679510cd0fb" Jul 13 02:57:02.089514 ip-10-0-134-52 kubenswrapper[2558]: I0713 02:57:02.089170 2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-jt47w" Jul 13 02:57:02.089514 ip-10-0-134-52 kubenswrapper[2558]: E0713 02:57:02.089296 2558 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-jt47w" podUID="72ebddc5-a4ff-4e56-a65d-508775d02170" Jul 13 02:57:02.089514 ip-10-0-134-52 kubenswrapper[2558]: I0713 02:57:02.089369 2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-hf6cl" Jul 13 02:57:02.089514 ip-10-0-134-52 kubenswrapper[2558]: E0713 02:57:02.089470 2558 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-hf6cl" podUID="5b3dc970-19d3-43e8-9a7b-4062feb75c3e" Jul 13 02:57:02.134697 ip-10-0-134-52 kubenswrapper[2558]: I0713 02:57:02.134574 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-node-tuning-operator/tuned-z7fz9" event={"ID":"93624b2e-1256-406d-892b-456a2b2cd0db","Type":"ContainerStarted","Data":"a5ccca7b4b72856576fc086dadea32a1f3797a223ff314e19255133ce2d2aae8"} Jul 13 02:57:02.148033 ip-10-0-134-52 kubenswrapper[2558]: I0713 02:57:02.147990 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-dvqmz" event={"ID":"e81648db-3aac-4493-99c2-af21b4fcf2b5","Type":"ContainerStarted","Data":"2ab5d72db4b996580ae2f443c55ec7f5c8d5e39f0722e841abb71107b850e29a"} Jul 13 02:57:02.151711 ip-10-0-134-52 kubenswrapper[2558]: I0713 02:57:02.151679 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/konnectivity-agent-pf2f6" event={"ID":"fe52b12d-b43c-483f-8b5b-155c4330c953","Type":"ContainerStarted","Data":"2f40b6a0d40a8c2c84403b7db5b04ffde5da3e9a31e5b7564f78cab2bff04bf4"} Jul 13 02:57:02.159180 ip-10-0-134-52 kubenswrapper[2558]: I0713 02:57:02.159152 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-operator/iptables-alerter-px6ng" event={"ID":"346339f5-1f30-46a0-a2aa-1ef007576943","Type":"ContainerStarted","Data":"32acab30e7549104f125a1e733effc1c33900f6b82b1b125c444304598943df4"} Jul 13 02:57:02.165105 ip-10-0-134-52 kubenswrapper[2558]: I0713 02:57:02.165077 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/node-ca-wpn4b" event={"ID":"e4bb1d1b-35fa-47b2-af3d-ec01bff3f7c0","Type":"ContainerStarted","Data":"cb5cab9b2865cade1f1e3cc3451a47cee2a12d1a752d2c0f5a0460f439994fed"} Jul 13 02:57:02.175206 ip-10-0-134-52 kubenswrapper[2558]: I0713 02:57:02.175181 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-7m9bp" event={"ID":"d7c10797-d1f7-4e82-bd2b-f81f851f1407","Type":"ContainerStarted","Data":"6a53fcf9c3e25b345192b846eddd5ac025f623e589b5945cd96cf3e1a043787c"} Jul 13 02:57:02.179357 ip-10-0-134-52 kubenswrapper[2558]: I0713 02:57:02.179306 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-scthx" event={"ID":"16e70418-d340-4604-b23d-6e6bd736b72f","Type":"ContainerStarted","Data":"be20d1dfd67abe5d3da1b7b4b71774d829949d47c2ff7551950bd3cca63c3815"} Jul 13 02:57:02.207580 ip-10-0-134-52 kubenswrapper[2558]: I0713 02:57:02.206893 2558 generic.go:356] "Generic (PLEG): container finished" podID="98adcf0180580c6711a29c73caa90e67" containerID="ac70a7df7e64dee60c9a3718fd5ee4c58e41f7ed9de4b05933141a8e76f7c22b" exitCode=0 Jul 13 02:57:02.207580 ip-10-0-134-52 kubenswrapper[2558]: I0713 02:57:02.207462 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-134-52.ec2.internal" event={"ID":"98adcf0180580c6711a29c73caa90e67","Type":"ContainerDied","Data":"ac70a7df7e64dee60c9a3718fd5ee4c58e41f7ed9de4b05933141a8e76f7c22b"} Jul 13 02:57:02.237785 ip-10-0-134-52 kubenswrapper[2558]: I0713 02:57:02.237478 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-134-52.ec2.internal" event={"ID":"c2b195f03ef2d8abb371e44a8b3b8700","Type":"ContainerStarted","Data":"9da7dae86e881a32970dd799d661375396e6778d45d3d8a98ebf39776da752b1"} Jul 13 02:57:02.250565 ip-10-0-134-52 kubenswrapper[2558]: I0713 02:57:02.250501 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/node-resolver-ndddr" event={"ID":"84e7b9a8-6c63-4aeb-8249-5aae103cf5cc","Type":"ContainerStarted","Data":"4a982f6da185e9f7f4a00bb3673e263d4d25dc842aa81f60c899cc0ad488f430"} Jul 13 02:57:02.254169 ip-10-0-134-52 kubenswrapper[2558]: I0713 02:57:02.254140 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-bxvd8" event={"ID":"fc1d702b-774e-4b93-a862-8ada20c10ce4","Type":"ContainerStarted","Data":"59618e42d4fc761cb23f8f765b984cc0b08c78fa650e395516bc04ee5e70c2f2"} Jul 13 02:57:02.256004 ip-10-0-134-52 kubenswrapper[2558]: I0713 02:57:02.255952 2558 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/kube-apiserver-proxy-ip-10-0-134-52.ec2.internal" podStartSLOduration=2.255934221 podStartE2EDuration="2.255934221s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-13 02:57:00 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-13 02:57:02.254809367 +0000 UTC m=+4.655409839" watchObservedRunningTime="2026-07-13 02:57:02.255934221 +0000 UTC m=+4.656534692" Jul 13 02:57:03.265547 ip-10-0-134-52 kubenswrapper[2558]: I0713 02:57:03.265511 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-134-52.ec2.internal" event={"ID":"98adcf0180580c6711a29c73caa90e67","Type":"ContainerStarted","Data":"790b8c486c352d67398acf726b4f679710c8b2f8c7bb5fb17f08d233dabddf25"} Jul 13 02:57:03.283893 ip-10-0-134-52 kubenswrapper[2558]: I0713 02:57:03.283836 2558 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-134-52.ec2.internal" podStartSLOduration=3.283814764 podStartE2EDuration="3.283814764s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-13 02:57:00 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-13 02:57:03.283561506 +0000 UTC m=+5.684161988" watchObservedRunningTime="2026-07-13 02:57:03.283814764 +0000 UTC m=+5.684415235" Jul 13 02:57:03.666242 ip-10-0-134-52 kubenswrapper[2558]: I0713 02:57:03.666141 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/72ebddc5-a4ff-4e56-a65d-508775d02170-metrics-certs\") pod \"network-metrics-daemon-jt47w\" (UID: \"72ebddc5-a4ff-4e56-a65d-508775d02170\") " pod="openshift-multus/network-metrics-daemon-jt47w" Jul 13 02:57:03.666242 ip-10-0-134-52 kubenswrapper[2558]: I0713 02:57:03.666209 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/5b3dc970-19d3-43e8-9a7b-4062feb75c3e-original-pull-secret\") pod \"global-pull-secret-syncer-hf6cl\" (UID: \"5b3dc970-19d3-43e8-9a7b-4062feb75c3e\") " pod="kube-system/global-pull-secret-syncer-hf6cl" Jul 13 02:57:03.666503 ip-10-0-134-52 kubenswrapper[2558]: E0713 02:57:03.666361 2558 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jul 13 02:57:03.666503 ip-10-0-134-52 kubenswrapper[2558]: E0713 02:57:03.666495 2558 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/5b3dc970-19d3-43e8-9a7b-4062feb75c3e-original-pull-secret podName:5b3dc970-19d3-43e8-9a7b-4062feb75c3e nodeName:}" failed. No retries permitted until 2026-07-13 02:57:07.666474616 +0000 UTC m=+10.067075062 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/5b3dc970-19d3-43e8-9a7b-4062feb75c3e-original-pull-secret") pod "global-pull-secret-syncer-hf6cl" (UID: "5b3dc970-19d3-43e8-9a7b-4062feb75c3e") : object "kube-system"/"original-pull-secret" not registered Jul 13 02:57:03.666644 ip-10-0-134-52 kubenswrapper[2558]: E0713 02:57:03.666573 2558 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jul 13 02:57:03.666644 ip-10-0-134-52 kubenswrapper[2558]: E0713 02:57:03.666609 2558 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/72ebddc5-a4ff-4e56-a65d-508775d02170-metrics-certs podName:72ebddc5-a4ff-4e56-a65d-508775d02170 nodeName:}" failed. No retries permitted until 2026-07-13 02:57:07.666598206 +0000 UTC m=+10.067198655 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/72ebddc5-a4ff-4e56-a65d-508775d02170-metrics-certs") pod "network-metrics-daemon-jt47w" (UID: "72ebddc5-a4ff-4e56-a65d-508775d02170") : object "openshift-multus"/"metrics-daemon-secret" not registered Jul 13 02:57:03.768066 ip-10-0-134-52 kubenswrapper[2558]: I0713 02:57:03.767426 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-f6cnb\" (UniqueName: \"kubernetes.io/projected/17234e1a-e139-4f9e-88fd-c679510cd0fb-kube-api-access-f6cnb\") pod \"network-check-target-fdbpv\" (UID: \"17234e1a-e139-4f9e-88fd-c679510cd0fb\") " pod="openshift-network-diagnostics/network-check-target-fdbpv" Jul 13 02:57:03.768066 ip-10-0-134-52 kubenswrapper[2558]: E0713 02:57:03.767615 2558 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jul 13 02:57:03.768066 ip-10-0-134-52 kubenswrapper[2558]: E0713 02:57:03.767637 2558 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jul 13 02:57:03.768066 ip-10-0-134-52 kubenswrapper[2558]: E0713 02:57:03.767650 2558 projected.go:196] Error preparing data for projected volume kube-api-access-f6cnb for pod openshift-network-diagnostics/network-check-target-fdbpv: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 13 02:57:03.768066 ip-10-0-134-52 kubenswrapper[2558]: E0713 02:57:03.767709 2558 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/17234e1a-e139-4f9e-88fd-c679510cd0fb-kube-api-access-f6cnb podName:17234e1a-e139-4f9e-88fd-c679510cd0fb nodeName:}" failed. No retries permitted until 2026-07-13 02:57:07.767689455 +0000 UTC m=+10.168289918 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "kube-api-access-f6cnb" (UniqueName: "kubernetes.io/projected/17234e1a-e139-4f9e-88fd-c679510cd0fb-kube-api-access-f6cnb") pod "network-check-target-fdbpv" (UID: "17234e1a-e139-4f9e-88fd-c679510cd0fb") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 13 02:57:04.087329 ip-10-0-134-52 kubenswrapper[2558]: I0713 02:57:04.087249 2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-fdbpv" Jul 13 02:57:04.087329 ip-10-0-134-52 kubenswrapper[2558]: I0713 02:57:04.087284 2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-hf6cl" Jul 13 02:57:04.087669 ip-10-0-134-52 kubenswrapper[2558]: I0713 02:57:04.087249 2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-jt47w" Jul 13 02:57:04.087669 ip-10-0-134-52 kubenswrapper[2558]: E0713 02:57:04.087384 2558 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-fdbpv" podUID="17234e1a-e139-4f9e-88fd-c679510cd0fb" Jul 13 02:57:04.087669 ip-10-0-134-52 kubenswrapper[2558]: E0713 02:57:04.087483 2558 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-jt47w" podUID="72ebddc5-a4ff-4e56-a65d-508775d02170" Jul 13 02:57:04.087669 ip-10-0-134-52 kubenswrapper[2558]: E0713 02:57:04.087567 2558 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-hf6cl" podUID="5b3dc970-19d3-43e8-9a7b-4062feb75c3e" Jul 13 02:57:06.089581 ip-10-0-134-52 kubenswrapper[2558]: I0713 02:57:06.089529 2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-fdbpv" Jul 13 02:57:06.090033 ip-10-0-134-52 kubenswrapper[2558]: E0713 02:57:06.089661 2558 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-fdbpv" podUID="17234e1a-e139-4f9e-88fd-c679510cd0fb" Jul 13 02:57:06.090119 ip-10-0-134-52 kubenswrapper[2558]: I0713 02:57:06.090097 2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-jt47w" Jul 13 02:57:06.090176 ip-10-0-134-52 kubenswrapper[2558]: I0713 02:57:06.090128 2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-hf6cl" Jul 13 02:57:06.090277 ip-10-0-134-52 kubenswrapper[2558]: E0713 02:57:06.090228 2558 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-jt47w" podUID="72ebddc5-a4ff-4e56-a65d-508775d02170" Jul 13 02:57:06.090365 ip-10-0-134-52 kubenswrapper[2558]: E0713 02:57:06.090320 2558 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-hf6cl" podUID="5b3dc970-19d3-43e8-9a7b-4062feb75c3e" Jul 13 02:57:07.699939 ip-10-0-134-52 kubenswrapper[2558]: I0713 02:57:07.699897 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/5b3dc970-19d3-43e8-9a7b-4062feb75c3e-original-pull-secret\") pod \"global-pull-secret-syncer-hf6cl\" (UID: \"5b3dc970-19d3-43e8-9a7b-4062feb75c3e\") " pod="kube-system/global-pull-secret-syncer-hf6cl" Jul 13 02:57:07.700434 ip-10-0-134-52 kubenswrapper[2558]: I0713 02:57:07.700003 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/72ebddc5-a4ff-4e56-a65d-508775d02170-metrics-certs\") pod \"network-metrics-daemon-jt47w\" (UID: \"72ebddc5-a4ff-4e56-a65d-508775d02170\") " pod="openshift-multus/network-metrics-daemon-jt47w" Jul 13 02:57:07.700434 ip-10-0-134-52 kubenswrapper[2558]: E0713 02:57:07.700054 2558 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jul 13 02:57:07.700434 ip-10-0-134-52 kubenswrapper[2558]: E0713 02:57:07.700129 2558 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jul 13 02:57:07.700434 ip-10-0-134-52 kubenswrapper[2558]: E0713 02:57:07.700149 2558 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/5b3dc970-19d3-43e8-9a7b-4062feb75c3e-original-pull-secret podName:5b3dc970-19d3-43e8-9a7b-4062feb75c3e nodeName:}" failed. No retries permitted until 2026-07-13 02:57:15.700127627 +0000 UTC m=+18.100728079 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/5b3dc970-19d3-43e8-9a7b-4062feb75c3e-original-pull-secret") pod "global-pull-secret-syncer-hf6cl" (UID: "5b3dc970-19d3-43e8-9a7b-4062feb75c3e") : object "kube-system"/"original-pull-secret" not registered Jul 13 02:57:07.700434 ip-10-0-134-52 kubenswrapper[2558]: E0713 02:57:07.700186 2558 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/72ebddc5-a4ff-4e56-a65d-508775d02170-metrics-certs podName:72ebddc5-a4ff-4e56-a65d-508775d02170 nodeName:}" failed. No retries permitted until 2026-07-13 02:57:15.700168935 +0000 UTC m=+18.100769397 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/72ebddc5-a4ff-4e56-a65d-508775d02170-metrics-certs") pod "network-metrics-daemon-jt47w" (UID: "72ebddc5-a4ff-4e56-a65d-508775d02170") : object "openshift-multus"/"metrics-daemon-secret" not registered Jul 13 02:57:07.800936 ip-10-0-134-52 kubenswrapper[2558]: I0713 02:57:07.800901 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-f6cnb\" (UniqueName: \"kubernetes.io/projected/17234e1a-e139-4f9e-88fd-c679510cd0fb-kube-api-access-f6cnb\") pod \"network-check-target-fdbpv\" (UID: \"17234e1a-e139-4f9e-88fd-c679510cd0fb\") " pod="openshift-network-diagnostics/network-check-target-fdbpv" Jul 13 02:57:07.801125 ip-10-0-134-52 kubenswrapper[2558]: E0713 02:57:07.801077 2558 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jul 13 02:57:07.801125 ip-10-0-134-52 kubenswrapper[2558]: E0713 02:57:07.801095 2558 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jul 13 02:57:07.801125 ip-10-0-134-52 kubenswrapper[2558]: E0713 02:57:07.801106 2558 projected.go:196] Error preparing data for projected volume kube-api-access-f6cnb for pod openshift-network-diagnostics/network-check-target-fdbpv: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 13 02:57:07.801299 ip-10-0-134-52 kubenswrapper[2558]: E0713 02:57:07.801187 2558 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/17234e1a-e139-4f9e-88fd-c679510cd0fb-kube-api-access-f6cnb podName:17234e1a-e139-4f9e-88fd-c679510cd0fb nodeName:}" failed. No retries permitted until 2026-07-13 02:57:15.801151391 +0000 UTC m=+18.201751842 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "kube-api-access-f6cnb" (UniqueName: "kubernetes.io/projected/17234e1a-e139-4f9e-88fd-c679510cd0fb-kube-api-access-f6cnb") pod "network-check-target-fdbpv" (UID: "17234e1a-e139-4f9e-88fd-c679510cd0fb") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 13 02:57:08.089623 ip-10-0-134-52 kubenswrapper[2558]: I0713 02:57:08.089536 2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-jt47w" Jul 13 02:57:08.089623 ip-10-0-134-52 kubenswrapper[2558]: I0713 02:57:08.089541 2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-fdbpv" Jul 13 02:57:08.089623 ip-10-0-134-52 kubenswrapper[2558]: I0713 02:57:08.089550 2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-hf6cl" Jul 13 02:57:08.090672 ip-10-0-134-52 kubenswrapper[2558]: E0713 02:57:08.090642 2558 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-jt47w" podUID="72ebddc5-a4ff-4e56-a65d-508775d02170" Jul 13 02:57:08.090824 ip-10-0-134-52 kubenswrapper[2558]: E0713 02:57:08.090786 2558 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-fdbpv" podUID="17234e1a-e139-4f9e-88fd-c679510cd0fb" Jul 13 02:57:08.090887 ip-10-0-134-52 kubenswrapper[2558]: E0713 02:57:08.090873 2558 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-hf6cl" podUID="5b3dc970-19d3-43e8-9a7b-4062feb75c3e" Jul 13 02:57:10.090444 ip-10-0-134-52 kubenswrapper[2558]: I0713 02:57:10.089949 2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-fdbpv" Jul 13 02:57:10.090444 ip-10-0-134-52 kubenswrapper[2558]: I0713 02:57:10.090063 2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-jt47w" Jul 13 02:57:10.090444 ip-10-0-134-52 kubenswrapper[2558]: E0713 02:57:10.090076 2558 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-fdbpv" podUID="17234e1a-e139-4f9e-88fd-c679510cd0fb" Jul 13 02:57:10.090444 ip-10-0-134-52 kubenswrapper[2558]: I0713 02:57:10.090099 2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-hf6cl" Jul 13 02:57:10.090444 ip-10-0-134-52 kubenswrapper[2558]: E0713 02:57:10.090198 2558 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-jt47w" podUID="72ebddc5-a4ff-4e56-a65d-508775d02170" Jul 13 02:57:10.090444 ip-10-0-134-52 kubenswrapper[2558]: E0713 02:57:10.090273 2558 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-hf6cl" podUID="5b3dc970-19d3-43e8-9a7b-4062feb75c3e" Jul 13 02:57:12.087218 ip-10-0-134-52 kubenswrapper[2558]: I0713 02:57:12.087178 2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-jt47w" Jul 13 02:57:12.087218 ip-10-0-134-52 kubenswrapper[2558]: I0713 02:57:12.087204 2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-fdbpv" Jul 13 02:57:12.087719 ip-10-0-134-52 kubenswrapper[2558]: I0713 02:57:12.087260 2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-hf6cl" Jul 13 02:57:12.087719 ip-10-0-134-52 kubenswrapper[2558]: E0713 02:57:12.087393 2558 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-jt47w" podUID="72ebddc5-a4ff-4e56-a65d-508775d02170" Jul 13 02:57:12.087719 ip-10-0-134-52 kubenswrapper[2558]: E0713 02:57:12.087538 2558 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-hf6cl" podUID="5b3dc970-19d3-43e8-9a7b-4062feb75c3e" Jul 13 02:57:12.087719 ip-10-0-134-52 kubenswrapper[2558]: E0713 02:57:12.087625 2558 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-fdbpv" podUID="17234e1a-e139-4f9e-88fd-c679510cd0fb" Jul 13 02:57:14.087393 ip-10-0-134-52 kubenswrapper[2558]: I0713 02:57:14.087347 2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-jt47w" Jul 13 02:57:14.087825 ip-10-0-134-52 kubenswrapper[2558]: I0713 02:57:14.087350 2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-hf6cl" Jul 13 02:57:14.087825 ip-10-0-134-52 kubenswrapper[2558]: E0713 02:57:14.087483 2558 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-jt47w" podUID="72ebddc5-a4ff-4e56-a65d-508775d02170" Jul 13 02:57:14.087825 ip-10-0-134-52 kubenswrapper[2558]: I0713 02:57:14.087368 2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-fdbpv" Jul 13 02:57:14.087825 ip-10-0-134-52 kubenswrapper[2558]: E0713 02:57:14.087559 2558 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-hf6cl" podUID="5b3dc970-19d3-43e8-9a7b-4062feb75c3e" Jul 13 02:57:14.087825 ip-10-0-134-52 kubenswrapper[2558]: E0713 02:57:14.087643 2558 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-fdbpv" podUID="17234e1a-e139-4f9e-88fd-c679510cd0fb" Jul 13 02:57:15.761844 ip-10-0-134-52 kubenswrapper[2558]: I0713 02:57:15.761806 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/72ebddc5-a4ff-4e56-a65d-508775d02170-metrics-certs\") pod \"network-metrics-daemon-jt47w\" (UID: \"72ebddc5-a4ff-4e56-a65d-508775d02170\") " pod="openshift-multus/network-metrics-daemon-jt47w" Jul 13 02:57:15.762356 ip-10-0-134-52 kubenswrapper[2558]: I0713 02:57:15.761868 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/5b3dc970-19d3-43e8-9a7b-4062feb75c3e-original-pull-secret\") pod \"global-pull-secret-syncer-hf6cl\" (UID: \"5b3dc970-19d3-43e8-9a7b-4062feb75c3e\") " pod="kube-system/global-pull-secret-syncer-hf6cl" Jul 13 02:57:15.762356 ip-10-0-134-52 kubenswrapper[2558]: E0713 02:57:15.761977 2558 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jul 13 02:57:15.762356 ip-10-0-134-52 kubenswrapper[2558]: E0713 02:57:15.761985 2558 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jul 13 02:57:15.762356 ip-10-0-134-52 kubenswrapper[2558]: E0713 02:57:15.762041 2558 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/5b3dc970-19d3-43e8-9a7b-4062feb75c3e-original-pull-secret podName:5b3dc970-19d3-43e8-9a7b-4062feb75c3e nodeName:}" failed. No retries permitted until 2026-07-13 02:57:31.762022446 +0000 UTC m=+34.162622890 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/5b3dc970-19d3-43e8-9a7b-4062feb75c3e-original-pull-secret") pod "global-pull-secret-syncer-hf6cl" (UID: "5b3dc970-19d3-43e8-9a7b-4062feb75c3e") : object "kube-system"/"original-pull-secret" not registered Jul 13 02:57:15.762356 ip-10-0-134-52 kubenswrapper[2558]: E0713 02:57:15.762062 2558 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/72ebddc5-a4ff-4e56-a65d-508775d02170-metrics-certs podName:72ebddc5-a4ff-4e56-a65d-508775d02170 nodeName:}" failed. No retries permitted until 2026-07-13 02:57:31.762051959 +0000 UTC m=+34.162652403 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/72ebddc5-a4ff-4e56-a65d-508775d02170-metrics-certs") pod "network-metrics-daemon-jt47w" (UID: "72ebddc5-a4ff-4e56-a65d-508775d02170") : object "openshift-multus"/"metrics-daemon-secret" not registered Jul 13 02:57:15.863005 ip-10-0-134-52 kubenswrapper[2558]: I0713 02:57:15.862966 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-f6cnb\" (UniqueName: \"kubernetes.io/projected/17234e1a-e139-4f9e-88fd-c679510cd0fb-kube-api-access-f6cnb\") pod \"network-check-target-fdbpv\" (UID: \"17234e1a-e139-4f9e-88fd-c679510cd0fb\") " pod="openshift-network-diagnostics/network-check-target-fdbpv" Jul 13 02:57:15.863148 ip-10-0-134-52 kubenswrapper[2558]: E0713 02:57:15.863095 2558 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jul 13 02:57:15.863148 ip-10-0-134-52 kubenswrapper[2558]: E0713 02:57:15.863110 2558 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jul 13 02:57:15.863148 ip-10-0-134-52 kubenswrapper[2558]: E0713 02:57:15.863119 2558 projected.go:196] Error preparing data for projected volume kube-api-access-f6cnb for pod openshift-network-diagnostics/network-check-target-fdbpv: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 13 02:57:15.863278 ip-10-0-134-52 kubenswrapper[2558]: E0713 02:57:15.863164 2558 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/17234e1a-e139-4f9e-88fd-c679510cd0fb-kube-api-access-f6cnb podName:17234e1a-e139-4f9e-88fd-c679510cd0fb nodeName:}" failed. No retries permitted until 2026-07-13 02:57:31.863152404 +0000 UTC m=+34.263752848 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "kube-api-access-f6cnb" (UniqueName: "kubernetes.io/projected/17234e1a-e139-4f9e-88fd-c679510cd0fb-kube-api-access-f6cnb") pod "network-check-target-fdbpv" (UID: "17234e1a-e139-4f9e-88fd-c679510cd0fb") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 13 02:57:16.086944 ip-10-0-134-52 kubenswrapper[2558]: I0713 02:57:16.086869 2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-hf6cl" Jul 13 02:57:16.086944 ip-10-0-134-52 kubenswrapper[2558]: I0713 02:57:16.086881 2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-fdbpv" Jul 13 02:57:16.086944 ip-10-0-134-52 kubenswrapper[2558]: I0713 02:57:16.086893 2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-jt47w" Jul 13 02:57:16.087188 ip-10-0-134-52 kubenswrapper[2558]: E0713 02:57:16.086987 2558 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-hf6cl" podUID="5b3dc970-19d3-43e8-9a7b-4062feb75c3e" Jul 13 02:57:16.087188 ip-10-0-134-52 kubenswrapper[2558]: E0713 02:57:16.087051 2558 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-jt47w" podUID="72ebddc5-a4ff-4e56-a65d-508775d02170" Jul 13 02:57:16.087188 ip-10-0-134-52 kubenswrapper[2558]: E0713 02:57:16.087123 2558 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-fdbpv" podUID="17234e1a-e139-4f9e-88fd-c679510cd0fb" Jul 13 02:57:18.088320 ip-10-0-134-52 kubenswrapper[2558]: I0713 02:57:18.088285 2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-fdbpv" Jul 13 02:57:18.088821 ip-10-0-134-52 kubenswrapper[2558]: E0713 02:57:18.088402 2558 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-fdbpv" podUID="17234e1a-e139-4f9e-88fd-c679510cd0fb" Jul 13 02:57:18.088821 ip-10-0-134-52 kubenswrapper[2558]: I0713 02:57:18.088443 2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-jt47w" Jul 13 02:57:18.088821 ip-10-0-134-52 kubenswrapper[2558]: I0713 02:57:18.088498 2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-hf6cl" Jul 13 02:57:18.088821 ip-10-0-134-52 kubenswrapper[2558]: E0713 02:57:18.088574 2558 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-hf6cl" podUID="5b3dc970-19d3-43e8-9a7b-4062feb75c3e" Jul 13 02:57:18.088821 ip-10-0-134-52 kubenswrapper[2558]: E0713 02:57:18.088647 2558 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-jt47w" podUID="72ebddc5-a4ff-4e56-a65d-508775d02170" Jul 13 02:57:20.087753 ip-10-0-134-52 kubenswrapper[2558]: I0713 02:57:20.087723 2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-fdbpv" Jul 13 02:57:20.087753 ip-10-0-134-52 kubenswrapper[2558]: I0713 02:57:20.087744 2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-jt47w" Jul 13 02:57:20.088360 ip-10-0-134-52 kubenswrapper[2558]: E0713 02:57:20.087849 2558 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-fdbpv" podUID="17234e1a-e139-4f9e-88fd-c679510cd0fb" Jul 13 02:57:20.088360 ip-10-0-134-52 kubenswrapper[2558]: E0713 02:57:20.088311 2558 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-jt47w" podUID="72ebddc5-a4ff-4e56-a65d-508775d02170" Jul 13 02:57:20.088562 ip-10-0-134-52 kubenswrapper[2558]: I0713 02:57:20.088531 2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-hf6cl" Jul 13 02:57:20.088755 ip-10-0-134-52 kubenswrapper[2558]: E0713 02:57:20.088724 2558 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-hf6cl" podUID="5b3dc970-19d3-43e8-9a7b-4062feb75c3e" Jul 13 02:57:21.305415 ip-10-0-134-52 kubenswrapper[2558]: I0713 02:57:21.305163 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-dvqmz" event={"ID":"e81648db-3aac-4493-99c2-af21b4fcf2b5","Type":"ContainerStarted","Data":"ebc2251a9169f04a2cc3d9c91925f8876d0e93e05bb6b57dd3731e6237767e53"} Jul 13 02:57:21.306854 ip-10-0-134-52 kubenswrapper[2558]: I0713 02:57:21.306826 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/konnectivity-agent-pf2f6" event={"ID":"fe52b12d-b43c-483f-8b5b-155c4330c953","Type":"ContainerStarted","Data":"e0d64d81e03b52093c857f77c124cbd622ab1633914542896c06d547d70037d6"} Jul 13 02:57:21.308358 ip-10-0-134-52 kubenswrapper[2558]: I0713 02:57:21.308299 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/node-ca-wpn4b" event={"ID":"e4bb1d1b-35fa-47b2-af3d-ec01bff3f7c0","Type":"ContainerStarted","Data":"cdbedcbb15e61ec0005d5b17636bee2a0342741763129b9ef16e5725eacd56b6"} Jul 13 02:57:21.313825 ip-10-0-134-52 kubenswrapper[2558]: I0713 02:57:21.313804 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-7m9bp" event={"ID":"d7c10797-d1f7-4e82-bd2b-f81f851f1407","Type":"ContainerStarted","Data":"4010b96bfaf822a53e7579aa0525b007dd1e114903746f852194cab958a918a4"} Jul 13 02:57:21.313907 ip-10-0-134-52 kubenswrapper[2558]: I0713 02:57:21.313888 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-7m9bp" event={"ID":"d7c10797-d1f7-4e82-bd2b-f81f851f1407","Type":"ContainerStarted","Data":"16e2695696c31aa158d9724f36fa34a0ffdf336c0664ad2077ffb4b0e86a81c7"} Jul 13 02:57:21.313962 ip-10-0-134-52 kubenswrapper[2558]: I0713 02:57:21.313929 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-7m9bp" event={"ID":"d7c10797-d1f7-4e82-bd2b-f81f851f1407","Type":"ContainerStarted","Data":"226a7f9df47b9f54b284e61cfdf69c8142fb7355ece9964fdfcaeca8129fd263"} Jul 13 02:57:21.313962 ip-10-0-134-52 kubenswrapper[2558]: I0713 02:57:21.313957 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-7m9bp" event={"ID":"d7c10797-d1f7-4e82-bd2b-f81f851f1407","Type":"ContainerStarted","Data":"08b8d9c0bfddd1f41d1c6f1abe5bb038b0f79d5793d897ddc550c81b6003d03b"} Jul 13 02:57:21.315343 ip-10-0-134-52 kubenswrapper[2558]: I0713 02:57:21.315304 2558 generic.go:356] "Generic (PLEG): container finished" podID="16e70418-d340-4604-b23d-6e6bd736b72f" containerID="6745c41bf6190c9e1d74319defb3ef9c689717b0f12dba8aedee86a070987ffa" exitCode=0 Jul 13 02:57:21.315448 ip-10-0-134-52 kubenswrapper[2558]: I0713 02:57:21.315358 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-scthx" event={"ID":"16e70418-d340-4604-b23d-6e6bd736b72f","Type":"ContainerDied","Data":"6745c41bf6190c9e1d74319defb3ef9c689717b0f12dba8aedee86a070987ffa"} Jul 13 02:57:21.316729 ip-10-0-134-52 kubenswrapper[2558]: I0713 02:57:21.316710 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/node-resolver-ndddr" event={"ID":"84e7b9a8-6c63-4aeb-8249-5aae103cf5cc","Type":"ContainerStarted","Data":"cf2720d34e402b7d6d5458f2c6bcf5603117a3c1e185eb1c45c740a732478226"} Jul 13 02:57:21.318199 ip-10-0-134-52 kubenswrapper[2558]: I0713 02:57:21.318179 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-bxvd8" event={"ID":"fc1d702b-774e-4b93-a862-8ada20c10ce4","Type":"ContainerStarted","Data":"f8f37a8cace3b757674e79986cd01e9726078dc9b330c91c8793511fd843ed32"} Jul 13 02:57:21.319427 ip-10-0-134-52 kubenswrapper[2558]: I0713 02:57:21.319408 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-node-tuning-operator/tuned-z7fz9" event={"ID":"93624b2e-1256-406d-892b-456a2b2cd0db","Type":"ContainerStarted","Data":"490c08b542ba90a24cfb93896ccc2580ea475084140d9a0f22951d656ee5885e"} Jul 13 02:57:21.328711 ip-10-0-134-52 kubenswrapper[2558]: I0713 02:57:21.328671 2558 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/multus-dvqmz" podStartSLOduration=3.825566495 podStartE2EDuration="23.328654936s" totalImagesPullingTime="19.503088441s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-13 02:56:58 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-13 02:57:21.328562032 +0000 UTC m=+23.729162498" watchObservedRunningTime="2026-07-13 02:57:21.328654936 +0000 UTC m=+23.729255404" Jul 13 02:57:21.345314 ip-10-0-134-52 kubenswrapper[2558]: I0713 02:57:21.345279 2558 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-image-registry/node-ca-wpn4b" podStartSLOduration=3.903134335 podStartE2EDuration="23.345268054s" totalImagesPullingTime="19.442133719s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-13 02:56:58 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-13 02:57:21.344916352 +0000 UTC m=+23.745516828" watchObservedRunningTime="2026-07-13 02:57:21.345268054 +0000 UTC m=+23.745868520" Jul 13 02:57:21.363820 ip-10-0-134-52 kubenswrapper[2558]: I0713 02:57:21.363788 2558 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-dns/node-resolver-ndddr" podStartSLOduration=2.916224008 podStartE2EDuration="22.363777169s" totalImagesPullingTime="19.447553161s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-13 02:56:59 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-13 02:57:21.363444523 +0000 UTC m=+23.764044989" watchObservedRunningTime="2026-07-13 02:57:21.363777169 +0000 UTC m=+23.764377635" Jul 13 02:57:21.380681 ip-10-0-134-52 kubenswrapper[2558]: I0713 02:57:21.380643 2558 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-node-tuning-operator/tuned-z7fz9" podStartSLOduration=3.92669167 podStartE2EDuration="23.380632802s" totalImagesPullingTime="19.453941132s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-13 02:56:58 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-13 02:57:21.380074749 +0000 UTC m=+23.780675298" watchObservedRunningTime="2026-07-13 02:57:21.380632802 +0000 UTC m=+23.781233268" Jul 13 02:57:21.441607 ip-10-0-134-52 kubenswrapper[2558]: I0713 02:57:21.441569 2558 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/konnectivity-agent-pf2f6" podStartSLOduration=3.038162484 podStartE2EDuration="22.441557651s" totalImagesPullingTime="19.403395167s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-13 02:56:59 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-13 02:57:21.441370378 +0000 UTC m=+23.841970837" watchObservedRunningTime="2026-07-13 02:57:21.441557651 +0000 UTC m=+23.842158117" Jul 13 02:57:22.087833 ip-10-0-134-52 kubenswrapper[2558]: I0713 02:57:22.087765 2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-jt47w" Jul 13 02:57:22.088003 ip-10-0-134-52 kubenswrapper[2558]: I0713 02:57:22.087765 2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-hf6cl" Jul 13 02:57:22.088003 ip-10-0-134-52 kubenswrapper[2558]: E0713 02:57:22.087895 2558 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-jt47w" podUID="72ebddc5-a4ff-4e56-a65d-508775d02170" Jul 13 02:57:22.088003 ip-10-0-134-52 kubenswrapper[2558]: I0713 02:57:22.087935 2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-fdbpv" Jul 13 02:57:22.088103 ip-10-0-134-52 kubenswrapper[2558]: E0713 02:57:22.088010 2558 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-hf6cl" podUID="5b3dc970-19d3-43e8-9a7b-4062feb75c3e" Jul 13 02:57:22.088103 ip-10-0-134-52 kubenswrapper[2558]: E0713 02:57:22.088078 2558 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-fdbpv" podUID="17234e1a-e139-4f9e-88fd-c679510cd0fb" Jul 13 02:57:22.324896 ip-10-0-134-52 kubenswrapper[2558]: I0713 02:57:22.324863 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-operator/iptables-alerter-px6ng" event={"ID":"346339f5-1f30-46a0-a2aa-1ef007576943","Type":"ContainerStarted","Data":"0de8a250f0dbbdb0427319e0611e804694dede9407a1a32cf6e7fadfd919a9a8"} Jul 13 02:57:22.326972 ip-10-0-134-52 kubenswrapper[2558]: I0713 02:57:22.326954 2558 plugin_watcher.go:194] "Adding socket path or updating timestamp to desired state cache" path="/var/lib/kubelet/plugins_registry/ebs.csi.aws.com-reg.sock" Jul 13 02:57:22.328638 ip-10-0-134-52 kubenswrapper[2558]: I0713 02:57:22.328589 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-7m9bp" event={"ID":"d7c10797-d1f7-4e82-bd2b-f81f851f1407","Type":"ContainerStarted","Data":"932a4b4a32aa443885732e23b4a517f72a2bf306a68fea977b2ac1aedf1147eb"} Jul 13 02:57:22.328744 ip-10-0-134-52 kubenswrapper[2558]: I0713 02:57:22.328664 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-7m9bp" event={"ID":"d7c10797-d1f7-4e82-bd2b-f81f851f1407","Type":"ContainerStarted","Data":"bd1eaecc8c951320658e1c966a14a11e85ca129d0006f472892cba24d22d1e1f"} Jul 13 02:57:22.331578 ip-10-0-134-52 kubenswrapper[2558]: I0713 02:57:22.331553 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-bxvd8" event={"ID":"fc1d702b-774e-4b93-a862-8ada20c10ce4","Type":"ContainerStarted","Data":"620d009e286b11bb450552527cbcecaa88f5c9ad630263d66a4d5e9d19d1e6f0"} Jul 13 02:57:22.990511 ip-10-0-134-52 kubenswrapper[2558]: I0713 02:57:22.990400 2558 reconciler.go:161] "OperationExecutor.RegisterPlugin started" plugin={"SocketPath":"/var/lib/kubelet/plugins_registry/ebs.csi.aws.com-reg.sock","Timestamp":"2026-07-13T02:57:22.326968731Z","UUID":"212ae57f-067f-4be3-86cb-229e153f45cf","Handler":null,"Name":"","Endpoint":""} Jul 13 02:57:22.992153 ip-10-0-134-52 kubenswrapper[2558]: I0713 02:57:22.992130 2558 csi_plugin.go:106] kubernetes.io/csi: Trying to validate a new CSI Driver with name: ebs.csi.aws.com endpoint: /var/lib/kubelet/plugins/ebs.csi.aws.com/csi.sock versions: 1.0.0 Jul 13 02:57:22.992153 ip-10-0-134-52 kubenswrapper[2558]: I0713 02:57:22.992167 2558 csi_plugin.go:119] kubernetes.io/csi: Register new plugin with name: ebs.csi.aws.com at endpoint: /var/lib/kubelet/plugins/ebs.csi.aws.com/csi.sock Jul 13 02:57:24.087491 ip-10-0-134-52 kubenswrapper[2558]: I0713 02:57:24.087418 2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-jt47w" Jul 13 02:57:24.087865 ip-10-0-134-52 kubenswrapper[2558]: I0713 02:57:24.087416 2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-hf6cl" Jul 13 02:57:24.087865 ip-10-0-134-52 kubenswrapper[2558]: E0713 02:57:24.087530 2558 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-jt47w" podUID="72ebddc5-a4ff-4e56-a65d-508775d02170" Jul 13 02:57:24.087865 ip-10-0-134-52 kubenswrapper[2558]: I0713 02:57:24.087572 2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-fdbpv" Jul 13 02:57:24.087865 ip-10-0-134-52 kubenswrapper[2558]: E0713 02:57:24.087655 2558 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-hf6cl" podUID="5b3dc970-19d3-43e8-9a7b-4062feb75c3e" Jul 13 02:57:24.087865 ip-10-0-134-52 kubenswrapper[2558]: E0713 02:57:24.087708 2558 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-fdbpv" podUID="17234e1a-e139-4f9e-88fd-c679510cd0fb" Jul 13 02:57:24.339077 ip-10-0-134-52 kubenswrapper[2558]: I0713 02:57:24.338994 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-7m9bp" event={"ID":"d7c10797-d1f7-4e82-bd2b-f81f851f1407","Type":"ContainerStarted","Data":"e605047c9e752ffaaa1e0f431f2a6986f5cd2f2aee2936683addcddfa83949fb"} Jul 13 02:57:24.341281 ip-10-0-134-52 kubenswrapper[2558]: I0713 02:57:24.341245 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-bxvd8" event={"ID":"fc1d702b-774e-4b93-a862-8ada20c10ce4","Type":"ContainerStarted","Data":"5159e1e985f5e510872aec387b358ecb3286c97e2af31de1339ac3fdc7243dbe"} Jul 13 02:57:24.366619 ip-10-0-134-52 kubenswrapper[2558]: I0713 02:57:24.366582 2558 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-bxvd8" podStartSLOduration=4.196523989 podStartE2EDuration="26.366562318s" totalImagesPullingTime="22.170038329s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-13 02:56:58 +0000 UTC" imagePullSessionsCount=3 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-13 02:57:24.365468589 +0000 UTC m=+26.766069057" watchObservedRunningTime="2026-07-13 02:57:24.366562318 +0000 UTC m=+26.767162787" Jul 13 02:57:24.366841 ip-10-0-134-52 kubenswrapper[2558]: I0713 02:57:24.366818 2558 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-operator/iptables-alerter-px6ng" podStartSLOduration=5.922869639 podStartE2EDuration="25.366809584s" totalImagesPullingTime="19.443939945s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-13 02:56:59 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-13 02:57:22.34225443 +0000 UTC m=+24.742854898" watchObservedRunningTime="2026-07-13 02:57:24.366809584 +0000 UTC m=+26.767410049" Jul 13 02:57:24.456301 ip-10-0-134-52 kubenswrapper[2558]: I0713 02:57:24.456265 2558 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="kube-system/konnectivity-agent-pf2f6" Jul 13 02:57:24.457059 ip-10-0-134-52 kubenswrapper[2558]: I0713 02:57:24.457036 2558 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="kube-system/konnectivity-agent-pf2f6" Jul 13 02:57:25.679080 ip-10-0-134-52 kubenswrapper[2558]: I0713 02:57:25.679052 2558 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kube-system/konnectivity-agent-pf2f6" Jul 13 02:57:25.679606 ip-10-0-134-52 kubenswrapper[2558]: I0713 02:57:25.679554 2558 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kube-system/konnectivity-agent-pf2f6" Jul 13 02:57:26.087038 ip-10-0-134-52 kubenswrapper[2558]: I0713 02:57:26.086991 2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-fdbpv" Jul 13 02:57:26.087038 ip-10-0-134-52 kubenswrapper[2558]: I0713 02:57:26.087009 2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-jt47w" Jul 13 02:57:26.087318 ip-10-0-134-52 kubenswrapper[2558]: E0713 02:57:26.087123 2558 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-fdbpv" podUID="17234e1a-e139-4f9e-88fd-c679510cd0fb" Jul 13 02:57:26.087475 ip-10-0-134-52 kubenswrapper[2558]: E0713 02:57:26.087324 2558 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-jt47w" podUID="72ebddc5-a4ff-4e56-a65d-508775d02170" Jul 13 02:57:26.087475 ip-10-0-134-52 kubenswrapper[2558]: I0713 02:57:26.087363 2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-hf6cl" Jul 13 02:57:26.087475 ip-10-0-134-52 kubenswrapper[2558]: E0713 02:57:26.087460 2558 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-hf6cl" podUID="5b3dc970-19d3-43e8-9a7b-4062feb75c3e" Jul 13 02:57:26.349308 ip-10-0-134-52 kubenswrapper[2558]: I0713 02:57:26.349010 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-7m9bp" event={"ID":"d7c10797-d1f7-4e82-bd2b-f81f851f1407","Type":"ContainerStarted","Data":"3350018fc93e439e5431dea7d84e017791c8cf7e44121bd0d874a05f66ce34a4"} Jul 13 02:57:26.349308 ip-10-0-134-52 kubenswrapper[2558]: I0713 02:57:26.349281 2558 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-7m9bp" Jul 13 02:57:26.349526 ip-10-0-134-52 kubenswrapper[2558]: I0713 02:57:26.349325 2558 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-7m9bp" Jul 13 02:57:26.349526 ip-10-0-134-52 kubenswrapper[2558]: I0713 02:57:26.349394 2558 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-7m9bp" Jul 13 02:57:26.352137 ip-10-0-134-52 kubenswrapper[2558]: I0713 02:57:26.352109 2558 generic.go:356] "Generic (PLEG): container finished" podID="16e70418-d340-4604-b23d-6e6bd736b72f" containerID="8d06797965e0d3d5c86f728c3085cedec4c5e31f0808a6578cc4d52569e0341d" exitCode=0 Jul 13 02:57:26.352298 ip-10-0-134-52 kubenswrapper[2558]: I0713 02:57:26.352228 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-scthx" event={"ID":"16e70418-d340-4604-b23d-6e6bd736b72f","Type":"ContainerDied","Data":"8d06797965e0d3d5c86f728c3085cedec4c5e31f0808a6578cc4d52569e0341d"} Jul 13 02:57:26.366237 ip-10-0-134-52 kubenswrapper[2558]: I0713 02:57:26.366218 2558 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-7m9bp" Jul 13 02:57:26.366878 ip-10-0-134-52 kubenswrapper[2558]: I0713 02:57:26.366854 2558 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-7m9bp" Jul 13 02:57:26.382153 ip-10-0-134-52 kubenswrapper[2558]: I0713 02:57:26.382117 2558 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ovn-kubernetes/ovnkube-node-7m9bp" podStartSLOduration=7.8615538879999995 podStartE2EDuration="27.382106272s" totalImagesPullingTime="19.520552384s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-13 02:56:59 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-13 02:57:26.381903246 +0000 UTC m=+28.782503713" watchObservedRunningTime="2026-07-13 02:57:26.382106272 +0000 UTC m=+28.782706738" Jul 13 02:57:28.000227 ip-10-0-134-52 kubenswrapper[2558]: I0713 02:57:28.000194 2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kube-system/global-pull-secret-syncer-hf6cl"] Jul 13 02:57:28.000858 ip-10-0-134-52 kubenswrapper[2558]: I0713 02:57:28.000342 2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-hf6cl" Jul 13 02:57:28.000858 ip-10-0-134-52 kubenswrapper[2558]: E0713 02:57:28.000442 2558 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-hf6cl" podUID="5b3dc970-19d3-43e8-9a7b-4062feb75c3e" Jul 13 02:57:28.003272 ip-10-0-134-52 kubenswrapper[2558]: I0713 02:57:28.003240 2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-target-fdbpv"] Jul 13 02:57:28.003408 ip-10-0-134-52 kubenswrapper[2558]: I0713 02:57:28.003355 2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-fdbpv" Jul 13 02:57:28.003483 ip-10-0-134-52 kubenswrapper[2558]: E0713 02:57:28.003435 2558 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-fdbpv" podUID="17234e1a-e139-4f9e-88fd-c679510cd0fb" Jul 13 02:57:28.013535 ip-10-0-134-52 kubenswrapper[2558]: I0713 02:57:28.013498 2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-multus/network-metrics-daemon-jt47w"] Jul 13 02:57:28.013664 ip-10-0-134-52 kubenswrapper[2558]: I0713 02:57:28.013592 2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-jt47w" Jul 13 02:57:28.013720 ip-10-0-134-52 kubenswrapper[2558]: E0713 02:57:28.013669 2558 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-jt47w" podUID="72ebddc5-a4ff-4e56-a65d-508775d02170" Jul 13 02:57:28.357894 ip-10-0-134-52 kubenswrapper[2558]: I0713 02:57:28.357854 2558 generic.go:356] "Generic (PLEG): container finished" podID="16e70418-d340-4604-b23d-6e6bd736b72f" containerID="38f6d3a6039fb4a99d9441c5275422ffb6171d63c9c4ae8e833f3d4accaab12f" exitCode=0 Jul 13 02:57:28.358058 ip-10-0-134-52 kubenswrapper[2558]: I0713 02:57:28.357916 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-scthx" event={"ID":"16e70418-d340-4604-b23d-6e6bd736b72f","Type":"ContainerDied","Data":"38f6d3a6039fb4a99d9441c5275422ffb6171d63c9c4ae8e833f3d4accaab12f"} Jul 13 02:57:30.087687 ip-10-0-134-52 kubenswrapper[2558]: I0713 02:57:30.087455 2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-jt47w" Jul 13 02:57:30.087988 ip-10-0-134-52 kubenswrapper[2558]: I0713 02:57:30.087462 2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-fdbpv" Jul 13 02:57:30.087988 ip-10-0-134-52 kubenswrapper[2558]: E0713 02:57:30.087811 2558 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-jt47w" podUID="72ebddc5-a4ff-4e56-a65d-508775d02170" Jul 13 02:57:30.087988 ip-10-0-134-52 kubenswrapper[2558]: I0713 02:57:30.087462 2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-hf6cl" Jul 13 02:57:30.087988 ip-10-0-134-52 kubenswrapper[2558]: E0713 02:57:30.087848 2558 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-fdbpv" podUID="17234e1a-e139-4f9e-88fd-c679510cd0fb" Jul 13 02:57:30.087988 ip-10-0-134-52 kubenswrapper[2558]: E0713 02:57:30.087914 2558 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-hf6cl" podUID="5b3dc970-19d3-43e8-9a7b-4062feb75c3e" Jul 13 02:57:30.364055 ip-10-0-134-52 kubenswrapper[2558]: I0713 02:57:30.363986 2558 generic.go:356] "Generic (PLEG): container finished" podID="16e70418-d340-4604-b23d-6e6bd736b72f" containerID="5311d60b34b79226057435cf2eab5844ee0de67775f12187837856ef48d7dcd8" exitCode=0 Jul 13 02:57:30.364055 ip-10-0-134-52 kubenswrapper[2558]: I0713 02:57:30.364044 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-scthx" event={"ID":"16e70418-d340-4604-b23d-6e6bd736b72f","Type":"ContainerDied","Data":"5311d60b34b79226057435cf2eab5844ee0de67775f12187837856ef48d7dcd8"} Jul 13 02:57:31.788118 ip-10-0-134-52 kubenswrapper[2558]: I0713 02:57:31.788085 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/5b3dc970-19d3-43e8-9a7b-4062feb75c3e-original-pull-secret\") pod \"global-pull-secret-syncer-hf6cl\" (UID: \"5b3dc970-19d3-43e8-9a7b-4062feb75c3e\") " pod="kube-system/global-pull-secret-syncer-hf6cl" Jul 13 02:57:31.788875 ip-10-0-134-52 kubenswrapper[2558]: I0713 02:57:31.788154 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/72ebddc5-a4ff-4e56-a65d-508775d02170-metrics-certs\") pod \"network-metrics-daemon-jt47w\" (UID: \"72ebddc5-a4ff-4e56-a65d-508775d02170\") " pod="openshift-multus/network-metrics-daemon-jt47w" Jul 13 02:57:31.788875 ip-10-0-134-52 kubenswrapper[2558]: E0713 02:57:31.788242 2558 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jul 13 02:57:31.788875 ip-10-0-134-52 kubenswrapper[2558]: E0713 02:57:31.788254 2558 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jul 13 02:57:31.788875 ip-10-0-134-52 kubenswrapper[2558]: E0713 02:57:31.788306 2558 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/72ebddc5-a4ff-4e56-a65d-508775d02170-metrics-certs podName:72ebddc5-a4ff-4e56-a65d-508775d02170 nodeName:}" failed. No retries permitted until 2026-07-13 02:58:03.788288272 +0000 UTC m=+66.188888730 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/72ebddc5-a4ff-4e56-a65d-508775d02170-metrics-certs") pod "network-metrics-daemon-jt47w" (UID: "72ebddc5-a4ff-4e56-a65d-508775d02170") : object "openshift-multus"/"metrics-daemon-secret" not registered Jul 13 02:57:31.788875 ip-10-0-134-52 kubenswrapper[2558]: E0713 02:57:31.788321 2558 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/5b3dc970-19d3-43e8-9a7b-4062feb75c3e-original-pull-secret podName:5b3dc970-19d3-43e8-9a7b-4062feb75c3e nodeName:}" failed. No retries permitted until 2026-07-13 02:58:03.788313528 +0000 UTC m=+66.188913979 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/5b3dc970-19d3-43e8-9a7b-4062feb75c3e-original-pull-secret") pod "global-pull-secret-syncer-hf6cl" (UID: "5b3dc970-19d3-43e8-9a7b-4062feb75c3e") : object "kube-system"/"original-pull-secret" not registered Jul 13 02:57:31.889183 ip-10-0-134-52 kubenswrapper[2558]: I0713 02:57:31.889148 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-f6cnb\" (UniqueName: \"kubernetes.io/projected/17234e1a-e139-4f9e-88fd-c679510cd0fb-kube-api-access-f6cnb\") pod \"network-check-target-fdbpv\" (UID: \"17234e1a-e139-4f9e-88fd-c679510cd0fb\") " pod="openshift-network-diagnostics/network-check-target-fdbpv" Jul 13 02:57:31.889372 ip-10-0-134-52 kubenswrapper[2558]: E0713 02:57:31.889278 2558 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jul 13 02:57:31.889372 ip-10-0-134-52 kubenswrapper[2558]: E0713 02:57:31.889297 2558 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jul 13 02:57:31.889372 ip-10-0-134-52 kubenswrapper[2558]: E0713 02:57:31.889307 2558 projected.go:196] Error preparing data for projected volume kube-api-access-f6cnb for pod openshift-network-diagnostics/network-check-target-fdbpv: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 13 02:57:31.889533 ip-10-0-134-52 kubenswrapper[2558]: E0713 02:57:31.889377 2558 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/17234e1a-e139-4f9e-88fd-c679510cd0fb-kube-api-access-f6cnb podName:17234e1a-e139-4f9e-88fd-c679510cd0fb nodeName:}" failed. No retries permitted until 2026-07-13 02:58:03.88936024 +0000 UTC m=+66.289960687 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "kube-api-access-f6cnb" (UniqueName: "kubernetes.io/projected/17234e1a-e139-4f9e-88fd-c679510cd0fb-kube-api-access-f6cnb") pod "network-check-target-fdbpv" (UID: "17234e1a-e139-4f9e-88fd-c679510cd0fb") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 13 02:57:32.087226 ip-10-0-134-52 kubenswrapper[2558]: I0713 02:57:32.087148 2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-hf6cl" Jul 13 02:57:32.087226 ip-10-0-134-52 kubenswrapper[2558]: I0713 02:57:32.087159 2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-jt47w" Jul 13 02:57:32.087226 ip-10-0-134-52 kubenswrapper[2558]: I0713 02:57:32.087186 2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-fdbpv" Jul 13 02:57:32.087480 ip-10-0-134-52 kubenswrapper[2558]: E0713 02:57:32.087257 2558 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-hf6cl" podUID="5b3dc970-19d3-43e8-9a7b-4062feb75c3e" Jul 13 02:57:32.087480 ip-10-0-134-52 kubenswrapper[2558]: E0713 02:57:32.087353 2558 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-jt47w" podUID="72ebddc5-a4ff-4e56-a65d-508775d02170" Jul 13 02:57:32.087480 ip-10-0-134-52 kubenswrapper[2558]: E0713 02:57:32.087427 2558 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-fdbpv" podUID="17234e1a-e139-4f9e-88fd-c679510cd0fb" Jul 13 02:57:34.087701 ip-10-0-134-52 kubenswrapper[2558]: I0713 02:57:34.087200 2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-jt47w" Jul 13 02:57:34.087701 ip-10-0-134-52 kubenswrapper[2558]: I0713 02:57:34.087200 2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-hf6cl" Jul 13 02:57:34.087701 ip-10-0-134-52 kubenswrapper[2558]: E0713 02:57:34.087361 2558 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-jt47w" podUID="72ebddc5-a4ff-4e56-a65d-508775d02170" Jul 13 02:57:34.087701 ip-10-0-134-52 kubenswrapper[2558]: I0713 02:57:34.087417 2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-fdbpv" Jul 13 02:57:34.087701 ip-10-0-134-52 kubenswrapper[2558]: E0713 02:57:34.087517 2558 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-hf6cl" podUID="5b3dc970-19d3-43e8-9a7b-4062feb75c3e" Jul 13 02:57:34.087701 ip-10-0-134-52 kubenswrapper[2558]: E0713 02:57:34.087599 2558 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-fdbpv" podUID="17234e1a-e139-4f9e-88fd-c679510cd0fb" Jul 13 02:57:34.463005 ip-10-0-134-52 kubenswrapper[2558]: I0713 02:57:34.462940 2558 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-134-52.ec2.internal" event="NodeReady" Jul 13 02:57:34.463124 ip-10-0-134-52 kubenswrapper[2558]: I0713 02:57:34.463049 2558 kubelet_node_status.go:489] "Fast updating node status as it just became ready" Jul 13 02:57:34.514635 ip-10-0-134-52 kubenswrapper[2558]: I0713 02:57:34.514609 2558 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-dns/dns-default-qkxhh"] Jul 13 02:57:34.516600 ip-10-0-134-52 kubenswrapper[2558]: I0713 02:57:34.516580 2558 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress-canary/ingress-canary-f8947"] Jul 13 02:57:34.516716 ip-10-0-134-52 kubenswrapper[2558]: I0713 02:57:34.516692 2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-qkxhh" Jul 13 02:57:34.518149 ip-10-0-134-52 kubenswrapper[2558]: I0713 02:57:34.518132 2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress-canary/ingress-canary-f8947" Jul 13 02:57:34.520471 ip-10-0-134-52 kubenswrapper[2558]: I0713 02:57:34.520383 2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-default-metrics-tls\"" Jul 13 02:57:34.520471 ip-10-0-134-52 kubenswrapper[2558]: I0713 02:57:34.520403 2558 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"dns-default\"" Jul 13 02:57:34.520471 ip-10-0-134-52 kubenswrapper[2558]: I0713 02:57:34.520422 2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-dockercfg-vw8zn\"" Jul 13 02:57:34.521144 ip-10-0-134-52 kubenswrapper[2558]: I0713 02:57:34.521126 2558 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress-canary\"/\"kube-root-ca.crt\"" Jul 13 02:57:34.521249 ip-10-0-134-52 kubenswrapper[2558]: I0713 02:57:34.521142 2558 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress-canary\"/\"openshift-service-ca.crt\"" Jul 13 02:57:34.521249 ip-10-0-134-52 kubenswrapper[2558]: I0713 02:57:34.521174 2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-canary\"/\"default-dockercfg-9bqmq\"" Jul 13 02:57:34.522356 ip-10-0-134-52 kubenswrapper[2558]: I0713 02:57:34.521741 2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-canary\"/\"canary-serving-cert\"" Jul 13 02:57:34.529526 ip-10-0-134-52 kubenswrapper[2558]: I0713 02:57:34.529497 2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress-canary/ingress-canary-f8947"] Jul 13 02:57:34.529615 ip-10-0-134-52 kubenswrapper[2558]: I0713 02:57:34.529552 2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-dns/dns-default-qkxhh"] Jul 13 02:57:34.609484 ip-10-0-134-52 kubenswrapper[2558]: I0713 02:57:34.609458 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/141bb0e2-17a1-4cd4-8d11-ed7120c2dd6b-cert\") pod \"ingress-canary-f8947\" (UID: \"141bb0e2-17a1-4cd4-8d11-ed7120c2dd6b\") " pod="openshift-ingress-canary/ingress-canary-f8947" Jul 13 02:57:34.609641 ip-10-0-134-52 kubenswrapper[2558]: I0713 02:57:34.609491 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/82341e74-e954-41d9-aac3-4e537551717a-config-volume\") pod \"dns-default-qkxhh\" (UID: \"82341e74-e954-41d9-aac3-4e537551717a\") " pod="openshift-dns/dns-default-qkxhh" Jul 13 02:57:34.609641 ip-10-0-134-52 kubenswrapper[2558]: I0713 02:57:34.609517 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-wnltw\" (UniqueName: \"kubernetes.io/projected/82341e74-e954-41d9-aac3-4e537551717a-kube-api-access-wnltw\") pod \"dns-default-qkxhh\" (UID: \"82341e74-e954-41d9-aac3-4e537551717a\") " pod="openshift-dns/dns-default-qkxhh" Jul 13 02:57:34.609641 ip-10-0-134-52 kubenswrapper[2558]: I0713 02:57:34.609535 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-vtkp9\" (UniqueName: \"kubernetes.io/projected/141bb0e2-17a1-4cd4-8d11-ed7120c2dd6b-kube-api-access-vtkp9\") pod \"ingress-canary-f8947\" (UID: \"141bb0e2-17a1-4cd4-8d11-ed7120c2dd6b\") " pod="openshift-ingress-canary/ingress-canary-f8947" Jul 13 02:57:34.609641 ip-10-0-134-52 kubenswrapper[2558]: I0713 02:57:34.609627 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/82341e74-e954-41d9-aac3-4e537551717a-tmp-dir\") pod \"dns-default-qkxhh\" (UID: \"82341e74-e954-41d9-aac3-4e537551717a\") " pod="openshift-dns/dns-default-qkxhh" Jul 13 02:57:34.609780 ip-10-0-134-52 kubenswrapper[2558]: I0713 02:57:34.609742 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/82341e74-e954-41d9-aac3-4e537551717a-metrics-tls\") pod \"dns-default-qkxhh\" (UID: \"82341e74-e954-41d9-aac3-4e537551717a\") " pod="openshift-dns/dns-default-qkxhh" Jul 13 02:57:34.710776 ip-10-0-134-52 kubenswrapper[2558]: I0713 02:57:34.710754 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/82341e74-e954-41d9-aac3-4e537551717a-metrics-tls\") pod \"dns-default-qkxhh\" (UID: \"82341e74-e954-41d9-aac3-4e537551717a\") " pod="openshift-dns/dns-default-qkxhh" Jul 13 02:57:34.710873 ip-10-0-134-52 kubenswrapper[2558]: I0713 02:57:34.710800 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/141bb0e2-17a1-4cd4-8d11-ed7120c2dd6b-cert\") pod \"ingress-canary-f8947\" (UID: \"141bb0e2-17a1-4cd4-8d11-ed7120c2dd6b\") " pod="openshift-ingress-canary/ingress-canary-f8947" Jul 13 02:57:34.710873 ip-10-0-134-52 kubenswrapper[2558]: I0713 02:57:34.710819 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/82341e74-e954-41d9-aac3-4e537551717a-config-volume\") pod \"dns-default-qkxhh\" (UID: \"82341e74-e954-41d9-aac3-4e537551717a\") " pod="openshift-dns/dns-default-qkxhh" Jul 13 02:57:34.710873 ip-10-0-134-52 kubenswrapper[2558]: I0713 02:57:34.710836 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-wnltw\" (UniqueName: \"kubernetes.io/projected/82341e74-e954-41d9-aac3-4e537551717a-kube-api-access-wnltw\") pod \"dns-default-qkxhh\" (UID: \"82341e74-e954-41d9-aac3-4e537551717a\") " pod="openshift-dns/dns-default-qkxhh" Jul 13 02:57:34.710873 ip-10-0-134-52 kubenswrapper[2558]: I0713 02:57:34.710859 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-vtkp9\" (UniqueName: \"kubernetes.io/projected/141bb0e2-17a1-4cd4-8d11-ed7120c2dd6b-kube-api-access-vtkp9\") pod \"ingress-canary-f8947\" (UID: \"141bb0e2-17a1-4cd4-8d11-ed7120c2dd6b\") " pod="openshift-ingress-canary/ingress-canary-f8947" Jul 13 02:57:34.711070 ip-10-0-134-52 kubenswrapper[2558]: I0713 02:57:34.710884 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/82341e74-e954-41d9-aac3-4e537551717a-tmp-dir\") pod \"dns-default-qkxhh\" (UID: \"82341e74-e954-41d9-aac3-4e537551717a\") " pod="openshift-dns/dns-default-qkxhh" Jul 13 02:57:34.711070 ip-10-0-134-52 kubenswrapper[2558]: E0713 02:57:34.710920 2558 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jul 13 02:57:34.711070 ip-10-0-134-52 kubenswrapper[2558]: E0713 02:57:34.710988 2558 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/82341e74-e954-41d9-aac3-4e537551717a-metrics-tls podName:82341e74-e954-41d9-aac3-4e537551717a nodeName:}" failed. No retries permitted until 2026-07-13 02:57:35.210969864 +0000 UTC m=+37.611570309 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/82341e74-e954-41d9-aac3-4e537551717a-metrics-tls") pod "dns-default-qkxhh" (UID: "82341e74-e954-41d9-aac3-4e537551717a") : secret "dns-default-metrics-tls" not found Jul 13 02:57:34.711222 ip-10-0-134-52 kubenswrapper[2558]: I0713 02:57:34.711194 2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/82341e74-e954-41d9-aac3-4e537551717a-tmp-dir\") pod \"dns-default-qkxhh\" (UID: \"82341e74-e954-41d9-aac3-4e537551717a\") " pod="openshift-dns/dns-default-qkxhh" Jul 13 02:57:34.711458 ip-10-0-134-52 kubenswrapper[2558]: I0713 02:57:34.711415 2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/82341e74-e954-41d9-aac3-4e537551717a-config-volume\") pod \"dns-default-qkxhh\" (UID: \"82341e74-e954-41d9-aac3-4e537551717a\") " pod="openshift-dns/dns-default-qkxhh" Jul 13 02:57:34.714615 ip-10-0-134-52 kubenswrapper[2558]: I0713 02:57:34.714568 2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/141bb0e2-17a1-4cd4-8d11-ed7120c2dd6b-cert\") pod \"ingress-canary-f8947\" (UID: \"141bb0e2-17a1-4cd4-8d11-ed7120c2dd6b\") " pod="openshift-ingress-canary/ingress-canary-f8947" Jul 13 02:57:34.720202 ip-10-0-134-52 kubenswrapper[2558]: I0713 02:57:34.720167 2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-wnltw\" (UniqueName: \"kubernetes.io/projected/82341e74-e954-41d9-aac3-4e537551717a-kube-api-access-wnltw\") pod \"dns-default-qkxhh\" (UID: \"82341e74-e954-41d9-aac3-4e537551717a\") " pod="openshift-dns/dns-default-qkxhh" Jul 13 02:57:34.720855 ip-10-0-134-52 kubenswrapper[2558]: I0713 02:57:34.720837 2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-vtkp9\" (UniqueName: \"kubernetes.io/projected/141bb0e2-17a1-4cd4-8d11-ed7120c2dd6b-kube-api-access-vtkp9\") pod \"ingress-canary-f8947\" (UID: \"141bb0e2-17a1-4cd4-8d11-ed7120c2dd6b\") " pod="openshift-ingress-canary/ingress-canary-f8947" Jul 13 02:57:34.837440 ip-10-0-134-52 kubenswrapper[2558]: I0713 02:57:34.837277 2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress-canary/ingress-canary-f8947" Jul 13 02:57:34.966981 ip-10-0-134-52 kubenswrapper[2558]: I0713 02:57:34.966879 2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress-canary/ingress-canary-f8947"] Jul 13 02:57:34.970490 ip-10-0-134-52 kubenswrapper[2558]: W0713 02:57:34.970462 2558 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod141bb0e2_17a1_4cd4_8d11_ed7120c2dd6b.slice/crio-6fda28dd6691162bac394f6fa3c1e8a3db30bf9d5d9e6a88f5f2a9454d507d8a WatchSource:0}: Error finding container 6fda28dd6691162bac394f6fa3c1e8a3db30bf9d5d9e6a88f5f2a9454d507d8a: Status 404 returned error can't find the container with id 6fda28dd6691162bac394f6fa3c1e8a3db30bf9d5d9e6a88f5f2a9454d507d8a Jul 13 02:57:35.214915 ip-10-0-134-52 kubenswrapper[2558]: I0713 02:57:35.214888 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/82341e74-e954-41d9-aac3-4e537551717a-metrics-tls\") pod \"dns-default-qkxhh\" (UID: \"82341e74-e954-41d9-aac3-4e537551717a\") " pod="openshift-dns/dns-default-qkxhh" Jul 13 02:57:35.215293 ip-10-0-134-52 kubenswrapper[2558]: E0713 02:57:35.215003 2558 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jul 13 02:57:35.215293 ip-10-0-134-52 kubenswrapper[2558]: E0713 02:57:35.215047 2558 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/82341e74-e954-41d9-aac3-4e537551717a-metrics-tls podName:82341e74-e954-41d9-aac3-4e537551717a nodeName:}" failed. No retries permitted until 2026-07-13 02:57:36.215034895 +0000 UTC m=+38.615635339 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/82341e74-e954-41d9-aac3-4e537551717a-metrics-tls") pod "dns-default-qkxhh" (UID: "82341e74-e954-41d9-aac3-4e537551717a") : secret "dns-default-metrics-tls" not found Jul 13 02:57:35.378123 ip-10-0-134-52 kubenswrapper[2558]: I0713 02:57:35.378066 2558 generic.go:356] "Generic (PLEG): container finished" podID="16e70418-d340-4604-b23d-6e6bd736b72f" containerID="0fd8543f35f6d9eb4ddc5191f4a5ab5058caaf3c3893c99fc80bbca8964673b5" exitCode=0 Jul 13 02:57:35.378214 ip-10-0-134-52 kubenswrapper[2558]: I0713 02:57:35.378139 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-scthx" event={"ID":"16e70418-d340-4604-b23d-6e6bd736b72f","Type":"ContainerDied","Data":"0fd8543f35f6d9eb4ddc5191f4a5ab5058caaf3c3893c99fc80bbca8964673b5"} Jul 13 02:57:35.379231 ip-10-0-134-52 kubenswrapper[2558]: I0713 02:57:35.379213 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress-canary/ingress-canary-f8947" event={"ID":"141bb0e2-17a1-4cd4-8d11-ed7120c2dd6b","Type":"ContainerStarted","Data":"6fda28dd6691162bac394f6fa3c1e8a3db30bf9d5d9e6a88f5f2a9454d507d8a"} Jul 13 02:57:36.087832 ip-10-0-134-52 kubenswrapper[2558]: I0713 02:57:36.087799 2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-fdbpv" Jul 13 02:57:36.088008 ip-10-0-134-52 kubenswrapper[2558]: I0713 02:57:36.087799 2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-jt47w" Jul 13 02:57:36.088008 ip-10-0-134-52 kubenswrapper[2558]: I0713 02:57:36.087927 2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-hf6cl" Jul 13 02:57:36.090686 ip-10-0-134-52 kubenswrapper[2558]: I0713 02:57:36.090662 2558 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"openshift-service-ca.crt\"" Jul 13 02:57:36.090790 ip-10-0-134-52 kubenswrapper[2558]: I0713 02:57:36.090700 2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"original-pull-secret\"" Jul 13 02:57:36.091955 ip-10-0-134-52 kubenswrapper[2558]: I0713 02:57:36.091936 2558 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"kube-root-ca.crt\"" Jul 13 02:57:36.092072 ip-10-0-134-52 kubenswrapper[2558]: I0713 02:57:36.091993 2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"default-dockercfg-nv65t\"" Jul 13 02:57:36.092072 ip-10-0-134-52 kubenswrapper[2558]: I0713 02:57:36.092042 2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-secret\"" Jul 13 02:57:36.092072 ip-10-0-134-52 kubenswrapper[2558]: I0713 02:57:36.092044 2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-sa-dockercfg-8nlv8\"" Jul 13 02:57:36.223717 ip-10-0-134-52 kubenswrapper[2558]: I0713 02:57:36.223687 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/82341e74-e954-41d9-aac3-4e537551717a-metrics-tls\") pod \"dns-default-qkxhh\" (UID: \"82341e74-e954-41d9-aac3-4e537551717a\") " pod="openshift-dns/dns-default-qkxhh" Jul 13 02:57:36.224135 ip-10-0-134-52 kubenswrapper[2558]: E0713 02:57:36.223840 2558 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jul 13 02:57:36.224135 ip-10-0-134-52 kubenswrapper[2558]: E0713 02:57:36.223910 2558 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/82341e74-e954-41d9-aac3-4e537551717a-metrics-tls podName:82341e74-e954-41d9-aac3-4e537551717a nodeName:}" failed. No retries permitted until 2026-07-13 02:57:38.223890489 +0000 UTC m=+40.624490937 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/82341e74-e954-41d9-aac3-4e537551717a-metrics-tls") pod "dns-default-qkxhh" (UID: "82341e74-e954-41d9-aac3-4e537551717a") : secret "dns-default-metrics-tls" not found Jul 13 02:57:36.385393 ip-10-0-134-52 kubenswrapper[2558]: I0713 02:57:36.385291 2558 generic.go:356] "Generic (PLEG): container finished" podID="16e70418-d340-4604-b23d-6e6bd736b72f" containerID="3e779e3e718b3c18a4b13b59ed37b48184474d9f8dc47e9642347a0ecb8f3d6e" exitCode=0 Jul 13 02:57:36.385393 ip-10-0-134-52 kubenswrapper[2558]: I0713 02:57:36.385363 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-scthx" event={"ID":"16e70418-d340-4604-b23d-6e6bd736b72f","Type":"ContainerDied","Data":"3e779e3e718b3c18a4b13b59ed37b48184474d9f8dc47e9642347a0ecb8f3d6e"} Jul 13 02:57:37.391272 ip-10-0-134-52 kubenswrapper[2558]: I0713 02:57:37.391031 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-scthx" event={"ID":"16e70418-d340-4604-b23d-6e6bd736b72f","Type":"ContainerStarted","Data":"0fed2dfcda5c637657d06fac41a45b773287d051e203ed3cbd4588fab92bbc30"} Jul 13 02:57:37.423081 ip-10-0-134-52 kubenswrapper[2558]: I0713 02:57:37.423042 2558 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/multus-additional-cni-plugins-scthx" podStartSLOduration=9.352705341 podStartE2EDuration="39.423028477s" totalImagesPullingTime="30.070323136s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-13 02:56:58 +0000 UTC" imagePullSessionsCount=5 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-13 02:57:37.423010589 +0000 UTC m=+39.823611054" watchObservedRunningTime="2026-07-13 02:57:37.423028477 +0000 UTC m=+39.823628943" Jul 13 02:57:38.239264 ip-10-0-134-52 kubenswrapper[2558]: I0713 02:57:38.239233 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/82341e74-e954-41d9-aac3-4e537551717a-metrics-tls\") pod \"dns-default-qkxhh\" (UID: \"82341e74-e954-41d9-aac3-4e537551717a\") " pod="openshift-dns/dns-default-qkxhh" Jul 13 02:57:38.239441 ip-10-0-134-52 kubenswrapper[2558]: E0713 02:57:38.239373 2558 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jul 13 02:57:38.239441 ip-10-0-134-52 kubenswrapper[2558]: E0713 02:57:38.239428 2558 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/82341e74-e954-41d9-aac3-4e537551717a-metrics-tls podName:82341e74-e954-41d9-aac3-4e537551717a nodeName:}" failed. No retries permitted until 2026-07-13 02:57:42.239414916 +0000 UTC m=+44.640015360 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/82341e74-e954-41d9-aac3-4e537551717a-metrics-tls") pod "dns-default-qkxhh" (UID: "82341e74-e954-41d9-aac3-4e537551717a") : secret "dns-default-metrics-tls" not found Jul 13 02:57:38.394807 ip-10-0-134-52 kubenswrapper[2558]: I0713 02:57:38.394775 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress-canary/ingress-canary-f8947" event={"ID":"141bb0e2-17a1-4cd4-8d11-ed7120c2dd6b","Type":"ContainerStarted","Data":"951899660d7d28525913b4c64279058363962e720586171113394a60af6b7b57"} Jul 13 02:57:38.413347 ip-10-0-134-52 kubenswrapper[2558]: I0713 02:57:38.413299 2558 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress-canary/ingress-canary-f8947" podStartSLOduration=1.812481917 podStartE2EDuration="4.413286174s" totalImagesPullingTime="2.600804257s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-13 02:57:34 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-13 02:57:38.411774034 +0000 UTC m=+40.812374497" watchObservedRunningTime="2026-07-13 02:57:38.413286174 +0000 UTC m=+40.813886639" Jul 13 02:57:42.265247 ip-10-0-134-52 kubenswrapper[2558]: I0713 02:57:42.265217 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/82341e74-e954-41d9-aac3-4e537551717a-metrics-tls\") pod \"dns-default-qkxhh\" (UID: \"82341e74-e954-41d9-aac3-4e537551717a\") " pod="openshift-dns/dns-default-qkxhh" Jul 13 02:57:42.265741 ip-10-0-134-52 kubenswrapper[2558]: E0713 02:57:42.265371 2558 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jul 13 02:57:42.265741 ip-10-0-134-52 kubenswrapper[2558]: E0713 02:57:42.265444 2558 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/82341e74-e954-41d9-aac3-4e537551717a-metrics-tls podName:82341e74-e954-41d9-aac3-4e537551717a nodeName:}" failed. No retries permitted until 2026-07-13 02:57:50.265423441 +0000 UTC m=+52.666023889 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/82341e74-e954-41d9-aac3-4e537551717a-metrics-tls") pod "dns-default-qkxhh" (UID: "82341e74-e954-41d9-aac3-4e537551717a") : secret "dns-default-metrics-tls" not found Jul 13 02:57:50.315953 ip-10-0-134-52 kubenswrapper[2558]: I0713 02:57:50.315918 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/82341e74-e954-41d9-aac3-4e537551717a-metrics-tls\") pod \"dns-default-qkxhh\" (UID: \"82341e74-e954-41d9-aac3-4e537551717a\") " pod="openshift-dns/dns-default-qkxhh" Jul 13 02:57:50.316482 ip-10-0-134-52 kubenswrapper[2558]: E0713 02:57:50.316039 2558 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jul 13 02:57:50.316482 ip-10-0-134-52 kubenswrapper[2558]: E0713 02:57:50.316104 2558 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/82341e74-e954-41d9-aac3-4e537551717a-metrics-tls podName:82341e74-e954-41d9-aac3-4e537551717a nodeName:}" failed. No retries permitted until 2026-07-13 02:58:06.316085706 +0000 UTC m=+68.716686152 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/82341e74-e954-41d9-aac3-4e537551717a-metrics-tls") pod "dns-default-qkxhh" (UID: "82341e74-e954-41d9-aac3-4e537551717a") : secret "dns-default-metrics-tls" not found Jul 13 02:57:58.367660 ip-10-0-134-52 kubenswrapper[2558]: I0713 02:57:58.367628 2558 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-7m9bp" Jul 13 02:58:03.801954 ip-10-0-134-52 kubenswrapper[2558]: I0713 02:58:03.801922 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/72ebddc5-a4ff-4e56-a65d-508775d02170-metrics-certs\") pod \"network-metrics-daemon-jt47w\" (UID: \"72ebddc5-a4ff-4e56-a65d-508775d02170\") " pod="openshift-multus/network-metrics-daemon-jt47w" Jul 13 02:58:03.802449 ip-10-0-134-52 kubenswrapper[2558]: I0713 02:58:03.801979 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/5b3dc970-19d3-43e8-9a7b-4062feb75c3e-original-pull-secret\") pod \"global-pull-secret-syncer-hf6cl\" (UID: \"5b3dc970-19d3-43e8-9a7b-4062feb75c3e\") " pod="kube-system/global-pull-secret-syncer-hf6cl" Jul 13 02:58:03.805262 ip-10-0-134-52 kubenswrapper[2558]: I0713 02:58:03.805241 2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-secret\"" Jul 13 02:58:03.805317 ip-10-0-134-52 kubenswrapper[2558]: I0713 02:58:03.805288 2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"original-pull-secret\"" Jul 13 02:58:03.812757 ip-10-0-134-52 kubenswrapper[2558]: E0713 02:58:03.812741 2558 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: secret "metrics-daemon-secret" not found Jul 13 02:58:03.812834 ip-10-0-134-52 kubenswrapper[2558]: E0713 02:58:03.812822 2558 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/72ebddc5-a4ff-4e56-a65d-508775d02170-metrics-certs podName:72ebddc5-a4ff-4e56-a65d-508775d02170 nodeName:}" failed. No retries permitted until 2026-07-13 02:59:07.812801324 +0000 UTC m=+130.213401783 (durationBeforeRetry 1m4s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/72ebddc5-a4ff-4e56-a65d-508775d02170-metrics-certs") pod "network-metrics-daemon-jt47w" (UID: "72ebddc5-a4ff-4e56-a65d-508775d02170") : secret "metrics-daemon-secret" not found Jul 13 02:58:03.816431 ip-10-0-134-52 kubenswrapper[2558]: I0713 02:58:03.816415 2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/5b3dc970-19d3-43e8-9a7b-4062feb75c3e-original-pull-secret\") pod \"global-pull-secret-syncer-hf6cl\" (UID: \"5b3dc970-19d3-43e8-9a7b-4062feb75c3e\") " pod="kube-system/global-pull-secret-syncer-hf6cl" Jul 13 02:58:03.902987 ip-10-0-134-52 kubenswrapper[2558]: I0713 02:58:03.902957 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-f6cnb\" (UniqueName: \"kubernetes.io/projected/17234e1a-e139-4f9e-88fd-c679510cd0fb-kube-api-access-f6cnb\") pod \"network-check-target-fdbpv\" (UID: \"17234e1a-e139-4f9e-88fd-c679510cd0fb\") " pod="openshift-network-diagnostics/network-check-target-fdbpv" Jul 13 02:58:03.906040 ip-10-0-134-52 kubenswrapper[2558]: I0713 02:58:03.906025 2558 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"kube-root-ca.crt\"" Jul 13 02:58:03.916161 ip-10-0-134-52 kubenswrapper[2558]: I0713 02:58:03.916147 2558 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"openshift-service-ca.crt\"" Jul 13 02:58:03.925964 ip-10-0-134-52 kubenswrapper[2558]: I0713 02:58:03.925943 2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-f6cnb\" (UniqueName: \"kubernetes.io/projected/17234e1a-e139-4f9e-88fd-c679510cd0fb-kube-api-access-f6cnb\") pod \"network-check-target-fdbpv\" (UID: \"17234e1a-e139-4f9e-88fd-c679510cd0fb\") " pod="openshift-network-diagnostics/network-check-target-fdbpv" Jul 13 02:58:04.003960 ip-10-0-134-52 kubenswrapper[2558]: I0713 02:58:04.003940 2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"default-dockercfg-nv65t\"" Jul 13 02:58:04.011242 ip-10-0-134-52 kubenswrapper[2558]: I0713 02:58:04.011222 2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-fdbpv" Jul 13 02:58:04.014692 ip-10-0-134-52 kubenswrapper[2558]: I0713 02:58:04.014674 2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-hf6cl" Jul 13 02:58:04.145518 ip-10-0-134-52 kubenswrapper[2558]: I0713 02:58:04.145491 2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-target-fdbpv"] Jul 13 02:58:04.148384 ip-10-0-134-52 kubenswrapper[2558]: W0713 02:58:04.148316 2558 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod17234e1a_e139_4f9e_88fd_c679510cd0fb.slice/crio-c9be6611b539e09f0bfc021cd018ee92717e580c9ab40e0ed42215edc4a9f3e1 WatchSource:0}: Error finding container c9be6611b539e09f0bfc021cd018ee92717e580c9ab40e0ed42215edc4a9f3e1: Status 404 returned error can't find the container with id c9be6611b539e09f0bfc021cd018ee92717e580c9ab40e0ed42215edc4a9f3e1 Jul 13 02:58:04.157891 ip-10-0-134-52 kubenswrapper[2558]: I0713 02:58:04.157869 2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kube-system/global-pull-secret-syncer-hf6cl"] Jul 13 02:58:04.161527 ip-10-0-134-52 kubenswrapper[2558]: W0713 02:58:04.161505 2558 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod5b3dc970_19d3_43e8_9a7b_4062feb75c3e.slice/crio-3068fffb99c22461f5d5267f45a6c8dfc23a077beed2ac2aa8c4a5c230b88fca WatchSource:0}: Error finding container 3068fffb99c22461f5d5267f45a6c8dfc23a077beed2ac2aa8c4a5c230b88fca: Status 404 returned error can't find the container with id 3068fffb99c22461f5d5267f45a6c8dfc23a077beed2ac2aa8c4a5c230b88fca Jul 13 02:58:04.453281 ip-10-0-134-52 kubenswrapper[2558]: I0713 02:58:04.453207 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-target-fdbpv" event={"ID":"17234e1a-e139-4f9e-88fd-c679510cd0fb","Type":"ContainerStarted","Data":"c9be6611b539e09f0bfc021cd018ee92717e580c9ab40e0ed42215edc4a9f3e1"} Jul 13 02:58:04.454190 ip-10-0-134-52 kubenswrapper[2558]: I0713 02:58:04.454170 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/global-pull-secret-syncer-hf6cl" event={"ID":"5b3dc970-19d3-43e8-9a7b-4062feb75c3e","Type":"ContainerStarted","Data":"3068fffb99c22461f5d5267f45a6c8dfc23a077beed2ac2aa8c4a5c230b88fca"} Jul 13 02:58:06.316966 ip-10-0-134-52 kubenswrapper[2558]: I0713 02:58:06.316925 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/82341e74-e954-41d9-aac3-4e537551717a-metrics-tls\") pod \"dns-default-qkxhh\" (UID: \"82341e74-e954-41d9-aac3-4e537551717a\") " pod="openshift-dns/dns-default-qkxhh" Jul 13 02:58:06.317419 ip-10-0-134-52 kubenswrapper[2558]: E0713 02:58:06.317062 2558 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jul 13 02:58:06.317419 ip-10-0-134-52 kubenswrapper[2558]: E0713 02:58:06.317144 2558 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/82341e74-e954-41d9-aac3-4e537551717a-metrics-tls podName:82341e74-e954-41d9-aac3-4e537551717a nodeName:}" failed. No retries permitted until 2026-07-13 02:58:38.317121625 +0000 UTC m=+100.717722086 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/82341e74-e954-41d9-aac3-4e537551717a-metrics-tls") pod "dns-default-qkxhh" (UID: "82341e74-e954-41d9-aac3-4e537551717a") : secret "dns-default-metrics-tls" not found Jul 13 02:58:09.468770 ip-10-0-134-52 kubenswrapper[2558]: I0713 02:58:09.468734 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/global-pull-secret-syncer-hf6cl" event={"ID":"5b3dc970-19d3-43e8-9a7b-4062feb75c3e","Type":"ContainerStarted","Data":"0bea79229ca99e2cc696cf84de367035b2a1bc61d5ce9bbd8262e78db7c54005"} Jul 13 02:58:09.470238 ip-10-0-134-52 kubenswrapper[2558]: I0713 02:58:09.470214 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-target-fdbpv" event={"ID":"17234e1a-e139-4f9e-88fd-c679510cd0fb","Type":"ContainerStarted","Data":"941dfa705f2314dd87e803ea665ae4fc46d11f814633a286082f237582d5bd63"} Jul 13 02:58:09.470342 ip-10-0-134-52 kubenswrapper[2558]: I0713 02:58:09.470268 2558 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-network-diagnostics/network-check-target-fdbpv" Jul 13 02:58:09.486878 ip-10-0-134-52 kubenswrapper[2558]: I0713 02:58:09.485599 2558 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/global-pull-secret-syncer-hf6cl" podStartSLOduration=65.982291773 podStartE2EDuration="1m10.485580155s" totalImagesPullingTime="4.503288382s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-13 02:56:59 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-13 02:58:09.484170008 +0000 UTC m=+71.884770475" watchObservedRunningTime="2026-07-13 02:58:09.485580155 +0000 UTC m=+71.886180621" Jul 13 02:58:38.412670 ip-10-0-134-52 kubenswrapper[2558]: I0713 02:58:38.412633 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/82341e74-e954-41d9-aac3-4e537551717a-metrics-tls\") pod \"dns-default-qkxhh\" (UID: \"82341e74-e954-41d9-aac3-4e537551717a\") " pod="openshift-dns/dns-default-qkxhh" Jul 13 02:58:38.413027 ip-10-0-134-52 kubenswrapper[2558]: E0713 02:58:38.412736 2558 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jul 13 02:58:38.413027 ip-10-0-134-52 kubenswrapper[2558]: E0713 02:58:38.412784 2558 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/82341e74-e954-41d9-aac3-4e537551717a-metrics-tls podName:82341e74-e954-41d9-aac3-4e537551717a nodeName:}" failed. No retries permitted until 2026-07-13 02:59:42.412770456 +0000 UTC m=+164.813370901 (durationBeforeRetry 1m4s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/82341e74-e954-41d9-aac3-4e537551717a-metrics-tls") pod "dns-default-qkxhh" (UID: "82341e74-e954-41d9-aac3-4e537551717a") : secret "dns-default-metrics-tls" not found Jul 13 02:58:40.474851 ip-10-0-134-52 kubenswrapper[2558]: I0713 02:58:40.474823 2558 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-network-diagnostics/network-check-target-fdbpv" Jul 13 02:58:40.492402 ip-10-0-134-52 kubenswrapper[2558]: I0713 02:58:40.492358 2558 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-diagnostics/network-check-target-fdbpv" podStartSLOduration=96.979609255 podStartE2EDuration="1m41.49232376s" totalImagesPullingTime="4.512714505s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-13 02:56:59 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-13 02:58:09.499307818 +0000 UTC m=+71.899908297" watchObservedRunningTime="2026-07-13 02:58:40.49232376 +0000 UTC m=+102.892924203" Jul 13 02:59:07.893608 ip-10-0-134-52 kubenswrapper[2558]: I0713 02:59:07.893573 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/72ebddc5-a4ff-4e56-a65d-508775d02170-metrics-certs\") pod \"network-metrics-daemon-jt47w\" (UID: \"72ebddc5-a4ff-4e56-a65d-508775d02170\") " pod="openshift-multus/network-metrics-daemon-jt47w" Jul 13 02:59:07.893980 ip-10-0-134-52 kubenswrapper[2558]: E0713 02:59:07.893693 2558 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: secret "metrics-daemon-secret" not found Jul 13 02:59:07.893980 ip-10-0-134-52 kubenswrapper[2558]: E0713 02:59:07.893752 2558 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/72ebddc5-a4ff-4e56-a65d-508775d02170-metrics-certs podName:72ebddc5-a4ff-4e56-a65d-508775d02170 nodeName:}" failed. No retries permitted until 2026-07-13 03:01:09.893738914 +0000 UTC m=+252.294339357 (durationBeforeRetry 2m2s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/72ebddc5-a4ff-4e56-a65d-508775d02170-metrics-certs") pod "network-metrics-daemon-jt47w" (UID: "72ebddc5-a4ff-4e56-a65d-508775d02170") : secret "metrics-daemon-secret" not found Jul 13 02:59:37.531545 ip-10-0-134-52 kubenswrapper[2558]: E0713 02:59:37.531499 2558 pod_workers.go:1324] "Error syncing pod, skipping" err="unmounted volumes=[metrics-tls], unattached volumes=[], failed to process volumes=[]: context deadline exceeded" pod="openshift-dns/dns-default-qkxhh" podUID="82341e74-e954-41d9-aac3-4e537551717a" Jul 13 02:59:37.667858 ip-10-0-134-52 kubenswrapper[2558]: I0713 02:59:37.667835 2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-qkxhh" Jul 13 02:59:39.108482 ip-10-0-134-52 kubenswrapper[2558]: E0713 02:59:39.108440 2558 pod_workers.go:1324] "Error syncing pod, skipping" err="unmounted volumes=[metrics-certs], unattached volumes=[], failed to process volumes=[]: context deadline exceeded" pod="openshift-multus/network-metrics-daemon-jt47w" podUID="72ebddc5-a4ff-4e56-a65d-508775d02170" Jul 13 02:59:42.508773 ip-10-0-134-52 kubenswrapper[2558]: I0713 02:59:42.508736 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/82341e74-e954-41d9-aac3-4e537551717a-metrics-tls\") pod \"dns-default-qkxhh\" (UID: \"82341e74-e954-41d9-aac3-4e537551717a\") " pod="openshift-dns/dns-default-qkxhh" Jul 13 02:59:42.509147 ip-10-0-134-52 kubenswrapper[2558]: E0713 02:59:42.508890 2558 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jul 13 02:59:42.509147 ip-10-0-134-52 kubenswrapper[2558]: E0713 02:59:42.508964 2558 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/82341e74-e954-41d9-aac3-4e537551717a-metrics-tls podName:82341e74-e954-41d9-aac3-4e537551717a nodeName:}" failed. No retries permitted until 2026-07-13 03:01:44.508948118 +0000 UTC m=+286.909548566 (durationBeforeRetry 2m2s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/82341e74-e954-41d9-aac3-4e537551717a-metrics-tls") pod "dns-default-qkxhh" (UID: "82341e74-e954-41d9-aac3-4e537551717a") : secret "dns-default-metrics-tls" not found Jul 13 02:59:54.086815 ip-10-0-134-52 kubenswrapper[2558]: I0713 02:59:54.086734 2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-jt47w" Jul 13 03:00:48.498983 ip-10-0-134-52 kubenswrapper[2558]: I0713 03:00:48.498944 2558 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-cluster-storage-operator/volume-data-source-validator-78495597f6-kx2qx"] Jul 13 03:00:48.500726 ip-10-0-134-52 kubenswrapper[2558]: I0713 03:00:48.500711 2558 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-image-registry/image-registry-57f887d685-pgx8m"] Jul 13 03:00:48.500851 ip-10-0-134-52 kubenswrapper[2558]: I0713 03:00:48.500832 2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-storage-operator/volume-data-source-validator-78495597f6-kx2qx" Jul 13 03:00:48.502262 ip-10-0-134-52 kubenswrapper[2558]: I0713 03:00:48.502244 2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-57f887d685-pgx8m" Jul 13 03:00:48.503543 ip-10-0-134-52 kubenswrapper[2558]: I0713 03:00:48.503523 2558 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-storage-operator\"/\"kube-root-ca.crt\"" Jul 13 03:00:48.503543 ip-10-0-134-52 kubenswrapper[2558]: I0713 03:00:48.503539 2558 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-storage-operator\"/\"openshift-service-ca.crt\"" Jul 13 03:00:48.503694 ip-10-0-134-52 kubenswrapper[2558]: I0713 03:00:48.503589 2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-storage-operator\"/\"volume-data-source-validator-dockercfg-ggvmb\"" Jul 13 03:00:48.505086 ip-10-0-134-52 kubenswrapper[2558]: I0713 03:00:48.505070 2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"image-registry-private-configuration\"" Jul 13 03:00:48.505174 ip-10-0-134-52 kubenswrapper[2558]: I0713 03:00:48.505083 2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"image-registry-tls\"" Jul 13 03:00:48.505912 ip-10-0-134-52 kubenswrapper[2558]: I0713 03:00:48.505886 2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"installation-pull-secrets\"" Jul 13 03:00:48.506564 ip-10-0-134-52 kubenswrapper[2558]: I0713 03:00:48.506546 2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"registry-dockercfg-jtncw\"" Jul 13 03:00:48.513302 ip-10-0-134-52 kubenswrapper[2558]: I0713 03:00:48.513284 2558 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"trusted-ca\"" Jul 13 03:00:48.529943 ip-10-0-134-52 kubenswrapper[2558]: I0713 03:00:48.529922 2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-image-registry/image-registry-57f887d685-pgx8m"] Jul 13 03:00:48.552698 ip-10-0-134-52 kubenswrapper[2558]: I0713 03:00:48.552674 2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-cluster-storage-operator/volume-data-source-validator-78495597f6-kx2qx"] Jul 13 03:00:48.593951 ip-10-0-134-52 kubenswrapper[2558]: I0713 03:00:48.593924 2558 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-service-ca-operator/service-ca-operator-7695fc6c8c-h9xnt"] Jul 13 03:00:48.595754 ip-10-0-134-52 kubenswrapper[2558]: I0713 03:00:48.595737 2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-service-ca-operator/service-ca-operator-7695fc6c8c-h9xnt" Jul 13 03:00:48.598300 ip-10-0-134-52 kubenswrapper[2558]: I0713 03:00:48.598277 2558 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-service-ca-operator\"/\"service-ca-operator-config\"" Jul 13 03:00:48.598428 ip-10-0-134-52 kubenswrapper[2558]: I0713 03:00:48.598352 2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-service-ca-operator\"/\"service-ca-operator-dockercfg-dq47v\"" Jul 13 03:00:48.598428 ip-10-0-134-52 kubenswrapper[2558]: I0713 03:00:48.598352 2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-service-ca-operator\"/\"serving-cert\"" Jul 13 03:00:48.598584 ip-10-0-134-52 kubenswrapper[2558]: I0713 03:00:48.598571 2558 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-service-ca-operator\"/\"kube-root-ca.crt\"" Jul 13 03:00:48.598748 ip-10-0-134-52 kubenswrapper[2558]: I0713 03:00:48.598732 2558 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-service-ca-operator\"/\"openshift-service-ca.crt\"" Jul 13 03:00:48.600523 ip-10-0-134-52 kubenswrapper[2558]: I0713 03:00:48.600505 2558 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/router-default-7d87747c94-bc7qr"] Jul 13 03:00:48.602717 ip-10-0-134-52 kubenswrapper[2558]: I0713 03:00:48.602699 2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/router-default-7d87747c94-bc7qr" Jul 13 03:00:48.605199 ip-10-0-134-52 kubenswrapper[2558]: I0713 03:00:48.605181 2558 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"service-ca-bundle\"" Jul 13 03:00:48.605199 ip-10-0-134-52 kubenswrapper[2558]: I0713 03:00:48.605194 2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"router-metrics-certs-default\"" Jul 13 03:00:48.605518 ip-10-0-134-52 kubenswrapper[2558]: I0713 03:00:48.605500 2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"router-stats-default\"" Jul 13 03:00:48.605856 ip-10-0-134-52 kubenswrapper[2558]: I0713 03:00:48.605833 2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"router-dockercfg-ljjtq\"" Jul 13 03:00:48.606045 ip-10-0-134-52 kubenswrapper[2558]: I0713 03:00:48.606031 2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"default-ingress-cert\"" Jul 13 03:00:48.606122 ip-10-0-134-52 kubenswrapper[2558]: I0713 03:00:48.606103 2558 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"openshift-service-ca.crt\"" Jul 13 03:00:48.606788 ip-10-0-134-52 kubenswrapper[2558]: I0713 03:00:48.606775 2558 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"kube-root-ca.crt\"" Jul 13 03:00:48.612641 ip-10-0-134-52 kubenswrapper[2558]: I0713 03:00:48.612594 2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-service-ca-operator/service-ca-operator-7695fc6c8c-h9xnt"] Jul 13 03:00:48.612788 ip-10-0-134-52 kubenswrapper[2558]: I0713 03:00:48.612767 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/20a99b49-0854-4214-bfb7-aab2b9ade3d8-installation-pull-secrets\") pod \"image-registry-57f887d685-pgx8m\" (UID: \"20a99b49-0854-4214-bfb7-aab2b9ade3d8\") " pod="openshift-image-registry/image-registry-57f887d685-pgx8m" Jul 13 03:00:48.612852 ip-10-0-134-52 kubenswrapper[2558]: I0713 03:00:48.612798 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/20a99b49-0854-4214-bfb7-aab2b9ade3d8-trusted-ca\") pod \"image-registry-57f887d685-pgx8m\" (UID: \"20a99b49-0854-4214-bfb7-aab2b9ade3d8\") " pod="openshift-image-registry/image-registry-57f887d685-pgx8m" Jul 13 03:00:48.612852 ip-10-0-134-52 kubenswrapper[2558]: I0713 03:00:48.612818 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-xhvkl\" (UniqueName: \"kubernetes.io/projected/20a99b49-0854-4214-bfb7-aab2b9ade3d8-kube-api-access-xhvkl\") pod \"image-registry-57f887d685-pgx8m\" (UID: \"20a99b49-0854-4214-bfb7-aab2b9ade3d8\") " pod="openshift-image-registry/image-registry-57f887d685-pgx8m" Jul 13 03:00:48.612958 ip-10-0-134-52 kubenswrapper[2558]: I0713 03:00:48.612857 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/20a99b49-0854-4214-bfb7-aab2b9ade3d8-ca-trust-extracted\") pod \"image-registry-57f887d685-pgx8m\" (UID: \"20a99b49-0854-4214-bfb7-aab2b9ade3d8\") " pod="openshift-image-registry/image-registry-57f887d685-pgx8m" Jul 13 03:00:48.612958 ip-10-0-134-52 kubenswrapper[2558]: I0713 03:00:48.612889 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/20a99b49-0854-4214-bfb7-aab2b9ade3d8-registry-certificates\") pod \"image-registry-57f887d685-pgx8m\" (UID: \"20a99b49-0854-4214-bfb7-aab2b9ade3d8\") " pod="openshift-image-registry/image-registry-57f887d685-pgx8m" Jul 13 03:00:48.612958 ip-10-0-134-52 kubenswrapper[2558]: I0713 03:00:48.612905 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/20a99b49-0854-4214-bfb7-aab2b9ade3d8-bound-sa-token\") pod \"image-registry-57f887d685-pgx8m\" (UID: \"20a99b49-0854-4214-bfb7-aab2b9ade3d8\") " pod="openshift-image-registry/image-registry-57f887d685-pgx8m" Jul 13 03:00:48.613103 ip-10-0-134-52 kubenswrapper[2558]: I0713 03:00:48.612974 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/20a99b49-0854-4214-bfb7-aab2b9ade3d8-image-registry-private-configuration\") pod \"image-registry-57f887d685-pgx8m\" (UID: \"20a99b49-0854-4214-bfb7-aab2b9ade3d8\") " pod="openshift-image-registry/image-registry-57f887d685-pgx8m" Jul 13 03:00:48.613103 ip-10-0-134-52 kubenswrapper[2558]: I0713 03:00:48.612994 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/20a99b49-0854-4214-bfb7-aab2b9ade3d8-registry-tls\") pod \"image-registry-57f887d685-pgx8m\" (UID: \"20a99b49-0854-4214-bfb7-aab2b9ade3d8\") " pod="openshift-image-registry/image-registry-57f887d685-pgx8m" Jul 13 03:00:48.613103 ip-10-0-134-52 kubenswrapper[2558]: I0713 03:00:48.613053 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-7kbww\" (UniqueName: \"kubernetes.io/projected/8f4f3c7f-bfbd-4059-92bf-ea8272bb31b5-kube-api-access-7kbww\") pod \"volume-data-source-validator-78495597f6-kx2qx\" (UID: \"8f4f3c7f-bfbd-4059-92bf-ea8272bb31b5\") " pod="openshift-cluster-storage-operator/volume-data-source-validator-78495597f6-kx2qx" Jul 13 03:00:48.616056 ip-10-0-134-52 kubenswrapper[2558]: I0713 03:00:48.616038 2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/router-default-7d87747c94-bc7qr"] Jul 13 03:00:48.713704 ip-10-0-134-52 kubenswrapper[2558]: I0713 03:00:48.713673 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/20a99b49-0854-4214-bfb7-aab2b9ade3d8-registry-tls\") pod \"image-registry-57f887d685-pgx8m\" (UID: \"20a99b49-0854-4214-bfb7-aab2b9ade3d8\") " pod="openshift-image-registry/image-registry-57f887d685-pgx8m" Jul 13 03:00:48.713704 ip-10-0-134-52 kubenswrapper[2558]: I0713 03:00:48.713704 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-7kbww\" (UniqueName: \"kubernetes.io/projected/8f4f3c7f-bfbd-4059-92bf-ea8272bb31b5-kube-api-access-7kbww\") pod \"volume-data-source-validator-78495597f6-kx2qx\" (UID: \"8f4f3c7f-bfbd-4059-92bf-ea8272bb31b5\") " pod="openshift-cluster-storage-operator/volume-data-source-validator-78495597f6-kx2qx" Jul 13 03:00:48.713891 ip-10-0-134-52 kubenswrapper[2558]: I0713 03:00:48.713727 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-knzfv\" (UniqueName: \"kubernetes.io/projected/53d1746c-0708-4c16-ace0-20912ab1c2d3-kube-api-access-knzfv\") pod \"router-default-7d87747c94-bc7qr\" (UID: \"53d1746c-0708-4c16-ace0-20912ab1c2d3\") " pod="openshift-ingress/router-default-7d87747c94-bc7qr" Jul 13 03:00:48.713891 ip-10-0-134-52 kubenswrapper[2558]: I0713 03:00:48.713751 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-rn6tc\" (UniqueName: \"kubernetes.io/projected/88ac8e6e-8f83-4e52-a83a-50e24965359e-kube-api-access-rn6tc\") pod \"service-ca-operator-7695fc6c8c-h9xnt\" (UID: \"88ac8e6e-8f83-4e52-a83a-50e24965359e\") " pod="openshift-service-ca-operator/service-ca-operator-7695fc6c8c-h9xnt" Jul 13 03:00:48.713891 ip-10-0-134-52 kubenswrapper[2558]: I0713 03:00:48.713767 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"default-certificate\" (UniqueName: \"kubernetes.io/secret/53d1746c-0708-4c16-ace0-20912ab1c2d3-default-certificate\") pod \"router-default-7d87747c94-bc7qr\" (UID: \"53d1746c-0708-4c16-ace0-20912ab1c2d3\") " pod="openshift-ingress/router-default-7d87747c94-bc7qr" Jul 13 03:00:48.713891 ip-10-0-134-52 kubenswrapper[2558]: I0713 03:00:48.713785 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"stats-auth\" (UniqueName: \"kubernetes.io/secret/53d1746c-0708-4c16-ace0-20912ab1c2d3-stats-auth\") pod \"router-default-7d87747c94-bc7qr\" (UID: \"53d1746c-0708-4c16-ace0-20912ab1c2d3\") " pod="openshift-ingress/router-default-7d87747c94-bc7qr" Jul 13 03:00:48.713891 ip-10-0-134-52 kubenswrapper[2558]: I0713 03:00:48.713807 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/20a99b49-0854-4214-bfb7-aab2b9ade3d8-installation-pull-secrets\") pod \"image-registry-57f887d685-pgx8m\" (UID: \"20a99b49-0854-4214-bfb7-aab2b9ade3d8\") " pod="openshift-image-registry/image-registry-57f887d685-pgx8m" Jul 13 03:00:48.713891 ip-10-0-134-52 kubenswrapper[2558]: E0713 03:00:48.713827 2558 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found Jul 13 03:00:48.713891 ip-10-0-134-52 kubenswrapper[2558]: E0713 03:00:48.713848 2558 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-57f887d685-pgx8m: secret "image-registry-tls" not found Jul 13 03:00:48.714180 ip-10-0-134-52 kubenswrapper[2558]: E0713 03:00:48.713919 2558 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/20a99b49-0854-4214-bfb7-aab2b9ade3d8-registry-tls podName:20a99b49-0854-4214-bfb7-aab2b9ade3d8 nodeName:}" failed. No retries permitted until 2026-07-13 03:00:49.21389765 +0000 UTC m=+231.614498104 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/20a99b49-0854-4214-bfb7-aab2b9ade3d8-registry-tls") pod "image-registry-57f887d685-pgx8m" (UID: "20a99b49-0854-4214-bfb7-aab2b9ade3d8") : secret "image-registry-tls" not found Jul 13 03:00:48.714180 ip-10-0-134-52 kubenswrapper[2558]: I0713 03:00:48.713829 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/20a99b49-0854-4214-bfb7-aab2b9ade3d8-trusted-ca\") pod \"image-registry-57f887d685-pgx8m\" (UID: \"20a99b49-0854-4214-bfb7-aab2b9ade3d8\") " pod="openshift-image-registry/image-registry-57f887d685-pgx8m" Jul 13 03:00:48.714180 ip-10-0-134-52 kubenswrapper[2558]: I0713 03:00:48.713953 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/53d1746c-0708-4c16-ace0-20912ab1c2d3-metrics-certs\") pod \"router-default-7d87747c94-bc7qr\" (UID: \"53d1746c-0708-4c16-ace0-20912ab1c2d3\") " pod="openshift-ingress/router-default-7d87747c94-bc7qr" Jul 13 03:00:48.714180 ip-10-0-134-52 kubenswrapper[2558]: I0713 03:00:48.713998 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-xhvkl\" (UniqueName: \"kubernetes.io/projected/20a99b49-0854-4214-bfb7-aab2b9ade3d8-kube-api-access-xhvkl\") pod \"image-registry-57f887d685-pgx8m\" (UID: \"20a99b49-0854-4214-bfb7-aab2b9ade3d8\") " pod="openshift-image-registry/image-registry-57f887d685-pgx8m" Jul 13 03:00:48.714180 ip-10-0-134-52 kubenswrapper[2558]: I0713 03:00:48.714021 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/88ac8e6e-8f83-4e52-a83a-50e24965359e-config\") pod \"service-ca-operator-7695fc6c8c-h9xnt\" (UID: \"88ac8e6e-8f83-4e52-a83a-50e24965359e\") " pod="openshift-service-ca-operator/service-ca-operator-7695fc6c8c-h9xnt" Jul 13 03:00:48.714180 ip-10-0-134-52 kubenswrapper[2558]: I0713 03:00:48.714045 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/53d1746c-0708-4c16-ace0-20912ab1c2d3-service-ca-bundle\") pod \"router-default-7d87747c94-bc7qr\" (UID: \"53d1746c-0708-4c16-ace0-20912ab1c2d3\") " pod="openshift-ingress/router-default-7d87747c94-bc7qr" Jul 13 03:00:48.714180 ip-10-0-134-52 kubenswrapper[2558]: I0713 03:00:48.714122 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/20a99b49-0854-4214-bfb7-aab2b9ade3d8-ca-trust-extracted\") pod \"image-registry-57f887d685-pgx8m\" (UID: \"20a99b49-0854-4214-bfb7-aab2b9ade3d8\") " pod="openshift-image-registry/image-registry-57f887d685-pgx8m" Jul 13 03:00:48.714180 ip-10-0-134-52 kubenswrapper[2558]: I0713 03:00:48.714165 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/20a99b49-0854-4214-bfb7-aab2b9ade3d8-registry-certificates\") pod \"image-registry-57f887d685-pgx8m\" (UID: \"20a99b49-0854-4214-bfb7-aab2b9ade3d8\") " pod="openshift-image-registry/image-registry-57f887d685-pgx8m" Jul 13 03:00:48.714609 ip-10-0-134-52 kubenswrapper[2558]: I0713 03:00:48.714195 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/20a99b49-0854-4214-bfb7-aab2b9ade3d8-bound-sa-token\") pod \"image-registry-57f887d685-pgx8m\" (UID: \"20a99b49-0854-4214-bfb7-aab2b9ade3d8\") " pod="openshift-image-registry/image-registry-57f887d685-pgx8m" Jul 13 03:00:48.714609 ip-10-0-134-52 kubenswrapper[2558]: I0713 03:00:48.714384 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/20a99b49-0854-4214-bfb7-aab2b9ade3d8-image-registry-private-configuration\") pod \"image-registry-57f887d685-pgx8m\" (UID: \"20a99b49-0854-4214-bfb7-aab2b9ade3d8\") " pod="openshift-image-registry/image-registry-57f887d685-pgx8m" Jul 13 03:00:48.714609 ip-10-0-134-52 kubenswrapper[2558]: I0713 03:00:48.714423 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/88ac8e6e-8f83-4e52-a83a-50e24965359e-serving-cert\") pod \"service-ca-operator-7695fc6c8c-h9xnt\" (UID: \"88ac8e6e-8f83-4e52-a83a-50e24965359e\") " pod="openshift-service-ca-operator/service-ca-operator-7695fc6c8c-h9xnt" Jul 13 03:00:48.714609 ip-10-0-134-52 kubenswrapper[2558]: I0713 03:00:48.714435 2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/20a99b49-0854-4214-bfb7-aab2b9ade3d8-ca-trust-extracted\") pod \"image-registry-57f887d685-pgx8m\" (UID: \"20a99b49-0854-4214-bfb7-aab2b9ade3d8\") " pod="openshift-image-registry/image-registry-57f887d685-pgx8m" Jul 13 03:00:48.714802 ip-10-0-134-52 kubenswrapper[2558]: I0713 03:00:48.714750 2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/20a99b49-0854-4214-bfb7-aab2b9ade3d8-registry-certificates\") pod \"image-registry-57f887d685-pgx8m\" (UID: \"20a99b49-0854-4214-bfb7-aab2b9ade3d8\") " pod="openshift-image-registry/image-registry-57f887d685-pgx8m" Jul 13 03:00:48.714880 ip-10-0-134-52 kubenswrapper[2558]: I0713 03:00:48.714861 2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/20a99b49-0854-4214-bfb7-aab2b9ade3d8-trusted-ca\") pod \"image-registry-57f887d685-pgx8m\" (UID: \"20a99b49-0854-4214-bfb7-aab2b9ade3d8\") " pod="openshift-image-registry/image-registry-57f887d685-pgx8m" Jul 13 03:00:48.716377 ip-10-0-134-52 kubenswrapper[2558]: I0713 03:00:48.716358 2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/20a99b49-0854-4214-bfb7-aab2b9ade3d8-installation-pull-secrets\") pod \"image-registry-57f887d685-pgx8m\" (UID: \"20a99b49-0854-4214-bfb7-aab2b9ade3d8\") " pod="openshift-image-registry/image-registry-57f887d685-pgx8m" Jul 13 03:00:48.716674 ip-10-0-134-52 kubenswrapper[2558]: I0713 03:00:48.716657 2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/20a99b49-0854-4214-bfb7-aab2b9ade3d8-image-registry-private-configuration\") pod \"image-registry-57f887d685-pgx8m\" (UID: \"20a99b49-0854-4214-bfb7-aab2b9ade3d8\") " pod="openshift-image-registry/image-registry-57f887d685-pgx8m" Jul 13 03:00:48.724147 ip-10-0-134-52 kubenswrapper[2558]: I0713 03:00:48.724126 2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-xhvkl\" (UniqueName: \"kubernetes.io/projected/20a99b49-0854-4214-bfb7-aab2b9ade3d8-kube-api-access-xhvkl\") pod \"image-registry-57f887d685-pgx8m\" (UID: \"20a99b49-0854-4214-bfb7-aab2b9ade3d8\") " pod="openshift-image-registry/image-registry-57f887d685-pgx8m" Jul 13 03:00:48.725204 ip-10-0-134-52 kubenswrapper[2558]: I0713 03:00:48.725186 2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/20a99b49-0854-4214-bfb7-aab2b9ade3d8-bound-sa-token\") pod \"image-registry-57f887d685-pgx8m\" (UID: \"20a99b49-0854-4214-bfb7-aab2b9ade3d8\") " pod="openshift-image-registry/image-registry-57f887d685-pgx8m" Jul 13 03:00:48.725749 ip-10-0-134-52 kubenswrapper[2558]: I0713 03:00:48.725733 2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-7kbww\" (UniqueName: \"kubernetes.io/projected/8f4f3c7f-bfbd-4059-92bf-ea8272bb31b5-kube-api-access-7kbww\") pod \"volume-data-source-validator-78495597f6-kx2qx\" (UID: \"8f4f3c7f-bfbd-4059-92bf-ea8272bb31b5\") " pod="openshift-cluster-storage-operator/volume-data-source-validator-78495597f6-kx2qx" Jul 13 03:00:48.810617 ip-10-0-134-52 kubenswrapper[2558]: I0713 03:00:48.810596 2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-storage-operator/volume-data-source-validator-78495597f6-kx2qx" Jul 13 03:00:48.814968 ip-10-0-134-52 kubenswrapper[2558]: I0713 03:00:48.814945 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/53d1746c-0708-4c16-ace0-20912ab1c2d3-metrics-certs\") pod \"router-default-7d87747c94-bc7qr\" (UID: \"53d1746c-0708-4c16-ace0-20912ab1c2d3\") " pod="openshift-ingress/router-default-7d87747c94-bc7qr" Jul 13 03:00:48.815074 ip-10-0-134-52 kubenswrapper[2558]: I0713 03:00:48.814973 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/88ac8e6e-8f83-4e52-a83a-50e24965359e-config\") pod \"service-ca-operator-7695fc6c8c-h9xnt\" (UID: \"88ac8e6e-8f83-4e52-a83a-50e24965359e\") " pod="openshift-service-ca-operator/service-ca-operator-7695fc6c8c-h9xnt" Jul 13 03:00:48.815074 ip-10-0-134-52 kubenswrapper[2558]: I0713 03:00:48.814989 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/53d1746c-0708-4c16-ace0-20912ab1c2d3-service-ca-bundle\") pod \"router-default-7d87747c94-bc7qr\" (UID: \"53d1746c-0708-4c16-ace0-20912ab1c2d3\") " pod="openshift-ingress/router-default-7d87747c94-bc7qr" Jul 13 03:00:48.815074 ip-10-0-134-52 kubenswrapper[2558]: I0713 03:00:48.815043 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/88ac8e6e-8f83-4e52-a83a-50e24965359e-serving-cert\") pod \"service-ca-operator-7695fc6c8c-h9xnt\" (UID: \"88ac8e6e-8f83-4e52-a83a-50e24965359e\") " pod="openshift-service-ca-operator/service-ca-operator-7695fc6c8c-h9xnt" Jul 13 03:00:48.815228 ip-10-0-134-52 kubenswrapper[2558]: I0713 03:00:48.815081 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-knzfv\" (UniqueName: \"kubernetes.io/projected/53d1746c-0708-4c16-ace0-20912ab1c2d3-kube-api-access-knzfv\") pod \"router-default-7d87747c94-bc7qr\" (UID: \"53d1746c-0708-4c16-ace0-20912ab1c2d3\") " pod="openshift-ingress/router-default-7d87747c94-bc7qr" Jul 13 03:00:48.815228 ip-10-0-134-52 kubenswrapper[2558]: E0713 03:00:48.815088 2558 secret.go:189] Couldn't get secret openshift-ingress/router-metrics-certs-default: secret "router-metrics-certs-default" not found Jul 13 03:00:48.815228 ip-10-0-134-52 kubenswrapper[2558]: I0713 03:00:48.815111 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-rn6tc\" (UniqueName: \"kubernetes.io/projected/88ac8e6e-8f83-4e52-a83a-50e24965359e-kube-api-access-rn6tc\") pod \"service-ca-operator-7695fc6c8c-h9xnt\" (UID: \"88ac8e6e-8f83-4e52-a83a-50e24965359e\") " pod="openshift-service-ca-operator/service-ca-operator-7695fc6c8c-h9xnt" Jul 13 03:00:48.815228 ip-10-0-134-52 kubenswrapper[2558]: I0713 03:00:48.815134 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"default-certificate\" (UniqueName: \"kubernetes.io/secret/53d1746c-0708-4c16-ace0-20912ab1c2d3-default-certificate\") pod \"router-default-7d87747c94-bc7qr\" (UID: \"53d1746c-0708-4c16-ace0-20912ab1c2d3\") " pod="openshift-ingress/router-default-7d87747c94-bc7qr" Jul 13 03:00:48.815228 ip-10-0-134-52 kubenswrapper[2558]: E0713 03:00:48.815159 2558 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/53d1746c-0708-4c16-ace0-20912ab1c2d3-metrics-certs podName:53d1746c-0708-4c16-ace0-20912ab1c2d3 nodeName:}" failed. No retries permitted until 2026-07-13 03:00:49.315138928 +0000 UTC m=+231.715739375 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/53d1746c-0708-4c16-ace0-20912ab1c2d3-metrics-certs") pod "router-default-7d87747c94-bc7qr" (UID: "53d1746c-0708-4c16-ace0-20912ab1c2d3") : secret "router-metrics-certs-default" not found Jul 13 03:00:48.815228 ip-10-0-134-52 kubenswrapper[2558]: I0713 03:00:48.815193 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"stats-auth\" (UniqueName: \"kubernetes.io/secret/53d1746c-0708-4c16-ace0-20912ab1c2d3-stats-auth\") pod \"router-default-7d87747c94-bc7qr\" (UID: \"53d1746c-0708-4c16-ace0-20912ab1c2d3\") " pod="openshift-ingress/router-default-7d87747c94-bc7qr" Jul 13 03:00:48.815573 ip-10-0-134-52 kubenswrapper[2558]: E0713 03:00:48.815399 2558 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/53d1746c-0708-4c16-ace0-20912ab1c2d3-service-ca-bundle podName:53d1746c-0708-4c16-ace0-20912ab1c2d3 nodeName:}" failed. No retries permitted until 2026-07-13 03:00:49.315379858 +0000 UTC m=+231.715980308 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "service-ca-bundle" (UniqueName: "kubernetes.io/configmap/53d1746c-0708-4c16-ace0-20912ab1c2d3-service-ca-bundle") pod "router-default-7d87747c94-bc7qr" (UID: "53d1746c-0708-4c16-ace0-20912ab1c2d3") : configmap references non-existent config key: service-ca.crt Jul 13 03:00:48.815692 ip-10-0-134-52 kubenswrapper[2558]: I0713 03:00:48.815667 2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/configmap/88ac8e6e-8f83-4e52-a83a-50e24965359e-config\") pod \"service-ca-operator-7695fc6c8c-h9xnt\" (UID: \"88ac8e6e-8f83-4e52-a83a-50e24965359e\") " pod="openshift-service-ca-operator/service-ca-operator-7695fc6c8c-h9xnt" Jul 13 03:00:48.817495 ip-10-0-134-52 kubenswrapper[2558]: I0713 03:00:48.817470 2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/88ac8e6e-8f83-4e52-a83a-50e24965359e-serving-cert\") pod \"service-ca-operator-7695fc6c8c-h9xnt\" (UID: \"88ac8e6e-8f83-4e52-a83a-50e24965359e\") " pod="openshift-service-ca-operator/service-ca-operator-7695fc6c8c-h9xnt" Jul 13 03:00:48.817670 ip-10-0-134-52 kubenswrapper[2558]: I0713 03:00:48.817647 2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"default-certificate\" (UniqueName: \"kubernetes.io/secret/53d1746c-0708-4c16-ace0-20912ab1c2d3-default-certificate\") pod \"router-default-7d87747c94-bc7qr\" (UID: \"53d1746c-0708-4c16-ace0-20912ab1c2d3\") " pod="openshift-ingress/router-default-7d87747c94-bc7qr" Jul 13 03:00:48.817739 ip-10-0-134-52 kubenswrapper[2558]: I0713 03:00:48.817724 2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"stats-auth\" (UniqueName: \"kubernetes.io/secret/53d1746c-0708-4c16-ace0-20912ab1c2d3-stats-auth\") pod \"router-default-7d87747c94-bc7qr\" (UID: \"53d1746c-0708-4c16-ace0-20912ab1c2d3\") " pod="openshift-ingress/router-default-7d87747c94-bc7qr" Jul 13 03:00:48.823690 ip-10-0-134-52 kubenswrapper[2558]: I0713 03:00:48.823439 2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-rn6tc\" (UniqueName: \"kubernetes.io/projected/88ac8e6e-8f83-4e52-a83a-50e24965359e-kube-api-access-rn6tc\") pod \"service-ca-operator-7695fc6c8c-h9xnt\" (UID: \"88ac8e6e-8f83-4e52-a83a-50e24965359e\") " pod="openshift-service-ca-operator/service-ca-operator-7695fc6c8c-h9xnt" Jul 13 03:00:48.823690 ip-10-0-134-52 kubenswrapper[2558]: I0713 03:00:48.823654 2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-knzfv\" (UniqueName: \"kubernetes.io/projected/53d1746c-0708-4c16-ace0-20912ab1c2d3-kube-api-access-knzfv\") pod \"router-default-7d87747c94-bc7qr\" (UID: \"53d1746c-0708-4c16-ace0-20912ab1c2d3\") " pod="openshift-ingress/router-default-7d87747c94-bc7qr" Jul 13 03:00:48.904762 ip-10-0-134-52 kubenswrapper[2558]: I0713 03:00:48.904725 2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-service-ca-operator/service-ca-operator-7695fc6c8c-h9xnt" Jul 13 03:00:48.929487 ip-10-0-134-52 kubenswrapper[2558]: I0713 03:00:48.929460 2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-cluster-storage-operator/volume-data-source-validator-78495597f6-kx2qx"] Jul 13 03:00:48.931744 ip-10-0-134-52 kubenswrapper[2558]: W0713 03:00:48.931704 2558 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod8f4f3c7f_bfbd_4059_92bf_ea8272bb31b5.slice/crio-9a6602dbe902398eb61751a6ae8b3d85513e9fb8ad9c41e179147e8bc1e1c2eb WatchSource:0}: Error finding container 9a6602dbe902398eb61751a6ae8b3d85513e9fb8ad9c41e179147e8bc1e1c2eb: Status 404 returned error can't find the container with id 9a6602dbe902398eb61751a6ae8b3d85513e9fb8ad9c41e179147e8bc1e1c2eb Jul 13 03:00:49.025833 ip-10-0-134-52 kubenswrapper[2558]: I0713 03:00:49.025668 2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-service-ca-operator/service-ca-operator-7695fc6c8c-h9xnt"] Jul 13 03:00:49.028070 ip-10-0-134-52 kubenswrapper[2558]: W0713 03:00:49.028048 2558 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod88ac8e6e_8f83_4e52_a83a_50e24965359e.slice/crio-93450f386835bb1496e3292eff515e0ad79804dc45c2039737410a74bd9a60bf WatchSource:0}: Error finding container 93450f386835bb1496e3292eff515e0ad79804dc45c2039737410a74bd9a60bf: Status 404 returned error can't find the container with id 93450f386835bb1496e3292eff515e0ad79804dc45c2039737410a74bd9a60bf Jul 13 03:00:49.217758 ip-10-0-134-52 kubenswrapper[2558]: I0713 03:00:49.217670 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/20a99b49-0854-4214-bfb7-aab2b9ade3d8-registry-tls\") pod \"image-registry-57f887d685-pgx8m\" (UID: \"20a99b49-0854-4214-bfb7-aab2b9ade3d8\") " pod="openshift-image-registry/image-registry-57f887d685-pgx8m" Jul 13 03:00:49.217893 ip-10-0-134-52 kubenswrapper[2558]: E0713 03:00:49.217815 2558 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found Jul 13 03:00:49.217893 ip-10-0-134-52 kubenswrapper[2558]: E0713 03:00:49.217834 2558 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-57f887d685-pgx8m: secret "image-registry-tls" not found Jul 13 03:00:49.217893 ip-10-0-134-52 kubenswrapper[2558]: E0713 03:00:49.217888 2558 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/20a99b49-0854-4214-bfb7-aab2b9ade3d8-registry-tls podName:20a99b49-0854-4214-bfb7-aab2b9ade3d8 nodeName:}" failed. No retries permitted until 2026-07-13 03:00:50.217872407 +0000 UTC m=+232.618472851 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/20a99b49-0854-4214-bfb7-aab2b9ade3d8-registry-tls") pod "image-registry-57f887d685-pgx8m" (UID: "20a99b49-0854-4214-bfb7-aab2b9ade3d8") : secret "image-registry-tls" not found Jul 13 03:00:49.318282 ip-10-0-134-52 kubenswrapper[2558]: I0713 03:00:49.318252 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/53d1746c-0708-4c16-ace0-20912ab1c2d3-metrics-certs\") pod \"router-default-7d87747c94-bc7qr\" (UID: \"53d1746c-0708-4c16-ace0-20912ab1c2d3\") " pod="openshift-ingress/router-default-7d87747c94-bc7qr" Jul 13 03:00:49.318420 ip-10-0-134-52 kubenswrapper[2558]: I0713 03:00:49.318291 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/53d1746c-0708-4c16-ace0-20912ab1c2d3-service-ca-bundle\") pod \"router-default-7d87747c94-bc7qr\" (UID: \"53d1746c-0708-4c16-ace0-20912ab1c2d3\") " pod="openshift-ingress/router-default-7d87747c94-bc7qr" Jul 13 03:00:49.318475 ip-10-0-134-52 kubenswrapper[2558]: E0713 03:00:49.318417 2558 secret.go:189] Couldn't get secret openshift-ingress/router-metrics-certs-default: secret "router-metrics-certs-default" not found Jul 13 03:00:49.318475 ip-10-0-134-52 kubenswrapper[2558]: E0713 03:00:49.318470 2558 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/53d1746c-0708-4c16-ace0-20912ab1c2d3-service-ca-bundle podName:53d1746c-0708-4c16-ace0-20912ab1c2d3 nodeName:}" failed. No retries permitted until 2026-07-13 03:00:50.318453208 +0000 UTC m=+232.719053654 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "service-ca-bundle" (UniqueName: "kubernetes.io/configmap/53d1746c-0708-4c16-ace0-20912ab1c2d3-service-ca-bundle") pod "router-default-7d87747c94-bc7qr" (UID: "53d1746c-0708-4c16-ace0-20912ab1c2d3") : configmap references non-existent config key: service-ca.crt Jul 13 03:00:49.318542 ip-10-0-134-52 kubenswrapper[2558]: E0713 03:00:49.318487 2558 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/53d1746c-0708-4c16-ace0-20912ab1c2d3-metrics-certs podName:53d1746c-0708-4c16-ace0-20912ab1c2d3 nodeName:}" failed. No retries permitted until 2026-07-13 03:00:50.31848025 +0000 UTC m=+232.719080694 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/53d1746c-0708-4c16-ace0-20912ab1c2d3-metrics-certs") pod "router-default-7d87747c94-bc7qr" (UID: "53d1746c-0708-4c16-ace0-20912ab1c2d3") : secret "router-metrics-certs-default" not found Jul 13 03:00:49.828241 ip-10-0-134-52 kubenswrapper[2558]: I0713 03:00:49.828206 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-storage-operator/volume-data-source-validator-78495597f6-kx2qx" event={"ID":"8f4f3c7f-bfbd-4059-92bf-ea8272bb31b5","Type":"ContainerStarted","Data":"9a6602dbe902398eb61751a6ae8b3d85513e9fb8ad9c41e179147e8bc1e1c2eb"} Jul 13 03:00:49.829441 ip-10-0-134-52 kubenswrapper[2558]: I0713 03:00:49.829400 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-service-ca-operator/service-ca-operator-7695fc6c8c-h9xnt" event={"ID":"88ac8e6e-8f83-4e52-a83a-50e24965359e","Type":"ContainerStarted","Data":"93450f386835bb1496e3292eff515e0ad79804dc45c2039737410a74bd9a60bf"} Jul 13 03:00:50.224058 ip-10-0-134-52 kubenswrapper[2558]: I0713 03:00:50.223980 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/20a99b49-0854-4214-bfb7-aab2b9ade3d8-registry-tls\") pod \"image-registry-57f887d685-pgx8m\" (UID: \"20a99b49-0854-4214-bfb7-aab2b9ade3d8\") " pod="openshift-image-registry/image-registry-57f887d685-pgx8m" Jul 13 03:00:50.224219 ip-10-0-134-52 kubenswrapper[2558]: E0713 03:00:50.224155 2558 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found Jul 13 03:00:50.224219 ip-10-0-134-52 kubenswrapper[2558]: E0713 03:00:50.224175 2558 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-57f887d685-pgx8m: secret "image-registry-tls" not found Jul 13 03:00:50.224352 ip-10-0-134-52 kubenswrapper[2558]: E0713 03:00:50.224244 2558 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/20a99b49-0854-4214-bfb7-aab2b9ade3d8-registry-tls podName:20a99b49-0854-4214-bfb7-aab2b9ade3d8 nodeName:}" failed. No retries permitted until 2026-07-13 03:00:52.224227529 +0000 UTC m=+234.624827996 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/20a99b49-0854-4214-bfb7-aab2b9ade3d8-registry-tls") pod "image-registry-57f887d685-pgx8m" (UID: "20a99b49-0854-4214-bfb7-aab2b9ade3d8") : secret "image-registry-tls" not found Jul 13 03:00:50.324445 ip-10-0-134-52 kubenswrapper[2558]: I0713 03:00:50.324412 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/53d1746c-0708-4c16-ace0-20912ab1c2d3-metrics-certs\") pod \"router-default-7d87747c94-bc7qr\" (UID: \"53d1746c-0708-4c16-ace0-20912ab1c2d3\") " pod="openshift-ingress/router-default-7d87747c94-bc7qr" Jul 13 03:00:50.324606 ip-10-0-134-52 kubenswrapper[2558]: I0713 03:00:50.324463 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/53d1746c-0708-4c16-ace0-20912ab1c2d3-service-ca-bundle\") pod \"router-default-7d87747c94-bc7qr\" (UID: \"53d1746c-0708-4c16-ace0-20912ab1c2d3\") " pod="openshift-ingress/router-default-7d87747c94-bc7qr" Jul 13 03:00:50.324606 ip-10-0-134-52 kubenswrapper[2558]: E0713 03:00:50.324574 2558 secret.go:189] Couldn't get secret openshift-ingress/router-metrics-certs-default: secret "router-metrics-certs-default" not found Jul 13 03:00:50.324726 ip-10-0-134-52 kubenswrapper[2558]: E0713 03:00:50.324623 2558 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/53d1746c-0708-4c16-ace0-20912ab1c2d3-service-ca-bundle podName:53d1746c-0708-4c16-ace0-20912ab1c2d3 nodeName:}" failed. No retries permitted until 2026-07-13 03:00:52.324603307 +0000 UTC m=+234.725203751 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "service-ca-bundle" (UniqueName: "kubernetes.io/configmap/53d1746c-0708-4c16-ace0-20912ab1c2d3-service-ca-bundle") pod "router-default-7d87747c94-bc7qr" (UID: "53d1746c-0708-4c16-ace0-20912ab1c2d3") : configmap references non-existent config key: service-ca.crt Jul 13 03:00:50.324726 ip-10-0-134-52 kubenswrapper[2558]: E0713 03:00:50.324640 2558 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/53d1746c-0708-4c16-ace0-20912ab1c2d3-metrics-certs podName:53d1746c-0708-4c16-ace0-20912ab1c2d3 nodeName:}" failed. No retries permitted until 2026-07-13 03:00:52.324633706 +0000 UTC m=+234.725234149 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/53d1746c-0708-4c16-ace0-20912ab1c2d3-metrics-certs") pod "router-default-7d87747c94-bc7qr" (UID: "53d1746c-0708-4c16-ace0-20912ab1c2d3") : secret "router-metrics-certs-default" not found Jul 13 03:00:50.833522 ip-10-0-134-52 kubenswrapper[2558]: I0713 03:00:50.833479 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-storage-operator/volume-data-source-validator-78495597f6-kx2qx" event={"ID":"8f4f3c7f-bfbd-4059-92bf-ea8272bb31b5","Type":"ContainerStarted","Data":"172cac0dc08c1db49c1e5d7addc677794014eb61f8fec583d3fce51b7c066652"} Jul 13 03:00:50.850899 ip-10-0-134-52 kubenswrapper[2558]: I0713 03:00:50.850847 2558 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-storage-operator/volume-data-source-validator-78495597f6-kx2qx" podStartSLOduration=1.382057005 podStartE2EDuration="2.850829611s" totalImagesPullingTime="1.468772606s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-13 03:00:48 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-13 03:00:50.850753134 +0000 UTC m=+233.251353601" watchObservedRunningTime="2026-07-13 03:00:50.850829611 +0000 UTC m=+233.251430078" Jul 13 03:00:51.837723 ip-10-0-134-52 kubenswrapper[2558]: I0713 03:00:51.837685 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-service-ca-operator/service-ca-operator-7695fc6c8c-h9xnt" event={"ID":"88ac8e6e-8f83-4e52-a83a-50e24965359e","Type":"ContainerStarted","Data":"c6152609803d328c0fef85559cf8df4753fd110e32c1875246ab6ee56cbffc9c"} Jul 13 03:00:51.854313 ip-10-0-134-52 kubenswrapper[2558]: I0713 03:00:51.854262 2558 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-service-ca-operator/service-ca-operator-7695fc6c8c-h9xnt" podStartSLOduration=1.704882629 podStartE2EDuration="3.854243037s" totalImagesPullingTime="2.149360408s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-13 03:00:48 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-13 03:00:51.85376971 +0000 UTC m=+234.254370176" watchObservedRunningTime="2026-07-13 03:00:51.854243037 +0000 UTC m=+234.254843505" Jul 13 03:00:52.236196 ip-10-0-134-52 kubenswrapper[2558]: I0713 03:00:52.236121 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/20a99b49-0854-4214-bfb7-aab2b9ade3d8-registry-tls\") pod \"image-registry-57f887d685-pgx8m\" (UID: \"20a99b49-0854-4214-bfb7-aab2b9ade3d8\") " pod="openshift-image-registry/image-registry-57f887d685-pgx8m" Jul 13 03:00:52.236357 ip-10-0-134-52 kubenswrapper[2558]: E0713 03:00:52.236249 2558 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found Jul 13 03:00:52.236357 ip-10-0-134-52 kubenswrapper[2558]: E0713 03:00:52.236265 2558 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-57f887d685-pgx8m: secret "image-registry-tls" not found Jul 13 03:00:52.236357 ip-10-0-134-52 kubenswrapper[2558]: E0713 03:00:52.236313 2558 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/20a99b49-0854-4214-bfb7-aab2b9ade3d8-registry-tls podName:20a99b49-0854-4214-bfb7-aab2b9ade3d8 nodeName:}" failed. No retries permitted until 2026-07-13 03:00:56.236299758 +0000 UTC m=+238.636900205 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/20a99b49-0854-4214-bfb7-aab2b9ade3d8-registry-tls") pod "image-registry-57f887d685-pgx8m" (UID: "20a99b49-0854-4214-bfb7-aab2b9ade3d8") : secret "image-registry-tls" not found Jul 13 03:00:52.336825 ip-10-0-134-52 kubenswrapper[2558]: I0713 03:00:52.336800 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/53d1746c-0708-4c16-ace0-20912ab1c2d3-metrics-certs\") pod \"router-default-7d87747c94-bc7qr\" (UID: \"53d1746c-0708-4c16-ace0-20912ab1c2d3\") " pod="openshift-ingress/router-default-7d87747c94-bc7qr" Jul 13 03:00:52.336929 ip-10-0-134-52 kubenswrapper[2558]: I0713 03:00:52.336834 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/53d1746c-0708-4c16-ace0-20912ab1c2d3-service-ca-bundle\") pod \"router-default-7d87747c94-bc7qr\" (UID: \"53d1746c-0708-4c16-ace0-20912ab1c2d3\") " pod="openshift-ingress/router-default-7d87747c94-bc7qr" Jul 13 03:00:52.336990 ip-10-0-134-52 kubenswrapper[2558]: E0713 03:00:52.336950 2558 secret.go:189] Couldn't get secret openshift-ingress/router-metrics-certs-default: secret "router-metrics-certs-default" not found Jul 13 03:00:52.337044 ip-10-0-134-52 kubenswrapper[2558]: E0713 03:00:52.336960 2558 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/53d1746c-0708-4c16-ace0-20912ab1c2d3-service-ca-bundle podName:53d1746c-0708-4c16-ace0-20912ab1c2d3 nodeName:}" failed. No retries permitted until 2026-07-13 03:00:56.336948466 +0000 UTC m=+238.737548910 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "service-ca-bundle" (UniqueName: "kubernetes.io/configmap/53d1746c-0708-4c16-ace0-20912ab1c2d3-service-ca-bundle") pod "router-default-7d87747c94-bc7qr" (UID: "53d1746c-0708-4c16-ace0-20912ab1c2d3") : configmap references non-existent config key: service-ca.crt Jul 13 03:00:52.337044 ip-10-0-134-52 kubenswrapper[2558]: E0713 03:00:52.337018 2558 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/53d1746c-0708-4c16-ace0-20912ab1c2d3-metrics-certs podName:53d1746c-0708-4c16-ace0-20912ab1c2d3 nodeName:}" failed. No retries permitted until 2026-07-13 03:00:56.337001353 +0000 UTC m=+238.737601805 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/53d1746c-0708-4c16-ace0-20912ab1c2d3-metrics-certs") pod "router-default-7d87747c94-bc7qr" (UID: "53d1746c-0708-4c16-ace0-20912ab1c2d3") : secret "router-metrics-certs-default" not found Jul 13 03:00:53.879034 ip-10-0-134-52 kubenswrapper[2558]: I0713 03:00:53.879004 2558 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-insights/insights-runtime-extractor-stn4f"] Jul 13 03:00:53.882541 ip-10-0-134-52 kubenswrapper[2558]: I0713 03:00:53.882522 2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-runtime-extractor-stn4f" Jul 13 03:00:53.885202 ip-10-0-134-52 kubenswrapper[2558]: I0713 03:00:53.885185 2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-tls\"" Jul 13 03:00:53.885316 ip-10-0-134-52 kubenswrapper[2558]: I0713 03:00:53.885278 2558 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"openshift-service-ca.crt\"" Jul 13 03:00:53.885316 ip-10-0-134-52 kubenswrapper[2558]: I0713 03:00:53.885285 2558 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"kube-root-ca.crt\"" Jul 13 03:00:53.886609 ip-10-0-134-52 kubenswrapper[2558]: I0713 03:00:53.886582 2558 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"kube-rbac-proxy\"" Jul 13 03:00:53.886691 ip-10-0-134-52 kubenswrapper[2558]: I0713 03:00:53.886628 2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-sa-dockercfg-7mbnd\"" Jul 13 03:00:53.893196 ip-10-0-134-52 kubenswrapper[2558]: I0713 03:00:53.893174 2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-runtime-extractor-stn4f"] Jul 13 03:00:54.049911 ip-10-0-134-52 kubenswrapper[2558]: I0713 03:00:54.049885 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-vv244\" (UniqueName: \"kubernetes.io/projected/2b9a19e5-02f8-40b5-aa0c-eb48dfc39020-kube-api-access-vv244\") pod \"insights-runtime-extractor-stn4f\" (UID: \"2b9a19e5-02f8-40b5-aa0c-eb48dfc39020\") " pod="openshift-insights/insights-runtime-extractor-stn4f" Jul 13 03:00:54.050087 ip-10-0-134-52 kubenswrapper[2558]: I0713 03:00:54.049955 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/2b9a19e5-02f8-40b5-aa0c-eb48dfc39020-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-stn4f\" (UID: \"2b9a19e5-02f8-40b5-aa0c-eb48dfc39020\") " pod="openshift-insights/insights-runtime-extractor-stn4f" Jul 13 03:00:54.050087 ip-10-0-134-52 kubenswrapper[2558]: I0713 03:00:54.049985 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/2b9a19e5-02f8-40b5-aa0c-eb48dfc39020-data-volume\") pod \"insights-runtime-extractor-stn4f\" (UID: \"2b9a19e5-02f8-40b5-aa0c-eb48dfc39020\") " pod="openshift-insights/insights-runtime-extractor-stn4f" Jul 13 03:00:54.050087 ip-10-0-134-52 kubenswrapper[2558]: I0713 03:00:54.050012 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/2b9a19e5-02f8-40b5-aa0c-eb48dfc39020-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-stn4f\" (UID: \"2b9a19e5-02f8-40b5-aa0c-eb48dfc39020\") " pod="openshift-insights/insights-runtime-extractor-stn4f" Jul 13 03:00:54.050244 ip-10-0-134-52 kubenswrapper[2558]: I0713 03:00:54.050134 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/2b9a19e5-02f8-40b5-aa0c-eb48dfc39020-crio-socket\") pod \"insights-runtime-extractor-stn4f\" (UID: \"2b9a19e5-02f8-40b5-aa0c-eb48dfc39020\") " pod="openshift-insights/insights-runtime-extractor-stn4f" Jul 13 03:00:54.150795 ip-10-0-134-52 kubenswrapper[2558]: I0713 03:00:54.150729 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/2b9a19e5-02f8-40b5-aa0c-eb48dfc39020-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-stn4f\" (UID: \"2b9a19e5-02f8-40b5-aa0c-eb48dfc39020\") " pod="openshift-insights/insights-runtime-extractor-stn4f" Jul 13 03:00:54.150795 ip-10-0-134-52 kubenswrapper[2558]: I0713 03:00:54.150756 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/2b9a19e5-02f8-40b5-aa0c-eb48dfc39020-data-volume\") pod \"insights-runtime-extractor-stn4f\" (UID: \"2b9a19e5-02f8-40b5-aa0c-eb48dfc39020\") " pod="openshift-insights/insights-runtime-extractor-stn4f" Jul 13 03:00:54.150795 ip-10-0-134-52 kubenswrapper[2558]: I0713 03:00:54.150775 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/2b9a19e5-02f8-40b5-aa0c-eb48dfc39020-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-stn4f\" (UID: \"2b9a19e5-02f8-40b5-aa0c-eb48dfc39020\") " pod="openshift-insights/insights-runtime-extractor-stn4f" Jul 13 03:00:54.151004 ip-10-0-134-52 kubenswrapper[2558]: I0713 03:00:54.150861 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/2b9a19e5-02f8-40b5-aa0c-eb48dfc39020-crio-socket\") pod \"insights-runtime-extractor-stn4f\" (UID: \"2b9a19e5-02f8-40b5-aa0c-eb48dfc39020\") " pod="openshift-insights/insights-runtime-extractor-stn4f" Jul 13 03:00:54.151004 ip-10-0-134-52 kubenswrapper[2558]: I0713 03:00:54.150911 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-vv244\" (UniqueName: \"kubernetes.io/projected/2b9a19e5-02f8-40b5-aa0c-eb48dfc39020-kube-api-access-vv244\") pod \"insights-runtime-extractor-stn4f\" (UID: \"2b9a19e5-02f8-40b5-aa0c-eb48dfc39020\") " pod="openshift-insights/insights-runtime-extractor-stn4f" Jul 13 03:00:54.151004 ip-10-0-134-52 kubenswrapper[2558]: E0713 03:00:54.150927 2558 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found Jul 13 03:00:54.151004 ip-10-0-134-52 kubenswrapper[2558]: E0713 03:00:54.150977 2558 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/2b9a19e5-02f8-40b5-aa0c-eb48dfc39020-insights-runtime-extractor-tls podName:2b9a19e5-02f8-40b5-aa0c-eb48dfc39020 nodeName:}" failed. No retries permitted until 2026-07-13 03:00:54.650963774 +0000 UTC m=+237.051564218 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/2b9a19e5-02f8-40b5-aa0c-eb48dfc39020-insights-runtime-extractor-tls") pod "insights-runtime-extractor-stn4f" (UID: "2b9a19e5-02f8-40b5-aa0c-eb48dfc39020") : secret "insights-runtime-extractor-tls" not found Jul 13 03:00:54.151195 ip-10-0-134-52 kubenswrapper[2558]: I0713 03:00:54.151006 2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/2b9a19e5-02f8-40b5-aa0c-eb48dfc39020-crio-socket\") pod \"insights-runtime-extractor-stn4f\" (UID: \"2b9a19e5-02f8-40b5-aa0c-eb48dfc39020\") " pod="openshift-insights/insights-runtime-extractor-stn4f" Jul 13 03:00:54.151195 ip-10-0-134-52 kubenswrapper[2558]: E0713 03:00:54.151022 2558 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found Jul 13 03:00:54.151195 ip-10-0-134-52 kubenswrapper[2558]: E0713 03:00:54.151073 2558 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/2b9a19e5-02f8-40b5-aa0c-eb48dfc39020-kube-rbac-proxy-cm podName:2b9a19e5-02f8-40b5-aa0c-eb48dfc39020 nodeName:}" failed. No retries permitted until 2026-07-13 03:00:54.651056633 +0000 UTC m=+237.051657079 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/2b9a19e5-02f8-40b5-aa0c-eb48dfc39020-kube-rbac-proxy-cm") pod "insights-runtime-extractor-stn4f" (UID: "2b9a19e5-02f8-40b5-aa0c-eb48dfc39020") : configmap "kube-rbac-proxy" not found Jul 13 03:00:54.151359 ip-10-0-134-52 kubenswrapper[2558]: I0713 03:00:54.151280 2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/2b9a19e5-02f8-40b5-aa0c-eb48dfc39020-data-volume\") pod \"insights-runtime-extractor-stn4f\" (UID: \"2b9a19e5-02f8-40b5-aa0c-eb48dfc39020\") " pod="openshift-insights/insights-runtime-extractor-stn4f" Jul 13 03:00:54.162586 ip-10-0-134-52 kubenswrapper[2558]: I0713 03:00:54.162568 2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-vv244\" (UniqueName: \"kubernetes.io/projected/2b9a19e5-02f8-40b5-aa0c-eb48dfc39020-kube-api-access-vv244\") pod \"insights-runtime-extractor-stn4f\" (UID: \"2b9a19e5-02f8-40b5-aa0c-eb48dfc39020\") " pod="openshift-insights/insights-runtime-extractor-stn4f" Jul 13 03:00:54.654246 ip-10-0-134-52 kubenswrapper[2558]: I0713 03:00:54.654216 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/2b9a19e5-02f8-40b5-aa0c-eb48dfc39020-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-stn4f\" (UID: \"2b9a19e5-02f8-40b5-aa0c-eb48dfc39020\") " pod="openshift-insights/insights-runtime-extractor-stn4f" Jul 13 03:00:54.654246 ip-10-0-134-52 kubenswrapper[2558]: I0713 03:00:54.654248 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/2b9a19e5-02f8-40b5-aa0c-eb48dfc39020-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-stn4f\" (UID: \"2b9a19e5-02f8-40b5-aa0c-eb48dfc39020\") " pod="openshift-insights/insights-runtime-extractor-stn4f" Jul 13 03:00:54.654441 ip-10-0-134-52 kubenswrapper[2558]: E0713 03:00:54.654323 2558 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found Jul 13 03:00:54.654441 ip-10-0-134-52 kubenswrapper[2558]: E0713 03:00:54.654369 2558 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found Jul 13 03:00:54.654441 ip-10-0-134-52 kubenswrapper[2558]: E0713 03:00:54.654390 2558 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/2b9a19e5-02f8-40b5-aa0c-eb48dfc39020-kube-rbac-proxy-cm podName:2b9a19e5-02f8-40b5-aa0c-eb48dfc39020 nodeName:}" failed. No retries permitted until 2026-07-13 03:00:55.654377764 +0000 UTC m=+238.054978209 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/2b9a19e5-02f8-40b5-aa0c-eb48dfc39020-kube-rbac-proxy-cm") pod "insights-runtime-extractor-stn4f" (UID: "2b9a19e5-02f8-40b5-aa0c-eb48dfc39020") : configmap "kube-rbac-proxy" not found Jul 13 03:00:54.654441 ip-10-0-134-52 kubenswrapper[2558]: E0713 03:00:54.654420 2558 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/2b9a19e5-02f8-40b5-aa0c-eb48dfc39020-insights-runtime-extractor-tls podName:2b9a19e5-02f8-40b5-aa0c-eb48dfc39020 nodeName:}" failed. No retries permitted until 2026-07-13 03:00:55.654408297 +0000 UTC m=+238.055008742 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/2b9a19e5-02f8-40b5-aa0c-eb48dfc39020-insights-runtime-extractor-tls") pod "insights-runtime-extractor-stn4f" (UID: "2b9a19e5-02f8-40b5-aa0c-eb48dfc39020") : secret "insights-runtime-extractor-tls" not found Jul 13 03:00:54.989601 ip-10-0-134-52 kubenswrapper[2558]: I0713 03:00:54.989541 2558 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-service-ca/service-ca-79f68b9f4f-z8q9q"] Jul 13 03:00:54.992665 ip-10-0-134-52 kubenswrapper[2558]: I0713 03:00:54.992649 2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-service-ca/service-ca-79f68b9f4f-z8q9q" Jul 13 03:00:54.995416 ip-10-0-134-52 kubenswrapper[2558]: I0713 03:00:54.995394 2558 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-service-ca\"/\"signing-cabundle\"" Jul 13 03:00:54.995529 ip-10-0-134-52 kubenswrapper[2558]: I0713 03:00:54.995422 2558 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-service-ca\"/\"kube-root-ca.crt\"" Jul 13 03:00:54.996564 ip-10-0-134-52 kubenswrapper[2558]: I0713 03:00:54.996538 2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-service-ca\"/\"service-ca-dockercfg-24nxq\"" Jul 13 03:00:54.996673 ip-10-0-134-52 kubenswrapper[2558]: I0713 03:00:54.996599 2558 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-service-ca\"/\"openshift-service-ca.crt\"" Jul 13 03:00:54.996673 ip-10-0-134-52 kubenswrapper[2558]: I0713 03:00:54.996608 2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-service-ca\"/\"signing-key\"" Jul 13 03:00:55.001554 ip-10-0-134-52 kubenswrapper[2558]: I0713 03:00:55.001532 2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-service-ca/service-ca-79f68b9f4f-z8q9q"] Jul 13 03:00:55.158524 ip-10-0-134-52 kubenswrapper[2558]: I0713 03:00:55.158496 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-wg4wh\" (UniqueName: \"kubernetes.io/projected/b605da07-f16d-4926-8bb0-6ebc15e23072-kube-api-access-wg4wh\") pod \"service-ca-79f68b9f4f-z8q9q\" (UID: \"b605da07-f16d-4926-8bb0-6ebc15e23072\") " pod="openshift-service-ca/service-ca-79f68b9f4f-z8q9q" Jul 13 03:00:55.158638 ip-10-0-134-52 kubenswrapper[2558]: I0713 03:00:55.158576 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"signing-cabundle\" (UniqueName: \"kubernetes.io/configmap/b605da07-f16d-4926-8bb0-6ebc15e23072-signing-cabundle\") pod \"service-ca-79f68b9f4f-z8q9q\" (UID: \"b605da07-f16d-4926-8bb0-6ebc15e23072\") " pod="openshift-service-ca/service-ca-79f68b9f4f-z8q9q" Jul 13 03:00:55.158638 ip-10-0-134-52 kubenswrapper[2558]: I0713 03:00:55.158611 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"signing-key\" (UniqueName: \"kubernetes.io/secret/b605da07-f16d-4926-8bb0-6ebc15e23072-signing-key\") pod \"service-ca-79f68b9f4f-z8q9q\" (UID: \"b605da07-f16d-4926-8bb0-6ebc15e23072\") " pod="openshift-service-ca/service-ca-79f68b9f4f-z8q9q" Jul 13 03:00:55.259129 ip-10-0-134-52 kubenswrapper[2558]: I0713 03:00:55.259064 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"signing-cabundle\" (UniqueName: \"kubernetes.io/configmap/b605da07-f16d-4926-8bb0-6ebc15e23072-signing-cabundle\") pod \"service-ca-79f68b9f4f-z8q9q\" (UID: \"b605da07-f16d-4926-8bb0-6ebc15e23072\") " pod="openshift-service-ca/service-ca-79f68b9f4f-z8q9q" Jul 13 03:00:55.259129 ip-10-0-134-52 kubenswrapper[2558]: I0713 03:00:55.259106 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"signing-key\" (UniqueName: \"kubernetes.io/secret/b605da07-f16d-4926-8bb0-6ebc15e23072-signing-key\") pod \"service-ca-79f68b9f4f-z8q9q\" (UID: \"b605da07-f16d-4926-8bb0-6ebc15e23072\") " pod="openshift-service-ca/service-ca-79f68b9f4f-z8q9q" Jul 13 03:00:55.259129 ip-10-0-134-52 kubenswrapper[2558]: I0713 03:00:55.259135 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-wg4wh\" (UniqueName: \"kubernetes.io/projected/b605da07-f16d-4926-8bb0-6ebc15e23072-kube-api-access-wg4wh\") pod \"service-ca-79f68b9f4f-z8q9q\" (UID: \"b605da07-f16d-4926-8bb0-6ebc15e23072\") " pod="openshift-service-ca/service-ca-79f68b9f4f-z8q9q" Jul 13 03:00:55.259686 ip-10-0-134-52 kubenswrapper[2558]: I0713 03:00:55.259666 2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"signing-cabundle\" (UniqueName: \"kubernetes.io/configmap/b605da07-f16d-4926-8bb0-6ebc15e23072-signing-cabundle\") pod \"service-ca-79f68b9f4f-z8q9q\" (UID: \"b605da07-f16d-4926-8bb0-6ebc15e23072\") " pod="openshift-service-ca/service-ca-79f68b9f4f-z8q9q" Jul 13 03:00:55.261519 ip-10-0-134-52 kubenswrapper[2558]: I0713 03:00:55.261502 2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"signing-key\" (UniqueName: \"kubernetes.io/secret/b605da07-f16d-4926-8bb0-6ebc15e23072-signing-key\") pod \"service-ca-79f68b9f4f-z8q9q\" (UID: \"b605da07-f16d-4926-8bb0-6ebc15e23072\") " pod="openshift-service-ca/service-ca-79f68b9f4f-z8q9q" Jul 13 03:00:55.277734 ip-10-0-134-52 kubenswrapper[2558]: I0713 03:00:55.277706 2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-wg4wh\" (UniqueName: \"kubernetes.io/projected/b605da07-f16d-4926-8bb0-6ebc15e23072-kube-api-access-wg4wh\") pod \"service-ca-79f68b9f4f-z8q9q\" (UID: \"b605da07-f16d-4926-8bb0-6ebc15e23072\") " pod="openshift-service-ca/service-ca-79f68b9f4f-z8q9q" Jul 13 03:00:55.301684 ip-10-0-134-52 kubenswrapper[2558]: I0713 03:00:55.301665 2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-service-ca/service-ca-79f68b9f4f-z8q9q" Jul 13 03:00:55.426208 ip-10-0-134-52 kubenswrapper[2558]: I0713 03:00:55.425364 2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-service-ca/service-ca-79f68b9f4f-z8q9q"] Jul 13 03:00:55.428499 ip-10-0-134-52 kubenswrapper[2558]: W0713 03:00:55.428456 2558 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podb605da07_f16d_4926_8bb0_6ebc15e23072.slice/crio-a7f124a7a163f6684c177b733fd1c64204969f61b593e3fc9f56291561e7d885 WatchSource:0}: Error finding container a7f124a7a163f6684c177b733fd1c64204969f61b593e3fc9f56291561e7d885: Status 404 returned error can't find the container with id a7f124a7a163f6684c177b733fd1c64204969f61b593e3fc9f56291561e7d885 Jul 13 03:00:55.662218 ip-10-0-134-52 kubenswrapper[2558]: I0713 03:00:55.662188 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/2b9a19e5-02f8-40b5-aa0c-eb48dfc39020-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-stn4f\" (UID: \"2b9a19e5-02f8-40b5-aa0c-eb48dfc39020\") " pod="openshift-insights/insights-runtime-extractor-stn4f" Jul 13 03:00:55.662379 ip-10-0-134-52 kubenswrapper[2558]: I0713 03:00:55.662223 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/2b9a19e5-02f8-40b5-aa0c-eb48dfc39020-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-stn4f\" (UID: \"2b9a19e5-02f8-40b5-aa0c-eb48dfc39020\") " pod="openshift-insights/insights-runtime-extractor-stn4f" Jul 13 03:00:55.662379 ip-10-0-134-52 kubenswrapper[2558]: E0713 03:00:55.662320 2558 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found Jul 13 03:00:55.662379 ip-10-0-134-52 kubenswrapper[2558]: E0713 03:00:55.662367 2558 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found Jul 13 03:00:55.662491 ip-10-0-134-52 kubenswrapper[2558]: E0713 03:00:55.662389 2558 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/2b9a19e5-02f8-40b5-aa0c-eb48dfc39020-kube-rbac-proxy-cm podName:2b9a19e5-02f8-40b5-aa0c-eb48dfc39020 nodeName:}" failed. No retries permitted until 2026-07-13 03:00:57.662375762 +0000 UTC m=+240.062976205 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/2b9a19e5-02f8-40b5-aa0c-eb48dfc39020-kube-rbac-proxy-cm") pod "insights-runtime-extractor-stn4f" (UID: "2b9a19e5-02f8-40b5-aa0c-eb48dfc39020") : configmap "kube-rbac-proxy" not found Jul 13 03:00:55.662491 ip-10-0-134-52 kubenswrapper[2558]: E0713 03:00:55.662427 2558 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/2b9a19e5-02f8-40b5-aa0c-eb48dfc39020-insights-runtime-extractor-tls podName:2b9a19e5-02f8-40b5-aa0c-eb48dfc39020 nodeName:}" failed. No retries permitted until 2026-07-13 03:00:57.662409687 +0000 UTC m=+240.063010135 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/2b9a19e5-02f8-40b5-aa0c-eb48dfc39020-insights-runtime-extractor-tls") pod "insights-runtime-extractor-stn4f" (UID: "2b9a19e5-02f8-40b5-aa0c-eb48dfc39020") : secret "insights-runtime-extractor-tls" not found Jul 13 03:00:55.848991 ip-10-0-134-52 kubenswrapper[2558]: I0713 03:00:55.848956 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-service-ca/service-ca-79f68b9f4f-z8q9q" event={"ID":"b605da07-f16d-4926-8bb0-6ebc15e23072","Type":"ContainerStarted","Data":"5e23dc7de2f2f0389b7954df96948bbd15aa9c2c8b20624b53e60ff075eda94e"} Jul 13 03:00:55.849153 ip-10-0-134-52 kubenswrapper[2558]: I0713 03:00:55.849013 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-service-ca/service-ca-79f68b9f4f-z8q9q" event={"ID":"b605da07-f16d-4926-8bb0-6ebc15e23072","Type":"ContainerStarted","Data":"a7f124a7a163f6684c177b733fd1c64204969f61b593e3fc9f56291561e7d885"} Jul 13 03:00:55.870388 ip-10-0-134-52 kubenswrapper[2558]: I0713 03:00:55.870344 2558 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-service-ca/service-ca-79f68b9f4f-z8q9q" podStartSLOduration=1.870314734 podStartE2EDuration="1.870314734s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-13 03:00:54 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-13 03:00:55.869103431 +0000 UTC m=+238.269703898" watchObservedRunningTime="2026-07-13 03:00:55.870314734 +0000 UTC m=+238.270915199" Jul 13 03:00:55.974413 ip-10-0-134-52 kubenswrapper[2558]: I0713 03:00:55.972641 2558 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_node-resolver-ndddr_84e7b9a8-6c63-4aeb-8249-5aae103cf5cc/dns-node-resolver/0.log" Jul 13 03:00:56.267435 ip-10-0-134-52 kubenswrapper[2558]: I0713 03:00:56.267358 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/20a99b49-0854-4214-bfb7-aab2b9ade3d8-registry-tls\") pod \"image-registry-57f887d685-pgx8m\" (UID: \"20a99b49-0854-4214-bfb7-aab2b9ade3d8\") " pod="openshift-image-registry/image-registry-57f887d685-pgx8m" Jul 13 03:00:56.267765 ip-10-0-134-52 kubenswrapper[2558]: E0713 03:00:56.267507 2558 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found Jul 13 03:00:56.267765 ip-10-0-134-52 kubenswrapper[2558]: E0713 03:00:56.267522 2558 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-57f887d685-pgx8m: secret "image-registry-tls" not found Jul 13 03:00:56.267765 ip-10-0-134-52 kubenswrapper[2558]: E0713 03:00:56.267573 2558 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/20a99b49-0854-4214-bfb7-aab2b9ade3d8-registry-tls podName:20a99b49-0854-4214-bfb7-aab2b9ade3d8 nodeName:}" failed. No retries permitted until 2026-07-13 03:01:04.267558458 +0000 UTC m=+246.668158914 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/20a99b49-0854-4214-bfb7-aab2b9ade3d8-registry-tls") pod "image-registry-57f887d685-pgx8m" (UID: "20a99b49-0854-4214-bfb7-aab2b9ade3d8") : secret "image-registry-tls" not found Jul 13 03:00:56.367675 ip-10-0-134-52 kubenswrapper[2558]: I0713 03:00:56.367649 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/53d1746c-0708-4c16-ace0-20912ab1c2d3-metrics-certs\") pod \"router-default-7d87747c94-bc7qr\" (UID: \"53d1746c-0708-4c16-ace0-20912ab1c2d3\") " pod="openshift-ingress/router-default-7d87747c94-bc7qr" Jul 13 03:00:56.367819 ip-10-0-134-52 kubenswrapper[2558]: I0713 03:00:56.367757 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/53d1746c-0708-4c16-ace0-20912ab1c2d3-service-ca-bundle\") pod \"router-default-7d87747c94-bc7qr\" (UID: \"53d1746c-0708-4c16-ace0-20912ab1c2d3\") " pod="openshift-ingress/router-default-7d87747c94-bc7qr" Jul 13 03:00:56.367819 ip-10-0-134-52 kubenswrapper[2558]: E0713 03:00:56.367804 2558 secret.go:189] Couldn't get secret openshift-ingress/router-metrics-certs-default: secret "router-metrics-certs-default" not found Jul 13 03:00:56.367891 ip-10-0-134-52 kubenswrapper[2558]: E0713 03:00:56.367866 2558 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/53d1746c-0708-4c16-ace0-20912ab1c2d3-metrics-certs podName:53d1746c-0708-4c16-ace0-20912ab1c2d3 nodeName:}" failed. No retries permitted until 2026-07-13 03:01:04.367848168 +0000 UTC m=+246.768448612 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/53d1746c-0708-4c16-ace0-20912ab1c2d3-metrics-certs") pod "router-default-7d87747c94-bc7qr" (UID: "53d1746c-0708-4c16-ace0-20912ab1c2d3") : secret "router-metrics-certs-default" not found Jul 13 03:00:56.367891 ip-10-0-134-52 kubenswrapper[2558]: E0713 03:00:56.367884 2558 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/53d1746c-0708-4c16-ace0-20912ab1c2d3-service-ca-bundle podName:53d1746c-0708-4c16-ace0-20912ab1c2d3 nodeName:}" failed. No retries permitted until 2026-07-13 03:01:04.367875602 +0000 UTC m=+246.768476047 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "service-ca-bundle" (UniqueName: "kubernetes.io/configmap/53d1746c-0708-4c16-ace0-20912ab1c2d3-service-ca-bundle") pod "router-default-7d87747c94-bc7qr" (UID: "53d1746c-0708-4c16-ace0-20912ab1c2d3") : configmap references non-existent config key: service-ca.crt Jul 13 03:00:57.170135 ip-10-0-134-52 kubenswrapper[2558]: I0713 03:00:57.170102 2558 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_node-ca-wpn4b_e4bb1d1b-35fa-47b2-af3d-ec01bff3f7c0/node-ca/0.log" Jul 13 03:00:57.676710 ip-10-0-134-52 kubenswrapper[2558]: I0713 03:00:57.676670 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/2b9a19e5-02f8-40b5-aa0c-eb48dfc39020-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-stn4f\" (UID: \"2b9a19e5-02f8-40b5-aa0c-eb48dfc39020\") " pod="openshift-insights/insights-runtime-extractor-stn4f" Jul 13 03:00:57.676710 ip-10-0-134-52 kubenswrapper[2558]: I0713 03:00:57.676714 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/2b9a19e5-02f8-40b5-aa0c-eb48dfc39020-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-stn4f\" (UID: \"2b9a19e5-02f8-40b5-aa0c-eb48dfc39020\") " pod="openshift-insights/insights-runtime-extractor-stn4f" Jul 13 03:00:57.677249 ip-10-0-134-52 kubenswrapper[2558]: E0713 03:00:57.676804 2558 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found Jul 13 03:00:57.677249 ip-10-0-134-52 kubenswrapper[2558]: E0713 03:00:57.676873 2558 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/2b9a19e5-02f8-40b5-aa0c-eb48dfc39020-kube-rbac-proxy-cm podName:2b9a19e5-02f8-40b5-aa0c-eb48dfc39020 nodeName:}" failed. No retries permitted until 2026-07-13 03:01:01.676853089 +0000 UTC m=+244.077453551 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/2b9a19e5-02f8-40b5-aa0c-eb48dfc39020-kube-rbac-proxy-cm") pod "insights-runtime-extractor-stn4f" (UID: "2b9a19e5-02f8-40b5-aa0c-eb48dfc39020") : configmap "kube-rbac-proxy" not found Jul 13 03:00:57.677249 ip-10-0-134-52 kubenswrapper[2558]: E0713 03:00:57.676886 2558 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found Jul 13 03:00:57.677249 ip-10-0-134-52 kubenswrapper[2558]: E0713 03:00:57.676937 2558 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/2b9a19e5-02f8-40b5-aa0c-eb48dfc39020-insights-runtime-extractor-tls podName:2b9a19e5-02f8-40b5-aa0c-eb48dfc39020 nodeName:}" failed. No retries permitted until 2026-07-13 03:01:01.67692493 +0000 UTC m=+244.077525374 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/2b9a19e5-02f8-40b5-aa0c-eb48dfc39020-insights-runtime-extractor-tls") pod "insights-runtime-extractor-stn4f" (UID: "2b9a19e5-02f8-40b5-aa0c-eb48dfc39020") : secret "insights-runtime-extractor-tls" not found Jul 13 03:00:57.769370 ip-10-0-134-52 kubenswrapper[2558]: I0713 03:00:57.769345 2558 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress-canary_ingress-canary-f8947_141bb0e2-17a1-4cd4-8d11-ed7120c2dd6b/serve-healthcheck-canary/0.log" Jul 13 03:01:01.708822 ip-10-0-134-52 kubenswrapper[2558]: I0713 03:01:01.708788 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/2b9a19e5-02f8-40b5-aa0c-eb48dfc39020-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-stn4f\" (UID: \"2b9a19e5-02f8-40b5-aa0c-eb48dfc39020\") " pod="openshift-insights/insights-runtime-extractor-stn4f" Jul 13 03:01:01.708822 ip-10-0-134-52 kubenswrapper[2558]: I0713 03:01:01.708823 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/2b9a19e5-02f8-40b5-aa0c-eb48dfc39020-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-stn4f\" (UID: \"2b9a19e5-02f8-40b5-aa0c-eb48dfc39020\") " pod="openshift-insights/insights-runtime-extractor-stn4f" Jul 13 03:01:01.709211 ip-10-0-134-52 kubenswrapper[2558]: E0713 03:01:01.708932 2558 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found Jul 13 03:01:01.709211 ip-10-0-134-52 kubenswrapper[2558]: E0713 03:01:01.708995 2558 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/2b9a19e5-02f8-40b5-aa0c-eb48dfc39020-insights-runtime-extractor-tls podName:2b9a19e5-02f8-40b5-aa0c-eb48dfc39020 nodeName:}" failed. No retries permitted until 2026-07-13 03:01:09.708977915 +0000 UTC m=+252.109578375 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/2b9a19e5-02f8-40b5-aa0c-eb48dfc39020-insights-runtime-extractor-tls") pod "insights-runtime-extractor-stn4f" (UID: "2b9a19e5-02f8-40b5-aa0c-eb48dfc39020") : secret "insights-runtime-extractor-tls" not found Jul 13 03:01:01.709289 ip-10-0-134-52 kubenswrapper[2558]: I0713 03:01:01.709264 2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/2b9a19e5-02f8-40b5-aa0c-eb48dfc39020-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-stn4f\" (UID: \"2b9a19e5-02f8-40b5-aa0c-eb48dfc39020\") " pod="openshift-insights/insights-runtime-extractor-stn4f" Jul 13 03:01:04.326380 ip-10-0-134-52 kubenswrapper[2558]: I0713 03:01:04.326347 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/20a99b49-0854-4214-bfb7-aab2b9ade3d8-registry-tls\") pod \"image-registry-57f887d685-pgx8m\" (UID: \"20a99b49-0854-4214-bfb7-aab2b9ade3d8\") " pod="openshift-image-registry/image-registry-57f887d685-pgx8m" Jul 13 03:01:04.328849 ip-10-0-134-52 kubenswrapper[2558]: I0713 03:01:04.328831 2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/20a99b49-0854-4214-bfb7-aab2b9ade3d8-registry-tls\") pod \"image-registry-57f887d685-pgx8m\" (UID: \"20a99b49-0854-4214-bfb7-aab2b9ade3d8\") " pod="openshift-image-registry/image-registry-57f887d685-pgx8m" Jul 13 03:01:04.418050 ip-10-0-134-52 kubenswrapper[2558]: I0713 03:01:04.418025 2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"registry-dockercfg-jtncw\"" Jul 13 03:01:04.426241 ip-10-0-134-52 kubenswrapper[2558]: I0713 03:01:04.426225 2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-57f887d685-pgx8m" Jul 13 03:01:04.427503 ip-10-0-134-52 kubenswrapper[2558]: I0713 03:01:04.427485 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/53d1746c-0708-4c16-ace0-20912ab1c2d3-metrics-certs\") pod \"router-default-7d87747c94-bc7qr\" (UID: \"53d1746c-0708-4c16-ace0-20912ab1c2d3\") " pod="openshift-ingress/router-default-7d87747c94-bc7qr" Jul 13 03:01:04.427577 ip-10-0-134-52 kubenswrapper[2558]: I0713 03:01:04.427548 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/53d1746c-0708-4c16-ace0-20912ab1c2d3-service-ca-bundle\") pod \"router-default-7d87747c94-bc7qr\" (UID: \"53d1746c-0708-4c16-ace0-20912ab1c2d3\") " pod="openshift-ingress/router-default-7d87747c94-bc7qr" Jul 13 03:01:04.428014 ip-10-0-134-52 kubenswrapper[2558]: I0713 03:01:04.427997 2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/53d1746c-0708-4c16-ace0-20912ab1c2d3-service-ca-bundle\") pod \"router-default-7d87747c94-bc7qr\" (UID: \"53d1746c-0708-4c16-ace0-20912ab1c2d3\") " pod="openshift-ingress/router-default-7d87747c94-bc7qr" Jul 13 03:01:04.429818 ip-10-0-134-52 kubenswrapper[2558]: I0713 03:01:04.429798 2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/53d1746c-0708-4c16-ace0-20912ab1c2d3-metrics-certs\") pod \"router-default-7d87747c94-bc7qr\" (UID: \"53d1746c-0708-4c16-ace0-20912ab1c2d3\") " pod="openshift-ingress/router-default-7d87747c94-bc7qr" Jul 13 03:01:04.514741 ip-10-0-134-52 kubenswrapper[2558]: I0713 03:01:04.514717 2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"router-dockercfg-ljjtq\"" Jul 13 03:01:04.522067 ip-10-0-134-52 kubenswrapper[2558]: I0713 03:01:04.522040 2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/router-default-7d87747c94-bc7qr" Jul 13 03:01:04.555016 ip-10-0-134-52 kubenswrapper[2558]: I0713 03:01:04.554988 2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-image-registry/image-registry-57f887d685-pgx8m"] Jul 13 03:01:04.558049 ip-10-0-134-52 kubenswrapper[2558]: W0713 03:01:04.558021 2558 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod20a99b49_0854_4214_bfb7_aab2b9ade3d8.slice/crio-11e84645ff4e3640f56a97acf0be8b852ebba5ba2434f3500be7940304085077 WatchSource:0}: Error finding container 11e84645ff4e3640f56a97acf0be8b852ebba5ba2434f3500be7940304085077: Status 404 returned error can't find the container with id 11e84645ff4e3640f56a97acf0be8b852ebba5ba2434f3500be7940304085077 Jul 13 03:01:04.652365 ip-10-0-134-52 kubenswrapper[2558]: I0713 03:01:04.652322 2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/router-default-7d87747c94-bc7qr"] Jul 13 03:01:04.655161 ip-10-0-134-52 kubenswrapper[2558]: W0713 03:01:04.655134 2558 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod53d1746c_0708_4c16_ace0_20912ab1c2d3.slice/crio-fe4d2b248099b3b00905ce918e9139dae0e94816455c7fa8800c4ce5565d67e8 WatchSource:0}: Error finding container fe4d2b248099b3b00905ce918e9139dae0e94816455c7fa8800c4ce5565d67e8: Status 404 returned error can't find the container with id fe4d2b248099b3b00905ce918e9139dae0e94816455c7fa8800c4ce5565d67e8 Jul 13 03:01:04.877135 ip-10-0-134-52 kubenswrapper[2558]: I0713 03:01:04.877053 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/router-default-7d87747c94-bc7qr" event={"ID":"53d1746c-0708-4c16-ace0-20912ab1c2d3","Type":"ContainerStarted","Data":"c1c49a9b759c4cde46be430c047f01e833bdc92d1a24df1db37bf5a0ff8b17b0"} Jul 13 03:01:04.877135 ip-10-0-134-52 kubenswrapper[2558]: I0713 03:01:04.877116 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/router-default-7d87747c94-bc7qr" event={"ID":"53d1746c-0708-4c16-ace0-20912ab1c2d3","Type":"ContainerStarted","Data":"fe4d2b248099b3b00905ce918e9139dae0e94816455c7fa8800c4ce5565d67e8"} Jul 13 03:01:04.878736 ip-10-0-134-52 kubenswrapper[2558]: I0713 03:01:04.878698 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-57f887d685-pgx8m" event={"ID":"20a99b49-0854-4214-bfb7-aab2b9ade3d8","Type":"ContainerStarted","Data":"f6fa6cfc97c6575643b48c3e4078642039c69207f35b84b9b71abad106a3a72c"} Jul 13 03:01:04.878857 ip-10-0-134-52 kubenswrapper[2558]: I0713 03:01:04.878751 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-57f887d685-pgx8m" event={"ID":"20a99b49-0854-4214-bfb7-aab2b9ade3d8","Type":"ContainerStarted","Data":"11e84645ff4e3640f56a97acf0be8b852ebba5ba2434f3500be7940304085077"} Jul 13 03:01:04.878857 ip-10-0-134-52 kubenswrapper[2558]: I0713 03:01:04.878794 2558 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-image-registry/image-registry-57f887d685-pgx8m" Jul 13 03:01:04.895993 ip-10-0-134-52 kubenswrapper[2558]: I0713 03:01:04.895944 2558 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/router-default-7d87747c94-bc7qr" podStartSLOduration=16.895924902 podStartE2EDuration="16.895924902s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-13 03:00:48 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-13 03:01:04.895555399 +0000 UTC m=+247.296155865" watchObservedRunningTime="2026-07-13 03:01:04.895924902 +0000 UTC m=+247.296525369" Jul 13 03:01:04.913766 ip-10-0-134-52 kubenswrapper[2558]: I0713 03:01:04.913721 2558 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-image-registry/image-registry-57f887d685-pgx8m" podStartSLOduration=16.913709385 podStartE2EDuration="16.913709385s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-13 03:00:48 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-13 03:01:04.913080004 +0000 UTC m=+247.313680470" watchObservedRunningTime="2026-07-13 03:01:04.913709385 +0000 UTC m=+247.314309851" Jul 13 03:01:05.522646 ip-10-0-134-52 kubenswrapper[2558]: I0713 03:01:05.522615 2558 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/router-default-7d87747c94-bc7qr" Jul 13 03:01:05.525380 ip-10-0-134-52 kubenswrapper[2558]: I0713 03:01:05.525356 2558 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/router-default-7d87747c94-bc7qr" Jul 13 03:01:05.884569 ip-10-0-134-52 kubenswrapper[2558]: I0713 03:01:05.884495 2558 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/router-default-7d87747c94-bc7qr" Jul 13 03:01:05.885695 ip-10-0-134-52 kubenswrapper[2558]: I0713 03:01:05.885676 2558 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/router-default-7d87747c94-bc7qr" Jul 13 03:01:09.767731 ip-10-0-134-52 kubenswrapper[2558]: I0713 03:01:09.767696 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/2b9a19e5-02f8-40b5-aa0c-eb48dfc39020-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-stn4f\" (UID: \"2b9a19e5-02f8-40b5-aa0c-eb48dfc39020\") " pod="openshift-insights/insights-runtime-extractor-stn4f" Jul 13 03:01:09.770038 ip-10-0-134-52 kubenswrapper[2558]: I0713 03:01:09.770018 2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/2b9a19e5-02f8-40b5-aa0c-eb48dfc39020-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-stn4f\" (UID: \"2b9a19e5-02f8-40b5-aa0c-eb48dfc39020\") " pod="openshift-insights/insights-runtime-extractor-stn4f" Jul 13 03:01:09.793795 ip-10-0-134-52 kubenswrapper[2558]: I0713 03:01:09.793768 2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-sa-dockercfg-7mbnd\"" Jul 13 03:01:09.802025 ip-10-0-134-52 kubenswrapper[2558]: I0713 03:01:09.801997 2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-runtime-extractor-stn4f" Jul 13 03:01:09.924607 ip-10-0-134-52 kubenswrapper[2558]: I0713 03:01:09.924545 2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-runtime-extractor-stn4f"] Jul 13 03:01:09.927084 ip-10-0-134-52 kubenswrapper[2558]: W0713 03:01:09.927052 2558 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod2b9a19e5_02f8_40b5_aa0c_eb48dfc39020.slice/crio-079404e610696b248d42c416338eb47d70e732443bf20ff28ca9bc1f3139f6a5 WatchSource:0}: Error finding container 079404e610696b248d42c416338eb47d70e732443bf20ff28ca9bc1f3139f6a5: Status 404 returned error can't find the container with id 079404e610696b248d42c416338eb47d70e732443bf20ff28ca9bc1f3139f6a5 Jul 13 03:01:09.969095 ip-10-0-134-52 kubenswrapper[2558]: I0713 03:01:09.969074 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/72ebddc5-a4ff-4e56-a65d-508775d02170-metrics-certs\") pod \"network-metrics-daemon-jt47w\" (UID: \"72ebddc5-a4ff-4e56-a65d-508775d02170\") " pod="openshift-multus/network-metrics-daemon-jt47w" Jul 13 03:01:09.971635 ip-10-0-134-52 kubenswrapper[2558]: I0713 03:01:09.971615 2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/72ebddc5-a4ff-4e56-a65d-508775d02170-metrics-certs\") pod \"network-metrics-daemon-jt47w\" (UID: \"72ebddc5-a4ff-4e56-a65d-508775d02170\") " pod="openshift-multus/network-metrics-daemon-jt47w" Jul 13 03:01:09.990224 ip-10-0-134-52 kubenswrapper[2558]: I0713 03:01:09.990202 2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-sa-dockercfg-8nlv8\"" Jul 13 03:01:09.997881 ip-10-0-134-52 kubenswrapper[2558]: I0713 03:01:09.997868 2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-jt47w" Jul 13 03:01:10.118043 ip-10-0-134-52 kubenswrapper[2558]: I0713 03:01:10.118016 2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-multus/network-metrics-daemon-jt47w"] Jul 13 03:01:10.120792 ip-10-0-134-52 kubenswrapper[2558]: W0713 03:01:10.120767 2558 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod72ebddc5_a4ff_4e56_a65d_508775d02170.slice/crio-34e89ba66862947a6f5b0058b6bd9766bfbb799eb9a67af31ff18fdd2591b764 WatchSource:0}: Error finding container 34e89ba66862947a6f5b0058b6bd9766bfbb799eb9a67af31ff18fdd2591b764: Status 404 returned error can't find the container with id 34e89ba66862947a6f5b0058b6bd9766bfbb799eb9a67af31ff18fdd2591b764 Jul 13 03:01:10.904570 ip-10-0-134-52 kubenswrapper[2558]: I0713 03:01:10.904529 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-stn4f" event={"ID":"2b9a19e5-02f8-40b5-aa0c-eb48dfc39020","Type":"ContainerStarted","Data":"079404e610696b248d42c416338eb47d70e732443bf20ff28ca9bc1f3139f6a5"} Jul 13 03:01:10.906429 ip-10-0-134-52 kubenswrapper[2558]: I0713 03:01:10.906398 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-jt47w" event={"ID":"72ebddc5-a4ff-4e56-a65d-508775d02170","Type":"ContainerStarted","Data":"34e89ba66862947a6f5b0058b6bd9766bfbb799eb9a67af31ff18fdd2591b764"} Jul 13 03:01:11.912723 ip-10-0-134-52 kubenswrapper[2558]: I0713 03:01:11.912686 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-jt47w" event={"ID":"72ebddc5-a4ff-4e56-a65d-508775d02170","Type":"ContainerStarted","Data":"69596ec66c70b22c1aff5d2905f681c1ac39eaa8c37cf4376fc61dca52d05e48"} Jul 13 03:01:11.913169 ip-10-0-134-52 kubenswrapper[2558]: I0713 03:01:11.912751 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-jt47w" event={"ID":"72ebddc5-a4ff-4e56-a65d-508775d02170","Type":"ContainerStarted","Data":"acecbdfb4ab8694d259fb60e69cf8be08b10207639ea5f15895e3297b8a5206d"} Jul 13 03:01:11.930946 ip-10-0-134-52 kubenswrapper[2558]: I0713 03:01:11.930894 2558 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/network-metrics-daemon-jt47w" podStartSLOduration=251.634595662 podStartE2EDuration="4m12.930878608s" totalImagesPullingTime="1.296282946s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-13 02:56:59 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-13 03:01:11.929027395 +0000 UTC m=+254.329627861" watchObservedRunningTime="2026-07-13 03:01:11.930878608 +0000 UTC m=+254.331479074" Jul 13 03:01:14.924120 ip-10-0-134-52 kubenswrapper[2558]: I0713 03:01:14.924090 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-stn4f" event={"ID":"2b9a19e5-02f8-40b5-aa0c-eb48dfc39020","Type":"ContainerStarted","Data":"b221aa76cb32c5b1dee2bf95f7201009231015c1de019170594f90457d968b1a"} Jul 13 03:01:14.924422 ip-10-0-134-52 kubenswrapper[2558]: I0713 03:01:14.924146 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-stn4f" event={"ID":"2b9a19e5-02f8-40b5-aa0c-eb48dfc39020","Type":"ContainerStarted","Data":"26c6cc8bbb7634b5e485a455a5ff926b7db3e61f24ca06ac2d289958fc913a53"} Jul 13 03:01:15.539160 ip-10-0-134-52 kubenswrapper[2558]: I0713 03:01:15.539128 2558 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-image-registry/image-registry-57f887d685-pgx8m"] Jul 13 03:01:17.940896 ip-10-0-134-52 kubenswrapper[2558]: I0713 03:01:17.940862 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-stn4f" event={"ID":"2b9a19e5-02f8-40b5-aa0c-eb48dfc39020","Type":"ContainerStarted","Data":"7bd15c58372a9b771ccd41a077952aae2332e72743af02549d39e9df3f1d850f"} Jul 13 03:01:17.959442 ip-10-0-134-52 kubenswrapper[2558]: I0713 03:01:17.959396 2558 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-insights/insights-runtime-extractor-stn4f" podStartSLOduration=17.742914049 podStartE2EDuration="24.959383185s" totalImagesPullingTime="7.216469136s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-13 03:00:53 +0000 UTC" imagePullSessionsCount=3 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-13 03:01:17.957719934 +0000 UTC m=+260.358320390" watchObservedRunningTime="2026-07-13 03:01:17.959383185 +0000 UTC m=+260.359983651" Jul 13 03:01:18.898736 ip-10-0-134-52 kubenswrapper[2558]: I0713 03:01:18.898661 2558 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/prometheus-operator-64785b6675-7tnh9"] Jul 13 03:01:18.901601 ip-10-0-134-52 kubenswrapper[2558]: I0713 03:01:18.901585 2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-operator-64785b6675-7tnh9" Jul 13 03:01:18.905970 ip-10-0-134-52 kubenswrapper[2558]: I0713 03:01:18.905843 2558 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"metrics-client-ca\"" Jul 13 03:01:18.905970 ip-10-0-134-52 kubenswrapper[2558]: I0713 03:01:18.905857 2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-operator-tls\"" Jul 13 03:01:18.905970 ip-10-0-134-52 kubenswrapper[2558]: I0713 03:01:18.905881 2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-operator-kube-rbac-proxy-config\"" Jul 13 03:01:18.905970 ip-10-0-134-52 kubenswrapper[2558]: I0713 03:01:18.905891 2558 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"kube-root-ca.crt\"" Jul 13 03:01:18.905970 ip-10-0-134-52 kubenswrapper[2558]: I0713 03:01:18.905859 2558 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"openshift-service-ca.crt\"" Jul 13 03:01:18.906297 ip-10-0-134-52 kubenswrapper[2558]: I0713 03:01:18.906223 2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-operator-dockercfg-bts9k\"" Jul 13 03:01:18.911195 ip-10-0-134-52 kubenswrapper[2558]: I0713 03:01:18.911171 2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-operator-64785b6675-7tnh9"] Jul 13 03:01:18.939646 ip-10-0-134-52 kubenswrapper[2558]: I0713 03:01:18.939626 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-operator-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/ecafd7ec-48df-4a8f-8626-117ea2e9af7b-prometheus-operator-kube-rbac-proxy-config\") pod \"prometheus-operator-64785b6675-7tnh9\" (UID: \"ecafd7ec-48df-4a8f-8626-117ea2e9af7b\") " pod="openshift-monitoring/prometheus-operator-64785b6675-7tnh9" Jul 13 03:01:18.939746 ip-10-0-134-52 kubenswrapper[2558]: I0713 03:01:18.939659 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-operator-tls\" (UniqueName: \"kubernetes.io/secret/ecafd7ec-48df-4a8f-8626-117ea2e9af7b-prometheus-operator-tls\") pod \"prometheus-operator-64785b6675-7tnh9\" (UID: \"ecafd7ec-48df-4a8f-8626-117ea2e9af7b\") " pod="openshift-monitoring/prometheus-operator-64785b6675-7tnh9" Jul 13 03:01:18.939825 ip-10-0-134-52 kubenswrapper[2558]: I0713 03:01:18.939762 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-x2v7j\" (UniqueName: \"kubernetes.io/projected/ecafd7ec-48df-4a8f-8626-117ea2e9af7b-kube-api-access-x2v7j\") pod \"prometheus-operator-64785b6675-7tnh9\" (UID: \"ecafd7ec-48df-4a8f-8626-117ea2e9af7b\") " pod="openshift-monitoring/prometheus-operator-64785b6675-7tnh9" Jul 13 03:01:18.939825 ip-10-0-134-52 kubenswrapper[2558]: I0713 03:01:18.939790 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/ecafd7ec-48df-4a8f-8626-117ea2e9af7b-metrics-client-ca\") pod \"prometheus-operator-64785b6675-7tnh9\" (UID: \"ecafd7ec-48df-4a8f-8626-117ea2e9af7b\") " pod="openshift-monitoring/prometheus-operator-64785b6675-7tnh9" Jul 13 03:01:19.040848 ip-10-0-134-52 kubenswrapper[2558]: I0713 03:01:19.040823 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-x2v7j\" (UniqueName: \"kubernetes.io/projected/ecafd7ec-48df-4a8f-8626-117ea2e9af7b-kube-api-access-x2v7j\") pod \"prometheus-operator-64785b6675-7tnh9\" (UID: \"ecafd7ec-48df-4a8f-8626-117ea2e9af7b\") " pod="openshift-monitoring/prometheus-operator-64785b6675-7tnh9" Jul 13 03:01:19.041208 ip-10-0-134-52 kubenswrapper[2558]: I0713 03:01:19.040865 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/ecafd7ec-48df-4a8f-8626-117ea2e9af7b-metrics-client-ca\") pod \"prometheus-operator-64785b6675-7tnh9\" (UID: \"ecafd7ec-48df-4a8f-8626-117ea2e9af7b\") " pod="openshift-monitoring/prometheus-operator-64785b6675-7tnh9" Jul 13 03:01:19.041208 ip-10-0-134-52 kubenswrapper[2558]: I0713 03:01:19.040888 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-operator-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/ecafd7ec-48df-4a8f-8626-117ea2e9af7b-prometheus-operator-kube-rbac-proxy-config\") pod \"prometheus-operator-64785b6675-7tnh9\" (UID: \"ecafd7ec-48df-4a8f-8626-117ea2e9af7b\") " pod="openshift-monitoring/prometheus-operator-64785b6675-7tnh9" Jul 13 03:01:19.041208 ip-10-0-134-52 kubenswrapper[2558]: I0713 03:01:19.040913 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-operator-tls\" (UniqueName: \"kubernetes.io/secret/ecafd7ec-48df-4a8f-8626-117ea2e9af7b-prometheus-operator-tls\") pod \"prometheus-operator-64785b6675-7tnh9\" (UID: \"ecafd7ec-48df-4a8f-8626-117ea2e9af7b\") " pod="openshift-monitoring/prometheus-operator-64785b6675-7tnh9" Jul 13 03:01:19.041208 ip-10-0-134-52 kubenswrapper[2558]: E0713 03:01:19.041079 2558 secret.go:189] Couldn't get secret openshift-monitoring/prometheus-operator-tls: secret "prometheus-operator-tls" not found Jul 13 03:01:19.041208 ip-10-0-134-52 kubenswrapper[2558]: E0713 03:01:19.041149 2558 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/ecafd7ec-48df-4a8f-8626-117ea2e9af7b-prometheus-operator-tls podName:ecafd7ec-48df-4a8f-8626-117ea2e9af7b nodeName:}" failed. No retries permitted until 2026-07-13 03:01:19.541128097 +0000 UTC m=+261.941728557 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "prometheus-operator-tls" (UniqueName: "kubernetes.io/secret/ecafd7ec-48df-4a8f-8626-117ea2e9af7b-prometheus-operator-tls") pod "prometheus-operator-64785b6675-7tnh9" (UID: "ecafd7ec-48df-4a8f-8626-117ea2e9af7b") : secret "prometheus-operator-tls" not found Jul 13 03:01:19.041764 ip-10-0-134-52 kubenswrapper[2558]: I0713 03:01:19.041737 2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/ecafd7ec-48df-4a8f-8626-117ea2e9af7b-metrics-client-ca\") pod \"prometheus-operator-64785b6675-7tnh9\" (UID: \"ecafd7ec-48df-4a8f-8626-117ea2e9af7b\") " pod="openshift-monitoring/prometheus-operator-64785b6675-7tnh9" Jul 13 03:01:19.043418 ip-10-0-134-52 kubenswrapper[2558]: I0713 03:01:19.043401 2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"prometheus-operator-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/ecafd7ec-48df-4a8f-8626-117ea2e9af7b-prometheus-operator-kube-rbac-proxy-config\") pod \"prometheus-operator-64785b6675-7tnh9\" (UID: \"ecafd7ec-48df-4a8f-8626-117ea2e9af7b\") " pod="openshift-monitoring/prometheus-operator-64785b6675-7tnh9" Jul 13 03:01:19.049825 ip-10-0-134-52 kubenswrapper[2558]: I0713 03:01:19.049803 2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-x2v7j\" (UniqueName: \"kubernetes.io/projected/ecafd7ec-48df-4a8f-8626-117ea2e9af7b-kube-api-access-x2v7j\") pod \"prometheus-operator-64785b6675-7tnh9\" (UID: \"ecafd7ec-48df-4a8f-8626-117ea2e9af7b\") " pod="openshift-monitoring/prometheus-operator-64785b6675-7tnh9" Jul 13 03:01:19.544545 ip-10-0-134-52 kubenswrapper[2558]: I0713 03:01:19.544517 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-operator-tls\" (UniqueName: \"kubernetes.io/secret/ecafd7ec-48df-4a8f-8626-117ea2e9af7b-prometheus-operator-tls\") pod \"prometheus-operator-64785b6675-7tnh9\" (UID: \"ecafd7ec-48df-4a8f-8626-117ea2e9af7b\") " pod="openshift-monitoring/prometheus-operator-64785b6675-7tnh9" Jul 13 03:01:19.546880 ip-10-0-134-52 kubenswrapper[2558]: I0713 03:01:19.546860 2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"prometheus-operator-tls\" (UniqueName: \"kubernetes.io/secret/ecafd7ec-48df-4a8f-8626-117ea2e9af7b-prometheus-operator-tls\") pod \"prometheus-operator-64785b6675-7tnh9\" (UID: \"ecafd7ec-48df-4a8f-8626-117ea2e9af7b\") " pod="openshift-monitoring/prometheus-operator-64785b6675-7tnh9" Jul 13 03:01:19.811161 ip-10-0-134-52 kubenswrapper[2558]: I0713 03:01:19.811134 2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-operator-64785b6675-7tnh9" Jul 13 03:01:19.938519 ip-10-0-134-52 kubenswrapper[2558]: I0713 03:01:19.938491 2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-operator-64785b6675-7tnh9"] Jul 13 03:01:19.940541 ip-10-0-134-52 kubenswrapper[2558]: W0713 03:01:19.940518 2558 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podecafd7ec_48df_4a8f_8626_117ea2e9af7b.slice/crio-fa83813d5c90a438f827d31af83a030809a37f106328821e647f8035eafe277c WatchSource:0}: Error finding container fa83813d5c90a438f827d31af83a030809a37f106328821e647f8035eafe277c: Status 404 returned error can't find the container with id fa83813d5c90a438f827d31af83a030809a37f106328821e647f8035eafe277c Jul 13 03:01:19.948407 ip-10-0-134-52 kubenswrapper[2558]: I0713 03:01:19.948379 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-operator-64785b6675-7tnh9" event={"ID":"ecafd7ec-48df-4a8f-8626-117ea2e9af7b","Type":"ContainerStarted","Data":"fa83813d5c90a438f827d31af83a030809a37f106328821e647f8035eafe277c"} Jul 13 03:01:21.961908 ip-10-0-134-52 kubenswrapper[2558]: I0713 03:01:21.961871 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-operator-64785b6675-7tnh9" event={"ID":"ecafd7ec-48df-4a8f-8626-117ea2e9af7b","Type":"ContainerStarted","Data":"1a216cebdf5da38853119443e21a55146c5e08c43ea517d9c22de86ee93f4efa"} Jul 13 03:01:21.962306 ip-10-0-134-52 kubenswrapper[2558]: I0713 03:01:21.961946 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-operator-64785b6675-7tnh9" event={"ID":"ecafd7ec-48df-4a8f-8626-117ea2e9af7b","Type":"ContainerStarted","Data":"b847ab5f50d85d05954003281220418ab0ec5ccaa449d2457085e08ded12f6be"} Jul 13 03:01:21.979211 ip-10-0-134-52 kubenswrapper[2558]: I0713 03:01:21.979155 2558 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/prometheus-operator-64785b6675-7tnh9" podStartSLOduration=2.583651 podStartE2EDuration="3.979140082s" totalImagesPullingTime="1.395489082s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-13 03:01:18 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-13 03:01:21.978058977 +0000 UTC m=+264.378659467" watchObservedRunningTime="2026-07-13 03:01:21.979140082 +0000 UTC m=+264.379740548" Jul 13 03:01:24.300505 ip-10-0-134-52 kubenswrapper[2558]: I0713 03:01:24.300468 2558 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/node-exporter-rssjv"] Jul 13 03:01:24.303726 ip-10-0-134-52 kubenswrapper[2558]: I0713 03:01:24.303701 2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/node-exporter-rssjv" Jul 13 03:01:24.306549 ip-10-0-134-52 kubenswrapper[2558]: I0713 03:01:24.306525 2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-tls\"" Jul 13 03:01:24.306749 ip-10-0-134-52 kubenswrapper[2558]: I0713 03:01:24.306611 2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-kube-rbac-proxy-config\"" Jul 13 03:01:24.306826 ip-10-0-134-52 kubenswrapper[2558]: I0713 03:01:24.306756 2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-dockercfg-9w62j\"" Jul 13 03:01:24.306876 ip-10-0-134-52 kubenswrapper[2558]: I0713 03:01:24.306632 2558 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"node-exporter-accelerators-collector-config\"" Jul 13 03:01:24.379821 ip-10-0-134-52 kubenswrapper[2558]: I0713 03:01:24.379790 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-7rsqz\" (UniqueName: \"kubernetes.io/projected/cd974d9c-4de2-4f2a-9b1b-3e58de6bec29-kube-api-access-7rsqz\") pod \"node-exporter-rssjv\" (UID: \"cd974d9c-4de2-4f2a-9b1b-3e58de6bec29\") " pod="openshift-monitoring/node-exporter-rssjv" Jul 13 03:01:24.379821 ip-10-0-134-52 kubenswrapper[2558]: I0713 03:01:24.379831 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/cd974d9c-4de2-4f2a-9b1b-3e58de6bec29-sys\") pod \"node-exporter-rssjv\" (UID: \"cd974d9c-4de2-4f2a-9b1b-3e58de6bec29\") " pod="openshift-monitoring/node-exporter-rssjv" Jul 13 03:01:24.380038 ip-10-0-134-52 kubenswrapper[2558]: I0713 03:01:24.379864 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/cd974d9c-4de2-4f2a-9b1b-3e58de6bec29-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-rssjv\" (UID: \"cd974d9c-4de2-4f2a-9b1b-3e58de6bec29\") " pod="openshift-monitoring/node-exporter-rssjv" Jul 13 03:01:24.380038 ip-10-0-134-52 kubenswrapper[2558]: I0713 03:01:24.379940 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/cd974d9c-4de2-4f2a-9b1b-3e58de6bec29-node-exporter-textfile\") pod \"node-exporter-rssjv\" (UID: \"cd974d9c-4de2-4f2a-9b1b-3e58de6bec29\") " pod="openshift-monitoring/node-exporter-rssjv" Jul 13 03:01:24.380038 ip-10-0-134-52 kubenswrapper[2558]: I0713 03:01:24.379975 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/cd974d9c-4de2-4f2a-9b1b-3e58de6bec29-node-exporter-tls\") pod \"node-exporter-rssjv\" (UID: \"cd974d9c-4de2-4f2a-9b1b-3e58de6bec29\") " pod="openshift-monitoring/node-exporter-rssjv" Jul 13 03:01:24.380038 ip-10-0-134-52 kubenswrapper[2558]: I0713 03:01:24.380015 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/cd974d9c-4de2-4f2a-9b1b-3e58de6bec29-metrics-client-ca\") pod \"node-exporter-rssjv\" (UID: \"cd974d9c-4de2-4f2a-9b1b-3e58de6bec29\") " pod="openshift-monitoring/node-exporter-rssjv" Jul 13 03:01:24.380196 ip-10-0-134-52 kubenswrapper[2558]: I0713 03:01:24.380052 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"root\" (UniqueName: \"kubernetes.io/host-path/cd974d9c-4de2-4f2a-9b1b-3e58de6bec29-root\") pod \"node-exporter-rssjv\" (UID: \"cd974d9c-4de2-4f2a-9b1b-3e58de6bec29\") " pod="openshift-monitoring/node-exporter-rssjv" Jul 13 03:01:24.380196 ip-10-0-134-52 kubenswrapper[2558]: I0713 03:01:24.380110 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/cd974d9c-4de2-4f2a-9b1b-3e58de6bec29-node-exporter-wtmp\") pod \"node-exporter-rssjv\" (UID: \"cd974d9c-4de2-4f2a-9b1b-3e58de6bec29\") " pod="openshift-monitoring/node-exporter-rssjv" Jul 13 03:01:24.380196 ip-10-0-134-52 kubenswrapper[2558]: I0713 03:01:24.380142 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/cd974d9c-4de2-4f2a-9b1b-3e58de6bec29-node-exporter-accelerators-collector-config\") pod \"node-exporter-rssjv\" (UID: \"cd974d9c-4de2-4f2a-9b1b-3e58de6bec29\") " pod="openshift-monitoring/node-exporter-rssjv" Jul 13 03:01:24.481452 ip-10-0-134-52 kubenswrapper[2558]: I0713 03:01:24.481418 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"root\" (UniqueName: \"kubernetes.io/host-path/cd974d9c-4de2-4f2a-9b1b-3e58de6bec29-root\") pod \"node-exporter-rssjv\" (UID: \"cd974d9c-4de2-4f2a-9b1b-3e58de6bec29\") " pod="openshift-monitoring/node-exporter-rssjv" Jul 13 03:01:24.481599 ip-10-0-134-52 kubenswrapper[2558]: I0713 03:01:24.481478 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/cd974d9c-4de2-4f2a-9b1b-3e58de6bec29-node-exporter-wtmp\") pod \"node-exporter-rssjv\" (UID: \"cd974d9c-4de2-4f2a-9b1b-3e58de6bec29\") " pod="openshift-monitoring/node-exporter-rssjv" Jul 13 03:01:24.481599 ip-10-0-134-52 kubenswrapper[2558]: I0713 03:01:24.481510 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/cd974d9c-4de2-4f2a-9b1b-3e58de6bec29-node-exporter-accelerators-collector-config\") pod \"node-exporter-rssjv\" (UID: \"cd974d9c-4de2-4f2a-9b1b-3e58de6bec29\") " pod="openshift-monitoring/node-exporter-rssjv" Jul 13 03:01:24.481599 ip-10-0-134-52 kubenswrapper[2558]: I0713 03:01:24.481535 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-7rsqz\" (UniqueName: \"kubernetes.io/projected/cd974d9c-4de2-4f2a-9b1b-3e58de6bec29-kube-api-access-7rsqz\") pod \"node-exporter-rssjv\" (UID: \"cd974d9c-4de2-4f2a-9b1b-3e58de6bec29\") " pod="openshift-monitoring/node-exporter-rssjv" Jul 13 03:01:24.481599 ip-10-0-134-52 kubenswrapper[2558]: I0713 03:01:24.481548 2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"root\" (UniqueName: \"kubernetes.io/host-path/cd974d9c-4de2-4f2a-9b1b-3e58de6bec29-root\") pod \"node-exporter-rssjv\" (UID: \"cd974d9c-4de2-4f2a-9b1b-3e58de6bec29\") " pod="openshift-monitoring/node-exporter-rssjv" Jul 13 03:01:24.481599 ip-10-0-134-52 kubenswrapper[2558]: I0713 03:01:24.481556 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/cd974d9c-4de2-4f2a-9b1b-3e58de6bec29-sys\") pod \"node-exporter-rssjv\" (UID: \"cd974d9c-4de2-4f2a-9b1b-3e58de6bec29\") " pod="openshift-monitoring/node-exporter-rssjv" Jul 13 03:01:24.481836 ip-10-0-134-52 kubenswrapper[2558]: I0713 03:01:24.481618 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/cd974d9c-4de2-4f2a-9b1b-3e58de6bec29-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-rssjv\" (UID: \"cd974d9c-4de2-4f2a-9b1b-3e58de6bec29\") " pod="openshift-monitoring/node-exporter-rssjv" Jul 13 03:01:24.481836 ip-10-0-134-52 kubenswrapper[2558]: I0713 03:01:24.481658 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/cd974d9c-4de2-4f2a-9b1b-3e58de6bec29-node-exporter-textfile\") pod \"node-exporter-rssjv\" (UID: \"cd974d9c-4de2-4f2a-9b1b-3e58de6bec29\") " pod="openshift-monitoring/node-exporter-rssjv" Jul 13 03:01:24.481836 ip-10-0-134-52 kubenswrapper[2558]: I0713 03:01:24.481685 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/cd974d9c-4de2-4f2a-9b1b-3e58de6bec29-node-exporter-tls\") pod \"node-exporter-rssjv\" (UID: \"cd974d9c-4de2-4f2a-9b1b-3e58de6bec29\") " pod="openshift-monitoring/node-exporter-rssjv" Jul 13 03:01:24.481836 ip-10-0-134-52 kubenswrapper[2558]: I0713 03:01:24.481721 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/cd974d9c-4de2-4f2a-9b1b-3e58de6bec29-metrics-client-ca\") pod \"node-exporter-rssjv\" (UID: \"cd974d9c-4de2-4f2a-9b1b-3e58de6bec29\") " pod="openshift-monitoring/node-exporter-rssjv" Jul 13 03:01:24.482028 ip-10-0-134-52 kubenswrapper[2558]: I0713 03:01:24.481886 2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/cd974d9c-4de2-4f2a-9b1b-3e58de6bec29-sys\") pod \"node-exporter-rssjv\" (UID: \"cd974d9c-4de2-4f2a-9b1b-3e58de6bec29\") " pod="openshift-monitoring/node-exporter-rssjv" Jul 13 03:01:24.482188 ip-10-0-134-52 kubenswrapper[2558]: I0713 03:01:24.482169 2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/cd974d9c-4de2-4f2a-9b1b-3e58de6bec29-node-exporter-textfile\") pod \"node-exporter-rssjv\" (UID: \"cd974d9c-4de2-4f2a-9b1b-3e58de6bec29\") " pod="openshift-monitoring/node-exporter-rssjv" Jul 13 03:01:24.482319 ip-10-0-134-52 kubenswrapper[2558]: I0713 03:01:24.482286 2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/cd974d9c-4de2-4f2a-9b1b-3e58de6bec29-node-exporter-wtmp\") pod \"node-exporter-rssjv\" (UID: \"cd974d9c-4de2-4f2a-9b1b-3e58de6bec29\") " pod="openshift-monitoring/node-exporter-rssjv" Jul 13 03:01:24.482421 ip-10-0-134-52 kubenswrapper[2558]: I0713 03:01:24.482251 2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/cd974d9c-4de2-4f2a-9b1b-3e58de6bec29-metrics-client-ca\") pod \"node-exporter-rssjv\" (UID: \"cd974d9c-4de2-4f2a-9b1b-3e58de6bec29\") " pod="openshift-monitoring/node-exporter-rssjv" Jul 13 03:01:24.482421 ip-10-0-134-52 kubenswrapper[2558]: I0713 03:01:24.482191 2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/cd974d9c-4de2-4f2a-9b1b-3e58de6bec29-node-exporter-accelerators-collector-config\") pod \"node-exporter-rssjv\" (UID: \"cd974d9c-4de2-4f2a-9b1b-3e58de6bec29\") " pod="openshift-monitoring/node-exporter-rssjv" Jul 13 03:01:24.484595 ip-10-0-134-52 kubenswrapper[2558]: I0713 03:01:24.484572 2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/cd974d9c-4de2-4f2a-9b1b-3e58de6bec29-node-exporter-tls\") pod \"node-exporter-rssjv\" (UID: \"cd974d9c-4de2-4f2a-9b1b-3e58de6bec29\") " pod="openshift-monitoring/node-exporter-rssjv" Jul 13 03:01:24.484876 ip-10-0-134-52 kubenswrapper[2558]: I0713 03:01:24.484854 2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/cd974d9c-4de2-4f2a-9b1b-3e58de6bec29-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-rssjv\" (UID: \"cd974d9c-4de2-4f2a-9b1b-3e58de6bec29\") " pod="openshift-monitoring/node-exporter-rssjv" Jul 13 03:01:24.492275 ip-10-0-134-52 kubenswrapper[2558]: I0713 03:01:24.492251 2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-7rsqz\" (UniqueName: \"kubernetes.io/projected/cd974d9c-4de2-4f2a-9b1b-3e58de6bec29-kube-api-access-7rsqz\") pod \"node-exporter-rssjv\" (UID: \"cd974d9c-4de2-4f2a-9b1b-3e58de6bec29\") " pod="openshift-monitoring/node-exporter-rssjv" Jul 13 03:01:24.613769 ip-10-0-134-52 kubenswrapper[2558]: I0713 03:01:24.613694 2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/node-exporter-rssjv" Jul 13 03:01:24.631438 ip-10-0-134-52 kubenswrapper[2558]: I0713 03:01:24.631417 2558 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console/console-6d6476497b-j24jp"] Jul 13 03:01:24.637157 ip-10-0-134-52 kubenswrapper[2558]: I0713 03:01:24.637134 2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-6d6476497b-j24jp" Jul 13 03:01:24.639883 ip-10-0-134-52 kubenswrapper[2558]: I0713 03:01:24.639863 2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-serving-cert\"" Jul 13 03:01:24.640157 ip-10-0-134-52 kubenswrapper[2558]: I0713 03:01:24.640143 2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-oauth-config\"" Jul 13 03:01:24.643691 ip-10-0-134-52 kubenswrapper[2558]: I0713 03:01:24.640583 2558 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"service-ca\"" Jul 13 03:01:24.643691 ip-10-0-134-52 kubenswrapper[2558]: I0713 03:01:24.640835 2558 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"openshift-service-ca.crt\"" Jul 13 03:01:24.643691 ip-10-0-134-52 kubenswrapper[2558]: I0713 03:01:24.641136 2558 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"oauth-serving-cert\"" Jul 13 03:01:24.643691 ip-10-0-134-52 kubenswrapper[2558]: I0713 03:01:24.641291 2558 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"kube-root-ca.crt\"" Jul 13 03:01:24.643691 ip-10-0-134-52 kubenswrapper[2558]: I0713 03:01:24.643628 2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-6d6476497b-j24jp"] Jul 13 03:01:24.644028 ip-10-0-134-52 kubenswrapper[2558]: I0713 03:01:24.643731 2558 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"console-config\"" Jul 13 03:01:24.644028 ip-10-0-134-52 kubenswrapper[2558]: I0713 03:01:24.643937 2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-dockercfg-5kptb\"" Jul 13 03:01:24.682977 ip-10-0-134-52 kubenswrapper[2558]: I0713 03:01:24.682951 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/2a4da825-3dbe-42c9-a325-e6ddcdab810c-console-serving-cert\") pod \"console-6d6476497b-j24jp\" (UID: \"2a4da825-3dbe-42c9-a325-e6ddcdab810c\") " pod="openshift-console/console-6d6476497b-j24jp" Jul 13 03:01:24.683075 ip-10-0-134-52 kubenswrapper[2558]: I0713 03:01:24.683029 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/2a4da825-3dbe-42c9-a325-e6ddcdab810c-oauth-serving-cert\") pod \"console-6d6476497b-j24jp\" (UID: \"2a4da825-3dbe-42c9-a325-e6ddcdab810c\") " pod="openshift-console/console-6d6476497b-j24jp" Jul 13 03:01:24.683075 ip-10-0-134-52 kubenswrapper[2558]: I0713 03:01:24.683057 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/2a4da825-3dbe-42c9-a325-e6ddcdab810c-service-ca\") pod \"console-6d6476497b-j24jp\" (UID: \"2a4da825-3dbe-42c9-a325-e6ddcdab810c\") " pod="openshift-console/console-6d6476497b-j24jp" Jul 13 03:01:24.683185 ip-10-0-134-52 kubenswrapper[2558]: I0713 03:01:24.683081 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-c94jn\" (UniqueName: \"kubernetes.io/projected/2a4da825-3dbe-42c9-a325-e6ddcdab810c-kube-api-access-c94jn\") pod \"console-6d6476497b-j24jp\" (UID: \"2a4da825-3dbe-42c9-a325-e6ddcdab810c\") " pod="openshift-console/console-6d6476497b-j24jp" Jul 13 03:01:24.683185 ip-10-0-134-52 kubenswrapper[2558]: I0713 03:01:24.683115 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/2a4da825-3dbe-42c9-a325-e6ddcdab810c-console-config\") pod \"console-6d6476497b-j24jp\" (UID: \"2a4da825-3dbe-42c9-a325-e6ddcdab810c\") " pod="openshift-console/console-6d6476497b-j24jp" Jul 13 03:01:24.683185 ip-10-0-134-52 kubenswrapper[2558]: I0713 03:01:24.683142 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/2a4da825-3dbe-42c9-a325-e6ddcdab810c-console-oauth-config\") pod \"console-6d6476497b-j24jp\" (UID: \"2a4da825-3dbe-42c9-a325-e6ddcdab810c\") " pod="openshift-console/console-6d6476497b-j24jp" Jul 13 03:01:24.784389 ip-10-0-134-52 kubenswrapper[2558]: I0713 03:01:24.784361 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/2a4da825-3dbe-42c9-a325-e6ddcdab810c-oauth-serving-cert\") pod \"console-6d6476497b-j24jp\" (UID: \"2a4da825-3dbe-42c9-a325-e6ddcdab810c\") " pod="openshift-console/console-6d6476497b-j24jp" Jul 13 03:01:24.784513 ip-10-0-134-52 kubenswrapper[2558]: I0713 03:01:24.784403 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/2a4da825-3dbe-42c9-a325-e6ddcdab810c-service-ca\") pod \"console-6d6476497b-j24jp\" (UID: \"2a4da825-3dbe-42c9-a325-e6ddcdab810c\") " pod="openshift-console/console-6d6476497b-j24jp" Jul 13 03:01:24.784513 ip-10-0-134-52 kubenswrapper[2558]: I0713 03:01:24.784425 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-c94jn\" (UniqueName: \"kubernetes.io/projected/2a4da825-3dbe-42c9-a325-e6ddcdab810c-kube-api-access-c94jn\") pod \"console-6d6476497b-j24jp\" (UID: \"2a4da825-3dbe-42c9-a325-e6ddcdab810c\") " pod="openshift-console/console-6d6476497b-j24jp" Jul 13 03:01:24.784513 ip-10-0-134-52 kubenswrapper[2558]: I0713 03:01:24.784452 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/2a4da825-3dbe-42c9-a325-e6ddcdab810c-console-config\") pod \"console-6d6476497b-j24jp\" (UID: \"2a4da825-3dbe-42c9-a325-e6ddcdab810c\") " pod="openshift-console/console-6d6476497b-j24jp" Jul 13 03:01:24.784513 ip-10-0-134-52 kubenswrapper[2558]: I0713 03:01:24.784483 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/2a4da825-3dbe-42c9-a325-e6ddcdab810c-console-oauth-config\") pod \"console-6d6476497b-j24jp\" (UID: \"2a4da825-3dbe-42c9-a325-e6ddcdab810c\") " pod="openshift-console/console-6d6476497b-j24jp" Jul 13 03:01:24.784711 ip-10-0-134-52 kubenswrapper[2558]: I0713 03:01:24.784546 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/2a4da825-3dbe-42c9-a325-e6ddcdab810c-console-serving-cert\") pod \"console-6d6476497b-j24jp\" (UID: \"2a4da825-3dbe-42c9-a325-e6ddcdab810c\") " pod="openshift-console/console-6d6476497b-j24jp" Jul 13 03:01:24.785229 ip-10-0-134-52 kubenswrapper[2558]: I0713 03:01:24.785173 2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/2a4da825-3dbe-42c9-a325-e6ddcdab810c-console-config\") pod \"console-6d6476497b-j24jp\" (UID: \"2a4da825-3dbe-42c9-a325-e6ddcdab810c\") " pod="openshift-console/console-6d6476497b-j24jp" Jul 13 03:01:24.785229 ip-10-0-134-52 kubenswrapper[2558]: I0713 03:01:24.785200 2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/2a4da825-3dbe-42c9-a325-e6ddcdab810c-service-ca\") pod \"console-6d6476497b-j24jp\" (UID: \"2a4da825-3dbe-42c9-a325-e6ddcdab810c\") " pod="openshift-console/console-6d6476497b-j24jp" Jul 13 03:01:24.785470 ip-10-0-134-52 kubenswrapper[2558]: I0713 03:01:24.785452 2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/2a4da825-3dbe-42c9-a325-e6ddcdab810c-oauth-serving-cert\") pod \"console-6d6476497b-j24jp\" (UID: \"2a4da825-3dbe-42c9-a325-e6ddcdab810c\") " pod="openshift-console/console-6d6476497b-j24jp" Jul 13 03:01:24.786941 ip-10-0-134-52 kubenswrapper[2558]: I0713 03:01:24.786921 2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/2a4da825-3dbe-42c9-a325-e6ddcdab810c-console-serving-cert\") pod \"console-6d6476497b-j24jp\" (UID: \"2a4da825-3dbe-42c9-a325-e6ddcdab810c\") " pod="openshift-console/console-6d6476497b-j24jp" Jul 13 03:01:24.787078 ip-10-0-134-52 kubenswrapper[2558]: I0713 03:01:24.787060 2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/2a4da825-3dbe-42c9-a325-e6ddcdab810c-console-oauth-config\") pod \"console-6d6476497b-j24jp\" (UID: \"2a4da825-3dbe-42c9-a325-e6ddcdab810c\") " pod="openshift-console/console-6d6476497b-j24jp" Jul 13 03:01:24.792173 ip-10-0-134-52 kubenswrapper[2558]: I0713 03:01:24.792151 2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-c94jn\" (UniqueName: \"kubernetes.io/projected/2a4da825-3dbe-42c9-a325-e6ddcdab810c-kube-api-access-c94jn\") pod \"console-6d6476497b-j24jp\" (UID: \"2a4da825-3dbe-42c9-a325-e6ddcdab810c\") " pod="openshift-console/console-6d6476497b-j24jp" Jul 13 03:01:24.953402 ip-10-0-134-52 kubenswrapper[2558]: I0713 03:01:24.953322 2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-6d6476497b-j24jp" Jul 13 03:01:24.972387 ip-10-0-134-52 kubenswrapper[2558]: I0713 03:01:24.972321 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-rssjv" event={"ID":"cd974d9c-4de2-4f2a-9b1b-3e58de6bec29","Type":"ContainerStarted","Data":"496c71b049f00283d25422d5e7e432b100dc9305f74fab71ca2909c257fa0d79"} Jul 13 03:01:25.082592 ip-10-0-134-52 kubenswrapper[2558]: I0713 03:01:25.082559 2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-6d6476497b-j24jp"] Jul 13 03:01:25.085441 ip-10-0-134-52 kubenswrapper[2558]: W0713 03:01:25.085409 2558 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod2a4da825_3dbe_42c9_a325_e6ddcdab810c.slice/crio-51537449dc8a0d0a5178cf01a7d4eb46f2c98b012c0d78454c383f1c996f37ea WatchSource:0}: Error finding container 51537449dc8a0d0a5178cf01a7d4eb46f2c98b012c0d78454c383f1c996f37ea: Status 404 returned error can't find the container with id 51537449dc8a0d0a5178cf01a7d4eb46f2c98b012c0d78454c383f1c996f37ea Jul 13 03:01:25.328845 ip-10-0-134-52 kubenswrapper[2558]: I0713 03:01:25.328264 2558 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/alertmanager-main-0"] Jul 13 03:01:25.333244 ip-10-0-134-52 kubenswrapper[2558]: I0713 03:01:25.332993 2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/alertmanager-main-0" Jul 13 03:01:25.336176 ip-10-0-134-52 kubenswrapper[2558]: I0713 03:01:25.336150 2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-generated\"" Jul 13 03:01:25.336419 ip-10-0-134-52 kubenswrapper[2558]: I0713 03:01:25.336402 2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-kube-rbac-proxy-web\"" Jul 13 03:01:25.336628 ip-10-0-134-52 kubenswrapper[2558]: I0713 03:01:25.336613 2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-tls-assets-0\"" Jul 13 03:01:25.337090 ip-10-0-134-52 kubenswrapper[2558]: I0713 03:01:25.336977 2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-tls\"" Jul 13 03:01:25.337090 ip-10-0-134-52 kubenswrapper[2558]: I0713 03:01:25.336997 2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-kube-rbac-proxy-metric\"" Jul 13 03:01:25.337090 ip-10-0-134-52 kubenswrapper[2558]: I0713 03:01:25.337034 2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-web-config\"" Jul 13 03:01:25.337272 ip-10-0-134-52 kubenswrapper[2558]: I0713 03:01:25.336985 2558 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"alertmanager-trusted-ca-bundle\"" Jul 13 03:01:25.337362 ip-10-0-134-52 kubenswrapper[2558]: I0713 03:01:25.337320 2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-kube-rbac-proxy\"" Jul 13 03:01:25.337428 ip-10-0-134-52 kubenswrapper[2558]: I0713 03:01:25.337321 2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-cluster-tls-config\"" Jul 13 03:01:25.337952 ip-10-0-134-52 kubenswrapper[2558]: I0713 03:01:25.337932 2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-dockercfg-bq2z4\"" Jul 13 03:01:25.351372 ip-10-0-134-52 kubenswrapper[2558]: I0713 03:01:25.351321 2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/alertmanager-main-0"] Jul 13 03:01:25.388689 ip-10-0-134-52 kubenswrapper[2558]: I0713 03:01:25.388657 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/efab6d01-9fed-48f2-8343-7423fd04ecd7-cluster-tls-config\") pod \"alertmanager-main-0\" (UID: \"efab6d01-9fed-48f2-8343-7423fd04ecd7\") " pod="openshift-monitoring/alertmanager-main-0" Jul 13 03:01:25.388859 ip-10-0-134-52 kubenswrapper[2558]: I0713 03:01:25.388713 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/efab6d01-9fed-48f2-8343-7423fd04ecd7-alertmanager-trusted-ca-bundle\") pod \"alertmanager-main-0\" (UID: \"efab6d01-9fed-48f2-8343-7423fd04ecd7\") " pod="openshift-monitoring/alertmanager-main-0" Jul 13 03:01:25.388859 ip-10-0-134-52 kubenswrapper[2558]: I0713 03:01:25.388753 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/efab6d01-9fed-48f2-8343-7423fd04ecd7-tls-assets\") pod \"alertmanager-main-0\" (UID: \"efab6d01-9fed-48f2-8343-7423fd04ecd7\") " pod="openshift-monitoring/alertmanager-main-0" Jul 13 03:01:25.388859 ip-10-0-134-52 kubenswrapper[2558]: I0713 03:01:25.388777 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/efab6d01-9fed-48f2-8343-7423fd04ecd7-alertmanager-main-db\") pod \"alertmanager-main-0\" (UID: \"efab6d01-9fed-48f2-8343-7423fd04ecd7\") " pod="openshift-monitoring/alertmanager-main-0" Jul 13 03:01:25.388859 ip-10-0-134-52 kubenswrapper[2558]: I0713 03:01:25.388808 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/efab6d01-9fed-48f2-8343-7423fd04ecd7-secret-alertmanager-kube-rbac-proxy-web\") pod \"alertmanager-main-0\" (UID: \"efab6d01-9fed-48f2-8343-7423fd04ecd7\") " pod="openshift-monitoring/alertmanager-main-0" Jul 13 03:01:25.388859 ip-10-0-134-52 kubenswrapper[2558]: I0713 03:01:25.388835 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/efab6d01-9fed-48f2-8343-7423fd04ecd7-metrics-client-ca\") pod \"alertmanager-main-0\" (UID: \"efab6d01-9fed-48f2-8343-7423fd04ecd7\") " pod="openshift-monitoring/alertmanager-main-0" Jul 13 03:01:25.388859 ip-10-0-134-52 kubenswrapper[2558]: I0713 03:01:25.388858 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/efab6d01-9fed-48f2-8343-7423fd04ecd7-web-config\") pod \"alertmanager-main-0\" (UID: \"efab6d01-9fed-48f2-8343-7423fd04ecd7\") " pod="openshift-monitoring/alertmanager-main-0" Jul 13 03:01:25.389043 ip-10-0-134-52 kubenswrapper[2558]: I0713 03:01:25.388914 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/efab6d01-9fed-48f2-8343-7423fd04ecd7-config-volume\") pod \"alertmanager-main-0\" (UID: \"efab6d01-9fed-48f2-8343-7423fd04ecd7\") " pod="openshift-monitoring/alertmanager-main-0" Jul 13 03:01:25.389043 ip-10-0-134-52 kubenswrapper[2558]: I0713 03:01:25.388942 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-g4x7r\" (UniqueName: \"kubernetes.io/projected/efab6d01-9fed-48f2-8343-7423fd04ecd7-kube-api-access-g4x7r\") pod \"alertmanager-main-0\" (UID: \"efab6d01-9fed-48f2-8343-7423fd04ecd7\") " pod="openshift-monitoring/alertmanager-main-0" Jul 13 03:01:25.389043 ip-10-0-134-52 kubenswrapper[2558]: I0713 03:01:25.388967 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/efab6d01-9fed-48f2-8343-7423fd04ecd7-secret-alertmanager-main-tls\") pod \"alertmanager-main-0\" (UID: \"efab6d01-9fed-48f2-8343-7423fd04ecd7\") " pod="openshift-monitoring/alertmanager-main-0" Jul 13 03:01:25.389043 ip-10-0-134-52 kubenswrapper[2558]: I0713 03:01:25.388991 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/efab6d01-9fed-48f2-8343-7423fd04ecd7-secret-alertmanager-kube-rbac-proxy\") pod \"alertmanager-main-0\" (UID: \"efab6d01-9fed-48f2-8343-7423fd04ecd7\") " pod="openshift-monitoring/alertmanager-main-0" Jul 13 03:01:25.389043 ip-10-0-134-52 kubenswrapper[2558]: I0713 03:01:25.389017 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/efab6d01-9fed-48f2-8343-7423fd04ecd7-config-out\") pod \"alertmanager-main-0\" (UID: \"efab6d01-9fed-48f2-8343-7423fd04ecd7\") " pod="openshift-monitoring/alertmanager-main-0" Jul 13 03:01:25.389193 ip-10-0-134-52 kubenswrapper[2558]: I0713 03:01:25.389054 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/efab6d01-9fed-48f2-8343-7423fd04ecd7-secret-alertmanager-kube-rbac-proxy-metric\") pod \"alertmanager-main-0\" (UID: \"efab6d01-9fed-48f2-8343-7423fd04ecd7\") " pod="openshift-monitoring/alertmanager-main-0" Jul 13 03:01:25.489868 ip-10-0-134-52 kubenswrapper[2558]: I0713 03:01:25.489833 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/efab6d01-9fed-48f2-8343-7423fd04ecd7-secret-alertmanager-kube-rbac-proxy-web\") pod \"alertmanager-main-0\" (UID: \"efab6d01-9fed-48f2-8343-7423fd04ecd7\") " pod="openshift-monitoring/alertmanager-main-0" Jul 13 03:01:25.490042 ip-10-0-134-52 kubenswrapper[2558]: I0713 03:01:25.489885 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/efab6d01-9fed-48f2-8343-7423fd04ecd7-metrics-client-ca\") pod \"alertmanager-main-0\" (UID: \"efab6d01-9fed-48f2-8343-7423fd04ecd7\") " pod="openshift-monitoring/alertmanager-main-0" Jul 13 03:01:25.490118 ip-10-0-134-52 kubenswrapper[2558]: I0713 03:01:25.490068 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/efab6d01-9fed-48f2-8343-7423fd04ecd7-web-config\") pod \"alertmanager-main-0\" (UID: \"efab6d01-9fed-48f2-8343-7423fd04ecd7\") " pod="openshift-monitoring/alertmanager-main-0" Jul 13 03:01:25.490173 ip-10-0-134-52 kubenswrapper[2558]: I0713 03:01:25.490134 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/efab6d01-9fed-48f2-8343-7423fd04ecd7-config-volume\") pod \"alertmanager-main-0\" (UID: \"efab6d01-9fed-48f2-8343-7423fd04ecd7\") " pod="openshift-monitoring/alertmanager-main-0" Jul 13 03:01:25.490229 ip-10-0-134-52 kubenswrapper[2558]: I0713 03:01:25.490168 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-g4x7r\" (UniqueName: \"kubernetes.io/projected/efab6d01-9fed-48f2-8343-7423fd04ecd7-kube-api-access-g4x7r\") pod \"alertmanager-main-0\" (UID: \"efab6d01-9fed-48f2-8343-7423fd04ecd7\") " pod="openshift-monitoring/alertmanager-main-0" Jul 13 03:01:25.490229 ip-10-0-134-52 kubenswrapper[2558]: I0713 03:01:25.490195 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/efab6d01-9fed-48f2-8343-7423fd04ecd7-secret-alertmanager-main-tls\") pod \"alertmanager-main-0\" (UID: \"efab6d01-9fed-48f2-8343-7423fd04ecd7\") " pod="openshift-monitoring/alertmanager-main-0" Jul 13 03:01:25.490229 ip-10-0-134-52 kubenswrapper[2558]: I0713 03:01:25.490219 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/efab6d01-9fed-48f2-8343-7423fd04ecd7-secret-alertmanager-kube-rbac-proxy\") pod \"alertmanager-main-0\" (UID: \"efab6d01-9fed-48f2-8343-7423fd04ecd7\") " pod="openshift-monitoring/alertmanager-main-0" Jul 13 03:01:25.490403 ip-10-0-134-52 kubenswrapper[2558]: I0713 03:01:25.490247 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/efab6d01-9fed-48f2-8343-7423fd04ecd7-config-out\") pod \"alertmanager-main-0\" (UID: \"efab6d01-9fed-48f2-8343-7423fd04ecd7\") " pod="openshift-monitoring/alertmanager-main-0" Jul 13 03:01:25.490403 ip-10-0-134-52 kubenswrapper[2558]: I0713 03:01:25.490299 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/efab6d01-9fed-48f2-8343-7423fd04ecd7-secret-alertmanager-kube-rbac-proxy-metric\") pod \"alertmanager-main-0\" (UID: \"efab6d01-9fed-48f2-8343-7423fd04ecd7\") " pod="openshift-monitoring/alertmanager-main-0" Jul 13 03:01:25.490403 ip-10-0-134-52 kubenswrapper[2558]: I0713 03:01:25.490373 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/efab6d01-9fed-48f2-8343-7423fd04ecd7-cluster-tls-config\") pod \"alertmanager-main-0\" (UID: \"efab6d01-9fed-48f2-8343-7423fd04ecd7\") " pod="openshift-monitoring/alertmanager-main-0" Jul 13 03:01:25.490550 ip-10-0-134-52 kubenswrapper[2558]: I0713 03:01:25.490430 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/efab6d01-9fed-48f2-8343-7423fd04ecd7-alertmanager-trusted-ca-bundle\") pod \"alertmanager-main-0\" (UID: \"efab6d01-9fed-48f2-8343-7423fd04ecd7\") " pod="openshift-monitoring/alertmanager-main-0" Jul 13 03:01:25.490550 ip-10-0-134-52 kubenswrapper[2558]: I0713 03:01:25.490459 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/efab6d01-9fed-48f2-8343-7423fd04ecd7-tls-assets\") pod \"alertmanager-main-0\" (UID: \"efab6d01-9fed-48f2-8343-7423fd04ecd7\") " pod="openshift-monitoring/alertmanager-main-0" Jul 13 03:01:25.490550 ip-10-0-134-52 kubenswrapper[2558]: I0713 03:01:25.490485 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/efab6d01-9fed-48f2-8343-7423fd04ecd7-alertmanager-main-db\") pod \"alertmanager-main-0\" (UID: \"efab6d01-9fed-48f2-8343-7423fd04ecd7\") " pod="openshift-monitoring/alertmanager-main-0" Jul 13 03:01:25.490764 ip-10-0-134-52 kubenswrapper[2558]: I0713 03:01:25.490743 2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/efab6d01-9fed-48f2-8343-7423fd04ecd7-metrics-client-ca\") pod \"alertmanager-main-0\" (UID: \"efab6d01-9fed-48f2-8343-7423fd04ecd7\") " pod="openshift-monitoring/alertmanager-main-0" Jul 13 03:01:25.490831 ip-10-0-134-52 kubenswrapper[2558]: I0713 03:01:25.490801 2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/efab6d01-9fed-48f2-8343-7423fd04ecd7-alertmanager-main-db\") pod \"alertmanager-main-0\" (UID: \"efab6d01-9fed-48f2-8343-7423fd04ecd7\") " pod="openshift-monitoring/alertmanager-main-0" Jul 13 03:01:25.491381 ip-10-0-134-52 kubenswrapper[2558]: E0713 03:01:25.491019 2558 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/efab6d01-9fed-48f2-8343-7423fd04ecd7-alertmanager-trusted-ca-bundle podName:efab6d01-9fed-48f2-8343-7423fd04ecd7 nodeName:}" failed. No retries permitted until 2026-07-13 03:01:25.990998958 +0000 UTC m=+268.391599404 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "alertmanager-trusted-ca-bundle" (UniqueName: "kubernetes.io/configmap/efab6d01-9fed-48f2-8343-7423fd04ecd7-alertmanager-trusted-ca-bundle") pod "alertmanager-main-0" (UID: "efab6d01-9fed-48f2-8343-7423fd04ecd7") : configmap references non-existent config key: ca-bundle.crt Jul 13 03:01:25.492867 ip-10-0-134-52 kubenswrapper[2558]: E0713 03:01:25.492185 2558 secret.go:189] Couldn't get secret openshift-monitoring/alertmanager-main-tls: secret "alertmanager-main-tls" not found Jul 13 03:01:25.492867 ip-10-0-134-52 kubenswrapper[2558]: E0713 03:01:25.492244 2558 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/efab6d01-9fed-48f2-8343-7423fd04ecd7-secret-alertmanager-main-tls podName:efab6d01-9fed-48f2-8343-7423fd04ecd7 nodeName:}" failed. No retries permitted until 2026-07-13 03:01:25.992226277 +0000 UTC m=+268.392826721 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "secret-alertmanager-main-tls" (UniqueName: "kubernetes.io/secret/efab6d01-9fed-48f2-8343-7423fd04ecd7-secret-alertmanager-main-tls") pod "alertmanager-main-0" (UID: "efab6d01-9fed-48f2-8343-7423fd04ecd7") : secret "alertmanager-main-tls" not found Jul 13 03:01:25.493382 ip-10-0-134-52 kubenswrapper[2558]: I0713 03:01:25.493356 2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/efab6d01-9fed-48f2-8343-7423fd04ecd7-secret-alertmanager-kube-rbac-proxy-web\") pod \"alertmanager-main-0\" (UID: \"efab6d01-9fed-48f2-8343-7423fd04ecd7\") " pod="openshift-monitoring/alertmanager-main-0" Jul 13 03:01:25.494065 ip-10-0-134-52 kubenswrapper[2558]: I0713 03:01:25.494043 2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/efab6d01-9fed-48f2-8343-7423fd04ecd7-secret-alertmanager-kube-rbac-proxy\") pod \"alertmanager-main-0\" (UID: \"efab6d01-9fed-48f2-8343-7423fd04ecd7\") " pod="openshift-monitoring/alertmanager-main-0" Jul 13 03:01:25.494900 ip-10-0-134-52 kubenswrapper[2558]: I0713 03:01:25.494874 2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/efab6d01-9fed-48f2-8343-7423fd04ecd7-config-out\") pod \"alertmanager-main-0\" (UID: \"efab6d01-9fed-48f2-8343-7423fd04ecd7\") " pod="openshift-monitoring/alertmanager-main-0" Jul 13 03:01:25.495982 ip-10-0-134-52 kubenswrapper[2558]: I0713 03:01:25.495490 2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/efab6d01-9fed-48f2-8343-7423fd04ecd7-web-config\") pod \"alertmanager-main-0\" (UID: \"efab6d01-9fed-48f2-8343-7423fd04ecd7\") " pod="openshift-monitoring/alertmanager-main-0" Jul 13 03:01:25.495982 ip-10-0-134-52 kubenswrapper[2558]: I0713 03:01:25.495935 2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/efab6d01-9fed-48f2-8343-7423fd04ecd7-cluster-tls-config\") pod \"alertmanager-main-0\" (UID: \"efab6d01-9fed-48f2-8343-7423fd04ecd7\") " pod="openshift-monitoring/alertmanager-main-0" Jul 13 03:01:25.496549 ip-10-0-134-52 kubenswrapper[2558]: I0713 03:01:25.496512 2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/efab6d01-9fed-48f2-8343-7423fd04ecd7-secret-alertmanager-kube-rbac-proxy-metric\") pod \"alertmanager-main-0\" (UID: \"efab6d01-9fed-48f2-8343-7423fd04ecd7\") " pod="openshift-monitoring/alertmanager-main-0" Jul 13 03:01:25.496955 ip-10-0-134-52 kubenswrapper[2558]: I0713 03:01:25.496909 2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/efab6d01-9fed-48f2-8343-7423fd04ecd7-config-volume\") pod \"alertmanager-main-0\" (UID: \"efab6d01-9fed-48f2-8343-7423fd04ecd7\") " pod="openshift-monitoring/alertmanager-main-0" Jul 13 03:01:25.497173 ip-10-0-134-52 kubenswrapper[2558]: I0713 03:01:25.497138 2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/efab6d01-9fed-48f2-8343-7423fd04ecd7-tls-assets\") pod \"alertmanager-main-0\" (UID: \"efab6d01-9fed-48f2-8343-7423fd04ecd7\") " pod="openshift-monitoring/alertmanager-main-0" Jul 13 03:01:25.499661 ip-10-0-134-52 kubenswrapper[2558]: I0713 03:01:25.499637 2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-g4x7r\" (UniqueName: \"kubernetes.io/projected/efab6d01-9fed-48f2-8343-7423fd04ecd7-kube-api-access-g4x7r\") pod \"alertmanager-main-0\" (UID: \"efab6d01-9fed-48f2-8343-7423fd04ecd7\") " pod="openshift-monitoring/alertmanager-main-0" Jul 13 03:01:25.545612 ip-10-0-134-52 kubenswrapper[2558]: I0713 03:01:25.545580 2558 patch_prober.go:28] interesting pod/image-registry-57f887d685-pgx8m container/registry namespace/openshift-image-registry: Readiness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body={"errors":[{"code":"UNAVAILABLE","message":"service unavailable","detail":"health check failed: please see /debug/health"}]} Jul 13 03:01:25.545737 ip-10-0-134-52 kubenswrapper[2558]: I0713 03:01:25.545637 2558 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-image-registry/image-registry-57f887d685-pgx8m" podUID="20a99b49-0854-4214-bfb7-aab2b9ade3d8" containerName="registry" probeResult="failure" output="HTTP probe failed with statuscode: 503" Jul 13 03:01:25.978179 ip-10-0-134-52 kubenswrapper[2558]: I0713 03:01:25.978082 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-6d6476497b-j24jp" event={"ID":"2a4da825-3dbe-42c9-a325-e6ddcdab810c","Type":"ContainerStarted","Data":"51537449dc8a0d0a5178cf01a7d4eb46f2c98b012c0d78454c383f1c996f37ea"} Jul 13 03:01:25.979849 ip-10-0-134-52 kubenswrapper[2558]: I0713 03:01:25.979825 2558 generic.go:356] "Generic (PLEG): container finished" podID="cd974d9c-4de2-4f2a-9b1b-3e58de6bec29" containerID="b26107d79e259db4655070d136a84bd0ac428b1455722aa04dd614a5331132e7" exitCode=0 Jul 13 03:01:25.979977 ip-10-0-134-52 kubenswrapper[2558]: I0713 03:01:25.979873 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-rssjv" event={"ID":"cd974d9c-4de2-4f2a-9b1b-3e58de6bec29","Type":"ContainerDied","Data":"b26107d79e259db4655070d136a84bd0ac428b1455722aa04dd614a5331132e7"} Jul 13 03:01:25.996000 ip-10-0-134-52 kubenswrapper[2558]: I0713 03:01:25.995976 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/efab6d01-9fed-48f2-8343-7423fd04ecd7-secret-alertmanager-main-tls\") pod \"alertmanager-main-0\" (UID: \"efab6d01-9fed-48f2-8343-7423fd04ecd7\") " pod="openshift-monitoring/alertmanager-main-0" Jul 13 03:01:25.996114 ip-10-0-134-52 kubenswrapper[2558]: I0713 03:01:25.996069 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/efab6d01-9fed-48f2-8343-7423fd04ecd7-alertmanager-trusted-ca-bundle\") pod \"alertmanager-main-0\" (UID: \"efab6d01-9fed-48f2-8343-7423fd04ecd7\") " pod="openshift-monitoring/alertmanager-main-0" Jul 13 03:01:25.996817 ip-10-0-134-52 kubenswrapper[2558]: I0713 03:01:25.996794 2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/efab6d01-9fed-48f2-8343-7423fd04ecd7-alertmanager-trusted-ca-bundle\") pod \"alertmanager-main-0\" (UID: \"efab6d01-9fed-48f2-8343-7423fd04ecd7\") " pod="openshift-monitoring/alertmanager-main-0" Jul 13 03:01:25.998910 ip-10-0-134-52 kubenswrapper[2558]: I0713 03:01:25.998887 2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/efab6d01-9fed-48f2-8343-7423fd04ecd7-secret-alertmanager-main-tls\") pod \"alertmanager-main-0\" (UID: \"efab6d01-9fed-48f2-8343-7423fd04ecd7\") " pod="openshift-monitoring/alertmanager-main-0" Jul 13 03:01:26.247301 ip-10-0-134-52 kubenswrapper[2558]: I0713 03:01:26.247214 2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/alertmanager-main-0" Jul 13 03:01:26.247761 ip-10-0-134-52 kubenswrapper[2558]: I0713 03:01:26.247740 2558 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/thanos-querier-77b686b4f7-bjzn2"] Jul 13 03:01:26.251087 ip-10-0-134-52 kubenswrapper[2558]: I0713 03:01:26.251070 2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/thanos-querier-77b686b4f7-bjzn2" Jul 13 03:01:26.254158 ip-10-0-134-52 kubenswrapper[2558]: I0713 03:01:26.253953 2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-kube-rbac-proxy-rules\"" Jul 13 03:01:26.254262 ip-10-0-134-52 kubenswrapper[2558]: I0713 03:01:26.254244 2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-kube-rbac-proxy-web\"" Jul 13 03:01:26.254323 ip-10-0-134-52 kubenswrapper[2558]: I0713 03:01:26.254274 2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-kube-rbac-proxy\"" Jul 13 03:01:26.254666 ip-10-0-134-52 kubenswrapper[2558]: I0713 03:01:26.254518 2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-dockercfg-zxrps\"" Jul 13 03:01:26.254666 ip-10-0-134-52 kubenswrapper[2558]: I0713 03:01:26.254523 2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-grpc-tls-8n43sus0pj8lj\"" Jul 13 03:01:26.254666 ip-10-0-134-52 kubenswrapper[2558]: I0713 03:01:26.254523 2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-kube-rbac-proxy-metrics\"" Jul 13 03:01:26.254666 ip-10-0-134-52 kubenswrapper[2558]: I0713 03:01:26.254603 2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-tls\"" Jul 13 03:01:26.266164 ip-10-0-134-52 kubenswrapper[2558]: I0713 03:01:26.266100 2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/thanos-querier-77b686b4f7-bjzn2"] Jul 13 03:01:26.298985 ip-10-0-134-52 kubenswrapper[2558]: I0713 03:01:26.298861 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/c69060a0-a145-4d88-b7fc-84d321cd2e8a-secret-thanos-querier-kube-rbac-proxy-web\") pod \"thanos-querier-77b686b4f7-bjzn2\" (UID: \"c69060a0-a145-4d88-b7fc-84d321cd2e8a\") " pod="openshift-monitoring/thanos-querier-77b686b4f7-bjzn2" Jul 13 03:01:26.298985 ip-10-0-134-52 kubenswrapper[2558]: I0713 03:01:26.298911 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-rules\" (UniqueName: \"kubernetes.io/secret/c69060a0-a145-4d88-b7fc-84d321cd2e8a-secret-thanos-querier-kube-rbac-proxy-rules\") pod \"thanos-querier-77b686b4f7-bjzn2\" (UID: \"c69060a0-a145-4d88-b7fc-84d321cd2e8a\") " pod="openshift-monitoring/thanos-querier-77b686b4f7-bjzn2" Jul 13 03:01:26.298985 ip-10-0-134-52 kubenswrapper[2558]: I0713 03:01:26.298946 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/c69060a0-a145-4d88-b7fc-84d321cd2e8a-metrics-client-ca\") pod \"thanos-querier-77b686b4f7-bjzn2\" (UID: \"c69060a0-a145-4d88-b7fc-84d321cd2e8a\") " pod="openshift-monitoring/thanos-querier-77b686b4f7-bjzn2" Jul 13 03:01:26.299242 ip-10-0-134-52 kubenswrapper[2558]: I0713 03:01:26.298991 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/c69060a0-a145-4d88-b7fc-84d321cd2e8a-secret-grpc-tls\") pod \"thanos-querier-77b686b4f7-bjzn2\" (UID: \"c69060a0-a145-4d88-b7fc-84d321cd2e8a\") " pod="openshift-monitoring/thanos-querier-77b686b4f7-bjzn2" Jul 13 03:01:26.299242 ip-10-0-134-52 kubenswrapper[2558]: I0713 03:01:26.299044 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-metrics\" (UniqueName: \"kubernetes.io/secret/c69060a0-a145-4d88-b7fc-84d321cd2e8a-secret-thanos-querier-kube-rbac-proxy-metrics\") pod \"thanos-querier-77b686b4f7-bjzn2\" (UID: \"c69060a0-a145-4d88-b7fc-84d321cd2e8a\") " pod="openshift-monitoring/thanos-querier-77b686b4f7-bjzn2" Jul 13 03:01:26.299242 ip-10-0-134-52 kubenswrapper[2558]: I0713 03:01:26.299064 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-g9pm8\" (UniqueName: \"kubernetes.io/projected/c69060a0-a145-4d88-b7fc-84d321cd2e8a-kube-api-access-g9pm8\") pod \"thanos-querier-77b686b4f7-bjzn2\" (UID: \"c69060a0-a145-4d88-b7fc-84d321cd2e8a\") " pod="openshift-monitoring/thanos-querier-77b686b4f7-bjzn2" Jul 13 03:01:26.299242 ip-10-0-134-52 kubenswrapper[2558]: I0713 03:01:26.299123 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-thanos-querier-tls\" (UniqueName: \"kubernetes.io/secret/c69060a0-a145-4d88-b7fc-84d321cd2e8a-secret-thanos-querier-tls\") pod \"thanos-querier-77b686b4f7-bjzn2\" (UID: \"c69060a0-a145-4d88-b7fc-84d321cd2e8a\") " pod="openshift-monitoring/thanos-querier-77b686b4f7-bjzn2" Jul 13 03:01:26.299242 ip-10-0-134-52 kubenswrapper[2558]: I0713 03:01:26.299154 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-thanos-querier-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/c69060a0-a145-4d88-b7fc-84d321cd2e8a-secret-thanos-querier-kube-rbac-proxy\") pod \"thanos-querier-77b686b4f7-bjzn2\" (UID: \"c69060a0-a145-4d88-b7fc-84d321cd2e8a\") " pod="openshift-monitoring/thanos-querier-77b686b4f7-bjzn2" Jul 13 03:01:26.398004 ip-10-0-134-52 kubenswrapper[2558]: I0713 03:01:26.397984 2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/alertmanager-main-0"] Jul 13 03:01:26.400376 ip-10-0-134-52 kubenswrapper[2558]: I0713 03:01:26.400349 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-thanos-querier-tls\" (UniqueName: \"kubernetes.io/secret/c69060a0-a145-4d88-b7fc-84d321cd2e8a-secret-thanos-querier-tls\") pod \"thanos-querier-77b686b4f7-bjzn2\" (UID: \"c69060a0-a145-4d88-b7fc-84d321cd2e8a\") " pod="openshift-monitoring/thanos-querier-77b686b4f7-bjzn2" Jul 13 03:01:26.400595 ip-10-0-134-52 kubenswrapper[2558]: I0713 03:01:26.400395 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-thanos-querier-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/c69060a0-a145-4d88-b7fc-84d321cd2e8a-secret-thanos-querier-kube-rbac-proxy\") pod \"thanos-querier-77b686b4f7-bjzn2\" (UID: \"c69060a0-a145-4d88-b7fc-84d321cd2e8a\") " pod="openshift-monitoring/thanos-querier-77b686b4f7-bjzn2" Jul 13 03:01:26.400595 ip-10-0-134-52 kubenswrapper[2558]: W0713 03:01:26.400397 2558 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podefab6d01_9fed_48f2_8343_7423fd04ecd7.slice/crio-33eb1c831db597bf61815274c24d22db82e20ee3611ec7f0479cb11d6a1cf192 WatchSource:0}: Error finding container 33eb1c831db597bf61815274c24d22db82e20ee3611ec7f0479cb11d6a1cf192: Status 404 returned error can't find the container with id 33eb1c831db597bf61815274c24d22db82e20ee3611ec7f0479cb11d6a1cf192 Jul 13 03:01:26.400595 ip-10-0-134-52 kubenswrapper[2558]: I0713 03:01:26.400452 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/c69060a0-a145-4d88-b7fc-84d321cd2e8a-secret-thanos-querier-kube-rbac-proxy-web\") pod \"thanos-querier-77b686b4f7-bjzn2\" (UID: \"c69060a0-a145-4d88-b7fc-84d321cd2e8a\") " pod="openshift-monitoring/thanos-querier-77b686b4f7-bjzn2" Jul 13 03:01:26.400595 ip-10-0-134-52 kubenswrapper[2558]: I0713 03:01:26.400586 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-rules\" (UniqueName: \"kubernetes.io/secret/c69060a0-a145-4d88-b7fc-84d321cd2e8a-secret-thanos-querier-kube-rbac-proxy-rules\") pod \"thanos-querier-77b686b4f7-bjzn2\" (UID: \"c69060a0-a145-4d88-b7fc-84d321cd2e8a\") " pod="openshift-monitoring/thanos-querier-77b686b4f7-bjzn2" Jul 13 03:01:26.400928 ip-10-0-134-52 kubenswrapper[2558]: I0713 03:01:26.400640 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/c69060a0-a145-4d88-b7fc-84d321cd2e8a-metrics-client-ca\") pod \"thanos-querier-77b686b4f7-bjzn2\" (UID: \"c69060a0-a145-4d88-b7fc-84d321cd2e8a\") " pod="openshift-monitoring/thanos-querier-77b686b4f7-bjzn2" Jul 13 03:01:26.400928 ip-10-0-134-52 kubenswrapper[2558]: I0713 03:01:26.400672 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/c69060a0-a145-4d88-b7fc-84d321cd2e8a-secret-grpc-tls\") pod \"thanos-querier-77b686b4f7-bjzn2\" (UID: \"c69060a0-a145-4d88-b7fc-84d321cd2e8a\") " pod="openshift-monitoring/thanos-querier-77b686b4f7-bjzn2" Jul 13 03:01:26.400928 ip-10-0-134-52 kubenswrapper[2558]: I0713 03:01:26.400756 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-metrics\" (UniqueName: \"kubernetes.io/secret/c69060a0-a145-4d88-b7fc-84d321cd2e8a-secret-thanos-querier-kube-rbac-proxy-metrics\") pod \"thanos-querier-77b686b4f7-bjzn2\" (UID: \"c69060a0-a145-4d88-b7fc-84d321cd2e8a\") " pod="openshift-monitoring/thanos-querier-77b686b4f7-bjzn2" Jul 13 03:01:26.400928 ip-10-0-134-52 kubenswrapper[2558]: I0713 03:01:26.400785 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-g9pm8\" (UniqueName: \"kubernetes.io/projected/c69060a0-a145-4d88-b7fc-84d321cd2e8a-kube-api-access-g9pm8\") pod \"thanos-querier-77b686b4f7-bjzn2\" (UID: \"c69060a0-a145-4d88-b7fc-84d321cd2e8a\") " pod="openshift-monitoring/thanos-querier-77b686b4f7-bjzn2" Jul 13 03:01:26.402323 ip-10-0-134-52 kubenswrapper[2558]: I0713 03:01:26.402292 2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/c69060a0-a145-4d88-b7fc-84d321cd2e8a-metrics-client-ca\") pod \"thanos-querier-77b686b4f7-bjzn2\" (UID: \"c69060a0-a145-4d88-b7fc-84d321cd2e8a\") " pod="openshift-monitoring/thanos-querier-77b686b4f7-bjzn2" Jul 13 03:01:26.403583 ip-10-0-134-52 kubenswrapper[2558]: I0713 03:01:26.403521 2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-thanos-querier-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/c69060a0-a145-4d88-b7fc-84d321cd2e8a-secret-thanos-querier-kube-rbac-proxy-web\") pod \"thanos-querier-77b686b4f7-bjzn2\" (UID: \"c69060a0-a145-4d88-b7fc-84d321cd2e8a\") " pod="openshift-monitoring/thanos-querier-77b686b4f7-bjzn2" Jul 13 03:01:26.404089 ip-10-0-134-52 kubenswrapper[2558]: I0713 03:01:26.404065 2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-thanos-querier-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/c69060a0-a145-4d88-b7fc-84d321cd2e8a-secret-thanos-querier-kube-rbac-proxy\") pod \"thanos-querier-77b686b4f7-bjzn2\" (UID: \"c69060a0-a145-4d88-b7fc-84d321cd2e8a\") " pod="openshift-monitoring/thanos-querier-77b686b4f7-bjzn2" Jul 13 03:01:26.404778 ip-10-0-134-52 kubenswrapper[2558]: I0713 03:01:26.404756 2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-thanos-querier-kube-rbac-proxy-rules\" (UniqueName: \"kubernetes.io/secret/c69060a0-a145-4d88-b7fc-84d321cd2e8a-secret-thanos-querier-kube-rbac-proxy-rules\") pod \"thanos-querier-77b686b4f7-bjzn2\" (UID: \"c69060a0-a145-4d88-b7fc-84d321cd2e8a\") " pod="openshift-monitoring/thanos-querier-77b686b4f7-bjzn2" Jul 13 03:01:26.404936 ip-10-0-134-52 kubenswrapper[2558]: I0713 03:01:26.404913 2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-thanos-querier-kube-rbac-proxy-metrics\" (UniqueName: \"kubernetes.io/secret/c69060a0-a145-4d88-b7fc-84d321cd2e8a-secret-thanos-querier-kube-rbac-proxy-metrics\") pod \"thanos-querier-77b686b4f7-bjzn2\" (UID: \"c69060a0-a145-4d88-b7fc-84d321cd2e8a\") " pod="openshift-monitoring/thanos-querier-77b686b4f7-bjzn2" Jul 13 03:01:26.405483 ip-10-0-134-52 kubenswrapper[2558]: I0713 03:01:26.405460 2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/c69060a0-a145-4d88-b7fc-84d321cd2e8a-secret-grpc-tls\") pod \"thanos-querier-77b686b4f7-bjzn2\" (UID: \"c69060a0-a145-4d88-b7fc-84d321cd2e8a\") " pod="openshift-monitoring/thanos-querier-77b686b4f7-bjzn2" Jul 13 03:01:26.405813 ip-10-0-134-52 kubenswrapper[2558]: I0713 03:01:26.405788 2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-thanos-querier-tls\" (UniqueName: \"kubernetes.io/secret/c69060a0-a145-4d88-b7fc-84d321cd2e8a-secret-thanos-querier-tls\") pod \"thanos-querier-77b686b4f7-bjzn2\" (UID: \"c69060a0-a145-4d88-b7fc-84d321cd2e8a\") " pod="openshift-monitoring/thanos-querier-77b686b4f7-bjzn2" Jul 13 03:01:26.409139 ip-10-0-134-52 kubenswrapper[2558]: I0713 03:01:26.409114 2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-g9pm8\" (UniqueName: \"kubernetes.io/projected/c69060a0-a145-4d88-b7fc-84d321cd2e8a-kube-api-access-g9pm8\") pod \"thanos-querier-77b686b4f7-bjzn2\" (UID: \"c69060a0-a145-4d88-b7fc-84d321cd2e8a\") " pod="openshift-monitoring/thanos-querier-77b686b4f7-bjzn2" Jul 13 03:01:26.562382 ip-10-0-134-52 kubenswrapper[2558]: I0713 03:01:26.562350 2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/thanos-querier-77b686b4f7-bjzn2" Jul 13 03:01:26.705298 ip-10-0-134-52 kubenswrapper[2558]: I0713 03:01:26.705274 2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/thanos-querier-77b686b4f7-bjzn2"] Jul 13 03:01:26.707937 ip-10-0-134-52 kubenswrapper[2558]: W0713 03:01:26.707908 2558 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podc69060a0_a145_4d88_b7fc_84d321cd2e8a.slice/crio-9b4c1f040690dec0a7f4616d675a44716e397ea9d83e77c73cb71196029675bd WatchSource:0}: Error finding container 9b4c1f040690dec0a7f4616d675a44716e397ea9d83e77c73cb71196029675bd: Status 404 returned error can't find the container with id 9b4c1f040690dec0a7f4616d675a44716e397ea9d83e77c73cb71196029675bd Jul 13 03:01:26.987118 ip-10-0-134-52 kubenswrapper[2558]: I0713 03:01:26.986950 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-rssjv" event={"ID":"cd974d9c-4de2-4f2a-9b1b-3e58de6bec29","Type":"ContainerStarted","Data":"78bc186a8e5aa7ed3a6ce145116be42dcea31f50cd29183f0a97d0d2dc2f3748"} Jul 13 03:01:26.987118 ip-10-0-134-52 kubenswrapper[2558]: I0713 03:01:26.987021 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-rssjv" event={"ID":"cd974d9c-4de2-4f2a-9b1b-3e58de6bec29","Type":"ContainerStarted","Data":"3b42674f13f41d9a6feb4b63691c89dcda7c57d68a27e3f5d498703400d97390"} Jul 13 03:01:26.988713 ip-10-0-134-52 kubenswrapper[2558]: I0713 03:01:26.988678 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-77b686b4f7-bjzn2" event={"ID":"c69060a0-a145-4d88-b7fc-84d321cd2e8a","Type":"ContainerStarted","Data":"9b4c1f040690dec0a7f4616d675a44716e397ea9d83e77c73cb71196029675bd"} Jul 13 03:01:26.990381 ip-10-0-134-52 kubenswrapper[2558]: I0713 03:01:26.990356 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"efab6d01-9fed-48f2-8343-7423fd04ecd7","Type":"ContainerStarted","Data":"33eb1c831db597bf61815274c24d22db82e20ee3611ec7f0479cb11d6a1cf192"} Jul 13 03:01:27.011057 ip-10-0-134-52 kubenswrapper[2558]: I0713 03:01:27.010799 2558 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/node-exporter-rssjv" podStartSLOduration=1.9109858769999999 podStartE2EDuration="3.010780147s" totalImagesPullingTime="1.031139387s" totalInitContainerRuntime="68.654883ms" isStatefulPod=true podCreationTimestamp="2026-07-13 03:01:24 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-13 03:01:27.010131236 +0000 UTC m=+269.410731703" watchObservedRunningTime="2026-07-13 03:01:27.010780147 +0000 UTC m=+269.411380622" Jul 13 03:01:29.472053 ip-10-0-134-52 kubenswrapper[2558]: I0713 03:01:29.471988 2558 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/telemeter-client-6bbd99d68b-47bkk"] Jul 13 03:01:29.475287 ip-10-0-134-52 kubenswrapper[2558]: I0713 03:01:29.475273 2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/telemeter-client-6bbd99d68b-47bkk" Jul 13 03:01:29.478029 ip-10-0-134-52 kubenswrapper[2558]: I0713 03:01:29.478009 2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"telemeter-client-tls\"" Jul 13 03:01:29.478197 ip-10-0-134-52 kubenswrapper[2558]: I0713 03:01:29.478177 2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"telemeter-client-dockercfg-wjgd5\"" Jul 13 03:01:29.478481 ip-10-0-134-52 kubenswrapper[2558]: I0713 03:01:29.478465 2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"telemeter-client\"" Jul 13 03:01:29.478555 ip-10-0-134-52 kubenswrapper[2558]: I0713 03:01:29.478489 2558 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"telemeter-client-serving-certs-ca-bundle\"" Jul 13 03:01:29.478608 ip-10-0-134-52 kubenswrapper[2558]: I0713 03:01:29.478590 2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"federate-client-certs\"" Jul 13 03:01:29.478671 ip-10-0-134-52 kubenswrapper[2558]: I0713 03:01:29.478615 2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"telemeter-client-kube-rbac-proxy-config\"" Jul 13 03:01:29.483808 ip-10-0-134-52 kubenswrapper[2558]: I0713 03:01:29.483789 2558 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"telemeter-trusted-ca-bundle-8i12ta5c71j38\"" Jul 13 03:01:29.492067 ip-10-0-134-52 kubenswrapper[2558]: I0713 03:01:29.492046 2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/telemeter-client-6bbd99d68b-47bkk"] Jul 13 03:01:29.531681 ip-10-0-134-52 kubenswrapper[2558]: I0713 03:01:29.531651 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-telemeter-client\" (UniqueName: \"kubernetes.io/secret/c0791684-d0ab-411b-a922-f703daa8c542-secret-telemeter-client\") pod \"telemeter-client-6bbd99d68b-47bkk\" (UID: \"c0791684-d0ab-411b-a922-f703daa8c542\") " pod="openshift-monitoring/telemeter-client-6bbd99d68b-47bkk" Jul 13 03:01:29.531681 ip-10-0-134-52 kubenswrapper[2558]: I0713 03:01:29.531680 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"federate-client-tls\" (UniqueName: \"kubernetes.io/secret/c0791684-d0ab-411b-a922-f703daa8c542-federate-client-tls\") pod \"telemeter-client-6bbd99d68b-47bkk\" (UID: \"c0791684-d0ab-411b-a922-f703daa8c542\") " pod="openshift-monitoring/telemeter-client-6bbd99d68b-47bkk" Jul 13 03:01:29.531825 ip-10-0-134-52 kubenswrapper[2558]: I0713 03:01:29.531790 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-telemeter-client-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/c0791684-d0ab-411b-a922-f703daa8c542-secret-telemeter-client-kube-rbac-proxy-config\") pod \"telemeter-client-6bbd99d68b-47bkk\" (UID: \"c0791684-d0ab-411b-a922-f703daa8c542\") " pod="openshift-monitoring/telemeter-client-6bbd99d68b-47bkk" Jul 13 03:01:29.531886 ip-10-0-134-52 kubenswrapper[2558]: I0713 03:01:29.531842 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"telemeter-client-tls\" (UniqueName: \"kubernetes.io/secret/c0791684-d0ab-411b-a922-f703daa8c542-telemeter-client-tls\") pod \"telemeter-client-6bbd99d68b-47bkk\" (UID: \"c0791684-d0ab-411b-a922-f703daa8c542\") " pod="openshift-monitoring/telemeter-client-6bbd99d68b-47bkk" Jul 13 03:01:29.531936 ip-10-0-134-52 kubenswrapper[2558]: I0713 03:01:29.531910 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/c0791684-d0ab-411b-a922-f703daa8c542-metrics-client-ca\") pod \"telemeter-client-6bbd99d68b-47bkk\" (UID: \"c0791684-d0ab-411b-a922-f703daa8c542\") " pod="openshift-monitoring/telemeter-client-6bbd99d68b-47bkk" Jul 13 03:01:29.531970 ip-10-0-134-52 kubenswrapper[2558]: I0713 03:01:29.531936 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/c0791684-d0ab-411b-a922-f703daa8c542-serving-certs-ca-bundle\") pod \"telemeter-client-6bbd99d68b-47bkk\" (UID: \"c0791684-d0ab-411b-a922-f703daa8c542\") " pod="openshift-monitoring/telemeter-client-6bbd99d68b-47bkk" Jul 13 03:01:29.531970 ip-10-0-134-52 kubenswrapper[2558]: I0713 03:01:29.531955 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"telemeter-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/c0791684-d0ab-411b-a922-f703daa8c542-telemeter-trusted-ca-bundle\") pod \"telemeter-client-6bbd99d68b-47bkk\" (UID: \"c0791684-d0ab-411b-a922-f703daa8c542\") " pod="openshift-monitoring/telemeter-client-6bbd99d68b-47bkk" Jul 13 03:01:29.532046 ip-10-0-134-52 kubenswrapper[2558]: I0713 03:01:29.531972 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-qt67c\" (UniqueName: \"kubernetes.io/projected/c0791684-d0ab-411b-a922-f703daa8c542-kube-api-access-qt67c\") pod \"telemeter-client-6bbd99d68b-47bkk\" (UID: \"c0791684-d0ab-411b-a922-f703daa8c542\") " pod="openshift-monitoring/telemeter-client-6bbd99d68b-47bkk" Jul 13 03:01:29.633040 ip-10-0-134-52 kubenswrapper[2558]: I0713 03:01:29.633019 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-telemeter-client\" (UniqueName: \"kubernetes.io/secret/c0791684-d0ab-411b-a922-f703daa8c542-secret-telemeter-client\") pod \"telemeter-client-6bbd99d68b-47bkk\" (UID: \"c0791684-d0ab-411b-a922-f703daa8c542\") " pod="openshift-monitoring/telemeter-client-6bbd99d68b-47bkk" Jul 13 03:01:29.633112 ip-10-0-134-52 kubenswrapper[2558]: I0713 03:01:29.633044 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"federate-client-tls\" (UniqueName: \"kubernetes.io/secret/c0791684-d0ab-411b-a922-f703daa8c542-federate-client-tls\") pod \"telemeter-client-6bbd99d68b-47bkk\" (UID: \"c0791684-d0ab-411b-a922-f703daa8c542\") " pod="openshift-monitoring/telemeter-client-6bbd99d68b-47bkk" Jul 13 03:01:29.633112 ip-10-0-134-52 kubenswrapper[2558]: I0713 03:01:29.633076 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-telemeter-client-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/c0791684-d0ab-411b-a922-f703daa8c542-secret-telemeter-client-kube-rbac-proxy-config\") pod \"telemeter-client-6bbd99d68b-47bkk\" (UID: \"c0791684-d0ab-411b-a922-f703daa8c542\") " pod="openshift-monitoring/telemeter-client-6bbd99d68b-47bkk" Jul 13 03:01:29.633212 ip-10-0-134-52 kubenswrapper[2558]: I0713 03:01:29.633195 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"telemeter-client-tls\" (UniqueName: \"kubernetes.io/secret/c0791684-d0ab-411b-a922-f703daa8c542-telemeter-client-tls\") pod \"telemeter-client-6bbd99d68b-47bkk\" (UID: \"c0791684-d0ab-411b-a922-f703daa8c542\") " pod="openshift-monitoring/telemeter-client-6bbd99d68b-47bkk" Jul 13 03:01:29.633290 ip-10-0-134-52 kubenswrapper[2558]: I0713 03:01:29.633277 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/c0791684-d0ab-411b-a922-f703daa8c542-metrics-client-ca\") pod \"telemeter-client-6bbd99d68b-47bkk\" (UID: \"c0791684-d0ab-411b-a922-f703daa8c542\") " pod="openshift-monitoring/telemeter-client-6bbd99d68b-47bkk" Jul 13 03:01:29.633382 ip-10-0-134-52 kubenswrapper[2558]: I0713 03:01:29.633309 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/c0791684-d0ab-411b-a922-f703daa8c542-serving-certs-ca-bundle\") pod \"telemeter-client-6bbd99d68b-47bkk\" (UID: \"c0791684-d0ab-411b-a922-f703daa8c542\") " pod="openshift-monitoring/telemeter-client-6bbd99d68b-47bkk" Jul 13 03:01:29.633382 ip-10-0-134-52 kubenswrapper[2558]: I0713 03:01:29.633367 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"telemeter-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/c0791684-d0ab-411b-a922-f703daa8c542-telemeter-trusted-ca-bundle\") pod \"telemeter-client-6bbd99d68b-47bkk\" (UID: \"c0791684-d0ab-411b-a922-f703daa8c542\") " pod="openshift-monitoring/telemeter-client-6bbd99d68b-47bkk" Jul 13 03:01:29.633488 ip-10-0-134-52 kubenswrapper[2558]: I0713 03:01:29.633396 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-qt67c\" (UniqueName: \"kubernetes.io/projected/c0791684-d0ab-411b-a922-f703daa8c542-kube-api-access-qt67c\") pod \"telemeter-client-6bbd99d68b-47bkk\" (UID: \"c0791684-d0ab-411b-a922-f703daa8c542\") " pod="openshift-monitoring/telemeter-client-6bbd99d68b-47bkk" Jul 13 03:01:29.634086 ip-10-0-134-52 kubenswrapper[2558]: I0713 03:01:29.634055 2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/c0791684-d0ab-411b-a922-f703daa8c542-metrics-client-ca\") pod \"telemeter-client-6bbd99d68b-47bkk\" (UID: \"c0791684-d0ab-411b-a922-f703daa8c542\") " pod="openshift-monitoring/telemeter-client-6bbd99d68b-47bkk" Jul 13 03:01:29.634193 ip-10-0-134-52 kubenswrapper[2558]: I0713 03:01:29.634055 2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/c0791684-d0ab-411b-a922-f703daa8c542-serving-certs-ca-bundle\") pod \"telemeter-client-6bbd99d68b-47bkk\" (UID: \"c0791684-d0ab-411b-a922-f703daa8c542\") " pod="openshift-monitoring/telemeter-client-6bbd99d68b-47bkk" Jul 13 03:01:29.634691 ip-10-0-134-52 kubenswrapper[2558]: I0713 03:01:29.634666 2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"telemeter-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/c0791684-d0ab-411b-a922-f703daa8c542-telemeter-trusted-ca-bundle\") pod \"telemeter-client-6bbd99d68b-47bkk\" (UID: \"c0791684-d0ab-411b-a922-f703daa8c542\") " pod="openshift-monitoring/telemeter-client-6bbd99d68b-47bkk" Jul 13 03:01:29.635617 ip-10-0-134-52 kubenswrapper[2558]: I0713 03:01:29.635592 2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-telemeter-client-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/c0791684-d0ab-411b-a922-f703daa8c542-secret-telemeter-client-kube-rbac-proxy-config\") pod \"telemeter-client-6bbd99d68b-47bkk\" (UID: \"c0791684-d0ab-411b-a922-f703daa8c542\") " pod="openshift-monitoring/telemeter-client-6bbd99d68b-47bkk" Jul 13 03:01:29.635827 ip-10-0-134-52 kubenswrapper[2558]: I0713 03:01:29.635809 2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"telemeter-client-tls\" (UniqueName: \"kubernetes.io/secret/c0791684-d0ab-411b-a922-f703daa8c542-telemeter-client-tls\") pod \"telemeter-client-6bbd99d68b-47bkk\" (UID: \"c0791684-d0ab-411b-a922-f703daa8c542\") " pod="openshift-monitoring/telemeter-client-6bbd99d68b-47bkk" Jul 13 03:01:29.636153 ip-10-0-134-52 kubenswrapper[2558]: I0713 03:01:29.636132 2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-telemeter-client\" (UniqueName: \"kubernetes.io/secret/c0791684-d0ab-411b-a922-f703daa8c542-secret-telemeter-client\") pod \"telemeter-client-6bbd99d68b-47bkk\" (UID: \"c0791684-d0ab-411b-a922-f703daa8c542\") " pod="openshift-monitoring/telemeter-client-6bbd99d68b-47bkk" Jul 13 03:01:29.636202 ip-10-0-134-52 kubenswrapper[2558]: I0713 03:01:29.636149 2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"federate-client-tls\" (UniqueName: \"kubernetes.io/secret/c0791684-d0ab-411b-a922-f703daa8c542-federate-client-tls\") pod \"telemeter-client-6bbd99d68b-47bkk\" (UID: \"c0791684-d0ab-411b-a922-f703daa8c542\") " pod="openshift-monitoring/telemeter-client-6bbd99d68b-47bkk" Jul 13 03:01:29.642997 ip-10-0-134-52 kubenswrapper[2558]: I0713 03:01:29.642976 2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-qt67c\" (UniqueName: \"kubernetes.io/projected/c0791684-d0ab-411b-a922-f703daa8c542-kube-api-access-qt67c\") pod \"telemeter-client-6bbd99d68b-47bkk\" (UID: \"c0791684-d0ab-411b-a922-f703daa8c542\") " pod="openshift-monitoring/telemeter-client-6bbd99d68b-47bkk" Jul 13 03:01:29.784185 ip-10-0-134-52 kubenswrapper[2558]: I0713 03:01:29.784131 2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/telemeter-client-6bbd99d68b-47bkk" Jul 13 03:01:29.918434 ip-10-0-134-52 kubenswrapper[2558]: I0713 03:01:29.918408 2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/telemeter-client-6bbd99d68b-47bkk"] Jul 13 03:01:29.919998 ip-10-0-134-52 kubenswrapper[2558]: W0713 03:01:29.919974 2558 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podc0791684_d0ab_411b_a922_f703daa8c542.slice/crio-9735820ea227a3aba0c96a3b3e33b8c3edb3c45d33b43e444ccc57f71f287681 WatchSource:0}: Error finding container 9735820ea227a3aba0c96a3b3e33b8c3edb3c45d33b43e444ccc57f71f287681: Status 404 returned error can't find the container with id 9735820ea227a3aba0c96a3b3e33b8c3edb3c45d33b43e444ccc57f71f287681 Jul 13 03:01:30.003093 ip-10-0-134-52 kubenswrapper[2558]: I0713 03:01:30.003064 2558 generic.go:356] "Generic (PLEG): container finished" podID="efab6d01-9fed-48f2-8343-7423fd04ecd7" containerID="df77a40ddeaf7c77bee47ae8bc706c1d7f8e60007ca0fd1bb7db40634d50c70b" exitCode=0 Jul 13 03:01:30.003199 ip-10-0-134-52 kubenswrapper[2558]: I0713 03:01:30.003128 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"efab6d01-9fed-48f2-8343-7423fd04ecd7","Type":"ContainerDied","Data":"df77a40ddeaf7c77bee47ae8bc706c1d7f8e60007ca0fd1bb7db40634d50c70b"} Jul 13 03:01:30.004379 ip-10-0-134-52 kubenswrapper[2558]: I0713 03:01:30.004353 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/telemeter-client-6bbd99d68b-47bkk" event={"ID":"c0791684-d0ab-411b-a922-f703daa8c542","Type":"ContainerStarted","Data":"9735820ea227a3aba0c96a3b3e33b8c3edb3c45d33b43e444ccc57f71f287681"} Jul 13 03:01:30.005969 ip-10-0-134-52 kubenswrapper[2558]: I0713 03:01:30.005916 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-6d6476497b-j24jp" event={"ID":"2a4da825-3dbe-42c9-a325-e6ddcdab810c","Type":"ContainerStarted","Data":"483191d976d5fdc2af2ef70b11f8c3fc40c914ba50a98f78a02999858eed0d2b"} Jul 13 03:01:30.007948 ip-10-0-134-52 kubenswrapper[2558]: I0713 03:01:30.007928 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-77b686b4f7-bjzn2" event={"ID":"c69060a0-a145-4d88-b7fc-84d321cd2e8a","Type":"ContainerStarted","Data":"5ff84f991c794e280057ae24532af74aad6b52fd3949d3a07af08b7d6e6160a6"} Jul 13 03:01:30.008024 ip-10-0-134-52 kubenswrapper[2558]: I0713 03:01:30.007976 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-77b686b4f7-bjzn2" event={"ID":"c69060a0-a145-4d88-b7fc-84d321cd2e8a","Type":"ContainerStarted","Data":"4d65df6f6b638f96e92ed70c30a036c4d4028d384b5c62797074e9802ef36440"} Jul 13 03:01:30.008024 ip-10-0-134-52 kubenswrapper[2558]: I0713 03:01:30.008001 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-77b686b4f7-bjzn2" event={"ID":"c69060a0-a145-4d88-b7fc-84d321cd2e8a","Type":"ContainerStarted","Data":"c02e45dd6f5ff46546caae1fe8c899fe5da5d8be1dfcee35e0f97fe254098c33"} Jul 13 03:01:30.053302 ip-10-0-134-52 kubenswrapper[2558]: I0713 03:01:30.053246 2558 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console/console-6d6476497b-j24jp" podStartSLOduration=1.9693308269999998 podStartE2EDuration="6.05323177s" totalImagesPullingTime="4.083900943s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-13 03:01:24 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-13 03:01:30.05257269 +0000 UTC m=+272.453173159" watchObservedRunningTime="2026-07-13 03:01:30.05323177 +0000 UTC m=+272.453832236" Jul 13 03:01:31.017140 ip-10-0-134-52 kubenswrapper[2558]: I0713 03:01:31.017019 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-77b686b4f7-bjzn2" event={"ID":"c69060a0-a145-4d88-b7fc-84d321cd2e8a","Type":"ContainerStarted","Data":"b55be8ae06acf2b9a496b554bddc42d6706a34dac6456be22db9471ec9b636a8"} Jul 13 03:01:31.017140 ip-10-0-134-52 kubenswrapper[2558]: I0713 03:01:31.017100 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-77b686b4f7-bjzn2" event={"ID":"c69060a0-a145-4d88-b7fc-84d321cd2e8a","Type":"ContainerStarted","Data":"5da0bd68c1761f853769e971e6c7082ccfad6a1499143c4b748ff406904352f8"} Jul 13 03:01:31.017658 ip-10-0-134-52 kubenswrapper[2558]: I0713 03:01:31.017172 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-77b686b4f7-bjzn2" event={"ID":"c69060a0-a145-4d88-b7fc-84d321cd2e8a","Type":"ContainerStarted","Data":"77247fc55d505f236dd78ac339dbbd35b675e0536a78bcbd4e328117e3320784"} Jul 13 03:01:31.046493 ip-10-0-134-52 kubenswrapper[2558]: I0713 03:01:31.046403 2558 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/thanos-querier-77b686b4f7-bjzn2" podStartSLOduration=1.6340798589999999 podStartE2EDuration="5.046380416s" totalImagesPullingTime="3.412300557s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-13 03:01:26 +0000 UTC" imagePullSessionsCount=2 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-13 03:01:31.04377686 +0000 UTC m=+273.444377349" watchObservedRunningTime="2026-07-13 03:01:31.046380416 +0000 UTC m=+273.446980882" Jul 13 03:01:32.021945 ip-10-0-134-52 kubenswrapper[2558]: I0713 03:01:32.021922 2558 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-monitoring/thanos-querier-77b686b4f7-bjzn2" Jul 13 03:01:33.015730 ip-10-0-134-52 kubenswrapper[2558]: I0713 03:01:33.015697 2558 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console/console-5fcbfb6964-qr9l7"] Jul 13 03:01:33.018916 ip-10-0-134-52 kubenswrapper[2558]: I0713 03:01:33.018894 2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-5fcbfb6964-qr9l7" Jul 13 03:01:33.027148 ip-10-0-134-52 kubenswrapper[2558]: I0713 03:01:33.026973 2558 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"trusted-ca-bundle\"" Jul 13 03:01:33.028819 ip-10-0-134-52 kubenswrapper[2558]: I0713 03:01:33.028799 2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-5fcbfb6964-qr9l7"] Jul 13 03:01:33.029878 ip-10-0-134-52 kubenswrapper[2558]: I0713 03:01:33.029852 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"efab6d01-9fed-48f2-8343-7423fd04ecd7","Type":"ContainerStarted","Data":"ef4131e9c7c54ef956b58b06a5aaae37425550647e52f2d3d45c3737521d1e8a"} Jul 13 03:01:33.029972 ip-10-0-134-52 kubenswrapper[2558]: I0713 03:01:33.029922 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"efab6d01-9fed-48f2-8343-7423fd04ecd7","Type":"ContainerStarted","Data":"65215590b71c0bdc0105967f6a2091587c787ad8de9065ff147c00cf91ae4a18"} Jul 13 03:01:33.029972 ip-10-0-134-52 kubenswrapper[2558]: I0713 03:01:33.029968 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"efab6d01-9fed-48f2-8343-7423fd04ecd7","Type":"ContainerStarted","Data":"865f30b78c9f29200c876e6d4cfb1b7c97583e19c9fb13f71ae46f2d996d392f"} Jul 13 03:01:33.030089 ip-10-0-134-52 kubenswrapper[2558]: I0713 03:01:33.030007 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"efab6d01-9fed-48f2-8343-7423fd04ecd7","Type":"ContainerStarted","Data":"9838f191125846c9d102d7b31e0cb6439ff649467d2cca66fb14dec2c1038516"} Jul 13 03:01:33.030089 ip-10-0-134-52 kubenswrapper[2558]: I0713 03:01:33.030043 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"efab6d01-9fed-48f2-8343-7423fd04ecd7","Type":"ContainerStarted","Data":"9a16dcb46316ab55dc89db0e8e1685a63ccc3adc2f3bef8a040b2b8dfe41f1c3"} Jul 13 03:01:33.030089 ip-10-0-134-52 kubenswrapper[2558]: I0713 03:01:33.030077 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"efab6d01-9fed-48f2-8343-7423fd04ecd7","Type":"ContainerStarted","Data":"d1612a326163d39c08b27ca610518b642db60037f0d92c481c4741fcbed24a09"} Jul 13 03:01:33.032284 ip-10-0-134-52 kubenswrapper[2558]: I0713 03:01:33.032260 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/telemeter-client-6bbd99d68b-47bkk" event={"ID":"c0791684-d0ab-411b-a922-f703daa8c542","Type":"ContainerStarted","Data":"bcfd3fe7ea10f5917d8c9ce1f4fb78abff2bd93a46f676ea0e7f833475513311"} Jul 13 03:01:33.032390 ip-10-0-134-52 kubenswrapper[2558]: I0713 03:01:33.032311 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/telemeter-client-6bbd99d68b-47bkk" event={"ID":"c0791684-d0ab-411b-a922-f703daa8c542","Type":"ContainerStarted","Data":"01821c1dd368c391c8e07ec53daadfc8137c592d1f7f1745dbd65f2f6adceaf6"} Jul 13 03:01:33.032390 ip-10-0-134-52 kubenswrapper[2558]: I0713 03:01:33.032366 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/telemeter-client-6bbd99d68b-47bkk" event={"ID":"c0791684-d0ab-411b-a922-f703daa8c542","Type":"ContainerStarted","Data":"e98e1ae8362a94e9c0f724d49567ba5b5645bdfb020ceb60efdb16a94e632a37"} Jul 13 03:01:33.066025 ip-10-0-134-52 kubenswrapper[2558]: I0713 03:01:33.065979 2558 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/telemeter-client-6bbd99d68b-47bkk" podStartSLOduration=1.9629223759999999 podStartE2EDuration="4.065966802s" totalImagesPullingTime="2.103044426s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-13 03:01:29 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-13 03:01:33.064378374 +0000 UTC m=+275.464978840" watchObservedRunningTime="2026-07-13 03:01:33.065966802 +0000 UTC m=+275.466567267" Jul 13 03:01:33.089851 ip-10-0-134-52 kubenswrapper[2558]: I0713 03:01:33.089814 2558 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/alertmanager-main-0" podStartSLOduration=3.287703679 podStartE2EDuration="8.089803038s" totalImagesPullingTime="4.784921047s" totalInitContainerRuntime="17.178312ms" isStatefulPod=false podCreationTimestamp="2026-07-13 03:01:25 +0000 UTC" imagePullSessionsCount=2 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-13 03:01:33.088355871 +0000 UTC m=+275.488956358" watchObservedRunningTime="2026-07-13 03:01:33.089803038 +0000 UTC m=+275.490403503" Jul 13 03:01:33.168392 ip-10-0-134-52 kubenswrapper[2558]: I0713 03:01:33.168353 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/07484034-3cb0-46f9-84f5-2ebec2e95044-console-serving-cert\") pod \"console-5fcbfb6964-qr9l7\" (UID: \"07484034-3cb0-46f9-84f5-2ebec2e95044\") " pod="openshift-console/console-5fcbfb6964-qr9l7" Jul 13 03:01:33.168392 ip-10-0-134-52 kubenswrapper[2558]: I0713 03:01:33.168401 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/07484034-3cb0-46f9-84f5-2ebec2e95044-console-config\") pod \"console-5fcbfb6964-qr9l7\" (UID: \"07484034-3cb0-46f9-84f5-2ebec2e95044\") " pod="openshift-console/console-5fcbfb6964-qr9l7" Jul 13 03:01:33.168600 ip-10-0-134-52 kubenswrapper[2558]: I0713 03:01:33.168439 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/07484034-3cb0-46f9-84f5-2ebec2e95044-trusted-ca-bundle\") pod \"console-5fcbfb6964-qr9l7\" (UID: \"07484034-3cb0-46f9-84f5-2ebec2e95044\") " pod="openshift-console/console-5fcbfb6964-qr9l7" Jul 13 03:01:33.168600 ip-10-0-134-52 kubenswrapper[2558]: I0713 03:01:33.168507 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/07484034-3cb0-46f9-84f5-2ebec2e95044-service-ca\") pod \"console-5fcbfb6964-qr9l7\" (UID: \"07484034-3cb0-46f9-84f5-2ebec2e95044\") " pod="openshift-console/console-5fcbfb6964-qr9l7" Jul 13 03:01:33.168600 ip-10-0-134-52 kubenswrapper[2558]: I0713 03:01:33.168529 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/07484034-3cb0-46f9-84f5-2ebec2e95044-oauth-serving-cert\") pod \"console-5fcbfb6964-qr9l7\" (UID: \"07484034-3cb0-46f9-84f5-2ebec2e95044\") " pod="openshift-console/console-5fcbfb6964-qr9l7" Jul 13 03:01:33.168770 ip-10-0-134-52 kubenswrapper[2558]: I0713 03:01:33.168644 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-ncgks\" (UniqueName: \"kubernetes.io/projected/07484034-3cb0-46f9-84f5-2ebec2e95044-kube-api-access-ncgks\") pod \"console-5fcbfb6964-qr9l7\" (UID: \"07484034-3cb0-46f9-84f5-2ebec2e95044\") " pod="openshift-console/console-5fcbfb6964-qr9l7" Jul 13 03:01:33.168850 ip-10-0-134-52 kubenswrapper[2558]: I0713 03:01:33.168827 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/07484034-3cb0-46f9-84f5-2ebec2e95044-console-oauth-config\") pod \"console-5fcbfb6964-qr9l7\" (UID: \"07484034-3cb0-46f9-84f5-2ebec2e95044\") " pod="openshift-console/console-5fcbfb6964-qr9l7" Jul 13 03:01:33.274460 ip-10-0-134-52 kubenswrapper[2558]: I0713 03:01:33.274179 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/07484034-3cb0-46f9-84f5-2ebec2e95044-console-serving-cert\") pod \"console-5fcbfb6964-qr9l7\" (UID: \"07484034-3cb0-46f9-84f5-2ebec2e95044\") " pod="openshift-console/console-5fcbfb6964-qr9l7" Jul 13 03:01:33.274460 ip-10-0-134-52 kubenswrapper[2558]: I0713 03:01:33.274442 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/07484034-3cb0-46f9-84f5-2ebec2e95044-console-config\") pod \"console-5fcbfb6964-qr9l7\" (UID: \"07484034-3cb0-46f9-84f5-2ebec2e95044\") " pod="openshift-console/console-5fcbfb6964-qr9l7" Jul 13 03:01:33.274628 ip-10-0-134-52 kubenswrapper[2558]: I0713 03:01:33.274474 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/07484034-3cb0-46f9-84f5-2ebec2e95044-trusted-ca-bundle\") pod \"console-5fcbfb6964-qr9l7\" (UID: \"07484034-3cb0-46f9-84f5-2ebec2e95044\") " pod="openshift-console/console-5fcbfb6964-qr9l7" Jul 13 03:01:33.274628 ip-10-0-134-52 kubenswrapper[2558]: I0713 03:01:33.274500 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/07484034-3cb0-46f9-84f5-2ebec2e95044-service-ca\") pod \"console-5fcbfb6964-qr9l7\" (UID: \"07484034-3cb0-46f9-84f5-2ebec2e95044\") " pod="openshift-console/console-5fcbfb6964-qr9l7" Jul 13 03:01:33.274628 ip-10-0-134-52 kubenswrapper[2558]: I0713 03:01:33.274521 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/07484034-3cb0-46f9-84f5-2ebec2e95044-oauth-serving-cert\") pod \"console-5fcbfb6964-qr9l7\" (UID: \"07484034-3cb0-46f9-84f5-2ebec2e95044\") " pod="openshift-console/console-5fcbfb6964-qr9l7" Jul 13 03:01:33.274628 ip-10-0-134-52 kubenswrapper[2558]: I0713 03:01:33.274552 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-ncgks\" (UniqueName: \"kubernetes.io/projected/07484034-3cb0-46f9-84f5-2ebec2e95044-kube-api-access-ncgks\") pod \"console-5fcbfb6964-qr9l7\" (UID: \"07484034-3cb0-46f9-84f5-2ebec2e95044\") " pod="openshift-console/console-5fcbfb6964-qr9l7" Jul 13 03:01:33.274628 ip-10-0-134-52 kubenswrapper[2558]: I0713 03:01:33.274601 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/07484034-3cb0-46f9-84f5-2ebec2e95044-console-oauth-config\") pod \"console-5fcbfb6964-qr9l7\" (UID: \"07484034-3cb0-46f9-84f5-2ebec2e95044\") " pod="openshift-console/console-5fcbfb6964-qr9l7" Jul 13 03:01:33.275314 ip-10-0-134-52 kubenswrapper[2558]: I0713 03:01:33.275247 2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/07484034-3cb0-46f9-84f5-2ebec2e95044-service-ca\") pod \"console-5fcbfb6964-qr9l7\" (UID: \"07484034-3cb0-46f9-84f5-2ebec2e95044\") " pod="openshift-console/console-5fcbfb6964-qr9l7" Jul 13 03:01:33.275314 ip-10-0-134-52 kubenswrapper[2558]: I0713 03:01:33.275314 2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/07484034-3cb0-46f9-84f5-2ebec2e95044-oauth-serving-cert\") pod \"console-5fcbfb6964-qr9l7\" (UID: \"07484034-3cb0-46f9-84f5-2ebec2e95044\") " pod="openshift-console/console-5fcbfb6964-qr9l7" Jul 13 03:01:33.275562 ip-10-0-134-52 kubenswrapper[2558]: I0713 03:01:33.275402 2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/07484034-3cb0-46f9-84f5-2ebec2e95044-trusted-ca-bundle\") pod \"console-5fcbfb6964-qr9l7\" (UID: \"07484034-3cb0-46f9-84f5-2ebec2e95044\") " pod="openshift-console/console-5fcbfb6964-qr9l7" Jul 13 03:01:33.275890 ip-10-0-134-52 kubenswrapper[2558]: I0713 03:01:33.275863 2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/07484034-3cb0-46f9-84f5-2ebec2e95044-console-config\") pod \"console-5fcbfb6964-qr9l7\" (UID: \"07484034-3cb0-46f9-84f5-2ebec2e95044\") " pod="openshift-console/console-5fcbfb6964-qr9l7" Jul 13 03:01:33.276747 ip-10-0-134-52 kubenswrapper[2558]: I0713 03:01:33.276722 2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/07484034-3cb0-46f9-84f5-2ebec2e95044-console-serving-cert\") pod \"console-5fcbfb6964-qr9l7\" (UID: \"07484034-3cb0-46f9-84f5-2ebec2e95044\") " pod="openshift-console/console-5fcbfb6964-qr9l7" Jul 13 03:01:33.277178 ip-10-0-134-52 kubenswrapper[2558]: I0713 03:01:33.277157 2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/07484034-3cb0-46f9-84f5-2ebec2e95044-console-oauth-config\") pod \"console-5fcbfb6964-qr9l7\" (UID: \"07484034-3cb0-46f9-84f5-2ebec2e95044\") " pod="openshift-console/console-5fcbfb6964-qr9l7" Jul 13 03:01:33.284375 ip-10-0-134-52 kubenswrapper[2558]: I0713 03:01:33.284358 2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-ncgks\" (UniqueName: \"kubernetes.io/projected/07484034-3cb0-46f9-84f5-2ebec2e95044-kube-api-access-ncgks\") pod \"console-5fcbfb6964-qr9l7\" (UID: \"07484034-3cb0-46f9-84f5-2ebec2e95044\") " pod="openshift-console/console-5fcbfb6964-qr9l7" Jul 13 03:01:33.340916 ip-10-0-134-52 kubenswrapper[2558]: I0713 03:01:33.340891 2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-5fcbfb6964-qr9l7" Jul 13 03:01:33.471881 ip-10-0-134-52 kubenswrapper[2558]: I0713 03:01:33.471768 2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-5fcbfb6964-qr9l7"] Jul 13 03:01:33.474408 ip-10-0-134-52 kubenswrapper[2558]: W0713 03:01:33.474382 2558 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod07484034_3cb0_46f9_84f5_2ebec2e95044.slice/crio-4f95467fef5b5b2901028ac5c9a4eebc157c3167c0ef8210a1f2e7aaf7821ce4 WatchSource:0}: Error finding container 4f95467fef5b5b2901028ac5c9a4eebc157c3167c0ef8210a1f2e7aaf7821ce4: Status 404 returned error can't find the container with id 4f95467fef5b5b2901028ac5c9a4eebc157c3167c0ef8210a1f2e7aaf7821ce4 Jul 13 03:01:34.037963 ip-10-0-134-52 kubenswrapper[2558]: I0713 03:01:34.037932 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-5fcbfb6964-qr9l7" event={"ID":"07484034-3cb0-46f9-84f5-2ebec2e95044","Type":"ContainerStarted","Data":"24be0428d638df61120ad7448953916eea6d45c9a138618673c33fb730e1ea63"} Jul 13 03:01:34.038410 ip-10-0-134-52 kubenswrapper[2558]: I0713 03:01:34.037981 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-5fcbfb6964-qr9l7" event={"ID":"07484034-3cb0-46f9-84f5-2ebec2e95044","Type":"ContainerStarted","Data":"4f95467fef5b5b2901028ac5c9a4eebc157c3167c0ef8210a1f2e7aaf7821ce4"} Jul 13 03:01:34.057361 ip-10-0-134-52 kubenswrapper[2558]: I0713 03:01:34.057301 2558 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console/console-5fcbfb6964-qr9l7" podStartSLOduration=2.057285969 podStartE2EDuration="2.057285969s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-13 03:01:32 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-13 03:01:34.055904085 +0000 UTC m=+276.456504550" watchObservedRunningTime="2026-07-13 03:01:34.057285969 +0000 UTC m=+276.457886435" Jul 13 03:01:34.954267 ip-10-0-134-52 kubenswrapper[2558]: I0713 03:01:34.954240 2558 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/console-6d6476497b-j24jp" Jul 13 03:01:34.954441 ip-10-0-134-52 kubenswrapper[2558]: I0713 03:01:34.954287 2558 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-console/console-6d6476497b-j24jp" Jul 13 03:01:34.958758 ip-10-0-134-52 kubenswrapper[2558]: I0713 03:01:34.958740 2558 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-console/console-6d6476497b-j24jp" Jul 13 03:01:35.045678 ip-10-0-134-52 kubenswrapper[2558]: I0713 03:01:35.045647 2558 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console/console-6d6476497b-j24jp" Jul 13 03:01:35.544602 ip-10-0-134-52 kubenswrapper[2558]: I0713 03:01:35.544575 2558 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-image-registry/image-registry-57f887d685-pgx8m" Jul 13 03:01:38.038004 ip-10-0-134-52 kubenswrapper[2558]: I0713 03:01:38.037931 2558 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-monitoring/thanos-querier-77b686b4f7-bjzn2" Jul 13 03:01:38.480877 ip-10-0-134-52 kubenswrapper[2558]: I0713 03:01:38.480845 2558 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-5fcbfb6964-qr9l7"] Jul 13 03:01:38.518513 ip-10-0-134-52 kubenswrapper[2558]: I0713 03:01:38.518474 2558 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console/console-76bb9cd886-whw2t"] Jul 13 03:01:38.522247 ip-10-0-134-52 kubenswrapper[2558]: I0713 03:01:38.522223 2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-76bb9cd886-whw2t" Jul 13 03:01:38.536409 ip-10-0-134-52 kubenswrapper[2558]: I0713 03:01:38.536382 2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-76bb9cd886-whw2t"] Jul 13 03:01:38.623677 ip-10-0-134-52 kubenswrapper[2558]: I0713 03:01:38.623641 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/54a4fc9b-27ee-4012-9bac-589d5d00e235-console-serving-cert\") pod \"console-76bb9cd886-whw2t\" (UID: \"54a4fc9b-27ee-4012-9bac-589d5d00e235\") " pod="openshift-console/console-76bb9cd886-whw2t" Jul 13 03:01:38.623807 ip-10-0-134-52 kubenswrapper[2558]: I0713 03:01:38.623754 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/54a4fc9b-27ee-4012-9bac-589d5d00e235-service-ca\") pod \"console-76bb9cd886-whw2t\" (UID: \"54a4fc9b-27ee-4012-9bac-589d5d00e235\") " pod="openshift-console/console-76bb9cd886-whw2t" Jul 13 03:01:38.623842 ip-10-0-134-52 kubenswrapper[2558]: I0713 03:01:38.623814 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/54a4fc9b-27ee-4012-9bac-589d5d00e235-console-oauth-config\") pod \"console-76bb9cd886-whw2t\" (UID: \"54a4fc9b-27ee-4012-9bac-589d5d00e235\") " pod="openshift-console/console-76bb9cd886-whw2t" Jul 13 03:01:38.623888 ip-10-0-134-52 kubenswrapper[2558]: I0713 03:01:38.623868 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/54a4fc9b-27ee-4012-9bac-589d5d00e235-console-config\") pod \"console-76bb9cd886-whw2t\" (UID: \"54a4fc9b-27ee-4012-9bac-589d5d00e235\") " pod="openshift-console/console-76bb9cd886-whw2t" Jul 13 03:01:38.623934 ip-10-0-134-52 kubenswrapper[2558]: I0713 03:01:38.623910 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/54a4fc9b-27ee-4012-9bac-589d5d00e235-oauth-serving-cert\") pod \"console-76bb9cd886-whw2t\" (UID: \"54a4fc9b-27ee-4012-9bac-589d5d00e235\") " pod="openshift-console/console-76bb9cd886-whw2t" Jul 13 03:01:38.624018 ip-10-0-134-52 kubenswrapper[2558]: I0713 03:01:38.624003 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/54a4fc9b-27ee-4012-9bac-589d5d00e235-trusted-ca-bundle\") pod \"console-76bb9cd886-whw2t\" (UID: \"54a4fc9b-27ee-4012-9bac-589d5d00e235\") " pod="openshift-console/console-76bb9cd886-whw2t" Jul 13 03:01:38.624051 ip-10-0-134-52 kubenswrapper[2558]: I0713 03:01:38.624032 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-4p97d\" (UniqueName: \"kubernetes.io/projected/54a4fc9b-27ee-4012-9bac-589d5d00e235-kube-api-access-4p97d\") pod \"console-76bb9cd886-whw2t\" (UID: \"54a4fc9b-27ee-4012-9bac-589d5d00e235\") " pod="openshift-console/console-76bb9cd886-whw2t" Jul 13 03:01:38.725463 ip-10-0-134-52 kubenswrapper[2558]: I0713 03:01:38.725426 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/54a4fc9b-27ee-4012-9bac-589d5d00e235-console-config\") pod \"console-76bb9cd886-whw2t\" (UID: \"54a4fc9b-27ee-4012-9bac-589d5d00e235\") " pod="openshift-console/console-76bb9cd886-whw2t" Jul 13 03:01:38.725463 ip-10-0-134-52 kubenswrapper[2558]: I0713 03:01:38.725466 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/54a4fc9b-27ee-4012-9bac-589d5d00e235-oauth-serving-cert\") pod \"console-76bb9cd886-whw2t\" (UID: \"54a4fc9b-27ee-4012-9bac-589d5d00e235\") " pod="openshift-console/console-76bb9cd886-whw2t" Jul 13 03:01:38.725700 ip-10-0-134-52 kubenswrapper[2558]: I0713 03:01:38.725503 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/54a4fc9b-27ee-4012-9bac-589d5d00e235-trusted-ca-bundle\") pod \"console-76bb9cd886-whw2t\" (UID: \"54a4fc9b-27ee-4012-9bac-589d5d00e235\") " pod="openshift-console/console-76bb9cd886-whw2t" Jul 13 03:01:38.725700 ip-10-0-134-52 kubenswrapper[2558]: I0713 03:01:38.725560 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-4p97d\" (UniqueName: \"kubernetes.io/projected/54a4fc9b-27ee-4012-9bac-589d5d00e235-kube-api-access-4p97d\") pod \"console-76bb9cd886-whw2t\" (UID: \"54a4fc9b-27ee-4012-9bac-589d5d00e235\") " pod="openshift-console/console-76bb9cd886-whw2t" Jul 13 03:01:38.725700 ip-10-0-134-52 kubenswrapper[2558]: I0713 03:01:38.725596 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/54a4fc9b-27ee-4012-9bac-589d5d00e235-console-serving-cert\") pod \"console-76bb9cd886-whw2t\" (UID: \"54a4fc9b-27ee-4012-9bac-589d5d00e235\") " pod="openshift-console/console-76bb9cd886-whw2t" Jul 13 03:01:38.725700 ip-10-0-134-52 kubenswrapper[2558]: I0713 03:01:38.725658 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/54a4fc9b-27ee-4012-9bac-589d5d00e235-service-ca\") pod \"console-76bb9cd886-whw2t\" (UID: \"54a4fc9b-27ee-4012-9bac-589d5d00e235\") " pod="openshift-console/console-76bb9cd886-whw2t" Jul 13 03:01:38.725857 ip-10-0-134-52 kubenswrapper[2558]: I0713 03:01:38.725705 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/54a4fc9b-27ee-4012-9bac-589d5d00e235-console-oauth-config\") pod \"console-76bb9cd886-whw2t\" (UID: \"54a4fc9b-27ee-4012-9bac-589d5d00e235\") " pod="openshift-console/console-76bb9cd886-whw2t" Jul 13 03:01:38.726405 ip-10-0-134-52 kubenswrapper[2558]: I0713 03:01:38.726378 2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/54a4fc9b-27ee-4012-9bac-589d5d00e235-service-ca\") pod \"console-76bb9cd886-whw2t\" (UID: \"54a4fc9b-27ee-4012-9bac-589d5d00e235\") " pod="openshift-console/console-76bb9cd886-whw2t" Jul 13 03:01:38.726405 ip-10-0-134-52 kubenswrapper[2558]: I0713 03:01:38.726390 2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/54a4fc9b-27ee-4012-9bac-589d5d00e235-console-config\") pod \"console-76bb9cd886-whw2t\" (UID: \"54a4fc9b-27ee-4012-9bac-589d5d00e235\") " pod="openshift-console/console-76bb9cd886-whw2t" Jul 13 03:01:38.726552 ip-10-0-134-52 kubenswrapper[2558]: I0713 03:01:38.726430 2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/54a4fc9b-27ee-4012-9bac-589d5d00e235-trusted-ca-bundle\") pod \"console-76bb9cd886-whw2t\" (UID: \"54a4fc9b-27ee-4012-9bac-589d5d00e235\") " pod="openshift-console/console-76bb9cd886-whw2t" Jul 13 03:01:38.726709 ip-10-0-134-52 kubenswrapper[2558]: I0713 03:01:38.726685 2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/54a4fc9b-27ee-4012-9bac-589d5d00e235-oauth-serving-cert\") pod \"console-76bb9cd886-whw2t\" (UID: \"54a4fc9b-27ee-4012-9bac-589d5d00e235\") " pod="openshift-console/console-76bb9cd886-whw2t" Jul 13 03:01:38.728053 ip-10-0-134-52 kubenswrapper[2558]: I0713 03:01:38.728029 2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/54a4fc9b-27ee-4012-9bac-589d5d00e235-console-serving-cert\") pod \"console-76bb9cd886-whw2t\" (UID: \"54a4fc9b-27ee-4012-9bac-589d5d00e235\") " pod="openshift-console/console-76bb9cd886-whw2t" Jul 13 03:01:38.728240 ip-10-0-134-52 kubenswrapper[2558]: I0713 03:01:38.728221 2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/54a4fc9b-27ee-4012-9bac-589d5d00e235-console-oauth-config\") pod \"console-76bb9cd886-whw2t\" (UID: \"54a4fc9b-27ee-4012-9bac-589d5d00e235\") " pod="openshift-console/console-76bb9cd886-whw2t" Jul 13 03:01:38.734202 ip-10-0-134-52 kubenswrapper[2558]: I0713 03:01:38.734151 2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-4p97d\" (UniqueName: \"kubernetes.io/projected/54a4fc9b-27ee-4012-9bac-589d5d00e235-kube-api-access-4p97d\") pod \"console-76bb9cd886-whw2t\" (UID: \"54a4fc9b-27ee-4012-9bac-589d5d00e235\") " pod="openshift-console/console-76bb9cd886-whw2t" Jul 13 03:01:38.835783 ip-10-0-134-52 kubenswrapper[2558]: I0713 03:01:38.835753 2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-76bb9cd886-whw2t" Jul 13 03:01:38.967501 ip-10-0-134-52 kubenswrapper[2558]: I0713 03:01:38.967477 2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-76bb9cd886-whw2t"] Jul 13 03:01:38.970114 ip-10-0-134-52 kubenswrapper[2558]: W0713 03:01:38.970093 2558 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod54a4fc9b_27ee_4012_9bac_589d5d00e235.slice/crio-40e1dcf6b94b469721ef1d97c73cc37ae577fef3b583902269ebdfe8f984961d WatchSource:0}: Error finding container 40e1dcf6b94b469721ef1d97c73cc37ae577fef3b583902269ebdfe8f984961d: Status 404 returned error can't find the container with id 40e1dcf6b94b469721ef1d97c73cc37ae577fef3b583902269ebdfe8f984961d Jul 13 03:01:39.059360 ip-10-0-134-52 kubenswrapper[2558]: I0713 03:01:39.059307 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-76bb9cd886-whw2t" event={"ID":"54a4fc9b-27ee-4012-9bac-589d5d00e235","Type":"ContainerStarted","Data":"7fa62d9a1ce46878fee758db36bc0f788c80a62f87ac55af0f9ce50a23c06e2c"} Jul 13 03:01:39.059686 ip-10-0-134-52 kubenswrapper[2558]: I0713 03:01:39.059382 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-76bb9cd886-whw2t" event={"ID":"54a4fc9b-27ee-4012-9bac-589d5d00e235","Type":"ContainerStarted","Data":"40e1dcf6b94b469721ef1d97c73cc37ae577fef3b583902269ebdfe8f984961d"} Jul 13 03:01:39.078349 ip-10-0-134-52 kubenswrapper[2558]: I0713 03:01:39.078275 2558 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console/console-76bb9cd886-whw2t" podStartSLOduration=1.078254715 podStartE2EDuration="1.078254715s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-13 03:01:38 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-13 03:01:39.077514577 +0000 UTC m=+281.478115043" watchObservedRunningTime="2026-07-13 03:01:39.078254715 +0000 UTC m=+281.478855182" Jul 13 03:01:40.565379 ip-10-0-134-52 kubenswrapper[2558]: I0713 03:01:40.565306 2558 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-image-registry/image-registry-57f887d685-pgx8m" podUID="20a99b49-0854-4214-bfb7-aab2b9ade3d8" containerName="registry" containerID="cri-o://f6fa6cfc97c6575643b48c3e4078642039c69207f35b84b9b71abad106a3a72c" gracePeriod=30 Jul 13 03:01:40.668588 ip-10-0-134-52 kubenswrapper[2558]: E0713 03:01:40.668558 2558 pod_workers.go:1324] "Error syncing pod, skipping" err="unmounted volumes=[metrics-tls], unattached volumes=[], failed to process volumes=[]: context deadline exceeded" pod="openshift-dns/dns-default-qkxhh" podUID="82341e74-e954-41d9-aac3-4e537551717a" Jul 13 03:01:40.800708 ip-10-0-134-52 kubenswrapper[2558]: I0713 03:01:40.800685 2558 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-57f887d685-pgx8m" Jul 13 03:01:40.944265 ip-10-0-134-52 kubenswrapper[2558]: I0713 03:01:40.944190 2558 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/20a99b49-0854-4214-bfb7-aab2b9ade3d8-image-registry-private-configuration\") pod \"20a99b49-0854-4214-bfb7-aab2b9ade3d8\" (UID: \"20a99b49-0854-4214-bfb7-aab2b9ade3d8\") " Jul 13 03:01:40.944265 ip-10-0-134-52 kubenswrapper[2558]: I0713 03:01:40.944226 2558 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/20a99b49-0854-4214-bfb7-aab2b9ade3d8-registry-certificates\") pod \"20a99b49-0854-4214-bfb7-aab2b9ade3d8\" (UID: \"20a99b49-0854-4214-bfb7-aab2b9ade3d8\") " Jul 13 03:01:40.944265 ip-10-0-134-52 kubenswrapper[2558]: I0713 03:01:40.944250 2558 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/20a99b49-0854-4214-bfb7-aab2b9ade3d8-registry-tls\") pod \"20a99b49-0854-4214-bfb7-aab2b9ade3d8\" (UID: \"20a99b49-0854-4214-bfb7-aab2b9ade3d8\") " Jul 13 03:01:40.944538 ip-10-0-134-52 kubenswrapper[2558]: I0713 03:01:40.944295 2558 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/20a99b49-0854-4214-bfb7-aab2b9ade3d8-bound-sa-token\") pod \"20a99b49-0854-4214-bfb7-aab2b9ade3d8\" (UID: \"20a99b49-0854-4214-bfb7-aab2b9ade3d8\") " Jul 13 03:01:40.944538 ip-10-0-134-52 kubenswrapper[2558]: I0713 03:01:40.944352 2558 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/20a99b49-0854-4214-bfb7-aab2b9ade3d8-ca-trust-extracted\") pod \"20a99b49-0854-4214-bfb7-aab2b9ade3d8\" (UID: \"20a99b49-0854-4214-bfb7-aab2b9ade3d8\") " Jul 13 03:01:40.944538 ip-10-0-134-52 kubenswrapper[2558]: I0713 03:01:40.944378 2558 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/20a99b49-0854-4214-bfb7-aab2b9ade3d8-trusted-ca\") pod \"20a99b49-0854-4214-bfb7-aab2b9ade3d8\" (UID: \"20a99b49-0854-4214-bfb7-aab2b9ade3d8\") " Jul 13 03:01:40.944538 ip-10-0-134-52 kubenswrapper[2558]: I0713 03:01:40.944409 2558 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-xhvkl\" (UniqueName: \"kubernetes.io/projected/20a99b49-0854-4214-bfb7-aab2b9ade3d8-kube-api-access-xhvkl\") pod \"20a99b49-0854-4214-bfb7-aab2b9ade3d8\" (UID: \"20a99b49-0854-4214-bfb7-aab2b9ade3d8\") " Jul 13 03:01:40.944538 ip-10-0-134-52 kubenswrapper[2558]: I0713 03:01:40.944443 2558 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/20a99b49-0854-4214-bfb7-aab2b9ade3d8-installation-pull-secrets\") pod \"20a99b49-0854-4214-bfb7-aab2b9ade3d8\" (UID: \"20a99b49-0854-4214-bfb7-aab2b9ade3d8\") " Jul 13 03:01:40.944819 ip-10-0-134-52 kubenswrapper[2558]: I0713 03:01:40.944789 2558 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/20a99b49-0854-4214-bfb7-aab2b9ade3d8-registry-certificates" (OuterVolumeSpecName: "registry-certificates") pod "20a99b49-0854-4214-bfb7-aab2b9ade3d8" (UID: "20a99b49-0854-4214-bfb7-aab2b9ade3d8"). InnerVolumeSpecName "registry-certificates". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 13 03:01:40.945274 ip-10-0-134-52 kubenswrapper[2558]: I0713 03:01:40.945244 2558 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/20a99b49-0854-4214-bfb7-aab2b9ade3d8-trusted-ca" (OuterVolumeSpecName: "trusted-ca") pod "20a99b49-0854-4214-bfb7-aab2b9ade3d8" (UID: "20a99b49-0854-4214-bfb7-aab2b9ade3d8"). InnerVolumeSpecName "trusted-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 13 03:01:40.947464 ip-10-0-134-52 kubenswrapper[2558]: I0713 03:01:40.947430 2558 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/20a99b49-0854-4214-bfb7-aab2b9ade3d8-image-registry-private-configuration" (OuterVolumeSpecName: "image-registry-private-configuration") pod "20a99b49-0854-4214-bfb7-aab2b9ade3d8" (UID: "20a99b49-0854-4214-bfb7-aab2b9ade3d8"). InnerVolumeSpecName "image-registry-private-configuration". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 13 03:01:40.947545 ip-10-0-134-52 kubenswrapper[2558]: I0713 03:01:40.947428 2558 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/20a99b49-0854-4214-bfb7-aab2b9ade3d8-kube-api-access-xhvkl" (OuterVolumeSpecName: "kube-api-access-xhvkl") pod "20a99b49-0854-4214-bfb7-aab2b9ade3d8" (UID: "20a99b49-0854-4214-bfb7-aab2b9ade3d8"). InnerVolumeSpecName "kube-api-access-xhvkl". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 13 03:01:40.947545 ip-10-0-134-52 kubenswrapper[2558]: I0713 03:01:40.947473 2558 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/20a99b49-0854-4214-bfb7-aab2b9ade3d8-registry-tls" (OuterVolumeSpecName: "registry-tls") pod "20a99b49-0854-4214-bfb7-aab2b9ade3d8" (UID: "20a99b49-0854-4214-bfb7-aab2b9ade3d8"). InnerVolumeSpecName "registry-tls". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 13 03:01:40.947545 ip-10-0-134-52 kubenswrapper[2558]: I0713 03:01:40.947478 2558 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/20a99b49-0854-4214-bfb7-aab2b9ade3d8-installation-pull-secrets" (OuterVolumeSpecName: "installation-pull-secrets") pod "20a99b49-0854-4214-bfb7-aab2b9ade3d8" (UID: "20a99b49-0854-4214-bfb7-aab2b9ade3d8"). InnerVolumeSpecName "installation-pull-secrets". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 13 03:01:40.947666 ip-10-0-134-52 kubenswrapper[2558]: I0713 03:01:40.947645 2558 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/20a99b49-0854-4214-bfb7-aab2b9ade3d8-bound-sa-token" (OuterVolumeSpecName: "bound-sa-token") pod "20a99b49-0854-4214-bfb7-aab2b9ade3d8" (UID: "20a99b49-0854-4214-bfb7-aab2b9ade3d8"). InnerVolumeSpecName "bound-sa-token". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 13 03:01:40.953286 ip-10-0-134-52 kubenswrapper[2558]: I0713 03:01:40.953263 2558 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/20a99b49-0854-4214-bfb7-aab2b9ade3d8-ca-trust-extracted" (OuterVolumeSpecName: "ca-trust-extracted") pod "20a99b49-0854-4214-bfb7-aab2b9ade3d8" (UID: "20a99b49-0854-4214-bfb7-aab2b9ade3d8"). InnerVolumeSpecName "ca-trust-extracted". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 13 03:01:41.045177 ip-10-0-134-52 kubenswrapper[2558]: I0713 03:01:41.045152 2558 reconciler_common.go:299] "Volume detached for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/20a99b49-0854-4214-bfb7-aab2b9ade3d8-ca-trust-extracted\") on node \"ip-10-0-134-52.ec2.internal\" DevicePath \"\"" Jul 13 03:01:41.045177 ip-10-0-134-52 kubenswrapper[2558]: I0713 03:01:41.045173 2558 reconciler_common.go:299] "Volume detached for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/20a99b49-0854-4214-bfb7-aab2b9ade3d8-trusted-ca\") on node \"ip-10-0-134-52.ec2.internal\" DevicePath \"\"" Jul 13 03:01:41.045288 ip-10-0-134-52 kubenswrapper[2558]: I0713 03:01:41.045183 2558 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-xhvkl\" (UniqueName: \"kubernetes.io/projected/20a99b49-0854-4214-bfb7-aab2b9ade3d8-kube-api-access-xhvkl\") on node \"ip-10-0-134-52.ec2.internal\" DevicePath \"\"" Jul 13 03:01:41.045288 ip-10-0-134-52 kubenswrapper[2558]: I0713 03:01:41.045192 2558 reconciler_common.go:299] "Volume detached for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/20a99b49-0854-4214-bfb7-aab2b9ade3d8-installation-pull-secrets\") on node \"ip-10-0-134-52.ec2.internal\" DevicePath \"\"" Jul 13 03:01:41.045288 ip-10-0-134-52 kubenswrapper[2558]: I0713 03:01:41.045200 2558 reconciler_common.go:299] "Volume detached for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/20a99b49-0854-4214-bfb7-aab2b9ade3d8-image-registry-private-configuration\") on node \"ip-10-0-134-52.ec2.internal\" DevicePath \"\"" Jul 13 03:01:41.045288 ip-10-0-134-52 kubenswrapper[2558]: I0713 03:01:41.045208 2558 reconciler_common.go:299] "Volume detached for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/20a99b49-0854-4214-bfb7-aab2b9ade3d8-registry-certificates\") on node \"ip-10-0-134-52.ec2.internal\" DevicePath \"\"" Jul 13 03:01:41.045288 ip-10-0-134-52 kubenswrapper[2558]: I0713 03:01:41.045217 2558 reconciler_common.go:299] "Volume detached for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/20a99b49-0854-4214-bfb7-aab2b9ade3d8-registry-tls\") on node \"ip-10-0-134-52.ec2.internal\" DevicePath \"\"" Jul 13 03:01:41.045288 ip-10-0-134-52 kubenswrapper[2558]: I0713 03:01:41.045225 2558 reconciler_common.go:299] "Volume detached for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/20a99b49-0854-4214-bfb7-aab2b9ade3d8-bound-sa-token\") on node \"ip-10-0-134-52.ec2.internal\" DevicePath \"\"" Jul 13 03:01:41.068036 ip-10-0-134-52 kubenswrapper[2558]: I0713 03:01:41.068008 2558 generic.go:356] "Generic (PLEG): container finished" podID="20a99b49-0854-4214-bfb7-aab2b9ade3d8" containerID="f6fa6cfc97c6575643b48c3e4078642039c69207f35b84b9b71abad106a3a72c" exitCode=0 Jul 13 03:01:41.068119 ip-10-0-134-52 kubenswrapper[2558]: I0713 03:01:41.068051 2558 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-57f887d685-pgx8m" Jul 13 03:01:41.068119 ip-10-0-134-52 kubenswrapper[2558]: I0713 03:01:41.068096 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-57f887d685-pgx8m" event={"ID":"20a99b49-0854-4214-bfb7-aab2b9ade3d8","Type":"ContainerDied","Data":"f6fa6cfc97c6575643b48c3e4078642039c69207f35b84b9b71abad106a3a72c"} Jul 13 03:01:41.068207 ip-10-0-134-52 kubenswrapper[2558]: I0713 03:01:41.068142 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-57f887d685-pgx8m" event={"ID":"20a99b49-0854-4214-bfb7-aab2b9ade3d8","Type":"ContainerDied","Data":"11e84645ff4e3640f56a97acf0be8b852ebba5ba2434f3500be7940304085077"} Jul 13 03:01:41.068308 ip-10-0-134-52 kubenswrapper[2558]: I0713 03:01:41.068294 2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-qkxhh" Jul 13 03:01:41.069131 ip-10-0-134-52 kubenswrapper[2558]: I0713 03:01:41.069112 2558 scope.go:117] "RemoveContainer" containerID="f6fa6cfc97c6575643b48c3e4078642039c69207f35b84b9b71abad106a3a72c" Jul 13 03:01:41.077775 ip-10-0-134-52 kubenswrapper[2558]: I0713 03:01:41.077760 2558 scope.go:117] "RemoveContainer" containerID="f6fa6cfc97c6575643b48c3e4078642039c69207f35b84b9b71abad106a3a72c" Jul 13 03:01:41.077978 ip-10-0-134-52 kubenswrapper[2558]: E0713 03:01:41.077962 2558 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"f6fa6cfc97c6575643b48c3e4078642039c69207f35b84b9b71abad106a3a72c\": container with ID starting with f6fa6cfc97c6575643b48c3e4078642039c69207f35b84b9b71abad106a3a72c not found: ID does not exist" containerID="f6fa6cfc97c6575643b48c3e4078642039c69207f35b84b9b71abad106a3a72c" Jul 13 03:01:41.078027 ip-10-0-134-52 kubenswrapper[2558]: I0713 03:01:41.077984 2558 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"f6fa6cfc97c6575643b48c3e4078642039c69207f35b84b9b71abad106a3a72c"} err="failed to get container status \"f6fa6cfc97c6575643b48c3e4078642039c69207f35b84b9b71abad106a3a72c\": rpc error: code = NotFound desc = could not find container \"f6fa6cfc97c6575643b48c3e4078642039c69207f35b84b9b71abad106a3a72c\": container with ID starting with f6fa6cfc97c6575643b48c3e4078642039c69207f35b84b9b71abad106a3a72c not found: ID does not exist" Jul 13 03:01:41.095989 ip-10-0-134-52 kubenswrapper[2558]: I0713 03:01:41.095959 2558 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-image-registry/image-registry-57f887d685-pgx8m"] Jul 13 03:01:41.103586 ip-10-0-134-52 kubenswrapper[2558]: I0713 03:01:41.103565 2558 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-image-registry/image-registry-57f887d685-pgx8m"] Jul 13 03:01:42.092216 ip-10-0-134-52 kubenswrapper[2558]: I0713 03:01:42.092180 2558 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="20a99b49-0854-4214-bfb7-aab2b9ade3d8" path="/var/lib/kubelet/pods/20a99b49-0854-4214-bfb7-aab2b9ade3d8/volumes" Jul 13 03:01:43.341936 ip-10-0-134-52 kubenswrapper[2558]: I0713 03:01:43.341903 2558 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/console-5fcbfb6964-qr9l7" Jul 13 03:01:44.576199 ip-10-0-134-52 kubenswrapper[2558]: I0713 03:01:44.576168 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/82341e74-e954-41d9-aac3-4e537551717a-metrics-tls\") pod \"dns-default-qkxhh\" (UID: \"82341e74-e954-41d9-aac3-4e537551717a\") " pod="openshift-dns/dns-default-qkxhh" Jul 13 03:01:44.578525 ip-10-0-134-52 kubenswrapper[2558]: I0713 03:01:44.578508 2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/82341e74-e954-41d9-aac3-4e537551717a-metrics-tls\") pod \"dns-default-qkxhh\" (UID: \"82341e74-e954-41d9-aac3-4e537551717a\") " pod="openshift-dns/dns-default-qkxhh" Jul 13 03:01:44.672213 ip-10-0-134-52 kubenswrapper[2558]: I0713 03:01:44.672191 2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-dockercfg-vw8zn\"" Jul 13 03:01:44.679660 ip-10-0-134-52 kubenswrapper[2558]: I0713 03:01:44.679636 2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-qkxhh" Jul 13 03:01:44.806408 ip-10-0-134-52 kubenswrapper[2558]: I0713 03:01:44.806386 2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-dns/dns-default-qkxhh"] Jul 13 03:01:44.808724 ip-10-0-134-52 kubenswrapper[2558]: W0713 03:01:44.808697 2558 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod82341e74_e954_41d9_aac3_4e537551717a.slice/crio-aaf41ec7264b23efe8466285a408f9900fc6cac3705a8cc37ceb503465748203 WatchSource:0}: Error finding container aaf41ec7264b23efe8466285a408f9900fc6cac3705a8cc37ceb503465748203: Status 404 returned error can't find the container with id aaf41ec7264b23efe8466285a408f9900fc6cac3705a8cc37ceb503465748203 Jul 13 03:01:45.090792 ip-10-0-134-52 kubenswrapper[2558]: I0713 03:01:45.090761 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-qkxhh" event={"ID":"82341e74-e954-41d9-aac3-4e537551717a","Type":"ContainerStarted","Data":"aaf41ec7264b23efe8466285a408f9900fc6cac3705a8cc37ceb503465748203"} Jul 13 03:01:47.101285 ip-10-0-134-52 kubenswrapper[2558]: I0713 03:01:47.101252 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-qkxhh" event={"ID":"82341e74-e954-41d9-aac3-4e537551717a","Type":"ContainerStarted","Data":"6894ff23ef964f4f66420e9a2bd326362d2e938c240fbd07887ade3b75947e41"} Jul 13 03:01:47.101571 ip-10-0-134-52 kubenswrapper[2558]: I0713 03:01:47.101305 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-qkxhh" event={"ID":"82341e74-e954-41d9-aac3-4e537551717a","Type":"ContainerStarted","Data":"f48d33acb3860e9dcbad45d91c0290d6ce10b4efc39128cea8d0155c21127245"} Jul 13 03:01:48.104826 ip-10-0-134-52 kubenswrapper[2558]: I0713 03:01:48.104794 2558 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-dns/dns-default-qkxhh" Jul 13 03:01:48.139101 ip-10-0-134-52 kubenswrapper[2558]: I0713 03:01:48.139059 2558 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-dns/dns-default-qkxhh" podStartSLOduration=252.12435238 podStartE2EDuration="4m14.139043356s" totalImagesPullingTime="2.014690976s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-13 02:57:34 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-13 03:01:48.138969871 +0000 UTC m=+290.539570336" watchObservedRunningTime="2026-07-13 03:01:48.139043356 +0000 UTC m=+290.539643816" Jul 13 03:01:48.836552 ip-10-0-134-52 kubenswrapper[2558]: I0713 03:01:48.836518 2558 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/console-76bb9cd886-whw2t" Jul 13 03:01:48.836803 ip-10-0-134-52 kubenswrapper[2558]: I0713 03:01:48.836781 2558 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-console/console-76bb9cd886-whw2t" Jul 13 03:01:48.841185 ip-10-0-134-52 kubenswrapper[2558]: I0713 03:01:48.841166 2558 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-console/console-76bb9cd886-whw2t" Jul 13 03:01:49.111878 ip-10-0-134-52 kubenswrapper[2558]: I0713 03:01:49.111807 2558 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console/console-76bb9cd886-whw2t" Jul 13 03:01:49.185126 ip-10-0-134-52 kubenswrapper[2558]: I0713 03:01:49.185097 2558 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-6d6476497b-j24jp"] Jul 13 03:01:57.949164 ip-10-0-134-52 kubenswrapper[2558]: I0713 03:01:57.949142 2558 kubelet.go:1648] "Image garbage collection succeeded" Jul 13 03:01:58.110778 ip-10-0-134-52 kubenswrapper[2558]: I0713 03:01:58.110672 2558 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-dns/dns-default-qkxhh" Jul 13 03:02:02.157129 ip-10-0-134-52 kubenswrapper[2558]: I0713 03:02:02.157048 2558 generic.go:356] "Generic (PLEG): container finished" podID="88ac8e6e-8f83-4e52-a83a-50e24965359e" containerID="c6152609803d328c0fef85559cf8df4753fd110e32c1875246ab6ee56cbffc9c" exitCode=0 Jul 13 03:02:02.157482 ip-10-0-134-52 kubenswrapper[2558]: I0713 03:02:02.157122 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-service-ca-operator/service-ca-operator-7695fc6c8c-h9xnt" event={"ID":"88ac8e6e-8f83-4e52-a83a-50e24965359e","Type":"ContainerDied","Data":"c6152609803d328c0fef85559cf8df4753fd110e32c1875246ab6ee56cbffc9c"} Jul 13 03:02:02.157482 ip-10-0-134-52 kubenswrapper[2558]: I0713 03:02:02.157448 2558 scope.go:117] "RemoveContainer" containerID="c6152609803d328c0fef85559cf8df4753fd110e32c1875246ab6ee56cbffc9c" Jul 13 03:02:03.162852 ip-10-0-134-52 kubenswrapper[2558]: I0713 03:02:03.162815 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-service-ca-operator/service-ca-operator-7695fc6c8c-h9xnt" event={"ID":"88ac8e6e-8f83-4e52-a83a-50e24965359e","Type":"ContainerStarted","Data":"189b2adb4f4f5ceef0c7a5cff7f9f399205dfabab8c6e6caa0626fabea753045"} Jul 13 03:02:03.502734 ip-10-0-134-52 kubenswrapper[2558]: I0713 03:02:03.502651 2558 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-console/console-5fcbfb6964-qr9l7" podUID="07484034-3cb0-46f9-84f5-2ebec2e95044" containerName="console" containerID="cri-o://24be0428d638df61120ad7448953916eea6d45c9a138618673c33fb730e1ea63" gracePeriod=15 Jul 13 03:02:03.754597 ip-10-0-134-52 kubenswrapper[2558]: I0713 03:02:03.754544 2558 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-5fcbfb6964-qr9l7" Jul 13 03:02:03.816140 ip-10-0-134-52 kubenswrapper[2558]: I0713 03:02:03.816113 2558 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/07484034-3cb0-46f9-84f5-2ebec2e95044-service-ca\") pod \"07484034-3cb0-46f9-84f5-2ebec2e95044\" (UID: \"07484034-3cb0-46f9-84f5-2ebec2e95044\") " Jul 13 03:02:03.816140 ip-10-0-134-52 kubenswrapper[2558]: I0713 03:02:03.816144 2558 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/07484034-3cb0-46f9-84f5-2ebec2e95044-console-oauth-config\") pod \"07484034-3cb0-46f9-84f5-2ebec2e95044\" (UID: \"07484034-3cb0-46f9-84f5-2ebec2e95044\") " Jul 13 03:02:03.816323 ip-10-0-134-52 kubenswrapper[2558]: I0713 03:02:03.816170 2558 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/07484034-3cb0-46f9-84f5-2ebec2e95044-console-config\") pod \"07484034-3cb0-46f9-84f5-2ebec2e95044\" (UID: \"07484034-3cb0-46f9-84f5-2ebec2e95044\") " Jul 13 03:02:03.816323 ip-10-0-134-52 kubenswrapper[2558]: I0713 03:02:03.816208 2558 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/07484034-3cb0-46f9-84f5-2ebec2e95044-console-serving-cert\") pod \"07484034-3cb0-46f9-84f5-2ebec2e95044\" (UID: \"07484034-3cb0-46f9-84f5-2ebec2e95044\") " Jul 13 03:02:03.816323 ip-10-0-134-52 kubenswrapper[2558]: I0713 03:02:03.816233 2558 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-ncgks\" (UniqueName: \"kubernetes.io/projected/07484034-3cb0-46f9-84f5-2ebec2e95044-kube-api-access-ncgks\") pod \"07484034-3cb0-46f9-84f5-2ebec2e95044\" (UID: \"07484034-3cb0-46f9-84f5-2ebec2e95044\") " Jul 13 03:02:03.816323 ip-10-0-134-52 kubenswrapper[2558]: I0713 03:02:03.816258 2558 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/07484034-3cb0-46f9-84f5-2ebec2e95044-oauth-serving-cert\") pod \"07484034-3cb0-46f9-84f5-2ebec2e95044\" (UID: \"07484034-3cb0-46f9-84f5-2ebec2e95044\") " Jul 13 03:02:03.816323 ip-10-0-134-52 kubenswrapper[2558]: I0713 03:02:03.816309 2558 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/07484034-3cb0-46f9-84f5-2ebec2e95044-trusted-ca-bundle\") pod \"07484034-3cb0-46f9-84f5-2ebec2e95044\" (UID: \"07484034-3cb0-46f9-84f5-2ebec2e95044\") " Jul 13 03:02:03.816617 ip-10-0-134-52 kubenswrapper[2558]: I0713 03:02:03.816591 2558 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/07484034-3cb0-46f9-84f5-2ebec2e95044-console-config" (OuterVolumeSpecName: "console-config") pod "07484034-3cb0-46f9-84f5-2ebec2e95044" (UID: "07484034-3cb0-46f9-84f5-2ebec2e95044"). InnerVolumeSpecName "console-config". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 13 03:02:03.816617 ip-10-0-134-52 kubenswrapper[2558]: I0713 03:02:03.816598 2558 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/07484034-3cb0-46f9-84f5-2ebec2e95044-service-ca" (OuterVolumeSpecName: "service-ca") pod "07484034-3cb0-46f9-84f5-2ebec2e95044" (UID: "07484034-3cb0-46f9-84f5-2ebec2e95044"). InnerVolumeSpecName "service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 13 03:02:03.816836 ip-10-0-134-52 kubenswrapper[2558]: I0713 03:02:03.816818 2558 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/07484034-3cb0-46f9-84f5-2ebec2e95044-trusted-ca-bundle" (OuterVolumeSpecName: "trusted-ca-bundle") pod "07484034-3cb0-46f9-84f5-2ebec2e95044" (UID: "07484034-3cb0-46f9-84f5-2ebec2e95044"). InnerVolumeSpecName "trusted-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 13 03:02:03.817168 ip-10-0-134-52 kubenswrapper[2558]: I0713 03:02:03.817142 2558 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/07484034-3cb0-46f9-84f5-2ebec2e95044-oauth-serving-cert" (OuterVolumeSpecName: "oauth-serving-cert") pod "07484034-3cb0-46f9-84f5-2ebec2e95044" (UID: "07484034-3cb0-46f9-84f5-2ebec2e95044"). InnerVolumeSpecName "oauth-serving-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 13 03:02:03.818522 ip-10-0-134-52 kubenswrapper[2558]: I0713 03:02:03.818501 2558 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/07484034-3cb0-46f9-84f5-2ebec2e95044-console-oauth-config" (OuterVolumeSpecName: "console-oauth-config") pod "07484034-3cb0-46f9-84f5-2ebec2e95044" (UID: "07484034-3cb0-46f9-84f5-2ebec2e95044"). InnerVolumeSpecName "console-oauth-config". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 13 03:02:03.818651 ip-10-0-134-52 kubenswrapper[2558]: I0713 03:02:03.818634 2558 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/07484034-3cb0-46f9-84f5-2ebec2e95044-console-serving-cert" (OuterVolumeSpecName: "console-serving-cert") pod "07484034-3cb0-46f9-84f5-2ebec2e95044" (UID: "07484034-3cb0-46f9-84f5-2ebec2e95044"). InnerVolumeSpecName "console-serving-cert". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 13 03:02:03.818776 ip-10-0-134-52 kubenswrapper[2558]: I0713 03:02:03.818760 2558 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/07484034-3cb0-46f9-84f5-2ebec2e95044-kube-api-access-ncgks" (OuterVolumeSpecName: "kube-api-access-ncgks") pod "07484034-3cb0-46f9-84f5-2ebec2e95044" (UID: "07484034-3cb0-46f9-84f5-2ebec2e95044"). InnerVolumeSpecName "kube-api-access-ncgks". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 13 03:02:03.917873 ip-10-0-134-52 kubenswrapper[2558]: I0713 03:02:03.917847 2558 reconciler_common.go:299] "Volume detached for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/07484034-3cb0-46f9-84f5-2ebec2e95044-console-serving-cert\") on node \"ip-10-0-134-52.ec2.internal\" DevicePath \"\"" Jul 13 03:02:03.917967 ip-10-0-134-52 kubenswrapper[2558]: I0713 03:02:03.917875 2558 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-ncgks\" (UniqueName: \"kubernetes.io/projected/07484034-3cb0-46f9-84f5-2ebec2e95044-kube-api-access-ncgks\") on node \"ip-10-0-134-52.ec2.internal\" DevicePath \"\"" Jul 13 03:02:03.917967 ip-10-0-134-52 kubenswrapper[2558]: I0713 03:02:03.917889 2558 reconciler_common.go:299] "Volume detached for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/07484034-3cb0-46f9-84f5-2ebec2e95044-oauth-serving-cert\") on node \"ip-10-0-134-52.ec2.internal\" DevicePath \"\"" Jul 13 03:02:03.917967 ip-10-0-134-52 kubenswrapper[2558]: I0713 03:02:03.917903 2558 reconciler_common.go:299] "Volume detached for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/07484034-3cb0-46f9-84f5-2ebec2e95044-trusted-ca-bundle\") on node \"ip-10-0-134-52.ec2.internal\" DevicePath \"\"" Jul 13 03:02:03.917967 ip-10-0-134-52 kubenswrapper[2558]: I0713 03:02:03.917916 2558 reconciler_common.go:299] "Volume detached for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/07484034-3cb0-46f9-84f5-2ebec2e95044-service-ca\") on node \"ip-10-0-134-52.ec2.internal\" DevicePath \"\"" Jul 13 03:02:03.917967 ip-10-0-134-52 kubenswrapper[2558]: I0713 03:02:03.917928 2558 reconciler_common.go:299] "Volume detached for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/07484034-3cb0-46f9-84f5-2ebec2e95044-console-oauth-config\") on node \"ip-10-0-134-52.ec2.internal\" DevicePath \"\"" Jul 13 03:02:03.917967 ip-10-0-134-52 kubenswrapper[2558]: I0713 03:02:03.917940 2558 reconciler_common.go:299] "Volume detached for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/07484034-3cb0-46f9-84f5-2ebec2e95044-console-config\") on node \"ip-10-0-134-52.ec2.internal\" DevicePath \"\"" Jul 13 03:02:04.167573 ip-10-0-134-52 kubenswrapper[2558]: I0713 03:02:04.167546 2558 generic.go:356] "Generic (PLEG): container finished" podID="07484034-3cb0-46f9-84f5-2ebec2e95044" containerID="24be0428d638df61120ad7448953916eea6d45c9a138618673c33fb730e1ea63" exitCode=0 Jul 13 03:02:04.167875 ip-10-0-134-52 kubenswrapper[2558]: I0713 03:02:04.167592 2558 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-5fcbfb6964-qr9l7" Jul 13 03:02:04.167875 ip-10-0-134-52 kubenswrapper[2558]: I0713 03:02:04.167616 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-5fcbfb6964-qr9l7" event={"ID":"07484034-3cb0-46f9-84f5-2ebec2e95044","Type":"ContainerDied","Data":"24be0428d638df61120ad7448953916eea6d45c9a138618673c33fb730e1ea63"} Jul 13 03:02:04.167875 ip-10-0-134-52 kubenswrapper[2558]: I0713 03:02:04.167651 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-5fcbfb6964-qr9l7" event={"ID":"07484034-3cb0-46f9-84f5-2ebec2e95044","Type":"ContainerDied","Data":"4f95467fef5b5b2901028ac5c9a4eebc157c3167c0ef8210a1f2e7aaf7821ce4"} Jul 13 03:02:04.167875 ip-10-0-134-52 kubenswrapper[2558]: I0713 03:02:04.167672 2558 scope.go:117] "RemoveContainer" containerID="24be0428d638df61120ad7448953916eea6d45c9a138618673c33fb730e1ea63" Jul 13 03:02:04.179137 ip-10-0-134-52 kubenswrapper[2558]: I0713 03:02:04.179118 2558 scope.go:117] "RemoveContainer" containerID="24be0428d638df61120ad7448953916eea6d45c9a138618673c33fb730e1ea63" Jul 13 03:02:04.179423 ip-10-0-134-52 kubenswrapper[2558]: E0713 03:02:04.179401 2558 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"24be0428d638df61120ad7448953916eea6d45c9a138618673c33fb730e1ea63\": container with ID starting with 24be0428d638df61120ad7448953916eea6d45c9a138618673c33fb730e1ea63 not found: ID does not exist" containerID="24be0428d638df61120ad7448953916eea6d45c9a138618673c33fb730e1ea63" Jul 13 03:02:04.179518 ip-10-0-134-52 kubenswrapper[2558]: I0713 03:02:04.179429 2558 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"24be0428d638df61120ad7448953916eea6d45c9a138618673c33fb730e1ea63"} err="failed to get container status \"24be0428d638df61120ad7448953916eea6d45c9a138618673c33fb730e1ea63\": rpc error: code = NotFound desc = could not find container \"24be0428d638df61120ad7448953916eea6d45c9a138618673c33fb730e1ea63\": container with ID starting with 24be0428d638df61120ad7448953916eea6d45c9a138618673c33fb730e1ea63 not found: ID does not exist" Jul 13 03:02:04.185535 ip-10-0-134-52 kubenswrapper[2558]: I0713 03:02:04.185515 2558 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-5fcbfb6964-qr9l7"] Jul 13 03:02:04.188792 ip-10-0-134-52 kubenswrapper[2558]: I0713 03:02:04.188772 2558 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-console/console-5fcbfb6964-qr9l7"] Jul 13 03:02:06.091582 ip-10-0-134-52 kubenswrapper[2558]: I0713 03:02:06.091544 2558 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="07484034-3cb0-46f9-84f5-2ebec2e95044" path="/var/lib/kubelet/pods/07484034-3cb0-46f9-84f5-2ebec2e95044/volumes" Jul 13 03:02:14.210646 ip-10-0-134-52 kubenswrapper[2558]: I0713 03:02:14.210609 2558 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-console/console-6d6476497b-j24jp" podUID="2a4da825-3dbe-42c9-a325-e6ddcdab810c" containerName="console" containerID="cri-o://483191d976d5fdc2af2ef70b11f8c3fc40c914ba50a98f78a02999858eed0d2b" gracePeriod=15 Jul 13 03:02:14.453429 ip-10-0-134-52 kubenswrapper[2558]: I0713 03:02:14.453408 2558 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-6d6476497b-j24jp" Jul 13 03:02:14.489866 ip-10-0-134-52 kubenswrapper[2558]: I0713 03:02:14.489809 2558 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/2a4da825-3dbe-42c9-a325-e6ddcdab810c-console-serving-cert\") pod \"2a4da825-3dbe-42c9-a325-e6ddcdab810c\" (UID: \"2a4da825-3dbe-42c9-a325-e6ddcdab810c\") " Jul 13 03:02:14.489866 ip-10-0-134-52 kubenswrapper[2558]: I0713 03:02:14.489846 2558 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/2a4da825-3dbe-42c9-a325-e6ddcdab810c-oauth-serving-cert\") pod \"2a4da825-3dbe-42c9-a325-e6ddcdab810c\" (UID: \"2a4da825-3dbe-42c9-a325-e6ddcdab810c\") " Jul 13 03:02:14.490049 ip-10-0-134-52 kubenswrapper[2558]: I0713 03:02:14.489885 2558 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/2a4da825-3dbe-42c9-a325-e6ddcdab810c-console-config\") pod \"2a4da825-3dbe-42c9-a325-e6ddcdab810c\" (UID: \"2a4da825-3dbe-42c9-a325-e6ddcdab810c\") " Jul 13 03:02:14.490049 ip-10-0-134-52 kubenswrapper[2558]: I0713 03:02:14.489982 2558 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-c94jn\" (UniqueName: \"kubernetes.io/projected/2a4da825-3dbe-42c9-a325-e6ddcdab810c-kube-api-access-c94jn\") pod \"2a4da825-3dbe-42c9-a325-e6ddcdab810c\" (UID: \"2a4da825-3dbe-42c9-a325-e6ddcdab810c\") " Jul 13 03:02:14.490049 ip-10-0-134-52 kubenswrapper[2558]: I0713 03:02:14.490014 2558 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/2a4da825-3dbe-42c9-a325-e6ddcdab810c-service-ca\") pod \"2a4da825-3dbe-42c9-a325-e6ddcdab810c\" (UID: \"2a4da825-3dbe-42c9-a325-e6ddcdab810c\") " Jul 13 03:02:14.490049 ip-10-0-134-52 kubenswrapper[2558]: I0713 03:02:14.490035 2558 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/2a4da825-3dbe-42c9-a325-e6ddcdab810c-console-oauth-config\") pod \"2a4da825-3dbe-42c9-a325-e6ddcdab810c\" (UID: \"2a4da825-3dbe-42c9-a325-e6ddcdab810c\") " Jul 13 03:02:14.490360 ip-10-0-134-52 kubenswrapper[2558]: I0713 03:02:14.490314 2558 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/2a4da825-3dbe-42c9-a325-e6ddcdab810c-console-config" (OuterVolumeSpecName: "console-config") pod "2a4da825-3dbe-42c9-a325-e6ddcdab810c" (UID: "2a4da825-3dbe-42c9-a325-e6ddcdab810c"). InnerVolumeSpecName "console-config". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 13 03:02:14.490439 ip-10-0-134-52 kubenswrapper[2558]: I0713 03:02:14.490353 2558 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/2a4da825-3dbe-42c9-a325-e6ddcdab810c-oauth-serving-cert" (OuterVolumeSpecName: "oauth-serving-cert") pod "2a4da825-3dbe-42c9-a325-e6ddcdab810c" (UID: "2a4da825-3dbe-42c9-a325-e6ddcdab810c"). InnerVolumeSpecName "oauth-serving-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 13 03:02:14.490585 ip-10-0-134-52 kubenswrapper[2558]: I0713 03:02:14.490464 2558 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/2a4da825-3dbe-42c9-a325-e6ddcdab810c-service-ca" (OuterVolumeSpecName: "service-ca") pod "2a4da825-3dbe-42c9-a325-e6ddcdab810c" (UID: "2a4da825-3dbe-42c9-a325-e6ddcdab810c"). InnerVolumeSpecName "service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 13 03:02:14.491997 ip-10-0-134-52 kubenswrapper[2558]: I0713 03:02:14.491971 2558 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/2a4da825-3dbe-42c9-a325-e6ddcdab810c-console-serving-cert" (OuterVolumeSpecName: "console-serving-cert") pod "2a4da825-3dbe-42c9-a325-e6ddcdab810c" (UID: "2a4da825-3dbe-42c9-a325-e6ddcdab810c"). InnerVolumeSpecName "console-serving-cert". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 13 03:02:14.492104 ip-10-0-134-52 kubenswrapper[2558]: I0713 03:02:14.492087 2558 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/2a4da825-3dbe-42c9-a325-e6ddcdab810c-kube-api-access-c94jn" (OuterVolumeSpecName: "kube-api-access-c94jn") pod "2a4da825-3dbe-42c9-a325-e6ddcdab810c" (UID: "2a4da825-3dbe-42c9-a325-e6ddcdab810c"). InnerVolumeSpecName "kube-api-access-c94jn". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 13 03:02:14.492205 ip-10-0-134-52 kubenswrapper[2558]: I0713 03:02:14.492189 2558 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/2a4da825-3dbe-42c9-a325-e6ddcdab810c-console-oauth-config" (OuterVolumeSpecName: "console-oauth-config") pod "2a4da825-3dbe-42c9-a325-e6ddcdab810c" (UID: "2a4da825-3dbe-42c9-a325-e6ddcdab810c"). InnerVolumeSpecName "console-oauth-config". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 13 03:02:14.591216 ip-10-0-134-52 kubenswrapper[2558]: I0713 03:02:14.591181 2558 reconciler_common.go:299] "Volume detached for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/2a4da825-3dbe-42c9-a325-e6ddcdab810c-console-serving-cert\") on node \"ip-10-0-134-52.ec2.internal\" DevicePath \"\"" Jul 13 03:02:14.591216 ip-10-0-134-52 kubenswrapper[2558]: I0713 03:02:14.591214 2558 reconciler_common.go:299] "Volume detached for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/2a4da825-3dbe-42c9-a325-e6ddcdab810c-oauth-serving-cert\") on node \"ip-10-0-134-52.ec2.internal\" DevicePath \"\"" Jul 13 03:02:14.591216 ip-10-0-134-52 kubenswrapper[2558]: I0713 03:02:14.591223 2558 reconciler_common.go:299] "Volume detached for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/2a4da825-3dbe-42c9-a325-e6ddcdab810c-console-config\") on node \"ip-10-0-134-52.ec2.internal\" DevicePath \"\"" Jul 13 03:02:14.591399 ip-10-0-134-52 kubenswrapper[2558]: I0713 03:02:14.591231 2558 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-c94jn\" (UniqueName: \"kubernetes.io/projected/2a4da825-3dbe-42c9-a325-e6ddcdab810c-kube-api-access-c94jn\") on node \"ip-10-0-134-52.ec2.internal\" DevicePath \"\"" Jul 13 03:02:14.591399 ip-10-0-134-52 kubenswrapper[2558]: I0713 03:02:14.591240 2558 reconciler_common.go:299] "Volume detached for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/2a4da825-3dbe-42c9-a325-e6ddcdab810c-service-ca\") on node \"ip-10-0-134-52.ec2.internal\" DevicePath \"\"" Jul 13 03:02:14.591399 ip-10-0-134-52 kubenswrapper[2558]: I0713 03:02:14.591248 2558 reconciler_common.go:299] "Volume detached for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/2a4da825-3dbe-42c9-a325-e6ddcdab810c-console-oauth-config\") on node \"ip-10-0-134-52.ec2.internal\" DevicePath \"\"" Jul 13 03:02:15.210116 ip-10-0-134-52 kubenswrapper[2558]: I0713 03:02:15.210084 2558 generic.go:356] "Generic (PLEG): container finished" podID="2a4da825-3dbe-42c9-a325-e6ddcdab810c" containerID="483191d976d5fdc2af2ef70b11f8c3fc40c914ba50a98f78a02999858eed0d2b" exitCode=0 Jul 13 03:02:15.210281 ip-10-0-134-52 kubenswrapper[2558]: I0713 03:02:15.210125 2558 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-6d6476497b-j24jp" Jul 13 03:02:15.210281 ip-10-0-134-52 kubenswrapper[2558]: I0713 03:02:15.210126 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-6d6476497b-j24jp" event={"ID":"2a4da825-3dbe-42c9-a325-e6ddcdab810c","Type":"ContainerDied","Data":"483191d976d5fdc2af2ef70b11f8c3fc40c914ba50a98f78a02999858eed0d2b"} Jul 13 03:02:15.210281 ip-10-0-134-52 kubenswrapper[2558]: I0713 03:02:15.210267 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-6d6476497b-j24jp" event={"ID":"2a4da825-3dbe-42c9-a325-e6ddcdab810c","Type":"ContainerDied","Data":"51537449dc8a0d0a5178cf01a7d4eb46f2c98b012c0d78454c383f1c996f37ea"} Jul 13 03:02:15.210477 ip-10-0-134-52 kubenswrapper[2558]: I0713 03:02:15.210302 2558 scope.go:117] "RemoveContainer" containerID="483191d976d5fdc2af2ef70b11f8c3fc40c914ba50a98f78a02999858eed0d2b" Jul 13 03:02:15.222218 ip-10-0-134-52 kubenswrapper[2558]: I0713 03:02:15.222199 2558 scope.go:117] "RemoveContainer" containerID="483191d976d5fdc2af2ef70b11f8c3fc40c914ba50a98f78a02999858eed0d2b" Jul 13 03:02:15.222481 ip-10-0-134-52 kubenswrapper[2558]: E0713 03:02:15.222462 2558 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"483191d976d5fdc2af2ef70b11f8c3fc40c914ba50a98f78a02999858eed0d2b\": container with ID starting with 483191d976d5fdc2af2ef70b11f8c3fc40c914ba50a98f78a02999858eed0d2b not found: ID does not exist" containerID="483191d976d5fdc2af2ef70b11f8c3fc40c914ba50a98f78a02999858eed0d2b" Jul 13 03:02:15.222525 ip-10-0-134-52 kubenswrapper[2558]: I0713 03:02:15.222489 2558 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"483191d976d5fdc2af2ef70b11f8c3fc40c914ba50a98f78a02999858eed0d2b"} err="failed to get container status \"483191d976d5fdc2af2ef70b11f8c3fc40c914ba50a98f78a02999858eed0d2b\": rpc error: code = NotFound desc = could not find container \"483191d976d5fdc2af2ef70b11f8c3fc40c914ba50a98f78a02999858eed0d2b\": container with ID starting with 483191d976d5fdc2af2ef70b11f8c3fc40c914ba50a98f78a02999858eed0d2b not found: ID does not exist" Jul 13 03:02:15.233508 ip-10-0-134-52 kubenswrapper[2558]: I0713 03:02:15.233487 2558 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-6d6476497b-j24jp"] Jul 13 03:02:15.238996 ip-10-0-134-52 kubenswrapper[2558]: I0713 03:02:15.238976 2558 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-console/console-6d6476497b-j24jp"] Jul 13 03:02:16.091413 ip-10-0-134-52 kubenswrapper[2558]: I0713 03:02:16.091385 2558 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="2a4da825-3dbe-42c9-a325-e6ddcdab810c" path="/var/lib/kubelet/pods/2a4da825-3dbe-42c9-a325-e6ddcdab810c/volumes" Jul 13 03:02:44.628184 ip-10-0-134-52 kubenswrapper[2558]: I0713 03:02:44.628148 2558 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-monitoring/alertmanager-main-0"] Jul 13 03:02:44.628797 ip-10-0-134-52 kubenswrapper[2558]: I0713 03:02:44.628462 2558 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-monitoring/alertmanager-main-0" podUID="efab6d01-9fed-48f2-8343-7423fd04ecd7" containerName="alertmanager" containerID="cri-o://d1612a326163d39c08b27ca610518b642db60037f0d92c481c4741fcbed24a09" gracePeriod=120 Jul 13 03:02:44.628797 ip-10-0-134-52 kubenswrapper[2558]: I0713 03:02:44.628518 2558 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-monitoring/alertmanager-main-0" podUID="efab6d01-9fed-48f2-8343-7423fd04ecd7" containerName="kube-rbac-proxy-metric" containerID="cri-o://65215590b71c0bdc0105967f6a2091587c787ad8de9065ff147c00cf91ae4a18" gracePeriod=120 Jul 13 03:02:44.628797 ip-10-0-134-52 kubenswrapper[2558]: I0713 03:02:44.628553 2558 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-monitoring/alertmanager-main-0" podUID="efab6d01-9fed-48f2-8343-7423fd04ecd7" containerName="kube-rbac-proxy-web" containerID="cri-o://9838f191125846c9d102d7b31e0cb6439ff649467d2cca66fb14dec2c1038516" gracePeriod=120 Jul 13 03:02:44.628797 ip-10-0-134-52 kubenswrapper[2558]: I0713 03:02:44.628579 2558 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-monitoring/alertmanager-main-0" podUID="efab6d01-9fed-48f2-8343-7423fd04ecd7" containerName="config-reloader" containerID="cri-o://9a16dcb46316ab55dc89db0e8e1685a63ccc3adc2f3bef8a040b2b8dfe41f1c3" gracePeriod=120 Jul 13 03:02:44.628797 ip-10-0-134-52 kubenswrapper[2558]: I0713 03:02:44.628641 2558 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-monitoring/alertmanager-main-0" podUID="efab6d01-9fed-48f2-8343-7423fd04ecd7" containerName="prom-label-proxy" containerID="cri-o://ef4131e9c7c54ef956b58b06a5aaae37425550647e52f2d3d45c3737521d1e8a" gracePeriod=120 Jul 13 03:02:44.628797 ip-10-0-134-52 kubenswrapper[2558]: I0713 03:02:44.628589 2558 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-monitoring/alertmanager-main-0" podUID="efab6d01-9fed-48f2-8343-7423fd04ecd7" containerName="kube-rbac-proxy" containerID="cri-o://865f30b78c9f29200c876e6d4cfb1b7c97583e19c9fb13f71ae46f2d996d392f" gracePeriod=120 Jul 13 03:02:45.329577 ip-10-0-134-52 kubenswrapper[2558]: I0713 03:02:45.329551 2558 generic.go:356] "Generic (PLEG): container finished" podID="efab6d01-9fed-48f2-8343-7423fd04ecd7" containerID="ef4131e9c7c54ef956b58b06a5aaae37425550647e52f2d3d45c3737521d1e8a" exitCode=0 Jul 13 03:02:45.329577 ip-10-0-134-52 kubenswrapper[2558]: I0713 03:02:45.329573 2558 generic.go:356] "Generic (PLEG): container finished" podID="efab6d01-9fed-48f2-8343-7423fd04ecd7" containerID="865f30b78c9f29200c876e6d4cfb1b7c97583e19c9fb13f71ae46f2d996d392f" exitCode=0 Jul 13 03:02:45.329577 ip-10-0-134-52 kubenswrapper[2558]: I0713 03:02:45.329579 2558 generic.go:356] "Generic (PLEG): container finished" podID="efab6d01-9fed-48f2-8343-7423fd04ecd7" containerID="9a16dcb46316ab55dc89db0e8e1685a63ccc3adc2f3bef8a040b2b8dfe41f1c3" exitCode=0 Jul 13 03:02:45.329577 ip-10-0-134-52 kubenswrapper[2558]: I0713 03:02:45.329584 2558 generic.go:356] "Generic (PLEG): container finished" podID="efab6d01-9fed-48f2-8343-7423fd04ecd7" containerID="d1612a326163d39c08b27ca610518b642db60037f0d92c481c4741fcbed24a09" exitCode=0 Jul 13 03:02:45.329870 ip-10-0-134-52 kubenswrapper[2558]: I0713 03:02:45.329625 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"efab6d01-9fed-48f2-8343-7423fd04ecd7","Type":"ContainerDied","Data":"ef4131e9c7c54ef956b58b06a5aaae37425550647e52f2d3d45c3737521d1e8a"} Jul 13 03:02:45.329870 ip-10-0-134-52 kubenswrapper[2558]: I0713 03:02:45.329704 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"efab6d01-9fed-48f2-8343-7423fd04ecd7","Type":"ContainerDied","Data":"865f30b78c9f29200c876e6d4cfb1b7c97583e19c9fb13f71ae46f2d996d392f"} Jul 13 03:02:45.329870 ip-10-0-134-52 kubenswrapper[2558]: I0713 03:02:45.329742 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"efab6d01-9fed-48f2-8343-7423fd04ecd7","Type":"ContainerDied","Data":"9a16dcb46316ab55dc89db0e8e1685a63ccc3adc2f3bef8a040b2b8dfe41f1c3"} Jul 13 03:02:45.329870 ip-10-0-134-52 kubenswrapper[2558]: I0713 03:02:45.329783 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"efab6d01-9fed-48f2-8343-7423fd04ecd7","Type":"ContainerDied","Data":"d1612a326163d39c08b27ca610518b642db60037f0d92c481c4741fcbed24a09"} Jul 13 03:02:45.876006 ip-10-0-134-52 kubenswrapper[2558]: I0713 03:02:45.875984 2558 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/alertmanager-main-0" Jul 13 03:02:46.015301 ip-10-0-134-52 kubenswrapper[2558]: I0713 03:02:46.015221 2558 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/efab6d01-9fed-48f2-8343-7423fd04ecd7-config-out\") pod \"efab6d01-9fed-48f2-8343-7423fd04ecd7\" (UID: \"efab6d01-9fed-48f2-8343-7423fd04ecd7\") " Jul 13 03:02:46.015301 ip-10-0-134-52 kubenswrapper[2558]: I0713 03:02:46.015265 2558 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/efab6d01-9fed-48f2-8343-7423fd04ecd7-alertmanager-trusted-ca-bundle\") pod \"efab6d01-9fed-48f2-8343-7423fd04ecd7\" (UID: \"efab6d01-9fed-48f2-8343-7423fd04ecd7\") " Jul 13 03:02:46.015301 ip-10-0-134-52 kubenswrapper[2558]: I0713 03:02:46.015292 2558 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/efab6d01-9fed-48f2-8343-7423fd04ecd7-metrics-client-ca\") pod \"efab6d01-9fed-48f2-8343-7423fd04ecd7\" (UID: \"efab6d01-9fed-48f2-8343-7423fd04ecd7\") " Jul 13 03:02:46.015596 ip-10-0-134-52 kubenswrapper[2558]: I0713 03:02:46.015356 2558 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/efab6d01-9fed-48f2-8343-7423fd04ecd7-secret-alertmanager-kube-rbac-proxy-web\") pod \"efab6d01-9fed-48f2-8343-7423fd04ecd7\" (UID: \"efab6d01-9fed-48f2-8343-7423fd04ecd7\") " Jul 13 03:02:46.015596 ip-10-0-134-52 kubenswrapper[2558]: I0713 03:02:46.015383 2558 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-g4x7r\" (UniqueName: \"kubernetes.io/projected/efab6d01-9fed-48f2-8343-7423fd04ecd7-kube-api-access-g4x7r\") pod \"efab6d01-9fed-48f2-8343-7423fd04ecd7\" (UID: \"efab6d01-9fed-48f2-8343-7423fd04ecd7\") " Jul 13 03:02:46.015596 ip-10-0-134-52 kubenswrapper[2558]: I0713 03:02:46.015434 2558 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/efab6d01-9fed-48f2-8343-7423fd04ecd7-secret-alertmanager-kube-rbac-proxy-metric\") pod \"efab6d01-9fed-48f2-8343-7423fd04ecd7\" (UID: \"efab6d01-9fed-48f2-8343-7423fd04ecd7\") " Jul 13 03:02:46.015596 ip-10-0-134-52 kubenswrapper[2558]: I0713 03:02:46.015474 2558 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/efab6d01-9fed-48f2-8343-7423fd04ecd7-secret-alertmanager-kube-rbac-proxy\") pod \"efab6d01-9fed-48f2-8343-7423fd04ecd7\" (UID: \"efab6d01-9fed-48f2-8343-7423fd04ecd7\") " Jul 13 03:02:46.015596 ip-10-0-134-52 kubenswrapper[2558]: I0713 03:02:46.015503 2558 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/efab6d01-9fed-48f2-8343-7423fd04ecd7-web-config\") pod \"efab6d01-9fed-48f2-8343-7423fd04ecd7\" (UID: \"efab6d01-9fed-48f2-8343-7423fd04ecd7\") " Jul 13 03:02:46.015596 ip-10-0-134-52 kubenswrapper[2558]: I0713 03:02:46.015533 2558 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/efab6d01-9fed-48f2-8343-7423fd04ecd7-tls-assets\") pod \"efab6d01-9fed-48f2-8343-7423fd04ecd7\" (UID: \"efab6d01-9fed-48f2-8343-7423fd04ecd7\") " Jul 13 03:02:46.015596 ip-10-0-134-52 kubenswrapper[2558]: I0713 03:02:46.015565 2558 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/efab6d01-9fed-48f2-8343-7423fd04ecd7-cluster-tls-config\") pod \"efab6d01-9fed-48f2-8343-7423fd04ecd7\" (UID: \"efab6d01-9fed-48f2-8343-7423fd04ecd7\") " Jul 13 03:02:46.015915 ip-10-0-134-52 kubenswrapper[2558]: I0713 03:02:46.015617 2558 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/efab6d01-9fed-48f2-8343-7423fd04ecd7-secret-alertmanager-main-tls\") pod \"efab6d01-9fed-48f2-8343-7423fd04ecd7\" (UID: \"efab6d01-9fed-48f2-8343-7423fd04ecd7\") " Jul 13 03:02:46.015915 ip-10-0-134-52 kubenswrapper[2558]: I0713 03:02:46.015659 2558 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/efab6d01-9fed-48f2-8343-7423fd04ecd7-alertmanager-main-db\") pod \"efab6d01-9fed-48f2-8343-7423fd04ecd7\" (UID: \"efab6d01-9fed-48f2-8343-7423fd04ecd7\") " Jul 13 03:02:46.015915 ip-10-0-134-52 kubenswrapper[2558]: I0713 03:02:46.015684 2558 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/efab6d01-9fed-48f2-8343-7423fd04ecd7-config-volume\") pod \"efab6d01-9fed-48f2-8343-7423fd04ecd7\" (UID: \"efab6d01-9fed-48f2-8343-7423fd04ecd7\") " Jul 13 03:02:46.015915 ip-10-0-134-52 kubenswrapper[2558]: I0713 03:02:46.015683 2558 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/efab6d01-9fed-48f2-8343-7423fd04ecd7-alertmanager-trusted-ca-bundle" (OuterVolumeSpecName: "alertmanager-trusted-ca-bundle") pod "efab6d01-9fed-48f2-8343-7423fd04ecd7" (UID: "efab6d01-9fed-48f2-8343-7423fd04ecd7"). InnerVolumeSpecName "alertmanager-trusted-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 13 03:02:46.015915 ip-10-0-134-52 kubenswrapper[2558]: I0713 03:02:46.015892 2558 reconciler_common.go:299] "Volume detached for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/efab6d01-9fed-48f2-8343-7423fd04ecd7-alertmanager-trusted-ca-bundle\") on node \"ip-10-0-134-52.ec2.internal\" DevicePath \"\"" Jul 13 03:02:46.016158 ip-10-0-134-52 kubenswrapper[2558]: I0713 03:02:46.015917 2558 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/efab6d01-9fed-48f2-8343-7423fd04ecd7-metrics-client-ca" (OuterVolumeSpecName: "metrics-client-ca") pod "efab6d01-9fed-48f2-8343-7423fd04ecd7" (UID: "efab6d01-9fed-48f2-8343-7423fd04ecd7"). InnerVolumeSpecName "metrics-client-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 13 03:02:46.016497 ip-10-0-134-52 kubenswrapper[2558]: I0713 03:02:46.016299 2558 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/efab6d01-9fed-48f2-8343-7423fd04ecd7-alertmanager-main-db" (OuterVolumeSpecName: "alertmanager-main-db") pod "efab6d01-9fed-48f2-8343-7423fd04ecd7" (UID: "efab6d01-9fed-48f2-8343-7423fd04ecd7"). InnerVolumeSpecName "alertmanager-main-db". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 13 03:02:46.018693 ip-10-0-134-52 kubenswrapper[2558]: I0713 03:02:46.018653 2558 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/efab6d01-9fed-48f2-8343-7423fd04ecd7-secret-alertmanager-kube-rbac-proxy" (OuterVolumeSpecName: "secret-alertmanager-kube-rbac-proxy") pod "efab6d01-9fed-48f2-8343-7423fd04ecd7" (UID: "efab6d01-9fed-48f2-8343-7423fd04ecd7"). InnerVolumeSpecName "secret-alertmanager-kube-rbac-proxy". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 13 03:02:46.019263 ip-10-0-134-52 kubenswrapper[2558]: I0713 03:02:46.019217 2558 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/efab6d01-9fed-48f2-8343-7423fd04ecd7-tls-assets" (OuterVolumeSpecName: "tls-assets") pod "efab6d01-9fed-48f2-8343-7423fd04ecd7" (UID: "efab6d01-9fed-48f2-8343-7423fd04ecd7"). InnerVolumeSpecName "tls-assets". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 13 03:02:46.019263 ip-10-0-134-52 kubenswrapper[2558]: I0713 03:02:46.019223 2558 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/efab6d01-9fed-48f2-8343-7423fd04ecd7-config-out" (OuterVolumeSpecName: "config-out") pod "efab6d01-9fed-48f2-8343-7423fd04ecd7" (UID: "efab6d01-9fed-48f2-8343-7423fd04ecd7"). InnerVolumeSpecName "config-out". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 13 03:02:46.019263 ip-10-0-134-52 kubenswrapper[2558]: I0713 03:02:46.019231 2558 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/efab6d01-9fed-48f2-8343-7423fd04ecd7-secret-alertmanager-kube-rbac-proxy-metric" (OuterVolumeSpecName: "secret-alertmanager-kube-rbac-proxy-metric") pod "efab6d01-9fed-48f2-8343-7423fd04ecd7" (UID: "efab6d01-9fed-48f2-8343-7423fd04ecd7"). InnerVolumeSpecName "secret-alertmanager-kube-rbac-proxy-metric". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 13 03:02:46.019263 ip-10-0-134-52 kubenswrapper[2558]: I0713 03:02:46.019255 2558 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/efab6d01-9fed-48f2-8343-7423fd04ecd7-config-volume" (OuterVolumeSpecName: "config-volume") pod "efab6d01-9fed-48f2-8343-7423fd04ecd7" (UID: "efab6d01-9fed-48f2-8343-7423fd04ecd7"). InnerVolumeSpecName "config-volume". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 13 03:02:46.019552 ip-10-0-134-52 kubenswrapper[2558]: I0713 03:02:46.019445 2558 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/efab6d01-9fed-48f2-8343-7423fd04ecd7-kube-api-access-g4x7r" (OuterVolumeSpecName: "kube-api-access-g4x7r") pod "efab6d01-9fed-48f2-8343-7423fd04ecd7" (UID: "efab6d01-9fed-48f2-8343-7423fd04ecd7"). InnerVolumeSpecName "kube-api-access-g4x7r". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 13 03:02:46.019708 ip-10-0-134-52 kubenswrapper[2558]: I0713 03:02:46.019678 2558 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/efab6d01-9fed-48f2-8343-7423fd04ecd7-secret-alertmanager-kube-rbac-proxy-web" (OuterVolumeSpecName: "secret-alertmanager-kube-rbac-proxy-web") pod "efab6d01-9fed-48f2-8343-7423fd04ecd7" (UID: "efab6d01-9fed-48f2-8343-7423fd04ecd7"). InnerVolumeSpecName "secret-alertmanager-kube-rbac-proxy-web". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 13 03:02:46.020014 ip-10-0-134-52 kubenswrapper[2558]: I0713 03:02:46.019994 2558 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/efab6d01-9fed-48f2-8343-7423fd04ecd7-secret-alertmanager-main-tls" (OuterVolumeSpecName: "secret-alertmanager-main-tls") pod "efab6d01-9fed-48f2-8343-7423fd04ecd7" (UID: "efab6d01-9fed-48f2-8343-7423fd04ecd7"). InnerVolumeSpecName "secret-alertmanager-main-tls". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 13 03:02:46.023554 ip-10-0-134-52 kubenswrapper[2558]: I0713 03:02:46.023535 2558 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/efab6d01-9fed-48f2-8343-7423fd04ecd7-cluster-tls-config" (OuterVolumeSpecName: "cluster-tls-config") pod "efab6d01-9fed-48f2-8343-7423fd04ecd7" (UID: "efab6d01-9fed-48f2-8343-7423fd04ecd7"). InnerVolumeSpecName "cluster-tls-config". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 13 03:02:46.029466 ip-10-0-134-52 kubenswrapper[2558]: I0713 03:02:46.029445 2558 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/efab6d01-9fed-48f2-8343-7423fd04ecd7-web-config" (OuterVolumeSpecName: "web-config") pod "efab6d01-9fed-48f2-8343-7423fd04ecd7" (UID: "efab6d01-9fed-48f2-8343-7423fd04ecd7"). InnerVolumeSpecName "web-config". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 13 03:02:46.116342 ip-10-0-134-52 kubenswrapper[2558]: I0713 03:02:46.116310 2558 reconciler_common.go:299] "Volume detached for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/efab6d01-9fed-48f2-8343-7423fd04ecd7-secret-alertmanager-kube-rbac-proxy\") on node \"ip-10-0-134-52.ec2.internal\" DevicePath \"\"" Jul 13 03:02:46.116342 ip-10-0-134-52 kubenswrapper[2558]: I0713 03:02:46.116341 2558 reconciler_common.go:299] "Volume detached for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/efab6d01-9fed-48f2-8343-7423fd04ecd7-web-config\") on node \"ip-10-0-134-52.ec2.internal\" DevicePath \"\"" Jul 13 03:02:46.116459 ip-10-0-134-52 kubenswrapper[2558]: I0713 03:02:46.116357 2558 reconciler_common.go:299] "Volume detached for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/efab6d01-9fed-48f2-8343-7423fd04ecd7-tls-assets\") on node \"ip-10-0-134-52.ec2.internal\" DevicePath \"\"" Jul 13 03:02:46.116459 ip-10-0-134-52 kubenswrapper[2558]: I0713 03:02:46.116366 2558 reconciler_common.go:299] "Volume detached for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/efab6d01-9fed-48f2-8343-7423fd04ecd7-cluster-tls-config\") on node \"ip-10-0-134-52.ec2.internal\" DevicePath \"\"" Jul 13 03:02:46.116459 ip-10-0-134-52 kubenswrapper[2558]: I0713 03:02:46.116374 2558 reconciler_common.go:299] "Volume detached for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/efab6d01-9fed-48f2-8343-7423fd04ecd7-secret-alertmanager-main-tls\") on node \"ip-10-0-134-52.ec2.internal\" DevicePath \"\"" Jul 13 03:02:46.116459 ip-10-0-134-52 kubenswrapper[2558]: I0713 03:02:46.116384 2558 reconciler_common.go:299] "Volume detached for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/efab6d01-9fed-48f2-8343-7423fd04ecd7-alertmanager-main-db\") on node \"ip-10-0-134-52.ec2.internal\" DevicePath \"\"" Jul 13 03:02:46.116459 ip-10-0-134-52 kubenswrapper[2558]: I0713 03:02:46.116392 2558 reconciler_common.go:299] "Volume detached for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/efab6d01-9fed-48f2-8343-7423fd04ecd7-config-volume\") on node \"ip-10-0-134-52.ec2.internal\" DevicePath \"\"" Jul 13 03:02:46.116459 ip-10-0-134-52 kubenswrapper[2558]: I0713 03:02:46.116399 2558 reconciler_common.go:299] "Volume detached for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/efab6d01-9fed-48f2-8343-7423fd04ecd7-config-out\") on node \"ip-10-0-134-52.ec2.internal\" DevicePath \"\"" Jul 13 03:02:46.116459 ip-10-0-134-52 kubenswrapper[2558]: I0713 03:02:46.116407 2558 reconciler_common.go:299] "Volume detached for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/efab6d01-9fed-48f2-8343-7423fd04ecd7-metrics-client-ca\") on node \"ip-10-0-134-52.ec2.internal\" DevicePath \"\"" Jul 13 03:02:46.116459 ip-10-0-134-52 kubenswrapper[2558]: I0713 03:02:46.116415 2558 reconciler_common.go:299] "Volume detached for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/efab6d01-9fed-48f2-8343-7423fd04ecd7-secret-alertmanager-kube-rbac-proxy-web\") on node \"ip-10-0-134-52.ec2.internal\" DevicePath \"\"" Jul 13 03:02:46.116459 ip-10-0-134-52 kubenswrapper[2558]: I0713 03:02:46.116428 2558 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-g4x7r\" (UniqueName: \"kubernetes.io/projected/efab6d01-9fed-48f2-8343-7423fd04ecd7-kube-api-access-g4x7r\") on node \"ip-10-0-134-52.ec2.internal\" DevicePath \"\"" Jul 13 03:02:46.116459 ip-10-0-134-52 kubenswrapper[2558]: I0713 03:02:46.116439 2558 reconciler_common.go:299] "Volume detached for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/efab6d01-9fed-48f2-8343-7423fd04ecd7-secret-alertmanager-kube-rbac-proxy-metric\") on node \"ip-10-0-134-52.ec2.internal\" DevicePath \"\"" Jul 13 03:02:46.335926 ip-10-0-134-52 kubenswrapper[2558]: I0713 03:02:46.335895 2558 generic.go:356] "Generic (PLEG): container finished" podID="efab6d01-9fed-48f2-8343-7423fd04ecd7" containerID="65215590b71c0bdc0105967f6a2091587c787ad8de9065ff147c00cf91ae4a18" exitCode=0 Jul 13 03:02:46.335926 ip-10-0-134-52 kubenswrapper[2558]: I0713 03:02:46.335922 2558 generic.go:356] "Generic (PLEG): container finished" podID="efab6d01-9fed-48f2-8343-7423fd04ecd7" containerID="9838f191125846c9d102d7b31e0cb6439ff649467d2cca66fb14dec2c1038516" exitCode=0 Jul 13 03:02:46.336066 ip-10-0-134-52 kubenswrapper[2558]: I0713 03:02:46.335962 2558 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/alertmanager-main-0" Jul 13 03:02:46.336066 ip-10-0-134-52 kubenswrapper[2558]: I0713 03:02:46.335966 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"efab6d01-9fed-48f2-8343-7423fd04ecd7","Type":"ContainerDied","Data":"65215590b71c0bdc0105967f6a2091587c787ad8de9065ff147c00cf91ae4a18"} Jul 13 03:02:46.336066 ip-10-0-134-52 kubenswrapper[2558]: I0713 03:02:46.336030 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"efab6d01-9fed-48f2-8343-7423fd04ecd7","Type":"ContainerDied","Data":"9838f191125846c9d102d7b31e0cb6439ff649467d2cca66fb14dec2c1038516"} Jul 13 03:02:46.336066 ip-10-0-134-52 kubenswrapper[2558]: I0713 03:02:46.336058 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"efab6d01-9fed-48f2-8343-7423fd04ecd7","Type":"ContainerDied","Data":"33eb1c831db597bf61815274c24d22db82e20ee3611ec7f0479cb11d6a1cf192"} Jul 13 03:02:46.336207 ip-10-0-134-52 kubenswrapper[2558]: I0713 03:02:46.336087 2558 scope.go:117] "RemoveContainer" containerID="ef4131e9c7c54ef956b58b06a5aaae37425550647e52f2d3d45c3737521d1e8a" Jul 13 03:02:46.343596 ip-10-0-134-52 kubenswrapper[2558]: I0713 03:02:46.343581 2558 scope.go:117] "RemoveContainer" containerID="65215590b71c0bdc0105967f6a2091587c787ad8de9065ff147c00cf91ae4a18" Jul 13 03:02:46.350447 ip-10-0-134-52 kubenswrapper[2558]: I0713 03:02:46.350425 2558 scope.go:117] "RemoveContainer" containerID="865f30b78c9f29200c876e6d4cfb1b7c97583e19c9fb13f71ae46f2d996d392f" Jul 13 03:02:46.356975 ip-10-0-134-52 kubenswrapper[2558]: I0713 03:02:46.356952 2558 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-monitoring/alertmanager-main-0"] Jul 13 03:02:46.358581 ip-10-0-134-52 kubenswrapper[2558]: I0713 03:02:46.358561 2558 scope.go:117] "RemoveContainer" containerID="9838f191125846c9d102d7b31e0cb6439ff649467d2cca66fb14dec2c1038516" Jul 13 03:02:46.361965 ip-10-0-134-52 kubenswrapper[2558]: I0713 03:02:46.361932 2558 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-monitoring/alertmanager-main-0"] Jul 13 03:02:46.367143 ip-10-0-134-52 kubenswrapper[2558]: I0713 03:02:46.367127 2558 scope.go:117] "RemoveContainer" containerID="9a16dcb46316ab55dc89db0e8e1685a63ccc3adc2f3bef8a040b2b8dfe41f1c3" Jul 13 03:02:46.373852 ip-10-0-134-52 kubenswrapper[2558]: I0713 03:02:46.373835 2558 scope.go:117] "RemoveContainer" containerID="d1612a326163d39c08b27ca610518b642db60037f0d92c481c4741fcbed24a09" Jul 13 03:02:46.380574 ip-10-0-134-52 kubenswrapper[2558]: I0713 03:02:46.380556 2558 scope.go:117] "RemoveContainer" containerID="df77a40ddeaf7c77bee47ae8bc706c1d7f8e60007ca0fd1bb7db40634d50c70b" Jul 13 03:02:46.385305 ip-10-0-134-52 kubenswrapper[2558]: I0713 03:02:46.385279 2558 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/alertmanager-main-0"] Jul 13 03:02:46.385607 ip-10-0-134-52 kubenswrapper[2558]: I0713 03:02:46.385589 2558 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="efab6d01-9fed-48f2-8343-7423fd04ecd7" containerName="alertmanager" Jul 13 03:02:46.385607 ip-10-0-134-52 kubenswrapper[2558]: I0713 03:02:46.385608 2558 state_mem.go:107] "Deleted CPUSet assignment" podUID="efab6d01-9fed-48f2-8343-7423fd04ecd7" containerName="alertmanager" Jul 13 03:02:46.385709 ip-10-0-134-52 kubenswrapper[2558]: I0713 03:02:46.385618 2558 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="efab6d01-9fed-48f2-8343-7423fd04ecd7" containerName="prom-label-proxy" Jul 13 03:02:46.385709 ip-10-0-134-52 kubenswrapper[2558]: I0713 03:02:46.385623 2558 state_mem.go:107] "Deleted CPUSet assignment" podUID="efab6d01-9fed-48f2-8343-7423fd04ecd7" containerName="prom-label-proxy" Jul 13 03:02:46.385709 ip-10-0-134-52 kubenswrapper[2558]: I0713 03:02:46.385632 2558 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="efab6d01-9fed-48f2-8343-7423fd04ecd7" containerName="kube-rbac-proxy-metric" Jul 13 03:02:46.385709 ip-10-0-134-52 kubenswrapper[2558]: I0713 03:02:46.385637 2558 state_mem.go:107] "Deleted CPUSet assignment" podUID="efab6d01-9fed-48f2-8343-7423fd04ecd7" containerName="kube-rbac-proxy-metric" Jul 13 03:02:46.385709 ip-10-0-134-52 kubenswrapper[2558]: I0713 03:02:46.385644 2558 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="efab6d01-9fed-48f2-8343-7423fd04ecd7" containerName="kube-rbac-proxy" Jul 13 03:02:46.385709 ip-10-0-134-52 kubenswrapper[2558]: I0713 03:02:46.385650 2558 state_mem.go:107] "Deleted CPUSet assignment" podUID="efab6d01-9fed-48f2-8343-7423fd04ecd7" containerName="kube-rbac-proxy" Jul 13 03:02:46.385709 ip-10-0-134-52 kubenswrapper[2558]: I0713 03:02:46.385656 2558 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="20a99b49-0854-4214-bfb7-aab2b9ade3d8" containerName="registry" Jul 13 03:02:46.385709 ip-10-0-134-52 kubenswrapper[2558]: I0713 03:02:46.385661 2558 state_mem.go:107] "Deleted CPUSet assignment" podUID="20a99b49-0854-4214-bfb7-aab2b9ade3d8" containerName="registry" Jul 13 03:02:46.385709 ip-10-0-134-52 kubenswrapper[2558]: I0713 03:02:46.385669 2558 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="efab6d01-9fed-48f2-8343-7423fd04ecd7" containerName="kube-rbac-proxy-web" Jul 13 03:02:46.385709 ip-10-0-134-52 kubenswrapper[2558]: I0713 03:02:46.385674 2558 state_mem.go:107] "Deleted CPUSet assignment" podUID="efab6d01-9fed-48f2-8343-7423fd04ecd7" containerName="kube-rbac-proxy-web" Jul 13 03:02:46.385709 ip-10-0-134-52 kubenswrapper[2558]: I0713 03:02:46.385681 2558 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="efab6d01-9fed-48f2-8343-7423fd04ecd7" containerName="config-reloader" Jul 13 03:02:46.385709 ip-10-0-134-52 kubenswrapper[2558]: I0713 03:02:46.385696 2558 state_mem.go:107] "Deleted CPUSet assignment" podUID="efab6d01-9fed-48f2-8343-7423fd04ecd7" containerName="config-reloader" Jul 13 03:02:46.385709 ip-10-0-134-52 kubenswrapper[2558]: I0713 03:02:46.385703 2558 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="2a4da825-3dbe-42c9-a325-e6ddcdab810c" containerName="console" Jul 13 03:02:46.385709 ip-10-0-134-52 kubenswrapper[2558]: I0713 03:02:46.385708 2558 state_mem.go:107] "Deleted CPUSet assignment" podUID="2a4da825-3dbe-42c9-a325-e6ddcdab810c" containerName="console" Jul 13 03:02:46.385709 ip-10-0-134-52 kubenswrapper[2558]: I0713 03:02:46.385716 2558 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="efab6d01-9fed-48f2-8343-7423fd04ecd7" containerName="init-config-reloader" Jul 13 03:02:46.386120 ip-10-0-134-52 kubenswrapper[2558]: I0713 03:02:46.385721 2558 state_mem.go:107] "Deleted CPUSet assignment" podUID="efab6d01-9fed-48f2-8343-7423fd04ecd7" containerName="init-config-reloader" Jul 13 03:02:46.386120 ip-10-0-134-52 kubenswrapper[2558]: I0713 03:02:46.385728 2558 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="07484034-3cb0-46f9-84f5-2ebec2e95044" containerName="console" Jul 13 03:02:46.386120 ip-10-0-134-52 kubenswrapper[2558]: I0713 03:02:46.385733 2558 state_mem.go:107] "Deleted CPUSet assignment" podUID="07484034-3cb0-46f9-84f5-2ebec2e95044" containerName="console" Jul 13 03:02:46.386120 ip-10-0-134-52 kubenswrapper[2558]: I0713 03:02:46.385773 2558 memory_manager.go:368] "RemoveStaleState removing state" podUID="efab6d01-9fed-48f2-8343-7423fd04ecd7" containerName="kube-rbac-proxy-metric" Jul 13 03:02:46.386120 ip-10-0-134-52 kubenswrapper[2558]: I0713 03:02:46.385780 2558 memory_manager.go:368] "RemoveStaleState removing state" podUID="efab6d01-9fed-48f2-8343-7423fd04ecd7" containerName="prom-label-proxy" Jul 13 03:02:46.386120 ip-10-0-134-52 kubenswrapper[2558]: I0713 03:02:46.385785 2558 memory_manager.go:368] "RemoveStaleState removing state" podUID="2a4da825-3dbe-42c9-a325-e6ddcdab810c" containerName="console" Jul 13 03:02:46.386120 ip-10-0-134-52 kubenswrapper[2558]: I0713 03:02:46.385792 2558 memory_manager.go:368] "RemoveStaleState removing state" podUID="efab6d01-9fed-48f2-8343-7423fd04ecd7" containerName="alertmanager" Jul 13 03:02:46.386120 ip-10-0-134-52 kubenswrapper[2558]: I0713 03:02:46.385798 2558 memory_manager.go:368] "RemoveStaleState removing state" podUID="efab6d01-9fed-48f2-8343-7423fd04ecd7" containerName="kube-rbac-proxy" Jul 13 03:02:46.386120 ip-10-0-134-52 kubenswrapper[2558]: I0713 03:02:46.385805 2558 memory_manager.go:368] "RemoveStaleState removing state" podUID="efab6d01-9fed-48f2-8343-7423fd04ecd7" containerName="config-reloader" Jul 13 03:02:46.386120 ip-10-0-134-52 kubenswrapper[2558]: I0713 03:02:46.385810 2558 memory_manager.go:368] "RemoveStaleState removing state" podUID="07484034-3cb0-46f9-84f5-2ebec2e95044" containerName="console" Jul 13 03:02:46.386120 ip-10-0-134-52 kubenswrapper[2558]: I0713 03:02:46.385814 2558 memory_manager.go:368] "RemoveStaleState removing state" podUID="20a99b49-0854-4214-bfb7-aab2b9ade3d8" containerName="registry" Jul 13 03:02:46.386120 ip-10-0-134-52 kubenswrapper[2558]: I0713 03:02:46.385818 2558 memory_manager.go:368] "RemoveStaleState removing state" podUID="efab6d01-9fed-48f2-8343-7423fd04ecd7" containerName="kube-rbac-proxy-web" Jul 13 03:02:46.389880 ip-10-0-134-52 kubenswrapper[2558]: I0713 03:02:46.389859 2558 scope.go:117] "RemoveContainer" containerID="ef4131e9c7c54ef956b58b06a5aaae37425550647e52f2d3d45c3737521d1e8a" Jul 13 03:02:46.390168 ip-10-0-134-52 kubenswrapper[2558]: E0713 03:02:46.390150 2558 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"ef4131e9c7c54ef956b58b06a5aaae37425550647e52f2d3d45c3737521d1e8a\": container with ID starting with ef4131e9c7c54ef956b58b06a5aaae37425550647e52f2d3d45c3737521d1e8a not found: ID does not exist" containerID="ef4131e9c7c54ef956b58b06a5aaae37425550647e52f2d3d45c3737521d1e8a" Jul 13 03:02:46.390234 ip-10-0-134-52 kubenswrapper[2558]: I0713 03:02:46.390177 2558 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"ef4131e9c7c54ef956b58b06a5aaae37425550647e52f2d3d45c3737521d1e8a"} err="failed to get container status \"ef4131e9c7c54ef956b58b06a5aaae37425550647e52f2d3d45c3737521d1e8a\": rpc error: code = NotFound desc = could not find container \"ef4131e9c7c54ef956b58b06a5aaae37425550647e52f2d3d45c3737521d1e8a\": container with ID starting with ef4131e9c7c54ef956b58b06a5aaae37425550647e52f2d3d45c3737521d1e8a not found: ID does not exist" Jul 13 03:02:46.390234 ip-10-0-134-52 kubenswrapper[2558]: I0713 03:02:46.390195 2558 scope.go:117] "RemoveContainer" containerID="65215590b71c0bdc0105967f6a2091587c787ad8de9065ff147c00cf91ae4a18" Jul 13 03:02:46.390480 ip-10-0-134-52 kubenswrapper[2558]: E0713 03:02:46.390463 2558 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"65215590b71c0bdc0105967f6a2091587c787ad8de9065ff147c00cf91ae4a18\": container with ID starting with 65215590b71c0bdc0105967f6a2091587c787ad8de9065ff147c00cf91ae4a18 not found: ID does not exist" containerID="65215590b71c0bdc0105967f6a2091587c787ad8de9065ff147c00cf91ae4a18" Jul 13 03:02:46.390531 ip-10-0-134-52 kubenswrapper[2558]: I0713 03:02:46.390486 2558 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"65215590b71c0bdc0105967f6a2091587c787ad8de9065ff147c00cf91ae4a18"} err="failed to get container status \"65215590b71c0bdc0105967f6a2091587c787ad8de9065ff147c00cf91ae4a18\": rpc error: code = NotFound desc = could not find container \"65215590b71c0bdc0105967f6a2091587c787ad8de9065ff147c00cf91ae4a18\": container with ID starting with 65215590b71c0bdc0105967f6a2091587c787ad8de9065ff147c00cf91ae4a18 not found: ID does not exist" Jul 13 03:02:46.390531 ip-10-0-134-52 kubenswrapper[2558]: I0713 03:02:46.390507 2558 scope.go:117] "RemoveContainer" containerID="865f30b78c9f29200c876e6d4cfb1b7c97583e19c9fb13f71ae46f2d996d392f" Jul 13 03:02:46.390726 ip-10-0-134-52 kubenswrapper[2558]: E0713 03:02:46.390710 2558 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"865f30b78c9f29200c876e6d4cfb1b7c97583e19c9fb13f71ae46f2d996d392f\": container with ID starting with 865f30b78c9f29200c876e6d4cfb1b7c97583e19c9fb13f71ae46f2d996d392f not found: ID does not exist" containerID="865f30b78c9f29200c876e6d4cfb1b7c97583e19c9fb13f71ae46f2d996d392f" Jul 13 03:02:46.390761 ip-10-0-134-52 kubenswrapper[2558]: I0713 03:02:46.390732 2558 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"865f30b78c9f29200c876e6d4cfb1b7c97583e19c9fb13f71ae46f2d996d392f"} err="failed to get container status \"865f30b78c9f29200c876e6d4cfb1b7c97583e19c9fb13f71ae46f2d996d392f\": rpc error: code = NotFound desc = could not find container \"865f30b78c9f29200c876e6d4cfb1b7c97583e19c9fb13f71ae46f2d996d392f\": container with ID starting with 865f30b78c9f29200c876e6d4cfb1b7c97583e19c9fb13f71ae46f2d996d392f not found: ID does not exist" Jul 13 03:02:46.390761 ip-10-0-134-52 kubenswrapper[2558]: I0713 03:02:46.390749 2558 scope.go:117] "RemoveContainer" containerID="9838f191125846c9d102d7b31e0cb6439ff649467d2cca66fb14dec2c1038516" Jul 13 03:02:46.391203 ip-10-0-134-52 kubenswrapper[2558]: E0713 03:02:46.390976 2558 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"9838f191125846c9d102d7b31e0cb6439ff649467d2cca66fb14dec2c1038516\": container with ID starting with 9838f191125846c9d102d7b31e0cb6439ff649467d2cca66fb14dec2c1038516 not found: ID does not exist" containerID="9838f191125846c9d102d7b31e0cb6439ff649467d2cca66fb14dec2c1038516" Jul 13 03:02:46.391203 ip-10-0-134-52 kubenswrapper[2558]: I0713 03:02:46.390990 2558 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"9838f191125846c9d102d7b31e0cb6439ff649467d2cca66fb14dec2c1038516"} err="failed to get container status \"9838f191125846c9d102d7b31e0cb6439ff649467d2cca66fb14dec2c1038516\": rpc error: code = NotFound desc = could not find container \"9838f191125846c9d102d7b31e0cb6439ff649467d2cca66fb14dec2c1038516\": container with ID starting with 9838f191125846c9d102d7b31e0cb6439ff649467d2cca66fb14dec2c1038516 not found: ID does not exist" Jul 13 03:02:46.391203 ip-10-0-134-52 kubenswrapper[2558]: I0713 03:02:46.391003 2558 scope.go:117] "RemoveContainer" containerID="9a16dcb46316ab55dc89db0e8e1685a63ccc3adc2f3bef8a040b2b8dfe41f1c3" Jul 13 03:02:46.391376 ip-10-0-134-52 kubenswrapper[2558]: E0713 03:02:46.391206 2558 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"9a16dcb46316ab55dc89db0e8e1685a63ccc3adc2f3bef8a040b2b8dfe41f1c3\": container with ID starting with 9a16dcb46316ab55dc89db0e8e1685a63ccc3adc2f3bef8a040b2b8dfe41f1c3 not found: ID does not exist" containerID="9a16dcb46316ab55dc89db0e8e1685a63ccc3adc2f3bef8a040b2b8dfe41f1c3" Jul 13 03:02:46.391376 ip-10-0-134-52 kubenswrapper[2558]: I0713 03:02:46.391226 2558 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"9a16dcb46316ab55dc89db0e8e1685a63ccc3adc2f3bef8a040b2b8dfe41f1c3"} err="failed to get container status \"9a16dcb46316ab55dc89db0e8e1685a63ccc3adc2f3bef8a040b2b8dfe41f1c3\": rpc error: code = NotFound desc = could not find container \"9a16dcb46316ab55dc89db0e8e1685a63ccc3adc2f3bef8a040b2b8dfe41f1c3\": container with ID starting with 9a16dcb46316ab55dc89db0e8e1685a63ccc3adc2f3bef8a040b2b8dfe41f1c3 not found: ID does not exist" Jul 13 03:02:46.391376 ip-10-0-134-52 kubenswrapper[2558]: I0713 03:02:46.391239 2558 scope.go:117] "RemoveContainer" containerID="d1612a326163d39c08b27ca610518b642db60037f0d92c481c4741fcbed24a09" Jul 13 03:02:46.391523 ip-10-0-134-52 kubenswrapper[2558]: I0713 03:02:46.391404 2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/alertmanager-main-0" Jul 13 03:02:46.391523 ip-10-0-134-52 kubenswrapper[2558]: E0713 03:02:46.391455 2558 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"d1612a326163d39c08b27ca610518b642db60037f0d92c481c4741fcbed24a09\": container with ID starting with d1612a326163d39c08b27ca610518b642db60037f0d92c481c4741fcbed24a09 not found: ID does not exist" containerID="d1612a326163d39c08b27ca610518b642db60037f0d92c481c4741fcbed24a09" Jul 13 03:02:46.391523 ip-10-0-134-52 kubenswrapper[2558]: I0713 03:02:46.391470 2558 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"d1612a326163d39c08b27ca610518b642db60037f0d92c481c4741fcbed24a09"} err="failed to get container status \"d1612a326163d39c08b27ca610518b642db60037f0d92c481c4741fcbed24a09\": rpc error: code = NotFound desc = could not find container \"d1612a326163d39c08b27ca610518b642db60037f0d92c481c4741fcbed24a09\": container with ID starting with d1612a326163d39c08b27ca610518b642db60037f0d92c481c4741fcbed24a09 not found: ID does not exist" Jul 13 03:02:46.391523 ip-10-0-134-52 kubenswrapper[2558]: I0713 03:02:46.391481 2558 scope.go:117] "RemoveContainer" containerID="df77a40ddeaf7c77bee47ae8bc706c1d7f8e60007ca0fd1bb7db40634d50c70b" Jul 13 03:02:46.391736 ip-10-0-134-52 kubenswrapper[2558]: E0713 03:02:46.391706 2558 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"df77a40ddeaf7c77bee47ae8bc706c1d7f8e60007ca0fd1bb7db40634d50c70b\": container with ID starting with df77a40ddeaf7c77bee47ae8bc706c1d7f8e60007ca0fd1bb7db40634d50c70b not found: ID does not exist" containerID="df77a40ddeaf7c77bee47ae8bc706c1d7f8e60007ca0fd1bb7db40634d50c70b" Jul 13 03:02:46.391841 ip-10-0-134-52 kubenswrapper[2558]: I0713 03:02:46.391742 2558 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"df77a40ddeaf7c77bee47ae8bc706c1d7f8e60007ca0fd1bb7db40634d50c70b"} err="failed to get container status \"df77a40ddeaf7c77bee47ae8bc706c1d7f8e60007ca0fd1bb7db40634d50c70b\": rpc error: code = NotFound desc = could not find container \"df77a40ddeaf7c77bee47ae8bc706c1d7f8e60007ca0fd1bb7db40634d50c70b\": container with ID starting with df77a40ddeaf7c77bee47ae8bc706c1d7f8e60007ca0fd1bb7db40634d50c70b not found: ID does not exist" Jul 13 03:02:46.391841 ip-10-0-134-52 kubenswrapper[2558]: I0713 03:02:46.391761 2558 scope.go:117] "RemoveContainer" containerID="ef4131e9c7c54ef956b58b06a5aaae37425550647e52f2d3d45c3737521d1e8a" Jul 13 03:02:46.392066 ip-10-0-134-52 kubenswrapper[2558]: I0713 03:02:46.392042 2558 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"ef4131e9c7c54ef956b58b06a5aaae37425550647e52f2d3d45c3737521d1e8a"} err="failed to get container status \"ef4131e9c7c54ef956b58b06a5aaae37425550647e52f2d3d45c3737521d1e8a\": rpc error: code = NotFound desc = could not find container \"ef4131e9c7c54ef956b58b06a5aaae37425550647e52f2d3d45c3737521d1e8a\": container with ID starting with ef4131e9c7c54ef956b58b06a5aaae37425550647e52f2d3d45c3737521d1e8a not found: ID does not exist" Jul 13 03:02:46.392066 ip-10-0-134-52 kubenswrapper[2558]: I0713 03:02:46.392064 2558 scope.go:117] "RemoveContainer" containerID="65215590b71c0bdc0105967f6a2091587c787ad8de9065ff147c00cf91ae4a18" Jul 13 03:02:46.392274 ip-10-0-134-52 kubenswrapper[2558]: I0713 03:02:46.392257 2558 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"65215590b71c0bdc0105967f6a2091587c787ad8de9065ff147c00cf91ae4a18"} err="failed to get container status \"65215590b71c0bdc0105967f6a2091587c787ad8de9065ff147c00cf91ae4a18\": rpc error: code = NotFound desc = could not find container \"65215590b71c0bdc0105967f6a2091587c787ad8de9065ff147c00cf91ae4a18\": container with ID starting with 65215590b71c0bdc0105967f6a2091587c787ad8de9065ff147c00cf91ae4a18 not found: ID does not exist" Jul 13 03:02:46.392316 ip-10-0-134-52 kubenswrapper[2558]: I0713 03:02:46.392275 2558 scope.go:117] "RemoveContainer" containerID="865f30b78c9f29200c876e6d4cfb1b7c97583e19c9fb13f71ae46f2d996d392f" Jul 13 03:02:46.392574 ip-10-0-134-52 kubenswrapper[2558]: I0713 03:02:46.392549 2558 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"865f30b78c9f29200c876e6d4cfb1b7c97583e19c9fb13f71ae46f2d996d392f"} err="failed to get container status \"865f30b78c9f29200c876e6d4cfb1b7c97583e19c9fb13f71ae46f2d996d392f\": rpc error: code = NotFound desc = could not find container \"865f30b78c9f29200c876e6d4cfb1b7c97583e19c9fb13f71ae46f2d996d392f\": container with ID starting with 865f30b78c9f29200c876e6d4cfb1b7c97583e19c9fb13f71ae46f2d996d392f not found: ID does not exist" Jul 13 03:02:46.392654 ip-10-0-134-52 kubenswrapper[2558]: I0713 03:02:46.392575 2558 scope.go:117] "RemoveContainer" containerID="9838f191125846c9d102d7b31e0cb6439ff649467d2cca66fb14dec2c1038516" Jul 13 03:02:46.392868 ip-10-0-134-52 kubenswrapper[2558]: I0713 03:02:46.392847 2558 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"9838f191125846c9d102d7b31e0cb6439ff649467d2cca66fb14dec2c1038516"} err="failed to get container status \"9838f191125846c9d102d7b31e0cb6439ff649467d2cca66fb14dec2c1038516\": rpc error: code = NotFound desc = could not find container \"9838f191125846c9d102d7b31e0cb6439ff649467d2cca66fb14dec2c1038516\": container with ID starting with 9838f191125846c9d102d7b31e0cb6439ff649467d2cca66fb14dec2c1038516 not found: ID does not exist" Jul 13 03:02:46.392930 ip-10-0-134-52 kubenswrapper[2558]: I0713 03:02:46.392870 2558 scope.go:117] "RemoveContainer" containerID="9a16dcb46316ab55dc89db0e8e1685a63ccc3adc2f3bef8a040b2b8dfe41f1c3" Jul 13 03:02:46.393142 ip-10-0-134-52 kubenswrapper[2558]: I0713 03:02:46.393116 2558 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"9a16dcb46316ab55dc89db0e8e1685a63ccc3adc2f3bef8a040b2b8dfe41f1c3"} err="failed to get container status \"9a16dcb46316ab55dc89db0e8e1685a63ccc3adc2f3bef8a040b2b8dfe41f1c3\": rpc error: code = NotFound desc = could not find container \"9a16dcb46316ab55dc89db0e8e1685a63ccc3adc2f3bef8a040b2b8dfe41f1c3\": container with ID starting with 9a16dcb46316ab55dc89db0e8e1685a63ccc3adc2f3bef8a040b2b8dfe41f1c3 not found: ID does not exist" Jul 13 03:02:46.393225 ip-10-0-134-52 kubenswrapper[2558]: I0713 03:02:46.393145 2558 scope.go:117] "RemoveContainer" containerID="d1612a326163d39c08b27ca610518b642db60037f0d92c481c4741fcbed24a09" Jul 13 03:02:46.393429 ip-10-0-134-52 kubenswrapper[2558]: I0713 03:02:46.393407 2558 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"d1612a326163d39c08b27ca610518b642db60037f0d92c481c4741fcbed24a09"} err="failed to get container status \"d1612a326163d39c08b27ca610518b642db60037f0d92c481c4741fcbed24a09\": rpc error: code = NotFound desc = could not find container \"d1612a326163d39c08b27ca610518b642db60037f0d92c481c4741fcbed24a09\": container with ID starting with d1612a326163d39c08b27ca610518b642db60037f0d92c481c4741fcbed24a09 not found: ID does not exist" Jul 13 03:02:46.393429 ip-10-0-134-52 kubenswrapper[2558]: I0713 03:02:46.393426 2558 scope.go:117] "RemoveContainer" containerID="df77a40ddeaf7c77bee47ae8bc706c1d7f8e60007ca0fd1bb7db40634d50c70b" Jul 13 03:02:46.393668 ip-10-0-134-52 kubenswrapper[2558]: I0713 03:02:46.393648 2558 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"df77a40ddeaf7c77bee47ae8bc706c1d7f8e60007ca0fd1bb7db40634d50c70b"} err="failed to get container status \"df77a40ddeaf7c77bee47ae8bc706c1d7f8e60007ca0fd1bb7db40634d50c70b\": rpc error: code = NotFound desc = could not find container \"df77a40ddeaf7c77bee47ae8bc706c1d7f8e60007ca0fd1bb7db40634d50c70b\": container with ID starting with df77a40ddeaf7c77bee47ae8bc706c1d7f8e60007ca0fd1bb7db40634d50c70b not found: ID does not exist" Jul 13 03:02:46.394056 ip-10-0-134-52 kubenswrapper[2558]: I0713 03:02:46.394034 2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-tls\"" Jul 13 03:02:46.394133 ip-10-0-134-52 kubenswrapper[2558]: I0713 03:02:46.394075 2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-dockercfg-bq2z4\"" Jul 13 03:02:46.394133 ip-10-0-134-52 kubenswrapper[2558]: I0713 03:02:46.394039 2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-cluster-tls-config\"" Jul 13 03:02:46.394133 ip-10-0-134-52 kubenswrapper[2558]: I0713 03:02:46.394114 2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-kube-rbac-proxy-web\"" Jul 13 03:02:46.394269 ip-10-0-134-52 kubenswrapper[2558]: I0713 03:02:46.394149 2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-kube-rbac-proxy\"" Jul 13 03:02:46.394311 ip-10-0-134-52 kubenswrapper[2558]: I0713 03:02:46.394289 2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-kube-rbac-proxy-metric\"" Jul 13 03:02:46.394485 ip-10-0-134-52 kubenswrapper[2558]: I0713 03:02:46.394470 2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-web-config\"" Jul 13 03:02:46.394552 ip-10-0-134-52 kubenswrapper[2558]: I0713 03:02:46.394511 2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-generated\"" Jul 13 03:02:46.394552 ip-10-0-134-52 kubenswrapper[2558]: I0713 03:02:46.394525 2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-tls-assets-0\"" Jul 13 03:02:46.399520 ip-10-0-134-52 kubenswrapper[2558]: I0713 03:02:46.399502 2558 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"alertmanager-trusted-ca-bundle\"" Jul 13 03:02:46.404551 ip-10-0-134-52 kubenswrapper[2558]: I0713 03:02:46.404528 2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/alertmanager-main-0"] Jul 13 03:02:46.520031 ip-10-0-134-52 kubenswrapper[2558]: I0713 03:02:46.519998 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/427741a2-bf37-4342-9132-b2a324768fb2-secret-alertmanager-kube-rbac-proxy-metric\") pod \"alertmanager-main-0\" (UID: \"427741a2-bf37-4342-9132-b2a324768fb2\") " pod="openshift-monitoring/alertmanager-main-0" Jul 13 03:02:46.520031 ip-10-0-134-52 kubenswrapper[2558]: I0713 03:02:46.520035 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/427741a2-bf37-4342-9132-b2a324768fb2-secret-alertmanager-main-tls\") pod \"alertmanager-main-0\" (UID: \"427741a2-bf37-4342-9132-b2a324768fb2\") " pod="openshift-monitoring/alertmanager-main-0" Jul 13 03:02:46.520248 ip-10-0-134-52 kubenswrapper[2558]: I0713 03:02:46.520063 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/427741a2-bf37-4342-9132-b2a324768fb2-web-config\") pod \"alertmanager-main-0\" (UID: \"427741a2-bf37-4342-9132-b2a324768fb2\") " pod="openshift-monitoring/alertmanager-main-0" Jul 13 03:02:46.520248 ip-10-0-134-52 kubenswrapper[2558]: I0713 03:02:46.520105 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/427741a2-bf37-4342-9132-b2a324768fb2-config-out\") pod \"alertmanager-main-0\" (UID: \"427741a2-bf37-4342-9132-b2a324768fb2\") " pod="openshift-monitoring/alertmanager-main-0" Jul 13 03:02:46.520248 ip-10-0-134-52 kubenswrapper[2558]: I0713 03:02:46.520177 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/427741a2-bf37-4342-9132-b2a324768fb2-tls-assets\") pod \"alertmanager-main-0\" (UID: \"427741a2-bf37-4342-9132-b2a324768fb2\") " pod="openshift-monitoring/alertmanager-main-0" Jul 13 03:02:46.520248 ip-10-0-134-52 kubenswrapper[2558]: I0713 03:02:46.520202 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/427741a2-bf37-4342-9132-b2a324768fb2-secret-alertmanager-kube-rbac-proxy-web\") pod \"alertmanager-main-0\" (UID: \"427741a2-bf37-4342-9132-b2a324768fb2\") " pod="openshift-monitoring/alertmanager-main-0" Jul 13 03:02:46.520248 ip-10-0-134-52 kubenswrapper[2558]: I0713 03:02:46.520225 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/427741a2-bf37-4342-9132-b2a324768fb2-config-volume\") pod \"alertmanager-main-0\" (UID: \"427741a2-bf37-4342-9132-b2a324768fb2\") " pod="openshift-monitoring/alertmanager-main-0" Jul 13 03:02:46.520502 ip-10-0-134-52 kubenswrapper[2558]: I0713 03:02:46.520256 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/427741a2-bf37-4342-9132-b2a324768fb2-metrics-client-ca\") pod \"alertmanager-main-0\" (UID: \"427741a2-bf37-4342-9132-b2a324768fb2\") " pod="openshift-monitoring/alertmanager-main-0" Jul 13 03:02:46.520502 ip-10-0-134-52 kubenswrapper[2558]: I0713 03:02:46.520280 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-tv9sg\" (UniqueName: \"kubernetes.io/projected/427741a2-bf37-4342-9132-b2a324768fb2-kube-api-access-tv9sg\") pod \"alertmanager-main-0\" (UID: \"427741a2-bf37-4342-9132-b2a324768fb2\") " pod="openshift-monitoring/alertmanager-main-0" Jul 13 03:02:46.520502 ip-10-0-134-52 kubenswrapper[2558]: I0713 03:02:46.520299 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/427741a2-bf37-4342-9132-b2a324768fb2-alertmanager-main-db\") pod \"alertmanager-main-0\" (UID: \"427741a2-bf37-4342-9132-b2a324768fb2\") " pod="openshift-monitoring/alertmanager-main-0" Jul 13 03:02:46.520502 ip-10-0-134-52 kubenswrapper[2558]: I0713 03:02:46.520313 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/427741a2-bf37-4342-9132-b2a324768fb2-alertmanager-trusted-ca-bundle\") pod \"alertmanager-main-0\" (UID: \"427741a2-bf37-4342-9132-b2a324768fb2\") " pod="openshift-monitoring/alertmanager-main-0" Jul 13 03:02:46.520502 ip-10-0-134-52 kubenswrapper[2558]: I0713 03:02:46.520380 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/427741a2-bf37-4342-9132-b2a324768fb2-secret-alertmanager-kube-rbac-proxy\") pod \"alertmanager-main-0\" (UID: \"427741a2-bf37-4342-9132-b2a324768fb2\") " pod="openshift-monitoring/alertmanager-main-0" Jul 13 03:02:46.520502 ip-10-0-134-52 kubenswrapper[2558]: I0713 03:02:46.520408 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/427741a2-bf37-4342-9132-b2a324768fb2-cluster-tls-config\") pod \"alertmanager-main-0\" (UID: \"427741a2-bf37-4342-9132-b2a324768fb2\") " pod="openshift-monitoring/alertmanager-main-0" Jul 13 03:02:46.620870 ip-10-0-134-52 kubenswrapper[2558]: I0713 03:02:46.620803 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/427741a2-bf37-4342-9132-b2a324768fb2-secret-alertmanager-kube-rbac-proxy-metric\") pod \"alertmanager-main-0\" (UID: \"427741a2-bf37-4342-9132-b2a324768fb2\") " pod="openshift-monitoring/alertmanager-main-0" Jul 13 03:02:46.620870 ip-10-0-134-52 kubenswrapper[2558]: I0713 03:02:46.620843 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/427741a2-bf37-4342-9132-b2a324768fb2-secret-alertmanager-main-tls\") pod \"alertmanager-main-0\" (UID: \"427741a2-bf37-4342-9132-b2a324768fb2\") " pod="openshift-monitoring/alertmanager-main-0" Jul 13 03:02:46.620870 ip-10-0-134-52 kubenswrapper[2558]: I0713 03:02:46.620860 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/427741a2-bf37-4342-9132-b2a324768fb2-web-config\") pod \"alertmanager-main-0\" (UID: \"427741a2-bf37-4342-9132-b2a324768fb2\") " pod="openshift-monitoring/alertmanager-main-0" Jul 13 03:02:46.621051 ip-10-0-134-52 kubenswrapper[2558]: I0713 03:02:46.620879 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/427741a2-bf37-4342-9132-b2a324768fb2-config-out\") pod \"alertmanager-main-0\" (UID: \"427741a2-bf37-4342-9132-b2a324768fb2\") " pod="openshift-monitoring/alertmanager-main-0" Jul 13 03:02:46.621051 ip-10-0-134-52 kubenswrapper[2558]: I0713 03:02:46.620921 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/427741a2-bf37-4342-9132-b2a324768fb2-tls-assets\") pod \"alertmanager-main-0\" (UID: \"427741a2-bf37-4342-9132-b2a324768fb2\") " pod="openshift-monitoring/alertmanager-main-0" Jul 13 03:02:46.621051 ip-10-0-134-52 kubenswrapper[2558]: I0713 03:02:46.620939 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/427741a2-bf37-4342-9132-b2a324768fb2-secret-alertmanager-kube-rbac-proxy-web\") pod \"alertmanager-main-0\" (UID: \"427741a2-bf37-4342-9132-b2a324768fb2\") " pod="openshift-monitoring/alertmanager-main-0" Jul 13 03:02:46.621051 ip-10-0-134-52 kubenswrapper[2558]: I0713 03:02:46.620956 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/427741a2-bf37-4342-9132-b2a324768fb2-config-volume\") pod \"alertmanager-main-0\" (UID: \"427741a2-bf37-4342-9132-b2a324768fb2\") " pod="openshift-monitoring/alertmanager-main-0" Jul 13 03:02:46.621051 ip-10-0-134-52 kubenswrapper[2558]: I0713 03:02:46.620977 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/427741a2-bf37-4342-9132-b2a324768fb2-metrics-client-ca\") pod \"alertmanager-main-0\" (UID: \"427741a2-bf37-4342-9132-b2a324768fb2\") " pod="openshift-monitoring/alertmanager-main-0" Jul 13 03:02:46.621051 ip-10-0-134-52 kubenswrapper[2558]: I0713 03:02:46.621000 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-tv9sg\" (UniqueName: \"kubernetes.io/projected/427741a2-bf37-4342-9132-b2a324768fb2-kube-api-access-tv9sg\") pod \"alertmanager-main-0\" (UID: \"427741a2-bf37-4342-9132-b2a324768fb2\") " pod="openshift-monitoring/alertmanager-main-0" Jul 13 03:02:46.621051 ip-10-0-134-52 kubenswrapper[2558]: I0713 03:02:46.621026 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/427741a2-bf37-4342-9132-b2a324768fb2-alertmanager-main-db\") pod \"alertmanager-main-0\" (UID: \"427741a2-bf37-4342-9132-b2a324768fb2\") " pod="openshift-monitoring/alertmanager-main-0" Jul 13 03:02:46.621051 ip-10-0-134-52 kubenswrapper[2558]: I0713 03:02:46.621049 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/427741a2-bf37-4342-9132-b2a324768fb2-alertmanager-trusted-ca-bundle\") pod \"alertmanager-main-0\" (UID: \"427741a2-bf37-4342-9132-b2a324768fb2\") " pod="openshift-monitoring/alertmanager-main-0" Jul 13 03:02:46.621467 ip-10-0-134-52 kubenswrapper[2558]: I0713 03:02:46.621080 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/427741a2-bf37-4342-9132-b2a324768fb2-secret-alertmanager-kube-rbac-proxy\") pod \"alertmanager-main-0\" (UID: \"427741a2-bf37-4342-9132-b2a324768fb2\") " pod="openshift-monitoring/alertmanager-main-0" Jul 13 03:02:46.621467 ip-10-0-134-52 kubenswrapper[2558]: I0713 03:02:46.621107 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/427741a2-bf37-4342-9132-b2a324768fb2-cluster-tls-config\") pod \"alertmanager-main-0\" (UID: \"427741a2-bf37-4342-9132-b2a324768fb2\") " pod="openshift-monitoring/alertmanager-main-0" Jul 13 03:02:46.623946 ip-10-0-134-52 kubenswrapper[2558]: I0713 03:02:46.623915 2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/427741a2-bf37-4342-9132-b2a324768fb2-config-out\") pod \"alertmanager-main-0\" (UID: \"427741a2-bf37-4342-9132-b2a324768fb2\") " pod="openshift-monitoring/alertmanager-main-0" Jul 13 03:02:46.624092 ip-10-0-134-52 kubenswrapper[2558]: I0713 03:02:46.624060 2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/427741a2-bf37-4342-9132-b2a324768fb2-secret-alertmanager-kube-rbac-proxy-web\") pod \"alertmanager-main-0\" (UID: \"427741a2-bf37-4342-9132-b2a324768fb2\") " pod="openshift-monitoring/alertmanager-main-0" Jul 13 03:02:46.624092 ip-10-0-134-52 kubenswrapper[2558]: I0713 03:02:46.624089 2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/427741a2-bf37-4342-9132-b2a324768fb2-secret-alertmanager-main-tls\") pod \"alertmanager-main-0\" (UID: \"427741a2-bf37-4342-9132-b2a324768fb2\") " pod="openshift-monitoring/alertmanager-main-0" Jul 13 03:02:46.624263 ip-10-0-134-52 kubenswrapper[2558]: I0713 03:02:46.624126 2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/427741a2-bf37-4342-9132-b2a324768fb2-tls-assets\") pod \"alertmanager-main-0\" (UID: \"427741a2-bf37-4342-9132-b2a324768fb2\") " pod="openshift-monitoring/alertmanager-main-0" Jul 13 03:02:46.624263 ip-10-0-134-52 kubenswrapper[2558]: I0713 03:02:46.624186 2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/427741a2-bf37-4342-9132-b2a324768fb2-web-config\") pod \"alertmanager-main-0\" (UID: \"427741a2-bf37-4342-9132-b2a324768fb2\") " pod="openshift-monitoring/alertmanager-main-0" Jul 13 03:02:46.624379 ip-10-0-134-52 kubenswrapper[2558]: I0713 03:02:46.624260 2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/427741a2-bf37-4342-9132-b2a324768fb2-cluster-tls-config\") pod \"alertmanager-main-0\" (UID: \"427741a2-bf37-4342-9132-b2a324768fb2\") " pod="openshift-monitoring/alertmanager-main-0" Jul 13 03:02:46.624420 ip-10-0-134-52 kubenswrapper[2558]: I0713 03:02:46.624394 2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/427741a2-bf37-4342-9132-b2a324768fb2-alertmanager-main-db\") pod \"alertmanager-main-0\" (UID: \"427741a2-bf37-4342-9132-b2a324768fb2\") " pod="openshift-monitoring/alertmanager-main-0" Jul 13 03:02:46.624453 ip-10-0-134-52 kubenswrapper[2558]: I0713 03:02:46.624430 2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/427741a2-bf37-4342-9132-b2a324768fb2-secret-alertmanager-kube-rbac-proxy-metric\") pod \"alertmanager-main-0\" (UID: \"427741a2-bf37-4342-9132-b2a324768fb2\") " pod="openshift-monitoring/alertmanager-main-0" Jul 13 03:02:46.624626 ip-10-0-134-52 kubenswrapper[2558]: I0713 03:02:46.624602 2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/427741a2-bf37-4342-9132-b2a324768fb2-metrics-client-ca\") pod \"alertmanager-main-0\" (UID: \"427741a2-bf37-4342-9132-b2a324768fb2\") " pod="openshift-monitoring/alertmanager-main-0" Jul 13 03:02:46.624875 ip-10-0-134-52 kubenswrapper[2558]: I0713 03:02:46.624857 2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/427741a2-bf37-4342-9132-b2a324768fb2-alertmanager-trusted-ca-bundle\") pod \"alertmanager-main-0\" (UID: \"427741a2-bf37-4342-9132-b2a324768fb2\") " pod="openshift-monitoring/alertmanager-main-0" Jul 13 03:02:46.624996 ip-10-0-134-52 kubenswrapper[2558]: I0713 03:02:46.624978 2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/427741a2-bf37-4342-9132-b2a324768fb2-config-volume\") pod \"alertmanager-main-0\" (UID: \"427741a2-bf37-4342-9132-b2a324768fb2\") " pod="openshift-monitoring/alertmanager-main-0" Jul 13 03:02:46.626146 ip-10-0-134-52 kubenswrapper[2558]: I0713 03:02:46.626130 2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/427741a2-bf37-4342-9132-b2a324768fb2-secret-alertmanager-kube-rbac-proxy\") pod \"alertmanager-main-0\" (UID: \"427741a2-bf37-4342-9132-b2a324768fb2\") " pod="openshift-monitoring/alertmanager-main-0" Jul 13 03:02:46.629992 ip-10-0-134-52 kubenswrapper[2558]: I0713 03:02:46.629968 2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-tv9sg\" (UniqueName: \"kubernetes.io/projected/427741a2-bf37-4342-9132-b2a324768fb2-kube-api-access-tv9sg\") pod \"alertmanager-main-0\" (UID: \"427741a2-bf37-4342-9132-b2a324768fb2\") " pod="openshift-monitoring/alertmanager-main-0" Jul 13 03:02:46.701999 ip-10-0-134-52 kubenswrapper[2558]: I0713 03:02:46.701980 2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/alertmanager-main-0" Jul 13 03:02:46.835806 ip-10-0-134-52 kubenswrapper[2558]: I0713 03:02:46.835483 2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/alertmanager-main-0"] Jul 13 03:02:46.838159 ip-10-0-134-52 kubenswrapper[2558]: W0713 03:02:46.838131 2558 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod427741a2_bf37_4342_9132_b2a324768fb2.slice/crio-b9928c05d038fbb3b915aa74d80d5828d5fa809755a9b0ce698808563e60bb42 WatchSource:0}: Error finding container b9928c05d038fbb3b915aa74d80d5828d5fa809755a9b0ce698808563e60bb42: Status 404 returned error can't find the container with id b9928c05d038fbb3b915aa74d80d5828d5fa809755a9b0ce698808563e60bb42 Jul 13 03:02:47.341007 ip-10-0-134-52 kubenswrapper[2558]: I0713 03:02:47.340979 2558 generic.go:356] "Generic (PLEG): container finished" podID="427741a2-bf37-4342-9132-b2a324768fb2" containerID="e71e57d99b6fa09089f83db06aa9875b4f88de28d95fecadb979bb20d7628dac" exitCode=0 Jul 13 03:02:47.341413 ip-10-0-134-52 kubenswrapper[2558]: I0713 03:02:47.341054 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"427741a2-bf37-4342-9132-b2a324768fb2","Type":"ContainerDied","Data":"e71e57d99b6fa09089f83db06aa9875b4f88de28d95fecadb979bb20d7628dac"} Jul 13 03:02:47.341413 ip-10-0-134-52 kubenswrapper[2558]: I0713 03:02:47.341115 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"427741a2-bf37-4342-9132-b2a324768fb2","Type":"ContainerStarted","Data":"b9928c05d038fbb3b915aa74d80d5828d5fa809755a9b0ce698808563e60bb42"} Jul 13 03:02:48.091532 ip-10-0-134-52 kubenswrapper[2558]: I0713 03:02:48.091500 2558 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="efab6d01-9fed-48f2-8343-7423fd04ecd7" path="/var/lib/kubelet/pods/efab6d01-9fed-48f2-8343-7423fd04ecd7/volumes" Jul 13 03:02:48.351549 ip-10-0-134-52 kubenswrapper[2558]: I0713 03:02:48.351479 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"427741a2-bf37-4342-9132-b2a324768fb2","Type":"ContainerStarted","Data":"c33b031d9503f6f7a608be4fb23ce402ee7118aded7385798a9d04784780fafe"} Jul 13 03:02:48.351549 ip-10-0-134-52 kubenswrapper[2558]: I0713 03:02:48.351538 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"427741a2-bf37-4342-9132-b2a324768fb2","Type":"ContainerStarted","Data":"ac41d4e0cce60a30458aa4bac70ef8ea7e21c0406d3a31d4af536e954eca6b73"} Jul 13 03:02:48.351884 ip-10-0-134-52 kubenswrapper[2558]: I0713 03:02:48.351564 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"427741a2-bf37-4342-9132-b2a324768fb2","Type":"ContainerStarted","Data":"98cbc59ffd257c50f305abf38803897b10e166c65676e7f914474591ebd8af61"} Jul 13 03:02:48.351884 ip-10-0-134-52 kubenswrapper[2558]: I0713 03:02:48.351588 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"427741a2-bf37-4342-9132-b2a324768fb2","Type":"ContainerStarted","Data":"4696059d78e751a6f972e61f5d4c94d5c0216536dd21902c9f98a3c10f414bfd"} Jul 13 03:02:48.351884 ip-10-0-134-52 kubenswrapper[2558]: I0713 03:02:48.351622 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"427741a2-bf37-4342-9132-b2a324768fb2","Type":"ContainerStarted","Data":"3f31d1e0632a3b2c8012c71925cc72f5db4b78cec4489938a23aaf3c392c1435"} Jul 13 03:02:48.351884 ip-10-0-134-52 kubenswrapper[2558]: I0713 03:02:48.351652 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"427741a2-bf37-4342-9132-b2a324768fb2","Type":"ContainerStarted","Data":"8ca35424bc9bcfc148e1a5bd0b5ed25e306f60aff75d0f4e7349d22a18fd53c1"} Jul 13 03:02:48.380071 ip-10-0-134-52 kubenswrapper[2558]: I0713 03:02:48.380027 2558 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/alertmanager-main-0" podStartSLOduration=2.362403725 podStartE2EDuration="2.380012312s" totalImagesPullingTime="0s" totalInitContainerRuntime="17.608587ms" isStatefulPod=false podCreationTimestamp="2026-07-13 03:02:46 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-13 03:02:48.378072903 +0000 UTC m=+350.778673384" watchObservedRunningTime="2026-07-13 03:02:48.380012312 +0000 UTC m=+350.780612778" Jul 13 03:02:53.592598 ip-10-0-134-52 kubenswrapper[2558]: I0713 03:02:53.592563 2558 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console/console-69dbcf8cc8-l28dx"] Jul 13 03:02:53.595959 ip-10-0-134-52 kubenswrapper[2558]: I0713 03:02:53.595941 2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-69dbcf8cc8-l28dx" Jul 13 03:02:53.608013 ip-10-0-134-52 kubenswrapper[2558]: I0713 03:02:53.607988 2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-69dbcf8cc8-l28dx"] Jul 13 03:02:53.673974 ip-10-0-134-52 kubenswrapper[2558]: I0713 03:02:53.673946 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/1c9fce77-2489-47e9-b6f9-d62fe5756e7d-console-oauth-config\") pod \"console-69dbcf8cc8-l28dx\" (UID: \"1c9fce77-2489-47e9-b6f9-d62fe5756e7d\") " pod="openshift-console/console-69dbcf8cc8-l28dx" Jul 13 03:02:53.674079 ip-10-0-134-52 kubenswrapper[2558]: I0713 03:02:53.673985 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-dtl44\" (UniqueName: \"kubernetes.io/projected/1c9fce77-2489-47e9-b6f9-d62fe5756e7d-kube-api-access-dtl44\") pod \"console-69dbcf8cc8-l28dx\" (UID: \"1c9fce77-2489-47e9-b6f9-d62fe5756e7d\") " pod="openshift-console/console-69dbcf8cc8-l28dx" Jul 13 03:02:53.674079 ip-10-0-134-52 kubenswrapper[2558]: I0713 03:02:53.674009 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/1c9fce77-2489-47e9-b6f9-d62fe5756e7d-trusted-ca-bundle\") pod \"console-69dbcf8cc8-l28dx\" (UID: \"1c9fce77-2489-47e9-b6f9-d62fe5756e7d\") " pod="openshift-console/console-69dbcf8cc8-l28dx" Jul 13 03:02:53.674200 ip-10-0-134-52 kubenswrapper[2558]: I0713 03:02:53.674126 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/1c9fce77-2489-47e9-b6f9-d62fe5756e7d-console-serving-cert\") pod \"console-69dbcf8cc8-l28dx\" (UID: \"1c9fce77-2489-47e9-b6f9-d62fe5756e7d\") " pod="openshift-console/console-69dbcf8cc8-l28dx" Jul 13 03:02:53.674200 ip-10-0-134-52 kubenswrapper[2558]: I0713 03:02:53.674178 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/1c9fce77-2489-47e9-b6f9-d62fe5756e7d-console-config\") pod \"console-69dbcf8cc8-l28dx\" (UID: \"1c9fce77-2489-47e9-b6f9-d62fe5756e7d\") " pod="openshift-console/console-69dbcf8cc8-l28dx" Jul 13 03:02:53.674293 ip-10-0-134-52 kubenswrapper[2558]: I0713 03:02:53.674205 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/1c9fce77-2489-47e9-b6f9-d62fe5756e7d-oauth-serving-cert\") pod \"console-69dbcf8cc8-l28dx\" (UID: \"1c9fce77-2489-47e9-b6f9-d62fe5756e7d\") " pod="openshift-console/console-69dbcf8cc8-l28dx" Jul 13 03:02:53.674293 ip-10-0-134-52 kubenswrapper[2558]: I0713 03:02:53.674249 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/1c9fce77-2489-47e9-b6f9-d62fe5756e7d-service-ca\") pod \"console-69dbcf8cc8-l28dx\" (UID: \"1c9fce77-2489-47e9-b6f9-d62fe5756e7d\") " pod="openshift-console/console-69dbcf8cc8-l28dx" Jul 13 03:02:53.775090 ip-10-0-134-52 kubenswrapper[2558]: I0713 03:02:53.775066 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/1c9fce77-2489-47e9-b6f9-d62fe5756e7d-console-oauth-config\") pod \"console-69dbcf8cc8-l28dx\" (UID: \"1c9fce77-2489-47e9-b6f9-d62fe5756e7d\") " pod="openshift-console/console-69dbcf8cc8-l28dx" Jul 13 03:02:53.775179 ip-10-0-134-52 kubenswrapper[2558]: I0713 03:02:53.775099 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-dtl44\" (UniqueName: \"kubernetes.io/projected/1c9fce77-2489-47e9-b6f9-d62fe5756e7d-kube-api-access-dtl44\") pod \"console-69dbcf8cc8-l28dx\" (UID: \"1c9fce77-2489-47e9-b6f9-d62fe5756e7d\") " pod="openshift-console/console-69dbcf8cc8-l28dx" Jul 13 03:02:53.775179 ip-10-0-134-52 kubenswrapper[2558]: I0713 03:02:53.775121 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/1c9fce77-2489-47e9-b6f9-d62fe5756e7d-trusted-ca-bundle\") pod \"console-69dbcf8cc8-l28dx\" (UID: \"1c9fce77-2489-47e9-b6f9-d62fe5756e7d\") " pod="openshift-console/console-69dbcf8cc8-l28dx" Jul 13 03:02:53.775380 ip-10-0-134-52 kubenswrapper[2558]: I0713 03:02:53.775261 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/1c9fce77-2489-47e9-b6f9-d62fe5756e7d-console-serving-cert\") pod \"console-69dbcf8cc8-l28dx\" (UID: \"1c9fce77-2489-47e9-b6f9-d62fe5756e7d\") " pod="openshift-console/console-69dbcf8cc8-l28dx" Jul 13 03:02:53.775380 ip-10-0-134-52 kubenswrapper[2558]: I0713 03:02:53.775312 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/1c9fce77-2489-47e9-b6f9-d62fe5756e7d-console-config\") pod \"console-69dbcf8cc8-l28dx\" (UID: \"1c9fce77-2489-47e9-b6f9-d62fe5756e7d\") " pod="openshift-console/console-69dbcf8cc8-l28dx" Jul 13 03:02:53.775380 ip-10-0-134-52 kubenswrapper[2558]: I0713 03:02:53.775362 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/1c9fce77-2489-47e9-b6f9-d62fe5756e7d-oauth-serving-cert\") pod \"console-69dbcf8cc8-l28dx\" (UID: \"1c9fce77-2489-47e9-b6f9-d62fe5756e7d\") " pod="openshift-console/console-69dbcf8cc8-l28dx" Jul 13 03:02:53.775524 ip-10-0-134-52 kubenswrapper[2558]: I0713 03:02:53.775407 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/1c9fce77-2489-47e9-b6f9-d62fe5756e7d-service-ca\") pod \"console-69dbcf8cc8-l28dx\" (UID: \"1c9fce77-2489-47e9-b6f9-d62fe5756e7d\") " pod="openshift-console/console-69dbcf8cc8-l28dx" Jul 13 03:02:53.775967 ip-10-0-134-52 kubenswrapper[2558]: I0713 03:02:53.775939 2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/1c9fce77-2489-47e9-b6f9-d62fe5756e7d-console-config\") pod \"console-69dbcf8cc8-l28dx\" (UID: \"1c9fce77-2489-47e9-b6f9-d62fe5756e7d\") " pod="openshift-console/console-69dbcf8cc8-l28dx" Jul 13 03:02:53.776053 ip-10-0-134-52 kubenswrapper[2558]: I0713 03:02:53.776034 2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/1c9fce77-2489-47e9-b6f9-d62fe5756e7d-service-ca\") pod \"console-69dbcf8cc8-l28dx\" (UID: \"1c9fce77-2489-47e9-b6f9-d62fe5756e7d\") " pod="openshift-console/console-69dbcf8cc8-l28dx" Jul 13 03:02:53.776261 ip-10-0-134-52 kubenswrapper[2558]: I0713 03:02:53.776236 2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/1c9fce77-2489-47e9-b6f9-d62fe5756e7d-oauth-serving-cert\") pod \"console-69dbcf8cc8-l28dx\" (UID: \"1c9fce77-2489-47e9-b6f9-d62fe5756e7d\") " pod="openshift-console/console-69dbcf8cc8-l28dx" Jul 13 03:02:53.776352 ip-10-0-134-52 kubenswrapper[2558]: I0713 03:02:53.776310 2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/1c9fce77-2489-47e9-b6f9-d62fe5756e7d-trusted-ca-bundle\") pod \"console-69dbcf8cc8-l28dx\" (UID: \"1c9fce77-2489-47e9-b6f9-d62fe5756e7d\") " pod="openshift-console/console-69dbcf8cc8-l28dx" Jul 13 03:02:53.777814 ip-10-0-134-52 kubenswrapper[2558]: I0713 03:02:53.777793 2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/1c9fce77-2489-47e9-b6f9-d62fe5756e7d-console-oauth-config\") pod \"console-69dbcf8cc8-l28dx\" (UID: \"1c9fce77-2489-47e9-b6f9-d62fe5756e7d\") " pod="openshift-console/console-69dbcf8cc8-l28dx" Jul 13 03:02:53.777864 ip-10-0-134-52 kubenswrapper[2558]: I0713 03:02:53.777832 2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/1c9fce77-2489-47e9-b6f9-d62fe5756e7d-console-serving-cert\") pod \"console-69dbcf8cc8-l28dx\" (UID: \"1c9fce77-2489-47e9-b6f9-d62fe5756e7d\") " pod="openshift-console/console-69dbcf8cc8-l28dx" Jul 13 03:02:53.783671 ip-10-0-134-52 kubenswrapper[2558]: I0713 03:02:53.783650 2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-dtl44\" (UniqueName: \"kubernetes.io/projected/1c9fce77-2489-47e9-b6f9-d62fe5756e7d-kube-api-access-dtl44\") pod \"console-69dbcf8cc8-l28dx\" (UID: \"1c9fce77-2489-47e9-b6f9-d62fe5756e7d\") " pod="openshift-console/console-69dbcf8cc8-l28dx" Jul 13 03:02:53.904926 ip-10-0-134-52 kubenswrapper[2558]: I0713 03:02:53.904858 2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-69dbcf8cc8-l28dx" Jul 13 03:02:54.034509 ip-10-0-134-52 kubenswrapper[2558]: I0713 03:02:54.034483 2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-69dbcf8cc8-l28dx"] Jul 13 03:02:54.036405 ip-10-0-134-52 kubenswrapper[2558]: W0713 03:02:54.036370 2558 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod1c9fce77_2489_47e9_b6f9_d62fe5756e7d.slice/crio-f7c0f05d13503f5306e94b1d89673771a0dd4ec9acd8bd4bf4c3d004e7b7f3af WatchSource:0}: Error finding container f7c0f05d13503f5306e94b1d89673771a0dd4ec9acd8bd4bf4c3d004e7b7f3af: Status 404 returned error can't find the container with id f7c0f05d13503f5306e94b1d89673771a0dd4ec9acd8bd4bf4c3d004e7b7f3af Jul 13 03:02:54.376772 ip-10-0-134-52 kubenswrapper[2558]: I0713 03:02:54.376735 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-69dbcf8cc8-l28dx" event={"ID":"1c9fce77-2489-47e9-b6f9-d62fe5756e7d","Type":"ContainerStarted","Data":"eb1a52ae6c4056b054da999eec459f42092cad0fce1c265d0ace37a4160588fa"} Jul 13 03:02:54.376921 ip-10-0-134-52 kubenswrapper[2558]: I0713 03:02:54.376788 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-69dbcf8cc8-l28dx" event={"ID":"1c9fce77-2489-47e9-b6f9-d62fe5756e7d","Type":"ContainerStarted","Data":"f7c0f05d13503f5306e94b1d89673771a0dd4ec9acd8bd4bf4c3d004e7b7f3af"} Jul 13 03:02:54.395491 ip-10-0-134-52 kubenswrapper[2558]: I0713 03:02:54.395446 2558 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console/console-69dbcf8cc8-l28dx" podStartSLOduration=1.395431376 podStartE2EDuration="1.395431376s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-13 03:02:53 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-13 03:02:54.3940178 +0000 UTC m=+356.794618282" watchObservedRunningTime="2026-07-13 03:02:54.395431376 +0000 UTC m=+356.796031841" Jul 13 03:03:03.905947 ip-10-0-134-52 kubenswrapper[2558]: I0713 03:03:03.905909 2558 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/console-69dbcf8cc8-l28dx" Jul 13 03:03:03.906420 ip-10-0-134-52 kubenswrapper[2558]: I0713 03:03:03.905976 2558 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-console/console-69dbcf8cc8-l28dx" Jul 13 03:03:03.910680 ip-10-0-134-52 kubenswrapper[2558]: I0713 03:03:03.910655 2558 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-console/console-69dbcf8cc8-l28dx" Jul 13 03:03:04.422236 ip-10-0-134-52 kubenswrapper[2558]: I0713 03:03:04.422204 2558 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console/console-69dbcf8cc8-l28dx" Jul 13 03:03:04.470127 ip-10-0-134-52 kubenswrapper[2558]: I0713 03:03:04.470098 2558 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-76bb9cd886-whw2t"] Jul 13 03:03:29.492407 ip-10-0-134-52 kubenswrapper[2558]: I0713 03:03:29.492349 2558 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-console/console-76bb9cd886-whw2t" podUID="54a4fc9b-27ee-4012-9bac-589d5d00e235" containerName="console" containerID="cri-o://7fa62d9a1ce46878fee758db36bc0f788c80a62f87ac55af0f9ce50a23c06e2c" gracePeriod=15 Jul 13 03:03:29.746226 ip-10-0-134-52 kubenswrapper[2558]: I0713 03:03:29.746165 2558 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-76bb9cd886-whw2t" Jul 13 03:03:29.914857 ip-10-0-134-52 kubenswrapper[2558]: I0713 03:03:29.914828 2558 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/54a4fc9b-27ee-4012-9bac-589d5d00e235-trusted-ca-bundle\") pod \"54a4fc9b-27ee-4012-9bac-589d5d00e235\" (UID: \"54a4fc9b-27ee-4012-9bac-589d5d00e235\") " Jul 13 03:03:29.915010 ip-10-0-134-52 kubenswrapper[2558]: I0713 03:03:29.914864 2558 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/54a4fc9b-27ee-4012-9bac-589d5d00e235-console-serving-cert\") pod \"54a4fc9b-27ee-4012-9bac-589d5d00e235\" (UID: \"54a4fc9b-27ee-4012-9bac-589d5d00e235\") " Jul 13 03:03:29.915010 ip-10-0-134-52 kubenswrapper[2558]: I0713 03:03:29.914890 2558 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/54a4fc9b-27ee-4012-9bac-589d5d00e235-console-config\") pod \"54a4fc9b-27ee-4012-9bac-589d5d00e235\" (UID: \"54a4fc9b-27ee-4012-9bac-589d5d00e235\") " Jul 13 03:03:29.915010 ip-10-0-134-52 kubenswrapper[2558]: I0713 03:03:29.914910 2558 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/54a4fc9b-27ee-4012-9bac-589d5d00e235-oauth-serving-cert\") pod \"54a4fc9b-27ee-4012-9bac-589d5d00e235\" (UID: \"54a4fc9b-27ee-4012-9bac-589d5d00e235\") " Jul 13 03:03:29.915010 ip-10-0-134-52 kubenswrapper[2558]: I0713 03:03:29.914951 2558 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/54a4fc9b-27ee-4012-9bac-589d5d00e235-service-ca\") pod \"54a4fc9b-27ee-4012-9bac-589d5d00e235\" (UID: \"54a4fc9b-27ee-4012-9bac-589d5d00e235\") " Jul 13 03:03:29.915010 ip-10-0-134-52 kubenswrapper[2558]: I0713 03:03:29.914983 2558 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/54a4fc9b-27ee-4012-9bac-589d5d00e235-console-oauth-config\") pod \"54a4fc9b-27ee-4012-9bac-589d5d00e235\" (UID: \"54a4fc9b-27ee-4012-9bac-589d5d00e235\") " Jul 13 03:03:29.915010 ip-10-0-134-52 kubenswrapper[2558]: I0713 03:03:29.915000 2558 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-4p97d\" (UniqueName: \"kubernetes.io/projected/54a4fc9b-27ee-4012-9bac-589d5d00e235-kube-api-access-4p97d\") pod \"54a4fc9b-27ee-4012-9bac-589d5d00e235\" (UID: \"54a4fc9b-27ee-4012-9bac-589d5d00e235\") " Jul 13 03:03:29.915365 ip-10-0-134-52 kubenswrapper[2558]: I0713 03:03:29.915309 2558 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/54a4fc9b-27ee-4012-9bac-589d5d00e235-console-config" (OuterVolumeSpecName: "console-config") pod "54a4fc9b-27ee-4012-9bac-589d5d00e235" (UID: "54a4fc9b-27ee-4012-9bac-589d5d00e235"). InnerVolumeSpecName "console-config". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 13 03:03:29.915503 ip-10-0-134-52 kubenswrapper[2558]: I0713 03:03:29.915371 2558 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/54a4fc9b-27ee-4012-9bac-589d5d00e235-trusted-ca-bundle" (OuterVolumeSpecName: "trusted-ca-bundle") pod "54a4fc9b-27ee-4012-9bac-589d5d00e235" (UID: "54a4fc9b-27ee-4012-9bac-589d5d00e235"). InnerVolumeSpecName "trusted-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 13 03:03:29.915503 ip-10-0-134-52 kubenswrapper[2558]: I0713 03:03:29.915428 2558 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/54a4fc9b-27ee-4012-9bac-589d5d00e235-oauth-serving-cert" (OuterVolumeSpecName: "oauth-serving-cert") pod "54a4fc9b-27ee-4012-9bac-589d5d00e235" (UID: "54a4fc9b-27ee-4012-9bac-589d5d00e235"). InnerVolumeSpecName "oauth-serving-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 13 03:03:29.915747 ip-10-0-134-52 kubenswrapper[2558]: I0713 03:03:29.915721 2558 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/54a4fc9b-27ee-4012-9bac-589d5d00e235-service-ca" (OuterVolumeSpecName: "service-ca") pod "54a4fc9b-27ee-4012-9bac-589d5d00e235" (UID: "54a4fc9b-27ee-4012-9bac-589d5d00e235"). InnerVolumeSpecName "service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 13 03:03:29.917054 ip-10-0-134-52 kubenswrapper[2558]: I0713 03:03:29.917026 2558 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/54a4fc9b-27ee-4012-9bac-589d5d00e235-console-serving-cert" (OuterVolumeSpecName: "console-serving-cert") pod "54a4fc9b-27ee-4012-9bac-589d5d00e235" (UID: "54a4fc9b-27ee-4012-9bac-589d5d00e235"). InnerVolumeSpecName "console-serving-cert". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 13 03:03:29.917224 ip-10-0-134-52 kubenswrapper[2558]: I0713 03:03:29.917203 2558 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/54a4fc9b-27ee-4012-9bac-589d5d00e235-console-oauth-config" (OuterVolumeSpecName: "console-oauth-config") pod "54a4fc9b-27ee-4012-9bac-589d5d00e235" (UID: "54a4fc9b-27ee-4012-9bac-589d5d00e235"). InnerVolumeSpecName "console-oauth-config". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 13 03:03:29.917313 ip-10-0-134-52 kubenswrapper[2558]: I0713 03:03:29.917238 2558 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/54a4fc9b-27ee-4012-9bac-589d5d00e235-kube-api-access-4p97d" (OuterVolumeSpecName: "kube-api-access-4p97d") pod "54a4fc9b-27ee-4012-9bac-589d5d00e235" (UID: "54a4fc9b-27ee-4012-9bac-589d5d00e235"). InnerVolumeSpecName "kube-api-access-4p97d". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 13 03:03:30.015688 ip-10-0-134-52 kubenswrapper[2558]: I0713 03:03:30.015640 2558 reconciler_common.go:299] "Volume detached for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/54a4fc9b-27ee-4012-9bac-589d5d00e235-console-serving-cert\") on node \"ip-10-0-134-52.ec2.internal\" DevicePath \"\"" Jul 13 03:03:30.015688 ip-10-0-134-52 kubenswrapper[2558]: I0713 03:03:30.015660 2558 reconciler_common.go:299] "Volume detached for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/54a4fc9b-27ee-4012-9bac-589d5d00e235-console-config\") on node \"ip-10-0-134-52.ec2.internal\" DevicePath \"\"" Jul 13 03:03:30.015688 ip-10-0-134-52 kubenswrapper[2558]: I0713 03:03:30.015669 2558 reconciler_common.go:299] "Volume detached for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/54a4fc9b-27ee-4012-9bac-589d5d00e235-oauth-serving-cert\") on node \"ip-10-0-134-52.ec2.internal\" DevicePath \"\"" Jul 13 03:03:30.015688 ip-10-0-134-52 kubenswrapper[2558]: I0713 03:03:30.015678 2558 reconciler_common.go:299] "Volume detached for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/54a4fc9b-27ee-4012-9bac-589d5d00e235-service-ca\") on node \"ip-10-0-134-52.ec2.internal\" DevicePath \"\"" Jul 13 03:03:30.015688 ip-10-0-134-52 kubenswrapper[2558]: I0713 03:03:30.015686 2558 reconciler_common.go:299] "Volume detached for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/54a4fc9b-27ee-4012-9bac-589d5d00e235-console-oauth-config\") on node \"ip-10-0-134-52.ec2.internal\" DevicePath \"\"" Jul 13 03:03:30.015907 ip-10-0-134-52 kubenswrapper[2558]: I0713 03:03:30.015694 2558 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-4p97d\" (UniqueName: \"kubernetes.io/projected/54a4fc9b-27ee-4012-9bac-589d5d00e235-kube-api-access-4p97d\") on node \"ip-10-0-134-52.ec2.internal\" DevicePath \"\"" Jul 13 03:03:30.015907 ip-10-0-134-52 kubenswrapper[2558]: I0713 03:03:30.015703 2558 reconciler_common.go:299] "Volume detached for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/54a4fc9b-27ee-4012-9bac-589d5d00e235-trusted-ca-bundle\") on node \"ip-10-0-134-52.ec2.internal\" DevicePath \"\"" Jul 13 03:03:30.514501 ip-10-0-134-52 kubenswrapper[2558]: I0713 03:03:30.514470 2558 generic.go:356] "Generic (PLEG): container finished" podID="54a4fc9b-27ee-4012-9bac-589d5d00e235" containerID="7fa62d9a1ce46878fee758db36bc0f788c80a62f87ac55af0f9ce50a23c06e2c" exitCode=0 Jul 13 03:03:30.514868 ip-10-0-134-52 kubenswrapper[2558]: I0713 03:03:30.514528 2558 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-76bb9cd886-whw2t" Jul 13 03:03:30.514868 ip-10-0-134-52 kubenswrapper[2558]: I0713 03:03:30.514527 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-76bb9cd886-whw2t" event={"ID":"54a4fc9b-27ee-4012-9bac-589d5d00e235","Type":"ContainerDied","Data":"7fa62d9a1ce46878fee758db36bc0f788c80a62f87ac55af0f9ce50a23c06e2c"} Jul 13 03:03:30.514868 ip-10-0-134-52 kubenswrapper[2558]: I0713 03:03:30.514650 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-76bb9cd886-whw2t" event={"ID":"54a4fc9b-27ee-4012-9bac-589d5d00e235","Type":"ContainerDied","Data":"40e1dcf6b94b469721ef1d97c73cc37ae577fef3b583902269ebdfe8f984961d"} Jul 13 03:03:30.514868 ip-10-0-134-52 kubenswrapper[2558]: I0713 03:03:30.514671 2558 scope.go:117] "RemoveContainer" containerID="7fa62d9a1ce46878fee758db36bc0f788c80a62f87ac55af0f9ce50a23c06e2c" Jul 13 03:03:30.522693 ip-10-0-134-52 kubenswrapper[2558]: I0713 03:03:30.522676 2558 scope.go:117] "RemoveContainer" containerID="7fa62d9a1ce46878fee758db36bc0f788c80a62f87ac55af0f9ce50a23c06e2c" Jul 13 03:03:30.522945 ip-10-0-134-52 kubenswrapper[2558]: E0713 03:03:30.522925 2558 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"7fa62d9a1ce46878fee758db36bc0f788c80a62f87ac55af0f9ce50a23c06e2c\": container with ID starting with 7fa62d9a1ce46878fee758db36bc0f788c80a62f87ac55af0f9ce50a23c06e2c not found: ID does not exist" containerID="7fa62d9a1ce46878fee758db36bc0f788c80a62f87ac55af0f9ce50a23c06e2c" Jul 13 03:03:30.523000 ip-10-0-134-52 kubenswrapper[2558]: I0713 03:03:30.522954 2558 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"7fa62d9a1ce46878fee758db36bc0f788c80a62f87ac55af0f9ce50a23c06e2c"} err="failed to get container status \"7fa62d9a1ce46878fee758db36bc0f788c80a62f87ac55af0f9ce50a23c06e2c\": rpc error: code = NotFound desc = could not find container \"7fa62d9a1ce46878fee758db36bc0f788c80a62f87ac55af0f9ce50a23c06e2c\": container with ID starting with 7fa62d9a1ce46878fee758db36bc0f788c80a62f87ac55af0f9ce50a23c06e2c not found: ID does not exist" Jul 13 03:03:30.530920 ip-10-0-134-52 kubenswrapper[2558]: I0713 03:03:30.530890 2558 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-76bb9cd886-whw2t"] Jul 13 03:03:30.534284 ip-10-0-134-52 kubenswrapper[2558]: I0713 03:03:30.534265 2558 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-console/console-76bb9cd886-whw2t"] Jul 13 03:03:32.091985 ip-10-0-134-52 kubenswrapper[2558]: I0713 03:03:32.091957 2558 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="54a4fc9b-27ee-4012-9bac-589d5d00e235" path="/var/lib/kubelet/pods/54a4fc9b-27ee-4012-9bac-589d5d00e235/volumes" Jul 13 03:03:46.158822 ip-10-0-134-52 kubenswrapper[2558]: I0713 03:03:46.158793 2558 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540bmcwp"] Jul 13 03:03:46.159199 ip-10-0-134-52 kubenswrapper[2558]: I0713 03:03:46.159062 2558 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="54a4fc9b-27ee-4012-9bac-589d5d00e235" containerName="console" Jul 13 03:03:46.159199 ip-10-0-134-52 kubenswrapper[2558]: I0713 03:03:46.159071 2558 state_mem.go:107] "Deleted CPUSet assignment" podUID="54a4fc9b-27ee-4012-9bac-589d5d00e235" containerName="console" Jul 13 03:03:46.159199 ip-10-0-134-52 kubenswrapper[2558]: I0713 03:03:46.159121 2558 memory_manager.go:368] "RemoveStaleState removing state" podUID="54a4fc9b-27ee-4012-9bac-589d5d00e235" containerName="console" Jul 13 03:03:46.163393 ip-10-0-134-52 kubenswrapper[2558]: I0713 03:03:46.163378 2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540bmcwp" Jul 13 03:03:46.166231 ip-10-0-134-52 kubenswrapper[2558]: I0713 03:03:46.166208 2558 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"kube-root-ca.crt\"" Jul 13 03:03:46.166231 ip-10-0-134-52 kubenswrapper[2558]: I0713 03:03:46.166230 2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-marketplace\"/\"default-dockercfg-44tz4\"" Jul 13 03:03:46.167431 ip-10-0-134-52 kubenswrapper[2558]: I0713 03:03:46.167416 2558 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"openshift-service-ca.crt\"" Jul 13 03:03:46.171589 ip-10-0-134-52 kubenswrapper[2558]: I0713 03:03:46.171569 2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540bmcwp"] Jul 13 03:03:46.229224 ip-10-0-134-52 kubenswrapper[2558]: I0713 03:03:46.229199 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-8t59n\" (UniqueName: \"kubernetes.io/projected/d1f3ba1a-09fa-4b3c-9e37-03891efdfba9-kube-api-access-8t59n\") pod \"685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540bmcwp\" (UID: \"d1f3ba1a-09fa-4b3c-9e37-03891efdfba9\") " pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540bmcwp" Jul 13 03:03:46.229362 ip-10-0-134-52 kubenswrapper[2558]: I0713 03:03:46.229246 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/d1f3ba1a-09fa-4b3c-9e37-03891efdfba9-bundle\") pod \"685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540bmcwp\" (UID: \"d1f3ba1a-09fa-4b3c-9e37-03891efdfba9\") " pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540bmcwp" Jul 13 03:03:46.229362 ip-10-0-134-52 kubenswrapper[2558]: I0713 03:03:46.229271 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/d1f3ba1a-09fa-4b3c-9e37-03891efdfba9-util\") pod \"685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540bmcwp\" (UID: \"d1f3ba1a-09fa-4b3c-9e37-03891efdfba9\") " pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540bmcwp" Jul 13 03:03:46.330420 ip-10-0-134-52 kubenswrapper[2558]: I0713 03:03:46.330401 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-8t59n\" (UniqueName: \"kubernetes.io/projected/d1f3ba1a-09fa-4b3c-9e37-03891efdfba9-kube-api-access-8t59n\") pod \"685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540bmcwp\" (UID: \"d1f3ba1a-09fa-4b3c-9e37-03891efdfba9\") " pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540bmcwp" Jul 13 03:03:46.330502 ip-10-0-134-52 kubenswrapper[2558]: I0713 03:03:46.330440 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/d1f3ba1a-09fa-4b3c-9e37-03891efdfba9-bundle\") pod \"685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540bmcwp\" (UID: \"d1f3ba1a-09fa-4b3c-9e37-03891efdfba9\") " pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540bmcwp" Jul 13 03:03:46.330502 ip-10-0-134-52 kubenswrapper[2558]: I0713 03:03:46.330463 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/d1f3ba1a-09fa-4b3c-9e37-03891efdfba9-util\") pod \"685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540bmcwp\" (UID: \"d1f3ba1a-09fa-4b3c-9e37-03891efdfba9\") " pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540bmcwp" Jul 13 03:03:46.330783 ip-10-0-134-52 kubenswrapper[2558]: I0713 03:03:46.330762 2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/d1f3ba1a-09fa-4b3c-9e37-03891efdfba9-bundle\") pod \"685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540bmcwp\" (UID: \"d1f3ba1a-09fa-4b3c-9e37-03891efdfba9\") " pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540bmcwp" Jul 13 03:03:46.330821 ip-10-0-134-52 kubenswrapper[2558]: I0713 03:03:46.330805 2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/d1f3ba1a-09fa-4b3c-9e37-03891efdfba9-util\") pod \"685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540bmcwp\" (UID: \"d1f3ba1a-09fa-4b3c-9e37-03891efdfba9\") " pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540bmcwp" Jul 13 03:03:46.338627 ip-10-0-134-52 kubenswrapper[2558]: I0713 03:03:46.338606 2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-8t59n\" (UniqueName: \"kubernetes.io/projected/d1f3ba1a-09fa-4b3c-9e37-03891efdfba9-kube-api-access-8t59n\") pod \"685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540bmcwp\" (UID: \"d1f3ba1a-09fa-4b3c-9e37-03891efdfba9\") " pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540bmcwp" Jul 13 03:03:46.472800 ip-10-0-134-52 kubenswrapper[2558]: I0713 03:03:46.472718 2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540bmcwp" Jul 13 03:03:46.595507 ip-10-0-134-52 kubenswrapper[2558]: I0713 03:03:46.595360 2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540bmcwp"] Jul 13 03:03:46.598016 ip-10-0-134-52 kubenswrapper[2558]: W0713 03:03:46.597989 2558 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podd1f3ba1a_09fa_4b3c_9e37_03891efdfba9.slice/crio-821650270cc08d04cd7feedd5f3dd0b2ad528581d30da866041b79080972f2da WatchSource:0}: Error finding container 821650270cc08d04cd7feedd5f3dd0b2ad528581d30da866041b79080972f2da: Status 404 returned error can't find the container with id 821650270cc08d04cd7feedd5f3dd0b2ad528581d30da866041b79080972f2da Jul 13 03:03:46.599829 ip-10-0-134-52 kubenswrapper[2558]: I0713 03:03:46.599814 2558 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider Jul 13 03:03:47.579642 ip-10-0-134-52 kubenswrapper[2558]: I0713 03:03:47.579611 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540bmcwp" event={"ID":"d1f3ba1a-09fa-4b3c-9e37-03891efdfba9","Type":"ContainerStarted","Data":"821650270cc08d04cd7feedd5f3dd0b2ad528581d30da866041b79080972f2da"} Jul 13 03:03:53.607849 ip-10-0-134-52 kubenswrapper[2558]: I0713 03:03:53.607814 2558 generic.go:356] "Generic (PLEG): container finished" podID="d1f3ba1a-09fa-4b3c-9e37-03891efdfba9" containerID="76077c1e97b09a4616532dec9863d19be58bd9c2a71671a9eb283026c7cb36c5" exitCode=0 Jul 13 03:03:53.608310 ip-10-0-134-52 kubenswrapper[2558]: I0713 03:03:53.607898 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540bmcwp" event={"ID":"d1f3ba1a-09fa-4b3c-9e37-03891efdfba9","Type":"ContainerDied","Data":"76077c1e97b09a4616532dec9863d19be58bd9c2a71671a9eb283026c7cb36c5"} Jul 13 03:03:55.617935 ip-10-0-134-52 kubenswrapper[2558]: I0713 03:03:55.617887 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540bmcwp" event={"ID":"d1f3ba1a-09fa-4b3c-9e37-03891efdfba9","Type":"ContainerStarted","Data":"a3bec75d7297fb46188fe3af2c50b18633d240716bda1d0735177b91f27085e2"} Jul 13 03:03:56.623650 ip-10-0-134-52 kubenswrapper[2558]: I0713 03:03:56.623607 2558 generic.go:356] "Generic (PLEG): container finished" podID="d1f3ba1a-09fa-4b3c-9e37-03891efdfba9" containerID="a3bec75d7297fb46188fe3af2c50b18633d240716bda1d0735177b91f27085e2" exitCode=0 Jul 13 03:03:56.624009 ip-10-0-134-52 kubenswrapper[2558]: I0713 03:03:56.623671 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540bmcwp" event={"ID":"d1f3ba1a-09fa-4b3c-9e37-03891efdfba9","Type":"ContainerDied","Data":"a3bec75d7297fb46188fe3af2c50b18633d240716bda1d0735177b91f27085e2"} Jul 13 03:04:05.667599 ip-10-0-134-52 kubenswrapper[2558]: I0713 03:04:05.667571 2558 generic.go:356] "Generic (PLEG): container finished" podID="d1f3ba1a-09fa-4b3c-9e37-03891efdfba9" containerID="516fff49c785a9921ca3ebc58108710f36836ec04a96b87a2ec54c6ea07785ca" exitCode=0 Jul 13 03:04:05.667967 ip-10-0-134-52 kubenswrapper[2558]: I0713 03:04:05.667648 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540bmcwp" event={"ID":"d1f3ba1a-09fa-4b3c-9e37-03891efdfba9","Type":"ContainerDied","Data":"516fff49c785a9921ca3ebc58108710f36836ec04a96b87a2ec54c6ea07785ca"} Jul 13 03:04:06.795405 ip-10-0-134-52 kubenswrapper[2558]: I0713 03:04:06.795383 2558 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540bmcwp" Jul 13 03:04:06.890146 ip-10-0-134-52 kubenswrapper[2558]: I0713 03:04:06.890124 2558 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/d1f3ba1a-09fa-4b3c-9e37-03891efdfba9-util\") pod \"d1f3ba1a-09fa-4b3c-9e37-03891efdfba9\" (UID: \"d1f3ba1a-09fa-4b3c-9e37-03891efdfba9\") " Jul 13 03:04:06.890273 ip-10-0-134-52 kubenswrapper[2558]: I0713 03:04:06.890163 2558 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-8t59n\" (UniqueName: \"kubernetes.io/projected/d1f3ba1a-09fa-4b3c-9e37-03891efdfba9-kube-api-access-8t59n\") pod \"d1f3ba1a-09fa-4b3c-9e37-03891efdfba9\" (UID: \"d1f3ba1a-09fa-4b3c-9e37-03891efdfba9\") " Jul 13 03:04:06.890273 ip-10-0-134-52 kubenswrapper[2558]: I0713 03:04:06.890209 2558 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/d1f3ba1a-09fa-4b3c-9e37-03891efdfba9-bundle\") pod \"d1f3ba1a-09fa-4b3c-9e37-03891efdfba9\" (UID: \"d1f3ba1a-09fa-4b3c-9e37-03891efdfba9\") " Jul 13 03:04:06.890892 ip-10-0-134-52 kubenswrapper[2558]: I0713 03:04:06.890866 2558 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/d1f3ba1a-09fa-4b3c-9e37-03891efdfba9-bundle" (OuterVolumeSpecName: "bundle") pod "d1f3ba1a-09fa-4b3c-9e37-03891efdfba9" (UID: "d1f3ba1a-09fa-4b3c-9e37-03891efdfba9"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 13 03:04:06.892476 ip-10-0-134-52 kubenswrapper[2558]: I0713 03:04:06.892456 2558 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/d1f3ba1a-09fa-4b3c-9e37-03891efdfba9-kube-api-access-8t59n" (OuterVolumeSpecName: "kube-api-access-8t59n") pod "d1f3ba1a-09fa-4b3c-9e37-03891efdfba9" (UID: "d1f3ba1a-09fa-4b3c-9e37-03891efdfba9"). InnerVolumeSpecName "kube-api-access-8t59n". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 13 03:04:06.894569 ip-10-0-134-52 kubenswrapper[2558]: I0713 03:04:06.894546 2558 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/d1f3ba1a-09fa-4b3c-9e37-03891efdfba9-util" (OuterVolumeSpecName: "util") pod "d1f3ba1a-09fa-4b3c-9e37-03891efdfba9" (UID: "d1f3ba1a-09fa-4b3c-9e37-03891efdfba9"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 13 03:04:06.991092 ip-10-0-134-52 kubenswrapper[2558]: I0713 03:04:06.991043 2558 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/d1f3ba1a-09fa-4b3c-9e37-03891efdfba9-util\") on node \"ip-10-0-134-52.ec2.internal\" DevicePath \"\"" Jul 13 03:04:06.991092 ip-10-0-134-52 kubenswrapper[2558]: I0713 03:04:06.991063 2558 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-8t59n\" (UniqueName: \"kubernetes.io/projected/d1f3ba1a-09fa-4b3c-9e37-03891efdfba9-kube-api-access-8t59n\") on node \"ip-10-0-134-52.ec2.internal\" DevicePath \"\"" Jul 13 03:04:06.991092 ip-10-0-134-52 kubenswrapper[2558]: I0713 03:04:06.991075 2558 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/d1f3ba1a-09fa-4b3c-9e37-03891efdfba9-bundle\") on node \"ip-10-0-134-52.ec2.internal\" DevicePath \"\"" Jul 13 03:04:07.678029 ip-10-0-134-52 kubenswrapper[2558]: I0713 03:04:07.678002 2558 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540bmcwp" Jul 13 03:04:07.678029 ip-10-0-134-52 kubenswrapper[2558]: I0713 03:04:07.678020 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540bmcwp" event={"ID":"d1f3ba1a-09fa-4b3c-9e37-03891efdfba9","Type":"ContainerDied","Data":"821650270cc08d04cd7feedd5f3dd0b2ad528581d30da866041b79080972f2da"} Jul 13 03:04:07.678218 ip-10-0-134-52 kubenswrapper[2558]: I0713 03:04:07.678066 2558 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="821650270cc08d04cd7feedd5f3dd0b2ad528581d30da866041b79080972f2da" Jul 13 03:04:14.171077 ip-10-0-134-52 kubenswrapper[2558]: I0713 03:04:14.171043 2558 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-5khb8"] Jul 13 03:04:14.171451 ip-10-0-134-52 kubenswrapper[2558]: I0713 03:04:14.171362 2558 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="d1f3ba1a-09fa-4b3c-9e37-03891efdfba9" containerName="pull" Jul 13 03:04:14.171451 ip-10-0-134-52 kubenswrapper[2558]: I0713 03:04:14.171376 2558 state_mem.go:107] "Deleted CPUSet assignment" podUID="d1f3ba1a-09fa-4b3c-9e37-03891efdfba9" containerName="pull" Jul 13 03:04:14.171451 ip-10-0-134-52 kubenswrapper[2558]: I0713 03:04:14.171395 2558 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="d1f3ba1a-09fa-4b3c-9e37-03891efdfba9" containerName="util" Jul 13 03:04:14.171451 ip-10-0-134-52 kubenswrapper[2558]: I0713 03:04:14.171401 2558 state_mem.go:107] "Deleted CPUSet assignment" podUID="d1f3ba1a-09fa-4b3c-9e37-03891efdfba9" containerName="util" Jul 13 03:04:14.171451 ip-10-0-134-52 kubenswrapper[2558]: I0713 03:04:14.171418 2558 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="d1f3ba1a-09fa-4b3c-9e37-03891efdfba9" containerName="extract" Jul 13 03:04:14.171451 ip-10-0-134-52 kubenswrapper[2558]: I0713 03:04:14.171424 2558 state_mem.go:107] "Deleted CPUSet assignment" podUID="d1f3ba1a-09fa-4b3c-9e37-03891efdfba9" containerName="extract" Jul 13 03:04:14.171633 ip-10-0-134-52 kubenswrapper[2558]: I0713 03:04:14.171477 2558 memory_manager.go:368] "RemoveStaleState removing state" podUID="d1f3ba1a-09fa-4b3c-9e37-03891efdfba9" containerName="extract" Jul 13 03:04:14.174859 ip-10-0-134-52 kubenswrapper[2558]: I0713 03:04:14.174842 2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-5khb8" Jul 13 03:04:14.177847 ip-10-0-134-52 kubenswrapper[2558]: I0713 03:04:14.177826 2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"cert-manager-operator\"/\"cert-manager-operator-controller-manager-dockercfg-txspf\"" Jul 13 03:04:14.177847 ip-10-0-134-52 kubenswrapper[2558]: I0713 03:04:14.177843 2558 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"cert-manager-operator\"/\"kube-root-ca.crt\"" Jul 13 03:04:14.178040 ip-10-0-134-52 kubenswrapper[2558]: I0713 03:04:14.178028 2558 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"cert-manager-operator\"/\"openshift-service-ca.crt\"" Jul 13 03:04:14.184770 ip-10-0-134-52 kubenswrapper[2558]: I0713 03:04:14.184749 2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-5khb8"] Jul 13 03:04:14.245343 ip-10-0-134-52 kubenswrapper[2558]: I0713 03:04:14.245315 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/25bcd2f4-355c-4a1e-9279-f1e42771475c-tmp\") pod \"cert-manager-operator-controller-manager-55c444bf86-5khb8\" (UID: \"25bcd2f4-355c-4a1e-9279-f1e42771475c\") " pod="cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-5khb8" Jul 13 03:04:14.245450 ip-10-0-134-52 kubenswrapper[2558]: I0713 03:04:14.245401 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-jrj6n\" (UniqueName: \"kubernetes.io/projected/25bcd2f4-355c-4a1e-9279-f1e42771475c-kube-api-access-jrj6n\") pod \"cert-manager-operator-controller-manager-55c444bf86-5khb8\" (UID: \"25bcd2f4-355c-4a1e-9279-f1e42771475c\") " pod="cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-5khb8" Jul 13 03:04:14.346634 ip-10-0-134-52 kubenswrapper[2558]: I0713 03:04:14.346601 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-jrj6n\" (UniqueName: \"kubernetes.io/projected/25bcd2f4-355c-4a1e-9279-f1e42771475c-kube-api-access-jrj6n\") pod \"cert-manager-operator-controller-manager-55c444bf86-5khb8\" (UID: \"25bcd2f4-355c-4a1e-9279-f1e42771475c\") " pod="cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-5khb8" Jul 13 03:04:14.346743 ip-10-0-134-52 kubenswrapper[2558]: I0713 03:04:14.346671 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/25bcd2f4-355c-4a1e-9279-f1e42771475c-tmp\") pod \"cert-manager-operator-controller-manager-55c444bf86-5khb8\" (UID: \"25bcd2f4-355c-4a1e-9279-f1e42771475c\") " pod="cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-5khb8" Jul 13 03:04:14.346991 ip-10-0-134-52 kubenswrapper[2558]: I0713 03:04:14.346972 2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/25bcd2f4-355c-4a1e-9279-f1e42771475c-tmp\") pod \"cert-manager-operator-controller-manager-55c444bf86-5khb8\" (UID: \"25bcd2f4-355c-4a1e-9279-f1e42771475c\") " pod="cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-5khb8" Jul 13 03:04:14.354857 ip-10-0-134-52 kubenswrapper[2558]: I0713 03:04:14.354830 2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-jrj6n\" (UniqueName: \"kubernetes.io/projected/25bcd2f4-355c-4a1e-9279-f1e42771475c-kube-api-access-jrj6n\") pod \"cert-manager-operator-controller-manager-55c444bf86-5khb8\" (UID: \"25bcd2f4-355c-4a1e-9279-f1e42771475c\") " pod="cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-5khb8" Jul 13 03:04:14.484392 ip-10-0-134-52 kubenswrapper[2558]: I0713 03:04:14.484325 2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-5khb8" Jul 13 03:04:14.612478 ip-10-0-134-52 kubenswrapper[2558]: I0713 03:04:14.612449 2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-5khb8"] Jul 13 03:04:14.615688 ip-10-0-134-52 kubenswrapper[2558]: W0713 03:04:14.615660 2558 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod25bcd2f4_355c_4a1e_9279_f1e42771475c.slice/crio-2d46837191b0acb81eb950b79f7de7fb82fe2aee2dad6a0c5f00d845320b4ac5 WatchSource:0}: Error finding container 2d46837191b0acb81eb950b79f7de7fb82fe2aee2dad6a0c5f00d845320b4ac5: Status 404 returned error can't find the container with id 2d46837191b0acb81eb950b79f7de7fb82fe2aee2dad6a0c5f00d845320b4ac5 Jul 13 03:04:14.706123 ip-10-0-134-52 kubenswrapper[2558]: I0713 03:04:14.706095 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-5khb8" event={"ID":"25bcd2f4-355c-4a1e-9279-f1e42771475c","Type":"ContainerStarted","Data":"2d46837191b0acb81eb950b79f7de7fb82fe2aee2dad6a0c5f00d845320b4ac5"} Jul 13 03:04:16.715767 ip-10-0-134-52 kubenswrapper[2558]: I0713 03:04:16.715725 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-5khb8" event={"ID":"25bcd2f4-355c-4a1e-9279-f1e42771475c","Type":"ContainerStarted","Data":"19742da9d3acc655d302c177a647cdb9ee335b5ddf68ab9d47c8f801311ebb5a"} Jul 13 03:04:16.741347 ip-10-0-134-52 kubenswrapper[2558]: I0713 03:04:16.741234 2558 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-5khb8" podStartSLOduration=1.202988692 podStartE2EDuration="2.741216147s" totalImagesPullingTime="1.538227455s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-13 03:04:14 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-13 03:04:16.739736231 +0000 UTC m=+439.140336697" watchObservedRunningTime="2026-07-13 03:04:16.741216147 +0000 UTC m=+439.141816614" Jul 13 03:04:18.431004 ip-10-0-134-52 kubenswrapper[2558]: I0713 03:04:18.430921 2558 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f5gl9r"] Jul 13 03:04:18.433349 ip-10-0-134-52 kubenswrapper[2558]: I0713 03:04:18.433312 2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f5gl9r" Jul 13 03:04:18.436185 ip-10-0-134-52 kubenswrapper[2558]: I0713 03:04:18.436167 2558 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"kube-root-ca.crt\"" Jul 13 03:04:18.436307 ip-10-0-134-52 kubenswrapper[2558]: I0713 03:04:18.436285 2558 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"openshift-service-ca.crt\"" Jul 13 03:04:18.436421 ip-10-0-134-52 kubenswrapper[2558]: I0713 03:04:18.436345 2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-marketplace\"/\"default-dockercfg-44tz4\"" Jul 13 03:04:18.442728 ip-10-0-134-52 kubenswrapper[2558]: I0713 03:04:18.442707 2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f5gl9r"] Jul 13 03:04:18.477884 ip-10-0-134-52 kubenswrapper[2558]: I0713 03:04:18.477859 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/5b0cb191-fef0-44f6-a387-ce5c2750262b-bundle\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f5gl9r\" (UID: \"5b0cb191-fef0-44f6-a387-ce5c2750262b\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f5gl9r" Jul 13 03:04:18.477980 ip-10-0-134-52 kubenswrapper[2558]: I0713 03:04:18.477914 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/5b0cb191-fef0-44f6-a387-ce5c2750262b-util\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f5gl9r\" (UID: \"5b0cb191-fef0-44f6-a387-ce5c2750262b\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f5gl9r" Jul 13 03:04:18.478025 ip-10-0-134-52 kubenswrapper[2558]: I0713 03:04:18.477988 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-cl5qs\" (UniqueName: \"kubernetes.io/projected/5b0cb191-fef0-44f6-a387-ce5c2750262b-kube-api-access-cl5qs\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f5gl9r\" (UID: \"5b0cb191-fef0-44f6-a387-ce5c2750262b\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f5gl9r" Jul 13 03:04:18.578676 ip-10-0-134-52 kubenswrapper[2558]: I0713 03:04:18.578653 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/5b0cb191-fef0-44f6-a387-ce5c2750262b-util\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f5gl9r\" (UID: \"5b0cb191-fef0-44f6-a387-ce5c2750262b\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f5gl9r" Jul 13 03:04:18.578779 ip-10-0-134-52 kubenswrapper[2558]: I0713 03:04:18.578699 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-cl5qs\" (UniqueName: \"kubernetes.io/projected/5b0cb191-fef0-44f6-a387-ce5c2750262b-kube-api-access-cl5qs\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f5gl9r\" (UID: \"5b0cb191-fef0-44f6-a387-ce5c2750262b\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f5gl9r" Jul 13 03:04:18.578779 ip-10-0-134-52 kubenswrapper[2558]: I0713 03:04:18.578727 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/5b0cb191-fef0-44f6-a387-ce5c2750262b-bundle\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f5gl9r\" (UID: \"5b0cb191-fef0-44f6-a387-ce5c2750262b\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f5gl9r" Jul 13 03:04:18.579024 ip-10-0-134-52 kubenswrapper[2558]: I0713 03:04:18.579000 2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/5b0cb191-fef0-44f6-a387-ce5c2750262b-util\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f5gl9r\" (UID: \"5b0cb191-fef0-44f6-a387-ce5c2750262b\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f5gl9r" Jul 13 03:04:18.579079 ip-10-0-134-52 kubenswrapper[2558]: I0713 03:04:18.579032 2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/5b0cb191-fef0-44f6-a387-ce5c2750262b-bundle\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f5gl9r\" (UID: \"5b0cb191-fef0-44f6-a387-ce5c2750262b\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f5gl9r" Jul 13 03:04:18.587575 ip-10-0-134-52 kubenswrapper[2558]: I0713 03:04:18.587546 2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-cl5qs\" (UniqueName: \"kubernetes.io/projected/5b0cb191-fef0-44f6-a387-ce5c2750262b-kube-api-access-cl5qs\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f5gl9r\" (UID: \"5b0cb191-fef0-44f6-a387-ce5c2750262b\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f5gl9r" Jul 13 03:04:18.742156 ip-10-0-134-52 kubenswrapper[2558]: I0713 03:04:18.742106 2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f5gl9r" Jul 13 03:04:18.872484 ip-10-0-134-52 kubenswrapper[2558]: I0713 03:04:18.872398 2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f5gl9r"] Jul 13 03:04:18.874978 ip-10-0-134-52 kubenswrapper[2558]: W0713 03:04:18.874949 2558 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod5b0cb191_fef0_44f6_a387_ce5c2750262b.slice/crio-b84dce826e874177a5ec181c547bf9131afb16b1778c8e4343f7796d11fb291b WatchSource:0}: Error finding container b84dce826e874177a5ec181c547bf9131afb16b1778c8e4343f7796d11fb291b: Status 404 returned error can't find the container with id b84dce826e874177a5ec181c547bf9131afb16b1778c8e4343f7796d11fb291b Jul 13 03:04:19.407869 ip-10-0-134-52 kubenswrapper[2558]: I0713 03:04:19.407839 2558 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["cert-manager/cert-manager-webhook-6486ffd997-xzcsn"] Jul 13 03:04:19.410890 ip-10-0-134-52 kubenswrapper[2558]: I0713 03:04:19.410872 2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager/cert-manager-webhook-6486ffd997-xzcsn" Jul 13 03:04:19.413727 ip-10-0-134-52 kubenswrapper[2558]: I0713 03:04:19.413699 2558 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"cert-manager\"/\"kube-root-ca.crt\"" Jul 13 03:04:19.415066 ip-10-0-134-52 kubenswrapper[2558]: I0713 03:04:19.415046 2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"cert-manager\"/\"cert-manager-webhook-dockercfg-vn75c\"" Jul 13 03:04:19.415193 ip-10-0-134-52 kubenswrapper[2558]: I0713 03:04:19.415046 2558 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"cert-manager\"/\"openshift-service-ca.crt\"" Jul 13 03:04:19.421127 ip-10-0-134-52 kubenswrapper[2558]: I0713 03:04:19.421108 2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["cert-manager/cert-manager-webhook-6486ffd997-xzcsn"] Jul 13 03:04:19.485392 ip-10-0-134-52 kubenswrapper[2558]: I0713 03:04:19.485366 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-4d56r\" (UniqueName: \"kubernetes.io/projected/9149e989-6d9d-4c8c-bb46-a41239d568ee-kube-api-access-4d56r\") pod \"cert-manager-webhook-6486ffd997-xzcsn\" (UID: \"9149e989-6d9d-4c8c-bb46-a41239d568ee\") " pod="cert-manager/cert-manager-webhook-6486ffd997-xzcsn" Jul 13 03:04:19.485701 ip-10-0-134-52 kubenswrapper[2558]: I0713 03:04:19.485397 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/9149e989-6d9d-4c8c-bb46-a41239d568ee-bound-sa-token\") pod \"cert-manager-webhook-6486ffd997-xzcsn\" (UID: \"9149e989-6d9d-4c8c-bb46-a41239d568ee\") " pod="cert-manager/cert-manager-webhook-6486ffd997-xzcsn" Jul 13 03:04:19.586363 ip-10-0-134-52 kubenswrapper[2558]: I0713 03:04:19.586316 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-4d56r\" (UniqueName: \"kubernetes.io/projected/9149e989-6d9d-4c8c-bb46-a41239d568ee-kube-api-access-4d56r\") pod \"cert-manager-webhook-6486ffd997-xzcsn\" (UID: \"9149e989-6d9d-4c8c-bb46-a41239d568ee\") " pod="cert-manager/cert-manager-webhook-6486ffd997-xzcsn" Jul 13 03:04:19.586363 ip-10-0-134-52 kubenswrapper[2558]: I0713 03:04:19.586366 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/9149e989-6d9d-4c8c-bb46-a41239d568ee-bound-sa-token\") pod \"cert-manager-webhook-6486ffd997-xzcsn\" (UID: \"9149e989-6d9d-4c8c-bb46-a41239d568ee\") " pod="cert-manager/cert-manager-webhook-6486ffd997-xzcsn" Jul 13 03:04:19.595537 ip-10-0-134-52 kubenswrapper[2558]: I0713 03:04:19.595512 2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/9149e989-6d9d-4c8c-bb46-a41239d568ee-bound-sa-token\") pod \"cert-manager-webhook-6486ffd997-xzcsn\" (UID: \"9149e989-6d9d-4c8c-bb46-a41239d568ee\") " pod="cert-manager/cert-manager-webhook-6486ffd997-xzcsn" Jul 13 03:04:19.595638 ip-10-0-134-52 kubenswrapper[2558]: I0713 03:04:19.595622 2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-4d56r\" (UniqueName: \"kubernetes.io/projected/9149e989-6d9d-4c8c-bb46-a41239d568ee-kube-api-access-4d56r\") pod \"cert-manager-webhook-6486ffd997-xzcsn\" (UID: \"9149e989-6d9d-4c8c-bb46-a41239d568ee\") " pod="cert-manager/cert-manager-webhook-6486ffd997-xzcsn" Jul 13 03:04:19.722682 ip-10-0-134-52 kubenswrapper[2558]: I0713 03:04:19.722626 2558 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["cert-manager/cert-manager-cainjector-559cdd8c87-rkr48"] Jul 13 03:04:19.725680 ip-10-0-134-52 kubenswrapper[2558]: I0713 03:04:19.725665 2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager/cert-manager-cainjector-559cdd8c87-rkr48" Jul 13 03:04:19.729272 ip-10-0-134-52 kubenswrapper[2558]: I0713 03:04:19.729254 2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager/cert-manager-webhook-6486ffd997-xzcsn" Jul 13 03:04:19.729384 ip-10-0-134-52 kubenswrapper[2558]: I0713 03:04:19.729254 2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"cert-manager\"/\"cert-manager-cainjector-dockercfg-v6tjt\"" Jul 13 03:04:19.729876 ip-10-0-134-52 kubenswrapper[2558]: I0713 03:04:19.729855 2558 generic.go:356] "Generic (PLEG): container finished" podID="5b0cb191-fef0-44f6-a387-ce5c2750262b" containerID="882bdb9517c469ce2d3a36ed67c817fec359119541ba41dd199afbbe2405ee00" exitCode=0 Jul 13 03:04:19.729985 ip-10-0-134-52 kubenswrapper[2558]: I0713 03:04:19.729940 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f5gl9r" event={"ID":"5b0cb191-fef0-44f6-a387-ce5c2750262b","Type":"ContainerDied","Data":"882bdb9517c469ce2d3a36ed67c817fec359119541ba41dd199afbbe2405ee00"} Jul 13 03:04:19.729985 ip-10-0-134-52 kubenswrapper[2558]: I0713 03:04:19.729977 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f5gl9r" event={"ID":"5b0cb191-fef0-44f6-a387-ce5c2750262b","Type":"ContainerStarted","Data":"b84dce826e874177a5ec181c547bf9131afb16b1778c8e4343f7796d11fb291b"} Jul 13 03:04:19.742038 ip-10-0-134-52 kubenswrapper[2558]: I0713 03:04:19.742002 2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["cert-manager/cert-manager-cainjector-559cdd8c87-rkr48"] Jul 13 03:04:19.788660 ip-10-0-134-52 kubenswrapper[2558]: I0713 03:04:19.788629 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-49hv7\" (UniqueName: \"kubernetes.io/projected/2e2e86e2-d3bc-4614-b2f9-89020f4c10d1-kube-api-access-49hv7\") pod \"cert-manager-cainjector-559cdd8c87-rkr48\" (UID: \"2e2e86e2-d3bc-4614-b2f9-89020f4c10d1\") " pod="cert-manager/cert-manager-cainjector-559cdd8c87-rkr48" Jul 13 03:04:19.788864 ip-10-0-134-52 kubenswrapper[2558]: I0713 03:04:19.788828 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/2e2e86e2-d3bc-4614-b2f9-89020f4c10d1-bound-sa-token\") pod \"cert-manager-cainjector-559cdd8c87-rkr48\" (UID: \"2e2e86e2-d3bc-4614-b2f9-89020f4c10d1\") " pod="cert-manager/cert-manager-cainjector-559cdd8c87-rkr48" Jul 13 03:04:19.859480 ip-10-0-134-52 kubenswrapper[2558]: I0713 03:04:19.859458 2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["cert-manager/cert-manager-webhook-6486ffd997-xzcsn"] Jul 13 03:04:19.861510 ip-10-0-134-52 kubenswrapper[2558]: W0713 03:04:19.861484 2558 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod9149e989_6d9d_4c8c_bb46_a41239d568ee.slice/crio-f03c890a04bccbd7998a669a9265a786be3479301e0c25b6b0e6c22c76127f84 WatchSource:0}: Error finding container f03c890a04bccbd7998a669a9265a786be3479301e0c25b6b0e6c22c76127f84: Status 404 returned error can't find the container with id f03c890a04bccbd7998a669a9265a786be3479301e0c25b6b0e6c22c76127f84 Jul 13 03:04:19.890081 ip-10-0-134-52 kubenswrapper[2558]: I0713 03:04:19.890054 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/2e2e86e2-d3bc-4614-b2f9-89020f4c10d1-bound-sa-token\") pod \"cert-manager-cainjector-559cdd8c87-rkr48\" (UID: \"2e2e86e2-d3bc-4614-b2f9-89020f4c10d1\") " pod="cert-manager/cert-manager-cainjector-559cdd8c87-rkr48" Jul 13 03:04:19.890174 ip-10-0-134-52 kubenswrapper[2558]: I0713 03:04:19.890093 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-49hv7\" (UniqueName: \"kubernetes.io/projected/2e2e86e2-d3bc-4614-b2f9-89020f4c10d1-kube-api-access-49hv7\") pod \"cert-manager-cainjector-559cdd8c87-rkr48\" (UID: \"2e2e86e2-d3bc-4614-b2f9-89020f4c10d1\") " pod="cert-manager/cert-manager-cainjector-559cdd8c87-rkr48" Jul 13 03:04:19.898259 ip-10-0-134-52 kubenswrapper[2558]: I0713 03:04:19.898235 2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/2e2e86e2-d3bc-4614-b2f9-89020f4c10d1-bound-sa-token\") pod \"cert-manager-cainjector-559cdd8c87-rkr48\" (UID: \"2e2e86e2-d3bc-4614-b2f9-89020f4c10d1\") " pod="cert-manager/cert-manager-cainjector-559cdd8c87-rkr48" Jul 13 03:04:19.898406 ip-10-0-134-52 kubenswrapper[2558]: I0713 03:04:19.898389 2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-49hv7\" (UniqueName: \"kubernetes.io/projected/2e2e86e2-d3bc-4614-b2f9-89020f4c10d1-kube-api-access-49hv7\") pod \"cert-manager-cainjector-559cdd8c87-rkr48\" (UID: \"2e2e86e2-d3bc-4614-b2f9-89020f4c10d1\") " pod="cert-manager/cert-manager-cainjector-559cdd8c87-rkr48" Jul 13 03:04:20.036145 ip-10-0-134-52 kubenswrapper[2558]: I0713 03:04:20.036088 2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager/cert-manager-cainjector-559cdd8c87-rkr48" Jul 13 03:04:20.161549 ip-10-0-134-52 kubenswrapper[2558]: I0713 03:04:20.161527 2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["cert-manager/cert-manager-cainjector-559cdd8c87-rkr48"] Jul 13 03:04:20.163408 ip-10-0-134-52 kubenswrapper[2558]: W0713 03:04:20.163380 2558 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod2e2e86e2_d3bc_4614_b2f9_89020f4c10d1.slice/crio-b5a3067b930fb9dda234d9840351a6dcf88a895dfe91d65fc9b8c83e81cdb3ec WatchSource:0}: Error finding container b5a3067b930fb9dda234d9840351a6dcf88a895dfe91d65fc9b8c83e81cdb3ec: Status 404 returned error can't find the container with id b5a3067b930fb9dda234d9840351a6dcf88a895dfe91d65fc9b8c83e81cdb3ec Jul 13 03:04:20.739637 ip-10-0-134-52 kubenswrapper[2558]: I0713 03:04:20.739598 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="cert-manager/cert-manager-cainjector-559cdd8c87-rkr48" event={"ID":"2e2e86e2-d3bc-4614-b2f9-89020f4c10d1","Type":"ContainerStarted","Data":"b5a3067b930fb9dda234d9840351a6dcf88a895dfe91d65fc9b8c83e81cdb3ec"} Jul 13 03:04:20.741293 ip-10-0-134-52 kubenswrapper[2558]: I0713 03:04:20.741257 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="cert-manager/cert-manager-webhook-6486ffd997-xzcsn" event={"ID":"9149e989-6d9d-4c8c-bb46-a41239d568ee","Type":"ContainerStarted","Data":"f03c890a04bccbd7998a669a9265a786be3479301e0c25b6b0e6c22c76127f84"} Jul 13 03:04:23.759049 ip-10-0-134-52 kubenswrapper[2558]: I0713 03:04:23.759012 2558 generic.go:356] "Generic (PLEG): container finished" podID="5b0cb191-fef0-44f6-a387-ce5c2750262b" containerID="8a66127d1c9d7cb81331171b19d469ef0c80e14565fe020b5d0ae5021e6af8dc" exitCode=0 Jul 13 03:04:23.759477 ip-10-0-134-52 kubenswrapper[2558]: I0713 03:04:23.759100 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f5gl9r" event={"ID":"5b0cb191-fef0-44f6-a387-ce5c2750262b","Type":"ContainerDied","Data":"8a66127d1c9d7cb81331171b19d469ef0c80e14565fe020b5d0ae5021e6af8dc"} Jul 13 03:04:23.760678 ip-10-0-134-52 kubenswrapper[2558]: I0713 03:04:23.760651 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="cert-manager/cert-manager-cainjector-559cdd8c87-rkr48" event={"ID":"2e2e86e2-d3bc-4614-b2f9-89020f4c10d1","Type":"ContainerStarted","Data":"26f97a3ef41ad3a58c148f50ccbc9a15619f553c0de364d595c8b34fa81d434d"} Jul 13 03:04:23.762113 ip-10-0-134-52 kubenswrapper[2558]: I0713 03:04:23.762095 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="cert-manager/cert-manager-webhook-6486ffd997-xzcsn" event={"ID":"9149e989-6d9d-4c8c-bb46-a41239d568ee","Type":"ContainerStarted","Data":"953095e06a2f4ca860248203a2573400da188e6021e8e8be9d71ccba6b925ddd"} Jul 13 03:04:23.762210 ip-10-0-134-52 kubenswrapper[2558]: I0713 03:04:23.762199 2558 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="cert-manager/cert-manager-webhook-6486ffd997-xzcsn" Jul 13 03:04:23.792585 ip-10-0-134-52 kubenswrapper[2558]: I0713 03:04:23.792542 2558 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="cert-manager/cert-manager-webhook-6486ffd997-xzcsn" podStartSLOduration=1.486216217 podStartE2EDuration="4.792529534s" totalImagesPullingTime="3.306313317s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-13 03:04:19 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-13 03:04:23.792162426 +0000 UTC m=+446.192762891" watchObservedRunningTime="2026-07-13 03:04:23.792529534 +0000 UTC m=+446.193130000" Jul 13 03:04:23.812746 ip-10-0-134-52 kubenswrapper[2558]: I0713 03:04:23.812704 2558 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="cert-manager/cert-manager-cainjector-559cdd8c87-rkr48" podStartSLOduration=1.814930753 podStartE2EDuration="4.812685881s" totalImagesPullingTime="2.997755128s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-13 03:04:19 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-13 03:04:23.81143794 +0000 UTC m=+446.212038407" watchObservedRunningTime="2026-07-13 03:04:23.812685881 +0000 UTC m=+446.213286347" Jul 13 03:04:24.768787 ip-10-0-134-52 kubenswrapper[2558]: I0713 03:04:24.768752 2558 generic.go:356] "Generic (PLEG): container finished" podID="5b0cb191-fef0-44f6-a387-ce5c2750262b" containerID="a47b451888cf886db96342f0b7602e527a32d2a475b1d916e525b3bde0d4a198" exitCode=0 Jul 13 03:04:24.769166 ip-10-0-134-52 kubenswrapper[2558]: I0713 03:04:24.768834 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f5gl9r" event={"ID":"5b0cb191-fef0-44f6-a387-ce5c2750262b","Type":"ContainerDied","Data":"a47b451888cf886db96342f0b7602e527a32d2a475b1d916e525b3bde0d4a198"} Jul 13 03:04:25.904062 ip-10-0-134-52 kubenswrapper[2558]: I0713 03:04:25.904038 2558 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f5gl9r" Jul 13 03:04:26.041609 ip-10-0-134-52 kubenswrapper[2558]: I0713 03:04:26.041545 2558 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/5b0cb191-fef0-44f6-a387-ce5c2750262b-util\") pod \"5b0cb191-fef0-44f6-a387-ce5c2750262b\" (UID: \"5b0cb191-fef0-44f6-a387-ce5c2750262b\") " Jul 13 03:04:26.041609 ip-10-0-134-52 kubenswrapper[2558]: I0713 03:04:26.041590 2558 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/5b0cb191-fef0-44f6-a387-ce5c2750262b-bundle\") pod \"5b0cb191-fef0-44f6-a387-ce5c2750262b\" (UID: \"5b0cb191-fef0-44f6-a387-ce5c2750262b\") " Jul 13 03:04:26.041765 ip-10-0-134-52 kubenswrapper[2558]: I0713 03:04:26.041622 2558 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-cl5qs\" (UniqueName: \"kubernetes.io/projected/5b0cb191-fef0-44f6-a387-ce5c2750262b-kube-api-access-cl5qs\") pod \"5b0cb191-fef0-44f6-a387-ce5c2750262b\" (UID: \"5b0cb191-fef0-44f6-a387-ce5c2750262b\") " Jul 13 03:04:26.042015 ip-10-0-134-52 kubenswrapper[2558]: I0713 03:04:26.041988 2558 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/5b0cb191-fef0-44f6-a387-ce5c2750262b-bundle" (OuterVolumeSpecName: "bundle") pod "5b0cb191-fef0-44f6-a387-ce5c2750262b" (UID: "5b0cb191-fef0-44f6-a387-ce5c2750262b"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 13 03:04:26.043817 ip-10-0-134-52 kubenswrapper[2558]: I0713 03:04:26.043786 2558 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/5b0cb191-fef0-44f6-a387-ce5c2750262b-kube-api-access-cl5qs" (OuterVolumeSpecName: "kube-api-access-cl5qs") pod "5b0cb191-fef0-44f6-a387-ce5c2750262b" (UID: "5b0cb191-fef0-44f6-a387-ce5c2750262b"). InnerVolumeSpecName "kube-api-access-cl5qs". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 13 03:04:26.045648 ip-10-0-134-52 kubenswrapper[2558]: I0713 03:04:26.045611 2558 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/5b0cb191-fef0-44f6-a387-ce5c2750262b-util" (OuterVolumeSpecName: "util") pod "5b0cb191-fef0-44f6-a387-ce5c2750262b" (UID: "5b0cb191-fef0-44f6-a387-ce5c2750262b"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 13 03:04:26.142560 ip-10-0-134-52 kubenswrapper[2558]: I0713 03:04:26.142539 2558 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/5b0cb191-fef0-44f6-a387-ce5c2750262b-util\") on node \"ip-10-0-134-52.ec2.internal\" DevicePath \"\"" Jul 13 03:04:26.142560 ip-10-0-134-52 kubenswrapper[2558]: I0713 03:04:26.142561 2558 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/5b0cb191-fef0-44f6-a387-ce5c2750262b-bundle\") on node \"ip-10-0-134-52.ec2.internal\" DevicePath \"\"" Jul 13 03:04:26.142691 ip-10-0-134-52 kubenswrapper[2558]: I0713 03:04:26.142570 2558 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-cl5qs\" (UniqueName: \"kubernetes.io/projected/5b0cb191-fef0-44f6-a387-ce5c2750262b-kube-api-access-cl5qs\") on node \"ip-10-0-134-52.ec2.internal\" DevicePath \"\"" Jul 13 03:04:26.780150 ip-10-0-134-52 kubenswrapper[2558]: I0713 03:04:26.780115 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f5gl9r" event={"ID":"5b0cb191-fef0-44f6-a387-ce5c2750262b","Type":"ContainerDied","Data":"b84dce826e874177a5ec181c547bf9131afb16b1778c8e4343f7796d11fb291b"} Jul 13 03:04:26.780296 ip-10-0-134-52 kubenswrapper[2558]: I0713 03:04:26.780165 2558 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f5gl9r" Jul 13 03:04:26.780296 ip-10-0-134-52 kubenswrapper[2558]: I0713 03:04:26.780172 2558 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="b84dce826e874177a5ec181c547bf9131afb16b1778c8e4343f7796d11fb291b" Jul 13 03:04:28.969509 ip-10-0-134-52 kubenswrapper[2558]: I0713 03:04:28.969479 2558 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["cert-manager/cert-manager-55b4d954d5-6k6qc"] Jul 13 03:04:28.969851 ip-10-0-134-52 kubenswrapper[2558]: I0713 03:04:28.969757 2558 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="5b0cb191-fef0-44f6-a387-ce5c2750262b" containerName="extract" Jul 13 03:04:28.969851 ip-10-0-134-52 kubenswrapper[2558]: I0713 03:04:28.969769 2558 state_mem.go:107] "Deleted CPUSet assignment" podUID="5b0cb191-fef0-44f6-a387-ce5c2750262b" containerName="extract" Jul 13 03:04:28.969851 ip-10-0-134-52 kubenswrapper[2558]: I0713 03:04:28.969789 2558 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="5b0cb191-fef0-44f6-a387-ce5c2750262b" containerName="pull" Jul 13 03:04:28.969851 ip-10-0-134-52 kubenswrapper[2558]: I0713 03:04:28.969794 2558 state_mem.go:107] "Deleted CPUSet assignment" podUID="5b0cb191-fef0-44f6-a387-ce5c2750262b" containerName="pull" Jul 13 03:04:28.969851 ip-10-0-134-52 kubenswrapper[2558]: I0713 03:04:28.969801 2558 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="5b0cb191-fef0-44f6-a387-ce5c2750262b" containerName="util" Jul 13 03:04:28.969851 ip-10-0-134-52 kubenswrapper[2558]: I0713 03:04:28.969806 2558 state_mem.go:107] "Deleted CPUSet assignment" podUID="5b0cb191-fef0-44f6-a387-ce5c2750262b" containerName="util" Jul 13 03:04:28.970025 ip-10-0-134-52 kubenswrapper[2558]: I0713 03:04:28.969861 2558 memory_manager.go:368] "RemoveStaleState removing state" podUID="5b0cb191-fef0-44f6-a387-ce5c2750262b" containerName="extract" Jul 13 03:04:28.973706 ip-10-0-134-52 kubenswrapper[2558]: I0713 03:04:28.973687 2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager/cert-manager-55b4d954d5-6k6qc" Jul 13 03:04:28.976513 ip-10-0-134-52 kubenswrapper[2558]: I0713 03:04:28.976486 2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"cert-manager\"/\"cert-manager-dockercfg-dgrxd\"" Jul 13 03:04:28.980821 ip-10-0-134-52 kubenswrapper[2558]: I0713 03:04:28.980790 2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["cert-manager/cert-manager-55b4d954d5-6k6qc"] Jul 13 03:04:29.062039 ip-10-0-134-52 kubenswrapper[2558]: I0713 03:04:29.062013 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-nf4zh\" (UniqueName: \"kubernetes.io/projected/5f2ee64e-f5ac-4fad-bc58-e5575d5ec8bc-kube-api-access-nf4zh\") pod \"cert-manager-55b4d954d5-6k6qc\" (UID: \"5f2ee64e-f5ac-4fad-bc58-e5575d5ec8bc\") " pod="cert-manager/cert-manager-55b4d954d5-6k6qc" Jul 13 03:04:29.062149 ip-10-0-134-52 kubenswrapper[2558]: I0713 03:04:29.062065 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/5f2ee64e-f5ac-4fad-bc58-e5575d5ec8bc-bound-sa-token\") pod \"cert-manager-55b4d954d5-6k6qc\" (UID: \"5f2ee64e-f5ac-4fad-bc58-e5575d5ec8bc\") " pod="cert-manager/cert-manager-55b4d954d5-6k6qc" Jul 13 03:04:29.163017 ip-10-0-134-52 kubenswrapper[2558]: I0713 03:04:29.162994 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-nf4zh\" (UniqueName: \"kubernetes.io/projected/5f2ee64e-f5ac-4fad-bc58-e5575d5ec8bc-kube-api-access-nf4zh\") pod \"cert-manager-55b4d954d5-6k6qc\" (UID: \"5f2ee64e-f5ac-4fad-bc58-e5575d5ec8bc\") " pod="cert-manager/cert-manager-55b4d954d5-6k6qc" Jul 13 03:04:29.163117 ip-10-0-134-52 kubenswrapper[2558]: I0713 03:04:29.163054 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/5f2ee64e-f5ac-4fad-bc58-e5575d5ec8bc-bound-sa-token\") pod \"cert-manager-55b4d954d5-6k6qc\" (UID: \"5f2ee64e-f5ac-4fad-bc58-e5575d5ec8bc\") " pod="cert-manager/cert-manager-55b4d954d5-6k6qc" Jul 13 03:04:29.171028 ip-10-0-134-52 kubenswrapper[2558]: I0713 03:04:29.171006 2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/5f2ee64e-f5ac-4fad-bc58-e5575d5ec8bc-bound-sa-token\") pod \"cert-manager-55b4d954d5-6k6qc\" (UID: \"5f2ee64e-f5ac-4fad-bc58-e5575d5ec8bc\") " pod="cert-manager/cert-manager-55b4d954d5-6k6qc" Jul 13 03:04:29.171293 ip-10-0-134-52 kubenswrapper[2558]: I0713 03:04:29.171272 2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-nf4zh\" (UniqueName: \"kubernetes.io/projected/5f2ee64e-f5ac-4fad-bc58-e5575d5ec8bc-kube-api-access-nf4zh\") pod \"cert-manager-55b4d954d5-6k6qc\" (UID: \"5f2ee64e-f5ac-4fad-bc58-e5575d5ec8bc\") " pod="cert-manager/cert-manager-55b4d954d5-6k6qc" Jul 13 03:04:29.282805 ip-10-0-134-52 kubenswrapper[2558]: I0713 03:04:29.282742 2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager/cert-manager-55b4d954d5-6k6qc" Jul 13 03:04:29.406426 ip-10-0-134-52 kubenswrapper[2558]: I0713 03:04:29.406401 2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["cert-manager/cert-manager-55b4d954d5-6k6qc"] Jul 13 03:04:29.408130 ip-10-0-134-52 kubenswrapper[2558]: W0713 03:04:29.408104 2558 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod5f2ee64e_f5ac_4fad_bc58_e5575d5ec8bc.slice/crio-d3eaa467405b23297bfb69342f807b2283ece829516333843b47b52f7f85b0f5 WatchSource:0}: Error finding container d3eaa467405b23297bfb69342f807b2283ece829516333843b47b52f7f85b0f5: Status 404 returned error can't find the container with id d3eaa467405b23297bfb69342f807b2283ece829516333843b47b52f7f85b0f5 Jul 13 03:04:29.771556 ip-10-0-134-52 kubenswrapper[2558]: I0713 03:04:29.771530 2558 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="cert-manager/cert-manager-webhook-6486ffd997-xzcsn" Jul 13 03:04:29.794440 ip-10-0-134-52 kubenswrapper[2558]: I0713 03:04:29.794396 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="cert-manager/cert-manager-55b4d954d5-6k6qc" event={"ID":"5f2ee64e-f5ac-4fad-bc58-e5575d5ec8bc","Type":"ContainerStarted","Data":"f9fa1fe7b36317d2eb3c458acde7ad1400ae128cc6ce8b20947a021db34f8f58"} Jul 13 03:04:29.794605 ip-10-0-134-52 kubenswrapper[2558]: I0713 03:04:29.794451 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="cert-manager/cert-manager-55b4d954d5-6k6qc" event={"ID":"5f2ee64e-f5ac-4fad-bc58-e5575d5ec8bc","Type":"ContainerStarted","Data":"d3eaa467405b23297bfb69342f807b2283ece829516333843b47b52f7f85b0f5"} Jul 13 03:04:29.809732 ip-10-0-134-52 kubenswrapper[2558]: I0713 03:04:29.809690 2558 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="cert-manager/cert-manager-55b4d954d5-6k6qc" podStartSLOduration=1.809675785 podStartE2EDuration="1.809675785s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-13 03:04:28 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-13 03:04:29.808950963 +0000 UTC m=+452.209551430" watchObservedRunningTime="2026-07-13 03:04:29.809675785 +0000 UTC m=+452.210276251" Jul 13 03:04:48.496089 ip-10-0-134-52 kubenswrapper[2558]: I0713 03:04:48.496058 2558 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afw6qkr"] Jul 13 03:04:48.500558 ip-10-0-134-52 kubenswrapper[2558]: I0713 03:04:48.500540 2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afw6qkr" Jul 13 03:04:48.503371 ip-10-0-134-52 kubenswrapper[2558]: I0713 03:04:48.503338 2558 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"openshift-service-ca.crt\"" Jul 13 03:04:48.503371 ip-10-0-134-52 kubenswrapper[2558]: I0713 03:04:48.503353 2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-marketplace\"/\"default-dockercfg-44tz4\"" Jul 13 03:04:48.503521 ip-10-0-134-52 kubenswrapper[2558]: I0713 03:04:48.503389 2558 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"kube-root-ca.crt\"" Jul 13 03:04:48.506610 ip-10-0-134-52 kubenswrapper[2558]: I0713 03:04:48.506590 2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afw6qkr"] Jul 13 03:04:48.601640 ip-10-0-134-52 kubenswrapper[2558]: I0713 03:04:48.601612 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/62926726-9f89-4036-807e-63824af3c9d4-bundle\") pod \"629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afw6qkr\" (UID: \"62926726-9f89-4036-807e-63824af3c9d4\") " pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afw6qkr" Jul 13 03:04:48.601746 ip-10-0-134-52 kubenswrapper[2558]: I0713 03:04:48.601653 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-lc9lh\" (UniqueName: \"kubernetes.io/projected/62926726-9f89-4036-807e-63824af3c9d4-kube-api-access-lc9lh\") pod \"629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afw6qkr\" (UID: \"62926726-9f89-4036-807e-63824af3c9d4\") " pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afw6qkr" Jul 13 03:04:48.601746 ip-10-0-134-52 kubenswrapper[2558]: I0713 03:04:48.601699 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/62926726-9f89-4036-807e-63824af3c9d4-util\") pod \"629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afw6qkr\" (UID: \"62926726-9f89-4036-807e-63824af3c9d4\") " pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afw6qkr" Jul 13 03:04:48.702429 ip-10-0-134-52 kubenswrapper[2558]: I0713 03:04:48.702403 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/62926726-9f89-4036-807e-63824af3c9d4-bundle\") pod \"629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afw6qkr\" (UID: \"62926726-9f89-4036-807e-63824af3c9d4\") " pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afw6qkr" Jul 13 03:04:48.702524 ip-10-0-134-52 kubenswrapper[2558]: I0713 03:04:48.702448 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-lc9lh\" (UniqueName: \"kubernetes.io/projected/62926726-9f89-4036-807e-63824af3c9d4-kube-api-access-lc9lh\") pod \"629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afw6qkr\" (UID: \"62926726-9f89-4036-807e-63824af3c9d4\") " pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afw6qkr" Jul 13 03:04:48.702524 ip-10-0-134-52 kubenswrapper[2558]: I0713 03:04:48.702503 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/62926726-9f89-4036-807e-63824af3c9d4-util\") pod \"629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afw6qkr\" (UID: \"62926726-9f89-4036-807e-63824af3c9d4\") " pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afw6qkr" Jul 13 03:04:48.702778 ip-10-0-134-52 kubenswrapper[2558]: I0713 03:04:48.702758 2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/62926726-9f89-4036-807e-63824af3c9d4-bundle\") pod \"629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afw6qkr\" (UID: \"62926726-9f89-4036-807e-63824af3c9d4\") " pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afw6qkr" Jul 13 03:04:48.702818 ip-10-0-134-52 kubenswrapper[2558]: I0713 03:04:48.702786 2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/62926726-9f89-4036-807e-63824af3c9d4-util\") pod \"629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afw6qkr\" (UID: \"62926726-9f89-4036-807e-63824af3c9d4\") " pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afw6qkr" Jul 13 03:04:48.712712 ip-10-0-134-52 kubenswrapper[2558]: I0713 03:04:48.712687 2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-lc9lh\" (UniqueName: \"kubernetes.io/projected/62926726-9f89-4036-807e-63824af3c9d4-kube-api-access-lc9lh\") pod \"629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afw6qkr\" (UID: \"62926726-9f89-4036-807e-63824af3c9d4\") " pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afw6qkr" Jul 13 03:04:48.810748 ip-10-0-134-52 kubenswrapper[2558]: I0713 03:04:48.810726 2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afw6qkr" Jul 13 03:04:48.937699 ip-10-0-134-52 kubenswrapper[2558]: I0713 03:04:48.937672 2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afw6qkr"] Jul 13 03:04:48.940225 ip-10-0-134-52 kubenswrapper[2558]: W0713 03:04:48.940201 2558 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod62926726_9f89_4036_807e_63824af3c9d4.slice/crio-21d289b7cb24940c4beb64c07df27415e9de8a71474ec5e278fe0a5bbd681e8d WatchSource:0}: Error finding container 21d289b7cb24940c4beb64c07df27415e9de8a71474ec5e278fe0a5bbd681e8d: Status 404 returned error can't find the container with id 21d289b7cb24940c4beb64c07df27415e9de8a71474ec5e278fe0a5bbd681e8d Jul 13 03:04:49.882818 ip-10-0-134-52 kubenswrapper[2558]: I0713 03:04:49.882781 2558 generic.go:356] "Generic (PLEG): container finished" podID="62926726-9f89-4036-807e-63824af3c9d4" containerID="54f81792cd84f2abd6116b0d3a9e433a4ec6de23da39cbdfc6a82be790b0ee27" exitCode=0 Jul 13 03:04:49.883150 ip-10-0-134-52 kubenswrapper[2558]: I0713 03:04:49.882868 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afw6qkr" event={"ID":"62926726-9f89-4036-807e-63824af3c9d4","Type":"ContainerDied","Data":"54f81792cd84f2abd6116b0d3a9e433a4ec6de23da39cbdfc6a82be790b0ee27"} Jul 13 03:04:49.883150 ip-10-0-134-52 kubenswrapper[2558]: I0713 03:04:49.882944 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afw6qkr" event={"ID":"62926726-9f89-4036-807e-63824af3c9d4","Type":"ContainerStarted","Data":"21d289b7cb24940c4beb64c07df27415e9de8a71474ec5e278fe0a5bbd681e8d"} Jul 13 03:04:50.889657 ip-10-0-134-52 kubenswrapper[2558]: I0713 03:04:50.889626 2558 generic.go:356] "Generic (PLEG): container finished" podID="62926726-9f89-4036-807e-63824af3c9d4" containerID="b41535c0912151c735d8222cf497012a0dc87aaea5896e34aff066e06cb29776" exitCode=0 Jul 13 03:04:50.889993 ip-10-0-134-52 kubenswrapper[2558]: I0713 03:04:50.889710 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afw6qkr" event={"ID":"62926726-9f89-4036-807e-63824af3c9d4","Type":"ContainerDied","Data":"b41535c0912151c735d8222cf497012a0dc87aaea5896e34aff066e06cb29776"} Jul 13 03:04:51.897308 ip-10-0-134-52 kubenswrapper[2558]: I0713 03:04:51.897273 2558 generic.go:356] "Generic (PLEG): container finished" podID="62926726-9f89-4036-807e-63824af3c9d4" containerID="8bd2702cf7003221a2e4d1649dfebac4960d6f91d296abb9ca3c52b6c7886560" exitCode=0 Jul 13 03:04:51.897695 ip-10-0-134-52 kubenswrapper[2558]: I0713 03:04:51.897368 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afw6qkr" event={"ID":"62926726-9f89-4036-807e-63824af3c9d4","Type":"ContainerDied","Data":"8bd2702cf7003221a2e4d1649dfebac4960d6f91d296abb9ca3c52b6c7886560"} Jul 13 03:04:53.024852 ip-10-0-134-52 kubenswrapper[2558]: I0713 03:04:53.024829 2558 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afw6qkr" Jul 13 03:04:53.137467 ip-10-0-134-52 kubenswrapper[2558]: I0713 03:04:53.137436 2558 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/62926726-9f89-4036-807e-63824af3c9d4-util\") pod \"62926726-9f89-4036-807e-63824af3c9d4\" (UID: \"62926726-9f89-4036-807e-63824af3c9d4\") " Jul 13 03:04:53.137640 ip-10-0-134-52 kubenswrapper[2558]: I0713 03:04:53.137492 2558 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/62926726-9f89-4036-807e-63824af3c9d4-bundle\") pod \"62926726-9f89-4036-807e-63824af3c9d4\" (UID: \"62926726-9f89-4036-807e-63824af3c9d4\") " Jul 13 03:04:53.137640 ip-10-0-134-52 kubenswrapper[2558]: I0713 03:04:53.137550 2558 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-lc9lh\" (UniqueName: \"kubernetes.io/projected/62926726-9f89-4036-807e-63824af3c9d4-kube-api-access-lc9lh\") pod \"62926726-9f89-4036-807e-63824af3c9d4\" (UID: \"62926726-9f89-4036-807e-63824af3c9d4\") " Jul 13 03:04:53.138181 ip-10-0-134-52 kubenswrapper[2558]: I0713 03:04:53.138159 2558 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/62926726-9f89-4036-807e-63824af3c9d4-bundle" (OuterVolumeSpecName: "bundle") pod "62926726-9f89-4036-807e-63824af3c9d4" (UID: "62926726-9f89-4036-807e-63824af3c9d4"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 13 03:04:53.139713 ip-10-0-134-52 kubenswrapper[2558]: I0713 03:04:53.139689 2558 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/62926726-9f89-4036-807e-63824af3c9d4-kube-api-access-lc9lh" (OuterVolumeSpecName: "kube-api-access-lc9lh") pod "62926726-9f89-4036-807e-63824af3c9d4" (UID: "62926726-9f89-4036-807e-63824af3c9d4"). InnerVolumeSpecName "kube-api-access-lc9lh". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 13 03:04:53.143708 ip-10-0-134-52 kubenswrapper[2558]: I0713 03:04:53.143684 2558 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/62926726-9f89-4036-807e-63824af3c9d4-util" (OuterVolumeSpecName: "util") pod "62926726-9f89-4036-807e-63824af3c9d4" (UID: "62926726-9f89-4036-807e-63824af3c9d4"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 13 03:04:53.238113 ip-10-0-134-52 kubenswrapper[2558]: I0713 03:04:53.238044 2558 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/62926726-9f89-4036-807e-63824af3c9d4-util\") on node \"ip-10-0-134-52.ec2.internal\" DevicePath \"\"" Jul 13 03:04:53.238113 ip-10-0-134-52 kubenswrapper[2558]: I0713 03:04:53.238066 2558 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/62926726-9f89-4036-807e-63824af3c9d4-bundle\") on node \"ip-10-0-134-52.ec2.internal\" DevicePath \"\"" Jul 13 03:04:53.238113 ip-10-0-134-52 kubenswrapper[2558]: I0713 03:04:53.238075 2558 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-lc9lh\" (UniqueName: \"kubernetes.io/projected/62926726-9f89-4036-807e-63824af3c9d4-kube-api-access-lc9lh\") on node \"ip-10-0-134-52.ec2.internal\" DevicePath \"\"" Jul 13 03:04:53.911958 ip-10-0-134-52 kubenswrapper[2558]: I0713 03:04:53.911927 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afw6qkr" event={"ID":"62926726-9f89-4036-807e-63824af3c9d4","Type":"ContainerDied","Data":"21d289b7cb24940c4beb64c07df27415e9de8a71474ec5e278fe0a5bbd681e8d"} Jul 13 03:04:53.912126 ip-10-0-134-52 kubenswrapper[2558]: I0713 03:04:53.911976 2558 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="21d289b7cb24940c4beb64c07df27415e9de8a71474ec5e278fe0a5bbd681e8d" Jul 13 03:04:53.912126 ip-10-0-134-52 kubenswrapper[2558]: I0713 03:04:53.912009 2558 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afw6qkr" Jul 13 03:05:01.452390 ip-10-0-134-52 kubenswrapper[2558]: I0713 03:05:01.452355 2558 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-7dcb9ff95f-jsjt6"] Jul 13 03:05:01.452747 ip-10-0-134-52 kubenswrapper[2558]: I0713 03:05:01.452670 2558 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="62926726-9f89-4036-807e-63824af3c9d4" containerName="pull" Jul 13 03:05:01.452747 ip-10-0-134-52 kubenswrapper[2558]: I0713 03:05:01.452680 2558 state_mem.go:107] "Deleted CPUSet assignment" podUID="62926726-9f89-4036-807e-63824af3c9d4" containerName="pull" Jul 13 03:05:01.452747 ip-10-0-134-52 kubenswrapper[2558]: I0713 03:05:01.452696 2558 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="62926726-9f89-4036-807e-63824af3c9d4" containerName="util" Jul 13 03:05:01.452747 ip-10-0-134-52 kubenswrapper[2558]: I0713 03:05:01.452702 2558 state_mem.go:107] "Deleted CPUSet assignment" podUID="62926726-9f89-4036-807e-63824af3c9d4" containerName="util" Jul 13 03:05:01.452747 ip-10-0-134-52 kubenswrapper[2558]: I0713 03:05:01.452712 2558 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="62926726-9f89-4036-807e-63824af3c9d4" containerName="extract" Jul 13 03:05:01.452747 ip-10-0-134-52 kubenswrapper[2558]: I0713 03:05:01.452717 2558 state_mem.go:107] "Deleted CPUSet assignment" podUID="62926726-9f89-4036-807e-63824af3c9d4" containerName="extract" Jul 13 03:05:01.452935 ip-10-0-134-52 kubenswrapper[2558]: I0713 03:05:01.452768 2558 memory_manager.go:368] "RemoveStaleState removing state" podUID="62926726-9f89-4036-807e-63824af3c9d4" containerName="extract" Jul 13 03:05:01.456973 ip-10-0-134-52 kubenswrapper[2558]: I0713 03:05:01.456957 2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/opendatahub-operator-controller-manager-7dcb9ff95f-jsjt6" Jul 13 03:05:01.459704 ip-10-0-134-52 kubenswrapper[2558]: I0713 03:05:01.459671 2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-manager-dockercfg-4gp7m\"" Jul 13 03:05:01.459829 ip-10-0-134-52 kubenswrapper[2558]: I0713 03:05:01.459703 2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-webhook-cert\"" Jul 13 03:05:01.460356 ip-10-0-134-52 kubenswrapper[2558]: I0713 03:05:01.460319 2558 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"openshift-service-ca.crt\"" Jul 13 03:05:01.460453 ip-10-0-134-52 kubenswrapper[2558]: I0713 03:05:01.460399 2558 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"kube-root-ca.crt\"" Jul 13 03:05:01.460626 ip-10-0-134-52 kubenswrapper[2558]: I0713 03:05:01.460611 2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-manager-service-cert\"" Jul 13 03:05:01.474749 ip-10-0-134-52 kubenswrapper[2558]: I0713 03:05:01.474729 2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-7dcb9ff95f-jsjt6"] Jul 13 03:05:01.597593 ip-10-0-134-52 kubenswrapper[2558]: I0713 03:05:01.597563 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/c8a067a6-8c09-470c-87f7-49ac6d22c34e-manifests\") pod \"opendatahub-operator-controller-manager-7dcb9ff95f-jsjt6\" (UID: \"c8a067a6-8c09-470c-87f7-49ac6d22c34e\") " pod="opendatahub/opendatahub-operator-controller-manager-7dcb9ff95f-jsjt6" Jul 13 03:05:01.597717 ip-10-0-134-52 kubenswrapper[2558]: I0713 03:05:01.597613 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/c8a067a6-8c09-470c-87f7-49ac6d22c34e-apiservice-cert\") pod \"opendatahub-operator-controller-manager-7dcb9ff95f-jsjt6\" (UID: \"c8a067a6-8c09-470c-87f7-49ac6d22c34e\") " pod="opendatahub/opendatahub-operator-controller-manager-7dcb9ff95f-jsjt6" Jul 13 03:05:01.597717 ip-10-0-134-52 kubenswrapper[2558]: I0713 03:05:01.597669 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/c8a067a6-8c09-470c-87f7-49ac6d22c34e-webhook-cert\") pod \"opendatahub-operator-controller-manager-7dcb9ff95f-jsjt6\" (UID: \"c8a067a6-8c09-470c-87f7-49ac6d22c34e\") " pod="opendatahub/opendatahub-operator-controller-manager-7dcb9ff95f-jsjt6" Jul 13 03:05:01.597717 ip-10-0-134-52 kubenswrapper[2558]: I0713 03:05:01.597689 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-n8g9c\" (UniqueName: \"kubernetes.io/projected/c8a067a6-8c09-470c-87f7-49ac6d22c34e-kube-api-access-n8g9c\") pod \"opendatahub-operator-controller-manager-7dcb9ff95f-jsjt6\" (UID: \"c8a067a6-8c09-470c-87f7-49ac6d22c34e\") " pod="opendatahub/opendatahub-operator-controller-manager-7dcb9ff95f-jsjt6" Jul 13 03:05:01.597815 ip-10-0-134-52 kubenswrapper[2558]: I0713 03:05:01.597718 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/c8a067a6-8c09-470c-87f7-49ac6d22c34e-tmp\") pod \"opendatahub-operator-controller-manager-7dcb9ff95f-jsjt6\" (UID: \"c8a067a6-8c09-470c-87f7-49ac6d22c34e\") " pod="opendatahub/opendatahub-operator-controller-manager-7dcb9ff95f-jsjt6" Jul 13 03:05:01.698517 ip-10-0-134-52 kubenswrapper[2558]: I0713 03:05:01.698489 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/c8a067a6-8c09-470c-87f7-49ac6d22c34e-tmp\") pod \"opendatahub-operator-controller-manager-7dcb9ff95f-jsjt6\" (UID: \"c8a067a6-8c09-470c-87f7-49ac6d22c34e\") " pod="opendatahub/opendatahub-operator-controller-manager-7dcb9ff95f-jsjt6" Jul 13 03:05:01.698642 ip-10-0-134-52 kubenswrapper[2558]: I0713 03:05:01.698533 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/c8a067a6-8c09-470c-87f7-49ac6d22c34e-manifests\") pod \"opendatahub-operator-controller-manager-7dcb9ff95f-jsjt6\" (UID: \"c8a067a6-8c09-470c-87f7-49ac6d22c34e\") " pod="opendatahub/opendatahub-operator-controller-manager-7dcb9ff95f-jsjt6" Jul 13 03:05:01.698642 ip-10-0-134-52 kubenswrapper[2558]: I0713 03:05:01.698575 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/c8a067a6-8c09-470c-87f7-49ac6d22c34e-apiservice-cert\") pod \"opendatahub-operator-controller-manager-7dcb9ff95f-jsjt6\" (UID: \"c8a067a6-8c09-470c-87f7-49ac6d22c34e\") " pod="opendatahub/opendatahub-operator-controller-manager-7dcb9ff95f-jsjt6" Jul 13 03:05:01.698642 ip-10-0-134-52 kubenswrapper[2558]: I0713 03:05:01.698619 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/c8a067a6-8c09-470c-87f7-49ac6d22c34e-webhook-cert\") pod \"opendatahub-operator-controller-manager-7dcb9ff95f-jsjt6\" (UID: \"c8a067a6-8c09-470c-87f7-49ac6d22c34e\") " pod="opendatahub/opendatahub-operator-controller-manager-7dcb9ff95f-jsjt6" Jul 13 03:05:01.698784 ip-10-0-134-52 kubenswrapper[2558]: I0713 03:05:01.698651 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-n8g9c\" (UniqueName: \"kubernetes.io/projected/c8a067a6-8c09-470c-87f7-49ac6d22c34e-kube-api-access-n8g9c\") pod \"opendatahub-operator-controller-manager-7dcb9ff95f-jsjt6\" (UID: \"c8a067a6-8c09-470c-87f7-49ac6d22c34e\") " pod="opendatahub/opendatahub-operator-controller-manager-7dcb9ff95f-jsjt6" Jul 13 03:05:01.698997 ip-10-0-134-52 kubenswrapper[2558]: I0713 03:05:01.698973 2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/c8a067a6-8c09-470c-87f7-49ac6d22c34e-manifests\") pod \"opendatahub-operator-controller-manager-7dcb9ff95f-jsjt6\" (UID: \"c8a067a6-8c09-470c-87f7-49ac6d22c34e\") " pod="opendatahub/opendatahub-operator-controller-manager-7dcb9ff95f-jsjt6" Jul 13 03:05:01.700755 ip-10-0-134-52 kubenswrapper[2558]: I0713 03:05:01.700735 2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/c8a067a6-8c09-470c-87f7-49ac6d22c34e-tmp\") pod \"opendatahub-operator-controller-manager-7dcb9ff95f-jsjt6\" (UID: \"c8a067a6-8c09-470c-87f7-49ac6d22c34e\") " pod="opendatahub/opendatahub-operator-controller-manager-7dcb9ff95f-jsjt6" Jul 13 03:05:01.700989 ip-10-0-134-52 kubenswrapper[2558]: I0713 03:05:01.700972 2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/c8a067a6-8c09-470c-87f7-49ac6d22c34e-apiservice-cert\") pod \"opendatahub-operator-controller-manager-7dcb9ff95f-jsjt6\" (UID: \"c8a067a6-8c09-470c-87f7-49ac6d22c34e\") " pod="opendatahub/opendatahub-operator-controller-manager-7dcb9ff95f-jsjt6" Jul 13 03:05:01.701064 ip-10-0-134-52 kubenswrapper[2558]: I0713 03:05:01.701005 2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/c8a067a6-8c09-470c-87f7-49ac6d22c34e-webhook-cert\") pod \"opendatahub-operator-controller-manager-7dcb9ff95f-jsjt6\" (UID: \"c8a067a6-8c09-470c-87f7-49ac6d22c34e\") " pod="opendatahub/opendatahub-operator-controller-manager-7dcb9ff95f-jsjt6" Jul 13 03:05:01.707746 ip-10-0-134-52 kubenswrapper[2558]: I0713 03:05:01.707681 2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-n8g9c\" (UniqueName: \"kubernetes.io/projected/c8a067a6-8c09-470c-87f7-49ac6d22c34e-kube-api-access-n8g9c\") pod \"opendatahub-operator-controller-manager-7dcb9ff95f-jsjt6\" (UID: \"c8a067a6-8c09-470c-87f7-49ac6d22c34e\") " pod="opendatahub/opendatahub-operator-controller-manager-7dcb9ff95f-jsjt6" Jul 13 03:05:01.767482 ip-10-0-134-52 kubenswrapper[2558]: I0713 03:05:01.767462 2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/opendatahub-operator-controller-manager-7dcb9ff95f-jsjt6" Jul 13 03:05:01.900958 ip-10-0-134-52 kubenswrapper[2558]: I0713 03:05:01.900935 2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-7dcb9ff95f-jsjt6"] Jul 13 03:05:01.903024 ip-10-0-134-52 kubenswrapper[2558]: W0713 03:05:01.902998 2558 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podc8a067a6_8c09_470c_87f7_49ac6d22c34e.slice/crio-4cd7587c83b752f3c6fff67561d74a862bf6733b0c3dd6a3c54014cbb9696023 WatchSource:0}: Error finding container 4cd7587c83b752f3c6fff67561d74a862bf6733b0c3dd6a3c54014cbb9696023: Status 404 returned error can't find the container with id 4cd7587c83b752f3c6fff67561d74a862bf6733b0c3dd6a3c54014cbb9696023 Jul 13 03:05:01.946624 ip-10-0-134-52 kubenswrapper[2558]: I0713 03:05:01.946592 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-7dcb9ff95f-jsjt6" event={"ID":"c8a067a6-8c09-470c-87f7-49ac6d22c34e","Type":"ContainerStarted","Data":"4cd7587c83b752f3c6fff67561d74a862bf6733b0c3dd6a3c54014cbb9696023"} Jul 13 03:05:04.963298 ip-10-0-134-52 kubenswrapper[2558]: I0713 03:05:04.963269 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-7dcb9ff95f-jsjt6" event={"ID":"c8a067a6-8c09-470c-87f7-49ac6d22c34e","Type":"ContainerStarted","Data":"85bd3ab654e5edc383364b30c81ab94a5c80c3349643a0b3ba99d311e337ebef"} Jul 13 03:05:06.974663 ip-10-0-134-52 kubenswrapper[2558]: I0713 03:05:06.974625 2558 generic.go:356] "Generic (PLEG): container finished" podID="c8a067a6-8c09-470c-87f7-49ac6d22c34e" containerID="85bd3ab654e5edc383364b30c81ab94a5c80c3349643a0b3ba99d311e337ebef" exitCode=0 Jul 13 03:05:06.975120 ip-10-0-134-52 kubenswrapper[2558]: I0713 03:05:06.974701 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-7dcb9ff95f-jsjt6" event={"ID":"c8a067a6-8c09-470c-87f7-49ac6d22c34e","Type":"ContainerDied","Data":"85bd3ab654e5edc383364b30c81ab94a5c80c3349643a0b3ba99d311e337ebef"} Jul 13 03:05:07.981227 ip-10-0-134-52 kubenswrapper[2558]: I0713 03:05:07.981195 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-7dcb9ff95f-jsjt6" event={"ID":"c8a067a6-8c09-470c-87f7-49ac6d22c34e","Type":"ContainerStarted","Data":"a9409daaacefbaddeabfa642d8ef90f87db4b9b865c3f1da1cd311355b273cc2"} Jul 13 03:05:07.981650 ip-10-0-134-52 kubenswrapper[2558]: I0713 03:05:07.981391 2558 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/opendatahub-operator-controller-manager-7dcb9ff95f-jsjt6" Jul 13 03:05:08.005054 ip-10-0-134-52 kubenswrapper[2558]: I0713 03:05:08.005006 2558 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/opendatahub-operator-controller-manager-7dcb9ff95f-jsjt6" podStartSLOduration=2.603037833 podStartE2EDuration="7.004993654s" totalImagesPullingTime="3.332948015s" totalInitContainerRuntime="1.069007806s" isStatefulPod=false podCreationTimestamp="2026-07-13 03:05:01 +0000 UTC" imagePullSessionsCount=2 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-13 03:05:08.002441436 +0000 UTC m=+490.403041920" watchObservedRunningTime="2026-07-13 03:05:08.004993654 +0000 UTC m=+490.405594120" Jul 13 03:05:18.988371 ip-10-0-134-52 kubenswrapper[2558]: I0713 03:05:18.988323 2558 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/opendatahub-operator-controller-manager-7dcb9ff95f-jsjt6" Jul 13 03:05:21.784680 ip-10-0-134-52 kubenswrapper[2558]: I0713 03:05:21.784651 2558 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/model-serving-api-54d89bd5fc-bvrs4"] Jul 13 03:05:21.786925 ip-10-0-134-52 kubenswrapper[2558]: I0713 03:05:21.786910 2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/model-serving-api-54d89bd5fc-bvrs4" Jul 13 03:05:21.789577 ip-10-0-134-52 kubenswrapper[2558]: I0713 03:05:21.789554 2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"model-serving-api-tls\"" Jul 13 03:05:21.804855 ip-10-0-134-52 kubenswrapper[2558]: I0713 03:05:21.804830 2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/model-serving-api-54d89bd5fc-bvrs4"] Jul 13 03:05:21.838594 ip-10-0-134-52 kubenswrapper[2558]: I0713 03:05:21.838566 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/cbfbffcd-8456-47cd-908e-7c8e9cec2304-tls-certs\") pod \"model-serving-api-54d89bd5fc-bvrs4\" (UID: \"cbfbffcd-8456-47cd-908e-7c8e9cec2304\") " pod="opendatahub/model-serving-api-54d89bd5fc-bvrs4" Jul 13 03:05:21.838694 ip-10-0-134-52 kubenswrapper[2558]: I0713 03:05:21.838612 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-c6tk6\" (UniqueName: \"kubernetes.io/projected/cbfbffcd-8456-47cd-908e-7c8e9cec2304-kube-api-access-c6tk6\") pod \"model-serving-api-54d89bd5fc-bvrs4\" (UID: \"cbfbffcd-8456-47cd-908e-7c8e9cec2304\") " pod="opendatahub/model-serving-api-54d89bd5fc-bvrs4" Jul 13 03:05:21.939792 ip-10-0-134-52 kubenswrapper[2558]: I0713 03:05:21.939765 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/cbfbffcd-8456-47cd-908e-7c8e9cec2304-tls-certs\") pod \"model-serving-api-54d89bd5fc-bvrs4\" (UID: \"cbfbffcd-8456-47cd-908e-7c8e9cec2304\") " pod="opendatahub/model-serving-api-54d89bd5fc-bvrs4" Jul 13 03:05:21.939896 ip-10-0-134-52 kubenswrapper[2558]: I0713 03:05:21.939805 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-c6tk6\" (UniqueName: \"kubernetes.io/projected/cbfbffcd-8456-47cd-908e-7c8e9cec2304-kube-api-access-c6tk6\") pod \"model-serving-api-54d89bd5fc-bvrs4\" (UID: \"cbfbffcd-8456-47cd-908e-7c8e9cec2304\") " pod="opendatahub/model-serving-api-54d89bd5fc-bvrs4" Jul 13 03:05:21.942265 ip-10-0-134-52 kubenswrapper[2558]: I0713 03:05:21.942237 2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/cbfbffcd-8456-47cd-908e-7c8e9cec2304-tls-certs\") pod \"model-serving-api-54d89bd5fc-bvrs4\" (UID: \"cbfbffcd-8456-47cd-908e-7c8e9cec2304\") " pod="opendatahub/model-serving-api-54d89bd5fc-bvrs4" Jul 13 03:05:21.954016 ip-10-0-134-52 kubenswrapper[2558]: I0713 03:05:21.953994 2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-c6tk6\" (UniqueName: \"kubernetes.io/projected/cbfbffcd-8456-47cd-908e-7c8e9cec2304-kube-api-access-c6tk6\") pod \"model-serving-api-54d89bd5fc-bvrs4\" (UID: \"cbfbffcd-8456-47cd-908e-7c8e9cec2304\") " pod="opendatahub/model-serving-api-54d89bd5fc-bvrs4" Jul 13 03:05:22.096957 ip-10-0-134-52 kubenswrapper[2558]: I0713 03:05:22.096932 2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/model-serving-api-54d89bd5fc-bvrs4" Jul 13 03:05:22.232627 ip-10-0-134-52 kubenswrapper[2558]: I0713 03:05:22.232603 2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/model-serving-api-54d89bd5fc-bvrs4"] Jul 13 03:05:22.234800 ip-10-0-134-52 kubenswrapper[2558]: W0713 03:05:22.234773 2558 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podcbfbffcd_8456_47cd_908e_7c8e9cec2304.slice/crio-c42154231f2d511723036639fd1c7af916ff5e36001323df23549f12f66e34e3 WatchSource:0}: Error finding container c42154231f2d511723036639fd1c7af916ff5e36001323df23549f12f66e34e3: Status 404 returned error can't find the container with id c42154231f2d511723036639fd1c7af916ff5e36001323df23549f12f66e34e3 Jul 13 03:05:23.056680 ip-10-0-134-52 kubenswrapper[2558]: I0713 03:05:23.056628 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/model-serving-api-54d89bd5fc-bvrs4" event={"ID":"cbfbffcd-8456-47cd-908e-7c8e9cec2304","Type":"ContainerStarted","Data":"c42154231f2d511723036639fd1c7af916ff5e36001323df23549f12f66e34e3"} Jul 13 03:05:24.063040 ip-10-0-134-52 kubenswrapper[2558]: I0713 03:05:24.063010 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/model-serving-api-54d89bd5fc-bvrs4" event={"ID":"cbfbffcd-8456-47cd-908e-7c8e9cec2304","Type":"ContainerStarted","Data":"97f597383497b12523719f927a3eea37c5a3c75c6b0153a2df3b96bb98a95131"} Jul 13 03:05:24.063445 ip-10-0-134-52 kubenswrapper[2558]: I0713 03:05:24.063079 2558 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/model-serving-api-54d89bd5fc-bvrs4" Jul 13 03:05:24.079536 ip-10-0-134-52 kubenswrapper[2558]: I0713 03:05:24.079494 2558 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/model-serving-api-54d89bd5fc-bvrs4" podStartSLOduration=1.318499933 podStartE2EDuration="3.079478337s" totalImagesPullingTime="1.760978404s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-13 03:05:21 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-13 03:05:24.077492183 +0000 UTC m=+506.478092659" watchObservedRunningTime="2026-07-13 03:05:24.079478337 +0000 UTC m=+506.480078844" Jul 13 03:05:28.514440 ip-10-0-134-52 kubenswrapper[2558]: I0713 03:05:28.514404 2558 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-lws-operator/lws-controller-manager-f4bfdbc5d-xbjpm"] Jul 13 03:05:28.517899 ip-10-0-134-52 kubenswrapper[2558]: I0713 03:05:28.517878 2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-lws-operator/lws-controller-manager-f4bfdbc5d-xbjpm" Jul 13 03:05:28.520930 ip-10-0-134-52 kubenswrapper[2558]: I0713 03:05:28.520904 2558 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-lws-operator\"/\"openshift-service-ca.crt\"" Jul 13 03:05:28.522462 ip-10-0-134-52 kubenswrapper[2558]: I0713 03:05:28.522427 2558 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-lws-operator\"/\"lws-manager-config\"" Jul 13 03:05:28.522462 ip-10-0-134-52 kubenswrapper[2558]: I0713 03:05:28.522431 2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-lws-operator\"/\"lws-controller-manager-dockercfg-mr88t\"" Jul 13 03:05:28.522624 ip-10-0-134-52 kubenswrapper[2558]: I0713 03:05:28.522467 2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-lws-operator\"/\"webhook-server-cert\"" Jul 13 03:05:28.522624 ip-10-0-134-52 kubenswrapper[2558]: I0713 03:05:28.522493 2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-lws-operator\"/\"metrics-server-cert\"" Jul 13 03:05:28.522624 ip-10-0-134-52 kubenswrapper[2558]: I0713 03:05:28.522430 2558 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-lws-operator\"/\"kube-root-ca.crt\"" Jul 13 03:05:28.528909 ip-10-0-134-52 kubenswrapper[2558]: I0713 03:05:28.528880 2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-lws-operator/lws-controller-manager-f4bfdbc5d-xbjpm"] Jul 13 03:05:28.588561 ip-10-0-134-52 kubenswrapper[2558]: I0713 03:05:28.588529 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/8f4f8061-35fc-41d0-9fe7-2766f1ea1ec1-cert\") pod \"lws-controller-manager-f4bfdbc5d-xbjpm\" (UID: \"8f4f8061-35fc-41d0-9fe7-2766f1ea1ec1\") " pod="openshift-lws-operator/lws-controller-manager-f4bfdbc5d-xbjpm" Jul 13 03:05:28.588889 ip-10-0-134-52 kubenswrapper[2558]: I0713 03:05:28.588865 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"manager-config\" (UniqueName: \"kubernetes.io/configmap/8f4f8061-35fc-41d0-9fe7-2766f1ea1ec1-manager-config\") pod \"lws-controller-manager-f4bfdbc5d-xbjpm\" (UID: \"8f4f8061-35fc-41d0-9fe7-2766f1ea1ec1\") " pod="openshift-lws-operator/lws-controller-manager-f4bfdbc5d-xbjpm" Jul 13 03:05:28.589082 ip-10-0-134-52 kubenswrapper[2558]: I0713 03:05:28.589066 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-cert\" (UniqueName: \"kubernetes.io/secret/8f4f8061-35fc-41d0-9fe7-2766f1ea1ec1-metrics-cert\") pod \"lws-controller-manager-f4bfdbc5d-xbjpm\" (UID: \"8f4f8061-35fc-41d0-9fe7-2766f1ea1ec1\") " pod="openshift-lws-operator/lws-controller-manager-f4bfdbc5d-xbjpm" Jul 13 03:05:28.589264 ip-10-0-134-52 kubenswrapper[2558]: I0713 03:05:28.589248 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-96vfz\" (UniqueName: \"kubernetes.io/projected/8f4f8061-35fc-41d0-9fe7-2766f1ea1ec1-kube-api-access-96vfz\") pod \"lws-controller-manager-f4bfdbc5d-xbjpm\" (UID: \"8f4f8061-35fc-41d0-9fe7-2766f1ea1ec1\") " pod="openshift-lws-operator/lws-controller-manager-f4bfdbc5d-xbjpm" Jul 13 03:05:28.689887 ip-10-0-134-52 kubenswrapper[2558]: I0713 03:05:28.689860 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-96vfz\" (UniqueName: \"kubernetes.io/projected/8f4f8061-35fc-41d0-9fe7-2766f1ea1ec1-kube-api-access-96vfz\") pod \"lws-controller-manager-f4bfdbc5d-xbjpm\" (UID: \"8f4f8061-35fc-41d0-9fe7-2766f1ea1ec1\") " pod="openshift-lws-operator/lws-controller-manager-f4bfdbc5d-xbjpm" Jul 13 03:05:28.690049 ip-10-0-134-52 kubenswrapper[2558]: I0713 03:05:28.689923 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/8f4f8061-35fc-41d0-9fe7-2766f1ea1ec1-cert\") pod \"lws-controller-manager-f4bfdbc5d-xbjpm\" (UID: \"8f4f8061-35fc-41d0-9fe7-2766f1ea1ec1\") " pod="openshift-lws-operator/lws-controller-manager-f4bfdbc5d-xbjpm" Jul 13 03:05:28.690049 ip-10-0-134-52 kubenswrapper[2558]: I0713 03:05:28.689977 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"manager-config\" (UniqueName: \"kubernetes.io/configmap/8f4f8061-35fc-41d0-9fe7-2766f1ea1ec1-manager-config\") pod \"lws-controller-manager-f4bfdbc5d-xbjpm\" (UID: \"8f4f8061-35fc-41d0-9fe7-2766f1ea1ec1\") " pod="openshift-lws-operator/lws-controller-manager-f4bfdbc5d-xbjpm" Jul 13 03:05:28.690049 ip-10-0-134-52 kubenswrapper[2558]: I0713 03:05:28.690004 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-cert\" (UniqueName: \"kubernetes.io/secret/8f4f8061-35fc-41d0-9fe7-2766f1ea1ec1-metrics-cert\") pod \"lws-controller-manager-f4bfdbc5d-xbjpm\" (UID: \"8f4f8061-35fc-41d0-9fe7-2766f1ea1ec1\") " pod="openshift-lws-operator/lws-controller-manager-f4bfdbc5d-xbjpm" Jul 13 03:05:28.690660 ip-10-0-134-52 kubenswrapper[2558]: I0713 03:05:28.690635 2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"manager-config\" (UniqueName: \"kubernetes.io/configmap/8f4f8061-35fc-41d0-9fe7-2766f1ea1ec1-manager-config\") pod \"lws-controller-manager-f4bfdbc5d-xbjpm\" (UID: \"8f4f8061-35fc-41d0-9fe7-2766f1ea1ec1\") " pod="openshift-lws-operator/lws-controller-manager-f4bfdbc5d-xbjpm" Jul 13 03:05:28.692574 ip-10-0-134-52 kubenswrapper[2558]: I0713 03:05:28.692552 2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-cert\" (UniqueName: \"kubernetes.io/secret/8f4f8061-35fc-41d0-9fe7-2766f1ea1ec1-metrics-cert\") pod \"lws-controller-manager-f4bfdbc5d-xbjpm\" (UID: \"8f4f8061-35fc-41d0-9fe7-2766f1ea1ec1\") " pod="openshift-lws-operator/lws-controller-manager-f4bfdbc5d-xbjpm" Jul 13 03:05:28.692681 ip-10-0-134-52 kubenswrapper[2558]: I0713 03:05:28.692600 2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/8f4f8061-35fc-41d0-9fe7-2766f1ea1ec1-cert\") pod \"lws-controller-manager-f4bfdbc5d-xbjpm\" (UID: \"8f4f8061-35fc-41d0-9fe7-2766f1ea1ec1\") " pod="openshift-lws-operator/lws-controller-manager-f4bfdbc5d-xbjpm" Jul 13 03:05:28.702527 ip-10-0-134-52 kubenswrapper[2558]: I0713 03:05:28.702503 2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-96vfz\" (UniqueName: \"kubernetes.io/projected/8f4f8061-35fc-41d0-9fe7-2766f1ea1ec1-kube-api-access-96vfz\") pod \"lws-controller-manager-f4bfdbc5d-xbjpm\" (UID: \"8f4f8061-35fc-41d0-9fe7-2766f1ea1ec1\") " pod="openshift-lws-operator/lws-controller-manager-f4bfdbc5d-xbjpm" Jul 13 03:05:28.827748 ip-10-0-134-52 kubenswrapper[2558]: I0713 03:05:28.827725 2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-lws-operator/lws-controller-manager-f4bfdbc5d-xbjpm" Jul 13 03:05:28.955784 ip-10-0-134-52 kubenswrapper[2558]: I0713 03:05:28.955756 2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-lws-operator/lws-controller-manager-f4bfdbc5d-xbjpm"] Jul 13 03:05:28.957515 ip-10-0-134-52 kubenswrapper[2558]: W0713 03:05:28.957488 2558 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod8f4f8061_35fc_41d0_9fe7_2766f1ea1ec1.slice/crio-ff409e7963b082e5fe6fa60dbb53294be43aac5f8ef351383dbeef403fb4d92a WatchSource:0}: Error finding container ff409e7963b082e5fe6fa60dbb53294be43aac5f8ef351383dbeef403fb4d92a: Status 404 returned error can't find the container with id ff409e7963b082e5fe6fa60dbb53294be43aac5f8ef351383dbeef403fb4d92a Jul 13 03:05:29.086964 ip-10-0-134-52 kubenswrapper[2558]: I0713 03:05:29.086901 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-lws-operator/lws-controller-manager-f4bfdbc5d-xbjpm" event={"ID":"8f4f8061-35fc-41d0-9fe7-2766f1ea1ec1","Type":"ContainerStarted","Data":"ff409e7963b082e5fe6fa60dbb53294be43aac5f8ef351383dbeef403fb4d92a"} Jul 13 03:05:31.099157 ip-10-0-134-52 kubenswrapper[2558]: I0713 03:05:31.099122 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-lws-operator/lws-controller-manager-f4bfdbc5d-xbjpm" event={"ID":"8f4f8061-35fc-41d0-9fe7-2766f1ea1ec1","Type":"ContainerStarted","Data":"a0def6a74cc70b17f3c22f906ec722bcc2bf1f98e282b2475d8a14637564f2a7"} Jul 13 03:05:31.099557 ip-10-0-134-52 kubenswrapper[2558]: I0713 03:05:31.099194 2558 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-lws-operator/lws-controller-manager-f4bfdbc5d-xbjpm" Jul 13 03:05:31.116859 ip-10-0-134-52 kubenswrapper[2558]: I0713 03:05:31.116780 2558 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-lws-operator/lws-controller-manager-f4bfdbc5d-xbjpm" podStartSLOduration=1.80771557 podStartE2EDuration="3.116766524s" totalImagesPullingTime="1.309050954s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-13 03:05:28 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-13 03:05:31.115167344 +0000 UTC m=+513.515767809" watchObservedRunningTime="2026-07-13 03:05:31.116766524 +0000 UTC m=+513.517366990" Jul 13 03:05:35.073055 ip-10-0-134-52 kubenswrapper[2558]: I0713 03:05:35.073016 2558 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/model-serving-api-54d89bd5fc-bvrs4" Jul 13 03:05:40.442853 ip-10-0-134-52 kubenswrapper[2558]: I0713 03:05:40.442823 2558 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/data-science-gateway-data-science-gateway-class-84cc848bd-jqv2h"] Jul 13 03:05:40.446271 ip-10-0-134-52 kubenswrapper[2558]: I0713 03:05:40.446255 2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-84cc848bd-jqv2h" Jul 13 03:05:40.453481 ip-10-0-134-52 kubenswrapper[2558]: I0713 03:05:40.453462 2558 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"openshift-gw-ca-root-cert\"" Jul 13 03:05:40.458557 ip-10-0-134-52 kubenswrapper[2558]: I0713 03:05:40.458541 2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"data-science-gateway-data-science-gateway-class-dockercfg-24qqr\"" Jul 13 03:05:40.470229 ip-10-0-134-52 kubenswrapper[2558]: I0713 03:05:40.470206 2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/data-science-gateway-data-science-gateway-class-84cc848bd-jqv2h"] Jul 13 03:05:40.484919 ip-10-0-134-52 kubenswrapper[2558]: I0713 03:05:40.484891 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/cb530dab-8654-407f-bacf-5eb448af97ef-istiod-ca-cert\") pod \"data-science-gateway-data-science-gateway-class-84cc848bd-jqv2h\" (UID: \"cb530dab-8654-407f-bacf-5eb448af97ef\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-84cc848bd-jqv2h" Jul 13 03:05:40.485029 ip-10-0-134-52 kubenswrapper[2558]: I0713 03:05:40.484926 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/cb530dab-8654-407f-bacf-5eb448af97ef-istio-token\") pod \"data-science-gateway-data-science-gateway-class-84cc848bd-jqv2h\" (UID: \"cb530dab-8654-407f-bacf-5eb448af97ef\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-84cc848bd-jqv2h" Jul 13 03:05:40.485029 ip-10-0-134-52 kubenswrapper[2558]: I0713 03:05:40.484948 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/cb530dab-8654-407f-bacf-5eb448af97ef-credential-socket\") pod \"data-science-gateway-data-science-gateway-class-84cc848bd-jqv2h\" (UID: \"cb530dab-8654-407f-bacf-5eb448af97ef\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-84cc848bd-jqv2h" Jul 13 03:05:40.485029 ip-10-0-134-52 kubenswrapper[2558]: I0713 03:05:40.485015 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/cb530dab-8654-407f-bacf-5eb448af97ef-workload-socket\") pod \"data-science-gateway-data-science-gateway-class-84cc848bd-jqv2h\" (UID: \"cb530dab-8654-407f-bacf-5eb448af97ef\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-84cc848bd-jqv2h" Jul 13 03:05:40.485178 ip-10-0-134-52 kubenswrapper[2558]: I0713 03:05:40.485097 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/cb530dab-8654-407f-bacf-5eb448af97ef-istio-podinfo\") pod \"data-science-gateway-data-science-gateway-class-84cc848bd-jqv2h\" (UID: \"cb530dab-8654-407f-bacf-5eb448af97ef\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-84cc848bd-jqv2h" Jul 13 03:05:40.485178 ip-10-0-134-52 kubenswrapper[2558]: I0713 03:05:40.485136 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/cb530dab-8654-407f-bacf-5eb448af97ef-istio-data\") pod \"data-science-gateway-data-science-gateway-class-84cc848bd-jqv2h\" (UID: \"cb530dab-8654-407f-bacf-5eb448af97ef\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-84cc848bd-jqv2h" Jul 13 03:05:40.485272 ip-10-0-134-52 kubenswrapper[2558]: I0713 03:05:40.485177 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/cb530dab-8654-407f-bacf-5eb448af97ef-istio-envoy\") pod \"data-science-gateway-data-science-gateway-class-84cc848bd-jqv2h\" (UID: \"cb530dab-8654-407f-bacf-5eb448af97ef\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-84cc848bd-jqv2h" Jul 13 03:05:40.485272 ip-10-0-134-52 kubenswrapper[2558]: I0713 03:05:40.485199 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/cb530dab-8654-407f-bacf-5eb448af97ef-workload-certs\") pod \"data-science-gateway-data-science-gateway-class-84cc848bd-jqv2h\" (UID: \"cb530dab-8654-407f-bacf-5eb448af97ef\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-84cc848bd-jqv2h" Jul 13 03:05:40.485272 ip-10-0-134-52 kubenswrapper[2558]: I0713 03:05:40.485222 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-2fl8c\" (UniqueName: \"kubernetes.io/projected/cb530dab-8654-407f-bacf-5eb448af97ef-kube-api-access-2fl8c\") pod \"data-science-gateway-data-science-gateway-class-84cc848bd-jqv2h\" (UID: \"cb530dab-8654-407f-bacf-5eb448af97ef\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-84cc848bd-jqv2h" Jul 13 03:05:40.585680 ip-10-0-134-52 kubenswrapper[2558]: I0713 03:05:40.585649 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/cb530dab-8654-407f-bacf-5eb448af97ef-istio-envoy\") pod \"data-science-gateway-data-science-gateway-class-84cc848bd-jqv2h\" (UID: \"cb530dab-8654-407f-bacf-5eb448af97ef\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-84cc848bd-jqv2h" Jul 13 03:05:40.585680 ip-10-0-134-52 kubenswrapper[2558]: I0713 03:05:40.585682 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/cb530dab-8654-407f-bacf-5eb448af97ef-workload-certs\") pod \"data-science-gateway-data-science-gateway-class-84cc848bd-jqv2h\" (UID: \"cb530dab-8654-407f-bacf-5eb448af97ef\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-84cc848bd-jqv2h" Jul 13 03:05:40.585858 ip-10-0-134-52 kubenswrapper[2558]: I0713 03:05:40.585704 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-2fl8c\" (UniqueName: \"kubernetes.io/projected/cb530dab-8654-407f-bacf-5eb448af97ef-kube-api-access-2fl8c\") pod \"data-science-gateway-data-science-gateway-class-84cc848bd-jqv2h\" (UID: \"cb530dab-8654-407f-bacf-5eb448af97ef\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-84cc848bd-jqv2h" Jul 13 03:05:40.585858 ip-10-0-134-52 kubenswrapper[2558]: I0713 03:05:40.585745 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/cb530dab-8654-407f-bacf-5eb448af97ef-istiod-ca-cert\") pod \"data-science-gateway-data-science-gateway-class-84cc848bd-jqv2h\" (UID: \"cb530dab-8654-407f-bacf-5eb448af97ef\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-84cc848bd-jqv2h" Jul 13 03:05:40.585858 ip-10-0-134-52 kubenswrapper[2558]: I0713 03:05:40.585777 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/cb530dab-8654-407f-bacf-5eb448af97ef-istio-token\") pod \"data-science-gateway-data-science-gateway-class-84cc848bd-jqv2h\" (UID: \"cb530dab-8654-407f-bacf-5eb448af97ef\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-84cc848bd-jqv2h" Jul 13 03:05:40.585858 ip-10-0-134-52 kubenswrapper[2558]: I0713 03:05:40.585809 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/cb530dab-8654-407f-bacf-5eb448af97ef-credential-socket\") pod \"data-science-gateway-data-science-gateway-class-84cc848bd-jqv2h\" (UID: \"cb530dab-8654-407f-bacf-5eb448af97ef\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-84cc848bd-jqv2h" Jul 13 03:05:40.586053 ip-10-0-134-52 kubenswrapper[2558]: I0713 03:05:40.585913 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/cb530dab-8654-407f-bacf-5eb448af97ef-workload-socket\") pod \"data-science-gateway-data-science-gateway-class-84cc848bd-jqv2h\" (UID: \"cb530dab-8654-407f-bacf-5eb448af97ef\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-84cc848bd-jqv2h" Jul 13 03:05:40.586150 ip-10-0-134-52 kubenswrapper[2558]: I0713 03:05:40.586126 2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/cb530dab-8654-407f-bacf-5eb448af97ef-workload-certs\") pod \"data-science-gateway-data-science-gateway-class-84cc848bd-jqv2h\" (UID: \"cb530dab-8654-407f-bacf-5eb448af97ef\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-84cc848bd-jqv2h" Jul 13 03:05:40.586259 ip-10-0-134-52 kubenswrapper[2558]: I0713 03:05:40.586190 2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/cb530dab-8654-407f-bacf-5eb448af97ef-credential-socket\") pod \"data-science-gateway-data-science-gateway-class-84cc848bd-jqv2h\" (UID: \"cb530dab-8654-407f-bacf-5eb448af97ef\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-84cc848bd-jqv2h" Jul 13 03:05:40.586259 ip-10-0-134-52 kubenswrapper[2558]: I0713 03:05:40.586252 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/cb530dab-8654-407f-bacf-5eb448af97ef-istio-podinfo\") pod \"data-science-gateway-data-science-gateway-class-84cc848bd-jqv2h\" (UID: \"cb530dab-8654-407f-bacf-5eb448af97ef\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-84cc848bd-jqv2h" Jul 13 03:05:40.586574 ip-10-0-134-52 kubenswrapper[2558]: I0713 03:05:40.586270 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/cb530dab-8654-407f-bacf-5eb448af97ef-istio-data\") pod \"data-science-gateway-data-science-gateway-class-84cc848bd-jqv2h\" (UID: \"cb530dab-8654-407f-bacf-5eb448af97ef\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-84cc848bd-jqv2h" Jul 13 03:05:40.586574 ip-10-0-134-52 kubenswrapper[2558]: I0713 03:05:40.586363 2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/cb530dab-8654-407f-bacf-5eb448af97ef-workload-socket\") pod \"data-science-gateway-data-science-gateway-class-84cc848bd-jqv2h\" (UID: \"cb530dab-8654-407f-bacf-5eb448af97ef\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-84cc848bd-jqv2h" Jul 13 03:05:40.586574 ip-10-0-134-52 kubenswrapper[2558]: I0713 03:05:40.586512 2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/cb530dab-8654-407f-bacf-5eb448af97ef-istiod-ca-cert\") pod \"data-science-gateway-data-science-gateway-class-84cc848bd-jqv2h\" (UID: \"cb530dab-8654-407f-bacf-5eb448af97ef\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-84cc848bd-jqv2h" Jul 13 03:05:40.586574 ip-10-0-134-52 kubenswrapper[2558]: I0713 03:05:40.586549 2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/cb530dab-8654-407f-bacf-5eb448af97ef-istio-data\") pod \"data-science-gateway-data-science-gateway-class-84cc848bd-jqv2h\" (UID: \"cb530dab-8654-407f-bacf-5eb448af97ef\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-84cc848bd-jqv2h" Jul 13 03:05:40.588136 ip-10-0-134-52 kubenswrapper[2558]: I0713 03:05:40.588116 2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/cb530dab-8654-407f-bacf-5eb448af97ef-istio-envoy\") pod \"data-science-gateway-data-science-gateway-class-84cc848bd-jqv2h\" (UID: \"cb530dab-8654-407f-bacf-5eb448af97ef\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-84cc848bd-jqv2h" Jul 13 03:05:40.588549 ip-10-0-134-52 kubenswrapper[2558]: I0713 03:05:40.588531 2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/cb530dab-8654-407f-bacf-5eb448af97ef-istio-podinfo\") pod \"data-science-gateway-data-science-gateway-class-84cc848bd-jqv2h\" (UID: \"cb530dab-8654-407f-bacf-5eb448af97ef\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-84cc848bd-jqv2h" Jul 13 03:05:40.600641 ip-10-0-134-52 kubenswrapper[2558]: I0713 03:05:40.600613 2558 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf42dw75"] Jul 13 03:05:40.604067 ip-10-0-134-52 kubenswrapper[2558]: I0713 03:05:40.604051 2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf42dw75" Jul 13 03:05:40.612560 ip-10-0-134-52 kubenswrapper[2558]: I0713 03:05:40.612540 2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-2fl8c\" (UniqueName: \"kubernetes.io/projected/cb530dab-8654-407f-bacf-5eb448af97ef-kube-api-access-2fl8c\") pod \"data-science-gateway-data-science-gateway-class-84cc848bd-jqv2h\" (UID: \"cb530dab-8654-407f-bacf-5eb448af97ef\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-84cc848bd-jqv2h" Jul 13 03:05:40.614921 ip-10-0-134-52 kubenswrapper[2558]: I0713 03:05:40.614903 2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/cb530dab-8654-407f-bacf-5eb448af97ef-istio-token\") pod \"data-science-gateway-data-science-gateway-class-84cc848bd-jqv2h\" (UID: \"cb530dab-8654-407f-bacf-5eb448af97ef\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-84cc848bd-jqv2h" Jul 13 03:05:40.629129 ip-10-0-134-52 kubenswrapper[2558]: I0713 03:05:40.629110 2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf42dw75"] Jul 13 03:05:40.687488 ip-10-0-134-52 kubenswrapper[2558]: I0713 03:05:40.687460 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/9f9b901e-71ee-4c58-81c0-f48dbb910356-istio-podinfo\") pod \"data-science-gateway-data-science-gateway-class-6576859cf42dw75\" (UID: \"9f9b901e-71ee-4c58-81c0-f48dbb910356\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf42dw75" Jul 13 03:05:40.687607 ip-10-0-134-52 kubenswrapper[2558]: I0713 03:05:40.687501 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/9f9b901e-71ee-4c58-81c0-f48dbb910356-workload-socket\") pod \"data-science-gateway-data-science-gateway-class-6576859cf42dw75\" (UID: \"9f9b901e-71ee-4c58-81c0-f48dbb910356\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf42dw75" Jul 13 03:05:40.687607 ip-10-0-134-52 kubenswrapper[2558]: I0713 03:05:40.687533 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/9f9b901e-71ee-4c58-81c0-f48dbb910356-credential-socket\") pod \"data-science-gateway-data-science-gateway-class-6576859cf42dw75\" (UID: \"9f9b901e-71ee-4c58-81c0-f48dbb910356\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf42dw75" Jul 13 03:05:40.687607 ip-10-0-134-52 kubenswrapper[2558]: I0713 03:05:40.687551 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/9f9b901e-71ee-4c58-81c0-f48dbb910356-istio-token\") pod \"data-science-gateway-data-science-gateway-class-6576859cf42dw75\" (UID: \"9f9b901e-71ee-4c58-81c0-f48dbb910356\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf42dw75" Jul 13 03:05:40.687607 ip-10-0-134-52 kubenswrapper[2558]: I0713 03:05:40.687593 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/9f9b901e-71ee-4c58-81c0-f48dbb910356-istiod-ca-cert\") pod \"data-science-gateway-data-science-gateway-class-6576859cf42dw75\" (UID: \"9f9b901e-71ee-4c58-81c0-f48dbb910356\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf42dw75" Jul 13 03:05:40.687735 ip-10-0-134-52 kubenswrapper[2558]: I0713 03:05:40.687611 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/9f9b901e-71ee-4c58-81c0-f48dbb910356-workload-certs\") pod \"data-science-gateway-data-science-gateway-class-6576859cf42dw75\" (UID: \"9f9b901e-71ee-4c58-81c0-f48dbb910356\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf42dw75" Jul 13 03:05:40.687735 ip-10-0-134-52 kubenswrapper[2558]: I0713 03:05:40.687641 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/9f9b901e-71ee-4c58-81c0-f48dbb910356-istio-data\") pod \"data-science-gateway-data-science-gateway-class-6576859cf42dw75\" (UID: \"9f9b901e-71ee-4c58-81c0-f48dbb910356\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf42dw75" Jul 13 03:05:40.687735 ip-10-0-134-52 kubenswrapper[2558]: I0713 03:05:40.687673 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-7wwkq\" (UniqueName: \"kubernetes.io/projected/9f9b901e-71ee-4c58-81c0-f48dbb910356-kube-api-access-7wwkq\") pod \"data-science-gateway-data-science-gateway-class-6576859cf42dw75\" (UID: \"9f9b901e-71ee-4c58-81c0-f48dbb910356\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf42dw75" Jul 13 03:05:40.687735 ip-10-0-134-52 kubenswrapper[2558]: I0713 03:05:40.687705 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/9f9b901e-71ee-4c58-81c0-f48dbb910356-istio-envoy\") pod \"data-science-gateway-data-science-gateway-class-6576859cf42dw75\" (UID: \"9f9b901e-71ee-4c58-81c0-f48dbb910356\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf42dw75" Jul 13 03:05:40.756666 ip-10-0-134-52 kubenswrapper[2558]: I0713 03:05:40.756612 2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-84cc848bd-jqv2h" Jul 13 03:05:40.788716 ip-10-0-134-52 kubenswrapper[2558]: I0713 03:05:40.788690 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/9f9b901e-71ee-4c58-81c0-f48dbb910356-credential-socket\") pod \"data-science-gateway-data-science-gateway-class-6576859cf42dw75\" (UID: \"9f9b901e-71ee-4c58-81c0-f48dbb910356\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf42dw75" Jul 13 03:05:40.788912 ip-10-0-134-52 kubenswrapper[2558]: I0713 03:05:40.788724 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/9f9b901e-71ee-4c58-81c0-f48dbb910356-istio-token\") pod \"data-science-gateway-data-science-gateway-class-6576859cf42dw75\" (UID: \"9f9b901e-71ee-4c58-81c0-f48dbb910356\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf42dw75" Jul 13 03:05:40.788912 ip-10-0-134-52 kubenswrapper[2558]: I0713 03:05:40.788744 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/9f9b901e-71ee-4c58-81c0-f48dbb910356-istiod-ca-cert\") pod \"data-science-gateway-data-science-gateway-class-6576859cf42dw75\" (UID: \"9f9b901e-71ee-4c58-81c0-f48dbb910356\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf42dw75" Jul 13 03:05:40.788912 ip-10-0-134-52 kubenswrapper[2558]: I0713 03:05:40.788760 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/9f9b901e-71ee-4c58-81c0-f48dbb910356-workload-certs\") pod \"data-science-gateway-data-science-gateway-class-6576859cf42dw75\" (UID: \"9f9b901e-71ee-4c58-81c0-f48dbb910356\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf42dw75" Jul 13 03:05:40.788912 ip-10-0-134-52 kubenswrapper[2558]: I0713 03:05:40.788811 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/9f9b901e-71ee-4c58-81c0-f48dbb910356-istio-data\") pod \"data-science-gateway-data-science-gateway-class-6576859cf42dw75\" (UID: \"9f9b901e-71ee-4c58-81c0-f48dbb910356\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf42dw75" Jul 13 03:05:40.788912 ip-10-0-134-52 kubenswrapper[2558]: I0713 03:05:40.788830 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-7wwkq\" (UniqueName: \"kubernetes.io/projected/9f9b901e-71ee-4c58-81c0-f48dbb910356-kube-api-access-7wwkq\") pod \"data-science-gateway-data-science-gateway-class-6576859cf42dw75\" (UID: \"9f9b901e-71ee-4c58-81c0-f48dbb910356\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf42dw75" Jul 13 03:05:40.788912 ip-10-0-134-52 kubenswrapper[2558]: I0713 03:05:40.788853 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/9f9b901e-71ee-4c58-81c0-f48dbb910356-istio-envoy\") pod \"data-science-gateway-data-science-gateway-class-6576859cf42dw75\" (UID: \"9f9b901e-71ee-4c58-81c0-f48dbb910356\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf42dw75" Jul 13 03:05:40.789216 ip-10-0-134-52 kubenswrapper[2558]: I0713 03:05:40.788915 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/9f9b901e-71ee-4c58-81c0-f48dbb910356-istio-podinfo\") pod \"data-science-gateway-data-science-gateway-class-6576859cf42dw75\" (UID: \"9f9b901e-71ee-4c58-81c0-f48dbb910356\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf42dw75" Jul 13 03:05:40.789216 ip-10-0-134-52 kubenswrapper[2558]: I0713 03:05:40.788961 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/9f9b901e-71ee-4c58-81c0-f48dbb910356-workload-socket\") pod \"data-science-gateway-data-science-gateway-class-6576859cf42dw75\" (UID: \"9f9b901e-71ee-4c58-81c0-f48dbb910356\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf42dw75" Jul 13 03:05:40.789216 ip-10-0-134-52 kubenswrapper[2558]: I0713 03:05:40.789117 2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/9f9b901e-71ee-4c58-81c0-f48dbb910356-credential-socket\") pod \"data-science-gateway-data-science-gateway-class-6576859cf42dw75\" (UID: \"9f9b901e-71ee-4c58-81c0-f48dbb910356\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf42dw75" Jul 13 03:05:40.789403 ip-10-0-134-52 kubenswrapper[2558]: I0713 03:05:40.789225 2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/9f9b901e-71ee-4c58-81c0-f48dbb910356-workload-certs\") pod \"data-science-gateway-data-science-gateway-class-6576859cf42dw75\" (UID: \"9f9b901e-71ee-4c58-81c0-f48dbb910356\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf42dw75" Jul 13 03:05:40.789403 ip-10-0-134-52 kubenswrapper[2558]: I0713 03:05:40.789300 2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/9f9b901e-71ee-4c58-81c0-f48dbb910356-istio-data\") pod \"data-science-gateway-data-science-gateway-class-6576859cf42dw75\" (UID: \"9f9b901e-71ee-4c58-81c0-f48dbb910356\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf42dw75" Jul 13 03:05:40.789536 ip-10-0-134-52 kubenswrapper[2558]: I0713 03:05:40.789510 2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/9f9b901e-71ee-4c58-81c0-f48dbb910356-workload-socket\") pod \"data-science-gateway-data-science-gateway-class-6576859cf42dw75\" (UID: \"9f9b901e-71ee-4c58-81c0-f48dbb910356\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf42dw75" Jul 13 03:05:40.789652 ip-10-0-134-52 kubenswrapper[2558]: I0713 03:05:40.789626 2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/9f9b901e-71ee-4c58-81c0-f48dbb910356-istiod-ca-cert\") pod \"data-science-gateway-data-science-gateway-class-6576859cf42dw75\" (UID: \"9f9b901e-71ee-4c58-81c0-f48dbb910356\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf42dw75" Jul 13 03:05:40.791401 ip-10-0-134-52 kubenswrapper[2558]: I0713 03:05:40.791380 2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/9f9b901e-71ee-4c58-81c0-f48dbb910356-istio-envoy\") pod \"data-science-gateway-data-science-gateway-class-6576859cf42dw75\" (UID: \"9f9b901e-71ee-4c58-81c0-f48dbb910356\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf42dw75" Jul 13 03:05:40.791485 ip-10-0-134-52 kubenswrapper[2558]: I0713 03:05:40.791475 2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/9f9b901e-71ee-4c58-81c0-f48dbb910356-istio-podinfo\") pod \"data-science-gateway-data-science-gateway-class-6576859cf42dw75\" (UID: \"9f9b901e-71ee-4c58-81c0-f48dbb910356\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf42dw75" Jul 13 03:05:40.799411 ip-10-0-134-52 kubenswrapper[2558]: I0713 03:05:40.799263 2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/9f9b901e-71ee-4c58-81c0-f48dbb910356-istio-token\") pod \"data-science-gateway-data-science-gateway-class-6576859cf42dw75\" (UID: \"9f9b901e-71ee-4c58-81c0-f48dbb910356\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf42dw75" Jul 13 03:05:40.802402 ip-10-0-134-52 kubenswrapper[2558]: I0713 03:05:40.802377 2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-7wwkq\" (UniqueName: \"kubernetes.io/projected/9f9b901e-71ee-4c58-81c0-f48dbb910356-kube-api-access-7wwkq\") pod \"data-science-gateway-data-science-gateway-class-6576859cf42dw75\" (UID: \"9f9b901e-71ee-4c58-81c0-f48dbb910356\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf42dw75" Jul 13 03:05:40.886291 ip-10-0-134-52 kubenswrapper[2558]: I0713 03:05:40.886264 2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/data-science-gateway-data-science-gateway-class-84cc848bd-jqv2h"] Jul 13 03:05:40.888044 ip-10-0-134-52 kubenswrapper[2558]: W0713 03:05:40.888015 2558 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podcb530dab_8654_407f_bacf_5eb448af97ef.slice/crio-76ac89073fc76053a94302d600f4ab6656c9240b285c5ed6ed5739ac441319a5 WatchSource:0}: Error finding container 76ac89073fc76053a94302d600f4ab6656c9240b285c5ed6ed5739ac441319a5: Status 404 returned error can't find the container with id 76ac89073fc76053a94302d600f4ab6656c9240b285c5ed6ed5739ac441319a5 Jul 13 03:05:40.914088 ip-10-0-134-52 kubenswrapper[2558]: I0713 03:05:40.914062 2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf42dw75" Jul 13 03:05:41.048721 ip-10-0-134-52 kubenswrapper[2558]: I0713 03:05:41.048672 2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf42dw75"] Jul 13 03:05:41.050837 ip-10-0-134-52 kubenswrapper[2558]: W0713 03:05:41.050810 2558 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod9f9b901e_71ee_4c58_81c0_f48dbb910356.slice/crio-da6b7319ceb72091c856be65bfc8b5328ba8f4b52d2d64b15e448c225b4a5fb9 WatchSource:0}: Error finding container da6b7319ceb72091c856be65bfc8b5328ba8f4b52d2d64b15e448c225b4a5fb9: Status 404 returned error can't find the container with id da6b7319ceb72091c856be65bfc8b5328ba8f4b52d2d64b15e448c225b4a5fb9 Jul 13 03:05:41.144949 ip-10-0-134-52 kubenswrapper[2558]: I0713 03:05:41.144912 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-84cc848bd-jqv2h" event={"ID":"cb530dab-8654-407f-bacf-5eb448af97ef","Type":"ContainerStarted","Data":"76ac89073fc76053a94302d600f4ab6656c9240b285c5ed6ed5739ac441319a5"} Jul 13 03:05:41.146127 ip-10-0-134-52 kubenswrapper[2558]: I0713 03:05:41.146106 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf42dw75" event={"ID":"9f9b901e-71ee-4c58-81c0-f48dbb910356","Type":"ContainerStarted","Data":"da6b7319ceb72091c856be65bfc8b5328ba8f4b52d2d64b15e448c225b4a5fb9"} Jul 13 03:05:42.107047 ip-10-0-134-52 kubenswrapper[2558]: I0713 03:05:42.107018 2558 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-lws-operator/lws-controller-manager-f4bfdbc5d-xbjpm" Jul 13 03:05:43.582445 ip-10-0-134-52 kubenswrapper[2558]: I0713 03:05:43.582410 2558 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892164Ki","pods":"250"} Jul 13 03:05:43.582718 ip-10-0-134-52 kubenswrapper[2558]: I0713 03:05:43.582481 2558 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892164Ki","pods":"250"} Jul 13 03:05:43.582718 ip-10-0-134-52 kubenswrapper[2558]: I0713 03:05:43.582509 2558 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892164Ki","pods":"250"} Jul 13 03:05:43.588535 ip-10-0-134-52 kubenswrapper[2558]: I0713 03:05:43.588506 2558 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892164Ki","pods":"250"} Jul 13 03:05:43.588638 ip-10-0-134-52 kubenswrapper[2558]: I0713 03:05:43.588563 2558 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892164Ki","pods":"250"} Jul 13 03:05:43.588638 ip-10-0-134-52 kubenswrapper[2558]: I0713 03:05:43.588591 2558 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892164Ki","pods":"250"} Jul 13 03:05:44.166277 ip-10-0-134-52 kubenswrapper[2558]: I0713 03:05:44.166244 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-84cc848bd-jqv2h" event={"ID":"cb530dab-8654-407f-bacf-5eb448af97ef","Type":"ContainerStarted","Data":"354952a6b1bf98455f2357840c827f2673cadb5d4a81ad15a15c3ec589947a25"} Jul 13 03:05:44.167769 ip-10-0-134-52 kubenswrapper[2558]: I0713 03:05:44.167731 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf42dw75" event={"ID":"9f9b901e-71ee-4c58-81c0-f48dbb910356","Type":"ContainerStarted","Data":"5e0637e061e6c8c3474f0bbef91987fb819368df824d93080ae66cdf2102ecfa"} Jul 13 03:05:44.185861 ip-10-0-134-52 kubenswrapper[2558]: I0713 03:05:44.185814 2558 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-84cc848bd-jqv2h" podStartSLOduration=1.493672697 podStartE2EDuration="4.185799152s" totalImagesPullingTime="2.692126455s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-13 03:05:40 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-13 03:05:44.185005578 +0000 UTC m=+526.585606063" watchObservedRunningTime="2026-07-13 03:05:44.185799152 +0000 UTC m=+526.586399617" Jul 13 03:05:44.208494 ip-10-0-134-52 kubenswrapper[2558]: I0713 03:05:44.204559 2558 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf42dw75" podStartSLOduration=1.6692804159999999 podStartE2EDuration="4.204541311s" totalImagesPullingTime="2.535260895s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-13 03:05:40 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-13 03:05:44.201980655 +0000 UTC m=+526.602581124" watchObservedRunningTime="2026-07-13 03:05:44.204541311 +0000 UTC m=+526.605141779" Jul 13 03:05:44.757277 ip-10-0-134-52 kubenswrapper[2558]: I0713 03:05:44.757247 2558 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-84cc848bd-jqv2h" Jul 13 03:05:44.758636 ip-10-0-134-52 kubenswrapper[2558]: I0713 03:05:44.758611 2558 patch_prober.go:28] interesting pod/data-science-gateway-data-science-gateway-class-84cc848bd-jqv2h container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.33:15021/healthz/ready\": dial tcp 10.133.0.33:15021: connect: connection refused" start-of-body= Jul 13 03:05:44.758755 ip-10-0-134-52 kubenswrapper[2558]: I0713 03:05:44.758661 2558 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-84cc848bd-jqv2h" podUID="cb530dab-8654-407f-bacf-5eb448af97ef" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.33:15021/healthz/ready\": dial tcp 10.133.0.33:15021: connect: connection refused" Jul 13 03:05:44.914576 ip-10-0-134-52 kubenswrapper[2558]: I0713 03:05:44.914548 2558 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf42dw75" Jul 13 03:05:44.918953 ip-10-0-134-52 kubenswrapper[2558]: I0713 03:05:44.918933 2558 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf42dw75" Jul 13 03:05:45.172472 ip-10-0-134-52 kubenswrapper[2558]: I0713 03:05:45.172442 2558 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf42dw75" Jul 13 03:05:45.173163 ip-10-0-134-52 kubenswrapper[2558]: I0713 03:05:45.173144 2558 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf42dw75" Jul 13 03:05:45.219528 ip-10-0-134-52 kubenswrapper[2558]: I0713 03:05:45.219498 2558 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/data-science-gateway-data-science-gateway-class-84cc848bd-jqv2h"] Jul 13 03:05:45.757166 ip-10-0-134-52 kubenswrapper[2558]: I0713 03:05:45.757137 2558 patch_prober.go:28] interesting pod/data-science-gateway-data-science-gateway-class-84cc848bd-jqv2h container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.33:15021/healthz/ready\": dial tcp 10.133.0.33:15021: connect: connection refused" start-of-body= Jul 13 03:05:45.757325 ip-10-0-134-52 kubenswrapper[2558]: I0713 03:05:45.757188 2558 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-84cc848bd-jqv2h" podUID="cb530dab-8654-407f-bacf-5eb448af97ef" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.33:15021/healthz/ready\": dial tcp 10.133.0.33:15021: connect: connection refused" Jul 13 03:05:46.757235 ip-10-0-134-52 kubenswrapper[2558]: I0713 03:05:46.757204 2558 patch_prober.go:28] interesting pod/data-science-gateway-data-science-gateway-class-84cc848bd-jqv2h container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.33:15021/healthz/ready\": dial tcp 10.133.0.33:15021: connect: connection refused" start-of-body= Jul 13 03:05:46.757430 ip-10-0-134-52 kubenswrapper[2558]: I0713 03:05:46.757256 2558 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-84cc848bd-jqv2h" podUID="cb530dab-8654-407f-bacf-5eb448af97ef" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.33:15021/healthz/ready\": dial tcp 10.133.0.33:15021: connect: connection refused" Jul 13 03:05:47.182697 ip-10-0-134-52 kubenswrapper[2558]: I0713 03:05:47.182660 2558 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-84cc848bd-jqv2h" podUID="cb530dab-8654-407f-bacf-5eb448af97ef" containerName="istio-proxy" containerID="cri-o://354952a6b1bf98455f2357840c827f2673cadb5d4a81ad15a15c3ec589947a25" gracePeriod=30 Jul 13 03:05:52.425994 ip-10-0-134-52 kubenswrapper[2558]: I0713 03:05:52.425966 2558 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-84cc848bd-jqv2h" Jul 13 03:05:52.484221 ip-10-0-134-52 kubenswrapper[2558]: I0713 03:05:52.484157 2558 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-2fl8c\" (UniqueName: \"kubernetes.io/projected/cb530dab-8654-407f-bacf-5eb448af97ef-kube-api-access-2fl8c\") pod \"cb530dab-8654-407f-bacf-5eb448af97ef\" (UID: \"cb530dab-8654-407f-bacf-5eb448af97ef\") " Jul 13 03:05:52.484221 ip-10-0-134-52 kubenswrapper[2558]: I0713 03:05:52.484195 2558 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/cb530dab-8654-407f-bacf-5eb448af97ef-istio-podinfo\") pod \"cb530dab-8654-407f-bacf-5eb448af97ef\" (UID: \"cb530dab-8654-407f-bacf-5eb448af97ef\") " Jul 13 03:05:52.484411 ip-10-0-134-52 kubenswrapper[2558]: I0713 03:05:52.484224 2558 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/cb530dab-8654-407f-bacf-5eb448af97ef-istiod-ca-cert\") pod \"cb530dab-8654-407f-bacf-5eb448af97ef\" (UID: \"cb530dab-8654-407f-bacf-5eb448af97ef\") " Jul 13 03:05:52.484411 ip-10-0-134-52 kubenswrapper[2558]: I0713 03:05:52.484246 2558 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/cb530dab-8654-407f-bacf-5eb448af97ef-workload-socket\") pod \"cb530dab-8654-407f-bacf-5eb448af97ef\" (UID: \"cb530dab-8654-407f-bacf-5eb448af97ef\") " Jul 13 03:05:52.484411 ip-10-0-134-52 kubenswrapper[2558]: I0713 03:05:52.484301 2558 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/cb530dab-8654-407f-bacf-5eb448af97ef-istio-token\") pod \"cb530dab-8654-407f-bacf-5eb448af97ef\" (UID: \"cb530dab-8654-407f-bacf-5eb448af97ef\") " Jul 13 03:05:52.484411 ip-10-0-134-52 kubenswrapper[2558]: I0713 03:05:52.484378 2558 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/cb530dab-8654-407f-bacf-5eb448af97ef-credential-socket\") pod \"cb530dab-8654-407f-bacf-5eb448af97ef\" (UID: \"cb530dab-8654-407f-bacf-5eb448af97ef\") " Jul 13 03:05:52.484589 ip-10-0-134-52 kubenswrapper[2558]: I0713 03:05:52.484440 2558 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/cb530dab-8654-407f-bacf-5eb448af97ef-istio-data\") pod \"cb530dab-8654-407f-bacf-5eb448af97ef\" (UID: \"cb530dab-8654-407f-bacf-5eb448af97ef\") " Jul 13 03:05:52.484589 ip-10-0-134-52 kubenswrapper[2558]: I0713 03:05:52.484467 2558 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/cb530dab-8654-407f-bacf-5eb448af97ef-istio-envoy\") pod \"cb530dab-8654-407f-bacf-5eb448af97ef\" (UID: \"cb530dab-8654-407f-bacf-5eb448af97ef\") " Jul 13 03:05:52.484589 ip-10-0-134-52 kubenswrapper[2558]: I0713 03:05:52.484488 2558 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/cb530dab-8654-407f-bacf-5eb448af97ef-workload-certs\") pod \"cb530dab-8654-407f-bacf-5eb448af97ef\" (UID: \"cb530dab-8654-407f-bacf-5eb448af97ef\") " Jul 13 03:05:52.484589 ip-10-0-134-52 kubenswrapper[2558]: I0713 03:05:52.484569 2558 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/cb530dab-8654-407f-bacf-5eb448af97ef-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "cb530dab-8654-407f-bacf-5eb448af97ef" (UID: "cb530dab-8654-407f-bacf-5eb448af97ef"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 13 03:05:52.484776 ip-10-0-134-52 kubenswrapper[2558]: I0713 03:05:52.484694 2558 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/cb530dab-8654-407f-bacf-5eb448af97ef-istio-data" (OuterVolumeSpecName: "istio-data") pod "cb530dab-8654-407f-bacf-5eb448af97ef" (UID: "cb530dab-8654-407f-bacf-5eb448af97ef"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 13 03:05:52.484776 ip-10-0-134-52 kubenswrapper[2558]: I0713 03:05:52.484697 2558 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/cb530dab-8654-407f-bacf-5eb448af97ef-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "cb530dab-8654-407f-bacf-5eb448af97ef" (UID: "cb530dab-8654-407f-bacf-5eb448af97ef"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 13 03:05:52.484776 ip-10-0-134-52 kubenswrapper[2558]: I0713 03:05:52.484715 2558 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/cb530dab-8654-407f-bacf-5eb448af97ef-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "cb530dab-8654-407f-bacf-5eb448af97ef" (UID: "cb530dab-8654-407f-bacf-5eb448af97ef"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 13 03:05:52.484936 ip-10-0-134-52 kubenswrapper[2558]: I0713 03:05:52.484827 2558 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/cb530dab-8654-407f-bacf-5eb448af97ef-istiod-ca-cert\") on node \"ip-10-0-134-52.ec2.internal\" DevicePath \"\"" Jul 13 03:05:52.484936 ip-10-0-134-52 kubenswrapper[2558]: I0713 03:05:52.484887 2558 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/cb530dab-8654-407f-bacf-5eb448af97ef-workload-socket\") on node \"ip-10-0-134-52.ec2.internal\" DevicePath \"\"" Jul 13 03:05:52.484936 ip-10-0-134-52 kubenswrapper[2558]: I0713 03:05:52.484910 2558 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/cb530dab-8654-407f-bacf-5eb448af97ef-credential-socket\") on node \"ip-10-0-134-52.ec2.internal\" DevicePath \"\"" Jul 13 03:05:52.484936 ip-10-0-134-52 kubenswrapper[2558]: I0713 03:05:52.484925 2558 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/cb530dab-8654-407f-bacf-5eb448af97ef-istio-data\") on node \"ip-10-0-134-52.ec2.internal\" DevicePath \"\"" Jul 13 03:05:52.484936 ip-10-0-134-52 kubenswrapper[2558]: I0713 03:05:52.484885 2558 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/cb530dab-8654-407f-bacf-5eb448af97ef-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "cb530dab-8654-407f-bacf-5eb448af97ef" (UID: "cb530dab-8654-407f-bacf-5eb448af97ef"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 13 03:05:52.487108 ip-10-0-134-52 kubenswrapper[2558]: I0713 03:05:52.487078 2558 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/cb530dab-8654-407f-bacf-5eb448af97ef-istio-token" (OuterVolumeSpecName: "istio-token") pod "cb530dab-8654-407f-bacf-5eb448af97ef" (UID: "cb530dab-8654-407f-bacf-5eb448af97ef"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 13 03:05:52.487222 ip-10-0-134-52 kubenswrapper[2558]: I0713 03:05:52.487082 2558 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/cb530dab-8654-407f-bacf-5eb448af97ef-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "cb530dab-8654-407f-bacf-5eb448af97ef" (UID: "cb530dab-8654-407f-bacf-5eb448af97ef"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue "" Jul 13 03:05:52.487222 ip-10-0-134-52 kubenswrapper[2558]: I0713 03:05:52.487173 2558 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/cb530dab-8654-407f-bacf-5eb448af97ef-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "cb530dab-8654-407f-bacf-5eb448af97ef" (UID: "cb530dab-8654-407f-bacf-5eb448af97ef"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 13 03:05:52.487222 ip-10-0-134-52 kubenswrapper[2558]: I0713 03:05:52.487188 2558 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/cb530dab-8654-407f-bacf-5eb448af97ef-kube-api-access-2fl8c" (OuterVolumeSpecName: "kube-api-access-2fl8c") pod "cb530dab-8654-407f-bacf-5eb448af97ef" (UID: "cb530dab-8654-407f-bacf-5eb448af97ef"). InnerVolumeSpecName "kube-api-access-2fl8c". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 13 03:05:52.585449 ip-10-0-134-52 kubenswrapper[2558]: I0713 03:05:52.585423 2558 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/cb530dab-8654-407f-bacf-5eb448af97ef-istio-envoy\") on node \"ip-10-0-134-52.ec2.internal\" DevicePath \"\"" Jul 13 03:05:52.585449 ip-10-0-134-52 kubenswrapper[2558]: I0713 03:05:52.585448 2558 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/cb530dab-8654-407f-bacf-5eb448af97ef-workload-certs\") on node \"ip-10-0-134-52.ec2.internal\" DevicePath \"\"" Jul 13 03:05:52.585582 ip-10-0-134-52 kubenswrapper[2558]: I0713 03:05:52.585461 2558 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-2fl8c\" (UniqueName: \"kubernetes.io/projected/cb530dab-8654-407f-bacf-5eb448af97ef-kube-api-access-2fl8c\") on node \"ip-10-0-134-52.ec2.internal\" DevicePath \"\"" Jul 13 03:05:52.585582 ip-10-0-134-52 kubenswrapper[2558]: I0713 03:05:52.585474 2558 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/cb530dab-8654-407f-bacf-5eb448af97ef-istio-podinfo\") on node \"ip-10-0-134-52.ec2.internal\" DevicePath \"\"" Jul 13 03:05:52.585582 ip-10-0-134-52 kubenswrapper[2558]: I0713 03:05:52.585488 2558 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/cb530dab-8654-407f-bacf-5eb448af97ef-istio-token\") on node \"ip-10-0-134-52.ec2.internal\" DevicePath \"\"" Jul 13 03:05:53.211059 ip-10-0-134-52 kubenswrapper[2558]: I0713 03:05:53.211024 2558 generic.go:356] "Generic (PLEG): container finished" podID="cb530dab-8654-407f-bacf-5eb448af97ef" containerID="354952a6b1bf98455f2357840c827f2673cadb5d4a81ad15a15c3ec589947a25" exitCode=0 Jul 13 03:05:53.211207 ip-10-0-134-52 kubenswrapper[2558]: I0713 03:05:53.211075 2558 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-84cc848bd-jqv2h" Jul 13 03:05:53.211207 ip-10-0-134-52 kubenswrapper[2558]: I0713 03:05:53.211114 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-84cc848bd-jqv2h" event={"ID":"cb530dab-8654-407f-bacf-5eb448af97ef","Type":"ContainerDied","Data":"354952a6b1bf98455f2357840c827f2673cadb5d4a81ad15a15c3ec589947a25"} Jul 13 03:05:53.211207 ip-10-0-134-52 kubenswrapper[2558]: I0713 03:05:53.211168 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-84cc848bd-jqv2h" event={"ID":"cb530dab-8654-407f-bacf-5eb448af97ef","Type":"ContainerDied","Data":"76ac89073fc76053a94302d600f4ab6656c9240b285c5ed6ed5739ac441319a5"} Jul 13 03:05:53.211207 ip-10-0-134-52 kubenswrapper[2558]: I0713 03:05:53.211191 2558 scope.go:117] "RemoveContainer" containerID="354952a6b1bf98455f2357840c827f2673cadb5d4a81ad15a15c3ec589947a25" Jul 13 03:05:53.220579 ip-10-0-134-52 kubenswrapper[2558]: I0713 03:05:53.220553 2558 scope.go:117] "RemoveContainer" containerID="354952a6b1bf98455f2357840c827f2673cadb5d4a81ad15a15c3ec589947a25" Jul 13 03:05:53.220836 ip-10-0-134-52 kubenswrapper[2558]: E0713 03:05:53.220819 2558 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"354952a6b1bf98455f2357840c827f2673cadb5d4a81ad15a15c3ec589947a25\": container with ID starting with 354952a6b1bf98455f2357840c827f2673cadb5d4a81ad15a15c3ec589947a25 not found: ID does not exist" containerID="354952a6b1bf98455f2357840c827f2673cadb5d4a81ad15a15c3ec589947a25" Jul 13 03:05:53.220890 ip-10-0-134-52 kubenswrapper[2558]: I0713 03:05:53.220845 2558 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"354952a6b1bf98455f2357840c827f2673cadb5d4a81ad15a15c3ec589947a25"} err="failed to get container status \"354952a6b1bf98455f2357840c827f2673cadb5d4a81ad15a15c3ec589947a25\": rpc error: code = NotFound desc = could not find container \"354952a6b1bf98455f2357840c827f2673cadb5d4a81ad15a15c3ec589947a25\": container with ID starting with 354952a6b1bf98455f2357840c827f2673cadb5d4a81ad15a15c3ec589947a25 not found: ID does not exist" Jul 13 03:05:53.231878 ip-10-0-134-52 kubenswrapper[2558]: I0713 03:05:53.231853 2558 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/data-science-gateway-data-science-gateway-class-84cc848bd-jqv2h"] Jul 13 03:05:53.236516 ip-10-0-134-52 kubenswrapper[2558]: I0713 03:05:53.236496 2558 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/data-science-gateway-data-science-gateway-class-84cc848bd-jqv2h"] Jul 13 03:05:54.092724 ip-10-0-134-52 kubenswrapper[2558]: I0713 03:05:54.092696 2558 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="cb530dab-8654-407f-bacf-5eb448af97ef" path="/var/lib/kubelet/pods/cb530dab-8654-407f-bacf-5eb448af97ef/volumes" Jul 13 03:06:22.053908 ip-10-0-134-52 kubenswrapper[2558]: I0713 03:06:22.053875 2558 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/kuadrant-operator-catalog-8hhqj"] Jul 13 03:06:22.054406 ip-10-0-134-52 kubenswrapper[2558]: I0713 03:06:22.054209 2558 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="cb530dab-8654-407f-bacf-5eb448af97ef" containerName="istio-proxy" Jul 13 03:06:22.054406 ip-10-0-134-52 kubenswrapper[2558]: I0713 03:06:22.054220 2558 state_mem.go:107] "Deleted CPUSet assignment" podUID="cb530dab-8654-407f-bacf-5eb448af97ef" containerName="istio-proxy" Jul 13 03:06:22.054406 ip-10-0-134-52 kubenswrapper[2558]: I0713 03:06:22.054281 2558 memory_manager.go:368] "RemoveStaleState removing state" podUID="cb530dab-8654-407f-bacf-5eb448af97ef" containerName="istio-proxy" Jul 13 03:06:22.057364 ip-10-0-134-52 kubenswrapper[2558]: I0713 03:06:22.057321 2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-catalog-8hhqj" Jul 13 03:06:22.060187 ip-10-0-134-52 kubenswrapper[2558]: I0713 03:06:22.060167 2558 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"kube-root-ca.crt\"" Jul 13 03:06:22.061324 ip-10-0-134-52 kubenswrapper[2558]: I0713 03:06:22.061297 2558 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"openshift-service-ca.crt\"" Jul 13 03:06:22.061442 ip-10-0-134-52 kubenswrapper[2558]: I0713 03:06:22.061364 2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"kuadrant-operator-catalog-dockercfg-nqdn9\"" Jul 13 03:06:22.068380 ip-10-0-134-52 kubenswrapper[2558]: I0713 03:06:22.068360 2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-catalog-8hhqj"] Jul 13 03:06:22.206138 ip-10-0-134-52 kubenswrapper[2558]: I0713 03:06:22.206111 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-wsh7f\" (UniqueName: \"kubernetes.io/projected/9de2cd69-a10f-4671-9d52-7db8761ff9ee-kube-api-access-wsh7f\") pod \"kuadrant-operator-catalog-8hhqj\" (UID: \"9de2cd69-a10f-4671-9d52-7db8761ff9ee\") " pod="kuadrant-system/kuadrant-operator-catalog-8hhqj" Jul 13 03:06:22.306686 ip-10-0-134-52 kubenswrapper[2558]: I0713 03:06:22.306622 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-wsh7f\" (UniqueName: \"kubernetes.io/projected/9de2cd69-a10f-4671-9d52-7db8761ff9ee-kube-api-access-wsh7f\") pod \"kuadrant-operator-catalog-8hhqj\" (UID: \"9de2cd69-a10f-4671-9d52-7db8761ff9ee\") " pod="kuadrant-system/kuadrant-operator-catalog-8hhqj" Jul 13 03:06:22.316180 ip-10-0-134-52 kubenswrapper[2558]: I0713 03:06:22.316157 2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-wsh7f\" (UniqueName: \"kubernetes.io/projected/9de2cd69-a10f-4671-9d52-7db8761ff9ee-kube-api-access-wsh7f\") pod \"kuadrant-operator-catalog-8hhqj\" (UID: \"9de2cd69-a10f-4671-9d52-7db8761ff9ee\") " pod="kuadrant-system/kuadrant-operator-catalog-8hhqj" Jul 13 03:06:22.366942 ip-10-0-134-52 kubenswrapper[2558]: I0713 03:06:22.366913 2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-catalog-8hhqj" Jul 13 03:06:22.422244 ip-10-0-134-52 kubenswrapper[2558]: I0713 03:06:22.422217 2558 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-catalog-8hhqj"] Jul 13 03:06:22.495200 ip-10-0-134-52 kubenswrapper[2558]: I0713 03:06:22.495180 2558 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-catalog-8hhqj"] Jul 13 03:06:22.497391 ip-10-0-134-52 kubenswrapper[2558]: W0713 03:06:22.497368 2558 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod9de2cd69_a10f_4671_9d52_7db8761ff9ee.slice/crio-1982d8c3ba2990a95bac48b04113d2b22d3a6e422cd4e3b0bdc8c44ced1b1af3 WatchSource:0}: Error finding container 1982d8c3ba2990a95bac48b04113d2b22d3a6e422cd4e3b0bdc8c44ced1b1af3: Status 404 returned error can't find the container with id 1982d8c3ba2990a95bac48b04113d2b22d3a6e422cd4e3b0bdc8c44ced1b1af3 Jul 13 03:06:22.631620 ip-10-0-134-52 kubenswrapper[2558]: I0713 03:06:22.631567 2558 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/kuadrant-operator-catalog-n762x"] Jul 13 03:06:22.636065 ip-10-0-134-52 kubenswrapper[2558]: I0713 03:06:22.636050 2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-catalog-n762x" Jul 13 03:06:22.642432 ip-10-0-134-52 kubenswrapper[2558]: I0713 03:06:22.642405 2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-catalog-n762x"] Jul 13 03:06:22.811657 ip-10-0-134-52 kubenswrapper[2558]: I0713 03:06:22.811628 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-j2blf\" (UniqueName: \"kubernetes.io/projected/d86562e5-26bb-4191-93fd-869ff608ab89-kube-api-access-j2blf\") pod \"kuadrant-operator-catalog-n762x\" (UID: \"d86562e5-26bb-4191-93fd-869ff608ab89\") " pod="kuadrant-system/kuadrant-operator-catalog-n762x" Jul 13 03:06:22.912932 ip-10-0-134-52 kubenswrapper[2558]: I0713 03:06:22.912864 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-j2blf\" (UniqueName: \"kubernetes.io/projected/d86562e5-26bb-4191-93fd-869ff608ab89-kube-api-access-j2blf\") pod \"kuadrant-operator-catalog-n762x\" (UID: \"d86562e5-26bb-4191-93fd-869ff608ab89\") " pod="kuadrant-system/kuadrant-operator-catalog-n762x" Jul 13 03:06:22.921045 ip-10-0-134-52 kubenswrapper[2558]: I0713 03:06:22.921019 2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-j2blf\" (UniqueName: \"kubernetes.io/projected/d86562e5-26bb-4191-93fd-869ff608ab89-kube-api-access-j2blf\") pod \"kuadrant-operator-catalog-n762x\" (UID: \"d86562e5-26bb-4191-93fd-869ff608ab89\") " pod="kuadrant-system/kuadrant-operator-catalog-n762x" Jul 13 03:06:22.947439 ip-10-0-134-52 kubenswrapper[2558]: I0713 03:06:22.947410 2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-catalog-n762x" Jul 13 03:06:23.106628 ip-10-0-134-52 kubenswrapper[2558]: I0713 03:06:23.106604 2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-catalog-n762x"] Jul 13 03:06:23.108407 ip-10-0-134-52 kubenswrapper[2558]: W0713 03:06:23.108382 2558 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podd86562e5_26bb_4191_93fd_869ff608ab89.slice/crio-e219962eeff64e1bc1040b7d1b57bc9688b25e8a8143eb0b7dbd39cccae76762 WatchSource:0}: Error finding container e219962eeff64e1bc1040b7d1b57bc9688b25e8a8143eb0b7dbd39cccae76762: Status 404 returned error can't find the container with id e219962eeff64e1bc1040b7d1b57bc9688b25e8a8143eb0b7dbd39cccae76762 Jul 13 03:06:23.351167 ip-10-0-134-52 kubenswrapper[2558]: I0713 03:06:23.351129 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-catalog-n762x" event={"ID":"d86562e5-26bb-4191-93fd-869ff608ab89","Type":"ContainerStarted","Data":"e219962eeff64e1bc1040b7d1b57bc9688b25e8a8143eb0b7dbd39cccae76762"} Jul 13 03:06:23.352359 ip-10-0-134-52 kubenswrapper[2558]: I0713 03:06:23.352313 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-catalog-8hhqj" event={"ID":"9de2cd69-a10f-4671-9d52-7db8761ff9ee","Type":"ContainerStarted","Data":"1982d8c3ba2990a95bac48b04113d2b22d3a6e422cd4e3b0bdc8c44ced1b1af3"} Jul 13 03:06:25.364670 ip-10-0-134-52 kubenswrapper[2558]: I0713 03:06:25.364633 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-catalog-n762x" event={"ID":"d86562e5-26bb-4191-93fd-869ff608ab89","Type":"ContainerStarted","Data":"3430858cd57488e0094b2676f471deff89c3e97d09b1dffadeebf695e0ffb39d"} Jul 13 03:06:25.366107 ip-10-0-134-52 kubenswrapper[2558]: I0713 03:06:25.366076 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-catalog-8hhqj" event={"ID":"9de2cd69-a10f-4671-9d52-7db8761ff9ee","Type":"ContainerStarted","Data":"769f4aff8c9dce9dd943d25c249fa115b3b01ae422ecfab17ea3ace0a4c62061"} Jul 13 03:06:25.366220 ip-10-0-134-52 kubenswrapper[2558]: I0713 03:06:25.366192 2558 kuberuntime_container.go:873] "Killing container with a grace period" pod="kuadrant-system/kuadrant-operator-catalog-8hhqj" podUID="9de2cd69-a10f-4671-9d52-7db8761ff9ee" containerName="registry-server" containerID="cri-o://769f4aff8c9dce9dd943d25c249fa115b3b01ae422ecfab17ea3ace0a4c62061" gracePeriod=2 Jul 13 03:06:25.383866 ip-10-0-134-52 kubenswrapper[2558]: I0713 03:06:25.383824 2558 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/kuadrant-operator-catalog-n762x" podStartSLOduration=1.988627986 podStartE2EDuration="3.383809158s" totalImagesPullingTime="1.395181172s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-13 03:06:22 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-13 03:06:25.382780168 +0000 UTC m=+567.783380634" watchObservedRunningTime="2026-07-13 03:06:25.383809158 +0000 UTC m=+567.784409655" Jul 13 03:06:25.399041 ip-10-0-134-52 kubenswrapper[2558]: I0713 03:06:25.398997 2558 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/kuadrant-operator-catalog-8hhqj" podStartSLOduration=1.393403852 podStartE2EDuration="3.39897975s" totalImagesPullingTime="2.005575898s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-13 03:06:22 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-13 03:06:25.397562934 +0000 UTC m=+567.798163418" watchObservedRunningTime="2026-07-13 03:06:25.39897975 +0000 UTC m=+567.799580217" Jul 13 03:06:25.610187 ip-10-0-134-52 kubenswrapper[2558]: I0713 03:06:25.610167 2558 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-catalog-8hhqj" Jul 13 03:06:25.645496 ip-10-0-134-52 kubenswrapper[2558]: I0713 03:06:25.645440 2558 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-wsh7f\" (UniqueName: \"kubernetes.io/projected/9de2cd69-a10f-4671-9d52-7db8761ff9ee-kube-api-access-wsh7f\") pod \"9de2cd69-a10f-4671-9d52-7db8761ff9ee\" (UID: \"9de2cd69-a10f-4671-9d52-7db8761ff9ee\") " Jul 13 03:06:25.647564 ip-10-0-134-52 kubenswrapper[2558]: I0713 03:06:25.647542 2558 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/9de2cd69-a10f-4671-9d52-7db8761ff9ee-kube-api-access-wsh7f" (OuterVolumeSpecName: "kube-api-access-wsh7f") pod "9de2cd69-a10f-4671-9d52-7db8761ff9ee" (UID: "9de2cd69-a10f-4671-9d52-7db8761ff9ee"). InnerVolumeSpecName "kube-api-access-wsh7f". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 13 03:06:25.745882 ip-10-0-134-52 kubenswrapper[2558]: I0713 03:06:25.745854 2558 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-wsh7f\" (UniqueName: \"kubernetes.io/projected/9de2cd69-a10f-4671-9d52-7db8761ff9ee-kube-api-access-wsh7f\") on node \"ip-10-0-134-52.ec2.internal\" DevicePath \"\"" Jul 13 03:06:26.371775 ip-10-0-134-52 kubenswrapper[2558]: I0713 03:06:26.371689 2558 generic.go:356] "Generic (PLEG): container finished" podID="9de2cd69-a10f-4671-9d52-7db8761ff9ee" containerID="769f4aff8c9dce9dd943d25c249fa115b3b01ae422ecfab17ea3ace0a4c62061" exitCode=0 Jul 13 03:06:26.371775 ip-10-0-134-52 kubenswrapper[2558]: I0713 03:06:26.371730 2558 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-catalog-8hhqj" Jul 13 03:06:26.371775 ip-10-0-134-52 kubenswrapper[2558]: I0713 03:06:26.371755 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-catalog-8hhqj" event={"ID":"9de2cd69-a10f-4671-9d52-7db8761ff9ee","Type":"ContainerDied","Data":"769f4aff8c9dce9dd943d25c249fa115b3b01ae422ecfab17ea3ace0a4c62061"} Jul 13 03:06:26.372248 ip-10-0-134-52 kubenswrapper[2558]: I0713 03:06:26.371818 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-catalog-8hhqj" event={"ID":"9de2cd69-a10f-4671-9d52-7db8761ff9ee","Type":"ContainerDied","Data":"1982d8c3ba2990a95bac48b04113d2b22d3a6e422cd4e3b0bdc8c44ced1b1af3"} Jul 13 03:06:26.372248 ip-10-0-134-52 kubenswrapper[2558]: I0713 03:06:26.371852 2558 scope.go:117] "RemoveContainer" containerID="769f4aff8c9dce9dd943d25c249fa115b3b01ae422ecfab17ea3ace0a4c62061" Jul 13 03:06:26.380735 ip-10-0-134-52 kubenswrapper[2558]: I0713 03:06:26.380719 2558 scope.go:117] "RemoveContainer" containerID="769f4aff8c9dce9dd943d25c249fa115b3b01ae422ecfab17ea3ace0a4c62061" Jul 13 03:06:26.380997 ip-10-0-134-52 kubenswrapper[2558]: E0713 03:06:26.380976 2558 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"769f4aff8c9dce9dd943d25c249fa115b3b01ae422ecfab17ea3ace0a4c62061\": container with ID starting with 769f4aff8c9dce9dd943d25c249fa115b3b01ae422ecfab17ea3ace0a4c62061 not found: ID does not exist" containerID="769f4aff8c9dce9dd943d25c249fa115b3b01ae422ecfab17ea3ace0a4c62061" Jul 13 03:06:26.381043 ip-10-0-134-52 kubenswrapper[2558]: I0713 03:06:26.381004 2558 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"769f4aff8c9dce9dd943d25c249fa115b3b01ae422ecfab17ea3ace0a4c62061"} err="failed to get container status \"769f4aff8c9dce9dd943d25c249fa115b3b01ae422ecfab17ea3ace0a4c62061\": rpc error: code = NotFound desc = could not find container \"769f4aff8c9dce9dd943d25c249fa115b3b01ae422ecfab17ea3ace0a4c62061\": container with ID starting with 769f4aff8c9dce9dd943d25c249fa115b3b01ae422ecfab17ea3ace0a4c62061 not found: ID does not exist" Jul 13 03:06:26.387911 ip-10-0-134-52 kubenswrapper[2558]: I0713 03:06:26.387891 2558 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-catalog-8hhqj"] Jul 13 03:06:26.395657 ip-10-0-134-52 kubenswrapper[2558]: I0713 03:06:26.395638 2558 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/kuadrant-operator-catalog-8hhqj"] Jul 13 03:06:28.093825 ip-10-0-134-52 kubenswrapper[2558]: I0713 03:06:28.093798 2558 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="9de2cd69-a10f-4671-9d52-7db8761ff9ee" path="/var/lib/kubelet/pods/9de2cd69-a10f-4671-9d52-7db8761ff9ee/volumes" Jul 13 03:06:32.948583 ip-10-0-134-52 kubenswrapper[2558]: I0713 03:06:32.948542 2558 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="kuadrant-system/kuadrant-operator-catalog-n762x" Jul 13 03:06:32.948970 ip-10-0-134-52 kubenswrapper[2558]: I0713 03:06:32.948602 2558 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/kuadrant-operator-catalog-n762x" Jul 13 03:06:32.971023 ip-10-0-134-52 kubenswrapper[2558]: I0713 03:06:32.970999 2558 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="kuadrant-system/kuadrant-operator-catalog-n762x" Jul 13 03:06:33.426510 ip-10-0-134-52 kubenswrapper[2558]: I0713 03:06:33.426485 2558 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/kuadrant-operator-catalog-n762x" Jul 13 03:06:38.070274 ip-10-0-134-52 kubenswrapper[2558]: I0713 03:06:38.070239 2558 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b7595s7h5"] Jul 13 03:06:38.070653 ip-10-0-134-52 kubenswrapper[2558]: I0713 03:06:38.070598 2558 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="9de2cd69-a10f-4671-9d52-7db8761ff9ee" containerName="registry-server" Jul 13 03:06:38.070653 ip-10-0-134-52 kubenswrapper[2558]: I0713 03:06:38.070611 2558 state_mem.go:107] "Deleted CPUSet assignment" podUID="9de2cd69-a10f-4671-9d52-7db8761ff9ee" containerName="registry-server" Jul 13 03:06:38.070730 ip-10-0-134-52 kubenswrapper[2558]: I0713 03:06:38.070677 2558 memory_manager.go:368] "RemoveStaleState removing state" podUID="9de2cd69-a10f-4671-9d52-7db8761ff9ee" containerName="registry-server" Jul 13 03:06:38.075071 ip-10-0-134-52 kubenswrapper[2558]: I0713 03:06:38.075055 2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b7595s7h5" Jul 13 03:06:38.077947 ip-10-0-134-52 kubenswrapper[2558]: I0713 03:06:38.077929 2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"default-dockercfg-ph7hg\"" Jul 13 03:06:38.081740 ip-10-0-134-52 kubenswrapper[2558]: I0713 03:06:38.081687 2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b7595s7h5"] Jul 13 03:06:38.134558 ip-10-0-134-52 kubenswrapper[2558]: I0713 03:06:38.134530 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/28acb62f-1fa2-45fa-a2b8-dba00604a968-util\") pod \"0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b7595s7h5\" (UID: \"28acb62f-1fa2-45fa-a2b8-dba00604a968\") " pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b7595s7h5" Jul 13 03:06:38.134677 ip-10-0-134-52 kubenswrapper[2558]: I0713 03:06:38.134584 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/28acb62f-1fa2-45fa-a2b8-dba00604a968-bundle\") pod \"0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b7595s7h5\" (UID: \"28acb62f-1fa2-45fa-a2b8-dba00604a968\") " pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b7595s7h5" Jul 13 03:06:38.134718 ip-10-0-134-52 kubenswrapper[2558]: I0713 03:06:38.134666 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-m68wc\" (UniqueName: \"kubernetes.io/projected/28acb62f-1fa2-45fa-a2b8-dba00604a968-kube-api-access-m68wc\") pod \"0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b7595s7h5\" (UID: \"28acb62f-1fa2-45fa-a2b8-dba00604a968\") " pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b7595s7h5" Jul 13 03:06:38.235396 ip-10-0-134-52 kubenswrapper[2558]: I0713 03:06:38.235362 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/28acb62f-1fa2-45fa-a2b8-dba00604a968-util\") pod \"0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b7595s7h5\" (UID: \"28acb62f-1fa2-45fa-a2b8-dba00604a968\") " pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b7595s7h5" Jul 13 03:06:38.235524 ip-10-0-134-52 kubenswrapper[2558]: I0713 03:06:38.235417 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/28acb62f-1fa2-45fa-a2b8-dba00604a968-bundle\") pod \"0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b7595s7h5\" (UID: \"28acb62f-1fa2-45fa-a2b8-dba00604a968\") " pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b7595s7h5" Jul 13 03:06:38.235577 ip-10-0-134-52 kubenswrapper[2558]: I0713 03:06:38.235531 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-m68wc\" (UniqueName: \"kubernetes.io/projected/28acb62f-1fa2-45fa-a2b8-dba00604a968-kube-api-access-m68wc\") pod \"0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b7595s7h5\" (UID: \"28acb62f-1fa2-45fa-a2b8-dba00604a968\") " pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b7595s7h5" Jul 13 03:06:38.235707 ip-10-0-134-52 kubenswrapper[2558]: I0713 03:06:38.235689 2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/28acb62f-1fa2-45fa-a2b8-dba00604a968-bundle\") pod \"0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b7595s7h5\" (UID: \"28acb62f-1fa2-45fa-a2b8-dba00604a968\") " pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b7595s7h5" Jul 13 03:06:38.235784 ip-10-0-134-52 kubenswrapper[2558]: I0713 03:06:38.235751 2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/28acb62f-1fa2-45fa-a2b8-dba00604a968-util\") pod \"0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b7595s7h5\" (UID: \"28acb62f-1fa2-45fa-a2b8-dba00604a968\") " pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b7595s7h5" Jul 13 03:06:38.245487 ip-10-0-134-52 kubenswrapper[2558]: I0713 03:06:38.245455 2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-m68wc\" (UniqueName: \"kubernetes.io/projected/28acb62f-1fa2-45fa-a2b8-dba00604a968-kube-api-access-m68wc\") pod \"0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b7595s7h5\" (UID: \"28acb62f-1fa2-45fa-a2b8-dba00604a968\") " pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b7595s7h5" Jul 13 03:06:38.385370 ip-10-0-134-52 kubenswrapper[2558]: I0713 03:06:38.385296 2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b7595s7h5" Jul 13 03:06:38.515066 ip-10-0-134-52 kubenswrapper[2558]: I0713 03:06:38.515040 2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b7595s7h5"] Jul 13 03:06:38.516913 ip-10-0-134-52 kubenswrapper[2558]: W0713 03:06:38.516885 2558 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod28acb62f_1fa2_45fa_a2b8_dba00604a968.slice/crio-d5c5986e93eeb5338525faf8e032e05b00c44ffad70f824a07600e36bd6b6be7 WatchSource:0}: Error finding container d5c5986e93eeb5338525faf8e032e05b00c44ffad70f824a07600e36bd6b6be7: Status 404 returned error can't find the container with id d5c5986e93eeb5338525faf8e032e05b00c44ffad70f824a07600e36bd6b6be7 Jul 13 03:06:38.665083 ip-10-0-134-52 kubenswrapper[2558]: I0713 03:06:38.665025 2558 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1kgdxq"] Jul 13 03:06:38.668470 ip-10-0-134-52 kubenswrapper[2558]: I0713 03:06:38.668454 2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1kgdxq" Jul 13 03:06:38.676709 ip-10-0-134-52 kubenswrapper[2558]: I0713 03:06:38.676688 2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1kgdxq"] Jul 13 03:06:38.739385 ip-10-0-134-52 kubenswrapper[2558]: I0713 03:06:38.739359 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/7e5a7536-75c8-40fb-b87a-1f700b719d2b-util\") pod \"9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1kgdxq\" (UID: \"7e5a7536-75c8-40fb-b87a-1f700b719d2b\") " pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1kgdxq" Jul 13 03:06:38.739508 ip-10-0-134-52 kubenswrapper[2558]: I0713 03:06:38.739393 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/7e5a7536-75c8-40fb-b87a-1f700b719d2b-bundle\") pod \"9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1kgdxq\" (UID: \"7e5a7536-75c8-40fb-b87a-1f700b719d2b\") " pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1kgdxq" Jul 13 03:06:38.739508 ip-10-0-134-52 kubenswrapper[2558]: I0713 03:06:38.739463 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-k6rmh\" (UniqueName: \"kubernetes.io/projected/7e5a7536-75c8-40fb-b87a-1f700b719d2b-kube-api-access-k6rmh\") pod \"9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1kgdxq\" (UID: \"7e5a7536-75c8-40fb-b87a-1f700b719d2b\") " pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1kgdxq" Jul 13 03:06:38.840138 ip-10-0-134-52 kubenswrapper[2558]: I0713 03:06:38.840113 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-k6rmh\" (UniqueName: \"kubernetes.io/projected/7e5a7536-75c8-40fb-b87a-1f700b719d2b-kube-api-access-k6rmh\") pod \"9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1kgdxq\" (UID: \"7e5a7536-75c8-40fb-b87a-1f700b719d2b\") " pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1kgdxq" Jul 13 03:06:38.840255 ip-10-0-134-52 kubenswrapper[2558]: I0713 03:06:38.840157 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/7e5a7536-75c8-40fb-b87a-1f700b719d2b-util\") pod \"9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1kgdxq\" (UID: \"7e5a7536-75c8-40fb-b87a-1f700b719d2b\") " pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1kgdxq" Jul 13 03:06:38.840255 ip-10-0-134-52 kubenswrapper[2558]: I0713 03:06:38.840182 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/7e5a7536-75c8-40fb-b87a-1f700b719d2b-bundle\") pod \"9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1kgdxq\" (UID: \"7e5a7536-75c8-40fb-b87a-1f700b719d2b\") " pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1kgdxq" Jul 13 03:06:38.840491 ip-10-0-134-52 kubenswrapper[2558]: I0713 03:06:38.840474 2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/7e5a7536-75c8-40fb-b87a-1f700b719d2b-util\") pod \"9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1kgdxq\" (UID: \"7e5a7536-75c8-40fb-b87a-1f700b719d2b\") " pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1kgdxq" Jul 13 03:06:38.840540 ip-10-0-134-52 kubenswrapper[2558]: I0713 03:06:38.840520 2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/7e5a7536-75c8-40fb-b87a-1f700b719d2b-bundle\") pod \"9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1kgdxq\" (UID: \"7e5a7536-75c8-40fb-b87a-1f700b719d2b\") " pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1kgdxq" Jul 13 03:06:38.848153 ip-10-0-134-52 kubenswrapper[2558]: I0713 03:06:38.848136 2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-k6rmh\" (UniqueName: \"kubernetes.io/projected/7e5a7536-75c8-40fb-b87a-1f700b719d2b-kube-api-access-k6rmh\") pod \"9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1kgdxq\" (UID: \"7e5a7536-75c8-40fb-b87a-1f700b719d2b\") " pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1kgdxq" Jul 13 03:06:38.986677 ip-10-0-134-52 kubenswrapper[2558]: I0713 03:06:38.986626 2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1kgdxq" Jul 13 03:06:39.063064 ip-10-0-134-52 kubenswrapper[2558]: I0713 03:06:39.063033 2558 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0xbh5q"] Jul 13 03:06:39.067919 ip-10-0-134-52 kubenswrapper[2558]: I0713 03:06:39.067896 2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0xbh5q" Jul 13 03:06:39.076046 ip-10-0-134-52 kubenswrapper[2558]: I0713 03:06:39.075988 2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0xbh5q"] Jul 13 03:06:39.119731 ip-10-0-134-52 kubenswrapper[2558]: I0713 03:06:39.119705 2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1kgdxq"] Jul 13 03:06:39.121449 ip-10-0-134-52 kubenswrapper[2558]: W0713 03:06:39.121427 2558 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod7e5a7536_75c8_40fb_b87a_1f700b719d2b.slice/crio-c30f482199960a5afbdbb6e353e40c6c4c68917d5da8c3841f59e50c5ee485ae WatchSource:0}: Error finding container c30f482199960a5afbdbb6e353e40c6c4c68917d5da8c3841f59e50c5ee485ae: Status 404 returned error can't find the container with id c30f482199960a5afbdbb6e353e40c6c4c68917d5da8c3841f59e50c5ee485ae Jul 13 03:06:39.143363 ip-10-0-134-52 kubenswrapper[2558]: I0713 03:06:39.143311 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/31221317-a0bf-4d04-87f4-f7b179fc3fd6-util\") pod \"19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0xbh5q\" (UID: \"31221317-a0bf-4d04-87f4-f7b179fc3fd6\") " pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0xbh5q" Jul 13 03:06:39.143455 ip-10-0-134-52 kubenswrapper[2558]: I0713 03:06:39.143398 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/31221317-a0bf-4d04-87f4-f7b179fc3fd6-bundle\") pod \"19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0xbh5q\" (UID: \"31221317-a0bf-4d04-87f4-f7b179fc3fd6\") " pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0xbh5q" Jul 13 03:06:39.143455 ip-10-0-134-52 kubenswrapper[2558]: I0713 03:06:39.143419 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-zpllh\" (UniqueName: \"kubernetes.io/projected/31221317-a0bf-4d04-87f4-f7b179fc3fd6-kube-api-access-zpllh\") pod \"19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0xbh5q\" (UID: \"31221317-a0bf-4d04-87f4-f7b179fc3fd6\") " pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0xbh5q" Jul 13 03:06:39.243997 ip-10-0-134-52 kubenswrapper[2558]: I0713 03:06:39.243929 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/31221317-a0bf-4d04-87f4-f7b179fc3fd6-util\") pod \"19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0xbh5q\" (UID: \"31221317-a0bf-4d04-87f4-f7b179fc3fd6\") " pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0xbh5q" Jul 13 03:06:39.244103 ip-10-0-134-52 kubenswrapper[2558]: I0713 03:06:39.244012 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/31221317-a0bf-4d04-87f4-f7b179fc3fd6-bundle\") pod \"19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0xbh5q\" (UID: \"31221317-a0bf-4d04-87f4-f7b179fc3fd6\") " pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0xbh5q" Jul 13 03:06:39.244103 ip-10-0-134-52 kubenswrapper[2558]: I0713 03:06:39.244043 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-zpllh\" (UniqueName: \"kubernetes.io/projected/31221317-a0bf-4d04-87f4-f7b179fc3fd6-kube-api-access-zpllh\") pod \"19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0xbh5q\" (UID: \"31221317-a0bf-4d04-87f4-f7b179fc3fd6\") " pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0xbh5q" Jul 13 03:06:39.244278 ip-10-0-134-52 kubenswrapper[2558]: I0713 03:06:39.244259 2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/31221317-a0bf-4d04-87f4-f7b179fc3fd6-util\") pod \"19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0xbh5q\" (UID: \"31221317-a0bf-4d04-87f4-f7b179fc3fd6\") " pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0xbh5q" Jul 13 03:06:39.244362 ip-10-0-134-52 kubenswrapper[2558]: I0713 03:06:39.244281 2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/31221317-a0bf-4d04-87f4-f7b179fc3fd6-bundle\") pod \"19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0xbh5q\" (UID: \"31221317-a0bf-4d04-87f4-f7b179fc3fd6\") " pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0xbh5q" Jul 13 03:06:39.252851 ip-10-0-134-52 kubenswrapper[2558]: I0713 03:06:39.252827 2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-zpllh\" (UniqueName: \"kubernetes.io/projected/31221317-a0bf-4d04-87f4-f7b179fc3fd6-kube-api-access-zpllh\") pod \"19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0xbh5q\" (UID: \"31221317-a0bf-4d04-87f4-f7b179fc3fd6\") " pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0xbh5q" Jul 13 03:06:39.381586 ip-10-0-134-52 kubenswrapper[2558]: I0713 03:06:39.381553 2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0xbh5q" Jul 13 03:06:39.438347 ip-10-0-134-52 kubenswrapper[2558]: I0713 03:06:39.438296 2558 generic.go:356] "Generic (PLEG): container finished" podID="28acb62f-1fa2-45fa-a2b8-dba00604a968" containerID="a07d317672218019d1c90c640146d5e31b2951b7b7d5160982af26ffba6f8974" exitCode=0 Jul 13 03:06:39.438486 ip-10-0-134-52 kubenswrapper[2558]: I0713 03:06:39.438410 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b7595s7h5" event={"ID":"28acb62f-1fa2-45fa-a2b8-dba00604a968","Type":"ContainerDied","Data":"a07d317672218019d1c90c640146d5e31b2951b7b7d5160982af26ffba6f8974"} Jul 13 03:06:39.438677 ip-10-0-134-52 kubenswrapper[2558]: I0713 03:06:39.438651 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b7595s7h5" event={"ID":"28acb62f-1fa2-45fa-a2b8-dba00604a968","Type":"ContainerStarted","Data":"d5c5986e93eeb5338525faf8e032e05b00c44ffad70f824a07600e36bd6b6be7"} Jul 13 03:06:39.441852 ip-10-0-134-52 kubenswrapper[2558]: I0713 03:06:39.441716 2558 generic.go:356] "Generic (PLEG): container finished" podID="7e5a7536-75c8-40fb-b87a-1f700b719d2b" containerID="cde4670ae1e3707b0a18ebb3be319558e2aa52a92fd7141c6d1a494111b684c4" exitCode=0 Jul 13 03:06:39.441852 ip-10-0-134-52 kubenswrapper[2558]: I0713 03:06:39.441778 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1kgdxq" event={"ID":"7e5a7536-75c8-40fb-b87a-1f700b719d2b","Type":"ContainerDied","Data":"cde4670ae1e3707b0a18ebb3be319558e2aa52a92fd7141c6d1a494111b684c4"} Jul 13 03:06:39.441852 ip-10-0-134-52 kubenswrapper[2558]: I0713 03:06:39.441816 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1kgdxq" event={"ID":"7e5a7536-75c8-40fb-b87a-1f700b719d2b","Type":"ContainerStarted","Data":"c30f482199960a5afbdbb6e353e40c6c4c68917d5da8c3841f59e50c5ee485ae"} Jul 13 03:06:39.453016 ip-10-0-134-52 kubenswrapper[2558]: I0713 03:06:39.452992 2558 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console/console-5bbc889ccd-k7sfh"] Jul 13 03:06:39.457818 ip-10-0-134-52 kubenswrapper[2558]: I0713 03:06:39.457798 2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-5bbc889ccd-k7sfh" Jul 13 03:06:39.473926 ip-10-0-134-52 kubenswrapper[2558]: I0713 03:06:39.473900 2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-5bbc889ccd-k7sfh"] Jul 13 03:06:39.487916 ip-10-0-134-52 kubenswrapper[2558]: I0713 03:06:39.487887 2558 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed7382lfg"] Jul 13 03:06:39.491834 ip-10-0-134-52 kubenswrapper[2558]: I0713 03:06:39.491811 2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed7382lfg" Jul 13 03:06:39.498160 ip-10-0-134-52 kubenswrapper[2558]: I0713 03:06:39.498102 2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed7382lfg"] Jul 13 03:06:39.523916 ip-10-0-134-52 kubenswrapper[2558]: I0713 03:06:39.523826 2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0xbh5q"] Jul 13 03:06:39.526082 ip-10-0-134-52 kubenswrapper[2558]: W0713 03:06:39.526053 2558 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod31221317_a0bf_4d04_87f4_f7b179fc3fd6.slice/crio-bc5a6e0fb6c1c965eb58c1d8d57d785021d8742d9c7605f0a218aeb77ed70117 WatchSource:0}: Error finding container bc5a6e0fb6c1c965eb58c1d8d57d785021d8742d9c7605f0a218aeb77ed70117: Status 404 returned error can't find the container with id bc5a6e0fb6c1c965eb58c1d8d57d785021d8742d9c7605f0a218aeb77ed70117 Jul 13 03:06:39.546760 ip-10-0-134-52 kubenswrapper[2558]: I0713 03:06:39.546738 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/f3527e90-e5fa-4bc8-b215-57dcde6593d3-console-oauth-config\") pod \"console-5bbc889ccd-k7sfh\" (UID: \"f3527e90-e5fa-4bc8-b215-57dcde6593d3\") " pod="openshift-console/console-5bbc889ccd-k7sfh" Jul 13 03:06:39.546867 ip-10-0-134-52 kubenswrapper[2558]: I0713 03:06:39.546780 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/f3527e90-e5fa-4bc8-b215-57dcde6593d3-console-config\") pod \"console-5bbc889ccd-k7sfh\" (UID: \"f3527e90-e5fa-4bc8-b215-57dcde6593d3\") " pod="openshift-console/console-5bbc889ccd-k7sfh" Jul 13 03:06:39.546867 ip-10-0-134-52 kubenswrapper[2558]: I0713 03:06:39.546855 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/f3527e90-e5fa-4bc8-b215-57dcde6593d3-trusted-ca-bundle\") pod \"console-5bbc889ccd-k7sfh\" (UID: \"f3527e90-e5fa-4bc8-b215-57dcde6593d3\") " pod="openshift-console/console-5bbc889ccd-k7sfh" Jul 13 03:06:39.546987 ip-10-0-134-52 kubenswrapper[2558]: I0713 03:06:39.546880 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/f3527e90-e5fa-4bc8-b215-57dcde6593d3-oauth-serving-cert\") pod \"console-5bbc889ccd-k7sfh\" (UID: \"f3527e90-e5fa-4bc8-b215-57dcde6593d3\") " pod="openshift-console/console-5bbc889ccd-k7sfh" Jul 13 03:06:39.546987 ip-10-0-134-52 kubenswrapper[2558]: I0713 03:06:39.546912 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-qxt9l\" (UniqueName: \"kubernetes.io/projected/ea4c0956-80a0-434e-9483-d5c467053b32-kube-api-access-qxt9l\") pod \"5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed7382lfg\" (UID: \"ea4c0956-80a0-434e-9483-d5c467053b32\") " pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed7382lfg" Jul 13 03:06:39.547102 ip-10-0-134-52 kubenswrapper[2558]: I0713 03:06:39.547013 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/f3527e90-e5fa-4bc8-b215-57dcde6593d3-service-ca\") pod \"console-5bbc889ccd-k7sfh\" (UID: \"f3527e90-e5fa-4bc8-b215-57dcde6593d3\") " pod="openshift-console/console-5bbc889ccd-k7sfh" Jul 13 03:06:39.547102 ip-10-0-134-52 kubenswrapper[2558]: I0713 03:06:39.547067 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/ea4c0956-80a0-434e-9483-d5c467053b32-util\") pod \"5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed7382lfg\" (UID: \"ea4c0956-80a0-434e-9483-d5c467053b32\") " pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed7382lfg" Jul 13 03:06:39.547214 ip-10-0-134-52 kubenswrapper[2558]: I0713 03:06:39.547162 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/f3527e90-e5fa-4bc8-b215-57dcde6593d3-console-serving-cert\") pod \"console-5bbc889ccd-k7sfh\" (UID: \"f3527e90-e5fa-4bc8-b215-57dcde6593d3\") " pod="openshift-console/console-5bbc889ccd-k7sfh" Jul 13 03:06:39.547268 ip-10-0-134-52 kubenswrapper[2558]: I0713 03:06:39.547214 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-2n8vb\" (UniqueName: \"kubernetes.io/projected/f3527e90-e5fa-4bc8-b215-57dcde6593d3-kube-api-access-2n8vb\") pod \"console-5bbc889ccd-k7sfh\" (UID: \"f3527e90-e5fa-4bc8-b215-57dcde6593d3\") " pod="openshift-console/console-5bbc889ccd-k7sfh" Jul 13 03:06:39.547340 ip-10-0-134-52 kubenswrapper[2558]: I0713 03:06:39.547309 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/ea4c0956-80a0-434e-9483-d5c467053b32-bundle\") pod \"5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed7382lfg\" (UID: \"ea4c0956-80a0-434e-9483-d5c467053b32\") " pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed7382lfg" Jul 13 03:06:39.647961 ip-10-0-134-52 kubenswrapper[2558]: I0713 03:06:39.647935 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/ea4c0956-80a0-434e-9483-d5c467053b32-bundle\") pod \"5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed7382lfg\" (UID: \"ea4c0956-80a0-434e-9483-d5c467053b32\") " pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed7382lfg" Jul 13 03:06:39.648088 ip-10-0-134-52 kubenswrapper[2558]: I0713 03:06:39.647981 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/f3527e90-e5fa-4bc8-b215-57dcde6593d3-console-oauth-config\") pod \"console-5bbc889ccd-k7sfh\" (UID: \"f3527e90-e5fa-4bc8-b215-57dcde6593d3\") " pod="openshift-console/console-5bbc889ccd-k7sfh" Jul 13 03:06:39.648088 ip-10-0-134-52 kubenswrapper[2558]: I0713 03:06:39.648001 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/f3527e90-e5fa-4bc8-b215-57dcde6593d3-console-config\") pod \"console-5bbc889ccd-k7sfh\" (UID: \"f3527e90-e5fa-4bc8-b215-57dcde6593d3\") " pod="openshift-console/console-5bbc889ccd-k7sfh" Jul 13 03:06:39.648088 ip-10-0-134-52 kubenswrapper[2558]: I0713 03:06:39.648018 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/f3527e90-e5fa-4bc8-b215-57dcde6593d3-trusted-ca-bundle\") pod \"console-5bbc889ccd-k7sfh\" (UID: \"f3527e90-e5fa-4bc8-b215-57dcde6593d3\") " pod="openshift-console/console-5bbc889ccd-k7sfh" Jul 13 03:06:39.648088 ip-10-0-134-52 kubenswrapper[2558]: I0713 03:06:39.648040 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/f3527e90-e5fa-4bc8-b215-57dcde6593d3-oauth-serving-cert\") pod \"console-5bbc889ccd-k7sfh\" (UID: \"f3527e90-e5fa-4bc8-b215-57dcde6593d3\") " pod="openshift-console/console-5bbc889ccd-k7sfh" Jul 13 03:06:39.648088 ip-10-0-134-52 kubenswrapper[2558]: I0713 03:06:39.648063 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-qxt9l\" (UniqueName: \"kubernetes.io/projected/ea4c0956-80a0-434e-9483-d5c467053b32-kube-api-access-qxt9l\") pod \"5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed7382lfg\" (UID: \"ea4c0956-80a0-434e-9483-d5c467053b32\") " pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed7382lfg" Jul 13 03:06:39.648088 ip-10-0-134-52 kubenswrapper[2558]: I0713 03:06:39.648086 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/f3527e90-e5fa-4bc8-b215-57dcde6593d3-service-ca\") pod \"console-5bbc889ccd-k7sfh\" (UID: \"f3527e90-e5fa-4bc8-b215-57dcde6593d3\") " pod="openshift-console/console-5bbc889ccd-k7sfh" Jul 13 03:06:39.648928 ip-10-0-134-52 kubenswrapper[2558]: I0713 03:06:39.648119 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/ea4c0956-80a0-434e-9483-d5c467053b32-util\") pod \"5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed7382lfg\" (UID: \"ea4c0956-80a0-434e-9483-d5c467053b32\") " pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed7382lfg" Jul 13 03:06:39.648928 ip-10-0-134-52 kubenswrapper[2558]: I0713 03:06:39.648197 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/f3527e90-e5fa-4bc8-b215-57dcde6593d3-console-serving-cert\") pod \"console-5bbc889ccd-k7sfh\" (UID: \"f3527e90-e5fa-4bc8-b215-57dcde6593d3\") " pod="openshift-console/console-5bbc889ccd-k7sfh" Jul 13 03:06:39.648928 ip-10-0-134-52 kubenswrapper[2558]: I0713 03:06:39.648240 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-2n8vb\" (UniqueName: \"kubernetes.io/projected/f3527e90-e5fa-4bc8-b215-57dcde6593d3-kube-api-access-2n8vb\") pod \"console-5bbc889ccd-k7sfh\" (UID: \"f3527e90-e5fa-4bc8-b215-57dcde6593d3\") " pod="openshift-console/console-5bbc889ccd-k7sfh" Jul 13 03:06:39.648928 ip-10-0-134-52 kubenswrapper[2558]: I0713 03:06:39.648316 2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/ea4c0956-80a0-434e-9483-d5c467053b32-bundle\") pod \"5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed7382lfg\" (UID: \"ea4c0956-80a0-434e-9483-d5c467053b32\") " pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed7382lfg" Jul 13 03:06:39.648928 ip-10-0-134-52 kubenswrapper[2558]: I0713 03:06:39.648708 2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/ea4c0956-80a0-434e-9483-d5c467053b32-util\") pod \"5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed7382lfg\" (UID: \"ea4c0956-80a0-434e-9483-d5c467053b32\") " pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed7382lfg" Jul 13 03:06:39.648928 ip-10-0-134-52 kubenswrapper[2558]: I0713 03:06:39.648778 2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/f3527e90-e5fa-4bc8-b215-57dcde6593d3-console-config\") pod \"console-5bbc889ccd-k7sfh\" (UID: \"f3527e90-e5fa-4bc8-b215-57dcde6593d3\") " pod="openshift-console/console-5bbc889ccd-k7sfh" Jul 13 03:06:39.648928 ip-10-0-134-52 kubenswrapper[2558]: I0713 03:06:39.648844 2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/f3527e90-e5fa-4bc8-b215-57dcde6593d3-oauth-serving-cert\") pod \"console-5bbc889ccd-k7sfh\" (UID: \"f3527e90-e5fa-4bc8-b215-57dcde6593d3\") " pod="openshift-console/console-5bbc889ccd-k7sfh" Jul 13 03:06:39.648928 ip-10-0-134-52 kubenswrapper[2558]: I0713 03:06:39.648871 2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/f3527e90-e5fa-4bc8-b215-57dcde6593d3-trusted-ca-bundle\") pod \"console-5bbc889ccd-k7sfh\" (UID: \"f3527e90-e5fa-4bc8-b215-57dcde6593d3\") " pod="openshift-console/console-5bbc889ccd-k7sfh" Jul 13 03:06:39.649392 ip-10-0-134-52 kubenswrapper[2558]: I0713 03:06:39.649048 2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/f3527e90-e5fa-4bc8-b215-57dcde6593d3-service-ca\") pod \"console-5bbc889ccd-k7sfh\" (UID: \"f3527e90-e5fa-4bc8-b215-57dcde6593d3\") " pod="openshift-console/console-5bbc889ccd-k7sfh" Jul 13 03:06:39.650563 ip-10-0-134-52 kubenswrapper[2558]: I0713 03:06:39.650545 2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/f3527e90-e5fa-4bc8-b215-57dcde6593d3-console-oauth-config\") pod \"console-5bbc889ccd-k7sfh\" (UID: \"f3527e90-e5fa-4bc8-b215-57dcde6593d3\") " pod="openshift-console/console-5bbc889ccd-k7sfh" Jul 13 03:06:39.650713 ip-10-0-134-52 kubenswrapper[2558]: I0713 03:06:39.650695 2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/f3527e90-e5fa-4bc8-b215-57dcde6593d3-console-serving-cert\") pod \"console-5bbc889ccd-k7sfh\" (UID: \"f3527e90-e5fa-4bc8-b215-57dcde6593d3\") " pod="openshift-console/console-5bbc889ccd-k7sfh" Jul 13 03:06:39.656178 ip-10-0-134-52 kubenswrapper[2558]: I0713 03:06:39.656157 2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-qxt9l\" (UniqueName: \"kubernetes.io/projected/ea4c0956-80a0-434e-9483-d5c467053b32-kube-api-access-qxt9l\") pod \"5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed7382lfg\" (UID: \"ea4c0956-80a0-434e-9483-d5c467053b32\") " pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed7382lfg" Jul 13 03:06:39.656759 ip-10-0-134-52 kubenswrapper[2558]: I0713 03:06:39.656741 2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-2n8vb\" (UniqueName: \"kubernetes.io/projected/f3527e90-e5fa-4bc8-b215-57dcde6593d3-kube-api-access-2n8vb\") pod \"console-5bbc889ccd-k7sfh\" (UID: \"f3527e90-e5fa-4bc8-b215-57dcde6593d3\") " pod="openshift-console/console-5bbc889ccd-k7sfh" Jul 13 03:06:39.768536 ip-10-0-134-52 kubenswrapper[2558]: I0713 03:06:39.768481 2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-5bbc889ccd-k7sfh" Jul 13 03:06:39.803204 ip-10-0-134-52 kubenswrapper[2558]: I0713 03:06:39.803181 2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed7382lfg" Jul 13 03:06:39.914469 ip-10-0-134-52 kubenswrapper[2558]: I0713 03:06:39.914448 2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-5bbc889ccd-k7sfh"] Jul 13 03:06:39.917477 ip-10-0-134-52 kubenswrapper[2558]: W0713 03:06:39.917446 2558 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podf3527e90_e5fa_4bc8_b215_57dcde6593d3.slice/crio-65a88e85302498233d8c17f86e02e0ac10d5b434cc64dbab23b0d148be38a345 WatchSource:0}: Error finding container 65a88e85302498233d8c17f86e02e0ac10d5b434cc64dbab23b0d148be38a345: Status 404 returned error can't find the container with id 65a88e85302498233d8c17f86e02e0ac10d5b434cc64dbab23b0d148be38a345 Jul 13 03:06:39.948433 ip-10-0-134-52 kubenswrapper[2558]: I0713 03:06:39.948409 2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed7382lfg"] Jul 13 03:06:39.949590 ip-10-0-134-52 kubenswrapper[2558]: W0713 03:06:39.949564 2558 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podea4c0956_80a0_434e_9483_d5c467053b32.slice/crio-4b8ea1dead0540d649aa4cbb62f64977b52b5c901dbdc7b4677a6cc2d41ae0c9 WatchSource:0}: Error finding container 4b8ea1dead0540d649aa4cbb62f64977b52b5c901dbdc7b4677a6cc2d41ae0c9: Status 404 returned error can't find the container with id 4b8ea1dead0540d649aa4cbb62f64977b52b5c901dbdc7b4677a6cc2d41ae0c9 Jul 13 03:06:40.449584 ip-10-0-134-52 kubenswrapper[2558]: I0713 03:06:40.449547 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-5bbc889ccd-k7sfh" event={"ID":"f3527e90-e5fa-4bc8-b215-57dcde6593d3","Type":"ContainerStarted","Data":"88a2012f74e9071663a7794e5778e0beff8229561aa816e5f9f5443481415974"} Jul 13 03:06:40.450005 ip-10-0-134-52 kubenswrapper[2558]: I0713 03:06:40.449607 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-5bbc889ccd-k7sfh" event={"ID":"f3527e90-e5fa-4bc8-b215-57dcde6593d3","Type":"ContainerStarted","Data":"65a88e85302498233d8c17f86e02e0ac10d5b434cc64dbab23b0d148be38a345"} Jul 13 03:06:40.451616 ip-10-0-134-52 kubenswrapper[2558]: I0713 03:06:40.451578 2558 generic.go:356] "Generic (PLEG): container finished" podID="28acb62f-1fa2-45fa-a2b8-dba00604a968" containerID="979775e389eb7a84e65eabf7da84303e1e8bc127ab4951ef15167cd4a1d1618a" exitCode=0 Jul 13 03:06:40.451776 ip-10-0-134-52 kubenswrapper[2558]: I0713 03:06:40.451632 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b7595s7h5" event={"ID":"28acb62f-1fa2-45fa-a2b8-dba00604a968","Type":"ContainerDied","Data":"979775e389eb7a84e65eabf7da84303e1e8bc127ab4951ef15167cd4a1d1618a"} Jul 13 03:06:40.453123 ip-10-0-134-52 kubenswrapper[2558]: I0713 03:06:40.453105 2558 generic.go:356] "Generic (PLEG): container finished" podID="ea4c0956-80a0-434e-9483-d5c467053b32" containerID="f92e7a0d47b1879aa3a786dd9dabd6b27e03895a498c6dd57244362c4c22556a" exitCode=0 Jul 13 03:06:40.453204 ip-10-0-134-52 kubenswrapper[2558]: I0713 03:06:40.453186 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed7382lfg" event={"ID":"ea4c0956-80a0-434e-9483-d5c467053b32","Type":"ContainerDied","Data":"f92e7a0d47b1879aa3a786dd9dabd6b27e03895a498c6dd57244362c4c22556a"} Jul 13 03:06:40.453254 ip-10-0-134-52 kubenswrapper[2558]: I0713 03:06:40.453236 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed7382lfg" event={"ID":"ea4c0956-80a0-434e-9483-d5c467053b32","Type":"ContainerStarted","Data":"4b8ea1dead0540d649aa4cbb62f64977b52b5c901dbdc7b4677a6cc2d41ae0c9"} Jul 13 03:06:40.454849 ip-10-0-134-52 kubenswrapper[2558]: I0713 03:06:40.454817 2558 generic.go:356] "Generic (PLEG): container finished" podID="31221317-a0bf-4d04-87f4-f7b179fc3fd6" containerID="51983404db76426720535f4c3a73dfd7c06f5b10cd54975b50c67de42ddcd036" exitCode=0 Jul 13 03:06:40.454942 ip-10-0-134-52 kubenswrapper[2558]: I0713 03:06:40.454848 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0xbh5q" event={"ID":"31221317-a0bf-4d04-87f4-f7b179fc3fd6","Type":"ContainerDied","Data":"51983404db76426720535f4c3a73dfd7c06f5b10cd54975b50c67de42ddcd036"} Jul 13 03:06:40.454942 ip-10-0-134-52 kubenswrapper[2558]: I0713 03:06:40.454893 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0xbh5q" event={"ID":"31221317-a0bf-4d04-87f4-f7b179fc3fd6","Type":"ContainerStarted","Data":"bc5a6e0fb6c1c965eb58c1d8d57d785021d8742d9c7605f0a218aeb77ed70117"} Jul 13 03:06:40.469147 ip-10-0-134-52 kubenswrapper[2558]: I0713 03:06:40.469106 2558 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console/console-5bbc889ccd-k7sfh" podStartSLOduration=1.469092912 podStartE2EDuration="1.469092912s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-13 03:06:39 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-13 03:06:40.467444086 +0000 UTC m=+582.868044555" watchObservedRunningTime="2026-07-13 03:06:40.469092912 +0000 UTC m=+582.869693378" Jul 13 03:06:41.463460 ip-10-0-134-52 kubenswrapper[2558]: I0713 03:06:41.463432 2558 generic.go:356] "Generic (PLEG): container finished" podID="31221317-a0bf-4d04-87f4-f7b179fc3fd6" containerID="67877754d3afd1b161d66cf12a48eabdea995ea1d84fac7531432d4652809dff" exitCode=0 Jul 13 03:06:41.463801 ip-10-0-134-52 kubenswrapper[2558]: I0713 03:06:41.463523 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0xbh5q" event={"ID":"31221317-a0bf-4d04-87f4-f7b179fc3fd6","Type":"ContainerDied","Data":"67877754d3afd1b161d66cf12a48eabdea995ea1d84fac7531432d4652809dff"} Jul 13 03:06:41.465365 ip-10-0-134-52 kubenswrapper[2558]: I0713 03:06:41.465324 2558 generic.go:356] "Generic (PLEG): container finished" podID="7e5a7536-75c8-40fb-b87a-1f700b719d2b" containerID="bead9ca299042deee4e42021cc271d9f70c159e6d0c81a8ff7026a0a2eaad939" exitCode=0 Jul 13 03:06:41.465476 ip-10-0-134-52 kubenswrapper[2558]: I0713 03:06:41.465365 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1kgdxq" event={"ID":"7e5a7536-75c8-40fb-b87a-1f700b719d2b","Type":"ContainerDied","Data":"bead9ca299042deee4e42021cc271d9f70c159e6d0c81a8ff7026a0a2eaad939"} Jul 13 03:06:41.467550 ip-10-0-134-52 kubenswrapper[2558]: I0713 03:06:41.467527 2558 generic.go:356] "Generic (PLEG): container finished" podID="28acb62f-1fa2-45fa-a2b8-dba00604a968" containerID="686217ce0a9961772d90f4087a8ce274c746858a656a770f1ae219b65446a8a4" exitCode=0 Jul 13 03:06:41.467629 ip-10-0-134-52 kubenswrapper[2558]: I0713 03:06:41.467602 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b7595s7h5" event={"ID":"28acb62f-1fa2-45fa-a2b8-dba00604a968","Type":"ContainerDied","Data":"686217ce0a9961772d90f4087a8ce274c746858a656a770f1ae219b65446a8a4"} Jul 13 03:06:41.469481 ip-10-0-134-52 kubenswrapper[2558]: I0713 03:06:41.469458 2558 generic.go:356] "Generic (PLEG): container finished" podID="ea4c0956-80a0-434e-9483-d5c467053b32" containerID="bbea01f7460f640942bd28521a73c45b72777c01f495e6d0f08782d5bfb48697" exitCode=0 Jul 13 03:06:41.469562 ip-10-0-134-52 kubenswrapper[2558]: I0713 03:06:41.469524 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed7382lfg" event={"ID":"ea4c0956-80a0-434e-9483-d5c467053b32","Type":"ContainerDied","Data":"bbea01f7460f640942bd28521a73c45b72777c01f495e6d0f08782d5bfb48697"} Jul 13 03:06:42.476938 ip-10-0-134-52 kubenswrapper[2558]: I0713 03:06:42.476907 2558 generic.go:356] "Generic (PLEG): container finished" podID="ea4c0956-80a0-434e-9483-d5c467053b32" containerID="204f5adecb5d73d53780e93540b6448933044248b29e4ff0f6b89c3d86841068" exitCode=0 Jul 13 03:06:42.477323 ip-10-0-134-52 kubenswrapper[2558]: I0713 03:06:42.476995 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed7382lfg" event={"ID":"ea4c0956-80a0-434e-9483-d5c467053b32","Type":"ContainerDied","Data":"204f5adecb5d73d53780e93540b6448933044248b29e4ff0f6b89c3d86841068"} Jul 13 03:06:42.479081 ip-10-0-134-52 kubenswrapper[2558]: I0713 03:06:42.479059 2558 generic.go:356] "Generic (PLEG): container finished" podID="31221317-a0bf-4d04-87f4-f7b179fc3fd6" containerID="875b8c1ed780cd4e3a9da561307bc779af841d579ca6a610aaf263728238484c" exitCode=0 Jul 13 03:06:42.479191 ip-10-0-134-52 kubenswrapper[2558]: I0713 03:06:42.479143 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0xbh5q" event={"ID":"31221317-a0bf-4d04-87f4-f7b179fc3fd6","Type":"ContainerDied","Data":"875b8c1ed780cd4e3a9da561307bc779af841d579ca6a610aaf263728238484c"} Jul 13 03:06:42.481097 ip-10-0-134-52 kubenswrapper[2558]: I0713 03:06:42.481068 2558 generic.go:356] "Generic (PLEG): container finished" podID="7e5a7536-75c8-40fb-b87a-1f700b719d2b" containerID="b78099ef8eac7c40f6256908b5e832a51e31f393dcd1541bbd44e1bfe754e749" exitCode=0 Jul 13 03:06:42.481199 ip-10-0-134-52 kubenswrapper[2558]: I0713 03:06:42.481131 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1kgdxq" event={"ID":"7e5a7536-75c8-40fb-b87a-1f700b719d2b","Type":"ContainerDied","Data":"b78099ef8eac7c40f6256908b5e832a51e31f393dcd1541bbd44e1bfe754e749"} Jul 13 03:06:42.618087 ip-10-0-134-52 kubenswrapper[2558]: I0713 03:06:42.618063 2558 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b7595s7h5" Jul 13 03:06:42.675806 ip-10-0-134-52 kubenswrapper[2558]: I0713 03:06:42.675780 2558 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-m68wc\" (UniqueName: \"kubernetes.io/projected/28acb62f-1fa2-45fa-a2b8-dba00604a968-kube-api-access-m68wc\") pod \"28acb62f-1fa2-45fa-a2b8-dba00604a968\" (UID: \"28acb62f-1fa2-45fa-a2b8-dba00604a968\") " Jul 13 03:06:42.675914 ip-10-0-134-52 kubenswrapper[2558]: I0713 03:06:42.675829 2558 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/28acb62f-1fa2-45fa-a2b8-dba00604a968-bundle\") pod \"28acb62f-1fa2-45fa-a2b8-dba00604a968\" (UID: \"28acb62f-1fa2-45fa-a2b8-dba00604a968\") " Jul 13 03:06:42.675914 ip-10-0-134-52 kubenswrapper[2558]: I0713 03:06:42.675889 2558 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/28acb62f-1fa2-45fa-a2b8-dba00604a968-util\") pod \"28acb62f-1fa2-45fa-a2b8-dba00604a968\" (UID: \"28acb62f-1fa2-45fa-a2b8-dba00604a968\") " Jul 13 03:06:42.676349 ip-10-0-134-52 kubenswrapper[2558]: I0713 03:06:42.676308 2558 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/28acb62f-1fa2-45fa-a2b8-dba00604a968-bundle" (OuterVolumeSpecName: "bundle") pod "28acb62f-1fa2-45fa-a2b8-dba00604a968" (UID: "28acb62f-1fa2-45fa-a2b8-dba00604a968"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 13 03:06:42.677875 ip-10-0-134-52 kubenswrapper[2558]: I0713 03:06:42.677845 2558 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/28acb62f-1fa2-45fa-a2b8-dba00604a968-kube-api-access-m68wc" (OuterVolumeSpecName: "kube-api-access-m68wc") pod "28acb62f-1fa2-45fa-a2b8-dba00604a968" (UID: "28acb62f-1fa2-45fa-a2b8-dba00604a968"). InnerVolumeSpecName "kube-api-access-m68wc". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 13 03:06:42.683904 ip-10-0-134-52 kubenswrapper[2558]: I0713 03:06:42.683880 2558 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/28acb62f-1fa2-45fa-a2b8-dba00604a968-util" (OuterVolumeSpecName: "util") pod "28acb62f-1fa2-45fa-a2b8-dba00604a968" (UID: "28acb62f-1fa2-45fa-a2b8-dba00604a968"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 13 03:06:42.777410 ip-10-0-134-52 kubenswrapper[2558]: I0713 03:06:42.777386 2558 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-m68wc\" (UniqueName: \"kubernetes.io/projected/28acb62f-1fa2-45fa-a2b8-dba00604a968-kube-api-access-m68wc\") on node \"ip-10-0-134-52.ec2.internal\" DevicePath \"\"" Jul 13 03:06:42.777410 ip-10-0-134-52 kubenswrapper[2558]: I0713 03:06:42.777405 2558 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/28acb62f-1fa2-45fa-a2b8-dba00604a968-bundle\") on node \"ip-10-0-134-52.ec2.internal\" DevicePath \"\"" Jul 13 03:06:42.777410 ip-10-0-134-52 kubenswrapper[2558]: I0713 03:06:42.777415 2558 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/28acb62f-1fa2-45fa-a2b8-dba00604a968-util\") on node \"ip-10-0-134-52.ec2.internal\" DevicePath \"\"" Jul 13 03:06:43.488147 ip-10-0-134-52 kubenswrapper[2558]: I0713 03:06:43.488118 2558 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b7595s7h5" Jul 13 03:06:43.488514 ip-10-0-134-52 kubenswrapper[2558]: I0713 03:06:43.488156 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b7595s7h5" event={"ID":"28acb62f-1fa2-45fa-a2b8-dba00604a968","Type":"ContainerDied","Data":"d5c5986e93eeb5338525faf8e032e05b00c44ffad70f824a07600e36bd6b6be7"} Jul 13 03:06:43.488514 ip-10-0-134-52 kubenswrapper[2558]: I0713 03:06:43.488187 2558 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="d5c5986e93eeb5338525faf8e032e05b00c44ffad70f824a07600e36bd6b6be7" Jul 13 03:06:43.633307 ip-10-0-134-52 kubenswrapper[2558]: I0713 03:06:43.633287 2558 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0xbh5q" Jul 13 03:06:43.670660 ip-10-0-134-52 kubenswrapper[2558]: I0713 03:06:43.670628 2558 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1kgdxq" Jul 13 03:06:43.673611 ip-10-0-134-52 kubenswrapper[2558]: I0713 03:06:43.673593 2558 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed7382lfg" Jul 13 03:06:43.684193 ip-10-0-134-52 kubenswrapper[2558]: I0713 03:06:43.684175 2558 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/31221317-a0bf-4d04-87f4-f7b179fc3fd6-util\") pod \"31221317-a0bf-4d04-87f4-f7b179fc3fd6\" (UID: \"31221317-a0bf-4d04-87f4-f7b179fc3fd6\") " Jul 13 03:06:43.684264 ip-10-0-134-52 kubenswrapper[2558]: I0713 03:06:43.684213 2558 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/31221317-a0bf-4d04-87f4-f7b179fc3fd6-bundle\") pod \"31221317-a0bf-4d04-87f4-f7b179fc3fd6\" (UID: \"31221317-a0bf-4d04-87f4-f7b179fc3fd6\") " Jul 13 03:06:43.684264 ip-10-0-134-52 kubenswrapper[2558]: I0713 03:06:43.684254 2558 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-zpllh\" (UniqueName: \"kubernetes.io/projected/31221317-a0bf-4d04-87f4-f7b179fc3fd6-kube-api-access-zpllh\") pod \"31221317-a0bf-4d04-87f4-f7b179fc3fd6\" (UID: \"31221317-a0bf-4d04-87f4-f7b179fc3fd6\") " Jul 13 03:06:43.684640 ip-10-0-134-52 kubenswrapper[2558]: I0713 03:06:43.684620 2558 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/31221317-a0bf-4d04-87f4-f7b179fc3fd6-bundle" (OuterVolumeSpecName: "bundle") pod "31221317-a0bf-4d04-87f4-f7b179fc3fd6" (UID: "31221317-a0bf-4d04-87f4-f7b179fc3fd6"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 13 03:06:43.686304 ip-10-0-134-52 kubenswrapper[2558]: I0713 03:06:43.686285 2558 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/31221317-a0bf-4d04-87f4-f7b179fc3fd6-kube-api-access-zpllh" (OuterVolumeSpecName: "kube-api-access-zpllh") pod "31221317-a0bf-4d04-87f4-f7b179fc3fd6" (UID: "31221317-a0bf-4d04-87f4-f7b179fc3fd6"). InnerVolumeSpecName "kube-api-access-zpllh". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 13 03:06:43.690381 ip-10-0-134-52 kubenswrapper[2558]: I0713 03:06:43.690356 2558 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/31221317-a0bf-4d04-87f4-f7b179fc3fd6-util" (OuterVolumeSpecName: "util") pod "31221317-a0bf-4d04-87f4-f7b179fc3fd6" (UID: "31221317-a0bf-4d04-87f4-f7b179fc3fd6"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 13 03:06:43.785931 ip-10-0-134-52 kubenswrapper[2558]: I0713 03:06:43.785863 2558 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/7e5a7536-75c8-40fb-b87a-1f700b719d2b-bundle\") pod \"7e5a7536-75c8-40fb-b87a-1f700b719d2b\" (UID: \"7e5a7536-75c8-40fb-b87a-1f700b719d2b\") " Jul 13 03:06:43.785931 ip-10-0-134-52 kubenswrapper[2558]: I0713 03:06:43.785907 2558 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/7e5a7536-75c8-40fb-b87a-1f700b719d2b-util\") pod \"7e5a7536-75c8-40fb-b87a-1f700b719d2b\" (UID: \"7e5a7536-75c8-40fb-b87a-1f700b719d2b\") " Jul 13 03:06:43.785931 ip-10-0-134-52 kubenswrapper[2558]: I0713 03:06:43.785928 2558 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-k6rmh\" (UniqueName: \"kubernetes.io/projected/7e5a7536-75c8-40fb-b87a-1f700b719d2b-kube-api-access-k6rmh\") pod \"7e5a7536-75c8-40fb-b87a-1f700b719d2b\" (UID: \"7e5a7536-75c8-40fb-b87a-1f700b719d2b\") " Jul 13 03:06:43.786177 ip-10-0-134-52 kubenswrapper[2558]: I0713 03:06:43.785956 2558 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/ea4c0956-80a0-434e-9483-d5c467053b32-util\") pod \"ea4c0956-80a0-434e-9483-d5c467053b32\" (UID: \"ea4c0956-80a0-434e-9483-d5c467053b32\") " Jul 13 03:06:43.786177 ip-10-0-134-52 kubenswrapper[2558]: I0713 03:06:43.785975 2558 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-qxt9l\" (UniqueName: \"kubernetes.io/projected/ea4c0956-80a0-434e-9483-d5c467053b32-kube-api-access-qxt9l\") pod \"ea4c0956-80a0-434e-9483-d5c467053b32\" (UID: \"ea4c0956-80a0-434e-9483-d5c467053b32\") " Jul 13 03:06:43.786177 ip-10-0-134-52 kubenswrapper[2558]: I0713 03:06:43.786001 2558 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/ea4c0956-80a0-434e-9483-d5c467053b32-bundle\") pod \"ea4c0956-80a0-434e-9483-d5c467053b32\" (UID: \"ea4c0956-80a0-434e-9483-d5c467053b32\") " Jul 13 03:06:43.786320 ip-10-0-134-52 kubenswrapper[2558]: I0713 03:06:43.786197 2558 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/31221317-a0bf-4d04-87f4-f7b179fc3fd6-bundle\") on node \"ip-10-0-134-52.ec2.internal\" DevicePath \"\"" Jul 13 03:06:43.786320 ip-10-0-134-52 kubenswrapper[2558]: I0713 03:06:43.786215 2558 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-zpllh\" (UniqueName: \"kubernetes.io/projected/31221317-a0bf-4d04-87f4-f7b179fc3fd6-kube-api-access-zpllh\") on node \"ip-10-0-134-52.ec2.internal\" DevicePath \"\"" Jul 13 03:06:43.786320 ip-10-0-134-52 kubenswrapper[2558]: I0713 03:06:43.786230 2558 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/31221317-a0bf-4d04-87f4-f7b179fc3fd6-util\") on node \"ip-10-0-134-52.ec2.internal\" DevicePath \"\"" Jul 13 03:06:43.786575 ip-10-0-134-52 kubenswrapper[2558]: I0713 03:06:43.786549 2558 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/7e5a7536-75c8-40fb-b87a-1f700b719d2b-bundle" (OuterVolumeSpecName: "bundle") pod "7e5a7536-75c8-40fb-b87a-1f700b719d2b" (UID: "7e5a7536-75c8-40fb-b87a-1f700b719d2b"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 13 03:06:43.787030 ip-10-0-134-52 kubenswrapper[2558]: I0713 03:06:43.787002 2558 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/ea4c0956-80a0-434e-9483-d5c467053b32-bundle" (OuterVolumeSpecName: "bundle") pod "ea4c0956-80a0-434e-9483-d5c467053b32" (UID: "ea4c0956-80a0-434e-9483-d5c467053b32"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 13 03:06:43.788234 ip-10-0-134-52 kubenswrapper[2558]: I0713 03:06:43.788210 2558 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/ea4c0956-80a0-434e-9483-d5c467053b32-kube-api-access-qxt9l" (OuterVolumeSpecName: "kube-api-access-qxt9l") pod "ea4c0956-80a0-434e-9483-d5c467053b32" (UID: "ea4c0956-80a0-434e-9483-d5c467053b32"). InnerVolumeSpecName "kube-api-access-qxt9l". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 13 03:06:43.788320 ip-10-0-134-52 kubenswrapper[2558]: I0713 03:06:43.788253 2558 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/7e5a7536-75c8-40fb-b87a-1f700b719d2b-kube-api-access-k6rmh" (OuterVolumeSpecName: "kube-api-access-k6rmh") pod "7e5a7536-75c8-40fb-b87a-1f700b719d2b" (UID: "7e5a7536-75c8-40fb-b87a-1f700b719d2b"). InnerVolumeSpecName "kube-api-access-k6rmh". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 13 03:06:43.794636 ip-10-0-134-52 kubenswrapper[2558]: I0713 03:06:43.794612 2558 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/7e5a7536-75c8-40fb-b87a-1f700b719d2b-util" (OuterVolumeSpecName: "util") pod "7e5a7536-75c8-40fb-b87a-1f700b719d2b" (UID: "7e5a7536-75c8-40fb-b87a-1f700b719d2b"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 13 03:06:43.794999 ip-10-0-134-52 kubenswrapper[2558]: I0713 03:06:43.794984 2558 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/ea4c0956-80a0-434e-9483-d5c467053b32-util" (OuterVolumeSpecName: "util") pod "ea4c0956-80a0-434e-9483-d5c467053b32" (UID: "ea4c0956-80a0-434e-9483-d5c467053b32"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 13 03:06:43.887305 ip-10-0-134-52 kubenswrapper[2558]: I0713 03:06:43.887279 2558 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/7e5a7536-75c8-40fb-b87a-1f700b719d2b-util\") on node \"ip-10-0-134-52.ec2.internal\" DevicePath \"\"" Jul 13 03:06:43.887305 ip-10-0-134-52 kubenswrapper[2558]: I0713 03:06:43.887301 2558 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-k6rmh\" (UniqueName: \"kubernetes.io/projected/7e5a7536-75c8-40fb-b87a-1f700b719d2b-kube-api-access-k6rmh\") on node \"ip-10-0-134-52.ec2.internal\" DevicePath \"\"" Jul 13 03:06:43.887437 ip-10-0-134-52 kubenswrapper[2558]: I0713 03:06:43.887311 2558 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/ea4c0956-80a0-434e-9483-d5c467053b32-util\") on node \"ip-10-0-134-52.ec2.internal\" DevicePath \"\"" Jul 13 03:06:43.887437 ip-10-0-134-52 kubenswrapper[2558]: I0713 03:06:43.887319 2558 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-qxt9l\" (UniqueName: \"kubernetes.io/projected/ea4c0956-80a0-434e-9483-d5c467053b32-kube-api-access-qxt9l\") on node \"ip-10-0-134-52.ec2.internal\" DevicePath \"\"" Jul 13 03:06:43.887437 ip-10-0-134-52 kubenswrapper[2558]: I0713 03:06:43.887349 2558 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/ea4c0956-80a0-434e-9483-d5c467053b32-bundle\") on node \"ip-10-0-134-52.ec2.internal\" DevicePath \"\"" Jul 13 03:06:43.887437 ip-10-0-134-52 kubenswrapper[2558]: I0713 03:06:43.887362 2558 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/7e5a7536-75c8-40fb-b87a-1f700b719d2b-bundle\") on node \"ip-10-0-134-52.ec2.internal\" DevicePath \"\"" Jul 13 03:06:44.495139 ip-10-0-134-52 kubenswrapper[2558]: I0713 03:06:44.495065 2558 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0xbh5q" Jul 13 03:06:44.495139 ip-10-0-134-52 kubenswrapper[2558]: I0713 03:06:44.495072 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0xbh5q" event={"ID":"31221317-a0bf-4d04-87f4-f7b179fc3fd6","Type":"ContainerDied","Data":"bc5a6e0fb6c1c965eb58c1d8d57d785021d8742d9c7605f0a218aeb77ed70117"} Jul 13 03:06:44.495562 ip-10-0-134-52 kubenswrapper[2558]: I0713 03:06:44.495152 2558 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="bc5a6e0fb6c1c965eb58c1d8d57d785021d8742d9c7605f0a218aeb77ed70117" Jul 13 03:06:44.497128 ip-10-0-134-52 kubenswrapper[2558]: I0713 03:06:44.497064 2558 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1kgdxq" Jul 13 03:06:44.497128 ip-10-0-134-52 kubenswrapper[2558]: I0713 03:06:44.497097 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1kgdxq" event={"ID":"7e5a7536-75c8-40fb-b87a-1f700b719d2b","Type":"ContainerDied","Data":"c30f482199960a5afbdbb6e353e40c6c4c68917d5da8c3841f59e50c5ee485ae"} Jul 13 03:06:44.497384 ip-10-0-134-52 kubenswrapper[2558]: I0713 03:06:44.497137 2558 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="c30f482199960a5afbdbb6e353e40c6c4c68917d5da8c3841f59e50c5ee485ae" Jul 13 03:06:44.499404 ip-10-0-134-52 kubenswrapper[2558]: I0713 03:06:44.499371 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed7382lfg" event={"ID":"ea4c0956-80a0-434e-9483-d5c467053b32","Type":"ContainerDied","Data":"4b8ea1dead0540d649aa4cbb62f64977b52b5c901dbdc7b4677a6cc2d41ae0c9"} Jul 13 03:06:44.499404 ip-10-0-134-52 kubenswrapper[2558]: I0713 03:06:44.499406 2558 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="4b8ea1dead0540d649aa4cbb62f64977b52b5c901dbdc7b4677a6cc2d41ae0c9" Jul 13 03:06:44.499535 ip-10-0-134-52 kubenswrapper[2558]: I0713 03:06:44.499502 2558 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed7382lfg" Jul 13 03:06:49.769010 ip-10-0-134-52 kubenswrapper[2558]: I0713 03:06:49.768979 2558 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/console-5bbc889ccd-k7sfh" Jul 13 03:06:49.769495 ip-10-0-134-52 kubenswrapper[2558]: I0713 03:06:49.769030 2558 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-console/console-5bbc889ccd-k7sfh" Jul 13 03:06:49.773450 ip-10-0-134-52 kubenswrapper[2558]: I0713 03:06:49.773426 2558 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-console/console-5bbc889ccd-k7sfh" Jul 13 03:06:50.532817 ip-10-0-134-52 kubenswrapper[2558]: I0713 03:06:50.532776 2558 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console/console-5bbc889ccd-k7sfh" Jul 13 03:06:50.599899 ip-10-0-134-52 kubenswrapper[2558]: I0713 03:06:50.599867 2558 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-69dbcf8cc8-l28dx"] Jul 13 03:06:55.954878 ip-10-0-134-52 kubenswrapper[2558]: I0713 03:06:55.954841 2558 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-h6hrb"] Jul 13 03:06:55.955399 ip-10-0-134-52 kubenswrapper[2558]: I0713 03:06:55.955202 2558 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="ea4c0956-80a0-434e-9483-d5c467053b32" containerName="util" Jul 13 03:06:55.955399 ip-10-0-134-52 kubenswrapper[2558]: I0713 03:06:55.955213 2558 state_mem.go:107] "Deleted CPUSet assignment" podUID="ea4c0956-80a0-434e-9483-d5c467053b32" containerName="util" Jul 13 03:06:55.955399 ip-10-0-134-52 kubenswrapper[2558]: I0713 03:06:55.955221 2558 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="ea4c0956-80a0-434e-9483-d5c467053b32" containerName="pull" Jul 13 03:06:55.955399 ip-10-0-134-52 kubenswrapper[2558]: I0713 03:06:55.955226 2558 state_mem.go:107] "Deleted CPUSet assignment" podUID="ea4c0956-80a0-434e-9483-d5c467053b32" containerName="pull" Jul 13 03:06:55.955399 ip-10-0-134-52 kubenswrapper[2558]: I0713 03:06:55.955236 2558 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="28acb62f-1fa2-45fa-a2b8-dba00604a968" containerName="util" Jul 13 03:06:55.955399 ip-10-0-134-52 kubenswrapper[2558]: I0713 03:06:55.955242 2558 state_mem.go:107] "Deleted CPUSet assignment" podUID="28acb62f-1fa2-45fa-a2b8-dba00604a968" containerName="util" Jul 13 03:06:55.955399 ip-10-0-134-52 kubenswrapper[2558]: I0713 03:06:55.955249 2558 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="7e5a7536-75c8-40fb-b87a-1f700b719d2b" containerName="pull" Jul 13 03:06:55.955399 ip-10-0-134-52 kubenswrapper[2558]: I0713 03:06:55.955254 2558 state_mem.go:107] "Deleted CPUSet assignment" podUID="7e5a7536-75c8-40fb-b87a-1f700b719d2b" containerName="pull" Jul 13 03:06:55.955399 ip-10-0-134-52 kubenswrapper[2558]: I0713 03:06:55.955265 2558 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="ea4c0956-80a0-434e-9483-d5c467053b32" containerName="extract" Jul 13 03:06:55.955399 ip-10-0-134-52 kubenswrapper[2558]: I0713 03:06:55.955269 2558 state_mem.go:107] "Deleted CPUSet assignment" podUID="ea4c0956-80a0-434e-9483-d5c467053b32" containerName="extract" Jul 13 03:06:55.955399 ip-10-0-134-52 kubenswrapper[2558]: I0713 03:06:55.955275 2558 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="7e5a7536-75c8-40fb-b87a-1f700b719d2b" containerName="extract" Jul 13 03:06:55.955399 ip-10-0-134-52 kubenswrapper[2558]: I0713 03:06:55.955281 2558 state_mem.go:107] "Deleted CPUSet assignment" podUID="7e5a7536-75c8-40fb-b87a-1f700b719d2b" containerName="extract" Jul 13 03:06:55.955399 ip-10-0-134-52 kubenswrapper[2558]: I0713 03:06:55.955286 2558 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="31221317-a0bf-4d04-87f4-f7b179fc3fd6" containerName="extract" Jul 13 03:06:55.955399 ip-10-0-134-52 kubenswrapper[2558]: I0713 03:06:55.955292 2558 state_mem.go:107] "Deleted CPUSet assignment" podUID="31221317-a0bf-4d04-87f4-f7b179fc3fd6" containerName="extract" Jul 13 03:06:55.955399 ip-10-0-134-52 kubenswrapper[2558]: I0713 03:06:55.955300 2558 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="31221317-a0bf-4d04-87f4-f7b179fc3fd6" containerName="util" Jul 13 03:06:55.955399 ip-10-0-134-52 kubenswrapper[2558]: I0713 03:06:55.955306 2558 state_mem.go:107] "Deleted CPUSet assignment" podUID="31221317-a0bf-4d04-87f4-f7b179fc3fd6" containerName="util" Jul 13 03:06:55.955399 ip-10-0-134-52 kubenswrapper[2558]: I0713 03:06:55.955317 2558 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="7e5a7536-75c8-40fb-b87a-1f700b719d2b" containerName="util" Jul 13 03:06:55.955399 ip-10-0-134-52 kubenswrapper[2558]: I0713 03:06:55.955322 2558 state_mem.go:107] "Deleted CPUSet assignment" podUID="7e5a7536-75c8-40fb-b87a-1f700b719d2b" containerName="util" Jul 13 03:06:55.955399 ip-10-0-134-52 kubenswrapper[2558]: I0713 03:06:55.955348 2558 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="28acb62f-1fa2-45fa-a2b8-dba00604a968" containerName="pull" Jul 13 03:06:55.955399 ip-10-0-134-52 kubenswrapper[2558]: I0713 03:06:55.955353 2558 state_mem.go:107] "Deleted CPUSet assignment" podUID="28acb62f-1fa2-45fa-a2b8-dba00604a968" containerName="pull" Jul 13 03:06:55.955399 ip-10-0-134-52 kubenswrapper[2558]: I0713 03:06:55.955360 2558 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="28acb62f-1fa2-45fa-a2b8-dba00604a968" containerName="extract" Jul 13 03:06:55.955399 ip-10-0-134-52 kubenswrapper[2558]: I0713 03:06:55.955365 2558 state_mem.go:107] "Deleted CPUSet assignment" podUID="28acb62f-1fa2-45fa-a2b8-dba00604a968" containerName="extract" Jul 13 03:06:55.955399 ip-10-0-134-52 kubenswrapper[2558]: I0713 03:06:55.955373 2558 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="31221317-a0bf-4d04-87f4-f7b179fc3fd6" containerName="pull" Jul 13 03:06:55.955399 ip-10-0-134-52 kubenswrapper[2558]: I0713 03:06:55.955378 2558 state_mem.go:107] "Deleted CPUSet assignment" podUID="31221317-a0bf-4d04-87f4-f7b179fc3fd6" containerName="pull" Jul 13 03:06:55.956189 ip-10-0-134-52 kubenswrapper[2558]: I0713 03:06:55.955430 2558 memory_manager.go:368] "RemoveStaleState removing state" podUID="31221317-a0bf-4d04-87f4-f7b179fc3fd6" containerName="extract" Jul 13 03:06:55.956189 ip-10-0-134-52 kubenswrapper[2558]: I0713 03:06:55.955439 2558 memory_manager.go:368] "RemoveStaleState removing state" podUID="7e5a7536-75c8-40fb-b87a-1f700b719d2b" containerName="extract" Jul 13 03:06:55.956189 ip-10-0-134-52 kubenswrapper[2558]: I0713 03:06:55.955445 2558 memory_manager.go:368] "RemoveStaleState removing state" podUID="28acb62f-1fa2-45fa-a2b8-dba00604a968" containerName="extract" Jul 13 03:06:55.956189 ip-10-0-134-52 kubenswrapper[2558]: I0713 03:06:55.955453 2558 memory_manager.go:368] "RemoveStaleState removing state" podUID="ea4c0956-80a0-434e-9483-d5c467053b32" containerName="extract" Jul 13 03:06:55.962739 ip-10-0-134-52 kubenswrapper[2558]: I0713 03:06:55.962719 2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-h6hrb" Jul 13 03:06:55.965542 ip-10-0-134-52 kubenswrapper[2558]: I0713 03:06:55.965523 2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"kuadrant-operator-controller-manager-dockercfg-kjmrl\"" Jul 13 03:06:55.969761 ip-10-0-134-52 kubenswrapper[2558]: I0713 03:06:55.969739 2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-h6hrb"] Jul 13 03:06:56.076715 ip-10-0-134-52 kubenswrapper[2558]: I0713 03:06:56.076682 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/b6cc5a03-94da-4277-91d3-61060c28e237-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-8684c9ff49-h6hrb\" (UID: \"b6cc5a03-94da-4277-91d3-61060c28e237\") " pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-h6hrb" Jul 13 03:06:56.076885 ip-10-0-134-52 kubenswrapper[2558]: I0713 03:06:56.076735 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-xcr9b\" (UniqueName: \"kubernetes.io/projected/b6cc5a03-94da-4277-91d3-61060c28e237-kube-api-access-xcr9b\") pod \"kuadrant-operator-controller-manager-8684c9ff49-h6hrb\" (UID: \"b6cc5a03-94da-4277-91d3-61060c28e237\") " pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-h6hrb" Jul 13 03:06:56.177818 ip-10-0-134-52 kubenswrapper[2558]: I0713 03:06:56.177781 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-xcr9b\" (UniqueName: \"kubernetes.io/projected/b6cc5a03-94da-4277-91d3-61060c28e237-kube-api-access-xcr9b\") pod \"kuadrant-operator-controller-manager-8684c9ff49-h6hrb\" (UID: \"b6cc5a03-94da-4277-91d3-61060c28e237\") " pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-h6hrb" Jul 13 03:06:56.177976 ip-10-0-134-52 kubenswrapper[2558]: I0713 03:06:56.177850 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/b6cc5a03-94da-4277-91d3-61060c28e237-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-8684c9ff49-h6hrb\" (UID: \"b6cc5a03-94da-4277-91d3-61060c28e237\") " pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-h6hrb" Jul 13 03:06:56.178156 ip-10-0-134-52 kubenswrapper[2558]: I0713 03:06:56.178141 2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/b6cc5a03-94da-4277-91d3-61060c28e237-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-8684c9ff49-h6hrb\" (UID: \"b6cc5a03-94da-4277-91d3-61060c28e237\") " pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-h6hrb" Jul 13 03:06:56.188830 ip-10-0-134-52 kubenswrapper[2558]: I0713 03:06:56.188803 2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-xcr9b\" (UniqueName: \"kubernetes.io/projected/b6cc5a03-94da-4277-91d3-61060c28e237-kube-api-access-xcr9b\") pod \"kuadrant-operator-controller-manager-8684c9ff49-h6hrb\" (UID: \"b6cc5a03-94da-4277-91d3-61060c28e237\") " pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-h6hrb" Jul 13 03:06:56.274958 ip-10-0-134-52 kubenswrapper[2558]: I0713 03:06:56.274889 2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-h6hrb" Jul 13 03:06:56.425641 ip-10-0-134-52 kubenswrapper[2558]: I0713 03:06:56.425616 2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-h6hrb"] Jul 13 03:06:56.426998 ip-10-0-134-52 kubenswrapper[2558]: W0713 03:06:56.426967 2558 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podb6cc5a03_94da_4277_91d3_61060c28e237.slice/crio-e6b766c3e69dfd0894ac6d1353b5615a28228e111331836f5d08e4ec346f33c9 WatchSource:0}: Error finding container e6b766c3e69dfd0894ac6d1353b5615a28228e111331836f5d08e4ec346f33c9: Status 404 returned error can't find the container with id e6b766c3e69dfd0894ac6d1353b5615a28228e111331836f5d08e4ec346f33c9 Jul 13 03:06:56.561781 ip-10-0-134-52 kubenswrapper[2558]: I0713 03:06:56.561748 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-h6hrb" event={"ID":"b6cc5a03-94da-4277-91d3-61060c28e237","Type":"ContainerStarted","Data":"e6b766c3e69dfd0894ac6d1353b5615a28228e111331836f5d08e4ec346f33c9"} Jul 13 03:07:03.600036 ip-10-0-134-52 kubenswrapper[2558]: I0713 03:07:03.599997 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-h6hrb" event={"ID":"b6cc5a03-94da-4277-91d3-61060c28e237","Type":"ContainerStarted","Data":"4d87789fd7925064a75edf8cf3c7fd17e717cf28532d4bb2e227947970f7e3b6"} Jul 13 03:07:03.600544 ip-10-0-134-52 kubenswrapper[2558]: I0713 03:07:03.600102 2558 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-h6hrb" Jul 13 03:07:03.619722 ip-10-0-134-52 kubenswrapper[2558]: I0713 03:07:03.619678 2558 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-h6hrb" podStartSLOduration=2.399001713 podStartE2EDuration="8.619664499s" totalImagesPullingTime="6.220662786s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-13 03:06:55 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-13 03:07:03.617545962 +0000 UTC m=+606.018146435" watchObservedRunningTime="2026-07-13 03:07:03.619664499 +0000 UTC m=+606.020264965" Jul 13 03:07:05.432484 ip-10-0-134-52 kubenswrapper[2558]: I0713 03:07:05.432443 2558 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/kuadrant-console-plugin-66b5774985-45lfc"] Jul 13 03:07:05.436371 ip-10-0-134-52 kubenswrapper[2558]: I0713 03:07:05.436354 2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-console-plugin-66b5774985-45lfc" Jul 13 03:07:05.439105 ip-10-0-134-52 kubenswrapper[2558]: I0713 03:07:05.439083 2558 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"kuadrant-console-nginx-conf\"" Jul 13 03:07:05.439225 ip-10-0-134-52 kubenswrapper[2558]: I0713 03:07:05.439105 2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"default-dockercfg-ph7hg\"" Jul 13 03:07:05.439280 ip-10-0-134-52 kubenswrapper[2558]: I0713 03:07:05.439239 2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"plugin-serving-cert\"" Jul 13 03:07:05.443571 ip-10-0-134-52 kubenswrapper[2558]: I0713 03:07:05.443548 2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-console-plugin-66b5774985-45lfc"] Jul 13 03:07:05.556288 ip-10-0-134-52 kubenswrapper[2558]: I0713 03:07:05.556265 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"nginx-conf\" (UniqueName: \"kubernetes.io/configmap/dae9a82d-b49e-4088-82d7-7894b3572063-nginx-conf\") pod \"kuadrant-console-plugin-66b5774985-45lfc\" (UID: \"dae9a82d-b49e-4088-82d7-7894b3572063\") " pod="kuadrant-system/kuadrant-console-plugin-66b5774985-45lfc" Jul 13 03:07:05.556432 ip-10-0-134-52 kubenswrapper[2558]: I0713 03:07:05.556301 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-2qssz\" (UniqueName: \"kubernetes.io/projected/dae9a82d-b49e-4088-82d7-7894b3572063-kube-api-access-2qssz\") pod \"kuadrant-console-plugin-66b5774985-45lfc\" (UID: \"dae9a82d-b49e-4088-82d7-7894b3572063\") " pod="kuadrant-system/kuadrant-console-plugin-66b5774985-45lfc" Jul 13 03:07:05.556432 ip-10-0-134-52 kubenswrapper[2558]: I0713 03:07:05.556324 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugin-serving-cert\" (UniqueName: \"kubernetes.io/secret/dae9a82d-b49e-4088-82d7-7894b3572063-plugin-serving-cert\") pod \"kuadrant-console-plugin-66b5774985-45lfc\" (UID: \"dae9a82d-b49e-4088-82d7-7894b3572063\") " pod="kuadrant-system/kuadrant-console-plugin-66b5774985-45lfc" Jul 13 03:07:05.657651 ip-10-0-134-52 kubenswrapper[2558]: I0713 03:07:05.657627 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-2qssz\" (UniqueName: \"kubernetes.io/projected/dae9a82d-b49e-4088-82d7-7894b3572063-kube-api-access-2qssz\") pod \"kuadrant-console-plugin-66b5774985-45lfc\" (UID: \"dae9a82d-b49e-4088-82d7-7894b3572063\") " pod="kuadrant-system/kuadrant-console-plugin-66b5774985-45lfc" Jul 13 03:07:05.657651 ip-10-0-134-52 kubenswrapper[2558]: I0713 03:07:05.657660 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugin-serving-cert\" (UniqueName: \"kubernetes.io/secret/dae9a82d-b49e-4088-82d7-7894b3572063-plugin-serving-cert\") pod \"kuadrant-console-plugin-66b5774985-45lfc\" (UID: \"dae9a82d-b49e-4088-82d7-7894b3572063\") " pod="kuadrant-system/kuadrant-console-plugin-66b5774985-45lfc" Jul 13 03:07:05.657849 ip-10-0-134-52 kubenswrapper[2558]: I0713 03:07:05.657716 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"nginx-conf\" (UniqueName: \"kubernetes.io/configmap/dae9a82d-b49e-4088-82d7-7894b3572063-nginx-conf\") pod \"kuadrant-console-plugin-66b5774985-45lfc\" (UID: \"dae9a82d-b49e-4088-82d7-7894b3572063\") " pod="kuadrant-system/kuadrant-console-plugin-66b5774985-45lfc" Jul 13 03:07:05.658255 ip-10-0-134-52 kubenswrapper[2558]: I0713 03:07:05.658235 2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"nginx-conf\" (UniqueName: \"kubernetes.io/configmap/dae9a82d-b49e-4088-82d7-7894b3572063-nginx-conf\") pod \"kuadrant-console-plugin-66b5774985-45lfc\" (UID: \"dae9a82d-b49e-4088-82d7-7894b3572063\") " pod="kuadrant-system/kuadrant-console-plugin-66b5774985-45lfc" Jul 13 03:07:05.660225 ip-10-0-134-52 kubenswrapper[2558]: I0713 03:07:05.660202 2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"plugin-serving-cert\" (UniqueName: \"kubernetes.io/secret/dae9a82d-b49e-4088-82d7-7894b3572063-plugin-serving-cert\") pod \"kuadrant-console-plugin-66b5774985-45lfc\" (UID: \"dae9a82d-b49e-4088-82d7-7894b3572063\") " pod="kuadrant-system/kuadrant-console-plugin-66b5774985-45lfc" Jul 13 03:07:05.665983 ip-10-0-134-52 kubenswrapper[2558]: I0713 03:07:05.665953 2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-2qssz\" (UniqueName: \"kubernetes.io/projected/dae9a82d-b49e-4088-82d7-7894b3572063-kube-api-access-2qssz\") pod \"kuadrant-console-plugin-66b5774985-45lfc\" (UID: \"dae9a82d-b49e-4088-82d7-7894b3572063\") " pod="kuadrant-system/kuadrant-console-plugin-66b5774985-45lfc" Jul 13 03:07:05.747821 ip-10-0-134-52 kubenswrapper[2558]: I0713 03:07:05.747740 2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-console-plugin-66b5774985-45lfc" Jul 13 03:07:05.880492 ip-10-0-134-52 kubenswrapper[2558]: I0713 03:07:05.880233 2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-console-plugin-66b5774985-45lfc"] Jul 13 03:07:05.883079 ip-10-0-134-52 kubenswrapper[2558]: W0713 03:07:05.883046 2558 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-poddae9a82d_b49e_4088_82d7_7894b3572063.slice/crio-0212e0b77d8b9e5e61e18f1240851d388e3f2696a6095436b54d28168f9c80be WatchSource:0}: Error finding container 0212e0b77d8b9e5e61e18f1240851d388e3f2696a6095436b54d28168f9c80be: Status 404 returned error can't find the container with id 0212e0b77d8b9e5e61e18f1240851d388e3f2696a6095436b54d28168f9c80be Jul 13 03:07:06.619294 ip-10-0-134-52 kubenswrapper[2558]: I0713 03:07:06.619258 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-console-plugin-66b5774985-45lfc" event={"ID":"dae9a82d-b49e-4088-82d7-7894b3572063","Type":"ContainerStarted","Data":"0212e0b77d8b9e5e61e18f1240851d388e3f2696a6095436b54d28168f9c80be"} Jul 13 03:07:14.607657 ip-10-0-134-52 kubenswrapper[2558]: I0713 03:07:14.607625 2558 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-h6hrb" Jul 13 03:07:15.630652 ip-10-0-134-52 kubenswrapper[2558]: I0713 03:07:15.630603 2558 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-console/console-69dbcf8cc8-l28dx" podUID="1c9fce77-2489-47e9-b6f9-d62fe5756e7d" containerName="console" containerID="cri-o://eb1a52ae6c4056b054da999eec459f42092cad0fce1c265d0ace37a4160588fa" gracePeriod=15 Jul 13 03:07:16.308261 ip-10-0-134-52 kubenswrapper[2558]: I0713 03:07:16.308228 2558 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-h6hrb"] Jul 13 03:07:16.308472 ip-10-0-134-52 kubenswrapper[2558]: I0713 03:07:16.308443 2558 kuberuntime_container.go:873] "Killing container with a grace period" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-h6hrb" podUID="b6cc5a03-94da-4277-91d3-61060c28e237" containerName="manager" containerID="cri-o://4d87789fd7925064a75edf8cf3c7fd17e717cf28532d4bb2e227947970f7e3b6" gracePeriod=2 Jul 13 03:07:16.319224 ip-10-0-134-52 kubenswrapper[2558]: I0713 03:07:16.319198 2558 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-ngnk7"] Jul 13 03:07:16.323996 ip-10-0-134-52 kubenswrapper[2558]: E0713 03:07:16.322079 2558 status_manager.go:1041] "Failed to update status for pod" err="failed to patch status \"{\\\"metadata\\\":{\\\"uid\\\":\\\"b6cc5a03-94da-4277-91d3-61060c28e237\\\"},\\\"status\\\":{\\\"$setElementOrder/conditions\\\":[{\\\"type\\\":\\\"PodReadyToStartContainers\\\"},{\\\"type\\\":\\\"Initialized\\\"},{\\\"type\\\":\\\"Ready\\\"},{\\\"type\\\":\\\"ContainersReady\\\"},{\\\"type\\\":\\\"PodScheduled\\\"}],\\\"conditions\\\":[{\\\"observedGeneration\\\":2,\\\"type\\\":\\\"PodReadyToStartContainers\\\"},{\\\"observedGeneration\\\":2,\\\"type\\\":\\\"Initialized\\\"},{\\\"observedGeneration\\\":2,\\\"type\\\":\\\"Ready\\\"},{\\\"observedGeneration\\\":2,\\\"type\\\":\\\"ContainersReady\\\"},{\\\"observedGeneration\\\":2,\\\"type\\\":\\\"PodScheduled\\\"}],\\\"observedGeneration\\\":2}}\" for pod \"kuadrant-system\"/\"kuadrant-operator-controller-manager-8684c9ff49-h6hrb\": pods \"kuadrant-operator-controller-manager-8684c9ff49-h6hrb\" not found" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-h6hrb" Jul 13 03:07:16.331661 ip-10-0-134-52 kubenswrapper[2558]: I0713 03:07:16.331583 2558 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-h6hrb"] Jul 13 03:07:16.331815 ip-10-0-134-52 kubenswrapper[2558]: I0713 03:07:16.331799 2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-ngnk7" Jul 13 03:07:16.335971 ip-10-0-134-52 kubenswrapper[2558]: E0713 03:07:16.335936 2558 status_manager.go:1018] "Failed to get status for pod" err="pods \"kuadrant-operator-controller-manager-8684c9ff49-h6hrb\" is forbidden: User \"system:node:ip-10-0-134-52.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-134-52.ec2.internal' and this object" podUID="b6cc5a03-94da-4277-91d3-61060c28e237" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-h6hrb" Jul 13 03:07:16.337588 ip-10-0-134-52 kubenswrapper[2558]: I0713 03:07:16.337527 2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-ngnk7"] Jul 13 03:07:16.459550 ip-10-0-134-52 kubenswrapper[2558]: I0713 03:07:16.459515 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-mskzj\" (UniqueName: \"kubernetes.io/projected/1bcb8ba9-6261-4b79-96be-b4f779db075e-kube-api-access-mskzj\") pod \"kuadrant-operator-controller-manager-55467d9f7-ngnk7\" (UID: \"1bcb8ba9-6261-4b79-96be-b4f779db075e\") " pod="kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-ngnk7" Jul 13 03:07:16.459741 ip-10-0-134-52 kubenswrapper[2558]: I0713 03:07:16.459683 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/1bcb8ba9-6261-4b79-96be-b4f779db075e-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-55467d9f7-ngnk7\" (UID: \"1bcb8ba9-6261-4b79-96be-b4f779db075e\") " pod="kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-ngnk7" Jul 13 03:07:16.491404 ip-10-0-134-52 kubenswrapper[2558]: I0713 03:07:16.491369 2558 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-86878c769f-zfb6m"] Jul 13 03:07:16.491809 ip-10-0-134-52 kubenswrapper[2558]: I0713 03:07:16.491786 2558 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="b6cc5a03-94da-4277-91d3-61060c28e237" containerName="manager" Jul 13 03:07:16.491809 ip-10-0-134-52 kubenswrapper[2558]: I0713 03:07:16.491803 2558 state_mem.go:107] "Deleted CPUSet assignment" podUID="b6cc5a03-94da-4277-91d3-61060c28e237" containerName="manager" Jul 13 03:07:16.491936 ip-10-0-134-52 kubenswrapper[2558]: I0713 03:07:16.491880 2558 memory_manager.go:368] "RemoveStaleState removing state" podUID="b6cc5a03-94da-4277-91d3-61060c28e237" containerName="manager" Jul 13 03:07:16.500434 ip-10-0-134-52 kubenswrapper[2558]: I0713 03:07:16.500413 2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-zfb6m" Jul 13 03:07:16.503390 ip-10-0-134-52 kubenswrapper[2558]: E0713 03:07:16.503359 2558 status_manager.go:1018] "Failed to get status for pod" err="pods \"kuadrant-operator-controller-manager-8684c9ff49-h6hrb\" is forbidden: User \"system:node:ip-10-0-134-52.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-134-52.ec2.internal' and this object" podUID="b6cc5a03-94da-4277-91d3-61060c28e237" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-h6hrb" Jul 13 03:07:16.510695 ip-10-0-134-52 kubenswrapper[2558]: I0713 03:07:16.510673 2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-86878c769f-zfb6m"] Jul 13 03:07:16.560649 ip-10-0-134-52 kubenswrapper[2558]: I0713 03:07:16.560574 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-mskzj\" (UniqueName: \"kubernetes.io/projected/1bcb8ba9-6261-4b79-96be-b4f779db075e-kube-api-access-mskzj\") pod \"kuadrant-operator-controller-manager-55467d9f7-ngnk7\" (UID: \"1bcb8ba9-6261-4b79-96be-b4f779db075e\") " pod="kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-ngnk7" Jul 13 03:07:16.560649 ip-10-0-134-52 kubenswrapper[2558]: I0713 03:07:16.560632 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/1bcb8ba9-6261-4b79-96be-b4f779db075e-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-55467d9f7-ngnk7\" (UID: \"1bcb8ba9-6261-4b79-96be-b4f779db075e\") " pod="kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-ngnk7" Jul 13 03:07:16.561022 ip-10-0-134-52 kubenswrapper[2558]: I0713 03:07:16.561005 2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/1bcb8ba9-6261-4b79-96be-b4f779db075e-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-55467d9f7-ngnk7\" (UID: \"1bcb8ba9-6261-4b79-96be-b4f779db075e\") " pod="kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-ngnk7" Jul 13 03:07:16.573226 ip-10-0-134-52 kubenswrapper[2558]: I0713 03:07:16.573202 2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-mskzj\" (UniqueName: \"kubernetes.io/projected/1bcb8ba9-6261-4b79-96be-b4f779db075e-kube-api-access-mskzj\") pod \"kuadrant-operator-controller-manager-55467d9f7-ngnk7\" (UID: \"1bcb8ba9-6261-4b79-96be-b4f779db075e\") " pod="kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-ngnk7" Jul 13 03:07:16.662011 ip-10-0-134-52 kubenswrapper[2558]: I0713 03:07:16.661978 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-gbgh8\" (UniqueName: \"kubernetes.io/projected/01f95c5d-9949-44ed-9165-ce388db14fe2-kube-api-access-gbgh8\") pod \"kuadrant-operator-controller-manager-86878c769f-zfb6m\" (UID: \"01f95c5d-9949-44ed-9165-ce388db14fe2\") " pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-zfb6m" Jul 13 03:07:16.662416 ip-10-0-134-52 kubenswrapper[2558]: I0713 03:07:16.662051 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/01f95c5d-9949-44ed-9165-ce388db14fe2-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-86878c769f-zfb6m\" (UID: \"01f95c5d-9949-44ed-9165-ce388db14fe2\") " pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-zfb6m" Jul 13 03:07:16.690682 ip-10-0-134-52 kubenswrapper[2558]: I0713 03:07:16.690652 2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-ngnk7" Jul 13 03:07:16.763518 ip-10-0-134-52 kubenswrapper[2558]: I0713 03:07:16.763490 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-gbgh8\" (UniqueName: \"kubernetes.io/projected/01f95c5d-9949-44ed-9165-ce388db14fe2-kube-api-access-gbgh8\") pod \"kuadrant-operator-controller-manager-86878c769f-zfb6m\" (UID: \"01f95c5d-9949-44ed-9165-ce388db14fe2\") " pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-zfb6m" Jul 13 03:07:16.763671 ip-10-0-134-52 kubenswrapper[2558]: I0713 03:07:16.763546 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/01f95c5d-9949-44ed-9165-ce388db14fe2-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-86878c769f-zfb6m\" (UID: \"01f95c5d-9949-44ed-9165-ce388db14fe2\") " pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-zfb6m" Jul 13 03:07:16.764027 ip-10-0-134-52 kubenswrapper[2558]: I0713 03:07:16.764010 2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/01f95c5d-9949-44ed-9165-ce388db14fe2-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-86878c769f-zfb6m\" (UID: \"01f95c5d-9949-44ed-9165-ce388db14fe2\") " pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-zfb6m" Jul 13 03:07:16.780650 ip-10-0-134-52 kubenswrapper[2558]: I0713 03:07:16.780621 2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-gbgh8\" (UniqueName: \"kubernetes.io/projected/01f95c5d-9949-44ed-9165-ce388db14fe2-kube-api-access-gbgh8\") pod \"kuadrant-operator-controller-manager-86878c769f-zfb6m\" (UID: \"01f95c5d-9949-44ed-9165-ce388db14fe2\") " pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-zfb6m" Jul 13 03:07:16.812492 ip-10-0-134-52 kubenswrapper[2558]: I0713 03:07:16.812419 2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-zfb6m" Jul 13 03:07:18.094110 ip-10-0-134-52 kubenswrapper[2558]: E0713 03:07:18.094073 2558 status_manager.go:1018] "Failed to get status for pod" err="pods \"kuadrant-operator-controller-manager-8684c9ff49-h6hrb\" is forbidden: User \"system:node:ip-10-0-134-52.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-134-52.ec2.internal' and this object" podUID="b6cc5a03-94da-4277-91d3-61060c28e237" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-h6hrb" Jul 13 03:07:24.419735 ip-10-0-134-52 kubenswrapper[2558]: I0713 03:07:24.419242 2558 patch_prober.go:28] interesting pod/console-69dbcf8cc8-l28dx container/console namespace/openshift-console: Readiness probe status=failure output="Get \"https://10.133.0.22:8443/health\": dial tcp 10.133.0.22:8443: connect: connection refused" start-of-body= Jul 13 03:07:24.419735 ip-10-0-134-52 kubenswrapper[2558]: I0713 03:07:24.419360 2558 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-console/console-69dbcf8cc8-l28dx" podUID="1c9fce77-2489-47e9-b6f9-d62fe5756e7d" containerName="console" probeResult="failure" output="Get \"https://10.133.0.22:8443/health\": dial tcp 10.133.0.22:8443: connect: connection refused" Jul 13 03:07:27.202667 ip-10-0-134-52 kubenswrapper[2558]: I0713 03:07:27.202285 2558 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-69dbcf8cc8-l28dx" Jul 13 03:07:27.205901 ip-10-0-134-52 kubenswrapper[2558]: I0713 03:07:27.205875 2558 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-h6hrb" Jul 13 03:07:27.206895 ip-10-0-134-52 kubenswrapper[2558]: I0713 03:07:27.206867 2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-86878c769f-zfb6m"] Jul 13 03:07:27.207375 ip-10-0-134-52 kubenswrapper[2558]: W0713 03:07:27.207349 2558 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod01f95c5d_9949_44ed_9165_ce388db14fe2.slice/crio-24824ffc401581f6ec748bb0bb11eb0880a7bc127475bda2b5713a28adf35cf9 WatchSource:0}: Error finding container 24824ffc401581f6ec748bb0bb11eb0880a7bc127475bda2b5713a28adf35cf9: Status 404 returned error can't find the container with id 24824ffc401581f6ec748bb0bb11eb0880a7bc127475bda2b5713a28adf35cf9 Jul 13 03:07:27.235037 ip-10-0-134-52 kubenswrapper[2558]: I0713 03:07:27.235015 2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-ngnk7"] Jul 13 03:07:27.236588 ip-10-0-134-52 kubenswrapper[2558]: W0713 03:07:27.236566 2558 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod1bcb8ba9_6261_4b79_96be_b4f779db075e.slice/crio-ec95014ba4106dcf463e027e7518bcfcfe75ebc8438bd821e4eed3b10b6d197d WatchSource:0}: Error finding container ec95014ba4106dcf463e027e7518bcfcfe75ebc8438bd821e4eed3b10b6d197d: Status 404 returned error can't find the container with id ec95014ba4106dcf463e027e7518bcfcfe75ebc8438bd821e4eed3b10b6d197d Jul 13 03:07:27.258915 ip-10-0-134-52 kubenswrapper[2558]: I0713 03:07:27.258894 2558 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/1c9fce77-2489-47e9-b6f9-d62fe5756e7d-console-serving-cert\") pod \"1c9fce77-2489-47e9-b6f9-d62fe5756e7d\" (UID: \"1c9fce77-2489-47e9-b6f9-d62fe5756e7d\") " Jul 13 03:07:27.259006 ip-10-0-134-52 kubenswrapper[2558]: I0713 03:07:27.258943 2558 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/1c9fce77-2489-47e9-b6f9-d62fe5756e7d-trusted-ca-bundle\") pod \"1c9fce77-2489-47e9-b6f9-d62fe5756e7d\" (UID: \"1c9fce77-2489-47e9-b6f9-d62fe5756e7d\") " Jul 13 03:07:27.259006 ip-10-0-134-52 kubenswrapper[2558]: I0713 03:07:27.258987 2558 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/1c9fce77-2489-47e9-b6f9-d62fe5756e7d-console-config\") pod \"1c9fce77-2489-47e9-b6f9-d62fe5756e7d\" (UID: \"1c9fce77-2489-47e9-b6f9-d62fe5756e7d\") " Jul 13 03:07:27.259117 ip-10-0-134-52 kubenswrapper[2558]: I0713 03:07:27.259010 2558 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/1c9fce77-2489-47e9-b6f9-d62fe5756e7d-oauth-serving-cert\") pod \"1c9fce77-2489-47e9-b6f9-d62fe5756e7d\" (UID: \"1c9fce77-2489-47e9-b6f9-d62fe5756e7d\") " Jul 13 03:07:27.259117 ip-10-0-134-52 kubenswrapper[2558]: I0713 03:07:27.259051 2558 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/1c9fce77-2489-47e9-b6f9-d62fe5756e7d-service-ca\") pod \"1c9fce77-2489-47e9-b6f9-d62fe5756e7d\" (UID: \"1c9fce77-2489-47e9-b6f9-d62fe5756e7d\") " Jul 13 03:07:27.259117 ip-10-0-134-52 kubenswrapper[2558]: I0713 03:07:27.259088 2558 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-dtl44\" (UniqueName: \"kubernetes.io/projected/1c9fce77-2489-47e9-b6f9-d62fe5756e7d-kube-api-access-dtl44\") pod \"1c9fce77-2489-47e9-b6f9-d62fe5756e7d\" (UID: \"1c9fce77-2489-47e9-b6f9-d62fe5756e7d\") " Jul 13 03:07:27.259268 ip-10-0-134-52 kubenswrapper[2558]: I0713 03:07:27.259121 2558 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/b6cc5a03-94da-4277-91d3-61060c28e237-extensions-socket-volume\") pod \"b6cc5a03-94da-4277-91d3-61060c28e237\" (UID: \"b6cc5a03-94da-4277-91d3-61060c28e237\") " Jul 13 03:07:27.259268 ip-10-0-134-52 kubenswrapper[2558]: I0713 03:07:27.259151 2558 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-xcr9b\" (UniqueName: \"kubernetes.io/projected/b6cc5a03-94da-4277-91d3-61060c28e237-kube-api-access-xcr9b\") pod \"b6cc5a03-94da-4277-91d3-61060c28e237\" (UID: \"b6cc5a03-94da-4277-91d3-61060c28e237\") " Jul 13 03:07:27.259268 ip-10-0-134-52 kubenswrapper[2558]: I0713 03:07:27.259207 2558 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/1c9fce77-2489-47e9-b6f9-d62fe5756e7d-console-oauth-config\") pod \"1c9fce77-2489-47e9-b6f9-d62fe5756e7d\" (UID: \"1c9fce77-2489-47e9-b6f9-d62fe5756e7d\") " Jul 13 03:07:27.259510 ip-10-0-134-52 kubenswrapper[2558]: I0713 03:07:27.259484 2558 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/1c9fce77-2489-47e9-b6f9-d62fe5756e7d-trusted-ca-bundle" (OuterVolumeSpecName: "trusted-ca-bundle") pod "1c9fce77-2489-47e9-b6f9-d62fe5756e7d" (UID: "1c9fce77-2489-47e9-b6f9-d62fe5756e7d"). InnerVolumeSpecName "trusted-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 13 03:07:27.259510 ip-10-0-134-52 kubenswrapper[2558]: I0713 03:07:27.259494 2558 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/1c9fce77-2489-47e9-b6f9-d62fe5756e7d-service-ca" (OuterVolumeSpecName: "service-ca") pod "1c9fce77-2489-47e9-b6f9-d62fe5756e7d" (UID: "1c9fce77-2489-47e9-b6f9-d62fe5756e7d"). InnerVolumeSpecName "service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 13 03:07:27.260095 ip-10-0-134-52 kubenswrapper[2558]: I0713 03:07:27.259690 2558 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/1c9fce77-2489-47e9-b6f9-d62fe5756e7d-oauth-serving-cert" (OuterVolumeSpecName: "oauth-serving-cert") pod "1c9fce77-2489-47e9-b6f9-d62fe5756e7d" (UID: "1c9fce77-2489-47e9-b6f9-d62fe5756e7d"). InnerVolumeSpecName "oauth-serving-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 13 03:07:27.260095 ip-10-0-134-52 kubenswrapper[2558]: I0713 03:07:27.259906 2558 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/1c9fce77-2489-47e9-b6f9-d62fe5756e7d-console-config" (OuterVolumeSpecName: "console-config") pod "1c9fce77-2489-47e9-b6f9-d62fe5756e7d" (UID: "1c9fce77-2489-47e9-b6f9-d62fe5756e7d"). InnerVolumeSpecName "console-config". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 13 03:07:27.260095 ip-10-0-134-52 kubenswrapper[2558]: I0713 03:07:27.260052 2558 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/b6cc5a03-94da-4277-91d3-61060c28e237-extensions-socket-volume" (OuterVolumeSpecName: "extensions-socket-volume") pod "b6cc5a03-94da-4277-91d3-61060c28e237" (UID: "b6cc5a03-94da-4277-91d3-61060c28e237"). InnerVolumeSpecName "extensions-socket-volume". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 13 03:07:27.261804 ip-10-0-134-52 kubenswrapper[2558]: I0713 03:07:27.261778 2558 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/1c9fce77-2489-47e9-b6f9-d62fe5756e7d-console-oauth-config" (OuterVolumeSpecName: "console-oauth-config") pod "1c9fce77-2489-47e9-b6f9-d62fe5756e7d" (UID: "1c9fce77-2489-47e9-b6f9-d62fe5756e7d"). InnerVolumeSpecName "console-oauth-config". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 13 03:07:27.262207 ip-10-0-134-52 kubenswrapper[2558]: I0713 03:07:27.262184 2558 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/b6cc5a03-94da-4277-91d3-61060c28e237-kube-api-access-xcr9b" (OuterVolumeSpecName: "kube-api-access-xcr9b") pod "b6cc5a03-94da-4277-91d3-61060c28e237" (UID: "b6cc5a03-94da-4277-91d3-61060c28e237"). InnerVolumeSpecName "kube-api-access-xcr9b". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 13 03:07:27.262391 ip-10-0-134-52 kubenswrapper[2558]: I0713 03:07:27.262364 2558 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/1c9fce77-2489-47e9-b6f9-d62fe5756e7d-kube-api-access-dtl44" (OuterVolumeSpecName: "kube-api-access-dtl44") pod "1c9fce77-2489-47e9-b6f9-d62fe5756e7d" (UID: "1c9fce77-2489-47e9-b6f9-d62fe5756e7d"). InnerVolumeSpecName "kube-api-access-dtl44". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 13 03:07:27.263067 ip-10-0-134-52 kubenswrapper[2558]: I0713 03:07:27.263030 2558 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/1c9fce77-2489-47e9-b6f9-d62fe5756e7d-console-serving-cert" (OuterVolumeSpecName: "console-serving-cert") pod "1c9fce77-2489-47e9-b6f9-d62fe5756e7d" (UID: "1c9fce77-2489-47e9-b6f9-d62fe5756e7d"). InnerVolumeSpecName "console-serving-cert". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 13 03:07:27.360880 ip-10-0-134-52 kubenswrapper[2558]: I0713 03:07:27.360844 2558 reconciler_common.go:299] "Volume detached for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/1c9fce77-2489-47e9-b6f9-d62fe5756e7d-console-oauth-config\") on node \"ip-10-0-134-52.ec2.internal\" DevicePath \"\"" Jul 13 03:07:27.360880 ip-10-0-134-52 kubenswrapper[2558]: I0713 03:07:27.360873 2558 reconciler_common.go:299] "Volume detached for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/1c9fce77-2489-47e9-b6f9-d62fe5756e7d-console-serving-cert\") on node \"ip-10-0-134-52.ec2.internal\" DevicePath \"\"" Jul 13 03:07:27.361076 ip-10-0-134-52 kubenswrapper[2558]: I0713 03:07:27.360886 2558 reconciler_common.go:299] "Volume detached for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/1c9fce77-2489-47e9-b6f9-d62fe5756e7d-trusted-ca-bundle\") on node \"ip-10-0-134-52.ec2.internal\" DevicePath \"\"" Jul 13 03:07:27.361076 ip-10-0-134-52 kubenswrapper[2558]: I0713 03:07:27.360900 2558 reconciler_common.go:299] "Volume detached for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/1c9fce77-2489-47e9-b6f9-d62fe5756e7d-console-config\") on node \"ip-10-0-134-52.ec2.internal\" DevicePath \"\"" Jul 13 03:07:27.361076 ip-10-0-134-52 kubenswrapper[2558]: I0713 03:07:27.360913 2558 reconciler_common.go:299] "Volume detached for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/1c9fce77-2489-47e9-b6f9-d62fe5756e7d-oauth-serving-cert\") on node \"ip-10-0-134-52.ec2.internal\" DevicePath \"\"" Jul 13 03:07:27.361076 ip-10-0-134-52 kubenswrapper[2558]: I0713 03:07:27.360924 2558 reconciler_common.go:299] "Volume detached for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/1c9fce77-2489-47e9-b6f9-d62fe5756e7d-service-ca\") on node \"ip-10-0-134-52.ec2.internal\" DevicePath \"\"" Jul 13 03:07:27.361076 ip-10-0-134-52 kubenswrapper[2558]: I0713 03:07:27.360935 2558 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-dtl44\" (UniqueName: \"kubernetes.io/projected/1c9fce77-2489-47e9-b6f9-d62fe5756e7d-kube-api-access-dtl44\") on node \"ip-10-0-134-52.ec2.internal\" DevicePath \"\"" Jul 13 03:07:27.361076 ip-10-0-134-52 kubenswrapper[2558]: I0713 03:07:27.360946 2558 reconciler_common.go:299] "Volume detached for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/b6cc5a03-94da-4277-91d3-61060c28e237-extensions-socket-volume\") on node \"ip-10-0-134-52.ec2.internal\" DevicePath \"\"" Jul 13 03:07:27.361076 ip-10-0-134-52 kubenswrapper[2558]: I0713 03:07:27.360958 2558 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-xcr9b\" (UniqueName: \"kubernetes.io/projected/b6cc5a03-94da-4277-91d3-61060c28e237-kube-api-access-xcr9b\") on node \"ip-10-0-134-52.ec2.internal\" DevicePath \"\"" Jul 13 03:07:27.759242 ip-10-0-134-52 kubenswrapper[2558]: I0713 03:07:27.759204 2558 generic.go:356] "Generic (PLEG): container finished" podID="1c9fce77-2489-47e9-b6f9-d62fe5756e7d" containerID="eb1a52ae6c4056b054da999eec459f42092cad0fce1c265d0ace37a4160588fa" exitCode=0 Jul 13 03:07:27.759467 ip-10-0-134-52 kubenswrapper[2558]: I0713 03:07:27.759255 2558 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-69dbcf8cc8-l28dx" Jul 13 03:07:27.759467 ip-10-0-134-52 kubenswrapper[2558]: I0713 03:07:27.759282 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-69dbcf8cc8-l28dx" event={"ID":"1c9fce77-2489-47e9-b6f9-d62fe5756e7d","Type":"ContainerDied","Data":"eb1a52ae6c4056b054da999eec459f42092cad0fce1c265d0ace37a4160588fa"} Jul 13 03:07:27.759467 ip-10-0-134-52 kubenswrapper[2558]: I0713 03:07:27.759345 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-69dbcf8cc8-l28dx" event={"ID":"1c9fce77-2489-47e9-b6f9-d62fe5756e7d","Type":"ContainerDied","Data":"f7c0f05d13503f5306e94b1d89673771a0dd4ec9acd8bd4bf4c3d004e7b7f3af"} Jul 13 03:07:27.759467 ip-10-0-134-52 kubenswrapper[2558]: I0713 03:07:27.759374 2558 scope.go:117] "RemoveContainer" containerID="eb1a52ae6c4056b054da999eec459f42092cad0fce1c265d0ace37a4160588fa" Jul 13 03:07:27.761373 ip-10-0-134-52 kubenswrapper[2558]: I0713 03:07:27.761345 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-zfb6m" event={"ID":"01f95c5d-9949-44ed-9165-ce388db14fe2","Type":"ContainerStarted","Data":"5032150ad34517a9c38003bc28b392f7ee3a53385397a986df52d434d405a0f4"} Jul 13 03:07:27.761511 ip-10-0-134-52 kubenswrapper[2558]: I0713 03:07:27.761392 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-zfb6m" event={"ID":"01f95c5d-9949-44ed-9165-ce388db14fe2","Type":"ContainerStarted","Data":"24824ffc401581f6ec748bb0bb11eb0880a7bc127475bda2b5713a28adf35cf9"} Jul 13 03:07:27.761511 ip-10-0-134-52 kubenswrapper[2558]: I0713 03:07:27.761424 2558 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-zfb6m" Jul 13 03:07:27.763569 ip-10-0-134-52 kubenswrapper[2558]: I0713 03:07:27.763108 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-ngnk7" event={"ID":"1bcb8ba9-6261-4b79-96be-b4f779db075e","Type":"ContainerStarted","Data":"abdaf88501ad56d7a2b9a031105606aa9e008001e5ee0028a6ad7caa8bdf21dd"} Jul 13 03:07:27.763569 ip-10-0-134-52 kubenswrapper[2558]: I0713 03:07:27.763163 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-ngnk7" event={"ID":"1bcb8ba9-6261-4b79-96be-b4f779db075e","Type":"ContainerStarted","Data":"ec95014ba4106dcf463e027e7518bcfcfe75ebc8438bd821e4eed3b10b6d197d"} Jul 13 03:07:27.763569 ip-10-0-134-52 kubenswrapper[2558]: I0713 03:07:27.763193 2558 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-ngnk7" Jul 13 03:07:27.764764 ip-10-0-134-52 kubenswrapper[2558]: I0713 03:07:27.764736 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-console-plugin-66b5774985-45lfc" event={"ID":"dae9a82d-b49e-4088-82d7-7894b3572063","Type":"ContainerStarted","Data":"8f968655d52be243e5bba059ad52e1d0c402ee26162e5f6a4b44ae81771f5c89"} Jul 13 03:07:27.766127 ip-10-0-134-52 kubenswrapper[2558]: I0713 03:07:27.766102 2558 generic.go:356] "Generic (PLEG): container finished" podID="b6cc5a03-94da-4277-91d3-61060c28e237" containerID="4d87789fd7925064a75edf8cf3c7fd17e717cf28532d4bb2e227947970f7e3b6" exitCode=0 Jul 13 03:07:27.766226 ip-10-0-134-52 kubenswrapper[2558]: I0713 03:07:27.766134 2558 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-h6hrb" Jul 13 03:07:27.770397 ip-10-0-134-52 kubenswrapper[2558]: I0713 03:07:27.770382 2558 scope.go:117] "RemoveContainer" containerID="eb1a52ae6c4056b054da999eec459f42092cad0fce1c265d0ace37a4160588fa" Jul 13 03:07:27.770671 ip-10-0-134-52 kubenswrapper[2558]: E0713 03:07:27.770652 2558 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"eb1a52ae6c4056b054da999eec459f42092cad0fce1c265d0ace37a4160588fa\": container with ID starting with eb1a52ae6c4056b054da999eec459f42092cad0fce1c265d0ace37a4160588fa not found: ID does not exist" containerID="eb1a52ae6c4056b054da999eec459f42092cad0fce1c265d0ace37a4160588fa" Jul 13 03:07:27.770747 ip-10-0-134-52 kubenswrapper[2558]: I0713 03:07:27.770682 2558 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"eb1a52ae6c4056b054da999eec459f42092cad0fce1c265d0ace37a4160588fa"} err="failed to get container status \"eb1a52ae6c4056b054da999eec459f42092cad0fce1c265d0ace37a4160588fa\": rpc error: code = NotFound desc = could not find container \"eb1a52ae6c4056b054da999eec459f42092cad0fce1c265d0ace37a4160588fa\": container with ID starting with eb1a52ae6c4056b054da999eec459f42092cad0fce1c265d0ace37a4160588fa not found: ID does not exist" Jul 13 03:07:27.770747 ip-10-0-134-52 kubenswrapper[2558]: I0713 03:07:27.770705 2558 scope.go:117] "RemoveContainer" containerID="4d87789fd7925064a75edf8cf3c7fd17e717cf28532d4bb2e227947970f7e3b6" Jul 13 03:07:27.779107 ip-10-0-134-52 kubenswrapper[2558]: I0713 03:07:27.779093 2558 scope.go:117] "RemoveContainer" containerID="4d87789fd7925064a75edf8cf3c7fd17e717cf28532d4bb2e227947970f7e3b6" Jul 13 03:07:27.779393 ip-10-0-134-52 kubenswrapper[2558]: E0713 03:07:27.779361 2558 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"4d87789fd7925064a75edf8cf3c7fd17e717cf28532d4bb2e227947970f7e3b6\": container with ID starting with 4d87789fd7925064a75edf8cf3c7fd17e717cf28532d4bb2e227947970f7e3b6 not found: ID does not exist" containerID="4d87789fd7925064a75edf8cf3c7fd17e717cf28532d4bb2e227947970f7e3b6" Jul 13 03:07:27.779484 ip-10-0-134-52 kubenswrapper[2558]: I0713 03:07:27.779393 2558 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"4d87789fd7925064a75edf8cf3c7fd17e717cf28532d4bb2e227947970f7e3b6"} err="failed to get container status \"4d87789fd7925064a75edf8cf3c7fd17e717cf28532d4bb2e227947970f7e3b6\": rpc error: code = NotFound desc = could not find container \"4d87789fd7925064a75edf8cf3c7fd17e717cf28532d4bb2e227947970f7e3b6\": container with ID starting with 4d87789fd7925064a75edf8cf3c7fd17e717cf28532d4bb2e227947970f7e3b6 not found: ID does not exist" Jul 13 03:07:27.783994 ip-10-0-134-52 kubenswrapper[2558]: I0713 03:07:27.783959 2558 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-zfb6m" podStartSLOduration=11.783947645 podStartE2EDuration="11.783947645s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-13 03:07:16 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-13 03:07:27.782318014 +0000 UTC m=+630.182918500" watchObservedRunningTime="2026-07-13 03:07:27.783947645 +0000 UTC m=+630.184548111" Jul 13 03:07:27.801970 ip-10-0-134-52 kubenswrapper[2558]: I0713 03:07:27.801929 2558 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-ngnk7" podStartSLOduration=11.801916208 podStartE2EDuration="11.801916208s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-13 03:07:16 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-13 03:07:27.801656462 +0000 UTC m=+630.202256974" watchObservedRunningTime="2026-07-13 03:07:27.801916208 +0000 UTC m=+630.202516671" Jul 13 03:07:27.819368 ip-10-0-134-52 kubenswrapper[2558]: I0713 03:07:27.819304 2558 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/kuadrant-console-plugin-66b5774985-45lfc" podStartSLOduration=1.603234705 podStartE2EDuration="22.819292251s" totalImagesPullingTime="21.216057546s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-13 03:07:05 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-13 03:07:27.817164401 +0000 UTC m=+630.217764867" watchObservedRunningTime="2026-07-13 03:07:27.819292251 +0000 UTC m=+630.219892763" Jul 13 03:07:27.833502 ip-10-0-134-52 kubenswrapper[2558]: I0713 03:07:27.833479 2558 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-69dbcf8cc8-l28dx"] Jul 13 03:07:27.839052 ip-10-0-134-52 kubenswrapper[2558]: I0713 03:07:27.839026 2558 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-console/console-69dbcf8cc8-l28dx"] Jul 13 03:07:28.096514 ip-10-0-134-52 kubenswrapper[2558]: I0713 03:07:28.096425 2558 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="1c9fce77-2489-47e9-b6f9-d62fe5756e7d" path="/var/lib/kubelet/pods/1c9fce77-2489-47e9-b6f9-d62fe5756e7d/volumes" Jul 13 03:07:28.096977 ip-10-0-134-52 kubenswrapper[2558]: I0713 03:07:28.096933 2558 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="b6cc5a03-94da-4277-91d3-61060c28e237" path="/var/lib/kubelet/pods/b6cc5a03-94da-4277-91d3-61060c28e237/volumes" Jul 13 03:07:38.775479 ip-10-0-134-52 kubenswrapper[2558]: I0713 03:07:38.775446 2558 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-zfb6m" Jul 13 03:07:38.775879 ip-10-0-134-52 kubenswrapper[2558]: I0713 03:07:38.775732 2558 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-ngnk7" Jul 13 03:07:38.843104 ip-10-0-134-52 kubenswrapper[2558]: I0713 03:07:38.843076 2558 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-ngnk7"] Jul 13 03:07:38.843288 ip-10-0-134-52 kubenswrapper[2558]: I0713 03:07:38.843239 2558 kuberuntime_container.go:873] "Killing container with a grace period" pod="kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-ngnk7" podUID="1bcb8ba9-6261-4b79-96be-b4f779db075e" containerName="manager" containerID="cri-o://abdaf88501ad56d7a2b9a031105606aa9e008001e5ee0028a6ad7caa8bdf21dd" gracePeriod=10 Jul 13 03:07:39.092390 ip-10-0-134-52 kubenswrapper[2558]: I0713 03:07:39.092370 2558 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-ngnk7" Jul 13 03:07:39.151495 ip-10-0-134-52 kubenswrapper[2558]: I0713 03:07:39.151471 2558 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-mskzj\" (UniqueName: \"kubernetes.io/projected/1bcb8ba9-6261-4b79-96be-b4f779db075e-kube-api-access-mskzj\") pod \"1bcb8ba9-6261-4b79-96be-b4f779db075e\" (UID: \"1bcb8ba9-6261-4b79-96be-b4f779db075e\") " Jul 13 03:07:39.151639 ip-10-0-134-52 kubenswrapper[2558]: I0713 03:07:39.151508 2558 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/1bcb8ba9-6261-4b79-96be-b4f779db075e-extensions-socket-volume\") pod \"1bcb8ba9-6261-4b79-96be-b4f779db075e\" (UID: \"1bcb8ba9-6261-4b79-96be-b4f779db075e\") " Jul 13 03:07:39.152015 ip-10-0-134-52 kubenswrapper[2558]: I0713 03:07:39.151985 2558 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/1bcb8ba9-6261-4b79-96be-b4f779db075e-extensions-socket-volume" (OuterVolumeSpecName: "extensions-socket-volume") pod "1bcb8ba9-6261-4b79-96be-b4f779db075e" (UID: "1bcb8ba9-6261-4b79-96be-b4f779db075e"). InnerVolumeSpecName "extensions-socket-volume". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 13 03:07:39.153787 ip-10-0-134-52 kubenswrapper[2558]: I0713 03:07:39.153761 2558 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/1bcb8ba9-6261-4b79-96be-b4f779db075e-kube-api-access-mskzj" (OuterVolumeSpecName: "kube-api-access-mskzj") pod "1bcb8ba9-6261-4b79-96be-b4f779db075e" (UID: "1bcb8ba9-6261-4b79-96be-b4f779db075e"). InnerVolumeSpecName "kube-api-access-mskzj". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 13 03:07:39.252076 ip-10-0-134-52 kubenswrapper[2558]: I0713 03:07:39.252056 2558 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-mskzj\" (UniqueName: \"kubernetes.io/projected/1bcb8ba9-6261-4b79-96be-b4f779db075e-kube-api-access-mskzj\") on node \"ip-10-0-134-52.ec2.internal\" DevicePath \"\"" Jul 13 03:07:39.252219 ip-10-0-134-52 kubenswrapper[2558]: I0713 03:07:39.252081 2558 reconciler_common.go:299] "Volume detached for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/1bcb8ba9-6261-4b79-96be-b4f779db075e-extensions-socket-volume\") on node \"ip-10-0-134-52.ec2.internal\" DevicePath \"\"" Jul 13 03:07:39.835194 ip-10-0-134-52 kubenswrapper[2558]: I0713 03:07:39.835163 2558 generic.go:356] "Generic (PLEG): container finished" podID="1bcb8ba9-6261-4b79-96be-b4f779db075e" containerID="abdaf88501ad56d7a2b9a031105606aa9e008001e5ee0028a6ad7caa8bdf21dd" exitCode=0 Jul 13 03:07:39.835586 ip-10-0-134-52 kubenswrapper[2558]: I0713 03:07:39.835232 2558 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-ngnk7" Jul 13 03:07:39.835586 ip-10-0-134-52 kubenswrapper[2558]: I0713 03:07:39.835239 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-ngnk7" event={"ID":"1bcb8ba9-6261-4b79-96be-b4f779db075e","Type":"ContainerDied","Data":"abdaf88501ad56d7a2b9a031105606aa9e008001e5ee0028a6ad7caa8bdf21dd"} Jul 13 03:07:39.835586 ip-10-0-134-52 kubenswrapper[2558]: I0713 03:07:39.835313 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-ngnk7" event={"ID":"1bcb8ba9-6261-4b79-96be-b4f779db075e","Type":"ContainerDied","Data":"ec95014ba4106dcf463e027e7518bcfcfe75ebc8438bd821e4eed3b10b6d197d"} Jul 13 03:07:39.835586 ip-10-0-134-52 kubenswrapper[2558]: I0713 03:07:39.835358 2558 scope.go:117] "RemoveContainer" containerID="abdaf88501ad56d7a2b9a031105606aa9e008001e5ee0028a6ad7caa8bdf21dd" Jul 13 03:07:39.844280 ip-10-0-134-52 kubenswrapper[2558]: I0713 03:07:39.844078 2558 scope.go:117] "RemoveContainer" containerID="abdaf88501ad56d7a2b9a031105606aa9e008001e5ee0028a6ad7caa8bdf21dd" Jul 13 03:07:39.844395 ip-10-0-134-52 kubenswrapper[2558]: E0713 03:07:39.844377 2558 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"abdaf88501ad56d7a2b9a031105606aa9e008001e5ee0028a6ad7caa8bdf21dd\": container with ID starting with abdaf88501ad56d7a2b9a031105606aa9e008001e5ee0028a6ad7caa8bdf21dd not found: ID does not exist" containerID="abdaf88501ad56d7a2b9a031105606aa9e008001e5ee0028a6ad7caa8bdf21dd" Jul 13 03:07:39.844443 ip-10-0-134-52 kubenswrapper[2558]: I0713 03:07:39.844402 2558 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"abdaf88501ad56d7a2b9a031105606aa9e008001e5ee0028a6ad7caa8bdf21dd"} err="failed to get container status \"abdaf88501ad56d7a2b9a031105606aa9e008001e5ee0028a6ad7caa8bdf21dd\": rpc error: code = NotFound desc = could not find container \"abdaf88501ad56d7a2b9a031105606aa9e008001e5ee0028a6ad7caa8bdf21dd\": container with ID starting with abdaf88501ad56d7a2b9a031105606aa9e008001e5ee0028a6ad7caa8bdf21dd not found: ID does not exist" Jul 13 03:07:39.864304 ip-10-0-134-52 kubenswrapper[2558]: I0713 03:07:39.864284 2558 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-ngnk7"] Jul 13 03:07:39.876155 ip-10-0-134-52 kubenswrapper[2558]: I0713 03:07:39.876123 2558 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-ngnk7"] Jul 13 03:07:40.092582 ip-10-0-134-52 kubenswrapper[2558]: I0713 03:07:40.092521 2558 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="1bcb8ba9-6261-4b79-96be-b4f779db075e" path="/var/lib/kubelet/pods/1bcb8ba9-6261-4b79-96be-b4f779db075e/volumes" Jul 13 03:07:55.168027 ip-10-0-134-52 kubenswrapper[2558]: I0713 03:07:55.167993 2558 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-pdpz9"] Jul 13 03:07:55.168520 ip-10-0-134-52 kubenswrapper[2558]: I0713 03:07:55.168501 2558 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="1c9fce77-2489-47e9-b6f9-d62fe5756e7d" containerName="console" Jul 13 03:07:55.168520 ip-10-0-134-52 kubenswrapper[2558]: I0713 03:07:55.168515 2558 state_mem.go:107] "Deleted CPUSet assignment" podUID="1c9fce77-2489-47e9-b6f9-d62fe5756e7d" containerName="console" Jul 13 03:07:55.168643 ip-10-0-134-52 kubenswrapper[2558]: I0713 03:07:55.168542 2558 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="1bcb8ba9-6261-4b79-96be-b4f779db075e" containerName="manager" Jul 13 03:07:55.168643 ip-10-0-134-52 kubenswrapper[2558]: I0713 03:07:55.168550 2558 state_mem.go:107] "Deleted CPUSet assignment" podUID="1bcb8ba9-6261-4b79-96be-b4f779db075e" containerName="manager" Jul 13 03:07:55.168732 ip-10-0-134-52 kubenswrapper[2558]: I0713 03:07:55.168644 2558 memory_manager.go:368] "RemoveStaleState removing state" podUID="1bcb8ba9-6261-4b79-96be-b4f779db075e" containerName="manager" Jul 13 03:07:55.168732 ip-10-0-134-52 kubenswrapper[2558]: I0713 03:07:55.168657 2558 memory_manager.go:368] "RemoveStaleState removing state" podUID="1c9fce77-2489-47e9-b6f9-d62fe5756e7d" containerName="console" Jul 13 03:07:55.382457 ip-10-0-134-52 kubenswrapper[2558]: I0713 03:07:55.382426 2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-pdpz9"] Jul 13 03:07:55.382618 ip-10-0-134-52 kubenswrapper[2558]: I0713 03:07:55.382526 2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-pdpz9" Jul 13 03:07:55.385229 ip-10-0-134-52 kubenswrapper[2558]: I0713 03:07:55.385204 2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"maas-default-gateway-openshift-default-dockercfg-k8tr6\"" Jul 13 03:07:55.479119 ip-10-0-134-52 kubenswrapper[2558]: I0713 03:07:55.479044 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/25ab9eef-bfef-4f8b-a0a5-5fd5abe2f44e-workload-certs\") pod \"maas-default-gateway-openshift-default-56654dcf7-pdpz9\" (UID: \"25ab9eef-bfef-4f8b-a0a5-5fd5abe2f44e\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-pdpz9" Jul 13 03:07:55.479119 ip-10-0-134-52 kubenswrapper[2558]: I0713 03:07:55.479077 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/25ab9eef-bfef-4f8b-a0a5-5fd5abe2f44e-istio-token\") pod \"maas-default-gateway-openshift-default-56654dcf7-pdpz9\" (UID: \"25ab9eef-bfef-4f8b-a0a5-5fd5abe2f44e\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-pdpz9" Jul 13 03:07:55.479119 ip-10-0-134-52 kubenswrapper[2558]: I0713 03:07:55.479098 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/25ab9eef-bfef-4f8b-a0a5-5fd5abe2f44e-istiod-ca-cert\") pod \"maas-default-gateway-openshift-default-56654dcf7-pdpz9\" (UID: \"25ab9eef-bfef-4f8b-a0a5-5fd5abe2f44e\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-pdpz9" Jul 13 03:07:55.479119 ip-10-0-134-52 kubenswrapper[2558]: I0713 03:07:55.479114 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-rxx5k\" (UniqueName: \"kubernetes.io/projected/25ab9eef-bfef-4f8b-a0a5-5fd5abe2f44e-kube-api-access-rxx5k\") pod \"maas-default-gateway-openshift-default-56654dcf7-pdpz9\" (UID: \"25ab9eef-bfef-4f8b-a0a5-5fd5abe2f44e\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-pdpz9" Jul 13 03:07:55.479399 ip-10-0-134-52 kubenswrapper[2558]: I0713 03:07:55.479194 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/25ab9eef-bfef-4f8b-a0a5-5fd5abe2f44e-credential-socket\") pod \"maas-default-gateway-openshift-default-56654dcf7-pdpz9\" (UID: \"25ab9eef-bfef-4f8b-a0a5-5fd5abe2f44e\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-pdpz9" Jul 13 03:07:55.479399 ip-10-0-134-52 kubenswrapper[2558]: I0713 03:07:55.479211 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/25ab9eef-bfef-4f8b-a0a5-5fd5abe2f44e-istio-podinfo\") pod \"maas-default-gateway-openshift-default-56654dcf7-pdpz9\" (UID: \"25ab9eef-bfef-4f8b-a0a5-5fd5abe2f44e\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-pdpz9" Jul 13 03:07:55.479399 ip-10-0-134-52 kubenswrapper[2558]: I0713 03:07:55.479240 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/25ab9eef-bfef-4f8b-a0a5-5fd5abe2f44e-workload-socket\") pod \"maas-default-gateway-openshift-default-56654dcf7-pdpz9\" (UID: \"25ab9eef-bfef-4f8b-a0a5-5fd5abe2f44e\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-pdpz9" Jul 13 03:07:55.479399 ip-10-0-134-52 kubenswrapper[2558]: I0713 03:07:55.479275 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/25ab9eef-bfef-4f8b-a0a5-5fd5abe2f44e-istio-data\") pod \"maas-default-gateway-openshift-default-56654dcf7-pdpz9\" (UID: \"25ab9eef-bfef-4f8b-a0a5-5fd5abe2f44e\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-pdpz9" Jul 13 03:07:55.479399 ip-10-0-134-52 kubenswrapper[2558]: I0713 03:07:55.479290 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/25ab9eef-bfef-4f8b-a0a5-5fd5abe2f44e-istio-envoy\") pod \"maas-default-gateway-openshift-default-56654dcf7-pdpz9\" (UID: \"25ab9eef-bfef-4f8b-a0a5-5fd5abe2f44e\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-pdpz9" Jul 13 03:07:55.580513 ip-10-0-134-52 kubenswrapper[2558]: I0713 03:07:55.580481 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/25ab9eef-bfef-4f8b-a0a5-5fd5abe2f44e-workload-socket\") pod \"maas-default-gateway-openshift-default-56654dcf7-pdpz9\" (UID: \"25ab9eef-bfef-4f8b-a0a5-5fd5abe2f44e\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-pdpz9" Jul 13 03:07:55.580652 ip-10-0-134-52 kubenswrapper[2558]: I0713 03:07:55.580546 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/25ab9eef-bfef-4f8b-a0a5-5fd5abe2f44e-istio-data\") pod \"maas-default-gateway-openshift-default-56654dcf7-pdpz9\" (UID: \"25ab9eef-bfef-4f8b-a0a5-5fd5abe2f44e\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-pdpz9" Jul 13 03:07:55.580652 ip-10-0-134-52 kubenswrapper[2558]: I0713 03:07:55.580579 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/25ab9eef-bfef-4f8b-a0a5-5fd5abe2f44e-istio-envoy\") pod \"maas-default-gateway-openshift-default-56654dcf7-pdpz9\" (UID: \"25ab9eef-bfef-4f8b-a0a5-5fd5abe2f44e\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-pdpz9" Jul 13 03:07:55.580652 ip-10-0-134-52 kubenswrapper[2558]: I0713 03:07:55.580631 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/25ab9eef-bfef-4f8b-a0a5-5fd5abe2f44e-workload-certs\") pod \"maas-default-gateway-openshift-default-56654dcf7-pdpz9\" (UID: \"25ab9eef-bfef-4f8b-a0a5-5fd5abe2f44e\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-pdpz9" Jul 13 03:07:55.580772 ip-10-0-134-52 kubenswrapper[2558]: I0713 03:07:55.580663 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/25ab9eef-bfef-4f8b-a0a5-5fd5abe2f44e-istio-token\") pod \"maas-default-gateway-openshift-default-56654dcf7-pdpz9\" (UID: \"25ab9eef-bfef-4f8b-a0a5-5fd5abe2f44e\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-pdpz9" Jul 13 03:07:55.580772 ip-10-0-134-52 kubenswrapper[2558]: I0713 03:07:55.580692 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/25ab9eef-bfef-4f8b-a0a5-5fd5abe2f44e-istiod-ca-cert\") pod \"maas-default-gateway-openshift-default-56654dcf7-pdpz9\" (UID: \"25ab9eef-bfef-4f8b-a0a5-5fd5abe2f44e\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-pdpz9" Jul 13 03:07:55.580772 ip-10-0-134-52 kubenswrapper[2558]: I0713 03:07:55.580717 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-rxx5k\" (UniqueName: \"kubernetes.io/projected/25ab9eef-bfef-4f8b-a0a5-5fd5abe2f44e-kube-api-access-rxx5k\") pod \"maas-default-gateway-openshift-default-56654dcf7-pdpz9\" (UID: \"25ab9eef-bfef-4f8b-a0a5-5fd5abe2f44e\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-pdpz9" Jul 13 03:07:55.580931 ip-10-0-134-52 kubenswrapper[2558]: I0713 03:07:55.580788 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/25ab9eef-bfef-4f8b-a0a5-5fd5abe2f44e-credential-socket\") pod \"maas-default-gateway-openshift-default-56654dcf7-pdpz9\" (UID: \"25ab9eef-bfef-4f8b-a0a5-5fd5abe2f44e\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-pdpz9" Jul 13 03:07:55.580931 ip-10-0-134-52 kubenswrapper[2558]: I0713 03:07:55.580824 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/25ab9eef-bfef-4f8b-a0a5-5fd5abe2f44e-istio-podinfo\") pod \"maas-default-gateway-openshift-default-56654dcf7-pdpz9\" (UID: \"25ab9eef-bfef-4f8b-a0a5-5fd5abe2f44e\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-pdpz9" Jul 13 03:07:55.581042 ip-10-0-134-52 kubenswrapper[2558]: I0713 03:07:55.580932 2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/25ab9eef-bfef-4f8b-a0a5-5fd5abe2f44e-workload-socket\") pod \"maas-default-gateway-openshift-default-56654dcf7-pdpz9\" (UID: \"25ab9eef-bfef-4f8b-a0a5-5fd5abe2f44e\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-pdpz9" Jul 13 03:07:55.581042 ip-10-0-134-52 kubenswrapper[2558]: I0713 03:07:55.580983 2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/25ab9eef-bfef-4f8b-a0a5-5fd5abe2f44e-istio-data\") pod \"maas-default-gateway-openshift-default-56654dcf7-pdpz9\" (UID: \"25ab9eef-bfef-4f8b-a0a5-5fd5abe2f44e\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-pdpz9" Jul 13 03:07:55.581146 ip-10-0-134-52 kubenswrapper[2558]: I0713 03:07:55.581103 2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/25ab9eef-bfef-4f8b-a0a5-5fd5abe2f44e-workload-certs\") pod \"maas-default-gateway-openshift-default-56654dcf7-pdpz9\" (UID: \"25ab9eef-bfef-4f8b-a0a5-5fd5abe2f44e\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-pdpz9" Jul 13 03:07:55.581301 ip-10-0-134-52 kubenswrapper[2558]: I0713 03:07:55.581278 2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/25ab9eef-bfef-4f8b-a0a5-5fd5abe2f44e-credential-socket\") pod \"maas-default-gateway-openshift-default-56654dcf7-pdpz9\" (UID: \"25ab9eef-bfef-4f8b-a0a5-5fd5abe2f44e\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-pdpz9" Jul 13 03:07:55.581496 ip-10-0-134-52 kubenswrapper[2558]: I0713 03:07:55.581476 2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/25ab9eef-bfef-4f8b-a0a5-5fd5abe2f44e-istiod-ca-cert\") pod \"maas-default-gateway-openshift-default-56654dcf7-pdpz9\" (UID: \"25ab9eef-bfef-4f8b-a0a5-5fd5abe2f44e\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-pdpz9" Jul 13 03:07:55.583038 ip-10-0-134-52 kubenswrapper[2558]: I0713 03:07:55.583020 2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/25ab9eef-bfef-4f8b-a0a5-5fd5abe2f44e-istio-envoy\") pod \"maas-default-gateway-openshift-default-56654dcf7-pdpz9\" (UID: \"25ab9eef-bfef-4f8b-a0a5-5fd5abe2f44e\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-pdpz9" Jul 13 03:07:55.583376 ip-10-0-134-52 kubenswrapper[2558]: I0713 03:07:55.583359 2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/25ab9eef-bfef-4f8b-a0a5-5fd5abe2f44e-istio-podinfo\") pod \"maas-default-gateway-openshift-default-56654dcf7-pdpz9\" (UID: \"25ab9eef-bfef-4f8b-a0a5-5fd5abe2f44e\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-pdpz9" Jul 13 03:07:55.588691 ip-10-0-134-52 kubenswrapper[2558]: I0713 03:07:55.588668 2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/25ab9eef-bfef-4f8b-a0a5-5fd5abe2f44e-istio-token\") pod \"maas-default-gateway-openshift-default-56654dcf7-pdpz9\" (UID: \"25ab9eef-bfef-4f8b-a0a5-5fd5abe2f44e\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-pdpz9" Jul 13 03:07:55.588938 ip-10-0-134-52 kubenswrapper[2558]: I0713 03:07:55.588918 2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-rxx5k\" (UniqueName: \"kubernetes.io/projected/25ab9eef-bfef-4f8b-a0a5-5fd5abe2f44e-kube-api-access-rxx5k\") pod \"maas-default-gateway-openshift-default-56654dcf7-pdpz9\" (UID: \"25ab9eef-bfef-4f8b-a0a5-5fd5abe2f44e\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-pdpz9" Jul 13 03:07:55.693220 ip-10-0-134-52 kubenswrapper[2558]: I0713 03:07:55.693198 2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-pdpz9" Jul 13 03:07:55.891036 ip-10-0-134-52 kubenswrapper[2558]: I0713 03:07:55.891009 2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-pdpz9"] Jul 13 03:07:55.892981 ip-10-0-134-52 kubenswrapper[2558]: W0713 03:07:55.892956 2558 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod25ab9eef_bfef_4f8b_a0a5_5fd5abe2f44e.slice/crio-c55d98d5dd1295f1f54851c5d93b5ec72f70773d8574a6c21aa41714844fd639 WatchSource:0}: Error finding container c55d98d5dd1295f1f54851c5d93b5ec72f70773d8574a6c21aa41714844fd639: Status 404 returned error can't find the container with id c55d98d5dd1295f1f54851c5d93b5ec72f70773d8574a6c21aa41714844fd639 Jul 13 03:07:55.895469 ip-10-0-134-52 kubenswrapper[2558]: I0713 03:07:55.895438 2558 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892164Ki","pods":"250"} Jul 13 03:07:55.895574 ip-10-0-134-52 kubenswrapper[2558]: I0713 03:07:55.895524 2558 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892164Ki","pods":"250"} Jul 13 03:07:55.895639 ip-10-0-134-52 kubenswrapper[2558]: I0713 03:07:55.895568 2558 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892164Ki","pods":"250"} Jul 13 03:07:55.923797 ip-10-0-134-52 kubenswrapper[2558]: I0713 03:07:55.923775 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-pdpz9" event={"ID":"25ab9eef-bfef-4f8b-a0a5-5fd5abe2f44e","Type":"ContainerStarted","Data":"c55d98d5dd1295f1f54851c5d93b5ec72f70773d8574a6c21aa41714844fd639"} Jul 13 03:07:56.932991 ip-10-0-134-52 kubenswrapper[2558]: I0713 03:07:56.932956 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-pdpz9" event={"ID":"25ab9eef-bfef-4f8b-a0a5-5fd5abe2f44e","Type":"ContainerStarted","Data":"826f9ade1d79d391e5e904b0a62c84fdfd725acb5d7f6787f11ad0bfc564f134"} Jul 13 03:07:56.955402 ip-10-0-134-52 kubenswrapper[2558]: I0713 03:07:56.955317 2558 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-pdpz9" podStartSLOduration=1.955304336 podStartE2EDuration="1.955304336s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-13 03:07:55 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-13 03:07:56.953523568 +0000 UTC m=+659.354124034" watchObservedRunningTime="2026-07-13 03:07:56.955304336 +0000 UTC m=+659.355904801" Jul 13 03:07:57.694075 ip-10-0-134-52 kubenswrapper[2558]: I0713 03:07:57.694041 2558 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-pdpz9" Jul 13 03:07:57.698633 ip-10-0-134-52 kubenswrapper[2558]: I0713 03:07:57.698610 2558 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-pdpz9" Jul 13 03:07:57.938799 ip-10-0-134-52 kubenswrapper[2558]: I0713 03:07:57.938765 2558 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-pdpz9" Jul 13 03:07:57.939613 ip-10-0-134-52 kubenswrapper[2558]: I0713 03:07:57.939589 2558 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-pdpz9" Jul 13 03:07:58.310109 ip-10-0-134-52 kubenswrapper[2558]: I0713 03:07:58.310080 2558 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-nq4gl"] Jul 13 03:07:58.323016 ip-10-0-134-52 kubenswrapper[2558]: I0713 03:07:58.322985 2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-nq4gl"] Jul 13 03:07:58.323147 ip-10-0-134-52 kubenswrapper[2558]: I0713 03:07:58.323037 2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-limitador-54d6d988d5-nq4gl" Jul 13 03:07:58.325681 ip-10-0-134-52 kubenswrapper[2558]: I0713 03:07:58.325663 2558 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"limitador-limits-config-limitador\"" Jul 13 03:07:58.338008 ip-10-0-134-52 kubenswrapper[2558]: I0713 03:07:58.337987 2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-nq4gl"] Jul 13 03:07:58.402654 ip-10-0-134-52 kubenswrapper[2558]: I0713 03:07:58.402627 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-file\" (UniqueName: \"kubernetes.io/configmap/b14362f9-1c59-4513-b306-291c6e73afc5-config-file\") pod \"limitador-limitador-54d6d988d5-nq4gl\" (UID: \"b14362f9-1c59-4513-b306-291c6e73afc5\") " pod="kuadrant-system/limitador-limitador-54d6d988d5-nq4gl" Jul 13 03:07:58.402762 ip-10-0-134-52 kubenswrapper[2558]: I0713 03:07:58.402679 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-4r5j7\" (UniqueName: \"kubernetes.io/projected/b14362f9-1c59-4513-b306-291c6e73afc5-kube-api-access-4r5j7\") pod \"limitador-limitador-54d6d988d5-nq4gl\" (UID: \"b14362f9-1c59-4513-b306-291c6e73afc5\") " pod="kuadrant-system/limitador-limitador-54d6d988d5-nq4gl" Jul 13 03:07:58.503247 ip-10-0-134-52 kubenswrapper[2558]: I0713 03:07:58.503220 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-file\" (UniqueName: \"kubernetes.io/configmap/b14362f9-1c59-4513-b306-291c6e73afc5-config-file\") pod \"limitador-limitador-54d6d988d5-nq4gl\" (UID: \"b14362f9-1c59-4513-b306-291c6e73afc5\") " pod="kuadrant-system/limitador-limitador-54d6d988d5-nq4gl" Jul 13 03:07:58.503384 ip-10-0-134-52 kubenswrapper[2558]: I0713 03:07:58.503267 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-4r5j7\" (UniqueName: \"kubernetes.io/projected/b14362f9-1c59-4513-b306-291c6e73afc5-kube-api-access-4r5j7\") pod \"limitador-limitador-54d6d988d5-nq4gl\" (UID: \"b14362f9-1c59-4513-b306-291c6e73afc5\") " pod="kuadrant-system/limitador-limitador-54d6d988d5-nq4gl" Jul 13 03:07:58.503818 ip-10-0-134-52 kubenswrapper[2558]: I0713 03:07:58.503800 2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config-file\" (UniqueName: \"kubernetes.io/configmap/b14362f9-1c59-4513-b306-291c6e73afc5-config-file\") pod \"limitador-limitador-54d6d988d5-nq4gl\" (UID: \"b14362f9-1c59-4513-b306-291c6e73afc5\") " pod="kuadrant-system/limitador-limitador-54d6d988d5-nq4gl" Jul 13 03:07:58.512165 ip-10-0-134-52 kubenswrapper[2558]: I0713 03:07:58.512134 2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-4r5j7\" (UniqueName: \"kubernetes.io/projected/b14362f9-1c59-4513-b306-291c6e73afc5-kube-api-access-4r5j7\") pod \"limitador-limitador-54d6d988d5-nq4gl\" (UID: \"b14362f9-1c59-4513-b306-291c6e73afc5\") " pod="kuadrant-system/limitador-limitador-54d6d988d5-nq4gl" Jul 13 03:07:58.635202 ip-10-0-134-52 kubenswrapper[2558]: I0713 03:07:58.635138 2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-limitador-54d6d988d5-nq4gl" Jul 13 03:07:58.762032 ip-10-0-134-52 kubenswrapper[2558]: I0713 03:07:58.762004 2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-nq4gl"] Jul 13 03:07:58.763254 ip-10-0-134-52 kubenswrapper[2558]: W0713 03:07:58.763230 2558 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podb14362f9_1c59_4513_b306_291c6e73afc5.slice/crio-c1be18a8a01324ac296aad01db4cc1c0246a43e4538d81fb7abd9a7028968c22 WatchSource:0}: Error finding container c1be18a8a01324ac296aad01db4cc1c0246a43e4538d81fb7abd9a7028968c22: Status 404 returned error can't find the container with id c1be18a8a01324ac296aad01db4cc1c0246a43e4538d81fb7abd9a7028968c22 Jul 13 03:07:58.945752 ip-10-0-134-52 kubenswrapper[2558]: I0713 03:07:58.945659 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-limitador-54d6d988d5-nq4gl" event={"ID":"b14362f9-1c59-4513-b306-291c6e73afc5","Type":"ContainerStarted","Data":"c1be18a8a01324ac296aad01db4cc1c0246a43e4538d81fb7abd9a7028968c22"} Jul 13 03:08:01.964223 ip-10-0-134-52 kubenswrapper[2558]: I0713 03:08:01.964192 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-limitador-54d6d988d5-nq4gl" event={"ID":"b14362f9-1c59-4513-b306-291c6e73afc5","Type":"ContainerStarted","Data":"825671cffaa1f041b1fa81797d4284ac4bb25ef4accaafd24c339bc33a2fc79f"} Jul 13 03:08:01.964665 ip-10-0-134-52 kubenswrapper[2558]: I0713 03:08:01.964311 2558 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/limitador-limitador-54d6d988d5-nq4gl" Jul 13 03:08:01.988144 ip-10-0-134-52 kubenswrapper[2558]: I0713 03:08:01.988087 2558 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/limitador-limitador-54d6d988d5-nq4gl" podStartSLOduration=1.365340677 podStartE2EDuration="3.988073583s" totalImagesPullingTime="2.622732906s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-13 03:07:58 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-13 03:08:01.985169579 +0000 UTC m=+664.385770046" watchObservedRunningTime="2026-07-13 03:08:01.988073583 +0000 UTC m=+664.388674086" Jul 13 03:08:12.970675 ip-10-0-134-52 kubenswrapper[2558]: I0713 03:08:12.970649 2558 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/limitador-limitador-54d6d988d5-nq4gl" Jul 13 03:09:09.931200 ip-10-0-134-52 kubenswrapper[2558]: I0713 03:09:09.931112 2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-nq4gl"] Jul 13 03:09:17.361250 ip-10-0-134-52 kubenswrapper[2558]: I0713 03:09:17.361184 2558 generic.go:356] "Generic (PLEG): container finished" podID="25ab9eef-bfef-4f8b-a0a5-5fd5abe2f44e" containerID="826f9ade1d79d391e5e904b0a62c84fdfd725acb5d7f6787f11ad0bfc564f134" exitCode=0 Jul 13 03:09:17.361729 ip-10-0-134-52 kubenswrapper[2558]: I0713 03:09:17.361266 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-pdpz9" event={"ID":"25ab9eef-bfef-4f8b-a0a5-5fd5abe2f44e","Type":"ContainerDied","Data":"826f9ade1d79d391e5e904b0a62c84fdfd725acb5d7f6787f11ad0bfc564f134"} Jul 13 03:09:17.361795 ip-10-0-134-52 kubenswrapper[2558]: I0713 03:09:17.361765 2558 scope.go:117] "RemoveContainer" containerID="826f9ade1d79d391e5e904b0a62c84fdfd725acb5d7f6787f11ad0bfc564f134" Jul 13 03:09:17.362838 ip-10-0-134-52 kubenswrapper[2558]: I0713 03:09:17.362813 2558 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892164Ki","pods":"250"} Jul 13 03:09:17.362914 ip-10-0-134-52 kubenswrapper[2558]: I0713 03:09:17.362885 2558 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892164Ki","pods":"250"} Jul 13 03:09:17.362969 ip-10-0-134-52 kubenswrapper[2558]: I0713 03:09:17.362920 2558 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892164Ki","pods":"250"} Jul 13 03:09:18.368049 ip-10-0-134-52 kubenswrapper[2558]: I0713 03:09:18.368015 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-pdpz9" event={"ID":"25ab9eef-bfef-4f8b-a0a5-5fd5abe2f44e","Type":"ContainerStarted","Data":"7a241e7805376a821cdec460139f7f217056ee36d281338528799fa30f70eb95"} Jul 13 03:09:18.694310 ip-10-0-134-52 kubenswrapper[2558]: I0713 03:09:18.694206 2558 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-pdpz9" Jul 13 03:09:18.694514 ip-10-0-134-52 kubenswrapper[2558]: I0713 03:09:18.694359 2558 patch_prober.go:28] interesting pod/maas-default-gateway-openshift-default-56654dcf7-pdpz9 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.46:15021/healthz/ready\": dial tcp 10.133.0.46:15021: connect: connection refused" start-of-body= Jul 13 03:09:18.694514 ip-10-0-134-52 kubenswrapper[2558]: I0713 03:09:18.694414 2558 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-pdpz9" podUID="25ab9eef-bfef-4f8b-a0a5-5fd5abe2f44e" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.46:15021/healthz/ready\": dial tcp 10.133.0.46:15021: connect: connection refused" Jul 13 03:09:19.694161 ip-10-0-134-52 kubenswrapper[2558]: I0713 03:09:19.694124 2558 patch_prober.go:28] interesting pod/maas-default-gateway-openshift-default-56654dcf7-pdpz9 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.46:15021/healthz/ready\": dial tcp 10.133.0.46:15021: connect: connection refused" start-of-body= Jul 13 03:09:19.694775 ip-10-0-134-52 kubenswrapper[2558]: I0713 03:09:19.694740 2558 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-pdpz9" podUID="25ab9eef-bfef-4f8b-a0a5-5fd5abe2f44e" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.46:15021/healthz/ready\": dial tcp 10.133.0.46:15021: connect: connection refused" Jul 13 03:09:20.694041 ip-10-0-134-52 kubenswrapper[2558]: I0713 03:09:20.693588 2558 patch_prober.go:28] interesting pod/maas-default-gateway-openshift-default-56654dcf7-pdpz9 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.46:15021/healthz/ready\": dial tcp 10.133.0.46:15021: connect: connection refused" start-of-body= Jul 13 03:09:20.694041 ip-10-0-134-52 kubenswrapper[2558]: I0713 03:09:20.693646 2558 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-pdpz9" podUID="25ab9eef-bfef-4f8b-a0a5-5fd5abe2f44e" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.46:15021/healthz/ready\": dial tcp 10.133.0.46:15021: connect: connection refused" Jul 13 03:09:21.693819 ip-10-0-134-52 kubenswrapper[2558]: I0713 03:09:21.693771 2558 patch_prober.go:28] interesting pod/maas-default-gateway-openshift-default-56654dcf7-pdpz9 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.46:15021/healthz/ready\": dial tcp 10.133.0.46:15021: connect: connection refused" start-of-body= Jul 13 03:09:21.694020 ip-10-0-134-52 kubenswrapper[2558]: I0713 03:09:21.693852 2558 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-pdpz9" podUID="25ab9eef-bfef-4f8b-a0a5-5fd5abe2f44e" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.46:15021/healthz/ready\": dial tcp 10.133.0.46:15021: connect: connection refused" Jul 13 03:09:22.697355 ip-10-0-134-52 kubenswrapper[2558]: I0713 03:09:22.697309 2558 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-pdpz9" Jul 13 03:09:22.697734 ip-10-0-134-52 kubenswrapper[2558]: I0713 03:09:22.697719 2558 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-pdpz9" Jul 13 03:09:22.698293 ip-10-0-134-52 kubenswrapper[2558]: I0713 03:09:22.698275 2558 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-pdpz9" Jul 13 03:09:25.054988 ip-10-0-134-52 kubenswrapper[2558]: I0713 03:09:25.054954 2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-nq4gl"] Jul 13 03:09:38.947239 ip-10-0-134-52 kubenswrapper[2558]: I0713 03:09:38.947205 2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-nq4gl"] Jul 13 03:09:46.152416 ip-10-0-134-52 kubenswrapper[2558]: I0713 03:09:46.152382 2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-nq4gl"] Jul 13 03:09:56.244240 ip-10-0-134-52 kubenswrapper[2558]: I0713 03:09:56.244196 2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-nq4gl"] Jul 13 03:10:10.842882 ip-10-0-134-52 kubenswrapper[2558]: I0713 03:10:10.842849 2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-nq4gl"] Jul 13 03:10:22.045355 ip-10-0-134-52 kubenswrapper[2558]: I0713 03:10:22.045261 2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-nq4gl"] Jul 13 03:11:47.455399 ip-10-0-134-52 kubenswrapper[2558]: I0713 03:11:47.455363 2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-nq4gl"] Jul 13 03:11:56.467028 ip-10-0-134-52 kubenswrapper[2558]: I0713 03:11:56.466956 2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-nq4gl"] Jul 13 03:12:08.250795 ip-10-0-134-52 kubenswrapper[2558]: I0713 03:12:08.250763 2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-nq4gl"] Jul 13 03:12:16.946775 ip-10-0-134-52 kubenswrapper[2558]: I0713 03:12:16.946740 2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-nq4gl"] Jul 13 03:12:27.645099 ip-10-0-134-52 kubenswrapper[2558]: I0713 03:12:27.645063 2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-nq4gl"] Jul 13 03:12:53.258428 ip-10-0-134-52 kubenswrapper[2558]: I0713 03:12:53.258396 2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-nq4gl"] Jul 13 03:13:06.550599 ip-10-0-134-52 kubenswrapper[2558]: I0713 03:13:06.550553 2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-nq4gl"] Jul 13 03:13:40.443649 ip-10-0-134-52 kubenswrapper[2558]: I0713 03:13:40.443618 2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-nq4gl"] Jul 13 03:13:50.142256 ip-10-0-134-52 kubenswrapper[2558]: I0713 03:13:50.142220 2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-nq4gl"] Jul 13 03:14:00.344983 ip-10-0-134-52 kubenswrapper[2558]: I0713 03:14:00.344942 2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-nq4gl"] Jul 13 03:14:10.844608 ip-10-0-134-52 kubenswrapper[2558]: I0713 03:14:10.844573 2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-nq4gl"] Jul 13 03:14:19.358132 ip-10-0-134-52 kubenswrapper[2558]: I0713 03:14:19.358098 2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-nq4gl"] Jul 13 03:14:28.651348 ip-10-0-134-52 kubenswrapper[2558]: I0713 03:14:28.651296 2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-nq4gl"] Jul 13 03:14:39.144643 ip-10-0-134-52 kubenswrapper[2558]: I0713 03:14:39.144610 2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-nq4gl"] Jul 13 03:14:49.345583 ip-10-0-134-52 kubenswrapper[2558]: I0713 03:14:49.345505 2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-nq4gl"] Jul 13 03:15:00.133730 ip-10-0-134-52 kubenswrapper[2558]: I0713 03:15:00.133700 2558 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-29731875-xszp7"] Jul 13 03:15:00.137127 ip-10-0-134-52 kubenswrapper[2558]: I0713 03:15:00.137107 2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29731875-xszp7" Jul 13 03:15:00.139902 ip-10-0-134-52 kubenswrapper[2558]: I0713 03:15:00.139884 2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-cleanup-dockercfg-5q45t\"" Jul 13 03:15:00.146807 ip-10-0-134-52 kubenswrapper[2558]: I0713 03:15:00.146790 2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29731875-xszp7" Jul 13 03:15:00.153622 ip-10-0-134-52 kubenswrapper[2558]: I0713 03:15:00.153599 2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-29731875-xszp7"] Jul 13 03:15:00.285007 ip-10-0-134-52 kubenswrapper[2558]: I0713 03:15:00.284980 2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-29731875-xszp7"] Jul 13 03:15:00.286683 ip-10-0-134-52 kubenswrapper[2558]: W0713 03:15:00.286656 2558 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podea05c0d3_0cb3_40e0_b857_1816dd846f8d.slice/crio-388211874d512785476ec4795d05693fb8f06709926afb2328e59d13071d89b2 WatchSource:0}: Error finding container 388211874d512785476ec4795d05693fb8f06709926afb2328e59d13071d89b2: Status 404 returned error can't find the container with id 388211874d512785476ec4795d05693fb8f06709926afb2328e59d13071d89b2 Jul 13 03:15:00.288677 ip-10-0-134-52 kubenswrapper[2558]: I0713 03:15:00.288658 2558 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider Jul 13 03:15:01.194208 ip-10-0-134-52 kubenswrapper[2558]: I0713 03:15:01.194170 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29731875-xszp7" event={"ID":"ea05c0d3-0cb3-40e0-b857-1816dd846f8d","Type":"ContainerStarted","Data":"388211874d512785476ec4795d05693fb8f06709926afb2328e59d13071d89b2"} Jul 13 03:15:03.206905 ip-10-0-134-52 kubenswrapper[2558]: I0713 03:15:03.206815 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29731875-xszp7" event={"ID":"ea05c0d3-0cb3-40e0-b857-1816dd846f8d","Type":"ContainerStarted","Data":"98a66469787c75db8559cbe0f08b81105e6a31cb31488ceafa0d4db9ed5e37d7"} Jul 13 03:15:03.222938 ip-10-0-134-52 kubenswrapper[2558]: I0713 03:15:03.222884 2558 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29731875-xszp7" podStartSLOduration=0.947435363 podStartE2EDuration="3.22286858s" totalImagesPullingTime="2.275433217s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-13 03:15:00 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-13 03:15:03.222081118 +0000 UTC m=+1085.622681588" watchObservedRunningTime="2026-07-13 03:15:03.22286858 +0000 UTC m=+1085.623469046" Jul 13 03:15:11.438257 ip-10-0-134-52 kubenswrapper[2558]: I0713 03:15:11.438226 2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-nq4gl"] Jul 13 03:15:23.248846 ip-10-0-134-52 kubenswrapper[2558]: I0713 03:15:23.248810 2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-nq4gl"] Jul 13 03:15:46.248825 ip-10-0-134-52 kubenswrapper[2558]: I0713 03:15:46.248784 2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-nq4gl"] Jul 13 03:15:55.354877 ip-10-0-134-52 kubenswrapper[2558]: I0713 03:15:55.354837 2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-nq4gl"] Jul 13 03:16:00.010775 ip-10-0-134-52 kubenswrapper[2558]: I0713 03:16:00.010739 2558 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-29731875-xszp7"] Jul 13 03:16:00.011197 ip-10-0-134-52 kubenswrapper[2558]: I0713 03:16:00.010932 2558 kuberuntime_container.go:873] "Killing container with a grace period" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29731875-xszp7" podUID="ea05c0d3-0cb3-40e0-b857-1816dd846f8d" containerName="cleanup" containerID="cri-o://98a66469787c75db8559cbe0f08b81105e6a31cb31488ceafa0d4db9ed5e37d7" gracePeriod=30 Jul 13 03:16:11.442854 ip-10-0-134-52 kubenswrapper[2558]: I0713 03:16:11.442822 2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-nq4gl"] Jul 13 03:16:22.749663 ip-10-0-134-52 kubenswrapper[2558]: I0713 03:16:22.749582 2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-nq4gl"] Jul 13 03:16:30.208351 ip-10-0-134-52 kubenswrapper[2558]: I0713 03:16:30.208306 2558 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29731875-xszp7" Jul 13 03:16:30.690638 ip-10-0-134-52 kubenswrapper[2558]: I0713 03:16:30.690604 2558 generic.go:356] "Generic (PLEG): container finished" podID="ea05c0d3-0cb3-40e0-b857-1816dd846f8d" containerID="98a66469787c75db8559cbe0f08b81105e6a31cb31488ceafa0d4db9ed5e37d7" exitCode=137 Jul 13 03:16:30.690638 ip-10-0-134-52 kubenswrapper[2558]: I0713 03:16:30.690641 2558 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29731875-xszp7" Jul 13 03:16:30.690898 ip-10-0-134-52 kubenswrapper[2558]: I0713 03:16:30.690689 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29731875-xszp7" event={"ID":"ea05c0d3-0cb3-40e0-b857-1816dd846f8d","Type":"ContainerDied","Data":"98a66469787c75db8559cbe0f08b81105e6a31cb31488ceafa0d4db9ed5e37d7"} Jul 13 03:16:30.690898 ip-10-0-134-52 kubenswrapper[2558]: I0713 03:16:30.690736 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29731875-xszp7" event={"ID":"ea05c0d3-0cb3-40e0-b857-1816dd846f8d","Type":"ContainerDied","Data":"388211874d512785476ec4795d05693fb8f06709926afb2328e59d13071d89b2"} Jul 13 03:16:30.690898 ip-10-0-134-52 kubenswrapper[2558]: I0713 03:16:30.690761 2558 scope.go:117] "RemoveContainer" containerID="98a66469787c75db8559cbe0f08b81105e6a31cb31488ceafa0d4db9ed5e37d7" Jul 13 03:16:30.700505 ip-10-0-134-52 kubenswrapper[2558]: I0713 03:16:30.700485 2558 scope.go:117] "RemoveContainer" containerID="98a66469787c75db8559cbe0f08b81105e6a31cb31488ceafa0d4db9ed5e37d7" Jul 13 03:16:30.700762 ip-10-0-134-52 kubenswrapper[2558]: E0713 03:16:30.700744 2558 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"98a66469787c75db8559cbe0f08b81105e6a31cb31488ceafa0d4db9ed5e37d7\": container with ID starting with 98a66469787c75db8559cbe0f08b81105e6a31cb31488ceafa0d4db9ed5e37d7 not found: ID does not exist" containerID="98a66469787c75db8559cbe0f08b81105e6a31cb31488ceafa0d4db9ed5e37d7" Jul 13 03:16:30.700821 ip-10-0-134-52 kubenswrapper[2558]: I0713 03:16:30.700770 2558 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"98a66469787c75db8559cbe0f08b81105e6a31cb31488ceafa0d4db9ed5e37d7"} err="failed to get container status \"98a66469787c75db8559cbe0f08b81105e6a31cb31488ceafa0d4db9ed5e37d7\": rpc error: code = NotFound desc = could not find container \"98a66469787c75db8559cbe0f08b81105e6a31cb31488ceafa0d4db9ed5e37d7\": container with ID starting with 98a66469787c75db8559cbe0f08b81105e6a31cb31488ceafa0d4db9ed5e37d7 not found: ID does not exist" Jul 13 03:16:30.712745 ip-10-0-134-52 kubenswrapper[2558]: I0713 03:16:30.712725 2558 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-29731875-xszp7"] Jul 13 03:16:30.714943 ip-10-0-134-52 kubenswrapper[2558]: I0713 03:16:30.714922 2558 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-29731875-xszp7"] Jul 13 03:16:32.094856 ip-10-0-134-52 kubenswrapper[2558]: I0713 03:16:32.094822 2558 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="ea05c0d3-0cb3-40e0-b857-1816dd846f8d" path="/var/lib/kubelet/pods/ea05c0d3-0cb3-40e0-b857-1816dd846f8d/volumes" Jul 13 03:16:32.140865 ip-10-0-134-52 kubenswrapper[2558]: I0713 03:16:32.140833 2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-nq4gl"] Jul 13 03:16:41.345019 ip-10-0-134-52 kubenswrapper[2558]: I0713 03:16:41.344984 2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-nq4gl"] Jul 13 03:16:50.849083 ip-10-0-134-52 kubenswrapper[2558]: I0713 03:16:50.849048 2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-nq4gl"] Jul 13 03:17:16.616537 ip-10-0-134-52 kubenswrapper[2558]: I0713 03:17:16.616499 2558 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-86878c769f-zfb6m"] Jul 13 03:17:16.617102 ip-10-0-134-52 kubenswrapper[2558]: I0713 03:17:16.616735 2558 kuberuntime_container.go:873] "Killing container with a grace period" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-zfb6m" podUID="01f95c5d-9949-44ed-9165-ce388db14fe2" containerName="manager" containerID="cri-o://5032150ad34517a9c38003bc28b392f7ee3a53385397a986df52d434d405a0f4" gracePeriod=10 Jul 13 03:17:19.780340 ip-10-0-134-52 kubenswrapper[2558]: I0713 03:17:19.780305 2558 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-zfb6m" Jul 13 03:17:19.842739 ip-10-0-134-52 kubenswrapper[2558]: I0713 03:17:19.842659 2558 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/01f95c5d-9949-44ed-9165-ce388db14fe2-extensions-socket-volume\") pod \"01f95c5d-9949-44ed-9165-ce388db14fe2\" (UID: \"01f95c5d-9949-44ed-9165-ce388db14fe2\") " Jul 13 03:17:19.842739 ip-10-0-134-52 kubenswrapper[2558]: I0713 03:17:19.842717 2558 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-gbgh8\" (UniqueName: \"kubernetes.io/projected/01f95c5d-9949-44ed-9165-ce388db14fe2-kube-api-access-gbgh8\") pod \"01f95c5d-9949-44ed-9165-ce388db14fe2\" (UID: \"01f95c5d-9949-44ed-9165-ce388db14fe2\") " Jul 13 03:17:19.843064 ip-10-0-134-52 kubenswrapper[2558]: I0713 03:17:19.843039 2558 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/01f95c5d-9949-44ed-9165-ce388db14fe2-extensions-socket-volume" (OuterVolumeSpecName: "extensions-socket-volume") pod "01f95c5d-9949-44ed-9165-ce388db14fe2" (UID: "01f95c5d-9949-44ed-9165-ce388db14fe2"). InnerVolumeSpecName "extensions-socket-volume". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 13 03:17:19.844746 ip-10-0-134-52 kubenswrapper[2558]: I0713 03:17:19.844715 2558 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/01f95c5d-9949-44ed-9165-ce388db14fe2-kube-api-access-gbgh8" (OuterVolumeSpecName: "kube-api-access-gbgh8") pod "01f95c5d-9949-44ed-9165-ce388db14fe2" (UID: "01f95c5d-9949-44ed-9165-ce388db14fe2"). InnerVolumeSpecName "kube-api-access-gbgh8". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 13 03:17:19.943966 ip-10-0-134-52 kubenswrapper[2558]: I0713 03:17:19.943943 2558 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-gbgh8\" (UniqueName: \"kubernetes.io/projected/01f95c5d-9949-44ed-9165-ce388db14fe2-kube-api-access-gbgh8\") on node \"ip-10-0-134-52.ec2.internal\" DevicePath \"\"" Jul 13 03:17:19.943966 ip-10-0-134-52 kubenswrapper[2558]: I0713 03:17:19.943964 2558 reconciler_common.go:299] "Volume detached for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/01f95c5d-9949-44ed-9165-ce388db14fe2-extensions-socket-volume\") on node \"ip-10-0-134-52.ec2.internal\" DevicePath \"\"" Jul 13 03:17:19.955642 ip-10-0-134-52 kubenswrapper[2558]: I0713 03:17:19.955618 2558 generic.go:356] "Generic (PLEG): container finished" podID="01f95c5d-9949-44ed-9165-ce388db14fe2" containerID="5032150ad34517a9c38003bc28b392f7ee3a53385397a986df52d434d405a0f4" exitCode=0 Jul 13 03:17:19.955736 ip-10-0-134-52 kubenswrapper[2558]: I0713 03:17:19.955662 2558 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-zfb6m" Jul 13 03:17:19.955778 ip-10-0-134-52 kubenswrapper[2558]: I0713 03:17:19.955657 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-zfb6m" event={"ID":"01f95c5d-9949-44ed-9165-ce388db14fe2","Type":"ContainerDied","Data":"5032150ad34517a9c38003bc28b392f7ee3a53385397a986df52d434d405a0f4"} Jul 13 03:17:19.955850 ip-10-0-134-52 kubenswrapper[2558]: I0713 03:17:19.955779 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-zfb6m" event={"ID":"01f95c5d-9949-44ed-9165-ce388db14fe2","Type":"ContainerDied","Data":"24824ffc401581f6ec748bb0bb11eb0880a7bc127475bda2b5713a28adf35cf9"} Jul 13 03:17:19.955850 ip-10-0-134-52 kubenswrapper[2558]: I0713 03:17:19.955809 2558 scope.go:117] "RemoveContainer" containerID="5032150ad34517a9c38003bc28b392f7ee3a53385397a986df52d434d405a0f4" Jul 13 03:17:19.966117 ip-10-0-134-52 kubenswrapper[2558]: I0713 03:17:19.966098 2558 scope.go:117] "RemoveContainer" containerID="5032150ad34517a9c38003bc28b392f7ee3a53385397a986df52d434d405a0f4" Jul 13 03:17:19.966383 ip-10-0-134-52 kubenswrapper[2558]: E0713 03:17:19.966361 2558 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"5032150ad34517a9c38003bc28b392f7ee3a53385397a986df52d434d405a0f4\": container with ID starting with 5032150ad34517a9c38003bc28b392f7ee3a53385397a986df52d434d405a0f4 not found: ID does not exist" containerID="5032150ad34517a9c38003bc28b392f7ee3a53385397a986df52d434d405a0f4" Jul 13 03:17:19.966439 ip-10-0-134-52 kubenswrapper[2558]: I0713 03:17:19.966390 2558 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"5032150ad34517a9c38003bc28b392f7ee3a53385397a986df52d434d405a0f4"} err="failed to get container status \"5032150ad34517a9c38003bc28b392f7ee3a53385397a986df52d434d405a0f4\": rpc error: code = NotFound desc = could not find container \"5032150ad34517a9c38003bc28b392f7ee3a53385397a986df52d434d405a0f4\": container with ID starting with 5032150ad34517a9c38003bc28b392f7ee3a53385397a986df52d434d405a0f4 not found: ID does not exist" Jul 13 03:17:19.984291 ip-10-0-134-52 kubenswrapper[2558]: I0713 03:17:19.984223 2558 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-86878c769f-zfb6m"] Jul 13 03:17:19.986736 ip-10-0-134-52 kubenswrapper[2558]: I0713 03:17:19.986716 2558 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-86878c769f-zfb6m"] Jul 13 03:17:20.093022 ip-10-0-134-52 kubenswrapper[2558]: I0713 03:17:20.092952 2558 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="01f95c5d-9949-44ed-9165-ce388db14fe2" path="/var/lib/kubelet/pods/01f95c5d-9949-44ed-9165-ce388db14fe2/volumes" Jul 13 03:18:17.744062 ip-10-0-134-52 kubenswrapper[2558]: I0713 03:18:17.744026 2558 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-86878c769f-fvgqp"] Jul 13 03:18:17.744476 ip-10-0-134-52 kubenswrapper[2558]: I0713 03:18:17.744417 2558 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="ea05c0d3-0cb3-40e0-b857-1816dd846f8d" containerName="cleanup" Jul 13 03:18:17.744476 ip-10-0-134-52 kubenswrapper[2558]: I0713 03:18:17.744431 2558 state_mem.go:107] "Deleted CPUSet assignment" podUID="ea05c0d3-0cb3-40e0-b857-1816dd846f8d" containerName="cleanup" Jul 13 03:18:17.744476 ip-10-0-134-52 kubenswrapper[2558]: I0713 03:18:17.744450 2558 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="01f95c5d-9949-44ed-9165-ce388db14fe2" containerName="manager" Jul 13 03:18:17.744476 ip-10-0-134-52 kubenswrapper[2558]: I0713 03:18:17.744460 2558 state_mem.go:107] "Deleted CPUSet assignment" podUID="01f95c5d-9949-44ed-9165-ce388db14fe2" containerName="manager" Jul 13 03:18:17.744618 ip-10-0-134-52 kubenswrapper[2558]: I0713 03:18:17.744531 2558 memory_manager.go:368] "RemoveStaleState removing state" podUID="01f95c5d-9949-44ed-9165-ce388db14fe2" containerName="manager" Jul 13 03:18:17.744618 ip-10-0-134-52 kubenswrapper[2558]: I0713 03:18:17.744548 2558 memory_manager.go:368] "RemoveStaleState removing state" podUID="ea05c0d3-0cb3-40e0-b857-1816dd846f8d" containerName="cleanup" Jul 13 03:18:17.748768 ip-10-0-134-52 kubenswrapper[2558]: I0713 03:18:17.748750 2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-fvgqp" Jul 13 03:18:17.751883 ip-10-0-134-52 kubenswrapper[2558]: I0713 03:18:17.751862 2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"kuadrant-operator-controller-manager-dockercfg-kjmrl\"" Jul 13 03:18:17.759564 ip-10-0-134-52 kubenswrapper[2558]: I0713 03:18:17.759543 2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-86878c769f-fvgqp"] Jul 13 03:18:17.891590 ip-10-0-134-52 kubenswrapper[2558]: I0713 03:18:17.891565 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-b7ttk\" (UniqueName: \"kubernetes.io/projected/aca7cb73-3ce6-4fbb-88b3-4d59d4802a3a-kube-api-access-b7ttk\") pod \"kuadrant-operator-controller-manager-86878c769f-fvgqp\" (UID: \"aca7cb73-3ce6-4fbb-88b3-4d59d4802a3a\") " pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-fvgqp" Jul 13 03:18:17.891733 ip-10-0-134-52 kubenswrapper[2558]: I0713 03:18:17.891605 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/aca7cb73-3ce6-4fbb-88b3-4d59d4802a3a-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-86878c769f-fvgqp\" (UID: \"aca7cb73-3ce6-4fbb-88b3-4d59d4802a3a\") " pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-fvgqp" Jul 13 03:18:17.992209 ip-10-0-134-52 kubenswrapper[2558]: I0713 03:18:17.992180 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-b7ttk\" (UniqueName: \"kubernetes.io/projected/aca7cb73-3ce6-4fbb-88b3-4d59d4802a3a-kube-api-access-b7ttk\") pod \"kuadrant-operator-controller-manager-86878c769f-fvgqp\" (UID: \"aca7cb73-3ce6-4fbb-88b3-4d59d4802a3a\") " pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-fvgqp" Jul 13 03:18:17.992315 ip-10-0-134-52 kubenswrapper[2558]: I0713 03:18:17.992220 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/aca7cb73-3ce6-4fbb-88b3-4d59d4802a3a-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-86878c769f-fvgqp\" (UID: \"aca7cb73-3ce6-4fbb-88b3-4d59d4802a3a\") " pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-fvgqp" Jul 13 03:18:17.992640 ip-10-0-134-52 kubenswrapper[2558]: I0713 03:18:17.992622 2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/aca7cb73-3ce6-4fbb-88b3-4d59d4802a3a-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-86878c769f-fvgqp\" (UID: \"aca7cb73-3ce6-4fbb-88b3-4d59d4802a3a\") " pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-fvgqp" Jul 13 03:18:18.001113 ip-10-0-134-52 kubenswrapper[2558]: I0713 03:18:18.001061 2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-b7ttk\" (UniqueName: \"kubernetes.io/projected/aca7cb73-3ce6-4fbb-88b3-4d59d4802a3a-kube-api-access-b7ttk\") pod \"kuadrant-operator-controller-manager-86878c769f-fvgqp\" (UID: \"aca7cb73-3ce6-4fbb-88b3-4d59d4802a3a\") " pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-fvgqp" Jul 13 03:18:18.058802 ip-10-0-134-52 kubenswrapper[2558]: I0713 03:18:18.058780 2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-fvgqp" Jul 13 03:18:18.195416 ip-10-0-134-52 kubenswrapper[2558]: I0713 03:18:18.195290 2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-86878c769f-fvgqp"] Jul 13 03:18:18.198007 ip-10-0-134-52 kubenswrapper[2558]: W0713 03:18:18.197968 2558 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podaca7cb73_3ce6_4fbb_88b3_4d59d4802a3a.slice/crio-c0ca2bdd3519ae6c87e9db07e49d38f1bd1bbd411c886c1660eced3deac3836b WatchSource:0}: Error finding container c0ca2bdd3519ae6c87e9db07e49d38f1bd1bbd411c886c1660eced3deac3836b: Status 404 returned error can't find the container with id c0ca2bdd3519ae6c87e9db07e49d38f1bd1bbd411c886c1660eced3deac3836b Jul 13 03:18:18.274946 ip-10-0-134-52 kubenswrapper[2558]: I0713 03:18:18.274909 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-fvgqp" event={"ID":"aca7cb73-3ce6-4fbb-88b3-4d59d4802a3a","Type":"ContainerStarted","Data":"676fad8bb7e54114ffda8008b0c84eaa1588dec52afcd73760155fe028dbb9d1"} Jul 13 03:18:18.275100 ip-10-0-134-52 kubenswrapper[2558]: I0713 03:18:18.274976 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-fvgqp" event={"ID":"aca7cb73-3ce6-4fbb-88b3-4d59d4802a3a","Type":"ContainerStarted","Data":"c0ca2bdd3519ae6c87e9db07e49d38f1bd1bbd411c886c1660eced3deac3836b"} Jul 13 03:18:18.275100 ip-10-0-134-52 kubenswrapper[2558]: I0713 03:18:18.275006 2558 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-fvgqp" Jul 13 03:18:18.293230 ip-10-0-134-52 kubenswrapper[2558]: I0713 03:18:18.293188 2558 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-fvgqp" podStartSLOduration=1.2931732409999999 podStartE2EDuration="1.293173241s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-13 03:18:17 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-13 03:18:18.292697311 +0000 UTC m=+1280.693297794" watchObservedRunningTime="2026-07-13 03:18:18.293173241 +0000 UTC m=+1280.693773706" Jul 13 03:18:29.282202 ip-10-0-134-52 kubenswrapper[2558]: I0713 03:18:29.282175 2558 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-fvgqp" Jul 13 03:18:38.547813 ip-10-0-134-52 kubenswrapper[2558]: I0713 03:18:38.547782 2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-nq4gl"] Jul 13 03:18:47.551713 ip-10-0-134-52 kubenswrapper[2558]: I0713 03:18:47.551678 2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-nq4gl"] Jul 13 03:19:00.547652 ip-10-0-134-52 kubenswrapper[2558]: I0713 03:19:00.547622 2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-nq4gl"] Jul 13 03:19:11.952928 ip-10-0-134-52 kubenswrapper[2558]: I0713 03:19:11.952894 2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-nq4gl"] Jul 13 03:19:21.645805 ip-10-0-134-52 kubenswrapper[2558]: I0713 03:19:21.645775 2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-nq4gl"] Jul 13 03:19:32.544782 ip-10-0-134-52 kubenswrapper[2558]: I0713 03:19:32.544733 2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-nq4gl"] Jul 13 03:19:42.743525 ip-10-0-134-52 kubenswrapper[2558]: I0713 03:19:42.743493 2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-nq4gl"] Jul 13 03:19:52.352224 ip-10-0-134-52 kubenswrapper[2558]: I0713 03:19:52.352186 2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-nq4gl"] Jul 13 03:20:03.750369 ip-10-0-134-52 kubenswrapper[2558]: I0713 03:20:03.750320 2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-nq4gl"] Jul 13 03:20:12.753718 ip-10-0-134-52 kubenswrapper[2558]: I0713 03:20:12.753683 2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-nq4gl"] Jul 13 03:20:23.441734 ip-10-0-134-52 kubenswrapper[2558]: I0713 03:20:23.441704 2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-nq4gl"] Jul 13 03:20:45.148617 ip-10-0-134-52 kubenswrapper[2558]: I0713 03:20:45.148581 2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-nq4gl"] Jul 13 03:20:54.441882 ip-10-0-134-52 kubenswrapper[2558]: I0713 03:20:54.441797 2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-nq4gl"] Jul 13 03:21:04.046382 ip-10-0-134-52 kubenswrapper[2558]: I0713 03:21:04.046345 2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-nq4gl"] Jul 13 03:21:22.050680 ip-10-0-134-52 kubenswrapper[2558]: I0713 03:21:22.050649 2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-nq4gl"] Jul 13 03:21:32.938096 ip-10-0-134-52 kubenswrapper[2558]: I0713 03:21:32.938060 2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-nq4gl"] Jul 13 03:21:42.047901 ip-10-0-134-52 kubenswrapper[2558]: I0713 03:21:42.047868 2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-nq4gl"] Jul 13 03:21:51.352607 ip-10-0-134-52 kubenswrapper[2558]: I0713 03:21:51.352567 2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-nq4gl"] Jul 13 03:22:01.566468 ip-10-0-134-52 kubenswrapper[2558]: I0713 03:22:01.566432 2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-nq4gl"] Jul 13 03:22:10.886486 ip-10-0-134-52 kubenswrapper[2558]: I0713 03:22:10.886452 2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-nq4gl"] Jul 13 03:22:20.656650 ip-10-0-134-52 kubenswrapper[2558]: I0713 03:22:20.656566 2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-nq4gl"] Jul 13 03:22:33.547137 ip-10-0-134-52 kubenswrapper[2558]: I0713 03:22:33.547097 2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-nq4gl"] Jul 13 03:22:42.554267 ip-10-0-134-52 kubenswrapper[2558]: I0713 03:22:42.554229 2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-nq4gl"] Jul 13 03:22:52.149137 ip-10-0-134-52 kubenswrapper[2558]: I0713 03:22:52.149098 2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-nq4gl"] Jul 13 03:23:01.946144 ip-10-0-134-52 kubenswrapper[2558]: I0713 03:23:01.946110 2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-nq4gl"] Jul 13 03:23:14.541604 ip-10-0-134-52 kubenswrapper[2558]: I0713 03:23:14.541571 2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-nq4gl"] Jul 13 03:23:23.356436 ip-10-0-134-52 kubenswrapper[2558]: I0713 03:23:23.356406 2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-nq4gl"] Jul 13 03:23:34.647753 ip-10-0-134-52 kubenswrapper[2558]: I0713 03:23:34.647719 2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-nq4gl"] Jul 13 03:23:46.343678 ip-10-0-134-52 kubenswrapper[2558]: I0713 03:23:46.343635 2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-nq4gl"] Jul 13 03:23:57.541540 ip-10-0-134-52 kubenswrapper[2558]: I0713 03:23:57.541460 2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-nq4gl"] Jul 13 03:24:08.262078 ip-10-0-134-52 kubenswrapper[2558]: I0713 03:24:08.262043 2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-nq4gl"] Jul 13 03:24:19.267395 ip-10-0-134-52 kubenswrapper[2558]: I0713 03:24:19.267359 2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-nq4gl"] Jul 13 03:24:28.738679 ip-10-0-134-52 kubenswrapper[2558]: I0713 03:24:28.738646 2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-nq4gl"] Jul 13 03:30:00.136507 ip-10-0-134-52 kubenswrapper[2558]: I0713 03:30:00.136433 2558 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-29731890-8txjd"] Jul 13 03:30:00.144489 ip-10-0-134-52 kubenswrapper[2558]: I0713 03:30:00.144470 2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29731890-8txjd" Jul 13 03:30:00.147323 ip-10-0-134-52 kubenswrapper[2558]: I0713 03:30:00.147298 2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-cleanup-dockercfg-5q45t\"" Jul 13 03:30:00.152761 ip-10-0-134-52 kubenswrapper[2558]: I0713 03:30:00.152731 2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-29731890-8txjd"] Jul 13 03:30:00.155714 ip-10-0-134-52 kubenswrapper[2558]: I0713 03:30:00.155695 2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29731890-8txjd" Jul 13 03:30:00.291028 ip-10-0-134-52 kubenswrapper[2558]: I0713 03:30:00.291001 2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-29731890-8txjd"] Jul 13 03:30:00.292551 ip-10-0-134-52 kubenswrapper[2558]: W0713 03:30:00.292520 2558 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poda978b947_d849_4f76_a8ab_31d37f34fff8.slice/crio-b80ef199485e5d52effe343b48d430f637439e7f821d3f2d642975b665273dbb WatchSource:0}: Error finding container b80ef199485e5d52effe343b48d430f637439e7f821d3f2d642975b665273dbb: Status 404 returned error can't find the container with id b80ef199485e5d52effe343b48d430f637439e7f821d3f2d642975b665273dbb Jul 13 03:30:01.018388 ip-10-0-134-52 kubenswrapper[2558]: I0713 03:30:01.018351 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29731890-8txjd" event={"ID":"a978b947-d849-4f76-a8ab-31d37f34fff8","Type":"ContainerStarted","Data":"0143c8565f08849b01e62b520c2d091c9fb2a7d921f1eb5f802308dbf1f9a832"} Jul 13 03:30:01.018546 ip-10-0-134-52 kubenswrapper[2558]: I0713 03:30:01.018405 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29731890-8txjd" event={"ID":"a978b947-d849-4f76-a8ab-31d37f34fff8","Type":"ContainerStarted","Data":"b80ef199485e5d52effe343b48d430f637439e7f821d3f2d642975b665273dbb"} Jul 13 03:30:01.032177 ip-10-0-134-52 kubenswrapper[2558]: I0713 03:30:01.032126 2558 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29731890-8txjd" podStartSLOduration=1.032108581 podStartE2EDuration="1.032108581s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-13 03:30:00 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-13 03:30:01.031715962 +0000 UTC m=+1983.432316428" watchObservedRunningTime="2026-07-13 03:30:01.032108581 +0000 UTC m=+1983.432709056" Jul 13 03:30:37.197310 ip-10-0-134-52 kubenswrapper[2558]: I0713 03:30:37.197277 2558 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-ait-927ff568-openshift-default-65cbb5f45-kvrtr"] Jul 13 03:30:37.201243 ip-10-0-134-52 kubenswrapper[2558]: I0713 03:30:37.201207 2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ait-927ff568-openshift-default-65cbb5f45-kvrtr" Jul 13 03:30:37.203994 ip-10-0-134-52 kubenswrapper[2558]: I0713 03:30:37.203964 2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-ait-927ff568-openshift-default-dockercfg-52c9l\"" Jul 13 03:30:37.213857 ip-10-0-134-52 kubenswrapper[2558]: I0713 03:30:37.213794 2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-ait-927ff568-openshift-default-65cbb5f45-kvrtr"] Jul 13 03:30:37.260679 ip-10-0-134-52 kubenswrapper[2558]: I0713 03:30:37.260647 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/2d7cf532-22ff-42df-92e8-e241a86b1d4e-credential-socket\") pod \"e2e-ait-927ff568-openshift-default-65cbb5f45-kvrtr\" (UID: \"2d7cf532-22ff-42df-92e8-e241a86b1d4e\") " pod="openshift-ingress/e2e-ait-927ff568-openshift-default-65cbb5f45-kvrtr" Jul 13 03:30:37.260821 ip-10-0-134-52 kubenswrapper[2558]: I0713 03:30:37.260687 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-vsp6c\" (UniqueName: \"kubernetes.io/projected/2d7cf532-22ff-42df-92e8-e241a86b1d4e-kube-api-access-vsp6c\") pod \"e2e-ait-927ff568-openshift-default-65cbb5f45-kvrtr\" (UID: \"2d7cf532-22ff-42df-92e8-e241a86b1d4e\") " pod="openshift-ingress/e2e-ait-927ff568-openshift-default-65cbb5f45-kvrtr" Jul 13 03:30:37.260821 ip-10-0-134-52 kubenswrapper[2558]: I0713 03:30:37.260709 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/2d7cf532-22ff-42df-92e8-e241a86b1d4e-istio-podinfo\") pod \"e2e-ait-927ff568-openshift-default-65cbb5f45-kvrtr\" (UID: \"2d7cf532-22ff-42df-92e8-e241a86b1d4e\") " pod="openshift-ingress/e2e-ait-927ff568-openshift-default-65cbb5f45-kvrtr" Jul 13 03:30:37.260821 ip-10-0-134-52 kubenswrapper[2558]: I0713 03:30:37.260730 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/2d7cf532-22ff-42df-92e8-e241a86b1d4e-workload-certs\") pod \"e2e-ait-927ff568-openshift-default-65cbb5f45-kvrtr\" (UID: \"2d7cf532-22ff-42df-92e8-e241a86b1d4e\") " pod="openshift-ingress/e2e-ait-927ff568-openshift-default-65cbb5f45-kvrtr" Jul 13 03:30:37.260821 ip-10-0-134-52 kubenswrapper[2558]: I0713 03:30:37.260777 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/2d7cf532-22ff-42df-92e8-e241a86b1d4e-istio-data\") pod \"e2e-ait-927ff568-openshift-default-65cbb5f45-kvrtr\" (UID: \"2d7cf532-22ff-42df-92e8-e241a86b1d4e\") " pod="openshift-ingress/e2e-ait-927ff568-openshift-default-65cbb5f45-kvrtr" Jul 13 03:30:37.260821 ip-10-0-134-52 kubenswrapper[2558]: I0713 03:30:37.260796 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/2d7cf532-22ff-42df-92e8-e241a86b1d4e-istio-token\") pod \"e2e-ait-927ff568-openshift-default-65cbb5f45-kvrtr\" (UID: \"2d7cf532-22ff-42df-92e8-e241a86b1d4e\") " pod="openshift-ingress/e2e-ait-927ff568-openshift-default-65cbb5f45-kvrtr" Jul 13 03:30:37.260821 ip-10-0-134-52 kubenswrapper[2558]: I0713 03:30:37.260815 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/2d7cf532-22ff-42df-92e8-e241a86b1d4e-istio-envoy\") pod \"e2e-ait-927ff568-openshift-default-65cbb5f45-kvrtr\" (UID: \"2d7cf532-22ff-42df-92e8-e241a86b1d4e\") " pod="openshift-ingress/e2e-ait-927ff568-openshift-default-65cbb5f45-kvrtr" Jul 13 03:30:37.261022 ip-10-0-134-52 kubenswrapper[2558]: I0713 03:30:37.260833 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/2d7cf532-22ff-42df-92e8-e241a86b1d4e-istiod-ca-cert\") pod \"e2e-ait-927ff568-openshift-default-65cbb5f45-kvrtr\" (UID: \"2d7cf532-22ff-42df-92e8-e241a86b1d4e\") " pod="openshift-ingress/e2e-ait-927ff568-openshift-default-65cbb5f45-kvrtr" Jul 13 03:30:37.261022 ip-10-0-134-52 kubenswrapper[2558]: I0713 03:30:37.260849 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/2d7cf532-22ff-42df-92e8-e241a86b1d4e-workload-socket\") pod \"e2e-ait-927ff568-openshift-default-65cbb5f45-kvrtr\" (UID: \"2d7cf532-22ff-42df-92e8-e241a86b1d4e\") " pod="openshift-ingress/e2e-ait-927ff568-openshift-default-65cbb5f45-kvrtr" Jul 13 03:30:37.361563 ip-10-0-134-52 kubenswrapper[2558]: I0713 03:30:37.361526 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/2d7cf532-22ff-42df-92e8-e241a86b1d4e-credential-socket\") pod \"e2e-ait-927ff568-openshift-default-65cbb5f45-kvrtr\" (UID: \"2d7cf532-22ff-42df-92e8-e241a86b1d4e\") " pod="openshift-ingress/e2e-ait-927ff568-openshift-default-65cbb5f45-kvrtr" Jul 13 03:30:37.361775 ip-10-0-134-52 kubenswrapper[2558]: I0713 03:30:37.361577 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-vsp6c\" (UniqueName: \"kubernetes.io/projected/2d7cf532-22ff-42df-92e8-e241a86b1d4e-kube-api-access-vsp6c\") pod \"e2e-ait-927ff568-openshift-default-65cbb5f45-kvrtr\" (UID: \"2d7cf532-22ff-42df-92e8-e241a86b1d4e\") " pod="openshift-ingress/e2e-ait-927ff568-openshift-default-65cbb5f45-kvrtr" Jul 13 03:30:37.361775 ip-10-0-134-52 kubenswrapper[2558]: I0713 03:30:37.361655 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/2d7cf532-22ff-42df-92e8-e241a86b1d4e-istio-podinfo\") pod \"e2e-ait-927ff568-openshift-default-65cbb5f45-kvrtr\" (UID: \"2d7cf532-22ff-42df-92e8-e241a86b1d4e\") " pod="openshift-ingress/e2e-ait-927ff568-openshift-default-65cbb5f45-kvrtr" Jul 13 03:30:37.361775 ip-10-0-134-52 kubenswrapper[2558]: I0713 03:30:37.361682 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/2d7cf532-22ff-42df-92e8-e241a86b1d4e-workload-certs\") pod \"e2e-ait-927ff568-openshift-default-65cbb5f45-kvrtr\" (UID: \"2d7cf532-22ff-42df-92e8-e241a86b1d4e\") " pod="openshift-ingress/e2e-ait-927ff568-openshift-default-65cbb5f45-kvrtr" Jul 13 03:30:37.361775 ip-10-0-134-52 kubenswrapper[2558]: I0713 03:30:37.361716 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/2d7cf532-22ff-42df-92e8-e241a86b1d4e-istio-data\") pod \"e2e-ait-927ff568-openshift-default-65cbb5f45-kvrtr\" (UID: \"2d7cf532-22ff-42df-92e8-e241a86b1d4e\") " pod="openshift-ingress/e2e-ait-927ff568-openshift-default-65cbb5f45-kvrtr" Jul 13 03:30:37.361775 ip-10-0-134-52 kubenswrapper[2558]: I0713 03:30:37.361741 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/2d7cf532-22ff-42df-92e8-e241a86b1d4e-istio-token\") pod \"e2e-ait-927ff568-openshift-default-65cbb5f45-kvrtr\" (UID: \"2d7cf532-22ff-42df-92e8-e241a86b1d4e\") " pod="openshift-ingress/e2e-ait-927ff568-openshift-default-65cbb5f45-kvrtr" Jul 13 03:30:37.361775 ip-10-0-134-52 kubenswrapper[2558]: I0713 03:30:37.361766 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/2d7cf532-22ff-42df-92e8-e241a86b1d4e-istio-envoy\") pod \"e2e-ait-927ff568-openshift-default-65cbb5f45-kvrtr\" (UID: \"2d7cf532-22ff-42df-92e8-e241a86b1d4e\") " pod="openshift-ingress/e2e-ait-927ff568-openshift-default-65cbb5f45-kvrtr" Jul 13 03:30:37.362091 ip-10-0-134-52 kubenswrapper[2558]: I0713 03:30:37.361794 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/2d7cf532-22ff-42df-92e8-e241a86b1d4e-istiod-ca-cert\") pod \"e2e-ait-927ff568-openshift-default-65cbb5f45-kvrtr\" (UID: \"2d7cf532-22ff-42df-92e8-e241a86b1d4e\") " pod="openshift-ingress/e2e-ait-927ff568-openshift-default-65cbb5f45-kvrtr" Jul 13 03:30:37.362091 ip-10-0-134-52 kubenswrapper[2558]: I0713 03:30:37.361819 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/2d7cf532-22ff-42df-92e8-e241a86b1d4e-workload-socket\") pod \"e2e-ait-927ff568-openshift-default-65cbb5f45-kvrtr\" (UID: \"2d7cf532-22ff-42df-92e8-e241a86b1d4e\") " pod="openshift-ingress/e2e-ait-927ff568-openshift-default-65cbb5f45-kvrtr" Jul 13 03:30:37.362091 ip-10-0-134-52 kubenswrapper[2558]: I0713 03:30:37.361959 2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/2d7cf532-22ff-42df-92e8-e241a86b1d4e-credential-socket\") pod \"e2e-ait-927ff568-openshift-default-65cbb5f45-kvrtr\" (UID: \"2d7cf532-22ff-42df-92e8-e241a86b1d4e\") " pod="openshift-ingress/e2e-ait-927ff568-openshift-default-65cbb5f45-kvrtr" Jul 13 03:30:37.362091 ip-10-0-134-52 kubenswrapper[2558]: I0713 03:30:37.362047 2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/2d7cf532-22ff-42df-92e8-e241a86b1d4e-workload-certs\") pod \"e2e-ait-927ff568-openshift-default-65cbb5f45-kvrtr\" (UID: \"2d7cf532-22ff-42df-92e8-e241a86b1d4e\") " pod="openshift-ingress/e2e-ait-927ff568-openshift-default-65cbb5f45-kvrtr" Jul 13 03:30:37.362358 ip-10-0-134-52 kubenswrapper[2558]: I0713 03:30:37.362195 2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/2d7cf532-22ff-42df-92e8-e241a86b1d4e-workload-socket\") pod \"e2e-ait-927ff568-openshift-default-65cbb5f45-kvrtr\" (UID: \"2d7cf532-22ff-42df-92e8-e241a86b1d4e\") " pod="openshift-ingress/e2e-ait-927ff568-openshift-default-65cbb5f45-kvrtr" Jul 13 03:30:37.362358 ip-10-0-134-52 kubenswrapper[2558]: I0713 03:30:37.362277 2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/2d7cf532-22ff-42df-92e8-e241a86b1d4e-istio-data\") pod \"e2e-ait-927ff568-openshift-default-65cbb5f45-kvrtr\" (UID: \"2d7cf532-22ff-42df-92e8-e241a86b1d4e\") " pod="openshift-ingress/e2e-ait-927ff568-openshift-default-65cbb5f45-kvrtr" Jul 13 03:30:37.362636 ip-10-0-134-52 kubenswrapper[2558]: I0713 03:30:37.362481 2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/2d7cf532-22ff-42df-92e8-e241a86b1d4e-istiod-ca-cert\") pod \"e2e-ait-927ff568-openshift-default-65cbb5f45-kvrtr\" (UID: \"2d7cf532-22ff-42df-92e8-e241a86b1d4e\") " pod="openshift-ingress/e2e-ait-927ff568-openshift-default-65cbb5f45-kvrtr" Jul 13 03:30:37.364123 ip-10-0-134-52 kubenswrapper[2558]: I0713 03:30:37.364102 2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/2d7cf532-22ff-42df-92e8-e241a86b1d4e-istio-envoy\") pod \"e2e-ait-927ff568-openshift-default-65cbb5f45-kvrtr\" (UID: \"2d7cf532-22ff-42df-92e8-e241a86b1d4e\") " pod="openshift-ingress/e2e-ait-927ff568-openshift-default-65cbb5f45-kvrtr" Jul 13 03:30:37.364259 ip-10-0-134-52 kubenswrapper[2558]: I0713 03:30:37.364242 2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/2d7cf532-22ff-42df-92e8-e241a86b1d4e-istio-podinfo\") pod \"e2e-ait-927ff568-openshift-default-65cbb5f45-kvrtr\" (UID: \"2d7cf532-22ff-42df-92e8-e241a86b1d4e\") " pod="openshift-ingress/e2e-ait-927ff568-openshift-default-65cbb5f45-kvrtr" Jul 13 03:30:37.369592 ip-10-0-134-52 kubenswrapper[2558]: I0713 03:30:37.369565 2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-vsp6c\" (UniqueName: \"kubernetes.io/projected/2d7cf532-22ff-42df-92e8-e241a86b1d4e-kube-api-access-vsp6c\") pod \"e2e-ait-927ff568-openshift-default-65cbb5f45-kvrtr\" (UID: \"2d7cf532-22ff-42df-92e8-e241a86b1d4e\") " pod="openshift-ingress/e2e-ait-927ff568-openshift-default-65cbb5f45-kvrtr" Jul 13 03:30:37.369674 ip-10-0-134-52 kubenswrapper[2558]: I0713 03:30:37.369649 2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/2d7cf532-22ff-42df-92e8-e241a86b1d4e-istio-token\") pod \"e2e-ait-927ff568-openshift-default-65cbb5f45-kvrtr\" (UID: \"2d7cf532-22ff-42df-92e8-e241a86b1d4e\") " pod="openshift-ingress/e2e-ait-927ff568-openshift-default-65cbb5f45-kvrtr" Jul 13 03:30:37.518425 ip-10-0-134-52 kubenswrapper[2558]: I0713 03:30:37.518352 2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ait-927ff568-openshift-default-65cbb5f45-kvrtr" Jul 13 03:30:37.656993 ip-10-0-134-52 kubenswrapper[2558]: I0713 03:30:37.656965 2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-ait-927ff568-openshift-default-65cbb5f45-kvrtr"] Jul 13 03:30:37.658681 ip-10-0-134-52 kubenswrapper[2558]: W0713 03:30:37.658631 2558 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod2d7cf532_22ff_42df_92e8_e241a86b1d4e.slice/crio-c05f3689289077fe2e08144bb89defcda45a0ccb9039f8a80f38627e039c2b0b WatchSource:0}: Error finding container c05f3689289077fe2e08144bb89defcda45a0ccb9039f8a80f38627e039c2b0b: Status 404 returned error can't find the container with id c05f3689289077fe2e08144bb89defcda45a0ccb9039f8a80f38627e039c2b0b Jul 13 03:30:37.660802 ip-10-0-134-52 kubenswrapper[2558]: I0713 03:30:37.660771 2558 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892164Ki","pods":"250"} Jul 13 03:30:37.660881 ip-10-0-134-52 kubenswrapper[2558]: I0713 03:30:37.660833 2558 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892164Ki","pods":"250"} Jul 13 03:30:37.660881 ip-10-0-134-52 kubenswrapper[2558]: I0713 03:30:37.660863 2558 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892164Ki","pods":"250"} Jul 13 03:30:38.231673 ip-10-0-134-52 kubenswrapper[2558]: I0713 03:30:38.231634 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ait-927ff568-openshift-default-65cbb5f45-kvrtr" event={"ID":"2d7cf532-22ff-42df-92e8-e241a86b1d4e","Type":"ContainerStarted","Data":"02243a1d2260c9b2e0aa0e67b013ecac53c95718a91834f162a9ce08ba39e588"} Jul 13 03:30:38.232047 ip-10-0-134-52 kubenswrapper[2558]: I0713 03:30:38.231687 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ait-927ff568-openshift-default-65cbb5f45-kvrtr" event={"ID":"2d7cf532-22ff-42df-92e8-e241a86b1d4e","Type":"ContainerStarted","Data":"c05f3689289077fe2e08144bb89defcda45a0ccb9039f8a80f38627e039c2b0b"} Jul 13 03:30:38.254254 ip-10-0-134-52 kubenswrapper[2558]: I0713 03:30:38.254205 2558 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-ait-927ff568-openshift-default-65cbb5f45-kvrtr" podStartSLOduration=1.254192176 podStartE2EDuration="1.254192176s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-13 03:30:37 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-13 03:30:38.250931399 +0000 UTC m=+2020.651531865" watchObservedRunningTime="2026-07-13 03:30:38.254192176 +0000 UTC m=+2020.654792706" Jul 13 03:30:38.518582 ip-10-0-134-52 kubenswrapper[2558]: I0713 03:30:38.518492 2558 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-ait-927ff568-openshift-default-65cbb5f45-kvrtr" Jul 13 03:30:38.524295 ip-10-0-134-52 kubenswrapper[2558]: I0713 03:30:38.524270 2558 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-ait-927ff568-openshift-default-65cbb5f45-kvrtr" Jul 13 03:30:39.236829 ip-10-0-134-52 kubenswrapper[2558]: I0713 03:30:39.236795 2558 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-ait-927ff568-openshift-default-65cbb5f45-kvrtr" Jul 13 03:30:39.237648 ip-10-0-134-52 kubenswrapper[2558]: I0713 03:30:39.237629 2558 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-ait-927ff568-openshift-default-65cbb5f45-kvrtr" Jul 13 03:30:41.137407 ip-10-0-134-52 kubenswrapper[2558]: I0713 03:30:41.137375 2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-nq4gl"] Jul 13 03:30:43.542007 ip-10-0-134-52 kubenswrapper[2558]: I0713 03:30:43.541970 2558 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-ait-927ff568-openshift-default-65cbb5f45-kvrtr"] Jul 13 03:30:43.542465 ip-10-0-134-52 kubenswrapper[2558]: I0713 03:30:43.542203 2558 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/e2e-ait-927ff568-openshift-default-65cbb5f45-kvrtr" podUID="2d7cf532-22ff-42df-92e8-e241a86b1d4e" containerName="istio-proxy" containerID="cri-o://02243a1d2260c9b2e0aa0e67b013ecac53c95718a91834f162a9ce08ba39e588" gracePeriod=30 Jul 13 03:30:49.300460 ip-10-0-134-52 kubenswrapper[2558]: I0713 03:30:49.300429 2558 generic.go:356] "Generic (PLEG): container finished" podID="2d7cf532-22ff-42df-92e8-e241a86b1d4e" containerID="02243a1d2260c9b2e0aa0e67b013ecac53c95718a91834f162a9ce08ba39e588" exitCode=0 Jul 13 03:30:49.300808 ip-10-0-134-52 kubenswrapper[2558]: I0713 03:30:49.300501 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ait-927ff568-openshift-default-65cbb5f45-kvrtr" event={"ID":"2d7cf532-22ff-42df-92e8-e241a86b1d4e","Type":"ContainerDied","Data":"02243a1d2260c9b2e0aa0e67b013ecac53c95718a91834f162a9ce08ba39e588"} Jul 13 03:30:49.300808 ip-10-0-134-52 kubenswrapper[2558]: I0713 03:30:49.300564 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ait-927ff568-openshift-default-65cbb5f45-kvrtr" event={"ID":"2d7cf532-22ff-42df-92e8-e241a86b1d4e","Type":"ContainerDied","Data":"c05f3689289077fe2e08144bb89defcda45a0ccb9039f8a80f38627e039c2b0b"} Jul 13 03:30:49.300808 ip-10-0-134-52 kubenswrapper[2558]: I0713 03:30:49.300582 2558 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="c05f3689289077fe2e08144bb89defcda45a0ccb9039f8a80f38627e039c2b0b" Jul 13 03:30:49.302722 ip-10-0-134-52 kubenswrapper[2558]: I0713 03:30:49.302706 2558 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ait-927ff568-openshift-default-65cbb5f45-kvrtr" Jul 13 03:30:49.370848 ip-10-0-134-52 kubenswrapper[2558]: I0713 03:30:49.370778 2558 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/2d7cf532-22ff-42df-92e8-e241a86b1d4e-istio-podinfo\") pod \"2d7cf532-22ff-42df-92e8-e241a86b1d4e\" (UID: \"2d7cf532-22ff-42df-92e8-e241a86b1d4e\") " Jul 13 03:30:49.370848 ip-10-0-134-52 kubenswrapper[2558]: I0713 03:30:49.370815 2558 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/2d7cf532-22ff-42df-92e8-e241a86b1d4e-istio-data\") pod \"2d7cf532-22ff-42df-92e8-e241a86b1d4e\" (UID: \"2d7cf532-22ff-42df-92e8-e241a86b1d4e\") " Jul 13 03:30:49.370848 ip-10-0-134-52 kubenswrapper[2558]: I0713 03:30:49.370832 2558 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/2d7cf532-22ff-42df-92e8-e241a86b1d4e-istiod-ca-cert\") pod \"2d7cf532-22ff-42df-92e8-e241a86b1d4e\" (UID: \"2d7cf532-22ff-42df-92e8-e241a86b1d4e\") " Jul 13 03:30:49.371106 ip-10-0-134-52 kubenswrapper[2558]: I0713 03:30:49.370863 2558 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/2d7cf532-22ff-42df-92e8-e241a86b1d4e-workload-socket\") pod \"2d7cf532-22ff-42df-92e8-e241a86b1d4e\" (UID: \"2d7cf532-22ff-42df-92e8-e241a86b1d4e\") " Jul 13 03:30:49.371106 ip-10-0-134-52 kubenswrapper[2558]: I0713 03:30:49.370985 2558 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/2d7cf532-22ff-42df-92e8-e241a86b1d4e-workload-certs\") pod \"2d7cf532-22ff-42df-92e8-e241a86b1d4e\" (UID: \"2d7cf532-22ff-42df-92e8-e241a86b1d4e\") " Jul 13 03:30:49.371106 ip-10-0-134-52 kubenswrapper[2558]: I0713 03:30:49.371057 2558 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/2d7cf532-22ff-42df-92e8-e241a86b1d4e-istio-token\") pod \"2d7cf532-22ff-42df-92e8-e241a86b1d4e\" (UID: \"2d7cf532-22ff-42df-92e8-e241a86b1d4e\") " Jul 13 03:30:49.371106 ip-10-0-134-52 kubenswrapper[2558]: I0713 03:30:49.371079 2558 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/2d7cf532-22ff-42df-92e8-e241a86b1d4e-credential-socket\") pod \"2d7cf532-22ff-42df-92e8-e241a86b1d4e\" (UID: \"2d7cf532-22ff-42df-92e8-e241a86b1d4e\") " Jul 13 03:30:49.371106 ip-10-0-134-52 kubenswrapper[2558]: I0713 03:30:49.371093 2558 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/2d7cf532-22ff-42df-92e8-e241a86b1d4e-istio-envoy\") pod \"2d7cf532-22ff-42df-92e8-e241a86b1d4e\" (UID: \"2d7cf532-22ff-42df-92e8-e241a86b1d4e\") " Jul 13 03:30:49.371396 ip-10-0-134-52 kubenswrapper[2558]: I0713 03:30:49.371147 2558 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/2d7cf532-22ff-42df-92e8-e241a86b1d4e-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "2d7cf532-22ff-42df-92e8-e241a86b1d4e" (UID: "2d7cf532-22ff-42df-92e8-e241a86b1d4e"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 13 03:30:49.371396 ip-10-0-134-52 kubenswrapper[2558]: I0713 03:30:49.371204 2558 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/2d7cf532-22ff-42df-92e8-e241a86b1d4e-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "2d7cf532-22ff-42df-92e8-e241a86b1d4e" (UID: "2d7cf532-22ff-42df-92e8-e241a86b1d4e"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 13 03:30:49.371396 ip-10-0-134-52 kubenswrapper[2558]: I0713 03:30:49.371247 2558 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-vsp6c\" (UniqueName: \"kubernetes.io/projected/2d7cf532-22ff-42df-92e8-e241a86b1d4e-kube-api-access-vsp6c\") pod \"2d7cf532-22ff-42df-92e8-e241a86b1d4e\" (UID: \"2d7cf532-22ff-42df-92e8-e241a86b1d4e\") " Jul 13 03:30:49.371396 ip-10-0-134-52 kubenswrapper[2558]: I0713 03:30:49.371270 2558 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/2d7cf532-22ff-42df-92e8-e241a86b1d4e-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "2d7cf532-22ff-42df-92e8-e241a86b1d4e" (UID: "2d7cf532-22ff-42df-92e8-e241a86b1d4e"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 13 03:30:49.371620 ip-10-0-134-52 kubenswrapper[2558]: I0713 03:30:49.371473 2558 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/2d7cf532-22ff-42df-92e8-e241a86b1d4e-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "2d7cf532-22ff-42df-92e8-e241a86b1d4e" (UID: "2d7cf532-22ff-42df-92e8-e241a86b1d4e"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 13 03:30:49.371620 ip-10-0-134-52 kubenswrapper[2558]: I0713 03:30:49.371606 2558 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/2d7cf532-22ff-42df-92e8-e241a86b1d4e-istiod-ca-cert\") on node \"ip-10-0-134-52.ec2.internal\" DevicePath \"\"" Jul 13 03:30:49.371736 ip-10-0-134-52 kubenswrapper[2558]: I0713 03:30:49.371626 2558 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/2d7cf532-22ff-42df-92e8-e241a86b1d4e-workload-socket\") on node \"ip-10-0-134-52.ec2.internal\" DevicePath \"\"" Jul 13 03:30:49.371736 ip-10-0-134-52 kubenswrapper[2558]: I0713 03:30:49.371639 2558 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/2d7cf532-22ff-42df-92e8-e241a86b1d4e-workload-certs\") on node \"ip-10-0-134-52.ec2.internal\" DevicePath \"\"" Jul 13 03:30:49.371736 ip-10-0-134-52 kubenswrapper[2558]: I0713 03:30:49.371652 2558 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/2d7cf532-22ff-42df-92e8-e241a86b1d4e-credential-socket\") on node \"ip-10-0-134-52.ec2.internal\" DevicePath \"\"" Jul 13 03:30:49.371916 ip-10-0-134-52 kubenswrapper[2558]: I0713 03:30:49.371883 2558 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/2d7cf532-22ff-42df-92e8-e241a86b1d4e-istio-data" (OuterVolumeSpecName: "istio-data") pod "2d7cf532-22ff-42df-92e8-e241a86b1d4e" (UID: "2d7cf532-22ff-42df-92e8-e241a86b1d4e"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 13 03:30:49.373254 ip-10-0-134-52 kubenswrapper[2558]: I0713 03:30:49.373227 2558 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/2d7cf532-22ff-42df-92e8-e241a86b1d4e-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "2d7cf532-22ff-42df-92e8-e241a86b1d4e" (UID: "2d7cf532-22ff-42df-92e8-e241a86b1d4e"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue "" Jul 13 03:30:49.373394 ip-10-0-134-52 kubenswrapper[2558]: I0713 03:30:49.373355 2558 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/2d7cf532-22ff-42df-92e8-e241a86b1d4e-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "2d7cf532-22ff-42df-92e8-e241a86b1d4e" (UID: "2d7cf532-22ff-42df-92e8-e241a86b1d4e"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 13 03:30:49.373491 ip-10-0-134-52 kubenswrapper[2558]: I0713 03:30:49.373469 2558 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/2d7cf532-22ff-42df-92e8-e241a86b1d4e-istio-token" (OuterVolumeSpecName: "istio-token") pod "2d7cf532-22ff-42df-92e8-e241a86b1d4e" (UID: "2d7cf532-22ff-42df-92e8-e241a86b1d4e"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 13 03:30:49.373588 ip-10-0-134-52 kubenswrapper[2558]: I0713 03:30:49.373569 2558 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/2d7cf532-22ff-42df-92e8-e241a86b1d4e-kube-api-access-vsp6c" (OuterVolumeSpecName: "kube-api-access-vsp6c") pod "2d7cf532-22ff-42df-92e8-e241a86b1d4e" (UID: "2d7cf532-22ff-42df-92e8-e241a86b1d4e"). InnerVolumeSpecName "kube-api-access-vsp6c". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 13 03:30:49.472638 ip-10-0-134-52 kubenswrapper[2558]: I0713 03:30:49.472611 2558 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/2d7cf532-22ff-42df-92e8-e241a86b1d4e-istio-podinfo\") on node \"ip-10-0-134-52.ec2.internal\" DevicePath \"\"" Jul 13 03:30:49.472638 ip-10-0-134-52 kubenswrapper[2558]: I0713 03:30:49.472634 2558 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/2d7cf532-22ff-42df-92e8-e241a86b1d4e-istio-data\") on node \"ip-10-0-134-52.ec2.internal\" DevicePath \"\"" Jul 13 03:30:49.472638 ip-10-0-134-52 kubenswrapper[2558]: I0713 03:30:49.472643 2558 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/2d7cf532-22ff-42df-92e8-e241a86b1d4e-istio-token\") on node \"ip-10-0-134-52.ec2.internal\" DevicePath \"\"" Jul 13 03:30:49.472840 ip-10-0-134-52 kubenswrapper[2558]: I0713 03:30:49.472651 2558 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/2d7cf532-22ff-42df-92e8-e241a86b1d4e-istio-envoy\") on node \"ip-10-0-134-52.ec2.internal\" DevicePath \"\"" Jul 13 03:30:49.472840 ip-10-0-134-52 kubenswrapper[2558]: I0713 03:30:49.472659 2558 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-vsp6c\" (UniqueName: \"kubernetes.io/projected/2d7cf532-22ff-42df-92e8-e241a86b1d4e-kube-api-access-vsp6c\") on node \"ip-10-0-134-52.ec2.internal\" DevicePath \"\"" Jul 13 03:30:49.576572 ip-10-0-134-52 kubenswrapper[2558]: I0713 03:30:49.576539 2558 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-ait-49b1aeaf-openshift-default-79d9969c7-cmvnm"] Jul 13 03:30:49.576938 ip-10-0-134-52 kubenswrapper[2558]: I0713 03:30:49.576925 2558 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="2d7cf532-22ff-42df-92e8-e241a86b1d4e" containerName="istio-proxy" Jul 13 03:30:49.576985 ip-10-0-134-52 kubenswrapper[2558]: I0713 03:30:49.576939 2558 state_mem.go:107] "Deleted CPUSet assignment" podUID="2d7cf532-22ff-42df-92e8-e241a86b1d4e" containerName="istio-proxy" Jul 13 03:30:49.577035 ip-10-0-134-52 kubenswrapper[2558]: I0713 03:30:49.577027 2558 memory_manager.go:368] "RemoveStaleState removing state" podUID="2d7cf532-22ff-42df-92e8-e241a86b1d4e" containerName="istio-proxy" Jul 13 03:30:49.580523 ip-10-0-134-52 kubenswrapper[2558]: I0713 03:30:49.580508 2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ait-49b1aeaf-openshift-default-79d9969c7-cmvnm" Jul 13 03:30:49.583921 ip-10-0-134-52 kubenswrapper[2558]: I0713 03:30:49.583902 2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-ait-49b1aeaf-openshift-default-dockercfg-js6df\"" Jul 13 03:30:49.602933 ip-10-0-134-52 kubenswrapper[2558]: I0713 03:30:49.602902 2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-ait-49b1aeaf-openshift-default-79d9969c7-cmvnm"] Jul 13 03:30:49.674127 ip-10-0-134-52 kubenswrapper[2558]: I0713 03:30:49.674037 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/3be2bfe6-ead7-41ef-bcb6-d6cd16220b20-istio-envoy\") pod \"e2e-ait-49b1aeaf-openshift-default-79d9969c7-cmvnm\" (UID: \"3be2bfe6-ead7-41ef-bcb6-d6cd16220b20\") " pod="openshift-ingress/e2e-ait-49b1aeaf-openshift-default-79d9969c7-cmvnm" Jul 13 03:30:49.674127 ip-10-0-134-52 kubenswrapper[2558]: I0713 03:30:49.674088 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/3be2bfe6-ead7-41ef-bcb6-d6cd16220b20-workload-socket\") pod \"e2e-ait-49b1aeaf-openshift-default-79d9969c7-cmvnm\" (UID: \"3be2bfe6-ead7-41ef-bcb6-d6cd16220b20\") " pod="openshift-ingress/e2e-ait-49b1aeaf-openshift-default-79d9969c7-cmvnm" Jul 13 03:30:49.674127 ip-10-0-134-52 kubenswrapper[2558]: I0713 03:30:49.674125 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/3be2bfe6-ead7-41ef-bcb6-d6cd16220b20-istio-podinfo\") pod \"e2e-ait-49b1aeaf-openshift-default-79d9969c7-cmvnm\" (UID: \"3be2bfe6-ead7-41ef-bcb6-d6cd16220b20\") " pod="openshift-ingress/e2e-ait-49b1aeaf-openshift-default-79d9969c7-cmvnm" Jul 13 03:30:49.674407 ip-10-0-134-52 kubenswrapper[2558]: I0713 03:30:49.674158 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/3be2bfe6-ead7-41ef-bcb6-d6cd16220b20-credential-socket\") pod \"e2e-ait-49b1aeaf-openshift-default-79d9969c7-cmvnm\" (UID: \"3be2bfe6-ead7-41ef-bcb6-d6cd16220b20\") " pod="openshift-ingress/e2e-ait-49b1aeaf-openshift-default-79d9969c7-cmvnm" Jul 13 03:30:49.674407 ip-10-0-134-52 kubenswrapper[2558]: I0713 03:30:49.674235 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/3be2bfe6-ead7-41ef-bcb6-d6cd16220b20-istio-token\") pod \"e2e-ait-49b1aeaf-openshift-default-79d9969c7-cmvnm\" (UID: \"3be2bfe6-ead7-41ef-bcb6-d6cd16220b20\") " pod="openshift-ingress/e2e-ait-49b1aeaf-openshift-default-79d9969c7-cmvnm" Jul 13 03:30:49.674407 ip-10-0-134-52 kubenswrapper[2558]: I0713 03:30:49.674340 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/3be2bfe6-ead7-41ef-bcb6-d6cd16220b20-workload-certs\") pod \"e2e-ait-49b1aeaf-openshift-default-79d9969c7-cmvnm\" (UID: \"3be2bfe6-ead7-41ef-bcb6-d6cd16220b20\") " pod="openshift-ingress/e2e-ait-49b1aeaf-openshift-default-79d9969c7-cmvnm" Jul 13 03:30:49.674407 ip-10-0-134-52 kubenswrapper[2558]: I0713 03:30:49.674365 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-8bfk7\" (UniqueName: \"kubernetes.io/projected/3be2bfe6-ead7-41ef-bcb6-d6cd16220b20-kube-api-access-8bfk7\") pod \"e2e-ait-49b1aeaf-openshift-default-79d9969c7-cmvnm\" (UID: \"3be2bfe6-ead7-41ef-bcb6-d6cd16220b20\") " pod="openshift-ingress/e2e-ait-49b1aeaf-openshift-default-79d9969c7-cmvnm" Jul 13 03:30:49.674407 ip-10-0-134-52 kubenswrapper[2558]: I0713 03:30:49.674388 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/3be2bfe6-ead7-41ef-bcb6-d6cd16220b20-istio-data\") pod \"e2e-ait-49b1aeaf-openshift-default-79d9969c7-cmvnm\" (UID: \"3be2bfe6-ead7-41ef-bcb6-d6cd16220b20\") " pod="openshift-ingress/e2e-ait-49b1aeaf-openshift-default-79d9969c7-cmvnm" Jul 13 03:30:49.674407 ip-10-0-134-52 kubenswrapper[2558]: I0713 03:30:49.674408 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/3be2bfe6-ead7-41ef-bcb6-d6cd16220b20-istiod-ca-cert\") pod \"e2e-ait-49b1aeaf-openshift-default-79d9969c7-cmvnm\" (UID: \"3be2bfe6-ead7-41ef-bcb6-d6cd16220b20\") " pod="openshift-ingress/e2e-ait-49b1aeaf-openshift-default-79d9969c7-cmvnm" Jul 13 03:30:49.775349 ip-10-0-134-52 kubenswrapper[2558]: I0713 03:30:49.775314 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/3be2bfe6-ead7-41ef-bcb6-d6cd16220b20-workload-certs\") pod \"e2e-ait-49b1aeaf-openshift-default-79d9969c7-cmvnm\" (UID: \"3be2bfe6-ead7-41ef-bcb6-d6cd16220b20\") " pod="openshift-ingress/e2e-ait-49b1aeaf-openshift-default-79d9969c7-cmvnm" Jul 13 03:30:49.775493 ip-10-0-134-52 kubenswrapper[2558]: I0713 03:30:49.775362 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-8bfk7\" (UniqueName: \"kubernetes.io/projected/3be2bfe6-ead7-41ef-bcb6-d6cd16220b20-kube-api-access-8bfk7\") pod \"e2e-ait-49b1aeaf-openshift-default-79d9969c7-cmvnm\" (UID: \"3be2bfe6-ead7-41ef-bcb6-d6cd16220b20\") " pod="openshift-ingress/e2e-ait-49b1aeaf-openshift-default-79d9969c7-cmvnm" Jul 13 03:30:49.775493 ip-10-0-134-52 kubenswrapper[2558]: I0713 03:30:49.775391 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/3be2bfe6-ead7-41ef-bcb6-d6cd16220b20-istio-data\") pod \"e2e-ait-49b1aeaf-openshift-default-79d9969c7-cmvnm\" (UID: \"3be2bfe6-ead7-41ef-bcb6-d6cd16220b20\") " pod="openshift-ingress/e2e-ait-49b1aeaf-openshift-default-79d9969c7-cmvnm" Jul 13 03:30:49.775493 ip-10-0-134-52 kubenswrapper[2558]: I0713 03:30:49.775418 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/3be2bfe6-ead7-41ef-bcb6-d6cd16220b20-istiod-ca-cert\") pod \"e2e-ait-49b1aeaf-openshift-default-79d9969c7-cmvnm\" (UID: \"3be2bfe6-ead7-41ef-bcb6-d6cd16220b20\") " pod="openshift-ingress/e2e-ait-49b1aeaf-openshift-default-79d9969c7-cmvnm" Jul 13 03:30:49.775493 ip-10-0-134-52 kubenswrapper[2558]: I0713 03:30:49.775465 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/3be2bfe6-ead7-41ef-bcb6-d6cd16220b20-istio-envoy\") pod \"e2e-ait-49b1aeaf-openshift-default-79d9969c7-cmvnm\" (UID: \"3be2bfe6-ead7-41ef-bcb6-d6cd16220b20\") " pod="openshift-ingress/e2e-ait-49b1aeaf-openshift-default-79d9969c7-cmvnm" Jul 13 03:30:49.775711 ip-10-0-134-52 kubenswrapper[2558]: I0713 03:30:49.775499 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/3be2bfe6-ead7-41ef-bcb6-d6cd16220b20-workload-socket\") pod \"e2e-ait-49b1aeaf-openshift-default-79d9969c7-cmvnm\" (UID: \"3be2bfe6-ead7-41ef-bcb6-d6cd16220b20\") " pod="openshift-ingress/e2e-ait-49b1aeaf-openshift-default-79d9969c7-cmvnm" Jul 13 03:30:49.775711 ip-10-0-134-52 kubenswrapper[2558]: I0713 03:30:49.775522 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/3be2bfe6-ead7-41ef-bcb6-d6cd16220b20-istio-podinfo\") pod \"e2e-ait-49b1aeaf-openshift-default-79d9969c7-cmvnm\" (UID: \"3be2bfe6-ead7-41ef-bcb6-d6cd16220b20\") " pod="openshift-ingress/e2e-ait-49b1aeaf-openshift-default-79d9969c7-cmvnm" Jul 13 03:30:49.775711 ip-10-0-134-52 kubenswrapper[2558]: I0713 03:30:49.775560 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/3be2bfe6-ead7-41ef-bcb6-d6cd16220b20-credential-socket\") pod \"e2e-ait-49b1aeaf-openshift-default-79d9969c7-cmvnm\" (UID: \"3be2bfe6-ead7-41ef-bcb6-d6cd16220b20\") " pod="openshift-ingress/e2e-ait-49b1aeaf-openshift-default-79d9969c7-cmvnm" Jul 13 03:30:49.775711 ip-10-0-134-52 kubenswrapper[2558]: I0713 03:30:49.775612 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/3be2bfe6-ead7-41ef-bcb6-d6cd16220b20-istio-token\") pod \"e2e-ait-49b1aeaf-openshift-default-79d9969c7-cmvnm\" (UID: \"3be2bfe6-ead7-41ef-bcb6-d6cd16220b20\") " pod="openshift-ingress/e2e-ait-49b1aeaf-openshift-default-79d9969c7-cmvnm" Jul 13 03:30:49.775896 ip-10-0-134-52 kubenswrapper[2558]: I0713 03:30:49.775730 2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/3be2bfe6-ead7-41ef-bcb6-d6cd16220b20-workload-certs\") pod \"e2e-ait-49b1aeaf-openshift-default-79d9969c7-cmvnm\" (UID: \"3be2bfe6-ead7-41ef-bcb6-d6cd16220b20\") " pod="openshift-ingress/e2e-ait-49b1aeaf-openshift-default-79d9969c7-cmvnm" Jul 13 03:30:49.775896 ip-10-0-134-52 kubenswrapper[2558]: I0713 03:30:49.775818 2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/3be2bfe6-ead7-41ef-bcb6-d6cd16220b20-workload-socket\") pod \"e2e-ait-49b1aeaf-openshift-default-79d9969c7-cmvnm\" (UID: \"3be2bfe6-ead7-41ef-bcb6-d6cd16220b20\") " pod="openshift-ingress/e2e-ait-49b1aeaf-openshift-default-79d9969c7-cmvnm" Jul 13 03:30:49.775984 ip-10-0-134-52 kubenswrapper[2558]: I0713 03:30:49.775897 2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/3be2bfe6-ead7-41ef-bcb6-d6cd16220b20-credential-socket\") pod \"e2e-ait-49b1aeaf-openshift-default-79d9969c7-cmvnm\" (UID: \"3be2bfe6-ead7-41ef-bcb6-d6cd16220b20\") " pod="openshift-ingress/e2e-ait-49b1aeaf-openshift-default-79d9969c7-cmvnm" Jul 13 03:30:49.776027 ip-10-0-134-52 kubenswrapper[2558]: I0713 03:30:49.775998 2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/3be2bfe6-ead7-41ef-bcb6-d6cd16220b20-istio-data\") pod \"e2e-ait-49b1aeaf-openshift-default-79d9969c7-cmvnm\" (UID: \"3be2bfe6-ead7-41ef-bcb6-d6cd16220b20\") " pod="openshift-ingress/e2e-ait-49b1aeaf-openshift-default-79d9969c7-cmvnm" Jul 13 03:30:49.776162 ip-10-0-134-52 kubenswrapper[2558]: I0713 03:30:49.776143 2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/3be2bfe6-ead7-41ef-bcb6-d6cd16220b20-istiod-ca-cert\") pod \"e2e-ait-49b1aeaf-openshift-default-79d9969c7-cmvnm\" (UID: \"3be2bfe6-ead7-41ef-bcb6-d6cd16220b20\") " pod="openshift-ingress/e2e-ait-49b1aeaf-openshift-default-79d9969c7-cmvnm" Jul 13 03:30:49.777820 ip-10-0-134-52 kubenswrapper[2558]: I0713 03:30:49.777797 2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/3be2bfe6-ead7-41ef-bcb6-d6cd16220b20-istio-envoy\") pod \"e2e-ait-49b1aeaf-openshift-default-79d9969c7-cmvnm\" (UID: \"3be2bfe6-ead7-41ef-bcb6-d6cd16220b20\") " pod="openshift-ingress/e2e-ait-49b1aeaf-openshift-default-79d9969c7-cmvnm" Jul 13 03:30:49.778009 ip-10-0-134-52 kubenswrapper[2558]: I0713 03:30:49.777992 2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/3be2bfe6-ead7-41ef-bcb6-d6cd16220b20-istio-podinfo\") pod \"e2e-ait-49b1aeaf-openshift-default-79d9969c7-cmvnm\" (UID: \"3be2bfe6-ead7-41ef-bcb6-d6cd16220b20\") " pod="openshift-ingress/e2e-ait-49b1aeaf-openshift-default-79d9969c7-cmvnm" Jul 13 03:30:49.783581 ip-10-0-134-52 kubenswrapper[2558]: I0713 03:30:49.783563 2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/3be2bfe6-ead7-41ef-bcb6-d6cd16220b20-istio-token\") pod \"e2e-ait-49b1aeaf-openshift-default-79d9969c7-cmvnm\" (UID: \"3be2bfe6-ead7-41ef-bcb6-d6cd16220b20\") " pod="openshift-ingress/e2e-ait-49b1aeaf-openshift-default-79d9969c7-cmvnm" Jul 13 03:30:49.783933 ip-10-0-134-52 kubenswrapper[2558]: I0713 03:30:49.783916 2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-8bfk7\" (UniqueName: \"kubernetes.io/projected/3be2bfe6-ead7-41ef-bcb6-d6cd16220b20-kube-api-access-8bfk7\") pod \"e2e-ait-49b1aeaf-openshift-default-79d9969c7-cmvnm\" (UID: \"3be2bfe6-ead7-41ef-bcb6-d6cd16220b20\") " pod="openshift-ingress/e2e-ait-49b1aeaf-openshift-default-79d9969c7-cmvnm" Jul 13 03:30:49.890450 ip-10-0-134-52 kubenswrapper[2558]: I0713 03:30:49.890423 2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ait-49b1aeaf-openshift-default-79d9969c7-cmvnm" Jul 13 03:30:50.026230 ip-10-0-134-52 kubenswrapper[2558]: I0713 03:30:50.026202 2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-ait-49b1aeaf-openshift-default-79d9969c7-cmvnm"] Jul 13 03:30:50.027221 ip-10-0-134-52 kubenswrapper[2558]: W0713 03:30:50.027199 2558 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod3be2bfe6_ead7_41ef_bcb6_d6cd16220b20.slice/crio-a9037fa00e49bc5ad494974b5cf7d962b3f1d42b39fe97152b2e67e088617307 WatchSource:0}: Error finding container a9037fa00e49bc5ad494974b5cf7d962b3f1d42b39fe97152b2e67e088617307: Status 404 returned error can't find the container with id a9037fa00e49bc5ad494974b5cf7d962b3f1d42b39fe97152b2e67e088617307 Jul 13 03:30:50.029306 ip-10-0-134-52 kubenswrapper[2558]: I0713 03:30:50.029273 2558 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892164Ki","pods":"250"} Jul 13 03:30:50.029402 ip-10-0-134-52 kubenswrapper[2558]: I0713 03:30:50.029358 2558 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892164Ki","pods":"250"} Jul 13 03:30:50.029402 ip-10-0-134-52 kubenswrapper[2558]: I0713 03:30:50.029387 2558 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892164Ki","pods":"250"} Jul 13 03:30:50.309088 ip-10-0-134-52 kubenswrapper[2558]: I0713 03:30:50.309041 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ait-49b1aeaf-openshift-default-79d9969c7-cmvnm" event={"ID":"3be2bfe6-ead7-41ef-bcb6-d6cd16220b20","Type":"ContainerStarted","Data":"122598d8ed006ce9e7eefcfdbc6ba01bb487b3a4c20f4cb0ceaf20e22d86bae4"} Jul 13 03:30:50.309566 ip-10-0-134-52 kubenswrapper[2558]: I0713 03:30:50.309109 2558 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ait-927ff568-openshift-default-65cbb5f45-kvrtr" Jul 13 03:30:50.309566 ip-10-0-134-52 kubenswrapper[2558]: I0713 03:30:50.309113 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ait-49b1aeaf-openshift-default-79d9969c7-cmvnm" event={"ID":"3be2bfe6-ead7-41ef-bcb6-d6cd16220b20","Type":"ContainerStarted","Data":"a9037fa00e49bc5ad494974b5cf7d962b3f1d42b39fe97152b2e67e088617307"} Jul 13 03:30:50.326487 ip-10-0-134-52 kubenswrapper[2558]: I0713 03:30:50.326435 2558 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-ait-49b1aeaf-openshift-default-79d9969c7-cmvnm" podStartSLOduration=1.326417735 podStartE2EDuration="1.326417735s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-13 03:30:49 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-13 03:30:50.325904553 +0000 UTC m=+2032.726505034" watchObservedRunningTime="2026-07-13 03:30:50.326417735 +0000 UTC m=+2032.727018201" Jul 13 03:30:50.340964 ip-10-0-134-52 kubenswrapper[2558]: I0713 03:30:50.340942 2558 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-ait-927ff568-openshift-default-65cbb5f45-kvrtr"] Jul 13 03:30:50.342995 ip-10-0-134-52 kubenswrapper[2558]: I0713 03:30:50.342976 2558 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-ait-927ff568-openshift-default-65cbb5f45-kvrtr"] Jul 13 03:30:50.890524 ip-10-0-134-52 kubenswrapper[2558]: I0713 03:30:50.890490 2558 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-ait-49b1aeaf-openshift-default-79d9969c7-cmvnm" Jul 13 03:30:51.896314 ip-10-0-134-52 kubenswrapper[2558]: I0713 03:30:51.896285 2558 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-ait-49b1aeaf-openshift-default-79d9969c7-cmvnm" Jul 13 03:30:52.094368 ip-10-0-134-52 kubenswrapper[2558]: I0713 03:30:52.094312 2558 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="2d7cf532-22ff-42df-92e8-e241a86b1d4e" path="/var/lib/kubelet/pods/2d7cf532-22ff-42df-92e8-e241a86b1d4e/volumes" Jul 13 03:30:52.320201 ip-10-0-134-52 kubenswrapper[2558]: I0713 03:30:52.320175 2558 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-ait-49b1aeaf-openshift-default-79d9969c7-cmvnm" Jul 13 03:30:52.321006 ip-10-0-134-52 kubenswrapper[2558]: I0713 03:30:52.320988 2558 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-ait-49b1aeaf-openshift-default-79d9969c7-cmvnm" Jul 13 03:30:54.140669 ip-10-0-134-52 kubenswrapper[2558]: I0713 03:30:54.140634 2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-nq4gl"] Jul 13 03:30:56.688509 ip-10-0-134-52 kubenswrapper[2558]: I0713 03:30:56.688468 2558 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-ait-49b1aeaf-openshift-default-79d9969c7-cmvnm"] Jul 13 03:30:56.689018 ip-10-0-134-52 kubenswrapper[2558]: I0713 03:30:56.688701 2558 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/e2e-ait-49b1aeaf-openshift-default-79d9969c7-cmvnm" podUID="3be2bfe6-ead7-41ef-bcb6-d6cd16220b20" containerName="istio-proxy" containerID="cri-o://122598d8ed006ce9e7eefcfdbc6ba01bb487b3a4c20f4cb0ceaf20e22d86bae4" gracePeriod=30 Jul 13 03:31:00.012775 ip-10-0-134-52 kubenswrapper[2558]: I0713 03:31:00.012724 2558 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-29731890-8txjd"] Jul 13 03:31:00.013185 ip-10-0-134-52 kubenswrapper[2558]: I0713 03:31:00.012990 2558 kuberuntime_container.go:873] "Killing container with a grace period" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29731890-8txjd" podUID="a978b947-d849-4f76-a8ab-31d37f34fff8" containerName="cleanup" containerID="cri-o://0143c8565f08849b01e62b520c2d091c9fb2a7d921f1eb5f802308dbf1f9a832" gracePeriod=30 Jul 13 03:31:02.160540 ip-10-0-134-52 kubenswrapper[2558]: I0713 03:31:02.160517 2558 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ait-49b1aeaf-openshift-default-79d9969c7-cmvnm" Jul 13 03:31:02.294664 ip-10-0-134-52 kubenswrapper[2558]: I0713 03:31:02.294581 2558 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/3be2bfe6-ead7-41ef-bcb6-d6cd16220b20-istio-podinfo\") pod \"3be2bfe6-ead7-41ef-bcb6-d6cd16220b20\" (UID: \"3be2bfe6-ead7-41ef-bcb6-d6cd16220b20\") " Jul 13 03:31:02.294664 ip-10-0-134-52 kubenswrapper[2558]: I0713 03:31:02.294655 2558 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/3be2bfe6-ead7-41ef-bcb6-d6cd16220b20-istiod-ca-cert\") pod \"3be2bfe6-ead7-41ef-bcb6-d6cd16220b20\" (UID: \"3be2bfe6-ead7-41ef-bcb6-d6cd16220b20\") " Jul 13 03:31:02.294887 ip-10-0-134-52 kubenswrapper[2558]: I0713 03:31:02.294711 2558 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/3be2bfe6-ead7-41ef-bcb6-d6cd16220b20-workload-certs\") pod \"3be2bfe6-ead7-41ef-bcb6-d6cd16220b20\" (UID: \"3be2bfe6-ead7-41ef-bcb6-d6cd16220b20\") " Jul 13 03:31:02.294887 ip-10-0-134-52 kubenswrapper[2558]: I0713 03:31:02.294739 2558 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-8bfk7\" (UniqueName: \"kubernetes.io/projected/3be2bfe6-ead7-41ef-bcb6-d6cd16220b20-kube-api-access-8bfk7\") pod \"3be2bfe6-ead7-41ef-bcb6-d6cd16220b20\" (UID: \"3be2bfe6-ead7-41ef-bcb6-d6cd16220b20\") " Jul 13 03:31:02.294887 ip-10-0-134-52 kubenswrapper[2558]: I0713 03:31:02.294781 2558 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/3be2bfe6-ead7-41ef-bcb6-d6cd16220b20-istio-envoy\") pod \"3be2bfe6-ead7-41ef-bcb6-d6cd16220b20\" (UID: \"3be2bfe6-ead7-41ef-bcb6-d6cd16220b20\") " Jul 13 03:31:02.294887 ip-10-0-134-52 kubenswrapper[2558]: I0713 03:31:02.294811 2558 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/3be2bfe6-ead7-41ef-bcb6-d6cd16220b20-credential-socket\") pod \"3be2bfe6-ead7-41ef-bcb6-d6cd16220b20\" (UID: \"3be2bfe6-ead7-41ef-bcb6-d6cd16220b20\") " Jul 13 03:31:02.294887 ip-10-0-134-52 kubenswrapper[2558]: I0713 03:31:02.294835 2558 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/3be2bfe6-ead7-41ef-bcb6-d6cd16220b20-istio-token\") pod \"3be2bfe6-ead7-41ef-bcb6-d6cd16220b20\" (UID: \"3be2bfe6-ead7-41ef-bcb6-d6cd16220b20\") " Jul 13 03:31:02.294887 ip-10-0-134-52 kubenswrapper[2558]: I0713 03:31:02.294882 2558 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/3be2bfe6-ead7-41ef-bcb6-d6cd16220b20-istio-data\") pod \"3be2bfe6-ead7-41ef-bcb6-d6cd16220b20\" (UID: \"3be2bfe6-ead7-41ef-bcb6-d6cd16220b20\") " Jul 13 03:31:02.295195 ip-10-0-134-52 kubenswrapper[2558]: I0713 03:31:02.294910 2558 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/3be2bfe6-ead7-41ef-bcb6-d6cd16220b20-workload-socket\") pod \"3be2bfe6-ead7-41ef-bcb6-d6cd16220b20\" (UID: \"3be2bfe6-ead7-41ef-bcb6-d6cd16220b20\") " Jul 13 03:31:02.295195 ip-10-0-134-52 kubenswrapper[2558]: I0713 03:31:02.295009 2558 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/3be2bfe6-ead7-41ef-bcb6-d6cd16220b20-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "3be2bfe6-ead7-41ef-bcb6-d6cd16220b20" (UID: "3be2bfe6-ead7-41ef-bcb6-d6cd16220b20"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 13 03:31:02.295195 ip-10-0-134-52 kubenswrapper[2558]: I0713 03:31:02.295083 2558 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/3be2bfe6-ead7-41ef-bcb6-d6cd16220b20-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "3be2bfe6-ead7-41ef-bcb6-d6cd16220b20" (UID: "3be2bfe6-ead7-41ef-bcb6-d6cd16220b20"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 13 03:31:02.295379 ip-10-0-134-52 kubenswrapper[2558]: I0713 03:31:02.295202 2558 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/3be2bfe6-ead7-41ef-bcb6-d6cd16220b20-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "3be2bfe6-ead7-41ef-bcb6-d6cd16220b20" (UID: "3be2bfe6-ead7-41ef-bcb6-d6cd16220b20"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 13 03:31:02.295379 ip-10-0-134-52 kubenswrapper[2558]: I0713 03:31:02.295240 2558 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/3be2bfe6-ead7-41ef-bcb6-d6cd16220b20-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "3be2bfe6-ead7-41ef-bcb6-d6cd16220b20" (UID: "3be2bfe6-ead7-41ef-bcb6-d6cd16220b20"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 13 03:31:02.295379 ip-10-0-134-52 kubenswrapper[2558]: I0713 03:31:02.295261 2558 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/3be2bfe6-ead7-41ef-bcb6-d6cd16220b20-istiod-ca-cert\") on node \"ip-10-0-134-52.ec2.internal\" DevicePath \"\"" Jul 13 03:31:02.295379 ip-10-0-134-52 kubenswrapper[2558]: I0713 03:31:02.295280 2558 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/3be2bfe6-ead7-41ef-bcb6-d6cd16220b20-workload-certs\") on node \"ip-10-0-134-52.ec2.internal\" DevicePath \"\"" Jul 13 03:31:02.296201 ip-10-0-134-52 kubenswrapper[2558]: I0713 03:31:02.296175 2558 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/3be2bfe6-ead7-41ef-bcb6-d6cd16220b20-istio-data" (OuterVolumeSpecName: "istio-data") pod "3be2bfe6-ead7-41ef-bcb6-d6cd16220b20" (UID: "3be2bfe6-ead7-41ef-bcb6-d6cd16220b20"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 13 03:31:02.297346 ip-10-0-134-52 kubenswrapper[2558]: I0713 03:31:02.297298 2558 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/3be2bfe6-ead7-41ef-bcb6-d6cd16220b20-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "3be2bfe6-ead7-41ef-bcb6-d6cd16220b20" (UID: "3be2bfe6-ead7-41ef-bcb6-d6cd16220b20"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue "" Jul 13 03:31:02.297448 ip-10-0-134-52 kubenswrapper[2558]: I0713 03:31:02.297364 2558 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/3be2bfe6-ead7-41ef-bcb6-d6cd16220b20-istio-token" (OuterVolumeSpecName: "istio-token") pod "3be2bfe6-ead7-41ef-bcb6-d6cd16220b20" (UID: "3be2bfe6-ead7-41ef-bcb6-d6cd16220b20"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 13 03:31:02.297798 ip-10-0-134-52 kubenswrapper[2558]: I0713 03:31:02.297766 2558 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/3be2bfe6-ead7-41ef-bcb6-d6cd16220b20-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "3be2bfe6-ead7-41ef-bcb6-d6cd16220b20" (UID: "3be2bfe6-ead7-41ef-bcb6-d6cd16220b20"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 13 03:31:02.297895 ip-10-0-134-52 kubenswrapper[2558]: I0713 03:31:02.297816 2558 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/3be2bfe6-ead7-41ef-bcb6-d6cd16220b20-kube-api-access-8bfk7" (OuterVolumeSpecName: "kube-api-access-8bfk7") pod "3be2bfe6-ead7-41ef-bcb6-d6cd16220b20" (UID: "3be2bfe6-ead7-41ef-bcb6-d6cd16220b20"). InnerVolumeSpecName "kube-api-access-8bfk7". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 13 03:31:02.375131 ip-10-0-134-52 kubenswrapper[2558]: I0713 03:31:02.375105 2558 generic.go:356] "Generic (PLEG): container finished" podID="3be2bfe6-ead7-41ef-bcb6-d6cd16220b20" containerID="122598d8ed006ce9e7eefcfdbc6ba01bb487b3a4c20f4cb0ceaf20e22d86bae4" exitCode=0 Jul 13 03:31:02.375276 ip-10-0-134-52 kubenswrapper[2558]: I0713 03:31:02.375141 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ait-49b1aeaf-openshift-default-79d9969c7-cmvnm" event={"ID":"3be2bfe6-ead7-41ef-bcb6-d6cd16220b20","Type":"ContainerDied","Data":"122598d8ed006ce9e7eefcfdbc6ba01bb487b3a4c20f4cb0ceaf20e22d86bae4"} Jul 13 03:31:02.375276 ip-10-0-134-52 kubenswrapper[2558]: I0713 03:31:02.375159 2558 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ait-49b1aeaf-openshift-default-79d9969c7-cmvnm" Jul 13 03:31:02.375276 ip-10-0-134-52 kubenswrapper[2558]: I0713 03:31:02.375198 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ait-49b1aeaf-openshift-default-79d9969c7-cmvnm" event={"ID":"3be2bfe6-ead7-41ef-bcb6-d6cd16220b20","Type":"ContainerDied","Data":"a9037fa00e49bc5ad494974b5cf7d962b3f1d42b39fe97152b2e67e088617307"} Jul 13 03:31:02.375276 ip-10-0-134-52 kubenswrapper[2558]: I0713 03:31:02.375221 2558 scope.go:117] "RemoveContainer" containerID="122598d8ed006ce9e7eefcfdbc6ba01bb487b3a4c20f4cb0ceaf20e22d86bae4" Jul 13 03:31:02.385263 ip-10-0-134-52 kubenswrapper[2558]: I0713 03:31:02.385248 2558 scope.go:117] "RemoveContainer" containerID="122598d8ed006ce9e7eefcfdbc6ba01bb487b3a4c20f4cb0ceaf20e22d86bae4" Jul 13 03:31:02.385557 ip-10-0-134-52 kubenswrapper[2558]: E0713 03:31:02.385538 2558 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"122598d8ed006ce9e7eefcfdbc6ba01bb487b3a4c20f4cb0ceaf20e22d86bae4\": container with ID starting with 122598d8ed006ce9e7eefcfdbc6ba01bb487b3a4c20f4cb0ceaf20e22d86bae4 not found: ID does not exist" containerID="122598d8ed006ce9e7eefcfdbc6ba01bb487b3a4c20f4cb0ceaf20e22d86bae4" Jul 13 03:31:02.385609 ip-10-0-134-52 kubenswrapper[2558]: I0713 03:31:02.385566 2558 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"122598d8ed006ce9e7eefcfdbc6ba01bb487b3a4c20f4cb0ceaf20e22d86bae4"} err="failed to get container status \"122598d8ed006ce9e7eefcfdbc6ba01bb487b3a4c20f4cb0ceaf20e22d86bae4\": rpc error: code = NotFound desc = could not find container \"122598d8ed006ce9e7eefcfdbc6ba01bb487b3a4c20f4cb0ceaf20e22d86bae4\": container with ID starting with 122598d8ed006ce9e7eefcfdbc6ba01bb487b3a4c20f4cb0ceaf20e22d86bae4 not found: ID does not exist" Jul 13 03:31:02.396410 ip-10-0-134-52 kubenswrapper[2558]: I0713 03:31:02.396258 2558 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-8bfk7\" (UniqueName: \"kubernetes.io/projected/3be2bfe6-ead7-41ef-bcb6-d6cd16220b20-kube-api-access-8bfk7\") on node \"ip-10-0-134-52.ec2.internal\" DevicePath \"\"" Jul 13 03:31:02.396410 ip-10-0-134-52 kubenswrapper[2558]: I0713 03:31:02.396285 2558 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/3be2bfe6-ead7-41ef-bcb6-d6cd16220b20-istio-envoy\") on node \"ip-10-0-134-52.ec2.internal\" DevicePath \"\"" Jul 13 03:31:02.396410 ip-10-0-134-52 kubenswrapper[2558]: I0713 03:31:02.396299 2558 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/3be2bfe6-ead7-41ef-bcb6-d6cd16220b20-credential-socket\") on node \"ip-10-0-134-52.ec2.internal\" DevicePath \"\"" Jul 13 03:31:02.396410 ip-10-0-134-52 kubenswrapper[2558]: I0713 03:31:02.396311 2558 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/3be2bfe6-ead7-41ef-bcb6-d6cd16220b20-istio-token\") on node \"ip-10-0-134-52.ec2.internal\" DevicePath \"\"" Jul 13 03:31:02.396410 ip-10-0-134-52 kubenswrapper[2558]: I0713 03:31:02.396323 2558 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/3be2bfe6-ead7-41ef-bcb6-d6cd16220b20-istio-data\") on node \"ip-10-0-134-52.ec2.internal\" DevicePath \"\"" Jul 13 03:31:02.396410 ip-10-0-134-52 kubenswrapper[2558]: I0713 03:31:02.396353 2558 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/3be2bfe6-ead7-41ef-bcb6-d6cd16220b20-workload-socket\") on node \"ip-10-0-134-52.ec2.internal\" DevicePath \"\"" Jul 13 03:31:02.396410 ip-10-0-134-52 kubenswrapper[2558]: I0713 03:31:02.396364 2558 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/3be2bfe6-ead7-41ef-bcb6-d6cd16220b20-istio-podinfo\") on node \"ip-10-0-134-52.ec2.internal\" DevicePath \"\"" Jul 13 03:31:02.399622 ip-10-0-134-52 kubenswrapper[2558]: I0713 03:31:02.399598 2558 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-ait-49b1aeaf-openshift-default-79d9969c7-cmvnm"] Jul 13 03:31:02.403049 ip-10-0-134-52 kubenswrapper[2558]: I0713 03:31:02.403025 2558 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-ait-49b1aeaf-openshift-default-79d9969c7-cmvnm"] Jul 13 03:31:02.584470 ip-10-0-134-52 kubenswrapper[2558]: I0713 03:31:02.584443 2558 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-derive-33013832-openshift-default-666d6dcbf5-k2mr9"] Jul 13 03:31:02.584835 ip-10-0-134-52 kubenswrapper[2558]: I0713 03:31:02.584821 2558 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="3be2bfe6-ead7-41ef-bcb6-d6cd16220b20" containerName="istio-proxy" Jul 13 03:31:02.584883 ip-10-0-134-52 kubenswrapper[2558]: I0713 03:31:02.584836 2558 state_mem.go:107] "Deleted CPUSet assignment" podUID="3be2bfe6-ead7-41ef-bcb6-d6cd16220b20" containerName="istio-proxy" Jul 13 03:31:02.584922 ip-10-0-134-52 kubenswrapper[2558]: I0713 03:31:02.584906 2558 memory_manager.go:368] "RemoveStaleState removing state" podUID="3be2bfe6-ead7-41ef-bcb6-d6cd16220b20" containerName="istio-proxy" Jul 13 03:31:02.587683 ip-10-0-134-52 kubenswrapper[2558]: I0713 03:31:02.587661 2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-derive-33013832-openshift-default-666d6dcbf5-k2mr9" Jul 13 03:31:02.590464 ip-10-0-134-52 kubenswrapper[2558]: I0713 03:31:02.590440 2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-derive-33013832-openshift-default-dockercfg-46jcw\"" Jul 13 03:31:02.600081 ip-10-0-134-52 kubenswrapper[2558]: I0713 03:31:02.600060 2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-derive-33013832-openshift-default-666d6dcbf5-k2mr9"] Jul 13 03:31:02.700133 ip-10-0-134-52 kubenswrapper[2558]: I0713 03:31:02.700104 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/face8612-0918-4306-ab28-24ab5345752c-istio-envoy\") pod \"e2e-derive-33013832-openshift-default-666d6dcbf5-k2mr9\" (UID: \"face8612-0918-4306-ab28-24ab5345752c\") " pod="openshift-ingress/e2e-derive-33013832-openshift-default-666d6dcbf5-k2mr9" Jul 13 03:31:02.700301 ip-10-0-134-52 kubenswrapper[2558]: I0713 03:31:02.700146 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/face8612-0918-4306-ab28-24ab5345752c-istio-podinfo\") pod \"e2e-derive-33013832-openshift-default-666d6dcbf5-k2mr9\" (UID: \"face8612-0918-4306-ab28-24ab5345752c\") " pod="openshift-ingress/e2e-derive-33013832-openshift-default-666d6dcbf5-k2mr9" Jul 13 03:31:02.700301 ip-10-0-134-52 kubenswrapper[2558]: I0713 03:31:02.700212 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-rp95b\" (UniqueName: \"kubernetes.io/projected/face8612-0918-4306-ab28-24ab5345752c-kube-api-access-rp95b\") pod \"e2e-derive-33013832-openshift-default-666d6dcbf5-k2mr9\" (UID: \"face8612-0918-4306-ab28-24ab5345752c\") " pod="openshift-ingress/e2e-derive-33013832-openshift-default-666d6dcbf5-k2mr9" Jul 13 03:31:02.700301 ip-10-0-134-52 kubenswrapper[2558]: I0713 03:31:02.700254 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/face8612-0918-4306-ab28-24ab5345752c-istiod-ca-cert\") pod \"e2e-derive-33013832-openshift-default-666d6dcbf5-k2mr9\" (UID: \"face8612-0918-4306-ab28-24ab5345752c\") " pod="openshift-ingress/e2e-derive-33013832-openshift-default-666d6dcbf5-k2mr9" Jul 13 03:31:02.700464 ip-10-0-134-52 kubenswrapper[2558]: I0713 03:31:02.700318 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/face8612-0918-4306-ab28-24ab5345752c-workload-certs\") pod \"e2e-derive-33013832-openshift-default-666d6dcbf5-k2mr9\" (UID: \"face8612-0918-4306-ab28-24ab5345752c\") " pod="openshift-ingress/e2e-derive-33013832-openshift-default-666d6dcbf5-k2mr9" Jul 13 03:31:02.700464 ip-10-0-134-52 kubenswrapper[2558]: I0713 03:31:02.700427 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/face8612-0918-4306-ab28-24ab5345752c-istio-data\") pod \"e2e-derive-33013832-openshift-default-666d6dcbf5-k2mr9\" (UID: \"face8612-0918-4306-ab28-24ab5345752c\") " pod="openshift-ingress/e2e-derive-33013832-openshift-default-666d6dcbf5-k2mr9" Jul 13 03:31:02.700464 ip-10-0-134-52 kubenswrapper[2558]: I0713 03:31:02.700454 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/face8612-0918-4306-ab28-24ab5345752c-workload-socket\") pod \"e2e-derive-33013832-openshift-default-666d6dcbf5-k2mr9\" (UID: \"face8612-0918-4306-ab28-24ab5345752c\") " pod="openshift-ingress/e2e-derive-33013832-openshift-default-666d6dcbf5-k2mr9" Jul 13 03:31:02.700575 ip-10-0-134-52 kubenswrapper[2558]: I0713 03:31:02.700471 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/face8612-0918-4306-ab28-24ab5345752c-istio-token\") pod \"e2e-derive-33013832-openshift-default-666d6dcbf5-k2mr9\" (UID: \"face8612-0918-4306-ab28-24ab5345752c\") " pod="openshift-ingress/e2e-derive-33013832-openshift-default-666d6dcbf5-k2mr9" Jul 13 03:31:02.700575 ip-10-0-134-52 kubenswrapper[2558]: I0713 03:31:02.700547 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/face8612-0918-4306-ab28-24ab5345752c-credential-socket\") pod \"e2e-derive-33013832-openshift-default-666d6dcbf5-k2mr9\" (UID: \"face8612-0918-4306-ab28-24ab5345752c\") " pod="openshift-ingress/e2e-derive-33013832-openshift-default-666d6dcbf5-k2mr9" Jul 13 03:31:02.801236 ip-10-0-134-52 kubenswrapper[2558]: I0713 03:31:02.801183 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/face8612-0918-4306-ab28-24ab5345752c-workload-certs\") pod \"e2e-derive-33013832-openshift-default-666d6dcbf5-k2mr9\" (UID: \"face8612-0918-4306-ab28-24ab5345752c\") " pod="openshift-ingress/e2e-derive-33013832-openshift-default-666d6dcbf5-k2mr9" Jul 13 03:31:02.801430 ip-10-0-134-52 kubenswrapper[2558]: I0713 03:31:02.801257 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/face8612-0918-4306-ab28-24ab5345752c-istio-data\") pod \"e2e-derive-33013832-openshift-default-666d6dcbf5-k2mr9\" (UID: \"face8612-0918-4306-ab28-24ab5345752c\") " pod="openshift-ingress/e2e-derive-33013832-openshift-default-666d6dcbf5-k2mr9" Jul 13 03:31:02.801430 ip-10-0-134-52 kubenswrapper[2558]: I0713 03:31:02.801285 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/face8612-0918-4306-ab28-24ab5345752c-workload-socket\") pod \"e2e-derive-33013832-openshift-default-666d6dcbf5-k2mr9\" (UID: \"face8612-0918-4306-ab28-24ab5345752c\") " pod="openshift-ingress/e2e-derive-33013832-openshift-default-666d6dcbf5-k2mr9" Jul 13 03:31:02.801430 ip-10-0-134-52 kubenswrapper[2558]: I0713 03:31:02.801311 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/face8612-0918-4306-ab28-24ab5345752c-istio-token\") pod \"e2e-derive-33013832-openshift-default-666d6dcbf5-k2mr9\" (UID: \"face8612-0918-4306-ab28-24ab5345752c\") " pod="openshift-ingress/e2e-derive-33013832-openshift-default-666d6dcbf5-k2mr9" Jul 13 03:31:02.801430 ip-10-0-134-52 kubenswrapper[2558]: I0713 03:31:02.801393 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/face8612-0918-4306-ab28-24ab5345752c-credential-socket\") pod \"e2e-derive-33013832-openshift-default-666d6dcbf5-k2mr9\" (UID: \"face8612-0918-4306-ab28-24ab5345752c\") " pod="openshift-ingress/e2e-derive-33013832-openshift-default-666d6dcbf5-k2mr9" Jul 13 03:31:02.801668 ip-10-0-134-52 kubenswrapper[2558]: I0713 03:31:02.801471 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/face8612-0918-4306-ab28-24ab5345752c-istio-envoy\") pod \"e2e-derive-33013832-openshift-default-666d6dcbf5-k2mr9\" (UID: \"face8612-0918-4306-ab28-24ab5345752c\") " pod="openshift-ingress/e2e-derive-33013832-openshift-default-666d6dcbf5-k2mr9" Jul 13 03:31:02.801668 ip-10-0-134-52 kubenswrapper[2558]: I0713 03:31:02.801615 2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/face8612-0918-4306-ab28-24ab5345752c-workload-certs\") pod \"e2e-derive-33013832-openshift-default-666d6dcbf5-k2mr9\" (UID: \"face8612-0918-4306-ab28-24ab5345752c\") " pod="openshift-ingress/e2e-derive-33013832-openshift-default-666d6dcbf5-k2mr9" Jul 13 03:31:02.801668 ip-10-0-134-52 kubenswrapper[2558]: I0713 03:31:02.801635 2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/face8612-0918-4306-ab28-24ab5345752c-workload-socket\") pod \"e2e-derive-33013832-openshift-default-666d6dcbf5-k2mr9\" (UID: \"face8612-0918-4306-ab28-24ab5345752c\") " pod="openshift-ingress/e2e-derive-33013832-openshift-default-666d6dcbf5-k2mr9" Jul 13 03:31:02.801668 ip-10-0-134-52 kubenswrapper[2558]: I0713 03:31:02.801641 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/face8612-0918-4306-ab28-24ab5345752c-istio-podinfo\") pod \"e2e-derive-33013832-openshift-default-666d6dcbf5-k2mr9\" (UID: \"face8612-0918-4306-ab28-24ab5345752c\") " pod="openshift-ingress/e2e-derive-33013832-openshift-default-666d6dcbf5-k2mr9" Jul 13 03:31:02.801892 ip-10-0-134-52 kubenswrapper[2558]: I0713 03:31:02.801682 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-rp95b\" (UniqueName: \"kubernetes.io/projected/face8612-0918-4306-ab28-24ab5345752c-kube-api-access-rp95b\") pod \"e2e-derive-33013832-openshift-default-666d6dcbf5-k2mr9\" (UID: \"face8612-0918-4306-ab28-24ab5345752c\") " pod="openshift-ingress/e2e-derive-33013832-openshift-default-666d6dcbf5-k2mr9" Jul 13 03:31:02.801892 ip-10-0-134-52 kubenswrapper[2558]: I0713 03:31:02.801714 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/face8612-0918-4306-ab28-24ab5345752c-istiod-ca-cert\") pod \"e2e-derive-33013832-openshift-default-666d6dcbf5-k2mr9\" (UID: \"face8612-0918-4306-ab28-24ab5345752c\") " pod="openshift-ingress/e2e-derive-33013832-openshift-default-666d6dcbf5-k2mr9" Jul 13 03:31:02.801892 ip-10-0-134-52 kubenswrapper[2558]: I0713 03:31:02.801784 2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/face8612-0918-4306-ab28-24ab5345752c-credential-socket\") pod \"e2e-derive-33013832-openshift-default-666d6dcbf5-k2mr9\" (UID: \"face8612-0918-4306-ab28-24ab5345752c\") " pod="openshift-ingress/e2e-derive-33013832-openshift-default-666d6dcbf5-k2mr9" Jul 13 03:31:02.802051 ip-10-0-134-52 kubenswrapper[2558]: I0713 03:31:02.801943 2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/face8612-0918-4306-ab28-24ab5345752c-istio-data\") pod \"e2e-derive-33013832-openshift-default-666d6dcbf5-k2mr9\" (UID: \"face8612-0918-4306-ab28-24ab5345752c\") " pod="openshift-ingress/e2e-derive-33013832-openshift-default-666d6dcbf5-k2mr9" Jul 13 03:31:02.802366 ip-10-0-134-52 kubenswrapper[2558]: I0713 03:31:02.802281 2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/face8612-0918-4306-ab28-24ab5345752c-istiod-ca-cert\") pod \"e2e-derive-33013832-openshift-default-666d6dcbf5-k2mr9\" (UID: \"face8612-0918-4306-ab28-24ab5345752c\") " pod="openshift-ingress/e2e-derive-33013832-openshift-default-666d6dcbf5-k2mr9" Jul 13 03:31:02.803861 ip-10-0-134-52 kubenswrapper[2558]: I0713 03:31:02.803839 2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/face8612-0918-4306-ab28-24ab5345752c-istio-envoy\") pod \"e2e-derive-33013832-openshift-default-666d6dcbf5-k2mr9\" (UID: \"face8612-0918-4306-ab28-24ab5345752c\") " pod="openshift-ingress/e2e-derive-33013832-openshift-default-666d6dcbf5-k2mr9" Jul 13 03:31:02.804126 ip-10-0-134-52 kubenswrapper[2558]: I0713 03:31:02.804100 2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/face8612-0918-4306-ab28-24ab5345752c-istio-podinfo\") pod \"e2e-derive-33013832-openshift-default-666d6dcbf5-k2mr9\" (UID: \"face8612-0918-4306-ab28-24ab5345752c\") " pod="openshift-ingress/e2e-derive-33013832-openshift-default-666d6dcbf5-k2mr9" Jul 13 03:31:02.809315 ip-10-0-134-52 kubenswrapper[2558]: I0713 03:31:02.809291 2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/face8612-0918-4306-ab28-24ab5345752c-istio-token\") pod \"e2e-derive-33013832-openshift-default-666d6dcbf5-k2mr9\" (UID: \"face8612-0918-4306-ab28-24ab5345752c\") " pod="openshift-ingress/e2e-derive-33013832-openshift-default-666d6dcbf5-k2mr9" Jul 13 03:31:02.809562 ip-10-0-134-52 kubenswrapper[2558]: I0713 03:31:02.809543 2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-rp95b\" (UniqueName: \"kubernetes.io/projected/face8612-0918-4306-ab28-24ab5345752c-kube-api-access-rp95b\") pod \"e2e-derive-33013832-openshift-default-666d6dcbf5-k2mr9\" (UID: \"face8612-0918-4306-ab28-24ab5345752c\") " pod="openshift-ingress/e2e-derive-33013832-openshift-default-666d6dcbf5-k2mr9" Jul 13 03:31:02.899779 ip-10-0-134-52 kubenswrapper[2558]: I0713 03:31:02.899718 2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-derive-33013832-openshift-default-666d6dcbf5-k2mr9" Jul 13 03:31:03.038918 ip-10-0-134-52 kubenswrapper[2558]: I0713 03:31:03.038893 2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-derive-33013832-openshift-default-666d6dcbf5-k2mr9"] Jul 13 03:31:03.039988 ip-10-0-134-52 kubenswrapper[2558]: W0713 03:31:03.039962 2558 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podface8612_0918_4306_ab28_24ab5345752c.slice/crio-1fd461ba1e0c354409975c9dc4d842e4a2c15ca595b20f7f4874ce065e50a658 WatchSource:0}: Error finding container 1fd461ba1e0c354409975c9dc4d842e4a2c15ca595b20f7f4874ce065e50a658: Status 404 returned error can't find the container with id 1fd461ba1e0c354409975c9dc4d842e4a2c15ca595b20f7f4874ce065e50a658 Jul 13 03:31:03.042604 ip-10-0-134-52 kubenswrapper[2558]: I0713 03:31:03.042576 2558 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892164Ki","pods":"250"} Jul 13 03:31:03.042672 ip-10-0-134-52 kubenswrapper[2558]: I0713 03:31:03.042634 2558 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892164Ki","pods":"250"} Jul 13 03:31:03.042707 ip-10-0-134-52 kubenswrapper[2558]: I0713 03:31:03.042689 2558 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892164Ki","pods":"250"} Jul 13 03:31:03.383772 ip-10-0-134-52 kubenswrapper[2558]: I0713 03:31:03.383732 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-derive-33013832-openshift-default-666d6dcbf5-k2mr9" event={"ID":"face8612-0918-4306-ab28-24ab5345752c","Type":"ContainerStarted","Data":"4efbfa6af8a900ef8065760976423a8a70af28a416636a2a50679334cf246f05"} Jul 13 03:31:03.384163 ip-10-0-134-52 kubenswrapper[2558]: I0713 03:31:03.383824 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-derive-33013832-openshift-default-666d6dcbf5-k2mr9" event={"ID":"face8612-0918-4306-ab28-24ab5345752c","Type":"ContainerStarted","Data":"1fd461ba1e0c354409975c9dc4d842e4a2c15ca595b20f7f4874ce065e50a658"} Jul 13 03:31:03.408887 ip-10-0-134-52 kubenswrapper[2558]: I0713 03:31:03.408830 2558 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-derive-33013832-openshift-default-666d6dcbf5-k2mr9" podStartSLOduration=1.408811577 podStartE2EDuration="1.408811577s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-13 03:31:02 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-13 03:31:03.405402078 +0000 UTC m=+2045.806002544" watchObservedRunningTime="2026-07-13 03:31:03.408811577 +0000 UTC m=+2045.809412044" Jul 13 03:31:03.900736 ip-10-0-134-52 kubenswrapper[2558]: I0713 03:31:03.900693 2558 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-derive-33013832-openshift-default-666d6dcbf5-k2mr9" Jul 13 03:31:04.095871 ip-10-0-134-52 kubenswrapper[2558]: I0713 03:31:04.095831 2558 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="3be2bfe6-ead7-41ef-bcb6-d6cd16220b20" path="/var/lib/kubelet/pods/3be2bfe6-ead7-41ef-bcb6-d6cd16220b20/volumes" Jul 13 03:31:04.905187 ip-10-0-134-52 kubenswrapper[2558]: I0713 03:31:04.905161 2558 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-derive-33013832-openshift-default-666d6dcbf5-k2mr9" Jul 13 03:31:05.395918 ip-10-0-134-52 kubenswrapper[2558]: I0713 03:31:05.395884 2558 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-derive-33013832-openshift-default-666d6dcbf5-k2mr9" Jul 13 03:31:05.396895 ip-10-0-134-52 kubenswrapper[2558]: I0713 03:31:05.396877 2558 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-derive-33013832-openshift-default-666d6dcbf5-k2mr9" Jul 13 03:31:05.837825 ip-10-0-134-52 kubenswrapper[2558]: I0713 03:31:05.837793 2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-nq4gl"] Jul 13 03:31:08.326043 ip-10-0-134-52 kubenswrapper[2558]: I0713 03:31:08.326007 2558 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-derive-33013832-openshift-default-666d6dcbf5-k2mr9"] Jul 13 03:31:08.413833 ip-10-0-134-52 kubenswrapper[2558]: I0713 03:31:08.413789 2558 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/e2e-derive-33013832-openshift-default-666d6dcbf5-k2mr9" podUID="face8612-0918-4306-ab28-24ab5345752c" containerName="istio-proxy" containerID="cri-o://4efbfa6af8a900ef8065760976423a8a70af28a416636a2a50679334cf246f05" gracePeriod=30 Jul 13 03:31:13.669837 ip-10-0-134-52 kubenswrapper[2558]: I0713 03:31:13.669805 2558 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-derive-33013832-openshift-default-666d6dcbf5-k2mr9" Jul 13 03:31:13.794996 ip-10-0-134-52 kubenswrapper[2558]: I0713 03:31:13.794909 2558 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/face8612-0918-4306-ab28-24ab5345752c-workload-certs\") pod \"face8612-0918-4306-ab28-24ab5345752c\" (UID: \"face8612-0918-4306-ab28-24ab5345752c\") " Jul 13 03:31:13.794996 ip-10-0-134-52 kubenswrapper[2558]: I0713 03:31:13.794955 2558 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/face8612-0918-4306-ab28-24ab5345752c-istio-data\") pod \"face8612-0918-4306-ab28-24ab5345752c\" (UID: \"face8612-0918-4306-ab28-24ab5345752c\") " Jul 13 03:31:13.794996 ip-10-0-134-52 kubenswrapper[2558]: I0713 03:31:13.794991 2558 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-rp95b\" (UniqueName: \"kubernetes.io/projected/face8612-0918-4306-ab28-24ab5345752c-kube-api-access-rp95b\") pod \"face8612-0918-4306-ab28-24ab5345752c\" (UID: \"face8612-0918-4306-ab28-24ab5345752c\") " Jul 13 03:31:13.795272 ip-10-0-134-52 kubenswrapper[2558]: I0713 03:31:13.795023 2558 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/face8612-0918-4306-ab28-24ab5345752c-istio-podinfo\") pod \"face8612-0918-4306-ab28-24ab5345752c\" (UID: \"face8612-0918-4306-ab28-24ab5345752c\") " Jul 13 03:31:13.795272 ip-10-0-134-52 kubenswrapper[2558]: I0713 03:31:13.795178 2558 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/face8612-0918-4306-ab28-24ab5345752c-workload-socket\") pod \"face8612-0918-4306-ab28-24ab5345752c\" (UID: \"face8612-0918-4306-ab28-24ab5345752c\") " Jul 13 03:31:13.795272 ip-10-0-134-52 kubenswrapper[2558]: I0713 03:31:13.795242 2558 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/face8612-0918-4306-ab28-24ab5345752c-istio-data" (OuterVolumeSpecName: "istio-data") pod "face8612-0918-4306-ab28-24ab5345752c" (UID: "face8612-0918-4306-ab28-24ab5345752c"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 13 03:31:13.795272 ip-10-0-134-52 kubenswrapper[2558]: I0713 03:31:13.795262 2558 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/face8612-0918-4306-ab28-24ab5345752c-istiod-ca-cert\") pod \"face8612-0918-4306-ab28-24ab5345752c\" (UID: \"face8612-0918-4306-ab28-24ab5345752c\") " Jul 13 03:31:13.795511 ip-10-0-134-52 kubenswrapper[2558]: I0713 03:31:13.795302 2558 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/face8612-0918-4306-ab28-24ab5345752c-istio-token\") pod \"face8612-0918-4306-ab28-24ab5345752c\" (UID: \"face8612-0918-4306-ab28-24ab5345752c\") " Jul 13 03:31:13.795511 ip-10-0-134-52 kubenswrapper[2558]: I0713 03:31:13.795256 2558 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/face8612-0918-4306-ab28-24ab5345752c-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "face8612-0918-4306-ab28-24ab5345752c" (UID: "face8612-0918-4306-ab28-24ab5345752c"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 13 03:31:13.795511 ip-10-0-134-52 kubenswrapper[2558]: I0713 03:31:13.795363 2558 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/face8612-0918-4306-ab28-24ab5345752c-credential-socket\") pod \"face8612-0918-4306-ab28-24ab5345752c\" (UID: \"face8612-0918-4306-ab28-24ab5345752c\") " Jul 13 03:31:13.795511 ip-10-0-134-52 kubenswrapper[2558]: I0713 03:31:13.795410 2558 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/face8612-0918-4306-ab28-24ab5345752c-istio-envoy\") pod \"face8612-0918-4306-ab28-24ab5345752c\" (UID: \"face8612-0918-4306-ab28-24ab5345752c\") " Jul 13 03:31:13.795511 ip-10-0-134-52 kubenswrapper[2558]: I0713 03:31:13.795474 2558 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/face8612-0918-4306-ab28-24ab5345752c-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "face8612-0918-4306-ab28-24ab5345752c" (UID: "face8612-0918-4306-ab28-24ab5345752c"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 13 03:31:13.795803 ip-10-0-134-52 kubenswrapper[2558]: I0713 03:31:13.795640 2558 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/face8612-0918-4306-ab28-24ab5345752c-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "face8612-0918-4306-ab28-24ab5345752c" (UID: "face8612-0918-4306-ab28-24ab5345752c"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 13 03:31:13.795803 ip-10-0-134-52 kubenswrapper[2558]: I0713 03:31:13.795822 2558 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/face8612-0918-4306-ab28-24ab5345752c-workload-certs\") on node \"ip-10-0-134-52.ec2.internal\" DevicePath \"\"" Jul 13 03:31:13.796023 ip-10-0-134-52 kubenswrapper[2558]: I0713 03:31:13.795840 2558 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/face8612-0918-4306-ab28-24ab5345752c-istio-data\") on node \"ip-10-0-134-52.ec2.internal\" DevicePath \"\"" Jul 13 03:31:13.796023 ip-10-0-134-52 kubenswrapper[2558]: I0713 03:31:13.795853 2558 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/face8612-0918-4306-ab28-24ab5345752c-workload-socket\") on node \"ip-10-0-134-52.ec2.internal\" DevicePath \"\"" Jul 13 03:31:13.796023 ip-10-0-134-52 kubenswrapper[2558]: I0713 03:31:13.795864 2558 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/face8612-0918-4306-ab28-24ab5345752c-credential-socket\") on node \"ip-10-0-134-52.ec2.internal\" DevicePath \"\"" Jul 13 03:31:13.797527 ip-10-0-134-52 kubenswrapper[2558]: I0713 03:31:13.797484 2558 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/face8612-0918-4306-ab28-24ab5345752c-kube-api-access-rp95b" (OuterVolumeSpecName: "kube-api-access-rp95b") pod "face8612-0918-4306-ab28-24ab5345752c" (UID: "face8612-0918-4306-ab28-24ab5345752c"). InnerVolumeSpecName "kube-api-access-rp95b". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 13 03:31:13.797664 ip-10-0-134-52 kubenswrapper[2558]: I0713 03:31:13.797560 2558 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/face8612-0918-4306-ab28-24ab5345752c-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "face8612-0918-4306-ab28-24ab5345752c" (UID: "face8612-0918-4306-ab28-24ab5345752c"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 13 03:31:13.797758 ip-10-0-134-52 kubenswrapper[2558]: I0713 03:31:13.797735 2558 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/face8612-0918-4306-ab28-24ab5345752c-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "face8612-0918-4306-ab28-24ab5345752c" (UID: "face8612-0918-4306-ab28-24ab5345752c"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue "" Jul 13 03:31:13.797897 ip-10-0-134-52 kubenswrapper[2558]: I0713 03:31:13.797879 2558 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/face8612-0918-4306-ab28-24ab5345752c-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "face8612-0918-4306-ab28-24ab5345752c" (UID: "face8612-0918-4306-ab28-24ab5345752c"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 13 03:31:13.797941 ip-10-0-134-52 kubenswrapper[2558]: I0713 03:31:13.797917 2558 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/face8612-0918-4306-ab28-24ab5345752c-istio-token" (OuterVolumeSpecName: "istio-token") pod "face8612-0918-4306-ab28-24ab5345752c" (UID: "face8612-0918-4306-ab28-24ab5345752c"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 13 03:31:13.896454 ip-10-0-134-52 kubenswrapper[2558]: I0713 03:31:13.896428 2558 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/face8612-0918-4306-ab28-24ab5345752c-istiod-ca-cert\") on node \"ip-10-0-134-52.ec2.internal\" DevicePath \"\"" Jul 13 03:31:13.896454 ip-10-0-134-52 kubenswrapper[2558]: I0713 03:31:13.896451 2558 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/face8612-0918-4306-ab28-24ab5345752c-istio-token\") on node \"ip-10-0-134-52.ec2.internal\" DevicePath \"\"" Jul 13 03:31:13.896454 ip-10-0-134-52 kubenswrapper[2558]: I0713 03:31:13.896458 2558 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/face8612-0918-4306-ab28-24ab5345752c-istio-envoy\") on node \"ip-10-0-134-52.ec2.internal\" DevicePath \"\"" Jul 13 03:31:13.896636 ip-10-0-134-52 kubenswrapper[2558]: I0713 03:31:13.896466 2558 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-rp95b\" (UniqueName: \"kubernetes.io/projected/face8612-0918-4306-ab28-24ab5345752c-kube-api-access-rp95b\") on node \"ip-10-0-134-52.ec2.internal\" DevicePath \"\"" Jul 13 03:31:13.896636 ip-10-0-134-52 kubenswrapper[2558]: I0713 03:31:13.896474 2558 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/face8612-0918-4306-ab28-24ab5345752c-istio-podinfo\") on node \"ip-10-0-134-52.ec2.internal\" DevicePath \"\"" Jul 13 03:31:14.446678 ip-10-0-134-52 kubenswrapper[2558]: I0713 03:31:14.446599 2558 generic.go:356] "Generic (PLEG): container finished" podID="face8612-0918-4306-ab28-24ab5345752c" containerID="4efbfa6af8a900ef8065760976423a8a70af28a416636a2a50679334cf246f05" exitCode=0 Jul 13 03:31:14.446678 ip-10-0-134-52 kubenswrapper[2558]: I0713 03:31:14.446662 2558 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-derive-33013832-openshift-default-666d6dcbf5-k2mr9" Jul 13 03:31:14.446909 ip-10-0-134-52 kubenswrapper[2558]: I0713 03:31:14.446690 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-derive-33013832-openshift-default-666d6dcbf5-k2mr9" event={"ID":"face8612-0918-4306-ab28-24ab5345752c","Type":"ContainerDied","Data":"4efbfa6af8a900ef8065760976423a8a70af28a416636a2a50679334cf246f05"} Jul 13 03:31:14.446909 ip-10-0-134-52 kubenswrapper[2558]: I0713 03:31:14.446780 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-derive-33013832-openshift-default-666d6dcbf5-k2mr9" event={"ID":"face8612-0918-4306-ab28-24ab5345752c","Type":"ContainerDied","Data":"1fd461ba1e0c354409975c9dc4d842e4a2c15ca595b20f7f4874ce065e50a658"} Jul 13 03:31:14.446909 ip-10-0-134-52 kubenswrapper[2558]: I0713 03:31:14.446810 2558 scope.go:117] "RemoveContainer" containerID="4efbfa6af8a900ef8065760976423a8a70af28a416636a2a50679334cf246f05" Jul 13 03:31:14.456039 ip-10-0-134-52 kubenswrapper[2558]: I0713 03:31:14.456017 2558 scope.go:117] "RemoveContainer" containerID="4efbfa6af8a900ef8065760976423a8a70af28a416636a2a50679334cf246f05" Jul 13 03:31:14.456301 ip-10-0-134-52 kubenswrapper[2558]: E0713 03:31:14.456282 2558 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"4efbfa6af8a900ef8065760976423a8a70af28a416636a2a50679334cf246f05\": container with ID starting with 4efbfa6af8a900ef8065760976423a8a70af28a416636a2a50679334cf246f05 not found: ID does not exist" containerID="4efbfa6af8a900ef8065760976423a8a70af28a416636a2a50679334cf246f05" Jul 13 03:31:14.456390 ip-10-0-134-52 kubenswrapper[2558]: I0713 03:31:14.456312 2558 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"4efbfa6af8a900ef8065760976423a8a70af28a416636a2a50679334cf246f05"} err="failed to get container status \"4efbfa6af8a900ef8065760976423a8a70af28a416636a2a50679334cf246f05\": rpc error: code = NotFound desc = could not find container \"4efbfa6af8a900ef8065760976423a8a70af28a416636a2a50679334cf246f05\": container with ID starting with 4efbfa6af8a900ef8065760976423a8a70af28a416636a2a50679334cf246f05 not found: ID does not exist" Jul 13 03:31:14.464861 ip-10-0-134-52 kubenswrapper[2558]: I0713 03:31:14.464839 2558 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-derive-33013832-openshift-default-666d6dcbf5-k2mr9"] Jul 13 03:31:14.468986 ip-10-0-134-52 kubenswrapper[2558]: I0713 03:31:14.468967 2558 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-derive-33013832-openshift-default-666d6dcbf5-k2mr9"] Jul 13 03:31:16.093236 ip-10-0-134-52 kubenswrapper[2558]: I0713 03:31:16.093203 2558 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="face8612-0918-4306-ab28-24ab5345752c" path="/var/lib/kubelet/pods/face8612-0918-4306-ab28-24ab5345752c/volumes" Jul 13 03:31:30.188169 ip-10-0-134-52 kubenswrapper[2558]: I0713 03:31:30.188142 2558 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29731890-8txjd" Jul 13 03:31:30.543279 ip-10-0-134-52 kubenswrapper[2558]: I0713 03:31:30.543250 2558 generic.go:356] "Generic (PLEG): container finished" podID="a978b947-d849-4f76-a8ab-31d37f34fff8" containerID="0143c8565f08849b01e62b520c2d091c9fb2a7d921f1eb5f802308dbf1f9a832" exitCode=137 Jul 13 03:31:30.543459 ip-10-0-134-52 kubenswrapper[2558]: I0713 03:31:30.543295 2558 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29731890-8txjd" Jul 13 03:31:30.543459 ip-10-0-134-52 kubenswrapper[2558]: I0713 03:31:30.543317 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29731890-8txjd" event={"ID":"a978b947-d849-4f76-a8ab-31d37f34fff8","Type":"ContainerDied","Data":"0143c8565f08849b01e62b520c2d091c9fb2a7d921f1eb5f802308dbf1f9a832"} Jul 13 03:31:30.543459 ip-10-0-134-52 kubenswrapper[2558]: I0713 03:31:30.543374 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29731890-8txjd" event={"ID":"a978b947-d849-4f76-a8ab-31d37f34fff8","Type":"ContainerDied","Data":"b80ef199485e5d52effe343b48d430f637439e7f821d3f2d642975b665273dbb"} Jul 13 03:31:30.543459 ip-10-0-134-52 kubenswrapper[2558]: I0713 03:31:30.543397 2558 scope.go:117] "RemoveContainer" containerID="0143c8565f08849b01e62b520c2d091c9fb2a7d921f1eb5f802308dbf1f9a832" Jul 13 03:31:30.554648 ip-10-0-134-52 kubenswrapper[2558]: I0713 03:31:30.554567 2558 scope.go:117] "RemoveContainer" containerID="0143c8565f08849b01e62b520c2d091c9fb2a7d921f1eb5f802308dbf1f9a832" Jul 13 03:31:30.555030 ip-10-0-134-52 kubenswrapper[2558]: E0713 03:31:30.555004 2558 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"0143c8565f08849b01e62b520c2d091c9fb2a7d921f1eb5f802308dbf1f9a832\": container with ID starting with 0143c8565f08849b01e62b520c2d091c9fb2a7d921f1eb5f802308dbf1f9a832 not found: ID does not exist" containerID="0143c8565f08849b01e62b520c2d091c9fb2a7d921f1eb5f802308dbf1f9a832" Jul 13 03:31:30.555134 ip-10-0-134-52 kubenswrapper[2558]: I0713 03:31:30.555036 2558 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"0143c8565f08849b01e62b520c2d091c9fb2a7d921f1eb5f802308dbf1f9a832"} err="failed to get container status \"0143c8565f08849b01e62b520c2d091c9fb2a7d921f1eb5f802308dbf1f9a832\": rpc error: code = NotFound desc = could not find container \"0143c8565f08849b01e62b520c2d091c9fb2a7d921f1eb5f802308dbf1f9a832\": container with ID starting with 0143c8565f08849b01e62b520c2d091c9fb2a7d921f1eb5f802308dbf1f9a832 not found: ID does not exist" Jul 13 03:31:30.563819 ip-10-0-134-52 kubenswrapper[2558]: I0713 03:31:30.563797 2558 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-29731890-8txjd"] Jul 13 03:31:30.567517 ip-10-0-134-52 kubenswrapper[2558]: I0713 03:31:30.567497 2558 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-29731890-8txjd"] Jul 13 03:31:32.093084 ip-10-0-134-52 kubenswrapper[2558]: I0713 03:31:32.093048 2558 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="a978b947-d849-4f76-a8ab-31d37f34fff8" path="/var/lib/kubelet/pods/a978b947-d849-4f76-a8ab-31d37f34fff8/volumes" Jul 13 03:32:37.638887 ip-10-0-134-52 kubenswrapper[2558]: I0713 03:32:37.638857 2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-nq4gl"] Jul 13 03:32:46.543962 ip-10-0-134-52 kubenswrapper[2558]: I0713 03:32:46.543927 2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-nq4gl"] Jul 13 03:32:48.642928 ip-10-0-134-52 kubenswrapper[2558]: I0713 03:32:48.642835 2558 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-mt-a8f491a4-openshift-default-5f96589cb7-x7f7c"] Jul 13 03:32:48.643401 ip-10-0-134-52 kubenswrapper[2558]: I0713 03:32:48.643245 2558 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="a978b947-d849-4f76-a8ab-31d37f34fff8" containerName="cleanup" Jul 13 03:32:48.643401 ip-10-0-134-52 kubenswrapper[2558]: I0713 03:32:48.643258 2558 state_mem.go:107] "Deleted CPUSet assignment" podUID="a978b947-d849-4f76-a8ab-31d37f34fff8" containerName="cleanup" Jul 13 03:32:48.643401 ip-10-0-134-52 kubenswrapper[2558]: I0713 03:32:48.643269 2558 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="face8612-0918-4306-ab28-24ab5345752c" containerName="istio-proxy" Jul 13 03:32:48.643401 ip-10-0-134-52 kubenswrapper[2558]: I0713 03:32:48.643276 2558 state_mem.go:107] "Deleted CPUSet assignment" podUID="face8612-0918-4306-ab28-24ab5345752c" containerName="istio-proxy" Jul 13 03:32:48.643401 ip-10-0-134-52 kubenswrapper[2558]: I0713 03:32:48.643354 2558 memory_manager.go:368] "RemoveStaleState removing state" podUID="face8612-0918-4306-ab28-24ab5345752c" containerName="istio-proxy" Jul 13 03:32:48.643401 ip-10-0-134-52 kubenswrapper[2558]: I0713 03:32:48.643368 2558 memory_manager.go:368] "RemoveStaleState removing state" podUID="a978b947-d849-4f76-a8ab-31d37f34fff8" containerName="cleanup" Jul 13 03:32:48.646371 ip-10-0-134-52 kubenswrapper[2558]: I0713 03:32:48.646351 2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-mt-a8f491a4-openshift-default-5f96589cb7-x7f7c" Jul 13 03:32:48.649013 ip-10-0-134-52 kubenswrapper[2558]: I0713 03:32:48.648992 2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-mt-a8f491a4-openshift-default-dockercfg-w88rj\"" Jul 13 03:32:48.658671 ip-10-0-134-52 kubenswrapper[2558]: I0713 03:32:48.658648 2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-mt-a8f491a4-openshift-default-5f96589cb7-x7f7c"] Jul 13 03:32:48.737111 ip-10-0-134-52 kubenswrapper[2558]: I0713 03:32:48.737078 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/acc2dec2-bf68-4b50-9f03-a78a8d63ba21-istiod-ca-cert\") pod \"e2e-mt-a8f491a4-openshift-default-5f96589cb7-x7f7c\" (UID: \"acc2dec2-bf68-4b50-9f03-a78a8d63ba21\") " pod="openshift-ingress/e2e-mt-a8f491a4-openshift-default-5f96589cb7-x7f7c" Jul 13 03:32:48.737243 ip-10-0-134-52 kubenswrapper[2558]: I0713 03:32:48.737208 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/acc2dec2-bf68-4b50-9f03-a78a8d63ba21-istio-envoy\") pod \"e2e-mt-a8f491a4-openshift-default-5f96589cb7-x7f7c\" (UID: \"acc2dec2-bf68-4b50-9f03-a78a8d63ba21\") " pod="openshift-ingress/e2e-mt-a8f491a4-openshift-default-5f96589cb7-x7f7c" Jul 13 03:32:48.737294 ip-10-0-134-52 kubenswrapper[2558]: I0713 03:32:48.737257 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-t97fb\" (UniqueName: \"kubernetes.io/projected/acc2dec2-bf68-4b50-9f03-a78a8d63ba21-kube-api-access-t97fb\") pod \"e2e-mt-a8f491a4-openshift-default-5f96589cb7-x7f7c\" (UID: \"acc2dec2-bf68-4b50-9f03-a78a8d63ba21\") " pod="openshift-ingress/e2e-mt-a8f491a4-openshift-default-5f96589cb7-x7f7c" Jul 13 03:32:48.737362 ip-10-0-134-52 kubenswrapper[2558]: I0713 03:32:48.737300 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/acc2dec2-bf68-4b50-9f03-a78a8d63ba21-istio-token\") pod \"e2e-mt-a8f491a4-openshift-default-5f96589cb7-x7f7c\" (UID: \"acc2dec2-bf68-4b50-9f03-a78a8d63ba21\") " pod="openshift-ingress/e2e-mt-a8f491a4-openshift-default-5f96589cb7-x7f7c" Jul 13 03:32:48.737412 ip-10-0-134-52 kubenswrapper[2558]: I0713 03:32:48.737371 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/acc2dec2-bf68-4b50-9f03-a78a8d63ba21-workload-certs\") pod \"e2e-mt-a8f491a4-openshift-default-5f96589cb7-x7f7c\" (UID: \"acc2dec2-bf68-4b50-9f03-a78a8d63ba21\") " pod="openshift-ingress/e2e-mt-a8f491a4-openshift-default-5f96589cb7-x7f7c" Jul 13 03:32:48.737450 ip-10-0-134-52 kubenswrapper[2558]: I0713 03:32:48.737414 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/acc2dec2-bf68-4b50-9f03-a78a8d63ba21-istio-data\") pod \"e2e-mt-a8f491a4-openshift-default-5f96589cb7-x7f7c\" (UID: \"acc2dec2-bf68-4b50-9f03-a78a8d63ba21\") " pod="openshift-ingress/e2e-mt-a8f491a4-openshift-default-5f96589cb7-x7f7c" Jul 13 03:32:48.737496 ip-10-0-134-52 kubenswrapper[2558]: I0713 03:32:48.737453 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/acc2dec2-bf68-4b50-9f03-a78a8d63ba21-istio-podinfo\") pod \"e2e-mt-a8f491a4-openshift-default-5f96589cb7-x7f7c\" (UID: \"acc2dec2-bf68-4b50-9f03-a78a8d63ba21\") " pod="openshift-ingress/e2e-mt-a8f491a4-openshift-default-5f96589cb7-x7f7c" Jul 13 03:32:48.737582 ip-10-0-134-52 kubenswrapper[2558]: I0713 03:32:48.737497 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/acc2dec2-bf68-4b50-9f03-a78a8d63ba21-workload-socket\") pod \"e2e-mt-a8f491a4-openshift-default-5f96589cb7-x7f7c\" (UID: \"acc2dec2-bf68-4b50-9f03-a78a8d63ba21\") " pod="openshift-ingress/e2e-mt-a8f491a4-openshift-default-5f96589cb7-x7f7c" Jul 13 03:32:48.737582 ip-10-0-134-52 kubenswrapper[2558]: I0713 03:32:48.737548 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/acc2dec2-bf68-4b50-9f03-a78a8d63ba21-credential-socket\") pod \"e2e-mt-a8f491a4-openshift-default-5f96589cb7-x7f7c\" (UID: \"acc2dec2-bf68-4b50-9f03-a78a8d63ba21\") " pod="openshift-ingress/e2e-mt-a8f491a4-openshift-default-5f96589cb7-x7f7c" Jul 13 03:32:48.838845 ip-10-0-134-52 kubenswrapper[2558]: I0713 03:32:48.838809 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/acc2dec2-bf68-4b50-9f03-a78a8d63ba21-istio-data\") pod \"e2e-mt-a8f491a4-openshift-default-5f96589cb7-x7f7c\" (UID: \"acc2dec2-bf68-4b50-9f03-a78a8d63ba21\") " pod="openshift-ingress/e2e-mt-a8f491a4-openshift-default-5f96589cb7-x7f7c" Jul 13 03:32:48.838845 ip-10-0-134-52 kubenswrapper[2558]: I0713 03:32:48.838852 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/acc2dec2-bf68-4b50-9f03-a78a8d63ba21-istio-podinfo\") pod \"e2e-mt-a8f491a4-openshift-default-5f96589cb7-x7f7c\" (UID: \"acc2dec2-bf68-4b50-9f03-a78a8d63ba21\") " pod="openshift-ingress/e2e-mt-a8f491a4-openshift-default-5f96589cb7-x7f7c" Jul 13 03:32:48.839089 ip-10-0-134-52 kubenswrapper[2558]: I0713 03:32:48.838872 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/acc2dec2-bf68-4b50-9f03-a78a8d63ba21-workload-socket\") pod \"e2e-mt-a8f491a4-openshift-default-5f96589cb7-x7f7c\" (UID: \"acc2dec2-bf68-4b50-9f03-a78a8d63ba21\") " pod="openshift-ingress/e2e-mt-a8f491a4-openshift-default-5f96589cb7-x7f7c" Jul 13 03:32:48.839089 ip-10-0-134-52 kubenswrapper[2558]: I0713 03:32:48.838905 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/acc2dec2-bf68-4b50-9f03-a78a8d63ba21-credential-socket\") pod \"e2e-mt-a8f491a4-openshift-default-5f96589cb7-x7f7c\" (UID: \"acc2dec2-bf68-4b50-9f03-a78a8d63ba21\") " pod="openshift-ingress/e2e-mt-a8f491a4-openshift-default-5f96589cb7-x7f7c" Jul 13 03:32:48.839089 ip-10-0-134-52 kubenswrapper[2558]: I0713 03:32:48.838931 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/acc2dec2-bf68-4b50-9f03-a78a8d63ba21-istiod-ca-cert\") pod \"e2e-mt-a8f491a4-openshift-default-5f96589cb7-x7f7c\" (UID: \"acc2dec2-bf68-4b50-9f03-a78a8d63ba21\") " pod="openshift-ingress/e2e-mt-a8f491a4-openshift-default-5f96589cb7-x7f7c" Jul 13 03:32:48.839089 ip-10-0-134-52 kubenswrapper[2558]: I0713 03:32:48.839003 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/acc2dec2-bf68-4b50-9f03-a78a8d63ba21-istio-envoy\") pod \"e2e-mt-a8f491a4-openshift-default-5f96589cb7-x7f7c\" (UID: \"acc2dec2-bf68-4b50-9f03-a78a8d63ba21\") " pod="openshift-ingress/e2e-mt-a8f491a4-openshift-default-5f96589cb7-x7f7c" Jul 13 03:32:48.839089 ip-10-0-134-52 kubenswrapper[2558]: I0713 03:32:48.839026 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-t97fb\" (UniqueName: \"kubernetes.io/projected/acc2dec2-bf68-4b50-9f03-a78a8d63ba21-kube-api-access-t97fb\") pod \"e2e-mt-a8f491a4-openshift-default-5f96589cb7-x7f7c\" (UID: \"acc2dec2-bf68-4b50-9f03-a78a8d63ba21\") " pod="openshift-ingress/e2e-mt-a8f491a4-openshift-default-5f96589cb7-x7f7c" Jul 13 03:32:48.839372 ip-10-0-134-52 kubenswrapper[2558]: I0713 03:32:48.839170 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/acc2dec2-bf68-4b50-9f03-a78a8d63ba21-istio-token\") pod \"e2e-mt-a8f491a4-openshift-default-5f96589cb7-x7f7c\" (UID: \"acc2dec2-bf68-4b50-9f03-a78a8d63ba21\") " pod="openshift-ingress/e2e-mt-a8f491a4-openshift-default-5f96589cb7-x7f7c" Jul 13 03:32:48.839372 ip-10-0-134-52 kubenswrapper[2558]: I0713 03:32:48.839227 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/acc2dec2-bf68-4b50-9f03-a78a8d63ba21-workload-certs\") pod \"e2e-mt-a8f491a4-openshift-default-5f96589cb7-x7f7c\" (UID: \"acc2dec2-bf68-4b50-9f03-a78a8d63ba21\") " pod="openshift-ingress/e2e-mt-a8f491a4-openshift-default-5f96589cb7-x7f7c" Jul 13 03:32:48.839372 ip-10-0-134-52 kubenswrapper[2558]: I0713 03:32:48.839244 2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/acc2dec2-bf68-4b50-9f03-a78a8d63ba21-istio-data\") pod \"e2e-mt-a8f491a4-openshift-default-5f96589cb7-x7f7c\" (UID: \"acc2dec2-bf68-4b50-9f03-a78a8d63ba21\") " pod="openshift-ingress/e2e-mt-a8f491a4-openshift-default-5f96589cb7-x7f7c" Jul 13 03:32:48.839372 ip-10-0-134-52 kubenswrapper[2558]: I0713 03:32:48.839296 2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/acc2dec2-bf68-4b50-9f03-a78a8d63ba21-credential-socket\") pod \"e2e-mt-a8f491a4-openshift-default-5f96589cb7-x7f7c\" (UID: \"acc2dec2-bf68-4b50-9f03-a78a8d63ba21\") " pod="openshift-ingress/e2e-mt-a8f491a4-openshift-default-5f96589cb7-x7f7c" Jul 13 03:32:48.839372 ip-10-0-134-52 kubenswrapper[2558]: I0713 03:32:48.839365 2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/acc2dec2-bf68-4b50-9f03-a78a8d63ba21-workload-socket\") pod \"e2e-mt-a8f491a4-openshift-default-5f96589cb7-x7f7c\" (UID: \"acc2dec2-bf68-4b50-9f03-a78a8d63ba21\") " pod="openshift-ingress/e2e-mt-a8f491a4-openshift-default-5f96589cb7-x7f7c" Jul 13 03:32:48.839635 ip-10-0-134-52 kubenswrapper[2558]: I0713 03:32:48.839564 2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/acc2dec2-bf68-4b50-9f03-a78a8d63ba21-workload-certs\") pod \"e2e-mt-a8f491a4-openshift-default-5f96589cb7-x7f7c\" (UID: \"acc2dec2-bf68-4b50-9f03-a78a8d63ba21\") " pod="openshift-ingress/e2e-mt-a8f491a4-openshift-default-5f96589cb7-x7f7c" Jul 13 03:32:48.839928 ip-10-0-134-52 kubenswrapper[2558]: I0713 03:32:48.839873 2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/acc2dec2-bf68-4b50-9f03-a78a8d63ba21-istiod-ca-cert\") pod \"e2e-mt-a8f491a4-openshift-default-5f96589cb7-x7f7c\" (UID: \"acc2dec2-bf68-4b50-9f03-a78a8d63ba21\") " pod="openshift-ingress/e2e-mt-a8f491a4-openshift-default-5f96589cb7-x7f7c" Jul 13 03:32:48.841440 ip-10-0-134-52 kubenswrapper[2558]: I0713 03:32:48.841411 2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/acc2dec2-bf68-4b50-9f03-a78a8d63ba21-istio-envoy\") pod \"e2e-mt-a8f491a4-openshift-default-5f96589cb7-x7f7c\" (UID: \"acc2dec2-bf68-4b50-9f03-a78a8d63ba21\") " pod="openshift-ingress/e2e-mt-a8f491a4-openshift-default-5f96589cb7-x7f7c" Jul 13 03:32:48.841810 ip-10-0-134-52 kubenswrapper[2558]: I0713 03:32:48.841789 2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/acc2dec2-bf68-4b50-9f03-a78a8d63ba21-istio-podinfo\") pod \"e2e-mt-a8f491a4-openshift-default-5f96589cb7-x7f7c\" (UID: \"acc2dec2-bf68-4b50-9f03-a78a8d63ba21\") " pod="openshift-ingress/e2e-mt-a8f491a4-openshift-default-5f96589cb7-x7f7c" Jul 13 03:32:48.854471 ip-10-0-134-52 kubenswrapper[2558]: I0713 03:32:48.854442 2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-t97fb\" (UniqueName: \"kubernetes.io/projected/acc2dec2-bf68-4b50-9f03-a78a8d63ba21-kube-api-access-t97fb\") pod \"e2e-mt-a8f491a4-openshift-default-5f96589cb7-x7f7c\" (UID: \"acc2dec2-bf68-4b50-9f03-a78a8d63ba21\") " pod="openshift-ingress/e2e-mt-a8f491a4-openshift-default-5f96589cb7-x7f7c" Jul 13 03:32:48.854471 ip-10-0-134-52 kubenswrapper[2558]: I0713 03:32:48.854459 2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/acc2dec2-bf68-4b50-9f03-a78a8d63ba21-istio-token\") pod \"e2e-mt-a8f491a4-openshift-default-5f96589cb7-x7f7c\" (UID: \"acc2dec2-bf68-4b50-9f03-a78a8d63ba21\") " pod="openshift-ingress/e2e-mt-a8f491a4-openshift-default-5f96589cb7-x7f7c" Jul 13 03:32:48.962836 ip-10-0-134-52 kubenswrapper[2558]: I0713 03:32:48.962740 2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-mt-a8f491a4-openshift-default-5f96589cb7-x7f7c" Jul 13 03:32:49.103554 ip-10-0-134-52 kubenswrapper[2558]: I0713 03:32:49.103525 2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-mt-a8f491a4-openshift-default-5f96589cb7-x7f7c"] Jul 13 03:32:49.104619 ip-10-0-134-52 kubenswrapper[2558]: W0713 03:32:49.104592 2558 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podacc2dec2_bf68_4b50_9f03_a78a8d63ba21.slice/crio-664381ced9e288a660bea917f63f1e6152ff2d4b0afd973031563477495652b0 WatchSource:0}: Error finding container 664381ced9e288a660bea917f63f1e6152ff2d4b0afd973031563477495652b0: Status 404 returned error can't find the container with id 664381ced9e288a660bea917f63f1e6152ff2d4b0afd973031563477495652b0 Jul 13 03:32:49.106713 ip-10-0-134-52 kubenswrapper[2558]: I0713 03:32:49.106671 2558 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892164Ki","pods":"250"} Jul 13 03:32:49.106807 ip-10-0-134-52 kubenswrapper[2558]: I0713 03:32:49.106757 2558 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892164Ki","pods":"250"} Jul 13 03:32:49.106807 ip-10-0-134-52 kubenswrapper[2558]: I0713 03:32:49.106796 2558 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892164Ki","pods":"250"} Jul 13 03:32:49.972544 ip-10-0-134-52 kubenswrapper[2558]: I0713 03:32:49.972505 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-mt-a8f491a4-openshift-default-5f96589cb7-x7f7c" event={"ID":"acc2dec2-bf68-4b50-9f03-a78a8d63ba21","Type":"ContainerStarted","Data":"72d8d2717bd4a80fe376f55b9c7907b07b4ef83dcd7e33b15e155c063ac7ecce"} Jul 13 03:32:49.973019 ip-10-0-134-52 kubenswrapper[2558]: I0713 03:32:49.972563 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-mt-a8f491a4-openshift-default-5f96589cb7-x7f7c" event={"ID":"acc2dec2-bf68-4b50-9f03-a78a8d63ba21","Type":"ContainerStarted","Data":"664381ced9e288a660bea917f63f1e6152ff2d4b0afd973031563477495652b0"} Jul 13 03:32:49.994662 ip-10-0-134-52 kubenswrapper[2558]: I0713 03:32:49.994608 2558 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-mt-a8f491a4-openshift-default-5f96589cb7-x7f7c" podStartSLOduration=1.994593923 podStartE2EDuration="1.994593923s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-13 03:32:48 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-13 03:32:49.992494027 +0000 UTC m=+2152.393094494" watchObservedRunningTime="2026-07-13 03:32:49.994593923 +0000 UTC m=+2152.395194389" Jul 13 03:32:50.962978 ip-10-0-134-52 kubenswrapper[2558]: I0713 03:32:50.962948 2558 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-mt-a8f491a4-openshift-default-5f96589cb7-x7f7c" Jul 13 03:32:50.968100 ip-10-0-134-52 kubenswrapper[2558]: I0713 03:32:50.968073 2558 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-mt-a8f491a4-openshift-default-5f96589cb7-x7f7c" Jul 13 03:32:50.977522 ip-10-0-134-52 kubenswrapper[2558]: I0713 03:32:50.977494 2558 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-mt-a8f491a4-openshift-default-5f96589cb7-x7f7c" Jul 13 03:32:50.978234 ip-10-0-134-52 kubenswrapper[2558]: I0713 03:32:50.978218 2558 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-mt-a8f491a4-openshift-default-5f96589cb7-x7f7c" Jul 13 03:36:07.597312 ip-10-0-134-52 kubenswrapper[2558]: I0713 03:36:07.597263 2558 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-mt-a8f491a4-openshift-default-5f96589cb7-x7f7c"] Jul 13 03:36:07.600000 ip-10-0-134-52 kubenswrapper[2558]: I0713 03:36:07.597539 2558 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/e2e-mt-a8f491a4-openshift-default-5f96589cb7-x7f7c" podUID="acc2dec2-bf68-4b50-9f03-a78a8d63ba21" containerName="istio-proxy" containerID="cri-o://72d8d2717bd4a80fe376f55b9c7907b07b4ef83dcd7e33b15e155c063ac7ecce" gracePeriod=30 Jul 13 03:36:12.848529 ip-10-0-134-52 kubenswrapper[2558]: I0713 03:36:12.848501 2558 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-mt-a8f491a4-openshift-default-5f96589cb7-x7f7c" Jul 13 03:36:12.916063 ip-10-0-134-52 kubenswrapper[2558]: I0713 03:36:12.915999 2558 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/acc2dec2-bf68-4b50-9f03-a78a8d63ba21-istio-token\") pod \"acc2dec2-bf68-4b50-9f03-a78a8d63ba21\" (UID: \"acc2dec2-bf68-4b50-9f03-a78a8d63ba21\") " Jul 13 03:36:12.916063 ip-10-0-134-52 kubenswrapper[2558]: I0713 03:36:12.916031 2558 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/acc2dec2-bf68-4b50-9f03-a78a8d63ba21-istio-podinfo\") pod \"acc2dec2-bf68-4b50-9f03-a78a8d63ba21\" (UID: \"acc2dec2-bf68-4b50-9f03-a78a8d63ba21\") " Jul 13 03:36:12.916063 ip-10-0-134-52 kubenswrapper[2558]: I0713 03:36:12.916058 2558 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/acc2dec2-bf68-4b50-9f03-a78a8d63ba21-credential-socket\") pod \"acc2dec2-bf68-4b50-9f03-a78a8d63ba21\" (UID: \"acc2dec2-bf68-4b50-9f03-a78a8d63ba21\") " Jul 13 03:36:12.916300 ip-10-0-134-52 kubenswrapper[2558]: I0713 03:36:12.916083 2558 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/acc2dec2-bf68-4b50-9f03-a78a8d63ba21-workload-socket\") pod \"acc2dec2-bf68-4b50-9f03-a78a8d63ba21\" (UID: \"acc2dec2-bf68-4b50-9f03-a78a8d63ba21\") " Jul 13 03:36:12.916300 ip-10-0-134-52 kubenswrapper[2558]: I0713 03:36:12.916118 2558 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/acc2dec2-bf68-4b50-9f03-a78a8d63ba21-istio-data\") pod \"acc2dec2-bf68-4b50-9f03-a78a8d63ba21\" (UID: \"acc2dec2-bf68-4b50-9f03-a78a8d63ba21\") " Jul 13 03:36:12.916300 ip-10-0-134-52 kubenswrapper[2558]: I0713 03:36:12.916147 2558 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/acc2dec2-bf68-4b50-9f03-a78a8d63ba21-istio-envoy\") pod \"acc2dec2-bf68-4b50-9f03-a78a8d63ba21\" (UID: \"acc2dec2-bf68-4b50-9f03-a78a8d63ba21\") " Jul 13 03:36:12.916300 ip-10-0-134-52 kubenswrapper[2558]: I0713 03:36:12.916225 2558 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/acc2dec2-bf68-4b50-9f03-a78a8d63ba21-istiod-ca-cert\") pod \"acc2dec2-bf68-4b50-9f03-a78a8d63ba21\" (UID: \"acc2dec2-bf68-4b50-9f03-a78a8d63ba21\") " Jul 13 03:36:12.916300 ip-10-0-134-52 kubenswrapper[2558]: I0713 03:36:12.916253 2558 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-t97fb\" (UniqueName: \"kubernetes.io/projected/acc2dec2-bf68-4b50-9f03-a78a8d63ba21-kube-api-access-t97fb\") pod \"acc2dec2-bf68-4b50-9f03-a78a8d63ba21\" (UID: \"acc2dec2-bf68-4b50-9f03-a78a8d63ba21\") " Jul 13 03:36:12.916593 ip-10-0-134-52 kubenswrapper[2558]: I0713 03:36:12.916317 2558 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/acc2dec2-bf68-4b50-9f03-a78a8d63ba21-workload-certs\") pod \"acc2dec2-bf68-4b50-9f03-a78a8d63ba21\" (UID: \"acc2dec2-bf68-4b50-9f03-a78a8d63ba21\") " Jul 13 03:36:12.916593 ip-10-0-134-52 kubenswrapper[2558]: I0713 03:36:12.916386 2558 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/acc2dec2-bf68-4b50-9f03-a78a8d63ba21-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "acc2dec2-bf68-4b50-9f03-a78a8d63ba21" (UID: "acc2dec2-bf68-4b50-9f03-a78a8d63ba21"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 13 03:36:12.916593 ip-10-0-134-52 kubenswrapper[2558]: I0713 03:36:12.916468 2558 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/acc2dec2-bf68-4b50-9f03-a78a8d63ba21-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "acc2dec2-bf68-4b50-9f03-a78a8d63ba21" (UID: "acc2dec2-bf68-4b50-9f03-a78a8d63ba21"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 13 03:36:12.916593 ip-10-0-134-52 kubenswrapper[2558]: I0713 03:36:12.916487 2558 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/acc2dec2-bf68-4b50-9f03-a78a8d63ba21-istio-data" (OuterVolumeSpecName: "istio-data") pod "acc2dec2-bf68-4b50-9f03-a78a8d63ba21" (UID: "acc2dec2-bf68-4b50-9f03-a78a8d63ba21"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 13 03:36:12.916808 ip-10-0-134-52 kubenswrapper[2558]: I0713 03:36:12.916667 2558 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/acc2dec2-bf68-4b50-9f03-a78a8d63ba21-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "acc2dec2-bf68-4b50-9f03-a78a8d63ba21" (UID: "acc2dec2-bf68-4b50-9f03-a78a8d63ba21"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 13 03:36:12.916808 ip-10-0-134-52 kubenswrapper[2558]: I0713 03:36:12.916744 2558 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/acc2dec2-bf68-4b50-9f03-a78a8d63ba21-credential-socket\") on node \"ip-10-0-134-52.ec2.internal\" DevicePath \"\"" Jul 13 03:36:12.916808 ip-10-0-134-52 kubenswrapper[2558]: I0713 03:36:12.916777 2558 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/acc2dec2-bf68-4b50-9f03-a78a8d63ba21-workload-socket\") on node \"ip-10-0-134-52.ec2.internal\" DevicePath \"\"" Jul 13 03:36:12.916808 ip-10-0-134-52 kubenswrapper[2558]: I0713 03:36:12.916792 2558 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/acc2dec2-bf68-4b50-9f03-a78a8d63ba21-istio-data\") on node \"ip-10-0-134-52.ec2.internal\" DevicePath \"\"" Jul 13 03:36:12.916808 ip-10-0-134-52 kubenswrapper[2558]: I0713 03:36:12.916805 2558 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/acc2dec2-bf68-4b50-9f03-a78a8d63ba21-workload-certs\") on node \"ip-10-0-134-52.ec2.internal\" DevicePath \"\"" Jul 13 03:36:12.917066 ip-10-0-134-52 kubenswrapper[2558]: I0713 03:36:12.917034 2558 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/acc2dec2-bf68-4b50-9f03-a78a8d63ba21-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "acc2dec2-bf68-4b50-9f03-a78a8d63ba21" (UID: "acc2dec2-bf68-4b50-9f03-a78a8d63ba21"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 13 03:36:12.918364 ip-10-0-134-52 kubenswrapper[2558]: I0713 03:36:12.918323 2558 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/acc2dec2-bf68-4b50-9f03-a78a8d63ba21-istio-token" (OuterVolumeSpecName: "istio-token") pod "acc2dec2-bf68-4b50-9f03-a78a8d63ba21" (UID: "acc2dec2-bf68-4b50-9f03-a78a8d63ba21"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 13 03:36:12.918558 ip-10-0-134-52 kubenswrapper[2558]: I0713 03:36:12.918539 2558 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/acc2dec2-bf68-4b50-9f03-a78a8d63ba21-kube-api-access-t97fb" (OuterVolumeSpecName: "kube-api-access-t97fb") pod "acc2dec2-bf68-4b50-9f03-a78a8d63ba21" (UID: "acc2dec2-bf68-4b50-9f03-a78a8d63ba21"). InnerVolumeSpecName "kube-api-access-t97fb". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 13 03:36:12.918870 ip-10-0-134-52 kubenswrapper[2558]: I0713 03:36:12.918844 2558 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/acc2dec2-bf68-4b50-9f03-a78a8d63ba21-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "acc2dec2-bf68-4b50-9f03-a78a8d63ba21" (UID: "acc2dec2-bf68-4b50-9f03-a78a8d63ba21"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue "" Jul 13 03:36:12.918964 ip-10-0-134-52 kubenswrapper[2558]: I0713 03:36:12.918864 2558 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/acc2dec2-bf68-4b50-9f03-a78a8d63ba21-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "acc2dec2-bf68-4b50-9f03-a78a8d63ba21" (UID: "acc2dec2-bf68-4b50-9f03-a78a8d63ba21"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 13 03:36:13.018015 ip-10-0-134-52 kubenswrapper[2558]: I0713 03:36:13.017987 2558 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/acc2dec2-bf68-4b50-9f03-a78a8d63ba21-istio-envoy\") on node \"ip-10-0-134-52.ec2.internal\" DevicePath \"\"" Jul 13 03:36:13.018015 ip-10-0-134-52 kubenswrapper[2558]: I0713 03:36:13.018011 2558 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/acc2dec2-bf68-4b50-9f03-a78a8d63ba21-istiod-ca-cert\") on node \"ip-10-0-134-52.ec2.internal\" DevicePath \"\"" Jul 13 03:36:13.018015 ip-10-0-134-52 kubenswrapper[2558]: I0713 03:36:13.018022 2558 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-t97fb\" (UniqueName: \"kubernetes.io/projected/acc2dec2-bf68-4b50-9f03-a78a8d63ba21-kube-api-access-t97fb\") on node \"ip-10-0-134-52.ec2.internal\" DevicePath \"\"" Jul 13 03:36:13.018225 ip-10-0-134-52 kubenswrapper[2558]: I0713 03:36:13.018030 2558 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/acc2dec2-bf68-4b50-9f03-a78a8d63ba21-istio-token\") on node \"ip-10-0-134-52.ec2.internal\" DevicePath \"\"" Jul 13 03:36:13.018225 ip-10-0-134-52 kubenswrapper[2558]: I0713 03:36:13.018039 2558 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/acc2dec2-bf68-4b50-9f03-a78a8d63ba21-istio-podinfo\") on node \"ip-10-0-134-52.ec2.internal\" DevicePath \"\"" Jul 13 03:36:13.093003 ip-10-0-134-52 kubenswrapper[2558]: I0713 03:36:13.092973 2558 generic.go:356] "Generic (PLEG): container finished" podID="acc2dec2-bf68-4b50-9f03-a78a8d63ba21" containerID="72d8d2717bd4a80fe376f55b9c7907b07b4ef83dcd7e33b15e155c063ac7ecce" exitCode=0 Jul 13 03:36:13.093127 ip-10-0-134-52 kubenswrapper[2558]: I0713 03:36:13.093014 2558 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-mt-a8f491a4-openshift-default-5f96589cb7-x7f7c" Jul 13 03:36:13.093127 ip-10-0-134-52 kubenswrapper[2558]: I0713 03:36:13.093058 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-mt-a8f491a4-openshift-default-5f96589cb7-x7f7c" event={"ID":"acc2dec2-bf68-4b50-9f03-a78a8d63ba21","Type":"ContainerDied","Data":"72d8d2717bd4a80fe376f55b9c7907b07b4ef83dcd7e33b15e155c063ac7ecce"} Jul 13 03:36:13.093127 ip-10-0-134-52 kubenswrapper[2558]: I0713 03:36:13.093110 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-mt-a8f491a4-openshift-default-5f96589cb7-x7f7c" event={"ID":"acc2dec2-bf68-4b50-9f03-a78a8d63ba21","Type":"ContainerDied","Data":"664381ced9e288a660bea917f63f1e6152ff2d4b0afd973031563477495652b0"} Jul 13 03:36:13.093294 ip-10-0-134-52 kubenswrapper[2558]: I0713 03:36:13.093141 2558 scope.go:117] "RemoveContainer" containerID="72d8d2717bd4a80fe376f55b9c7907b07b4ef83dcd7e33b15e155c063ac7ecce" Jul 13 03:36:13.103520 ip-10-0-134-52 kubenswrapper[2558]: I0713 03:36:13.103505 2558 scope.go:117] "RemoveContainer" containerID="72d8d2717bd4a80fe376f55b9c7907b07b4ef83dcd7e33b15e155c063ac7ecce" Jul 13 03:36:13.103805 ip-10-0-134-52 kubenswrapper[2558]: E0713 03:36:13.103758 2558 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"72d8d2717bd4a80fe376f55b9c7907b07b4ef83dcd7e33b15e155c063ac7ecce\": container with ID starting with 72d8d2717bd4a80fe376f55b9c7907b07b4ef83dcd7e33b15e155c063ac7ecce not found: ID does not exist" containerID="72d8d2717bd4a80fe376f55b9c7907b07b4ef83dcd7e33b15e155c063ac7ecce" Jul 13 03:36:13.103843 ip-10-0-134-52 kubenswrapper[2558]: I0713 03:36:13.103816 2558 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"72d8d2717bd4a80fe376f55b9c7907b07b4ef83dcd7e33b15e155c063ac7ecce"} err="failed to get container status \"72d8d2717bd4a80fe376f55b9c7907b07b4ef83dcd7e33b15e155c063ac7ecce\": rpc error: code = NotFound desc = could not find container \"72d8d2717bd4a80fe376f55b9c7907b07b4ef83dcd7e33b15e155c063ac7ecce\": container with ID starting with 72d8d2717bd4a80fe376f55b9c7907b07b4ef83dcd7e33b15e155c063ac7ecce not found: ID does not exist" Jul 13 03:36:13.114528 ip-10-0-134-52 kubenswrapper[2558]: I0713 03:36:13.114507 2558 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-mt-a8f491a4-openshift-default-5f96589cb7-x7f7c"] Jul 13 03:36:13.117962 ip-10-0-134-52 kubenswrapper[2558]: I0713 03:36:13.117943 2558 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-mt-a8f491a4-openshift-default-5f96589cb7-x7f7c"] Jul 13 03:36:14.092612 ip-10-0-134-52 kubenswrapper[2558]: I0713 03:36:14.092580 2558 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="acc2dec2-bf68-4b50-9f03-a78a8d63ba21" path="/var/lib/kubelet/pods/acc2dec2-bf68-4b50-9f03-a78a8d63ba21/volumes" Jul 13 03:36:27.196918 ip-10-0-134-52 kubenswrapper[2558]: I0713 03:36:27.196887 2558 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-mt-766a483d-openshift-default-c476d7999-h6ljt"] Jul 13 03:36:27.197280 ip-10-0-134-52 kubenswrapper[2558]: I0713 03:36:27.197260 2558 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="acc2dec2-bf68-4b50-9f03-a78a8d63ba21" containerName="istio-proxy" Jul 13 03:36:27.197280 ip-10-0-134-52 kubenswrapper[2558]: I0713 03:36:27.197271 2558 state_mem.go:107] "Deleted CPUSet assignment" podUID="acc2dec2-bf68-4b50-9f03-a78a8d63ba21" containerName="istio-proxy" Jul 13 03:36:27.197373 ip-10-0-134-52 kubenswrapper[2558]: I0713 03:36:27.197365 2558 memory_manager.go:368] "RemoveStaleState removing state" podUID="acc2dec2-bf68-4b50-9f03-a78a8d63ba21" containerName="istio-proxy" Jul 13 03:36:27.201645 ip-10-0-134-52 kubenswrapper[2558]: I0713 03:36:27.201628 2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-mt-766a483d-openshift-default-c476d7999-h6ljt" Jul 13 03:36:27.204361 ip-10-0-134-52 kubenswrapper[2558]: I0713 03:36:27.204315 2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-mt-766a483d-openshift-default-dockercfg-g5fn8\"" Jul 13 03:36:27.212118 ip-10-0-134-52 kubenswrapper[2558]: I0713 03:36:27.212095 2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-mt-766a483d-openshift-default-c476d7999-h6ljt"] Jul 13 03:36:27.337101 ip-10-0-134-52 kubenswrapper[2558]: I0713 03:36:27.337062 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/e7e2f4c6-ab60-479f-af4e-75c381b2bf52-workload-socket\") pod \"e2e-mt-766a483d-openshift-default-c476d7999-h6ljt\" (UID: \"e7e2f4c6-ab60-479f-af4e-75c381b2bf52\") " pod="openshift-ingress/e2e-mt-766a483d-openshift-default-c476d7999-h6ljt" Jul 13 03:36:27.337101 ip-10-0-134-52 kubenswrapper[2558]: I0713 03:36:27.337104 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/e7e2f4c6-ab60-479f-af4e-75c381b2bf52-istio-token\") pod \"e2e-mt-766a483d-openshift-default-c476d7999-h6ljt\" (UID: \"e7e2f4c6-ab60-479f-af4e-75c381b2bf52\") " pod="openshift-ingress/e2e-mt-766a483d-openshift-default-c476d7999-h6ljt" Jul 13 03:36:27.337319 ip-10-0-134-52 kubenswrapper[2558]: I0713 03:36:27.337123 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/e7e2f4c6-ab60-479f-af4e-75c381b2bf52-istiod-ca-cert\") pod \"e2e-mt-766a483d-openshift-default-c476d7999-h6ljt\" (UID: \"e7e2f4c6-ab60-479f-af4e-75c381b2bf52\") " pod="openshift-ingress/e2e-mt-766a483d-openshift-default-c476d7999-h6ljt" Jul 13 03:36:27.337319 ip-10-0-134-52 kubenswrapper[2558]: I0713 03:36:27.337229 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/e7e2f4c6-ab60-479f-af4e-75c381b2bf52-istio-envoy\") pod \"e2e-mt-766a483d-openshift-default-c476d7999-h6ljt\" (UID: \"e7e2f4c6-ab60-479f-af4e-75c381b2bf52\") " pod="openshift-ingress/e2e-mt-766a483d-openshift-default-c476d7999-h6ljt" Jul 13 03:36:27.337319 ip-10-0-134-52 kubenswrapper[2558]: I0713 03:36:27.337263 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/e7e2f4c6-ab60-479f-af4e-75c381b2bf52-istio-podinfo\") pod \"e2e-mt-766a483d-openshift-default-c476d7999-h6ljt\" (UID: \"e7e2f4c6-ab60-479f-af4e-75c381b2bf52\") " pod="openshift-ingress/e2e-mt-766a483d-openshift-default-c476d7999-h6ljt" Jul 13 03:36:27.337442 ip-10-0-134-52 kubenswrapper[2558]: I0713 03:36:27.337381 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/e7e2f4c6-ab60-479f-af4e-75c381b2bf52-workload-certs\") pod \"e2e-mt-766a483d-openshift-default-c476d7999-h6ljt\" (UID: \"e7e2f4c6-ab60-479f-af4e-75c381b2bf52\") " pod="openshift-ingress/e2e-mt-766a483d-openshift-default-c476d7999-h6ljt" Jul 13 03:36:27.337442 ip-10-0-134-52 kubenswrapper[2558]: I0713 03:36:27.337406 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-xmj94\" (UniqueName: \"kubernetes.io/projected/e7e2f4c6-ab60-479f-af4e-75c381b2bf52-kube-api-access-xmj94\") pod \"e2e-mt-766a483d-openshift-default-c476d7999-h6ljt\" (UID: \"e7e2f4c6-ab60-479f-af4e-75c381b2bf52\") " pod="openshift-ingress/e2e-mt-766a483d-openshift-default-c476d7999-h6ljt" Jul 13 03:36:27.337442 ip-10-0-134-52 kubenswrapper[2558]: I0713 03:36:27.337428 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/e7e2f4c6-ab60-479f-af4e-75c381b2bf52-credential-socket\") pod \"e2e-mt-766a483d-openshift-default-c476d7999-h6ljt\" (UID: \"e7e2f4c6-ab60-479f-af4e-75c381b2bf52\") " pod="openshift-ingress/e2e-mt-766a483d-openshift-default-c476d7999-h6ljt" Jul 13 03:36:27.337548 ip-10-0-134-52 kubenswrapper[2558]: I0713 03:36:27.337460 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/e7e2f4c6-ab60-479f-af4e-75c381b2bf52-istio-data\") pod \"e2e-mt-766a483d-openshift-default-c476d7999-h6ljt\" (UID: \"e7e2f4c6-ab60-479f-af4e-75c381b2bf52\") " pod="openshift-ingress/e2e-mt-766a483d-openshift-default-c476d7999-h6ljt" Jul 13 03:36:27.438775 ip-10-0-134-52 kubenswrapper[2558]: I0713 03:36:27.438745 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/e7e2f4c6-ab60-479f-af4e-75c381b2bf52-credential-socket\") pod \"e2e-mt-766a483d-openshift-default-c476d7999-h6ljt\" (UID: \"e7e2f4c6-ab60-479f-af4e-75c381b2bf52\") " pod="openshift-ingress/e2e-mt-766a483d-openshift-default-c476d7999-h6ljt" Jul 13 03:36:27.438951 ip-10-0-134-52 kubenswrapper[2558]: I0713 03:36:27.438787 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/e7e2f4c6-ab60-479f-af4e-75c381b2bf52-istio-data\") pod \"e2e-mt-766a483d-openshift-default-c476d7999-h6ljt\" (UID: \"e7e2f4c6-ab60-479f-af4e-75c381b2bf52\") " pod="openshift-ingress/e2e-mt-766a483d-openshift-default-c476d7999-h6ljt" Jul 13 03:36:27.438951 ip-10-0-134-52 kubenswrapper[2558]: I0713 03:36:27.438819 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/e7e2f4c6-ab60-479f-af4e-75c381b2bf52-workload-socket\") pod \"e2e-mt-766a483d-openshift-default-c476d7999-h6ljt\" (UID: \"e7e2f4c6-ab60-479f-af4e-75c381b2bf52\") " pod="openshift-ingress/e2e-mt-766a483d-openshift-default-c476d7999-h6ljt" Jul 13 03:36:27.438951 ip-10-0-134-52 kubenswrapper[2558]: I0713 03:36:27.438869 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/e7e2f4c6-ab60-479f-af4e-75c381b2bf52-istio-token\") pod \"e2e-mt-766a483d-openshift-default-c476d7999-h6ljt\" (UID: \"e7e2f4c6-ab60-479f-af4e-75c381b2bf52\") " pod="openshift-ingress/e2e-mt-766a483d-openshift-default-c476d7999-h6ljt" Jul 13 03:36:27.438951 ip-10-0-134-52 kubenswrapper[2558]: I0713 03:36:27.438894 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/e7e2f4c6-ab60-479f-af4e-75c381b2bf52-istiod-ca-cert\") pod \"e2e-mt-766a483d-openshift-default-c476d7999-h6ljt\" (UID: \"e7e2f4c6-ab60-479f-af4e-75c381b2bf52\") " pod="openshift-ingress/e2e-mt-766a483d-openshift-default-c476d7999-h6ljt" Jul 13 03:36:27.438951 ip-10-0-134-52 kubenswrapper[2558]: I0713 03:36:27.438940 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/e7e2f4c6-ab60-479f-af4e-75c381b2bf52-istio-envoy\") pod \"e2e-mt-766a483d-openshift-default-c476d7999-h6ljt\" (UID: \"e7e2f4c6-ab60-479f-af4e-75c381b2bf52\") " pod="openshift-ingress/e2e-mt-766a483d-openshift-default-c476d7999-h6ljt" Jul 13 03:36:27.439233 ip-10-0-134-52 kubenswrapper[2558]: I0713 03:36:27.438969 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/e7e2f4c6-ab60-479f-af4e-75c381b2bf52-istio-podinfo\") pod \"e2e-mt-766a483d-openshift-default-c476d7999-h6ljt\" (UID: \"e7e2f4c6-ab60-479f-af4e-75c381b2bf52\") " pod="openshift-ingress/e2e-mt-766a483d-openshift-default-c476d7999-h6ljt" Jul 13 03:36:27.439233 ip-10-0-134-52 kubenswrapper[2558]: I0713 03:36:27.439079 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/e7e2f4c6-ab60-479f-af4e-75c381b2bf52-workload-certs\") pod \"e2e-mt-766a483d-openshift-default-c476d7999-h6ljt\" (UID: \"e7e2f4c6-ab60-479f-af4e-75c381b2bf52\") " pod="openshift-ingress/e2e-mt-766a483d-openshift-default-c476d7999-h6ljt" Jul 13 03:36:27.439233 ip-10-0-134-52 kubenswrapper[2558]: I0713 03:36:27.439113 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-xmj94\" (UniqueName: \"kubernetes.io/projected/e7e2f4c6-ab60-479f-af4e-75c381b2bf52-kube-api-access-xmj94\") pod \"e2e-mt-766a483d-openshift-default-c476d7999-h6ljt\" (UID: \"e7e2f4c6-ab60-479f-af4e-75c381b2bf52\") " pod="openshift-ingress/e2e-mt-766a483d-openshift-default-c476d7999-h6ljt" Jul 13 03:36:27.439233 ip-10-0-134-52 kubenswrapper[2558]: I0713 03:36:27.439193 2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/e7e2f4c6-ab60-479f-af4e-75c381b2bf52-credential-socket\") pod \"e2e-mt-766a483d-openshift-default-c476d7999-h6ljt\" (UID: \"e7e2f4c6-ab60-479f-af4e-75c381b2bf52\") " pod="openshift-ingress/e2e-mt-766a483d-openshift-default-c476d7999-h6ljt" Jul 13 03:36:27.439480 ip-10-0-134-52 kubenswrapper[2558]: I0713 03:36:27.439267 2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/e7e2f4c6-ab60-479f-af4e-75c381b2bf52-istio-data\") pod \"e2e-mt-766a483d-openshift-default-c476d7999-h6ljt\" (UID: \"e7e2f4c6-ab60-479f-af4e-75c381b2bf52\") " pod="openshift-ingress/e2e-mt-766a483d-openshift-default-c476d7999-h6ljt" Jul 13 03:36:27.439480 ip-10-0-134-52 kubenswrapper[2558]: I0713 03:36:27.439291 2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/e7e2f4c6-ab60-479f-af4e-75c381b2bf52-workload-socket\") pod \"e2e-mt-766a483d-openshift-default-c476d7999-h6ljt\" (UID: \"e7e2f4c6-ab60-479f-af4e-75c381b2bf52\") " pod="openshift-ingress/e2e-mt-766a483d-openshift-default-c476d7999-h6ljt" Jul 13 03:36:27.439619 ip-10-0-134-52 kubenswrapper[2558]: I0713 03:36:27.439592 2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/e7e2f4c6-ab60-479f-af4e-75c381b2bf52-workload-certs\") pod \"e2e-mt-766a483d-openshift-default-c476d7999-h6ljt\" (UID: \"e7e2f4c6-ab60-479f-af4e-75c381b2bf52\") " pod="openshift-ingress/e2e-mt-766a483d-openshift-default-c476d7999-h6ljt" Jul 13 03:36:27.439899 ip-10-0-134-52 kubenswrapper[2558]: I0713 03:36:27.439841 2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/e7e2f4c6-ab60-479f-af4e-75c381b2bf52-istiod-ca-cert\") pod \"e2e-mt-766a483d-openshift-default-c476d7999-h6ljt\" (UID: \"e7e2f4c6-ab60-479f-af4e-75c381b2bf52\") " pod="openshift-ingress/e2e-mt-766a483d-openshift-default-c476d7999-h6ljt" Jul 13 03:36:27.441537 ip-10-0-134-52 kubenswrapper[2558]: I0713 03:36:27.441516 2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/e7e2f4c6-ab60-479f-af4e-75c381b2bf52-istio-envoy\") pod \"e2e-mt-766a483d-openshift-default-c476d7999-h6ljt\" (UID: \"e7e2f4c6-ab60-479f-af4e-75c381b2bf52\") " pod="openshift-ingress/e2e-mt-766a483d-openshift-default-c476d7999-h6ljt" Jul 13 03:36:27.442236 ip-10-0-134-52 kubenswrapper[2558]: I0713 03:36:27.442214 2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/e7e2f4c6-ab60-479f-af4e-75c381b2bf52-istio-podinfo\") pod \"e2e-mt-766a483d-openshift-default-c476d7999-h6ljt\" (UID: \"e7e2f4c6-ab60-479f-af4e-75c381b2bf52\") " pod="openshift-ingress/e2e-mt-766a483d-openshift-default-c476d7999-h6ljt" Jul 13 03:36:27.458240 ip-10-0-134-52 kubenswrapper[2558]: I0713 03:36:27.458171 2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-xmj94\" (UniqueName: \"kubernetes.io/projected/e7e2f4c6-ab60-479f-af4e-75c381b2bf52-kube-api-access-xmj94\") pod \"e2e-mt-766a483d-openshift-default-c476d7999-h6ljt\" (UID: \"e7e2f4c6-ab60-479f-af4e-75c381b2bf52\") " pod="openshift-ingress/e2e-mt-766a483d-openshift-default-c476d7999-h6ljt" Jul 13 03:36:27.459255 ip-10-0-134-52 kubenswrapper[2558]: I0713 03:36:27.459234 2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/e7e2f4c6-ab60-479f-af4e-75c381b2bf52-istio-token\") pod \"e2e-mt-766a483d-openshift-default-c476d7999-h6ljt\" (UID: \"e7e2f4c6-ab60-479f-af4e-75c381b2bf52\") " pod="openshift-ingress/e2e-mt-766a483d-openshift-default-c476d7999-h6ljt" Jul 13 03:36:27.515153 ip-10-0-134-52 kubenswrapper[2558]: I0713 03:36:27.515125 2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-mt-766a483d-openshift-default-c476d7999-h6ljt" Jul 13 03:36:27.671237 ip-10-0-134-52 kubenswrapper[2558]: I0713 03:36:27.671213 2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-mt-766a483d-openshift-default-c476d7999-h6ljt"] Jul 13 03:36:27.672844 ip-10-0-134-52 kubenswrapper[2558]: W0713 03:36:27.672812 2558 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pode7e2f4c6_ab60_479f_af4e_75c381b2bf52.slice/crio-0b02491b50a2b0142bb17789be0da12e3108904bafa14e91bfe7b00e7e8d5f72 WatchSource:0}: Error finding container 0b02491b50a2b0142bb17789be0da12e3108904bafa14e91bfe7b00e7e8d5f72: Status 404 returned error can't find the container with id 0b02491b50a2b0142bb17789be0da12e3108904bafa14e91bfe7b00e7e8d5f72 Jul 13 03:36:27.675025 ip-10-0-134-52 kubenswrapper[2558]: I0713 03:36:27.674996 2558 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892164Ki","pods":"250"} Jul 13 03:36:27.675128 ip-10-0-134-52 kubenswrapper[2558]: I0713 03:36:27.675065 2558 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892164Ki","pods":"250"} Jul 13 03:36:27.675128 ip-10-0-134-52 kubenswrapper[2558]: I0713 03:36:27.675111 2558 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892164Ki","pods":"250"} Jul 13 03:36:28.183620 ip-10-0-134-52 kubenswrapper[2558]: I0713 03:36:28.183581 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-mt-766a483d-openshift-default-c476d7999-h6ljt" event={"ID":"e7e2f4c6-ab60-479f-af4e-75c381b2bf52","Type":"ContainerStarted","Data":"48aa1e38031d591a6983f3663a764a2fdb2aa3cf0b678b49e32857b5c5abf04d"} Jul 13 03:36:28.183806 ip-10-0-134-52 kubenswrapper[2558]: I0713 03:36:28.183633 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-mt-766a483d-openshift-default-c476d7999-h6ljt" event={"ID":"e7e2f4c6-ab60-479f-af4e-75c381b2bf52","Type":"ContainerStarted","Data":"0b02491b50a2b0142bb17789be0da12e3108904bafa14e91bfe7b00e7e8d5f72"} Jul 13 03:36:28.206198 ip-10-0-134-52 kubenswrapper[2558]: I0713 03:36:28.206149 2558 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-mt-766a483d-openshift-default-c476d7999-h6ljt" podStartSLOduration=1.206134343 podStartE2EDuration="1.206134343s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-13 03:36:27 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-13 03:36:28.204906325 +0000 UTC m=+2370.605506809" watchObservedRunningTime="2026-07-13 03:36:28.206134343 +0000 UTC m=+2370.606734807" Jul 13 03:36:28.516301 ip-10-0-134-52 kubenswrapper[2558]: I0713 03:36:28.516227 2558 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-mt-766a483d-openshift-default-c476d7999-h6ljt" Jul 13 03:36:28.520853 ip-10-0-134-52 kubenswrapper[2558]: I0713 03:36:28.520829 2558 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-mt-766a483d-openshift-default-c476d7999-h6ljt" Jul 13 03:36:29.189578 ip-10-0-134-52 kubenswrapper[2558]: I0713 03:36:29.189534 2558 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-mt-766a483d-openshift-default-c476d7999-h6ljt" Jul 13 03:36:29.190537 ip-10-0-134-52 kubenswrapper[2558]: I0713 03:36:29.190513 2558 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-mt-766a483d-openshift-default-c476d7999-h6ljt" Jul 13 03:36:35.137706 ip-10-0-134-52 kubenswrapper[2558]: I0713 03:36:35.137675 2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-nq4gl"] Jul 13 03:36:43.272129 ip-10-0-134-52 kubenswrapper[2558]: I0713 03:36:43.272054 2558 generic.go:356] "Generic (PLEG): container finished" podID="e7e2f4c6-ab60-479f-af4e-75c381b2bf52" containerID="48aa1e38031d591a6983f3663a764a2fdb2aa3cf0b678b49e32857b5c5abf04d" exitCode=0 Jul 13 03:36:43.272535 ip-10-0-134-52 kubenswrapper[2558]: I0713 03:36:43.272129 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-mt-766a483d-openshift-default-c476d7999-h6ljt" event={"ID":"e7e2f4c6-ab60-479f-af4e-75c381b2bf52","Type":"ContainerDied","Data":"48aa1e38031d591a6983f3663a764a2fdb2aa3cf0b678b49e32857b5c5abf04d"} Jul 13 03:36:43.272535 ip-10-0-134-52 kubenswrapper[2558]: I0713 03:36:43.272512 2558 scope.go:117] "RemoveContainer" containerID="48aa1e38031d591a6983f3663a764a2fdb2aa3cf0b678b49e32857b5c5abf04d" Jul 13 03:36:43.273517 ip-10-0-134-52 kubenswrapper[2558]: I0713 03:36:43.273492 2558 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892164Ki","pods":"250"} Jul 13 03:36:43.273596 ip-10-0-134-52 kubenswrapper[2558]: I0713 03:36:43.273564 2558 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892164Ki","pods":"250"} Jul 13 03:36:43.273637 ip-10-0-134-52 kubenswrapper[2558]: I0713 03:36:43.273601 2558 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892164Ki","pods":"250"} Jul 13 03:36:44.190123 ip-10-0-134-52 kubenswrapper[2558]: I0713 03:36:44.190079 2558 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-mt-766a483d-openshift-default-c476d7999-h6ljt" Jul 13 03:36:44.279640 ip-10-0-134-52 kubenswrapper[2558]: I0713 03:36:44.279600 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-mt-766a483d-openshift-default-c476d7999-h6ljt" event={"ID":"e7e2f4c6-ab60-479f-af4e-75c381b2bf52","Type":"ContainerStarted","Data":"f942162ff8b48f22e31b397d335be48e6615297409712e6c5029910e23f6ed2e"} Jul 13 03:36:44.515502 ip-10-0-134-52 kubenswrapper[2558]: I0713 03:36:44.515390 2558 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-mt-766a483d-openshift-default-c476d7999-h6ljt" Jul 13 03:36:44.517020 ip-10-0-134-52 kubenswrapper[2558]: I0713 03:36:44.516985 2558 patch_prober.go:28] interesting pod/e2e-mt-766a483d-openshift-default-c476d7999-h6ljt container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.55:15021/healthz/ready\": dial tcp 10.133.0.55:15021: connect: connection refused" start-of-body= Jul 13 03:36:44.517178 ip-10-0-134-52 kubenswrapper[2558]: I0713 03:36:44.517068 2558 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-mt-766a483d-openshift-default-c476d7999-h6ljt" podUID="e7e2f4c6-ab60-479f-af4e-75c381b2bf52" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.55:15021/healthz/ready\": dial tcp 10.133.0.55:15021: connect: connection refused" Jul 13 03:36:45.515855 ip-10-0-134-52 kubenswrapper[2558]: I0713 03:36:45.515809 2558 patch_prober.go:28] interesting pod/e2e-mt-766a483d-openshift-default-c476d7999-h6ljt container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.55:15021/healthz/ready\": dial tcp 10.133.0.55:15021: connect: connection refused" start-of-body= Jul 13 03:36:45.516363 ip-10-0-134-52 kubenswrapper[2558]: I0713 03:36:45.515880 2558 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-mt-766a483d-openshift-default-c476d7999-h6ljt" podUID="e7e2f4c6-ab60-479f-af4e-75c381b2bf52" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.55:15021/healthz/ready\": dial tcp 10.133.0.55:15021: connect: connection refused" Jul 13 03:36:46.515887 ip-10-0-134-52 kubenswrapper[2558]: I0713 03:36:46.515846 2558 patch_prober.go:28] interesting pod/e2e-mt-766a483d-openshift-default-c476d7999-h6ljt container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.55:15021/healthz/ready\": dial tcp 10.133.0.55:15021: connect: connection refused" start-of-body= Jul 13 03:36:46.516369 ip-10-0-134-52 kubenswrapper[2558]: I0713 03:36:46.515906 2558 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-mt-766a483d-openshift-default-c476d7999-h6ljt" podUID="e7e2f4c6-ab60-479f-af4e-75c381b2bf52" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.55:15021/healthz/ready\": dial tcp 10.133.0.55:15021: connect: connection refused" Jul 13 03:36:47.515552 ip-10-0-134-52 kubenswrapper[2558]: I0713 03:36:47.515519 2558 patch_prober.go:28] interesting pod/e2e-mt-766a483d-openshift-default-c476d7999-h6ljt container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.55:15021/healthz/ready\": dial tcp 10.133.0.55:15021: connect: connection refused" start-of-body= Jul 13 03:36:47.515733 ip-10-0-134-52 kubenswrapper[2558]: I0713 03:36:47.515571 2558 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-mt-766a483d-openshift-default-c476d7999-h6ljt" podUID="e7e2f4c6-ab60-479f-af4e-75c381b2bf52" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.55:15021/healthz/ready\": dial tcp 10.133.0.55:15021: connect: connection refused" Jul 13 03:36:48.519286 ip-10-0-134-52 kubenswrapper[2558]: I0713 03:36:48.519245 2558 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-mt-766a483d-openshift-default-c476d7999-h6ljt" Jul 13 03:36:48.519784 ip-10-0-134-52 kubenswrapper[2558]: I0713 03:36:48.519656 2558 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-mt-766a483d-openshift-default-c476d7999-h6ljt" Jul 13 03:36:48.520358 ip-10-0-134-52 kubenswrapper[2558]: I0713 03:36:48.520320 2558 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-mt-766a483d-openshift-default-c476d7999-h6ljt" Jul 13 03:36:55.642305 ip-10-0-134-52 kubenswrapper[2558]: I0713 03:36:55.641572 2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-nq4gl"] Jul 13 03:36:58.275034 ip-10-0-134-52 kubenswrapper[2558]: I0713 03:36:58.275004 2558 scope.go:117] "RemoveContainer" containerID="02243a1d2260c9b2e0aa0e67b013ecac53c95718a91834f162a9ce08ba39e588" Jul 13 03:37:09.942596 ip-10-0-134-52 kubenswrapper[2558]: I0713 03:37:09.942560 2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-nq4gl"] Jul 13 03:37:22.839635 ip-10-0-134-52 kubenswrapper[2558]: I0713 03:37:22.839543 2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-nq4gl"] Jul 13 03:37:57.341300 ip-10-0-134-52 kubenswrapper[2558]: I0713 03:37:57.341265 2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-nq4gl"] Jul 13 03:38:14.230595 ip-10-0-134-52 kubenswrapper[2558]: I0713 03:38:14.230565 2558 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-mt-766a483d-openshift-default-c476d7999-h6ljt"] Jul 13 03:38:14.231086 ip-10-0-134-52 kubenswrapper[2558]: I0713 03:38:14.230771 2558 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/e2e-mt-766a483d-openshift-default-c476d7999-h6ljt" podUID="e7e2f4c6-ab60-479f-af4e-75c381b2bf52" containerName="istio-proxy" containerID="cri-o://f942162ff8b48f22e31b397d335be48e6615297409712e6c5029910e23f6ed2e" gracePeriod=30 Jul 13 03:38:17.948175 ip-10-0-134-52 kubenswrapper[2558]: I0713 03:38:17.948135 2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-nq4gl"] Jul 13 03:38:18.521957 ip-10-0-134-52 kubenswrapper[2558]: I0713 03:38:18.521921 2558 patch_prober.go:28] interesting pod/e2e-mt-766a483d-openshift-default-c476d7999-h6ljt container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body= Jul 13 03:38:18.522118 ip-10-0-134-52 kubenswrapper[2558]: I0713 03:38:18.521990 2558 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/e2e-mt-766a483d-openshift-default-c476d7999-h6ljt" podUID="e7e2f4c6-ab60-479f-af4e-75c381b2bf52" containerName="istio-proxy" probeResult="failure" output="HTTP probe failed with statuscode: 503" Jul 13 03:38:19.494621 ip-10-0-134-52 kubenswrapper[2558]: I0713 03:38:19.494564 2558 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-mt-766a483d-openshift-default-c476d7999-h6ljt" Jul 13 03:38:19.554860 ip-10-0-134-52 kubenswrapper[2558]: I0713 03:38:19.554830 2558 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/e7e2f4c6-ab60-479f-af4e-75c381b2bf52-istio-data\") pod \"e7e2f4c6-ab60-479f-af4e-75c381b2bf52\" (UID: \"e7e2f4c6-ab60-479f-af4e-75c381b2bf52\") " Jul 13 03:38:19.555000 ip-10-0-134-52 kubenswrapper[2558]: I0713 03:38:19.554874 2558 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-xmj94\" (UniqueName: \"kubernetes.io/projected/e7e2f4c6-ab60-479f-af4e-75c381b2bf52-kube-api-access-xmj94\") pod \"e7e2f4c6-ab60-479f-af4e-75c381b2bf52\" (UID: \"e7e2f4c6-ab60-479f-af4e-75c381b2bf52\") " Jul 13 03:38:19.555000 ip-10-0-134-52 kubenswrapper[2558]: I0713 03:38:19.554897 2558 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/e7e2f4c6-ab60-479f-af4e-75c381b2bf52-istio-token\") pod \"e7e2f4c6-ab60-479f-af4e-75c381b2bf52\" (UID: \"e7e2f4c6-ab60-479f-af4e-75c381b2bf52\") " Jul 13 03:38:19.555000 ip-10-0-134-52 kubenswrapper[2558]: I0713 03:38:19.554915 2558 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/e7e2f4c6-ab60-479f-af4e-75c381b2bf52-istio-podinfo\") pod \"e7e2f4c6-ab60-479f-af4e-75c381b2bf52\" (UID: \"e7e2f4c6-ab60-479f-af4e-75c381b2bf52\") " Jul 13 03:38:19.555000 ip-10-0-134-52 kubenswrapper[2558]: I0713 03:38:19.554947 2558 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/e7e2f4c6-ab60-479f-af4e-75c381b2bf52-istiod-ca-cert\") pod \"e7e2f4c6-ab60-479f-af4e-75c381b2bf52\" (UID: \"e7e2f4c6-ab60-479f-af4e-75c381b2bf52\") " Jul 13 03:38:19.555208 ip-10-0-134-52 kubenswrapper[2558]: I0713 03:38:19.555113 2558 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/e7e2f4c6-ab60-479f-af4e-75c381b2bf52-workload-certs\") pod \"e7e2f4c6-ab60-479f-af4e-75c381b2bf52\" (UID: \"e7e2f4c6-ab60-479f-af4e-75c381b2bf52\") " Jul 13 03:38:19.555208 ip-10-0-134-52 kubenswrapper[2558]: I0713 03:38:19.555180 2558 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/e7e2f4c6-ab60-479f-af4e-75c381b2bf52-credential-socket\") pod \"e7e2f4c6-ab60-479f-af4e-75c381b2bf52\" (UID: \"e7e2f4c6-ab60-479f-af4e-75c381b2bf52\") " Jul 13 03:38:19.555313 ip-10-0-134-52 kubenswrapper[2558]: I0713 03:38:19.555232 2558 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/e7e2f4c6-ab60-479f-af4e-75c381b2bf52-workload-socket\") pod \"e7e2f4c6-ab60-479f-af4e-75c381b2bf52\" (UID: \"e7e2f4c6-ab60-479f-af4e-75c381b2bf52\") " Jul 13 03:38:19.555313 ip-10-0-134-52 kubenswrapper[2558]: I0713 03:38:19.555257 2558 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/e7e2f4c6-ab60-479f-af4e-75c381b2bf52-istio-envoy\") pod \"e7e2f4c6-ab60-479f-af4e-75c381b2bf52\" (UID: \"e7e2f4c6-ab60-479f-af4e-75c381b2bf52\") " Jul 13 03:38:19.555313 ip-10-0-134-52 kubenswrapper[2558]: I0713 03:38:19.555279 2558 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/e7e2f4c6-ab60-479f-af4e-75c381b2bf52-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "e7e2f4c6-ab60-479f-af4e-75c381b2bf52" (UID: "e7e2f4c6-ab60-479f-af4e-75c381b2bf52"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 13 03:38:19.555497 ip-10-0-134-52 kubenswrapper[2558]: I0713 03:38:19.555368 2558 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/e7e2f4c6-ab60-479f-af4e-75c381b2bf52-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "e7e2f4c6-ab60-479f-af4e-75c381b2bf52" (UID: "e7e2f4c6-ab60-479f-af4e-75c381b2bf52"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 13 03:38:19.555701 ip-10-0-134-52 kubenswrapper[2558]: I0713 03:38:19.555598 2558 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/e7e2f4c6-ab60-479f-af4e-75c381b2bf52-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "e7e2f4c6-ab60-479f-af4e-75c381b2bf52" (UID: "e7e2f4c6-ab60-479f-af4e-75c381b2bf52"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 13 03:38:19.555799 ip-10-0-134-52 kubenswrapper[2558]: I0713 03:38:19.555635 2558 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/e7e2f4c6-ab60-479f-af4e-75c381b2bf52-istiod-ca-cert\") on node \"ip-10-0-134-52.ec2.internal\" DevicePath \"\"" Jul 13 03:38:19.555852 ip-10-0-134-52 kubenswrapper[2558]: I0713 03:38:19.555814 2558 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/e7e2f4c6-ab60-479f-af4e-75c381b2bf52-workload-certs\") on node \"ip-10-0-134-52.ec2.internal\" DevicePath \"\"" Jul 13 03:38:19.555852 ip-10-0-134-52 kubenswrapper[2558]: I0713 03:38:19.555829 2558 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/e7e2f4c6-ab60-479f-af4e-75c381b2bf52-istio-data" (OuterVolumeSpecName: "istio-data") pod "e7e2f4c6-ab60-479f-af4e-75c381b2bf52" (UID: "e7e2f4c6-ab60-479f-af4e-75c381b2bf52"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 13 03:38:19.556026 ip-10-0-134-52 kubenswrapper[2558]: I0713 03:38:19.556005 2558 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/e7e2f4c6-ab60-479f-af4e-75c381b2bf52-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "e7e2f4c6-ab60-479f-af4e-75c381b2bf52" (UID: "e7e2f4c6-ab60-479f-af4e-75c381b2bf52"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 13 03:38:19.557250 ip-10-0-134-52 kubenswrapper[2558]: I0713 03:38:19.557225 2558 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/e7e2f4c6-ab60-479f-af4e-75c381b2bf52-istio-token" (OuterVolumeSpecName: "istio-token") pod "e7e2f4c6-ab60-479f-af4e-75c381b2bf52" (UID: "e7e2f4c6-ab60-479f-af4e-75c381b2bf52"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 13 03:38:19.557250 ip-10-0-134-52 kubenswrapper[2558]: I0713 03:38:19.557241 2558 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/e7e2f4c6-ab60-479f-af4e-75c381b2bf52-kube-api-access-xmj94" (OuterVolumeSpecName: "kube-api-access-xmj94") pod "e7e2f4c6-ab60-479f-af4e-75c381b2bf52" (UID: "e7e2f4c6-ab60-479f-af4e-75c381b2bf52"). InnerVolumeSpecName "kube-api-access-xmj94". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 13 03:38:19.557438 ip-10-0-134-52 kubenswrapper[2558]: I0713 03:38:19.557313 2558 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/e7e2f4c6-ab60-479f-af4e-75c381b2bf52-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "e7e2f4c6-ab60-479f-af4e-75c381b2bf52" (UID: "e7e2f4c6-ab60-479f-af4e-75c381b2bf52"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue "" Jul 13 03:38:19.557746 ip-10-0-134-52 kubenswrapper[2558]: I0713 03:38:19.557721 2558 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/e7e2f4c6-ab60-479f-af4e-75c381b2bf52-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "e7e2f4c6-ab60-479f-af4e-75c381b2bf52" (UID: "e7e2f4c6-ab60-479f-af4e-75c381b2bf52"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 13 03:38:19.657226 ip-10-0-134-52 kubenswrapper[2558]: I0713 03:38:19.657201 2558 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/e7e2f4c6-ab60-479f-af4e-75c381b2bf52-istio-data\") on node \"ip-10-0-134-52.ec2.internal\" DevicePath \"\"" Jul 13 03:38:19.657226 ip-10-0-134-52 kubenswrapper[2558]: I0713 03:38:19.657222 2558 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-xmj94\" (UniqueName: \"kubernetes.io/projected/e7e2f4c6-ab60-479f-af4e-75c381b2bf52-kube-api-access-xmj94\") on node \"ip-10-0-134-52.ec2.internal\" DevicePath \"\"" Jul 13 03:38:19.657405 ip-10-0-134-52 kubenswrapper[2558]: I0713 03:38:19.657232 2558 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/e7e2f4c6-ab60-479f-af4e-75c381b2bf52-istio-token\") on node \"ip-10-0-134-52.ec2.internal\" DevicePath \"\"" Jul 13 03:38:19.657405 ip-10-0-134-52 kubenswrapper[2558]: I0713 03:38:19.657243 2558 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/e7e2f4c6-ab60-479f-af4e-75c381b2bf52-istio-podinfo\") on node \"ip-10-0-134-52.ec2.internal\" DevicePath \"\"" Jul 13 03:38:19.657405 ip-10-0-134-52 kubenswrapper[2558]: I0713 03:38:19.657257 2558 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/e7e2f4c6-ab60-479f-af4e-75c381b2bf52-credential-socket\") on node \"ip-10-0-134-52.ec2.internal\" DevicePath \"\"" Jul 13 03:38:19.657405 ip-10-0-134-52 kubenswrapper[2558]: I0713 03:38:19.657267 2558 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/e7e2f4c6-ab60-479f-af4e-75c381b2bf52-workload-socket\") on node \"ip-10-0-134-52.ec2.internal\" DevicePath \"\"" Jul 13 03:38:19.657405 ip-10-0-134-52 kubenswrapper[2558]: I0713 03:38:19.657277 2558 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/e7e2f4c6-ab60-479f-af4e-75c381b2bf52-istio-envoy\") on node \"ip-10-0-134-52.ec2.internal\" DevicePath \"\"" Jul 13 03:38:19.801985 ip-10-0-134-52 kubenswrapper[2558]: I0713 03:38:19.801952 2558 generic.go:356] "Generic (PLEG): container finished" podID="e7e2f4c6-ab60-479f-af4e-75c381b2bf52" containerID="f942162ff8b48f22e31b397d335be48e6615297409712e6c5029910e23f6ed2e" exitCode=0 Jul 13 03:38:19.802085 ip-10-0-134-52 kubenswrapper[2558]: I0713 03:38:19.801998 2558 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-mt-766a483d-openshift-default-c476d7999-h6ljt" Jul 13 03:38:19.802085 ip-10-0-134-52 kubenswrapper[2558]: I0713 03:38:19.802045 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-mt-766a483d-openshift-default-c476d7999-h6ljt" event={"ID":"e7e2f4c6-ab60-479f-af4e-75c381b2bf52","Type":"ContainerDied","Data":"f942162ff8b48f22e31b397d335be48e6615297409712e6c5029910e23f6ed2e"} Jul 13 03:38:19.802166 ip-10-0-134-52 kubenswrapper[2558]: I0713 03:38:19.802102 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-mt-766a483d-openshift-default-c476d7999-h6ljt" event={"ID":"e7e2f4c6-ab60-479f-af4e-75c381b2bf52","Type":"ContainerDied","Data":"0b02491b50a2b0142bb17789be0da12e3108904bafa14e91bfe7b00e7e8d5f72"} Jul 13 03:38:19.802166 ip-10-0-134-52 kubenswrapper[2558]: I0713 03:38:19.802125 2558 scope.go:117] "RemoveContainer" containerID="f942162ff8b48f22e31b397d335be48e6615297409712e6c5029910e23f6ed2e" Jul 13 03:38:19.814937 ip-10-0-134-52 kubenswrapper[2558]: I0713 03:38:19.814917 2558 scope.go:117] "RemoveContainer" containerID="48aa1e38031d591a6983f3663a764a2fdb2aa3cf0b678b49e32857b5c5abf04d" Jul 13 03:38:19.825588 ip-10-0-134-52 kubenswrapper[2558]: I0713 03:38:19.825480 2558 scope.go:117] "RemoveContainer" containerID="f942162ff8b48f22e31b397d335be48e6615297409712e6c5029910e23f6ed2e" Jul 13 03:38:19.825818 ip-10-0-134-52 kubenswrapper[2558]: E0713 03:38:19.825798 2558 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"f942162ff8b48f22e31b397d335be48e6615297409712e6c5029910e23f6ed2e\": container with ID starting with f942162ff8b48f22e31b397d335be48e6615297409712e6c5029910e23f6ed2e not found: ID does not exist" containerID="f942162ff8b48f22e31b397d335be48e6615297409712e6c5029910e23f6ed2e" Jul 13 03:38:19.825870 ip-10-0-134-52 kubenswrapper[2558]: I0713 03:38:19.825829 2558 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"f942162ff8b48f22e31b397d335be48e6615297409712e6c5029910e23f6ed2e"} err="failed to get container status \"f942162ff8b48f22e31b397d335be48e6615297409712e6c5029910e23f6ed2e\": rpc error: code = NotFound desc = could not find container \"f942162ff8b48f22e31b397d335be48e6615297409712e6c5029910e23f6ed2e\": container with ID starting with f942162ff8b48f22e31b397d335be48e6615297409712e6c5029910e23f6ed2e not found: ID does not exist" Jul 13 03:38:19.825870 ip-10-0-134-52 kubenswrapper[2558]: I0713 03:38:19.825850 2558 scope.go:117] "RemoveContainer" containerID="48aa1e38031d591a6983f3663a764a2fdb2aa3cf0b678b49e32857b5c5abf04d" Jul 13 03:38:19.826115 ip-10-0-134-52 kubenswrapper[2558]: E0713 03:38:19.826091 2558 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"48aa1e38031d591a6983f3663a764a2fdb2aa3cf0b678b49e32857b5c5abf04d\": container with ID starting with 48aa1e38031d591a6983f3663a764a2fdb2aa3cf0b678b49e32857b5c5abf04d not found: ID does not exist" containerID="48aa1e38031d591a6983f3663a764a2fdb2aa3cf0b678b49e32857b5c5abf04d" Jul 13 03:38:19.826167 ip-10-0-134-52 kubenswrapper[2558]: I0713 03:38:19.826128 2558 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"48aa1e38031d591a6983f3663a764a2fdb2aa3cf0b678b49e32857b5c5abf04d"} err="failed to get container status \"48aa1e38031d591a6983f3663a764a2fdb2aa3cf0b678b49e32857b5c5abf04d\": rpc error: code = NotFound desc = could not find container \"48aa1e38031d591a6983f3663a764a2fdb2aa3cf0b678b49e32857b5c5abf04d\": container with ID starting with 48aa1e38031d591a6983f3663a764a2fdb2aa3cf0b678b49e32857b5c5abf04d not found: ID does not exist" Jul 13 03:38:19.841892 ip-10-0-134-52 kubenswrapper[2558]: I0713 03:38:19.841868 2558 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-mt-766a483d-openshift-default-c476d7999-h6ljt"] Jul 13 03:38:19.849857 ip-10-0-134-52 kubenswrapper[2558]: I0713 03:38:19.849833 2558 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-mt-766a483d-openshift-default-c476d7999-h6ljt"] Jul 13 03:38:20.092867 ip-10-0-134-52 kubenswrapper[2558]: I0713 03:38:20.092755 2558 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="e7e2f4c6-ab60-479f-af4e-75c381b2bf52" path="/var/lib/kubelet/pods/e7e2f4c6-ab60-479f-af4e-75c381b2bf52/volumes" Jul 13 03:38:31.444629 ip-10-0-134-52 kubenswrapper[2558]: I0713 03:38:31.444596 2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-nq4gl"] Jul 13 03:39:07.904737 ip-10-0-134-52 kubenswrapper[2558]: I0713 03:39:07.904699 2558 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-inf-a-3eb586-openshift-default-656798d47f-gtcwz"] Jul 13 03:39:07.905255 ip-10-0-134-52 kubenswrapper[2558]: I0713 03:39:07.905238 2558 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="e7e2f4c6-ab60-479f-af4e-75c381b2bf52" containerName="istio-proxy" Jul 13 03:39:07.905301 ip-10-0-134-52 kubenswrapper[2558]: I0713 03:39:07.905257 2558 state_mem.go:107] "Deleted CPUSet assignment" podUID="e7e2f4c6-ab60-479f-af4e-75c381b2bf52" containerName="istio-proxy" Jul 13 03:39:07.905301 ip-10-0-134-52 kubenswrapper[2558]: I0713 03:39:07.905292 2558 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="e7e2f4c6-ab60-479f-af4e-75c381b2bf52" containerName="istio-proxy" Jul 13 03:39:07.905398 ip-10-0-134-52 kubenswrapper[2558]: I0713 03:39:07.905300 2558 state_mem.go:107] "Deleted CPUSet assignment" podUID="e7e2f4c6-ab60-479f-af4e-75c381b2bf52" containerName="istio-proxy" Jul 13 03:39:07.905441 ip-10-0-134-52 kubenswrapper[2558]: I0713 03:39:07.905426 2558 memory_manager.go:368] "RemoveStaleState removing state" podUID="e7e2f4c6-ab60-479f-af4e-75c381b2bf52" containerName="istio-proxy" Jul 13 03:39:07.905476 ip-10-0-134-52 kubenswrapper[2558]: I0713 03:39:07.905445 2558 memory_manager.go:368] "RemoveStaleState removing state" podUID="e7e2f4c6-ab60-479f-af4e-75c381b2bf52" containerName="istio-proxy" Jul 13 03:39:07.908680 ip-10-0-134-52 kubenswrapper[2558]: I0713 03:39:07.908660 2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-inf-a-3eb586-openshift-default-656798d47f-gtcwz" Jul 13 03:39:07.911222 ip-10-0-134-52 kubenswrapper[2558]: I0713 03:39:07.911202 2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-inf-a-3eb586-openshift-default-dockercfg-jcswb\"" Jul 13 03:39:07.917909 ip-10-0-134-52 kubenswrapper[2558]: I0713 03:39:07.917884 2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-inf-a-3eb586-openshift-default-656798d47f-gtcwz"] Jul 13 03:39:07.920773 ip-10-0-134-52 kubenswrapper[2558]: I0713 03:39:07.920749 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/4c359649-6479-4483-a209-f324f729e1ef-credential-socket\") pod \"e2e-inf-a-3eb586-openshift-default-656798d47f-gtcwz\" (UID: \"4c359649-6479-4483-a209-f324f729e1ef\") " pod="openshift-ingress/e2e-inf-a-3eb586-openshift-default-656798d47f-gtcwz" Jul 13 03:39:07.920858 ip-10-0-134-52 kubenswrapper[2558]: I0713 03:39:07.920795 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/4c359649-6479-4483-a209-f324f729e1ef-istio-envoy\") pod \"e2e-inf-a-3eb586-openshift-default-656798d47f-gtcwz\" (UID: \"4c359649-6479-4483-a209-f324f729e1ef\") " pod="openshift-ingress/e2e-inf-a-3eb586-openshift-default-656798d47f-gtcwz" Jul 13 03:39:07.920858 ip-10-0-134-52 kubenswrapper[2558]: I0713 03:39:07.920821 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/4c359649-6479-4483-a209-f324f729e1ef-istiod-ca-cert\") pod \"e2e-inf-a-3eb586-openshift-default-656798d47f-gtcwz\" (UID: \"4c359649-6479-4483-a209-f324f729e1ef\") " pod="openshift-ingress/e2e-inf-a-3eb586-openshift-default-656798d47f-gtcwz" Jul 13 03:39:07.920930 ip-10-0-134-52 kubenswrapper[2558]: I0713 03:39:07.920876 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/4c359649-6479-4483-a209-f324f729e1ef-workload-socket\") pod \"e2e-inf-a-3eb586-openshift-default-656798d47f-gtcwz\" (UID: \"4c359649-6479-4483-a209-f324f729e1ef\") " pod="openshift-ingress/e2e-inf-a-3eb586-openshift-default-656798d47f-gtcwz" Jul 13 03:39:07.920930 ip-10-0-134-52 kubenswrapper[2558]: I0713 03:39:07.920899 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/4c359649-6479-4483-a209-f324f729e1ef-istio-data\") pod \"e2e-inf-a-3eb586-openshift-default-656798d47f-gtcwz\" (UID: \"4c359649-6479-4483-a209-f324f729e1ef\") " pod="openshift-ingress/e2e-inf-a-3eb586-openshift-default-656798d47f-gtcwz" Jul 13 03:39:07.920930 ip-10-0-134-52 kubenswrapper[2558]: I0713 03:39:07.920922 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/4c359649-6479-4483-a209-f324f729e1ef-istio-token\") pod \"e2e-inf-a-3eb586-openshift-default-656798d47f-gtcwz\" (UID: \"4c359649-6479-4483-a209-f324f729e1ef\") " pod="openshift-ingress/e2e-inf-a-3eb586-openshift-default-656798d47f-gtcwz" Jul 13 03:39:07.921056 ip-10-0-134-52 kubenswrapper[2558]: I0713 03:39:07.920963 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-v4pjb\" (UniqueName: \"kubernetes.io/projected/4c359649-6479-4483-a209-f324f729e1ef-kube-api-access-v4pjb\") pod \"e2e-inf-a-3eb586-openshift-default-656798d47f-gtcwz\" (UID: \"4c359649-6479-4483-a209-f324f729e1ef\") " pod="openshift-ingress/e2e-inf-a-3eb586-openshift-default-656798d47f-gtcwz" Jul 13 03:39:07.921056 ip-10-0-134-52 kubenswrapper[2558]: I0713 03:39:07.920999 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/4c359649-6479-4483-a209-f324f729e1ef-istio-podinfo\") pod \"e2e-inf-a-3eb586-openshift-default-656798d47f-gtcwz\" (UID: \"4c359649-6479-4483-a209-f324f729e1ef\") " pod="openshift-ingress/e2e-inf-a-3eb586-openshift-default-656798d47f-gtcwz" Jul 13 03:39:07.921056 ip-10-0-134-52 kubenswrapper[2558]: I0713 03:39:07.921028 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/4c359649-6479-4483-a209-f324f729e1ef-workload-certs\") pod \"e2e-inf-a-3eb586-openshift-default-656798d47f-gtcwz\" (UID: \"4c359649-6479-4483-a209-f324f729e1ef\") " pod="openshift-ingress/e2e-inf-a-3eb586-openshift-default-656798d47f-gtcwz" Jul 13 03:39:08.021984 ip-10-0-134-52 kubenswrapper[2558]: I0713 03:39:08.021945 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/4c359649-6479-4483-a209-f324f729e1ef-workload-socket\") pod \"e2e-inf-a-3eb586-openshift-default-656798d47f-gtcwz\" (UID: \"4c359649-6479-4483-a209-f324f729e1ef\") " pod="openshift-ingress/e2e-inf-a-3eb586-openshift-default-656798d47f-gtcwz" Jul 13 03:39:08.021984 ip-10-0-134-52 kubenswrapper[2558]: I0713 03:39:08.021983 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/4c359649-6479-4483-a209-f324f729e1ef-istio-data\") pod \"e2e-inf-a-3eb586-openshift-default-656798d47f-gtcwz\" (UID: \"4c359649-6479-4483-a209-f324f729e1ef\") " pod="openshift-ingress/e2e-inf-a-3eb586-openshift-default-656798d47f-gtcwz" Jul 13 03:39:08.022244 ip-10-0-134-52 kubenswrapper[2558]: I0713 03:39:08.022002 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/4c359649-6479-4483-a209-f324f729e1ef-istio-token\") pod \"e2e-inf-a-3eb586-openshift-default-656798d47f-gtcwz\" (UID: \"4c359649-6479-4483-a209-f324f729e1ef\") " pod="openshift-ingress/e2e-inf-a-3eb586-openshift-default-656798d47f-gtcwz" Jul 13 03:39:08.022244 ip-10-0-134-52 kubenswrapper[2558]: I0713 03:39:08.022020 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-v4pjb\" (UniqueName: \"kubernetes.io/projected/4c359649-6479-4483-a209-f324f729e1ef-kube-api-access-v4pjb\") pod \"e2e-inf-a-3eb586-openshift-default-656798d47f-gtcwz\" (UID: \"4c359649-6479-4483-a209-f324f729e1ef\") " pod="openshift-ingress/e2e-inf-a-3eb586-openshift-default-656798d47f-gtcwz" Jul 13 03:39:08.022244 ip-10-0-134-52 kubenswrapper[2558]: I0713 03:39:08.022039 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/4c359649-6479-4483-a209-f324f729e1ef-istio-podinfo\") pod \"e2e-inf-a-3eb586-openshift-default-656798d47f-gtcwz\" (UID: \"4c359649-6479-4483-a209-f324f729e1ef\") " pod="openshift-ingress/e2e-inf-a-3eb586-openshift-default-656798d47f-gtcwz" Jul 13 03:39:08.022244 ip-10-0-134-52 kubenswrapper[2558]: I0713 03:39:08.022114 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/4c359649-6479-4483-a209-f324f729e1ef-workload-certs\") pod \"e2e-inf-a-3eb586-openshift-default-656798d47f-gtcwz\" (UID: \"4c359649-6479-4483-a209-f324f729e1ef\") " pod="openshift-ingress/e2e-inf-a-3eb586-openshift-default-656798d47f-gtcwz" Jul 13 03:39:08.022244 ip-10-0-134-52 kubenswrapper[2558]: I0713 03:39:08.022227 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/4c359649-6479-4483-a209-f324f729e1ef-credential-socket\") pod \"e2e-inf-a-3eb586-openshift-default-656798d47f-gtcwz\" (UID: \"4c359649-6479-4483-a209-f324f729e1ef\") " pod="openshift-ingress/e2e-inf-a-3eb586-openshift-default-656798d47f-gtcwz" Jul 13 03:39:08.022552 ip-10-0-134-52 kubenswrapper[2558]: I0713 03:39:08.022271 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/4c359649-6479-4483-a209-f324f729e1ef-istio-envoy\") pod \"e2e-inf-a-3eb586-openshift-default-656798d47f-gtcwz\" (UID: \"4c359649-6479-4483-a209-f324f729e1ef\") " pod="openshift-ingress/e2e-inf-a-3eb586-openshift-default-656798d47f-gtcwz" Jul 13 03:39:08.022552 ip-10-0-134-52 kubenswrapper[2558]: I0713 03:39:08.022295 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/4c359649-6479-4483-a209-f324f729e1ef-istiod-ca-cert\") pod \"e2e-inf-a-3eb586-openshift-default-656798d47f-gtcwz\" (UID: \"4c359649-6479-4483-a209-f324f729e1ef\") " pod="openshift-ingress/e2e-inf-a-3eb586-openshift-default-656798d47f-gtcwz" Jul 13 03:39:08.022552 ip-10-0-134-52 kubenswrapper[2558]: I0713 03:39:08.022449 2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/4c359649-6479-4483-a209-f324f729e1ef-workload-socket\") pod \"e2e-inf-a-3eb586-openshift-default-656798d47f-gtcwz\" (UID: \"4c359649-6479-4483-a209-f324f729e1ef\") " pod="openshift-ingress/e2e-inf-a-3eb586-openshift-default-656798d47f-gtcwz" Jul 13 03:39:08.022552 ip-10-0-134-52 kubenswrapper[2558]: I0713 03:39:08.022479 2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/4c359649-6479-4483-a209-f324f729e1ef-istio-data\") pod \"e2e-inf-a-3eb586-openshift-default-656798d47f-gtcwz\" (UID: \"4c359649-6479-4483-a209-f324f729e1ef\") " pod="openshift-ingress/e2e-inf-a-3eb586-openshift-default-656798d47f-gtcwz" Jul 13 03:39:08.022552 ip-10-0-134-52 kubenswrapper[2558]: I0713 03:39:08.022543 2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/4c359649-6479-4483-a209-f324f729e1ef-workload-certs\") pod \"e2e-inf-a-3eb586-openshift-default-656798d47f-gtcwz\" (UID: \"4c359649-6479-4483-a209-f324f729e1ef\") " pod="openshift-ingress/e2e-inf-a-3eb586-openshift-default-656798d47f-gtcwz" Jul 13 03:39:08.022786 ip-10-0-134-52 kubenswrapper[2558]: I0713 03:39:08.022765 2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/4c359649-6479-4483-a209-f324f729e1ef-credential-socket\") pod \"e2e-inf-a-3eb586-openshift-default-656798d47f-gtcwz\" (UID: \"4c359649-6479-4483-a209-f324f729e1ef\") " pod="openshift-ingress/e2e-inf-a-3eb586-openshift-default-656798d47f-gtcwz" Jul 13 03:39:08.022994 ip-10-0-134-52 kubenswrapper[2558]: I0713 03:39:08.022972 2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/4c359649-6479-4483-a209-f324f729e1ef-istiod-ca-cert\") pod \"e2e-inf-a-3eb586-openshift-default-656798d47f-gtcwz\" (UID: \"4c359649-6479-4483-a209-f324f729e1ef\") " pod="openshift-ingress/e2e-inf-a-3eb586-openshift-default-656798d47f-gtcwz" Jul 13 03:39:08.024731 ip-10-0-134-52 kubenswrapper[2558]: I0713 03:39:08.024701 2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/4c359649-6479-4483-a209-f324f729e1ef-istio-envoy\") pod \"e2e-inf-a-3eb586-openshift-default-656798d47f-gtcwz\" (UID: \"4c359649-6479-4483-a209-f324f729e1ef\") " pod="openshift-ingress/e2e-inf-a-3eb586-openshift-default-656798d47f-gtcwz" Jul 13 03:39:08.024829 ip-10-0-134-52 kubenswrapper[2558]: I0713 03:39:08.024807 2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/4c359649-6479-4483-a209-f324f729e1ef-istio-podinfo\") pod \"e2e-inf-a-3eb586-openshift-default-656798d47f-gtcwz\" (UID: \"4c359649-6479-4483-a209-f324f729e1ef\") " pod="openshift-ingress/e2e-inf-a-3eb586-openshift-default-656798d47f-gtcwz" Jul 13 03:39:08.034062 ip-10-0-134-52 kubenswrapper[2558]: I0713 03:39:08.034003 2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-v4pjb\" (UniqueName: \"kubernetes.io/projected/4c359649-6479-4483-a209-f324f729e1ef-kube-api-access-v4pjb\") pod \"e2e-inf-a-3eb586-openshift-default-656798d47f-gtcwz\" (UID: \"4c359649-6479-4483-a209-f324f729e1ef\") " pod="openshift-ingress/e2e-inf-a-3eb586-openshift-default-656798d47f-gtcwz" Jul 13 03:39:08.034062 ip-10-0-134-52 kubenswrapper[2558]: I0713 03:39:08.034074 2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/4c359649-6479-4483-a209-f324f729e1ef-istio-token\") pod \"e2e-inf-a-3eb586-openshift-default-656798d47f-gtcwz\" (UID: \"4c359649-6479-4483-a209-f324f729e1ef\") " pod="openshift-ingress/e2e-inf-a-3eb586-openshift-default-656798d47f-gtcwz" Jul 13 03:39:08.220595 ip-10-0-134-52 kubenswrapper[2558]: I0713 03:39:08.220530 2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-inf-a-3eb586-openshift-default-656798d47f-gtcwz" Jul 13 03:39:08.363803 ip-10-0-134-52 kubenswrapper[2558]: I0713 03:39:08.363773 2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-inf-a-3eb586-openshift-default-656798d47f-gtcwz"] Jul 13 03:39:08.364992 ip-10-0-134-52 kubenswrapper[2558]: W0713 03:39:08.364962 2558 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod4c359649_6479_4483_a209_f324f729e1ef.slice/crio-f02afa7f4cfcd950452a2181445bed789426b54338f248d7edf619304887ba8c WatchSource:0}: Error finding container f02afa7f4cfcd950452a2181445bed789426b54338f248d7edf619304887ba8c: Status 404 returned error can't find the container with id f02afa7f4cfcd950452a2181445bed789426b54338f248d7edf619304887ba8c Jul 13 03:39:08.367110 ip-10-0-134-52 kubenswrapper[2558]: I0713 03:39:08.367081 2558 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892164Ki","pods":"250"} Jul 13 03:39:08.367168 ip-10-0-134-52 kubenswrapper[2558]: I0713 03:39:08.367144 2558 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892164Ki","pods":"250"} Jul 13 03:39:08.367208 ip-10-0-134-52 kubenswrapper[2558]: I0713 03:39:08.367174 2558 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892164Ki","pods":"250"} Jul 13 03:39:09.060629 ip-10-0-134-52 kubenswrapper[2558]: I0713 03:39:09.060592 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-inf-a-3eb586-openshift-default-656798d47f-gtcwz" event={"ID":"4c359649-6479-4483-a209-f324f729e1ef","Type":"ContainerStarted","Data":"b0aa32ef8075660c25ab83efb8a0f14b2cb0b574383c79f028028a76c54172d3"} Jul 13 03:39:09.061099 ip-10-0-134-52 kubenswrapper[2558]: I0713 03:39:09.060654 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-inf-a-3eb586-openshift-default-656798d47f-gtcwz" event={"ID":"4c359649-6479-4483-a209-f324f729e1ef","Type":"ContainerStarted","Data":"f02afa7f4cfcd950452a2181445bed789426b54338f248d7edf619304887ba8c"} Jul 13 03:39:09.080395 ip-10-0-134-52 kubenswrapper[2558]: I0713 03:39:09.080310 2558 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-inf-a-3eb586-openshift-default-656798d47f-gtcwz" podStartSLOduration=2.080291714 podStartE2EDuration="2.080291714s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-13 03:39:07 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-13 03:39:09.079512249 +0000 UTC m=+2531.480112716" watchObservedRunningTime="2026-07-13 03:39:09.080291714 +0000 UTC m=+2531.480892181" Jul 13 03:39:09.221756 ip-10-0-134-52 kubenswrapper[2558]: I0713 03:39:09.221722 2558 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-inf-a-3eb586-openshift-default-656798d47f-gtcwz" Jul 13 03:39:09.223164 ip-10-0-134-52 kubenswrapper[2558]: I0713 03:39:09.223138 2558 patch_prober.go:28] interesting pod/e2e-inf-a-3eb586-openshift-default-656798d47f-gtcwz container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.56:15021/healthz/ready\": dial tcp 10.133.0.56:15021: connect: connection refused" start-of-body= Jul 13 03:39:09.223291 ip-10-0-134-52 kubenswrapper[2558]: I0713 03:39:09.223197 2558 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-inf-a-3eb586-openshift-default-656798d47f-gtcwz" podUID="4c359649-6479-4483-a209-f324f729e1ef" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.56:15021/healthz/ready\": dial tcp 10.133.0.56:15021: connect: connection refused" Jul 13 03:39:10.225043 ip-10-0-134-52 kubenswrapper[2558]: I0713 03:39:10.225008 2558 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-inf-a-3eb586-openshift-default-656798d47f-gtcwz" Jul 13 03:39:11.070808 ip-10-0-134-52 kubenswrapper[2558]: I0713 03:39:11.070776 2558 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-inf-a-3eb586-openshift-default-656798d47f-gtcwz" Jul 13 03:39:11.071807 ip-10-0-134-52 kubenswrapper[2558]: I0713 03:39:11.071786 2558 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-inf-a-3eb586-openshift-default-656798d47f-gtcwz" Jul 13 03:42:26.318004 ip-10-0-134-52 kubenswrapper[2558]: I0713 03:42:26.317909 2558 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-inf-a-3eb586-openshift-default-656798d47f-gtcwz"] Jul 13 03:42:26.320573 ip-10-0-134-52 kubenswrapper[2558]: I0713 03:42:26.318199 2558 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/e2e-inf-a-3eb586-openshift-default-656798d47f-gtcwz" podUID="4c359649-6479-4483-a209-f324f729e1ef" containerName="istio-proxy" containerID="cri-o://b0aa32ef8075660c25ab83efb8a0f14b2cb0b574383c79f028028a76c54172d3" gracePeriod=30 Jul 13 03:42:31.569159 ip-10-0-134-52 kubenswrapper[2558]: I0713 03:42:31.569132 2558 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-inf-a-3eb586-openshift-default-656798d47f-gtcwz" Jul 13 03:42:31.646208 ip-10-0-134-52 kubenswrapper[2558]: I0713 03:42:31.646136 2558 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/4c359649-6479-4483-a209-f324f729e1ef-istio-data\") pod \"4c359649-6479-4483-a209-f324f729e1ef\" (UID: \"4c359649-6479-4483-a209-f324f729e1ef\") " Jul 13 03:42:31.646208 ip-10-0-134-52 kubenswrapper[2558]: I0713 03:42:31.646185 2558 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-v4pjb\" (UniqueName: \"kubernetes.io/projected/4c359649-6479-4483-a209-f324f729e1ef-kube-api-access-v4pjb\") pod \"4c359649-6479-4483-a209-f324f729e1ef\" (UID: \"4c359649-6479-4483-a209-f324f729e1ef\") " Jul 13 03:42:31.646418 ip-10-0-134-52 kubenswrapper[2558]: I0713 03:42:31.646218 2558 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/4c359649-6479-4483-a209-f324f729e1ef-istio-envoy\") pod \"4c359649-6479-4483-a209-f324f729e1ef\" (UID: \"4c359649-6479-4483-a209-f324f729e1ef\") " Jul 13 03:42:31.646418 ip-10-0-134-52 kubenswrapper[2558]: I0713 03:42:31.646252 2558 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/4c359649-6479-4483-a209-f324f729e1ef-credential-socket\") pod \"4c359649-6479-4483-a209-f324f729e1ef\" (UID: \"4c359649-6479-4483-a209-f324f729e1ef\") " Jul 13 03:42:31.646418 ip-10-0-134-52 kubenswrapper[2558]: I0713 03:42:31.646294 2558 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/4c359649-6479-4483-a209-f324f729e1ef-istiod-ca-cert\") pod \"4c359649-6479-4483-a209-f324f729e1ef\" (UID: \"4c359649-6479-4483-a209-f324f729e1ef\") " Jul 13 03:42:31.646418 ip-10-0-134-52 kubenswrapper[2558]: I0713 03:42:31.646384 2558 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/4c359649-6479-4483-a209-f324f729e1ef-workload-socket\") pod \"4c359649-6479-4483-a209-f324f729e1ef\" (UID: \"4c359649-6479-4483-a209-f324f729e1ef\") " Jul 13 03:42:31.646638 ip-10-0-134-52 kubenswrapper[2558]: I0713 03:42:31.646433 2558 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/4c359649-6479-4483-a209-f324f729e1ef-istio-token\") pod \"4c359649-6479-4483-a209-f324f729e1ef\" (UID: \"4c359649-6479-4483-a209-f324f729e1ef\") " Jul 13 03:42:31.646638 ip-10-0-134-52 kubenswrapper[2558]: I0713 03:42:31.646432 2558 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/4c359649-6479-4483-a209-f324f729e1ef-istio-data" (OuterVolumeSpecName: "istio-data") pod "4c359649-6479-4483-a209-f324f729e1ef" (UID: "4c359649-6479-4483-a209-f324f729e1ef"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 13 03:42:31.646638 ip-10-0-134-52 kubenswrapper[2558]: I0713 03:42:31.646484 2558 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/4c359649-6479-4483-a209-f324f729e1ef-istio-podinfo\") pod \"4c359649-6479-4483-a209-f324f729e1ef\" (UID: \"4c359649-6479-4483-a209-f324f729e1ef\") " Jul 13 03:42:31.646638 ip-10-0-134-52 kubenswrapper[2558]: I0713 03:42:31.646512 2558 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/4c359649-6479-4483-a209-f324f729e1ef-workload-certs\") pod \"4c359649-6479-4483-a209-f324f729e1ef\" (UID: \"4c359649-6479-4483-a209-f324f729e1ef\") " Jul 13 03:42:31.646831 ip-10-0-134-52 kubenswrapper[2558]: I0713 03:42:31.646648 2558 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/4c359649-6479-4483-a209-f324f729e1ef-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "4c359649-6479-4483-a209-f324f729e1ef" (UID: "4c359649-6479-4483-a209-f324f729e1ef"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 13 03:42:31.646831 ip-10-0-134-52 kubenswrapper[2558]: I0713 03:42:31.646710 2558 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/4c359649-6479-4483-a209-f324f729e1ef-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "4c359649-6479-4483-a209-f324f729e1ef" (UID: "4c359649-6479-4483-a209-f324f729e1ef"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 13 03:42:31.646926 ip-10-0-134-52 kubenswrapper[2558]: I0713 03:42:31.646867 2558 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/4c359649-6479-4483-a209-f324f729e1ef-istiod-ca-cert\") on node \"ip-10-0-134-52.ec2.internal\" DevicePath \"\"" Jul 13 03:42:31.646926 ip-10-0-134-52 kubenswrapper[2558]: I0713 03:42:31.646889 2558 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/4c359649-6479-4483-a209-f324f729e1ef-workload-socket\") on node \"ip-10-0-134-52.ec2.internal\" DevicePath \"\"" Jul 13 03:42:31.646926 ip-10-0-134-52 kubenswrapper[2558]: I0713 03:42:31.646903 2558 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/4c359649-6479-4483-a209-f324f729e1ef-istio-data\") on node \"ip-10-0-134-52.ec2.internal\" DevicePath \"\"" Jul 13 03:42:31.647040 ip-10-0-134-52 kubenswrapper[2558]: I0713 03:42:31.646872 2558 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/4c359649-6479-4483-a209-f324f729e1ef-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "4c359649-6479-4483-a209-f324f729e1ef" (UID: "4c359649-6479-4483-a209-f324f729e1ef"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 13 03:42:31.647291 ip-10-0-134-52 kubenswrapper[2558]: I0713 03:42:31.647268 2558 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/4c359649-6479-4483-a209-f324f729e1ef-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "4c359649-6479-4483-a209-f324f729e1ef" (UID: "4c359649-6479-4483-a209-f324f729e1ef"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 13 03:42:31.648608 ip-10-0-134-52 kubenswrapper[2558]: I0713 03:42:31.648582 2558 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/4c359649-6479-4483-a209-f324f729e1ef-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "4c359649-6479-4483-a209-f324f729e1ef" (UID: "4c359649-6479-4483-a209-f324f729e1ef"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 13 03:42:31.648714 ip-10-0-134-52 kubenswrapper[2558]: I0713 03:42:31.648612 2558 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/4c359649-6479-4483-a209-f324f729e1ef-kube-api-access-v4pjb" (OuterVolumeSpecName: "kube-api-access-v4pjb") pod "4c359649-6479-4483-a209-f324f729e1ef" (UID: "4c359649-6479-4483-a209-f324f729e1ef"). InnerVolumeSpecName "kube-api-access-v4pjb". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 13 03:42:31.649071 ip-10-0-134-52 kubenswrapper[2558]: I0713 03:42:31.649051 2558 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/4c359649-6479-4483-a209-f324f729e1ef-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "4c359649-6479-4483-a209-f324f729e1ef" (UID: "4c359649-6479-4483-a209-f324f729e1ef"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue "" Jul 13 03:42:31.649137 ip-10-0-134-52 kubenswrapper[2558]: I0713 03:42:31.649071 2558 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/4c359649-6479-4483-a209-f324f729e1ef-istio-token" (OuterVolumeSpecName: "istio-token") pod "4c359649-6479-4483-a209-f324f729e1ef" (UID: "4c359649-6479-4483-a209-f324f729e1ef"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 13 03:42:31.747292 ip-10-0-134-52 kubenswrapper[2558]: I0713 03:42:31.747267 2558 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/4c359649-6479-4483-a209-f324f729e1ef-istio-token\") on node \"ip-10-0-134-52.ec2.internal\" DevicePath \"\"" Jul 13 03:42:31.747292 ip-10-0-134-52 kubenswrapper[2558]: I0713 03:42:31.747289 2558 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/4c359649-6479-4483-a209-f324f729e1ef-istio-podinfo\") on node \"ip-10-0-134-52.ec2.internal\" DevicePath \"\"" Jul 13 03:42:31.747442 ip-10-0-134-52 kubenswrapper[2558]: I0713 03:42:31.747299 2558 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/4c359649-6479-4483-a209-f324f729e1ef-workload-certs\") on node \"ip-10-0-134-52.ec2.internal\" DevicePath \"\"" Jul 13 03:42:31.747442 ip-10-0-134-52 kubenswrapper[2558]: I0713 03:42:31.747308 2558 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-v4pjb\" (UniqueName: \"kubernetes.io/projected/4c359649-6479-4483-a209-f324f729e1ef-kube-api-access-v4pjb\") on node \"ip-10-0-134-52.ec2.internal\" DevicePath \"\"" Jul 13 03:42:31.747442 ip-10-0-134-52 kubenswrapper[2558]: I0713 03:42:31.747317 2558 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/4c359649-6479-4483-a209-f324f729e1ef-istio-envoy\") on node \"ip-10-0-134-52.ec2.internal\" DevicePath \"\"" Jul 13 03:42:31.747442 ip-10-0-134-52 kubenswrapper[2558]: I0713 03:42:31.747325 2558 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/4c359649-6479-4483-a209-f324f729e1ef-credential-socket\") on node \"ip-10-0-134-52.ec2.internal\" DevicePath \"\"" Jul 13 03:42:32.144683 ip-10-0-134-52 kubenswrapper[2558]: I0713 03:42:32.144650 2558 generic.go:356] "Generic (PLEG): container finished" podID="4c359649-6479-4483-a209-f324f729e1ef" containerID="b0aa32ef8075660c25ab83efb8a0f14b2cb0b574383c79f028028a76c54172d3" exitCode=0 Jul 13 03:42:32.144830 ip-10-0-134-52 kubenswrapper[2558]: I0713 03:42:32.144694 2558 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-inf-a-3eb586-openshift-default-656798d47f-gtcwz" Jul 13 03:42:32.144830 ip-10-0-134-52 kubenswrapper[2558]: I0713 03:42:32.144741 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-inf-a-3eb586-openshift-default-656798d47f-gtcwz" event={"ID":"4c359649-6479-4483-a209-f324f729e1ef","Type":"ContainerDied","Data":"b0aa32ef8075660c25ab83efb8a0f14b2cb0b574383c79f028028a76c54172d3"} Jul 13 03:42:32.144830 ip-10-0-134-52 kubenswrapper[2558]: I0713 03:42:32.144792 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-inf-a-3eb586-openshift-default-656798d47f-gtcwz" event={"ID":"4c359649-6479-4483-a209-f324f729e1ef","Type":"ContainerDied","Data":"f02afa7f4cfcd950452a2181445bed789426b54338f248d7edf619304887ba8c"} Jul 13 03:42:32.144830 ip-10-0-134-52 kubenswrapper[2558]: I0713 03:42:32.144822 2558 scope.go:117] "RemoveContainer" containerID="b0aa32ef8075660c25ab83efb8a0f14b2cb0b574383c79f028028a76c54172d3" Jul 13 03:42:32.153901 ip-10-0-134-52 kubenswrapper[2558]: I0713 03:42:32.153886 2558 scope.go:117] "RemoveContainer" containerID="b0aa32ef8075660c25ab83efb8a0f14b2cb0b574383c79f028028a76c54172d3" Jul 13 03:42:32.154154 ip-10-0-134-52 kubenswrapper[2558]: E0713 03:42:32.154134 2558 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"b0aa32ef8075660c25ab83efb8a0f14b2cb0b574383c79f028028a76c54172d3\": container with ID starting with b0aa32ef8075660c25ab83efb8a0f14b2cb0b574383c79f028028a76c54172d3 not found: ID does not exist" containerID="b0aa32ef8075660c25ab83efb8a0f14b2cb0b574383c79f028028a76c54172d3" Jul 13 03:42:32.154209 ip-10-0-134-52 kubenswrapper[2558]: I0713 03:42:32.154162 2558 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"b0aa32ef8075660c25ab83efb8a0f14b2cb0b574383c79f028028a76c54172d3"} err="failed to get container status \"b0aa32ef8075660c25ab83efb8a0f14b2cb0b574383c79f028028a76c54172d3\": rpc error: code = NotFound desc = could not find container \"b0aa32ef8075660c25ab83efb8a0f14b2cb0b574383c79f028028a76c54172d3\": container with ID starting with b0aa32ef8075660c25ab83efb8a0f14b2cb0b574383c79f028028a76c54172d3 not found: ID does not exist" Jul 13 03:42:32.163209 ip-10-0-134-52 kubenswrapper[2558]: I0713 03:42:32.163188 2558 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-inf-a-3eb586-openshift-default-656798d47f-gtcwz"] Jul 13 03:42:32.167132 ip-10-0-134-52 kubenswrapper[2558]: I0713 03:42:32.167112 2558 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-inf-a-3eb586-openshift-default-656798d47f-gtcwz"] Jul 13 03:42:32.963131 ip-10-0-134-52 kubenswrapper[2558]: I0713 03:42:32.963103 2558 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_model-serving-api-54d89bd5fc-bvrs4_cbfbffcd-8456-47cd-908e-7c8e9cec2304/server/0.log" Jul 13 03:42:33.444103 ip-10-0-134-52 kubenswrapper[2558]: I0713 03:42:33.444080 2558 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-7dcb9ff95f-jsjt6_c8a067a6-8c09-470c-87f7-49ac6d22c34e/copy-manifests/0.log" Jul 13 03:42:33.450311 ip-10-0-134-52 kubenswrapper[2558]: I0713 03:42:33.450288 2558 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-7dcb9ff95f-jsjt6_c8a067a6-8c09-470c-87f7-49ac6d22c34e/manager/0.log" Jul 13 03:42:34.093502 ip-10-0-134-52 kubenswrapper[2558]: I0713 03:42:34.093463 2558 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="4c359649-6479-4483-a209-f324f729e1ef" path="/var/lib/kubelet/pods/4c359649-6479-4483-a209-f324f729e1ef/volumes" Jul 13 03:42:34.669631 ip-10-0-134-52 kubenswrapper[2558]: I0713 03:42:34.669597 2558 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b7595s7h5_28acb62f-1fa2-45fa-a2b8-dba00604a968/extract/0.log" Jul 13 03:42:34.674962 ip-10-0-134-52 kubenswrapper[2558]: I0713 03:42:34.674944 2558 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b7595s7h5_28acb62f-1fa2-45fa-a2b8-dba00604a968/util/0.log" Jul 13 03:42:34.680531 ip-10-0-134-52 kubenswrapper[2558]: I0713 03:42:34.680502 2558 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b7595s7h5_28acb62f-1fa2-45fa-a2b8-dba00604a968/pull/0.log" Jul 13 03:42:34.786414 ip-10-0-134-52 kubenswrapper[2558]: I0713 03:42:34.786388 2558 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0xbh5q_31221317-a0bf-4d04-87f4-f7b179fc3fd6/util/0.log" Jul 13 03:42:34.791825 ip-10-0-134-52 kubenswrapper[2558]: I0713 03:42:34.791805 2558 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0xbh5q_31221317-a0bf-4d04-87f4-f7b179fc3fd6/pull/0.log" Jul 13 03:42:34.796854 ip-10-0-134-52 kubenswrapper[2558]: I0713 03:42:34.796837 2558 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0xbh5q_31221317-a0bf-4d04-87f4-f7b179fc3fd6/extract/0.log" Jul 13 03:42:34.909182 ip-10-0-134-52 kubenswrapper[2558]: I0713 03:42:34.909160 2558 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed7382lfg_ea4c0956-80a0-434e-9483-d5c467053b32/util/0.log" Jul 13 03:42:34.915412 ip-10-0-134-52 kubenswrapper[2558]: I0713 03:42:34.915387 2558 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed7382lfg_ea4c0956-80a0-434e-9483-d5c467053b32/pull/0.log" Jul 13 03:42:34.921295 ip-10-0-134-52 kubenswrapper[2558]: I0713 03:42:34.921244 2558 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed7382lfg_ea4c0956-80a0-434e-9483-d5c467053b32/extract/0.log" Jul 13 03:42:35.030100 ip-10-0-134-52 kubenswrapper[2558]: I0713 03:42:35.030080 2558 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1kgdxq_7e5a7536-75c8-40fb-b87a-1f700b719d2b/util/0.log" Jul 13 03:42:35.036243 ip-10-0-134-52 kubenswrapper[2558]: I0713 03:42:35.036227 2558 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1kgdxq_7e5a7536-75c8-40fb-b87a-1f700b719d2b/pull/0.log" Jul 13 03:42:35.042225 ip-10-0-134-52 kubenswrapper[2558]: I0713 03:42:35.042204 2558 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1kgdxq_7e5a7536-75c8-40fb-b87a-1f700b719d2b/extract/0.log" Jul 13 03:42:35.473873 ip-10-0-134-52 kubenswrapper[2558]: I0713 03:42:35.473850 2558 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_kuadrant-console-plugin-66b5774985-45lfc_dae9a82d-b49e-4088-82d7-7894b3572063/kuadrant-console-plugin/0.log" Jul 13 03:42:35.593254 ip-10-0-134-52 kubenswrapper[2558]: I0713 03:42:35.593221 2558 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_kuadrant-operator-catalog-n762x_d86562e5-26bb-4191-93fd-869ff608ab89/registry-server/0.log" Jul 13 03:42:35.721800 ip-10-0-134-52 kubenswrapper[2558]: I0713 03:42:35.721768 2558 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_kuadrant-operator-controller-manager-86878c769f-fvgqp_aca7cb73-3ce6-4fbb-88b3-4d59d4802a3a/manager/0.log" Jul 13 03:42:35.834882 ip-10-0-134-52 kubenswrapper[2558]: I0713 03:42:35.834850 2558 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_limitador-limitador-54d6d988d5-nq4gl_b14362f9-1c59-4513-b306-291c6e73afc5/limitador/0.log" Jul 13 03:42:36.304396 ip-10-0-134-52 kubenswrapper[2558]: I0713 03:42:36.304325 2558 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_data-science-gateway-data-science-gateway-class-6576859cf42dw75_9f9b901e-71ee-4c58-81c0-f48dbb910356/istio-proxy/0.log" Jul 13 03:42:36.761659 ip-10-0-134-52 kubenswrapper[2558]: I0713 03:42:36.761584 2558 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_maas-default-gateway-openshift-default-56654dcf7-pdpz9_25ab9eef-bfef-4f8b-a0a5-5fd5abe2f44e/istio-proxy/1.log" Jul 13 03:42:37.100401 ip-10-0-134-52 kubenswrapper[2558]: I0713 03:42:37.100358 2558 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_router-default-7d87747c94-bc7qr_53d1746c-0708-4c16-ace0-20912ab1c2d3/router/0.log" Jul 13 03:42:41.597191 ip-10-0-134-52 kubenswrapper[2558]: I0713 03:42:41.597155 2558 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-must-gather-xjlbl/must-gather-v67v2"] Jul 13 03:42:41.600794 ip-10-0-134-52 kubenswrapper[2558]: I0713 03:42:41.598517 2558 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="4c359649-6479-4483-a209-f324f729e1ef" containerName="istio-proxy" Jul 13 03:42:41.600794 ip-10-0-134-52 kubenswrapper[2558]: I0713 03:42:41.598546 2558 state_mem.go:107] "Deleted CPUSet assignment" podUID="4c359649-6479-4483-a209-f324f729e1ef" containerName="istio-proxy" Jul 13 03:42:41.600794 ip-10-0-134-52 kubenswrapper[2558]: I0713 03:42:41.598727 2558 memory_manager.go:368] "RemoveStaleState removing state" podUID="4c359649-6479-4483-a209-f324f729e1ef" containerName="istio-proxy" Jul 13 03:42:41.603134 ip-10-0-134-52 kubenswrapper[2558]: I0713 03:42:41.603099 2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-xjlbl/must-gather-v67v2" Jul 13 03:42:41.605759 ip-10-0-134-52 kubenswrapper[2558]: I0713 03:42:41.605737 2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-must-gather-xjlbl\"/\"default-dockercfg-5wgrz\"" Jul 13 03:42:41.605895 ip-10-0-134-52 kubenswrapper[2558]: I0713 03:42:41.605816 2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-xjlbl/must-gather-v67v2"] Jul 13 03:42:41.607083 ip-10-0-134-52 kubenswrapper[2558]: I0713 03:42:41.607061 2558 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-must-gather-xjlbl\"/\"kube-root-ca.crt\"" Jul 13 03:42:41.607188 ip-10-0-134-52 kubenswrapper[2558]: I0713 03:42:41.607061 2558 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-must-gather-xjlbl\"/\"openshift-service-ca.crt\"" Jul 13 03:42:41.624843 ip-10-0-134-52 kubenswrapper[2558]: I0713 03:42:41.624820 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"must-gather-output\" (UniqueName: \"kubernetes.io/empty-dir/89cb4ee7-3a1c-4283-a15d-1647888418a2-must-gather-output\") pod \"must-gather-v67v2\" (UID: \"89cb4ee7-3a1c-4283-a15d-1647888418a2\") " pod="openshift-must-gather-xjlbl/must-gather-v67v2" Jul 13 03:42:41.624955 ip-10-0-134-52 kubenswrapper[2558]: I0713 03:42:41.624868 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-sc6nc\" (UniqueName: \"kubernetes.io/projected/89cb4ee7-3a1c-4283-a15d-1647888418a2-kube-api-access-sc6nc\") pod \"must-gather-v67v2\" (UID: \"89cb4ee7-3a1c-4283-a15d-1647888418a2\") " pod="openshift-must-gather-xjlbl/must-gather-v67v2" Jul 13 03:42:41.725874 ip-10-0-134-52 kubenswrapper[2558]: I0713 03:42:41.725848 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"must-gather-output\" (UniqueName: \"kubernetes.io/empty-dir/89cb4ee7-3a1c-4283-a15d-1647888418a2-must-gather-output\") pod \"must-gather-v67v2\" (UID: \"89cb4ee7-3a1c-4283-a15d-1647888418a2\") " pod="openshift-must-gather-xjlbl/must-gather-v67v2" Jul 13 03:42:41.725981 ip-10-0-134-52 kubenswrapper[2558]: I0713 03:42:41.725883 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-sc6nc\" (UniqueName: \"kubernetes.io/projected/89cb4ee7-3a1c-4283-a15d-1647888418a2-kube-api-access-sc6nc\") pod \"must-gather-v67v2\" (UID: \"89cb4ee7-3a1c-4283-a15d-1647888418a2\") " pod="openshift-must-gather-xjlbl/must-gather-v67v2" Jul 13 03:42:41.726195 ip-10-0-134-52 kubenswrapper[2558]: I0713 03:42:41.726175 2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"must-gather-output\" (UniqueName: \"kubernetes.io/empty-dir/89cb4ee7-3a1c-4283-a15d-1647888418a2-must-gather-output\") pod \"must-gather-v67v2\" (UID: \"89cb4ee7-3a1c-4283-a15d-1647888418a2\") " pod="openshift-must-gather-xjlbl/must-gather-v67v2" Jul 13 03:42:41.734213 ip-10-0-134-52 kubenswrapper[2558]: I0713 03:42:41.734190 2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-sc6nc\" (UniqueName: \"kubernetes.io/projected/89cb4ee7-3a1c-4283-a15d-1647888418a2-kube-api-access-sc6nc\") pod \"must-gather-v67v2\" (UID: \"89cb4ee7-3a1c-4283-a15d-1647888418a2\") " pod="openshift-must-gather-xjlbl/must-gather-v67v2" Jul 13 03:42:41.914078 ip-10-0-134-52 kubenswrapper[2558]: I0713 03:42:41.914013 2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-xjlbl/must-gather-v67v2" Jul 13 03:42:42.050878 ip-10-0-134-52 kubenswrapper[2558]: I0713 03:42:42.050847 2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-xjlbl/must-gather-v67v2"] Jul 13 03:42:42.052512 ip-10-0-134-52 kubenswrapper[2558]: W0713 03:42:42.052482 2558 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod89cb4ee7_3a1c_4283_a15d_1647888418a2.slice/crio-67f68e71417305c4acc497f68d3824a72768e2c30e1fcc06d0c392ce5c612cdd WatchSource:0}: Error finding container 67f68e71417305c4acc497f68d3824a72768e2c30e1fcc06d0c392ce5c612cdd: Status 404 returned error can't find the container with id 67f68e71417305c4acc497f68d3824a72768e2c30e1fcc06d0c392ce5c612cdd Jul 13 03:42:42.054860 ip-10-0-134-52 kubenswrapper[2558]: I0713 03:42:42.054841 2558 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider Jul 13 03:42:42.198601 ip-10-0-134-52 kubenswrapper[2558]: I0713 03:42:42.198537 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-xjlbl/must-gather-v67v2" event={"ID":"89cb4ee7-3a1c-4283-a15d-1647888418a2","Type":"ContainerStarted","Data":"67f68e71417305c4acc497f68d3824a72768e2c30e1fcc06d0c392ce5c612cdd"} Jul 13 03:42:43.206964 ip-10-0-134-52 kubenswrapper[2558]: I0713 03:42:43.206935 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-xjlbl/must-gather-v67v2" event={"ID":"89cb4ee7-3a1c-4283-a15d-1647888418a2","Type":"ContainerStarted","Data":"4b36e76a667014590c819b8fb6fb6a93c079172dabe8b2154f8ed2c80dc4b132"} Jul 13 03:42:44.213821 ip-10-0-134-52 kubenswrapper[2558]: I0713 03:42:44.213785 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-xjlbl/must-gather-v67v2" event={"ID":"89cb4ee7-3a1c-4283-a15d-1647888418a2","Type":"ContainerStarted","Data":"69c22ffd35eb1cd2e159c57a570e430944b87d536c71714df0b93e1892ebc4de"} Jul 13 03:42:44.229343 ip-10-0-134-52 kubenswrapper[2558]: I0713 03:42:44.229274 2558 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-must-gather-xjlbl/must-gather-v67v2" podStartSLOduration=2.175990116 podStartE2EDuration="3.229256316s" totalImagesPullingTime="1.0532662s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-13 03:42:41 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-13 03:42:44.227415023 +0000 UTC m=+2746.628015480" watchObservedRunningTime="2026-07-13 03:42:44.229256316 +0000 UTC m=+2746.629856785" Jul 13 03:42:44.590717 ip-10-0-134-52 kubenswrapper[2558]: I0713 03:42:44.590679 2558 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_global-pull-secret-syncer-hf6cl_5b3dc970-19d3-43e8-9a7b-4062feb75c3e/global-pull-secret-syncer/0.log" Jul 13 03:42:44.776711 ip-10-0-134-52 kubenswrapper[2558]: I0713 03:42:44.776666 2558 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_konnectivity-agent-pf2f6_fe52b12d-b43c-483f-8b5b-155c4330c953/konnectivity-agent/0.log" Jul 13 03:42:44.820408 ip-10-0-134-52 kubenswrapper[2558]: I0713 03:42:44.820378 2558 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_kube-apiserver-proxy-ip-10-0-134-52.ec2.internal_c2b195f03ef2d8abb371e44a8b3b8700/haproxy/0.log" Jul 13 03:42:49.326527 ip-10-0-134-52 kubenswrapper[2558]: I0713 03:42:49.326494 2558 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b7595s7h5_28acb62f-1fa2-45fa-a2b8-dba00604a968/extract/0.log" Jul 13 03:42:49.346747 ip-10-0-134-52 kubenswrapper[2558]: I0713 03:42:49.346712 2558 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b7595s7h5_28acb62f-1fa2-45fa-a2b8-dba00604a968/util/0.log" Jul 13 03:42:49.366281 ip-10-0-134-52 kubenswrapper[2558]: I0713 03:42:49.366250 2558 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b7595s7h5_28acb62f-1fa2-45fa-a2b8-dba00604a968/pull/0.log" Jul 13 03:42:49.391253 ip-10-0-134-52 kubenswrapper[2558]: I0713 03:42:49.391220 2558 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0xbh5q_31221317-a0bf-4d04-87f4-f7b179fc3fd6/extract/0.log" Jul 13 03:42:49.415022 ip-10-0-134-52 kubenswrapper[2558]: I0713 03:42:49.414989 2558 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0xbh5q_31221317-a0bf-4d04-87f4-f7b179fc3fd6/util/0.log" Jul 13 03:42:49.433904 ip-10-0-134-52 kubenswrapper[2558]: I0713 03:42:49.433866 2558 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0xbh5q_31221317-a0bf-4d04-87f4-f7b179fc3fd6/pull/0.log" Jul 13 03:42:49.457095 ip-10-0-134-52 kubenswrapper[2558]: I0713 03:42:49.457061 2558 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed7382lfg_ea4c0956-80a0-434e-9483-d5c467053b32/extract/0.log" Jul 13 03:42:49.477204 ip-10-0-134-52 kubenswrapper[2558]: I0713 03:42:49.477170 2558 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed7382lfg_ea4c0956-80a0-434e-9483-d5c467053b32/util/0.log" Jul 13 03:42:49.499642 ip-10-0-134-52 kubenswrapper[2558]: I0713 03:42:49.499606 2558 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed7382lfg_ea4c0956-80a0-434e-9483-d5c467053b32/pull/0.log" Jul 13 03:42:49.521262 ip-10-0-134-52 kubenswrapper[2558]: I0713 03:42:49.521230 2558 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1kgdxq_7e5a7536-75c8-40fb-b87a-1f700b719d2b/extract/0.log" Jul 13 03:42:49.540351 ip-10-0-134-52 kubenswrapper[2558]: I0713 03:42:49.540305 2558 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1kgdxq_7e5a7536-75c8-40fb-b87a-1f700b719d2b/util/0.log" Jul 13 03:42:49.561074 ip-10-0-134-52 kubenswrapper[2558]: I0713 03:42:49.561040 2558 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1kgdxq_7e5a7536-75c8-40fb-b87a-1f700b719d2b/pull/0.log" Jul 13 03:42:49.900287 ip-10-0-134-52 kubenswrapper[2558]: I0713 03:42:49.900253 2558 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_kuadrant-console-plugin-66b5774985-45lfc_dae9a82d-b49e-4088-82d7-7894b3572063/kuadrant-console-plugin/0.log" Jul 13 03:42:49.940100 ip-10-0-134-52 kubenswrapper[2558]: I0713 03:42:49.940065 2558 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_kuadrant-operator-catalog-n762x_d86562e5-26bb-4191-93fd-869ff608ab89/registry-server/0.log" Jul 13 03:42:50.050359 ip-10-0-134-52 kubenswrapper[2558]: I0713 03:42:50.046624 2558 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_kuadrant-operator-controller-manager-86878c769f-fvgqp_aca7cb73-3ce6-4fbb-88b3-4d59d4802a3a/manager/0.log" Jul 13 03:42:50.077499 ip-10-0-134-52 kubenswrapper[2558]: I0713 03:42:50.077445 2558 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_limitador-limitador-54d6d988d5-nq4gl_b14362f9-1c59-4513-b306-291c6e73afc5/limitador/0.log" Jul 13 03:42:51.856589 ip-10-0-134-52 kubenswrapper[2558]: I0713 03:42:51.856563 2558 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_427741a2-bf37-4342-9132-b2a324768fb2/alertmanager/0.log" Jul 13 03:42:51.882265 ip-10-0-134-52 kubenswrapper[2558]: I0713 03:42:51.882232 2558 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_427741a2-bf37-4342-9132-b2a324768fb2/config-reloader/0.log" Jul 13 03:42:51.903025 ip-10-0-134-52 kubenswrapper[2558]: I0713 03:42:51.903000 2558 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_427741a2-bf37-4342-9132-b2a324768fb2/kube-rbac-proxy-web/0.log" Jul 13 03:42:51.924141 ip-10-0-134-52 kubenswrapper[2558]: I0713 03:42:51.924116 2558 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_427741a2-bf37-4342-9132-b2a324768fb2/kube-rbac-proxy/0.log" Jul 13 03:42:51.943430 ip-10-0-134-52 kubenswrapper[2558]: I0713 03:42:51.943389 2558 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_427741a2-bf37-4342-9132-b2a324768fb2/kube-rbac-proxy-metric/0.log" Jul 13 03:42:51.962800 ip-10-0-134-52 kubenswrapper[2558]: I0713 03:42:51.962705 2558 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_427741a2-bf37-4342-9132-b2a324768fb2/prom-label-proxy/0.log" Jul 13 03:42:51.983220 ip-10-0-134-52 kubenswrapper[2558]: I0713 03:42:51.983191 2558 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_427741a2-bf37-4342-9132-b2a324768fb2/init-config-reloader/0.log" Jul 13 03:42:52.260635 ip-10-0-134-52 kubenswrapper[2558]: I0713 03:42:52.260556 2558 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-rssjv_cd974d9c-4de2-4f2a-9b1b-3e58de6bec29/node-exporter/0.log" Jul 13 03:42:52.280205 ip-10-0-134-52 kubenswrapper[2558]: I0713 03:42:52.280173 2558 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-rssjv_cd974d9c-4de2-4f2a-9b1b-3e58de6bec29/kube-rbac-proxy/0.log" Jul 13 03:42:52.301532 ip-10-0-134-52 kubenswrapper[2558]: I0713 03:42:52.301506 2558 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-rssjv_cd974d9c-4de2-4f2a-9b1b-3e58de6bec29/init-textfile/0.log" Jul 13 03:42:52.651260 ip-10-0-134-52 kubenswrapper[2558]: I0713 03:42:52.651213 2558 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-operator-64785b6675-7tnh9_ecafd7ec-48df-4a8f-8626-117ea2e9af7b/prometheus-operator/0.log" Jul 13 03:42:52.669126 ip-10-0-134-52 kubenswrapper[2558]: I0713 03:42:52.669082 2558 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-operator-64785b6675-7tnh9_ecafd7ec-48df-4a8f-8626-117ea2e9af7b/kube-rbac-proxy/0.log" Jul 13 03:42:52.717959 ip-10-0-134-52 kubenswrapper[2558]: I0713 03:42:52.717929 2558 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_telemeter-client-6bbd99d68b-47bkk_c0791684-d0ab-411b-a922-f703daa8c542/telemeter-client/0.log" Jul 13 03:42:52.736603 ip-10-0-134-52 kubenswrapper[2558]: I0713 03:42:52.736575 2558 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_telemeter-client-6bbd99d68b-47bkk_c0791684-d0ab-411b-a922-f703daa8c542/reload/0.log" Jul 13 03:42:52.756931 ip-10-0-134-52 kubenswrapper[2558]: I0713 03:42:52.756903 2558 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_telemeter-client-6bbd99d68b-47bkk_c0791684-d0ab-411b-a922-f703daa8c542/kube-rbac-proxy/0.log" Jul 13 03:42:52.787782 ip-10-0-134-52 kubenswrapper[2558]: I0713 03:42:52.787192 2558 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-77b686b4f7-bjzn2_c69060a0-a145-4d88-b7fc-84d321cd2e8a/thanos-query/0.log" Jul 13 03:42:52.810614 ip-10-0-134-52 kubenswrapper[2558]: I0713 03:42:52.810585 2558 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-77b686b4f7-bjzn2_c69060a0-a145-4d88-b7fc-84d321cd2e8a/kube-rbac-proxy-web/0.log" Jul 13 03:42:52.827858 ip-10-0-134-52 kubenswrapper[2558]: I0713 03:42:52.827827 2558 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-77b686b4f7-bjzn2_c69060a0-a145-4d88-b7fc-84d321cd2e8a/kube-rbac-proxy/0.log" Jul 13 03:42:52.845133 ip-10-0-134-52 kubenswrapper[2558]: I0713 03:42:52.845106 2558 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-77b686b4f7-bjzn2_c69060a0-a145-4d88-b7fc-84d321cd2e8a/prom-label-proxy/0.log" Jul 13 03:42:52.865585 ip-10-0-134-52 kubenswrapper[2558]: I0713 03:42:52.865558 2558 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-77b686b4f7-bjzn2_c69060a0-a145-4d88-b7fc-84d321cd2e8a/kube-rbac-proxy-rules/0.log" Jul 13 03:42:52.883715 ip-10-0-134-52 kubenswrapper[2558]: I0713 03:42:52.883687 2558 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-77b686b4f7-bjzn2_c69060a0-a145-4d88-b7fc-84d321cd2e8a/kube-rbac-proxy-metrics/0.log" Jul 13 03:42:54.368842 ip-10-0-134-52 kubenswrapper[2558]: I0713 03:42:54.368806 2558 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-must-gather-xjlbl/perf-node-gather-daemonset-tppdn"] Jul 13 03:42:54.376602 ip-10-0-134-52 kubenswrapper[2558]: I0713 03:42:54.376577 2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-xjlbl/perf-node-gather-daemonset-tppdn" Jul 13 03:42:54.381135 ip-10-0-134-52 kubenswrapper[2558]: I0713 03:42:54.381070 2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-xjlbl/perf-node-gather-daemonset-tppdn"] Jul 13 03:42:54.462845 ip-10-0-134-52 kubenswrapper[2558]: I0713 03:42:54.462808 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/fc01aafb-6dd7-426a-989d-5760a81ffff3-proc\") pod \"perf-node-gather-daemonset-tppdn\" (UID: \"fc01aafb-6dd7-426a-989d-5760a81ffff3\") " pod="openshift-must-gather-xjlbl/perf-node-gather-daemonset-tppdn" Jul 13 03:42:54.463014 ip-10-0-134-52 kubenswrapper[2558]: I0713 03:42:54.462966 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-mbpz8\" (UniqueName: \"kubernetes.io/projected/fc01aafb-6dd7-426a-989d-5760a81ffff3-kube-api-access-mbpz8\") pod \"perf-node-gather-daemonset-tppdn\" (UID: \"fc01aafb-6dd7-426a-989d-5760a81ffff3\") " pod="openshift-must-gather-xjlbl/perf-node-gather-daemonset-tppdn" Jul 13 03:42:54.463090 ip-10-0-134-52 kubenswrapper[2558]: I0713 03:42:54.463012 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/fc01aafb-6dd7-426a-989d-5760a81ffff3-sys\") pod \"perf-node-gather-daemonset-tppdn\" (UID: \"fc01aafb-6dd7-426a-989d-5760a81ffff3\") " pod="openshift-must-gather-xjlbl/perf-node-gather-daemonset-tppdn" Jul 13 03:42:54.463090 ip-10-0-134-52 kubenswrapper[2558]: I0713 03:42:54.463042 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/fc01aafb-6dd7-426a-989d-5760a81ffff3-lib-modules\") pod \"perf-node-gather-daemonset-tppdn\" (UID: \"fc01aafb-6dd7-426a-989d-5760a81ffff3\") " pod="openshift-must-gather-xjlbl/perf-node-gather-daemonset-tppdn" Jul 13 03:42:54.463213 ip-10-0-134-52 kubenswrapper[2558]: I0713 03:42:54.463163 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/fc01aafb-6dd7-426a-989d-5760a81ffff3-podres\") pod \"perf-node-gather-daemonset-tppdn\" (UID: \"fc01aafb-6dd7-426a-989d-5760a81ffff3\") " pod="openshift-must-gather-xjlbl/perf-node-gather-daemonset-tppdn" Jul 13 03:42:54.563790 ip-10-0-134-52 kubenswrapper[2558]: I0713 03:42:54.563730 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/fc01aafb-6dd7-426a-989d-5760a81ffff3-podres\") pod \"perf-node-gather-daemonset-tppdn\" (UID: \"fc01aafb-6dd7-426a-989d-5760a81ffff3\") " pod="openshift-must-gather-xjlbl/perf-node-gather-daemonset-tppdn" Jul 13 03:42:54.564006 ip-10-0-134-52 kubenswrapper[2558]: I0713 03:42:54.563811 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/fc01aafb-6dd7-426a-989d-5760a81ffff3-proc\") pod \"perf-node-gather-daemonset-tppdn\" (UID: \"fc01aafb-6dd7-426a-989d-5760a81ffff3\") " pod="openshift-must-gather-xjlbl/perf-node-gather-daemonset-tppdn" Jul 13 03:42:54.564006 ip-10-0-134-52 kubenswrapper[2558]: I0713 03:42:54.563919 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-mbpz8\" (UniqueName: \"kubernetes.io/projected/fc01aafb-6dd7-426a-989d-5760a81ffff3-kube-api-access-mbpz8\") pod \"perf-node-gather-daemonset-tppdn\" (UID: \"fc01aafb-6dd7-426a-989d-5760a81ffff3\") " pod="openshift-must-gather-xjlbl/perf-node-gather-daemonset-tppdn" Jul 13 03:42:54.564006 ip-10-0-134-52 kubenswrapper[2558]: I0713 03:42:54.563951 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/fc01aafb-6dd7-426a-989d-5760a81ffff3-sys\") pod \"perf-node-gather-daemonset-tppdn\" (UID: \"fc01aafb-6dd7-426a-989d-5760a81ffff3\") " pod="openshift-must-gather-xjlbl/perf-node-gather-daemonset-tppdn" Jul 13 03:42:54.564006 ip-10-0-134-52 kubenswrapper[2558]: I0713 03:42:54.563980 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/fc01aafb-6dd7-426a-989d-5760a81ffff3-lib-modules\") pod \"perf-node-gather-daemonset-tppdn\" (UID: \"fc01aafb-6dd7-426a-989d-5760a81ffff3\") " pod="openshift-must-gather-xjlbl/perf-node-gather-daemonset-tppdn" Jul 13 03:42:54.564249 ip-10-0-134-52 kubenswrapper[2558]: I0713 03:42:54.564175 2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/fc01aafb-6dd7-426a-989d-5760a81ffff3-lib-modules\") pod \"perf-node-gather-daemonset-tppdn\" (UID: \"fc01aafb-6dd7-426a-989d-5760a81ffff3\") " pod="openshift-must-gather-xjlbl/perf-node-gather-daemonset-tppdn" Jul 13 03:42:54.564314 ip-10-0-134-52 kubenswrapper[2558]: I0713 03:42:54.564244 2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/fc01aafb-6dd7-426a-989d-5760a81ffff3-proc\") pod \"perf-node-gather-daemonset-tppdn\" (UID: \"fc01aafb-6dd7-426a-989d-5760a81ffff3\") " pod="openshift-must-gather-xjlbl/perf-node-gather-daemonset-tppdn" Jul 13 03:42:54.564314 ip-10-0-134-52 kubenswrapper[2558]: I0713 03:42:54.564280 2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/fc01aafb-6dd7-426a-989d-5760a81ffff3-podres\") pod \"perf-node-gather-daemonset-tppdn\" (UID: \"fc01aafb-6dd7-426a-989d-5760a81ffff3\") " pod="openshift-must-gather-xjlbl/perf-node-gather-daemonset-tppdn" Jul 13 03:42:54.564314 ip-10-0-134-52 kubenswrapper[2558]: I0713 03:42:54.564287 2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/fc01aafb-6dd7-426a-989d-5760a81ffff3-sys\") pod \"perf-node-gather-daemonset-tppdn\" (UID: \"fc01aafb-6dd7-426a-989d-5760a81ffff3\") " pod="openshift-must-gather-xjlbl/perf-node-gather-daemonset-tppdn" Jul 13 03:42:54.572868 ip-10-0-134-52 kubenswrapper[2558]: I0713 03:42:54.572842 2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-mbpz8\" (UniqueName: \"kubernetes.io/projected/fc01aafb-6dd7-426a-989d-5760a81ffff3-kube-api-access-mbpz8\") pod \"perf-node-gather-daemonset-tppdn\" (UID: \"fc01aafb-6dd7-426a-989d-5760a81ffff3\") " pod="openshift-must-gather-xjlbl/perf-node-gather-daemonset-tppdn" Jul 13 03:42:54.691957 ip-10-0-134-52 kubenswrapper[2558]: I0713 03:42:54.691871 2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-xjlbl/perf-node-gather-daemonset-tppdn" Jul 13 03:42:54.880998 ip-10-0-134-52 kubenswrapper[2558]: I0713 03:42:54.880781 2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-xjlbl/perf-node-gather-daemonset-tppdn"] Jul 13 03:42:55.108968 ip-10-0-134-52 kubenswrapper[2558]: I0713 03:42:55.108940 2558 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console_console-5bbc889ccd-k7sfh_f3527e90-e5fa-4bc8-b215-57dcde6593d3/console/0.log" Jul 13 03:42:55.301769 ip-10-0-134-52 kubenswrapper[2558]: I0713 03:42:55.301733 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-xjlbl/perf-node-gather-daemonset-tppdn" event={"ID":"fc01aafb-6dd7-426a-989d-5760a81ffff3","Type":"ContainerStarted","Data":"e0e70e25806b7850c2956bcc30ce8501dc2efd99d7937d6e0f49e46de4f9d4ef"} Jul 13 03:42:55.301964 ip-10-0-134-52 kubenswrapper[2558]: I0713 03:42:55.301800 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-xjlbl/perf-node-gather-daemonset-tppdn" event={"ID":"fc01aafb-6dd7-426a-989d-5760a81ffff3","Type":"ContainerStarted","Data":"d306f064c5fb7ef1f864a6c15a321e0b7dd866fb5e8e96abccbb798f88f26b38"} Jul 13 03:42:55.301964 ip-10-0-134-52 kubenswrapper[2558]: I0713 03:42:55.301936 2558 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-must-gather-xjlbl/perf-node-gather-daemonset-tppdn" Jul 13 03:42:55.316506 ip-10-0-134-52 kubenswrapper[2558]: I0713 03:42:55.316451 2558 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-must-gather-xjlbl/perf-node-gather-daemonset-tppdn" podStartSLOduration=1.316432304 podStartE2EDuration="1.316432304s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-13 03:42:54 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-13 03:42:55.315940234 +0000 UTC m=+2757.716540701" watchObservedRunningTime="2026-07-13 03:42:55.316432304 +0000 UTC m=+2757.717032772" Jul 13 03:42:55.711072 ip-10-0-134-52 kubenswrapper[2558]: I0713 03:42:55.711003 2558 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-cluster-storage-operator_volume-data-source-validator-78495597f6-kx2qx_8f4f3c7f-bfbd-4059-92bf-ea8272bb31b5/volume-data-source-validator/0.log" Jul 13 03:42:56.723203 ip-10-0-134-52 kubenswrapper[2558]: I0713 03:42:56.723159 2558 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_dns-default-qkxhh_82341e74-e954-41d9-aac3-4e537551717a/dns/0.log" Jul 13 03:42:56.740686 ip-10-0-134-52 kubenswrapper[2558]: I0713 03:42:56.740650 2558 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_dns-default-qkxhh_82341e74-e954-41d9-aac3-4e537551717a/kube-rbac-proxy/0.log" Jul 13 03:42:56.783278 ip-10-0-134-52 kubenswrapper[2558]: I0713 03:42:56.783240 2558 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_node-resolver-ndddr_84e7b9a8-6c63-4aeb-8249-5aae103cf5cc/dns-node-resolver/0.log" Jul 13 03:42:57.355805 ip-10-0-134-52 kubenswrapper[2558]: I0713 03:42:57.355771 2558 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_node-ca-wpn4b_e4bb1d1b-35fa-47b2-af3d-ec01bff3f7c0/node-ca/0.log" Jul 13 03:42:58.233767 ip-10-0-134-52 kubenswrapper[2558]: I0713 03:42:58.233733 2558 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_data-science-gateway-data-science-gateway-class-6576859cf42dw75_9f9b901e-71ee-4c58-81c0-f48dbb910356/istio-proxy/0.log" Jul 13 03:42:58.373567 ip-10-0-134-52 kubenswrapper[2558]: I0713 03:42:58.373533 2558 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_maas-default-gateway-openshift-default-56654dcf7-pdpz9_25ab9eef-bfef-4f8b-a0a5-5fd5abe2f44e/istio-proxy/0.log" Jul 13 03:42:58.437580 ip-10-0-134-52 kubenswrapper[2558]: I0713 03:42:58.437529 2558 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_maas-default-gateway-openshift-default-56654dcf7-pdpz9_25ab9eef-bfef-4f8b-a0a5-5fd5abe2f44e/istio-proxy/1.log" Jul 13 03:42:58.514453 ip-10-0-134-52 kubenswrapper[2558]: I0713 03:42:58.514382 2558 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_router-default-7d87747c94-bc7qr_53d1746c-0708-4c16-ace0-20912ab1c2d3/router/0.log" Jul 13 03:42:59.164947 ip-10-0-134-52 kubenswrapper[2558]: I0713 03:42:59.164916 2558 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress-canary_ingress-canary-f8947_141bb0e2-17a1-4cd4-8d11-ed7120c2dd6b/serve-healthcheck-canary/0.log" Jul 13 03:42:59.736278 ip-10-0-134-52 kubenswrapper[2558]: I0713 03:42:59.736247 2558 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-stn4f_2b9a19e5-02f8-40b5-aa0c-eb48dfc39020/kube-rbac-proxy/0.log" Jul 13 03:42:59.752768 ip-10-0-134-52 kubenswrapper[2558]: I0713 03:42:59.752746 2558 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-stn4f_2b9a19e5-02f8-40b5-aa0c-eb48dfc39020/exporter/0.log" Jul 13 03:42:59.771836 ip-10-0-134-52 kubenswrapper[2558]: I0713 03:42:59.771800 2558 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-stn4f_2b9a19e5-02f8-40b5-aa0c-eb48dfc39020/extractor/0.log" Jul 13 03:43:01.324537 ip-10-0-134-52 kubenswrapper[2558]: I0713 03:43:01.324503 2558 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-must-gather-xjlbl/perf-node-gather-daemonset-tppdn" Jul 13 03:43:01.966754 ip-10-0-134-52 kubenswrapper[2558]: I0713 03:43:01.966731 2558 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_model-serving-api-54d89bd5fc-bvrs4_cbfbffcd-8456-47cd-908e-7c8e9cec2304/server/0.log" Jul 13 03:43:02.161439 ip-10-0-134-52 kubenswrapper[2558]: I0713 03:43:02.161409 2558 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-7dcb9ff95f-jsjt6_c8a067a6-8c09-470c-87f7-49ac6d22c34e/manager/0.log" Jul 13 03:43:02.178081 ip-10-0-134-52 kubenswrapper[2558]: I0713 03:43:02.178054 2558 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-7dcb9ff95f-jsjt6_c8a067a6-8c09-470c-87f7-49ac6d22c34e/copy-manifests/0.log" Jul 13 03:43:03.437654 ip-10-0-134-52 kubenswrapper[2558]: I0713 03:43:03.437615 2558 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-lws-operator_lws-controller-manager-f4bfdbc5d-xbjpm_8f4f8061-35fc-41d0-9fe7-2766f1ea1ec1/manager/0.log" Jul 13 03:43:04.928582 ip-10-0-134-52 kubenswrapper[2558]: I0713 03:43:04.928503 2558 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_data-science-gateway-data-science-gateway-class-6576859cf42dw75_9f9b901e-71ee-4c58-81c0-f48dbb910356/istio-proxy/0.log" Jul 13 03:43:05.035353 ip-10-0-134-52 kubenswrapper[2558]: I0713 03:43:05.035248 2558 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_maas-default-gateway-openshift-default-56654dcf7-pdpz9_25ab9eef-bfef-4f8b-a0a5-5fd5abe2f44e/istio-proxy/0.log" Jul 13 03:43:05.095049 ip-10-0-134-52 kubenswrapper[2558]: I0713 03:43:05.095019 2558 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_maas-default-gateway-openshift-default-56654dcf7-pdpz9_25ab9eef-bfef-4f8b-a0a5-5fd5abe2f44e/istio-proxy/1.log" Jul 13 03:43:05.143184 ip-10-0-134-52 kubenswrapper[2558]: I0713 03:43:05.143152 2558 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_router-default-7d87747c94-bc7qr_53d1746c-0708-4c16-ace0-20912ab1c2d3/router/0.log" Jul 13 03:43:06.263133 ip-10-0-134-52 kubenswrapper[2558]: I0713 03:43:06.263097 2558 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_data-science-gateway-data-science-gateway-class-6576859cf42dw75_9f9b901e-71ee-4c58-81c0-f48dbb910356/istio-proxy/0.log" Jul 13 03:43:06.380575 ip-10-0-134-52 kubenswrapper[2558]: I0713 03:43:06.380460 2558 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_maas-default-gateway-openshift-default-56654dcf7-pdpz9_25ab9eef-bfef-4f8b-a0a5-5fd5abe2f44e/istio-proxy/0.log" Jul 13 03:43:06.435074 ip-10-0-134-52 kubenswrapper[2558]: I0713 03:43:06.434992 2558 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_maas-default-gateway-openshift-default-56654dcf7-pdpz9_25ab9eef-bfef-4f8b-a0a5-5fd5abe2f44e/istio-proxy/1.log" Jul 13 03:43:06.505678 ip-10-0-134-52 kubenswrapper[2558]: I0713 03:43:06.505651 2558 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_router-default-7d87747c94-bc7qr_53d1746c-0708-4c16-ace0-20912ab1c2d3/router/0.log" Jul 13 03:43:10.129156 ip-10-0-134-52 kubenswrapper[2558]: I0713 03:43:10.129118 2558 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-scthx_16e70418-d340-4604-b23d-6e6bd736b72f/kube-multus-additional-cni-plugins/0.log" Jul 13 03:43:10.146575 ip-10-0-134-52 kubenswrapper[2558]: I0713 03:43:10.146546 2558 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-scthx_16e70418-d340-4604-b23d-6e6bd736b72f/egress-router-binary-copy/0.log" Jul 13 03:43:10.165192 ip-10-0-134-52 kubenswrapper[2558]: I0713 03:43:10.165169 2558 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-scthx_16e70418-d340-4604-b23d-6e6bd736b72f/cni-plugins/0.log" Jul 13 03:43:10.186225 ip-10-0-134-52 kubenswrapper[2558]: I0713 03:43:10.186205 2558 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-scthx_16e70418-d340-4604-b23d-6e6bd736b72f/bond-cni-plugin/0.log" Jul 13 03:43:10.206489 ip-10-0-134-52 kubenswrapper[2558]: I0713 03:43:10.206464 2558 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-scthx_16e70418-d340-4604-b23d-6e6bd736b72f/routeoverride-cni/0.log" Jul 13 03:43:10.224490 ip-10-0-134-52 kubenswrapper[2558]: I0713 03:43:10.224471 2558 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-scthx_16e70418-d340-4604-b23d-6e6bd736b72f/whereabouts-cni-bincopy/0.log" Jul 13 03:43:10.242272 ip-10-0-134-52 kubenswrapper[2558]: I0713 03:43:10.242249 2558 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-scthx_16e70418-d340-4604-b23d-6e6bd736b72f/whereabouts-cni/0.log" Jul 13 03:43:10.281386 ip-10-0-134-52 kubenswrapper[2558]: I0713 03:43:10.281367 2558 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-dvqmz_e81648db-3aac-4493-99c2-af21b4fcf2b5/kube-multus/0.log" Jul 13 03:43:10.348056 ip-10-0-134-52 kubenswrapper[2558]: I0713 03:43:10.348034 2558 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_network-metrics-daemon-jt47w_72ebddc5-a4ff-4e56-a65d-508775d02170/network-metrics-daemon/0.log" Jul 13 03:43:10.362492 ip-10-0-134-52 kubenswrapper[2558]: I0713 03:43:10.362469 2558 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_network-metrics-daemon-jt47w_72ebddc5-a4ff-4e56-a65d-508775d02170/kube-rbac-proxy/0.log" Jul 13 03:43:11.200683 ip-10-0-134-52 kubenswrapper[2558]: I0713 03:43:11.200653 2558 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-7m9bp_d7c10797-d1f7-4e82-bd2b-f81f851f1407/ovn-controller/0.log" Jul 13 03:43:11.213932 ip-10-0-134-52 kubenswrapper[2558]: I0713 03:43:11.213895 2558 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-7m9bp_d7c10797-d1f7-4e82-bd2b-f81f851f1407/ovn-acl-logging/0.log" Jul 13 03:43:11.241066 ip-10-0-134-52 kubenswrapper[2558]: I0713 03:43:11.241042 2558 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-7m9bp_d7c10797-d1f7-4e82-bd2b-f81f851f1407/kube-rbac-proxy-node/0.log" Jul 13 03:43:11.263123 ip-10-0-134-52 kubenswrapper[2558]: I0713 03:43:11.263071 2558 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-7m9bp_d7c10797-d1f7-4e82-bd2b-f81f851f1407/kube-rbac-proxy-ovn-metrics/0.log" Jul 13 03:43:11.278285 ip-10-0-134-52 kubenswrapper[2558]: I0713 03:43:11.278248 2558 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-7m9bp_d7c10797-d1f7-4e82-bd2b-f81f851f1407/northd/0.log" Jul 13 03:43:11.295853 ip-10-0-134-52 kubenswrapper[2558]: I0713 03:43:11.295829 2558 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-7m9bp_d7c10797-d1f7-4e82-bd2b-f81f851f1407/nbdb/0.log" Jul 13 03:43:11.313490 ip-10-0-134-52 kubenswrapper[2558]: I0713 03:43:11.313467 2558 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-7m9bp_d7c10797-d1f7-4e82-bd2b-f81f851f1407/sbdb/0.log" Jul 13 03:43:11.385700 ip-10-0-134-52 kubenswrapper[2558]: I0713 03:43:11.385643 2558 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-7m9bp_d7c10797-d1f7-4e82-bd2b-f81f851f1407/ovnkube-controller/0.log"