May 21 12:59:57.806238 ip-10-0-133-64 systemd[1]: kubelet.service: Failed to load environment files: No such file or directory May 21 12:59:57.806251 ip-10-0-133-64 systemd[1]: kubelet.service: Failed to run 'start-pre' task: No such file or directory May 21 12:59:57.806258 ip-10-0-133-64 systemd[1]: kubelet.service: Failed with result 'resources'. May 21 12:59:57.806470 ip-10-0-133-64 systemd[1]: Failed to start Kubernetes Kubelet. May 21 13:00:08.028271 ip-10-0-133-64 systemd[1]: kubelet.service: Failed to schedule restart job: Unit crio.service not found. May 21 13:00:08.028286 ip-10-0-133-64 systemd[1]: kubelet.service: Failed with result 'resources'. -- Boot f44211a7f71d42ceb0503f4ce598ed48 -- May 21 13:02:33.326085 ip-10-0-133-64 systemd[1]: Starting Kubernetes Kubelet... May 21 13:02:33.785447 ip-10-0-133-64 kubenswrapper[2562]: Flag --container-runtime-endpoint has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information. May 21 13:02:33.785447 ip-10-0-133-64 kubenswrapper[2562]: Flag --minimum-container-ttl-duration has been deprecated, Use --eviction-hard or --eviction-soft instead. Will be removed in a future version. May 21 13:02:33.785447 ip-10-0-133-64 kubenswrapper[2562]: Flag --volume-plugin-dir has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information. May 21 13:02:33.785447 ip-10-0-133-64 kubenswrapper[2562]: Flag --pod-infra-container-image has been deprecated, will be removed in 1.35. Image garbage collector will get sandbox image information from CRI. May 21 13:02:33.785447 ip-10-0-133-64 kubenswrapper[2562]: Flag --system-reserved has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information. May 21 13:02:33.786542 ip-10-0-133-64 kubenswrapper[2562]: I0521 13:02:33.786262 2562 server.go:212] "--pod-infra-container-image will not be pruned by the image garbage collector in kubelet and should also be set in the remote runtime" May 21 13:02:33.792235 ip-10-0-133-64 kubenswrapper[2562]: W0521 13:02:33.792209 2562 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration May 21 13:02:33.792235 ip-10-0-133-64 kubenswrapper[2562]: W0521 13:02:33.792228 2562 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure May 21 13:02:33.792235 ip-10-0-133-64 kubenswrapper[2562]: W0521 13:02:33.792232 2562 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig May 21 13:02:33.792235 ip-10-0-133-64 kubenswrapper[2562]: W0521 13:02:33.792236 2562 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses May 21 13:02:33.792235 ip-10-0-133-64 kubenswrapper[2562]: W0521 13:02:33.792239 2562 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal May 21 13:02:33.792235 ip-10-0-133-64 kubenswrapper[2562]: W0521 13:02:33.792242 2562 feature_gate.go:328] unrecognized feature gate: PinnedImages May 21 13:02:33.792553 ip-10-0-133-64 kubenswrapper[2562]: W0521 13:02:33.792246 2562 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController May 21 13:02:33.792553 ip-10-0-133-64 kubenswrapper[2562]: W0521 13:02:33.792250 2562 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting May 21 13:02:33.792553 ip-10-0-133-64 kubenswrapper[2562]: W0521 13:02:33.792252 2562 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot May 21 13:02:33.792553 ip-10-0-133-64 kubenswrapper[2562]: W0521 13:02:33.792255 2562 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall May 21 13:02:33.792553 ip-10-0-133-64 kubenswrapper[2562]: W0521 13:02:33.792257 2562 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup May 21 13:02:33.792553 ip-10-0-133-64 kubenswrapper[2562]: W0521 13:02:33.792260 2562 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration May 21 13:02:33.792553 ip-10-0-133-64 kubenswrapper[2562]: W0521 13:02:33.792263 2562 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings May 21 13:02:33.792553 ip-10-0-133-64 kubenswrapper[2562]: W0521 13:02:33.792265 2562 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix May 21 13:02:33.792553 ip-10-0-133-64 kubenswrapper[2562]: W0521 13:02:33.792268 2562 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall May 21 13:02:33.792553 ip-10-0-133-64 kubenswrapper[2562]: W0521 13:02:33.792270 2562 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv May 21 13:02:33.792553 ip-10-0-133-64 kubenswrapper[2562]: W0521 13:02:33.792273 2562 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata May 21 13:02:33.792553 ip-10-0-133-64 kubenswrapper[2562]: W0521 13:02:33.792275 2562 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission May 21 13:02:33.792553 ip-10-0-133-64 kubenswrapper[2562]: W0521 13:02:33.792278 2562 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS May 21 13:02:33.792553 ip-10-0-133-64 kubenswrapper[2562]: W0521 13:02:33.792280 2562 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration May 21 13:02:33.792553 ip-10-0-133-64 kubenswrapper[2562]: W0521 13:02:33.792283 2562 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity May 21 13:02:33.792553 ip-10-0-133-64 kubenswrapper[2562]: W0521 13:02:33.792285 2562 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure May 21 13:02:33.792553 ip-10-0-133-64 kubenswrapper[2562]: W0521 13:02:33.792288 2562 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy May 21 13:02:33.792553 ip-10-0-133-64 kubenswrapper[2562]: W0521 13:02:33.792290 2562 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles May 21 13:02:33.792553 ip-10-0-133-64 kubenswrapper[2562]: W0521 13:02:33.792292 2562 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterOperations May 21 13:02:33.793025 ip-10-0-133-64 kubenswrapper[2562]: W0521 13:02:33.792304 2562 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation May 21 13:02:33.793025 ip-10-0-133-64 kubenswrapper[2562]: W0521 13:02:33.792307 2562 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager May 21 13:02:33.793025 ip-10-0-133-64 kubenswrapper[2562]: W0521 13:02:33.792309 2562 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider May 21 13:02:33.793025 ip-10-0-133-64 kubenswrapper[2562]: W0521 13:02:33.792313 2562 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. May 21 13:02:33.793025 ip-10-0-133-64 kubenswrapper[2562]: W0521 13:02:33.792318 2562 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts May 21 13:02:33.793025 ip-10-0-133-64 kubenswrapper[2562]: W0521 13:02:33.792321 2562 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud May 21 13:02:33.793025 ip-10-0-133-64 kubenswrapper[2562]: W0521 13:02:33.792324 2562 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA May 21 13:02:33.793025 ip-10-0-133-64 kubenswrapper[2562]: W0521 13:02:33.792327 2562 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks May 21 13:02:33.793025 ip-10-0-133-64 kubenswrapper[2562]: W0521 13:02:33.792329 2562 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig May 21 13:02:33.793025 ip-10-0-133-64 kubenswrapper[2562]: W0521 13:02:33.792332 2562 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets May 21 13:02:33.793025 ip-10-0-133-64 kubenswrapper[2562]: W0521 13:02:33.792335 2562 feature_gate.go:328] unrecognized feature gate: NewOLM May 21 13:02:33.793025 ip-10-0-133-64 kubenswrapper[2562]: W0521 13:02:33.792337 2562 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather May 21 13:02:33.793025 ip-10-0-133-64 kubenswrapper[2562]: W0521 13:02:33.792340 2562 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas May 21 13:02:33.793025 ip-10-0-133-64 kubenswrapper[2562]: W0521 13:02:33.792342 2562 feature_gate.go:328] unrecognized feature gate: IngressControllerLBSubnetsAWS May 21 13:02:33.793025 ip-10-0-133-64 kubenswrapper[2562]: W0521 13:02:33.792346 2562 feature_gate.go:328] unrecognized feature gate: SignatureStores May 21 13:02:33.793025 ip-10-0-133-64 kubenswrapper[2562]: W0521 13:02:33.792349 2562 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall May 21 13:02:33.793025 ip-10-0-133-64 kubenswrapper[2562]: W0521 13:02:33.792352 2562 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode May 21 13:02:33.793025 ip-10-0-133-64 kubenswrapper[2562]: W0521 13:02:33.792354 2562 feature_gate.go:328] unrecognized feature gate: SetEIPForNLBIngressController May 21 13:02:33.793025 ip-10-0-133-64 kubenswrapper[2562]: W0521 13:02:33.792358 2562 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement May 21 13:02:33.793492 ip-10-0-133-64 kubenswrapper[2562]: W0521 13:02:33.792360 2562 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk May 21 13:02:33.793492 ip-10-0-133-64 kubenswrapper[2562]: W0521 13:02:33.792363 2562 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes May 21 13:02:33.793492 ip-10-0-133-64 kubenswrapper[2562]: W0521 13:02:33.792365 2562 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall May 21 13:02:33.793492 ip-10-0-133-64 kubenswrapper[2562]: W0521 13:02:33.792368 2562 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities May 21 13:02:33.793492 ip-10-0-133-64 kubenswrapper[2562]: W0521 13:02:33.792371 2562 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement May 21 13:02:33.793492 ip-10-0-133-64 kubenswrapper[2562]: W0521 13:02:33.792373 2562 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI May 21 13:02:33.793492 ip-10-0-133-64 kubenswrapper[2562]: W0521 13:02:33.792376 2562 feature_gate.go:328] unrecognized feature gate: GatewayAPIController May 21 13:02:33.793492 ip-10-0-133-64 kubenswrapper[2562]: W0521 13:02:33.792378 2562 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks May 21 13:02:33.793492 ip-10-0-133-64 kubenswrapper[2562]: W0521 13:02:33.792381 2562 feature_gate.go:328] unrecognized feature gate: OVNObservability May 21 13:02:33.793492 ip-10-0-133-64 kubenswrapper[2562]: W0521 13:02:33.792384 2562 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud May 21 13:02:33.793492 ip-10-0-133-64 kubenswrapper[2562]: W0521 13:02:33.792387 2562 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup May 21 13:02:33.793492 ip-10-0-133-64 kubenswrapper[2562]: W0521 13:02:33.792389 2562 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes May 21 13:02:33.793492 ip-10-0-133-64 kubenswrapper[2562]: W0521 13:02:33.792392 2562 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification May 21 13:02:33.793492 ip-10-0-133-64 kubenswrapper[2562]: W0521 13:02:33.792396 2562 feature_gate.go:328] unrecognized feature gate: UpgradeStatus May 21 13:02:33.793492 ip-10-0-133-64 kubenswrapper[2562]: W0521 13:02:33.792400 2562 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS May 21 13:02:33.793492 ip-10-0-133-64 kubenswrapper[2562]: W0521 13:02:33.792405 2562 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode May 21 13:02:33.793492 ip-10-0-133-64 kubenswrapper[2562]: W0521 13:02:33.792407 2562 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints May 21 13:02:33.793492 ip-10-0-133-64 kubenswrapper[2562]: W0521 13:02:33.792410 2562 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS May 21 13:02:33.793492 ip-10-0-133-64 kubenswrapper[2562]: W0521 13:02:33.792412 2562 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall May 21 13:02:33.793492 ip-10-0-133-64 kubenswrapper[2562]: W0521 13:02:33.792415 2562 feature_gate.go:328] unrecognized feature gate: ExternalOIDC May 21 13:02:33.793994 ip-10-0-133-64 kubenswrapper[2562]: W0521 13:02:33.792418 2562 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere May 21 13:02:33.793994 ip-10-0-133-64 kubenswrapper[2562]: W0521 13:02:33.792420 2562 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation May 21 13:02:33.793994 ip-10-0-133-64 kubenswrapper[2562]: W0521 13:02:33.792423 2562 feature_gate.go:328] unrecognized feature gate: InsightsConfigAPI May 21 13:02:33.793994 ip-10-0-133-64 kubenswrapper[2562]: W0521 13:02:33.792427 2562 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. May 21 13:02:33.793994 ip-10-0-133-64 kubenswrapper[2562]: W0521 13:02:33.792432 2562 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements May 21 13:02:33.793994 ip-10-0-133-64 kubenswrapper[2562]: W0521 13:02:33.792435 2562 feature_gate.go:328] unrecognized feature gate: Example2 May 21 13:02:33.793994 ip-10-0-133-64 kubenswrapper[2562]: W0521 13:02:33.792438 2562 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota May 21 13:02:33.793994 ip-10-0-133-64 kubenswrapper[2562]: W0521 13:02:33.792441 2562 feature_gate.go:328] unrecognized feature gate: Example May 21 13:02:33.793994 ip-10-0-133-64 kubenswrapper[2562]: W0521 13:02:33.792444 2562 feature_gate.go:328] unrecognized feature gate: ShortCertRotation May 21 13:02:33.793994 ip-10-0-133-64 kubenswrapper[2562]: W0521 13:02:33.792447 2562 feature_gate.go:328] unrecognized feature gate: ManagedBootImages May 21 13:02:33.793994 ip-10-0-133-64 kubenswrapper[2562]: W0521 13:02:33.792451 2562 feature_gate.go:328] unrecognized feature gate: DualReplica May 21 13:02:33.793994 ip-10-0-133-64 kubenswrapper[2562]: W0521 13:02:33.792454 2562 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace May 21 13:02:33.793994 ip-10-0-133-64 kubenswrapper[2562]: W0521 13:02:33.792456 2562 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig May 21 13:02:33.793994 ip-10-0-133-64 kubenswrapper[2562]: W0521 13:02:33.792459 2562 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk May 21 13:02:33.793994 ip-10-0-133-64 kubenswrapper[2562]: W0521 13:02:33.792464 2562 feature_gate.go:328] unrecognized feature gate: DNSNameResolver May 21 13:02:33.793994 ip-10-0-133-64 kubenswrapper[2562]: W0521 13:02:33.792467 2562 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts May 21 13:02:33.793994 ip-10-0-133-64 kubenswrapper[2562]: W0521 13:02:33.792470 2562 feature_gate.go:328] unrecognized feature gate: GatewayAPI May 21 13:02:33.793994 ip-10-0-133-64 kubenswrapper[2562]: W0521 13:02:33.792472 2562 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup May 21 13:02:33.793994 ip-10-0-133-64 kubenswrapper[2562]: W0521 13:02:33.792475 2562 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform May 21 13:02:33.793994 ip-10-0-133-64 kubenswrapper[2562]: W0521 13:02:33.792478 2562 feature_gate.go:328] unrecognized feature gate: InsightsConfig May 21 13:02:33.794474 ip-10-0-133-64 kubenswrapper[2562]: W0521 13:02:33.792480 2562 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy May 21 13:02:33.794474 ip-10-0-133-64 kubenswrapper[2562]: W0521 13:02:33.792483 2562 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter May 21 13:02:33.794474 ip-10-0-133-64 kubenswrapper[2562]: W0521 13:02:33.792878 2562 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints May 21 13:02:33.794474 ip-10-0-133-64 kubenswrapper[2562]: W0521 13:02:33.792884 2562 feature_gate.go:328] unrecognized feature gate: DNSNameResolver May 21 13:02:33.794474 ip-10-0-133-64 kubenswrapper[2562]: W0521 13:02:33.792887 2562 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings May 21 13:02:33.794474 ip-10-0-133-64 kubenswrapper[2562]: W0521 13:02:33.792890 2562 feature_gate.go:328] unrecognized feature gate: DualReplica May 21 13:02:33.794474 ip-10-0-133-64 kubenswrapper[2562]: W0521 13:02:33.792892 2562 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification May 21 13:02:33.794474 ip-10-0-133-64 kubenswrapper[2562]: W0521 13:02:33.792895 2562 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity May 21 13:02:33.794474 ip-10-0-133-64 kubenswrapper[2562]: W0521 13:02:33.792898 2562 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot May 21 13:02:33.794474 ip-10-0-133-64 kubenswrapper[2562]: W0521 13:02:33.792900 2562 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation May 21 13:02:33.794474 ip-10-0-133-64 kubenswrapper[2562]: W0521 13:02:33.792919 2562 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata May 21 13:02:33.794474 ip-10-0-133-64 kubenswrapper[2562]: W0521 13:02:33.792923 2562 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig May 21 13:02:33.794474 ip-10-0-133-64 kubenswrapper[2562]: W0521 13:02:33.792926 2562 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud May 21 13:02:33.794474 ip-10-0-133-64 kubenswrapper[2562]: W0521 13:02:33.792929 2562 feature_gate.go:328] unrecognized feature gate: SetEIPForNLBIngressController May 21 13:02:33.794474 ip-10-0-133-64 kubenswrapper[2562]: W0521 13:02:33.792931 2562 feature_gate.go:328] unrecognized feature gate: UpgradeStatus May 21 13:02:33.794474 ip-10-0-133-64 kubenswrapper[2562]: W0521 13:02:33.792934 2562 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform May 21 13:02:33.794474 ip-10-0-133-64 kubenswrapper[2562]: W0521 13:02:33.792937 2562 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy May 21 13:02:33.794474 ip-10-0-133-64 kubenswrapper[2562]: W0521 13:02:33.792941 2562 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. May 21 13:02:33.794474 ip-10-0-133-64 kubenswrapper[2562]: W0521 13:02:33.792945 2562 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting May 21 13:02:33.794474 ip-10-0-133-64 kubenswrapper[2562]: W0521 13:02:33.792949 2562 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv May 21 13:02:33.794980 ip-10-0-133-64 kubenswrapper[2562]: W0521 13:02:33.792952 2562 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement May 21 13:02:33.794980 ip-10-0-133-64 kubenswrapper[2562]: W0521 13:02:33.792955 2562 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission May 21 13:02:33.794980 ip-10-0-133-64 kubenswrapper[2562]: W0521 13:02:33.792957 2562 feature_gate.go:328] unrecognized feature gate: Example2 May 21 13:02:33.794980 ip-10-0-133-64 kubenswrapper[2562]: W0521 13:02:33.792960 2562 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup May 21 13:02:33.794980 ip-10-0-133-64 kubenswrapper[2562]: W0521 13:02:33.792963 2562 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration May 21 13:02:33.794980 ip-10-0-133-64 kubenswrapper[2562]: W0521 13:02:33.792966 2562 feature_gate.go:328] unrecognized feature gate: OVNObservability May 21 13:02:33.794980 ip-10-0-133-64 kubenswrapper[2562]: W0521 13:02:33.792969 2562 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS May 21 13:02:33.794980 ip-10-0-133-64 kubenswrapper[2562]: W0521 13:02:33.792972 2562 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement May 21 13:02:33.794980 ip-10-0-133-64 kubenswrapper[2562]: W0521 13:02:33.792975 2562 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather May 21 13:02:33.794980 ip-10-0-133-64 kubenswrapper[2562]: W0521 13:02:33.792977 2562 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure May 21 13:02:33.794980 ip-10-0-133-64 kubenswrapper[2562]: W0521 13:02:33.792980 2562 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure May 21 13:02:33.794980 ip-10-0-133-64 kubenswrapper[2562]: W0521 13:02:33.792982 2562 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode May 21 13:02:33.794980 ip-10-0-133-64 kubenswrapper[2562]: W0521 13:02:33.792985 2562 feature_gate.go:328] unrecognized feature gate: Example May 21 13:02:33.794980 ip-10-0-133-64 kubenswrapper[2562]: W0521 13:02:33.792988 2562 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS May 21 13:02:33.794980 ip-10-0-133-64 kubenswrapper[2562]: W0521 13:02:33.792990 2562 feature_gate.go:328] unrecognized feature gate: ShortCertRotation May 21 13:02:33.794980 ip-10-0-133-64 kubenswrapper[2562]: W0521 13:02:33.792992 2562 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation May 21 13:02:33.794980 ip-10-0-133-64 kubenswrapper[2562]: W0521 13:02:33.792995 2562 feature_gate.go:328] unrecognized feature gate: ManagedBootImages May 21 13:02:33.794980 ip-10-0-133-64 kubenswrapper[2562]: W0521 13:02:33.792997 2562 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController May 21 13:02:33.794980 ip-10-0-133-64 kubenswrapper[2562]: W0521 13:02:33.793000 2562 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes May 21 13:02:33.794980 ip-10-0-133-64 kubenswrapper[2562]: W0521 13:02:33.793002 2562 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere May 21 13:02:33.795467 ip-10-0-133-64 kubenswrapper[2562]: W0521 13:02:33.793005 2562 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts May 21 13:02:33.795467 ip-10-0-133-64 kubenswrapper[2562]: W0521 13:02:33.793008 2562 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy May 21 13:02:33.795467 ip-10-0-133-64 kubenswrapper[2562]: W0521 13:02:33.793011 2562 feature_gate.go:328] unrecognized feature gate: InsightsConfig May 21 13:02:33.795467 ip-10-0-133-64 kubenswrapper[2562]: W0521 13:02:33.793014 2562 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts May 21 13:02:33.795467 ip-10-0-133-64 kubenswrapper[2562]: W0521 13:02:33.793016 2562 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets May 21 13:02:33.795467 ip-10-0-133-64 kubenswrapper[2562]: W0521 13:02:33.793018 2562 feature_gate.go:328] unrecognized feature gate: PinnedImages May 21 13:02:33.795467 ip-10-0-133-64 kubenswrapper[2562]: W0521 13:02:33.793021 2562 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements May 21 13:02:33.795467 ip-10-0-133-64 kubenswrapper[2562]: W0521 13:02:33.793023 2562 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles May 21 13:02:33.795467 ip-10-0-133-64 kubenswrapper[2562]: W0521 13:02:33.793026 2562 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes May 21 13:02:33.795467 ip-10-0-133-64 kubenswrapper[2562]: W0521 13:02:33.793029 2562 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode May 21 13:02:33.795467 ip-10-0-133-64 kubenswrapper[2562]: W0521 13:02:33.793031 2562 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall May 21 13:02:33.795467 ip-10-0-133-64 kubenswrapper[2562]: W0521 13:02:33.793035 2562 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider May 21 13:02:33.795467 ip-10-0-133-64 kubenswrapper[2562]: W0521 13:02:33.793038 2562 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup May 21 13:02:33.795467 ip-10-0-133-64 kubenswrapper[2562]: W0521 13:02:33.793041 2562 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall May 21 13:02:33.795467 ip-10-0-133-64 kubenswrapper[2562]: W0521 13:02:33.793044 2562 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud May 21 13:02:33.795467 ip-10-0-133-64 kubenswrapper[2562]: W0521 13:02:33.793047 2562 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration May 21 13:02:33.795467 ip-10-0-133-64 kubenswrapper[2562]: W0521 13:02:33.793049 2562 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA May 21 13:02:33.795467 ip-10-0-133-64 kubenswrapper[2562]: W0521 13:02:33.793051 2562 feature_gate.go:328] unrecognized feature gate: IngressControllerLBSubnetsAWS May 21 13:02:33.795467 ip-10-0-133-64 kubenswrapper[2562]: W0521 13:02:33.793054 2562 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal May 21 13:02:33.795467 ip-10-0-133-64 kubenswrapper[2562]: W0521 13:02:33.793057 2562 feature_gate.go:328] unrecognized feature gate: SignatureStores May 21 13:02:33.795967 ip-10-0-133-64 kubenswrapper[2562]: W0521 13:02:33.793060 2562 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup May 21 13:02:33.795967 ip-10-0-133-64 kubenswrapper[2562]: W0521 13:02:33.793062 2562 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk May 21 13:02:33.795967 ip-10-0-133-64 kubenswrapper[2562]: W0521 13:02:33.793065 2562 feature_gate.go:328] unrecognized feature gate: GatewayAPIController May 21 13:02:33.795967 ip-10-0-133-64 kubenswrapper[2562]: W0521 13:02:33.793067 2562 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig May 21 13:02:33.795967 ip-10-0-133-64 kubenswrapper[2562]: W0521 13:02:33.793070 2562 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities May 21 13:02:33.795967 ip-10-0-133-64 kubenswrapper[2562]: W0521 13:02:33.793074 2562 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. May 21 13:02:33.795967 ip-10-0-133-64 kubenswrapper[2562]: W0521 13:02:33.793077 2562 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk May 21 13:02:33.795967 ip-10-0-133-64 kubenswrapper[2562]: W0521 13:02:33.793080 2562 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter May 21 13:02:33.795967 ip-10-0-133-64 kubenswrapper[2562]: W0521 13:02:33.793083 2562 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks May 21 13:02:33.795967 ip-10-0-133-64 kubenswrapper[2562]: W0521 13:02:33.793085 2562 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall May 21 13:02:33.795967 ip-10-0-133-64 kubenswrapper[2562]: W0521 13:02:33.793088 2562 feature_gate.go:328] unrecognized feature gate: GatewayAPI May 21 13:02:33.795967 ip-10-0-133-64 kubenswrapper[2562]: W0521 13:02:33.793090 2562 feature_gate.go:328] unrecognized feature gate: InsightsConfigAPI May 21 13:02:33.795967 ip-10-0-133-64 kubenswrapper[2562]: W0521 13:02:33.793094 2562 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix May 21 13:02:33.795967 ip-10-0-133-64 kubenswrapper[2562]: W0521 13:02:33.793097 2562 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas May 21 13:02:33.795967 ip-10-0-133-64 kubenswrapper[2562]: W0521 13:02:33.793099 2562 feature_gate.go:328] unrecognized feature gate: ExternalOIDC May 21 13:02:33.795967 ip-10-0-133-64 kubenswrapper[2562]: W0521 13:02:33.793101 2562 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS May 21 13:02:33.795967 ip-10-0-133-64 kubenswrapper[2562]: W0521 13:02:33.793104 2562 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI May 21 13:02:33.795967 ip-10-0-133-64 kubenswrapper[2562]: W0521 13:02:33.793107 2562 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota May 21 13:02:33.795967 ip-10-0-133-64 kubenswrapper[2562]: W0521 13:02:33.793109 2562 feature_gate.go:328] unrecognized feature gate: NewOLM May 21 13:02:33.795967 ip-10-0-133-64 kubenswrapper[2562]: W0521 13:02:33.793112 2562 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace May 21 13:02:33.796474 ip-10-0-133-64 kubenswrapper[2562]: W0521 13:02:33.793115 2562 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig May 21 13:02:33.796474 ip-10-0-133-64 kubenswrapper[2562]: W0521 13:02:33.793117 2562 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses May 21 13:02:33.796474 ip-10-0-133-64 kubenswrapper[2562]: W0521 13:02:33.793120 2562 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterOperations May 21 13:02:33.796474 ip-10-0-133-64 kubenswrapper[2562]: W0521 13:02:33.793124 2562 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall May 21 13:02:33.796474 ip-10-0-133-64 kubenswrapper[2562]: W0521 13:02:33.793126 2562 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks May 21 13:02:33.796474 ip-10-0-133-64 kubenswrapper[2562]: W0521 13:02:33.793129 2562 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall May 21 13:02:33.796474 ip-10-0-133-64 kubenswrapper[2562]: W0521 13:02:33.793132 2562 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager May 21 13:02:33.796474 ip-10-0-133-64 kubenswrapper[2562]: W0521 13:02:33.793134 2562 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration May 21 13:02:33.796474 ip-10-0-133-64 kubenswrapper[2562]: I0521 13:02:33.793771 2562 flags.go:64] FLAG: --address="0.0.0.0" May 21 13:02:33.796474 ip-10-0-133-64 kubenswrapper[2562]: I0521 13:02:33.793780 2562 flags.go:64] FLAG: --allowed-unsafe-sysctls="[]" May 21 13:02:33.796474 ip-10-0-133-64 kubenswrapper[2562]: I0521 13:02:33.793787 2562 flags.go:64] FLAG: --anonymous-auth="true" May 21 13:02:33.796474 ip-10-0-133-64 kubenswrapper[2562]: I0521 13:02:33.793791 2562 flags.go:64] FLAG: --application-metrics-count-limit="100" May 21 13:02:33.796474 ip-10-0-133-64 kubenswrapper[2562]: I0521 13:02:33.793810 2562 flags.go:64] FLAG: --authentication-token-webhook="false" May 21 13:02:33.796474 ip-10-0-133-64 kubenswrapper[2562]: I0521 13:02:33.793814 2562 flags.go:64] FLAG: --authentication-token-webhook-cache-ttl="2m0s" May 21 13:02:33.796474 ip-10-0-133-64 kubenswrapper[2562]: I0521 13:02:33.793818 2562 flags.go:64] FLAG: --authorization-mode="AlwaysAllow" May 21 13:02:33.796474 ip-10-0-133-64 kubenswrapper[2562]: I0521 13:02:33.793825 2562 flags.go:64] FLAG: --authorization-webhook-cache-authorized-ttl="5m0s" May 21 13:02:33.796474 ip-10-0-133-64 kubenswrapper[2562]: I0521 13:02:33.793829 2562 flags.go:64] FLAG: --authorization-webhook-cache-unauthorized-ttl="30s" May 21 13:02:33.796474 ip-10-0-133-64 kubenswrapper[2562]: I0521 13:02:33.793832 2562 flags.go:64] FLAG: --boot-id-file="/proc/sys/kernel/random/boot_id" May 21 13:02:33.796474 ip-10-0-133-64 kubenswrapper[2562]: I0521 13:02:33.793835 2562 flags.go:64] FLAG: --bootstrap-kubeconfig="/etc/kubernetes/kubeconfig" May 21 13:02:33.796474 ip-10-0-133-64 kubenswrapper[2562]: I0521 13:02:33.793839 2562 flags.go:64] FLAG: --cert-dir="/var/lib/kubelet/pki" May 21 13:02:33.796474 ip-10-0-133-64 kubenswrapper[2562]: I0521 13:02:33.793842 2562 flags.go:64] FLAG: --cgroup-driver="cgroupfs" May 21 13:02:33.796998 ip-10-0-133-64 kubenswrapper[2562]: I0521 13:02:33.793845 2562 flags.go:64] FLAG: --cgroup-root="" May 21 13:02:33.796998 ip-10-0-133-64 kubenswrapper[2562]: I0521 13:02:33.793848 2562 flags.go:64] FLAG: --cgroups-per-qos="true" May 21 13:02:33.796998 ip-10-0-133-64 kubenswrapper[2562]: I0521 13:02:33.793850 2562 flags.go:64] FLAG: --client-ca-file="" May 21 13:02:33.796998 ip-10-0-133-64 kubenswrapper[2562]: I0521 13:02:33.793853 2562 flags.go:64] FLAG: --cloud-config="" May 21 13:02:33.796998 ip-10-0-133-64 kubenswrapper[2562]: I0521 13:02:33.793856 2562 flags.go:64] FLAG: --cloud-provider="external" May 21 13:02:33.796998 ip-10-0-133-64 kubenswrapper[2562]: I0521 13:02:33.793859 2562 flags.go:64] FLAG: --cluster-dns="[]" May 21 13:02:33.796998 ip-10-0-133-64 kubenswrapper[2562]: I0521 13:02:33.793863 2562 flags.go:64] FLAG: --cluster-domain="" May 21 13:02:33.796998 ip-10-0-133-64 kubenswrapper[2562]: I0521 13:02:33.793866 2562 flags.go:64] FLAG: --config="/etc/kubernetes/kubelet.conf" May 21 13:02:33.796998 ip-10-0-133-64 kubenswrapper[2562]: I0521 13:02:33.793870 2562 flags.go:64] FLAG: --config-dir="" May 21 13:02:33.796998 ip-10-0-133-64 kubenswrapper[2562]: I0521 13:02:33.793873 2562 flags.go:64] FLAG: --container-hints="/etc/cadvisor/container_hints.json" May 21 13:02:33.796998 ip-10-0-133-64 kubenswrapper[2562]: I0521 13:02:33.793876 2562 flags.go:64] FLAG: --container-log-max-files="5" May 21 13:02:33.796998 ip-10-0-133-64 kubenswrapper[2562]: I0521 13:02:33.793880 2562 flags.go:64] FLAG: --container-log-max-size="10Mi" May 21 13:02:33.796998 ip-10-0-133-64 kubenswrapper[2562]: I0521 13:02:33.793883 2562 flags.go:64] FLAG: --container-runtime-endpoint="/var/run/crio/crio.sock" May 21 13:02:33.796998 ip-10-0-133-64 kubenswrapper[2562]: I0521 13:02:33.793886 2562 flags.go:64] FLAG: --containerd="/run/containerd/containerd.sock" May 21 13:02:33.796998 ip-10-0-133-64 kubenswrapper[2562]: I0521 13:02:33.793889 2562 flags.go:64] FLAG: --containerd-namespace="k8s.io" May 21 13:02:33.796998 ip-10-0-133-64 kubenswrapper[2562]: I0521 13:02:33.793892 2562 flags.go:64] FLAG: --contention-profiling="false" May 21 13:02:33.796998 ip-10-0-133-64 kubenswrapper[2562]: I0521 13:02:33.793895 2562 flags.go:64] FLAG: --cpu-cfs-quota="true" May 21 13:02:33.796998 ip-10-0-133-64 kubenswrapper[2562]: I0521 13:02:33.793898 2562 flags.go:64] FLAG: --cpu-cfs-quota-period="100ms" May 21 13:02:33.796998 ip-10-0-133-64 kubenswrapper[2562]: I0521 13:02:33.793901 2562 flags.go:64] FLAG: --cpu-manager-policy="none" May 21 13:02:33.796998 ip-10-0-133-64 kubenswrapper[2562]: I0521 13:02:33.793905 2562 flags.go:64] FLAG: --cpu-manager-policy-options="" May 21 13:02:33.796998 ip-10-0-133-64 kubenswrapper[2562]: I0521 13:02:33.793909 2562 flags.go:64] FLAG: --cpu-manager-reconcile-period="10s" May 21 13:02:33.796998 ip-10-0-133-64 kubenswrapper[2562]: I0521 13:02:33.793912 2562 flags.go:64] FLAG: --enable-controller-attach-detach="true" May 21 13:02:33.796998 ip-10-0-133-64 kubenswrapper[2562]: I0521 13:02:33.793914 2562 flags.go:64] FLAG: --enable-debugging-handlers="true" May 21 13:02:33.796998 ip-10-0-133-64 kubenswrapper[2562]: I0521 13:02:33.793917 2562 flags.go:64] FLAG: --enable-load-reader="false" May 21 13:02:33.796998 ip-10-0-133-64 kubenswrapper[2562]: I0521 13:02:33.793921 2562 flags.go:64] FLAG: --enable-server="true" May 21 13:02:33.797589 ip-10-0-133-64 kubenswrapper[2562]: I0521 13:02:33.793924 2562 flags.go:64] FLAG: --enforce-node-allocatable="[pods]" May 21 13:02:33.797589 ip-10-0-133-64 kubenswrapper[2562]: I0521 13:02:33.793929 2562 flags.go:64] FLAG: --event-burst="100" May 21 13:02:33.797589 ip-10-0-133-64 kubenswrapper[2562]: I0521 13:02:33.793932 2562 flags.go:64] FLAG: --event-qps="50" May 21 13:02:33.797589 ip-10-0-133-64 kubenswrapper[2562]: I0521 13:02:33.793935 2562 flags.go:64] FLAG: --event-storage-age-limit="default=0" May 21 13:02:33.797589 ip-10-0-133-64 kubenswrapper[2562]: I0521 13:02:33.793938 2562 flags.go:64] FLAG: --event-storage-event-limit="default=0" May 21 13:02:33.797589 ip-10-0-133-64 kubenswrapper[2562]: I0521 13:02:33.793942 2562 flags.go:64] FLAG: --eviction-hard="" May 21 13:02:33.797589 ip-10-0-133-64 kubenswrapper[2562]: I0521 13:02:33.793946 2562 flags.go:64] FLAG: --eviction-max-pod-grace-period="0" May 21 13:02:33.797589 ip-10-0-133-64 kubenswrapper[2562]: I0521 13:02:33.793949 2562 flags.go:64] FLAG: --eviction-minimum-reclaim="" May 21 13:02:33.797589 ip-10-0-133-64 kubenswrapper[2562]: I0521 13:02:33.793952 2562 flags.go:64] FLAG: --eviction-pressure-transition-period="5m0s" May 21 13:02:33.797589 ip-10-0-133-64 kubenswrapper[2562]: I0521 13:02:33.793955 2562 flags.go:64] FLAG: --eviction-soft="" May 21 13:02:33.797589 ip-10-0-133-64 kubenswrapper[2562]: I0521 13:02:33.793958 2562 flags.go:64] FLAG: --eviction-soft-grace-period="" May 21 13:02:33.797589 ip-10-0-133-64 kubenswrapper[2562]: I0521 13:02:33.793962 2562 flags.go:64] FLAG: --exit-on-lock-contention="false" May 21 13:02:33.797589 ip-10-0-133-64 kubenswrapper[2562]: I0521 13:02:33.793965 2562 flags.go:64] FLAG: --experimental-allocatable-ignore-eviction="false" May 21 13:02:33.797589 ip-10-0-133-64 kubenswrapper[2562]: I0521 13:02:33.793968 2562 flags.go:64] FLAG: --experimental-mounter-path="" May 21 13:02:33.797589 ip-10-0-133-64 kubenswrapper[2562]: I0521 13:02:33.793971 2562 flags.go:64] FLAG: --fail-cgroupv1="false" May 21 13:02:33.797589 ip-10-0-133-64 kubenswrapper[2562]: I0521 13:02:33.793974 2562 flags.go:64] FLAG: --fail-swap-on="true" May 21 13:02:33.797589 ip-10-0-133-64 kubenswrapper[2562]: I0521 13:02:33.793977 2562 flags.go:64] FLAG: --feature-gates="" May 21 13:02:33.797589 ip-10-0-133-64 kubenswrapper[2562]: I0521 13:02:33.793981 2562 flags.go:64] FLAG: --file-check-frequency="20s" May 21 13:02:33.797589 ip-10-0-133-64 kubenswrapper[2562]: I0521 13:02:33.793984 2562 flags.go:64] FLAG: --global-housekeeping-interval="1m0s" May 21 13:02:33.797589 ip-10-0-133-64 kubenswrapper[2562]: I0521 13:02:33.793987 2562 flags.go:64] FLAG: --hairpin-mode="promiscuous-bridge" May 21 13:02:33.797589 ip-10-0-133-64 kubenswrapper[2562]: I0521 13:02:33.793990 2562 flags.go:64] FLAG: --healthz-bind-address="127.0.0.1" May 21 13:02:33.797589 ip-10-0-133-64 kubenswrapper[2562]: I0521 13:02:33.793993 2562 flags.go:64] FLAG: --healthz-port="10248" May 21 13:02:33.797589 ip-10-0-133-64 kubenswrapper[2562]: I0521 13:02:33.793996 2562 flags.go:64] FLAG: --help="false" May 21 13:02:33.797589 ip-10-0-133-64 kubenswrapper[2562]: I0521 13:02:33.794000 2562 flags.go:64] FLAG: --hostname-override="ip-10-0-133-64.ec2.internal" May 21 13:02:33.797589 ip-10-0-133-64 kubenswrapper[2562]: I0521 13:02:33.794003 2562 flags.go:64] FLAG: --housekeeping-interval="10s" May 21 13:02:33.798221 ip-10-0-133-64 kubenswrapper[2562]: I0521 13:02:33.794006 2562 flags.go:64] FLAG: --http-check-frequency="20s" May 21 13:02:33.798221 ip-10-0-133-64 kubenswrapper[2562]: I0521 13:02:33.794009 2562 flags.go:64] FLAG: --image-credential-provider-bin-dir="/usr/libexec/kubelet-image-credential-provider-plugins" May 21 13:02:33.798221 ip-10-0-133-64 kubenswrapper[2562]: I0521 13:02:33.794013 2562 flags.go:64] FLAG: --image-credential-provider-config="/etc/kubernetes/credential-providers/ecr-credential-provider.yaml" May 21 13:02:33.798221 ip-10-0-133-64 kubenswrapper[2562]: I0521 13:02:33.794016 2562 flags.go:64] FLAG: --image-gc-high-threshold="85" May 21 13:02:33.798221 ip-10-0-133-64 kubenswrapper[2562]: I0521 13:02:33.794019 2562 flags.go:64] FLAG: --image-gc-low-threshold="80" May 21 13:02:33.798221 ip-10-0-133-64 kubenswrapper[2562]: I0521 13:02:33.794022 2562 flags.go:64] FLAG: --image-service-endpoint="" May 21 13:02:33.798221 ip-10-0-133-64 kubenswrapper[2562]: I0521 13:02:33.794025 2562 flags.go:64] FLAG: --kernel-memcg-notification="false" May 21 13:02:33.798221 ip-10-0-133-64 kubenswrapper[2562]: I0521 13:02:33.794028 2562 flags.go:64] FLAG: --kube-api-burst="100" May 21 13:02:33.798221 ip-10-0-133-64 kubenswrapper[2562]: I0521 13:02:33.794031 2562 flags.go:64] FLAG: --kube-api-content-type="application/vnd.kubernetes.protobuf" May 21 13:02:33.798221 ip-10-0-133-64 kubenswrapper[2562]: I0521 13:02:33.794034 2562 flags.go:64] FLAG: --kube-api-qps="50" May 21 13:02:33.798221 ip-10-0-133-64 kubenswrapper[2562]: I0521 13:02:33.794037 2562 flags.go:64] FLAG: --kube-reserved="" May 21 13:02:33.798221 ip-10-0-133-64 kubenswrapper[2562]: I0521 13:02:33.794040 2562 flags.go:64] FLAG: --kube-reserved-cgroup="" May 21 13:02:33.798221 ip-10-0-133-64 kubenswrapper[2562]: I0521 13:02:33.794043 2562 flags.go:64] FLAG: --kubeconfig="/var/lib/kubelet/kubeconfig" May 21 13:02:33.798221 ip-10-0-133-64 kubenswrapper[2562]: I0521 13:02:33.794046 2562 flags.go:64] FLAG: --kubelet-cgroups="" May 21 13:02:33.798221 ip-10-0-133-64 kubenswrapper[2562]: I0521 13:02:33.794049 2562 flags.go:64] FLAG: --local-storage-capacity-isolation="true" May 21 13:02:33.798221 ip-10-0-133-64 kubenswrapper[2562]: I0521 13:02:33.794051 2562 flags.go:64] FLAG: --lock-file="" May 21 13:02:33.798221 ip-10-0-133-64 kubenswrapper[2562]: I0521 13:02:33.794054 2562 flags.go:64] FLAG: --log-cadvisor-usage="false" May 21 13:02:33.798221 ip-10-0-133-64 kubenswrapper[2562]: I0521 13:02:33.794057 2562 flags.go:64] FLAG: --log-flush-frequency="5s" May 21 13:02:33.798221 ip-10-0-133-64 kubenswrapper[2562]: I0521 13:02:33.794060 2562 flags.go:64] FLAG: --log-json-info-buffer-size="0" May 21 13:02:33.798221 ip-10-0-133-64 kubenswrapper[2562]: I0521 13:02:33.794066 2562 flags.go:64] FLAG: --log-json-split-stream="false" May 21 13:02:33.798221 ip-10-0-133-64 kubenswrapper[2562]: I0521 13:02:33.794069 2562 flags.go:64] FLAG: --log-text-info-buffer-size="0" May 21 13:02:33.798221 ip-10-0-133-64 kubenswrapper[2562]: I0521 13:02:33.794072 2562 flags.go:64] FLAG: --log-text-split-stream="false" May 21 13:02:33.798221 ip-10-0-133-64 kubenswrapper[2562]: I0521 13:02:33.794074 2562 flags.go:64] FLAG: --logging-format="text" May 21 13:02:33.798781 ip-10-0-133-64 kubenswrapper[2562]: I0521 13:02:33.794077 2562 flags.go:64] FLAG: --machine-id-file="/etc/machine-id,/var/lib/dbus/machine-id" May 21 13:02:33.798781 ip-10-0-133-64 kubenswrapper[2562]: I0521 13:02:33.794081 2562 flags.go:64] FLAG: --make-iptables-util-chains="true" May 21 13:02:33.798781 ip-10-0-133-64 kubenswrapper[2562]: I0521 13:02:33.794083 2562 flags.go:64] FLAG: --manifest-url="" May 21 13:02:33.798781 ip-10-0-133-64 kubenswrapper[2562]: I0521 13:02:33.794086 2562 flags.go:64] FLAG: --manifest-url-header="" May 21 13:02:33.798781 ip-10-0-133-64 kubenswrapper[2562]: I0521 13:02:33.794090 2562 flags.go:64] FLAG: --max-housekeeping-interval="15s" May 21 13:02:33.798781 ip-10-0-133-64 kubenswrapper[2562]: I0521 13:02:33.794093 2562 flags.go:64] FLAG: --max-open-files="1000000" May 21 13:02:33.798781 ip-10-0-133-64 kubenswrapper[2562]: I0521 13:02:33.794097 2562 flags.go:64] FLAG: --max-pods="110" May 21 13:02:33.798781 ip-10-0-133-64 kubenswrapper[2562]: I0521 13:02:33.794100 2562 flags.go:64] FLAG: --maximum-dead-containers="-1" May 21 13:02:33.798781 ip-10-0-133-64 kubenswrapper[2562]: I0521 13:02:33.794103 2562 flags.go:64] FLAG: --maximum-dead-containers-per-container="1" May 21 13:02:33.798781 ip-10-0-133-64 kubenswrapper[2562]: I0521 13:02:33.794106 2562 flags.go:64] FLAG: --memory-manager-policy="None" May 21 13:02:33.798781 ip-10-0-133-64 kubenswrapper[2562]: I0521 13:02:33.794109 2562 flags.go:64] FLAG: --minimum-container-ttl-duration="6m0s" May 21 13:02:33.798781 ip-10-0-133-64 kubenswrapper[2562]: I0521 13:02:33.794111 2562 flags.go:64] FLAG: --minimum-image-ttl-duration="2m0s" May 21 13:02:33.798781 ip-10-0-133-64 kubenswrapper[2562]: I0521 13:02:33.794114 2562 flags.go:64] FLAG: --node-ip="0.0.0.0" May 21 13:02:33.798781 ip-10-0-133-64 kubenswrapper[2562]: I0521 13:02:33.794117 2562 flags.go:64] FLAG: --node-labels="node-role.kubernetes.io/worker=,node.openshift.io/os_id=rhel" May 21 13:02:33.798781 ip-10-0-133-64 kubenswrapper[2562]: I0521 13:02:33.794124 2562 flags.go:64] FLAG: --node-status-max-images="50" May 21 13:02:33.798781 ip-10-0-133-64 kubenswrapper[2562]: I0521 13:02:33.794127 2562 flags.go:64] FLAG: --node-status-update-frequency="10s" May 21 13:02:33.798781 ip-10-0-133-64 kubenswrapper[2562]: I0521 13:02:33.794130 2562 flags.go:64] FLAG: --oom-score-adj="-999" May 21 13:02:33.798781 ip-10-0-133-64 kubenswrapper[2562]: I0521 13:02:33.794133 2562 flags.go:64] FLAG: --pod-cidr="" May 21 13:02:33.798781 ip-10-0-133-64 kubenswrapper[2562]: I0521 13:02:33.794137 2562 flags.go:64] FLAG: --pod-infra-container-image="quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:afe88671bf163c42b467d159dc6f0b784dbe28b1ed44e171edc9c06fd99cc6fc" May 21 13:02:33.798781 ip-10-0-133-64 kubenswrapper[2562]: I0521 13:02:33.794142 2562 flags.go:64] FLAG: --pod-manifest-path="" May 21 13:02:33.798781 ip-10-0-133-64 kubenswrapper[2562]: I0521 13:02:33.794145 2562 flags.go:64] FLAG: --pod-max-pids="-1" May 21 13:02:33.798781 ip-10-0-133-64 kubenswrapper[2562]: I0521 13:02:33.794148 2562 flags.go:64] FLAG: --pods-per-core="0" May 21 13:02:33.798781 ip-10-0-133-64 kubenswrapper[2562]: I0521 13:02:33.794151 2562 flags.go:64] FLAG: --port="10250" May 21 13:02:33.798781 ip-10-0-133-64 kubenswrapper[2562]: I0521 13:02:33.794154 2562 flags.go:64] FLAG: --protect-kernel-defaults="false" May 21 13:02:33.799413 ip-10-0-133-64 kubenswrapper[2562]: I0521 13:02:33.794157 2562 flags.go:64] FLAG: --provider-id="aws:///us-east-1a/i-0a20859b7fde31c36" May 21 13:02:33.799413 ip-10-0-133-64 kubenswrapper[2562]: I0521 13:02:33.794160 2562 flags.go:64] FLAG: --qos-reserved="" May 21 13:02:33.799413 ip-10-0-133-64 kubenswrapper[2562]: I0521 13:02:33.794163 2562 flags.go:64] FLAG: --read-only-port="10255" May 21 13:02:33.799413 ip-10-0-133-64 kubenswrapper[2562]: I0521 13:02:33.794166 2562 flags.go:64] FLAG: --register-node="true" May 21 13:02:33.799413 ip-10-0-133-64 kubenswrapper[2562]: I0521 13:02:33.794171 2562 flags.go:64] FLAG: --register-schedulable="true" May 21 13:02:33.799413 ip-10-0-133-64 kubenswrapper[2562]: I0521 13:02:33.794174 2562 flags.go:64] FLAG: --register-with-taints="" May 21 13:02:33.799413 ip-10-0-133-64 kubenswrapper[2562]: I0521 13:02:33.794178 2562 flags.go:64] FLAG: --registry-burst="10" May 21 13:02:33.799413 ip-10-0-133-64 kubenswrapper[2562]: I0521 13:02:33.794181 2562 flags.go:64] FLAG: --registry-qps="5" May 21 13:02:33.799413 ip-10-0-133-64 kubenswrapper[2562]: I0521 13:02:33.794184 2562 flags.go:64] FLAG: --reserved-cpus="" May 21 13:02:33.799413 ip-10-0-133-64 kubenswrapper[2562]: I0521 13:02:33.794186 2562 flags.go:64] FLAG: --reserved-memory="" May 21 13:02:33.799413 ip-10-0-133-64 kubenswrapper[2562]: I0521 13:02:33.794190 2562 flags.go:64] FLAG: --resolv-conf="/etc/resolv.conf" May 21 13:02:33.799413 ip-10-0-133-64 kubenswrapper[2562]: I0521 13:02:33.794193 2562 flags.go:64] FLAG: --root-dir="/var/lib/kubelet" May 21 13:02:33.799413 ip-10-0-133-64 kubenswrapper[2562]: I0521 13:02:33.794197 2562 flags.go:64] FLAG: --rotate-certificates="false" May 21 13:02:33.799413 ip-10-0-133-64 kubenswrapper[2562]: I0521 13:02:33.794199 2562 flags.go:64] FLAG: --rotate-server-certificates="false" May 21 13:02:33.799413 ip-10-0-133-64 kubenswrapper[2562]: I0521 13:02:33.794202 2562 flags.go:64] FLAG: --runonce="false" May 21 13:02:33.799413 ip-10-0-133-64 kubenswrapper[2562]: I0521 13:02:33.794205 2562 flags.go:64] FLAG: --runtime-cgroups="/system.slice/crio.service" May 21 13:02:33.799413 ip-10-0-133-64 kubenswrapper[2562]: I0521 13:02:33.794208 2562 flags.go:64] FLAG: --runtime-request-timeout="2m0s" May 21 13:02:33.799413 ip-10-0-133-64 kubenswrapper[2562]: I0521 13:02:33.794211 2562 flags.go:64] FLAG: --seccomp-default="false" May 21 13:02:33.799413 ip-10-0-133-64 kubenswrapper[2562]: I0521 13:02:33.794214 2562 flags.go:64] FLAG: --serialize-image-pulls="true" May 21 13:02:33.799413 ip-10-0-133-64 kubenswrapper[2562]: I0521 13:02:33.794217 2562 flags.go:64] FLAG: --storage-driver-buffer-duration="1m0s" May 21 13:02:33.799413 ip-10-0-133-64 kubenswrapper[2562]: I0521 13:02:33.794220 2562 flags.go:64] FLAG: --storage-driver-db="cadvisor" May 21 13:02:33.799413 ip-10-0-133-64 kubenswrapper[2562]: I0521 13:02:33.794223 2562 flags.go:64] FLAG: --storage-driver-host="localhost:8086" May 21 13:02:33.799413 ip-10-0-133-64 kubenswrapper[2562]: I0521 13:02:33.794226 2562 flags.go:64] FLAG: --storage-driver-password="root" May 21 13:02:33.799413 ip-10-0-133-64 kubenswrapper[2562]: I0521 13:02:33.794229 2562 flags.go:64] FLAG: --storage-driver-secure="false" May 21 13:02:33.799413 ip-10-0-133-64 kubenswrapper[2562]: I0521 13:02:33.794232 2562 flags.go:64] FLAG: --storage-driver-table="stats" May 21 13:02:33.799413 ip-10-0-133-64 kubenswrapper[2562]: I0521 13:02:33.794235 2562 flags.go:64] FLAG: --storage-driver-user="root" May 21 13:02:33.800048 ip-10-0-133-64 kubenswrapper[2562]: I0521 13:02:33.794238 2562 flags.go:64] FLAG: --streaming-connection-idle-timeout="4h0m0s" May 21 13:02:33.800048 ip-10-0-133-64 kubenswrapper[2562]: I0521 13:02:33.794244 2562 flags.go:64] FLAG: --sync-frequency="1m0s" May 21 13:02:33.800048 ip-10-0-133-64 kubenswrapper[2562]: I0521 13:02:33.794247 2562 flags.go:64] FLAG: --system-cgroups="" May 21 13:02:33.800048 ip-10-0-133-64 kubenswrapper[2562]: I0521 13:02:33.794250 2562 flags.go:64] FLAG: --system-reserved="cpu=500m,ephemeral-storage=1Gi,memory=1Gi" May 21 13:02:33.800048 ip-10-0-133-64 kubenswrapper[2562]: I0521 13:02:33.794255 2562 flags.go:64] FLAG: --system-reserved-cgroup="" May 21 13:02:33.800048 ip-10-0-133-64 kubenswrapper[2562]: I0521 13:02:33.794258 2562 flags.go:64] FLAG: --tls-cert-file="" May 21 13:02:33.800048 ip-10-0-133-64 kubenswrapper[2562]: I0521 13:02:33.794261 2562 flags.go:64] FLAG: --tls-cipher-suites="[]" May 21 13:02:33.800048 ip-10-0-133-64 kubenswrapper[2562]: I0521 13:02:33.794265 2562 flags.go:64] FLAG: --tls-min-version="" May 21 13:02:33.800048 ip-10-0-133-64 kubenswrapper[2562]: I0521 13:02:33.794268 2562 flags.go:64] FLAG: --tls-private-key-file="" May 21 13:02:33.800048 ip-10-0-133-64 kubenswrapper[2562]: I0521 13:02:33.794271 2562 flags.go:64] FLAG: --topology-manager-policy="none" May 21 13:02:33.800048 ip-10-0-133-64 kubenswrapper[2562]: I0521 13:02:33.794275 2562 flags.go:64] FLAG: --topology-manager-policy-options="" May 21 13:02:33.800048 ip-10-0-133-64 kubenswrapper[2562]: I0521 13:02:33.794278 2562 flags.go:64] FLAG: --topology-manager-scope="container" May 21 13:02:33.800048 ip-10-0-133-64 kubenswrapper[2562]: I0521 13:02:33.794281 2562 flags.go:64] FLAG: --v="2" May 21 13:02:33.800048 ip-10-0-133-64 kubenswrapper[2562]: I0521 13:02:33.794285 2562 flags.go:64] FLAG: --version="false" May 21 13:02:33.800048 ip-10-0-133-64 kubenswrapper[2562]: I0521 13:02:33.794289 2562 flags.go:64] FLAG: --vmodule="" May 21 13:02:33.800048 ip-10-0-133-64 kubenswrapper[2562]: I0521 13:02:33.794293 2562 flags.go:64] FLAG: --volume-plugin-dir="/etc/kubernetes/kubelet-plugins/volume/exec" May 21 13:02:33.800048 ip-10-0-133-64 kubenswrapper[2562]: I0521 13:02:33.794296 2562 flags.go:64] FLAG: --volume-stats-agg-period="1m0s" May 21 13:02:33.800048 ip-10-0-133-64 kubenswrapper[2562]: W0521 13:02:33.794387 2562 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere May 21 13:02:33.800048 ip-10-0-133-64 kubenswrapper[2562]: W0521 13:02:33.794391 2562 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities May 21 13:02:33.800048 ip-10-0-133-64 kubenswrapper[2562]: W0521 13:02:33.794394 2562 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification May 21 13:02:33.800048 ip-10-0-133-64 kubenswrapper[2562]: W0521 13:02:33.794397 2562 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController May 21 13:02:33.800048 ip-10-0-133-64 kubenswrapper[2562]: W0521 13:02:33.794400 2562 feature_gate.go:328] unrecognized feature gate: InsightsConfigAPI May 21 13:02:33.800048 ip-10-0-133-64 kubenswrapper[2562]: W0521 13:02:33.794403 2562 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall May 21 13:02:33.800641 ip-10-0-133-64 kubenswrapper[2562]: W0521 13:02:33.794405 2562 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode May 21 13:02:33.800641 ip-10-0-133-64 kubenswrapper[2562]: W0521 13:02:33.794408 2562 feature_gate.go:328] unrecognized feature gate: DualReplica May 21 13:02:33.800641 ip-10-0-133-64 kubenswrapper[2562]: W0521 13:02:33.794410 2562 feature_gate.go:328] unrecognized feature gate: PinnedImages May 21 13:02:33.800641 ip-10-0-133-64 kubenswrapper[2562]: W0521 13:02:33.794413 2562 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig May 21 13:02:33.800641 ip-10-0-133-64 kubenswrapper[2562]: W0521 13:02:33.794415 2562 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission May 21 13:02:33.800641 ip-10-0-133-64 kubenswrapper[2562]: W0521 13:02:33.794418 2562 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks May 21 13:02:33.800641 ip-10-0-133-64 kubenswrapper[2562]: W0521 13:02:33.794420 2562 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall May 21 13:02:33.800641 ip-10-0-133-64 kubenswrapper[2562]: W0521 13:02:33.794424 2562 feature_gate.go:328] unrecognized feature gate: GatewayAPIController May 21 13:02:33.800641 ip-10-0-133-64 kubenswrapper[2562]: W0521 13:02:33.794426 2562 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes May 21 13:02:33.800641 ip-10-0-133-64 kubenswrapper[2562]: W0521 13:02:33.794429 2562 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles May 21 13:02:33.800641 ip-10-0-133-64 kubenswrapper[2562]: W0521 13:02:33.794433 2562 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode May 21 13:02:33.800641 ip-10-0-133-64 kubenswrapper[2562]: W0521 13:02:33.794436 2562 feature_gate.go:328] unrecognized feature gate: DNSNameResolver May 21 13:02:33.800641 ip-10-0-133-64 kubenswrapper[2562]: W0521 13:02:33.794439 2562 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement May 21 13:02:33.800641 ip-10-0-133-64 kubenswrapper[2562]: W0521 13:02:33.794441 2562 feature_gate.go:328] unrecognized feature gate: SignatureStores May 21 13:02:33.800641 ip-10-0-133-64 kubenswrapper[2562]: W0521 13:02:33.794445 2562 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. May 21 13:02:33.800641 ip-10-0-133-64 kubenswrapper[2562]: W0521 13:02:33.794449 2562 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager May 21 13:02:33.800641 ip-10-0-133-64 kubenswrapper[2562]: W0521 13:02:33.794451 2562 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration May 21 13:02:33.800641 ip-10-0-133-64 kubenswrapper[2562]: W0521 13:02:33.794454 2562 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement May 21 13:02:33.800641 ip-10-0-133-64 kubenswrapper[2562]: W0521 13:02:33.794457 2562 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup May 21 13:02:33.801168 ip-10-0-133-64 kubenswrapper[2562]: W0521 13:02:33.794461 2562 feature_gate.go:328] unrecognized feature gate: Example2 May 21 13:02:33.801168 ip-10-0-133-64 kubenswrapper[2562]: W0521 13:02:33.794463 2562 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS May 21 13:02:33.801168 ip-10-0-133-64 kubenswrapper[2562]: W0521 13:02:33.794466 2562 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks May 21 13:02:33.801168 ip-10-0-133-64 kubenswrapper[2562]: W0521 13:02:33.794468 2562 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting May 21 13:02:33.801168 ip-10-0-133-64 kubenswrapper[2562]: W0521 13:02:33.794471 2562 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix May 21 13:02:33.801168 ip-10-0-133-64 kubenswrapper[2562]: W0521 13:02:33.794474 2562 feature_gate.go:328] unrecognized feature gate: OVNObservability May 21 13:02:33.801168 ip-10-0-133-64 kubenswrapper[2562]: W0521 13:02:33.794476 2562 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata May 21 13:02:33.801168 ip-10-0-133-64 kubenswrapper[2562]: W0521 13:02:33.794493 2562 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes May 21 13:02:33.801168 ip-10-0-133-64 kubenswrapper[2562]: W0521 13:02:33.794497 2562 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS May 21 13:02:33.801168 ip-10-0-133-64 kubenswrapper[2562]: W0521 13:02:33.794500 2562 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup May 21 13:02:33.801168 ip-10-0-133-64 kubenswrapper[2562]: W0521 13:02:33.794503 2562 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure May 21 13:02:33.801168 ip-10-0-133-64 kubenswrapper[2562]: W0521 13:02:33.794506 2562 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather May 21 13:02:33.801168 ip-10-0-133-64 kubenswrapper[2562]: W0521 13:02:33.794509 2562 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal May 21 13:02:33.801168 ip-10-0-133-64 kubenswrapper[2562]: W0521 13:02:33.794512 2562 feature_gate.go:328] unrecognized feature gate: IngressControllerLBSubnetsAWS May 21 13:02:33.801168 ip-10-0-133-64 kubenswrapper[2562]: W0521 13:02:33.794514 2562 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation May 21 13:02:33.801168 ip-10-0-133-64 kubenswrapper[2562]: W0521 13:02:33.794517 2562 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS May 21 13:02:33.801168 ip-10-0-133-64 kubenswrapper[2562]: W0521 13:02:33.794520 2562 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts May 21 13:02:33.801168 ip-10-0-133-64 kubenswrapper[2562]: W0521 13:02:33.794522 2562 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets May 21 13:02:33.801168 ip-10-0-133-64 kubenswrapper[2562]: W0521 13:02:33.794524 2562 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud May 21 13:02:33.801168 ip-10-0-133-64 kubenswrapper[2562]: W0521 13:02:33.794527 2562 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota May 21 13:02:33.801657 ip-10-0-133-64 kubenswrapper[2562]: W0521 13:02:33.794530 2562 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA May 21 13:02:33.801657 ip-10-0-133-64 kubenswrapper[2562]: W0521 13:02:33.794533 2562 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv May 21 13:02:33.801657 ip-10-0-133-64 kubenswrapper[2562]: W0521 13:02:33.794535 2562 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall May 21 13:02:33.801657 ip-10-0-133-64 kubenswrapper[2562]: W0521 13:02:33.794539 2562 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration May 21 13:02:33.801657 ip-10-0-133-64 kubenswrapper[2562]: W0521 13:02:33.794542 2562 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter May 21 13:02:33.801657 ip-10-0-133-64 kubenswrapper[2562]: W0521 13:02:33.794545 2562 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot May 21 13:02:33.801657 ip-10-0-133-64 kubenswrapper[2562]: W0521 13:02:33.794548 2562 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts May 21 13:02:33.801657 ip-10-0-133-64 kubenswrapper[2562]: W0521 13:02:33.794550 2562 feature_gate.go:328] unrecognized feature gate: NewOLM May 21 13:02:33.801657 ip-10-0-133-64 kubenswrapper[2562]: W0521 13:02:33.794553 2562 feature_gate.go:328] unrecognized feature gate: ManagedBootImages May 21 13:02:33.801657 ip-10-0-133-64 kubenswrapper[2562]: W0521 13:02:33.794555 2562 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk May 21 13:02:33.801657 ip-10-0-133-64 kubenswrapper[2562]: W0521 13:02:33.794558 2562 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig May 21 13:02:33.801657 ip-10-0-133-64 kubenswrapper[2562]: W0521 13:02:33.794561 2562 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk May 21 13:02:33.801657 ip-10-0-133-64 kubenswrapper[2562]: W0521 13:02:33.794565 2562 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform May 21 13:02:33.801657 ip-10-0-133-64 kubenswrapper[2562]: W0521 13:02:33.794567 2562 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses May 21 13:02:33.801657 ip-10-0-133-64 kubenswrapper[2562]: W0521 13:02:33.794570 2562 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall May 21 13:02:33.801657 ip-10-0-133-64 kubenswrapper[2562]: W0521 13:02:33.794572 2562 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity May 21 13:02:33.801657 ip-10-0-133-64 kubenswrapper[2562]: W0521 13:02:33.794575 2562 feature_gate.go:328] unrecognized feature gate: Example May 21 13:02:33.801657 ip-10-0-133-64 kubenswrapper[2562]: W0521 13:02:33.794577 2562 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider May 21 13:02:33.801657 ip-10-0-133-64 kubenswrapper[2562]: W0521 13:02:33.794580 2562 feature_gate.go:328] unrecognized feature gate: UpgradeStatus May 21 13:02:33.801657 ip-10-0-133-64 kubenswrapper[2562]: W0521 13:02:33.794582 2562 feature_gate.go:328] unrecognized feature gate: GatewayAPI May 21 13:02:33.802168 ip-10-0-133-64 kubenswrapper[2562]: W0521 13:02:33.794585 2562 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation May 21 13:02:33.802168 ip-10-0-133-64 kubenswrapper[2562]: W0521 13:02:33.794587 2562 feature_gate.go:328] unrecognized feature gate: SetEIPForNLBIngressController May 21 13:02:33.802168 ip-10-0-133-64 kubenswrapper[2562]: W0521 13:02:33.794590 2562 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall May 21 13:02:33.802168 ip-10-0-133-64 kubenswrapper[2562]: W0521 13:02:33.794592 2562 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy May 21 13:02:33.802168 ip-10-0-133-64 kubenswrapper[2562]: W0521 13:02:33.794595 2562 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings May 21 13:02:33.802168 ip-10-0-133-64 kubenswrapper[2562]: W0521 13:02:33.794598 2562 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints May 21 13:02:33.802168 ip-10-0-133-64 kubenswrapper[2562]: W0521 13:02:33.794600 2562 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud May 21 13:02:33.802168 ip-10-0-133-64 kubenswrapper[2562]: W0521 13:02:33.794603 2562 feature_gate.go:328] unrecognized feature gate: InsightsConfig May 21 13:02:33.802168 ip-10-0-133-64 kubenswrapper[2562]: W0521 13:02:33.794605 2562 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig May 21 13:02:33.802168 ip-10-0-133-64 kubenswrapper[2562]: W0521 13:02:33.794608 2562 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure May 21 13:02:33.802168 ip-10-0-133-64 kubenswrapper[2562]: W0521 13:02:33.794610 2562 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements May 21 13:02:33.802168 ip-10-0-133-64 kubenswrapper[2562]: W0521 13:02:33.794613 2562 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy May 21 13:02:33.802168 ip-10-0-133-64 kubenswrapper[2562]: W0521 13:02:33.794617 2562 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. May 21 13:02:33.802168 ip-10-0-133-64 kubenswrapper[2562]: W0521 13:02:33.794620 2562 feature_gate.go:328] unrecognized feature gate: ShortCertRotation May 21 13:02:33.802168 ip-10-0-133-64 kubenswrapper[2562]: W0521 13:02:33.794623 2562 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas May 21 13:02:33.802168 ip-10-0-133-64 kubenswrapper[2562]: W0521 13:02:33.794627 2562 feature_gate.go:328] unrecognized feature gate: ExternalOIDC May 21 13:02:33.802168 ip-10-0-133-64 kubenswrapper[2562]: W0521 13:02:33.794630 2562 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration May 21 13:02:33.802168 ip-10-0-133-64 kubenswrapper[2562]: W0521 13:02:33.794633 2562 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace May 21 13:02:33.802168 ip-10-0-133-64 kubenswrapper[2562]: W0521 13:02:33.794636 2562 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI May 21 13:02:33.802633 ip-10-0-133-64 kubenswrapper[2562]: W0521 13:02:33.794638 2562 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterOperations May 21 13:02:33.802633 ip-10-0-133-64 kubenswrapper[2562]: W0521 13:02:33.794640 2562 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup May 21 13:02:33.802633 ip-10-0-133-64 kubenswrapper[2562]: I0521 13:02:33.795366 2562 feature_gate.go:384] feature gates: {map[DynamicResourceAllocation:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutatingAdmissionPolicy:false NodeSwap:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:false]} May 21 13:02:33.802633 ip-10-0-133-64 kubenswrapper[2562]: I0521 13:02:33.801820 2562 server.go:530] "Kubelet version" kubeletVersion="v1.33.11" May 21 13:02:33.802633 ip-10-0-133-64 kubenswrapper[2562]: I0521 13:02:33.801838 2562 server.go:532] "Golang settings" GOGC="" GOMAXPROCS="" GOTRACEBACK="" May 21 13:02:33.802633 ip-10-0-133-64 kubenswrapper[2562]: W0521 13:02:33.801886 2562 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall May 21 13:02:33.802633 ip-10-0-133-64 kubenswrapper[2562]: W0521 13:02:33.801891 2562 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota May 21 13:02:33.802633 ip-10-0-133-64 kubenswrapper[2562]: W0521 13:02:33.801895 2562 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager May 21 13:02:33.802633 ip-10-0-133-64 kubenswrapper[2562]: W0521 13:02:33.801899 2562 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration May 21 13:02:33.802633 ip-10-0-133-64 kubenswrapper[2562]: W0521 13:02:33.801902 2562 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk May 21 13:02:33.802633 ip-10-0-133-64 kubenswrapper[2562]: W0521 13:02:33.801905 2562 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata May 21 13:02:33.802633 ip-10-0-133-64 kubenswrapper[2562]: W0521 13:02:33.801907 2562 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission May 21 13:02:33.802633 ip-10-0-133-64 kubenswrapper[2562]: W0521 13:02:33.801910 2562 feature_gate.go:328] unrecognized feature gate: Example2 May 21 13:02:33.802633 ip-10-0-133-64 kubenswrapper[2562]: W0521 13:02:33.801913 2562 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS May 21 13:02:33.802633 ip-10-0-133-64 kubenswrapper[2562]: W0521 13:02:33.801915 2562 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather May 21 13:02:33.803047 ip-10-0-133-64 kubenswrapper[2562]: W0521 13:02:33.801918 2562 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy May 21 13:02:33.803047 ip-10-0-133-64 kubenswrapper[2562]: W0521 13:02:33.801921 2562 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup May 21 13:02:33.803047 ip-10-0-133-64 kubenswrapper[2562]: W0521 13:02:33.801923 2562 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall May 21 13:02:33.803047 ip-10-0-133-64 kubenswrapper[2562]: W0521 13:02:33.801926 2562 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud May 21 13:02:33.803047 ip-10-0-133-64 kubenswrapper[2562]: W0521 13:02:33.801930 2562 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. May 21 13:02:33.803047 ip-10-0-133-64 kubenswrapper[2562]: W0521 13:02:33.801934 2562 feature_gate.go:328] unrecognized feature gate: Example May 21 13:02:33.803047 ip-10-0-133-64 kubenswrapper[2562]: W0521 13:02:33.801937 2562 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud May 21 13:02:33.803047 ip-10-0-133-64 kubenswrapper[2562]: W0521 13:02:33.801939 2562 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI May 21 13:02:33.803047 ip-10-0-133-64 kubenswrapper[2562]: W0521 13:02:33.801942 2562 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings May 21 13:02:33.803047 ip-10-0-133-64 kubenswrapper[2562]: W0521 13:02:33.801945 2562 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure May 21 13:02:33.803047 ip-10-0-133-64 kubenswrapper[2562]: W0521 13:02:33.801947 2562 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS May 21 13:02:33.803047 ip-10-0-133-64 kubenswrapper[2562]: W0521 13:02:33.801950 2562 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA May 21 13:02:33.803047 ip-10-0-133-64 kubenswrapper[2562]: W0521 13:02:33.801952 2562 feature_gate.go:328] unrecognized feature gate: SignatureStores May 21 13:02:33.803047 ip-10-0-133-64 kubenswrapper[2562]: W0521 13:02:33.801955 2562 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks May 21 13:02:33.803047 ip-10-0-133-64 kubenswrapper[2562]: W0521 13:02:33.801957 2562 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks May 21 13:02:33.803047 ip-10-0-133-64 kubenswrapper[2562]: W0521 13:02:33.801961 2562 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv May 21 13:02:33.803047 ip-10-0-133-64 kubenswrapper[2562]: W0521 13:02:33.801963 2562 feature_gate.go:328] unrecognized feature gate: ShortCertRotation May 21 13:02:33.803047 ip-10-0-133-64 kubenswrapper[2562]: W0521 13:02:33.801966 2562 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses May 21 13:02:33.803047 ip-10-0-133-64 kubenswrapper[2562]: W0521 13:02:33.801969 2562 feature_gate.go:328] unrecognized feature gate: DNSNameResolver May 21 13:02:33.803518 ip-10-0-133-64 kubenswrapper[2562]: W0521 13:02:33.801971 2562 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification May 21 13:02:33.803518 ip-10-0-133-64 kubenswrapper[2562]: W0521 13:02:33.801974 2562 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig May 21 13:02:33.803518 ip-10-0-133-64 kubenswrapper[2562]: W0521 13:02:33.801977 2562 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup May 21 13:02:33.803518 ip-10-0-133-64 kubenswrapper[2562]: W0521 13:02:33.801980 2562 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode May 21 13:02:33.803518 ip-10-0-133-64 kubenswrapper[2562]: W0521 13:02:33.801982 2562 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles May 21 13:02:33.803518 ip-10-0-133-64 kubenswrapper[2562]: W0521 13:02:33.801985 2562 feature_gate.go:328] unrecognized feature gate: IngressControllerLBSubnetsAWS May 21 13:02:33.803518 ip-10-0-133-64 kubenswrapper[2562]: W0521 13:02:33.801987 2562 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix May 21 13:02:33.803518 ip-10-0-133-64 kubenswrapper[2562]: W0521 13:02:33.801990 2562 feature_gate.go:328] unrecognized feature gate: SetEIPForNLBIngressController May 21 13:02:33.803518 ip-10-0-133-64 kubenswrapper[2562]: W0521 13:02:33.801992 2562 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting May 21 13:02:33.803518 ip-10-0-133-64 kubenswrapper[2562]: W0521 13:02:33.801995 2562 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter May 21 13:02:33.803518 ip-10-0-133-64 kubenswrapper[2562]: W0521 13:02:33.801998 2562 feature_gate.go:328] unrecognized feature gate: NewOLM May 21 13:02:33.803518 ip-10-0-133-64 kubenswrapper[2562]: W0521 13:02:33.802001 2562 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall May 21 13:02:33.803518 ip-10-0-133-64 kubenswrapper[2562]: W0521 13:02:33.802003 2562 feature_gate.go:328] unrecognized feature gate: OVNObservability May 21 13:02:33.803518 ip-10-0-133-64 kubenswrapper[2562]: W0521 13:02:33.802006 2562 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig May 21 13:02:33.803518 ip-10-0-133-64 kubenswrapper[2562]: W0521 13:02:33.802009 2562 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider May 21 13:02:33.803518 ip-10-0-133-64 kubenswrapper[2562]: W0521 13:02:33.802013 2562 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. May 21 13:02:33.803518 ip-10-0-133-64 kubenswrapper[2562]: W0521 13:02:33.802016 2562 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity May 21 13:02:33.803518 ip-10-0-133-64 kubenswrapper[2562]: W0521 13:02:33.802019 2562 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement May 21 13:02:33.803518 ip-10-0-133-64 kubenswrapper[2562]: W0521 13:02:33.802022 2562 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts May 21 13:02:33.803992 ip-10-0-133-64 kubenswrapper[2562]: W0521 13:02:33.802025 2562 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall May 21 13:02:33.803992 ip-10-0-133-64 kubenswrapper[2562]: W0521 13:02:33.802028 2562 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk May 21 13:02:33.803992 ip-10-0-133-64 kubenswrapper[2562]: W0521 13:02:33.802031 2562 feature_gate.go:328] unrecognized feature gate: UpgradeStatus May 21 13:02:33.803992 ip-10-0-133-64 kubenswrapper[2562]: W0521 13:02:33.802033 2562 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement May 21 13:02:33.803992 ip-10-0-133-64 kubenswrapper[2562]: W0521 13:02:33.802036 2562 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController May 21 13:02:33.803992 ip-10-0-133-64 kubenswrapper[2562]: W0521 13:02:33.802039 2562 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets May 21 13:02:33.803992 ip-10-0-133-64 kubenswrapper[2562]: W0521 13:02:33.802041 2562 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes May 21 13:02:33.803992 ip-10-0-133-64 kubenswrapper[2562]: W0521 13:02:33.802044 2562 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode May 21 13:02:33.803992 ip-10-0-133-64 kubenswrapper[2562]: W0521 13:02:33.802046 2562 feature_gate.go:328] unrecognized feature gate: GatewayAPIController May 21 13:02:33.803992 ip-10-0-133-64 kubenswrapper[2562]: W0521 13:02:33.802049 2562 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace May 21 13:02:33.803992 ip-10-0-133-64 kubenswrapper[2562]: W0521 13:02:33.802052 2562 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot May 21 13:02:33.803992 ip-10-0-133-64 kubenswrapper[2562]: W0521 13:02:33.802054 2562 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes May 21 13:02:33.803992 ip-10-0-133-64 kubenswrapper[2562]: W0521 13:02:33.802058 2562 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal May 21 13:02:33.803992 ip-10-0-133-64 kubenswrapper[2562]: W0521 13:02:33.802060 2562 feature_gate.go:328] unrecognized feature gate: ExternalOIDC May 21 13:02:33.803992 ip-10-0-133-64 kubenswrapper[2562]: W0521 13:02:33.802063 2562 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall May 21 13:02:33.803992 ip-10-0-133-64 kubenswrapper[2562]: W0521 13:02:33.802066 2562 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration May 21 13:02:33.803992 ip-10-0-133-64 kubenswrapper[2562]: W0521 13:02:33.802069 2562 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints May 21 13:02:33.803992 ip-10-0-133-64 kubenswrapper[2562]: W0521 13:02:33.802071 2562 feature_gate.go:328] unrecognized feature gate: DualReplica May 21 13:02:33.803992 ip-10-0-133-64 kubenswrapper[2562]: W0521 13:02:33.802074 2562 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation May 21 13:02:33.803992 ip-10-0-133-64 kubenswrapper[2562]: W0521 13:02:33.802077 2562 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere May 21 13:02:33.804469 ip-10-0-133-64 kubenswrapper[2562]: W0521 13:02:33.802079 2562 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts May 21 13:02:33.804469 ip-10-0-133-64 kubenswrapper[2562]: W0521 13:02:33.802082 2562 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig May 21 13:02:33.804469 ip-10-0-133-64 kubenswrapper[2562]: W0521 13:02:33.802085 2562 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities May 21 13:02:33.804469 ip-10-0-133-64 kubenswrapper[2562]: W0521 13:02:33.802087 2562 feature_gate.go:328] unrecognized feature gate: InsightsConfigAPI May 21 13:02:33.804469 ip-10-0-133-64 kubenswrapper[2562]: W0521 13:02:33.802090 2562 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterOperations May 21 13:02:33.804469 ip-10-0-133-64 kubenswrapper[2562]: W0521 13:02:33.802092 2562 feature_gate.go:328] unrecognized feature gate: PinnedImages May 21 13:02:33.804469 ip-10-0-133-64 kubenswrapper[2562]: W0521 13:02:33.802095 2562 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup May 21 13:02:33.804469 ip-10-0-133-64 kubenswrapper[2562]: W0521 13:02:33.802097 2562 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy May 21 13:02:33.804469 ip-10-0-133-64 kubenswrapper[2562]: W0521 13:02:33.802100 2562 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure May 21 13:02:33.804469 ip-10-0-133-64 kubenswrapper[2562]: W0521 13:02:33.802102 2562 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation May 21 13:02:33.804469 ip-10-0-133-64 kubenswrapper[2562]: W0521 13:02:33.802105 2562 feature_gate.go:328] unrecognized feature gate: GatewayAPI May 21 13:02:33.804469 ip-10-0-133-64 kubenswrapper[2562]: W0521 13:02:33.802107 2562 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS May 21 13:02:33.804469 ip-10-0-133-64 kubenswrapper[2562]: W0521 13:02:33.802110 2562 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration May 21 13:02:33.804469 ip-10-0-133-64 kubenswrapper[2562]: W0521 13:02:33.802113 2562 feature_gate.go:328] unrecognized feature gate: ManagedBootImages May 21 13:02:33.804469 ip-10-0-133-64 kubenswrapper[2562]: W0521 13:02:33.802116 2562 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas May 21 13:02:33.804469 ip-10-0-133-64 kubenswrapper[2562]: W0521 13:02:33.802118 2562 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform May 21 13:02:33.804469 ip-10-0-133-64 kubenswrapper[2562]: W0521 13:02:33.802121 2562 feature_gate.go:328] unrecognized feature gate: InsightsConfig May 21 13:02:33.804469 ip-10-0-133-64 kubenswrapper[2562]: W0521 13:02:33.802123 2562 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements May 21 13:02:33.804932 ip-10-0-133-64 kubenswrapper[2562]: I0521 13:02:33.802128 2562 feature_gate.go:384] feature gates: {map[DynamicResourceAllocation:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutatingAdmissionPolicy:false NodeSwap:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:false]} May 21 13:02:33.804932 ip-10-0-133-64 kubenswrapper[2562]: W0521 13:02:33.802223 2562 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts May 21 13:02:33.804932 ip-10-0-133-64 kubenswrapper[2562]: W0521 13:02:33.802227 2562 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig May 21 13:02:33.804932 ip-10-0-133-64 kubenswrapper[2562]: W0521 13:02:33.802230 2562 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot May 21 13:02:33.804932 ip-10-0-133-64 kubenswrapper[2562]: W0521 13:02:33.802234 2562 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS May 21 13:02:33.804932 ip-10-0-133-64 kubenswrapper[2562]: W0521 13:02:33.802237 2562 feature_gate.go:328] unrecognized feature gate: InsightsConfigAPI May 21 13:02:33.804932 ip-10-0-133-64 kubenswrapper[2562]: W0521 13:02:33.802240 2562 feature_gate.go:328] unrecognized feature gate: GatewayAPI May 21 13:02:33.804932 ip-10-0-133-64 kubenswrapper[2562]: W0521 13:02:33.802242 2562 feature_gate.go:328] unrecognized feature gate: SignatureStores May 21 13:02:33.804932 ip-10-0-133-64 kubenswrapper[2562]: W0521 13:02:33.802245 2562 feature_gate.go:328] unrecognized feature gate: Example2 May 21 13:02:33.804932 ip-10-0-133-64 kubenswrapper[2562]: W0521 13:02:33.802249 2562 feature_gate.go:328] unrecognized feature gate: DualReplica May 21 13:02:33.804932 ip-10-0-133-64 kubenswrapper[2562]: W0521 13:02:33.802251 2562 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles May 21 13:02:33.804932 ip-10-0-133-64 kubenswrapper[2562]: W0521 13:02:33.802254 2562 feature_gate.go:328] unrecognized feature gate: GatewayAPIController May 21 13:02:33.804932 ip-10-0-133-64 kubenswrapper[2562]: W0521 13:02:33.802257 2562 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall May 21 13:02:33.804932 ip-10-0-133-64 kubenswrapper[2562]: W0521 13:02:33.802260 2562 feature_gate.go:328] unrecognized feature gate: Example May 21 13:02:33.804932 ip-10-0-133-64 kubenswrapper[2562]: W0521 13:02:33.802262 2562 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission May 21 13:02:33.804932 ip-10-0-133-64 kubenswrapper[2562]: W0521 13:02:33.802265 2562 feature_gate.go:328] unrecognized feature gate: UpgradeStatus May 21 13:02:33.805321 ip-10-0-133-64 kubenswrapper[2562]: W0521 13:02:33.802267 2562 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter May 21 13:02:33.805321 ip-10-0-133-64 kubenswrapper[2562]: W0521 13:02:33.802270 2562 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting May 21 13:02:33.805321 ip-10-0-133-64 kubenswrapper[2562]: W0521 13:02:33.802272 2562 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings May 21 13:02:33.805321 ip-10-0-133-64 kubenswrapper[2562]: W0521 13:02:33.802276 2562 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. May 21 13:02:33.805321 ip-10-0-133-64 kubenswrapper[2562]: W0521 13:02:33.802280 2562 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure May 21 13:02:33.805321 ip-10-0-133-64 kubenswrapper[2562]: W0521 13:02:33.802283 2562 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig May 21 13:02:33.805321 ip-10-0-133-64 kubenswrapper[2562]: W0521 13:02:33.802286 2562 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration May 21 13:02:33.805321 ip-10-0-133-64 kubenswrapper[2562]: W0521 13:02:33.802289 2562 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas May 21 13:02:33.805321 ip-10-0-133-64 kubenswrapper[2562]: W0521 13:02:33.802291 2562 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig May 21 13:02:33.805321 ip-10-0-133-64 kubenswrapper[2562]: W0521 13:02:33.802294 2562 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere May 21 13:02:33.805321 ip-10-0-133-64 kubenswrapper[2562]: W0521 13:02:33.802297 2562 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota May 21 13:02:33.805321 ip-10-0-133-64 kubenswrapper[2562]: W0521 13:02:33.802299 2562 feature_gate.go:328] unrecognized feature gate: ShortCertRotation May 21 13:02:33.805321 ip-10-0-133-64 kubenswrapper[2562]: W0521 13:02:33.802302 2562 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace May 21 13:02:33.805321 ip-10-0-133-64 kubenswrapper[2562]: W0521 13:02:33.802305 2562 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk May 21 13:02:33.805321 ip-10-0-133-64 kubenswrapper[2562]: W0521 13:02:33.802307 2562 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts May 21 13:02:33.805321 ip-10-0-133-64 kubenswrapper[2562]: W0521 13:02:33.802310 2562 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation May 21 13:02:33.805321 ip-10-0-133-64 kubenswrapper[2562]: W0521 13:02:33.802313 2562 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController May 21 13:02:33.805321 ip-10-0-133-64 kubenswrapper[2562]: W0521 13:02:33.802315 2562 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration May 21 13:02:33.805321 ip-10-0-133-64 kubenswrapper[2562]: W0521 13:02:33.802318 2562 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall May 21 13:02:33.805781 ip-10-0-133-64 kubenswrapper[2562]: W0521 13:02:33.802320 2562 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI May 21 13:02:33.805781 ip-10-0-133-64 kubenswrapper[2562]: W0521 13:02:33.802323 2562 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration May 21 13:02:33.805781 ip-10-0-133-64 kubenswrapper[2562]: W0521 13:02:33.802326 2562 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud May 21 13:02:33.805781 ip-10-0-133-64 kubenswrapper[2562]: W0521 13:02:33.802328 2562 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk May 21 13:02:33.805781 ip-10-0-133-64 kubenswrapper[2562]: W0521 13:02:33.802331 2562 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterOperations May 21 13:02:33.805781 ip-10-0-133-64 kubenswrapper[2562]: W0521 13:02:33.802334 2562 feature_gate.go:328] unrecognized feature gate: InsightsConfig May 21 13:02:33.805781 ip-10-0-133-64 kubenswrapper[2562]: W0521 13:02:33.802338 2562 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. May 21 13:02:33.805781 ip-10-0-133-64 kubenswrapper[2562]: W0521 13:02:33.802341 2562 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement May 21 13:02:33.805781 ip-10-0-133-64 kubenswrapper[2562]: W0521 13:02:33.802343 2562 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager May 21 13:02:33.805781 ip-10-0-133-64 kubenswrapper[2562]: W0521 13:02:33.802346 2562 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks May 21 13:02:33.805781 ip-10-0-133-64 kubenswrapper[2562]: W0521 13:02:33.802349 2562 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification May 21 13:02:33.805781 ip-10-0-133-64 kubenswrapper[2562]: W0521 13:02:33.802351 2562 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS May 21 13:02:33.805781 ip-10-0-133-64 kubenswrapper[2562]: W0521 13:02:33.802353 2562 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather May 21 13:02:33.805781 ip-10-0-133-64 kubenswrapper[2562]: W0521 13:02:33.802356 2562 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup May 21 13:02:33.805781 ip-10-0-133-64 kubenswrapper[2562]: W0521 13:02:33.802358 2562 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy May 21 13:02:33.805781 ip-10-0-133-64 kubenswrapper[2562]: W0521 13:02:33.802361 2562 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities May 21 13:02:33.805781 ip-10-0-133-64 kubenswrapper[2562]: W0521 13:02:33.802363 2562 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud May 21 13:02:33.805781 ip-10-0-133-64 kubenswrapper[2562]: W0521 13:02:33.802366 2562 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy May 21 13:02:33.805781 ip-10-0-133-64 kubenswrapper[2562]: W0521 13:02:33.802368 2562 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity May 21 13:02:33.806254 ip-10-0-133-64 kubenswrapper[2562]: W0521 13:02:33.802371 2562 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall May 21 13:02:33.806254 ip-10-0-133-64 kubenswrapper[2562]: W0521 13:02:33.802373 2562 feature_gate.go:328] unrecognized feature gate: NewOLM May 21 13:02:33.806254 ip-10-0-133-64 kubenswrapper[2562]: W0521 13:02:33.802376 2562 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall May 21 13:02:33.806254 ip-10-0-133-64 kubenswrapper[2562]: W0521 13:02:33.802379 2562 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv May 21 13:02:33.806254 ip-10-0-133-64 kubenswrapper[2562]: W0521 13:02:33.802381 2562 feature_gate.go:328] unrecognized feature gate: DNSNameResolver May 21 13:02:33.806254 ip-10-0-133-64 kubenswrapper[2562]: W0521 13:02:33.802383 2562 feature_gate.go:328] unrecognized feature gate: OVNObservability May 21 13:02:33.806254 ip-10-0-133-64 kubenswrapper[2562]: W0521 13:02:33.802386 2562 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal May 21 13:02:33.806254 ip-10-0-133-64 kubenswrapper[2562]: W0521 13:02:33.802388 2562 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata May 21 13:02:33.806254 ip-10-0-133-64 kubenswrapper[2562]: W0521 13:02:33.802391 2562 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks May 21 13:02:33.806254 ip-10-0-133-64 kubenswrapper[2562]: W0521 13:02:33.802393 2562 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode May 21 13:02:33.806254 ip-10-0-133-64 kubenswrapper[2562]: W0521 13:02:33.802396 2562 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints May 21 13:02:33.806254 ip-10-0-133-64 kubenswrapper[2562]: W0521 13:02:33.802398 2562 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation May 21 13:02:33.806254 ip-10-0-133-64 kubenswrapper[2562]: W0521 13:02:33.802401 2562 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements May 21 13:02:33.806254 ip-10-0-133-64 kubenswrapper[2562]: W0521 13:02:33.802403 2562 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform May 21 13:02:33.806254 ip-10-0-133-64 kubenswrapper[2562]: W0521 13:02:33.802406 2562 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode May 21 13:02:33.806254 ip-10-0-133-64 kubenswrapper[2562]: W0521 13:02:33.802408 2562 feature_gate.go:328] unrecognized feature gate: ExternalOIDC May 21 13:02:33.806254 ip-10-0-133-64 kubenswrapper[2562]: W0521 13:02:33.802411 2562 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses May 21 13:02:33.806254 ip-10-0-133-64 kubenswrapper[2562]: W0521 13:02:33.802414 2562 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS May 21 13:02:33.806254 ip-10-0-133-64 kubenswrapper[2562]: W0521 13:02:33.802417 2562 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA May 21 13:02:33.806254 ip-10-0-133-64 kubenswrapper[2562]: W0521 13:02:33.802419 2562 feature_gate.go:328] unrecognized feature gate: PinnedImages May 21 13:02:33.806733 ip-10-0-133-64 kubenswrapper[2562]: W0521 13:02:33.802422 2562 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix May 21 13:02:33.806733 ip-10-0-133-64 kubenswrapper[2562]: W0521 13:02:33.802424 2562 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes May 21 13:02:33.806733 ip-10-0-133-64 kubenswrapper[2562]: W0521 13:02:33.802427 2562 feature_gate.go:328] unrecognized feature gate: SetEIPForNLBIngressController May 21 13:02:33.806733 ip-10-0-133-64 kubenswrapper[2562]: W0521 13:02:33.802429 2562 feature_gate.go:328] unrecognized feature gate: ManagedBootImages May 21 13:02:33.806733 ip-10-0-133-64 kubenswrapper[2562]: W0521 13:02:33.802432 2562 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure May 21 13:02:33.806733 ip-10-0-133-64 kubenswrapper[2562]: W0521 13:02:33.802434 2562 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall May 21 13:02:33.806733 ip-10-0-133-64 kubenswrapper[2562]: W0521 13:02:33.802437 2562 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement May 21 13:02:33.806733 ip-10-0-133-64 kubenswrapper[2562]: W0521 13:02:33.802439 2562 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup May 21 13:02:33.806733 ip-10-0-133-64 kubenswrapper[2562]: W0521 13:02:33.802442 2562 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets May 21 13:02:33.806733 ip-10-0-133-64 kubenswrapper[2562]: W0521 13:02:33.802445 2562 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes May 21 13:02:33.806733 ip-10-0-133-64 kubenswrapper[2562]: W0521 13:02:33.802447 2562 feature_gate.go:328] unrecognized feature gate: IngressControllerLBSubnetsAWS May 21 13:02:33.806733 ip-10-0-133-64 kubenswrapper[2562]: W0521 13:02:33.802450 2562 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider May 21 13:02:33.806733 ip-10-0-133-64 kubenswrapper[2562]: W0521 13:02:33.802452 2562 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup May 21 13:02:33.806733 ip-10-0-133-64 kubenswrapper[2562]: I0521 13:02:33.802457 2562 feature_gate.go:384] feature gates: {map[DynamicResourceAllocation:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutatingAdmissionPolicy:false NodeSwap:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:false]} May 21 13:02:33.806733 ip-10-0-133-64 kubenswrapper[2562]: I0521 13:02:33.803313 2562 server.go:962] "Client rotation is on, will bootstrap in background" May 21 13:02:33.807899 ip-10-0-133-64 kubenswrapper[2562]: I0521 13:02:33.807886 2562 bootstrap.go:101] "Use the bootstrap credentials to request a cert, and set kubeconfig to point to the certificate dir" May 21 13:02:33.808793 ip-10-0-133-64 kubenswrapper[2562]: I0521 13:02:33.808780 2562 server.go:1019] "Starting client certificate rotation" May 21 13:02:33.808913 ip-10-0-133-64 kubenswrapper[2562]: I0521 13:02:33.808896 2562 certificate_manager.go:422] "Certificate rotation is enabled" logger="kubernetes.io/kube-apiserver-client-kubelet" May 21 13:02:33.808965 ip-10-0-133-64 kubenswrapper[2562]: I0521 13:02:33.808944 2562 certificate_manager.go:566] "Rotating certificates" logger="kubernetes.io/kube-apiserver-client-kubelet" May 21 13:02:33.835319 ip-10-0-133-64 kubenswrapper[2562]: I0521 13:02:33.835299 2562 dynamic_cafile_content.go:123] "Loaded a new CA Bundle and Verifier" name="client-ca-bundle::/etc/kubernetes/kubelet-ca.crt" May 21 13:02:33.840527 ip-10-0-133-64 kubenswrapper[2562]: I0521 13:02:33.840510 2562 dynamic_cafile_content.go:161] "Starting controller" name="client-ca-bundle::/etc/kubernetes/kubelet-ca.crt" May 21 13:02:33.858394 ip-10-0-133-64 kubenswrapper[2562]: I0521 13:02:33.858373 2562 log.go:25] "Validated CRI v1 runtime API" May 21 13:02:33.864286 ip-10-0-133-64 kubenswrapper[2562]: I0521 13:02:33.864269 2562 log.go:25] "Validated CRI v1 image API" May 21 13:02:33.865515 ip-10-0-133-64 kubenswrapper[2562]: I0521 13:02:33.865500 2562 server.go:1452] "Using cgroup driver setting received from the CRI runtime" cgroupDriver="systemd" May 21 13:02:33.866519 ip-10-0-133-64 kubenswrapper[2562]: I0521 13:02:33.866498 2562 reflector.go:430] "Caches populated" logger="kubernetes.io/kube-apiserver-client-kubelet" type="*v1.CertificateSigningRequest" reflector="k8s.io/client-go/tools/watch/informerwatcher.go:162" May 21 13:02:33.868057 ip-10-0-133-64 kubenswrapper[2562]: I0521 13:02:33.868036 2562 fs.go:135] Filesystem UUIDs: map[46790cff-9b89-4c5d-9aec-9febc4eb3e58:/dev/nvme0n1p3 7B77-95E7:/dev/nvme0n1p2 f43dce69-c97e-4fdc-8cf6-c55f74697cd1:/dev/nvme0n1p4] May 21 13:02:33.868122 ip-10-0-133-64 kubenswrapper[2562]: I0521 13:02:33.868057 2562 fs.go:136] Filesystem partitions: map[/dev/nvme0n1p3:{mountpoint:/boot major:259 minor:3 fsType:ext4 blockSize:0} /dev/nvme0n1p4:{mountpoint:/var major:259 minor:4 fsType:xfs blockSize:0} /dev/shm:{mountpoint:/dev/shm major:0 minor:22 fsType:tmpfs blockSize:0} /run:{mountpoint:/run major:0 minor:24 fsType:tmpfs blockSize:0} /tmp:{mountpoint:/tmp major:0 minor:31 fsType:tmpfs blockSize:0} composefs_0-33:{mountpoint:/ major:0 minor:33 fsType:overlay blockSize:0}] May 21 13:02:33.872422 ip-10-0-133-64 kubenswrapper[2562]: I0521 13:02:33.872318 2562 manager.go:217] Machine: {Timestamp:2026-05-21 13:02:33.871769819 +0000 UTC m=+0.422051177 CPUVendorID:GenuineIntel NumCores:8 NumPhysicalCores:4 NumSockets:1 CpuFrequency:3956000 MemoryCapacity:33164496896 SwapCapacity:0 MemoryByType:map[] NVMInfo:{MemoryModeCapacity:0 AppDirectModeCapacity:0 AvgPowerBudget:0} HugePages:[{PageSize:1048576 NumPages:0} {PageSize:2048 NumPages:0}] MachineID:ec225587f6b710d9688a2806d9fd77db SystemUUID:ec225587-f6b7-10d9-688a-2806d9fd77db BootID:f44211a7-f71d-42ce-b050-3f4ce598ed48 Filesystems:[{Device:composefs_0-33 DeviceMajor:0 DeviceMinor:33 Capacity:6103040 Type:vfs Inodes:18446744073709551615 HasInodes:true} {Device:/tmp DeviceMajor:0 DeviceMinor:31 Capacity:16582250496 Type:vfs Inodes:1048576 HasInodes:true} {Device:/dev/nvme0n1p3 DeviceMajor:259 DeviceMinor:3 Capacity:366869504 Type:vfs Inodes:98304 HasInodes:true} {Device:/dev/shm DeviceMajor:0 DeviceMinor:22 Capacity:16582246400 Type:vfs Inodes:4048400 HasInodes:true} {Device:/run DeviceMajor:0 DeviceMinor:24 Capacity:6632902656 Type:vfs Inodes:819200 HasInodes:true} {Device:/dev/nvme0n1p4 DeviceMajor:259 DeviceMinor:4 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true}] DiskMap:map[259:0:{Name:nvme0n1 Major:259 Minor:0 Size:128849018880 Scheduler:none}] NetworkDevices:[{Name:br-ex MacAddress:02:27:d2:fe:dc:0d Speed:0 Mtu:9001} {Name:ens5 MacAddress:02:27:d2:fe:dc:0d Speed:0 Mtu:9001} {Name:ovs-system MacAddress:66:de:49:f7:45:99 Speed:0 Mtu:1500}] Topology:[{Id:0 Memory:33164496896 HugePages:[{PageSize:1048576 NumPages:0} {PageSize:2048 NumPages:0}] Cores:[{Id:0 Threads:[0 4] Caches:[{Id:0 Size:32768 Type:Data Level:1} {Id:0 Size:32768 Type:Instruction Level:1} {Id:0 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:1 Threads:[1 5] Caches:[{Id:1 Size:32768 Type:Data Level:1} {Id:1 Size:32768 Type:Instruction Level:1} {Id:1 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:2 Threads:[2 6] Caches:[{Id:2 Size:32768 Type:Data Level:1} {Id:2 Size:32768 Type:Instruction Level:1} {Id:2 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:3 Threads:[3 7] Caches:[{Id:3 Size:32768 Type:Data Level:1} {Id:3 Size:32768 Type:Instruction Level:1} {Id:3 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:}] Caches:[{Id:0 Size:37486592 Type:Unified Level:3}] Distances:[10]}] CloudProvider:Unknown InstanceType:Unknown InstanceID:None} May 21 13:02:33.873184 ip-10-0-133-64 kubenswrapper[2562]: I0521 13:02:33.873174 2562 manager_no_libpfm.go:29] cAdvisor is build without cgo and/or libpfm support. Perf event counters are not available. May 21 13:02:33.873271 ip-10-0-133-64 kubenswrapper[2562]: I0521 13:02:33.873259 2562 manager.go:233] Version: {KernelVersion:5.14.0-570.114.1.el9_6.x86_64 ContainerOsVersion:Red Hat Enterprise Linux CoreOS 9.6.20260512-0 (Plow) DockerVersion: DockerAPIVersion: CadvisorVersion: CadvisorRevision:} May 21 13:02:33.877211 ip-10-0-133-64 kubenswrapper[2562]: I0521 13:02:33.877185 2562 container_manager_linux.go:270] "Container manager verified user specified cgroup-root exists" cgroupRoot=[] May 21 13:02:33.877355 ip-10-0-133-64 kubenswrapper[2562]: I0521 13:02:33.877215 2562 container_manager_linux.go:275] "Creating Container Manager object based on Node Config" nodeConfig={"NodeName":"ip-10-0-133-64.ec2.internal","RuntimeCgroupsName":"/system.slice/crio.service","SystemCgroupsName":"/system.slice","KubeletCgroupsName":"","KubeletOOMScoreAdj":-999,"ContainerRuntime":"","CgroupsPerQOS":true,"CgroupRoot":"/","CgroupDriver":"systemd","KubeletRootDir":"/var/lib/kubelet","ProtectKernelDefaults":true,"KubeReservedCgroupName":"","SystemReservedCgroupName":"","ReservedSystemCPUs":{},"EnforceNodeAllocatable":{"pods":{}},"KubeReserved":null,"SystemReserved":{"cpu":"500m","ephemeral-storage":"1Gi","memory":"1Gi"},"HardEvictionThresholds":[{"Signal":"nodefs.available","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.1},"GracePeriod":0,"MinReclaim":null},{"Signal":"nodefs.inodesFree","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.05},"GracePeriod":0,"MinReclaim":null},{"Signal":"imagefs.available","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.15},"GracePeriod":0,"MinReclaim":null},{"Signal":"imagefs.inodesFree","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.05},"GracePeriod":0,"MinReclaim":null},{"Signal":"memory.available","Operator":"LessThan","Value":{"Quantity":"100Mi","Percentage":0},"GracePeriod":0,"MinReclaim":null}],"QOSReserved":{},"CPUManagerPolicy":"none","CPUManagerPolicyOptions":null,"TopologyManagerScope":"container","CPUManagerReconcilePeriod":10000000000,"MemoryManagerPolicy":"None","MemoryManagerReservedMemory":null,"PodPidsLimit":4096,"EnforceCPULimits":true,"CPUCFSQuotaPeriod":100000000,"TopologyManagerPolicy":"none","TopologyManagerPolicyOptions":null,"CgroupVersion":2} May 21 13:02:33.877406 ip-10-0-133-64 kubenswrapper[2562]: I0521 13:02:33.877366 2562 topology_manager.go:138] "Creating topology manager with none policy" May 21 13:02:33.877406 ip-10-0-133-64 kubenswrapper[2562]: I0521 13:02:33.877374 2562 container_manager_linux.go:306] "Creating device plugin manager" May 21 13:02:33.877406 ip-10-0-133-64 kubenswrapper[2562]: I0521 13:02:33.877382 2562 manager.go:141] "Creating Device Plugin manager" path="/var/lib/kubelet/device-plugins/kubelet.sock" May 21 13:02:33.877406 ip-10-0-133-64 kubenswrapper[2562]: I0521 13:02:33.877397 2562 server.go:72] "Creating device plugin registration server" version="v1beta1" socket="/var/lib/kubelet/device-plugins/kubelet.sock" May 21 13:02:33.878901 ip-10-0-133-64 kubenswrapper[2562]: I0521 13:02:33.878890 2562 state_mem.go:36] "Initialized new in-memory state store" May 21 13:02:33.879035 ip-10-0-133-64 kubenswrapper[2562]: I0521 13:02:33.879026 2562 server.go:1267] "Using root directory" path="/var/lib/kubelet" May 21 13:02:33.882190 ip-10-0-133-64 kubenswrapper[2562]: I0521 13:02:33.882180 2562 kubelet.go:491] "Attempting to sync node with API server" May 21 13:02:33.882222 ip-10-0-133-64 kubenswrapper[2562]: I0521 13:02:33.882196 2562 kubelet.go:386] "Adding static pod path" path="/etc/kubernetes/manifests" May 21 13:02:33.882222 ip-10-0-133-64 kubenswrapper[2562]: I0521 13:02:33.882212 2562 file.go:69] "Watching path" path="/etc/kubernetes/manifests" May 21 13:02:33.882222 ip-10-0-133-64 kubenswrapper[2562]: I0521 13:02:33.882222 2562 kubelet.go:397] "Adding apiserver pod source" May 21 13:02:33.882317 ip-10-0-133-64 kubenswrapper[2562]: I0521 13:02:33.882230 2562 apiserver.go:42] "Waiting for node sync before watching apiserver pods" May 21 13:02:33.883399 ip-10-0-133-64 kubenswrapper[2562]: I0521 13:02:33.883385 2562 state_mem.go:40] "Initialized new in-memory state store for pod resource information tracking" May 21 13:02:33.883453 ip-10-0-133-64 kubenswrapper[2562]: I0521 13:02:33.883411 2562 state_mem.go:40] "Initialized new in-memory state store for pod resource information tracking" May 21 13:02:33.886668 ip-10-0-133-64 kubenswrapper[2562]: I0521 13:02:33.886650 2562 kuberuntime_manager.go:279] "Container runtime initialized" containerRuntime="cri-o" version="1.33.11-2.rhaos4.20.gitb2a8320.el9" apiVersion="v1" May 21 13:02:33.888346 ip-10-0-133-64 kubenswrapper[2562]: I0521 13:02:33.888323 2562 kubelet.go:953] "Not starting ClusterTrustBundle informer because we are in static kubelet mode or the ClusterTrustBundleProjection featuregate is disabled" May 21 13:02:33.889492 ip-10-0-133-64 kubenswrapper[2562]: I0521 13:02:33.889480 2562 plugins.go:616] "Loaded volume plugin" pluginName="kubernetes.io/portworx-volume" May 21 13:02:33.889538 ip-10-0-133-64 kubenswrapper[2562]: I0521 13:02:33.889497 2562 plugins.go:616] "Loaded volume plugin" pluginName="kubernetes.io/empty-dir" May 21 13:02:33.889538 ip-10-0-133-64 kubenswrapper[2562]: I0521 13:02:33.889504 2562 plugins.go:616] "Loaded volume plugin" pluginName="kubernetes.io/git-repo" May 21 13:02:33.889538 ip-10-0-133-64 kubenswrapper[2562]: I0521 13:02:33.889509 2562 plugins.go:616] "Loaded volume plugin" pluginName="kubernetes.io/host-path" May 21 13:02:33.889538 ip-10-0-133-64 kubenswrapper[2562]: I0521 13:02:33.889518 2562 plugins.go:616] "Loaded volume plugin" pluginName="kubernetes.io/nfs" May 21 13:02:33.889538 ip-10-0-133-64 kubenswrapper[2562]: I0521 13:02:33.889524 2562 plugins.go:616] "Loaded volume plugin" pluginName="kubernetes.io/secret" May 21 13:02:33.889677 ip-10-0-133-64 kubenswrapper[2562]: I0521 13:02:33.889542 2562 plugins.go:616] "Loaded volume plugin" pluginName="kubernetes.io/iscsi" May 21 13:02:33.889677 ip-10-0-133-64 kubenswrapper[2562]: I0521 13:02:33.889548 2562 plugins.go:616] "Loaded volume plugin" pluginName="kubernetes.io/downward-api" May 21 13:02:33.889677 ip-10-0-133-64 kubenswrapper[2562]: I0521 13:02:33.889555 2562 plugins.go:616] "Loaded volume plugin" pluginName="kubernetes.io/fc" May 21 13:02:33.889677 ip-10-0-133-64 kubenswrapper[2562]: I0521 13:02:33.889561 2562 plugins.go:616] "Loaded volume plugin" pluginName="kubernetes.io/configmap" May 21 13:02:33.889677 ip-10-0-133-64 kubenswrapper[2562]: I0521 13:02:33.889581 2562 plugins.go:616] "Loaded volume plugin" pluginName="kubernetes.io/projected" May 21 13:02:33.889677 ip-10-0-133-64 kubenswrapper[2562]: I0521 13:02:33.889587 2562 plugins.go:616] "Loaded volume plugin" pluginName="kubernetes.io/local-volume" May 21 13:02:33.890368 ip-10-0-133-64 kubenswrapper[2562]: I0521 13:02:33.890359 2562 plugins.go:616] "Loaded volume plugin" pluginName="kubernetes.io/csi" May 21 13:02:33.890398 ip-10-0-133-64 kubenswrapper[2562]: I0521 13:02:33.890368 2562 plugins.go:616] "Loaded volume plugin" pluginName="kubernetes.io/image" May 21 13:02:33.893944 ip-10-0-133-64 kubenswrapper[2562]: I0521 13:02:33.893920 2562 watchdog_linux.go:99] "Systemd watchdog is not enabled" May 21 13:02:33.894191 ip-10-0-133-64 kubenswrapper[2562]: I0521 13:02:33.894167 2562 server.go:1295] "Started kubelet" May 21 13:02:33.894687 ip-10-0-133-64 kubenswrapper[2562]: I0521 13:02:33.894647 2562 ratelimit.go:55] "Setting rate limiting for endpoint" service="podresources" qps=100 burstTokens=10 May 21 13:02:33.894768 ip-10-0-133-64 kubenswrapper[2562]: I0521 13:02:33.894715 2562 server_v1.go:47] "podresources" method="list" useActivePods=true May 21 13:02:33.895040 ip-10-0-133-64 systemd[1]: Started Kubernetes Kubelet. May 21 13:02:33.895727 ip-10-0-133-64 kubenswrapper[2562]: I0521 13:02:33.895597 2562 server.go:180] "Starting to listen" address="0.0.0.0" port=10250 May 21 13:02:33.896816 ip-10-0-133-64 kubenswrapper[2562]: I0521 13:02:33.896783 2562 csi_plugin.go:988] Failed to contact API server when waiting for CSINode publishing: csinodes.storage.k8s.io "ip-10-0-133-64.ec2.internal" is forbidden: User "system:anonymous" cannot get resource "csinodes" in API group "storage.k8s.io" at the cluster scope May 21 13:02:33.896981 ip-10-0-133-64 kubenswrapper[2562]: I0521 13:02:33.896963 2562 server.go:255] "Starting to serve the podresources API" endpoint="unix:/var/lib/kubelet/pod-resources/kubelet.sock" May 21 13:02:33.897404 ip-10-0-133-64 kubenswrapper[2562]: E0521 13:02:33.897382 2562 reflector.go:200] "Failed to watch" err="failed to list *v1.Service: services is forbidden: User \"system:anonymous\" cannot list resource \"services\" in API group \"\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Service" May 21 13:02:33.897470 ip-10-0-133-64 kubenswrapper[2562]: E0521 13:02:33.897381 2562 reflector.go:200] "Failed to watch" err="failed to list *v1.Node: nodes \"ip-10-0-133-64.ec2.internal\" is forbidden: User \"system:anonymous\" cannot list resource \"nodes\" in API group \"\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Node" May 21 13:02:33.899667 ip-10-0-133-64 kubenswrapper[2562]: I0521 13:02:33.899653 2562 server.go:317] "Adding debug handlers to kubelet server" May 21 13:02:33.903319 ip-10-0-133-64 kubenswrapper[2562]: I0521 13:02:33.903115 2562 csr.go:274] "Certificate signing request is approved, waiting to be issued" logger="kubernetes.io/kube-apiserver-client-kubelet" csr="csr-l967j" May 21 13:02:33.904027 ip-10-0-133-64 kubenswrapper[2562]: I0521 13:02:33.904009 2562 fs_resource_analyzer.go:67] "Starting FS ResourceAnalyzer" May 21 13:02:33.904114 ip-10-0-133-64 kubenswrapper[2562]: I0521 13:02:33.904030 2562 certificate_manager.go:422] "Certificate rotation is enabled" logger="kubernetes.io/kubelet-serving" May 21 13:02:33.904114 ip-10-0-133-64 kubenswrapper[2562]: I0521 13:02:33.904098 2562 volume_manager.go:295] "The desired_state_of_world populator starts" May 21 13:02:33.904114 ip-10-0-133-64 kubenswrapper[2562]: I0521 13:02:33.904109 2562 volume_manager.go:297] "Starting Kubelet Volume Manager" May 21 13:02:33.904259 ip-10-0-133-64 kubenswrapper[2562]: I0521 13:02:33.904217 2562 desired_state_of_world_populator.go:150] "Desired state populator starts to run" May 21 13:02:33.904259 ip-10-0-133-64 kubenswrapper[2562]: I0521 13:02:33.904243 2562 reconstruct.go:97] "Volume reconstruction finished" May 21 13:02:33.904259 ip-10-0-133-64 kubenswrapper[2562]: I0521 13:02:33.904252 2562 reconciler.go:26] "Reconciler: start to sync state" May 21 13:02:33.905028 ip-10-0-133-64 kubenswrapper[2562]: E0521 13:02:33.904862 2562 kubelet_node_status.go:515] "Error getting the current node from lister" err="node \"ip-10-0-133-64.ec2.internal\" not found" May 21 13:02:33.905028 ip-10-0-133-64 kubenswrapper[2562]: I0521 13:02:33.904969 2562 factory.go:55] Registering systemd factory May 21 13:02:33.905154 ip-10-0-133-64 kubenswrapper[2562]: I0521 13:02:33.905041 2562 factory.go:223] Registration of the systemd container factory successfully May 21 13:02:33.905292 ip-10-0-133-64 kubenswrapper[2562]: I0521 13:02:33.905273 2562 factory.go:153] Registering CRI-O factory May 21 13:02:33.905292 ip-10-0-133-64 kubenswrapper[2562]: I0521 13:02:33.905293 2562 factory.go:223] Registration of the crio container factory successfully May 21 13:02:33.905409 ip-10-0-133-64 kubenswrapper[2562]: I0521 13:02:33.905383 2562 factory.go:221] Registration of the containerd container factory failed: unable to create containerd client: containerd: cannot unix dial containerd api service: dial unix /run/containerd/containerd.sock: connect: no such file or directory May 21 13:02:33.905461 ip-10-0-133-64 kubenswrapper[2562]: I0521 13:02:33.905419 2562 factory.go:103] Registering Raw factory May 21 13:02:33.905461 ip-10-0-133-64 kubenswrapper[2562]: I0521 13:02:33.905434 2562 manager.go:1196] Started watching for new ooms in manager May 21 13:02:33.905844 ip-10-0-133-64 kubenswrapper[2562]: E0521 13:02:33.904855 2562 event.go:359] "Server rejected event (will not retry!)" err="events is forbidden: User \"system:anonymous\" cannot create resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-133-64.ec2.internal.18b19645b359589c default 0 0001-01-01 00:00:00 +0000 UTC map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-133-64.ec2.internal,UID:ip-10-0-133-64.ec2.internal,APIVersion:,ResourceVersion:,FieldPath:,},Reason:Starting,Message:Starting kubelet.,Source:EventSource{Component:kubelet,Host:ip-10-0-133-64.ec2.internal,},FirstTimestamp:2026-05-21 13:02:33.893943452 +0000 UTC m=+0.444224822,LastTimestamp:2026-05-21 13:02:33.893943452 +0000 UTC m=+0.444224822,Count:1,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-133-64.ec2.internal,}" May 21 13:02:33.905965 ip-10-0-133-64 kubenswrapper[2562]: I0521 13:02:33.905843 2562 manager.go:319] Starting recovery of all containers May 21 13:02:33.906147 ip-10-0-133-64 kubenswrapper[2562]: E0521 13:02:33.905868 2562 kubelet.go:1618] "Image garbage collection failed once. Stats initialization may not have completed yet" err="failed to get imageFs info: unable to find data in memory cache" May 21 13:02:33.909604 ip-10-0-133-64 kubenswrapper[2562]: I0521 13:02:33.909578 2562 csr.go:270] "Certificate signing request is issued" logger="kubernetes.io/kube-apiserver-client-kubelet" csr="csr-l967j" May 21 13:02:33.915213 ip-10-0-133-64 kubenswrapper[2562]: I0521 13:02:33.915175 2562 reflector.go:430] "Caches populated" type="*v1.CSIDriver" reflector="k8s.io/client-go/informers/factory.go:160" May 21 13:02:33.916258 ip-10-0-133-64 kubenswrapper[2562]: I0521 13:02:33.916241 2562 manager.go:324] Recovery completed May 21 13:02:33.917923 ip-10-0-133-64 kubenswrapper[2562]: E0521 13:02:33.917906 2562 nodelease.go:49] "Failed to get node when trying to set owner ref to the node lease" err="nodes \"ip-10-0-133-64.ec2.internal\" not found" node="ip-10-0-133-64.ec2.internal" May 21 13:02:33.920737 ip-10-0-133-64 kubenswrapper[2562]: I0521 13:02:33.920725 2562 kubelet_node_status.go:413] "Setting node annotation to enable volume controller attach/detach" May 21 13:02:33.923316 ip-10-0-133-64 kubenswrapper[2562]: I0521 13:02:33.923300 2562 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-133-64.ec2.internal" event="NodeHasSufficientMemory" May 21 13:02:33.923385 ip-10-0-133-64 kubenswrapper[2562]: I0521 13:02:33.923376 2562 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-133-64.ec2.internal" event="NodeHasNoDiskPressure" May 21 13:02:33.923421 ip-10-0-133-64 kubenswrapper[2562]: I0521 13:02:33.923393 2562 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-133-64.ec2.internal" event="NodeHasSufficientPID" May 21 13:02:33.923920 ip-10-0-133-64 kubenswrapper[2562]: I0521 13:02:33.923905 2562 cpu_manager.go:222] "Starting CPU manager" policy="none" May 21 13:02:33.923920 ip-10-0-133-64 kubenswrapper[2562]: I0521 13:02:33.923920 2562 cpu_manager.go:223] "Reconciling" reconcilePeriod="10s" May 21 13:02:33.924015 ip-10-0-133-64 kubenswrapper[2562]: I0521 13:02:33.923939 2562 state_mem.go:36] "Initialized new in-memory state store" May 21 13:02:33.926409 ip-10-0-133-64 kubenswrapper[2562]: I0521 13:02:33.926398 2562 policy_none.go:49] "None policy: Start" May 21 13:02:33.926454 ip-10-0-133-64 kubenswrapper[2562]: I0521 13:02:33.926415 2562 memory_manager.go:186] "Starting memorymanager" policy="None" May 21 13:02:33.926454 ip-10-0-133-64 kubenswrapper[2562]: I0521 13:02:33.926425 2562 state_mem.go:35] "Initializing new in-memory state store" May 21 13:02:33.965360 ip-10-0-133-64 kubenswrapper[2562]: I0521 13:02:33.965344 2562 manager.go:341] "Starting Device Plugin manager" May 21 13:02:33.971410 ip-10-0-133-64 kubenswrapper[2562]: E0521 13:02:33.965420 2562 manager.go:517] "Failed to read data from checkpoint" err="checkpoint is not found" checkpoint="kubelet_internal_checkpoint" May 21 13:02:33.971410 ip-10-0-133-64 kubenswrapper[2562]: I0521 13:02:33.965440 2562 server.go:85] "Starting device plugin registration server" May 21 13:02:33.971410 ip-10-0-133-64 kubenswrapper[2562]: I0521 13:02:33.965657 2562 eviction_manager.go:189] "Eviction manager: starting control loop" May 21 13:02:33.971410 ip-10-0-133-64 kubenswrapper[2562]: I0521 13:02:33.965667 2562 container_log_manager.go:189] "Initializing container log rotate workers" workers=1 monitorPeriod="10s" May 21 13:02:33.971410 ip-10-0-133-64 kubenswrapper[2562]: I0521 13:02:33.965760 2562 plugin_watcher.go:51] "Plugin Watcher Start" path="/var/lib/kubelet/plugins_registry" May 21 13:02:33.971410 ip-10-0-133-64 kubenswrapper[2562]: I0521 13:02:33.965851 2562 plugin_manager.go:116] "The desired_state_of_world populator (plugin watcher) starts" May 21 13:02:33.971410 ip-10-0-133-64 kubenswrapper[2562]: I0521 13:02:33.965860 2562 plugin_manager.go:118] "Starting Kubelet Plugin Manager" May 21 13:02:33.971410 ip-10-0-133-64 kubenswrapper[2562]: E0521 13:02:33.966288 2562 eviction_manager.go:267] "eviction manager: failed to check if we have separate container filesystem. Ignoring." err="non-existent label \"crio-containers\"" May 21 13:02:33.971410 ip-10-0-133-64 kubenswrapper[2562]: E0521 13:02:33.966321 2562 eviction_manager.go:292] "Eviction manager: failed to get summary stats" err="failed to get node info: node \"ip-10-0-133-64.ec2.internal\" not found" May 21 13:02:34.031224 ip-10-0-133-64 kubenswrapper[2562]: I0521 13:02:34.031186 2562 kubelet_network_linux.go:49] "Initialized iptables rules." protocol="IPv4" May 21 13:02:34.032363 ip-10-0-133-64 kubenswrapper[2562]: I0521 13:02:34.032340 2562 kubelet_network_linux.go:49] "Initialized iptables rules." protocol="IPv6" May 21 13:02:34.032454 ip-10-0-133-64 kubenswrapper[2562]: I0521 13:02:34.032368 2562 status_manager.go:230] "Starting to sync pod status with apiserver" May 21 13:02:34.032454 ip-10-0-133-64 kubenswrapper[2562]: I0521 13:02:34.032388 2562 watchdog_linux.go:127] "Systemd watchdog is not enabled or the interval is invalid, so health checking will not be started." May 21 13:02:34.032454 ip-10-0-133-64 kubenswrapper[2562]: I0521 13:02:34.032398 2562 kubelet.go:2451] "Starting kubelet main sync loop" May 21 13:02:34.032454 ip-10-0-133-64 kubenswrapper[2562]: E0521 13:02:34.032440 2562 kubelet.go:2475] "Skipping pod synchronization" err="PLEG is not healthy: pleg has yet to be successful" May 21 13:02:34.035677 ip-10-0-133-64 kubenswrapper[2562]: I0521 13:02:34.035626 2562 reflector.go:430] "Caches populated" type="*v1.RuntimeClass" reflector="k8s.io/client-go/informers/factory.go:160" May 21 13:02:34.066754 ip-10-0-133-64 kubenswrapper[2562]: I0521 13:02:34.066736 2562 kubelet_node_status.go:413] "Setting node annotation to enable volume controller attach/detach" May 21 13:02:34.067781 ip-10-0-133-64 kubenswrapper[2562]: I0521 13:02:34.067766 2562 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-133-64.ec2.internal" event="NodeHasSufficientMemory" May 21 13:02:34.067859 ip-10-0-133-64 kubenswrapper[2562]: I0521 13:02:34.067794 2562 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-133-64.ec2.internal" event="NodeHasNoDiskPressure" May 21 13:02:34.067859 ip-10-0-133-64 kubenswrapper[2562]: I0521 13:02:34.067821 2562 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-133-64.ec2.internal" event="NodeHasSufficientPID" May 21 13:02:34.067859 ip-10-0-133-64 kubenswrapper[2562]: I0521 13:02:34.067845 2562 kubelet_node_status.go:78] "Attempting to register node" node="ip-10-0-133-64.ec2.internal" May 21 13:02:34.075888 ip-10-0-133-64 kubenswrapper[2562]: I0521 13:02:34.075873 2562 kubelet_node_status.go:81] "Successfully registered node" node="ip-10-0-133-64.ec2.internal" May 21 13:02:34.075937 ip-10-0-133-64 kubenswrapper[2562]: E0521 13:02:34.075895 2562 kubelet_node_status.go:597] "Error updating node status, will retry" err="error getting node \"ip-10-0-133-64.ec2.internal\": node \"ip-10-0-133-64.ec2.internal\" not found" May 21 13:02:34.091531 ip-10-0-133-64 kubenswrapper[2562]: E0521 13:02:34.091508 2562 kubelet_node_status.go:515] "Error getting the current node from lister" err="node \"ip-10-0-133-64.ec2.internal\" not found" May 21 13:02:34.133525 ip-10-0-133-64 kubenswrapper[2562]: I0521 13:02:34.133478 2562 kubelet.go:2537] "SyncLoop ADD" source="file" pods=["openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-133-64.ec2.internal","kube-system/kube-apiserver-proxy-ip-10-0-133-64.ec2.internal"] May 21 13:02:34.133620 ip-10-0-133-64 kubenswrapper[2562]: I0521 13:02:34.133570 2562 kubelet_node_status.go:413] "Setting node annotation to enable volume controller attach/detach" May 21 13:02:34.134530 ip-10-0-133-64 kubenswrapper[2562]: I0521 13:02:34.134514 2562 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-133-64.ec2.internal" event="NodeHasSufficientMemory" May 21 13:02:34.134606 ip-10-0-133-64 kubenswrapper[2562]: I0521 13:02:34.134543 2562 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-133-64.ec2.internal" event="NodeHasNoDiskPressure" May 21 13:02:34.134606 ip-10-0-133-64 kubenswrapper[2562]: I0521 13:02:34.134558 2562 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-133-64.ec2.internal" event="NodeHasSufficientPID" May 21 13:02:34.136024 ip-10-0-133-64 kubenswrapper[2562]: I0521 13:02:34.136010 2562 kubelet_node_status.go:413] "Setting node annotation to enable volume controller attach/detach" May 21 13:02:34.136184 ip-10-0-133-64 kubenswrapper[2562]: I0521 13:02:34.136171 2562 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-133-64.ec2.internal" May 21 13:02:34.136225 ip-10-0-133-64 kubenswrapper[2562]: I0521 13:02:34.136203 2562 kubelet_node_status.go:413] "Setting node annotation to enable volume controller attach/detach" May 21 13:02:34.136760 ip-10-0-133-64 kubenswrapper[2562]: I0521 13:02:34.136736 2562 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-133-64.ec2.internal" event="NodeHasSufficientMemory" May 21 13:02:34.136871 ip-10-0-133-64 kubenswrapper[2562]: I0521 13:02:34.136765 2562 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-133-64.ec2.internal" event="NodeHasNoDiskPressure" May 21 13:02:34.136871 ip-10-0-133-64 kubenswrapper[2562]: I0521 13:02:34.136737 2562 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-133-64.ec2.internal" event="NodeHasSufficientMemory" May 21 13:02:34.136871 ip-10-0-133-64 kubenswrapper[2562]: I0521 13:02:34.136777 2562 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-133-64.ec2.internal" event="NodeHasSufficientPID" May 21 13:02:34.136871 ip-10-0-133-64 kubenswrapper[2562]: I0521 13:02:34.136817 2562 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-133-64.ec2.internal" event="NodeHasNoDiskPressure" May 21 13:02:34.136871 ip-10-0-133-64 kubenswrapper[2562]: I0521 13:02:34.136834 2562 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-133-64.ec2.internal" event="NodeHasSufficientPID" May 21 13:02:34.138118 ip-10-0-133-64 kubenswrapper[2562]: I0521 13:02:34.138101 2562 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/kube-apiserver-proxy-ip-10-0-133-64.ec2.internal" May 21 13:02:34.138198 ip-10-0-133-64 kubenswrapper[2562]: I0521 13:02:34.138133 2562 kubelet_node_status.go:413] "Setting node annotation to enable volume controller attach/detach" May 21 13:02:34.138793 ip-10-0-133-64 kubenswrapper[2562]: I0521 13:02:34.138777 2562 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-133-64.ec2.internal" event="NodeHasSufficientMemory" May 21 13:02:34.138887 ip-10-0-133-64 kubenswrapper[2562]: I0521 13:02:34.138823 2562 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-133-64.ec2.internal" event="NodeHasNoDiskPressure" May 21 13:02:34.138887 ip-10-0-133-64 kubenswrapper[2562]: I0521 13:02:34.138839 2562 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-133-64.ec2.internal" event="NodeHasSufficientPID" May 21 13:02:34.154328 ip-10-0-133-64 kubenswrapper[2562]: E0521 13:02:34.154306 2562 kubelet.go:3336] "No need to create a mirror pod, since failed to get node info from the cluster" err="node \"ip-10-0-133-64.ec2.internal\" not found" node="ip-10-0-133-64.ec2.internal" May 21 13:02:34.158475 ip-10-0-133-64 kubenswrapper[2562]: E0521 13:02:34.158462 2562 kubelet.go:3336] "No need to create a mirror pod, since failed to get node info from the cluster" err="node \"ip-10-0-133-64.ec2.internal\" not found" node="ip-10-0-133-64.ec2.internal" May 21 13:02:34.192213 ip-10-0-133-64 kubenswrapper[2562]: E0521 13:02:34.192190 2562 kubelet_node_status.go:515] "Error getting the current node from lister" err="node \"ip-10-0-133-64.ec2.internal\" not found" May 21 13:02:34.206458 ip-10-0-133-64 kubenswrapper[2562]: I0521 13:02:34.206439 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/fe9d808f2e9ea9d31117a0e071d6f6f8-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-133-64.ec2.internal\" (UID: \"fe9d808f2e9ea9d31117a0e071d6f6f8\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-133-64.ec2.internal" May 21 13:02:34.206512 ip-10-0-133-64 kubenswrapper[2562]: I0521 13:02:34.206463 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/fe9d808f2e9ea9d31117a0e071d6f6f8-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-133-64.ec2.internal\" (UID: \"fe9d808f2e9ea9d31117a0e071d6f6f8\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-133-64.ec2.internal" May 21 13:02:34.206512 ip-10-0-133-64 kubenswrapper[2562]: I0521 13:02:34.206482 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/host-path/831fde2011330f939091daa7a5d4d0a8-config\") pod \"kube-apiserver-proxy-ip-10-0-133-64.ec2.internal\" (UID: \"831fde2011330f939091daa7a5d4d0a8\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-133-64.ec2.internal" May 21 13:02:34.292850 ip-10-0-133-64 kubenswrapper[2562]: E0521 13:02:34.292767 2562 kubelet_node_status.go:515] "Error getting the current node from lister" err="node \"ip-10-0-133-64.ec2.internal\" not found" May 21 13:02:34.307127 ip-10-0-133-64 kubenswrapper[2562]: I0521 13:02:34.307105 2562 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/fe9d808f2e9ea9d31117a0e071d6f6f8-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-133-64.ec2.internal\" (UID: \"fe9d808f2e9ea9d31117a0e071d6f6f8\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-133-64.ec2.internal" May 21 13:02:34.307176 ip-10-0-133-64 kubenswrapper[2562]: I0521 13:02:34.307138 2562 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/host-path/831fde2011330f939091daa7a5d4d0a8-config\") pod \"kube-apiserver-proxy-ip-10-0-133-64.ec2.internal\" (UID: \"831fde2011330f939091daa7a5d4d0a8\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-133-64.ec2.internal" May 21 13:02:34.307176 ip-10-0-133-64 kubenswrapper[2562]: I0521 13:02:34.307158 2562 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/fe9d808f2e9ea9d31117a0e071d6f6f8-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-133-64.ec2.internal\" (UID: \"fe9d808f2e9ea9d31117a0e071d6f6f8\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-133-64.ec2.internal" May 21 13:02:34.307235 ip-10-0-133-64 kubenswrapper[2562]: I0521 13:02:34.307212 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/fe9d808f2e9ea9d31117a0e071d6f6f8-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-133-64.ec2.internal\" (UID: \"fe9d808f2e9ea9d31117a0e071d6f6f8\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-133-64.ec2.internal" May 21 13:02:34.307235 ip-10-0-133-64 kubenswrapper[2562]: I0521 13:02:34.307224 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/host-path/831fde2011330f939091daa7a5d4d0a8-config\") pod \"kube-apiserver-proxy-ip-10-0-133-64.ec2.internal\" (UID: \"831fde2011330f939091daa7a5d4d0a8\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-133-64.ec2.internal" May 21 13:02:34.307300 ip-10-0-133-64 kubenswrapper[2562]: I0521 13:02:34.307230 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/fe9d808f2e9ea9d31117a0e071d6f6f8-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-133-64.ec2.internal\" (UID: \"fe9d808f2e9ea9d31117a0e071d6f6f8\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-133-64.ec2.internal" May 21 13:02:34.393541 ip-10-0-133-64 kubenswrapper[2562]: E0521 13:02:34.393499 2562 kubelet_node_status.go:515] "Error getting the current node from lister" err="node \"ip-10-0-133-64.ec2.internal\" not found" May 21 13:02:34.457974 ip-10-0-133-64 kubenswrapper[2562]: I0521 13:02:34.457932 2562 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-133-64.ec2.internal" May 21 13:02:34.460868 ip-10-0-133-64 kubenswrapper[2562]: I0521 13:02:34.460854 2562 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/kube-apiserver-proxy-ip-10-0-133-64.ec2.internal" May 21 13:02:34.494495 ip-10-0-133-64 kubenswrapper[2562]: E0521 13:02:34.494472 2562 kubelet_node_status.go:515] "Error getting the current node from lister" err="node \"ip-10-0-133-64.ec2.internal\" not found" May 21 13:02:34.595015 ip-10-0-133-64 kubenswrapper[2562]: E0521 13:02:34.594931 2562 kubelet_node_status.go:515] "Error getting the current node from lister" err="node \"ip-10-0-133-64.ec2.internal\" not found" May 21 13:02:34.695434 ip-10-0-133-64 kubenswrapper[2562]: E0521 13:02:34.695408 2562 kubelet_node_status.go:515] "Error getting the current node from lister" err="node \"ip-10-0-133-64.ec2.internal\" not found" May 21 13:02:34.796122 ip-10-0-133-64 kubenswrapper[2562]: E0521 13:02:34.796095 2562 kubelet_node_status.go:515] "Error getting the current node from lister" err="node \"ip-10-0-133-64.ec2.internal\" not found" May 21 13:02:34.808416 ip-10-0-133-64 kubenswrapper[2562]: I0521 13:02:34.808398 2562 transport.go:147] "Certificate rotation detected, shutting down client connections to start using new credentials" May 21 13:02:34.808562 ip-10-0-133-64 kubenswrapper[2562]: I0521 13:02:34.808546 2562 reflector.go:556] "Warning: watch ended with error" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.CSIDriver" err="very short watch: k8s.io/client-go/informers/factory.go:160: Unexpected watch close - watch lasted less than a second and no items received" May 21 13:02:34.808624 ip-10-0-133-64 kubenswrapper[2562]: I0521 13:02:34.808575 2562 reflector.go:556] "Warning: watch ended with error" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.RuntimeClass" err="very short watch: k8s.io/client-go/informers/factory.go:160: Unexpected watch close - watch lasted less than a second and no items received" May 21 13:02:34.852640 ip-10-0-133-64 kubenswrapper[2562]: I0521 13:02:34.852586 2562 reflector.go:430] "Caches populated" type="*v1.Service" reflector="k8s.io/client-go/informers/factory.go:160" May 21 13:02:34.896631 ip-10-0-133-64 kubenswrapper[2562]: E0521 13:02:34.896594 2562 kubelet_node_status.go:515] "Error getting the current node from lister" err="node \"ip-10-0-133-64.ec2.internal\" not found" May 21 13:02:34.904767 ip-10-0-133-64 kubenswrapper[2562]: I0521 13:02:34.904743 2562 certificate_manager.go:566] "Rotating certificates" logger="kubernetes.io/kubelet-serving" May 21 13:02:34.911256 ip-10-0-133-64 kubenswrapper[2562]: I0521 13:02:34.911225 2562 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kube-apiserver-client-kubelet" expiration="2028-05-20 12:57:33 +0000 UTC" deadline="2027-12-05 07:14:14.330739924 +0000 UTC" May 21 13:02:34.911256 ip-10-0-133-64 kubenswrapper[2562]: I0521 13:02:34.911253 2562 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kube-apiserver-client-kubelet" sleep="13506h11m39.419490044s" May 21 13:02:34.917971 ip-10-0-133-64 kubenswrapper[2562]: I0521 13:02:34.917950 2562 reflector.go:430] "Caches populated" logger="kubernetes.io/kubelet-serving" type="*v1.CertificateSigningRequest" reflector="k8s.io/client-go/tools/watch/informerwatcher.go:162" May 21 13:02:34.949391 ip-10-0-133-64 kubenswrapper[2562]: I0521 13:02:34.949358 2562 csr.go:274] "Certificate signing request is approved, waiting to be issued" logger="kubernetes.io/kubelet-serving" csr="csr-jmqrw" May 21 13:02:34.957154 ip-10-0-133-64 kubenswrapper[2562]: I0521 13:02:34.957124 2562 csr.go:270] "Certificate signing request is issued" logger="kubernetes.io/kubelet-serving" csr="csr-jmqrw" May 21 13:02:34.996765 ip-10-0-133-64 kubenswrapper[2562]: E0521 13:02:34.996739 2562 kubelet_node_status.go:515] "Error getting the current node from lister" err="node \"ip-10-0-133-64.ec2.internal\" not found" May 21 13:02:34.997088 ip-10-0-133-64 kubenswrapper[2562]: W0521 13:02:34.997057 2562 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod831fde2011330f939091daa7a5d4d0a8.slice/crio-36237f7da2827e2dcb59e15ce4b118339547f42b5bd6ec56a4e122b90e2680a8 WatchSource:0}: Error finding container 36237f7da2827e2dcb59e15ce4b118339547f42b5bd6ec56a4e122b90e2680a8: Status 404 returned error can't find the container with id 36237f7da2827e2dcb59e15ce4b118339547f42b5bd6ec56a4e122b90e2680a8 May 21 13:02:34.997316 ip-10-0-133-64 kubenswrapper[2562]: W0521 13:02:34.997294 2562 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podfe9d808f2e9ea9d31117a0e071d6f6f8.slice/crio-fb5e72dbfd7b3cf920819b7664e560a7f193d8b9fd1389839d4408ee79afe454 WatchSource:0}: Error finding container fb5e72dbfd7b3cf920819b7664e560a7f193d8b9fd1389839d4408ee79afe454: Status 404 returned error can't find the container with id fb5e72dbfd7b3cf920819b7664e560a7f193d8b9fd1389839d4408ee79afe454 May 21 13:02:35.001107 ip-10-0-133-64 kubenswrapper[2562]: I0521 13:02:35.001090 2562 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider May 21 13:02:35.035139 ip-10-0-133-64 kubenswrapper[2562]: I0521 13:02:35.035095 2562 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-133-64.ec2.internal" event={"ID":"fe9d808f2e9ea9d31117a0e071d6f6f8","Type":"ContainerStarted","Data":"fb5e72dbfd7b3cf920819b7664e560a7f193d8b9fd1389839d4408ee79afe454"} May 21 13:02:35.036046 ip-10-0-133-64 kubenswrapper[2562]: I0521 13:02:35.036027 2562 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-133-64.ec2.internal" event={"ID":"831fde2011330f939091daa7a5d4d0a8","Type":"ContainerStarted","Data":"36237f7da2827e2dcb59e15ce4b118339547f42b5bd6ec56a4e122b90e2680a8"} May 21 13:02:35.097245 ip-10-0-133-64 kubenswrapper[2562]: E0521 13:02:35.097211 2562 kubelet_node_status.go:515] "Error getting the current node from lister" err="node \"ip-10-0-133-64.ec2.internal\" not found" May 21 13:02:35.197709 ip-10-0-133-64 kubenswrapper[2562]: E0521 13:02:35.197681 2562 kubelet_node_status.go:515] "Error getting the current node from lister" err="node \"ip-10-0-133-64.ec2.internal\" not found" May 21 13:02:35.298212 ip-10-0-133-64 kubenswrapper[2562]: E0521 13:02:35.298178 2562 kubelet_node_status.go:515] "Error getting the current node from lister" err="node \"ip-10-0-133-64.ec2.internal\" not found" May 21 13:02:35.399069 ip-10-0-133-64 kubenswrapper[2562]: E0521 13:02:35.399026 2562 kubelet_node_status.go:515] "Error getting the current node from lister" err="node \"ip-10-0-133-64.ec2.internal\" not found" May 21 13:02:35.498125 ip-10-0-133-64 kubenswrapper[2562]: I0521 13:02:35.498050 2562 reflector.go:430] "Caches populated" type="*v1.Node" reflector="k8s.io/client-go/informers/factory.go:160" May 21 13:02:35.505102 ip-10-0-133-64 kubenswrapper[2562]: I0521 13:02:35.505051 2562 kubelet.go:3340] "Creating a mirror pod for static pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-133-64.ec2.internal" May 21 13:02:35.515842 ip-10-0-133-64 kubenswrapper[2562]: I0521 13:02:35.515816 2562 warnings.go:110] "Warning: metadata.name: this is used in the Pod's hostname, which can result in surprising behavior; a DNS label is recommended: [must not contain dots]" May 21 13:02:35.516865 ip-10-0-133-64 kubenswrapper[2562]: I0521 13:02:35.516849 2562 kubelet.go:3340] "Creating a mirror pod for static pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-133-64.ec2.internal" May 21 13:02:35.524844 ip-10-0-133-64 kubenswrapper[2562]: I0521 13:02:35.524827 2562 warnings.go:110] "Warning: metadata.name: this is used in the Pod's hostname, which can result in surprising behavior; a DNS label is recommended: [must not contain dots]" May 21 13:02:35.883511 ip-10-0-133-64 kubenswrapper[2562]: I0521 13:02:35.883422 2562 apiserver.go:52] "Watching apiserver" May 21 13:02:35.889276 ip-10-0-133-64 kubenswrapper[2562]: I0521 13:02:35.889181 2562 reflector.go:430] "Caches populated" type="*v1.Pod" reflector="pkg/kubelet/config/apiserver.go:66" May 21 13:02:35.889636 ip-10-0-133-64 kubenswrapper[2562]: I0521 13:02:35.889610 2562 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-multus/multus-5hhpk","openshift-multus/network-metrics-daemon-fhvt9","openshift-network-diagnostics/network-check-target-zkhxz","openshift-network-operator/iptables-alerter-flqfh","openshift-ovn-kubernetes/ovnkube-node-ltpwh","kube-system/kube-apiserver-proxy-ip-10-0-133-64.ec2.internal","openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-snb4z","openshift-cluster-node-tuning-operator/tuned-sjffj","openshift-image-registry/node-ca-lm4qk","openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-133-64.ec2.internal","openshift-multus/multus-additional-cni-plugins-p8bmj","kube-system/konnectivity-agent-4zjmp"] May 21 13:02:35.891172 ip-10-0-133-64 kubenswrapper[2562]: I0521 13:02:35.891143 2562 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-5hhpk" May 21 13:02:35.892380 ip-10-0-133-64 kubenswrapper[2562]: I0521 13:02:35.892359 2562 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-fhvt9" May 21 13:02:35.892484 ip-10-0-133-64 kubenswrapper[2562]: E0521 13:02:35.892452 2562 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-fhvt9" podUID="8fd03c97-7fa6-42e9-ab95-5fde631dcd29" May 21 13:02:35.893771 ip-10-0-133-64 kubenswrapper[2562]: I0521 13:02:35.893660 2562 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-zkhxz" May 21 13:02:35.893771 ip-10-0-133-64 kubenswrapper[2562]: E0521 13:02:35.893736 2562 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-zkhxz" podUID="9e5a4d6a-bac9-4fb2-97b6-ae1675433f6e" May 21 13:02:35.893943 ip-10-0-133-64 kubenswrapper[2562]: I0521 13:02:35.893872 2562 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"openshift-service-ca.crt\"" May 21 13:02:35.894076 ip-10-0-133-64 kubenswrapper[2562]: I0521 13:02:35.894057 2562 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"multus-daemon-config\"" May 21 13:02:35.894178 ip-10-0-133-64 kubenswrapper[2562]: I0521 13:02:35.894084 2562 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"cni-copy-resources\"" May 21 13:02:35.894178 ip-10-0-133-64 kubenswrapper[2562]: I0521 13:02:35.894164 2562 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"kube-root-ca.crt\"" May 21 13:02:35.894282 ip-10-0-133-64 kubenswrapper[2562]: I0521 13:02:35.894178 2562 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"default-dockercfg-qp4n7\"" May 21 13:02:35.894996 ip-10-0-133-64 kubenswrapper[2562]: I0521 13:02:35.894975 2562 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-operator/iptables-alerter-flqfh" May 21 13:02:35.897289 ip-10-0-133-64 kubenswrapper[2562]: I0521 13:02:35.897063 2562 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"kube-root-ca.crt\"" May 21 13:02:35.897289 ip-10-0-133-64 kubenswrapper[2562]: I0521 13:02:35.897097 2562 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"iptables-alerter-script\"" May 21 13:02:35.897289 ip-10-0-133-64 kubenswrapper[2562]: I0521 13:02:35.897112 2562 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"openshift-service-ca.crt\"" May 21 13:02:35.897289 ip-10-0-133-64 kubenswrapper[2562]: I0521 13:02:35.897243 2562 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-operator\"/\"iptables-alerter-dockercfg-s75zv\"" May 21 13:02:35.897515 ip-10-0-133-64 kubenswrapper[2562]: I0521 13:02:35.897430 2562 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ovn-kubernetes/ovnkube-node-ltpwh" May 21 13:02:35.897856 ip-10-0-133-64 kubenswrapper[2562]: I0521 13:02:35.897684 2562 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-snb4z" May 21 13:02:35.899485 ip-10-0-133-64 kubenswrapper[2562]: I0521 13:02:35.899465 2562 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"ovnkube-config\"" May 21 13:02:35.900743 ip-10-0-133-64 kubenswrapper[2562]: I0521 13:02:35.899676 2562 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"env-overrides\"" May 21 13:02:35.900743 ip-10-0-133-64 kubenswrapper[2562]: I0521 13:02:35.899874 2562 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"openshift-service-ca.crt\"" May 21 13:02:35.900743 ip-10-0-133-64 kubenswrapper[2562]: I0521 13:02:35.900338 2562 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ovn-kubernetes\"/\"ovn-node-metrics-cert\"" May 21 13:02:35.900743 ip-10-0-133-64 kubenswrapper[2562]: I0521 13:02:35.900366 2562 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/node-ca-lm4qk" May 21 13:02:35.900743 ip-10-0-133-64 kubenswrapper[2562]: I0521 13:02:35.900427 2562 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-csi-drivers\"/\"aws-ebs-csi-driver-node-metrics-serving-cert\"" May 21 13:02:35.900743 ip-10-0-133-64 kubenswrapper[2562]: I0521 13:02:35.900482 2562 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-csi-drivers\"/\"kube-root-ca.crt\"" May 21 13:02:35.900743 ip-10-0-133-64 kubenswrapper[2562]: I0521 13:02:35.900556 2562 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"ovnkube-script-lib\"" May 21 13:02:35.900743 ip-10-0-133-64 kubenswrapper[2562]: I0521 13:02:35.900603 2562 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-csi-drivers\"/\"openshift-service-ca.crt\"" May 21 13:02:35.901449 ip-10-0-133-64 kubenswrapper[2562]: I0521 13:02:35.901084 2562 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"kube-root-ca.crt\"" May 21 13:02:35.901449 ip-10-0-133-64 kubenswrapper[2562]: I0521 13:02:35.901294 2562 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ovn-kubernetes\"/\"ovn-kubernetes-node-dockercfg-xhf6v\"" May 21 13:02:35.901592 ip-10-0-133-64 kubenswrapper[2562]: I0521 13:02:35.901576 2562 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-csi-drivers\"/\"aws-ebs-csi-driver-node-sa-dockercfg-vtn72\"" May 21 13:02:35.901907 ip-10-0-133-64 kubenswrapper[2562]: I0521 13:02:35.901889 2562 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-node-tuning-operator/tuned-sjffj" May 21 13:02:35.903329 ip-10-0-133-64 kubenswrapper[2562]: I0521 13:02:35.903290 2562 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"image-registry-certificates\"" May 21 13:02:35.903975 ip-10-0-133-64 kubenswrapper[2562]: I0521 13:02:35.903955 2562 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"node-ca-dockercfg-jx7zt\"" May 21 13:02:35.904864 ip-10-0-133-64 kubenswrapper[2562]: I0521 13:02:35.904222 2562 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/konnectivity-agent-4zjmp" May 21 13:02:35.904864 ip-10-0-133-64 kubenswrapper[2562]: I0521 13:02:35.904258 2562 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"kube-root-ca.crt\"" May 21 13:02:35.904864 ip-10-0-133-64 kubenswrapper[2562]: I0521 13:02:35.904380 2562 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"kube-root-ca.crt\"" May 21 13:02:35.904864 ip-10-0-133-64 kubenswrapper[2562]: I0521 13:02:35.904450 2562 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"openshift-service-ca.crt\"" May 21 13:02:35.905100 ip-10-0-133-64 kubenswrapper[2562]: I0521 13:02:35.905079 2562 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"tuned-dockercfg-6x8b5\"" May 21 13:02:35.905153 ip-10-0-133-64 kubenswrapper[2562]: I0521 13:02:35.905123 2562 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-additional-cni-plugins-p8bmj" May 21 13:02:35.905358 ip-10-0-133-64 kubenswrapper[2562]: I0521 13:02:35.905342 2562 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"openshift-service-ca.crt\"" May 21 13:02:35.907718 ip-10-0-133-64 kubenswrapper[2562]: I0521 13:02:35.907698 2562 desired_state_of_world_populator.go:158] "Finished populating initial desired state of world" May 21 13:02:35.907945 ip-10-0-133-64 kubenswrapper[2562]: I0521 13:02:35.907925 2562 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kube-system\"/\"konnectivity-ca-bundle\"" May 21 13:02:35.908378 ip-10-0-133-64 kubenswrapper[2562]: I0521 13:02:35.908218 2562 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"whereabouts-flatfile-config\"" May 21 13:02:35.908474 ip-10-0-133-64 kubenswrapper[2562]: I0521 13:02:35.908430 2562 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"konnectivity-agent\"" May 21 13:02:35.908533 ip-10-0-133-64 kubenswrapper[2562]: I0521 13:02:35.908507 2562 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"default-cni-sysctl-allowlist\"" May 21 13:02:35.908671 ip-10-0-133-64 kubenswrapper[2562]: I0521 13:02:35.908650 2562 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"multus-ancillary-tools-dockercfg-nktl2\"" May 21 13:02:35.908788 ip-10-0-133-64 kubenswrapper[2562]: I0521 13:02:35.908772 2562 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"default-dockercfg-rhzqh\"" May 21 13:02:35.916987 ip-10-0-133-64 kubenswrapper[2562]: I0521 13:02:35.916965 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/e416ed10-9d00-41ee-8c5e-6acf4f78643f-system-cni-dir\") pod \"multus-5hhpk\" (UID: \"e416ed10-9d00-41ee-8c5e-6acf4f78643f\") " pod="openshift-multus/multus-5hhpk" May 21 13:02:35.917153 ip-10-0-133-64 kubenswrapper[2562]: I0521 13:02:35.917132 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/e416ed10-9d00-41ee-8c5e-6acf4f78643f-host-run-k8s-cni-cncf-io\") pod \"multus-5hhpk\" (UID: \"e416ed10-9d00-41ee-8c5e-6acf4f78643f\") " pod="openshift-multus/multus-5hhpk" May 21 13:02:35.917256 ip-10-0-133-64 kubenswrapper[2562]: I0521 13:02:35.917163 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-gxl92\" (UniqueName: \"kubernetes.io/projected/0ab0e3ad-cd32-4b7d-aea2-93bfd52b94ca-kube-api-access-gxl92\") pod \"multus-additional-cni-plugins-p8bmj\" (UID: \"0ab0e3ad-cd32-4b7d-aea2-93bfd52b94ca\") " pod="openshift-multus/multus-additional-cni-plugins-p8bmj" May 21 13:02:35.917256 ip-10-0-133-64 kubenswrapper[2562]: I0521 13:02:35.917230 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/9782b774-8d77-4b0b-bf5f-4678a677e161-etc-modprobe-d\") pod \"tuned-sjffj\" (UID: \"9782b774-8d77-4b0b-bf5f-4678a677e161\") " pod="openshift-cluster-node-tuning-operator/tuned-sjffj" May 21 13:02:35.917369 ip-10-0-133-64 kubenswrapper[2562]: I0521 13:02:35.917259 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/e416ed10-9d00-41ee-8c5e-6acf4f78643f-host-run-multus-certs\") pod \"multus-5hhpk\" (UID: \"e416ed10-9d00-41ee-8c5e-6acf4f78643f\") " pod="openshift-multus/multus-5hhpk" May 21 13:02:35.917369 ip-10-0-133-64 kubenswrapper[2562]: I0521 13:02:35.917282 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/b74d36d8-43b2-428f-a5a7-8701f9fae368-etc-selinux\") pod \"aws-ebs-csi-driver-node-snb4z\" (UID: \"b74d36d8-43b2-428f-a5a7-8701f9fae368\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-snb4z" May 21 13:02:35.917369 ip-10-0-133-64 kubenswrapper[2562]: I0521 13:02:35.917308 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/0ab0e3ad-cd32-4b7d-aea2-93bfd52b94ca-system-cni-dir\") pod \"multus-additional-cni-plugins-p8bmj\" (UID: \"0ab0e3ad-cd32-4b7d-aea2-93bfd52b94ca\") " pod="openshift-multus/multus-additional-cni-plugins-p8bmj" May 21 13:02:35.917369 ip-10-0-133-64 kubenswrapper[2562]: I0521 13:02:35.917332 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/9782b774-8d77-4b0b-bf5f-4678a677e161-etc-sysconfig\") pod \"tuned-sjffj\" (UID: \"9782b774-8d77-4b0b-bf5f-4678a677e161\") " pod="openshift-cluster-node-tuning-operator/tuned-sjffj" May 21 13:02:35.917369 ip-10-0-133-64 kubenswrapper[2562]: I0521 13:02:35.917355 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/9782b774-8d77-4b0b-bf5f-4678a677e161-etc-tuned\") pod \"tuned-sjffj\" (UID: \"9782b774-8d77-4b0b-bf5f-4678a677e161\") " pod="openshift-cluster-node-tuning-operator/tuned-sjffj" May 21 13:02:35.917616 ip-10-0-133-64 kubenswrapper[2562]: I0521 13:02:35.917376 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/e416ed10-9d00-41ee-8c5e-6acf4f78643f-multus-socket-dir-parent\") pod \"multus-5hhpk\" (UID: \"e416ed10-9d00-41ee-8c5e-6acf4f78643f\") " pod="openshift-multus/multus-5hhpk" May 21 13:02:35.917616 ip-10-0-133-64 kubenswrapper[2562]: I0521 13:02:35.917399 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/e416ed10-9d00-41ee-8c5e-6acf4f78643f-host-var-lib-cni-multus\") pod \"multus-5hhpk\" (UID: \"e416ed10-9d00-41ee-8c5e-6acf4f78643f\") " pod="openshift-multus/multus-5hhpk" May 21 13:02:35.917616 ip-10-0-133-64 kubenswrapper[2562]: I0521 13:02:35.917422 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-6klh7\" (UniqueName: \"kubernetes.io/projected/8fd03c97-7fa6-42e9-ab95-5fde631dcd29-kube-api-access-6klh7\") pod \"network-metrics-daemon-fhvt9\" (UID: \"8fd03c97-7fa6-42e9-ab95-5fde631dcd29\") " pod="openshift-multus/network-metrics-daemon-fhvt9" May 21 13:02:35.917616 ip-10-0-133-64 kubenswrapper[2562]: I0521 13:02:35.917486 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-n225x\" (UniqueName: \"kubernetes.io/projected/da3fc398-1999-44e7-80b5-5f699d3f7744-kube-api-access-n225x\") pod \"node-ca-lm4qk\" (UID: \"da3fc398-1999-44e7-80b5-5f699d3f7744\") " pod="openshift-image-registry/node-ca-lm4qk" May 21 13:02:35.917616 ip-10-0-133-64 kubenswrapper[2562]: I0521 13:02:35.917511 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/4eea719d-a66b-4ce0-aa45-0ef984662354-iptables-alerter-script\") pod \"iptables-alerter-flqfh\" (UID: \"4eea719d-a66b-4ce0-aa45-0ef984662354\") " pod="openshift-network-operator/iptables-alerter-flqfh" May 21 13:02:35.917616 ip-10-0-133-64 kubenswrapper[2562]: I0521 13:02:35.917551 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/2d49aff3-1eb6-46f0-bfe3-c5b167536671-host-slash\") pod \"ovnkube-node-ltpwh\" (UID: \"2d49aff3-1eb6-46f0-bfe3-c5b167536671\") " pod="openshift-ovn-kubernetes/ovnkube-node-ltpwh" May 21 13:02:35.917616 ip-10-0-133-64 kubenswrapper[2562]: I0521 13:02:35.917579 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/2d49aff3-1eb6-46f0-bfe3-c5b167536671-run-ovn\") pod \"ovnkube-node-ltpwh\" (UID: \"2d49aff3-1eb6-46f0-bfe3-c5b167536671\") " pod="openshift-ovn-kubernetes/ovnkube-node-ltpwh" May 21 13:02:35.917616 ip-10-0-133-64 kubenswrapper[2562]: I0521 13:02:35.917598 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/2d49aff3-1eb6-46f0-bfe3-c5b167536671-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-ltpwh\" (UID: \"2d49aff3-1eb6-46f0-bfe3-c5b167536671\") " pod="openshift-ovn-kubernetes/ovnkube-node-ltpwh" May 21 13:02:35.918004 ip-10-0-133-64 kubenswrapper[2562]: I0521 13:02:35.917619 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/2d49aff3-1eb6-46f0-bfe3-c5b167536671-env-overrides\") pod \"ovnkube-node-ltpwh\" (UID: \"2d49aff3-1eb6-46f0-bfe3-c5b167536671\") " pod="openshift-ovn-kubernetes/ovnkube-node-ltpwh" May 21 13:02:35.918004 ip-10-0-133-64 kubenswrapper[2562]: I0521 13:02:35.917641 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/2d49aff3-1eb6-46f0-bfe3-c5b167536671-ovnkube-script-lib\") pod \"ovnkube-node-ltpwh\" (UID: \"2d49aff3-1eb6-46f0-bfe3-c5b167536671\") " pod="openshift-ovn-kubernetes/ovnkube-node-ltpwh" May 21 13:02:35.918004 ip-10-0-133-64 kubenswrapper[2562]: I0521 13:02:35.917664 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/2d49aff3-1eb6-46f0-bfe3-c5b167536671-run-systemd\") pod \"ovnkube-node-ltpwh\" (UID: \"2d49aff3-1eb6-46f0-bfe3-c5b167536671\") " pod="openshift-ovn-kubernetes/ovnkube-node-ltpwh" May 21 13:02:35.918004 ip-10-0-133-64 kubenswrapper[2562]: I0521 13:02:35.917687 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/2d49aff3-1eb6-46f0-bfe3-c5b167536671-var-lib-openvswitch\") pod \"ovnkube-node-ltpwh\" (UID: \"2d49aff3-1eb6-46f0-bfe3-c5b167536671\") " pod="openshift-ovn-kubernetes/ovnkube-node-ltpwh" May 21 13:02:35.918004 ip-10-0-133-64 kubenswrapper[2562]: I0521 13:02:35.917716 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/2d49aff3-1eb6-46f0-bfe3-c5b167536671-host-cni-netd\") pod \"ovnkube-node-ltpwh\" (UID: \"2d49aff3-1eb6-46f0-bfe3-c5b167536671\") " pod="openshift-ovn-kubernetes/ovnkube-node-ltpwh" May 21 13:02:35.918004 ip-10-0-133-64 kubenswrapper[2562]: I0521 13:02:35.917739 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/9782b774-8d77-4b0b-bf5f-4678a677e161-host\") pod \"tuned-sjffj\" (UID: \"9782b774-8d77-4b0b-bf5f-4678a677e161\") " pod="openshift-cluster-node-tuning-operator/tuned-sjffj" May 21 13:02:35.918004 ip-10-0-133-64 kubenswrapper[2562]: I0521 13:02:35.917785 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/e416ed10-9d00-41ee-8c5e-6acf4f78643f-host-var-lib-cni-bin\") pod \"multus-5hhpk\" (UID: \"e416ed10-9d00-41ee-8c5e-6acf4f78643f\") " pod="openshift-multus/multus-5hhpk" May 21 13:02:35.918004 ip-10-0-133-64 kubenswrapper[2562]: I0521 13:02:35.917832 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/e416ed10-9d00-41ee-8c5e-6acf4f78643f-multus-conf-dir\") pod \"multus-5hhpk\" (UID: \"e416ed10-9d00-41ee-8c5e-6acf4f78643f\") " pod="openshift-multus/multus-5hhpk" May 21 13:02:35.918004 ip-10-0-133-64 kubenswrapper[2562]: I0521 13:02:35.917857 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/4eea719d-a66b-4ce0-aa45-0ef984662354-host-slash\") pod \"iptables-alerter-flqfh\" (UID: \"4eea719d-a66b-4ce0-aa45-0ef984662354\") " pod="openshift-network-operator/iptables-alerter-flqfh" May 21 13:02:35.918004 ip-10-0-133-64 kubenswrapper[2562]: I0521 13:02:35.917879 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/2d49aff3-1eb6-46f0-bfe3-c5b167536671-node-log\") pod \"ovnkube-node-ltpwh\" (UID: \"2d49aff3-1eb6-46f0-bfe3-c5b167536671\") " pod="openshift-ovn-kubernetes/ovnkube-node-ltpwh" May 21 13:02:35.918004 ip-10-0-133-64 kubenswrapper[2562]: I0521 13:02:35.917910 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/2d49aff3-1eb6-46f0-bfe3-c5b167536671-log-socket\") pod \"ovnkube-node-ltpwh\" (UID: \"2d49aff3-1eb6-46f0-bfe3-c5b167536671\") " pod="openshift-ovn-kubernetes/ovnkube-node-ltpwh" May 21 13:02:35.918004 ip-10-0-133-64 kubenswrapper[2562]: I0521 13:02:35.917941 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/9782b774-8d77-4b0b-bf5f-4678a677e161-sys\") pod \"tuned-sjffj\" (UID: \"9782b774-8d77-4b0b-bf5f-4678a677e161\") " pod="openshift-cluster-node-tuning-operator/tuned-sjffj" May 21 13:02:35.918004 ip-10-0-133-64 kubenswrapper[2562]: I0521 13:02:35.917956 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/e416ed10-9d00-41ee-8c5e-6acf4f78643f-cnibin\") pod \"multus-5hhpk\" (UID: \"e416ed10-9d00-41ee-8c5e-6acf4f78643f\") " pod="openshift-multus/multus-5hhpk" May 21 13:02:35.918004 ip-10-0-133-64 kubenswrapper[2562]: I0521 13:02:35.917971 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/0ab0e3ad-cd32-4b7d-aea2-93bfd52b94ca-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-p8bmj\" (UID: \"0ab0e3ad-cd32-4b7d-aea2-93bfd52b94ca\") " pod="openshift-multus/multus-additional-cni-plugins-p8bmj" May 21 13:02:35.918004 ip-10-0-133-64 kubenswrapper[2562]: I0521 13:02:35.918005 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/9782b774-8d77-4b0b-bf5f-4678a677e161-var-lib-kubelet\") pod \"tuned-sjffj\" (UID: \"9782b774-8d77-4b0b-bf5f-4678a677e161\") " pod="openshift-cluster-node-tuning-operator/tuned-sjffj" May 21 13:02:35.918733 ip-10-0-133-64 kubenswrapper[2562]: I0521 13:02:35.918029 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-7hf5c\" (UniqueName: \"kubernetes.io/projected/9782b774-8d77-4b0b-bf5f-4678a677e161-kube-api-access-7hf5c\") pod \"tuned-sjffj\" (UID: \"9782b774-8d77-4b0b-bf5f-4678a677e161\") " pod="openshift-cluster-node-tuning-operator/tuned-sjffj" May 21 13:02:35.918733 ip-10-0-133-64 kubenswrapper[2562]: I0521 13:02:35.918057 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/9782b774-8d77-4b0b-bf5f-4678a677e161-etc-kubernetes\") pod \"tuned-sjffj\" (UID: \"9782b774-8d77-4b0b-bf5f-4678a677e161\") " pod="openshift-cluster-node-tuning-operator/tuned-sjffj" May 21 13:02:35.918733 ip-10-0-133-64 kubenswrapper[2562]: I0521 13:02:35.918080 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/2d49aff3-1eb6-46f0-bfe3-c5b167536671-host-run-ovn-kubernetes\") pod \"ovnkube-node-ltpwh\" (UID: \"2d49aff3-1eb6-46f0-bfe3-c5b167536671\") " pod="openshift-ovn-kubernetes/ovnkube-node-ltpwh" May 21 13:02:35.918733 ip-10-0-133-64 kubenswrapper[2562]: I0521 13:02:35.918107 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/2d49aff3-1eb6-46f0-bfe3-c5b167536671-host-cni-bin\") pod \"ovnkube-node-ltpwh\" (UID: \"2d49aff3-1eb6-46f0-bfe3-c5b167536671\") " pod="openshift-ovn-kubernetes/ovnkube-node-ltpwh" May 21 13:02:35.918733 ip-10-0-133-64 kubenswrapper[2562]: I0521 13:02:35.918129 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/b74d36d8-43b2-428f-a5a7-8701f9fae368-sys-fs\") pod \"aws-ebs-csi-driver-node-snb4z\" (UID: \"b74d36d8-43b2-428f-a5a7-8701f9fae368\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-snb4z" May 21 13:02:35.918733 ip-10-0-133-64 kubenswrapper[2562]: I0521 13:02:35.918161 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/0ab0e3ad-cd32-4b7d-aea2-93bfd52b94ca-os-release\") pod \"multus-additional-cni-plugins-p8bmj\" (UID: \"0ab0e3ad-cd32-4b7d-aea2-93bfd52b94ca\") " pod="openshift-multus/multus-additional-cni-plugins-p8bmj" May 21 13:02:35.918733 ip-10-0-133-64 kubenswrapper[2562]: I0521 13:02:35.918186 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/0ab0e3ad-cd32-4b7d-aea2-93bfd52b94ca-cni-binary-copy\") pod \"multus-additional-cni-plugins-p8bmj\" (UID: \"0ab0e3ad-cd32-4b7d-aea2-93bfd52b94ca\") " pod="openshift-multus/multus-additional-cni-plugins-p8bmj" May 21 13:02:35.918733 ip-10-0-133-64 kubenswrapper[2562]: I0521 13:02:35.918208 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/9782b774-8d77-4b0b-bf5f-4678a677e161-etc-sysctl-conf\") pod \"tuned-sjffj\" (UID: \"9782b774-8d77-4b0b-bf5f-4678a677e161\") " pod="openshift-cluster-node-tuning-operator/tuned-sjffj" May 21 13:02:35.918733 ip-10-0-133-64 kubenswrapper[2562]: I0521 13:02:35.918232 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run\" (UniqueName: \"kubernetes.io/host-path/9782b774-8d77-4b0b-bf5f-4678a677e161-run\") pod \"tuned-sjffj\" (UID: \"9782b774-8d77-4b0b-bf5f-4678a677e161\") " pod="openshift-cluster-node-tuning-operator/tuned-sjffj" May 21 13:02:35.918733 ip-10-0-133-64 kubenswrapper[2562]: I0521 13:02:35.918266 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/9782b774-8d77-4b0b-bf5f-4678a677e161-lib-modules\") pod \"tuned-sjffj\" (UID: \"9782b774-8d77-4b0b-bf5f-4678a677e161\") " pod="openshift-cluster-node-tuning-operator/tuned-sjffj" May 21 13:02:35.918733 ip-10-0-133-64 kubenswrapper[2562]: I0521 13:02:35.918298 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/2d49aff3-1eb6-46f0-bfe3-c5b167536671-host-run-netns\") pod \"ovnkube-node-ltpwh\" (UID: \"2d49aff3-1eb6-46f0-bfe3-c5b167536671\") " pod="openshift-ovn-kubernetes/ovnkube-node-ltpwh" May 21 13:02:35.918733 ip-10-0-133-64 kubenswrapper[2562]: I0521 13:02:35.918323 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-hxb25\" (UniqueName: \"kubernetes.io/projected/2d49aff3-1eb6-46f0-bfe3-c5b167536671-kube-api-access-hxb25\") pod \"ovnkube-node-ltpwh\" (UID: \"2d49aff3-1eb6-46f0-bfe3-c5b167536671\") " pod="openshift-ovn-kubernetes/ovnkube-node-ltpwh" May 21 13:02:35.918733 ip-10-0-133-64 kubenswrapper[2562]: I0521 13:02:35.918347 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/9782b774-8d77-4b0b-bf5f-4678a677e161-etc-sysctl-d\") pod \"tuned-sjffj\" (UID: \"9782b774-8d77-4b0b-bf5f-4678a677e161\") " pod="openshift-cluster-node-tuning-operator/tuned-sjffj" May 21 13:02:35.918733 ip-10-0-133-64 kubenswrapper[2562]: I0521 13:02:35.918368 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/da3fc398-1999-44e7-80b5-5f699d3f7744-host\") pod \"node-ca-lm4qk\" (UID: \"da3fc398-1999-44e7-80b5-5f699d3f7744\") " pod="openshift-image-registry/node-ca-lm4qk" May 21 13:02:35.918733 ip-10-0-133-64 kubenswrapper[2562]: I0521 13:02:35.918390 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/e416ed10-9d00-41ee-8c5e-6acf4f78643f-os-release\") pod \"multus-5hhpk\" (UID: \"e416ed10-9d00-41ee-8c5e-6acf4f78643f\") " pod="openshift-multus/multus-5hhpk" May 21 13:02:35.918733 ip-10-0-133-64 kubenswrapper[2562]: I0521 13:02:35.918413 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/e416ed10-9d00-41ee-8c5e-6acf4f78643f-host-var-lib-kubelet\") pod \"multus-5hhpk\" (UID: \"e416ed10-9d00-41ee-8c5e-6acf4f78643f\") " pod="openshift-multus/multus-5hhpk" May 21 13:02:35.919587 ip-10-0-133-64 kubenswrapper[2562]: I0521 13:02:35.918436 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/e416ed10-9d00-41ee-8c5e-6acf4f78643f-multus-daemon-config\") pod \"multus-5hhpk\" (UID: \"e416ed10-9d00-41ee-8c5e-6acf4f78643f\") " pod="openshift-multus/multus-5hhpk" May 21 13:02:35.919587 ip-10-0-133-64 kubenswrapper[2562]: I0521 13:02:35.918457 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/2d49aff3-1eb6-46f0-bfe3-c5b167536671-systemd-units\") pod \"ovnkube-node-ltpwh\" (UID: \"2d49aff3-1eb6-46f0-bfe3-c5b167536671\") " pod="openshift-ovn-kubernetes/ovnkube-node-ltpwh" May 21 13:02:35.919587 ip-10-0-133-64 kubenswrapper[2562]: I0521 13:02:35.918479 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/b74d36d8-43b2-428f-a5a7-8701f9fae368-registration-dir\") pod \"aws-ebs-csi-driver-node-snb4z\" (UID: \"b74d36d8-43b2-428f-a5a7-8701f9fae368\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-snb4z" May 21 13:02:35.919587 ip-10-0-133-64 kubenswrapper[2562]: I0521 13:02:35.918502 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/b74d36d8-43b2-428f-a5a7-8701f9fae368-device-dir\") pod \"aws-ebs-csi-driver-node-snb4z\" (UID: \"b74d36d8-43b2-428f-a5a7-8701f9fae368\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-snb4z" May 21 13:02:35.919587 ip-10-0-133-64 kubenswrapper[2562]: I0521 13:02:35.918549 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/9782b774-8d77-4b0b-bf5f-4678a677e161-tmp\") pod \"tuned-sjffj\" (UID: \"9782b774-8d77-4b0b-bf5f-4678a677e161\") " pod="openshift-cluster-node-tuning-operator/tuned-sjffj" May 21 13:02:35.919587 ip-10-0-133-64 kubenswrapper[2562]: I0521 13:02:35.918587 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-9xdt5\" (UniqueName: \"kubernetes.io/projected/4eea719d-a66b-4ce0-aa45-0ef984662354-kube-api-access-9xdt5\") pod \"iptables-alerter-flqfh\" (UID: \"4eea719d-a66b-4ce0-aa45-0ef984662354\") " pod="openshift-network-operator/iptables-alerter-flqfh" May 21 13:02:35.919587 ip-10-0-133-64 kubenswrapper[2562]: I0521 13:02:35.918615 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/2d49aff3-1eb6-46f0-bfe3-c5b167536671-ovnkube-config\") pod \"ovnkube-node-ltpwh\" (UID: \"2d49aff3-1eb6-46f0-bfe3-c5b167536671\") " pod="openshift-ovn-kubernetes/ovnkube-node-ltpwh" May 21 13:02:35.919587 ip-10-0-133-64 kubenswrapper[2562]: I0521 13:02:35.918652 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/b74d36d8-43b2-428f-a5a7-8701f9fae368-socket-dir\") pod \"aws-ebs-csi-driver-node-snb4z\" (UID: \"b74d36d8-43b2-428f-a5a7-8701f9fae368\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-snb4z" May 21 13:02:35.919587 ip-10-0-133-64 kubenswrapper[2562]: I0521 13:02:35.918719 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-hf5z8\" (UniqueName: \"kubernetes.io/projected/b74d36d8-43b2-428f-a5a7-8701f9fae368-kube-api-access-hf5z8\") pod \"aws-ebs-csi-driver-node-snb4z\" (UID: \"b74d36d8-43b2-428f-a5a7-8701f9fae368\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-snb4z" May 21 13:02:35.919587 ip-10-0-133-64 kubenswrapper[2562]: I0521 13:02:35.918765 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/0ab0e3ad-cd32-4b7d-aea2-93bfd52b94ca-cnibin\") pod \"multus-additional-cni-plugins-p8bmj\" (UID: \"0ab0e3ad-cd32-4b7d-aea2-93bfd52b94ca\") " pod="openshift-multus/multus-additional-cni-plugins-p8bmj" May 21 13:02:35.919587 ip-10-0-133-64 kubenswrapper[2562]: I0521 13:02:35.918854 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/0ab0e3ad-cd32-4b7d-aea2-93bfd52b94ca-tuning-conf-dir\") pod \"multus-additional-cni-plugins-p8bmj\" (UID: \"0ab0e3ad-cd32-4b7d-aea2-93bfd52b94ca\") " pod="openshift-multus/multus-additional-cni-plugins-p8bmj" May 21 13:02:35.919587 ip-10-0-133-64 kubenswrapper[2562]: I0521 13:02:35.918884 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/b37e4909-8e26-4b8d-856d-34f9d0c5832e-agent-certs\") pod \"konnectivity-agent-4zjmp\" (UID: \"b37e4909-8e26-4b8d-856d-34f9d0c5832e\") " pod="kube-system/konnectivity-agent-4zjmp" May 21 13:02:35.919587 ip-10-0-133-64 kubenswrapper[2562]: I0521 13:02:35.918935 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/e416ed10-9d00-41ee-8c5e-6acf4f78643f-hostroot\") pod \"multus-5hhpk\" (UID: \"e416ed10-9d00-41ee-8c5e-6acf4f78643f\") " pod="openshift-multus/multus-5hhpk" May 21 13:02:35.919587 ip-10-0-133-64 kubenswrapper[2562]: I0521 13:02:35.918959 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-lqlpv\" (UniqueName: \"kubernetes.io/projected/e416ed10-9d00-41ee-8c5e-6acf4f78643f-kube-api-access-lqlpv\") pod \"multus-5hhpk\" (UID: \"e416ed10-9d00-41ee-8c5e-6acf4f78643f\") " pod="openshift-multus/multus-5hhpk" May 21 13:02:35.919587 ip-10-0-133-64 kubenswrapper[2562]: I0521 13:02:35.918979 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/2d49aff3-1eb6-46f0-bfe3-c5b167536671-host-kubelet\") pod \"ovnkube-node-ltpwh\" (UID: \"2d49aff3-1eb6-46f0-bfe3-c5b167536671\") " pod="openshift-ovn-kubernetes/ovnkube-node-ltpwh" May 21 13:02:35.919587 ip-10-0-133-64 kubenswrapper[2562]: I0521 13:02:35.919003 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/8fd03c97-7fa6-42e9-ab95-5fde631dcd29-metrics-certs\") pod \"network-metrics-daemon-fhvt9\" (UID: \"8fd03c97-7fa6-42e9-ab95-5fde631dcd29\") " pod="openshift-multus/network-metrics-daemon-fhvt9" May 21 13:02:35.920332 ip-10-0-133-64 kubenswrapper[2562]: I0521 13:02:35.919028 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-2r7z9\" (UniqueName: \"kubernetes.io/projected/9e5a4d6a-bac9-4fb2-97b6-ae1675433f6e-kube-api-access-2r7z9\") pod \"network-check-target-zkhxz\" (UID: \"9e5a4d6a-bac9-4fb2-97b6-ae1675433f6e\") " pod="openshift-network-diagnostics/network-check-target-zkhxz" May 21 13:02:35.920332 ip-10-0-133-64 kubenswrapper[2562]: I0521 13:02:35.919073 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/e416ed10-9d00-41ee-8c5e-6acf4f78643f-cni-binary-copy\") pod \"multus-5hhpk\" (UID: \"e416ed10-9d00-41ee-8c5e-6acf4f78643f\") " pod="openshift-multus/multus-5hhpk" May 21 13:02:35.920332 ip-10-0-133-64 kubenswrapper[2562]: I0521 13:02:35.919106 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/e416ed10-9d00-41ee-8c5e-6acf4f78643f-etc-kubernetes\") pod \"multus-5hhpk\" (UID: \"e416ed10-9d00-41ee-8c5e-6acf4f78643f\") " pod="openshift-multus/multus-5hhpk" May 21 13:02:35.920332 ip-10-0-133-64 kubenswrapper[2562]: I0521 13:02:35.919298 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/2d49aff3-1eb6-46f0-bfe3-c5b167536671-ovn-node-metrics-cert\") pod \"ovnkube-node-ltpwh\" (UID: \"2d49aff3-1eb6-46f0-bfe3-c5b167536671\") " pod="openshift-ovn-kubernetes/ovnkube-node-ltpwh" May 21 13:02:35.920332 ip-10-0-133-64 kubenswrapper[2562]: I0521 13:02:35.919350 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/0ab0e3ad-cd32-4b7d-aea2-93bfd52b94ca-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-p8bmj\" (UID: \"0ab0e3ad-cd32-4b7d-aea2-93bfd52b94ca\") " pod="openshift-multus/multus-additional-cni-plugins-p8bmj" May 21 13:02:35.920332 ip-10-0-133-64 kubenswrapper[2562]: I0521 13:02:35.919378 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/9782b774-8d77-4b0b-bf5f-4678a677e161-etc-systemd\") pod \"tuned-sjffj\" (UID: \"9782b774-8d77-4b0b-bf5f-4678a677e161\") " pod="openshift-cluster-node-tuning-operator/tuned-sjffj" May 21 13:02:35.920332 ip-10-0-133-64 kubenswrapper[2562]: I0521 13:02:35.919521 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/e416ed10-9d00-41ee-8c5e-6acf4f78643f-multus-cni-dir\") pod \"multus-5hhpk\" (UID: \"e416ed10-9d00-41ee-8c5e-6acf4f78643f\") " pod="openshift-multus/multus-5hhpk" May 21 13:02:35.920332 ip-10-0-133-64 kubenswrapper[2562]: I0521 13:02:35.919564 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/2d49aff3-1eb6-46f0-bfe3-c5b167536671-etc-openvswitch\") pod \"ovnkube-node-ltpwh\" (UID: \"2d49aff3-1eb6-46f0-bfe3-c5b167536671\") " pod="openshift-ovn-kubernetes/ovnkube-node-ltpwh" May 21 13:02:35.920332 ip-10-0-133-64 kubenswrapper[2562]: I0521 13:02:35.919672 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/b74d36d8-43b2-428f-a5a7-8701f9fae368-kubelet-dir\") pod \"aws-ebs-csi-driver-node-snb4z\" (UID: \"b74d36d8-43b2-428f-a5a7-8701f9fae368\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-snb4z" May 21 13:02:35.920332 ip-10-0-133-64 kubenswrapper[2562]: I0521 13:02:35.919700 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/b37e4909-8e26-4b8d-856d-34f9d0c5832e-konnectivity-ca\") pod \"konnectivity-agent-4zjmp\" (UID: \"b37e4909-8e26-4b8d-856d-34f9d0c5832e\") " pod="kube-system/konnectivity-agent-4zjmp" May 21 13:02:35.920332 ip-10-0-133-64 kubenswrapper[2562]: I0521 13:02:35.919725 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/da3fc398-1999-44e7-80b5-5f699d3f7744-serviceca\") pod \"node-ca-lm4qk\" (UID: \"da3fc398-1999-44e7-80b5-5f699d3f7744\") " pod="openshift-image-registry/node-ca-lm4qk" May 21 13:02:35.920332 ip-10-0-133-64 kubenswrapper[2562]: I0521 13:02:35.919748 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/e416ed10-9d00-41ee-8c5e-6acf4f78643f-host-run-netns\") pod \"multus-5hhpk\" (UID: \"e416ed10-9d00-41ee-8c5e-6acf4f78643f\") " pod="openshift-multus/multus-5hhpk" May 21 13:02:35.920332 ip-10-0-133-64 kubenswrapper[2562]: I0521 13:02:35.919784 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/2d49aff3-1eb6-46f0-bfe3-c5b167536671-run-openvswitch\") pod \"ovnkube-node-ltpwh\" (UID: \"2d49aff3-1eb6-46f0-bfe3-c5b167536671\") " pod="openshift-ovn-kubernetes/ovnkube-node-ltpwh" May 21 13:02:35.957790 ip-10-0-133-64 kubenswrapper[2562]: I0521 13:02:35.957735 2562 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kubelet-serving" expiration="2028-05-20 12:57:34 +0000 UTC" deadline="2027-10-16 20:35:18.906239921 +0000 UTC" May 21 13:02:35.957790 ip-10-0-133-64 kubenswrapper[2562]: I0521 13:02:35.957767 2562 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kubelet-serving" sleep="12319h32m42.94847664s" May 21 13:02:35.992660 ip-10-0-133-64 kubenswrapper[2562]: I0521 13:02:35.992627 2562 reflector.go:430] "Caches populated" type="*v1.CSIDriver" reflector="k8s.io/client-go/informers/factory.go:160" May 21 13:02:36.021295 ip-10-0-133-64 kubenswrapper[2562]: I0521 13:02:36.020934 2562 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/2d49aff3-1eb6-46f0-bfe3-c5b167536671-ovnkube-config\") pod \"ovnkube-node-ltpwh\" (UID: \"2d49aff3-1eb6-46f0-bfe3-c5b167536671\") " pod="openshift-ovn-kubernetes/ovnkube-node-ltpwh" May 21 13:02:36.021295 ip-10-0-133-64 kubenswrapper[2562]: I0521 13:02:36.020980 2562 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/b74d36d8-43b2-428f-a5a7-8701f9fae368-socket-dir\") pod \"aws-ebs-csi-driver-node-snb4z\" (UID: \"b74d36d8-43b2-428f-a5a7-8701f9fae368\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-snb4z" May 21 13:02:36.021295 ip-10-0-133-64 kubenswrapper[2562]: I0521 13:02:36.021016 2562 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-hf5z8\" (UniqueName: \"kubernetes.io/projected/b74d36d8-43b2-428f-a5a7-8701f9fae368-kube-api-access-hf5z8\") pod \"aws-ebs-csi-driver-node-snb4z\" (UID: \"b74d36d8-43b2-428f-a5a7-8701f9fae368\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-snb4z" May 21 13:02:36.021295 ip-10-0-133-64 kubenswrapper[2562]: I0521 13:02:36.021048 2562 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/0ab0e3ad-cd32-4b7d-aea2-93bfd52b94ca-cnibin\") pod \"multus-additional-cni-plugins-p8bmj\" (UID: \"0ab0e3ad-cd32-4b7d-aea2-93bfd52b94ca\") " pod="openshift-multus/multus-additional-cni-plugins-p8bmj" May 21 13:02:36.021295 ip-10-0-133-64 kubenswrapper[2562]: I0521 13:02:36.021078 2562 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/0ab0e3ad-cd32-4b7d-aea2-93bfd52b94ca-tuning-conf-dir\") pod \"multus-additional-cni-plugins-p8bmj\" (UID: \"0ab0e3ad-cd32-4b7d-aea2-93bfd52b94ca\") " pod="openshift-multus/multus-additional-cni-plugins-p8bmj" May 21 13:02:36.021295 ip-10-0-133-64 kubenswrapper[2562]: I0521 13:02:36.021112 2562 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/b37e4909-8e26-4b8d-856d-34f9d0c5832e-agent-certs\") pod \"konnectivity-agent-4zjmp\" (UID: \"b37e4909-8e26-4b8d-856d-34f9d0c5832e\") " pod="kube-system/konnectivity-agent-4zjmp" May 21 13:02:36.021295 ip-10-0-133-64 kubenswrapper[2562]: I0521 13:02:36.021141 2562 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/e416ed10-9d00-41ee-8c5e-6acf4f78643f-hostroot\") pod \"multus-5hhpk\" (UID: \"e416ed10-9d00-41ee-8c5e-6acf4f78643f\") " pod="openshift-multus/multus-5hhpk" May 21 13:02:36.021295 ip-10-0-133-64 kubenswrapper[2562]: I0521 13:02:36.021175 2562 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-lqlpv\" (UniqueName: \"kubernetes.io/projected/e416ed10-9d00-41ee-8c5e-6acf4f78643f-kube-api-access-lqlpv\") pod \"multus-5hhpk\" (UID: \"e416ed10-9d00-41ee-8c5e-6acf4f78643f\") " pod="openshift-multus/multus-5hhpk" May 21 13:02:36.021819 ip-10-0-133-64 kubenswrapper[2562]: I0521 13:02:36.021275 2562 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/2d49aff3-1eb6-46f0-bfe3-c5b167536671-host-kubelet\") pod \"ovnkube-node-ltpwh\" (UID: \"2d49aff3-1eb6-46f0-bfe3-c5b167536671\") " pod="openshift-ovn-kubernetes/ovnkube-node-ltpwh" May 21 13:02:36.021819 ip-10-0-133-64 kubenswrapper[2562]: I0521 13:02:36.021377 2562 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/8fd03c97-7fa6-42e9-ab95-5fde631dcd29-metrics-certs\") pod \"network-metrics-daemon-fhvt9\" (UID: \"8fd03c97-7fa6-42e9-ab95-5fde631dcd29\") " pod="openshift-multus/network-metrics-daemon-fhvt9" May 21 13:02:36.021819 ip-10-0-133-64 kubenswrapper[2562]: I0521 13:02:36.021420 2562 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-2r7z9\" (UniqueName: \"kubernetes.io/projected/9e5a4d6a-bac9-4fb2-97b6-ae1675433f6e-kube-api-access-2r7z9\") pod \"network-check-target-zkhxz\" (UID: \"9e5a4d6a-bac9-4fb2-97b6-ae1675433f6e\") " pod="openshift-network-diagnostics/network-check-target-zkhxz" May 21 13:02:36.021819 ip-10-0-133-64 kubenswrapper[2562]: E0521 13:02:36.021518 2562 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered May 21 13:02:36.021819 ip-10-0-133-64 kubenswrapper[2562]: E0521 13:02:36.021632 2562 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/8fd03c97-7fa6-42e9-ab95-5fde631dcd29-metrics-certs podName:8fd03c97-7fa6-42e9-ab95-5fde631dcd29 nodeName:}" failed. No retries permitted until 2026-05-21 13:02:36.521581685 +0000 UTC m=+3.071863045 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/8fd03c97-7fa6-42e9-ab95-5fde631dcd29-metrics-certs") pod "network-metrics-daemon-fhvt9" (UID: "8fd03c97-7fa6-42e9-ab95-5fde631dcd29") : object "openshift-multus"/"metrics-daemon-secret" not registered May 21 13:02:36.021819 ip-10-0-133-64 kubenswrapper[2562]: I0521 13:02:36.021635 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/0ab0e3ad-cd32-4b7d-aea2-93bfd52b94ca-cnibin\") pod \"multus-additional-cni-plugins-p8bmj\" (UID: \"0ab0e3ad-cd32-4b7d-aea2-93bfd52b94ca\") " pod="openshift-multus/multus-additional-cni-plugins-p8bmj" May 21 13:02:36.021819 ip-10-0-133-64 kubenswrapper[2562]: I0521 13:02:36.021757 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/b74d36d8-43b2-428f-a5a7-8701f9fae368-socket-dir\") pod \"aws-ebs-csi-driver-node-snb4z\" (UID: \"b74d36d8-43b2-428f-a5a7-8701f9fae368\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-snb4z" May 21 13:02:36.022160 ip-10-0-133-64 kubenswrapper[2562]: I0521 13:02:36.021894 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/e416ed10-9d00-41ee-8c5e-6acf4f78643f-hostroot\") pod \"multus-5hhpk\" (UID: \"e416ed10-9d00-41ee-8c5e-6acf4f78643f\") " pod="openshift-multus/multus-5hhpk" May 21 13:02:36.022160 ip-10-0-133-64 kubenswrapper[2562]: I0521 13:02:36.021927 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/0ab0e3ad-cd32-4b7d-aea2-93bfd52b94ca-tuning-conf-dir\") pod \"multus-additional-cni-plugins-p8bmj\" (UID: \"0ab0e3ad-cd32-4b7d-aea2-93bfd52b94ca\") " pod="openshift-multus/multus-additional-cni-plugins-p8bmj" May 21 13:02:36.022160 ip-10-0-133-64 kubenswrapper[2562]: I0521 13:02:36.021961 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/2d49aff3-1eb6-46f0-bfe3-c5b167536671-host-kubelet\") pod \"ovnkube-node-ltpwh\" (UID: \"2d49aff3-1eb6-46f0-bfe3-c5b167536671\") " pod="openshift-ovn-kubernetes/ovnkube-node-ltpwh" May 21 13:02:36.022160 ip-10-0-133-64 kubenswrapper[2562]: I0521 13:02:36.022136 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/2d49aff3-1eb6-46f0-bfe3-c5b167536671-ovnkube-config\") pod \"ovnkube-node-ltpwh\" (UID: \"2d49aff3-1eb6-46f0-bfe3-c5b167536671\") " pod="openshift-ovn-kubernetes/ovnkube-node-ltpwh" May 21 13:02:36.022313 ip-10-0-133-64 kubenswrapper[2562]: I0521 13:02:36.021593 2562 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/e416ed10-9d00-41ee-8c5e-6acf4f78643f-cni-binary-copy\") pod \"multus-5hhpk\" (UID: \"e416ed10-9d00-41ee-8c5e-6acf4f78643f\") " pod="openshift-multus/multus-5hhpk" May 21 13:02:36.022640 ip-10-0-133-64 kubenswrapper[2562]: I0521 13:02:36.022613 2562 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/e416ed10-9d00-41ee-8c5e-6acf4f78643f-etc-kubernetes\") pod \"multus-5hhpk\" (UID: \"e416ed10-9d00-41ee-8c5e-6acf4f78643f\") " pod="openshift-multus/multus-5hhpk" May 21 13:02:36.022767 ip-10-0-133-64 kubenswrapper[2562]: I0521 13:02:36.022655 2562 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/2d49aff3-1eb6-46f0-bfe3-c5b167536671-ovn-node-metrics-cert\") pod \"ovnkube-node-ltpwh\" (UID: \"2d49aff3-1eb6-46f0-bfe3-c5b167536671\") " pod="openshift-ovn-kubernetes/ovnkube-node-ltpwh" May 21 13:02:36.022767 ip-10-0-133-64 kubenswrapper[2562]: I0521 13:02:36.022683 2562 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/0ab0e3ad-cd32-4b7d-aea2-93bfd52b94ca-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-p8bmj\" (UID: \"0ab0e3ad-cd32-4b7d-aea2-93bfd52b94ca\") " pod="openshift-multus/multus-additional-cni-plugins-p8bmj" May 21 13:02:36.022767 ip-10-0-133-64 kubenswrapper[2562]: I0521 13:02:36.022708 2562 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/9782b774-8d77-4b0b-bf5f-4678a677e161-etc-systemd\") pod \"tuned-sjffj\" (UID: \"9782b774-8d77-4b0b-bf5f-4678a677e161\") " pod="openshift-cluster-node-tuning-operator/tuned-sjffj" May 21 13:02:36.022767 ip-10-0-133-64 kubenswrapper[2562]: I0521 13:02:36.022734 2562 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/e416ed10-9d00-41ee-8c5e-6acf4f78643f-multus-cni-dir\") pod \"multus-5hhpk\" (UID: \"e416ed10-9d00-41ee-8c5e-6acf4f78643f\") " pod="openshift-multus/multus-5hhpk" May 21 13:02:36.022767 ip-10-0-133-64 kubenswrapper[2562]: I0521 13:02:36.022758 2562 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/2d49aff3-1eb6-46f0-bfe3-c5b167536671-etc-openvswitch\") pod \"ovnkube-node-ltpwh\" (UID: \"2d49aff3-1eb6-46f0-bfe3-c5b167536671\") " pod="openshift-ovn-kubernetes/ovnkube-node-ltpwh" May 21 13:02:36.023054 ip-10-0-133-64 kubenswrapper[2562]: I0521 13:02:36.022759 2562 swap_util.go:74] "error creating dir to test if tmpfs noswap is enabled. Assuming not supported" mount path="" error="stat /var/lib/kubelet/plugins/kubernetes.io/empty-dir: no such file or directory" May 21 13:02:36.023054 ip-10-0-133-64 kubenswrapper[2562]: I0521 13:02:36.022781 2562 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/b74d36d8-43b2-428f-a5a7-8701f9fae368-kubelet-dir\") pod \"aws-ebs-csi-driver-node-snb4z\" (UID: \"b74d36d8-43b2-428f-a5a7-8701f9fae368\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-snb4z" May 21 13:02:36.023054 ip-10-0-133-64 kubenswrapper[2562]: I0521 13:02:36.022829 2562 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/b37e4909-8e26-4b8d-856d-34f9d0c5832e-konnectivity-ca\") pod \"konnectivity-agent-4zjmp\" (UID: \"b37e4909-8e26-4b8d-856d-34f9d0c5832e\") " pod="kube-system/konnectivity-agent-4zjmp" May 21 13:02:36.023054 ip-10-0-133-64 kubenswrapper[2562]: I0521 13:02:36.022853 2562 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/da3fc398-1999-44e7-80b5-5f699d3f7744-serviceca\") pod \"node-ca-lm4qk\" (UID: \"da3fc398-1999-44e7-80b5-5f699d3f7744\") " pod="openshift-image-registry/node-ca-lm4qk" May 21 13:02:36.023054 ip-10-0-133-64 kubenswrapper[2562]: I0521 13:02:36.022877 2562 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/e416ed10-9d00-41ee-8c5e-6acf4f78643f-host-run-netns\") pod \"multus-5hhpk\" (UID: \"e416ed10-9d00-41ee-8c5e-6acf4f78643f\") " pod="openshift-multus/multus-5hhpk" May 21 13:02:36.023054 ip-10-0-133-64 kubenswrapper[2562]: I0521 13:02:36.022889 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/e416ed10-9d00-41ee-8c5e-6acf4f78643f-multus-cni-dir\") pod \"multus-5hhpk\" (UID: \"e416ed10-9d00-41ee-8c5e-6acf4f78643f\") " pod="openshift-multus/multus-5hhpk" May 21 13:02:36.023054 ip-10-0-133-64 kubenswrapper[2562]: I0521 13:02:36.022900 2562 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/2d49aff3-1eb6-46f0-bfe3-c5b167536671-run-openvswitch\") pod \"ovnkube-node-ltpwh\" (UID: \"2d49aff3-1eb6-46f0-bfe3-c5b167536671\") " pod="openshift-ovn-kubernetes/ovnkube-node-ltpwh" May 21 13:02:36.023054 ip-10-0-133-64 kubenswrapper[2562]: I0521 13:02:36.022940 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/2d49aff3-1eb6-46f0-bfe3-c5b167536671-run-openvswitch\") pod \"ovnkube-node-ltpwh\" (UID: \"2d49aff3-1eb6-46f0-bfe3-c5b167536671\") " pod="openshift-ovn-kubernetes/ovnkube-node-ltpwh" May 21 13:02:36.023054 ip-10-0-133-64 kubenswrapper[2562]: I0521 13:02:36.022942 2562 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/e416ed10-9d00-41ee-8c5e-6acf4f78643f-system-cni-dir\") pod \"multus-5hhpk\" (UID: \"e416ed10-9d00-41ee-8c5e-6acf4f78643f\") " pod="openshift-multus/multus-5hhpk" May 21 13:02:36.023054 ip-10-0-133-64 kubenswrapper[2562]: I0521 13:02:36.022980 2562 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/e416ed10-9d00-41ee-8c5e-6acf4f78643f-host-run-k8s-cni-cncf-io\") pod \"multus-5hhpk\" (UID: \"e416ed10-9d00-41ee-8c5e-6acf4f78643f\") " pod="openshift-multus/multus-5hhpk" May 21 13:02:36.023054 ip-10-0-133-64 kubenswrapper[2562]: I0521 13:02:36.022988 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/e416ed10-9d00-41ee-8c5e-6acf4f78643f-system-cni-dir\") pod \"multus-5hhpk\" (UID: \"e416ed10-9d00-41ee-8c5e-6acf4f78643f\") " pod="openshift-multus/multus-5hhpk" May 21 13:02:36.023054 ip-10-0-133-64 kubenswrapper[2562]: I0521 13:02:36.023013 2562 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-gxl92\" (UniqueName: \"kubernetes.io/projected/0ab0e3ad-cd32-4b7d-aea2-93bfd52b94ca-kube-api-access-gxl92\") pod \"multus-additional-cni-plugins-p8bmj\" (UID: \"0ab0e3ad-cd32-4b7d-aea2-93bfd52b94ca\") " pod="openshift-multus/multus-additional-cni-plugins-p8bmj" May 21 13:02:36.023054 ip-10-0-133-64 kubenswrapper[2562]: I0521 13:02:36.023042 2562 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/9782b774-8d77-4b0b-bf5f-4678a677e161-etc-modprobe-d\") pod \"tuned-sjffj\" (UID: \"9782b774-8d77-4b0b-bf5f-4678a677e161\") " pod="openshift-cluster-node-tuning-operator/tuned-sjffj" May 21 13:02:36.023054 ip-10-0-133-64 kubenswrapper[2562]: I0521 13:02:36.023055 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/e416ed10-9d00-41ee-8c5e-6acf4f78643f-cni-binary-copy\") pod \"multus-5hhpk\" (UID: \"e416ed10-9d00-41ee-8c5e-6acf4f78643f\") " pod="openshift-multus/multus-5hhpk" May 21 13:02:36.023689 ip-10-0-133-64 kubenswrapper[2562]: I0521 13:02:36.023068 2562 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/e416ed10-9d00-41ee-8c5e-6acf4f78643f-host-run-multus-certs\") pod \"multus-5hhpk\" (UID: \"e416ed10-9d00-41ee-8c5e-6acf4f78643f\") " pod="openshift-multus/multus-5hhpk" May 21 13:02:36.023689 ip-10-0-133-64 kubenswrapper[2562]: I0521 13:02:36.023105 2562 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/b74d36d8-43b2-428f-a5a7-8701f9fae368-etc-selinux\") pod \"aws-ebs-csi-driver-node-snb4z\" (UID: \"b74d36d8-43b2-428f-a5a7-8701f9fae368\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-snb4z" May 21 13:02:36.023689 ip-10-0-133-64 kubenswrapper[2562]: I0521 13:02:36.023112 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/2d49aff3-1eb6-46f0-bfe3-c5b167536671-etc-openvswitch\") pod \"ovnkube-node-ltpwh\" (UID: \"2d49aff3-1eb6-46f0-bfe3-c5b167536671\") " pod="openshift-ovn-kubernetes/ovnkube-node-ltpwh" May 21 13:02:36.023689 ip-10-0-133-64 kubenswrapper[2562]: I0521 13:02:36.023136 2562 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/0ab0e3ad-cd32-4b7d-aea2-93bfd52b94ca-system-cni-dir\") pod \"multus-additional-cni-plugins-p8bmj\" (UID: \"0ab0e3ad-cd32-4b7d-aea2-93bfd52b94ca\") " pod="openshift-multus/multus-additional-cni-plugins-p8bmj" May 21 13:02:36.023689 ip-10-0-133-64 kubenswrapper[2562]: I0521 13:02:36.023160 2562 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/9782b774-8d77-4b0b-bf5f-4678a677e161-etc-sysconfig\") pod \"tuned-sjffj\" (UID: \"9782b774-8d77-4b0b-bf5f-4678a677e161\") " pod="openshift-cluster-node-tuning-operator/tuned-sjffj" May 21 13:02:36.023689 ip-10-0-133-64 kubenswrapper[2562]: I0521 13:02:36.023180 2562 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/9782b774-8d77-4b0b-bf5f-4678a677e161-etc-tuned\") pod \"tuned-sjffj\" (UID: \"9782b774-8d77-4b0b-bf5f-4678a677e161\") " pod="openshift-cluster-node-tuning-operator/tuned-sjffj" May 21 13:02:36.023689 ip-10-0-133-64 kubenswrapper[2562]: I0521 13:02:36.023201 2562 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/e416ed10-9d00-41ee-8c5e-6acf4f78643f-multus-socket-dir-parent\") pod \"multus-5hhpk\" (UID: \"e416ed10-9d00-41ee-8c5e-6acf4f78643f\") " pod="openshift-multus/multus-5hhpk" May 21 13:02:36.023689 ip-10-0-133-64 kubenswrapper[2562]: I0521 13:02:36.023225 2562 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/e416ed10-9d00-41ee-8c5e-6acf4f78643f-host-var-lib-cni-multus\") pod \"multus-5hhpk\" (UID: \"e416ed10-9d00-41ee-8c5e-6acf4f78643f\") " pod="openshift-multus/multus-5hhpk" May 21 13:02:36.023689 ip-10-0-133-64 kubenswrapper[2562]: I0521 13:02:36.023230 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/9782b774-8d77-4b0b-bf5f-4678a677e161-etc-modprobe-d\") pod \"tuned-sjffj\" (UID: \"9782b774-8d77-4b0b-bf5f-4678a677e161\") " pod="openshift-cluster-node-tuning-operator/tuned-sjffj" May 21 13:02:36.023689 ip-10-0-133-64 kubenswrapper[2562]: I0521 13:02:36.023253 2562 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-6klh7\" (UniqueName: \"kubernetes.io/projected/8fd03c97-7fa6-42e9-ab95-5fde631dcd29-kube-api-access-6klh7\") pod \"network-metrics-daemon-fhvt9\" (UID: \"8fd03c97-7fa6-42e9-ab95-5fde631dcd29\") " pod="openshift-multus/network-metrics-daemon-fhvt9" May 21 13:02:36.023689 ip-10-0-133-64 kubenswrapper[2562]: I0521 13:02:36.023117 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/e416ed10-9d00-41ee-8c5e-6acf4f78643f-host-run-netns\") pod \"multus-5hhpk\" (UID: \"e416ed10-9d00-41ee-8c5e-6acf4f78643f\") " pod="openshift-multus/multus-5hhpk" May 21 13:02:36.023689 ip-10-0-133-64 kubenswrapper[2562]: I0521 13:02:36.023280 2562 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-n225x\" (UniqueName: \"kubernetes.io/projected/da3fc398-1999-44e7-80b5-5f699d3f7744-kube-api-access-n225x\") pod \"node-ca-lm4qk\" (UID: \"da3fc398-1999-44e7-80b5-5f699d3f7744\") " pod="openshift-image-registry/node-ca-lm4qk" May 21 13:02:36.023689 ip-10-0-133-64 kubenswrapper[2562]: I0521 13:02:36.023299 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/e416ed10-9d00-41ee-8c5e-6acf4f78643f-host-run-multus-certs\") pod \"multus-5hhpk\" (UID: \"e416ed10-9d00-41ee-8c5e-6acf4f78643f\") " pod="openshift-multus/multus-5hhpk" May 21 13:02:36.023689 ip-10-0-133-64 kubenswrapper[2562]: I0521 13:02:36.023308 2562 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/4eea719d-a66b-4ce0-aa45-0ef984662354-iptables-alerter-script\") pod \"iptables-alerter-flqfh\" (UID: \"4eea719d-a66b-4ce0-aa45-0ef984662354\") " pod="openshift-network-operator/iptables-alerter-flqfh" May 21 13:02:36.023689 ip-10-0-133-64 kubenswrapper[2562]: I0521 13:02:36.023320 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/e416ed10-9d00-41ee-8c5e-6acf4f78643f-host-run-k8s-cni-cncf-io\") pod \"multus-5hhpk\" (UID: \"e416ed10-9d00-41ee-8c5e-6acf4f78643f\") " pod="openshift-multus/multus-5hhpk" May 21 13:02:36.023689 ip-10-0-133-64 kubenswrapper[2562]: I0521 13:02:36.023352 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/b74d36d8-43b2-428f-a5a7-8701f9fae368-kubelet-dir\") pod \"aws-ebs-csi-driver-node-snb4z\" (UID: \"b74d36d8-43b2-428f-a5a7-8701f9fae368\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-snb4z" May 21 13:02:36.023689 ip-10-0-133-64 kubenswrapper[2562]: I0521 13:02:36.023365 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/e416ed10-9d00-41ee-8c5e-6acf4f78643f-etc-kubernetes\") pod \"multus-5hhpk\" (UID: \"e416ed10-9d00-41ee-8c5e-6acf4f78643f\") " pod="openshift-multus/multus-5hhpk" May 21 13:02:36.024511 ip-10-0-133-64 kubenswrapper[2562]: I0521 13:02:36.023378 2562 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/2d49aff3-1eb6-46f0-bfe3-c5b167536671-host-slash\") pod \"ovnkube-node-ltpwh\" (UID: \"2d49aff3-1eb6-46f0-bfe3-c5b167536671\") " pod="openshift-ovn-kubernetes/ovnkube-node-ltpwh" May 21 13:02:36.024511 ip-10-0-133-64 kubenswrapper[2562]: I0521 13:02:36.023404 2562 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/2d49aff3-1eb6-46f0-bfe3-c5b167536671-run-ovn\") pod \"ovnkube-node-ltpwh\" (UID: \"2d49aff3-1eb6-46f0-bfe3-c5b167536671\") " pod="openshift-ovn-kubernetes/ovnkube-node-ltpwh" May 21 13:02:36.024511 ip-10-0-133-64 kubenswrapper[2562]: I0521 13:02:36.023411 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/9782b774-8d77-4b0b-bf5f-4678a677e161-etc-systemd\") pod \"tuned-sjffj\" (UID: \"9782b774-8d77-4b0b-bf5f-4678a677e161\") " pod="openshift-cluster-node-tuning-operator/tuned-sjffj" May 21 13:02:36.024511 ip-10-0-133-64 kubenswrapper[2562]: I0521 13:02:36.023439 2562 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/2d49aff3-1eb6-46f0-bfe3-c5b167536671-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-ltpwh\" (UID: \"2d49aff3-1eb6-46f0-bfe3-c5b167536671\") " pod="openshift-ovn-kubernetes/ovnkube-node-ltpwh" May 21 13:02:36.024511 ip-10-0-133-64 kubenswrapper[2562]: I0521 13:02:36.023465 2562 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/2d49aff3-1eb6-46f0-bfe3-c5b167536671-env-overrides\") pod \"ovnkube-node-ltpwh\" (UID: \"2d49aff3-1eb6-46f0-bfe3-c5b167536671\") " pod="openshift-ovn-kubernetes/ovnkube-node-ltpwh" May 21 13:02:36.024511 ip-10-0-133-64 kubenswrapper[2562]: I0521 13:02:36.023468 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/2d49aff3-1eb6-46f0-bfe3-c5b167536671-host-slash\") pod \"ovnkube-node-ltpwh\" (UID: \"2d49aff3-1eb6-46f0-bfe3-c5b167536671\") " pod="openshift-ovn-kubernetes/ovnkube-node-ltpwh" May 21 13:02:36.024511 ip-10-0-133-64 kubenswrapper[2562]: I0521 13:02:36.023484 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/0ab0e3ad-cd32-4b7d-aea2-93bfd52b94ca-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-p8bmj\" (UID: \"0ab0e3ad-cd32-4b7d-aea2-93bfd52b94ca\") " pod="openshift-multus/multus-additional-cni-plugins-p8bmj" May 21 13:02:36.024511 ip-10-0-133-64 kubenswrapper[2562]: I0521 13:02:36.023498 2562 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/2d49aff3-1eb6-46f0-bfe3-c5b167536671-ovnkube-script-lib\") pod \"ovnkube-node-ltpwh\" (UID: \"2d49aff3-1eb6-46f0-bfe3-c5b167536671\") " pod="openshift-ovn-kubernetes/ovnkube-node-ltpwh" May 21 13:02:36.024511 ip-10-0-133-64 kubenswrapper[2562]: I0521 13:02:36.023525 2562 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/2d49aff3-1eb6-46f0-bfe3-c5b167536671-run-systemd\") pod \"ovnkube-node-ltpwh\" (UID: \"2d49aff3-1eb6-46f0-bfe3-c5b167536671\") " pod="openshift-ovn-kubernetes/ovnkube-node-ltpwh" May 21 13:02:36.024511 ip-10-0-133-64 kubenswrapper[2562]: I0521 13:02:36.023526 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/b37e4909-8e26-4b8d-856d-34f9d0c5832e-konnectivity-ca\") pod \"konnectivity-agent-4zjmp\" (UID: \"b37e4909-8e26-4b8d-856d-34f9d0c5832e\") " pod="kube-system/konnectivity-agent-4zjmp" May 21 13:02:36.024511 ip-10-0-133-64 kubenswrapper[2562]: I0521 13:02:36.023566 2562 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/2d49aff3-1eb6-46f0-bfe3-c5b167536671-var-lib-openvswitch\") pod \"ovnkube-node-ltpwh\" (UID: \"2d49aff3-1eb6-46f0-bfe3-c5b167536671\") " pod="openshift-ovn-kubernetes/ovnkube-node-ltpwh" May 21 13:02:36.024511 ip-10-0-133-64 kubenswrapper[2562]: I0521 13:02:36.023592 2562 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/2d49aff3-1eb6-46f0-bfe3-c5b167536671-host-cni-netd\") pod \"ovnkube-node-ltpwh\" (UID: \"2d49aff3-1eb6-46f0-bfe3-c5b167536671\") " pod="openshift-ovn-kubernetes/ovnkube-node-ltpwh" May 21 13:02:36.024511 ip-10-0-133-64 kubenswrapper[2562]: I0521 13:02:36.023616 2562 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/9782b774-8d77-4b0b-bf5f-4678a677e161-host\") pod \"tuned-sjffj\" (UID: \"9782b774-8d77-4b0b-bf5f-4678a677e161\") " pod="openshift-cluster-node-tuning-operator/tuned-sjffj" May 21 13:02:36.024511 ip-10-0-133-64 kubenswrapper[2562]: I0521 13:02:36.023640 2562 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/e416ed10-9d00-41ee-8c5e-6acf4f78643f-host-var-lib-cni-bin\") pod \"multus-5hhpk\" (UID: \"e416ed10-9d00-41ee-8c5e-6acf4f78643f\") " pod="openshift-multus/multus-5hhpk" May 21 13:02:36.024511 ip-10-0-133-64 kubenswrapper[2562]: I0521 13:02:36.023664 2562 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/e416ed10-9d00-41ee-8c5e-6acf4f78643f-multus-conf-dir\") pod \"multus-5hhpk\" (UID: \"e416ed10-9d00-41ee-8c5e-6acf4f78643f\") " pod="openshift-multus/multus-5hhpk" May 21 13:02:36.024511 ip-10-0-133-64 kubenswrapper[2562]: I0521 13:02:36.023692 2562 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/4eea719d-a66b-4ce0-aa45-0ef984662354-host-slash\") pod \"iptables-alerter-flqfh\" (UID: \"4eea719d-a66b-4ce0-aa45-0ef984662354\") " pod="openshift-network-operator/iptables-alerter-flqfh" May 21 13:02:36.024511 ip-10-0-133-64 kubenswrapper[2562]: I0521 13:02:36.023724 2562 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/2d49aff3-1eb6-46f0-bfe3-c5b167536671-node-log\") pod \"ovnkube-node-ltpwh\" (UID: \"2d49aff3-1eb6-46f0-bfe3-c5b167536671\") " pod="openshift-ovn-kubernetes/ovnkube-node-ltpwh" May 21 13:02:36.025328 ip-10-0-133-64 kubenswrapper[2562]: I0521 13:02:36.023749 2562 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/2d49aff3-1eb6-46f0-bfe3-c5b167536671-log-socket\") pod \"ovnkube-node-ltpwh\" (UID: \"2d49aff3-1eb6-46f0-bfe3-c5b167536671\") " pod="openshift-ovn-kubernetes/ovnkube-node-ltpwh" May 21 13:02:36.025328 ip-10-0-133-64 kubenswrapper[2562]: I0521 13:02:36.023775 2562 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/9782b774-8d77-4b0b-bf5f-4678a677e161-sys\") pod \"tuned-sjffj\" (UID: \"9782b774-8d77-4b0b-bf5f-4678a677e161\") " pod="openshift-cluster-node-tuning-operator/tuned-sjffj" May 21 13:02:36.025328 ip-10-0-133-64 kubenswrapper[2562]: I0521 13:02:36.023818 2562 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/e416ed10-9d00-41ee-8c5e-6acf4f78643f-cnibin\") pod \"multus-5hhpk\" (UID: \"e416ed10-9d00-41ee-8c5e-6acf4f78643f\") " pod="openshift-multus/multus-5hhpk" May 21 13:02:36.025328 ip-10-0-133-64 kubenswrapper[2562]: I0521 13:02:36.023829 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host\" (UniqueName: \"kubernetes.io/host-path/9782b774-8d77-4b0b-bf5f-4678a677e161-host\") pod \"tuned-sjffj\" (UID: \"9782b774-8d77-4b0b-bf5f-4678a677e161\") " pod="openshift-cluster-node-tuning-operator/tuned-sjffj" May 21 13:02:36.025328 ip-10-0-133-64 kubenswrapper[2562]: I0521 13:02:36.023843 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/2d49aff3-1eb6-46f0-bfe3-c5b167536671-env-overrides\") pod \"ovnkube-node-ltpwh\" (UID: \"2d49aff3-1eb6-46f0-bfe3-c5b167536671\") " pod="openshift-ovn-kubernetes/ovnkube-node-ltpwh" May 21 13:02:36.025328 ip-10-0-133-64 kubenswrapper[2562]: I0521 13:02:36.023847 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/4eea719d-a66b-4ce0-aa45-0ef984662354-iptables-alerter-script\") pod \"iptables-alerter-flqfh\" (UID: \"4eea719d-a66b-4ce0-aa45-0ef984662354\") " pod="openshift-network-operator/iptables-alerter-flqfh" May 21 13:02:36.025328 ip-10-0-133-64 kubenswrapper[2562]: I0521 13:02:36.023846 2562 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/0ab0e3ad-cd32-4b7d-aea2-93bfd52b94ca-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-p8bmj\" (UID: \"0ab0e3ad-cd32-4b7d-aea2-93bfd52b94ca\") " pod="openshift-multus/multus-additional-cni-plugins-p8bmj" May 21 13:02:36.025328 ip-10-0-133-64 kubenswrapper[2562]: I0521 13:02:36.023879 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/2d49aff3-1eb6-46f0-bfe3-c5b167536671-run-systemd\") pod \"ovnkube-node-ltpwh\" (UID: \"2d49aff3-1eb6-46f0-bfe3-c5b167536671\") " pod="openshift-ovn-kubernetes/ovnkube-node-ltpwh" May 21 13:02:36.025328 ip-10-0-133-64 kubenswrapper[2562]: I0521 13:02:36.023896 2562 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/9782b774-8d77-4b0b-bf5f-4678a677e161-var-lib-kubelet\") pod \"tuned-sjffj\" (UID: \"9782b774-8d77-4b0b-bf5f-4678a677e161\") " pod="openshift-cluster-node-tuning-operator/tuned-sjffj" May 21 13:02:36.025328 ip-10-0-133-64 kubenswrapper[2562]: I0521 13:02:36.023901 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/e416ed10-9d00-41ee-8c5e-6acf4f78643f-host-var-lib-cni-multus\") pod \"multus-5hhpk\" (UID: \"e416ed10-9d00-41ee-8c5e-6acf4f78643f\") " pod="openshift-multus/multus-5hhpk" May 21 13:02:36.025328 ip-10-0-133-64 kubenswrapper[2562]: I0521 13:02:36.023907 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/e416ed10-9d00-41ee-8c5e-6acf4f78643f-host-var-lib-cni-bin\") pod \"multus-5hhpk\" (UID: \"e416ed10-9d00-41ee-8c5e-6acf4f78643f\") " pod="openshift-multus/multus-5hhpk" May 21 13:02:36.025328 ip-10-0-133-64 kubenswrapper[2562]: I0521 13:02:36.023922 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/2d49aff3-1eb6-46f0-bfe3-c5b167536671-var-lib-openvswitch\") pod \"ovnkube-node-ltpwh\" (UID: \"2d49aff3-1eb6-46f0-bfe3-c5b167536671\") " pod="openshift-ovn-kubernetes/ovnkube-node-ltpwh" May 21 13:02:36.025328 ip-10-0-133-64 kubenswrapper[2562]: I0521 13:02:36.023924 2562 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-7hf5c\" (UniqueName: \"kubernetes.io/projected/9782b774-8d77-4b0b-bf5f-4678a677e161-kube-api-access-7hf5c\") pod \"tuned-sjffj\" (UID: \"9782b774-8d77-4b0b-bf5f-4678a677e161\") " pod="openshift-cluster-node-tuning-operator/tuned-sjffj" May 21 13:02:36.025328 ip-10-0-133-64 kubenswrapper[2562]: I0521 13:02:36.023967 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/2d49aff3-1eb6-46f0-bfe3-c5b167536671-log-socket\") pod \"ovnkube-node-ltpwh\" (UID: \"2d49aff3-1eb6-46f0-bfe3-c5b167536671\") " pod="openshift-ovn-kubernetes/ovnkube-node-ltpwh" May 21 13:02:36.025328 ip-10-0-133-64 kubenswrapper[2562]: I0521 13:02:36.023973 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/2d49aff3-1eb6-46f0-bfe3-c5b167536671-host-cni-netd\") pod \"ovnkube-node-ltpwh\" (UID: \"2d49aff3-1eb6-46f0-bfe3-c5b167536671\") " pod="openshift-ovn-kubernetes/ovnkube-node-ltpwh" May 21 13:02:36.025328 ip-10-0-133-64 kubenswrapper[2562]: I0521 13:02:36.024043 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/2d49aff3-1eb6-46f0-bfe3-c5b167536671-ovnkube-script-lib\") pod \"ovnkube-node-ltpwh\" (UID: \"2d49aff3-1eb6-46f0-bfe3-c5b167536671\") " pod="openshift-ovn-kubernetes/ovnkube-node-ltpwh" May 21 13:02:36.025328 ip-10-0-133-64 kubenswrapper[2562]: I0521 13:02:36.024045 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/e416ed10-9d00-41ee-8c5e-6acf4f78643f-cnibin\") pod \"multus-5hhpk\" (UID: \"e416ed10-9d00-41ee-8c5e-6acf4f78643f\") " pod="openshift-multus/multus-5hhpk" May 21 13:02:36.025328 ip-10-0-133-64 kubenswrapper[2562]: I0521 13:02:36.024078 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/9782b774-8d77-4b0b-bf5f-4678a677e161-sys\") pod \"tuned-sjffj\" (UID: \"9782b774-8d77-4b0b-bf5f-4678a677e161\") " pod="openshift-cluster-node-tuning-operator/tuned-sjffj" May 21 13:02:36.026162 ip-10-0-133-64 kubenswrapper[2562]: I0521 13:02:36.024116 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/e416ed10-9d00-41ee-8c5e-6acf4f78643f-multus-conf-dir\") pod \"multus-5hhpk\" (UID: \"e416ed10-9d00-41ee-8c5e-6acf4f78643f\") " pod="openshift-multus/multus-5hhpk" May 21 13:02:36.026162 ip-10-0-133-64 kubenswrapper[2562]: I0521 13:02:36.024120 2562 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/9782b774-8d77-4b0b-bf5f-4678a677e161-etc-kubernetes\") pod \"tuned-sjffj\" (UID: \"9782b774-8d77-4b0b-bf5f-4678a677e161\") " pod="openshift-cluster-node-tuning-operator/tuned-sjffj" May 21 13:02:36.026162 ip-10-0-133-64 kubenswrapper[2562]: I0521 13:02:36.023442 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/2d49aff3-1eb6-46f0-bfe3-c5b167536671-run-ovn\") pod \"ovnkube-node-ltpwh\" (UID: \"2d49aff3-1eb6-46f0-bfe3-c5b167536671\") " pod="openshift-ovn-kubernetes/ovnkube-node-ltpwh" May 21 13:02:36.026162 ip-10-0-133-64 kubenswrapper[2562]: I0521 13:02:36.024166 2562 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/2d49aff3-1eb6-46f0-bfe3-c5b167536671-host-run-ovn-kubernetes\") pod \"ovnkube-node-ltpwh\" (UID: \"2d49aff3-1eb6-46f0-bfe3-c5b167536671\") " pod="openshift-ovn-kubernetes/ovnkube-node-ltpwh" May 21 13:02:36.026162 ip-10-0-133-64 kubenswrapper[2562]: I0521 13:02:36.024161 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/2d49aff3-1eb6-46f0-bfe3-c5b167536671-node-log\") pod \"ovnkube-node-ltpwh\" (UID: \"2d49aff3-1eb6-46f0-bfe3-c5b167536671\") " pod="openshift-ovn-kubernetes/ovnkube-node-ltpwh" May 21 13:02:36.026162 ip-10-0-133-64 kubenswrapper[2562]: I0521 13:02:36.024195 2562 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/2d49aff3-1eb6-46f0-bfe3-c5b167536671-host-cni-bin\") pod \"ovnkube-node-ltpwh\" (UID: \"2d49aff3-1eb6-46f0-bfe3-c5b167536671\") " pod="openshift-ovn-kubernetes/ovnkube-node-ltpwh" May 21 13:02:36.026162 ip-10-0-133-64 kubenswrapper[2562]: I0521 13:02:36.024198 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/b74d36d8-43b2-428f-a5a7-8701f9fae368-etc-selinux\") pod \"aws-ebs-csi-driver-node-snb4z\" (UID: \"b74d36d8-43b2-428f-a5a7-8701f9fae368\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-snb4z" May 21 13:02:36.026162 ip-10-0-133-64 kubenswrapper[2562]: I0521 13:02:36.024218 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/2d49aff3-1eb6-46f0-bfe3-c5b167536671-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-ltpwh\" (UID: \"2d49aff3-1eb6-46f0-bfe3-c5b167536671\") " pod="openshift-ovn-kubernetes/ovnkube-node-ltpwh" May 21 13:02:36.026162 ip-10-0-133-64 kubenswrapper[2562]: I0521 13:02:36.024226 2562 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/b74d36d8-43b2-428f-a5a7-8701f9fae368-sys-fs\") pod \"aws-ebs-csi-driver-node-snb4z\" (UID: \"b74d36d8-43b2-428f-a5a7-8701f9fae368\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-snb4z" May 21 13:02:36.026162 ip-10-0-133-64 kubenswrapper[2562]: I0521 13:02:36.024253 2562 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/0ab0e3ad-cd32-4b7d-aea2-93bfd52b94ca-os-release\") pod \"multus-additional-cni-plugins-p8bmj\" (UID: \"0ab0e3ad-cd32-4b7d-aea2-93bfd52b94ca\") " pod="openshift-multus/multus-additional-cni-plugins-p8bmj" May 21 13:02:36.026162 ip-10-0-133-64 kubenswrapper[2562]: I0521 13:02:36.024259 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/2d49aff3-1eb6-46f0-bfe3-c5b167536671-host-run-ovn-kubernetes\") pod \"ovnkube-node-ltpwh\" (UID: \"2d49aff3-1eb6-46f0-bfe3-c5b167536671\") " pod="openshift-ovn-kubernetes/ovnkube-node-ltpwh" May 21 13:02:36.026162 ip-10-0-133-64 kubenswrapper[2562]: I0521 13:02:36.024263 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/0ab0e3ad-cd32-4b7d-aea2-93bfd52b94ca-system-cni-dir\") pod \"multus-additional-cni-plugins-p8bmj\" (UID: \"0ab0e3ad-cd32-4b7d-aea2-93bfd52b94ca\") " pod="openshift-multus/multus-additional-cni-plugins-p8bmj" May 21 13:02:36.026162 ip-10-0-133-64 kubenswrapper[2562]: I0521 13:02:36.024291 2562 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/0ab0e3ad-cd32-4b7d-aea2-93bfd52b94ca-cni-binary-copy\") pod \"multus-additional-cni-plugins-p8bmj\" (UID: \"0ab0e3ad-cd32-4b7d-aea2-93bfd52b94ca\") " pod="openshift-multus/multus-additional-cni-plugins-p8bmj" May 21 13:02:36.026162 ip-10-0-133-64 kubenswrapper[2562]: I0521 13:02:36.024295 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/0ab0e3ad-cd32-4b7d-aea2-93bfd52b94ca-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-p8bmj\" (UID: \"0ab0e3ad-cd32-4b7d-aea2-93bfd52b94ca\") " pod="openshift-multus/multus-additional-cni-plugins-p8bmj" May 21 13:02:36.026162 ip-10-0-133-64 kubenswrapper[2562]: I0521 13:02:36.024309 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/2d49aff3-1eb6-46f0-bfe3-c5b167536671-host-cni-bin\") pod \"ovnkube-node-ltpwh\" (UID: \"2d49aff3-1eb6-46f0-bfe3-c5b167536671\") " pod="openshift-ovn-kubernetes/ovnkube-node-ltpwh" May 21 13:02:36.026162 ip-10-0-133-64 kubenswrapper[2562]: I0521 13:02:36.024319 2562 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/9782b774-8d77-4b0b-bf5f-4678a677e161-etc-sysctl-conf\") pod \"tuned-sjffj\" (UID: \"9782b774-8d77-4b0b-bf5f-4678a677e161\") " pod="openshift-cluster-node-tuning-operator/tuned-sjffj" May 21 13:02:36.026162 ip-10-0-133-64 kubenswrapper[2562]: I0521 13:02:36.024342 2562 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"run\" (UniqueName: \"kubernetes.io/host-path/9782b774-8d77-4b0b-bf5f-4678a677e161-run\") pod \"tuned-sjffj\" (UID: \"9782b774-8d77-4b0b-bf5f-4678a677e161\") " pod="openshift-cluster-node-tuning-operator/tuned-sjffj" May 21 13:02:36.026715 ip-10-0-133-64 kubenswrapper[2562]: I0521 13:02:36.024363 2562 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/9782b774-8d77-4b0b-bf5f-4678a677e161-lib-modules\") pod \"tuned-sjffj\" (UID: \"9782b774-8d77-4b0b-bf5f-4678a677e161\") " pod="openshift-cluster-node-tuning-operator/tuned-sjffj" May 21 13:02:36.026715 ip-10-0-133-64 kubenswrapper[2562]: I0521 13:02:36.024371 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/e416ed10-9d00-41ee-8c5e-6acf4f78643f-multus-socket-dir-parent\") pod \"multus-5hhpk\" (UID: \"e416ed10-9d00-41ee-8c5e-6acf4f78643f\") " pod="openshift-multus/multus-5hhpk" May 21 13:02:36.026715 ip-10-0-133-64 kubenswrapper[2562]: I0521 13:02:36.024386 2562 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/2d49aff3-1eb6-46f0-bfe3-c5b167536671-host-run-netns\") pod \"ovnkube-node-ltpwh\" (UID: \"2d49aff3-1eb6-46f0-bfe3-c5b167536671\") " pod="openshift-ovn-kubernetes/ovnkube-node-ltpwh" May 21 13:02:36.026715 ip-10-0-133-64 kubenswrapper[2562]: I0521 13:02:36.024396 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/9782b774-8d77-4b0b-bf5f-4678a677e161-etc-kubernetes\") pod \"tuned-sjffj\" (UID: \"9782b774-8d77-4b0b-bf5f-4678a677e161\") " pod="openshift-cluster-node-tuning-operator/tuned-sjffj" May 21 13:02:36.026715 ip-10-0-133-64 kubenswrapper[2562]: I0521 13:02:36.024413 2562 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-hxb25\" (UniqueName: \"kubernetes.io/projected/2d49aff3-1eb6-46f0-bfe3-c5b167536671-kube-api-access-hxb25\") pod \"ovnkube-node-ltpwh\" (UID: \"2d49aff3-1eb6-46f0-bfe3-c5b167536671\") " pod="openshift-ovn-kubernetes/ovnkube-node-ltpwh" May 21 13:02:36.026715 ip-10-0-133-64 kubenswrapper[2562]: I0521 13:02:36.024420 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/9782b774-8d77-4b0b-bf5f-4678a677e161-etc-sysconfig\") pod \"tuned-sjffj\" (UID: \"9782b774-8d77-4b0b-bf5f-4678a677e161\") " pod="openshift-cluster-node-tuning-operator/tuned-sjffj" May 21 13:02:36.026715 ip-10-0-133-64 kubenswrapper[2562]: I0521 13:02:36.024362 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/b74d36d8-43b2-428f-a5a7-8701f9fae368-sys-fs\") pod \"aws-ebs-csi-driver-node-snb4z\" (UID: \"b74d36d8-43b2-428f-a5a7-8701f9fae368\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-snb4z" May 21 13:02:36.026715 ip-10-0-133-64 kubenswrapper[2562]: I0521 13:02:36.024439 2562 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/9782b774-8d77-4b0b-bf5f-4678a677e161-etc-sysctl-d\") pod \"tuned-sjffj\" (UID: \"9782b774-8d77-4b0b-bf5f-4678a677e161\") " pod="openshift-cluster-node-tuning-operator/tuned-sjffj" May 21 13:02:36.026715 ip-10-0-133-64 kubenswrapper[2562]: I0521 13:02:36.024444 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"run\" (UniqueName: \"kubernetes.io/host-path/9782b774-8d77-4b0b-bf5f-4678a677e161-run\") pod \"tuned-sjffj\" (UID: \"9782b774-8d77-4b0b-bf5f-4678a677e161\") " pod="openshift-cluster-node-tuning-operator/tuned-sjffj" May 21 13:02:36.026715 ip-10-0-133-64 kubenswrapper[2562]: I0521 13:02:36.024458 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/da3fc398-1999-44e7-80b5-5f699d3f7744-serviceca\") pod \"node-ca-lm4qk\" (UID: \"da3fc398-1999-44e7-80b5-5f699d3f7744\") " pod="openshift-image-registry/node-ca-lm4qk" May 21 13:02:36.026715 ip-10-0-133-64 kubenswrapper[2562]: I0521 13:02:36.024468 2562 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/da3fc398-1999-44e7-80b5-5f699d3f7744-host\") pod \"node-ca-lm4qk\" (UID: \"da3fc398-1999-44e7-80b5-5f699d3f7744\") " pod="openshift-image-registry/node-ca-lm4qk" May 21 13:02:36.026715 ip-10-0-133-64 kubenswrapper[2562]: I0521 13:02:36.024496 2562 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/e416ed10-9d00-41ee-8c5e-6acf4f78643f-os-release\") pod \"multus-5hhpk\" (UID: \"e416ed10-9d00-41ee-8c5e-6acf4f78643f\") " pod="openshift-multus/multus-5hhpk" May 21 13:02:36.026715 ip-10-0-133-64 kubenswrapper[2562]: I0521 13:02:36.024501 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/4eea719d-a66b-4ce0-aa45-0ef984662354-host-slash\") pod \"iptables-alerter-flqfh\" (UID: \"4eea719d-a66b-4ce0-aa45-0ef984662354\") " pod="openshift-network-operator/iptables-alerter-flqfh" May 21 13:02:36.026715 ip-10-0-133-64 kubenswrapper[2562]: I0521 13:02:36.024513 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/9782b774-8d77-4b0b-bf5f-4678a677e161-lib-modules\") pod \"tuned-sjffj\" (UID: \"9782b774-8d77-4b0b-bf5f-4678a677e161\") " pod="openshift-cluster-node-tuning-operator/tuned-sjffj" May 21 13:02:36.026715 ip-10-0-133-64 kubenswrapper[2562]: I0521 13:02:36.024320 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/0ab0e3ad-cd32-4b7d-aea2-93bfd52b94ca-os-release\") pod \"multus-additional-cni-plugins-p8bmj\" (UID: \"0ab0e3ad-cd32-4b7d-aea2-93bfd52b94ca\") " pod="openshift-multus/multus-additional-cni-plugins-p8bmj" May 21 13:02:36.026715 ip-10-0-133-64 kubenswrapper[2562]: I0521 13:02:36.024523 2562 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/e416ed10-9d00-41ee-8c5e-6acf4f78643f-host-var-lib-kubelet\") pod \"multus-5hhpk\" (UID: \"e416ed10-9d00-41ee-8c5e-6acf4f78643f\") " pod="openshift-multus/multus-5hhpk" May 21 13:02:36.026715 ip-10-0-133-64 kubenswrapper[2562]: I0521 13:02:36.024536 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/9782b774-8d77-4b0b-bf5f-4678a677e161-var-lib-kubelet\") pod \"tuned-sjffj\" (UID: \"9782b774-8d77-4b0b-bf5f-4678a677e161\") " pod="openshift-cluster-node-tuning-operator/tuned-sjffj" May 21 13:02:36.026715 ip-10-0-133-64 kubenswrapper[2562]: I0521 13:02:36.024559 2562 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/e416ed10-9d00-41ee-8c5e-6acf4f78643f-multus-daemon-config\") pod \"multus-5hhpk\" (UID: \"e416ed10-9d00-41ee-8c5e-6acf4f78643f\") " pod="openshift-multus/multus-5hhpk" May 21 13:02:36.027417 ip-10-0-133-64 kubenswrapper[2562]: I0521 13:02:36.024563 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/e416ed10-9d00-41ee-8c5e-6acf4f78643f-host-var-lib-kubelet\") pod \"multus-5hhpk\" (UID: \"e416ed10-9d00-41ee-8c5e-6acf4f78643f\") " pod="openshift-multus/multus-5hhpk" May 21 13:02:36.027417 ip-10-0-133-64 kubenswrapper[2562]: I0521 13:02:36.024581 2562 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/2d49aff3-1eb6-46f0-bfe3-c5b167536671-systemd-units\") pod \"ovnkube-node-ltpwh\" (UID: \"2d49aff3-1eb6-46f0-bfe3-c5b167536671\") " pod="openshift-ovn-kubernetes/ovnkube-node-ltpwh" May 21 13:02:36.027417 ip-10-0-133-64 kubenswrapper[2562]: I0521 13:02:36.024607 2562 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/b74d36d8-43b2-428f-a5a7-8701f9fae368-registration-dir\") pod \"aws-ebs-csi-driver-node-snb4z\" (UID: \"b74d36d8-43b2-428f-a5a7-8701f9fae368\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-snb4z" May 21 13:02:36.027417 ip-10-0-133-64 kubenswrapper[2562]: I0521 13:02:36.024610 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host\" (UniqueName: \"kubernetes.io/host-path/da3fc398-1999-44e7-80b5-5f699d3f7744-host\") pod \"node-ca-lm4qk\" (UID: \"da3fc398-1999-44e7-80b5-5f699d3f7744\") " pod="openshift-image-registry/node-ca-lm4qk" May 21 13:02:36.027417 ip-10-0-133-64 kubenswrapper[2562]: I0521 13:02:36.024618 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/9782b774-8d77-4b0b-bf5f-4678a677e161-etc-sysctl-conf\") pod \"tuned-sjffj\" (UID: \"9782b774-8d77-4b0b-bf5f-4678a677e161\") " pod="openshift-cluster-node-tuning-operator/tuned-sjffj" May 21 13:02:36.027417 ip-10-0-133-64 kubenswrapper[2562]: I0521 13:02:36.024632 2562 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/b74d36d8-43b2-428f-a5a7-8701f9fae368-device-dir\") pod \"aws-ebs-csi-driver-node-snb4z\" (UID: \"b74d36d8-43b2-428f-a5a7-8701f9fae368\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-snb4z" May 21 13:02:36.027417 ip-10-0-133-64 kubenswrapper[2562]: I0521 13:02:36.024640 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/9782b774-8d77-4b0b-bf5f-4678a677e161-etc-sysctl-d\") pod \"tuned-sjffj\" (UID: \"9782b774-8d77-4b0b-bf5f-4678a677e161\") " pod="openshift-cluster-node-tuning-operator/tuned-sjffj" May 21 13:02:36.027417 ip-10-0-133-64 kubenswrapper[2562]: I0521 13:02:36.024656 2562 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/9782b774-8d77-4b0b-bf5f-4678a677e161-tmp\") pod \"tuned-sjffj\" (UID: \"9782b774-8d77-4b0b-bf5f-4678a677e161\") " pod="openshift-cluster-node-tuning-operator/tuned-sjffj" May 21 13:02:36.027417 ip-10-0-133-64 kubenswrapper[2562]: I0521 13:02:36.024672 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/e416ed10-9d00-41ee-8c5e-6acf4f78643f-os-release\") pod \"multus-5hhpk\" (UID: \"e416ed10-9d00-41ee-8c5e-6acf4f78643f\") " pod="openshift-multus/multus-5hhpk" May 21 13:02:36.027417 ip-10-0-133-64 kubenswrapper[2562]: I0521 13:02:36.024682 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/2d49aff3-1eb6-46f0-bfe3-c5b167536671-host-run-netns\") pod \"ovnkube-node-ltpwh\" (UID: \"2d49aff3-1eb6-46f0-bfe3-c5b167536671\") " pod="openshift-ovn-kubernetes/ovnkube-node-ltpwh" May 21 13:02:36.027417 ip-10-0-133-64 kubenswrapper[2562]: I0521 13:02:36.024683 2562 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-9xdt5\" (UniqueName: \"kubernetes.io/projected/4eea719d-a66b-4ce0-aa45-0ef984662354-kube-api-access-9xdt5\") pod \"iptables-alerter-flqfh\" (UID: \"4eea719d-a66b-4ce0-aa45-0ef984662354\") " pod="openshift-network-operator/iptables-alerter-flqfh" May 21 13:02:36.027417 ip-10-0-133-64 kubenswrapper[2562]: I0521 13:02:36.024761 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/b74d36d8-43b2-428f-a5a7-8701f9fae368-registration-dir\") pod \"aws-ebs-csi-driver-node-snb4z\" (UID: \"b74d36d8-43b2-428f-a5a7-8701f9fae368\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-snb4z" May 21 13:02:36.027417 ip-10-0-133-64 kubenswrapper[2562]: I0521 13:02:36.024829 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/b74d36d8-43b2-428f-a5a7-8701f9fae368-device-dir\") pod \"aws-ebs-csi-driver-node-snb4z\" (UID: \"b74d36d8-43b2-428f-a5a7-8701f9fae368\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-snb4z" May 21 13:02:36.027417 ip-10-0-133-64 kubenswrapper[2562]: I0521 13:02:36.024658 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/2d49aff3-1eb6-46f0-bfe3-c5b167536671-systemd-units\") pod \"ovnkube-node-ltpwh\" (UID: \"2d49aff3-1eb6-46f0-bfe3-c5b167536671\") " pod="openshift-ovn-kubernetes/ovnkube-node-ltpwh" May 21 13:02:36.027417 ip-10-0-133-64 kubenswrapper[2562]: I0521 13:02:36.024922 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/0ab0e3ad-cd32-4b7d-aea2-93bfd52b94ca-cni-binary-copy\") pod \"multus-additional-cni-plugins-p8bmj\" (UID: \"0ab0e3ad-cd32-4b7d-aea2-93bfd52b94ca\") " pod="openshift-multus/multus-additional-cni-plugins-p8bmj" May 21 13:02:36.027417 ip-10-0-133-64 kubenswrapper[2562]: I0521 13:02:36.025129 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/e416ed10-9d00-41ee-8c5e-6acf4f78643f-multus-daemon-config\") pod \"multus-5hhpk\" (UID: \"e416ed10-9d00-41ee-8c5e-6acf4f78643f\") " pod="openshift-multus/multus-5hhpk" May 21 13:02:36.027417 ip-10-0-133-64 kubenswrapper[2562]: I0521 13:02:36.026858 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/2d49aff3-1eb6-46f0-bfe3-c5b167536671-ovn-node-metrics-cert\") pod \"ovnkube-node-ltpwh\" (UID: \"2d49aff3-1eb6-46f0-bfe3-c5b167536671\") " pod="openshift-ovn-kubernetes/ovnkube-node-ltpwh" May 21 13:02:36.027417 ip-10-0-133-64 kubenswrapper[2562]: I0521 13:02:36.027156 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/9782b774-8d77-4b0b-bf5f-4678a677e161-tmp\") pod \"tuned-sjffj\" (UID: \"9782b774-8d77-4b0b-bf5f-4678a677e161\") " pod="openshift-cluster-node-tuning-operator/tuned-sjffj" May 21 13:02:36.028240 ip-10-0-133-64 kubenswrapper[2562]: I0521 13:02:36.027290 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/9782b774-8d77-4b0b-bf5f-4678a677e161-etc-tuned\") pod \"tuned-sjffj\" (UID: \"9782b774-8d77-4b0b-bf5f-4678a677e161\") " pod="openshift-cluster-node-tuning-operator/tuned-sjffj" May 21 13:02:36.028240 ip-10-0-133-64 kubenswrapper[2562]: E0521 13:02:36.027586 2562 projected.go:289] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered May 21 13:02:36.028240 ip-10-0-133-64 kubenswrapper[2562]: E0521 13:02:36.027607 2562 projected.go:289] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered May 21 13:02:36.028240 ip-10-0-133-64 kubenswrapper[2562]: E0521 13:02:36.027620 2562 projected.go:194] Error preparing data for projected volume kube-api-access-2r7z9 for pod openshift-network-diagnostics/network-check-target-zkhxz: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] May 21 13:02:36.028240 ip-10-0-133-64 kubenswrapper[2562]: E0521 13:02:36.027688 2562 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/9e5a4d6a-bac9-4fb2-97b6-ae1675433f6e-kube-api-access-2r7z9 podName:9e5a4d6a-bac9-4fb2-97b6-ae1675433f6e nodeName:}" failed. No retries permitted until 2026-05-21 13:02:36.527668167 +0000 UTC m=+3.077949515 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "kube-api-access-2r7z9" (UniqueName: "kubernetes.io/projected/9e5a4d6a-bac9-4fb2-97b6-ae1675433f6e-kube-api-access-2r7z9") pod "network-check-target-zkhxz" (UID: "9e5a4d6a-bac9-4fb2-97b6-ae1675433f6e") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] May 21 13:02:36.028240 ip-10-0-133-64 kubenswrapper[2562]: I0521 13:02:36.027821 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/b37e4909-8e26-4b8d-856d-34f9d0c5832e-agent-certs\") pod \"konnectivity-agent-4zjmp\" (UID: \"b37e4909-8e26-4b8d-856d-34f9d0c5832e\") " pod="kube-system/konnectivity-agent-4zjmp" May 21 13:02:36.030215 ip-10-0-133-64 kubenswrapper[2562]: I0521 13:02:36.030191 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-lqlpv\" (UniqueName: \"kubernetes.io/projected/e416ed10-9d00-41ee-8c5e-6acf4f78643f-kube-api-access-lqlpv\") pod \"multus-5hhpk\" (UID: \"e416ed10-9d00-41ee-8c5e-6acf4f78643f\") " pod="openshift-multus/multus-5hhpk" May 21 13:02:36.030357 ip-10-0-133-64 kubenswrapper[2562]: I0521 13:02:36.030231 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-gxl92\" (UniqueName: \"kubernetes.io/projected/0ab0e3ad-cd32-4b7d-aea2-93bfd52b94ca-kube-api-access-gxl92\") pod \"multus-additional-cni-plugins-p8bmj\" (UID: \"0ab0e3ad-cd32-4b7d-aea2-93bfd52b94ca\") " pod="openshift-multus/multus-additional-cni-plugins-p8bmj" May 21 13:02:36.031039 ip-10-0-133-64 kubenswrapper[2562]: I0521 13:02:36.031018 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-6klh7\" (UniqueName: \"kubernetes.io/projected/8fd03c97-7fa6-42e9-ab95-5fde631dcd29-kube-api-access-6klh7\") pod \"network-metrics-daemon-fhvt9\" (UID: \"8fd03c97-7fa6-42e9-ab95-5fde631dcd29\") " pod="openshift-multus/network-metrics-daemon-fhvt9" May 21 13:02:36.031369 ip-10-0-133-64 kubenswrapper[2562]: I0521 13:02:36.031348 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-hf5z8\" (UniqueName: \"kubernetes.io/projected/b74d36d8-43b2-428f-a5a7-8701f9fae368-kube-api-access-hf5z8\") pod \"aws-ebs-csi-driver-node-snb4z\" (UID: \"b74d36d8-43b2-428f-a5a7-8701f9fae368\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-snb4z" May 21 13:02:36.034780 ip-10-0-133-64 kubenswrapper[2562]: I0521 13:02:36.034571 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-9xdt5\" (UniqueName: \"kubernetes.io/projected/4eea719d-a66b-4ce0-aa45-0ef984662354-kube-api-access-9xdt5\") pod \"iptables-alerter-flqfh\" (UID: \"4eea719d-a66b-4ce0-aa45-0ef984662354\") " pod="openshift-network-operator/iptables-alerter-flqfh" May 21 13:02:36.034780 ip-10-0-133-64 kubenswrapper[2562]: I0521 13:02:36.034728 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-n225x\" (UniqueName: \"kubernetes.io/projected/da3fc398-1999-44e7-80b5-5f699d3f7744-kube-api-access-n225x\") pod \"node-ca-lm4qk\" (UID: \"da3fc398-1999-44e7-80b5-5f699d3f7744\") " pod="openshift-image-registry/node-ca-lm4qk" May 21 13:02:36.034780 ip-10-0-133-64 kubenswrapper[2562]: I0521 13:02:36.034742 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-hxb25\" (UniqueName: \"kubernetes.io/projected/2d49aff3-1eb6-46f0-bfe3-c5b167536671-kube-api-access-hxb25\") pod \"ovnkube-node-ltpwh\" (UID: \"2d49aff3-1eb6-46f0-bfe3-c5b167536671\") " pod="openshift-ovn-kubernetes/ovnkube-node-ltpwh" May 21 13:02:36.035739 ip-10-0-133-64 kubenswrapper[2562]: I0521 13:02:36.035719 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-7hf5c\" (UniqueName: \"kubernetes.io/projected/9782b774-8d77-4b0b-bf5f-4678a677e161-kube-api-access-7hf5c\") pod \"tuned-sjffj\" (UID: \"9782b774-8d77-4b0b-bf5f-4678a677e161\") " pod="openshift-cluster-node-tuning-operator/tuned-sjffj" May 21 13:02:36.164576 ip-10-0-133-64 kubenswrapper[2562]: I0521 13:02:36.164508 2562 reflector.go:430] "Caches populated" type="*v1.RuntimeClass" reflector="k8s.io/client-go/informers/factory.go:160" May 21 13:02:36.206417 ip-10-0-133-64 kubenswrapper[2562]: I0521 13:02:36.206383 2562 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-5hhpk" May 21 13:02:36.215274 ip-10-0-133-64 kubenswrapper[2562]: I0521 13:02:36.215255 2562 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-operator/iptables-alerter-flqfh" May 21 13:02:36.223876 ip-10-0-133-64 kubenswrapper[2562]: I0521 13:02:36.223857 2562 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ovn-kubernetes/ovnkube-node-ltpwh" May 21 13:02:36.230593 ip-10-0-133-64 kubenswrapper[2562]: I0521 13:02:36.230574 2562 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-snb4z" May 21 13:02:36.237157 ip-10-0-133-64 kubenswrapper[2562]: I0521 13:02:36.237136 2562 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/node-ca-lm4qk" May 21 13:02:36.245732 ip-10-0-133-64 kubenswrapper[2562]: I0521 13:02:36.245704 2562 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-node-tuning-operator/tuned-sjffj" May 21 13:02:36.253302 ip-10-0-133-64 kubenswrapper[2562]: I0521 13:02:36.253285 2562 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/konnectivity-agent-4zjmp" May 21 13:02:36.260840 ip-10-0-133-64 kubenswrapper[2562]: I0521 13:02:36.260821 2562 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-additional-cni-plugins-p8bmj" May 21 13:02:36.527495 ip-10-0-133-64 kubenswrapper[2562]: I0521 13:02:36.527416 2562 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/8fd03c97-7fa6-42e9-ab95-5fde631dcd29-metrics-certs\") pod \"network-metrics-daemon-fhvt9\" (UID: \"8fd03c97-7fa6-42e9-ab95-5fde631dcd29\") " pod="openshift-multus/network-metrics-daemon-fhvt9" May 21 13:02:36.527659 ip-10-0-133-64 kubenswrapper[2562]: E0521 13:02:36.527596 2562 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered May 21 13:02:36.527710 ip-10-0-133-64 kubenswrapper[2562]: E0521 13:02:36.527662 2562 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/8fd03c97-7fa6-42e9-ab95-5fde631dcd29-metrics-certs podName:8fd03c97-7fa6-42e9-ab95-5fde631dcd29 nodeName:}" failed. No retries permitted until 2026-05-21 13:02:37.52764162 +0000 UTC m=+4.077922981 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/8fd03c97-7fa6-42e9-ab95-5fde631dcd29-metrics-certs") pod "network-metrics-daemon-fhvt9" (UID: "8fd03c97-7fa6-42e9-ab95-5fde631dcd29") : object "openshift-multus"/"metrics-daemon-secret" not registered May 21 13:02:36.600835 ip-10-0-133-64 kubenswrapper[2562]: W0521 13:02:36.600794 2562 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podb37e4909_8e26_4b8d_856d_34f9d0c5832e.slice/crio-4462cc30a40cddc916c73eac9a2349f36649fe24e59f04a4604ada9059ce4d1c WatchSource:0}: Error finding container 4462cc30a40cddc916c73eac9a2349f36649fe24e59f04a4604ada9059ce4d1c: Status 404 returned error can't find the container with id 4462cc30a40cddc916c73eac9a2349f36649fe24e59f04a4604ada9059ce4d1c May 21 13:02:36.601054 ip-10-0-133-64 kubenswrapper[2562]: W0521 13:02:36.601034 2562 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod9782b774_8d77_4b0b_bf5f_4678a677e161.slice/crio-0ff7c434110511afc2c298c2b909ca34fa1457392bba349a65ee5a55d081fe54 WatchSource:0}: Error finding container 0ff7c434110511afc2c298c2b909ca34fa1457392bba349a65ee5a55d081fe54: Status 404 returned error can't find the container with id 0ff7c434110511afc2c298c2b909ca34fa1457392bba349a65ee5a55d081fe54 May 21 13:02:36.603919 ip-10-0-133-64 kubenswrapper[2562]: W0521 13:02:36.603896 2562 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod2d49aff3_1eb6_46f0_bfe3_c5b167536671.slice/crio-44b062d26f6d4e6a98410b4c9612975f60040ef7be536b72c2a5a3d20e9a54ec WatchSource:0}: Error finding container 44b062d26f6d4e6a98410b4c9612975f60040ef7be536b72c2a5a3d20e9a54ec: Status 404 returned error can't find the container with id 44b062d26f6d4e6a98410b4c9612975f60040ef7be536b72c2a5a3d20e9a54ec May 21 13:02:36.604793 ip-10-0-133-64 kubenswrapper[2562]: W0521 13:02:36.604769 2562 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod0ab0e3ad_cd32_4b7d_aea2_93bfd52b94ca.slice/crio-717146f344f13c82761c561cce40b749951cccef7ecf0c7ff2ad72bdda955dc7 WatchSource:0}: Error finding container 717146f344f13c82761c561cce40b749951cccef7ecf0c7ff2ad72bdda955dc7: Status 404 returned error can't find the container with id 717146f344f13c82761c561cce40b749951cccef7ecf0c7ff2ad72bdda955dc7 May 21 13:02:36.607908 ip-10-0-133-64 kubenswrapper[2562]: W0521 13:02:36.607855 2562 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pode416ed10_9d00_41ee_8c5e_6acf4f78643f.slice/crio-806d7320b110d609b68e26585fc30a7c384c7a6623804ffa17cb909084dc03f6 WatchSource:0}: Error finding container 806d7320b110d609b68e26585fc30a7c384c7a6623804ffa17cb909084dc03f6: Status 404 returned error can't find the container with id 806d7320b110d609b68e26585fc30a7c384c7a6623804ffa17cb909084dc03f6 May 21 13:02:36.609042 ip-10-0-133-64 kubenswrapper[2562]: W0521 13:02:36.608971 2562 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podb74d36d8_43b2_428f_a5a7_8701f9fae368.slice/crio-e3be348c04d4c0283be7a490c6dad28ed9a07f9b8e4bfdb2d502b741587ef43f WatchSource:0}: Error finding container e3be348c04d4c0283be7a490c6dad28ed9a07f9b8e4bfdb2d502b741587ef43f: Status 404 returned error can't find the container with id e3be348c04d4c0283be7a490c6dad28ed9a07f9b8e4bfdb2d502b741587ef43f May 21 13:02:36.611136 ip-10-0-133-64 kubenswrapper[2562]: W0521 13:02:36.610902 2562 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podda3fc398_1999_44e7_80b5_5f699d3f7744.slice/crio-e2cc333cfde0559cfe70871e9f4c633c6a79405d959d12e1a6d5dfebf1823842 WatchSource:0}: Error finding container e2cc333cfde0559cfe70871e9f4c633c6a79405d959d12e1a6d5dfebf1823842: Status 404 returned error can't find the container with id e2cc333cfde0559cfe70871e9f4c633c6a79405d959d12e1a6d5dfebf1823842 May 21 13:02:36.611604 ip-10-0-133-64 kubenswrapper[2562]: W0521 13:02:36.611299 2562 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod4eea719d_a66b_4ce0_aa45_0ef984662354.slice/crio-37a0496409a99aab11ec01cba1e1f7c85980b49383b2aaadd2a147ce702cb193 WatchSource:0}: Error finding container 37a0496409a99aab11ec01cba1e1f7c85980b49383b2aaadd2a147ce702cb193: Status 404 returned error can't find the container with id 37a0496409a99aab11ec01cba1e1f7c85980b49383b2aaadd2a147ce702cb193 May 21 13:02:36.628502 ip-10-0-133-64 kubenswrapper[2562]: I0521 13:02:36.628475 2562 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-2r7z9\" (UniqueName: \"kubernetes.io/projected/9e5a4d6a-bac9-4fb2-97b6-ae1675433f6e-kube-api-access-2r7z9\") pod \"network-check-target-zkhxz\" (UID: \"9e5a4d6a-bac9-4fb2-97b6-ae1675433f6e\") " pod="openshift-network-diagnostics/network-check-target-zkhxz" May 21 13:02:36.628647 ip-10-0-133-64 kubenswrapper[2562]: E0521 13:02:36.628631 2562 projected.go:289] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered May 21 13:02:36.628707 ip-10-0-133-64 kubenswrapper[2562]: E0521 13:02:36.628655 2562 projected.go:289] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered May 21 13:02:36.628707 ip-10-0-133-64 kubenswrapper[2562]: E0521 13:02:36.628668 2562 projected.go:194] Error preparing data for projected volume kube-api-access-2r7z9 for pod openshift-network-diagnostics/network-check-target-zkhxz: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] May 21 13:02:36.628791 ip-10-0-133-64 kubenswrapper[2562]: E0521 13:02:36.628724 2562 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/9e5a4d6a-bac9-4fb2-97b6-ae1675433f6e-kube-api-access-2r7z9 podName:9e5a4d6a-bac9-4fb2-97b6-ae1675433f6e nodeName:}" failed. No retries permitted until 2026-05-21 13:02:37.628705069 +0000 UTC m=+4.178986415 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "kube-api-access-2r7z9" (UniqueName: "kubernetes.io/projected/9e5a4d6a-bac9-4fb2-97b6-ae1675433f6e-kube-api-access-2r7z9") pod "network-check-target-zkhxz" (UID: "9e5a4d6a-bac9-4fb2-97b6-ae1675433f6e") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] May 21 13:02:36.958932 ip-10-0-133-64 kubenswrapper[2562]: I0521 13:02:36.958886 2562 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kubelet-serving" expiration="2028-05-20 12:57:34 +0000 UTC" deadline="2028-02-18 07:48:30.904812142 +0000 UTC" May 21 13:02:36.958932 ip-10-0-133-64 kubenswrapper[2562]: I0521 13:02:36.958923 2562 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kubelet-serving" sleep="15306h45m53.945892601s" May 21 13:02:37.043470 ip-10-0-133-64 kubenswrapper[2562]: I0521 13:02:37.043407 2562 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-5hhpk" event={"ID":"e416ed10-9d00-41ee-8c5e-6acf4f78643f","Type":"ContainerStarted","Data":"806d7320b110d609b68e26585fc30a7c384c7a6623804ffa17cb909084dc03f6"} May 21 13:02:37.054115 ip-10-0-133-64 kubenswrapper[2562]: I0521 13:02:37.054078 2562 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-node-tuning-operator/tuned-sjffj" event={"ID":"9782b774-8d77-4b0b-bf5f-4678a677e161","Type":"ContainerStarted","Data":"0ff7c434110511afc2c298c2b909ca34fa1457392bba349a65ee5a55d081fe54"} May 21 13:02:37.057559 ip-10-0-133-64 kubenswrapper[2562]: I0521 13:02:37.057531 2562 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kube-system/konnectivity-agent-4zjmp" event={"ID":"b37e4909-8e26-4b8d-856d-34f9d0c5832e","Type":"ContainerStarted","Data":"4462cc30a40cddc916c73eac9a2349f36649fe24e59f04a4604ada9059ce4d1c"} May 21 13:02:37.060113 ip-10-0-133-64 kubenswrapper[2562]: I0521 13:02:37.060084 2562 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-snb4z" event={"ID":"b74d36d8-43b2-428f-a5a7-8701f9fae368","Type":"ContainerStarted","Data":"e3be348c04d4c0283be7a490c6dad28ed9a07f9b8e4bfdb2d502b741587ef43f"} May 21 13:02:37.061866 ip-10-0-133-64 kubenswrapper[2562]: I0521 13:02:37.061839 2562 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/node-ca-lm4qk" event={"ID":"da3fc398-1999-44e7-80b5-5f699d3f7744","Type":"ContainerStarted","Data":"e2cc333cfde0559cfe70871e9f4c633c6a79405d959d12e1a6d5dfebf1823842"} May 21 13:02:37.068343 ip-10-0-133-64 kubenswrapper[2562]: I0521 13:02:37.068142 2562 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-p8bmj" event={"ID":"0ab0e3ad-cd32-4b7d-aea2-93bfd52b94ca","Type":"ContainerStarted","Data":"717146f344f13c82761c561cce40b749951cccef7ecf0c7ff2ad72bdda955dc7"} May 21 13:02:37.072210 ip-10-0-133-64 kubenswrapper[2562]: I0521 13:02:37.072182 2562 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-ltpwh" event={"ID":"2d49aff3-1eb6-46f0-bfe3-c5b167536671","Type":"ContainerStarted","Data":"44b062d26f6d4e6a98410b4c9612975f60040ef7be536b72c2a5a3d20e9a54ec"} May 21 13:02:37.077819 ip-10-0-133-64 kubenswrapper[2562]: I0521 13:02:37.077653 2562 generic.go:358] "Generic (PLEG): container finished" podID="fe9d808f2e9ea9d31117a0e071d6f6f8" containerID="f481a32a51d3fad372b226baf1262a9838d70b00d7e6faea431764c9d14f761b" exitCode=0 May 21 13:02:37.077819 ip-10-0-133-64 kubenswrapper[2562]: I0521 13:02:37.077716 2562 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-133-64.ec2.internal" event={"ID":"fe9d808f2e9ea9d31117a0e071d6f6f8","Type":"ContainerDied","Data":"f481a32a51d3fad372b226baf1262a9838d70b00d7e6faea431764c9d14f761b"} May 21 13:02:37.090492 ip-10-0-133-64 kubenswrapper[2562]: I0521 13:02:37.090463 2562 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-133-64.ec2.internal" event={"ID":"831fde2011330f939091daa7a5d4d0a8","Type":"ContainerStarted","Data":"e68cfe65838739d334bc6b5a3819749b62f1037333f9e8618c0bab57da975f90"} May 21 13:02:37.096579 ip-10-0-133-64 kubenswrapper[2562]: I0521 13:02:37.096527 2562 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-network-operator/iptables-alerter-flqfh" event={"ID":"4eea719d-a66b-4ce0-aa45-0ef984662354","Type":"ContainerStarted","Data":"37a0496409a99aab11ec01cba1e1f7c85980b49383b2aaadd2a147ce702cb193"} May 21 13:02:37.537436 ip-10-0-133-64 kubenswrapper[2562]: I0521 13:02:37.537350 2562 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/8fd03c97-7fa6-42e9-ab95-5fde631dcd29-metrics-certs\") pod \"network-metrics-daemon-fhvt9\" (UID: \"8fd03c97-7fa6-42e9-ab95-5fde631dcd29\") " pod="openshift-multus/network-metrics-daemon-fhvt9" May 21 13:02:37.537598 ip-10-0-133-64 kubenswrapper[2562]: E0521 13:02:37.537535 2562 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered May 21 13:02:37.537658 ip-10-0-133-64 kubenswrapper[2562]: E0521 13:02:37.537603 2562 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/8fd03c97-7fa6-42e9-ab95-5fde631dcd29-metrics-certs podName:8fd03c97-7fa6-42e9-ab95-5fde631dcd29 nodeName:}" failed. No retries permitted until 2026-05-21 13:02:39.537584106 +0000 UTC m=+6.087865457 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/8fd03c97-7fa6-42e9-ab95-5fde631dcd29-metrics-certs") pod "network-metrics-daemon-fhvt9" (UID: "8fd03c97-7fa6-42e9-ab95-5fde631dcd29") : object "openshift-multus"/"metrics-daemon-secret" not registered May 21 13:02:37.638760 ip-10-0-133-64 kubenswrapper[2562]: I0521 13:02:37.638722 2562 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-2r7z9\" (UniqueName: \"kubernetes.io/projected/9e5a4d6a-bac9-4fb2-97b6-ae1675433f6e-kube-api-access-2r7z9\") pod \"network-check-target-zkhxz\" (UID: \"9e5a4d6a-bac9-4fb2-97b6-ae1675433f6e\") " pod="openshift-network-diagnostics/network-check-target-zkhxz" May 21 13:02:37.638943 ip-10-0-133-64 kubenswrapper[2562]: E0521 13:02:37.638898 2562 projected.go:289] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered May 21 13:02:37.638943 ip-10-0-133-64 kubenswrapper[2562]: E0521 13:02:37.638922 2562 projected.go:289] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered May 21 13:02:37.638943 ip-10-0-133-64 kubenswrapper[2562]: E0521 13:02:37.638935 2562 projected.go:194] Error preparing data for projected volume kube-api-access-2r7z9 for pod openshift-network-diagnostics/network-check-target-zkhxz: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] May 21 13:02:37.639107 ip-10-0-133-64 kubenswrapper[2562]: E0521 13:02:37.638994 2562 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/9e5a4d6a-bac9-4fb2-97b6-ae1675433f6e-kube-api-access-2r7z9 podName:9e5a4d6a-bac9-4fb2-97b6-ae1675433f6e nodeName:}" failed. No retries permitted until 2026-05-21 13:02:39.638976553 +0000 UTC m=+6.189257905 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "kube-api-access-2r7z9" (UniqueName: "kubernetes.io/projected/9e5a4d6a-bac9-4fb2-97b6-ae1675433f6e-kube-api-access-2r7z9") pod "network-check-target-zkhxz" (UID: "9e5a4d6a-bac9-4fb2-97b6-ae1675433f6e") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] May 21 13:02:38.034047 ip-10-0-133-64 kubenswrapper[2562]: I0521 13:02:38.033969 2562 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-fhvt9" May 21 13:02:38.034047 ip-10-0-133-64 kubenswrapper[2562]: I0521 13:02:38.034006 2562 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-zkhxz" May 21 13:02:38.034521 ip-10-0-133-64 kubenswrapper[2562]: E0521 13:02:38.034120 2562 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-fhvt9" podUID="8fd03c97-7fa6-42e9-ab95-5fde631dcd29" May 21 13:02:38.034521 ip-10-0-133-64 kubenswrapper[2562]: E0521 13:02:38.034192 2562 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-zkhxz" podUID="9e5a4d6a-bac9-4fb2-97b6-ae1675433f6e" May 21 13:02:38.106112 ip-10-0-133-64 kubenswrapper[2562]: I0521 13:02:38.106076 2562 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-133-64.ec2.internal" event={"ID":"fe9d808f2e9ea9d31117a0e071d6f6f8","Type":"ContainerStarted","Data":"b0bd7b0fbcee40f0dd05288fe434892487dff4596ae63a4b1f10fd8d12f37b86"} May 21 13:02:38.122402 ip-10-0-133-64 kubenswrapper[2562]: I0521 13:02:38.122345 2562 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="kube-system/kube-apiserver-proxy-ip-10-0-133-64.ec2.internal" podStartSLOduration=3.122324887 podStartE2EDuration="3.122324887s" podCreationTimestamp="2026-05-21 13:02:35 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2026-05-21 13:02:37.11284565 +0000 UTC m=+3.663127019" watchObservedRunningTime="2026-05-21 13:02:38.122324887 +0000 UTC m=+4.672606256" May 21 13:02:38.122694 ip-10-0-133-64 kubenswrapper[2562]: I0521 13:02:38.122661 2562 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-133-64.ec2.internal" podStartSLOduration=3.122652699 podStartE2EDuration="3.122652699s" podCreationTimestamp="2026-05-21 13:02:35 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2026-05-21 13:02:38.121643919 +0000 UTC m=+4.671925287" watchObservedRunningTime="2026-05-21 13:02:38.122652699 +0000 UTC m=+4.672934072" May 21 13:02:39.557307 ip-10-0-133-64 kubenswrapper[2562]: I0521 13:02:39.557262 2562 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/8fd03c97-7fa6-42e9-ab95-5fde631dcd29-metrics-certs\") pod \"network-metrics-daemon-fhvt9\" (UID: \"8fd03c97-7fa6-42e9-ab95-5fde631dcd29\") " pod="openshift-multus/network-metrics-daemon-fhvt9" May 21 13:02:39.557763 ip-10-0-133-64 kubenswrapper[2562]: E0521 13:02:39.557453 2562 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered May 21 13:02:39.557763 ip-10-0-133-64 kubenswrapper[2562]: E0521 13:02:39.557519 2562 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/8fd03c97-7fa6-42e9-ab95-5fde631dcd29-metrics-certs podName:8fd03c97-7fa6-42e9-ab95-5fde631dcd29 nodeName:}" failed. No retries permitted until 2026-05-21 13:02:43.55750058 +0000 UTC m=+10.107781930 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/8fd03c97-7fa6-42e9-ab95-5fde631dcd29-metrics-certs") pod "network-metrics-daemon-fhvt9" (UID: "8fd03c97-7fa6-42e9-ab95-5fde631dcd29") : object "openshift-multus"/"metrics-daemon-secret" not registered May 21 13:02:39.658331 ip-10-0-133-64 kubenswrapper[2562]: I0521 13:02:39.657722 2562 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-2r7z9\" (UniqueName: \"kubernetes.io/projected/9e5a4d6a-bac9-4fb2-97b6-ae1675433f6e-kube-api-access-2r7z9\") pod \"network-check-target-zkhxz\" (UID: \"9e5a4d6a-bac9-4fb2-97b6-ae1675433f6e\") " pod="openshift-network-diagnostics/network-check-target-zkhxz" May 21 13:02:39.658331 ip-10-0-133-64 kubenswrapper[2562]: E0521 13:02:39.657911 2562 projected.go:289] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered May 21 13:02:39.658331 ip-10-0-133-64 kubenswrapper[2562]: E0521 13:02:39.657930 2562 projected.go:289] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered May 21 13:02:39.658331 ip-10-0-133-64 kubenswrapper[2562]: E0521 13:02:39.657944 2562 projected.go:194] Error preparing data for projected volume kube-api-access-2r7z9 for pod openshift-network-diagnostics/network-check-target-zkhxz: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] May 21 13:02:39.658331 ip-10-0-133-64 kubenswrapper[2562]: E0521 13:02:39.658003 2562 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/9e5a4d6a-bac9-4fb2-97b6-ae1675433f6e-kube-api-access-2r7z9 podName:9e5a4d6a-bac9-4fb2-97b6-ae1675433f6e nodeName:}" failed. No retries permitted until 2026-05-21 13:02:43.65798344 +0000 UTC m=+10.208264803 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "kube-api-access-2r7z9" (UniqueName: "kubernetes.io/projected/9e5a4d6a-bac9-4fb2-97b6-ae1675433f6e-kube-api-access-2r7z9") pod "network-check-target-zkhxz" (UID: "9e5a4d6a-bac9-4fb2-97b6-ae1675433f6e") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] May 21 13:02:40.035814 ip-10-0-133-64 kubenswrapper[2562]: I0521 13:02:40.035061 2562 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-fhvt9" May 21 13:02:40.035814 ip-10-0-133-64 kubenswrapper[2562]: E0521 13:02:40.035199 2562 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-fhvt9" podUID="8fd03c97-7fa6-42e9-ab95-5fde631dcd29" May 21 13:02:40.035814 ip-10-0-133-64 kubenswrapper[2562]: I0521 13:02:40.035610 2562 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-zkhxz" May 21 13:02:40.035814 ip-10-0-133-64 kubenswrapper[2562]: E0521 13:02:40.035752 2562 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-zkhxz" podUID="9e5a4d6a-bac9-4fb2-97b6-ae1675433f6e" May 21 13:02:42.033278 ip-10-0-133-64 kubenswrapper[2562]: I0521 13:02:42.033207 2562 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-fhvt9" May 21 13:02:42.033278 ip-10-0-133-64 kubenswrapper[2562]: I0521 13:02:42.033230 2562 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-zkhxz" May 21 13:02:42.033785 ip-10-0-133-64 kubenswrapper[2562]: E0521 13:02:42.033356 2562 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-fhvt9" podUID="8fd03c97-7fa6-42e9-ab95-5fde631dcd29" May 21 13:02:42.033785 ip-10-0-133-64 kubenswrapper[2562]: E0521 13:02:42.033488 2562 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-zkhxz" podUID="9e5a4d6a-bac9-4fb2-97b6-ae1675433f6e" May 21 13:02:43.591285 ip-10-0-133-64 kubenswrapper[2562]: I0521 13:02:43.591241 2562 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/8fd03c97-7fa6-42e9-ab95-5fde631dcd29-metrics-certs\") pod \"network-metrics-daemon-fhvt9\" (UID: \"8fd03c97-7fa6-42e9-ab95-5fde631dcd29\") " pod="openshift-multus/network-metrics-daemon-fhvt9" May 21 13:02:43.591773 ip-10-0-133-64 kubenswrapper[2562]: E0521 13:02:43.591429 2562 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered May 21 13:02:43.591773 ip-10-0-133-64 kubenswrapper[2562]: E0521 13:02:43.591502 2562 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/8fd03c97-7fa6-42e9-ab95-5fde631dcd29-metrics-certs podName:8fd03c97-7fa6-42e9-ab95-5fde631dcd29 nodeName:}" failed. No retries permitted until 2026-05-21 13:02:51.591483294 +0000 UTC m=+18.141764655 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/8fd03c97-7fa6-42e9-ab95-5fde631dcd29-metrics-certs") pod "network-metrics-daemon-fhvt9" (UID: "8fd03c97-7fa6-42e9-ab95-5fde631dcd29") : object "openshift-multus"/"metrics-daemon-secret" not registered May 21 13:02:43.691974 ip-10-0-133-64 kubenswrapper[2562]: I0521 13:02:43.691932 2562 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-2r7z9\" (UniqueName: \"kubernetes.io/projected/9e5a4d6a-bac9-4fb2-97b6-ae1675433f6e-kube-api-access-2r7z9\") pod \"network-check-target-zkhxz\" (UID: \"9e5a4d6a-bac9-4fb2-97b6-ae1675433f6e\") " pod="openshift-network-diagnostics/network-check-target-zkhxz" May 21 13:02:43.692154 ip-10-0-133-64 kubenswrapper[2562]: E0521 13:02:43.692141 2562 projected.go:289] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered May 21 13:02:43.692223 ip-10-0-133-64 kubenswrapper[2562]: E0521 13:02:43.692165 2562 projected.go:289] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered May 21 13:02:43.692223 ip-10-0-133-64 kubenswrapper[2562]: E0521 13:02:43.692178 2562 projected.go:194] Error preparing data for projected volume kube-api-access-2r7z9 for pod openshift-network-diagnostics/network-check-target-zkhxz: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] May 21 13:02:43.692318 ip-10-0-133-64 kubenswrapper[2562]: E0521 13:02:43.692236 2562 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/9e5a4d6a-bac9-4fb2-97b6-ae1675433f6e-kube-api-access-2r7z9 podName:9e5a4d6a-bac9-4fb2-97b6-ae1675433f6e nodeName:}" failed. No retries permitted until 2026-05-21 13:02:51.692218062 +0000 UTC m=+18.242499424 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "kube-api-access-2r7z9" (UniqueName: "kubernetes.io/projected/9e5a4d6a-bac9-4fb2-97b6-ae1675433f6e-kube-api-access-2r7z9") pod "network-check-target-zkhxz" (UID: "9e5a4d6a-bac9-4fb2-97b6-ae1675433f6e") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] May 21 13:02:44.033320 ip-10-0-133-64 kubenswrapper[2562]: I0521 13:02:44.033289 2562 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-fhvt9" May 21 13:02:44.033507 ip-10-0-133-64 kubenswrapper[2562]: E0521 13:02:44.033383 2562 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-fhvt9" podUID="8fd03c97-7fa6-42e9-ab95-5fde631dcd29" May 21 13:02:44.033757 ip-10-0-133-64 kubenswrapper[2562]: I0521 13:02:44.033655 2562 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-zkhxz" May 21 13:02:44.033757 ip-10-0-133-64 kubenswrapper[2562]: E0521 13:02:44.033711 2562 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-zkhxz" podUID="9e5a4d6a-bac9-4fb2-97b6-ae1675433f6e" May 21 13:02:45.496339 ip-10-0-133-64 kubenswrapper[2562]: I0521 13:02:45.496300 2562 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-dns/node-resolver-qqgxp"] May 21 13:02:45.564717 ip-10-0-133-64 kubenswrapper[2562]: I0521 13:02:45.564674 2562 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/node-resolver-qqgxp" May 21 13:02:45.569900 ip-10-0-133-64 kubenswrapper[2562]: I0521 13:02:45.569783 2562 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"node-resolver-dockercfg-zzdv5\"" May 21 13:02:45.569900 ip-10-0-133-64 kubenswrapper[2562]: I0521 13:02:45.569783 2562 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"openshift-service-ca.crt\"" May 21 13:02:45.569900 ip-10-0-133-64 kubenswrapper[2562]: I0521 13:02:45.569824 2562 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"kube-root-ca.crt\"" May 21 13:02:45.606848 ip-10-0-133-64 kubenswrapper[2562]: I0521 13:02:45.606783 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/f025d291-e59b-45b8-9b1a-83d59bcf8609-hosts-file\") pod \"node-resolver-qqgxp\" (UID: \"f025d291-e59b-45b8-9b1a-83d59bcf8609\") " pod="openshift-dns/node-resolver-qqgxp" May 21 13:02:45.607025 ip-10-0-133-64 kubenswrapper[2562]: I0521 13:02:45.606904 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/f025d291-e59b-45b8-9b1a-83d59bcf8609-tmp-dir\") pod \"node-resolver-qqgxp\" (UID: \"f025d291-e59b-45b8-9b1a-83d59bcf8609\") " pod="openshift-dns/node-resolver-qqgxp" May 21 13:02:45.607025 ip-10-0-133-64 kubenswrapper[2562]: I0521 13:02:45.606961 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-qc4n6\" (UniqueName: \"kubernetes.io/projected/f025d291-e59b-45b8-9b1a-83d59bcf8609-kube-api-access-qc4n6\") pod \"node-resolver-qqgxp\" (UID: \"f025d291-e59b-45b8-9b1a-83d59bcf8609\") " pod="openshift-dns/node-resolver-qqgxp" May 21 13:02:45.708072 ip-10-0-133-64 kubenswrapper[2562]: I0521 13:02:45.708031 2562 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/f025d291-e59b-45b8-9b1a-83d59bcf8609-hosts-file\") pod \"node-resolver-qqgxp\" (UID: \"f025d291-e59b-45b8-9b1a-83d59bcf8609\") " pod="openshift-dns/node-resolver-qqgxp" May 21 13:02:45.708266 ip-10-0-133-64 kubenswrapper[2562]: I0521 13:02:45.708080 2562 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/f025d291-e59b-45b8-9b1a-83d59bcf8609-tmp-dir\") pod \"node-resolver-qqgxp\" (UID: \"f025d291-e59b-45b8-9b1a-83d59bcf8609\") " pod="openshift-dns/node-resolver-qqgxp" May 21 13:02:45.708266 ip-10-0-133-64 kubenswrapper[2562]: I0521 13:02:45.708108 2562 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-qc4n6\" (UniqueName: \"kubernetes.io/projected/f025d291-e59b-45b8-9b1a-83d59bcf8609-kube-api-access-qc4n6\") pod \"node-resolver-qqgxp\" (UID: \"f025d291-e59b-45b8-9b1a-83d59bcf8609\") " pod="openshift-dns/node-resolver-qqgxp" May 21 13:02:45.708266 ip-10-0-133-64 kubenswrapper[2562]: I0521 13:02:45.708186 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/f025d291-e59b-45b8-9b1a-83d59bcf8609-hosts-file\") pod \"node-resolver-qqgxp\" (UID: \"f025d291-e59b-45b8-9b1a-83d59bcf8609\") " pod="openshift-dns/node-resolver-qqgxp" May 21 13:02:45.708474 ip-10-0-133-64 kubenswrapper[2562]: I0521 13:02:45.708431 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/f025d291-e59b-45b8-9b1a-83d59bcf8609-tmp-dir\") pod \"node-resolver-qqgxp\" (UID: \"f025d291-e59b-45b8-9b1a-83d59bcf8609\") " pod="openshift-dns/node-resolver-qqgxp" May 21 13:02:45.717886 ip-10-0-133-64 kubenswrapper[2562]: I0521 13:02:45.717859 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-qc4n6\" (UniqueName: \"kubernetes.io/projected/f025d291-e59b-45b8-9b1a-83d59bcf8609-kube-api-access-qc4n6\") pod \"node-resolver-qqgxp\" (UID: \"f025d291-e59b-45b8-9b1a-83d59bcf8609\") " pod="openshift-dns/node-resolver-qqgxp" May 21 13:02:45.876134 ip-10-0-133-64 kubenswrapper[2562]: I0521 13:02:45.876061 2562 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/node-resolver-qqgxp" May 21 13:02:46.032863 ip-10-0-133-64 kubenswrapper[2562]: I0521 13:02:46.032822 2562 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-fhvt9" May 21 13:02:46.033033 ip-10-0-133-64 kubenswrapper[2562]: I0521 13:02:46.032823 2562 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-zkhxz" May 21 13:02:46.033033 ip-10-0-133-64 kubenswrapper[2562]: E0521 13:02:46.032971 2562 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-fhvt9" podUID="8fd03c97-7fa6-42e9-ab95-5fde631dcd29" May 21 13:02:46.033033 ip-10-0-133-64 kubenswrapper[2562]: E0521 13:02:46.033023 2562 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-zkhxz" podUID="9e5a4d6a-bac9-4fb2-97b6-ae1675433f6e" May 21 13:02:48.033341 ip-10-0-133-64 kubenswrapper[2562]: I0521 13:02:48.033303 2562 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-fhvt9" May 21 13:02:48.033859 ip-10-0-133-64 kubenswrapper[2562]: E0521 13:02:48.033445 2562 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-fhvt9" podUID="8fd03c97-7fa6-42e9-ab95-5fde631dcd29" May 21 13:02:48.033859 ip-10-0-133-64 kubenswrapper[2562]: I0521 13:02:48.033521 2562 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-zkhxz" May 21 13:02:48.033859 ip-10-0-133-64 kubenswrapper[2562]: E0521 13:02:48.033638 2562 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-zkhxz" podUID="9e5a4d6a-bac9-4fb2-97b6-ae1675433f6e" May 21 13:02:50.032850 ip-10-0-133-64 kubenswrapper[2562]: I0521 13:02:50.032816 2562 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-fhvt9" May 21 13:02:50.033285 ip-10-0-133-64 kubenswrapper[2562]: E0521 13:02:50.032950 2562 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-fhvt9" podUID="8fd03c97-7fa6-42e9-ab95-5fde631dcd29" May 21 13:02:50.033285 ip-10-0-133-64 kubenswrapper[2562]: I0521 13:02:50.033013 2562 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-zkhxz" May 21 13:02:50.033285 ip-10-0-133-64 kubenswrapper[2562]: E0521 13:02:50.033111 2562 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-zkhxz" podUID="9e5a4d6a-bac9-4fb2-97b6-ae1675433f6e" May 21 13:02:51.652350 ip-10-0-133-64 kubenswrapper[2562]: I0521 13:02:51.652107 2562 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/8fd03c97-7fa6-42e9-ab95-5fde631dcd29-metrics-certs\") pod \"network-metrics-daemon-fhvt9\" (UID: \"8fd03c97-7fa6-42e9-ab95-5fde631dcd29\") " pod="openshift-multus/network-metrics-daemon-fhvt9" May 21 13:02:51.652793 ip-10-0-133-64 kubenswrapper[2562]: E0521 13:02:51.652202 2562 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered May 21 13:02:51.652793 ip-10-0-133-64 kubenswrapper[2562]: E0521 13:02:51.652431 2562 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/8fd03c97-7fa6-42e9-ab95-5fde631dcd29-metrics-certs podName:8fd03c97-7fa6-42e9-ab95-5fde631dcd29 nodeName:}" failed. No retries permitted until 2026-05-21 13:03:07.65240956 +0000 UTC m=+34.202690908 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/8fd03c97-7fa6-42e9-ab95-5fde631dcd29-metrics-certs") pod "network-metrics-daemon-fhvt9" (UID: "8fd03c97-7fa6-42e9-ab95-5fde631dcd29") : object "openshift-multus"/"metrics-daemon-secret" not registered May 21 13:02:51.752916 ip-10-0-133-64 kubenswrapper[2562]: I0521 13:02:51.752888 2562 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-2r7z9\" (UniqueName: \"kubernetes.io/projected/9e5a4d6a-bac9-4fb2-97b6-ae1675433f6e-kube-api-access-2r7z9\") pod \"network-check-target-zkhxz\" (UID: \"9e5a4d6a-bac9-4fb2-97b6-ae1675433f6e\") " pod="openshift-network-diagnostics/network-check-target-zkhxz" May 21 13:02:51.753107 ip-10-0-133-64 kubenswrapper[2562]: E0521 13:02:51.753008 2562 projected.go:289] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered May 21 13:02:51.753107 ip-10-0-133-64 kubenswrapper[2562]: E0521 13:02:51.753025 2562 projected.go:289] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered May 21 13:02:51.753107 ip-10-0-133-64 kubenswrapper[2562]: E0521 13:02:51.753034 2562 projected.go:194] Error preparing data for projected volume kube-api-access-2r7z9 for pod openshift-network-diagnostics/network-check-target-zkhxz: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] May 21 13:02:51.753107 ip-10-0-133-64 kubenswrapper[2562]: E0521 13:02:51.753086 2562 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/9e5a4d6a-bac9-4fb2-97b6-ae1675433f6e-kube-api-access-2r7z9 podName:9e5a4d6a-bac9-4fb2-97b6-ae1675433f6e nodeName:}" failed. No retries permitted until 2026-05-21 13:03:07.75306734 +0000 UTC m=+34.303348688 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "kube-api-access-2r7z9" (UniqueName: "kubernetes.io/projected/9e5a4d6a-bac9-4fb2-97b6-ae1675433f6e-kube-api-access-2r7z9") pod "network-check-target-zkhxz" (UID: "9e5a4d6a-bac9-4fb2-97b6-ae1675433f6e") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] May 21 13:02:52.033678 ip-10-0-133-64 kubenswrapper[2562]: I0521 13:02:52.033599 2562 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-fhvt9" May 21 13:02:52.033852 ip-10-0-133-64 kubenswrapper[2562]: I0521 13:02:52.033599 2562 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-zkhxz" May 21 13:02:52.033852 ip-10-0-133-64 kubenswrapper[2562]: E0521 13:02:52.033752 2562 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-fhvt9" podUID="8fd03c97-7fa6-42e9-ab95-5fde631dcd29" May 21 13:02:52.033852 ip-10-0-133-64 kubenswrapper[2562]: E0521 13:02:52.033824 2562 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-zkhxz" podUID="9e5a4d6a-bac9-4fb2-97b6-ae1675433f6e" May 21 13:02:54.033550 ip-10-0-133-64 kubenswrapper[2562]: I0521 13:02:54.033515 2562 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-fhvt9" May 21 13:02:54.034012 ip-10-0-133-64 kubenswrapper[2562]: E0521 13:02:54.033624 2562 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-fhvt9" podUID="8fd03c97-7fa6-42e9-ab95-5fde631dcd29" May 21 13:02:54.034012 ip-10-0-133-64 kubenswrapper[2562]: I0521 13:02:54.033710 2562 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-zkhxz" May 21 13:02:54.034012 ip-10-0-133-64 kubenswrapper[2562]: E0521 13:02:54.033839 2562 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-zkhxz" podUID="9e5a4d6a-bac9-4fb2-97b6-ae1675433f6e" May 21 13:02:54.579442 ip-10-0-133-64 kubenswrapper[2562]: W0521 13:02:54.579419 2562 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podf025d291_e59b_45b8_9b1a_83d59bcf8609.slice/crio-748010ed5c05f78ceba986e920001b62287ce789023c68558d96ebc7633e9895 WatchSource:0}: Error finding container 748010ed5c05f78ceba986e920001b62287ce789023c68558d96ebc7633e9895: Status 404 returned error can't find the container with id 748010ed5c05f78ceba986e920001b62287ce789023c68558d96ebc7633e9895 May 21 13:02:55.136780 ip-10-0-133-64 kubenswrapper[2562]: I0521 13:02:55.136548 2562 generic.go:358] "Generic (PLEG): container finished" podID="0ab0e3ad-cd32-4b7d-aea2-93bfd52b94ca" containerID="a9d9ee0244e401c2239ce9495f2240931c80beb7ddb9ccad48dfe168c12c954f" exitCode=0 May 21 13:02:55.137489 ip-10-0-133-64 kubenswrapper[2562]: I0521 13:02:55.136625 2562 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-p8bmj" event={"ID":"0ab0e3ad-cd32-4b7d-aea2-93bfd52b94ca","Type":"ContainerDied","Data":"a9d9ee0244e401c2239ce9495f2240931c80beb7ddb9ccad48dfe168c12c954f"} May 21 13:02:55.138990 ip-10-0-133-64 kubenswrapper[2562]: I0521 13:02:55.138969 2562 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-ltpwh" event={"ID":"2d49aff3-1eb6-46f0-bfe3-c5b167536671","Type":"ContainerStarted","Data":"65b4f23230bab3f460e0623575323e11ce62ae42b6bcd323a09df90fa6bd8cae"} May 21 13:02:55.139096 ip-10-0-133-64 kubenswrapper[2562]: I0521 13:02:55.138995 2562 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-ltpwh" event={"ID":"2d49aff3-1eb6-46f0-bfe3-c5b167536671","Type":"ContainerStarted","Data":"4d8efed86cd3c5a279a4f45177ce1d593d7f7bd186772ed7129a2cd173b1d103"} May 21 13:02:55.139096 ip-10-0-133-64 kubenswrapper[2562]: I0521 13:02:55.139010 2562 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-ltpwh" event={"ID":"2d49aff3-1eb6-46f0-bfe3-c5b167536671","Type":"ContainerStarted","Data":"e03db2f4786bfee92517c2dfcc3dcf48454335655b019b2a7c3726f831c59659"} May 21 13:02:55.139096 ip-10-0-133-64 kubenswrapper[2562]: I0521 13:02:55.139021 2562 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-ltpwh" event={"ID":"2d49aff3-1eb6-46f0-bfe3-c5b167536671","Type":"ContainerStarted","Data":"e83850fe2c855aaecda1f738ccd295d5758c18859a6694f70b9639ece26ee7c5"} May 21 13:02:55.140343 ip-10-0-133-64 kubenswrapper[2562]: I0521 13:02:55.140318 2562 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-dns/node-resolver-qqgxp" event={"ID":"f025d291-e59b-45b8-9b1a-83d59bcf8609","Type":"ContainerStarted","Data":"2a99cd6d8dd53bda37a5c5b0349bcc5739665321c1bae954dd90b9cec4762c06"} May 21 13:02:55.140441 ip-10-0-133-64 kubenswrapper[2562]: I0521 13:02:55.140353 2562 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-dns/node-resolver-qqgxp" event={"ID":"f025d291-e59b-45b8-9b1a-83d59bcf8609","Type":"ContainerStarted","Data":"748010ed5c05f78ceba986e920001b62287ce789023c68558d96ebc7633e9895"} May 21 13:02:55.141481 ip-10-0-133-64 kubenswrapper[2562]: I0521 13:02:55.141461 2562 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-5hhpk" event={"ID":"e416ed10-9d00-41ee-8c5e-6acf4f78643f","Type":"ContainerStarted","Data":"8880d28ae8eae7d6d0f1dc8f3fff69a69fe3b151eb9f1d3ba7014e5db5b9b022"} May 21 13:02:55.143239 ip-10-0-133-64 kubenswrapper[2562]: I0521 13:02:55.143220 2562 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-node-tuning-operator/tuned-sjffj" event={"ID":"9782b774-8d77-4b0b-bf5f-4678a677e161","Type":"ContainerStarted","Data":"9fdf85642809741f562198156a63a1ec957a9106d344f0fd43677763a3380d55"} May 21 13:02:55.144449 ip-10-0-133-64 kubenswrapper[2562]: I0521 13:02:55.144430 2562 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kube-system/konnectivity-agent-4zjmp" event={"ID":"b37e4909-8e26-4b8d-856d-34f9d0c5832e","Type":"ContainerStarted","Data":"44aec382e30f062ad1bfc9b48afdefadac245492ff25128bcb0264beaefffbc8"} May 21 13:02:55.145719 ip-10-0-133-64 kubenswrapper[2562]: I0521 13:02:55.145699 2562 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-snb4z" event={"ID":"b74d36d8-43b2-428f-a5a7-8701f9fae368","Type":"ContainerStarted","Data":"371438d16e4cbe29765746199d6820bb96930b7e0d91ff2d52bb0490b9e778a7"} May 21 13:02:55.146835 ip-10-0-133-64 kubenswrapper[2562]: I0521 13:02:55.146816 2562 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/node-ca-lm4qk" event={"ID":"da3fc398-1999-44e7-80b5-5f699d3f7744","Type":"ContainerStarted","Data":"bfc77659ac1bb7d0134212b8ee0ec7a6f6ee425c23bf0d7e49a253372e48765f"} May 21 13:02:55.173000 ip-10-0-133-64 kubenswrapper[2562]: I0521 13:02:55.172965 2562 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-cluster-node-tuning-operator/tuned-sjffj" podStartSLOduration=3.19777207 podStartE2EDuration="21.17295417s" podCreationTimestamp="2026-05-21 13:02:34 +0000 UTC" firstStartedPulling="2026-05-21 13:02:36.603444049 +0000 UTC m=+3.153725409" lastFinishedPulling="2026-05-21 13:02:54.57862615 +0000 UTC m=+21.128907509" observedRunningTime="2026-05-21 13:02:55.172633094 +0000 UTC m=+21.722914468" watchObservedRunningTime="2026-05-21 13:02:55.17295417 +0000 UTC m=+21.723235537" May 21 13:02:55.190790 ip-10-0-133-64 kubenswrapper[2562]: I0521 13:02:55.190735 2562 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="kube-system/konnectivity-agent-4zjmp" podStartSLOduration=7.210302876 podStartE2EDuration="21.190721117s" podCreationTimestamp="2026-05-21 13:02:34 +0000 UTC" firstStartedPulling="2026-05-21 13:02:36.602855577 +0000 UTC m=+3.153136941" lastFinishedPulling="2026-05-21 13:02:50.583273632 +0000 UTC m=+17.133555182" observedRunningTime="2026-05-21 13:02:55.190608238 +0000 UTC m=+21.740889605" watchObservedRunningTime="2026-05-21 13:02:55.190721117 +0000 UTC m=+21.741002484" May 21 13:02:55.250196 ip-10-0-133-64 kubenswrapper[2562]: I0521 13:02:55.250159 2562 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-multus/multus-5hhpk" podStartSLOduration=3.253328786 podStartE2EDuration="21.250144056s" podCreationTimestamp="2026-05-21 13:02:34 +0000 UTC" firstStartedPulling="2026-05-21 13:02:36.611515379 +0000 UTC m=+3.161796734" lastFinishedPulling="2026-05-21 13:02:54.608330642 +0000 UTC m=+21.158612004" observedRunningTime="2026-05-21 13:02:55.214251548 +0000 UTC m=+21.764532921" watchObservedRunningTime="2026-05-21 13:02:55.250144056 +0000 UTC m=+21.800425501" May 21 13:02:55.250630 ip-10-0-133-64 kubenswrapper[2562]: I0521 13:02:55.250605 2562 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-image-registry/node-ca-lm4qk" podStartSLOduration=3.349078139 podStartE2EDuration="21.250596668s" podCreationTimestamp="2026-05-21 13:02:34 +0000 UTC" firstStartedPulling="2026-05-21 13:02:36.612541853 +0000 UTC m=+3.162823211" lastFinishedPulling="2026-05-21 13:02:54.514060378 +0000 UTC m=+21.064341740" observedRunningTime="2026-05-21 13:02:55.250332991 +0000 UTC m=+21.800614358" watchObservedRunningTime="2026-05-21 13:02:55.250596668 +0000 UTC m=+21.800878035" May 21 13:02:56.032976 ip-10-0-133-64 kubenswrapper[2562]: I0521 13:02:56.032943 2562 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-fhvt9" May 21 13:02:56.033102 ip-10-0-133-64 kubenswrapper[2562]: E0521 13:02:56.033071 2562 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-fhvt9" podUID="8fd03c97-7fa6-42e9-ab95-5fde631dcd29" May 21 13:02:56.033257 ip-10-0-133-64 kubenswrapper[2562]: I0521 13:02:56.033234 2562 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-zkhxz" May 21 13:02:56.033367 ip-10-0-133-64 kubenswrapper[2562]: E0521 13:02:56.033345 2562 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-zkhxz" podUID="9e5a4d6a-bac9-4fb2-97b6-ae1675433f6e" May 21 13:02:56.120429 ip-10-0-133-64 kubenswrapper[2562]: I0521 13:02:56.120367 2562 plugin_watcher.go:194] "Adding socket path or updating timestamp to desired state cache" path="/var/lib/kubelet/plugins_registry/ebs.csi.aws.com-reg.sock" May 21 13:02:56.150711 ip-10-0-133-64 kubenswrapper[2562]: I0521 13:02:56.150670 2562 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-snb4z" event={"ID":"b74d36d8-43b2-428f-a5a7-8701f9fae368","Type":"ContainerStarted","Data":"038069f74039b0480391a88728e99c902ed58e01f3b286bfcb05aceeb68ac943"} May 21 13:02:56.153822 ip-10-0-133-64 kubenswrapper[2562]: I0521 13:02:56.153782 2562 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-ltpwh" event={"ID":"2d49aff3-1eb6-46f0-bfe3-c5b167536671","Type":"ContainerStarted","Data":"c1b7f06553d2be4f75acaac5928aa5461dc7a7ebbbfb6857dfe7871f8a5f82fd"} May 21 13:02:56.153950 ip-10-0-133-64 kubenswrapper[2562]: I0521 13:02:56.153831 2562 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-ltpwh" event={"ID":"2d49aff3-1eb6-46f0-bfe3-c5b167536671","Type":"ContainerStarted","Data":"813837903f28caf17523beaf166019be5267ef269d4f18da142cb7f0fe3b41c2"} May 21 13:02:56.155255 ip-10-0-133-64 kubenswrapper[2562]: I0521 13:02:56.155208 2562 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-network-operator/iptables-alerter-flqfh" event={"ID":"4eea719d-a66b-4ce0-aa45-0ef984662354","Type":"ContainerStarted","Data":"fa13ef0a5aac1bf0c1299cf6ea742252e70f5da7781c5eda69324a17e7dd3277"} May 21 13:02:56.169980 ip-10-0-133-64 kubenswrapper[2562]: I0521 13:02:56.169926 2562 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-dns/node-resolver-qqgxp" podStartSLOduration=11.169910626 podStartE2EDuration="11.169910626s" podCreationTimestamp="2026-05-21 13:02:45 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2026-05-21 13:02:55.291394775 +0000 UTC m=+21.841676144" watchObservedRunningTime="2026-05-21 13:02:56.169910626 +0000 UTC m=+22.720191997" May 21 13:02:56.170267 ip-10-0-133-64 kubenswrapper[2562]: I0521 13:02:56.170241 2562 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-network-operator/iptables-alerter-flqfh" podStartSLOduration=4.207086287 podStartE2EDuration="22.170234704s" podCreationTimestamp="2026-05-21 13:02:34 +0000 UTC" firstStartedPulling="2026-05-21 13:02:36.61257021 +0000 UTC m=+3.162851562" lastFinishedPulling="2026-05-21 13:02:54.575718615 +0000 UTC m=+21.125999979" observedRunningTime="2026-05-21 13:02:56.169528788 +0000 UTC m=+22.719810157" watchObservedRunningTime="2026-05-21 13:02:56.170234704 +0000 UTC m=+22.720516071" May 21 13:02:56.977449 ip-10-0-133-64 kubenswrapper[2562]: I0521 13:02:56.977259 2562 reconciler.go:161] "OperationExecutor.RegisterPlugin started" plugin={"SocketPath":"/var/lib/kubelet/plugins_registry/ebs.csi.aws.com-reg.sock","Timestamp":"2026-05-21T13:02:56.120389564Z","UUID":"bc4ebccb-0d6f-4c67-9826-e76a5aa961b7","Handler":null,"Name":"","Endpoint":""} May 21 13:02:56.979132 ip-10-0-133-64 kubenswrapper[2562]: I0521 13:02:56.979105 2562 csi_plugin.go:106] kubernetes.io/csi: Trying to validate a new CSI Driver with name: ebs.csi.aws.com endpoint: /var/lib/kubelet/plugins/ebs.csi.aws.com/csi.sock versions: 1.0.0 May 21 13:02:56.979132 ip-10-0-133-64 kubenswrapper[2562]: I0521 13:02:56.979137 2562 csi_plugin.go:119] kubernetes.io/csi: Register new plugin with name: ebs.csi.aws.com at endpoint: /var/lib/kubelet/plugins/ebs.csi.aws.com/csi.sock May 21 13:02:57.159684 ip-10-0-133-64 kubenswrapper[2562]: I0521 13:02:57.159645 2562 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-snb4z" event={"ID":"b74d36d8-43b2-428f-a5a7-8701f9fae368","Type":"ContainerStarted","Data":"1f7ddf4f7425a7701b481e3b6a2ca955612da668a173a9761946f4103942bf8a"} May 21 13:02:57.179331 ip-10-0-133-64 kubenswrapper[2562]: I0521 13:02:57.179269 2562 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-snb4z" podStartSLOduration=2.739932033 podStartE2EDuration="23.179252112s" podCreationTimestamp="2026-05-21 13:02:34 +0000 UTC" firstStartedPulling="2026-05-21 13:02:36.611143751 +0000 UTC m=+3.161425104" lastFinishedPulling="2026-05-21 13:02:57.050463837 +0000 UTC m=+23.600745183" observedRunningTime="2026-05-21 13:02:57.179142132 +0000 UTC m=+23.729423504" watchObservedRunningTime="2026-05-21 13:02:57.179252112 +0000 UTC m=+23.729533511" May 21 13:02:57.288777 ip-10-0-133-64 kubenswrapper[2562]: I0521 13:02:57.288695 2562 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["kube-system/global-pull-secret-syncer-qw7g7"] May 21 13:02:57.301738 ip-10-0-133-64 kubenswrapper[2562]: I0521 13:02:57.301716 2562 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-qw7g7" May 21 13:02:57.301822 ip-10-0-133-64 kubenswrapper[2562]: E0521 13:02:57.301778 2562 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-qw7g7" podUID="6a5bcf2e-872d-429c-83dc-c5facd09899f" May 21 13:02:57.397391 ip-10-0-133-64 kubenswrapper[2562]: I0521 13:02:57.397360 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/6a5bcf2e-872d-429c-83dc-c5facd09899f-original-pull-secret\") pod \"global-pull-secret-syncer-qw7g7\" (UID: \"6a5bcf2e-872d-429c-83dc-c5facd09899f\") " pod="kube-system/global-pull-secret-syncer-qw7g7" May 21 13:02:57.397566 ip-10-0-133-64 kubenswrapper[2562]: I0521 13:02:57.397403 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/6a5bcf2e-872d-429c-83dc-c5facd09899f-kubelet-config\") pod \"global-pull-secret-syncer-qw7g7\" (UID: \"6a5bcf2e-872d-429c-83dc-c5facd09899f\") " pod="kube-system/global-pull-secret-syncer-qw7g7" May 21 13:02:57.397566 ip-10-0-133-64 kubenswrapper[2562]: I0521 13:02:57.397443 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/6a5bcf2e-872d-429c-83dc-c5facd09899f-dbus\") pod \"global-pull-secret-syncer-qw7g7\" (UID: \"6a5bcf2e-872d-429c-83dc-c5facd09899f\") " pod="kube-system/global-pull-secret-syncer-qw7g7" May 21 13:02:57.497771 ip-10-0-133-64 kubenswrapper[2562]: I0521 13:02:57.497741 2562 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/6a5bcf2e-872d-429c-83dc-c5facd09899f-dbus\") pod \"global-pull-secret-syncer-qw7g7\" (UID: \"6a5bcf2e-872d-429c-83dc-c5facd09899f\") " pod="kube-system/global-pull-secret-syncer-qw7g7" May 21 13:02:57.497912 ip-10-0-133-64 kubenswrapper[2562]: I0521 13:02:57.497837 2562 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/6a5bcf2e-872d-429c-83dc-c5facd09899f-original-pull-secret\") pod \"global-pull-secret-syncer-qw7g7\" (UID: \"6a5bcf2e-872d-429c-83dc-c5facd09899f\") " pod="kube-system/global-pull-secret-syncer-qw7g7" May 21 13:02:57.497912 ip-10-0-133-64 kubenswrapper[2562]: I0521 13:02:57.497876 2562 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/6a5bcf2e-872d-429c-83dc-c5facd09899f-kubelet-config\") pod \"global-pull-secret-syncer-qw7g7\" (UID: \"6a5bcf2e-872d-429c-83dc-c5facd09899f\") " pod="kube-system/global-pull-secret-syncer-qw7g7" May 21 13:02:57.498015 ip-10-0-133-64 kubenswrapper[2562]: I0521 13:02:57.497965 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/6a5bcf2e-872d-429c-83dc-c5facd09899f-kubelet-config\") pod \"global-pull-secret-syncer-qw7g7\" (UID: \"6a5bcf2e-872d-429c-83dc-c5facd09899f\") " pod="kube-system/global-pull-secret-syncer-qw7g7" May 21 13:02:57.498015 ip-10-0-133-64 kubenswrapper[2562]: E0521 13:02:57.497988 2562 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered May 21 13:02:57.498111 ip-10-0-133-64 kubenswrapper[2562]: I0521 13:02:57.498020 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/6a5bcf2e-872d-429c-83dc-c5facd09899f-dbus\") pod \"global-pull-secret-syncer-qw7g7\" (UID: \"6a5bcf2e-872d-429c-83dc-c5facd09899f\") " pod="kube-system/global-pull-secret-syncer-qw7g7" May 21 13:02:57.498111 ip-10-0-133-64 kubenswrapper[2562]: E0521 13:02:57.498062 2562 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/6a5bcf2e-872d-429c-83dc-c5facd09899f-original-pull-secret podName:6a5bcf2e-872d-429c-83dc-c5facd09899f nodeName:}" failed. No retries permitted until 2026-05-21 13:02:57.998043173 +0000 UTC m=+24.548324526 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/6a5bcf2e-872d-429c-83dc-c5facd09899f-original-pull-secret") pod "global-pull-secret-syncer-qw7g7" (UID: "6a5bcf2e-872d-429c-83dc-c5facd09899f") : object "kube-system"/"original-pull-secret" not registered May 21 13:02:57.583758 ip-10-0-133-64 kubenswrapper[2562]: I0521 13:02:57.583680 2562 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="kube-system/konnectivity-agent-4zjmp" May 21 13:02:57.584393 ip-10-0-133-64 kubenswrapper[2562]: I0521 13:02:57.584370 2562 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="started" pod="kube-system/konnectivity-agent-4zjmp" May 21 13:02:58.001401 ip-10-0-133-64 kubenswrapper[2562]: I0521 13:02:58.001317 2562 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/6a5bcf2e-872d-429c-83dc-c5facd09899f-original-pull-secret\") pod \"global-pull-secret-syncer-qw7g7\" (UID: \"6a5bcf2e-872d-429c-83dc-c5facd09899f\") " pod="kube-system/global-pull-secret-syncer-qw7g7" May 21 13:02:58.001560 ip-10-0-133-64 kubenswrapper[2562]: E0521 13:02:58.001466 2562 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered May 21 13:02:58.001560 ip-10-0-133-64 kubenswrapper[2562]: E0521 13:02:58.001537 2562 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/6a5bcf2e-872d-429c-83dc-c5facd09899f-original-pull-secret podName:6a5bcf2e-872d-429c-83dc-c5facd09899f nodeName:}" failed. No retries permitted until 2026-05-21 13:02:59.001521075 +0000 UTC m=+25.551802421 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/6a5bcf2e-872d-429c-83dc-c5facd09899f-original-pull-secret") pod "global-pull-secret-syncer-qw7g7" (UID: "6a5bcf2e-872d-429c-83dc-c5facd09899f") : object "kube-system"/"original-pull-secret" not registered May 21 13:02:58.033082 ip-10-0-133-64 kubenswrapper[2562]: I0521 13:02:58.033047 2562 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-zkhxz" May 21 13:02:58.033239 ip-10-0-133-64 kubenswrapper[2562]: E0521 13:02:58.033162 2562 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-zkhxz" podUID="9e5a4d6a-bac9-4fb2-97b6-ae1675433f6e" May 21 13:02:58.033308 ip-10-0-133-64 kubenswrapper[2562]: I0521 13:02:58.033263 2562 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-fhvt9" May 21 13:02:58.033418 ip-10-0-133-64 kubenswrapper[2562]: E0521 13:02:58.033375 2562 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-fhvt9" podUID="8fd03c97-7fa6-42e9-ab95-5fde631dcd29" May 21 13:02:58.165108 ip-10-0-133-64 kubenswrapper[2562]: I0521 13:02:58.165066 2562 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-ltpwh" event={"ID":"2d49aff3-1eb6-46f0-bfe3-c5b167536671","Type":"ContainerStarted","Data":"f6fd7443f130fcac4e3f8afa0f3ee62b2995f2c99398da740d269d630455fd08"} May 21 13:02:58.165697 ip-10-0-133-64 kubenswrapper[2562]: I0521 13:02:58.165353 2562 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kube-system/konnectivity-agent-4zjmp" May 21 13:02:58.165893 ip-10-0-133-64 kubenswrapper[2562]: I0521 13:02:58.165867 2562 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="kube-system/konnectivity-agent-4zjmp" May 21 13:02:59.008193 ip-10-0-133-64 kubenswrapper[2562]: I0521 13:02:59.008150 2562 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/6a5bcf2e-872d-429c-83dc-c5facd09899f-original-pull-secret\") pod \"global-pull-secret-syncer-qw7g7\" (UID: \"6a5bcf2e-872d-429c-83dc-c5facd09899f\") " pod="kube-system/global-pull-secret-syncer-qw7g7" May 21 13:02:59.008367 ip-10-0-133-64 kubenswrapper[2562]: E0521 13:02:59.008329 2562 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered May 21 13:02:59.008426 ip-10-0-133-64 kubenswrapper[2562]: E0521 13:02:59.008407 2562 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/6a5bcf2e-872d-429c-83dc-c5facd09899f-original-pull-secret podName:6a5bcf2e-872d-429c-83dc-c5facd09899f nodeName:}" failed. No retries permitted until 2026-05-21 13:03:01.008386983 +0000 UTC m=+27.558668333 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/6a5bcf2e-872d-429c-83dc-c5facd09899f-original-pull-secret") pod "global-pull-secret-syncer-qw7g7" (UID: "6a5bcf2e-872d-429c-83dc-c5facd09899f") : object "kube-system"/"original-pull-secret" not registered May 21 13:02:59.033432 ip-10-0-133-64 kubenswrapper[2562]: I0521 13:02:59.033399 2562 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-qw7g7" May 21 13:02:59.033572 ip-10-0-133-64 kubenswrapper[2562]: E0521 13:02:59.033527 2562 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-qw7g7" podUID="6a5bcf2e-872d-429c-83dc-c5facd09899f" May 21 13:03:00.032902 ip-10-0-133-64 kubenswrapper[2562]: I0521 13:03:00.032707 2562 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-fhvt9" May 21 13:03:00.033471 ip-10-0-133-64 kubenswrapper[2562]: E0521 13:03:00.033022 2562 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-fhvt9" podUID="8fd03c97-7fa6-42e9-ab95-5fde631dcd29" May 21 13:03:00.035073 ip-10-0-133-64 kubenswrapper[2562]: I0521 13:03:00.035052 2562 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-zkhxz" May 21 13:03:00.035188 ip-10-0-133-64 kubenswrapper[2562]: E0521 13:03:00.035143 2562 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-zkhxz" podUID="9e5a4d6a-bac9-4fb2-97b6-ae1675433f6e" May 21 13:03:00.169768 ip-10-0-133-64 kubenswrapper[2562]: I0521 13:03:00.169732 2562 generic.go:358] "Generic (PLEG): container finished" podID="0ab0e3ad-cd32-4b7d-aea2-93bfd52b94ca" containerID="6966f1eb79b2db19b5031ddbe771fa6d509e0de660c6c2f75ccfd096a5e85300" exitCode=0 May 21 13:03:00.169935 ip-10-0-133-64 kubenswrapper[2562]: I0521 13:03:00.169827 2562 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-p8bmj" event={"ID":"0ab0e3ad-cd32-4b7d-aea2-93bfd52b94ca","Type":"ContainerDied","Data":"6966f1eb79b2db19b5031ddbe771fa6d509e0de660c6c2f75ccfd096a5e85300"} May 21 13:03:00.173140 ip-10-0-133-64 kubenswrapper[2562]: I0521 13:03:00.173104 2562 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-ltpwh" event={"ID":"2d49aff3-1eb6-46f0-bfe3-c5b167536671","Type":"ContainerStarted","Data":"72c4bf41134d0f049b9887ffa703c7eb5a04c5c1ea11dd0fde88168f1f137d0a"} May 21 13:03:00.173485 ip-10-0-133-64 kubenswrapper[2562]: I0521 13:03:00.173471 2562 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-ltpwh" May 21 13:03:00.173485 ip-10-0-133-64 kubenswrapper[2562]: I0521 13:03:00.173493 2562 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-ltpwh" May 21 13:03:00.189207 ip-10-0-133-64 kubenswrapper[2562]: I0521 13:03:00.189189 2562 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-ltpwh" May 21 13:03:00.214586 ip-10-0-133-64 kubenswrapper[2562]: I0521 13:03:00.214534 2562 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-ovn-kubernetes/ovnkube-node-ltpwh" podStartSLOduration=8.08671571 podStartE2EDuration="26.214518902s" podCreationTimestamp="2026-05-21 13:02:34 +0000 UTC" firstStartedPulling="2026-05-21 13:02:36.606518389 +0000 UTC m=+3.156799748" lastFinishedPulling="2026-05-21 13:02:54.734321584 +0000 UTC m=+21.284602940" observedRunningTime="2026-05-21 13:03:00.213878601 +0000 UTC m=+26.764159962" watchObservedRunningTime="2026-05-21 13:03:00.214518902 +0000 UTC m=+26.764800270" May 21 13:03:01.025093 ip-10-0-133-64 kubenswrapper[2562]: I0521 13:03:01.025043 2562 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/6a5bcf2e-872d-429c-83dc-c5facd09899f-original-pull-secret\") pod \"global-pull-secret-syncer-qw7g7\" (UID: \"6a5bcf2e-872d-429c-83dc-c5facd09899f\") " pod="kube-system/global-pull-secret-syncer-qw7g7" May 21 13:03:01.025255 ip-10-0-133-64 kubenswrapper[2562]: E0521 13:03:01.025170 2562 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered May 21 13:03:01.025255 ip-10-0-133-64 kubenswrapper[2562]: E0521 13:03:01.025254 2562 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/6a5bcf2e-872d-429c-83dc-c5facd09899f-original-pull-secret podName:6a5bcf2e-872d-429c-83dc-c5facd09899f nodeName:}" failed. No retries permitted until 2026-05-21 13:03:05.02523819 +0000 UTC m=+31.575519540 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/6a5bcf2e-872d-429c-83dc-c5facd09899f-original-pull-secret") pod "global-pull-secret-syncer-qw7g7" (UID: "6a5bcf2e-872d-429c-83dc-c5facd09899f") : object "kube-system"/"original-pull-secret" not registered May 21 13:03:01.033024 ip-10-0-133-64 kubenswrapper[2562]: I0521 13:03:01.032999 2562 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-qw7g7" May 21 13:03:01.033397 ip-10-0-133-64 kubenswrapper[2562]: E0521 13:03:01.033118 2562 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-qw7g7" podUID="6a5bcf2e-872d-429c-83dc-c5facd09899f" May 21 13:03:01.177141 ip-10-0-133-64 kubenswrapper[2562]: I0521 13:03:01.177066 2562 generic.go:358] "Generic (PLEG): container finished" podID="0ab0e3ad-cd32-4b7d-aea2-93bfd52b94ca" containerID="a929b2f36c1716f16d1cadfb5603ade9640dc5b364a3d693655361fde42514ed" exitCode=0 May 21 13:03:01.177141 ip-10-0-133-64 kubenswrapper[2562]: I0521 13:03:01.177103 2562 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-p8bmj" event={"ID":"0ab0e3ad-cd32-4b7d-aea2-93bfd52b94ca","Type":"ContainerDied","Data":"a929b2f36c1716f16d1cadfb5603ade9640dc5b364a3d693655361fde42514ed"} May 21 13:03:01.177689 ip-10-0-133-64 kubenswrapper[2562]: I0521 13:03:01.177669 2562 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-ltpwh" May 21 13:03:01.193253 ip-10-0-133-64 kubenswrapper[2562]: I0521 13:03:01.193228 2562 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-ltpwh" May 21 13:03:01.557115 ip-10-0-133-64 kubenswrapper[2562]: I0521 13:03:01.557031 2562 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-multus/network-metrics-daemon-fhvt9"] May 21 13:03:01.557253 ip-10-0-133-64 kubenswrapper[2562]: I0521 13:03:01.557150 2562 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-fhvt9" May 21 13:03:01.557253 ip-10-0-133-64 kubenswrapper[2562]: E0521 13:03:01.557233 2562 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-fhvt9" podUID="8fd03c97-7fa6-42e9-ab95-5fde631dcd29" May 21 13:03:01.560955 ip-10-0-133-64 kubenswrapper[2562]: I0521 13:03:01.560928 2562 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-target-zkhxz"] May 21 13:03:01.561071 ip-10-0-133-64 kubenswrapper[2562]: I0521 13:03:01.561036 2562 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-zkhxz" May 21 13:03:01.561147 ip-10-0-133-64 kubenswrapper[2562]: E0521 13:03:01.561124 2562 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-zkhxz" podUID="9e5a4d6a-bac9-4fb2-97b6-ae1675433f6e" May 21 13:03:01.561479 ip-10-0-133-64 kubenswrapper[2562]: I0521 13:03:01.561456 2562 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kube-system/global-pull-secret-syncer-qw7g7"] May 21 13:03:01.561570 ip-10-0-133-64 kubenswrapper[2562]: I0521 13:03:01.561535 2562 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-qw7g7" May 21 13:03:01.561623 ip-10-0-133-64 kubenswrapper[2562]: E0521 13:03:01.561609 2562 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-qw7g7" podUID="6a5bcf2e-872d-429c-83dc-c5facd09899f" May 21 13:03:02.183065 ip-10-0-133-64 kubenswrapper[2562]: I0521 13:03:02.182978 2562 generic.go:358] "Generic (PLEG): container finished" podID="0ab0e3ad-cd32-4b7d-aea2-93bfd52b94ca" containerID="c509130a71cd980d20ad218bae956c6a3b9aca5600e036028dcecbfeadd4f20c" exitCode=0 May 21 13:03:02.183488 ip-10-0-133-64 kubenswrapper[2562]: I0521 13:03:02.183067 2562 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-p8bmj" event={"ID":"0ab0e3ad-cd32-4b7d-aea2-93bfd52b94ca","Type":"ContainerDied","Data":"c509130a71cd980d20ad218bae956c6a3b9aca5600e036028dcecbfeadd4f20c"} May 21 13:03:03.033094 ip-10-0-133-64 kubenswrapper[2562]: I0521 13:03:03.033065 2562 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-zkhxz" May 21 13:03:03.033247 ip-10-0-133-64 kubenswrapper[2562]: E0521 13:03:03.033163 2562 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-zkhxz" podUID="9e5a4d6a-bac9-4fb2-97b6-ae1675433f6e" May 21 13:03:03.033247 ip-10-0-133-64 kubenswrapper[2562]: I0521 13:03:03.033074 2562 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-fhvt9" May 21 13:03:03.033337 ip-10-0-133-64 kubenswrapper[2562]: E0521 13:03:03.033252 2562 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-fhvt9" podUID="8fd03c97-7fa6-42e9-ab95-5fde631dcd29" May 21 13:03:03.033337 ip-10-0-133-64 kubenswrapper[2562]: I0521 13:03:03.033065 2562 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-qw7g7" May 21 13:03:03.033337 ip-10-0-133-64 kubenswrapper[2562]: E0521 13:03:03.033322 2562 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-qw7g7" podUID="6a5bcf2e-872d-429c-83dc-c5facd09899f" May 21 13:03:05.032779 ip-10-0-133-64 kubenswrapper[2562]: I0521 13:03:05.032742 2562 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-qw7g7" May 21 13:03:05.033389 ip-10-0-133-64 kubenswrapper[2562]: I0521 13:03:05.032742 2562 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-zkhxz" May 21 13:03:05.033389 ip-10-0-133-64 kubenswrapper[2562]: E0521 13:03:05.032867 2562 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-qw7g7" podUID="6a5bcf2e-872d-429c-83dc-c5facd09899f" May 21 13:03:05.033389 ip-10-0-133-64 kubenswrapper[2562]: E0521 13:03:05.032902 2562 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-zkhxz" podUID="9e5a4d6a-bac9-4fb2-97b6-ae1675433f6e" May 21 13:03:05.033389 ip-10-0-133-64 kubenswrapper[2562]: I0521 13:03:05.032964 2562 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-fhvt9" May 21 13:03:05.033389 ip-10-0-133-64 kubenswrapper[2562]: E0521 13:03:05.033075 2562 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-fhvt9" podUID="8fd03c97-7fa6-42e9-ab95-5fde631dcd29" May 21 13:03:05.051828 ip-10-0-133-64 kubenswrapper[2562]: I0521 13:03:05.051776 2562 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/6a5bcf2e-872d-429c-83dc-c5facd09899f-original-pull-secret\") pod \"global-pull-secret-syncer-qw7g7\" (UID: \"6a5bcf2e-872d-429c-83dc-c5facd09899f\") " pod="kube-system/global-pull-secret-syncer-qw7g7" May 21 13:03:05.052085 ip-10-0-133-64 kubenswrapper[2562]: E0521 13:03:05.051912 2562 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered May 21 13:03:05.052085 ip-10-0-133-64 kubenswrapper[2562]: E0521 13:03:05.051989 2562 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/6a5bcf2e-872d-429c-83dc-c5facd09899f-original-pull-secret podName:6a5bcf2e-872d-429c-83dc-c5facd09899f nodeName:}" failed. No retries permitted until 2026-05-21 13:03:13.051969006 +0000 UTC m=+39.602250352 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/6a5bcf2e-872d-429c-83dc-c5facd09899f-original-pull-secret") pod "global-pull-secret-syncer-qw7g7" (UID: "6a5bcf2e-872d-429c-83dc-c5facd09899f") : object "kube-system"/"original-pull-secret" not registered May 21 13:03:07.033871 ip-10-0-133-64 kubenswrapper[2562]: I0521 13:03:07.033619 2562 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-zkhxz" May 21 13:03:07.034343 ip-10-0-133-64 kubenswrapper[2562]: I0521 13:03:07.033622 2562 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-qw7g7" May 21 13:03:07.034343 ip-10-0-133-64 kubenswrapper[2562]: E0521 13:03:07.033975 2562 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-zkhxz" podUID="9e5a4d6a-bac9-4fb2-97b6-ae1675433f6e" May 21 13:03:07.034343 ip-10-0-133-64 kubenswrapper[2562]: I0521 13:03:07.033633 2562 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-fhvt9" May 21 13:03:07.034343 ip-10-0-133-64 kubenswrapper[2562]: E0521 13:03:07.034025 2562 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-qw7g7" podUID="6a5bcf2e-872d-429c-83dc-c5facd09899f" May 21 13:03:07.034343 ip-10-0-133-64 kubenswrapper[2562]: E0521 13:03:07.034153 2562 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-fhvt9" podUID="8fd03c97-7fa6-42e9-ab95-5fde631dcd29" May 21 13:03:07.314502 ip-10-0-133-64 kubenswrapper[2562]: I0521 13:03:07.314426 2562 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-133-64.ec2.internal" event="NodeReady" May 21 13:03:07.314691 ip-10-0-133-64 kubenswrapper[2562]: I0521 13:03:07.314608 2562 kubelet_node_status.go:550] "Fast updating node status as it just became ready" May 21 13:03:07.353549 ip-10-0-133-64 kubenswrapper[2562]: I0521 13:03:07.353510 2562 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-image-registry/image-registry-c7d665b66-khpd9"] May 21 13:03:07.373261 ip-10-0-133-64 kubenswrapper[2562]: I0521 13:03:07.373228 2562 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-dns/dns-default-jmwf6"] May 21 13:03:07.373441 ip-10-0-133-64 kubenswrapper[2562]: I0521 13:03:07.373402 2562 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-c7d665b66-khpd9" May 21 13:03:07.376107 ip-10-0-133-64 kubenswrapper[2562]: I0521 13:03:07.376034 2562 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"installation-pull-secrets\"" May 21 13:03:07.376369 ip-10-0-133-64 kubenswrapper[2562]: I0521 13:03:07.376144 2562 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"image-registry-private-configuration\"" May 21 13:03:07.376706 ip-10-0-133-64 kubenswrapper[2562]: I0521 13:03:07.376685 2562 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"image-registry-tls\"" May 21 13:03:07.377387 ip-10-0-133-64 kubenswrapper[2562]: I0521 13:03:07.377246 2562 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"registry-dockercfg-pgxzw\"" May 21 13:03:07.383519 ip-10-0-133-64 kubenswrapper[2562]: I0521 13:03:07.381157 2562 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-ingress-canary/ingress-canary-6d7rg"] May 21 13:03:07.394807 ip-10-0-133-64 kubenswrapper[2562]: I0521 13:03:07.394757 2562 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"trusted-ca\"" May 21 13:03:07.397639 ip-10-0-133-64 kubenswrapper[2562]: I0521 13:03:07.397611 2562 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-image-registry/image-registry-c7d665b66-khpd9"] May 21 13:03:07.397639 ip-10-0-133-64 kubenswrapper[2562]: I0521 13:03:07.397639 2562 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-dns/dns-default-jmwf6"] May 21 13:03:07.397835 ip-10-0-133-64 kubenswrapper[2562]: I0521 13:03:07.397652 2562 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-ingress-canary/ingress-canary-6d7rg"] May 21 13:03:07.397835 ip-10-0-133-64 kubenswrapper[2562]: I0521 13:03:07.397765 2562 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress-canary/ingress-canary-6d7rg" May 21 13:03:07.398235 ip-10-0-133-64 kubenswrapper[2562]: I0521 13:03:07.398052 2562 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-jmwf6" May 21 13:03:07.400255 ip-10-0-133-64 kubenswrapper[2562]: I0521 13:03:07.400234 2562 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress-canary\"/\"openshift-service-ca.crt\"" May 21 13:03:07.400357 ip-10-0-133-64 kubenswrapper[2562]: I0521 13:03:07.400275 2562 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-canary\"/\"canary-serving-cert\"" May 21 13:03:07.400357 ip-10-0-133-64 kubenswrapper[2562]: I0521 13:03:07.400317 2562 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-default-metrics-tls\"" May 21 13:03:07.400640 ip-10-0-133-64 kubenswrapper[2562]: I0521 13:03:07.400624 2562 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"dns-default\"" May 21 13:03:07.400740 ip-10-0-133-64 kubenswrapper[2562]: I0521 13:03:07.400706 2562 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress-canary\"/\"kube-root-ca.crt\"" May 21 13:03:07.400836 ip-10-0-133-64 kubenswrapper[2562]: I0521 13:03:07.400813 2562 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-canary\"/\"default-dockercfg-7b4pc\"" May 21 13:03:07.400975 ip-10-0-133-64 kubenswrapper[2562]: I0521 13:03:07.400954 2562 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-dockercfg-4szfj\"" May 21 13:03:07.470013 ip-10-0-133-64 kubenswrapper[2562]: I0521 13:03:07.469981 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/10a964ec-b101-49a4-8dc7-0f208c0fe49d-registry-certificates\") pod \"image-registry-c7d665b66-khpd9\" (UID: \"10a964ec-b101-49a4-8dc7-0f208c0fe49d\") " pod="openshift-image-registry/image-registry-c7d665b66-khpd9" May 21 13:03:07.470220 ip-10-0-133-64 kubenswrapper[2562]: I0521 13:03:07.470053 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-j4b8q\" (UniqueName: \"kubernetes.io/projected/10a964ec-b101-49a4-8dc7-0f208c0fe49d-kube-api-access-j4b8q\") pod \"image-registry-c7d665b66-khpd9\" (UID: \"10a964ec-b101-49a4-8dc7-0f208c0fe49d\") " pod="openshift-image-registry/image-registry-c7d665b66-khpd9" May 21 13:03:07.470220 ip-10-0-133-64 kubenswrapper[2562]: I0521 13:03:07.470081 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/ceb9bb27-e558-4ca2-9baf-cc21c0216ef6-cert\") pod \"ingress-canary-6d7rg\" (UID: \"ceb9bb27-e558-4ca2-9baf-cc21c0216ef6\") " pod="openshift-ingress-canary/ingress-canary-6d7rg" May 21 13:03:07.470220 ip-10-0-133-64 kubenswrapper[2562]: I0521 13:03:07.470146 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/10a964ec-b101-49a4-8dc7-0f208c0fe49d-bound-sa-token\") pod \"image-registry-c7d665b66-khpd9\" (UID: \"10a964ec-b101-49a4-8dc7-0f208c0fe49d\") " pod="openshift-image-registry/image-registry-c7d665b66-khpd9" May 21 13:03:07.470220 ip-10-0-133-64 kubenswrapper[2562]: I0521 13:03:07.470169 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/10a964ec-b101-49a4-8dc7-0f208c0fe49d-image-registry-private-configuration\") pod \"image-registry-c7d665b66-khpd9\" (UID: \"10a964ec-b101-49a4-8dc7-0f208c0fe49d\") " pod="openshift-image-registry/image-registry-c7d665b66-khpd9" May 21 13:03:07.470220 ip-10-0-133-64 kubenswrapper[2562]: I0521 13:03:07.470193 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/10a964ec-b101-49a4-8dc7-0f208c0fe49d-trusted-ca\") pod \"image-registry-c7d665b66-khpd9\" (UID: \"10a964ec-b101-49a4-8dc7-0f208c0fe49d\") " pod="openshift-image-registry/image-registry-c7d665b66-khpd9" May 21 13:03:07.470426 ip-10-0-133-64 kubenswrapper[2562]: I0521 13:03:07.470224 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-rczlg\" (UniqueName: \"kubernetes.io/projected/ceb9bb27-e558-4ca2-9baf-cc21c0216ef6-kube-api-access-rczlg\") pod \"ingress-canary-6d7rg\" (UID: \"ceb9bb27-e558-4ca2-9baf-cc21c0216ef6\") " pod="openshift-ingress-canary/ingress-canary-6d7rg" May 21 13:03:07.470426 ip-10-0-133-64 kubenswrapper[2562]: I0521 13:03:07.470285 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/10a964ec-b101-49a4-8dc7-0f208c0fe49d-ca-trust-extracted\") pod \"image-registry-c7d665b66-khpd9\" (UID: \"10a964ec-b101-49a4-8dc7-0f208c0fe49d\") " pod="openshift-image-registry/image-registry-c7d665b66-khpd9" May 21 13:03:07.470426 ip-10-0-133-64 kubenswrapper[2562]: I0521 13:03:07.470359 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/f0b8359d-d8af-4b73-8592-27cac5c13257-config-volume\") pod \"dns-default-jmwf6\" (UID: \"f0b8359d-d8af-4b73-8592-27cac5c13257\") " pod="openshift-dns/dns-default-jmwf6" May 21 13:03:07.470426 ip-10-0-133-64 kubenswrapper[2562]: I0521 13:03:07.470398 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/10a964ec-b101-49a4-8dc7-0f208c0fe49d-registry-tls\") pod \"image-registry-c7d665b66-khpd9\" (UID: \"10a964ec-b101-49a4-8dc7-0f208c0fe49d\") " pod="openshift-image-registry/image-registry-c7d665b66-khpd9" May 21 13:03:07.470604 ip-10-0-133-64 kubenswrapper[2562]: I0521 13:03:07.470433 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/f0b8359d-d8af-4b73-8592-27cac5c13257-metrics-tls\") pod \"dns-default-jmwf6\" (UID: \"f0b8359d-d8af-4b73-8592-27cac5c13257\") " pod="openshift-dns/dns-default-jmwf6" May 21 13:03:07.470604 ip-10-0-133-64 kubenswrapper[2562]: I0521 13:03:07.470453 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/f0b8359d-d8af-4b73-8592-27cac5c13257-tmp-dir\") pod \"dns-default-jmwf6\" (UID: \"f0b8359d-d8af-4b73-8592-27cac5c13257\") " pod="openshift-dns/dns-default-jmwf6" May 21 13:03:07.470604 ip-10-0-133-64 kubenswrapper[2562]: I0521 13:03:07.470477 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-vv97q\" (UniqueName: \"kubernetes.io/projected/f0b8359d-d8af-4b73-8592-27cac5c13257-kube-api-access-vv97q\") pod \"dns-default-jmwf6\" (UID: \"f0b8359d-d8af-4b73-8592-27cac5c13257\") " pod="openshift-dns/dns-default-jmwf6" May 21 13:03:07.470604 ip-10-0-133-64 kubenswrapper[2562]: I0521 13:03:07.470566 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/10a964ec-b101-49a4-8dc7-0f208c0fe49d-installation-pull-secrets\") pod \"image-registry-c7d665b66-khpd9\" (UID: \"10a964ec-b101-49a4-8dc7-0f208c0fe49d\") " pod="openshift-image-registry/image-registry-c7d665b66-khpd9" May 21 13:03:07.571388 ip-10-0-133-64 kubenswrapper[2562]: I0521 13:03:07.571303 2562 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/10a964ec-b101-49a4-8dc7-0f208c0fe49d-ca-trust-extracted\") pod \"image-registry-c7d665b66-khpd9\" (UID: \"10a964ec-b101-49a4-8dc7-0f208c0fe49d\") " pod="openshift-image-registry/image-registry-c7d665b66-khpd9" May 21 13:03:07.571388 ip-10-0-133-64 kubenswrapper[2562]: I0521 13:03:07.571356 2562 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/f0b8359d-d8af-4b73-8592-27cac5c13257-config-volume\") pod \"dns-default-jmwf6\" (UID: \"f0b8359d-d8af-4b73-8592-27cac5c13257\") " pod="openshift-dns/dns-default-jmwf6" May 21 13:03:07.571388 ip-10-0-133-64 kubenswrapper[2562]: I0521 13:03:07.571384 2562 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/10a964ec-b101-49a4-8dc7-0f208c0fe49d-registry-tls\") pod \"image-registry-c7d665b66-khpd9\" (UID: \"10a964ec-b101-49a4-8dc7-0f208c0fe49d\") " pod="openshift-image-registry/image-registry-c7d665b66-khpd9" May 21 13:03:07.571693 ip-10-0-133-64 kubenswrapper[2562]: I0521 13:03:07.571409 2562 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/f0b8359d-d8af-4b73-8592-27cac5c13257-metrics-tls\") pod \"dns-default-jmwf6\" (UID: \"f0b8359d-d8af-4b73-8592-27cac5c13257\") " pod="openshift-dns/dns-default-jmwf6" May 21 13:03:07.571693 ip-10-0-133-64 kubenswrapper[2562]: I0521 13:03:07.571425 2562 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/f0b8359d-d8af-4b73-8592-27cac5c13257-tmp-dir\") pod \"dns-default-jmwf6\" (UID: \"f0b8359d-d8af-4b73-8592-27cac5c13257\") " pod="openshift-dns/dns-default-jmwf6" May 21 13:03:07.571693 ip-10-0-133-64 kubenswrapper[2562]: I0521 13:03:07.571440 2562 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-vv97q\" (UniqueName: \"kubernetes.io/projected/f0b8359d-d8af-4b73-8592-27cac5c13257-kube-api-access-vv97q\") pod \"dns-default-jmwf6\" (UID: \"f0b8359d-d8af-4b73-8592-27cac5c13257\") " pod="openshift-dns/dns-default-jmwf6" May 21 13:03:07.571693 ip-10-0-133-64 kubenswrapper[2562]: I0521 13:03:07.571460 2562 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/10a964ec-b101-49a4-8dc7-0f208c0fe49d-installation-pull-secrets\") pod \"image-registry-c7d665b66-khpd9\" (UID: \"10a964ec-b101-49a4-8dc7-0f208c0fe49d\") " pod="openshift-image-registry/image-registry-c7d665b66-khpd9" May 21 13:03:07.571693 ip-10-0-133-64 kubenswrapper[2562]: I0521 13:03:07.571482 2562 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/10a964ec-b101-49a4-8dc7-0f208c0fe49d-registry-certificates\") pod \"image-registry-c7d665b66-khpd9\" (UID: \"10a964ec-b101-49a4-8dc7-0f208c0fe49d\") " pod="openshift-image-registry/image-registry-c7d665b66-khpd9" May 21 13:03:07.571693 ip-10-0-133-64 kubenswrapper[2562]: E0521 13:03:07.571531 2562 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found May 21 13:03:07.572006 ip-10-0-133-64 kubenswrapper[2562]: I0521 13:03:07.571540 2562 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-j4b8q\" (UniqueName: \"kubernetes.io/projected/10a964ec-b101-49a4-8dc7-0f208c0fe49d-kube-api-access-j4b8q\") pod \"image-registry-c7d665b66-khpd9\" (UID: \"10a964ec-b101-49a4-8dc7-0f208c0fe49d\") " pod="openshift-image-registry/image-registry-c7d665b66-khpd9" May 21 13:03:07.572006 ip-10-0-133-64 kubenswrapper[2562]: I0521 13:03:07.571778 2562 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/ceb9bb27-e558-4ca2-9baf-cc21c0216ef6-cert\") pod \"ingress-canary-6d7rg\" (UID: \"ceb9bb27-e558-4ca2-9baf-cc21c0216ef6\") " pod="openshift-ingress-canary/ingress-canary-6d7rg" May 21 13:03:07.572006 ip-10-0-133-64 kubenswrapper[2562]: I0521 13:03:07.571783 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/f0b8359d-d8af-4b73-8592-27cac5c13257-tmp-dir\") pod \"dns-default-jmwf6\" (UID: \"f0b8359d-d8af-4b73-8592-27cac5c13257\") " pod="openshift-dns/dns-default-jmwf6" May 21 13:03:07.572006 ip-10-0-133-64 kubenswrapper[2562]: I0521 13:03:07.571786 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/10a964ec-b101-49a4-8dc7-0f208c0fe49d-ca-trust-extracted\") pod \"image-registry-c7d665b66-khpd9\" (UID: \"10a964ec-b101-49a4-8dc7-0f208c0fe49d\") " pod="openshift-image-registry/image-registry-c7d665b66-khpd9" May 21 13:03:07.572006 ip-10-0-133-64 kubenswrapper[2562]: E0521 13:03:07.571533 2562 projected.go:264] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found May 21 13:03:07.572006 ip-10-0-133-64 kubenswrapper[2562]: E0521 13:03:07.571848 2562 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/f0b8359d-d8af-4b73-8592-27cac5c13257-metrics-tls podName:f0b8359d-d8af-4b73-8592-27cac5c13257 nodeName:}" failed. No retries permitted until 2026-05-21 13:03:08.071828052 +0000 UTC m=+34.622109413 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/f0b8359d-d8af-4b73-8592-27cac5c13257-metrics-tls") pod "dns-default-jmwf6" (UID: "f0b8359d-d8af-4b73-8592-27cac5c13257") : secret "dns-default-metrics-tls" not found May 21 13:03:07.572006 ip-10-0-133-64 kubenswrapper[2562]: E0521 13:03:07.571860 2562 projected.go:194] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-c7d665b66-khpd9: secret "image-registry-tls" not found May 21 13:03:07.572006 ip-10-0-133-64 kubenswrapper[2562]: E0521 13:03:07.571882 2562 secret.go:189] Couldn't get secret openshift-ingress-canary/canary-serving-cert: secret "canary-serving-cert" not found May 21 13:03:07.572006 ip-10-0-133-64 kubenswrapper[2562]: E0521 13:03:07.571972 2562 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/10a964ec-b101-49a4-8dc7-0f208c0fe49d-registry-tls podName:10a964ec-b101-49a4-8dc7-0f208c0fe49d nodeName:}" failed. No retries permitted until 2026-05-21 13:03:08.071957497 +0000 UTC m=+34.622238884 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/10a964ec-b101-49a4-8dc7-0f208c0fe49d-registry-tls") pod "image-registry-c7d665b66-khpd9" (UID: "10a964ec-b101-49a4-8dc7-0f208c0fe49d") : secret "image-registry-tls" not found May 21 13:03:07.572006 ip-10-0-133-64 kubenswrapper[2562]: E0521 13:03:07.571992 2562 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/ceb9bb27-e558-4ca2-9baf-cc21c0216ef6-cert podName:ceb9bb27-e558-4ca2-9baf-cc21c0216ef6 nodeName:}" failed. No retries permitted until 2026-05-21 13:03:08.071979353 +0000 UTC m=+34.622260714 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "cert" (UniqueName: "kubernetes.io/secret/ceb9bb27-e558-4ca2-9baf-cc21c0216ef6-cert") pod "ingress-canary-6d7rg" (UID: "ceb9bb27-e558-4ca2-9baf-cc21c0216ef6") : secret "canary-serving-cert" not found May 21 13:03:07.572441 ip-10-0-133-64 kubenswrapper[2562]: I0521 13:03:07.572014 2562 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/10a964ec-b101-49a4-8dc7-0f208c0fe49d-bound-sa-token\") pod \"image-registry-c7d665b66-khpd9\" (UID: \"10a964ec-b101-49a4-8dc7-0f208c0fe49d\") " pod="openshift-image-registry/image-registry-c7d665b66-khpd9" May 21 13:03:07.572441 ip-10-0-133-64 kubenswrapper[2562]: I0521 13:03:07.572047 2562 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/10a964ec-b101-49a4-8dc7-0f208c0fe49d-image-registry-private-configuration\") pod \"image-registry-c7d665b66-khpd9\" (UID: \"10a964ec-b101-49a4-8dc7-0f208c0fe49d\") " pod="openshift-image-registry/image-registry-c7d665b66-khpd9" May 21 13:03:07.572441 ip-10-0-133-64 kubenswrapper[2562]: I0521 13:03:07.572073 2562 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/10a964ec-b101-49a4-8dc7-0f208c0fe49d-trusted-ca\") pod \"image-registry-c7d665b66-khpd9\" (UID: \"10a964ec-b101-49a4-8dc7-0f208c0fe49d\") " pod="openshift-image-registry/image-registry-c7d665b66-khpd9" May 21 13:03:07.572441 ip-10-0-133-64 kubenswrapper[2562]: I0521 13:03:07.572102 2562 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-rczlg\" (UniqueName: \"kubernetes.io/projected/ceb9bb27-e558-4ca2-9baf-cc21c0216ef6-kube-api-access-rczlg\") pod \"ingress-canary-6d7rg\" (UID: \"ceb9bb27-e558-4ca2-9baf-cc21c0216ef6\") " pod="openshift-ingress-canary/ingress-canary-6d7rg" May 21 13:03:07.572441 ip-10-0-133-64 kubenswrapper[2562]: I0521 13:03:07.572189 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/f0b8359d-d8af-4b73-8592-27cac5c13257-config-volume\") pod \"dns-default-jmwf6\" (UID: \"f0b8359d-d8af-4b73-8592-27cac5c13257\") " pod="openshift-dns/dns-default-jmwf6" May 21 13:03:07.572441 ip-10-0-133-64 kubenswrapper[2562]: I0521 13:03:07.572302 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/10a964ec-b101-49a4-8dc7-0f208c0fe49d-registry-certificates\") pod \"image-registry-c7d665b66-khpd9\" (UID: \"10a964ec-b101-49a4-8dc7-0f208c0fe49d\") " pod="openshift-image-registry/image-registry-c7d665b66-khpd9" May 21 13:03:07.572973 ip-10-0-133-64 kubenswrapper[2562]: I0521 13:03:07.572951 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/10a964ec-b101-49a4-8dc7-0f208c0fe49d-trusted-ca\") pod \"image-registry-c7d665b66-khpd9\" (UID: \"10a964ec-b101-49a4-8dc7-0f208c0fe49d\") " pod="openshift-image-registry/image-registry-c7d665b66-khpd9" May 21 13:03:07.581847 ip-10-0-133-64 kubenswrapper[2562]: I0521 13:03:07.581726 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-vv97q\" (UniqueName: \"kubernetes.io/projected/f0b8359d-d8af-4b73-8592-27cac5c13257-kube-api-access-vv97q\") pod \"dns-default-jmwf6\" (UID: \"f0b8359d-d8af-4b73-8592-27cac5c13257\") " pod="openshift-dns/dns-default-jmwf6" May 21 13:03:07.581847 ip-10-0-133-64 kubenswrapper[2562]: I0521 13:03:07.581778 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/10a964ec-b101-49a4-8dc7-0f208c0fe49d-image-registry-private-configuration\") pod \"image-registry-c7d665b66-khpd9\" (UID: \"10a964ec-b101-49a4-8dc7-0f208c0fe49d\") " pod="openshift-image-registry/image-registry-c7d665b66-khpd9" May 21 13:03:07.581847 ip-10-0-133-64 kubenswrapper[2562]: I0521 13:03:07.581815 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/10a964ec-b101-49a4-8dc7-0f208c0fe49d-installation-pull-secrets\") pod \"image-registry-c7d665b66-khpd9\" (UID: \"10a964ec-b101-49a4-8dc7-0f208c0fe49d\") " pod="openshift-image-registry/image-registry-c7d665b66-khpd9" May 21 13:03:07.582061 ip-10-0-133-64 kubenswrapper[2562]: I0521 13:03:07.581997 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/10a964ec-b101-49a4-8dc7-0f208c0fe49d-bound-sa-token\") pod \"image-registry-c7d665b66-khpd9\" (UID: \"10a964ec-b101-49a4-8dc7-0f208c0fe49d\") " pod="openshift-image-registry/image-registry-c7d665b66-khpd9" May 21 13:03:07.582134 ip-10-0-133-64 kubenswrapper[2562]: I0521 13:03:07.582111 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-j4b8q\" (UniqueName: \"kubernetes.io/projected/10a964ec-b101-49a4-8dc7-0f208c0fe49d-kube-api-access-j4b8q\") pod \"image-registry-c7d665b66-khpd9\" (UID: \"10a964ec-b101-49a4-8dc7-0f208c0fe49d\") " pod="openshift-image-registry/image-registry-c7d665b66-khpd9" May 21 13:03:07.582741 ip-10-0-133-64 kubenswrapper[2562]: I0521 13:03:07.582720 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-rczlg\" (UniqueName: \"kubernetes.io/projected/ceb9bb27-e558-4ca2-9baf-cc21c0216ef6-kube-api-access-rczlg\") pod \"ingress-canary-6d7rg\" (UID: \"ceb9bb27-e558-4ca2-9baf-cc21c0216ef6\") " pod="openshift-ingress-canary/ingress-canary-6d7rg" May 21 13:03:07.672632 ip-10-0-133-64 kubenswrapper[2562]: I0521 13:03:07.672592 2562 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/8fd03c97-7fa6-42e9-ab95-5fde631dcd29-metrics-certs\") pod \"network-metrics-daemon-fhvt9\" (UID: \"8fd03c97-7fa6-42e9-ab95-5fde631dcd29\") " pod="openshift-multus/network-metrics-daemon-fhvt9" May 21 13:03:07.672814 ip-10-0-133-64 kubenswrapper[2562]: E0521 13:03:07.672736 2562 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered May 21 13:03:07.672875 ip-10-0-133-64 kubenswrapper[2562]: E0521 13:03:07.672831 2562 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/8fd03c97-7fa6-42e9-ab95-5fde631dcd29-metrics-certs podName:8fd03c97-7fa6-42e9-ab95-5fde631dcd29 nodeName:}" failed. No retries permitted until 2026-05-21 13:03:39.672810165 +0000 UTC m=+66.223091529 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/8fd03c97-7fa6-42e9-ab95-5fde631dcd29-metrics-certs") pod "network-metrics-daemon-fhvt9" (UID: "8fd03c97-7fa6-42e9-ab95-5fde631dcd29") : object "openshift-multus"/"metrics-daemon-secret" not registered May 21 13:03:07.773392 ip-10-0-133-64 kubenswrapper[2562]: I0521 13:03:07.773338 2562 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-2r7z9\" (UniqueName: \"kubernetes.io/projected/9e5a4d6a-bac9-4fb2-97b6-ae1675433f6e-kube-api-access-2r7z9\") pod \"network-check-target-zkhxz\" (UID: \"9e5a4d6a-bac9-4fb2-97b6-ae1675433f6e\") " pod="openshift-network-diagnostics/network-check-target-zkhxz" May 21 13:03:07.773591 ip-10-0-133-64 kubenswrapper[2562]: E0521 13:03:07.773511 2562 projected.go:289] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered May 21 13:03:07.773591 ip-10-0-133-64 kubenswrapper[2562]: E0521 13:03:07.773532 2562 projected.go:289] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered May 21 13:03:07.773591 ip-10-0-133-64 kubenswrapper[2562]: E0521 13:03:07.773545 2562 projected.go:194] Error preparing data for projected volume kube-api-access-2r7z9 for pod openshift-network-diagnostics/network-check-target-zkhxz: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] May 21 13:03:07.773713 ip-10-0-133-64 kubenswrapper[2562]: E0521 13:03:07.773603 2562 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/9e5a4d6a-bac9-4fb2-97b6-ae1675433f6e-kube-api-access-2r7z9 podName:9e5a4d6a-bac9-4fb2-97b6-ae1675433f6e nodeName:}" failed. No retries permitted until 2026-05-21 13:03:39.773588126 +0000 UTC m=+66.323869485 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "kube-api-access-2r7z9" (UniqueName: "kubernetes.io/projected/9e5a4d6a-bac9-4fb2-97b6-ae1675433f6e-kube-api-access-2r7z9") pod "network-check-target-zkhxz" (UID: "9e5a4d6a-bac9-4fb2-97b6-ae1675433f6e") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] May 21 13:03:08.076050 ip-10-0-133-64 kubenswrapper[2562]: I0521 13:03:08.075998 2562 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/10a964ec-b101-49a4-8dc7-0f208c0fe49d-registry-tls\") pod \"image-registry-c7d665b66-khpd9\" (UID: \"10a964ec-b101-49a4-8dc7-0f208c0fe49d\") " pod="openshift-image-registry/image-registry-c7d665b66-khpd9" May 21 13:03:08.076715 ip-10-0-133-64 kubenswrapper[2562]: I0521 13:03:08.076060 2562 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/f0b8359d-d8af-4b73-8592-27cac5c13257-metrics-tls\") pod \"dns-default-jmwf6\" (UID: \"f0b8359d-d8af-4b73-8592-27cac5c13257\") " pod="openshift-dns/dns-default-jmwf6" May 21 13:03:08.076715 ip-10-0-133-64 kubenswrapper[2562]: I0521 13:03:08.076141 2562 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/ceb9bb27-e558-4ca2-9baf-cc21c0216ef6-cert\") pod \"ingress-canary-6d7rg\" (UID: \"ceb9bb27-e558-4ca2-9baf-cc21c0216ef6\") " pod="openshift-ingress-canary/ingress-canary-6d7rg" May 21 13:03:08.076715 ip-10-0-133-64 kubenswrapper[2562]: E0521 13:03:08.076169 2562 projected.go:264] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found May 21 13:03:08.076715 ip-10-0-133-64 kubenswrapper[2562]: E0521 13:03:08.076194 2562 projected.go:194] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-c7d665b66-khpd9: secret "image-registry-tls" not found May 21 13:03:08.076715 ip-10-0-133-64 kubenswrapper[2562]: E0521 13:03:08.076259 2562 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found May 21 13:03:08.076715 ip-10-0-133-64 kubenswrapper[2562]: E0521 13:03:08.076274 2562 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/10a964ec-b101-49a4-8dc7-0f208c0fe49d-registry-tls podName:10a964ec-b101-49a4-8dc7-0f208c0fe49d nodeName:}" failed. No retries permitted until 2026-05-21 13:03:09.076253268 +0000 UTC m=+35.626534638 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/10a964ec-b101-49a4-8dc7-0f208c0fe49d-registry-tls") pod "image-registry-c7d665b66-khpd9" (UID: "10a964ec-b101-49a4-8dc7-0f208c0fe49d") : secret "image-registry-tls" not found May 21 13:03:08.076715 ip-10-0-133-64 kubenswrapper[2562]: E0521 13:03:08.076274 2562 secret.go:189] Couldn't get secret openshift-ingress-canary/canary-serving-cert: secret "canary-serving-cert" not found May 21 13:03:08.076715 ip-10-0-133-64 kubenswrapper[2562]: E0521 13:03:08.076320 2562 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/f0b8359d-d8af-4b73-8592-27cac5c13257-metrics-tls podName:f0b8359d-d8af-4b73-8592-27cac5c13257 nodeName:}" failed. No retries permitted until 2026-05-21 13:03:09.07630333 +0000 UTC m=+35.626584687 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/f0b8359d-d8af-4b73-8592-27cac5c13257-metrics-tls") pod "dns-default-jmwf6" (UID: "f0b8359d-d8af-4b73-8592-27cac5c13257") : secret "dns-default-metrics-tls" not found May 21 13:03:08.076715 ip-10-0-133-64 kubenswrapper[2562]: E0521 13:03:08.076341 2562 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/ceb9bb27-e558-4ca2-9baf-cc21c0216ef6-cert podName:ceb9bb27-e558-4ca2-9baf-cc21c0216ef6 nodeName:}" failed. No retries permitted until 2026-05-21 13:03:09.076330154 +0000 UTC m=+35.626611502 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "cert" (UniqueName: "kubernetes.io/secret/ceb9bb27-e558-4ca2-9baf-cc21c0216ef6-cert") pod "ingress-canary-6d7rg" (UID: "ceb9bb27-e558-4ca2-9baf-cc21c0216ef6") : secret "canary-serving-cert" not found May 21 13:03:09.032641 ip-10-0-133-64 kubenswrapper[2562]: I0521 13:03:09.032561 2562 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-fhvt9" May 21 13:03:09.032870 ip-10-0-133-64 kubenswrapper[2562]: I0521 13:03:09.032561 2562 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-zkhxz" May 21 13:03:09.032870 ip-10-0-133-64 kubenswrapper[2562]: I0521 13:03:09.032561 2562 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-qw7g7" May 21 13:03:09.035395 ip-10-0-133-64 kubenswrapper[2562]: I0521 13:03:09.035372 2562 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"kube-root-ca.crt\"" May 21 13:03:09.036099 ip-10-0-133-64 kubenswrapper[2562]: I0521 13:03:09.036076 2562 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"original-pull-secret\"" May 21 13:03:09.036284 ip-10-0-133-64 kubenswrapper[2562]: I0521 13:03:09.036262 2562 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"openshift-service-ca.crt\"" May 21 13:03:09.036394 ip-10-0-133-64 kubenswrapper[2562]: I0521 13:03:09.036296 2562 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-sa-dockercfg-dfgjb\"" May 21 13:03:09.036458 ip-10-0-133-64 kubenswrapper[2562]: I0521 13:03:09.036398 2562 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"default-dockercfg-b4mfv\"" May 21 13:03:09.036501 ip-10-0-133-64 kubenswrapper[2562]: I0521 13:03:09.036489 2562 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-secret\"" May 21 13:03:09.084834 ip-10-0-133-64 kubenswrapper[2562]: I0521 13:03:09.084792 2562 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/10a964ec-b101-49a4-8dc7-0f208c0fe49d-registry-tls\") pod \"image-registry-c7d665b66-khpd9\" (UID: \"10a964ec-b101-49a4-8dc7-0f208c0fe49d\") " pod="openshift-image-registry/image-registry-c7d665b66-khpd9" May 21 13:03:09.085203 ip-10-0-133-64 kubenswrapper[2562]: I0521 13:03:09.084845 2562 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/f0b8359d-d8af-4b73-8592-27cac5c13257-metrics-tls\") pod \"dns-default-jmwf6\" (UID: \"f0b8359d-d8af-4b73-8592-27cac5c13257\") " pod="openshift-dns/dns-default-jmwf6" May 21 13:03:09.085203 ip-10-0-133-64 kubenswrapper[2562]: I0521 13:03:09.084919 2562 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/ceb9bb27-e558-4ca2-9baf-cc21c0216ef6-cert\") pod \"ingress-canary-6d7rg\" (UID: \"ceb9bb27-e558-4ca2-9baf-cc21c0216ef6\") " pod="openshift-ingress-canary/ingress-canary-6d7rg" May 21 13:03:09.085203 ip-10-0-133-64 kubenswrapper[2562]: E0521 13:03:09.085004 2562 projected.go:264] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found May 21 13:03:09.085203 ip-10-0-133-64 kubenswrapper[2562]: E0521 13:03:09.085018 2562 projected.go:194] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-c7d665b66-khpd9: secret "image-registry-tls" not found May 21 13:03:09.085203 ip-10-0-133-64 kubenswrapper[2562]: E0521 13:03:09.085034 2562 secret.go:189] Couldn't get secret openshift-ingress-canary/canary-serving-cert: secret "canary-serving-cert" not found May 21 13:03:09.085203 ip-10-0-133-64 kubenswrapper[2562]: E0521 13:03:09.085041 2562 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found May 21 13:03:09.085203 ip-10-0-133-64 kubenswrapper[2562]: E0521 13:03:09.085079 2562 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/ceb9bb27-e558-4ca2-9baf-cc21c0216ef6-cert podName:ceb9bb27-e558-4ca2-9baf-cc21c0216ef6 nodeName:}" failed. No retries permitted until 2026-05-21 13:03:11.085060923 +0000 UTC m=+37.635342270 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "cert" (UniqueName: "kubernetes.io/secret/ceb9bb27-e558-4ca2-9baf-cc21c0216ef6-cert") pod "ingress-canary-6d7rg" (UID: "ceb9bb27-e558-4ca2-9baf-cc21c0216ef6") : secret "canary-serving-cert" not found May 21 13:03:09.085203 ip-10-0-133-64 kubenswrapper[2562]: E0521 13:03:09.085096 2562 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/10a964ec-b101-49a4-8dc7-0f208c0fe49d-registry-tls podName:10a964ec-b101-49a4-8dc7-0f208c0fe49d nodeName:}" failed. No retries permitted until 2026-05-21 13:03:11.085087189 +0000 UTC m=+37.635368535 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/10a964ec-b101-49a4-8dc7-0f208c0fe49d-registry-tls") pod "image-registry-c7d665b66-khpd9" (UID: "10a964ec-b101-49a4-8dc7-0f208c0fe49d") : secret "image-registry-tls" not found May 21 13:03:09.085203 ip-10-0-133-64 kubenswrapper[2562]: E0521 13:03:09.085116 2562 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/f0b8359d-d8af-4b73-8592-27cac5c13257-metrics-tls podName:f0b8359d-d8af-4b73-8592-27cac5c13257 nodeName:}" failed. No retries permitted until 2026-05-21 13:03:11.085107709 +0000 UTC m=+37.635389060 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/f0b8359d-d8af-4b73-8592-27cac5c13257-metrics-tls") pod "dns-default-jmwf6" (UID: "f0b8359d-d8af-4b73-8592-27cac5c13257") : secret "dns-default-metrics-tls" not found May 21 13:03:09.197469 ip-10-0-133-64 kubenswrapper[2562]: I0521 13:03:09.197437 2562 generic.go:358] "Generic (PLEG): container finished" podID="0ab0e3ad-cd32-4b7d-aea2-93bfd52b94ca" containerID="37d7e7b2ca038f49851807429aaa51a5de3607103d32bd7314db2237201ee8d4" exitCode=0 May 21 13:03:09.197644 ip-10-0-133-64 kubenswrapper[2562]: I0521 13:03:09.197494 2562 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-p8bmj" event={"ID":"0ab0e3ad-cd32-4b7d-aea2-93bfd52b94ca","Type":"ContainerDied","Data":"37d7e7b2ca038f49851807429aaa51a5de3607103d32bd7314db2237201ee8d4"} May 21 13:03:10.201745 ip-10-0-133-64 kubenswrapper[2562]: I0521 13:03:10.201714 2562 generic.go:358] "Generic (PLEG): container finished" podID="0ab0e3ad-cd32-4b7d-aea2-93bfd52b94ca" containerID="161ab0bcce01e7e6be051e9609ef73c0849b2aef94bc878f3b2a98147f4ae648" exitCode=0 May 21 13:03:10.201745 ip-10-0-133-64 kubenswrapper[2562]: I0521 13:03:10.201749 2562 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-p8bmj" event={"ID":"0ab0e3ad-cd32-4b7d-aea2-93bfd52b94ca","Type":"ContainerDied","Data":"161ab0bcce01e7e6be051e9609ef73c0849b2aef94bc878f3b2a98147f4ae648"} May 21 13:03:10.956956 ip-10-0-133-64 kubenswrapper[2562]: I0521 13:03:10.956720 2562 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-service-ca/service-ca-67d667c7d-tbt2s"] May 21 13:03:10.993354 ip-10-0-133-64 kubenswrapper[2562]: I0521 13:03:10.993325 2562 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-service-ca/service-ca-67d667c7d-tbt2s"] May 21 13:03:10.993526 ip-10-0-133-64 kubenswrapper[2562]: I0521 13:03:10.993456 2562 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-service-ca/service-ca-67d667c7d-tbt2s" May 21 13:03:10.996813 ip-10-0-133-64 kubenswrapper[2562]: I0521 13:03:10.996781 2562 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-service-ca\"/\"kube-root-ca.crt\"" May 21 13:03:10.996936 ip-10-0-133-64 kubenswrapper[2562]: I0521 13:03:10.996785 2562 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-service-ca\"/\"openshift-service-ca.crt\"" May 21 13:03:10.997307 ip-10-0-133-64 kubenswrapper[2562]: I0521 13:03:10.997286 2562 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-service-ca\"/\"signing-cabundle\"" May 21 13:03:10.997414 ip-10-0-133-64 kubenswrapper[2562]: I0521 13:03:10.997317 2562 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-service-ca\"/\"signing-key\"" May 21 13:03:10.997414 ip-10-0-133-64 kubenswrapper[2562]: I0521 13:03:10.997375 2562 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-service-ca\"/\"service-ca-dockercfg-t46xv\"" May 21 13:03:11.101397 ip-10-0-133-64 kubenswrapper[2562]: I0521 13:03:11.101372 2562 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/ceb9bb27-e558-4ca2-9baf-cc21c0216ef6-cert\") pod \"ingress-canary-6d7rg\" (UID: \"ceb9bb27-e558-4ca2-9baf-cc21c0216ef6\") " pod="openshift-ingress-canary/ingress-canary-6d7rg" May 21 13:03:11.101541 ip-10-0-133-64 kubenswrapper[2562]: I0521 13:03:11.101410 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-njcrz\" (UniqueName: \"kubernetes.io/projected/8f49d48a-cd8b-4c86-bc33-98e0f98f016d-kube-api-access-njcrz\") pod \"service-ca-67d667c7d-tbt2s\" (UID: \"8f49d48a-cd8b-4c86-bc33-98e0f98f016d\") " pod="openshift-service-ca/service-ca-67d667c7d-tbt2s" May 21 13:03:11.101541 ip-10-0-133-64 kubenswrapper[2562]: I0521 13:03:11.101438 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"signing-cabundle\" (UniqueName: \"kubernetes.io/configmap/8f49d48a-cd8b-4c86-bc33-98e0f98f016d-signing-cabundle\") pod \"service-ca-67d667c7d-tbt2s\" (UID: \"8f49d48a-cd8b-4c86-bc33-98e0f98f016d\") " pod="openshift-service-ca/service-ca-67d667c7d-tbt2s" May 21 13:03:11.101541 ip-10-0-133-64 kubenswrapper[2562]: I0521 13:03:11.101455 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"signing-key\" (UniqueName: \"kubernetes.io/secret/8f49d48a-cd8b-4c86-bc33-98e0f98f016d-signing-key\") pod \"service-ca-67d667c7d-tbt2s\" (UID: \"8f49d48a-cd8b-4c86-bc33-98e0f98f016d\") " pod="openshift-service-ca/service-ca-67d667c7d-tbt2s" May 21 13:03:11.101541 ip-10-0-133-64 kubenswrapper[2562]: E0521 13:03:11.101522 2562 secret.go:189] Couldn't get secret openshift-ingress-canary/canary-serving-cert: secret "canary-serving-cert" not found May 21 13:03:11.101683 ip-10-0-133-64 kubenswrapper[2562]: E0521 13:03:11.101589 2562 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/ceb9bb27-e558-4ca2-9baf-cc21c0216ef6-cert podName:ceb9bb27-e558-4ca2-9baf-cc21c0216ef6 nodeName:}" failed. No retries permitted until 2026-05-21 13:03:15.101573508 +0000 UTC m=+41.651854854 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "cert" (UniqueName: "kubernetes.io/secret/ceb9bb27-e558-4ca2-9baf-cc21c0216ef6-cert") pod "ingress-canary-6d7rg" (UID: "ceb9bb27-e558-4ca2-9baf-cc21c0216ef6") : secret "canary-serving-cert" not found May 21 13:03:11.101683 ip-10-0-133-64 kubenswrapper[2562]: I0521 13:03:11.101653 2562 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/10a964ec-b101-49a4-8dc7-0f208c0fe49d-registry-tls\") pod \"image-registry-c7d665b66-khpd9\" (UID: \"10a964ec-b101-49a4-8dc7-0f208c0fe49d\") " pod="openshift-image-registry/image-registry-c7d665b66-khpd9" May 21 13:03:11.101758 ip-10-0-133-64 kubenswrapper[2562]: I0521 13:03:11.101685 2562 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/f0b8359d-d8af-4b73-8592-27cac5c13257-metrics-tls\") pod \"dns-default-jmwf6\" (UID: \"f0b8359d-d8af-4b73-8592-27cac5c13257\") " pod="openshift-dns/dns-default-jmwf6" May 21 13:03:11.101758 ip-10-0-133-64 kubenswrapper[2562]: E0521 13:03:11.101741 2562 projected.go:264] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found May 21 13:03:11.101758 ip-10-0-133-64 kubenswrapper[2562]: E0521 13:03:11.101754 2562 projected.go:194] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-c7d665b66-khpd9: secret "image-registry-tls" not found May 21 13:03:11.101894 ip-10-0-133-64 kubenswrapper[2562]: E0521 13:03:11.101809 2562 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/10a964ec-b101-49a4-8dc7-0f208c0fe49d-registry-tls podName:10a964ec-b101-49a4-8dc7-0f208c0fe49d nodeName:}" failed. No retries permitted until 2026-05-21 13:03:15.101783813 +0000 UTC m=+41.652065159 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/10a964ec-b101-49a4-8dc7-0f208c0fe49d-registry-tls") pod "image-registry-c7d665b66-khpd9" (UID: "10a964ec-b101-49a4-8dc7-0f208c0fe49d") : secret "image-registry-tls" not found May 21 13:03:11.101894 ip-10-0-133-64 kubenswrapper[2562]: E0521 13:03:11.101842 2562 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found May 21 13:03:11.101972 ip-10-0-133-64 kubenswrapper[2562]: E0521 13:03:11.101894 2562 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/f0b8359d-d8af-4b73-8592-27cac5c13257-metrics-tls podName:f0b8359d-d8af-4b73-8592-27cac5c13257 nodeName:}" failed. No retries permitted until 2026-05-21 13:03:15.101877945 +0000 UTC m=+41.652159301 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/f0b8359d-d8af-4b73-8592-27cac5c13257-metrics-tls") pod "dns-default-jmwf6" (UID: "f0b8359d-d8af-4b73-8592-27cac5c13257") : secret "dns-default-metrics-tls" not found May 21 13:03:11.202232 ip-10-0-133-64 kubenswrapper[2562]: I0521 13:03:11.202202 2562 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-njcrz\" (UniqueName: \"kubernetes.io/projected/8f49d48a-cd8b-4c86-bc33-98e0f98f016d-kube-api-access-njcrz\") pod \"service-ca-67d667c7d-tbt2s\" (UID: \"8f49d48a-cd8b-4c86-bc33-98e0f98f016d\") " pod="openshift-service-ca/service-ca-67d667c7d-tbt2s" May 21 13:03:11.202611 ip-10-0-133-64 kubenswrapper[2562]: I0521 13:03:11.202238 2562 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"signing-cabundle\" (UniqueName: \"kubernetes.io/configmap/8f49d48a-cd8b-4c86-bc33-98e0f98f016d-signing-cabundle\") pod \"service-ca-67d667c7d-tbt2s\" (UID: \"8f49d48a-cd8b-4c86-bc33-98e0f98f016d\") " pod="openshift-service-ca/service-ca-67d667c7d-tbt2s" May 21 13:03:11.202611 ip-10-0-133-64 kubenswrapper[2562]: I0521 13:03:11.202256 2562 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"signing-key\" (UniqueName: \"kubernetes.io/secret/8f49d48a-cd8b-4c86-bc33-98e0f98f016d-signing-key\") pod \"service-ca-67d667c7d-tbt2s\" (UID: \"8f49d48a-cd8b-4c86-bc33-98e0f98f016d\") " pod="openshift-service-ca/service-ca-67d667c7d-tbt2s" May 21 13:03:11.203026 ip-10-0-133-64 kubenswrapper[2562]: I0521 13:03:11.203003 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"signing-cabundle\" (UniqueName: \"kubernetes.io/configmap/8f49d48a-cd8b-4c86-bc33-98e0f98f016d-signing-cabundle\") pod \"service-ca-67d667c7d-tbt2s\" (UID: \"8f49d48a-cd8b-4c86-bc33-98e0f98f016d\") " pod="openshift-service-ca/service-ca-67d667c7d-tbt2s" May 21 13:03:11.205674 ip-10-0-133-64 kubenswrapper[2562]: I0521 13:03:11.205652 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"signing-key\" (UniqueName: \"kubernetes.io/secret/8f49d48a-cd8b-4c86-bc33-98e0f98f016d-signing-key\") pod \"service-ca-67d667c7d-tbt2s\" (UID: \"8f49d48a-cd8b-4c86-bc33-98e0f98f016d\") " pod="openshift-service-ca/service-ca-67d667c7d-tbt2s" May 21 13:03:11.206714 ip-10-0-133-64 kubenswrapper[2562]: I0521 13:03:11.206692 2562 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-p8bmj" event={"ID":"0ab0e3ad-cd32-4b7d-aea2-93bfd52b94ca","Type":"ContainerStarted","Data":"08ddc54ac38134378e5060bd94288bb6afdc3ee21ad651e6a46c07ec74b736cb"} May 21 13:03:11.216354 ip-10-0-133-64 kubenswrapper[2562]: I0521 13:03:11.216304 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-njcrz\" (UniqueName: \"kubernetes.io/projected/8f49d48a-cd8b-4c86-bc33-98e0f98f016d-kube-api-access-njcrz\") pod \"service-ca-67d667c7d-tbt2s\" (UID: \"8f49d48a-cd8b-4c86-bc33-98e0f98f016d\") " pod="openshift-service-ca/service-ca-67d667c7d-tbt2s" May 21 13:03:11.261700 ip-10-0-133-64 kubenswrapper[2562]: I0521 13:03:11.261644 2562 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-multus/multus-additional-cni-plugins-p8bmj" podStartSLOduration=5.370894923 podStartE2EDuration="37.261627425s" podCreationTimestamp="2026-05-21 13:02:34 +0000 UTC" firstStartedPulling="2026-05-21 13:02:36.609294934 +0000 UTC m=+3.159576291" lastFinishedPulling="2026-05-21 13:03:08.500027433 +0000 UTC m=+35.050308793" observedRunningTime="2026-05-21 13:03:11.260388434 +0000 UTC m=+37.810669804" watchObservedRunningTime="2026-05-21 13:03:11.261627425 +0000 UTC m=+37.811908794" May 21 13:03:11.302447 ip-10-0-133-64 kubenswrapper[2562]: I0521 13:03:11.302418 2562 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-service-ca/service-ca-67d667c7d-tbt2s" May 21 13:03:11.453730 ip-10-0-133-64 kubenswrapper[2562]: I0521 13:03:11.453689 2562 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-service-ca/service-ca-67d667c7d-tbt2s"] May 21 13:03:11.457779 ip-10-0-133-64 kubenswrapper[2562]: W0521 13:03:11.457751 2562 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod8f49d48a_cd8b_4c86_bc33_98e0f98f016d.slice/crio-2aa4f01e24e588947384ca01ccf0c6bafeea4331f6e75ad68741f58866d41e14 WatchSource:0}: Error finding container 2aa4f01e24e588947384ca01ccf0c6bafeea4331f6e75ad68741f58866d41e14: Status 404 returned error can't find the container with id 2aa4f01e24e588947384ca01ccf0c6bafeea4331f6e75ad68741f58866d41e14 May 21 13:03:12.210261 ip-10-0-133-64 kubenswrapper[2562]: I0521 13:03:12.210225 2562 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-service-ca/service-ca-67d667c7d-tbt2s" event={"ID":"8f49d48a-cd8b-4c86-bc33-98e0f98f016d","Type":"ContainerStarted","Data":"2aa4f01e24e588947384ca01ccf0c6bafeea4331f6e75ad68741f58866d41e14"} May 21 13:03:13.116075 ip-10-0-133-64 kubenswrapper[2562]: I0521 13:03:13.115854 2562 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/6a5bcf2e-872d-429c-83dc-c5facd09899f-original-pull-secret\") pod \"global-pull-secret-syncer-qw7g7\" (UID: \"6a5bcf2e-872d-429c-83dc-c5facd09899f\") " pod="kube-system/global-pull-secret-syncer-qw7g7" May 21 13:03:13.118976 ip-10-0-133-64 kubenswrapper[2562]: I0521 13:03:13.118955 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/6a5bcf2e-872d-429c-83dc-c5facd09899f-original-pull-secret\") pod \"global-pull-secret-syncer-qw7g7\" (UID: \"6a5bcf2e-872d-429c-83dc-c5facd09899f\") " pod="kube-system/global-pull-secret-syncer-qw7g7" May 21 13:03:13.251986 ip-10-0-133-64 kubenswrapper[2562]: I0521 13:03:13.251954 2562 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-qw7g7" May 21 13:03:13.626733 ip-10-0-133-64 kubenswrapper[2562]: I0521 13:03:13.626703 2562 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kube-system/global-pull-secret-syncer-qw7g7"] May 21 13:03:13.630001 ip-10-0-133-64 kubenswrapper[2562]: W0521 13:03:13.629971 2562 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod6a5bcf2e_872d_429c_83dc_c5facd09899f.slice/crio-e4bb2bdd2bb5310789b3356e7ace55e3e9d4477c21b9225b32d4dd71be8f7ef2 WatchSource:0}: Error finding container e4bb2bdd2bb5310789b3356e7ace55e3e9d4477c21b9225b32d4dd71be8f7ef2: Status 404 returned error can't find the container with id e4bb2bdd2bb5310789b3356e7ace55e3e9d4477c21b9225b32d4dd71be8f7ef2 May 21 13:03:14.215993 ip-10-0-133-64 kubenswrapper[2562]: I0521 13:03:14.215955 2562 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-service-ca/service-ca-67d667c7d-tbt2s" event={"ID":"8f49d48a-cd8b-4c86-bc33-98e0f98f016d","Type":"ContainerStarted","Data":"0941a0cfed14fa7c1e37683c36a073c493ad72e563f1a17e87f8ea29014def6b"} May 21 13:03:14.217361 ip-10-0-133-64 kubenswrapper[2562]: I0521 13:03:14.217331 2562 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kube-system/global-pull-secret-syncer-qw7g7" event={"ID":"6a5bcf2e-872d-429c-83dc-c5facd09899f","Type":"ContainerStarted","Data":"e4bb2bdd2bb5310789b3356e7ace55e3e9d4477c21b9225b32d4dd71be8f7ef2"} May 21 13:03:14.232112 ip-10-0-133-64 kubenswrapper[2562]: I0521 13:03:14.232062 2562 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-service-ca/service-ca-67d667c7d-tbt2s" podStartSLOduration=1.817973538 podStartE2EDuration="4.232049708s" podCreationTimestamp="2026-05-21 13:03:10 +0000 UTC" firstStartedPulling="2026-05-21 13:03:11.459411446 +0000 UTC m=+38.009692792" lastFinishedPulling="2026-05-21 13:03:13.873487603 +0000 UTC m=+40.423768962" observedRunningTime="2026-05-21 13:03:14.231646646 +0000 UTC m=+40.781928013" watchObservedRunningTime="2026-05-21 13:03:14.232049708 +0000 UTC m=+40.782331075" May 21 13:03:15.133564 ip-10-0-133-64 kubenswrapper[2562]: I0521 13:03:15.133513 2562 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/ceb9bb27-e558-4ca2-9baf-cc21c0216ef6-cert\") pod \"ingress-canary-6d7rg\" (UID: \"ceb9bb27-e558-4ca2-9baf-cc21c0216ef6\") " pod="openshift-ingress-canary/ingress-canary-6d7rg" May 21 13:03:15.134042 ip-10-0-133-64 kubenswrapper[2562]: I0521 13:03:15.133597 2562 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/10a964ec-b101-49a4-8dc7-0f208c0fe49d-registry-tls\") pod \"image-registry-c7d665b66-khpd9\" (UID: \"10a964ec-b101-49a4-8dc7-0f208c0fe49d\") " pod="openshift-image-registry/image-registry-c7d665b66-khpd9" May 21 13:03:15.134042 ip-10-0-133-64 kubenswrapper[2562]: I0521 13:03:15.133630 2562 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/f0b8359d-d8af-4b73-8592-27cac5c13257-metrics-tls\") pod \"dns-default-jmwf6\" (UID: \"f0b8359d-d8af-4b73-8592-27cac5c13257\") " pod="openshift-dns/dns-default-jmwf6" May 21 13:03:15.134042 ip-10-0-133-64 kubenswrapper[2562]: E0521 13:03:15.133785 2562 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found May 21 13:03:15.134042 ip-10-0-133-64 kubenswrapper[2562]: E0521 13:03:15.133861 2562 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/f0b8359d-d8af-4b73-8592-27cac5c13257-metrics-tls podName:f0b8359d-d8af-4b73-8592-27cac5c13257 nodeName:}" failed. No retries permitted until 2026-05-21 13:03:23.13384252 +0000 UTC m=+49.684123873 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/f0b8359d-d8af-4b73-8592-27cac5c13257-metrics-tls") pod "dns-default-jmwf6" (UID: "f0b8359d-d8af-4b73-8592-27cac5c13257") : secret "dns-default-metrics-tls" not found May 21 13:03:15.134501 ip-10-0-133-64 kubenswrapper[2562]: E0521 13:03:15.134271 2562 secret.go:189] Couldn't get secret openshift-ingress-canary/canary-serving-cert: secret "canary-serving-cert" not found May 21 13:03:15.134501 ip-10-0-133-64 kubenswrapper[2562]: E0521 13:03:15.134317 2562 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/ceb9bb27-e558-4ca2-9baf-cc21c0216ef6-cert podName:ceb9bb27-e558-4ca2-9baf-cc21c0216ef6 nodeName:}" failed. No retries permitted until 2026-05-21 13:03:23.134301424 +0000 UTC m=+49.684582776 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "cert" (UniqueName: "kubernetes.io/secret/ceb9bb27-e558-4ca2-9baf-cc21c0216ef6-cert") pod "ingress-canary-6d7rg" (UID: "ceb9bb27-e558-4ca2-9baf-cc21c0216ef6") : secret "canary-serving-cert" not found May 21 13:03:15.134501 ip-10-0-133-64 kubenswrapper[2562]: E0521 13:03:15.134393 2562 projected.go:264] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found May 21 13:03:15.134501 ip-10-0-133-64 kubenswrapper[2562]: E0521 13:03:15.134417 2562 projected.go:194] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-c7d665b66-khpd9: secret "image-registry-tls" not found May 21 13:03:15.134501 ip-10-0-133-64 kubenswrapper[2562]: E0521 13:03:15.134472 2562 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/10a964ec-b101-49a4-8dc7-0f208c0fe49d-registry-tls podName:10a964ec-b101-49a4-8dc7-0f208c0fe49d nodeName:}" failed. No retries permitted until 2026-05-21 13:03:23.134453786 +0000 UTC m=+49.684735146 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/10a964ec-b101-49a4-8dc7-0f208c0fe49d-registry-tls") pod "image-registry-c7d665b66-khpd9" (UID: "10a964ec-b101-49a4-8dc7-0f208c0fe49d") : secret "image-registry-tls" not found May 21 13:03:19.228296 ip-10-0-133-64 kubenswrapper[2562]: I0521 13:03:19.228255 2562 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kube-system/global-pull-secret-syncer-qw7g7" event={"ID":"6a5bcf2e-872d-429c-83dc-c5facd09899f","Type":"ContainerStarted","Data":"dfd85af7449320dc12c2391a0883870f8c5406d0dd10dd30742aec88a3270295"} May 21 13:03:19.250751 ip-10-0-133-64 kubenswrapper[2562]: I0521 13:03:19.250696 2562 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="kube-system/global-pull-secret-syncer-qw7g7" podStartSLOduration=17.730685583 podStartE2EDuration="22.25068002s" podCreationTimestamp="2026-05-21 13:02:57 +0000 UTC" firstStartedPulling="2026-05-21 13:03:13.631660135 +0000 UTC m=+40.181941480" lastFinishedPulling="2026-05-21 13:03:18.151654359 +0000 UTC m=+44.701935917" observedRunningTime="2026-05-21 13:03:19.250167361 +0000 UTC m=+45.800448729" watchObservedRunningTime="2026-05-21 13:03:19.25068002 +0000 UTC m=+45.800961389" May 21 13:03:23.193605 ip-10-0-133-64 kubenswrapper[2562]: I0521 13:03:23.193558 2562 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/10a964ec-b101-49a4-8dc7-0f208c0fe49d-registry-tls\") pod \"image-registry-c7d665b66-khpd9\" (UID: \"10a964ec-b101-49a4-8dc7-0f208c0fe49d\") " pod="openshift-image-registry/image-registry-c7d665b66-khpd9" May 21 13:03:23.194028 ip-10-0-133-64 kubenswrapper[2562]: I0521 13:03:23.193621 2562 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/f0b8359d-d8af-4b73-8592-27cac5c13257-metrics-tls\") pod \"dns-default-jmwf6\" (UID: \"f0b8359d-d8af-4b73-8592-27cac5c13257\") " pod="openshift-dns/dns-default-jmwf6" May 21 13:03:23.194028 ip-10-0-133-64 kubenswrapper[2562]: I0521 13:03:23.193690 2562 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/ceb9bb27-e558-4ca2-9baf-cc21c0216ef6-cert\") pod \"ingress-canary-6d7rg\" (UID: \"ceb9bb27-e558-4ca2-9baf-cc21c0216ef6\") " pod="openshift-ingress-canary/ingress-canary-6d7rg" May 21 13:03:23.196221 ip-10-0-133-64 kubenswrapper[2562]: I0521 13:03:23.196189 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/f0b8359d-d8af-4b73-8592-27cac5c13257-metrics-tls\") pod \"dns-default-jmwf6\" (UID: \"f0b8359d-d8af-4b73-8592-27cac5c13257\") " pod="openshift-dns/dns-default-jmwf6" May 21 13:03:23.196354 ip-10-0-133-64 kubenswrapper[2562]: I0521 13:03:23.196289 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/ceb9bb27-e558-4ca2-9baf-cc21c0216ef6-cert\") pod \"ingress-canary-6d7rg\" (UID: \"ceb9bb27-e558-4ca2-9baf-cc21c0216ef6\") " pod="openshift-ingress-canary/ingress-canary-6d7rg" May 21 13:03:23.197470 ip-10-0-133-64 kubenswrapper[2562]: I0521 13:03:23.197446 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/10a964ec-b101-49a4-8dc7-0f208c0fe49d-registry-tls\") pod \"image-registry-c7d665b66-khpd9\" (UID: \"10a964ec-b101-49a4-8dc7-0f208c0fe49d\") " pod="openshift-image-registry/image-registry-c7d665b66-khpd9" May 21 13:03:23.288477 ip-10-0-133-64 kubenswrapper[2562]: I0521 13:03:23.288444 2562 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-c7d665b66-khpd9" May 21 13:03:23.309471 ip-10-0-133-64 kubenswrapper[2562]: I0521 13:03:23.309441 2562 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress-canary/ingress-canary-6d7rg" May 21 13:03:23.317575 ip-10-0-133-64 kubenswrapper[2562]: I0521 13:03:23.317224 2562 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-jmwf6" May 21 13:03:23.472392 ip-10-0-133-64 kubenswrapper[2562]: I0521 13:03:23.472361 2562 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-image-registry/image-registry-c7d665b66-khpd9"] May 21 13:03:23.477179 ip-10-0-133-64 kubenswrapper[2562]: W0521 13:03:23.477150 2562 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod10a964ec_b101_49a4_8dc7_0f208c0fe49d.slice/crio-995e75488b9df0ce489605ec406dc1209d9ae2a2483adadba51f817932f7c640 WatchSource:0}: Error finding container 995e75488b9df0ce489605ec406dc1209d9ae2a2483adadba51f817932f7c640: Status 404 returned error can't find the container with id 995e75488b9df0ce489605ec406dc1209d9ae2a2483adadba51f817932f7c640 May 21 13:03:23.485133 ip-10-0-133-64 kubenswrapper[2562]: I0521 13:03:23.485103 2562 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-ingress-canary/ingress-canary-6d7rg"] May 21 13:03:23.489039 ip-10-0-133-64 kubenswrapper[2562]: W0521 13:03:23.489015 2562 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podceb9bb27_e558_4ca2_9baf_cc21c0216ef6.slice/crio-2a97d32f72086b7b897e984a6d219a8b6cd85910810f2fa180c75a62877cb301 WatchSource:0}: Error finding container 2a97d32f72086b7b897e984a6d219a8b6cd85910810f2fa180c75a62877cb301: Status 404 returned error can't find the container with id 2a97d32f72086b7b897e984a6d219a8b6cd85910810f2fa180c75a62877cb301 May 21 13:03:23.500636 ip-10-0-133-64 kubenswrapper[2562]: I0521 13:03:23.500613 2562 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-dns/dns-default-jmwf6"] May 21 13:03:23.503160 ip-10-0-133-64 kubenswrapper[2562]: W0521 13:03:23.503134 2562 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podf0b8359d_d8af_4b73_8592_27cac5c13257.slice/crio-7a68d26901e00ac1828da7e6d69fcd348067ea481e22ba04ceedac8c7d4487e3 WatchSource:0}: Error finding container 7a68d26901e00ac1828da7e6d69fcd348067ea481e22ba04ceedac8c7d4487e3: Status 404 returned error can't find the container with id 7a68d26901e00ac1828da7e6d69fcd348067ea481e22ba04ceedac8c7d4487e3 May 21 13:03:24.240528 ip-10-0-133-64 kubenswrapper[2562]: I0521 13:03:24.240176 2562 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-c7d665b66-khpd9" event={"ID":"10a964ec-b101-49a4-8dc7-0f208c0fe49d","Type":"ContainerStarted","Data":"855a9a7cbf11f7bac8f9acc5ea97d84112dfecdcedb1a04c2b6c28ebc87c7600"} May 21 13:03:24.240528 ip-10-0-133-64 kubenswrapper[2562]: I0521 13:03:24.240220 2562 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-c7d665b66-khpd9" event={"ID":"10a964ec-b101-49a4-8dc7-0f208c0fe49d","Type":"ContainerStarted","Data":"995e75488b9df0ce489605ec406dc1209d9ae2a2483adadba51f817932f7c640"} May 21 13:03:24.240528 ip-10-0-133-64 kubenswrapper[2562]: I0521 13:03:24.240419 2562 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-image-registry/image-registry-c7d665b66-khpd9" May 21 13:03:24.241814 ip-10-0-133-64 kubenswrapper[2562]: I0521 13:03:24.241773 2562 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-jmwf6" event={"ID":"f0b8359d-d8af-4b73-8592-27cac5c13257","Type":"ContainerStarted","Data":"7a68d26901e00ac1828da7e6d69fcd348067ea481e22ba04ceedac8c7d4487e3"} May 21 13:03:24.243369 ip-10-0-133-64 kubenswrapper[2562]: I0521 13:03:24.243341 2562 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-ingress-canary/ingress-canary-6d7rg" event={"ID":"ceb9bb27-e558-4ca2-9baf-cc21c0216ef6","Type":"ContainerStarted","Data":"2a97d32f72086b7b897e984a6d219a8b6cd85910810f2fa180c75a62877cb301"} May 21 13:03:24.259426 ip-10-0-133-64 kubenswrapper[2562]: I0521 13:03:24.259376 2562 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-image-registry/image-registry-c7d665b66-khpd9" podStartSLOduration=60.259359248 podStartE2EDuration="1m0.259359248s" podCreationTimestamp="2026-05-21 13:02:24 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2026-05-21 13:03:24.258933974 +0000 UTC m=+50.809215335" watchObservedRunningTime="2026-05-21 13:03:24.259359248 +0000 UTC m=+50.809640618" May 21 13:03:26.250294 ip-10-0-133-64 kubenswrapper[2562]: I0521 13:03:26.250248 2562 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-jmwf6" event={"ID":"f0b8359d-d8af-4b73-8592-27cac5c13257","Type":"ContainerStarted","Data":"f4396e586160daadf4b669b4f6c9c171b2bac20328982e5760e53d2fea9fac5e"} May 21 13:03:26.250294 ip-10-0-133-64 kubenswrapper[2562]: I0521 13:03:26.250298 2562 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-jmwf6" event={"ID":"f0b8359d-d8af-4b73-8592-27cac5c13257","Type":"ContainerStarted","Data":"0a733e584315e15ca4a7212196d8bc70720606e8f4bb89b48f481724efed9fec"} May 21 13:03:26.250850 ip-10-0-133-64 kubenswrapper[2562]: I0521 13:03:26.250398 2562 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-dns/dns-default-jmwf6" May 21 13:03:26.251569 ip-10-0-133-64 kubenswrapper[2562]: I0521 13:03:26.251548 2562 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-ingress-canary/ingress-canary-6d7rg" event={"ID":"ceb9bb27-e558-4ca2-9baf-cc21c0216ef6","Type":"ContainerStarted","Data":"edb3d516019b0076cbbbe2edef5264c4ae55835931b2dad9be321bd80013247f"} May 21 13:03:26.266708 ip-10-0-133-64 kubenswrapper[2562]: I0521 13:03:26.266657 2562 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-dns/dns-default-jmwf6" podStartSLOduration=17.23726838 podStartE2EDuration="19.266644836s" podCreationTimestamp="2026-05-21 13:03:07 +0000 UTC" firstStartedPulling="2026-05-21 13:03:23.505329104 +0000 UTC m=+50.055610464" lastFinishedPulling="2026-05-21 13:03:25.534705574 +0000 UTC m=+52.084986920" observedRunningTime="2026-05-21 13:03:26.26638435 +0000 UTC m=+52.816665718" watchObservedRunningTime="2026-05-21 13:03:26.266644836 +0000 UTC m=+52.816926203" May 21 13:03:26.281422 ip-10-0-133-64 kubenswrapper[2562]: I0521 13:03:26.281381 2562 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-ingress-canary/ingress-canary-6d7rg" podStartSLOduration=17.235710313 podStartE2EDuration="19.28137s" podCreationTimestamp="2026-05-21 13:03:07 +0000 UTC" firstStartedPulling="2026-05-21 13:03:23.49137187 +0000 UTC m=+50.041653215" lastFinishedPulling="2026-05-21 13:03:25.537031553 +0000 UTC m=+52.087312902" observedRunningTime="2026-05-21 13:03:26.280884955 +0000 UTC m=+52.831166323" watchObservedRunningTime="2026-05-21 13:03:26.28137 +0000 UTC m=+52.831651368" May 21 13:03:30.210261 ip-10-0-133-64 kubenswrapper[2562]: I0521 13:03:30.210225 2562 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-cluster-samples-operator/cluster-samples-operator-697587599-ngd5n"] May 21 13:03:30.213100 ip-10-0-133-64 kubenswrapper[2562]: I0521 13:03:30.213076 2562 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-console-operator/console-operator-76dff48d59-pt4fg"] May 21 13:03:30.213254 ip-10-0-133-64 kubenswrapper[2562]: I0521 13:03:30.213234 2562 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-samples-operator/cluster-samples-operator-697587599-ngd5n" May 21 13:03:30.215061 ip-10-0-133-64 kubenswrapper[2562]: I0521 13:03:30.215044 2562 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console-operator/console-operator-76dff48d59-pt4fg" May 21 13:03:30.215736 ip-10-0-133-64 kubenswrapper[2562]: I0521 13:03:30.215705 2562 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-samples-operator\"/\"samples-operator-tls\"" May 21 13:03:30.215961 ip-10-0-133-64 kubenswrapper[2562]: I0521 13:03:30.215946 2562 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-samples-operator\"/\"kube-root-ca.crt\"" May 21 13:03:30.216048 ip-10-0-133-64 kubenswrapper[2562]: I0521 13:03:30.215980 2562 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-samples-operator\"/\"openshift-service-ca.crt\"" May 21 13:03:30.216338 ip-10-0-133-64 kubenswrapper[2562]: I0521 13:03:30.216319 2562 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-samples-operator\"/\"cluster-samples-operator-dockercfg-cgfqg\"" May 21 13:03:30.217692 ip-10-0-133-64 kubenswrapper[2562]: I0521 13:03:30.217671 2562 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console-operator\"/\"openshift-service-ca.crt\"" May 21 13:03:30.218327 ip-10-0-133-64 kubenswrapper[2562]: I0521 13:03:30.218308 2562 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-cluster-storage-operator/volume-data-source-validator-5cf8c89d64-m8jhs"] May 21 13:03:30.219074 ip-10-0-133-64 kubenswrapper[2562]: I0521 13:03:30.219055 2562 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console-operator\"/\"console-operator-dockercfg-pbjkw\"" May 21 13:03:30.219186 ip-10-0-133-64 kubenswrapper[2562]: I0521 13:03:30.219084 2562 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console-operator\"/\"serving-cert\"" May 21 13:03:30.219496 ip-10-0-133-64 kubenswrapper[2562]: I0521 13:03:30.219457 2562 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console-operator\"/\"kube-root-ca.crt\"" May 21 13:03:30.220148 ip-10-0-133-64 kubenswrapper[2562]: I0521 13:03:30.220132 2562 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-storage-operator/volume-data-source-validator-5cf8c89d64-m8jhs" May 21 13:03:30.221110 ip-10-0-133-64 kubenswrapper[2562]: I0521 13:03:30.221088 2562 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console-operator\"/\"console-operator-config\"" May 21 13:03:30.221586 ip-10-0-133-64 kubenswrapper[2562]: I0521 13:03:30.221564 2562 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-insights/insights-operator-78bdfb888c-cj42h"] May 21 13:03:30.228090 ip-10-0-133-64 kubenswrapper[2562]: I0521 13:03:30.228072 2562 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-operator-78bdfb888c-cj42h" May 21 13:03:30.228167 ip-10-0-133-64 kubenswrapper[2562]: I0521 13:03:30.228123 2562 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console-operator\"/\"trusted-ca\"" May 21 13:03:30.232760 ip-10-0-133-64 kubenswrapper[2562]: I0521 13:03:30.232742 2562 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-storage-operator\"/\"openshift-service-ca.crt\"" May 21 13:03:30.233060 ip-10-0-133-64 kubenswrapper[2562]: I0521 13:03:30.232788 2562 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-storage-operator\"/\"kube-root-ca.crt\"" May 21 13:03:30.233164 ip-10-0-133-64 kubenswrapper[2562]: I0521 13:03:30.233042 2562 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"kube-root-ca.crt\"" May 21 13:03:30.233164 ip-10-0-133-64 kubenswrapper[2562]: I0521 13:03:30.233075 2562 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"openshift-service-ca.crt\"" May 21 13:03:30.233164 ip-10-0-133-64 kubenswrapper[2562]: I0521 13:03:30.233085 2562 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-storage-operator\"/\"volume-data-source-validator-dockercfg-5pqd9\"" May 21 13:03:30.233719 ip-10-0-133-64 kubenswrapper[2562]: I0521 13:03:30.233438 2562 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"operator-dockercfg-sljrk\"" May 21 13:03:30.233719 ip-10-0-133-64 kubenswrapper[2562]: I0521 13:03:30.233594 2562 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"openshift-insights-serving-cert\"" May 21 13:03:30.234442 ip-10-0-133-64 kubenswrapper[2562]: I0521 13:03:30.233918 2562 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"service-ca-bundle\"" May 21 13:03:30.236524 ip-10-0-133-64 kubenswrapper[2562]: I0521 13:03:30.236494 2562 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-console-operator/console-operator-76dff48d59-pt4fg"] May 21 13:03:30.237561 ip-10-0-133-64 kubenswrapper[2562]: I0521 13:03:30.237525 2562 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-cluster-storage-operator/volume-data-source-validator-5cf8c89d64-m8jhs"] May 21 13:03:30.242971 ip-10-0-133-64 kubenswrapper[2562]: I0521 13:03:30.242954 2562 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"trusted-ca-bundle\"" May 21 13:03:30.249183 ip-10-0-133-64 kubenswrapper[2562]: I0521 13:03:30.249164 2562 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-operator-78bdfb888c-cj42h"] May 21 13:03:30.249874 ip-10-0-133-64 kubenswrapper[2562]: I0521 13:03:30.249854 2562 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-cluster-samples-operator/cluster-samples-operator-697587599-ngd5n"] May 21 13:03:30.263442 ip-10-0-133-64 kubenswrapper[2562]: I0521 13:03:30.263420 2562 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openshift-image-registry/image-registry-c7d665b66-khpd9"] May 21 13:03:30.307924 ip-10-0-133-64 kubenswrapper[2562]: I0521 13:03:30.307897 2562 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-monitoring/cluster-monitoring-operator-6c75959455-mhvc5"] May 21 13:03:30.309792 ip-10-0-133-64 kubenswrapper[2562]: I0521 13:03:30.309777 2562 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-ingress/router-default-66c9cf854b-46gbc"] May 21 13:03:30.309951 ip-10-0-133-64 kubenswrapper[2562]: I0521 13:03:30.309932 2562 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/cluster-monitoring-operator-6c75959455-mhvc5" May 21 13:03:30.311509 ip-10-0-133-64 kubenswrapper[2562]: I0521 13:03:30.311488 2562 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/router-default-66c9cf854b-46gbc" May 21 13:03:30.312793 ip-10-0-133-64 kubenswrapper[2562]: I0521 13:03:30.312772 2562 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"kube-root-ca.crt\"" May 21 13:03:30.313004 ip-10-0-133-64 kubenswrapper[2562]: I0521 13:03:30.312989 2562 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"openshift-service-ca.crt\"" May 21 13:03:30.313085 ip-10-0-133-64 kubenswrapper[2562]: I0521 13:03:30.313067 2562 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"cluster-monitoring-operator-tls\"" May 21 13:03:30.313148 ip-10-0-133-64 kubenswrapper[2562]: I0521 13:03:30.313067 2562 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"cluster-monitoring-operator-dockercfg-jlqnk\"" May 21 13:03:30.314688 ip-10-0-133-64 kubenswrapper[2562]: I0521 13:03:30.314671 2562 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"service-ca-bundle\"" May 21 13:03:30.314932 ip-10-0-133-64 kubenswrapper[2562]: I0521 13:03:30.314912 2562 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"router-stats-default\"" May 21 13:03:30.315023 ip-10-0-133-64 kubenswrapper[2562]: I0521 13:03:30.314937 2562 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"openshift-service-ca.crt\"" May 21 13:03:30.315023 ip-10-0-133-64 kubenswrapper[2562]: I0521 13:03:30.314963 2562 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"router-metrics-certs-default\"" May 21 13:03:30.315023 ip-10-0-133-64 kubenswrapper[2562]: I0521 13:03:30.314943 2562 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"default-ingress-cert\"" May 21 13:03:30.315184 ip-10-0-133-64 kubenswrapper[2562]: I0521 13:03:30.315120 2562 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"router-dockercfg-q4qbb\"" May 21 13:03:30.315310 ip-10-0-133-64 kubenswrapper[2562]: I0521 13:03:30.315295 2562 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"kube-root-ca.crt\"" May 21 13:03:30.315354 ip-10-0-133-64 kubenswrapper[2562]: I0521 13:03:30.315325 2562 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"telemetry-config\"" May 21 13:03:30.335555 ip-10-0-133-64 kubenswrapper[2562]: I0521 13:03:30.335527 2562 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/router-default-66c9cf854b-46gbc"] May 21 13:03:30.345721 ip-10-0-133-64 kubenswrapper[2562]: I0521 13:03:30.345701 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-f9kpx\" (UniqueName: \"kubernetes.io/projected/71e47aab-dc0c-4d26-9429-a9fef31cac1f-kube-api-access-f9kpx\") pod \"cluster-samples-operator-697587599-ngd5n\" (UID: \"71e47aab-dc0c-4d26-9429-a9fef31cac1f\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-697587599-ngd5n" May 21 13:03:30.345845 ip-10-0-133-64 kubenswrapper[2562]: I0521 13:03:30.345742 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/ef0f845b-ec3c-4e76-873d-f2552c56364c-trusted-ca\") pod \"console-operator-76dff48d59-pt4fg\" (UID: \"ef0f845b-ec3c-4e76-873d-f2552c56364c\") " pod="openshift-console-operator/console-operator-76dff48d59-pt4fg" May 21 13:03:30.345845 ip-10-0-133-64 kubenswrapper[2562]: I0521 13:03:30.345776 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/ef0f845b-ec3c-4e76-873d-f2552c56364c-serving-cert\") pod \"console-operator-76dff48d59-pt4fg\" (UID: \"ef0f845b-ec3c-4e76-873d-f2552c56364c\") " pod="openshift-console-operator/console-operator-76dff48d59-pt4fg" May 21 13:03:30.345937 ip-10-0-133-64 kubenswrapper[2562]: I0521 13:03:30.345887 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-zzcd4\" (UniqueName: \"kubernetes.io/projected/4ca422c1-c6f3-49c0-a3cb-64f1b1793866-kube-api-access-zzcd4\") pod \"volume-data-source-validator-5cf8c89d64-m8jhs\" (UID: \"4ca422c1-c6f3-49c0-a3cb-64f1b1793866\") " pod="openshift-cluster-storage-operator/volume-data-source-validator-5cf8c89d64-m8jhs" May 21 13:03:30.345937 ip-10-0-133-64 kubenswrapper[2562]: I0521 13:03:30.345924 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/ef0f845b-ec3c-4e76-873d-f2552c56364c-config\") pod \"console-operator-76dff48d59-pt4fg\" (UID: \"ef0f845b-ec3c-4e76-873d-f2552c56364c\") " pod="openshift-console-operator/console-operator-76dff48d59-pt4fg" May 21 13:03:30.346036 ip-10-0-133-64 kubenswrapper[2562]: I0521 13:03:30.345941 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/d1ebaaa0-5942-4283-8952-713181fda43e-serving-cert\") pod \"insights-operator-78bdfb888c-cj42h\" (UID: \"d1ebaaa0-5942-4283-8952-713181fda43e\") " pod="openshift-insights/insights-operator-78bdfb888c-cj42h" May 21 13:03:30.346036 ip-10-0-133-64 kubenswrapper[2562]: I0521 13:03:30.345969 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-kbb4b\" (UniqueName: \"kubernetes.io/projected/ef0f845b-ec3c-4e76-873d-f2552c56364c-kube-api-access-kbb4b\") pod \"console-operator-76dff48d59-pt4fg\" (UID: \"ef0f845b-ec3c-4e76-873d-f2552c56364c\") " pod="openshift-console-operator/console-operator-76dff48d59-pt4fg" May 21 13:03:30.346036 ip-10-0-133-64 kubenswrapper[2562]: I0521 13:03:30.346005 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"snapshots\" (UniqueName: \"kubernetes.io/empty-dir/d1ebaaa0-5942-4283-8952-713181fda43e-snapshots\") pod \"insights-operator-78bdfb888c-cj42h\" (UID: \"d1ebaaa0-5942-4283-8952-713181fda43e\") " pod="openshift-insights/insights-operator-78bdfb888c-cj42h" May 21 13:03:30.346170 ip-10-0-133-64 kubenswrapper[2562]: I0521 13:03:30.346046 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-k9s5c\" (UniqueName: \"kubernetes.io/projected/d1ebaaa0-5942-4283-8952-713181fda43e-kube-api-access-k9s5c\") pod \"insights-operator-78bdfb888c-cj42h\" (UID: \"d1ebaaa0-5942-4283-8952-713181fda43e\") " pod="openshift-insights/insights-operator-78bdfb888c-cj42h" May 21 13:03:30.346170 ip-10-0-133-64 kubenswrapper[2562]: I0521 13:03:30.346122 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/d1ebaaa0-5942-4283-8952-713181fda43e-trusted-ca-bundle\") pod \"insights-operator-78bdfb888c-cj42h\" (UID: \"d1ebaaa0-5942-4283-8952-713181fda43e\") " pod="openshift-insights/insights-operator-78bdfb888c-cj42h" May 21 13:03:30.346170 ip-10-0-133-64 kubenswrapper[2562]: I0521 13:03:30.346141 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/d1ebaaa0-5942-4283-8952-713181fda43e-service-ca-bundle\") pod \"insights-operator-78bdfb888c-cj42h\" (UID: \"d1ebaaa0-5942-4283-8952-713181fda43e\") " pod="openshift-insights/insights-operator-78bdfb888c-cj42h" May 21 13:03:30.346321 ip-10-0-133-64 kubenswrapper[2562]: I0521 13:03:30.346174 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/71e47aab-dc0c-4d26-9429-a9fef31cac1f-samples-operator-tls\") pod \"cluster-samples-operator-697587599-ngd5n\" (UID: \"71e47aab-dc0c-4d26-9429-a9fef31cac1f\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-697587599-ngd5n" May 21 13:03:30.346321 ip-10-0-133-64 kubenswrapper[2562]: I0521 13:03:30.346208 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/d1ebaaa0-5942-4283-8952-713181fda43e-tmp\") pod \"insights-operator-78bdfb888c-cj42h\" (UID: \"d1ebaaa0-5942-4283-8952-713181fda43e\") " pod="openshift-insights/insights-operator-78bdfb888c-cj42h" May 21 13:03:30.347319 ip-10-0-133-64 kubenswrapper[2562]: I0521 13:03:30.347298 2562 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/cluster-monitoring-operator-6c75959455-mhvc5"] May 21 13:03:30.427675 ip-10-0-133-64 kubenswrapper[2562]: I0521 13:03:30.427643 2562 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-image-registry/image-registry-59f998bd79-jn4d2"] May 21 13:03:30.429660 ip-10-0-133-64 kubenswrapper[2562]: I0521 13:03:30.429646 2562 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-59f998bd79-jn4d2" May 21 13:03:30.447154 ip-10-0-133-64 kubenswrapper[2562]: I0521 13:03:30.447130 2562 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-f9kpx\" (UniqueName: \"kubernetes.io/projected/71e47aab-dc0c-4d26-9429-a9fef31cac1f-kube-api-access-f9kpx\") pod \"cluster-samples-operator-697587599-ngd5n\" (UID: \"71e47aab-dc0c-4d26-9429-a9fef31cac1f\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-697587599-ngd5n" May 21 13:03:30.447268 ip-10-0-133-64 kubenswrapper[2562]: I0521 13:03:30.447170 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/349ca67b-a757-4620-943e-90741bff22ff-installation-pull-secrets\") pod \"image-registry-59f998bd79-jn4d2\" (UID: \"349ca67b-a757-4620-943e-90741bff22ff\") " pod="openshift-image-registry/image-registry-59f998bd79-jn4d2" May 21 13:03:30.447330 ip-10-0-133-64 kubenswrapper[2562]: I0521 13:03:30.447296 2562 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/ef0f845b-ec3c-4e76-873d-f2552c56364c-trusted-ca\") pod \"console-operator-76dff48d59-pt4fg\" (UID: \"ef0f845b-ec3c-4e76-873d-f2552c56364c\") " pod="openshift-console-operator/console-operator-76dff48d59-pt4fg" May 21 13:03:30.447386 ip-10-0-133-64 kubenswrapper[2562]: I0521 13:03:30.447334 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/7ba99752-9a0f-4032-a47f-8e1df0d52758-service-ca-bundle\") pod \"router-default-66c9cf854b-46gbc\" (UID: \"7ba99752-9a0f-4032-a47f-8e1df0d52758\") " pod="openshift-ingress/router-default-66c9cf854b-46gbc" May 21 13:03:30.447386 ip-10-0-133-64 kubenswrapper[2562]: I0521 13:03:30.447371 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/349ca67b-a757-4620-943e-90741bff22ff-trusted-ca\") pod \"image-registry-59f998bd79-jn4d2\" (UID: \"349ca67b-a757-4620-943e-90741bff22ff\") " pod="openshift-image-registry/image-registry-59f998bd79-jn4d2" May 21 13:03:30.447518 ip-10-0-133-64 kubenswrapper[2562]: I0521 13:03:30.447404 2562 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/ef0f845b-ec3c-4e76-873d-f2552c56364c-serving-cert\") pod \"console-operator-76dff48d59-pt4fg\" (UID: \"ef0f845b-ec3c-4e76-873d-f2552c56364c\") " pod="openshift-console-operator/console-operator-76dff48d59-pt4fg" May 21 13:03:30.447518 ip-10-0-133-64 kubenswrapper[2562]: I0521 13:03:30.447457 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/349ca67b-a757-4620-943e-90741bff22ff-image-registry-private-configuration\") pod \"image-registry-59f998bd79-jn4d2\" (UID: \"349ca67b-a757-4620-943e-90741bff22ff\") " pod="openshift-image-registry/image-registry-59f998bd79-jn4d2" May 21 13:03:30.447518 ip-10-0-133-64 kubenswrapper[2562]: I0521 13:03:30.447489 2562 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-zzcd4\" (UniqueName: \"kubernetes.io/projected/4ca422c1-c6f3-49c0-a3cb-64f1b1793866-kube-api-access-zzcd4\") pod \"volume-data-source-validator-5cf8c89d64-m8jhs\" (UID: \"4ca422c1-c6f3-49c0-a3cb-64f1b1793866\") " pod="openshift-cluster-storage-operator/volume-data-source-validator-5cf8c89d64-m8jhs" May 21 13:03:30.447716 ip-10-0-133-64 kubenswrapper[2562]: I0521 13:03:30.447522 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/7ba99752-9a0f-4032-a47f-8e1df0d52758-metrics-certs\") pod \"router-default-66c9cf854b-46gbc\" (UID: \"7ba99752-9a0f-4032-a47f-8e1df0d52758\") " pod="openshift-ingress/router-default-66c9cf854b-46gbc" May 21 13:03:30.447716 ip-10-0-133-64 kubenswrapper[2562]: I0521 13:03:30.447563 2562 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/ef0f845b-ec3c-4e76-873d-f2552c56364c-config\") pod \"console-operator-76dff48d59-pt4fg\" (UID: \"ef0f845b-ec3c-4e76-873d-f2552c56364c\") " pod="openshift-console-operator/console-operator-76dff48d59-pt4fg" May 21 13:03:30.447716 ip-10-0-133-64 kubenswrapper[2562]: I0521 13:03:30.447587 2562 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/d1ebaaa0-5942-4283-8952-713181fda43e-serving-cert\") pod \"insights-operator-78bdfb888c-cj42h\" (UID: \"d1ebaaa0-5942-4283-8952-713181fda43e\") " pod="openshift-insights/insights-operator-78bdfb888c-cj42h" May 21 13:03:30.447716 ip-10-0-133-64 kubenswrapper[2562]: I0521 13:03:30.447740 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/349ca67b-a757-4620-943e-90741bff22ff-registry-tls\") pod \"image-registry-59f998bd79-jn4d2\" (UID: \"349ca67b-a757-4620-943e-90741bff22ff\") " pod="openshift-image-registry/image-registry-59f998bd79-jn4d2" May 21 13:03:30.448050 ip-10-0-133-64 kubenswrapper[2562]: I0521 13:03:30.447775 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/349ca67b-a757-4620-943e-90741bff22ff-bound-sa-token\") pod \"image-registry-59f998bd79-jn4d2\" (UID: \"349ca67b-a757-4620-943e-90741bff22ff\") " pod="openshift-image-registry/image-registry-59f998bd79-jn4d2" May 21 13:03:30.448050 ip-10-0-133-64 kubenswrapper[2562]: I0521 13:03:30.447817 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-q49db\" (UniqueName: \"kubernetes.io/projected/349ca67b-a757-4620-943e-90741bff22ff-kube-api-access-q49db\") pod \"image-registry-59f998bd79-jn4d2\" (UID: \"349ca67b-a757-4620-943e-90741bff22ff\") " pod="openshift-image-registry/image-registry-59f998bd79-jn4d2" May 21 13:03:30.448050 ip-10-0-133-64 kubenswrapper[2562]: I0521 13:03:30.447854 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/4cf9c09a-0d70-4b12-bf3b-da664ea578a3-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-6c75959455-mhvc5\" (UID: \"4cf9c09a-0d70-4b12-bf3b-da664ea578a3\") " pod="openshift-monitoring/cluster-monitoring-operator-6c75959455-mhvc5" May 21 13:03:30.448050 ip-10-0-133-64 kubenswrapper[2562]: I0521 13:03:30.447881 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"stats-auth\" (UniqueName: \"kubernetes.io/secret/7ba99752-9a0f-4032-a47f-8e1df0d52758-stats-auth\") pod \"router-default-66c9cf854b-46gbc\" (UID: \"7ba99752-9a0f-4032-a47f-8e1df0d52758\") " pod="openshift-ingress/router-default-66c9cf854b-46gbc" May 21 13:03:30.448050 ip-10-0-133-64 kubenswrapper[2562]: I0521 13:03:30.447910 2562 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-kbb4b\" (UniqueName: \"kubernetes.io/projected/ef0f845b-ec3c-4e76-873d-f2552c56364c-kube-api-access-kbb4b\") pod \"console-operator-76dff48d59-pt4fg\" (UID: \"ef0f845b-ec3c-4e76-873d-f2552c56364c\") " pod="openshift-console-operator/console-operator-76dff48d59-pt4fg" May 21 13:03:30.448050 ip-10-0-133-64 kubenswrapper[2562]: I0521 13:03:30.447938 2562 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"snapshots\" (UniqueName: \"kubernetes.io/empty-dir/d1ebaaa0-5942-4283-8952-713181fda43e-snapshots\") pod \"insights-operator-78bdfb888c-cj42h\" (UID: \"d1ebaaa0-5942-4283-8952-713181fda43e\") " pod="openshift-insights/insights-operator-78bdfb888c-cj42h" May 21 13:03:30.448050 ip-10-0-133-64 kubenswrapper[2562]: I0521 13:03:30.447965 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-rrj6m\" (UniqueName: \"kubernetes.io/projected/7ba99752-9a0f-4032-a47f-8e1df0d52758-kube-api-access-rrj6m\") pod \"router-default-66c9cf854b-46gbc\" (UID: \"7ba99752-9a0f-4032-a47f-8e1df0d52758\") " pod="openshift-ingress/router-default-66c9cf854b-46gbc" May 21 13:03:30.448050 ip-10-0-133-64 kubenswrapper[2562]: I0521 13:03:30.447994 2562 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-k9s5c\" (UniqueName: \"kubernetes.io/projected/d1ebaaa0-5942-4283-8952-713181fda43e-kube-api-access-k9s5c\") pod \"insights-operator-78bdfb888c-cj42h\" (UID: \"d1ebaaa0-5942-4283-8952-713181fda43e\") " pod="openshift-insights/insights-operator-78bdfb888c-cj42h" May 21 13:03:30.448050 ip-10-0-133-64 kubenswrapper[2562]: I0521 13:03:30.448020 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"telemetry-config\" (UniqueName: \"kubernetes.io/configmap/4cf9c09a-0d70-4b12-bf3b-da664ea578a3-telemetry-config\") pod \"cluster-monitoring-operator-6c75959455-mhvc5\" (UID: \"4cf9c09a-0d70-4b12-bf3b-da664ea578a3\") " pod="openshift-monitoring/cluster-monitoring-operator-6c75959455-mhvc5" May 21 13:03:30.448050 ip-10-0-133-64 kubenswrapper[2562]: I0521 13:03:30.448045 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"default-certificate\" (UniqueName: \"kubernetes.io/secret/7ba99752-9a0f-4032-a47f-8e1df0d52758-default-certificate\") pod \"router-default-66c9cf854b-46gbc\" (UID: \"7ba99752-9a0f-4032-a47f-8e1df0d52758\") " pod="openshift-ingress/router-default-66c9cf854b-46gbc" May 21 13:03:30.448502 ip-10-0-133-64 kubenswrapper[2562]: I0521 13:03:30.448071 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/349ca67b-a757-4620-943e-90741bff22ff-registry-certificates\") pod \"image-registry-59f998bd79-jn4d2\" (UID: \"349ca67b-a757-4620-943e-90741bff22ff\") " pod="openshift-image-registry/image-registry-59f998bd79-jn4d2" May 21 13:03:30.448502 ip-10-0-133-64 kubenswrapper[2562]: I0521 13:03:30.448359 2562 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/d1ebaaa0-5942-4283-8952-713181fda43e-trusted-ca-bundle\") pod \"insights-operator-78bdfb888c-cj42h\" (UID: \"d1ebaaa0-5942-4283-8952-713181fda43e\") " pod="openshift-insights/insights-operator-78bdfb888c-cj42h" May 21 13:03:30.448502 ip-10-0-133-64 kubenswrapper[2562]: I0521 13:03:30.448394 2562 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/d1ebaaa0-5942-4283-8952-713181fda43e-service-ca-bundle\") pod \"insights-operator-78bdfb888c-cj42h\" (UID: \"d1ebaaa0-5942-4283-8952-713181fda43e\") " pod="openshift-insights/insights-operator-78bdfb888c-cj42h" May 21 13:03:30.448502 ip-10-0-133-64 kubenswrapper[2562]: I0521 13:03:30.448468 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/ef0f845b-ec3c-4e76-873d-f2552c56364c-trusted-ca\") pod \"console-operator-76dff48d59-pt4fg\" (UID: \"ef0f845b-ec3c-4e76-873d-f2552c56364c\") " pod="openshift-console-operator/console-operator-76dff48d59-pt4fg" May 21 13:03:30.448502 ip-10-0-133-64 kubenswrapper[2562]: I0521 13:03:30.448481 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-9j7vg\" (UniqueName: \"kubernetes.io/projected/4cf9c09a-0d70-4b12-bf3b-da664ea578a3-kube-api-access-9j7vg\") pod \"cluster-monitoring-operator-6c75959455-mhvc5\" (UID: \"4cf9c09a-0d70-4b12-bf3b-da664ea578a3\") " pod="openshift-monitoring/cluster-monitoring-operator-6c75959455-mhvc5" May 21 13:03:30.448754 ip-10-0-133-64 kubenswrapper[2562]: I0521 13:03:30.448514 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/349ca67b-a757-4620-943e-90741bff22ff-ca-trust-extracted\") pod \"image-registry-59f998bd79-jn4d2\" (UID: \"349ca67b-a757-4620-943e-90741bff22ff\") " pod="openshift-image-registry/image-registry-59f998bd79-jn4d2" May 21 13:03:30.448754 ip-10-0-133-64 kubenswrapper[2562]: I0521 13:03:30.448543 2562 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/71e47aab-dc0c-4d26-9429-a9fef31cac1f-samples-operator-tls\") pod \"cluster-samples-operator-697587599-ngd5n\" (UID: \"71e47aab-dc0c-4d26-9429-a9fef31cac1f\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-697587599-ngd5n" May 21 13:03:30.448754 ip-10-0-133-64 kubenswrapper[2562]: I0521 13:03:30.448569 2562 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/d1ebaaa0-5942-4283-8952-713181fda43e-tmp\") pod \"insights-operator-78bdfb888c-cj42h\" (UID: \"d1ebaaa0-5942-4283-8952-713181fda43e\") " pod="openshift-insights/insights-operator-78bdfb888c-cj42h" May 21 13:03:30.449278 ip-10-0-133-64 kubenswrapper[2562]: I0521 13:03:30.449255 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"snapshots\" (UniqueName: \"kubernetes.io/empty-dir/d1ebaaa0-5942-4283-8952-713181fda43e-snapshots\") pod \"insights-operator-78bdfb888c-cj42h\" (UID: \"d1ebaaa0-5942-4283-8952-713181fda43e\") " pod="openshift-insights/insights-operator-78bdfb888c-cj42h" May 21 13:03:30.449824 ip-10-0-133-64 kubenswrapper[2562]: I0521 13:03:30.449776 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/configmap/ef0f845b-ec3c-4e76-873d-f2552c56364c-config\") pod \"console-operator-76dff48d59-pt4fg\" (UID: \"ef0f845b-ec3c-4e76-873d-f2552c56364c\") " pod="openshift-console-operator/console-operator-76dff48d59-pt4fg" May 21 13:03:30.450747 ip-10-0-133-64 kubenswrapper[2562]: I0521 13:03:30.450675 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/d1ebaaa0-5942-4283-8952-713181fda43e-serving-cert\") pod \"insights-operator-78bdfb888c-cj42h\" (UID: \"d1ebaaa0-5942-4283-8952-713181fda43e\") " pod="openshift-insights/insights-operator-78bdfb888c-cj42h" May 21 13:03:30.450858 ip-10-0-133-64 kubenswrapper[2562]: I0521 13:03:30.450840 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/d1ebaaa0-5942-4283-8952-713181fda43e-service-ca-bundle\") pod \"insights-operator-78bdfb888c-cj42h\" (UID: \"d1ebaaa0-5942-4283-8952-713181fda43e\") " pod="openshift-insights/insights-operator-78bdfb888c-cj42h" May 21 13:03:30.451262 ip-10-0-133-64 kubenswrapper[2562]: I0521 13:03:30.451238 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/d1ebaaa0-5942-4283-8952-713181fda43e-tmp\") pod \"insights-operator-78bdfb888c-cj42h\" (UID: \"d1ebaaa0-5942-4283-8952-713181fda43e\") " pod="openshift-insights/insights-operator-78bdfb888c-cj42h" May 21 13:03:30.452616 ip-10-0-133-64 kubenswrapper[2562]: I0521 13:03:30.452588 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/ef0f845b-ec3c-4e76-873d-f2552c56364c-serving-cert\") pod \"console-operator-76dff48d59-pt4fg\" (UID: \"ef0f845b-ec3c-4e76-873d-f2552c56364c\") " pod="openshift-console-operator/console-operator-76dff48d59-pt4fg" May 21 13:03:30.452746 ip-10-0-133-64 kubenswrapper[2562]: I0521 13:03:30.452721 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/71e47aab-dc0c-4d26-9429-a9fef31cac1f-samples-operator-tls\") pod \"cluster-samples-operator-697587599-ngd5n\" (UID: \"71e47aab-dc0c-4d26-9429-a9fef31cac1f\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-697587599-ngd5n" May 21 13:03:30.453508 ip-10-0-133-64 kubenswrapper[2562]: I0521 13:03:30.453465 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/d1ebaaa0-5942-4283-8952-713181fda43e-trusted-ca-bundle\") pod \"insights-operator-78bdfb888c-cj42h\" (UID: \"d1ebaaa0-5942-4283-8952-713181fda43e\") " pod="openshift-insights/insights-operator-78bdfb888c-cj42h" May 21 13:03:30.454341 ip-10-0-133-64 kubenswrapper[2562]: I0521 13:03:30.454316 2562 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-image-registry/image-registry-59f998bd79-jn4d2"] May 21 13:03:30.474786 ip-10-0-133-64 kubenswrapper[2562]: I0521 13:03:30.474722 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-k9s5c\" (UniqueName: \"kubernetes.io/projected/d1ebaaa0-5942-4283-8952-713181fda43e-kube-api-access-k9s5c\") pod \"insights-operator-78bdfb888c-cj42h\" (UID: \"d1ebaaa0-5942-4283-8952-713181fda43e\") " pod="openshift-insights/insights-operator-78bdfb888c-cj42h" May 21 13:03:30.475462 ip-10-0-133-64 kubenswrapper[2562]: I0521 13:03:30.475443 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-f9kpx\" (UniqueName: \"kubernetes.io/projected/71e47aab-dc0c-4d26-9429-a9fef31cac1f-kube-api-access-f9kpx\") pod \"cluster-samples-operator-697587599-ngd5n\" (UID: \"71e47aab-dc0c-4d26-9429-a9fef31cac1f\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-697587599-ngd5n" May 21 13:03:30.475529 ip-10-0-133-64 kubenswrapper[2562]: I0521 13:03:30.475498 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-kbb4b\" (UniqueName: \"kubernetes.io/projected/ef0f845b-ec3c-4e76-873d-f2552c56364c-kube-api-access-kbb4b\") pod \"console-operator-76dff48d59-pt4fg\" (UID: \"ef0f845b-ec3c-4e76-873d-f2552c56364c\") " pod="openshift-console-operator/console-operator-76dff48d59-pt4fg" May 21 13:03:30.475932 ip-10-0-133-64 kubenswrapper[2562]: I0521 13:03:30.475915 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-zzcd4\" (UniqueName: \"kubernetes.io/projected/4ca422c1-c6f3-49c0-a3cb-64f1b1793866-kube-api-access-zzcd4\") pod \"volume-data-source-validator-5cf8c89d64-m8jhs\" (UID: \"4ca422c1-c6f3-49c0-a3cb-64f1b1793866\") " pod="openshift-cluster-storage-operator/volume-data-source-validator-5cf8c89d64-m8jhs" May 21 13:03:30.528238 ip-10-0-133-64 kubenswrapper[2562]: I0521 13:03:30.528207 2562 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-samples-operator/cluster-samples-operator-697587599-ngd5n" May 21 13:03:30.535539 ip-10-0-133-64 kubenswrapper[2562]: I0521 13:03:30.535521 2562 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console-operator/console-operator-76dff48d59-pt4fg" May 21 13:03:30.542236 ip-10-0-133-64 kubenswrapper[2562]: I0521 13:03:30.542208 2562 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-operator-78bdfb888c-cj42h" May 21 13:03:30.547871 ip-10-0-133-64 kubenswrapper[2562]: I0521 13:03:30.547849 2562 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-storage-operator/volume-data-source-validator-5cf8c89d64-m8jhs" May 21 13:03:30.549970 ip-10-0-133-64 kubenswrapper[2562]: I0521 13:03:30.549940 2562 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/349ca67b-a757-4620-943e-90741bff22ff-registry-tls\") pod \"image-registry-59f998bd79-jn4d2\" (UID: \"349ca67b-a757-4620-943e-90741bff22ff\") " pod="openshift-image-registry/image-registry-59f998bd79-jn4d2" May 21 13:03:30.550044 ip-10-0-133-64 kubenswrapper[2562]: I0521 13:03:30.549981 2562 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/349ca67b-a757-4620-943e-90741bff22ff-bound-sa-token\") pod \"image-registry-59f998bd79-jn4d2\" (UID: \"349ca67b-a757-4620-943e-90741bff22ff\") " pod="openshift-image-registry/image-registry-59f998bd79-jn4d2" May 21 13:03:30.550044 ip-10-0-133-64 kubenswrapper[2562]: I0521 13:03:30.550000 2562 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-q49db\" (UniqueName: \"kubernetes.io/projected/349ca67b-a757-4620-943e-90741bff22ff-kube-api-access-q49db\") pod \"image-registry-59f998bd79-jn4d2\" (UID: \"349ca67b-a757-4620-943e-90741bff22ff\") " pod="openshift-image-registry/image-registry-59f998bd79-jn4d2" May 21 13:03:30.550044 ip-10-0-133-64 kubenswrapper[2562]: I0521 13:03:30.550024 2562 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/4cf9c09a-0d70-4b12-bf3b-da664ea578a3-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-6c75959455-mhvc5\" (UID: \"4cf9c09a-0d70-4b12-bf3b-da664ea578a3\") " pod="openshift-monitoring/cluster-monitoring-operator-6c75959455-mhvc5" May 21 13:03:30.550193 ip-10-0-133-64 kubenswrapper[2562]: I0521 13:03:30.550049 2562 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"stats-auth\" (UniqueName: \"kubernetes.io/secret/7ba99752-9a0f-4032-a47f-8e1df0d52758-stats-auth\") pod \"router-default-66c9cf854b-46gbc\" (UID: \"7ba99752-9a0f-4032-a47f-8e1df0d52758\") " pod="openshift-ingress/router-default-66c9cf854b-46gbc" May 21 13:03:30.550193 ip-10-0-133-64 kubenswrapper[2562]: I0521 13:03:30.550074 2562 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-rrj6m\" (UniqueName: \"kubernetes.io/projected/7ba99752-9a0f-4032-a47f-8e1df0d52758-kube-api-access-rrj6m\") pod \"router-default-66c9cf854b-46gbc\" (UID: \"7ba99752-9a0f-4032-a47f-8e1df0d52758\") " pod="openshift-ingress/router-default-66c9cf854b-46gbc" May 21 13:03:30.550193 ip-10-0-133-64 kubenswrapper[2562]: I0521 13:03:30.550099 2562 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"telemetry-config\" (UniqueName: \"kubernetes.io/configmap/4cf9c09a-0d70-4b12-bf3b-da664ea578a3-telemetry-config\") pod \"cluster-monitoring-operator-6c75959455-mhvc5\" (UID: \"4cf9c09a-0d70-4b12-bf3b-da664ea578a3\") " pod="openshift-monitoring/cluster-monitoring-operator-6c75959455-mhvc5" May 21 13:03:30.550193 ip-10-0-133-64 kubenswrapper[2562]: I0521 13:03:30.550122 2562 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"default-certificate\" (UniqueName: \"kubernetes.io/secret/7ba99752-9a0f-4032-a47f-8e1df0d52758-default-certificate\") pod \"router-default-66c9cf854b-46gbc\" (UID: \"7ba99752-9a0f-4032-a47f-8e1df0d52758\") " pod="openshift-ingress/router-default-66c9cf854b-46gbc" May 21 13:03:30.550193 ip-10-0-133-64 kubenswrapper[2562]: I0521 13:03:30.550146 2562 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/349ca67b-a757-4620-943e-90741bff22ff-registry-certificates\") pod \"image-registry-59f998bd79-jn4d2\" (UID: \"349ca67b-a757-4620-943e-90741bff22ff\") " pod="openshift-image-registry/image-registry-59f998bd79-jn4d2" May 21 13:03:30.550430 ip-10-0-133-64 kubenswrapper[2562]: I0521 13:03:30.550197 2562 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-9j7vg\" (UniqueName: \"kubernetes.io/projected/4cf9c09a-0d70-4b12-bf3b-da664ea578a3-kube-api-access-9j7vg\") pod \"cluster-monitoring-operator-6c75959455-mhvc5\" (UID: \"4cf9c09a-0d70-4b12-bf3b-da664ea578a3\") " pod="openshift-monitoring/cluster-monitoring-operator-6c75959455-mhvc5" May 21 13:03:30.550430 ip-10-0-133-64 kubenswrapper[2562]: I0521 13:03:30.550226 2562 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/349ca67b-a757-4620-943e-90741bff22ff-ca-trust-extracted\") pod \"image-registry-59f998bd79-jn4d2\" (UID: \"349ca67b-a757-4620-943e-90741bff22ff\") " pod="openshift-image-registry/image-registry-59f998bd79-jn4d2" May 21 13:03:30.550430 ip-10-0-133-64 kubenswrapper[2562]: I0521 13:03:30.550265 2562 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/349ca67b-a757-4620-943e-90741bff22ff-installation-pull-secrets\") pod \"image-registry-59f998bd79-jn4d2\" (UID: \"349ca67b-a757-4620-943e-90741bff22ff\") " pod="openshift-image-registry/image-registry-59f998bd79-jn4d2" May 21 13:03:30.550430 ip-10-0-133-64 kubenswrapper[2562]: I0521 13:03:30.550297 2562 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/7ba99752-9a0f-4032-a47f-8e1df0d52758-service-ca-bundle\") pod \"router-default-66c9cf854b-46gbc\" (UID: \"7ba99752-9a0f-4032-a47f-8e1df0d52758\") " pod="openshift-ingress/router-default-66c9cf854b-46gbc" May 21 13:03:30.550430 ip-10-0-133-64 kubenswrapper[2562]: I0521 13:03:30.550327 2562 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/349ca67b-a757-4620-943e-90741bff22ff-trusted-ca\") pod \"image-registry-59f998bd79-jn4d2\" (UID: \"349ca67b-a757-4620-943e-90741bff22ff\") " pod="openshift-image-registry/image-registry-59f998bd79-jn4d2" May 21 13:03:30.550430 ip-10-0-133-64 kubenswrapper[2562]: I0521 13:03:30.550377 2562 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/349ca67b-a757-4620-943e-90741bff22ff-image-registry-private-configuration\") pod \"image-registry-59f998bd79-jn4d2\" (UID: \"349ca67b-a757-4620-943e-90741bff22ff\") " pod="openshift-image-registry/image-registry-59f998bd79-jn4d2" May 21 13:03:30.550430 ip-10-0-133-64 kubenswrapper[2562]: I0521 13:03:30.550409 2562 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/7ba99752-9a0f-4032-a47f-8e1df0d52758-metrics-certs\") pod \"router-default-66c9cf854b-46gbc\" (UID: \"7ba99752-9a0f-4032-a47f-8e1df0d52758\") " pod="openshift-ingress/router-default-66c9cf854b-46gbc" May 21 13:03:30.551584 ip-10-0-133-64 kubenswrapper[2562]: I0521 13:03:30.551555 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/7ba99752-9a0f-4032-a47f-8e1df0d52758-service-ca-bundle\") pod \"router-default-66c9cf854b-46gbc\" (UID: \"7ba99752-9a0f-4032-a47f-8e1df0d52758\") " pod="openshift-ingress/router-default-66c9cf854b-46gbc" May 21 13:03:30.551672 ip-10-0-133-64 kubenswrapper[2562]: I0521 13:03:30.551614 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/349ca67b-a757-4620-943e-90741bff22ff-ca-trust-extracted\") pod \"image-registry-59f998bd79-jn4d2\" (UID: \"349ca67b-a757-4620-943e-90741bff22ff\") " pod="openshift-image-registry/image-registry-59f998bd79-jn4d2" May 21 13:03:30.551672 ip-10-0-133-64 kubenswrapper[2562]: I0521 13:03:30.551643 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"telemetry-config\" (UniqueName: \"kubernetes.io/configmap/4cf9c09a-0d70-4b12-bf3b-da664ea578a3-telemetry-config\") pod \"cluster-monitoring-operator-6c75959455-mhvc5\" (UID: \"4cf9c09a-0d70-4b12-bf3b-da664ea578a3\") " pod="openshift-monitoring/cluster-monitoring-operator-6c75959455-mhvc5" May 21 13:03:30.552190 ip-10-0-133-64 kubenswrapper[2562]: I0521 13:03:30.551874 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/349ca67b-a757-4620-943e-90741bff22ff-registry-certificates\") pod \"image-registry-59f998bd79-jn4d2\" (UID: \"349ca67b-a757-4620-943e-90741bff22ff\") " pod="openshift-image-registry/image-registry-59f998bd79-jn4d2" May 21 13:03:30.553973 ip-10-0-133-64 kubenswrapper[2562]: I0521 13:03:30.552372 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/349ca67b-a757-4620-943e-90741bff22ff-trusted-ca\") pod \"image-registry-59f998bd79-jn4d2\" (UID: \"349ca67b-a757-4620-943e-90741bff22ff\") " pod="openshift-image-registry/image-registry-59f998bd79-jn4d2" May 21 13:03:30.555755 ip-10-0-133-64 kubenswrapper[2562]: I0521 13:03:30.554936 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/7ba99752-9a0f-4032-a47f-8e1df0d52758-metrics-certs\") pod \"router-default-66c9cf854b-46gbc\" (UID: \"7ba99752-9a0f-4032-a47f-8e1df0d52758\") " pod="openshift-ingress/router-default-66c9cf854b-46gbc" May 21 13:03:30.555755 ip-10-0-133-64 kubenswrapper[2562]: I0521 13:03:30.555316 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/4cf9c09a-0d70-4b12-bf3b-da664ea578a3-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-6c75959455-mhvc5\" (UID: \"4cf9c09a-0d70-4b12-bf3b-da664ea578a3\") " pod="openshift-monitoring/cluster-monitoring-operator-6c75959455-mhvc5" May 21 13:03:30.556683 ip-10-0-133-64 kubenswrapper[2562]: I0521 13:03:30.556650 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"stats-auth\" (UniqueName: \"kubernetes.io/secret/7ba99752-9a0f-4032-a47f-8e1df0d52758-stats-auth\") pod \"router-default-66c9cf854b-46gbc\" (UID: \"7ba99752-9a0f-4032-a47f-8e1df0d52758\") " pod="openshift-ingress/router-default-66c9cf854b-46gbc" May 21 13:03:30.557059 ip-10-0-133-64 kubenswrapper[2562]: I0521 13:03:30.557021 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/349ca67b-a757-4620-943e-90741bff22ff-registry-tls\") pod \"image-registry-59f998bd79-jn4d2\" (UID: \"349ca67b-a757-4620-943e-90741bff22ff\") " pod="openshift-image-registry/image-registry-59f998bd79-jn4d2" May 21 13:03:30.557315 ip-10-0-133-64 kubenswrapper[2562]: I0521 13:03:30.557291 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/349ca67b-a757-4620-943e-90741bff22ff-installation-pull-secrets\") pod \"image-registry-59f998bd79-jn4d2\" (UID: \"349ca67b-a757-4620-943e-90741bff22ff\") " pod="openshift-image-registry/image-registry-59f998bd79-jn4d2" May 21 13:03:30.557857 ip-10-0-133-64 kubenswrapper[2562]: I0521 13:03:30.557773 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/349ca67b-a757-4620-943e-90741bff22ff-image-registry-private-configuration\") pod \"image-registry-59f998bd79-jn4d2\" (UID: \"349ca67b-a757-4620-943e-90741bff22ff\") " pod="openshift-image-registry/image-registry-59f998bd79-jn4d2" May 21 13:03:30.559976 ip-10-0-133-64 kubenswrapper[2562]: I0521 13:03:30.559946 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"default-certificate\" (UniqueName: \"kubernetes.io/secret/7ba99752-9a0f-4032-a47f-8e1df0d52758-default-certificate\") pod \"router-default-66c9cf854b-46gbc\" (UID: \"7ba99752-9a0f-4032-a47f-8e1df0d52758\") " pod="openshift-ingress/router-default-66c9cf854b-46gbc" May 21 13:03:30.561783 ip-10-0-133-64 kubenswrapper[2562]: I0521 13:03:30.561750 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/349ca67b-a757-4620-943e-90741bff22ff-bound-sa-token\") pod \"image-registry-59f998bd79-jn4d2\" (UID: \"349ca67b-a757-4620-943e-90741bff22ff\") " pod="openshift-image-registry/image-registry-59f998bd79-jn4d2" May 21 13:03:30.562240 ip-10-0-133-64 kubenswrapper[2562]: I0521 13:03:30.562218 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-q49db\" (UniqueName: \"kubernetes.io/projected/349ca67b-a757-4620-943e-90741bff22ff-kube-api-access-q49db\") pod \"image-registry-59f998bd79-jn4d2\" (UID: \"349ca67b-a757-4620-943e-90741bff22ff\") " pod="openshift-image-registry/image-registry-59f998bd79-jn4d2" May 21 13:03:30.563002 ip-10-0-133-64 kubenswrapper[2562]: I0521 13:03:30.562955 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-9j7vg\" (UniqueName: \"kubernetes.io/projected/4cf9c09a-0d70-4b12-bf3b-da664ea578a3-kube-api-access-9j7vg\") pod \"cluster-monitoring-operator-6c75959455-mhvc5\" (UID: \"4cf9c09a-0d70-4b12-bf3b-da664ea578a3\") " pod="openshift-monitoring/cluster-monitoring-operator-6c75959455-mhvc5" May 21 13:03:30.571920 ip-10-0-133-64 kubenswrapper[2562]: I0521 13:03:30.571866 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-rrj6m\" (UniqueName: \"kubernetes.io/projected/7ba99752-9a0f-4032-a47f-8e1df0d52758-kube-api-access-rrj6m\") pod \"router-default-66c9cf854b-46gbc\" (UID: \"7ba99752-9a0f-4032-a47f-8e1df0d52758\") " pod="openshift-ingress/router-default-66c9cf854b-46gbc" May 21 13:03:30.620208 ip-10-0-133-64 kubenswrapper[2562]: I0521 13:03:30.620033 2562 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/cluster-monitoring-operator-6c75959455-mhvc5" May 21 13:03:30.626131 ip-10-0-133-64 kubenswrapper[2562]: I0521 13:03:30.624423 2562 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/router-default-66c9cf854b-46gbc" May 21 13:03:30.699472 ip-10-0-133-64 kubenswrapper[2562]: I0521 13:03:30.699425 2562 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-cluster-samples-operator/cluster-samples-operator-697587599-ngd5n"] May 21 13:03:30.721059 ip-10-0-133-64 kubenswrapper[2562]: I0521 13:03:30.720904 2562 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-console-operator/console-operator-76dff48d59-pt4fg"] May 21 13:03:30.729378 ip-10-0-133-64 kubenswrapper[2562]: W0521 13:03:30.729311 2562 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podef0f845b_ec3c_4e76_873d_f2552c56364c.slice/crio-c9706a1d20157e70665f89c879b4449d3b771ea26aca978964c86761f28e3f6c WatchSource:0}: Error finding container c9706a1d20157e70665f89c879b4449d3b771ea26aca978964c86761f28e3f6c: Status 404 returned error can't find the container with id c9706a1d20157e70665f89c879b4449d3b771ea26aca978964c86761f28e3f6c May 21 13:03:30.738670 ip-10-0-133-64 kubenswrapper[2562]: I0521 13:03:30.738638 2562 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-59f998bd79-jn4d2" May 21 13:03:30.809853 ip-10-0-133-64 kubenswrapper[2562]: I0521 13:03:30.809825 2562 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/router-default-66c9cf854b-46gbc"] May 21 13:03:30.814577 ip-10-0-133-64 kubenswrapper[2562]: W0521 13:03:30.814548 2562 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod7ba99752_9a0f_4032_a47f_8e1df0d52758.slice/crio-d1d7364180d05a7912d4dbb602d956a4ae1d7b66ef942e3955a48eca61047a4c WatchSource:0}: Error finding container d1d7364180d05a7912d4dbb602d956a4ae1d7b66ef942e3955a48eca61047a4c: Status 404 returned error can't find the container with id d1d7364180d05a7912d4dbb602d956a4ae1d7b66ef942e3955a48eca61047a4c May 21 13:03:30.825393 ip-10-0-133-64 kubenswrapper[2562]: I0521 13:03:30.825255 2562 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/cluster-monitoring-operator-6c75959455-mhvc5"] May 21 13:03:30.829041 ip-10-0-133-64 kubenswrapper[2562]: W0521 13:03:30.829012 2562 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod4cf9c09a_0d70_4b12_bf3b_da664ea578a3.slice/crio-58a87842b4deda175e24add59e0ac7d1ee995d87ccd994060ba8cbdea2b75295 WatchSource:0}: Error finding container 58a87842b4deda175e24add59e0ac7d1ee995d87ccd994060ba8cbdea2b75295: Status 404 returned error can't find the container with id 58a87842b4deda175e24add59e0ac7d1ee995d87ccd994060ba8cbdea2b75295 May 21 13:03:30.881218 ip-10-0-133-64 kubenswrapper[2562]: I0521 13:03:30.881190 2562 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-image-registry/image-registry-59f998bd79-jn4d2"] May 21 13:03:30.884216 ip-10-0-133-64 kubenswrapper[2562]: W0521 13:03:30.884191 2562 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod349ca67b_a757_4620_943e_90741bff22ff.slice/crio-640de9e302b1bdacf3cd02123d6eec71289dd6c0d156cb28d5916e4e64a43d77 WatchSource:0}: Error finding container 640de9e302b1bdacf3cd02123d6eec71289dd6c0d156cb28d5916e4e64a43d77: Status 404 returned error can't find the container with id 640de9e302b1bdacf3cd02123d6eec71289dd6c0d156cb28d5916e4e64a43d77 May 21 13:03:30.951197 ip-10-0-133-64 kubenswrapper[2562]: I0521 13:03:30.951167 2562 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-cluster-storage-operator/volume-data-source-validator-5cf8c89d64-m8jhs"] May 21 13:03:30.954333 ip-10-0-133-64 kubenswrapper[2562]: W0521 13:03:30.954309 2562 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod4ca422c1_c6f3_49c0_a3cb_64f1b1793866.slice/crio-8dca6bc21faac0fce748a2133ffa22b001f18a6ca48b3df83a5d50243ebe8fbb WatchSource:0}: Error finding container 8dca6bc21faac0fce748a2133ffa22b001f18a6ca48b3df83a5d50243ebe8fbb: Status 404 returned error can't find the container with id 8dca6bc21faac0fce748a2133ffa22b001f18a6ca48b3df83a5d50243ebe8fbb May 21 13:03:30.956018 ip-10-0-133-64 kubenswrapper[2562]: I0521 13:03:30.955987 2562 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-operator-78bdfb888c-cj42h"] May 21 13:03:30.959105 ip-10-0-133-64 kubenswrapper[2562]: W0521 13:03:30.959083 2562 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podd1ebaaa0_5942_4283_8952_713181fda43e.slice/crio-091df0a92bde8f65bb344255e7e72d2bb11ed3dd9c726057bd8cc34e293fb6c1 WatchSource:0}: Error finding container 091df0a92bde8f65bb344255e7e72d2bb11ed3dd9c726057bd8cc34e293fb6c1: Status 404 returned error can't find the container with id 091df0a92bde8f65bb344255e7e72d2bb11ed3dd9c726057bd8cc34e293fb6c1 May 21 13:03:31.266494 ip-10-0-133-64 kubenswrapper[2562]: I0521 13:03:31.266455 2562 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/router-default-66c9cf854b-46gbc" event={"ID":"7ba99752-9a0f-4032-a47f-8e1df0d52758","Type":"ContainerStarted","Data":"bf2aa85123b7212bd4a8a1e2defd96eb40a5a27f7b039b5af9924b7319f7054d"} May 21 13:03:31.266986 ip-10-0-133-64 kubenswrapper[2562]: I0521 13:03:31.266500 2562 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/router-default-66c9cf854b-46gbc" event={"ID":"7ba99752-9a0f-4032-a47f-8e1df0d52758","Type":"ContainerStarted","Data":"d1d7364180d05a7912d4dbb602d956a4ae1d7b66ef942e3955a48eca61047a4c"} May 21 13:03:31.267541 ip-10-0-133-64 kubenswrapper[2562]: I0521 13:03:31.267514 2562 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-operator-78bdfb888c-cj42h" event={"ID":"d1ebaaa0-5942-4283-8952-713181fda43e","Type":"ContainerStarted","Data":"091df0a92bde8f65bb344255e7e72d2bb11ed3dd9c726057bd8cc34e293fb6c1"} May 21 13:03:31.268412 ip-10-0-133-64 kubenswrapper[2562]: I0521 13:03:31.268387 2562 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-storage-operator/volume-data-source-validator-5cf8c89d64-m8jhs" event={"ID":"4ca422c1-c6f3-49c0-a3cb-64f1b1793866","Type":"ContainerStarted","Data":"8dca6bc21faac0fce748a2133ffa22b001f18a6ca48b3df83a5d50243ebe8fbb"} May 21 13:03:31.269574 ip-10-0-133-64 kubenswrapper[2562]: I0521 13:03:31.269549 2562 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-59f998bd79-jn4d2" event={"ID":"349ca67b-a757-4620-943e-90741bff22ff","Type":"ContainerStarted","Data":"71087ba18671c502e2f71ca14fa5c0361e966dfa0b2da7dfd81a53f36f5a4ed4"} May 21 13:03:31.269694 ip-10-0-133-64 kubenswrapper[2562]: I0521 13:03:31.269583 2562 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-59f998bd79-jn4d2" event={"ID":"349ca67b-a757-4620-943e-90741bff22ff","Type":"ContainerStarted","Data":"640de9e302b1bdacf3cd02123d6eec71289dd6c0d156cb28d5916e4e64a43d77"} May 21 13:03:31.269694 ip-10-0-133-64 kubenswrapper[2562]: I0521 13:03:31.269687 2562 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-image-registry/image-registry-59f998bd79-jn4d2" May 21 13:03:31.270567 ip-10-0-133-64 kubenswrapper[2562]: I0521 13:03:31.270543 2562 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/cluster-monitoring-operator-6c75959455-mhvc5" event={"ID":"4cf9c09a-0d70-4b12-bf3b-da664ea578a3","Type":"ContainerStarted","Data":"58a87842b4deda175e24add59e0ac7d1ee995d87ccd994060ba8cbdea2b75295"} May 21 13:03:31.271529 ip-10-0-133-64 kubenswrapper[2562]: I0521 13:03:31.271506 2562 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-console-operator/console-operator-76dff48d59-pt4fg" event={"ID":"ef0f845b-ec3c-4e76-873d-f2552c56364c","Type":"ContainerStarted","Data":"c9706a1d20157e70665f89c879b4449d3b771ea26aca978964c86761f28e3f6c"} May 21 13:03:31.272488 ip-10-0-133-64 kubenswrapper[2562]: I0521 13:03:31.272470 2562 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-samples-operator/cluster-samples-operator-697587599-ngd5n" event={"ID":"71e47aab-dc0c-4d26-9429-a9fef31cac1f","Type":"ContainerStarted","Data":"ea1bc890e4493ad51125100c9aecdc3017a3b90aa5c79aa11ebfb927f48ef19b"} May 21 13:03:31.287584 ip-10-0-133-64 kubenswrapper[2562]: I0521 13:03:31.287539 2562 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-ingress/router-default-66c9cf854b-46gbc" podStartSLOduration=1.287523834 podStartE2EDuration="1.287523834s" podCreationTimestamp="2026-05-21 13:03:30 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2026-05-21 13:03:31.286794868 +0000 UTC m=+57.837076236" watchObservedRunningTime="2026-05-21 13:03:31.287523834 +0000 UTC m=+57.837805183" May 21 13:03:31.309514 ip-10-0-133-64 kubenswrapper[2562]: I0521 13:03:31.309466 2562 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-image-registry/image-registry-59f998bd79-jn4d2" podStartSLOduration=1.3094489 podStartE2EDuration="1.3094489s" podCreationTimestamp="2026-05-21 13:03:30 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2026-05-21 13:03:31.308574202 +0000 UTC m=+57.858855571" watchObservedRunningTime="2026-05-21 13:03:31.3094489 +0000 UTC m=+57.859730268" May 21 13:03:31.626300 ip-10-0-133-64 kubenswrapper[2562]: I0521 13:03:31.626222 2562 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/router-default-66c9cf854b-46gbc" May 21 13:03:31.629356 ip-10-0-133-64 kubenswrapper[2562]: I0521 13:03:31.629330 2562 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/router-default-66c9cf854b-46gbc" May 21 13:03:32.287016 ip-10-0-133-64 kubenswrapper[2562]: I0521 13:03:32.286977 2562 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/router-default-66c9cf854b-46gbc" May 21 13:03:32.288893 ip-10-0-133-64 kubenswrapper[2562]: I0521 13:03:32.288642 2562 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/router-default-66c9cf854b-46gbc" May 21 13:03:33.197645 ip-10-0-133-64 kubenswrapper[2562]: I0521 13:03:33.197601 2562 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-ltpwh" May 21 13:03:35.298502 ip-10-0-133-64 kubenswrapper[2562]: I0521 13:03:35.296932 2562 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-storage-operator/volume-data-source-validator-5cf8c89d64-m8jhs" event={"ID":"4ca422c1-c6f3-49c0-a3cb-64f1b1793866","Type":"ContainerStarted","Data":"1541d277e9b7935b146b90b35a94b984215e2f993fe8659a6da9756fc0ee1495"} May 21 13:03:35.299065 ip-10-0-133-64 kubenswrapper[2562]: I0521 13:03:35.299031 2562 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/cluster-monitoring-operator-6c75959455-mhvc5" event={"ID":"4cf9c09a-0d70-4b12-bf3b-da664ea578a3","Type":"ContainerStarted","Data":"8a3af1d90b21a3d2670108b4746826384bbe969fa0fa757bd7306209fca1fd43"} May 21 13:03:35.300831 ip-10-0-133-64 kubenswrapper[2562]: I0521 13:03:35.300773 2562 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-console-operator/console-operator-76dff48d59-pt4fg" event={"ID":"ef0f845b-ec3c-4e76-873d-f2552c56364c","Type":"ContainerStarted","Data":"66e3664452e2e42d0ca6e5c87cd3296778a0ef82bb483334f03e7edbe3c8b53c"} May 21 13:03:35.301757 ip-10-0-133-64 kubenswrapper[2562]: I0521 13:03:35.301725 2562 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console-operator/console-operator-76dff48d59-pt4fg" May 21 13:03:35.302573 ip-10-0-133-64 kubenswrapper[2562]: I0521 13:03:35.302551 2562 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-samples-operator/cluster-samples-operator-697587599-ngd5n" event={"ID":"71e47aab-dc0c-4d26-9429-a9fef31cac1f","Type":"ContainerStarted","Data":"b38ae40bec71ca2a042bec54db2c2fff16085f947d70446d6589e560c1b40f82"} May 21 13:03:35.302684 ip-10-0-133-64 kubenswrapper[2562]: I0521 13:03:35.302579 2562 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-samples-operator/cluster-samples-operator-697587599-ngd5n" event={"ID":"71e47aab-dc0c-4d26-9429-a9fef31cac1f","Type":"ContainerStarted","Data":"63177e7b6d66b3dae68b1abc3b677589d6d7913ffcc5a38afe771f1fc60ac905"} May 21 13:03:35.304422 ip-10-0-133-64 kubenswrapper[2562]: I0521 13:03:35.304376 2562 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-operator-78bdfb888c-cj42h" event={"ID":"d1ebaaa0-5942-4283-8952-713181fda43e","Type":"ContainerStarted","Data":"04d6ce81584016cb8b6e157608efb9e0edfd58888715b9fda9988476e79809b7"} May 21 13:03:35.318115 ip-10-0-133-64 kubenswrapper[2562]: I0521 13:03:35.318067 2562 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-cluster-storage-operator/volume-data-source-validator-5cf8c89d64-m8jhs" podStartSLOduration=1.541851584 podStartE2EDuration="5.318053482s" podCreationTimestamp="2026-05-21 13:03:30 +0000 UTC" firstStartedPulling="2026-05-21 13:03:30.956722691 +0000 UTC m=+57.507004041" lastFinishedPulling="2026-05-21 13:03:34.732924589 +0000 UTC m=+61.283205939" observedRunningTime="2026-05-21 13:03:35.317667872 +0000 UTC m=+61.867949240" watchObservedRunningTime="2026-05-21 13:03:35.318053482 +0000 UTC m=+61.868334852" May 21 13:03:35.336912 ip-10-0-133-64 kubenswrapper[2562]: I0521 13:03:35.336887 2562 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console-operator/console-operator-76dff48d59-pt4fg" May 21 13:03:35.337774 ip-10-0-133-64 kubenswrapper[2562]: I0521 13:03:35.337729 2562 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-insights/insights-operator-78bdfb888c-cj42h" podStartSLOduration=1.5673853850000001 podStartE2EDuration="5.337714487s" podCreationTimestamp="2026-05-21 13:03:30 +0000 UTC" firstStartedPulling="2026-05-21 13:03:30.963295047 +0000 UTC m=+57.513576400" lastFinishedPulling="2026-05-21 13:03:34.733624152 +0000 UTC m=+61.283905502" observedRunningTime="2026-05-21 13:03:35.33739865 +0000 UTC m=+61.887680020" watchObservedRunningTime="2026-05-21 13:03:35.337714487 +0000 UTC m=+61.887995858" May 21 13:03:35.354670 ip-10-0-133-64 kubenswrapper[2562]: I0521 13:03:35.354641 2562 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-monitoring/prometheus-operator-admission-webhook-6c4bbc67b7-22k89"] May 21 13:03:35.357058 ip-10-0-133-64 kubenswrapper[2562]: I0521 13:03:35.357037 2562 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-operator-admission-webhook-6c4bbc67b7-22k89" May 21 13:03:35.359555 ip-10-0-133-64 kubenswrapper[2562]: I0521 13:03:35.359472 2562 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-operator-admission-webhook-dockercfg-f2d8k\"" May 21 13:03:35.359555 ip-10-0-133-64 kubenswrapper[2562]: I0521 13:03:35.359492 2562 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-operator-admission-webhook-tls\"" May 21 13:03:35.363360 ip-10-0-133-64 kubenswrapper[2562]: I0521 13:03:35.363296 2562 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-monitoring/cluster-monitoring-operator-6c75959455-mhvc5" podStartSLOduration=1.4580232450000001 podStartE2EDuration="5.36328116s" podCreationTimestamp="2026-05-21 13:03:30 +0000 UTC" firstStartedPulling="2026-05-21 13:03:30.831032593 +0000 UTC m=+57.381313943" lastFinishedPulling="2026-05-21 13:03:34.736290503 +0000 UTC m=+61.286571858" observedRunningTime="2026-05-21 13:03:35.361766824 +0000 UTC m=+61.912048193" watchObservedRunningTime="2026-05-21 13:03:35.36328116 +0000 UTC m=+61.913562530" May 21 13:03:35.371827 ip-10-0-133-64 kubenswrapper[2562]: I0521 13:03:35.371343 2562 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-operator-admission-webhook-6c4bbc67b7-22k89"] May 21 13:03:35.395840 ip-10-0-133-64 kubenswrapper[2562]: I0521 13:03:35.392483 2562 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-cluster-samples-operator/cluster-samples-operator-697587599-ngd5n" podStartSLOduration=1.437904665 podStartE2EDuration="5.392465933s" podCreationTimestamp="2026-05-21 13:03:30 +0000 UTC" firstStartedPulling="2026-05-21 13:03:30.776691088 +0000 UTC m=+57.326972438" lastFinishedPulling="2026-05-21 13:03:34.731252346 +0000 UTC m=+61.281533706" observedRunningTime="2026-05-21 13:03:35.392124186 +0000 UTC m=+61.942405555" watchObservedRunningTime="2026-05-21 13:03:35.392465933 +0000 UTC m=+61.942747302" May 21 13:03:35.395840 ip-10-0-133-64 kubenswrapper[2562]: I0521 13:03:35.395738 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certificates\" (UniqueName: \"kubernetes.io/secret/a6471fd0-c934-471c-ba70-be8b1a241e84-tls-certificates\") pod \"prometheus-operator-admission-webhook-6c4bbc67b7-22k89\" (UID: \"a6471fd0-c934-471c-ba70-be8b1a241e84\") " pod="openshift-monitoring/prometheus-operator-admission-webhook-6c4bbc67b7-22k89" May 21 13:03:35.420561 ip-10-0-133-64 kubenswrapper[2562]: I0521 13:03:35.420515 2562 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-console-operator/console-operator-76dff48d59-pt4fg" podStartSLOduration=1.4218096550000001 podStartE2EDuration="5.420502099s" podCreationTimestamp="2026-05-21 13:03:30 +0000 UTC" firstStartedPulling="2026-05-21 13:03:30.732246159 +0000 UTC m=+57.282527521" lastFinishedPulling="2026-05-21 13:03:34.7309386 +0000 UTC m=+61.281219965" observedRunningTime="2026-05-21 13:03:35.42010463 +0000 UTC m=+61.970385997" watchObservedRunningTime="2026-05-21 13:03:35.420502099 +0000 UTC m=+61.970783467" May 21 13:03:35.496503 ip-10-0-133-64 kubenswrapper[2562]: I0521 13:03:35.496459 2562 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"tls-certificates\" (UniqueName: \"kubernetes.io/secret/a6471fd0-c934-471c-ba70-be8b1a241e84-tls-certificates\") pod \"prometheus-operator-admission-webhook-6c4bbc67b7-22k89\" (UID: \"a6471fd0-c934-471c-ba70-be8b1a241e84\") " pod="openshift-monitoring/prometheus-operator-admission-webhook-6c4bbc67b7-22k89" May 21 13:03:35.499891 ip-10-0-133-64 kubenswrapper[2562]: I0521 13:03:35.499865 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-certificates\" (UniqueName: \"kubernetes.io/secret/a6471fd0-c934-471c-ba70-be8b1a241e84-tls-certificates\") pod \"prometheus-operator-admission-webhook-6c4bbc67b7-22k89\" (UID: \"a6471fd0-c934-471c-ba70-be8b1a241e84\") " pod="openshift-monitoring/prometheus-operator-admission-webhook-6c4bbc67b7-22k89" May 21 13:03:35.539732 ip-10-0-133-64 kubenswrapper[2562]: I0521 13:03:35.539698 2562 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-console/downloads-57bd96b888-52n4w"] May 21 13:03:35.541994 ip-10-0-133-64 kubenswrapper[2562]: I0521 13:03:35.541975 2562 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/downloads-57bd96b888-52n4w" May 21 13:03:35.544655 ip-10-0-133-64 kubenswrapper[2562]: I0521 13:03:35.544632 2562 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"default-dockercfg-hxb7g\"" May 21 13:03:35.544859 ip-10-0-133-64 kubenswrapper[2562]: I0521 13:03:35.544640 2562 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"openshift-service-ca.crt\"" May 21 13:03:35.544967 ip-10-0-133-64 kubenswrapper[2562]: I0521 13:03:35.544640 2562 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"kube-root-ca.crt\"" May 21 13:03:35.553333 ip-10-0-133-64 kubenswrapper[2562]: I0521 13:03:35.553312 2562 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-console/downloads-57bd96b888-52n4w"] May 21 13:03:35.598208 ip-10-0-133-64 kubenswrapper[2562]: I0521 13:03:35.598180 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-jldcc\" (UniqueName: \"kubernetes.io/projected/1cbe2845-fe10-40ee-907d-f4425f3ddc35-kube-api-access-jldcc\") pod \"downloads-57bd96b888-52n4w\" (UID: \"1cbe2845-fe10-40ee-907d-f4425f3ddc35\") " pod="openshift-console/downloads-57bd96b888-52n4w" May 21 13:03:35.667967 ip-10-0-133-64 kubenswrapper[2562]: I0521 13:03:35.667928 2562 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-operator-admission-webhook-6c4bbc67b7-22k89" May 21 13:03:35.699136 ip-10-0-133-64 kubenswrapper[2562]: I0521 13:03:35.699100 2562 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-jldcc\" (UniqueName: \"kubernetes.io/projected/1cbe2845-fe10-40ee-907d-f4425f3ddc35-kube-api-access-jldcc\") pod \"downloads-57bd96b888-52n4w\" (UID: \"1cbe2845-fe10-40ee-907d-f4425f3ddc35\") " pod="openshift-console/downloads-57bd96b888-52n4w" May 21 13:03:35.707847 ip-10-0-133-64 kubenswrapper[2562]: I0521 13:03:35.707823 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-jldcc\" (UniqueName: \"kubernetes.io/projected/1cbe2845-fe10-40ee-907d-f4425f3ddc35-kube-api-access-jldcc\") pod \"downloads-57bd96b888-52n4w\" (UID: \"1cbe2845-fe10-40ee-907d-f4425f3ddc35\") " pod="openshift-console/downloads-57bd96b888-52n4w" May 21 13:03:35.837583 ip-10-0-133-64 kubenswrapper[2562]: I0521 13:03:35.837377 2562 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-operator-admission-webhook-6c4bbc67b7-22k89"] May 21 13:03:35.839761 ip-10-0-133-64 kubenswrapper[2562]: W0521 13:03:35.839732 2562 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poda6471fd0_c934_471c_ba70_be8b1a241e84.slice/crio-6475be75105fd90a7cb3a6347557f1b88fe2c267b0b6f99b08ed7e5c6b3140fb WatchSource:0}: Error finding container 6475be75105fd90a7cb3a6347557f1b88fe2c267b0b6f99b08ed7e5c6b3140fb: Status 404 returned error can't find the container with id 6475be75105fd90a7cb3a6347557f1b88fe2c267b0b6f99b08ed7e5c6b3140fb May 21 13:03:35.853217 ip-10-0-133-64 kubenswrapper[2562]: I0521 13:03:35.853192 2562 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/downloads-57bd96b888-52n4w" May 21 13:03:35.984601 ip-10-0-133-64 kubenswrapper[2562]: I0521 13:03:35.984570 2562 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-console/downloads-57bd96b888-52n4w"] May 21 13:03:35.987587 ip-10-0-133-64 kubenswrapper[2562]: W0521 13:03:35.987561 2562 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod1cbe2845_fe10_40ee_907d_f4425f3ddc35.slice/crio-dbd16e950b7b634626adacb6ad4fe58fb57e40368a542132cb7183077293d40d WatchSource:0}: Error finding container dbd16e950b7b634626adacb6ad4fe58fb57e40368a542132cb7183077293d40d: Status 404 returned error can't find the container with id dbd16e950b7b634626adacb6ad4fe58fb57e40368a542132cb7183077293d40d May 21 13:03:36.255882 ip-10-0-133-64 kubenswrapper[2562]: I0521 13:03:36.255850 2562 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-dns/dns-default-jmwf6" May 21 13:03:36.310858 ip-10-0-133-64 kubenswrapper[2562]: I0521 13:03:36.310824 2562 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-console/downloads-57bd96b888-52n4w" event={"ID":"1cbe2845-fe10-40ee-907d-f4425f3ddc35","Type":"ContainerStarted","Data":"dbd16e950b7b634626adacb6ad4fe58fb57e40368a542132cb7183077293d40d"} May 21 13:03:36.311858 ip-10-0-133-64 kubenswrapper[2562]: I0521 13:03:36.311829 2562 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-operator-admission-webhook-6c4bbc67b7-22k89" event={"ID":"a6471fd0-c934-471c-ba70-be8b1a241e84","Type":"ContainerStarted","Data":"6475be75105fd90a7cb3a6347557f1b88fe2c267b0b6f99b08ed7e5c6b3140fb"} May 21 13:03:36.817252 ip-10-0-133-64 kubenswrapper[2562]: I0521 13:03:36.817147 2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_dns-default-jmwf6_f0b8359d-d8af-4b73-8592-27cac5c13257/dns/0.log" May 21 13:03:37.008415 ip-10-0-133-64 kubenswrapper[2562]: I0521 13:03:37.008344 2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_dns-default-jmwf6_f0b8359d-d8af-4b73-8592-27cac5c13257/kube-rbac-proxy/0.log" May 21 13:03:37.316395 ip-10-0-133-64 kubenswrapper[2562]: I0521 13:03:37.316355 2562 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-operator-admission-webhook-6c4bbc67b7-22k89" event={"ID":"a6471fd0-c934-471c-ba70-be8b1a241e84","Type":"ContainerStarted","Data":"6fe3c453781192a76aaad9e51a3f335ec4131437a67aa5beb377834f9c6c2355"} May 21 13:03:37.335403 ip-10-0-133-64 kubenswrapper[2562]: I0521 13:03:37.335340 2562 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-monitoring/prometheus-operator-admission-webhook-6c4bbc67b7-22k89" podStartSLOduration=1.228818517 podStartE2EDuration="2.335320329s" podCreationTimestamp="2026-05-21 13:03:35 +0000 UTC" firstStartedPulling="2026-05-21 13:03:35.841930028 +0000 UTC m=+62.392211375" lastFinishedPulling="2026-05-21 13:03:36.948431838 +0000 UTC m=+63.498713187" observedRunningTime="2026-05-21 13:03:37.333883939 +0000 UTC m=+63.884165308" watchObservedRunningTime="2026-05-21 13:03:37.335320329 +0000 UTC m=+63.885601698" May 21 13:03:38.005983 ip-10-0-133-64 kubenswrapper[2562]: I0521 13:03:38.005955 2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_node-resolver-qqgxp_f025d291-e59b-45b8-9b1a-83d59bcf8609/dns-node-resolver/0.log" May 21 13:03:38.205390 ip-10-0-133-64 kubenswrapper[2562]: I0521 13:03:38.205357 2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_image-registry-59f998bd79-jn4d2_349ca67b-a757-4620-943e-90741bff22ff/registry/0.log" May 21 13:03:38.319694 ip-10-0-133-64 kubenswrapper[2562]: I0521 13:03:38.319576 2562 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-monitoring/prometheus-operator-admission-webhook-6c4bbc67b7-22k89" May 21 13:03:38.325265 ip-10-0-133-64 kubenswrapper[2562]: I0521 13:03:38.325240 2562 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-monitoring/prometheus-operator-admission-webhook-6c4bbc67b7-22k89" May 21 13:03:38.598773 ip-10-0-133-64 kubenswrapper[2562]: I0521 13:03:38.598683 2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_image-registry-c7d665b66-khpd9_10a964ec-b101-49a4-8dc7-0f208c0fe49d/registry/0.log" May 21 13:03:38.732321 ip-10-0-133-64 kubenswrapper[2562]: I0521 13:03:38.732288 2562 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-insights/insights-runtime-extractor-jhlks"] May 21 13:03:38.752953 ip-10-0-133-64 kubenswrapper[2562]: I0521 13:03:38.752915 2562 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-runtime-extractor-jhlks"] May 21 13:03:38.753125 ip-10-0-133-64 kubenswrapper[2562]: I0521 13:03:38.753048 2562 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-runtime-extractor-jhlks" May 21 13:03:38.755291 ip-10-0-133-64 kubenswrapper[2562]: I0521 13:03:38.755264 2562 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-sa-dockercfg-722bt\"" May 21 13:03:38.755414 ip-10-0-133-64 kubenswrapper[2562]: I0521 13:03:38.755268 2562 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"kube-rbac-proxy\"" May 21 13:03:38.755546 ip-10-0-133-64 kubenswrapper[2562]: I0521 13:03:38.755531 2562 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-tls\"" May 21 13:03:38.824040 ip-10-0-133-64 kubenswrapper[2562]: I0521 13:03:38.824005 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/fe062474-0a60-4dcf-9f4c-b2aa09c03169-crio-socket\") pod \"insights-runtime-extractor-jhlks\" (UID: \"fe062474-0a60-4dcf-9f4c-b2aa09c03169\") " pod="openshift-insights/insights-runtime-extractor-jhlks" May 21 13:03:38.824215 ip-10-0-133-64 kubenswrapper[2562]: I0521 13:03:38.824082 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-k7vvn\" (UniqueName: \"kubernetes.io/projected/fe062474-0a60-4dcf-9f4c-b2aa09c03169-kube-api-access-k7vvn\") pod \"insights-runtime-extractor-jhlks\" (UID: \"fe062474-0a60-4dcf-9f4c-b2aa09c03169\") " pod="openshift-insights/insights-runtime-extractor-jhlks" May 21 13:03:38.824215 ip-10-0-133-64 kubenswrapper[2562]: I0521 13:03:38.824140 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/fe062474-0a60-4dcf-9f4c-b2aa09c03169-data-volume\") pod \"insights-runtime-extractor-jhlks\" (UID: \"fe062474-0a60-4dcf-9f4c-b2aa09c03169\") " pod="openshift-insights/insights-runtime-extractor-jhlks" May 21 13:03:38.824334 ip-10-0-133-64 kubenswrapper[2562]: I0521 13:03:38.824237 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/fe062474-0a60-4dcf-9f4c-b2aa09c03169-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-jhlks\" (UID: \"fe062474-0a60-4dcf-9f4c-b2aa09c03169\") " pod="openshift-insights/insights-runtime-extractor-jhlks" May 21 13:03:38.824334 ip-10-0-133-64 kubenswrapper[2562]: I0521 13:03:38.824277 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/fe062474-0a60-4dcf-9f4c-b2aa09c03169-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-jhlks\" (UID: \"fe062474-0a60-4dcf-9f4c-b2aa09c03169\") " pod="openshift-insights/insights-runtime-extractor-jhlks" May 21 13:03:38.925748 ip-10-0-133-64 kubenswrapper[2562]: I0521 13:03:38.925664 2562 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/fe062474-0a60-4dcf-9f4c-b2aa09c03169-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-jhlks\" (UID: \"fe062474-0a60-4dcf-9f4c-b2aa09c03169\") " pod="openshift-insights/insights-runtime-extractor-jhlks" May 21 13:03:38.925748 ip-10-0-133-64 kubenswrapper[2562]: I0521 13:03:38.925725 2562 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/fe062474-0a60-4dcf-9f4c-b2aa09c03169-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-jhlks\" (UID: \"fe062474-0a60-4dcf-9f4c-b2aa09c03169\") " pod="openshift-insights/insights-runtime-extractor-jhlks" May 21 13:03:38.925945 ip-10-0-133-64 kubenswrapper[2562]: I0521 13:03:38.925763 2562 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/fe062474-0a60-4dcf-9f4c-b2aa09c03169-crio-socket\") pod \"insights-runtime-extractor-jhlks\" (UID: \"fe062474-0a60-4dcf-9f4c-b2aa09c03169\") " pod="openshift-insights/insights-runtime-extractor-jhlks" May 21 13:03:38.925945 ip-10-0-133-64 kubenswrapper[2562]: I0521 13:03:38.925874 2562 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-k7vvn\" (UniqueName: \"kubernetes.io/projected/fe062474-0a60-4dcf-9f4c-b2aa09c03169-kube-api-access-k7vvn\") pod \"insights-runtime-extractor-jhlks\" (UID: \"fe062474-0a60-4dcf-9f4c-b2aa09c03169\") " pod="openshift-insights/insights-runtime-extractor-jhlks" May 21 13:03:38.925945 ip-10-0-133-64 kubenswrapper[2562]: E0521 13:03:38.925899 2562 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found May 21 13:03:38.925945 ip-10-0-133-64 kubenswrapper[2562]: I0521 13:03:38.925914 2562 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/fe062474-0a60-4dcf-9f4c-b2aa09c03169-data-volume\") pod \"insights-runtime-extractor-jhlks\" (UID: \"fe062474-0a60-4dcf-9f4c-b2aa09c03169\") " pod="openshift-insights/insights-runtime-extractor-jhlks" May 21 13:03:38.925945 ip-10-0-133-64 kubenswrapper[2562]: I0521 13:03:38.925936 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/fe062474-0a60-4dcf-9f4c-b2aa09c03169-crio-socket\") pod \"insights-runtime-extractor-jhlks\" (UID: \"fe062474-0a60-4dcf-9f4c-b2aa09c03169\") " pod="openshift-insights/insights-runtime-extractor-jhlks" May 21 13:03:38.926181 ip-10-0-133-64 kubenswrapper[2562]: E0521 13:03:38.925976 2562 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/fe062474-0a60-4dcf-9f4c-b2aa09c03169-insights-runtime-extractor-tls podName:fe062474-0a60-4dcf-9f4c-b2aa09c03169 nodeName:}" failed. No retries permitted until 2026-05-21 13:03:39.425954575 +0000 UTC m=+65.976235924 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/fe062474-0a60-4dcf-9f4c-b2aa09c03169-insights-runtime-extractor-tls") pod "insights-runtime-extractor-jhlks" (UID: "fe062474-0a60-4dcf-9f4c-b2aa09c03169") : secret "insights-runtime-extractor-tls" not found May 21 13:03:38.926244 ip-10-0-133-64 kubenswrapper[2562]: I0521 13:03:38.926233 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/fe062474-0a60-4dcf-9f4c-b2aa09c03169-data-volume\") pod \"insights-runtime-extractor-jhlks\" (UID: \"fe062474-0a60-4dcf-9f4c-b2aa09c03169\") " pod="openshift-insights/insights-runtime-extractor-jhlks" May 21 13:03:38.926323 ip-10-0-133-64 kubenswrapper[2562]: I0521 13:03:38.926307 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/fe062474-0a60-4dcf-9f4c-b2aa09c03169-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-jhlks\" (UID: \"fe062474-0a60-4dcf-9f4c-b2aa09c03169\") " pod="openshift-insights/insights-runtime-extractor-jhlks" May 21 13:03:38.935621 ip-10-0-133-64 kubenswrapper[2562]: I0521 13:03:38.935594 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-k7vvn\" (UniqueName: \"kubernetes.io/projected/fe062474-0a60-4dcf-9f4c-b2aa09c03169-kube-api-access-k7vvn\") pod \"insights-runtime-extractor-jhlks\" (UID: \"fe062474-0a60-4dcf-9f4c-b2aa09c03169\") " pod="openshift-insights/insights-runtime-extractor-jhlks" May 21 13:03:39.198420 ip-10-0-133-64 kubenswrapper[2562]: I0521 13:03:39.198352 2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_node-ca-lm4qk_da3fc398-1999-44e7-80b5-5f699d3f7744/node-ca/0.log" May 21 13:03:39.401512 ip-10-0-133-64 kubenswrapper[2562]: I0521 13:03:39.401472 2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_router-default-66c9cf854b-46gbc_7ba99752-9a0f-4032-a47f-8e1df0d52758/router/0.log" May 21 13:03:39.430678 ip-10-0-133-64 kubenswrapper[2562]: I0521 13:03:39.430645 2562 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/fe062474-0a60-4dcf-9f4c-b2aa09c03169-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-jhlks\" (UID: \"fe062474-0a60-4dcf-9f4c-b2aa09c03169\") " pod="openshift-insights/insights-runtime-extractor-jhlks" May 21 13:03:39.432895 ip-10-0-133-64 kubenswrapper[2562]: I0521 13:03:39.432866 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/fe062474-0a60-4dcf-9f4c-b2aa09c03169-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-jhlks\" (UID: \"fe062474-0a60-4dcf-9f4c-b2aa09c03169\") " pod="openshift-insights/insights-runtime-extractor-jhlks" May 21 13:03:39.599320 ip-10-0-133-64 kubenswrapper[2562]: I0521 13:03:39.599293 2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress-canary_ingress-canary-6d7rg_ceb9bb27-e558-4ca2-9baf-cc21c0216ef6/serve-healthcheck-canary/0.log" May 21 13:03:39.662163 ip-10-0-133-64 kubenswrapper[2562]: I0521 13:03:39.662123 2562 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-runtime-extractor-jhlks" May 21 13:03:39.732464 ip-10-0-133-64 kubenswrapper[2562]: I0521 13:03:39.732425 2562 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/8fd03c97-7fa6-42e9-ab95-5fde631dcd29-metrics-certs\") pod \"network-metrics-daemon-fhvt9\" (UID: \"8fd03c97-7fa6-42e9-ab95-5fde631dcd29\") " pod="openshift-multus/network-metrics-daemon-fhvt9" May 21 13:03:39.735253 ip-10-0-133-64 kubenswrapper[2562]: I0521 13:03:39.735212 2562 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-secret\"" May 21 13:03:39.746174 ip-10-0-133-64 kubenswrapper[2562]: I0521 13:03:39.746127 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/8fd03c97-7fa6-42e9-ab95-5fde631dcd29-metrics-certs\") pod \"network-metrics-daemon-fhvt9\" (UID: \"8fd03c97-7fa6-42e9-ab95-5fde631dcd29\") " pod="openshift-multus/network-metrics-daemon-fhvt9" May 21 13:03:39.804197 ip-10-0-133-64 kubenswrapper[2562]: I0521 13:03:39.804163 2562 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-runtime-extractor-jhlks"] May 21 13:03:39.807938 ip-10-0-133-64 kubenswrapper[2562]: W0521 13:03:39.807906 2562 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podfe062474_0a60_4dcf_9f4c_b2aa09c03169.slice/crio-f89cbc56547d7f85dcba3c0d216bd9252d5d4dcaee4cd8c1b41615788f7ef1c0 WatchSource:0}: Error finding container f89cbc56547d7f85dcba3c0d216bd9252d5d4dcaee4cd8c1b41615788f7ef1c0: Status 404 returned error can't find the container with id f89cbc56547d7f85dcba3c0d216bd9252d5d4dcaee4cd8c1b41615788f7ef1c0 May 21 13:03:39.833526 ip-10-0-133-64 kubenswrapper[2562]: I0521 13:03:39.833493 2562 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-2r7z9\" (UniqueName: \"kubernetes.io/projected/9e5a4d6a-bac9-4fb2-97b6-ae1675433f6e-kube-api-access-2r7z9\") pod \"network-check-target-zkhxz\" (UID: \"9e5a4d6a-bac9-4fb2-97b6-ae1675433f6e\") " pod="openshift-network-diagnostics/network-check-target-zkhxz" May 21 13:03:39.835987 ip-10-0-133-64 kubenswrapper[2562]: I0521 13:03:39.835968 2562 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"kube-root-ca.crt\"" May 21 13:03:39.847295 ip-10-0-133-64 kubenswrapper[2562]: I0521 13:03:39.847270 2562 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"openshift-service-ca.crt\"" May 21 13:03:39.857999 ip-10-0-133-64 kubenswrapper[2562]: I0521 13:03:39.857937 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-2r7z9\" (UniqueName: \"kubernetes.io/projected/9e5a4d6a-bac9-4fb2-97b6-ae1675433f6e-kube-api-access-2r7z9\") pod \"network-check-target-zkhxz\" (UID: \"9e5a4d6a-bac9-4fb2-97b6-ae1675433f6e\") " pod="openshift-network-diagnostics/network-check-target-zkhxz" May 21 13:03:39.944313 ip-10-0-133-64 kubenswrapper[2562]: I0521 13:03:39.944288 2562 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-sa-dockercfg-dfgjb\"" May 21 13:03:39.951627 ip-10-0-133-64 kubenswrapper[2562]: I0521 13:03:39.951586 2562 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"default-dockercfg-b4mfv\"" May 21 13:03:39.952570 ip-10-0-133-64 kubenswrapper[2562]: I0521 13:03:39.952547 2562 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-fhvt9" May 21 13:03:39.958360 ip-10-0-133-64 kubenswrapper[2562]: I0521 13:03:39.958264 2562 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-zkhxz" May 21 13:03:40.102823 ip-10-0-133-64 kubenswrapper[2562]: I0521 13:03:40.102763 2562 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-multus/network-metrics-daemon-fhvt9"] May 21 13:03:40.107010 ip-10-0-133-64 kubenswrapper[2562]: W0521 13:03:40.106967 2562 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod8fd03c97_7fa6_42e9_ab95_5fde631dcd29.slice/crio-70fee7daf093f7aeeeb0c0c3fef11c25881165741293ade841553cc4cbc90ae9 WatchSource:0}: Error finding container 70fee7daf093f7aeeeb0c0c3fef11c25881165741293ade841553cc4cbc90ae9: Status 404 returned error can't find the container with id 70fee7daf093f7aeeeb0c0c3fef11c25881165741293ade841553cc4cbc90ae9 May 21 13:03:40.134684 ip-10-0-133-64 kubenswrapper[2562]: I0521 13:03:40.134631 2562 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-target-zkhxz"] May 21 13:03:40.138615 ip-10-0-133-64 kubenswrapper[2562]: W0521 13:03:40.138563 2562 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod9e5a4d6a_bac9_4fb2_97b6_ae1675433f6e.slice/crio-95e01879c35ea8c92a5bb9c8c6f87c93fbd6095aae2f7dee26ed696555bf5359 WatchSource:0}: Error finding container 95e01879c35ea8c92a5bb9c8c6f87c93fbd6095aae2f7dee26ed696555bf5359: Status 404 returned error can't find the container with id 95e01879c35ea8c92a5bb9c8c6f87c93fbd6095aae2f7dee26ed696555bf5359 May 21 13:03:40.269597 ip-10-0-133-64 kubenswrapper[2562]: I0521 13:03:40.269546 2562 patch_prober.go:28] interesting pod/image-registry-c7d665b66-khpd9 container/registry namespace/openshift-image-registry: Readiness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body={"errors":[{"code":"UNAVAILABLE","message":"service unavailable","detail":"health check failed: please see /debug/health"}]} May 21 13:03:40.269761 ip-10-0-133-64 kubenswrapper[2562]: I0521 13:03:40.269616 2562 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-image-registry/image-registry-c7d665b66-khpd9" podUID="10a964ec-b101-49a4-8dc7-0f208c0fe49d" containerName="registry" probeResult="failure" output="HTTP probe failed with statuscode: 503" May 21 13:03:40.326717 ip-10-0-133-64 kubenswrapper[2562]: I0521 13:03:40.326681 2562 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-fhvt9" event={"ID":"8fd03c97-7fa6-42e9-ab95-5fde631dcd29","Type":"ContainerStarted","Data":"70fee7daf093f7aeeeb0c0c3fef11c25881165741293ade841553cc4cbc90ae9"} May 21 13:03:40.328298 ip-10-0-133-64 kubenswrapper[2562]: I0521 13:03:40.328269 2562 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-jhlks" event={"ID":"fe062474-0a60-4dcf-9f4c-b2aa09c03169","Type":"ContainerStarted","Data":"a622a080761034d40171259c533ea9e4004eeeb81c8fc26006414d6ad06dbae3"} May 21 13:03:40.328419 ip-10-0-133-64 kubenswrapper[2562]: I0521 13:03:40.328307 2562 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-jhlks" event={"ID":"fe062474-0a60-4dcf-9f4c-b2aa09c03169","Type":"ContainerStarted","Data":"f89cbc56547d7f85dcba3c0d216bd9252d5d4dcaee4cd8c1b41615788f7ef1c0"} May 21 13:03:40.329591 ip-10-0-133-64 kubenswrapper[2562]: I0521 13:03:40.329557 2562 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-target-zkhxz" event={"ID":"9e5a4d6a-bac9-4fb2-97b6-ae1675433f6e","Type":"ContainerStarted","Data":"95e01879c35ea8c92a5bb9c8c6f87c93fbd6095aae2f7dee26ed696555bf5359"} May 21 13:03:42.337548 ip-10-0-133-64 kubenswrapper[2562]: I0521 13:03:42.337404 2562 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-fhvt9" event={"ID":"8fd03c97-7fa6-42e9-ab95-5fde631dcd29","Type":"ContainerStarted","Data":"e25b0533a7429287ead923fed49fcea4bed6cb315522b56afff3f9d3c040fac0"} May 21 13:03:42.337548 ip-10-0-133-64 kubenswrapper[2562]: I0521 13:03:42.337451 2562 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-fhvt9" event={"ID":"8fd03c97-7fa6-42e9-ab95-5fde631dcd29","Type":"ContainerStarted","Data":"b1bad4d1b0ae7ce1bffd6cd46891f463f0b6c934ad43b89e7da930dbf7076774"} May 21 13:03:42.340115 ip-10-0-133-64 kubenswrapper[2562]: I0521 13:03:42.340073 2562 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-jhlks" event={"ID":"fe062474-0a60-4dcf-9f4c-b2aa09c03169","Type":"ContainerStarted","Data":"008d39f4c50d614211e9dd738c29e4d4da160c0d52efd072bc204d602becd9f0"} May 21 13:03:42.355990 ip-10-0-133-64 kubenswrapper[2562]: I0521 13:03:42.355941 2562 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-multus/network-metrics-daemon-fhvt9" podStartSLOduration=66.908048841 podStartE2EDuration="1m8.355926538s" podCreationTimestamp="2026-05-21 13:02:34 +0000 UTC" firstStartedPulling="2026-05-21 13:03:40.113087019 +0000 UTC m=+66.663368380" lastFinishedPulling="2026-05-21 13:03:41.560964719 +0000 UTC m=+68.111246077" observedRunningTime="2026-05-21 13:03:42.353741295 +0000 UTC m=+68.904022663" watchObservedRunningTime="2026-05-21 13:03:42.355926538 +0000 UTC m=+68.906207910" May 21 13:03:45.355599 ip-10-0-133-64 kubenswrapper[2562]: I0521 13:03:45.355560 2562 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-jhlks" event={"ID":"fe062474-0a60-4dcf-9f4c-b2aa09c03169","Type":"ContainerStarted","Data":"d50a7839e846896fac11f0542a6bc0d6035fa6362f50e160e537a9d640f6f497"} May 21 13:03:45.357562 ip-10-0-133-64 kubenswrapper[2562]: I0521 13:03:45.357529 2562 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-target-zkhxz" event={"ID":"9e5a4d6a-bac9-4fb2-97b6-ae1675433f6e","Type":"ContainerStarted","Data":"3444ebad4883180af3fee587a09cc2c7c3b10c16f3389d92597107fa37caa5a2"} May 21 13:03:45.357692 ip-10-0-133-64 kubenswrapper[2562]: I0521 13:03:45.357591 2562 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-network-diagnostics/network-check-target-zkhxz" May 21 13:03:45.378383 ip-10-0-133-64 kubenswrapper[2562]: I0521 13:03:45.378324 2562 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-insights/insights-runtime-extractor-jhlks" podStartSLOduration=2.816226017 podStartE2EDuration="7.378306486s" podCreationTimestamp="2026-05-21 13:03:38 +0000 UTC" firstStartedPulling="2026-05-21 13:03:39.945232118 +0000 UTC m=+66.495513477" lastFinishedPulling="2026-05-21 13:03:44.507312595 +0000 UTC m=+71.057593946" observedRunningTime="2026-05-21 13:03:45.377018881 +0000 UTC m=+71.927300249" watchObservedRunningTime="2026-05-21 13:03:45.378306486 +0000 UTC m=+71.928587855" May 21 13:03:45.393444 ip-10-0-133-64 kubenswrapper[2562]: I0521 13:03:45.393393 2562 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-network-diagnostics/network-check-target-zkhxz" podStartSLOduration=67.019367826 podStartE2EDuration="1m11.393379318s" podCreationTimestamp="2026-05-21 13:02:34 +0000 UTC" firstStartedPulling="2026-05-21 13:03:40.141781242 +0000 UTC m=+66.692062604" lastFinishedPulling="2026-05-21 13:03:44.515792749 +0000 UTC m=+71.066074096" observedRunningTime="2026-05-21 13:03:45.392389738 +0000 UTC m=+71.942671107" watchObservedRunningTime="2026-05-21 13:03:45.393379318 +0000 UTC m=+71.943660687" May 21 13:03:45.967002 ip-10-0-133-64 kubenswrapper[2562]: I0521 13:03:45.966941 2562 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-monitoring/node-exporter-j52sx"] May 21 13:03:45.971194 ip-10-0-133-64 kubenswrapper[2562]: I0521 13:03:45.971095 2562 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/node-exporter-j52sx" May 21 13:03:45.973902 ip-10-0-133-64 kubenswrapper[2562]: I0521 13:03:45.973880 2562 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-tls\"" May 21 13:03:45.974286 ip-10-0-133-64 kubenswrapper[2562]: I0521 13:03:45.974038 2562 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"metrics-client-ca\"" May 21 13:03:45.974286 ip-10-0-133-64 kubenswrapper[2562]: I0521 13:03:45.973986 2562 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-kube-rbac-proxy-config\"" May 21 13:03:45.974286 ip-10-0-133-64 kubenswrapper[2562]: I0521 13:03:45.974173 2562 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"node-exporter-accelerators-collector-config\"" May 21 13:03:45.974622 ip-10-0-133-64 kubenswrapper[2562]: I0521 13:03:45.974600 2562 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-dockercfg-2vl85\"" May 21 13:03:46.087514 ip-10-0-133-64 kubenswrapper[2562]: I0521 13:03:46.087350 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/bec846a9-572c-4fce-a95a-492bc285b1d3-node-exporter-accelerators-collector-config\") pod \"node-exporter-j52sx\" (UID: \"bec846a9-572c-4fce-a95a-492bc285b1d3\") " pod="openshift-monitoring/node-exporter-j52sx" May 21 13:03:46.087514 ip-10-0-133-64 kubenswrapper[2562]: I0521 13:03:46.087403 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/bec846a9-572c-4fce-a95a-492bc285b1d3-node-exporter-tls\") pod \"node-exporter-j52sx\" (UID: \"bec846a9-572c-4fce-a95a-492bc285b1d3\") " pod="openshift-monitoring/node-exporter-j52sx" May 21 13:03:46.087514 ip-10-0-133-64 kubenswrapper[2562]: I0521 13:03:46.087444 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-6f4g2\" (UniqueName: \"kubernetes.io/projected/bec846a9-572c-4fce-a95a-492bc285b1d3-kube-api-access-6f4g2\") pod \"node-exporter-j52sx\" (UID: \"bec846a9-572c-4fce-a95a-492bc285b1d3\") " pod="openshift-monitoring/node-exporter-j52sx" May 21 13:03:46.087514 ip-10-0-133-64 kubenswrapper[2562]: I0521 13:03:46.087516 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/bec846a9-572c-4fce-a95a-492bc285b1d3-metrics-client-ca\") pod \"node-exporter-j52sx\" (UID: \"bec846a9-572c-4fce-a95a-492bc285b1d3\") " pod="openshift-monitoring/node-exporter-j52sx" May 21 13:03:46.087867 ip-10-0-133-64 kubenswrapper[2562]: I0521 13:03:46.087564 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/bec846a9-572c-4fce-a95a-492bc285b1d3-node-exporter-textfile\") pod \"node-exporter-j52sx\" (UID: \"bec846a9-572c-4fce-a95a-492bc285b1d3\") " pod="openshift-monitoring/node-exporter-j52sx" May 21 13:03:46.087867 ip-10-0-133-64 kubenswrapper[2562]: I0521 13:03:46.087603 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/bec846a9-572c-4fce-a95a-492bc285b1d3-node-exporter-wtmp\") pod \"node-exporter-j52sx\" (UID: \"bec846a9-572c-4fce-a95a-492bc285b1d3\") " pod="openshift-monitoring/node-exporter-j52sx" May 21 13:03:46.087867 ip-10-0-133-64 kubenswrapper[2562]: I0521 13:03:46.087634 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/bec846a9-572c-4fce-a95a-492bc285b1d3-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-j52sx\" (UID: \"bec846a9-572c-4fce-a95a-492bc285b1d3\") " pod="openshift-monitoring/node-exporter-j52sx" May 21 13:03:46.087867 ip-10-0-133-64 kubenswrapper[2562]: I0521 13:03:46.087663 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/bec846a9-572c-4fce-a95a-492bc285b1d3-sys\") pod \"node-exporter-j52sx\" (UID: \"bec846a9-572c-4fce-a95a-492bc285b1d3\") " pod="openshift-monitoring/node-exporter-j52sx" May 21 13:03:46.087867 ip-10-0-133-64 kubenswrapper[2562]: I0521 13:03:46.087701 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"root\" (UniqueName: \"kubernetes.io/host-path/bec846a9-572c-4fce-a95a-492bc285b1d3-root\") pod \"node-exporter-j52sx\" (UID: \"bec846a9-572c-4fce-a95a-492bc285b1d3\") " pod="openshift-monitoring/node-exporter-j52sx" May 21 13:03:46.188820 ip-10-0-133-64 kubenswrapper[2562]: I0521 13:03:46.188770 2562 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-6f4g2\" (UniqueName: \"kubernetes.io/projected/bec846a9-572c-4fce-a95a-492bc285b1d3-kube-api-access-6f4g2\") pod \"node-exporter-j52sx\" (UID: \"bec846a9-572c-4fce-a95a-492bc285b1d3\") " pod="openshift-monitoring/node-exporter-j52sx" May 21 13:03:46.188973 ip-10-0-133-64 kubenswrapper[2562]: I0521 13:03:46.188844 2562 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/bec846a9-572c-4fce-a95a-492bc285b1d3-metrics-client-ca\") pod \"node-exporter-j52sx\" (UID: \"bec846a9-572c-4fce-a95a-492bc285b1d3\") " pod="openshift-monitoring/node-exporter-j52sx" May 21 13:03:46.188973 ip-10-0-133-64 kubenswrapper[2562]: I0521 13:03:46.188892 2562 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/bec846a9-572c-4fce-a95a-492bc285b1d3-node-exporter-textfile\") pod \"node-exporter-j52sx\" (UID: \"bec846a9-572c-4fce-a95a-492bc285b1d3\") " pod="openshift-monitoring/node-exporter-j52sx" May 21 13:03:46.188973 ip-10-0-133-64 kubenswrapper[2562]: I0521 13:03:46.188939 2562 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/bec846a9-572c-4fce-a95a-492bc285b1d3-node-exporter-wtmp\") pod \"node-exporter-j52sx\" (UID: \"bec846a9-572c-4fce-a95a-492bc285b1d3\") " pod="openshift-monitoring/node-exporter-j52sx" May 21 13:03:46.189084 ip-10-0-133-64 kubenswrapper[2562]: I0521 13:03:46.188975 2562 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/bec846a9-572c-4fce-a95a-492bc285b1d3-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-j52sx\" (UID: \"bec846a9-572c-4fce-a95a-492bc285b1d3\") " pod="openshift-monitoring/node-exporter-j52sx" May 21 13:03:46.189084 ip-10-0-133-64 kubenswrapper[2562]: I0521 13:03:46.189008 2562 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/bec846a9-572c-4fce-a95a-492bc285b1d3-sys\") pod \"node-exporter-j52sx\" (UID: \"bec846a9-572c-4fce-a95a-492bc285b1d3\") " pod="openshift-monitoring/node-exporter-j52sx" May 21 13:03:46.189084 ip-10-0-133-64 kubenswrapper[2562]: I0521 13:03:46.189052 2562 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"root\" (UniqueName: \"kubernetes.io/host-path/bec846a9-572c-4fce-a95a-492bc285b1d3-root\") pod \"node-exporter-j52sx\" (UID: \"bec846a9-572c-4fce-a95a-492bc285b1d3\") " pod="openshift-monitoring/node-exporter-j52sx" May 21 13:03:46.189172 ip-10-0-133-64 kubenswrapper[2562]: I0521 13:03:46.189080 2562 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/bec846a9-572c-4fce-a95a-492bc285b1d3-node-exporter-accelerators-collector-config\") pod \"node-exporter-j52sx\" (UID: \"bec846a9-572c-4fce-a95a-492bc285b1d3\") " pod="openshift-monitoring/node-exporter-j52sx" May 21 13:03:46.189172 ip-10-0-133-64 kubenswrapper[2562]: I0521 13:03:46.189116 2562 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/bec846a9-572c-4fce-a95a-492bc285b1d3-node-exporter-tls\") pod \"node-exporter-j52sx\" (UID: \"bec846a9-572c-4fce-a95a-492bc285b1d3\") " pod="openshift-monitoring/node-exporter-j52sx" May 21 13:03:46.189300 ip-10-0-133-64 kubenswrapper[2562]: E0521 13:03:46.189285 2562 secret.go:189] Couldn't get secret openshift-monitoring/node-exporter-tls: secret "node-exporter-tls" not found May 21 13:03:46.189362 ip-10-0-133-64 kubenswrapper[2562]: E0521 13:03:46.189353 2562 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/bec846a9-572c-4fce-a95a-492bc285b1d3-node-exporter-tls podName:bec846a9-572c-4fce-a95a-492bc285b1d3 nodeName:}" failed. No retries permitted until 2026-05-21 13:03:46.689331993 +0000 UTC m=+73.239613359 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "node-exporter-tls" (UniqueName: "kubernetes.io/secret/bec846a9-572c-4fce-a95a-492bc285b1d3-node-exporter-tls") pod "node-exporter-j52sx" (UID: "bec846a9-572c-4fce-a95a-492bc285b1d3") : secret "node-exporter-tls" not found May 21 13:03:46.189710 ip-10-0-133-64 kubenswrapper[2562]: I0521 13:03:46.189490 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/bec846a9-572c-4fce-a95a-492bc285b1d3-sys\") pod \"node-exporter-j52sx\" (UID: \"bec846a9-572c-4fce-a95a-492bc285b1d3\") " pod="openshift-monitoring/node-exporter-j52sx" May 21 13:03:46.189976 ip-10-0-133-64 kubenswrapper[2562]: I0521 13:03:46.189949 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"root\" (UniqueName: \"kubernetes.io/host-path/bec846a9-572c-4fce-a95a-492bc285b1d3-root\") pod \"node-exporter-j52sx\" (UID: \"bec846a9-572c-4fce-a95a-492bc285b1d3\") " pod="openshift-monitoring/node-exporter-j52sx" May 21 13:03:46.189976 ip-10-0-133-64 kubenswrapper[2562]: I0521 13:03:46.189967 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/bec846a9-572c-4fce-a95a-492bc285b1d3-node-exporter-wtmp\") pod \"node-exporter-j52sx\" (UID: \"bec846a9-572c-4fce-a95a-492bc285b1d3\") " pod="openshift-monitoring/node-exporter-j52sx" May 21 13:03:46.190151 ip-10-0-133-64 kubenswrapper[2562]: I0521 13:03:46.190060 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/bec846a9-572c-4fce-a95a-492bc285b1d3-node-exporter-accelerators-collector-config\") pod \"node-exporter-j52sx\" (UID: \"bec846a9-572c-4fce-a95a-492bc285b1d3\") " pod="openshift-monitoring/node-exporter-j52sx" May 21 13:03:46.190151 ip-10-0-133-64 kubenswrapper[2562]: I0521 13:03:46.190060 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/bec846a9-572c-4fce-a95a-492bc285b1d3-metrics-client-ca\") pod \"node-exporter-j52sx\" (UID: \"bec846a9-572c-4fce-a95a-492bc285b1d3\") " pod="openshift-monitoring/node-exporter-j52sx" May 21 13:03:46.190340 ip-10-0-133-64 kubenswrapper[2562]: I0521 13:03:46.190318 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/bec846a9-572c-4fce-a95a-492bc285b1d3-node-exporter-textfile\") pod \"node-exporter-j52sx\" (UID: \"bec846a9-572c-4fce-a95a-492bc285b1d3\") " pod="openshift-monitoring/node-exporter-j52sx" May 21 13:03:46.192482 ip-10-0-133-64 kubenswrapper[2562]: I0521 13:03:46.192440 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/bec846a9-572c-4fce-a95a-492bc285b1d3-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-j52sx\" (UID: \"bec846a9-572c-4fce-a95a-492bc285b1d3\") " pod="openshift-monitoring/node-exporter-j52sx" May 21 13:03:46.199517 ip-10-0-133-64 kubenswrapper[2562]: I0521 13:03:46.199494 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-6f4g2\" (UniqueName: \"kubernetes.io/projected/bec846a9-572c-4fce-a95a-492bc285b1d3-kube-api-access-6f4g2\") pod \"node-exporter-j52sx\" (UID: \"bec846a9-572c-4fce-a95a-492bc285b1d3\") " pod="openshift-monitoring/node-exporter-j52sx" May 21 13:03:46.694784 ip-10-0-133-64 kubenswrapper[2562]: I0521 13:03:46.694750 2562 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/bec846a9-572c-4fce-a95a-492bc285b1d3-node-exporter-tls\") pod \"node-exporter-j52sx\" (UID: \"bec846a9-572c-4fce-a95a-492bc285b1d3\") " pod="openshift-monitoring/node-exporter-j52sx" May 21 13:03:46.697200 ip-10-0-133-64 kubenswrapper[2562]: I0521 13:03:46.697174 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/bec846a9-572c-4fce-a95a-492bc285b1d3-node-exporter-tls\") pod \"node-exporter-j52sx\" (UID: \"bec846a9-572c-4fce-a95a-492bc285b1d3\") " pod="openshift-monitoring/node-exporter-j52sx" May 21 13:03:46.885907 ip-10-0-133-64 kubenswrapper[2562]: I0521 13:03:46.885393 2562 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/node-exporter-j52sx" May 21 13:03:46.897066 ip-10-0-133-64 kubenswrapper[2562]: W0521 13:03:46.897031 2562 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podbec846a9_572c_4fce_a95a_492bc285b1d3.slice/crio-8cfbac690229ddf738d15f46043561a2597163943a900385b7835619792812e3 WatchSource:0}: Error finding container 8cfbac690229ddf738d15f46043561a2597163943a900385b7835619792812e3: Status 404 returned error can't find the container with id 8cfbac690229ddf738d15f46043561a2597163943a900385b7835619792812e3 May 21 13:03:47.364945 ip-10-0-133-64 kubenswrapper[2562]: I0521 13:03:47.364908 2562 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-j52sx" event={"ID":"bec846a9-572c-4fce-a95a-492bc285b1d3","Type":"ContainerStarted","Data":"8cfbac690229ddf738d15f46043561a2597163943a900385b7835619792812e3"} May 21 13:03:50.268376 ip-10-0-133-64 kubenswrapper[2562]: I0521 13:03:50.268337 2562 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-image-registry/image-registry-c7d665b66-khpd9" May 21 13:03:52.291536 ip-10-0-133-64 kubenswrapper[2562]: I0521 13:03:52.291505 2562 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-image-registry/image-registry-59f998bd79-jn4d2" May 21 13:03:54.653555 ip-10-0-133-64 kubenswrapper[2562]: I0521 13:03:54.653414 2562 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-console/console-76bf65bdf9-7jrrj"] May 21 13:03:54.659453 ip-10-0-133-64 kubenswrapper[2562]: I0521 13:03:54.659423 2562 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-76bf65bdf9-7jrrj" May 21 13:03:54.662243 ip-10-0-133-64 kubenswrapper[2562]: I0521 13:03:54.662221 2562 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-dockercfg-s69mp\"" May 21 13:03:54.663734 ip-10-0-133-64 kubenswrapper[2562]: I0521 13:03:54.663710 2562 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"service-ca\"" May 21 13:03:54.663734 ip-10-0-133-64 kubenswrapper[2562]: I0521 13:03:54.663737 2562 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"oauth-serving-cert\"" May 21 13:03:54.663734 ip-10-0-133-64 kubenswrapper[2562]: I0521 13:03:54.663712 2562 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-oauth-config\"" May 21 13:03:54.663990 ip-10-0-133-64 kubenswrapper[2562]: I0521 13:03:54.663929 2562 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"console-config\"" May 21 13:03:54.664908 ip-10-0-133-64 kubenswrapper[2562]: I0521 13:03:54.664788 2562 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-serving-cert\"" May 21 13:03:54.666776 ip-10-0-133-64 kubenswrapper[2562]: I0521 13:03:54.666719 2562 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-76bf65bdf9-7jrrj"] May 21 13:03:54.674843 ip-10-0-133-64 kubenswrapper[2562]: I0521 13:03:54.674822 2562 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"trusted-ca-bundle\"" May 21 13:03:54.776717 ip-10-0-133-64 kubenswrapper[2562]: I0521 13:03:54.776674 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-h7c9v\" (UniqueName: \"kubernetes.io/projected/50cae0dc-98da-468c-9874-fdfc3fa80322-kube-api-access-h7c9v\") pod \"console-76bf65bdf9-7jrrj\" (UID: \"50cae0dc-98da-468c-9874-fdfc3fa80322\") " pod="openshift-console/console-76bf65bdf9-7jrrj" May 21 13:03:54.776887 ip-10-0-133-64 kubenswrapper[2562]: I0521 13:03:54.776729 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/50cae0dc-98da-468c-9874-fdfc3fa80322-oauth-serving-cert\") pod \"console-76bf65bdf9-7jrrj\" (UID: \"50cae0dc-98da-468c-9874-fdfc3fa80322\") " pod="openshift-console/console-76bf65bdf9-7jrrj" May 21 13:03:54.776887 ip-10-0-133-64 kubenswrapper[2562]: I0521 13:03:54.776825 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/50cae0dc-98da-468c-9874-fdfc3fa80322-console-oauth-config\") pod \"console-76bf65bdf9-7jrrj\" (UID: \"50cae0dc-98da-468c-9874-fdfc3fa80322\") " pod="openshift-console/console-76bf65bdf9-7jrrj" May 21 13:03:54.776887 ip-10-0-133-64 kubenswrapper[2562]: I0521 13:03:54.776857 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/50cae0dc-98da-468c-9874-fdfc3fa80322-trusted-ca-bundle\") pod \"console-76bf65bdf9-7jrrj\" (UID: \"50cae0dc-98da-468c-9874-fdfc3fa80322\") " pod="openshift-console/console-76bf65bdf9-7jrrj" May 21 13:03:54.777062 ip-10-0-133-64 kubenswrapper[2562]: I0521 13:03:54.776896 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/50cae0dc-98da-468c-9874-fdfc3fa80322-console-serving-cert\") pod \"console-76bf65bdf9-7jrrj\" (UID: \"50cae0dc-98da-468c-9874-fdfc3fa80322\") " pod="openshift-console/console-76bf65bdf9-7jrrj" May 21 13:03:54.777062 ip-10-0-133-64 kubenswrapper[2562]: I0521 13:03:54.776952 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/50cae0dc-98da-468c-9874-fdfc3fa80322-console-config\") pod \"console-76bf65bdf9-7jrrj\" (UID: \"50cae0dc-98da-468c-9874-fdfc3fa80322\") " pod="openshift-console/console-76bf65bdf9-7jrrj" May 21 13:03:54.777062 ip-10-0-133-64 kubenswrapper[2562]: I0521 13:03:54.777009 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/50cae0dc-98da-468c-9874-fdfc3fa80322-service-ca\") pod \"console-76bf65bdf9-7jrrj\" (UID: \"50cae0dc-98da-468c-9874-fdfc3fa80322\") " pod="openshift-console/console-76bf65bdf9-7jrrj" May 21 13:03:54.878034 ip-10-0-133-64 kubenswrapper[2562]: I0521 13:03:54.877998 2562 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/50cae0dc-98da-468c-9874-fdfc3fa80322-console-oauth-config\") pod \"console-76bf65bdf9-7jrrj\" (UID: \"50cae0dc-98da-468c-9874-fdfc3fa80322\") " pod="openshift-console/console-76bf65bdf9-7jrrj" May 21 13:03:54.878253 ip-10-0-133-64 kubenswrapper[2562]: I0521 13:03:54.878042 2562 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/50cae0dc-98da-468c-9874-fdfc3fa80322-trusted-ca-bundle\") pod \"console-76bf65bdf9-7jrrj\" (UID: \"50cae0dc-98da-468c-9874-fdfc3fa80322\") " pod="openshift-console/console-76bf65bdf9-7jrrj" May 21 13:03:54.878253 ip-10-0-133-64 kubenswrapper[2562]: I0521 13:03:54.878072 2562 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/50cae0dc-98da-468c-9874-fdfc3fa80322-console-serving-cert\") pod \"console-76bf65bdf9-7jrrj\" (UID: \"50cae0dc-98da-468c-9874-fdfc3fa80322\") " pod="openshift-console/console-76bf65bdf9-7jrrj" May 21 13:03:54.878253 ip-10-0-133-64 kubenswrapper[2562]: I0521 13:03:54.878115 2562 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/50cae0dc-98da-468c-9874-fdfc3fa80322-console-config\") pod \"console-76bf65bdf9-7jrrj\" (UID: \"50cae0dc-98da-468c-9874-fdfc3fa80322\") " pod="openshift-console/console-76bf65bdf9-7jrrj" May 21 13:03:54.878253 ip-10-0-133-64 kubenswrapper[2562]: I0521 13:03:54.878162 2562 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/50cae0dc-98da-468c-9874-fdfc3fa80322-service-ca\") pod \"console-76bf65bdf9-7jrrj\" (UID: \"50cae0dc-98da-468c-9874-fdfc3fa80322\") " pod="openshift-console/console-76bf65bdf9-7jrrj" May 21 13:03:54.878253 ip-10-0-133-64 kubenswrapper[2562]: I0521 13:03:54.878221 2562 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-h7c9v\" (UniqueName: \"kubernetes.io/projected/50cae0dc-98da-468c-9874-fdfc3fa80322-kube-api-access-h7c9v\") pod \"console-76bf65bdf9-7jrrj\" (UID: \"50cae0dc-98da-468c-9874-fdfc3fa80322\") " pod="openshift-console/console-76bf65bdf9-7jrrj" May 21 13:03:54.878253 ip-10-0-133-64 kubenswrapper[2562]: I0521 13:03:54.878251 2562 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/50cae0dc-98da-468c-9874-fdfc3fa80322-oauth-serving-cert\") pod \"console-76bf65bdf9-7jrrj\" (UID: \"50cae0dc-98da-468c-9874-fdfc3fa80322\") " pod="openshift-console/console-76bf65bdf9-7jrrj" May 21 13:03:54.879013 ip-10-0-133-64 kubenswrapper[2562]: I0521 13:03:54.878960 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/50cae0dc-98da-468c-9874-fdfc3fa80322-service-ca\") pod \"console-76bf65bdf9-7jrrj\" (UID: \"50cae0dc-98da-468c-9874-fdfc3fa80322\") " pod="openshift-console/console-76bf65bdf9-7jrrj" May 21 13:03:54.879013 ip-10-0-133-64 kubenswrapper[2562]: I0521 13:03:54.878999 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/50cae0dc-98da-468c-9874-fdfc3fa80322-console-config\") pod \"console-76bf65bdf9-7jrrj\" (UID: \"50cae0dc-98da-468c-9874-fdfc3fa80322\") " pod="openshift-console/console-76bf65bdf9-7jrrj" May 21 13:03:54.879176 ip-10-0-133-64 kubenswrapper[2562]: I0521 13:03:54.879056 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/50cae0dc-98da-468c-9874-fdfc3fa80322-trusted-ca-bundle\") pod \"console-76bf65bdf9-7jrrj\" (UID: \"50cae0dc-98da-468c-9874-fdfc3fa80322\") " pod="openshift-console/console-76bf65bdf9-7jrrj" May 21 13:03:54.879176 ip-10-0-133-64 kubenswrapper[2562]: I0521 13:03:54.879109 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/50cae0dc-98da-468c-9874-fdfc3fa80322-oauth-serving-cert\") pod \"console-76bf65bdf9-7jrrj\" (UID: \"50cae0dc-98da-468c-9874-fdfc3fa80322\") " pod="openshift-console/console-76bf65bdf9-7jrrj" May 21 13:03:54.881084 ip-10-0-133-64 kubenswrapper[2562]: I0521 13:03:54.881058 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/50cae0dc-98da-468c-9874-fdfc3fa80322-console-serving-cert\") pod \"console-76bf65bdf9-7jrrj\" (UID: \"50cae0dc-98da-468c-9874-fdfc3fa80322\") " pod="openshift-console/console-76bf65bdf9-7jrrj" May 21 13:03:54.881185 ip-10-0-133-64 kubenswrapper[2562]: I0521 13:03:54.881145 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/50cae0dc-98da-468c-9874-fdfc3fa80322-console-oauth-config\") pod \"console-76bf65bdf9-7jrrj\" (UID: \"50cae0dc-98da-468c-9874-fdfc3fa80322\") " pod="openshift-console/console-76bf65bdf9-7jrrj" May 21 13:03:54.887914 ip-10-0-133-64 kubenswrapper[2562]: I0521 13:03:54.887869 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-h7c9v\" (UniqueName: \"kubernetes.io/projected/50cae0dc-98da-468c-9874-fdfc3fa80322-kube-api-access-h7c9v\") pod \"console-76bf65bdf9-7jrrj\" (UID: \"50cae0dc-98da-468c-9874-fdfc3fa80322\") " pod="openshift-console/console-76bf65bdf9-7jrrj" May 21 13:03:54.972237 ip-10-0-133-64 kubenswrapper[2562]: I0521 13:03:54.972198 2562 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-76bf65bdf9-7jrrj" May 21 13:03:55.281414 ip-10-0-133-64 kubenswrapper[2562]: I0521 13:03:55.281290 2562 kuberuntime_container.go:864] "Killing container with a grace period" pod="openshift-image-registry/image-registry-c7d665b66-khpd9" podUID="10a964ec-b101-49a4-8dc7-0f208c0fe49d" containerName="registry" containerID="cri-o://855a9a7cbf11f7bac8f9acc5ea97d84112dfecdcedb1a04c2b6c28ebc87c7600" gracePeriod=30 May 21 13:03:55.620456 ip-10-0-133-64 kubenswrapper[2562]: I0521 13:03:55.620431 2562 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-c7d665b66-khpd9" May 21 13:03:55.683868 ip-10-0-133-64 kubenswrapper[2562]: I0521 13:03:55.683832 2562 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/10a964ec-b101-49a4-8dc7-0f208c0fe49d-registry-tls\") pod \"10a964ec-b101-49a4-8dc7-0f208c0fe49d\" (UID: \"10a964ec-b101-49a4-8dc7-0f208c0fe49d\") " May 21 13:03:55.683868 ip-10-0-133-64 kubenswrapper[2562]: I0521 13:03:55.683879 2562 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/10a964ec-b101-49a4-8dc7-0f208c0fe49d-trusted-ca\") pod \"10a964ec-b101-49a4-8dc7-0f208c0fe49d\" (UID: \"10a964ec-b101-49a4-8dc7-0f208c0fe49d\") " May 21 13:03:55.684690 ip-10-0-133-64 kubenswrapper[2562]: I0521 13:03:55.683901 2562 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-j4b8q\" (UniqueName: \"kubernetes.io/projected/10a964ec-b101-49a4-8dc7-0f208c0fe49d-kube-api-access-j4b8q\") pod \"10a964ec-b101-49a4-8dc7-0f208c0fe49d\" (UID: \"10a964ec-b101-49a4-8dc7-0f208c0fe49d\") " May 21 13:03:55.684690 ip-10-0-133-64 kubenswrapper[2562]: I0521 13:03:55.683931 2562 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/10a964ec-b101-49a4-8dc7-0f208c0fe49d-installation-pull-secrets\") pod \"10a964ec-b101-49a4-8dc7-0f208c0fe49d\" (UID: \"10a964ec-b101-49a4-8dc7-0f208c0fe49d\") " May 21 13:03:55.684690 ip-10-0-133-64 kubenswrapper[2562]: I0521 13:03:55.684033 2562 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/10a964ec-b101-49a4-8dc7-0f208c0fe49d-image-registry-private-configuration\") pod \"10a964ec-b101-49a4-8dc7-0f208c0fe49d\" (UID: \"10a964ec-b101-49a4-8dc7-0f208c0fe49d\") " May 21 13:03:55.684690 ip-10-0-133-64 kubenswrapper[2562]: I0521 13:03:55.684113 2562 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/10a964ec-b101-49a4-8dc7-0f208c0fe49d-ca-trust-extracted\") pod \"10a964ec-b101-49a4-8dc7-0f208c0fe49d\" (UID: \"10a964ec-b101-49a4-8dc7-0f208c0fe49d\") " May 21 13:03:55.684690 ip-10-0-133-64 kubenswrapper[2562]: I0521 13:03:55.684159 2562 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/10a964ec-b101-49a4-8dc7-0f208c0fe49d-registry-certificates\") pod \"10a964ec-b101-49a4-8dc7-0f208c0fe49d\" (UID: \"10a964ec-b101-49a4-8dc7-0f208c0fe49d\") " May 21 13:03:55.684690 ip-10-0-133-64 kubenswrapper[2562]: I0521 13:03:55.684203 2562 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/10a964ec-b101-49a4-8dc7-0f208c0fe49d-bound-sa-token\") pod \"10a964ec-b101-49a4-8dc7-0f208c0fe49d\" (UID: \"10a964ec-b101-49a4-8dc7-0f208c0fe49d\") " May 21 13:03:55.684690 ip-10-0-133-64 kubenswrapper[2562]: I0521 13:03:55.684461 2562 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/10a964ec-b101-49a4-8dc7-0f208c0fe49d-trusted-ca" (OuterVolumeSpecName: "trusted-ca") pod "10a964ec-b101-49a4-8dc7-0f208c0fe49d" (UID: "10a964ec-b101-49a4-8dc7-0f208c0fe49d"). InnerVolumeSpecName "trusted-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue "" May 21 13:03:55.684690 ip-10-0-133-64 kubenswrapper[2562]: I0521 13:03:55.684605 2562 reconciler_common.go:299] "Volume detached for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/10a964ec-b101-49a4-8dc7-0f208c0fe49d-trusted-ca\") on node \"ip-10-0-133-64.ec2.internal\" DevicePath \"\"" May 21 13:03:55.685132 ip-10-0-133-64 kubenswrapper[2562]: I0521 13:03:55.685023 2562 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/10a964ec-b101-49a4-8dc7-0f208c0fe49d-registry-certificates" (OuterVolumeSpecName: "registry-certificates") pod "10a964ec-b101-49a4-8dc7-0f208c0fe49d" (UID: "10a964ec-b101-49a4-8dc7-0f208c0fe49d"). InnerVolumeSpecName "registry-certificates". PluginName "kubernetes.io/configmap", VolumeGIDValue "" May 21 13:03:55.686669 ip-10-0-133-64 kubenswrapper[2562]: I0521 13:03:55.686640 2562 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/10a964ec-b101-49a4-8dc7-0f208c0fe49d-kube-api-access-j4b8q" (OuterVolumeSpecName: "kube-api-access-j4b8q") pod "10a964ec-b101-49a4-8dc7-0f208c0fe49d" (UID: "10a964ec-b101-49a4-8dc7-0f208c0fe49d"). InnerVolumeSpecName "kube-api-access-j4b8q". PluginName "kubernetes.io/projected", VolumeGIDValue "" May 21 13:03:55.686776 ip-10-0-133-64 kubenswrapper[2562]: I0521 13:03:55.686652 2562 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/10a964ec-b101-49a4-8dc7-0f208c0fe49d-installation-pull-secrets" (OuterVolumeSpecName: "installation-pull-secrets") pod "10a964ec-b101-49a4-8dc7-0f208c0fe49d" (UID: "10a964ec-b101-49a4-8dc7-0f208c0fe49d"). InnerVolumeSpecName "installation-pull-secrets". PluginName "kubernetes.io/secret", VolumeGIDValue "" May 21 13:03:55.686776 ip-10-0-133-64 kubenswrapper[2562]: I0521 13:03:55.686731 2562 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/10a964ec-b101-49a4-8dc7-0f208c0fe49d-registry-tls" (OuterVolumeSpecName: "registry-tls") pod "10a964ec-b101-49a4-8dc7-0f208c0fe49d" (UID: "10a964ec-b101-49a4-8dc7-0f208c0fe49d"). InnerVolumeSpecName "registry-tls". PluginName "kubernetes.io/projected", VolumeGIDValue "" May 21 13:03:55.686776 ip-10-0-133-64 kubenswrapper[2562]: I0521 13:03:55.686747 2562 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/10a964ec-b101-49a4-8dc7-0f208c0fe49d-image-registry-private-configuration" (OuterVolumeSpecName: "image-registry-private-configuration") pod "10a964ec-b101-49a4-8dc7-0f208c0fe49d" (UID: "10a964ec-b101-49a4-8dc7-0f208c0fe49d"). InnerVolumeSpecName "image-registry-private-configuration". PluginName "kubernetes.io/secret", VolumeGIDValue "" May 21 13:03:55.687230 ip-10-0-133-64 kubenswrapper[2562]: I0521 13:03:55.687214 2562 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/10a964ec-b101-49a4-8dc7-0f208c0fe49d-bound-sa-token" (OuterVolumeSpecName: "bound-sa-token") pod "10a964ec-b101-49a4-8dc7-0f208c0fe49d" (UID: "10a964ec-b101-49a4-8dc7-0f208c0fe49d"). InnerVolumeSpecName "bound-sa-token". PluginName "kubernetes.io/projected", VolumeGIDValue "" May 21 13:03:55.693887 ip-10-0-133-64 kubenswrapper[2562]: I0521 13:03:55.693859 2562 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/10a964ec-b101-49a4-8dc7-0f208c0fe49d-ca-trust-extracted" (OuterVolumeSpecName: "ca-trust-extracted") pod "10a964ec-b101-49a4-8dc7-0f208c0fe49d" (UID: "10a964ec-b101-49a4-8dc7-0f208c0fe49d"). InnerVolumeSpecName "ca-trust-extracted". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" May 21 13:03:55.785844 ip-10-0-133-64 kubenswrapper[2562]: I0521 13:03:55.785792 2562 reconciler_common.go:299] "Volume detached for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/10a964ec-b101-49a4-8dc7-0f208c0fe49d-image-registry-private-configuration\") on node \"ip-10-0-133-64.ec2.internal\" DevicePath \"\"" May 21 13:03:55.785844 ip-10-0-133-64 kubenswrapper[2562]: I0521 13:03:55.785843 2562 reconciler_common.go:299] "Volume detached for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/10a964ec-b101-49a4-8dc7-0f208c0fe49d-ca-trust-extracted\") on node \"ip-10-0-133-64.ec2.internal\" DevicePath \"\"" May 21 13:03:55.786016 ip-10-0-133-64 kubenswrapper[2562]: I0521 13:03:55.785859 2562 reconciler_common.go:299] "Volume detached for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/10a964ec-b101-49a4-8dc7-0f208c0fe49d-registry-certificates\") on node \"ip-10-0-133-64.ec2.internal\" DevicePath \"\"" May 21 13:03:55.786016 ip-10-0-133-64 kubenswrapper[2562]: I0521 13:03:55.785879 2562 reconciler_common.go:299] "Volume detached for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/10a964ec-b101-49a4-8dc7-0f208c0fe49d-bound-sa-token\") on node \"ip-10-0-133-64.ec2.internal\" DevicePath \"\"" May 21 13:03:55.786016 ip-10-0-133-64 kubenswrapper[2562]: I0521 13:03:55.785893 2562 reconciler_common.go:299] "Volume detached for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/10a964ec-b101-49a4-8dc7-0f208c0fe49d-registry-tls\") on node \"ip-10-0-133-64.ec2.internal\" DevicePath \"\"" May 21 13:03:55.786016 ip-10-0-133-64 kubenswrapper[2562]: I0521 13:03:55.785907 2562 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-j4b8q\" (UniqueName: \"kubernetes.io/projected/10a964ec-b101-49a4-8dc7-0f208c0fe49d-kube-api-access-j4b8q\") on node \"ip-10-0-133-64.ec2.internal\" DevicePath \"\"" May 21 13:03:55.786016 ip-10-0-133-64 kubenswrapper[2562]: I0521 13:03:55.785921 2562 reconciler_common.go:299] "Volume detached for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/10a964ec-b101-49a4-8dc7-0f208c0fe49d-installation-pull-secrets\") on node \"ip-10-0-133-64.ec2.internal\" DevicePath \"\"" May 21 13:03:55.791896 ip-10-0-133-64 kubenswrapper[2562]: I0521 13:03:55.791836 2562 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-76bf65bdf9-7jrrj"] May 21 13:03:55.796455 ip-10-0-133-64 kubenswrapper[2562]: W0521 13:03:55.796424 2562 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod50cae0dc_98da_468c_9874_fdfc3fa80322.slice/crio-5f24d0b96c2756f918f4a7e9dc23b437f89cfdb9e7cd02efc00864ba58184e06 WatchSource:0}: Error finding container 5f24d0b96c2756f918f4a7e9dc23b437f89cfdb9e7cd02efc00864ba58184e06: Status 404 returned error can't find the container with id 5f24d0b96c2756f918f4a7e9dc23b437f89cfdb9e7cd02efc00864ba58184e06 May 21 13:03:56.399775 ip-10-0-133-64 kubenswrapper[2562]: I0521 13:03:56.397456 2562 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-console/downloads-57bd96b888-52n4w" event={"ID":"1cbe2845-fe10-40ee-907d-f4425f3ddc35","Type":"ContainerStarted","Data":"e5c6f86ce931f81c3cafcf9003b10f2d6c2865cd1c9393f1d334766717d3df6d"} May 21 13:03:56.399775 ip-10-0-133-64 kubenswrapper[2562]: I0521 13:03:56.397842 2562 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/downloads-57bd96b888-52n4w" May 21 13:03:56.401243 ip-10-0-133-64 kubenswrapper[2562]: I0521 13:03:56.401212 2562 generic.go:358] "Generic (PLEG): container finished" podID="10a964ec-b101-49a4-8dc7-0f208c0fe49d" containerID="855a9a7cbf11f7bac8f9acc5ea97d84112dfecdcedb1a04c2b6c28ebc87c7600" exitCode=0 May 21 13:03:56.401369 ip-10-0-133-64 kubenswrapper[2562]: I0521 13:03:56.401339 2562 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-c7d665b66-khpd9" event={"ID":"10a964ec-b101-49a4-8dc7-0f208c0fe49d","Type":"ContainerDied","Data":"855a9a7cbf11f7bac8f9acc5ea97d84112dfecdcedb1a04c2b6c28ebc87c7600"} May 21 13:03:56.401437 ip-10-0-133-64 kubenswrapper[2562]: I0521 13:03:56.401368 2562 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-c7d665b66-khpd9" event={"ID":"10a964ec-b101-49a4-8dc7-0f208c0fe49d","Type":"ContainerDied","Data":"995e75488b9df0ce489605ec406dc1209d9ae2a2483adadba51f817932f7c640"} May 21 13:03:56.401437 ip-10-0-133-64 kubenswrapper[2562]: I0521 13:03:56.401388 2562 scope.go:117] "RemoveContainer" containerID="855a9a7cbf11f7bac8f9acc5ea97d84112dfecdcedb1a04c2b6c28ebc87c7600" May 21 13:03:56.401551 ip-10-0-133-64 kubenswrapper[2562]: I0521 13:03:56.401536 2562 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-c7d665b66-khpd9" May 21 13:03:56.403534 ip-10-0-133-64 kubenswrapper[2562]: I0521 13:03:56.403508 2562 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-76bf65bdf9-7jrrj" event={"ID":"50cae0dc-98da-468c-9874-fdfc3fa80322","Type":"ContainerStarted","Data":"5f24d0b96c2756f918f4a7e9dc23b437f89cfdb9e7cd02efc00864ba58184e06"} May 21 13:03:56.408779 ip-10-0-133-64 kubenswrapper[2562]: I0521 13:03:56.408755 2562 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console/downloads-57bd96b888-52n4w" May 21 13:03:56.408908 ip-10-0-133-64 kubenswrapper[2562]: I0521 13:03:56.408782 2562 generic.go:358] "Generic (PLEG): container finished" podID="bec846a9-572c-4fce-a95a-492bc285b1d3" containerID="80cfc9e0fc9c62a594acca6feac42366a315c3489e8dbf54613d49aba2c5a735" exitCode=0 May 21 13:03:56.408908 ip-10-0-133-64 kubenswrapper[2562]: I0521 13:03:56.408788 2562 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-j52sx" event={"ID":"bec846a9-572c-4fce-a95a-492bc285b1d3","Type":"ContainerDied","Data":"80cfc9e0fc9c62a594acca6feac42366a315c3489e8dbf54613d49aba2c5a735"} May 21 13:03:56.413024 ip-10-0-133-64 kubenswrapper[2562]: I0521 13:03:56.412999 2562 scope.go:117] "RemoveContainer" containerID="855a9a7cbf11f7bac8f9acc5ea97d84112dfecdcedb1a04c2b6c28ebc87c7600" May 21 13:03:56.413969 ip-10-0-133-64 kubenswrapper[2562]: E0521 13:03:56.413942 2562 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"855a9a7cbf11f7bac8f9acc5ea97d84112dfecdcedb1a04c2b6c28ebc87c7600\": container with ID starting with 855a9a7cbf11f7bac8f9acc5ea97d84112dfecdcedb1a04c2b6c28ebc87c7600 not found: ID does not exist" containerID="855a9a7cbf11f7bac8f9acc5ea97d84112dfecdcedb1a04c2b6c28ebc87c7600" May 21 13:03:56.414083 ip-10-0-133-64 kubenswrapper[2562]: I0521 13:03:56.413979 2562 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"855a9a7cbf11f7bac8f9acc5ea97d84112dfecdcedb1a04c2b6c28ebc87c7600"} err="failed to get container status \"855a9a7cbf11f7bac8f9acc5ea97d84112dfecdcedb1a04c2b6c28ebc87c7600\": rpc error: code = NotFound desc = could not find container \"855a9a7cbf11f7bac8f9acc5ea97d84112dfecdcedb1a04c2b6c28ebc87c7600\": container with ID starting with 855a9a7cbf11f7bac8f9acc5ea97d84112dfecdcedb1a04c2b6c28ebc87c7600 not found: ID does not exist" May 21 13:03:56.417413 ip-10-0-133-64 kubenswrapper[2562]: I0521 13:03:56.417243 2562 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-console/downloads-57bd96b888-52n4w" podStartSLOduration=1.60746402 podStartE2EDuration="21.417228572s" podCreationTimestamp="2026-05-21 13:03:35 +0000 UTC" firstStartedPulling="2026-05-21 13:03:35.989583403 +0000 UTC m=+62.539864750" lastFinishedPulling="2026-05-21 13:03:55.799347955 +0000 UTC m=+82.349629302" observedRunningTime="2026-05-21 13:03:56.416432425 +0000 UTC m=+82.966713793" watchObservedRunningTime="2026-05-21 13:03:56.417228572 +0000 UTC m=+82.967509940" May 21 13:03:56.532162 ip-10-0-133-64 kubenswrapper[2562]: I0521 13:03:56.531762 2562 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openshift-image-registry/image-registry-c7d665b66-khpd9"] May 21 13:03:56.539625 ip-10-0-133-64 kubenswrapper[2562]: I0521 13:03:56.539578 2562 kubelet.go:2547] "SyncLoop REMOVE" source="api" pods=["openshift-image-registry/image-registry-c7d665b66-khpd9"] May 21 13:03:57.418058 ip-10-0-133-64 kubenswrapper[2562]: I0521 13:03:57.418016 2562 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-j52sx" event={"ID":"bec846a9-572c-4fce-a95a-492bc285b1d3","Type":"ContainerStarted","Data":"d5e2bd10a53fa6e9e98bf120cb7349567a3989b2116909a736b29ba47a291f9c"} May 21 13:03:57.418597 ip-10-0-133-64 kubenswrapper[2562]: I0521 13:03:57.418111 2562 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-j52sx" event={"ID":"bec846a9-572c-4fce-a95a-492bc285b1d3","Type":"ContainerStarted","Data":"c0c3c2b62e4c8b7053a851b7a3f53390364db70ac5ad9177e3c93fafccf8a5eb"} May 21 13:03:57.445062 ip-10-0-133-64 kubenswrapper[2562]: I0521 13:03:57.443692 2562 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-monitoring/node-exporter-j52sx" podStartSLOduration=3.895317112 podStartE2EDuration="12.443672511s" podCreationTimestamp="2026-05-21 13:03:45 +0000 UTC" firstStartedPulling="2026-05-21 13:03:46.901771133 +0000 UTC m=+73.452052482" lastFinishedPulling="2026-05-21 13:03:55.450126521 +0000 UTC m=+82.000407881" observedRunningTime="2026-05-21 13:03:57.441369407 +0000 UTC m=+83.991650788" watchObservedRunningTime="2026-05-21 13:03:57.443672511 +0000 UTC m=+83.993953879" May 21 13:03:58.039364 ip-10-0-133-64 kubenswrapper[2562]: I0521 13:03:58.039296 2562 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="10a964ec-b101-49a4-8dc7-0f208c0fe49d" path="/var/lib/kubelet/pods/10a964ec-b101-49a4-8dc7-0f208c0fe49d/volumes" May 21 13:04:00.433665 ip-10-0-133-64 kubenswrapper[2562]: I0521 13:04:00.433616 2562 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-76bf65bdf9-7jrrj" event={"ID":"50cae0dc-98da-468c-9874-fdfc3fa80322","Type":"ContainerStarted","Data":"f84e12ad86d759ddff236c85bbe1409994a9096b60300ec03a11cb95ae70f52a"} May 21 13:04:00.454497 ip-10-0-133-64 kubenswrapper[2562]: I0521 13:04:00.454437 2562 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-console/console-76bf65bdf9-7jrrj" podStartSLOduration=2.69193135 podStartE2EDuration="6.454418766s" podCreationTimestamp="2026-05-21 13:03:54 +0000 UTC" firstStartedPulling="2026-05-21 13:03:55.798411206 +0000 UTC m=+82.348692555" lastFinishedPulling="2026-05-21 13:03:59.560898606 +0000 UTC m=+86.111179971" observedRunningTime="2026-05-21 13:04:00.451877053 +0000 UTC m=+87.002158421" watchObservedRunningTime="2026-05-21 13:04:00.454418766 +0000 UTC m=+87.004700135" May 21 13:04:02.445628 ip-10-0-133-64 kubenswrapper[2562]: I0521 13:04:02.445594 2562 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openshift-console/console-76bf65bdf9-7jrrj"] May 21 13:04:04.972723 ip-10-0-133-64 kubenswrapper[2562]: I0521 13:04:04.972686 2562 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/console-76bf65bdf9-7jrrj" May 21 13:04:16.363208 ip-10-0-133-64 kubenswrapper[2562]: I0521 13:04:16.363175 2562 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-network-diagnostics/network-check-target-zkhxz" May 21 13:04:27.468357 ip-10-0-133-64 kubenswrapper[2562]: I0521 13:04:27.468293 2562 kuberuntime_container.go:864] "Killing container with a grace period" pod="openshift-console/console-76bf65bdf9-7jrrj" podUID="50cae0dc-98da-468c-9874-fdfc3fa80322" containerName="console" containerID="cri-o://f84e12ad86d759ddff236c85bbe1409994a9096b60300ec03a11cb95ae70f52a" gracePeriod=15 May 21 13:04:27.732776 ip-10-0-133-64 kubenswrapper[2562]: I0521 13:04:27.732750 2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console_console-76bf65bdf9-7jrrj_50cae0dc-98da-468c-9874-fdfc3fa80322/console/0.log" May 21 13:04:27.732915 ip-10-0-133-64 kubenswrapper[2562]: I0521 13:04:27.732832 2562 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-76bf65bdf9-7jrrj" May 21 13:04:27.750401 ip-10-0-133-64 kubenswrapper[2562]: I0521 13:04:27.750366 2562 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/50cae0dc-98da-468c-9874-fdfc3fa80322-oauth-serving-cert\") pod \"50cae0dc-98da-468c-9874-fdfc3fa80322\" (UID: \"50cae0dc-98da-468c-9874-fdfc3fa80322\") " May 21 13:04:27.750590 ip-10-0-133-64 kubenswrapper[2562]: I0521 13:04:27.750413 2562 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/50cae0dc-98da-468c-9874-fdfc3fa80322-trusted-ca-bundle\") pod \"50cae0dc-98da-468c-9874-fdfc3fa80322\" (UID: \"50cae0dc-98da-468c-9874-fdfc3fa80322\") " May 21 13:04:27.750590 ip-10-0-133-64 kubenswrapper[2562]: I0521 13:04:27.750442 2562 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/50cae0dc-98da-468c-9874-fdfc3fa80322-service-ca\") pod \"50cae0dc-98da-468c-9874-fdfc3fa80322\" (UID: \"50cae0dc-98da-468c-9874-fdfc3fa80322\") " May 21 13:04:27.750590 ip-10-0-133-64 kubenswrapper[2562]: I0521 13:04:27.750471 2562 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-h7c9v\" (UniqueName: \"kubernetes.io/projected/50cae0dc-98da-468c-9874-fdfc3fa80322-kube-api-access-h7c9v\") pod \"50cae0dc-98da-468c-9874-fdfc3fa80322\" (UID: \"50cae0dc-98da-468c-9874-fdfc3fa80322\") " May 21 13:04:27.750590 ip-10-0-133-64 kubenswrapper[2562]: I0521 13:04:27.750529 2562 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/50cae0dc-98da-468c-9874-fdfc3fa80322-console-serving-cert\") pod \"50cae0dc-98da-468c-9874-fdfc3fa80322\" (UID: \"50cae0dc-98da-468c-9874-fdfc3fa80322\") " May 21 13:04:27.750590 ip-10-0-133-64 kubenswrapper[2562]: I0521 13:04:27.750553 2562 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/50cae0dc-98da-468c-9874-fdfc3fa80322-console-config\") pod \"50cae0dc-98da-468c-9874-fdfc3fa80322\" (UID: \"50cae0dc-98da-468c-9874-fdfc3fa80322\") " May 21 13:04:27.750874 ip-10-0-133-64 kubenswrapper[2562]: I0521 13:04:27.750593 2562 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/50cae0dc-98da-468c-9874-fdfc3fa80322-console-oauth-config\") pod \"50cae0dc-98da-468c-9874-fdfc3fa80322\" (UID: \"50cae0dc-98da-468c-9874-fdfc3fa80322\") " May 21 13:04:27.752299 ip-10-0-133-64 kubenswrapper[2562]: I0521 13:04:27.751827 2562 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/50cae0dc-98da-468c-9874-fdfc3fa80322-service-ca" (OuterVolumeSpecName: "service-ca") pod "50cae0dc-98da-468c-9874-fdfc3fa80322" (UID: "50cae0dc-98da-468c-9874-fdfc3fa80322"). InnerVolumeSpecName "service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue "" May 21 13:04:27.752299 ip-10-0-133-64 kubenswrapper[2562]: I0521 13:04:27.752267 2562 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/50cae0dc-98da-468c-9874-fdfc3fa80322-oauth-serving-cert" (OuterVolumeSpecName: "oauth-serving-cert") pod "50cae0dc-98da-468c-9874-fdfc3fa80322" (UID: "50cae0dc-98da-468c-9874-fdfc3fa80322"). InnerVolumeSpecName "oauth-serving-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue "" May 21 13:04:27.752456 ip-10-0-133-64 kubenswrapper[2562]: I0521 13:04:27.752389 2562 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/50cae0dc-98da-468c-9874-fdfc3fa80322-trusted-ca-bundle" (OuterVolumeSpecName: "trusted-ca-bundle") pod "50cae0dc-98da-468c-9874-fdfc3fa80322" (UID: "50cae0dc-98da-468c-9874-fdfc3fa80322"). InnerVolumeSpecName "trusted-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue "" May 21 13:04:27.752574 ip-10-0-133-64 kubenswrapper[2562]: I0521 13:04:27.752542 2562 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/50cae0dc-98da-468c-9874-fdfc3fa80322-console-config" (OuterVolumeSpecName: "console-config") pod "50cae0dc-98da-468c-9874-fdfc3fa80322" (UID: "50cae0dc-98da-468c-9874-fdfc3fa80322"). InnerVolumeSpecName "console-config". PluginName "kubernetes.io/configmap", VolumeGIDValue "" May 21 13:04:27.753613 ip-10-0-133-64 kubenswrapper[2562]: I0521 13:04:27.753582 2562 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/50cae0dc-98da-468c-9874-fdfc3fa80322-console-oauth-config" (OuterVolumeSpecName: "console-oauth-config") pod "50cae0dc-98da-468c-9874-fdfc3fa80322" (UID: "50cae0dc-98da-468c-9874-fdfc3fa80322"). InnerVolumeSpecName "console-oauth-config". PluginName "kubernetes.io/secret", VolumeGIDValue "" May 21 13:04:27.754438 ip-10-0-133-64 kubenswrapper[2562]: I0521 13:04:27.754412 2562 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/50cae0dc-98da-468c-9874-fdfc3fa80322-kube-api-access-h7c9v" (OuterVolumeSpecName: "kube-api-access-h7c9v") pod "50cae0dc-98da-468c-9874-fdfc3fa80322" (UID: "50cae0dc-98da-468c-9874-fdfc3fa80322"). InnerVolumeSpecName "kube-api-access-h7c9v". PluginName "kubernetes.io/projected", VolumeGIDValue "" May 21 13:04:27.754548 ip-10-0-133-64 kubenswrapper[2562]: I0521 13:04:27.754510 2562 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/50cae0dc-98da-468c-9874-fdfc3fa80322-console-serving-cert" (OuterVolumeSpecName: "console-serving-cert") pod "50cae0dc-98da-468c-9874-fdfc3fa80322" (UID: "50cae0dc-98da-468c-9874-fdfc3fa80322"). InnerVolumeSpecName "console-serving-cert". PluginName "kubernetes.io/secret", VolumeGIDValue "" May 21 13:04:27.851205 ip-10-0-133-64 kubenswrapper[2562]: I0521 13:04:27.851166 2562 reconciler_common.go:299] "Volume detached for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/50cae0dc-98da-468c-9874-fdfc3fa80322-oauth-serving-cert\") on node \"ip-10-0-133-64.ec2.internal\" DevicePath \"\"" May 21 13:04:27.851205 ip-10-0-133-64 kubenswrapper[2562]: I0521 13:04:27.851199 2562 reconciler_common.go:299] "Volume detached for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/50cae0dc-98da-468c-9874-fdfc3fa80322-trusted-ca-bundle\") on node \"ip-10-0-133-64.ec2.internal\" DevicePath \"\"" May 21 13:04:27.851205 ip-10-0-133-64 kubenswrapper[2562]: I0521 13:04:27.851211 2562 reconciler_common.go:299] "Volume detached for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/50cae0dc-98da-468c-9874-fdfc3fa80322-service-ca\") on node \"ip-10-0-133-64.ec2.internal\" DevicePath \"\"" May 21 13:04:27.851440 ip-10-0-133-64 kubenswrapper[2562]: I0521 13:04:27.851220 2562 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-h7c9v\" (UniqueName: \"kubernetes.io/projected/50cae0dc-98da-468c-9874-fdfc3fa80322-kube-api-access-h7c9v\") on node \"ip-10-0-133-64.ec2.internal\" DevicePath \"\"" May 21 13:04:27.851440 ip-10-0-133-64 kubenswrapper[2562]: I0521 13:04:27.851230 2562 reconciler_common.go:299] "Volume detached for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/50cae0dc-98da-468c-9874-fdfc3fa80322-console-serving-cert\") on node \"ip-10-0-133-64.ec2.internal\" DevicePath \"\"" May 21 13:04:27.851440 ip-10-0-133-64 kubenswrapper[2562]: I0521 13:04:27.851240 2562 reconciler_common.go:299] "Volume detached for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/50cae0dc-98da-468c-9874-fdfc3fa80322-console-config\") on node \"ip-10-0-133-64.ec2.internal\" DevicePath \"\"" May 21 13:04:27.851440 ip-10-0-133-64 kubenswrapper[2562]: I0521 13:04:27.851249 2562 reconciler_common.go:299] "Volume detached for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/50cae0dc-98da-468c-9874-fdfc3fa80322-console-oauth-config\") on node \"ip-10-0-133-64.ec2.internal\" DevicePath \"\"" May 21 13:04:28.511844 ip-10-0-133-64 kubenswrapper[2562]: I0521 13:04:28.511817 2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console_console-76bf65bdf9-7jrrj_50cae0dc-98da-468c-9874-fdfc3fa80322/console/0.log" May 21 13:04:28.512237 ip-10-0-133-64 kubenswrapper[2562]: I0521 13:04:28.511859 2562 generic.go:358] "Generic (PLEG): container finished" podID="50cae0dc-98da-468c-9874-fdfc3fa80322" containerID="f84e12ad86d759ddff236c85bbe1409994a9096b60300ec03a11cb95ae70f52a" exitCode=2 May 21 13:04:28.512237 ip-10-0-133-64 kubenswrapper[2562]: I0521 13:04:28.511899 2562 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-76bf65bdf9-7jrrj" event={"ID":"50cae0dc-98da-468c-9874-fdfc3fa80322","Type":"ContainerDied","Data":"f84e12ad86d759ddff236c85bbe1409994a9096b60300ec03a11cb95ae70f52a"} May 21 13:04:28.512237 ip-10-0-133-64 kubenswrapper[2562]: I0521 13:04:28.511920 2562 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-76bf65bdf9-7jrrj" event={"ID":"50cae0dc-98da-468c-9874-fdfc3fa80322","Type":"ContainerDied","Data":"5f24d0b96c2756f918f4a7e9dc23b437f89cfdb9e7cd02efc00864ba58184e06"} May 21 13:04:28.512237 ip-10-0-133-64 kubenswrapper[2562]: I0521 13:04:28.511921 2562 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-76bf65bdf9-7jrrj" May 21 13:04:28.512237 ip-10-0-133-64 kubenswrapper[2562]: I0521 13:04:28.511939 2562 scope.go:117] "RemoveContainer" containerID="f84e12ad86d759ddff236c85bbe1409994a9096b60300ec03a11cb95ae70f52a" May 21 13:04:28.519901 ip-10-0-133-64 kubenswrapper[2562]: I0521 13:04:28.519871 2562 scope.go:117] "RemoveContainer" containerID="f84e12ad86d759ddff236c85bbe1409994a9096b60300ec03a11cb95ae70f52a" May 21 13:04:28.524513 ip-10-0-133-64 kubenswrapper[2562]: E0521 13:04:28.524484 2562 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"f84e12ad86d759ddff236c85bbe1409994a9096b60300ec03a11cb95ae70f52a\": container with ID starting with f84e12ad86d759ddff236c85bbe1409994a9096b60300ec03a11cb95ae70f52a not found: ID does not exist" containerID="f84e12ad86d759ddff236c85bbe1409994a9096b60300ec03a11cb95ae70f52a" May 21 13:04:28.524638 ip-10-0-133-64 kubenswrapper[2562]: I0521 13:04:28.524519 2562 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"f84e12ad86d759ddff236c85bbe1409994a9096b60300ec03a11cb95ae70f52a"} err="failed to get container status \"f84e12ad86d759ddff236c85bbe1409994a9096b60300ec03a11cb95ae70f52a\": rpc error: code = NotFound desc = could not find container \"f84e12ad86d759ddff236c85bbe1409994a9096b60300ec03a11cb95ae70f52a\": container with ID starting with f84e12ad86d759ddff236c85bbe1409994a9096b60300ec03a11cb95ae70f52a not found: ID does not exist" May 21 13:04:28.531220 ip-10-0-133-64 kubenswrapper[2562]: I0521 13:04:28.531192 2562 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openshift-console/console-76bf65bdf9-7jrrj"] May 21 13:04:28.535618 ip-10-0-133-64 kubenswrapper[2562]: I0521 13:04:28.535596 2562 kubelet.go:2547] "SyncLoop REMOVE" source="api" pods=["openshift-console/console-76bf65bdf9-7jrrj"] May 21 13:04:30.036985 ip-10-0-133-64 kubenswrapper[2562]: I0521 13:04:30.036943 2562 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="50cae0dc-98da-468c-9874-fdfc3fa80322" path="/var/lib/kubelet/pods/50cae0dc-98da-468c-9874-fdfc3fa80322/volumes" May 21 13:05:28.688142 ip-10-0-133-64 kubenswrapper[2562]: I0521 13:05:28.687948 2562 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-console/console-5846c7d4fc-d6vkl"] May 21 13:05:28.688828 ip-10-0-133-64 kubenswrapper[2562]: I0521 13:05:28.688785 2562 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="10a964ec-b101-49a4-8dc7-0f208c0fe49d" containerName="registry" May 21 13:05:28.688828 ip-10-0-133-64 kubenswrapper[2562]: I0521 13:05:28.688827 2562 state_mem.go:107] "Deleted CPUSet assignment" podUID="10a964ec-b101-49a4-8dc7-0f208c0fe49d" containerName="registry" May 21 13:05:28.689018 ip-10-0-133-64 kubenswrapper[2562]: I0521 13:05:28.688840 2562 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="50cae0dc-98da-468c-9874-fdfc3fa80322" containerName="console" May 21 13:05:28.689018 ip-10-0-133-64 kubenswrapper[2562]: I0521 13:05:28.688846 2562 state_mem.go:107] "Deleted CPUSet assignment" podUID="50cae0dc-98da-468c-9874-fdfc3fa80322" containerName="console" May 21 13:05:28.689018 ip-10-0-133-64 kubenswrapper[2562]: I0521 13:05:28.688908 2562 memory_manager.go:356] "RemoveStaleState removing state" podUID="50cae0dc-98da-468c-9874-fdfc3fa80322" containerName="console" May 21 13:05:28.689018 ip-10-0-133-64 kubenswrapper[2562]: I0521 13:05:28.688917 2562 memory_manager.go:356] "RemoveStaleState removing state" podUID="10a964ec-b101-49a4-8dc7-0f208c0fe49d" containerName="registry" May 21 13:05:28.690667 ip-10-0-133-64 kubenswrapper[2562]: I0521 13:05:28.690649 2562 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-5846c7d4fc-d6vkl" May 21 13:05:28.693182 ip-10-0-133-64 kubenswrapper[2562]: I0521 13:05:28.693161 2562 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-oauth-config\"" May 21 13:05:28.693743 ip-10-0-133-64 kubenswrapper[2562]: I0521 13:05:28.693726 2562 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"service-ca\"" May 21 13:05:28.693844 ip-10-0-133-64 kubenswrapper[2562]: I0521 13:05:28.693751 2562 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"console-config\"" May 21 13:05:28.693983 ip-10-0-133-64 kubenswrapper[2562]: I0521 13:05:28.693967 2562 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-serving-cert\"" May 21 13:05:28.694053 ip-10-0-133-64 kubenswrapper[2562]: I0521 13:05:28.694006 2562 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-dockercfg-s69mp\"" May 21 13:05:28.694053 ip-10-0-133-64 kubenswrapper[2562]: I0521 13:05:28.694021 2562 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"oauth-serving-cert\"" May 21 13:05:28.702466 ip-10-0-133-64 kubenswrapper[2562]: I0521 13:05:28.702443 2562 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"trusted-ca-bundle\"" May 21 13:05:28.719192 ip-10-0-133-64 kubenswrapper[2562]: I0521 13:05:28.719162 2562 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-5846c7d4fc-d6vkl"] May 21 13:05:28.729188 ip-10-0-133-64 kubenswrapper[2562]: I0521 13:05:28.729164 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/61c9864a-6ce0-4dfa-aed5-be86a6b92a63-trusted-ca-bundle\") pod \"console-5846c7d4fc-d6vkl\" (UID: \"61c9864a-6ce0-4dfa-aed5-be86a6b92a63\") " pod="openshift-console/console-5846c7d4fc-d6vkl" May 21 13:05:28.729304 ip-10-0-133-64 kubenswrapper[2562]: I0521 13:05:28.729202 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/61c9864a-6ce0-4dfa-aed5-be86a6b92a63-service-ca\") pod \"console-5846c7d4fc-d6vkl\" (UID: \"61c9864a-6ce0-4dfa-aed5-be86a6b92a63\") " pod="openshift-console/console-5846c7d4fc-d6vkl" May 21 13:05:28.729304 ip-10-0-133-64 kubenswrapper[2562]: I0521 13:05:28.729270 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-lrdzc\" (UniqueName: \"kubernetes.io/projected/61c9864a-6ce0-4dfa-aed5-be86a6b92a63-kube-api-access-lrdzc\") pod \"console-5846c7d4fc-d6vkl\" (UID: \"61c9864a-6ce0-4dfa-aed5-be86a6b92a63\") " pod="openshift-console/console-5846c7d4fc-d6vkl" May 21 13:05:28.729392 ip-10-0-133-64 kubenswrapper[2562]: I0521 13:05:28.729304 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/61c9864a-6ce0-4dfa-aed5-be86a6b92a63-oauth-serving-cert\") pod \"console-5846c7d4fc-d6vkl\" (UID: \"61c9864a-6ce0-4dfa-aed5-be86a6b92a63\") " pod="openshift-console/console-5846c7d4fc-d6vkl" May 21 13:05:28.729392 ip-10-0-133-64 kubenswrapper[2562]: I0521 13:05:28.729321 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/61c9864a-6ce0-4dfa-aed5-be86a6b92a63-console-serving-cert\") pod \"console-5846c7d4fc-d6vkl\" (UID: \"61c9864a-6ce0-4dfa-aed5-be86a6b92a63\") " pod="openshift-console/console-5846c7d4fc-d6vkl" May 21 13:05:28.729392 ip-10-0-133-64 kubenswrapper[2562]: I0521 13:05:28.729342 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/61c9864a-6ce0-4dfa-aed5-be86a6b92a63-console-oauth-config\") pod \"console-5846c7d4fc-d6vkl\" (UID: \"61c9864a-6ce0-4dfa-aed5-be86a6b92a63\") " pod="openshift-console/console-5846c7d4fc-d6vkl" May 21 13:05:28.729392 ip-10-0-133-64 kubenswrapper[2562]: I0521 13:05:28.729365 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/61c9864a-6ce0-4dfa-aed5-be86a6b92a63-console-config\") pod \"console-5846c7d4fc-d6vkl\" (UID: \"61c9864a-6ce0-4dfa-aed5-be86a6b92a63\") " pod="openshift-console/console-5846c7d4fc-d6vkl" May 21 13:05:28.829791 ip-10-0-133-64 kubenswrapper[2562]: I0521 13:05:28.829759 2562 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/61c9864a-6ce0-4dfa-aed5-be86a6b92a63-trusted-ca-bundle\") pod \"console-5846c7d4fc-d6vkl\" (UID: \"61c9864a-6ce0-4dfa-aed5-be86a6b92a63\") " pod="openshift-console/console-5846c7d4fc-d6vkl" May 21 13:05:28.829992 ip-10-0-133-64 kubenswrapper[2562]: I0521 13:05:28.829811 2562 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/61c9864a-6ce0-4dfa-aed5-be86a6b92a63-service-ca\") pod \"console-5846c7d4fc-d6vkl\" (UID: \"61c9864a-6ce0-4dfa-aed5-be86a6b92a63\") " pod="openshift-console/console-5846c7d4fc-d6vkl" May 21 13:05:28.829992 ip-10-0-133-64 kubenswrapper[2562]: I0521 13:05:28.829845 2562 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-lrdzc\" (UniqueName: \"kubernetes.io/projected/61c9864a-6ce0-4dfa-aed5-be86a6b92a63-kube-api-access-lrdzc\") pod \"console-5846c7d4fc-d6vkl\" (UID: \"61c9864a-6ce0-4dfa-aed5-be86a6b92a63\") " pod="openshift-console/console-5846c7d4fc-d6vkl" May 21 13:05:28.829992 ip-10-0-133-64 kubenswrapper[2562]: I0521 13:05:28.829868 2562 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/61c9864a-6ce0-4dfa-aed5-be86a6b92a63-oauth-serving-cert\") pod \"console-5846c7d4fc-d6vkl\" (UID: \"61c9864a-6ce0-4dfa-aed5-be86a6b92a63\") " pod="openshift-console/console-5846c7d4fc-d6vkl" May 21 13:05:28.829992 ip-10-0-133-64 kubenswrapper[2562]: I0521 13:05:28.829888 2562 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/61c9864a-6ce0-4dfa-aed5-be86a6b92a63-console-serving-cert\") pod \"console-5846c7d4fc-d6vkl\" (UID: \"61c9864a-6ce0-4dfa-aed5-be86a6b92a63\") " pod="openshift-console/console-5846c7d4fc-d6vkl" May 21 13:05:28.829992 ip-10-0-133-64 kubenswrapper[2562]: I0521 13:05:28.829908 2562 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/61c9864a-6ce0-4dfa-aed5-be86a6b92a63-console-oauth-config\") pod \"console-5846c7d4fc-d6vkl\" (UID: \"61c9864a-6ce0-4dfa-aed5-be86a6b92a63\") " pod="openshift-console/console-5846c7d4fc-d6vkl" May 21 13:05:28.829992 ip-10-0-133-64 kubenswrapper[2562]: I0521 13:05:28.829932 2562 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/61c9864a-6ce0-4dfa-aed5-be86a6b92a63-console-config\") pod \"console-5846c7d4fc-d6vkl\" (UID: \"61c9864a-6ce0-4dfa-aed5-be86a6b92a63\") " pod="openshift-console/console-5846c7d4fc-d6vkl" May 21 13:05:28.830711 ip-10-0-133-64 kubenswrapper[2562]: I0521 13:05:28.830681 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/61c9864a-6ce0-4dfa-aed5-be86a6b92a63-service-ca\") pod \"console-5846c7d4fc-d6vkl\" (UID: \"61c9864a-6ce0-4dfa-aed5-be86a6b92a63\") " pod="openshift-console/console-5846c7d4fc-d6vkl" May 21 13:05:28.830711 ip-10-0-133-64 kubenswrapper[2562]: I0521 13:05:28.830704 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/61c9864a-6ce0-4dfa-aed5-be86a6b92a63-console-config\") pod \"console-5846c7d4fc-d6vkl\" (UID: \"61c9864a-6ce0-4dfa-aed5-be86a6b92a63\") " pod="openshift-console/console-5846c7d4fc-d6vkl" May 21 13:05:28.830917 ip-10-0-133-64 kubenswrapper[2562]: I0521 13:05:28.830693 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/61c9864a-6ce0-4dfa-aed5-be86a6b92a63-oauth-serving-cert\") pod \"console-5846c7d4fc-d6vkl\" (UID: \"61c9864a-6ce0-4dfa-aed5-be86a6b92a63\") " pod="openshift-console/console-5846c7d4fc-d6vkl" May 21 13:05:28.831000 ip-10-0-133-64 kubenswrapper[2562]: I0521 13:05:28.830981 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/61c9864a-6ce0-4dfa-aed5-be86a6b92a63-trusted-ca-bundle\") pod \"console-5846c7d4fc-d6vkl\" (UID: \"61c9864a-6ce0-4dfa-aed5-be86a6b92a63\") " pod="openshift-console/console-5846c7d4fc-d6vkl" May 21 13:05:28.832459 ip-10-0-133-64 kubenswrapper[2562]: I0521 13:05:28.832426 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/61c9864a-6ce0-4dfa-aed5-be86a6b92a63-console-oauth-config\") pod \"console-5846c7d4fc-d6vkl\" (UID: \"61c9864a-6ce0-4dfa-aed5-be86a6b92a63\") " pod="openshift-console/console-5846c7d4fc-d6vkl" May 21 13:05:28.832610 ip-10-0-133-64 kubenswrapper[2562]: I0521 13:05:28.832590 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/61c9864a-6ce0-4dfa-aed5-be86a6b92a63-console-serving-cert\") pod \"console-5846c7d4fc-d6vkl\" (UID: \"61c9864a-6ce0-4dfa-aed5-be86a6b92a63\") " pod="openshift-console/console-5846c7d4fc-d6vkl" May 21 13:05:28.865743 ip-10-0-133-64 kubenswrapper[2562]: I0521 13:05:28.865712 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-lrdzc\" (UniqueName: \"kubernetes.io/projected/61c9864a-6ce0-4dfa-aed5-be86a6b92a63-kube-api-access-lrdzc\") pod \"console-5846c7d4fc-d6vkl\" (UID: \"61c9864a-6ce0-4dfa-aed5-be86a6b92a63\") " pod="openshift-console/console-5846c7d4fc-d6vkl" May 21 13:05:29.000484 ip-10-0-133-64 kubenswrapper[2562]: I0521 13:05:29.000451 2562 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-5846c7d4fc-d6vkl" May 21 13:05:29.128742 ip-10-0-133-64 kubenswrapper[2562]: I0521 13:05:29.128709 2562 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-5846c7d4fc-d6vkl"] May 21 13:05:29.131654 ip-10-0-133-64 kubenswrapper[2562]: W0521 13:05:29.131632 2562 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod61c9864a_6ce0_4dfa_aed5_be86a6b92a63.slice/crio-495935d5e21ab6bda3be21b011947a8af5a35df522f781e09fcc643468958cae WatchSource:0}: Error finding container 495935d5e21ab6bda3be21b011947a8af5a35df522f781e09fcc643468958cae: Status 404 returned error can't find the container with id 495935d5e21ab6bda3be21b011947a8af5a35df522f781e09fcc643468958cae May 21 13:05:29.678812 ip-10-0-133-64 kubenswrapper[2562]: I0521 13:05:29.678772 2562 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-5846c7d4fc-d6vkl" event={"ID":"61c9864a-6ce0-4dfa-aed5-be86a6b92a63","Type":"ContainerStarted","Data":"ab6e5cf3bb8a3c04eab5e2b054aaa09dbb4c0054f548b61902e62ac4f812b27d"} May 21 13:05:29.679006 ip-10-0-133-64 kubenswrapper[2562]: I0521 13:05:29.678826 2562 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-5846c7d4fc-d6vkl" event={"ID":"61c9864a-6ce0-4dfa-aed5-be86a6b92a63","Type":"ContainerStarted","Data":"495935d5e21ab6bda3be21b011947a8af5a35df522f781e09fcc643468958cae"} May 21 13:05:29.721047 ip-10-0-133-64 kubenswrapper[2562]: I0521 13:05:29.720995 2562 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-console/console-5846c7d4fc-d6vkl" podStartSLOduration=1.720979282 podStartE2EDuration="1.720979282s" podCreationTimestamp="2026-05-21 13:05:28 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2026-05-21 13:05:29.718538796 +0000 UTC m=+176.268820164" watchObservedRunningTime="2026-05-21 13:05:29.720979282 +0000 UTC m=+176.271260650" May 21 13:05:39.001560 ip-10-0-133-64 kubenswrapper[2562]: I0521 13:05:39.001522 2562 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-console/console-5846c7d4fc-d6vkl" May 21 13:05:39.002002 ip-10-0-133-64 kubenswrapper[2562]: I0521 13:05:39.001571 2562 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/console-5846c7d4fc-d6vkl" May 21 13:05:39.006365 ip-10-0-133-64 kubenswrapper[2562]: I0521 13:05:39.006340 2562 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-console/console-5846c7d4fc-d6vkl" May 21 13:05:39.708210 ip-10-0-133-64 kubenswrapper[2562]: I0521 13:05:39.708184 2562 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console/console-5846c7d4fc-d6vkl" May 21 13:06:07.385890 ip-10-0-133-64 kubenswrapper[2562]: I0521 13:06:07.385854 2562 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-marketplace/2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19dxb4mr"] May 21 13:06:07.388295 ip-10-0-133-64 kubenswrapper[2562]: I0521 13:06:07.388271 2562 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19dxb4mr" May 21 13:06:07.391382 ip-10-0-133-64 kubenswrapper[2562]: I0521 13:06:07.391364 2562 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"kube-root-ca.crt\"" May 21 13:06:07.392442 ip-10-0-133-64 kubenswrapper[2562]: I0521 13:06:07.392424 2562 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-marketplace\"/\"default-dockercfg-z9cvq\"" May 21 13:06:07.392521 ip-10-0-133-64 kubenswrapper[2562]: I0521 13:06:07.392424 2562 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"openshift-service-ca.crt\"" May 21 13:06:07.398940 ip-10-0-133-64 kubenswrapper[2562]: I0521 13:06:07.398914 2562 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19dxb4mr"] May 21 13:06:07.445152 ip-10-0-133-64 kubenswrapper[2562]: I0521 13:06:07.445114 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/bdc79105-6268-44de-98fb-bda4e10f8f8d-bundle\") pod \"2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19dxb4mr\" (UID: \"bdc79105-6268-44de-98fb-bda4e10f8f8d\") " pod="openshift-marketplace/2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19dxb4mr" May 21 13:06:07.445152 ip-10-0-133-64 kubenswrapper[2562]: I0521 13:06:07.445159 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-fpn2w\" (UniqueName: \"kubernetes.io/projected/bdc79105-6268-44de-98fb-bda4e10f8f8d-kube-api-access-fpn2w\") pod \"2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19dxb4mr\" (UID: \"bdc79105-6268-44de-98fb-bda4e10f8f8d\") " pod="openshift-marketplace/2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19dxb4mr" May 21 13:06:07.445393 ip-10-0-133-64 kubenswrapper[2562]: I0521 13:06:07.445271 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/bdc79105-6268-44de-98fb-bda4e10f8f8d-util\") pod \"2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19dxb4mr\" (UID: \"bdc79105-6268-44de-98fb-bda4e10f8f8d\") " pod="openshift-marketplace/2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19dxb4mr" May 21 13:06:07.546121 ip-10-0-133-64 kubenswrapper[2562]: I0521 13:06:07.546069 2562 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-fpn2w\" (UniqueName: \"kubernetes.io/projected/bdc79105-6268-44de-98fb-bda4e10f8f8d-kube-api-access-fpn2w\") pod \"2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19dxb4mr\" (UID: \"bdc79105-6268-44de-98fb-bda4e10f8f8d\") " pod="openshift-marketplace/2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19dxb4mr" May 21 13:06:07.546327 ip-10-0-133-64 kubenswrapper[2562]: I0521 13:06:07.546221 2562 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/bdc79105-6268-44de-98fb-bda4e10f8f8d-util\") pod \"2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19dxb4mr\" (UID: \"bdc79105-6268-44de-98fb-bda4e10f8f8d\") " pod="openshift-marketplace/2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19dxb4mr" May 21 13:06:07.546327 ip-10-0-133-64 kubenswrapper[2562]: I0521 13:06:07.546272 2562 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/bdc79105-6268-44de-98fb-bda4e10f8f8d-bundle\") pod \"2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19dxb4mr\" (UID: \"bdc79105-6268-44de-98fb-bda4e10f8f8d\") " pod="openshift-marketplace/2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19dxb4mr" May 21 13:06:07.546694 ip-10-0-133-64 kubenswrapper[2562]: I0521 13:06:07.546673 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/bdc79105-6268-44de-98fb-bda4e10f8f8d-bundle\") pod \"2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19dxb4mr\" (UID: \"bdc79105-6268-44de-98fb-bda4e10f8f8d\") " pod="openshift-marketplace/2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19dxb4mr" May 21 13:06:07.546740 ip-10-0-133-64 kubenswrapper[2562]: I0521 13:06:07.546690 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/bdc79105-6268-44de-98fb-bda4e10f8f8d-util\") pod \"2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19dxb4mr\" (UID: \"bdc79105-6268-44de-98fb-bda4e10f8f8d\") " pod="openshift-marketplace/2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19dxb4mr" May 21 13:06:07.554164 ip-10-0-133-64 kubenswrapper[2562]: I0521 13:06:07.554140 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-fpn2w\" (UniqueName: \"kubernetes.io/projected/bdc79105-6268-44de-98fb-bda4e10f8f8d-kube-api-access-fpn2w\") pod \"2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19dxb4mr\" (UID: \"bdc79105-6268-44de-98fb-bda4e10f8f8d\") " pod="openshift-marketplace/2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19dxb4mr" May 21 13:06:07.697644 ip-10-0-133-64 kubenswrapper[2562]: I0521 13:06:07.697566 2562 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19dxb4mr" May 21 13:06:07.826470 ip-10-0-133-64 kubenswrapper[2562]: I0521 13:06:07.826375 2562 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19dxb4mr"] May 21 13:06:07.829012 ip-10-0-133-64 kubenswrapper[2562]: W0521 13:06:07.828986 2562 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podbdc79105_6268_44de_98fb_bda4e10f8f8d.slice/crio-8f0b18bbe6b44e367f1d445c397dd302db53465acd9dc21f5c743ea502a726ce WatchSource:0}: Error finding container 8f0b18bbe6b44e367f1d445c397dd302db53465acd9dc21f5c743ea502a726ce: Status 404 returned error can't find the container with id 8f0b18bbe6b44e367f1d445c397dd302db53465acd9dc21f5c743ea502a726ce May 21 13:06:08.790156 ip-10-0-133-64 kubenswrapper[2562]: I0521 13:06:08.790107 2562 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19dxb4mr" event={"ID":"bdc79105-6268-44de-98fb-bda4e10f8f8d","Type":"ContainerStarted","Data":"8f0b18bbe6b44e367f1d445c397dd302db53465acd9dc21f5c743ea502a726ce"} May 21 13:06:15.810086 ip-10-0-133-64 kubenswrapper[2562]: I0521 13:06:15.810051 2562 generic.go:358] "Generic (PLEG): container finished" podID="bdc79105-6268-44de-98fb-bda4e10f8f8d" containerID="25e0e300267c095f5495f76ff9db27753ffec065718b0a198d12fbff79980e3c" exitCode=0 May 21 13:06:15.810470 ip-10-0-133-64 kubenswrapper[2562]: I0521 13:06:15.810108 2562 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19dxb4mr" event={"ID":"bdc79105-6268-44de-98fb-bda4e10f8f8d","Type":"ContainerDied","Data":"25e0e300267c095f5495f76ff9db27753ffec065718b0a198d12fbff79980e3c"} May 21 13:06:19.822341 ip-10-0-133-64 kubenswrapper[2562]: I0521 13:06:19.822303 2562 generic.go:358] "Generic (PLEG): container finished" podID="bdc79105-6268-44de-98fb-bda4e10f8f8d" containerID="7c1a3bf12031e36050e2a95a4d875cc2dc50784fbc22802a97e4a74821c553c3" exitCode=0 May 21 13:06:19.822844 ip-10-0-133-64 kubenswrapper[2562]: I0521 13:06:19.822369 2562 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19dxb4mr" event={"ID":"bdc79105-6268-44de-98fb-bda4e10f8f8d","Type":"ContainerDied","Data":"7c1a3bf12031e36050e2a95a4d875cc2dc50784fbc22802a97e4a74821c553c3"} May 21 13:06:26.846791 ip-10-0-133-64 kubenswrapper[2562]: I0521 13:06:26.846754 2562 generic.go:358] "Generic (PLEG): container finished" podID="bdc79105-6268-44de-98fb-bda4e10f8f8d" containerID="f76cced3bb03230bbcc4cb9667e2fc5c9c1cb10716ab805bb936983d00bbaa36" exitCode=0 May 21 13:06:26.847191 ip-10-0-133-64 kubenswrapper[2562]: I0521 13:06:26.846840 2562 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19dxb4mr" event={"ID":"bdc79105-6268-44de-98fb-bda4e10f8f8d","Type":"ContainerDied","Data":"f76cced3bb03230bbcc4cb9667e2fc5c9c1cb10716ab805bb936983d00bbaa36"} May 21 13:06:27.975906 ip-10-0-133-64 kubenswrapper[2562]: I0521 13:06:27.975881 2562 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19dxb4mr" May 21 13:06:28.121250 ip-10-0-133-64 kubenswrapper[2562]: I0521 13:06:28.121168 2562 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/bdc79105-6268-44de-98fb-bda4e10f8f8d-bundle\") pod \"bdc79105-6268-44de-98fb-bda4e10f8f8d\" (UID: \"bdc79105-6268-44de-98fb-bda4e10f8f8d\") " May 21 13:06:28.121250 ip-10-0-133-64 kubenswrapper[2562]: I0521 13:06:28.121207 2562 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-fpn2w\" (UniqueName: \"kubernetes.io/projected/bdc79105-6268-44de-98fb-bda4e10f8f8d-kube-api-access-fpn2w\") pod \"bdc79105-6268-44de-98fb-bda4e10f8f8d\" (UID: \"bdc79105-6268-44de-98fb-bda4e10f8f8d\") " May 21 13:06:28.121442 ip-10-0-133-64 kubenswrapper[2562]: I0521 13:06:28.121282 2562 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/bdc79105-6268-44de-98fb-bda4e10f8f8d-util\") pod \"bdc79105-6268-44de-98fb-bda4e10f8f8d\" (UID: \"bdc79105-6268-44de-98fb-bda4e10f8f8d\") " May 21 13:06:28.121947 ip-10-0-133-64 kubenswrapper[2562]: I0521 13:06:28.121919 2562 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/bdc79105-6268-44de-98fb-bda4e10f8f8d-bundle" (OuterVolumeSpecName: "bundle") pod "bdc79105-6268-44de-98fb-bda4e10f8f8d" (UID: "bdc79105-6268-44de-98fb-bda4e10f8f8d"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" May 21 13:06:28.123480 ip-10-0-133-64 kubenswrapper[2562]: I0521 13:06:28.123457 2562 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/bdc79105-6268-44de-98fb-bda4e10f8f8d-kube-api-access-fpn2w" (OuterVolumeSpecName: "kube-api-access-fpn2w") pod "bdc79105-6268-44de-98fb-bda4e10f8f8d" (UID: "bdc79105-6268-44de-98fb-bda4e10f8f8d"). InnerVolumeSpecName "kube-api-access-fpn2w". PluginName "kubernetes.io/projected", VolumeGIDValue "" May 21 13:06:28.125669 ip-10-0-133-64 kubenswrapper[2562]: I0521 13:06:28.125646 2562 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/bdc79105-6268-44de-98fb-bda4e10f8f8d-util" (OuterVolumeSpecName: "util") pod "bdc79105-6268-44de-98fb-bda4e10f8f8d" (UID: "bdc79105-6268-44de-98fb-bda4e10f8f8d"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" May 21 13:06:28.222523 ip-10-0-133-64 kubenswrapper[2562]: I0521 13:06:28.222497 2562 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/bdc79105-6268-44de-98fb-bda4e10f8f8d-util\") on node \"ip-10-0-133-64.ec2.internal\" DevicePath \"\"" May 21 13:06:28.222523 ip-10-0-133-64 kubenswrapper[2562]: I0521 13:06:28.222518 2562 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/bdc79105-6268-44de-98fb-bda4e10f8f8d-bundle\") on node \"ip-10-0-133-64.ec2.internal\" DevicePath \"\"" May 21 13:06:28.222687 ip-10-0-133-64 kubenswrapper[2562]: I0521 13:06:28.222528 2562 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-fpn2w\" (UniqueName: \"kubernetes.io/projected/bdc79105-6268-44de-98fb-bda4e10f8f8d-kube-api-access-fpn2w\") on node \"ip-10-0-133-64.ec2.internal\" DevicePath \"\"" May 21 13:06:28.854600 ip-10-0-133-64 kubenswrapper[2562]: I0521 13:06:28.854560 2562 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19dxb4mr" event={"ID":"bdc79105-6268-44de-98fb-bda4e10f8f8d","Type":"ContainerDied","Data":"8f0b18bbe6b44e367f1d445c397dd302db53465acd9dc21f5c743ea502a726ce"} May 21 13:06:28.854600 ip-10-0-133-64 kubenswrapper[2562]: I0521 13:06:28.854600 2562 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="8f0b18bbe6b44e367f1d445c397dd302db53465acd9dc21f5c743ea502a726ce" May 21 13:06:28.854829 ip-10-0-133-64 kubenswrapper[2562]: I0521 13:06:28.854622 2562 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19dxb4mr" May 21 13:06:35.576503 ip-10-0-133-64 kubenswrapper[2562]: I0521 13:06:35.576470 2562 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["cert-manager-operator/cert-manager-operator-controller-manager-54b9655956-rqhql"] May 21 13:06:35.576954 ip-10-0-133-64 kubenswrapper[2562]: I0521 13:06:35.576734 2562 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="bdc79105-6268-44de-98fb-bda4e10f8f8d" containerName="util" May 21 13:06:35.576954 ip-10-0-133-64 kubenswrapper[2562]: I0521 13:06:35.576745 2562 state_mem.go:107] "Deleted CPUSet assignment" podUID="bdc79105-6268-44de-98fb-bda4e10f8f8d" containerName="util" May 21 13:06:35.576954 ip-10-0-133-64 kubenswrapper[2562]: I0521 13:06:35.576751 2562 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="bdc79105-6268-44de-98fb-bda4e10f8f8d" containerName="pull" May 21 13:06:35.576954 ip-10-0-133-64 kubenswrapper[2562]: I0521 13:06:35.576757 2562 state_mem.go:107] "Deleted CPUSet assignment" podUID="bdc79105-6268-44de-98fb-bda4e10f8f8d" containerName="pull" May 21 13:06:35.576954 ip-10-0-133-64 kubenswrapper[2562]: I0521 13:06:35.576765 2562 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="bdc79105-6268-44de-98fb-bda4e10f8f8d" containerName="extract" May 21 13:06:35.576954 ip-10-0-133-64 kubenswrapper[2562]: I0521 13:06:35.576771 2562 state_mem.go:107] "Deleted CPUSet assignment" podUID="bdc79105-6268-44de-98fb-bda4e10f8f8d" containerName="extract" May 21 13:06:35.576954 ip-10-0-133-64 kubenswrapper[2562]: I0521 13:06:35.576836 2562 memory_manager.go:356] "RemoveStaleState removing state" podUID="bdc79105-6268-44de-98fb-bda4e10f8f8d" containerName="extract" May 21 13:06:35.581177 ip-10-0-133-64 kubenswrapper[2562]: I0521 13:06:35.581159 2562 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager-operator/cert-manager-operator-controller-manager-54b9655956-rqhql" May 21 13:06:35.584027 ip-10-0-133-64 kubenswrapper[2562]: I0521 13:06:35.584002 2562 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"cert-manager-operator\"/\"kube-root-ca.crt\"" May 21 13:06:35.584130 ip-10-0-133-64 kubenswrapper[2562]: I0521 13:06:35.584051 2562 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"cert-manager-operator\"/\"openshift-service-ca.crt\"" May 21 13:06:35.584986 ip-10-0-133-64 kubenswrapper[2562]: I0521 13:06:35.584853 2562 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"cert-manager-operator\"/\"cert-manager-operator-controller-manager-dockercfg-h2q44\"" May 21 13:06:35.592281 ip-10-0-133-64 kubenswrapper[2562]: I0521 13:06:35.592255 2562 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["cert-manager-operator/cert-manager-operator-controller-manager-54b9655956-rqhql"] May 21 13:06:35.678823 ip-10-0-133-64 kubenswrapper[2562]: I0521 13:06:35.678777 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-7g6cv\" (UniqueName: \"kubernetes.io/projected/e271e2d4-c636-40cf-aa3e-fd1f98bff23c-kube-api-access-7g6cv\") pod \"cert-manager-operator-controller-manager-54b9655956-rqhql\" (UID: \"e271e2d4-c636-40cf-aa3e-fd1f98bff23c\") " pod="cert-manager-operator/cert-manager-operator-controller-manager-54b9655956-rqhql" May 21 13:06:35.678999 ip-10-0-133-64 kubenswrapper[2562]: I0521 13:06:35.678913 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/e271e2d4-c636-40cf-aa3e-fd1f98bff23c-tmp\") pod \"cert-manager-operator-controller-manager-54b9655956-rqhql\" (UID: \"e271e2d4-c636-40cf-aa3e-fd1f98bff23c\") " pod="cert-manager-operator/cert-manager-operator-controller-manager-54b9655956-rqhql" May 21 13:06:35.780187 ip-10-0-133-64 kubenswrapper[2562]: I0521 13:06:35.780152 2562 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-7g6cv\" (UniqueName: \"kubernetes.io/projected/e271e2d4-c636-40cf-aa3e-fd1f98bff23c-kube-api-access-7g6cv\") pod \"cert-manager-operator-controller-manager-54b9655956-rqhql\" (UID: \"e271e2d4-c636-40cf-aa3e-fd1f98bff23c\") " pod="cert-manager-operator/cert-manager-operator-controller-manager-54b9655956-rqhql" May 21 13:06:35.780363 ip-10-0-133-64 kubenswrapper[2562]: I0521 13:06:35.780239 2562 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/e271e2d4-c636-40cf-aa3e-fd1f98bff23c-tmp\") pod \"cert-manager-operator-controller-manager-54b9655956-rqhql\" (UID: \"e271e2d4-c636-40cf-aa3e-fd1f98bff23c\") " pod="cert-manager-operator/cert-manager-operator-controller-manager-54b9655956-rqhql" May 21 13:06:35.780572 ip-10-0-133-64 kubenswrapper[2562]: I0521 13:06:35.780555 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/e271e2d4-c636-40cf-aa3e-fd1f98bff23c-tmp\") pod \"cert-manager-operator-controller-manager-54b9655956-rqhql\" (UID: \"e271e2d4-c636-40cf-aa3e-fd1f98bff23c\") " pod="cert-manager-operator/cert-manager-operator-controller-manager-54b9655956-rqhql" May 21 13:06:35.789137 ip-10-0-133-64 kubenswrapper[2562]: I0521 13:06:35.789116 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-7g6cv\" (UniqueName: \"kubernetes.io/projected/e271e2d4-c636-40cf-aa3e-fd1f98bff23c-kube-api-access-7g6cv\") pod \"cert-manager-operator-controller-manager-54b9655956-rqhql\" (UID: \"e271e2d4-c636-40cf-aa3e-fd1f98bff23c\") " pod="cert-manager-operator/cert-manager-operator-controller-manager-54b9655956-rqhql" May 21 13:06:35.895019 ip-10-0-133-64 kubenswrapper[2562]: I0521 13:06:35.894931 2562 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager-operator/cert-manager-operator-controller-manager-54b9655956-rqhql" May 21 13:06:36.027099 ip-10-0-133-64 kubenswrapper[2562]: I0521 13:06:36.027072 2562 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["cert-manager-operator/cert-manager-operator-controller-manager-54b9655956-rqhql"] May 21 13:06:36.030195 ip-10-0-133-64 kubenswrapper[2562]: W0521 13:06:36.030162 2562 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pode271e2d4_c636_40cf_aa3e_fd1f98bff23c.slice/crio-8053b51bd01f47e6bc3f973bf8de07df1dd31d7f97537e4e40f24215513573af WatchSource:0}: Error finding container 8053b51bd01f47e6bc3f973bf8de07df1dd31d7f97537e4e40f24215513573af: Status 404 returned error can't find the container with id 8053b51bd01f47e6bc3f973bf8de07df1dd31d7f97537e4e40f24215513573af May 21 13:06:36.878260 ip-10-0-133-64 kubenswrapper[2562]: I0521 13:06:36.878222 2562 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="cert-manager-operator/cert-manager-operator-controller-manager-54b9655956-rqhql" event={"ID":"e271e2d4-c636-40cf-aa3e-fd1f98bff23c","Type":"ContainerStarted","Data":"8053b51bd01f47e6bc3f973bf8de07df1dd31d7f97537e4e40f24215513573af"} May 21 13:06:37.887335 ip-10-0-133-64 kubenswrapper[2562]: I0521 13:06:37.887287 2562 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="cert-manager-operator/cert-manager-operator-controller-manager-54b9655956-rqhql" event={"ID":"e271e2d4-c636-40cf-aa3e-fd1f98bff23c","Type":"ContainerStarted","Data":"87c92fabf561ebf2e8cac76fc912088c304e58cf5fd5aee28c533a5b0ce0644d"} May 21 13:06:37.927475 ip-10-0-133-64 kubenswrapper[2562]: I0521 13:06:37.927418 2562 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="cert-manager-operator/cert-manager-operator-controller-manager-54b9655956-rqhql" podStartSLOduration=1.567641608 podStartE2EDuration="2.92740537s" podCreationTimestamp="2026-05-21 13:06:35 +0000 UTC" firstStartedPulling="2026-05-21 13:06:36.032572159 +0000 UTC m=+242.582853504" lastFinishedPulling="2026-05-21 13:06:37.392335918 +0000 UTC m=+243.942617266" observedRunningTime="2026-05-21 13:06:37.92104379 +0000 UTC m=+244.471325158" watchObservedRunningTime="2026-05-21 13:06:37.92740537 +0000 UTC m=+244.477686738" May 21 13:06:39.919570 ip-10-0-133-64 kubenswrapper[2562]: I0521 13:06:39.919539 2562 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f5xxgh"] May 21 13:06:39.921761 ip-10-0-133-64 kubenswrapper[2562]: I0521 13:06:39.921745 2562 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f5xxgh" May 21 13:06:39.925942 ip-10-0-133-64 kubenswrapper[2562]: I0521 13:06:39.925918 2562 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-marketplace\"/\"default-dockercfg-z9cvq\"" May 21 13:06:39.926063 ip-10-0-133-64 kubenswrapper[2562]: I0521 13:06:39.925944 2562 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"kube-root-ca.crt\"" May 21 13:06:39.926063 ip-10-0-133-64 kubenswrapper[2562]: I0521 13:06:39.925945 2562 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"openshift-service-ca.crt\"" May 21 13:06:39.934302 ip-10-0-133-64 kubenswrapper[2562]: I0521 13:06:39.934282 2562 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f5xxgh"] May 21 13:06:40.010060 ip-10-0-133-64 kubenswrapper[2562]: I0521 13:06:40.010019 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/3e4ffa2f-64a7-4f60-a63f-ff82ff99fe6f-util\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f5xxgh\" (UID: \"3e4ffa2f-64a7-4f60-a63f-ff82ff99fe6f\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f5xxgh" May 21 13:06:40.010209 ip-10-0-133-64 kubenswrapper[2562]: I0521 13:06:40.010072 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-xr9d5\" (UniqueName: \"kubernetes.io/projected/3e4ffa2f-64a7-4f60-a63f-ff82ff99fe6f-kube-api-access-xr9d5\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f5xxgh\" (UID: \"3e4ffa2f-64a7-4f60-a63f-ff82ff99fe6f\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f5xxgh" May 21 13:06:40.010209 ip-10-0-133-64 kubenswrapper[2562]: I0521 13:06:40.010117 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/3e4ffa2f-64a7-4f60-a63f-ff82ff99fe6f-bundle\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f5xxgh\" (UID: \"3e4ffa2f-64a7-4f60-a63f-ff82ff99fe6f\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f5xxgh" May 21 13:06:40.111468 ip-10-0-133-64 kubenswrapper[2562]: I0521 13:06:40.111414 2562 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/3e4ffa2f-64a7-4f60-a63f-ff82ff99fe6f-util\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f5xxgh\" (UID: \"3e4ffa2f-64a7-4f60-a63f-ff82ff99fe6f\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f5xxgh" May 21 13:06:40.111468 ip-10-0-133-64 kubenswrapper[2562]: I0521 13:06:40.111465 2562 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-xr9d5\" (UniqueName: \"kubernetes.io/projected/3e4ffa2f-64a7-4f60-a63f-ff82ff99fe6f-kube-api-access-xr9d5\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f5xxgh\" (UID: \"3e4ffa2f-64a7-4f60-a63f-ff82ff99fe6f\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f5xxgh" May 21 13:06:40.111677 ip-10-0-133-64 kubenswrapper[2562]: I0521 13:06:40.111516 2562 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/3e4ffa2f-64a7-4f60-a63f-ff82ff99fe6f-bundle\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f5xxgh\" (UID: \"3e4ffa2f-64a7-4f60-a63f-ff82ff99fe6f\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f5xxgh" May 21 13:06:40.111879 ip-10-0-133-64 kubenswrapper[2562]: I0521 13:06:40.111863 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/3e4ffa2f-64a7-4f60-a63f-ff82ff99fe6f-bundle\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f5xxgh\" (UID: \"3e4ffa2f-64a7-4f60-a63f-ff82ff99fe6f\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f5xxgh" May 21 13:06:40.111941 ip-10-0-133-64 kubenswrapper[2562]: I0521 13:06:40.111923 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/3e4ffa2f-64a7-4f60-a63f-ff82ff99fe6f-util\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f5xxgh\" (UID: \"3e4ffa2f-64a7-4f60-a63f-ff82ff99fe6f\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f5xxgh" May 21 13:06:40.120701 ip-10-0-133-64 kubenswrapper[2562]: I0521 13:06:40.120674 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-xr9d5\" (UniqueName: \"kubernetes.io/projected/3e4ffa2f-64a7-4f60-a63f-ff82ff99fe6f-kube-api-access-xr9d5\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f5xxgh\" (UID: \"3e4ffa2f-64a7-4f60-a63f-ff82ff99fe6f\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f5xxgh" May 21 13:06:40.230832 ip-10-0-133-64 kubenswrapper[2562]: I0521 13:06:40.230810 2562 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f5xxgh" May 21 13:06:40.358441 ip-10-0-133-64 kubenswrapper[2562]: I0521 13:06:40.358414 2562 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f5xxgh"] May 21 13:06:40.360724 ip-10-0-133-64 kubenswrapper[2562]: W0521 13:06:40.360691 2562 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod3e4ffa2f_64a7_4f60_a63f_ff82ff99fe6f.slice/crio-59f18f9012332353402b72981f85382a61bbb8ecbe272c59564ac8d1efa892e3 WatchSource:0}: Error finding container 59f18f9012332353402b72981f85382a61bbb8ecbe272c59564ac8d1efa892e3: Status 404 returned error can't find the container with id 59f18f9012332353402b72981f85382a61bbb8ecbe272c59564ac8d1efa892e3 May 21 13:06:40.897397 ip-10-0-133-64 kubenswrapper[2562]: I0521 13:06:40.897360 2562 generic.go:358] "Generic (PLEG): container finished" podID="3e4ffa2f-64a7-4f60-a63f-ff82ff99fe6f" containerID="d007459af101257c1adfe2efb9f8069cd87ece31c49ee1bbde19ce0e2deecce1" exitCode=0 May 21 13:06:40.897606 ip-10-0-133-64 kubenswrapper[2562]: I0521 13:06:40.897452 2562 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f5xxgh" event={"ID":"3e4ffa2f-64a7-4f60-a63f-ff82ff99fe6f","Type":"ContainerDied","Data":"d007459af101257c1adfe2efb9f8069cd87ece31c49ee1bbde19ce0e2deecce1"} May 21 13:06:40.897606 ip-10-0-133-64 kubenswrapper[2562]: I0521 13:06:40.897491 2562 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f5xxgh" event={"ID":"3e4ffa2f-64a7-4f60-a63f-ff82ff99fe6f","Type":"ContainerStarted","Data":"59f18f9012332353402b72981f85382a61bbb8ecbe272c59564ac8d1efa892e3"} May 21 13:06:43.401928 ip-10-0-133-64 kubenswrapper[2562]: I0521 13:06:43.401841 2562 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["cert-manager/cert-manager-cainjector-68b757865b-gpb8p"] May 21 13:06:43.404075 ip-10-0-133-64 kubenswrapper[2562]: I0521 13:06:43.404059 2562 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager/cert-manager-cainjector-68b757865b-gpb8p" May 21 13:06:43.406099 ip-10-0-133-64 kubenswrapper[2562]: I0521 13:06:43.406074 2562 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"cert-manager\"/\"kube-root-ca.crt\"" May 21 13:06:43.406872 ip-10-0-133-64 kubenswrapper[2562]: I0521 13:06:43.406849 2562 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"cert-manager\"/\"cert-manager-cainjector-dockercfg-nm7nf\"" May 21 13:06:43.406977 ip-10-0-133-64 kubenswrapper[2562]: I0521 13:06:43.406849 2562 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"cert-manager\"/\"openshift-service-ca.crt\"" May 21 13:06:43.415427 ip-10-0-133-64 kubenswrapper[2562]: I0521 13:06:43.415404 2562 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["cert-manager/cert-manager-cainjector-68b757865b-gpb8p"] May 21 13:06:43.437316 ip-10-0-133-64 kubenswrapper[2562]: I0521 13:06:43.437290 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/aa981c2f-9af2-4203-8c6c-39fa38e72481-bound-sa-token\") pod \"cert-manager-cainjector-68b757865b-gpb8p\" (UID: \"aa981c2f-9af2-4203-8c6c-39fa38e72481\") " pod="cert-manager/cert-manager-cainjector-68b757865b-gpb8p" May 21 13:06:43.437417 ip-10-0-133-64 kubenswrapper[2562]: I0521 13:06:43.437365 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-gnfd7\" (UniqueName: \"kubernetes.io/projected/aa981c2f-9af2-4203-8c6c-39fa38e72481-kube-api-access-gnfd7\") pod \"cert-manager-cainjector-68b757865b-gpb8p\" (UID: \"aa981c2f-9af2-4203-8c6c-39fa38e72481\") " pod="cert-manager/cert-manager-cainjector-68b757865b-gpb8p" May 21 13:06:43.538548 ip-10-0-133-64 kubenswrapper[2562]: I0521 13:06:43.538506 2562 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-gnfd7\" (UniqueName: \"kubernetes.io/projected/aa981c2f-9af2-4203-8c6c-39fa38e72481-kube-api-access-gnfd7\") pod \"cert-manager-cainjector-68b757865b-gpb8p\" (UID: \"aa981c2f-9af2-4203-8c6c-39fa38e72481\") " pod="cert-manager/cert-manager-cainjector-68b757865b-gpb8p" May 21 13:06:43.538548 ip-10-0-133-64 kubenswrapper[2562]: I0521 13:06:43.538551 2562 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/aa981c2f-9af2-4203-8c6c-39fa38e72481-bound-sa-token\") pod \"cert-manager-cainjector-68b757865b-gpb8p\" (UID: \"aa981c2f-9af2-4203-8c6c-39fa38e72481\") " pod="cert-manager/cert-manager-cainjector-68b757865b-gpb8p" May 21 13:06:43.547314 ip-10-0-133-64 kubenswrapper[2562]: I0521 13:06:43.547292 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/aa981c2f-9af2-4203-8c6c-39fa38e72481-bound-sa-token\") pod \"cert-manager-cainjector-68b757865b-gpb8p\" (UID: \"aa981c2f-9af2-4203-8c6c-39fa38e72481\") " pod="cert-manager/cert-manager-cainjector-68b757865b-gpb8p" May 21 13:06:43.547416 ip-10-0-133-64 kubenswrapper[2562]: I0521 13:06:43.547366 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-gnfd7\" (UniqueName: \"kubernetes.io/projected/aa981c2f-9af2-4203-8c6c-39fa38e72481-kube-api-access-gnfd7\") pod \"cert-manager-cainjector-68b757865b-gpb8p\" (UID: \"aa981c2f-9af2-4203-8c6c-39fa38e72481\") " pod="cert-manager/cert-manager-cainjector-68b757865b-gpb8p" May 21 13:06:43.727317 ip-10-0-133-64 kubenswrapper[2562]: I0521 13:06:43.727286 2562 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager/cert-manager-cainjector-68b757865b-gpb8p" May 21 13:06:43.872888 ip-10-0-133-64 kubenswrapper[2562]: I0521 13:06:43.872852 2562 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["cert-manager/cert-manager-cainjector-68b757865b-gpb8p"] May 21 13:06:43.878853 ip-10-0-133-64 kubenswrapper[2562]: W0521 13:06:43.878822 2562 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-podaa981c2f_9af2_4203_8c6c_39fa38e72481.slice/crio-bf2daf166d0e3b35ac9771ad89838782ab40a13e76ec025c4ea6961d02f2a1a7 WatchSource:0}: Error finding container bf2daf166d0e3b35ac9771ad89838782ab40a13e76ec025c4ea6961d02f2a1a7: Status 404 returned error can't find the container with id bf2daf166d0e3b35ac9771ad89838782ab40a13e76ec025c4ea6961d02f2a1a7 May 21 13:06:43.908144 ip-10-0-133-64 kubenswrapper[2562]: I0521 13:06:43.908112 2562 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="cert-manager/cert-manager-cainjector-68b757865b-gpb8p" event={"ID":"aa981c2f-9af2-4203-8c6c-39fa38e72481","Type":"ContainerStarted","Data":"bf2daf166d0e3b35ac9771ad89838782ab40a13e76ec025c4ea6961d02f2a1a7"} May 21 13:06:43.909533 ip-10-0-133-64 kubenswrapper[2562]: I0521 13:06:43.909509 2562 generic.go:358] "Generic (PLEG): container finished" podID="3e4ffa2f-64a7-4f60-a63f-ff82ff99fe6f" containerID="97d673a64a1a115b27d5f4ee5258d7797902569b80066a5c6af341640f1a6efb" exitCode=0 May 21 13:06:43.909619 ip-10-0-133-64 kubenswrapper[2562]: I0521 13:06:43.909556 2562 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f5xxgh" event={"ID":"3e4ffa2f-64a7-4f60-a63f-ff82ff99fe6f","Type":"ContainerDied","Data":"97d673a64a1a115b27d5f4ee5258d7797902569b80066a5c6af341640f1a6efb"} May 21 13:06:44.914851 ip-10-0-133-64 kubenswrapper[2562]: I0521 13:06:44.914794 2562 generic.go:358] "Generic (PLEG): container finished" podID="3e4ffa2f-64a7-4f60-a63f-ff82ff99fe6f" containerID="e21f9cb8eca4fa0ef6691a064973a0ab347387be8ded097ba27d4b3d8d43a867" exitCode=0 May 21 13:06:44.915233 ip-10-0-133-64 kubenswrapper[2562]: I0521 13:06:44.914861 2562 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f5xxgh" event={"ID":"3e4ffa2f-64a7-4f60-a63f-ff82ff99fe6f","Type":"ContainerDied","Data":"e21f9cb8eca4fa0ef6691a064973a0ab347387be8ded097ba27d4b3d8d43a867"} May 21 13:06:46.557536 ip-10-0-133-64 kubenswrapper[2562]: I0521 13:06:46.557510 2562 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f5xxgh" May 21 13:06:46.664357 ip-10-0-133-64 kubenswrapper[2562]: I0521 13:06:46.664335 2562 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-xr9d5\" (UniqueName: \"kubernetes.io/projected/3e4ffa2f-64a7-4f60-a63f-ff82ff99fe6f-kube-api-access-xr9d5\") pod \"3e4ffa2f-64a7-4f60-a63f-ff82ff99fe6f\" (UID: \"3e4ffa2f-64a7-4f60-a63f-ff82ff99fe6f\") " May 21 13:06:46.664447 ip-10-0-133-64 kubenswrapper[2562]: I0521 13:06:46.664380 2562 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/3e4ffa2f-64a7-4f60-a63f-ff82ff99fe6f-util\") pod \"3e4ffa2f-64a7-4f60-a63f-ff82ff99fe6f\" (UID: \"3e4ffa2f-64a7-4f60-a63f-ff82ff99fe6f\") " May 21 13:06:46.664447 ip-10-0-133-64 kubenswrapper[2562]: I0521 13:06:46.664400 2562 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/3e4ffa2f-64a7-4f60-a63f-ff82ff99fe6f-bundle\") pod \"3e4ffa2f-64a7-4f60-a63f-ff82ff99fe6f\" (UID: \"3e4ffa2f-64a7-4f60-a63f-ff82ff99fe6f\") " May 21 13:06:46.664792 ip-10-0-133-64 kubenswrapper[2562]: I0521 13:06:46.664768 2562 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/3e4ffa2f-64a7-4f60-a63f-ff82ff99fe6f-bundle" (OuterVolumeSpecName: "bundle") pod "3e4ffa2f-64a7-4f60-a63f-ff82ff99fe6f" (UID: "3e4ffa2f-64a7-4f60-a63f-ff82ff99fe6f"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" May 21 13:06:46.666412 ip-10-0-133-64 kubenswrapper[2562]: I0521 13:06:46.666389 2562 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/3e4ffa2f-64a7-4f60-a63f-ff82ff99fe6f-kube-api-access-xr9d5" (OuterVolumeSpecName: "kube-api-access-xr9d5") pod "3e4ffa2f-64a7-4f60-a63f-ff82ff99fe6f" (UID: "3e4ffa2f-64a7-4f60-a63f-ff82ff99fe6f"). InnerVolumeSpecName "kube-api-access-xr9d5". PluginName "kubernetes.io/projected", VolumeGIDValue "" May 21 13:06:46.671024 ip-10-0-133-64 kubenswrapper[2562]: I0521 13:06:46.670997 2562 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/3e4ffa2f-64a7-4f60-a63f-ff82ff99fe6f-util" (OuterVolumeSpecName: "util") pod "3e4ffa2f-64a7-4f60-a63f-ff82ff99fe6f" (UID: "3e4ffa2f-64a7-4f60-a63f-ff82ff99fe6f"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" May 21 13:06:46.765283 ip-10-0-133-64 kubenswrapper[2562]: I0521 13:06:46.765249 2562 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-xr9d5\" (UniqueName: \"kubernetes.io/projected/3e4ffa2f-64a7-4f60-a63f-ff82ff99fe6f-kube-api-access-xr9d5\") on node \"ip-10-0-133-64.ec2.internal\" DevicePath \"\"" May 21 13:06:46.765283 ip-10-0-133-64 kubenswrapper[2562]: I0521 13:06:46.765278 2562 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/3e4ffa2f-64a7-4f60-a63f-ff82ff99fe6f-util\") on node \"ip-10-0-133-64.ec2.internal\" DevicePath \"\"" May 21 13:06:46.765283 ip-10-0-133-64 kubenswrapper[2562]: I0521 13:06:46.765289 2562 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/3e4ffa2f-64a7-4f60-a63f-ff82ff99fe6f-bundle\") on node \"ip-10-0-133-64.ec2.internal\" DevicePath \"\"" May 21 13:06:46.923499 ip-10-0-133-64 kubenswrapper[2562]: I0521 13:06:46.923399 2562 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="cert-manager/cert-manager-cainjector-68b757865b-gpb8p" event={"ID":"aa981c2f-9af2-4203-8c6c-39fa38e72481","Type":"ContainerStarted","Data":"3a60e66bfadcf18e3a3cce0304df76295d81004af49e7c026273a126bad8939a"} May 21 13:06:46.925290 ip-10-0-133-64 kubenswrapper[2562]: I0521 13:06:46.925260 2562 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f5xxgh" event={"ID":"3e4ffa2f-64a7-4f60-a63f-ff82ff99fe6f","Type":"ContainerDied","Data":"59f18f9012332353402b72981f85382a61bbb8ecbe272c59564ac8d1efa892e3"} May 21 13:06:46.925290 ip-10-0-133-64 kubenswrapper[2562]: I0521 13:06:46.925294 2562 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="59f18f9012332353402b72981f85382a61bbb8ecbe272c59564ac8d1efa892e3" May 21 13:06:46.925496 ip-10-0-133-64 kubenswrapper[2562]: I0521 13:06:46.925368 2562 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f5xxgh" May 21 13:06:46.946234 ip-10-0-133-64 kubenswrapper[2562]: I0521 13:06:46.946191 2562 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="cert-manager/cert-manager-cainjector-68b757865b-gpb8p" podStartSLOduration=1.219848219 podStartE2EDuration="3.946175571s" podCreationTimestamp="2026-05-21 13:06:43 +0000 UTC" firstStartedPulling="2026-05-21 13:06:43.882665606 +0000 UTC m=+250.432946952" lastFinishedPulling="2026-05-21 13:06:46.608992955 +0000 UTC m=+253.159274304" observedRunningTime="2026-05-21 13:06:46.94481265 +0000 UTC m=+253.495094011" watchObservedRunningTime="2026-05-21 13:06:46.946175571 +0000 UTC m=+253.496456938" May 21 13:06:59.221358 ip-10-0-133-64 kubenswrapper[2562]: I0521 13:06:59.221275 2562 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-marketplace/3081035efbc3f76b8ae1b663abbd2a6bc5b4896fe94818011b247755c5f9msx"] May 21 13:06:59.221728 ip-10-0-133-64 kubenswrapper[2562]: I0521 13:06:59.221599 2562 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="3e4ffa2f-64a7-4f60-a63f-ff82ff99fe6f" containerName="pull" May 21 13:06:59.221728 ip-10-0-133-64 kubenswrapper[2562]: I0521 13:06:59.221610 2562 state_mem.go:107] "Deleted CPUSet assignment" podUID="3e4ffa2f-64a7-4f60-a63f-ff82ff99fe6f" containerName="pull" May 21 13:06:59.221728 ip-10-0-133-64 kubenswrapper[2562]: I0521 13:06:59.221620 2562 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="3e4ffa2f-64a7-4f60-a63f-ff82ff99fe6f" containerName="extract" May 21 13:06:59.221728 ip-10-0-133-64 kubenswrapper[2562]: I0521 13:06:59.221626 2562 state_mem.go:107] "Deleted CPUSet assignment" podUID="3e4ffa2f-64a7-4f60-a63f-ff82ff99fe6f" containerName="extract" May 21 13:06:59.221728 ip-10-0-133-64 kubenswrapper[2562]: I0521 13:06:59.221639 2562 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="3e4ffa2f-64a7-4f60-a63f-ff82ff99fe6f" containerName="util" May 21 13:06:59.221728 ip-10-0-133-64 kubenswrapper[2562]: I0521 13:06:59.221644 2562 state_mem.go:107] "Deleted CPUSet assignment" podUID="3e4ffa2f-64a7-4f60-a63f-ff82ff99fe6f" containerName="util" May 21 13:06:59.221728 ip-10-0-133-64 kubenswrapper[2562]: I0521 13:06:59.221693 2562 memory_manager.go:356] "RemoveStaleState removing state" podUID="3e4ffa2f-64a7-4f60-a63f-ff82ff99fe6f" containerName="extract" May 21 13:06:59.224826 ip-10-0-133-64 kubenswrapper[2562]: I0521 13:06:59.224787 2562 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/3081035efbc3f76b8ae1b663abbd2a6bc5b4896fe94818011b247755c5f9msx" May 21 13:06:59.227028 ip-10-0-133-64 kubenswrapper[2562]: I0521 13:06:59.227004 2562 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"openshift-service-ca.crt\"" May 21 13:06:59.227758 ip-10-0-133-64 kubenswrapper[2562]: I0521 13:06:59.227741 2562 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-marketplace\"/\"default-dockercfg-z9cvq\"" May 21 13:06:59.227911 ip-10-0-133-64 kubenswrapper[2562]: I0521 13:06:59.227758 2562 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"kube-root-ca.crt\"" May 21 13:06:59.233467 ip-10-0-133-64 kubenswrapper[2562]: I0521 13:06:59.233437 2562 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/3081035efbc3f76b8ae1b663abbd2a6bc5b4896fe94818011b247755c5f9msx"] May 21 13:06:59.260424 ip-10-0-133-64 kubenswrapper[2562]: I0521 13:06:59.260393 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-p5wf6\" (UniqueName: \"kubernetes.io/projected/af618b36-15dd-4829-92a4-c6c02b1cba52-kube-api-access-p5wf6\") pod \"3081035efbc3f76b8ae1b663abbd2a6bc5b4896fe94818011b247755c5f9msx\" (UID: \"af618b36-15dd-4829-92a4-c6c02b1cba52\") " pod="openshift-marketplace/3081035efbc3f76b8ae1b663abbd2a6bc5b4896fe94818011b247755c5f9msx" May 21 13:06:59.260551 ip-10-0-133-64 kubenswrapper[2562]: I0521 13:06:59.260449 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/af618b36-15dd-4829-92a4-c6c02b1cba52-util\") pod \"3081035efbc3f76b8ae1b663abbd2a6bc5b4896fe94818011b247755c5f9msx\" (UID: \"af618b36-15dd-4829-92a4-c6c02b1cba52\") " pod="openshift-marketplace/3081035efbc3f76b8ae1b663abbd2a6bc5b4896fe94818011b247755c5f9msx" May 21 13:06:59.260551 ip-10-0-133-64 kubenswrapper[2562]: I0521 13:06:59.260519 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/af618b36-15dd-4829-92a4-c6c02b1cba52-bundle\") pod \"3081035efbc3f76b8ae1b663abbd2a6bc5b4896fe94818011b247755c5f9msx\" (UID: \"af618b36-15dd-4829-92a4-c6c02b1cba52\") " pod="openshift-marketplace/3081035efbc3f76b8ae1b663abbd2a6bc5b4896fe94818011b247755c5f9msx" May 21 13:06:59.361303 ip-10-0-133-64 kubenswrapper[2562]: I0521 13:06:59.361268 2562 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/af618b36-15dd-4829-92a4-c6c02b1cba52-bundle\") pod \"3081035efbc3f76b8ae1b663abbd2a6bc5b4896fe94818011b247755c5f9msx\" (UID: \"af618b36-15dd-4829-92a4-c6c02b1cba52\") " pod="openshift-marketplace/3081035efbc3f76b8ae1b663abbd2a6bc5b4896fe94818011b247755c5f9msx" May 21 13:06:59.361460 ip-10-0-133-64 kubenswrapper[2562]: I0521 13:06:59.361352 2562 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-p5wf6\" (UniqueName: \"kubernetes.io/projected/af618b36-15dd-4829-92a4-c6c02b1cba52-kube-api-access-p5wf6\") pod \"3081035efbc3f76b8ae1b663abbd2a6bc5b4896fe94818011b247755c5f9msx\" (UID: \"af618b36-15dd-4829-92a4-c6c02b1cba52\") " pod="openshift-marketplace/3081035efbc3f76b8ae1b663abbd2a6bc5b4896fe94818011b247755c5f9msx" May 21 13:06:59.361460 ip-10-0-133-64 kubenswrapper[2562]: I0521 13:06:59.361401 2562 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/af618b36-15dd-4829-92a4-c6c02b1cba52-util\") pod \"3081035efbc3f76b8ae1b663abbd2a6bc5b4896fe94818011b247755c5f9msx\" (UID: \"af618b36-15dd-4829-92a4-c6c02b1cba52\") " pod="openshift-marketplace/3081035efbc3f76b8ae1b663abbd2a6bc5b4896fe94818011b247755c5f9msx" May 21 13:06:59.361722 ip-10-0-133-64 kubenswrapper[2562]: I0521 13:06:59.361696 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/af618b36-15dd-4829-92a4-c6c02b1cba52-bundle\") pod \"3081035efbc3f76b8ae1b663abbd2a6bc5b4896fe94818011b247755c5f9msx\" (UID: \"af618b36-15dd-4829-92a4-c6c02b1cba52\") " pod="openshift-marketplace/3081035efbc3f76b8ae1b663abbd2a6bc5b4896fe94818011b247755c5f9msx" May 21 13:06:59.361788 ip-10-0-133-64 kubenswrapper[2562]: I0521 13:06:59.361716 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/af618b36-15dd-4829-92a4-c6c02b1cba52-util\") pod \"3081035efbc3f76b8ae1b663abbd2a6bc5b4896fe94818011b247755c5f9msx\" (UID: \"af618b36-15dd-4829-92a4-c6c02b1cba52\") " pod="openshift-marketplace/3081035efbc3f76b8ae1b663abbd2a6bc5b4896fe94818011b247755c5f9msx" May 21 13:06:59.370298 ip-10-0-133-64 kubenswrapper[2562]: I0521 13:06:59.370272 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-p5wf6\" (UniqueName: \"kubernetes.io/projected/af618b36-15dd-4829-92a4-c6c02b1cba52-kube-api-access-p5wf6\") pod \"3081035efbc3f76b8ae1b663abbd2a6bc5b4896fe94818011b247755c5f9msx\" (UID: \"af618b36-15dd-4829-92a4-c6c02b1cba52\") " pod="openshift-marketplace/3081035efbc3f76b8ae1b663abbd2a6bc5b4896fe94818011b247755c5f9msx" May 21 13:06:59.534862 ip-10-0-133-64 kubenswrapper[2562]: I0521 13:06:59.534767 2562 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/3081035efbc3f76b8ae1b663abbd2a6bc5b4896fe94818011b247755c5f9msx" May 21 13:06:59.664258 ip-10-0-133-64 kubenswrapper[2562]: I0521 13:06:59.664234 2562 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/3081035efbc3f76b8ae1b663abbd2a6bc5b4896fe94818011b247755c5f9msx"] May 21 13:06:59.666999 ip-10-0-133-64 kubenswrapper[2562]: W0521 13:06:59.666970 2562 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podaf618b36_15dd_4829_92a4_c6c02b1cba52.slice/crio-1dce563a812bb74e414f1ba5939219942b6923aba5cb44d74c0e523c541c9086 WatchSource:0}: Error finding container 1dce563a812bb74e414f1ba5939219942b6923aba5cb44d74c0e523c541c9086: Status 404 returned error can't find the container with id 1dce563a812bb74e414f1ba5939219942b6923aba5cb44d74c0e523c541c9086 May 21 13:06:59.966517 ip-10-0-133-64 kubenswrapper[2562]: I0521 13:06:59.966482 2562 generic.go:358] "Generic (PLEG): container finished" podID="af618b36-15dd-4829-92a4-c6c02b1cba52" containerID="01a710e4353b55c75010aee3c0890f42fb32ac84bd887299012bed0a59e5077e" exitCode=0 May 21 13:06:59.966679 ip-10-0-133-64 kubenswrapper[2562]: I0521 13:06:59.966562 2562 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/3081035efbc3f76b8ae1b663abbd2a6bc5b4896fe94818011b247755c5f9msx" event={"ID":"af618b36-15dd-4829-92a4-c6c02b1cba52","Type":"ContainerDied","Data":"01a710e4353b55c75010aee3c0890f42fb32ac84bd887299012bed0a59e5077e"} May 21 13:06:59.966679 ip-10-0-133-64 kubenswrapper[2562]: I0521 13:06:59.966596 2562 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/3081035efbc3f76b8ae1b663abbd2a6bc5b4896fe94818011b247755c5f9msx" event={"ID":"af618b36-15dd-4829-92a4-c6c02b1cba52","Type":"ContainerStarted","Data":"1dce563a812bb74e414f1ba5939219942b6923aba5cb44d74c0e523c541c9086"} May 21 13:07:00.971783 ip-10-0-133-64 kubenswrapper[2562]: I0521 13:07:00.971753 2562 generic.go:358] "Generic (PLEG): container finished" podID="af618b36-15dd-4829-92a4-c6c02b1cba52" containerID="0b752a93318cd81546b43de13bef45845b837d6b77ff1e71cb695176d16ebcc9" exitCode=0 May 21 13:07:00.972177 ip-10-0-133-64 kubenswrapper[2562]: I0521 13:07:00.971837 2562 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/3081035efbc3f76b8ae1b663abbd2a6bc5b4896fe94818011b247755c5f9msx" event={"ID":"af618b36-15dd-4829-92a4-c6c02b1cba52","Type":"ContainerDied","Data":"0b752a93318cd81546b43de13bef45845b837d6b77ff1e71cb695176d16ebcc9"} May 21 13:07:01.976328 ip-10-0-133-64 kubenswrapper[2562]: I0521 13:07:01.976288 2562 generic.go:358] "Generic (PLEG): container finished" podID="af618b36-15dd-4829-92a4-c6c02b1cba52" containerID="d7b8a063c64b3533190f0d4cbceea8248c8619f434c2538ad0ac07b1adf98568" exitCode=0 May 21 13:07:01.976767 ip-10-0-133-64 kubenswrapper[2562]: I0521 13:07:01.976374 2562 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/3081035efbc3f76b8ae1b663abbd2a6bc5b4896fe94818011b247755c5f9msx" event={"ID":"af618b36-15dd-4829-92a4-c6c02b1cba52","Type":"ContainerDied","Data":"d7b8a063c64b3533190f0d4cbceea8248c8619f434c2538ad0ac07b1adf98568"} May 21 13:07:03.105441 ip-10-0-133-64 kubenswrapper[2562]: I0521 13:07:03.105419 2562 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/3081035efbc3f76b8ae1b663abbd2a6bc5b4896fe94818011b247755c5f9msx" May 21 13:07:03.192641 ip-10-0-133-64 kubenswrapper[2562]: I0521 13:07:03.192611 2562 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/af618b36-15dd-4829-92a4-c6c02b1cba52-bundle\") pod \"af618b36-15dd-4829-92a4-c6c02b1cba52\" (UID: \"af618b36-15dd-4829-92a4-c6c02b1cba52\") " May 21 13:07:03.192822 ip-10-0-133-64 kubenswrapper[2562]: I0521 13:07:03.192670 2562 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-p5wf6\" (UniqueName: \"kubernetes.io/projected/af618b36-15dd-4829-92a4-c6c02b1cba52-kube-api-access-p5wf6\") pod \"af618b36-15dd-4829-92a4-c6c02b1cba52\" (UID: \"af618b36-15dd-4829-92a4-c6c02b1cba52\") " May 21 13:07:03.192822 ip-10-0-133-64 kubenswrapper[2562]: I0521 13:07:03.192686 2562 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/af618b36-15dd-4829-92a4-c6c02b1cba52-util\") pod \"af618b36-15dd-4829-92a4-c6c02b1cba52\" (UID: \"af618b36-15dd-4829-92a4-c6c02b1cba52\") " May 21 13:07:03.193449 ip-10-0-133-64 kubenswrapper[2562]: I0521 13:07:03.193421 2562 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/af618b36-15dd-4829-92a4-c6c02b1cba52-bundle" (OuterVolumeSpecName: "bundle") pod "af618b36-15dd-4829-92a4-c6c02b1cba52" (UID: "af618b36-15dd-4829-92a4-c6c02b1cba52"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" May 21 13:07:03.194667 ip-10-0-133-64 kubenswrapper[2562]: I0521 13:07:03.194639 2562 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/af618b36-15dd-4829-92a4-c6c02b1cba52-kube-api-access-p5wf6" (OuterVolumeSpecName: "kube-api-access-p5wf6") pod "af618b36-15dd-4829-92a4-c6c02b1cba52" (UID: "af618b36-15dd-4829-92a4-c6c02b1cba52"). InnerVolumeSpecName "kube-api-access-p5wf6". PluginName "kubernetes.io/projected", VolumeGIDValue "" May 21 13:07:03.198556 ip-10-0-133-64 kubenswrapper[2562]: I0521 13:07:03.198527 2562 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/af618b36-15dd-4829-92a4-c6c02b1cba52-util" (OuterVolumeSpecName: "util") pod "af618b36-15dd-4829-92a4-c6c02b1cba52" (UID: "af618b36-15dd-4829-92a4-c6c02b1cba52"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" May 21 13:07:03.293612 ip-10-0-133-64 kubenswrapper[2562]: I0521 13:07:03.293502 2562 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-p5wf6\" (UniqueName: \"kubernetes.io/projected/af618b36-15dd-4829-92a4-c6c02b1cba52-kube-api-access-p5wf6\") on node \"ip-10-0-133-64.ec2.internal\" DevicePath \"\"" May 21 13:07:03.293612 ip-10-0-133-64 kubenswrapper[2562]: I0521 13:07:03.293552 2562 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/af618b36-15dd-4829-92a4-c6c02b1cba52-util\") on node \"ip-10-0-133-64.ec2.internal\" DevicePath \"\"" May 21 13:07:03.293612 ip-10-0-133-64 kubenswrapper[2562]: I0521 13:07:03.293564 2562 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/af618b36-15dd-4829-92a4-c6c02b1cba52-bundle\") on node \"ip-10-0-133-64.ec2.internal\" DevicePath \"\"" May 21 13:07:03.984533 ip-10-0-133-64 kubenswrapper[2562]: I0521 13:07:03.984497 2562 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/3081035efbc3f76b8ae1b663abbd2a6bc5b4896fe94818011b247755c5f9msx" event={"ID":"af618b36-15dd-4829-92a4-c6c02b1cba52","Type":"ContainerDied","Data":"1dce563a812bb74e414f1ba5939219942b6923aba5cb44d74c0e523c541c9086"} May 21 13:07:03.984533 ip-10-0-133-64 kubenswrapper[2562]: I0521 13:07:03.984528 2562 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/3081035efbc3f76b8ae1b663abbd2a6bc5b4896fe94818011b247755c5f9msx" May 21 13:07:03.984730 ip-10-0-133-64 kubenswrapper[2562]: I0521 13:07:03.984532 2562 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="1dce563a812bb74e414f1ba5939219942b6923aba5cb44d74c0e523c541c9086" May 21 13:07:13.045732 ip-10-0-133-64 kubenswrapper[2562]: I0521 13:07:13.045691 2562 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-marketplace/f77c1a82ade775f7608969957d57ee0b8db93eeada9825bd6f7f7156c9mdvj4"] May 21 13:07:13.046223 ip-10-0-133-64 kubenswrapper[2562]: I0521 13:07:13.046018 2562 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="af618b36-15dd-4829-92a4-c6c02b1cba52" containerName="extract" May 21 13:07:13.046223 ip-10-0-133-64 kubenswrapper[2562]: I0521 13:07:13.046031 2562 state_mem.go:107] "Deleted CPUSet assignment" podUID="af618b36-15dd-4829-92a4-c6c02b1cba52" containerName="extract" May 21 13:07:13.046223 ip-10-0-133-64 kubenswrapper[2562]: I0521 13:07:13.046056 2562 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="af618b36-15dd-4829-92a4-c6c02b1cba52" containerName="pull" May 21 13:07:13.046223 ip-10-0-133-64 kubenswrapper[2562]: I0521 13:07:13.046062 2562 state_mem.go:107] "Deleted CPUSet assignment" podUID="af618b36-15dd-4829-92a4-c6c02b1cba52" containerName="pull" May 21 13:07:13.046223 ip-10-0-133-64 kubenswrapper[2562]: I0521 13:07:13.046070 2562 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="af618b36-15dd-4829-92a4-c6c02b1cba52" containerName="util" May 21 13:07:13.046223 ip-10-0-133-64 kubenswrapper[2562]: I0521 13:07:13.046076 2562 state_mem.go:107] "Deleted CPUSet assignment" podUID="af618b36-15dd-4829-92a4-c6c02b1cba52" containerName="util" May 21 13:07:13.046223 ip-10-0-133-64 kubenswrapper[2562]: I0521 13:07:13.046124 2562 memory_manager.go:356] "RemoveStaleState removing state" podUID="af618b36-15dd-4829-92a4-c6c02b1cba52" containerName="extract" May 21 13:07:13.049036 ip-10-0-133-64 kubenswrapper[2562]: I0521 13:07:13.049018 2562 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/f77c1a82ade775f7608969957d57ee0b8db93eeada9825bd6f7f7156c9mdvj4" May 21 13:07:13.051342 ip-10-0-133-64 kubenswrapper[2562]: I0521 13:07:13.051309 2562 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"openshift-service-ca.crt\"" May 21 13:07:13.052081 ip-10-0-133-64 kubenswrapper[2562]: I0521 13:07:13.052058 2562 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-marketplace\"/\"default-dockercfg-z9cvq\"" May 21 13:07:13.052081 ip-10-0-133-64 kubenswrapper[2562]: I0521 13:07:13.052079 2562 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"kube-root-ca.crt\"" May 21 13:07:13.058115 ip-10-0-133-64 kubenswrapper[2562]: I0521 13:07:13.058089 2562 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/f77c1a82ade775f7608969957d57ee0b8db93eeada9825bd6f7f7156c9mdvj4"] May 21 13:07:13.172118 ip-10-0-133-64 kubenswrapper[2562]: I0521 13:07:13.172081 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/ce2e1a5e-4db3-4c08-9e1d-f9aad95d29ad-bundle\") pod \"f77c1a82ade775f7608969957d57ee0b8db93eeada9825bd6f7f7156c9mdvj4\" (UID: \"ce2e1a5e-4db3-4c08-9e1d-f9aad95d29ad\") " pod="openshift-marketplace/f77c1a82ade775f7608969957d57ee0b8db93eeada9825bd6f7f7156c9mdvj4" May 21 13:07:13.172118 ip-10-0-133-64 kubenswrapper[2562]: I0521 13:07:13.172122 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/ce2e1a5e-4db3-4c08-9e1d-f9aad95d29ad-util\") pod \"f77c1a82ade775f7608969957d57ee0b8db93eeada9825bd6f7f7156c9mdvj4\" (UID: \"ce2e1a5e-4db3-4c08-9e1d-f9aad95d29ad\") " pod="openshift-marketplace/f77c1a82ade775f7608969957d57ee0b8db93eeada9825bd6f7f7156c9mdvj4" May 21 13:07:13.172319 ip-10-0-133-64 kubenswrapper[2562]: I0521 13:07:13.172154 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-bbl7t\" (UniqueName: \"kubernetes.io/projected/ce2e1a5e-4db3-4c08-9e1d-f9aad95d29ad-kube-api-access-bbl7t\") pod \"f77c1a82ade775f7608969957d57ee0b8db93eeada9825bd6f7f7156c9mdvj4\" (UID: \"ce2e1a5e-4db3-4c08-9e1d-f9aad95d29ad\") " pod="openshift-marketplace/f77c1a82ade775f7608969957d57ee0b8db93eeada9825bd6f7f7156c9mdvj4" May 21 13:07:13.273470 ip-10-0-133-64 kubenswrapper[2562]: I0521 13:07:13.273417 2562 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/ce2e1a5e-4db3-4c08-9e1d-f9aad95d29ad-bundle\") pod \"f77c1a82ade775f7608969957d57ee0b8db93eeada9825bd6f7f7156c9mdvj4\" (UID: \"ce2e1a5e-4db3-4c08-9e1d-f9aad95d29ad\") " pod="openshift-marketplace/f77c1a82ade775f7608969957d57ee0b8db93eeada9825bd6f7f7156c9mdvj4" May 21 13:07:13.273470 ip-10-0-133-64 kubenswrapper[2562]: I0521 13:07:13.273470 2562 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/ce2e1a5e-4db3-4c08-9e1d-f9aad95d29ad-util\") pod \"f77c1a82ade775f7608969957d57ee0b8db93eeada9825bd6f7f7156c9mdvj4\" (UID: \"ce2e1a5e-4db3-4c08-9e1d-f9aad95d29ad\") " pod="openshift-marketplace/f77c1a82ade775f7608969957d57ee0b8db93eeada9825bd6f7f7156c9mdvj4" May 21 13:07:13.273684 ip-10-0-133-64 kubenswrapper[2562]: I0521 13:07:13.273494 2562 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-bbl7t\" (UniqueName: \"kubernetes.io/projected/ce2e1a5e-4db3-4c08-9e1d-f9aad95d29ad-kube-api-access-bbl7t\") pod \"f77c1a82ade775f7608969957d57ee0b8db93eeada9825bd6f7f7156c9mdvj4\" (UID: \"ce2e1a5e-4db3-4c08-9e1d-f9aad95d29ad\") " pod="openshift-marketplace/f77c1a82ade775f7608969957d57ee0b8db93eeada9825bd6f7f7156c9mdvj4" May 21 13:07:13.273860 ip-10-0-133-64 kubenswrapper[2562]: I0521 13:07:13.273837 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/ce2e1a5e-4db3-4c08-9e1d-f9aad95d29ad-util\") pod \"f77c1a82ade775f7608969957d57ee0b8db93eeada9825bd6f7f7156c9mdvj4\" (UID: \"ce2e1a5e-4db3-4c08-9e1d-f9aad95d29ad\") " pod="openshift-marketplace/f77c1a82ade775f7608969957d57ee0b8db93eeada9825bd6f7f7156c9mdvj4" May 21 13:07:13.273908 ip-10-0-133-64 kubenswrapper[2562]: I0521 13:07:13.273874 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/ce2e1a5e-4db3-4c08-9e1d-f9aad95d29ad-bundle\") pod \"f77c1a82ade775f7608969957d57ee0b8db93eeada9825bd6f7f7156c9mdvj4\" (UID: \"ce2e1a5e-4db3-4c08-9e1d-f9aad95d29ad\") " pod="openshift-marketplace/f77c1a82ade775f7608969957d57ee0b8db93eeada9825bd6f7f7156c9mdvj4" May 21 13:07:13.281401 ip-10-0-133-64 kubenswrapper[2562]: I0521 13:07:13.281367 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-bbl7t\" (UniqueName: \"kubernetes.io/projected/ce2e1a5e-4db3-4c08-9e1d-f9aad95d29ad-kube-api-access-bbl7t\") pod \"f77c1a82ade775f7608969957d57ee0b8db93eeada9825bd6f7f7156c9mdvj4\" (UID: \"ce2e1a5e-4db3-4c08-9e1d-f9aad95d29ad\") " pod="openshift-marketplace/f77c1a82ade775f7608969957d57ee0b8db93eeada9825bd6f7f7156c9mdvj4" May 21 13:07:13.359170 ip-10-0-133-64 kubenswrapper[2562]: I0521 13:07:13.359071 2562 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/f77c1a82ade775f7608969957d57ee0b8db93eeada9825bd6f7f7156c9mdvj4" May 21 13:07:13.492755 ip-10-0-133-64 kubenswrapper[2562]: I0521 13:07:13.492728 2562 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/f77c1a82ade775f7608969957d57ee0b8db93eeada9825bd6f7f7156c9mdvj4"] May 21 13:07:13.495042 ip-10-0-133-64 kubenswrapper[2562]: W0521 13:07:13.495007 2562 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podce2e1a5e_4db3_4c08_9e1d_f9aad95d29ad.slice/crio-0480d84618940c7672387f3477f30eec6cfcad484d423a2474dff16c1b2ad46e WatchSource:0}: Error finding container 0480d84618940c7672387f3477f30eec6cfcad484d423a2474dff16c1b2ad46e: Status 404 returned error can't find the container with id 0480d84618940c7672387f3477f30eec6cfcad484d423a2474dff16c1b2ad46e May 21 13:07:13.934137 ip-10-0-133-64 kubenswrapper[2562]: I0521 13:07:13.929603 2562 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-8545859b7d-zzdb2"] May 21 13:07:13.934895 ip-10-0-133-64 kubenswrapper[2562]: I0521 13:07:13.934864 2562 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/opendatahub-operator-controller-manager-8545859b7d-zzdb2" May 21 13:07:13.937387 ip-10-0-133-64 kubenswrapper[2562]: I0521 13:07:13.937364 2562 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-manager-service-cert\"" May 21 13:07:13.937625 ip-10-0-133-64 kubenswrapper[2562]: I0521 13:07:13.937601 2562 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-manager-dockercfg-2g5gn\"" May 21 13:07:13.937848 ip-10-0-133-64 kubenswrapper[2562]: I0521 13:07:13.937831 2562 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-webhook-cert\"" May 21 13:07:13.937899 ip-10-0-133-64 kubenswrapper[2562]: I0521 13:07:13.937839 2562 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"openshift-service-ca.crt\"" May 21 13:07:13.938134 ip-10-0-133-64 kubenswrapper[2562]: I0521 13:07:13.938105 2562 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"kube-root-ca.crt\"" May 21 13:07:13.944194 ip-10-0-133-64 kubenswrapper[2562]: I0521 13:07:13.944173 2562 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-8545859b7d-zzdb2"] May 21 13:07:13.980447 ip-10-0-133-64 kubenswrapper[2562]: I0521 13:07:13.980418 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/1e611ccc-dd25-4210-ba16-a99ffc39eb2f-apiservice-cert\") pod \"opendatahub-operator-controller-manager-8545859b7d-zzdb2\" (UID: \"1e611ccc-dd25-4210-ba16-a99ffc39eb2f\") " pod="opendatahub/opendatahub-operator-controller-manager-8545859b7d-zzdb2" May 21 13:07:13.980610 ip-10-0-133-64 kubenswrapper[2562]: I0521 13:07:13.980462 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-xsrsg\" (UniqueName: \"kubernetes.io/projected/1e611ccc-dd25-4210-ba16-a99ffc39eb2f-kube-api-access-xsrsg\") pod \"opendatahub-operator-controller-manager-8545859b7d-zzdb2\" (UID: \"1e611ccc-dd25-4210-ba16-a99ffc39eb2f\") " pod="opendatahub/opendatahub-operator-controller-manager-8545859b7d-zzdb2" May 21 13:07:13.980610 ip-10-0-133-64 kubenswrapper[2562]: I0521 13:07:13.980539 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/1e611ccc-dd25-4210-ba16-a99ffc39eb2f-webhook-cert\") pod \"opendatahub-operator-controller-manager-8545859b7d-zzdb2\" (UID: \"1e611ccc-dd25-4210-ba16-a99ffc39eb2f\") " pod="opendatahub/opendatahub-operator-controller-manager-8545859b7d-zzdb2" May 21 13:07:14.016790 ip-10-0-133-64 kubenswrapper[2562]: I0521 13:07:14.016749 2562 generic.go:358] "Generic (PLEG): container finished" podID="ce2e1a5e-4db3-4c08-9e1d-f9aad95d29ad" containerID="5349f77fc4b6adca6594cd8521e3fb428896cb23aae04a04c0abf4b4b4549b5a" exitCode=0 May 21 13:07:14.017013 ip-10-0-133-64 kubenswrapper[2562]: I0521 13:07:14.016834 2562 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/f77c1a82ade775f7608969957d57ee0b8db93eeada9825bd6f7f7156c9mdvj4" event={"ID":"ce2e1a5e-4db3-4c08-9e1d-f9aad95d29ad","Type":"ContainerDied","Data":"5349f77fc4b6adca6594cd8521e3fb428896cb23aae04a04c0abf4b4b4549b5a"} May 21 13:07:14.017013 ip-10-0-133-64 kubenswrapper[2562]: I0521 13:07:14.016861 2562 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/f77c1a82ade775f7608969957d57ee0b8db93eeada9825bd6f7f7156c9mdvj4" event={"ID":"ce2e1a5e-4db3-4c08-9e1d-f9aad95d29ad","Type":"ContainerStarted","Data":"0480d84618940c7672387f3477f30eec6cfcad484d423a2474dff16c1b2ad46e"} May 21 13:07:14.081524 ip-10-0-133-64 kubenswrapper[2562]: I0521 13:07:14.081487 2562 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/1e611ccc-dd25-4210-ba16-a99ffc39eb2f-apiservice-cert\") pod \"opendatahub-operator-controller-manager-8545859b7d-zzdb2\" (UID: \"1e611ccc-dd25-4210-ba16-a99ffc39eb2f\") " pod="opendatahub/opendatahub-operator-controller-manager-8545859b7d-zzdb2" May 21 13:07:14.082055 ip-10-0-133-64 kubenswrapper[2562]: I0521 13:07:14.081546 2562 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-xsrsg\" (UniqueName: \"kubernetes.io/projected/1e611ccc-dd25-4210-ba16-a99ffc39eb2f-kube-api-access-xsrsg\") pod \"opendatahub-operator-controller-manager-8545859b7d-zzdb2\" (UID: \"1e611ccc-dd25-4210-ba16-a99ffc39eb2f\") " pod="opendatahub/opendatahub-operator-controller-manager-8545859b7d-zzdb2" May 21 13:07:14.082055 ip-10-0-133-64 kubenswrapper[2562]: I0521 13:07:14.081624 2562 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/1e611ccc-dd25-4210-ba16-a99ffc39eb2f-webhook-cert\") pod \"opendatahub-operator-controller-manager-8545859b7d-zzdb2\" (UID: \"1e611ccc-dd25-4210-ba16-a99ffc39eb2f\") " pod="opendatahub/opendatahub-operator-controller-manager-8545859b7d-zzdb2" May 21 13:07:14.084068 ip-10-0-133-64 kubenswrapper[2562]: I0521 13:07:14.084048 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/1e611ccc-dd25-4210-ba16-a99ffc39eb2f-webhook-cert\") pod \"opendatahub-operator-controller-manager-8545859b7d-zzdb2\" (UID: \"1e611ccc-dd25-4210-ba16-a99ffc39eb2f\") " pod="opendatahub/opendatahub-operator-controller-manager-8545859b7d-zzdb2" May 21 13:07:14.084130 ip-10-0-133-64 kubenswrapper[2562]: I0521 13:07:14.084094 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/1e611ccc-dd25-4210-ba16-a99ffc39eb2f-apiservice-cert\") pod \"opendatahub-operator-controller-manager-8545859b7d-zzdb2\" (UID: \"1e611ccc-dd25-4210-ba16-a99ffc39eb2f\") " pod="opendatahub/opendatahub-operator-controller-manager-8545859b7d-zzdb2" May 21 13:07:14.090453 ip-10-0-133-64 kubenswrapper[2562]: I0521 13:07:14.090426 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-xsrsg\" (UniqueName: \"kubernetes.io/projected/1e611ccc-dd25-4210-ba16-a99ffc39eb2f-kube-api-access-xsrsg\") pod \"opendatahub-operator-controller-manager-8545859b7d-zzdb2\" (UID: \"1e611ccc-dd25-4210-ba16-a99ffc39eb2f\") " pod="opendatahub/opendatahub-operator-controller-manager-8545859b7d-zzdb2" May 21 13:07:14.246205 ip-10-0-133-64 kubenswrapper[2562]: I0521 13:07:14.246173 2562 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/opendatahub-operator-controller-manager-8545859b7d-zzdb2" May 21 13:07:14.381486 ip-10-0-133-64 kubenswrapper[2562]: I0521 13:07:14.381458 2562 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-8545859b7d-zzdb2"] May 21 13:07:14.384707 ip-10-0-133-64 kubenswrapper[2562]: W0521 13:07:14.384678 2562 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod1e611ccc_dd25_4210_ba16_a99ffc39eb2f.slice/crio-107e0a871fc0790f005086c93ff2875bb14081879bc4d6692dcf38483e2127f9 WatchSource:0}: Error finding container 107e0a871fc0790f005086c93ff2875bb14081879bc4d6692dcf38483e2127f9: Status 404 returned error can't find the container with id 107e0a871fc0790f005086c93ff2875bb14081879bc4d6692dcf38483e2127f9 May 21 13:07:15.022907 ip-10-0-133-64 kubenswrapper[2562]: I0521 13:07:15.022838 2562 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-8545859b7d-zzdb2" event={"ID":"1e611ccc-dd25-4210-ba16-a99ffc39eb2f","Type":"ContainerStarted","Data":"107e0a871fc0790f005086c93ff2875bb14081879bc4d6692dcf38483e2127f9"} May 21 13:07:15.025229 ip-10-0-133-64 kubenswrapper[2562]: I0521 13:07:15.025153 2562 generic.go:358] "Generic (PLEG): container finished" podID="ce2e1a5e-4db3-4c08-9e1d-f9aad95d29ad" containerID="b455a3e0f73b64a9666ae07b6132d6fb29f5217d4c2184f81522f8a4448a279e" exitCode=0 May 21 13:07:15.025229 ip-10-0-133-64 kubenswrapper[2562]: I0521 13:07:15.025196 2562 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/f77c1a82ade775f7608969957d57ee0b8db93eeada9825bd6f7f7156c9mdvj4" event={"ID":"ce2e1a5e-4db3-4c08-9e1d-f9aad95d29ad","Type":"ContainerDied","Data":"b455a3e0f73b64a9666ae07b6132d6fb29f5217d4c2184f81522f8a4448a279e"} May 21 13:07:16.031164 ip-10-0-133-64 kubenswrapper[2562]: I0521 13:07:16.031129 2562 generic.go:358] "Generic (PLEG): container finished" podID="ce2e1a5e-4db3-4c08-9e1d-f9aad95d29ad" containerID="011fffd29043adffa0ed052f4a8c23e5e6cea8261e98a624bdd3a53f5da0b3bd" exitCode=0 May 21 13:07:16.031613 ip-10-0-133-64 kubenswrapper[2562]: I0521 13:07:16.031211 2562 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/f77c1a82ade775f7608969957d57ee0b8db93eeada9825bd6f7f7156c9mdvj4" event={"ID":"ce2e1a5e-4db3-4c08-9e1d-f9aad95d29ad","Type":"ContainerDied","Data":"011fffd29043adffa0ed052f4a8c23e5e6cea8261e98a624bdd3a53f5da0b3bd"} May 21 13:07:17.036051 ip-10-0-133-64 kubenswrapper[2562]: I0521 13:07:17.036008 2562 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-8545859b7d-zzdb2" event={"ID":"1e611ccc-dd25-4210-ba16-a99ffc39eb2f","Type":"ContainerStarted","Data":"9d0625fc86c584aefa0019e1570b19e91109dfdb8defc59099c0609a625365f9"} May 21 13:07:17.036497 ip-10-0-133-64 kubenswrapper[2562]: I0521 13:07:17.036086 2562 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/opendatahub-operator-controller-manager-8545859b7d-zzdb2" May 21 13:07:17.077281 ip-10-0-133-64 kubenswrapper[2562]: I0521 13:07:17.077231 2562 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="opendatahub/opendatahub-operator-controller-manager-8545859b7d-zzdb2" podStartSLOduration=1.587535396 podStartE2EDuration="4.07721401s" podCreationTimestamp="2026-05-21 13:07:13 +0000 UTC" firstStartedPulling="2026-05-21 13:07:14.386418634 +0000 UTC m=+280.936699980" lastFinishedPulling="2026-05-21 13:07:16.876097248 +0000 UTC m=+283.426378594" observedRunningTime="2026-05-21 13:07:17.075576902 +0000 UTC m=+283.625858269" watchObservedRunningTime="2026-05-21 13:07:17.07721401 +0000 UTC m=+283.627495379" May 21 13:07:17.159088 ip-10-0-133-64 kubenswrapper[2562]: I0521 13:07:17.159064 2562 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/f77c1a82ade775f7608969957d57ee0b8db93eeada9825bd6f7f7156c9mdvj4" May 21 13:07:17.212279 ip-10-0-133-64 kubenswrapper[2562]: I0521 13:07:17.212240 2562 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-bbl7t\" (UniqueName: \"kubernetes.io/projected/ce2e1a5e-4db3-4c08-9e1d-f9aad95d29ad-kube-api-access-bbl7t\") pod \"ce2e1a5e-4db3-4c08-9e1d-f9aad95d29ad\" (UID: \"ce2e1a5e-4db3-4c08-9e1d-f9aad95d29ad\") " May 21 13:07:17.212468 ip-10-0-133-64 kubenswrapper[2562]: I0521 13:07:17.212298 2562 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/ce2e1a5e-4db3-4c08-9e1d-f9aad95d29ad-util\") pod \"ce2e1a5e-4db3-4c08-9e1d-f9aad95d29ad\" (UID: \"ce2e1a5e-4db3-4c08-9e1d-f9aad95d29ad\") " May 21 13:07:17.212468 ip-10-0-133-64 kubenswrapper[2562]: I0521 13:07:17.212318 2562 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/ce2e1a5e-4db3-4c08-9e1d-f9aad95d29ad-bundle\") pod \"ce2e1a5e-4db3-4c08-9e1d-f9aad95d29ad\" (UID: \"ce2e1a5e-4db3-4c08-9e1d-f9aad95d29ad\") " May 21 13:07:17.213088 ip-10-0-133-64 kubenswrapper[2562]: I0521 13:07:17.213066 2562 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/ce2e1a5e-4db3-4c08-9e1d-f9aad95d29ad-bundle" (OuterVolumeSpecName: "bundle") pod "ce2e1a5e-4db3-4c08-9e1d-f9aad95d29ad" (UID: "ce2e1a5e-4db3-4c08-9e1d-f9aad95d29ad"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" May 21 13:07:17.214655 ip-10-0-133-64 kubenswrapper[2562]: I0521 13:07:17.214628 2562 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/ce2e1a5e-4db3-4c08-9e1d-f9aad95d29ad-kube-api-access-bbl7t" (OuterVolumeSpecName: "kube-api-access-bbl7t") pod "ce2e1a5e-4db3-4c08-9e1d-f9aad95d29ad" (UID: "ce2e1a5e-4db3-4c08-9e1d-f9aad95d29ad"). InnerVolumeSpecName "kube-api-access-bbl7t". PluginName "kubernetes.io/projected", VolumeGIDValue "" May 21 13:07:17.218293 ip-10-0-133-64 kubenswrapper[2562]: I0521 13:07:17.218258 2562 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/ce2e1a5e-4db3-4c08-9e1d-f9aad95d29ad-util" (OuterVolumeSpecName: "util") pod "ce2e1a5e-4db3-4c08-9e1d-f9aad95d29ad" (UID: "ce2e1a5e-4db3-4c08-9e1d-f9aad95d29ad"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" May 21 13:07:17.313143 ip-10-0-133-64 kubenswrapper[2562]: I0521 13:07:17.313106 2562 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/ce2e1a5e-4db3-4c08-9e1d-f9aad95d29ad-util\") on node \"ip-10-0-133-64.ec2.internal\" DevicePath \"\"" May 21 13:07:17.313143 ip-10-0-133-64 kubenswrapper[2562]: I0521 13:07:17.313134 2562 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/ce2e1a5e-4db3-4c08-9e1d-f9aad95d29ad-bundle\") on node \"ip-10-0-133-64.ec2.internal\" DevicePath \"\"" May 21 13:07:17.313143 ip-10-0-133-64 kubenswrapper[2562]: I0521 13:07:17.313143 2562 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-bbl7t\" (UniqueName: \"kubernetes.io/projected/ce2e1a5e-4db3-4c08-9e1d-f9aad95d29ad-kube-api-access-bbl7t\") on node \"ip-10-0-133-64.ec2.internal\" DevicePath \"\"" May 21 13:07:18.045498 ip-10-0-133-64 kubenswrapper[2562]: I0521 13:07:18.045413 2562 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/f77c1a82ade775f7608969957d57ee0b8db93eeada9825bd6f7f7156c9mdvj4" event={"ID":"ce2e1a5e-4db3-4c08-9e1d-f9aad95d29ad","Type":"ContainerDied","Data":"0480d84618940c7672387f3477f30eec6cfcad484d423a2474dff16c1b2ad46e"} May 21 13:07:18.045894 ip-10-0-133-64 kubenswrapper[2562]: I0521 13:07:18.045842 2562 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="0480d84618940c7672387f3477f30eec6cfcad484d423a2474dff16c1b2ad46e" May 21 13:07:18.045894 ip-10-0-133-64 kubenswrapper[2562]: I0521 13:07:18.045859 2562 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/f77c1a82ade775f7608969957d57ee0b8db93eeada9825bd6f7f7156c9mdvj4" May 21 13:07:23.114126 ip-10-0-133-64 kubenswrapper[2562]: I0521 13:07:23.114094 2562 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-lws-operator/lws-controller-manager-54666c59c-4rcdz"] May 21 13:07:23.114498 ip-10-0-133-64 kubenswrapper[2562]: I0521 13:07:23.114412 2562 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="ce2e1a5e-4db3-4c08-9e1d-f9aad95d29ad" containerName="util" May 21 13:07:23.114498 ip-10-0-133-64 kubenswrapper[2562]: I0521 13:07:23.114424 2562 state_mem.go:107] "Deleted CPUSet assignment" podUID="ce2e1a5e-4db3-4c08-9e1d-f9aad95d29ad" containerName="util" May 21 13:07:23.114498 ip-10-0-133-64 kubenswrapper[2562]: I0521 13:07:23.114437 2562 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="ce2e1a5e-4db3-4c08-9e1d-f9aad95d29ad" containerName="pull" May 21 13:07:23.114498 ip-10-0-133-64 kubenswrapper[2562]: I0521 13:07:23.114443 2562 state_mem.go:107] "Deleted CPUSet assignment" podUID="ce2e1a5e-4db3-4c08-9e1d-f9aad95d29ad" containerName="pull" May 21 13:07:23.114498 ip-10-0-133-64 kubenswrapper[2562]: I0521 13:07:23.114456 2562 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="ce2e1a5e-4db3-4c08-9e1d-f9aad95d29ad" containerName="extract" May 21 13:07:23.114498 ip-10-0-133-64 kubenswrapper[2562]: I0521 13:07:23.114463 2562 state_mem.go:107] "Deleted CPUSet assignment" podUID="ce2e1a5e-4db3-4c08-9e1d-f9aad95d29ad" containerName="extract" May 21 13:07:23.114682 ip-10-0-133-64 kubenswrapper[2562]: I0521 13:07:23.114506 2562 memory_manager.go:356] "RemoveStaleState removing state" podUID="ce2e1a5e-4db3-4c08-9e1d-f9aad95d29ad" containerName="extract" May 21 13:07:23.116915 ip-10-0-133-64 kubenswrapper[2562]: I0521 13:07:23.116897 2562 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-lws-operator/lws-controller-manager-54666c59c-4rcdz" May 21 13:07:23.120343 ip-10-0-133-64 kubenswrapper[2562]: I0521 13:07:23.120318 2562 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-lws-operator\"/\"lws-controller-manager-dockercfg-8qkpg\"" May 21 13:07:23.120445 ip-10-0-133-64 kubenswrapper[2562]: I0521 13:07:23.120346 2562 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-lws-operator\"/\"webhook-server-cert\"" May 21 13:07:23.120445 ip-10-0-133-64 kubenswrapper[2562]: I0521 13:07:23.120346 2562 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-lws-operator\"/\"metrics-server-cert\"" May 21 13:07:23.120623 ip-10-0-133-64 kubenswrapper[2562]: I0521 13:07:23.120605 2562 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-lws-operator\"/\"lws-manager-config\"" May 21 13:07:23.120861 ip-10-0-133-64 kubenswrapper[2562]: I0521 13:07:23.120846 2562 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-lws-operator\"/\"kube-root-ca.crt\"" May 21 13:07:23.121179 ip-10-0-133-64 kubenswrapper[2562]: I0521 13:07:23.121162 2562 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-lws-operator\"/\"openshift-service-ca.crt\"" May 21 13:07:23.149880 ip-10-0-133-64 kubenswrapper[2562]: I0521 13:07:23.149852 2562 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-lws-operator/lws-controller-manager-54666c59c-4rcdz"] May 21 13:07:23.266269 ip-10-0-133-64 kubenswrapper[2562]: I0521 13:07:23.266216 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-cert\" (UniqueName: \"kubernetes.io/secret/729b321b-a23b-41d9-b7c2-923d3d3088ac-metrics-cert\") pod \"lws-controller-manager-54666c59c-4rcdz\" (UID: \"729b321b-a23b-41d9-b7c2-923d3d3088ac\") " pod="openshift-lws-operator/lws-controller-manager-54666c59c-4rcdz" May 21 13:07:23.266269 ip-10-0-133-64 kubenswrapper[2562]: I0521 13:07:23.266267 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-phmch\" (UniqueName: \"kubernetes.io/projected/729b321b-a23b-41d9-b7c2-923d3d3088ac-kube-api-access-phmch\") pod \"lws-controller-manager-54666c59c-4rcdz\" (UID: \"729b321b-a23b-41d9-b7c2-923d3d3088ac\") " pod="openshift-lws-operator/lws-controller-manager-54666c59c-4rcdz" May 21 13:07:23.266514 ip-10-0-133-64 kubenswrapper[2562]: I0521 13:07:23.266347 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"manager-config\" (UniqueName: \"kubernetes.io/configmap/729b321b-a23b-41d9-b7c2-923d3d3088ac-manager-config\") pod \"lws-controller-manager-54666c59c-4rcdz\" (UID: \"729b321b-a23b-41d9-b7c2-923d3d3088ac\") " pod="openshift-lws-operator/lws-controller-manager-54666c59c-4rcdz" May 21 13:07:23.266514 ip-10-0-133-64 kubenswrapper[2562]: I0521 13:07:23.266434 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/729b321b-a23b-41d9-b7c2-923d3d3088ac-cert\") pod \"lws-controller-manager-54666c59c-4rcdz\" (UID: \"729b321b-a23b-41d9-b7c2-923d3d3088ac\") " pod="openshift-lws-operator/lws-controller-manager-54666c59c-4rcdz" May 21 13:07:23.367007 ip-10-0-133-64 kubenswrapper[2562]: I0521 13:07:23.366899 2562 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-cert\" (UniqueName: \"kubernetes.io/secret/729b321b-a23b-41d9-b7c2-923d3d3088ac-metrics-cert\") pod \"lws-controller-manager-54666c59c-4rcdz\" (UID: \"729b321b-a23b-41d9-b7c2-923d3d3088ac\") " pod="openshift-lws-operator/lws-controller-manager-54666c59c-4rcdz" May 21 13:07:23.367007 ip-10-0-133-64 kubenswrapper[2562]: I0521 13:07:23.366951 2562 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-phmch\" (UniqueName: \"kubernetes.io/projected/729b321b-a23b-41d9-b7c2-923d3d3088ac-kube-api-access-phmch\") pod \"lws-controller-manager-54666c59c-4rcdz\" (UID: \"729b321b-a23b-41d9-b7c2-923d3d3088ac\") " pod="openshift-lws-operator/lws-controller-manager-54666c59c-4rcdz" May 21 13:07:23.367007 ip-10-0-133-64 kubenswrapper[2562]: I0521 13:07:23.366979 2562 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"manager-config\" (UniqueName: \"kubernetes.io/configmap/729b321b-a23b-41d9-b7c2-923d3d3088ac-manager-config\") pod \"lws-controller-manager-54666c59c-4rcdz\" (UID: \"729b321b-a23b-41d9-b7c2-923d3d3088ac\") " pod="openshift-lws-operator/lws-controller-manager-54666c59c-4rcdz" May 21 13:07:23.367007 ip-10-0-133-64 kubenswrapper[2562]: I0521 13:07:23.367000 2562 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/729b321b-a23b-41d9-b7c2-923d3d3088ac-cert\") pod \"lws-controller-manager-54666c59c-4rcdz\" (UID: \"729b321b-a23b-41d9-b7c2-923d3d3088ac\") " pod="openshift-lws-operator/lws-controller-manager-54666c59c-4rcdz" May 21 13:07:23.367733 ip-10-0-133-64 kubenswrapper[2562]: I0521 13:07:23.367706 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"manager-config\" (UniqueName: \"kubernetes.io/configmap/729b321b-a23b-41d9-b7c2-923d3d3088ac-manager-config\") pod \"lws-controller-manager-54666c59c-4rcdz\" (UID: \"729b321b-a23b-41d9-b7c2-923d3d3088ac\") " pod="openshift-lws-operator/lws-controller-manager-54666c59c-4rcdz" May 21 13:07:23.369546 ip-10-0-133-64 kubenswrapper[2562]: I0521 13:07:23.369525 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/729b321b-a23b-41d9-b7c2-923d3d3088ac-cert\") pod \"lws-controller-manager-54666c59c-4rcdz\" (UID: \"729b321b-a23b-41d9-b7c2-923d3d3088ac\") " pod="openshift-lws-operator/lws-controller-manager-54666c59c-4rcdz" May 21 13:07:23.369621 ip-10-0-133-64 kubenswrapper[2562]: I0521 13:07:23.369590 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-cert\" (UniqueName: \"kubernetes.io/secret/729b321b-a23b-41d9-b7c2-923d3d3088ac-metrics-cert\") pod \"lws-controller-manager-54666c59c-4rcdz\" (UID: \"729b321b-a23b-41d9-b7c2-923d3d3088ac\") " pod="openshift-lws-operator/lws-controller-manager-54666c59c-4rcdz" May 21 13:07:23.378150 ip-10-0-133-64 kubenswrapper[2562]: I0521 13:07:23.378118 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-phmch\" (UniqueName: \"kubernetes.io/projected/729b321b-a23b-41d9-b7c2-923d3d3088ac-kube-api-access-phmch\") pod \"lws-controller-manager-54666c59c-4rcdz\" (UID: \"729b321b-a23b-41d9-b7c2-923d3d3088ac\") " pod="openshift-lws-operator/lws-controller-manager-54666c59c-4rcdz" May 21 13:07:23.425893 ip-10-0-133-64 kubenswrapper[2562]: I0521 13:07:23.425858 2562 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-lws-operator/lws-controller-manager-54666c59c-4rcdz" May 21 13:07:23.555421 ip-10-0-133-64 kubenswrapper[2562]: I0521 13:07:23.555396 2562 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-lws-operator/lws-controller-manager-54666c59c-4rcdz"] May 21 13:07:23.557205 ip-10-0-133-64 kubenswrapper[2562]: W0521 13:07:23.557181 2562 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod729b321b_a23b_41d9_b7c2_923d3d3088ac.slice/crio-b1f964d88c4787d9e31bf0f1bf8465244dbd1c66a7fcd8f4c9f302b1a6db2f15 WatchSource:0}: Error finding container b1f964d88c4787d9e31bf0f1bf8465244dbd1c66a7fcd8f4c9f302b1a6db2f15: Status 404 returned error can't find the container with id b1f964d88c4787d9e31bf0f1bf8465244dbd1c66a7fcd8f4c9f302b1a6db2f15 May 21 13:07:24.066228 ip-10-0-133-64 kubenswrapper[2562]: I0521 13:07:24.066193 2562 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-lws-operator/lws-controller-manager-54666c59c-4rcdz" event={"ID":"729b321b-a23b-41d9-b7c2-923d3d3088ac","Type":"ContainerStarted","Data":"b1f964d88c4787d9e31bf0f1bf8465244dbd1c66a7fcd8f4c9f302b1a6db2f15"} May 21 13:07:25.071199 ip-10-0-133-64 kubenswrapper[2562]: I0521 13:07:25.071161 2562 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-lws-operator/lws-controller-manager-54666c59c-4rcdz" event={"ID":"729b321b-a23b-41d9-b7c2-923d3d3088ac","Type":"ContainerStarted","Data":"28da272319d3ce11966dddb79b9abca90ecd556f137599354949738ee7dc682b"} May 21 13:07:25.071583 ip-10-0-133-64 kubenswrapper[2562]: I0521 13:07:25.071229 2562 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-lws-operator/lws-controller-manager-54666c59c-4rcdz" May 21 13:07:25.099451 ip-10-0-133-64 kubenswrapper[2562]: I0521 13:07:25.099400 2562 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-lws-operator/lws-controller-manager-54666c59c-4rcdz" podStartSLOduration=0.708796796 podStartE2EDuration="2.099387532s" podCreationTimestamp="2026-05-21 13:07:23 +0000 UTC" firstStartedPulling="2026-05-21 13:07:23.558786426 +0000 UTC m=+290.109067899" lastFinishedPulling="2026-05-21 13:07:24.949377286 +0000 UTC m=+291.499658635" observedRunningTime="2026-05-21 13:07:25.09781031 +0000 UTC m=+291.648091670" watchObservedRunningTime="2026-05-21 13:07:25.099387532 +0000 UTC m=+291.649668900" May 21 13:07:28.048479 ip-10-0-133-64 kubenswrapper[2562]: I0521 13:07:28.048444 2562 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/opendatahub-operator-controller-manager-8545859b7d-zzdb2" May 21 13:07:33.933645 ip-10-0-133-64 kubenswrapper[2562]: I0521 13:07:33.933619 2562 kubelet.go:1628] "Image garbage collection succeeded" May 21 13:07:36.076696 ip-10-0-133-64 kubenswrapper[2562]: I0521 13:07:36.076663 2562 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-lws-operator/lws-controller-manager-54666c59c-4rcdz" May 21 13:07:43.180508 ip-10-0-133-64 kubenswrapper[2562]: I0521 13:07:43.180469 2562 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-marketplace/4c892a6d2d8a57acbc49427d3a7d24e253bab25be2c607ef405d2c4835c7lnn"] May 21 13:07:43.187060 ip-10-0-133-64 kubenswrapper[2562]: I0521 13:07:43.187040 2562 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/4c892a6d2d8a57acbc49427d3a7d24e253bab25be2c607ef405d2c4835c7lnn" May 21 13:07:43.189358 ip-10-0-133-64 kubenswrapper[2562]: I0521 13:07:43.189338 2562 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"kube-root-ca.crt\"" May 21 13:07:43.189575 ip-10-0-133-64 kubenswrapper[2562]: I0521 13:07:43.189561 2562 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"openshift-service-ca.crt\"" May 21 13:07:43.190194 ip-10-0-133-64 kubenswrapper[2562]: I0521 13:07:43.190179 2562 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-marketplace\"/\"default-dockercfg-z9cvq\"" May 21 13:07:43.193639 ip-10-0-133-64 kubenswrapper[2562]: I0521 13:07:43.193615 2562 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/4c892a6d2d8a57acbc49427d3a7d24e253bab25be2c607ef405d2c4835c7lnn"] May 21 13:07:43.226817 ip-10-0-133-64 kubenswrapper[2562]: I0521 13:07:43.226766 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-k6hfp\" (UniqueName: \"kubernetes.io/projected/b4b3a091-066c-47b8-900f-82ec08f813ca-kube-api-access-k6hfp\") pod \"4c892a6d2d8a57acbc49427d3a7d24e253bab25be2c607ef405d2c4835c7lnn\" (UID: \"b4b3a091-066c-47b8-900f-82ec08f813ca\") " pod="openshift-marketplace/4c892a6d2d8a57acbc49427d3a7d24e253bab25be2c607ef405d2c4835c7lnn" May 21 13:07:43.226961 ip-10-0-133-64 kubenswrapper[2562]: I0521 13:07:43.226848 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/b4b3a091-066c-47b8-900f-82ec08f813ca-util\") pod \"4c892a6d2d8a57acbc49427d3a7d24e253bab25be2c607ef405d2c4835c7lnn\" (UID: \"b4b3a091-066c-47b8-900f-82ec08f813ca\") " pod="openshift-marketplace/4c892a6d2d8a57acbc49427d3a7d24e253bab25be2c607ef405d2c4835c7lnn" May 21 13:07:43.226961 ip-10-0-133-64 kubenswrapper[2562]: I0521 13:07:43.226885 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/b4b3a091-066c-47b8-900f-82ec08f813ca-bundle\") pod \"4c892a6d2d8a57acbc49427d3a7d24e253bab25be2c607ef405d2c4835c7lnn\" (UID: \"b4b3a091-066c-47b8-900f-82ec08f813ca\") " pod="openshift-marketplace/4c892a6d2d8a57acbc49427d3a7d24e253bab25be2c607ef405d2c4835c7lnn" May 21 13:07:43.327860 ip-10-0-133-64 kubenswrapper[2562]: I0521 13:07:43.327828 2562 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/b4b3a091-066c-47b8-900f-82ec08f813ca-bundle\") pod \"4c892a6d2d8a57acbc49427d3a7d24e253bab25be2c607ef405d2c4835c7lnn\" (UID: \"b4b3a091-066c-47b8-900f-82ec08f813ca\") " pod="openshift-marketplace/4c892a6d2d8a57acbc49427d3a7d24e253bab25be2c607ef405d2c4835c7lnn" May 21 13:07:43.328053 ip-10-0-133-64 kubenswrapper[2562]: I0521 13:07:43.327902 2562 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-k6hfp\" (UniqueName: \"kubernetes.io/projected/b4b3a091-066c-47b8-900f-82ec08f813ca-kube-api-access-k6hfp\") pod \"4c892a6d2d8a57acbc49427d3a7d24e253bab25be2c607ef405d2c4835c7lnn\" (UID: \"b4b3a091-066c-47b8-900f-82ec08f813ca\") " pod="openshift-marketplace/4c892a6d2d8a57acbc49427d3a7d24e253bab25be2c607ef405d2c4835c7lnn" May 21 13:07:43.328053 ip-10-0-133-64 kubenswrapper[2562]: I0521 13:07:43.327936 2562 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/b4b3a091-066c-47b8-900f-82ec08f813ca-util\") pod \"4c892a6d2d8a57acbc49427d3a7d24e253bab25be2c607ef405d2c4835c7lnn\" (UID: \"b4b3a091-066c-47b8-900f-82ec08f813ca\") " pod="openshift-marketplace/4c892a6d2d8a57acbc49427d3a7d24e253bab25be2c607ef405d2c4835c7lnn" May 21 13:07:43.328271 ip-10-0-133-64 kubenswrapper[2562]: I0521 13:07:43.328245 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/b4b3a091-066c-47b8-900f-82ec08f813ca-bundle\") pod \"4c892a6d2d8a57acbc49427d3a7d24e253bab25be2c607ef405d2c4835c7lnn\" (UID: \"b4b3a091-066c-47b8-900f-82ec08f813ca\") " pod="openshift-marketplace/4c892a6d2d8a57acbc49427d3a7d24e253bab25be2c607ef405d2c4835c7lnn" May 21 13:07:43.328332 ip-10-0-133-64 kubenswrapper[2562]: I0521 13:07:43.328297 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/b4b3a091-066c-47b8-900f-82ec08f813ca-util\") pod \"4c892a6d2d8a57acbc49427d3a7d24e253bab25be2c607ef405d2c4835c7lnn\" (UID: \"b4b3a091-066c-47b8-900f-82ec08f813ca\") " pod="openshift-marketplace/4c892a6d2d8a57acbc49427d3a7d24e253bab25be2c607ef405d2c4835c7lnn" May 21 13:07:43.340390 ip-10-0-133-64 kubenswrapper[2562]: I0521 13:07:43.340360 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-k6hfp\" (UniqueName: \"kubernetes.io/projected/b4b3a091-066c-47b8-900f-82ec08f813ca-kube-api-access-k6hfp\") pod \"4c892a6d2d8a57acbc49427d3a7d24e253bab25be2c607ef405d2c4835c7lnn\" (UID: \"b4b3a091-066c-47b8-900f-82ec08f813ca\") " pod="openshift-marketplace/4c892a6d2d8a57acbc49427d3a7d24e253bab25be2c607ef405d2c4835c7lnn" May 21 13:07:43.497823 ip-10-0-133-64 kubenswrapper[2562]: I0521 13:07:43.497769 2562 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/4c892a6d2d8a57acbc49427d3a7d24e253bab25be2c607ef405d2c4835c7lnn" May 21 13:07:43.624470 ip-10-0-133-64 kubenswrapper[2562]: I0521 13:07:43.624418 2562 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/4c892a6d2d8a57acbc49427d3a7d24e253bab25be2c607ef405d2c4835c7lnn"] May 21 13:07:43.627237 ip-10-0-133-64 kubenswrapper[2562]: W0521 13:07:43.627209 2562 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podb4b3a091_066c_47b8_900f_82ec08f813ca.slice/crio-a356f48198146babd6523bc61e8ac8994e32e4e4c6319629eee53bf6aeebb973 WatchSource:0}: Error finding container a356f48198146babd6523bc61e8ac8994e32e4e4c6319629eee53bf6aeebb973: Status 404 returned error can't find the container with id a356f48198146babd6523bc61e8ac8994e32e4e4c6319629eee53bf6aeebb973 May 21 13:07:43.629056 ip-10-0-133-64 kubenswrapper[2562]: I0521 13:07:43.629032 2562 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider May 21 13:07:44.133466 ip-10-0-133-64 kubenswrapper[2562]: I0521 13:07:44.133419 2562 generic.go:358] "Generic (PLEG): container finished" podID="b4b3a091-066c-47b8-900f-82ec08f813ca" containerID="291a21535743454d325d4064513ce8726dc273edc50187cdaab0c6455df55b47" exitCode=0 May 21 13:07:44.133771 ip-10-0-133-64 kubenswrapper[2562]: I0521 13:07:44.133566 2562 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/4c892a6d2d8a57acbc49427d3a7d24e253bab25be2c607ef405d2c4835c7lnn" event={"ID":"b4b3a091-066c-47b8-900f-82ec08f813ca","Type":"ContainerDied","Data":"291a21535743454d325d4064513ce8726dc273edc50187cdaab0c6455df55b47"} May 21 13:07:44.133771 ip-10-0-133-64 kubenswrapper[2562]: I0521 13:07:44.133613 2562 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/4c892a6d2d8a57acbc49427d3a7d24e253bab25be2c607ef405d2c4835c7lnn" event={"ID":"b4b3a091-066c-47b8-900f-82ec08f813ca","Type":"ContainerStarted","Data":"a356f48198146babd6523bc61e8ac8994e32e4e4c6319629eee53bf6aeebb973"} May 21 13:07:46.142403 ip-10-0-133-64 kubenswrapper[2562]: I0521 13:07:46.142368 2562 generic.go:358] "Generic (PLEG): container finished" podID="b4b3a091-066c-47b8-900f-82ec08f813ca" containerID="9c812bf677ae2b63aa9b9f62e980bdecc68f05a93216bf965fb1d8f7a7d058d7" exitCode=0 May 21 13:07:46.142832 ip-10-0-133-64 kubenswrapper[2562]: I0521 13:07:46.142451 2562 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/4c892a6d2d8a57acbc49427d3a7d24e253bab25be2c607ef405d2c4835c7lnn" event={"ID":"b4b3a091-066c-47b8-900f-82ec08f813ca","Type":"ContainerDied","Data":"9c812bf677ae2b63aa9b9f62e980bdecc68f05a93216bf965fb1d8f7a7d058d7"} May 21 13:07:47.149918 ip-10-0-133-64 kubenswrapper[2562]: I0521 13:07:47.149885 2562 generic.go:358] "Generic (PLEG): container finished" podID="b4b3a091-066c-47b8-900f-82ec08f813ca" containerID="8eafbf4725cb4c57f585a1f94cafa8af01598ff347c31008b83d45d764d0ca0e" exitCode=0 May 21 13:07:47.150277 ip-10-0-133-64 kubenswrapper[2562]: I0521 13:07:47.149970 2562 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/4c892a6d2d8a57acbc49427d3a7d24e253bab25be2c607ef405d2c4835c7lnn" event={"ID":"b4b3a091-066c-47b8-900f-82ec08f813ca","Type":"ContainerDied","Data":"8eafbf4725cb4c57f585a1f94cafa8af01598ff347c31008b83d45d764d0ca0e"} May 21 13:07:48.277472 ip-10-0-133-64 kubenswrapper[2562]: I0521 13:07:48.277447 2562 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/4c892a6d2d8a57acbc49427d3a7d24e253bab25be2c607ef405d2c4835c7lnn" May 21 13:07:48.366562 ip-10-0-133-64 kubenswrapper[2562]: I0521 13:07:48.366522 2562 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-k6hfp\" (UniqueName: \"kubernetes.io/projected/b4b3a091-066c-47b8-900f-82ec08f813ca-kube-api-access-k6hfp\") pod \"b4b3a091-066c-47b8-900f-82ec08f813ca\" (UID: \"b4b3a091-066c-47b8-900f-82ec08f813ca\") " May 21 13:07:48.366739 ip-10-0-133-64 kubenswrapper[2562]: I0521 13:07:48.366594 2562 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/b4b3a091-066c-47b8-900f-82ec08f813ca-util\") pod \"b4b3a091-066c-47b8-900f-82ec08f813ca\" (UID: \"b4b3a091-066c-47b8-900f-82ec08f813ca\") " May 21 13:07:48.366739 ip-10-0-133-64 kubenswrapper[2562]: I0521 13:07:48.366615 2562 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/b4b3a091-066c-47b8-900f-82ec08f813ca-bundle\") pod \"b4b3a091-066c-47b8-900f-82ec08f813ca\" (UID: \"b4b3a091-066c-47b8-900f-82ec08f813ca\") " May 21 13:07:48.367571 ip-10-0-133-64 kubenswrapper[2562]: I0521 13:07:48.367543 2562 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/b4b3a091-066c-47b8-900f-82ec08f813ca-bundle" (OuterVolumeSpecName: "bundle") pod "b4b3a091-066c-47b8-900f-82ec08f813ca" (UID: "b4b3a091-066c-47b8-900f-82ec08f813ca"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" May 21 13:07:48.368678 ip-10-0-133-64 kubenswrapper[2562]: I0521 13:07:48.368657 2562 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/b4b3a091-066c-47b8-900f-82ec08f813ca-kube-api-access-k6hfp" (OuterVolumeSpecName: "kube-api-access-k6hfp") pod "b4b3a091-066c-47b8-900f-82ec08f813ca" (UID: "b4b3a091-066c-47b8-900f-82ec08f813ca"). InnerVolumeSpecName "kube-api-access-k6hfp". PluginName "kubernetes.io/projected", VolumeGIDValue "" May 21 13:07:48.374672 ip-10-0-133-64 kubenswrapper[2562]: I0521 13:07:48.374627 2562 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/b4b3a091-066c-47b8-900f-82ec08f813ca-util" (OuterVolumeSpecName: "util") pod "b4b3a091-066c-47b8-900f-82ec08f813ca" (UID: "b4b3a091-066c-47b8-900f-82ec08f813ca"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" May 21 13:07:48.467505 ip-10-0-133-64 kubenswrapper[2562]: I0521 13:07:48.467476 2562 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-k6hfp\" (UniqueName: \"kubernetes.io/projected/b4b3a091-066c-47b8-900f-82ec08f813ca-kube-api-access-k6hfp\") on node \"ip-10-0-133-64.ec2.internal\" DevicePath \"\"" May 21 13:07:48.467505 ip-10-0-133-64 kubenswrapper[2562]: I0521 13:07:48.467506 2562 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/b4b3a091-066c-47b8-900f-82ec08f813ca-util\") on node \"ip-10-0-133-64.ec2.internal\" DevicePath \"\"" May 21 13:07:48.467697 ip-10-0-133-64 kubenswrapper[2562]: I0521 13:07:48.467518 2562 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/b4b3a091-066c-47b8-900f-82ec08f813ca-bundle\") on node \"ip-10-0-133-64.ec2.internal\" DevicePath \"\"" May 21 13:07:49.157264 ip-10-0-133-64 kubenswrapper[2562]: I0521 13:07:49.157227 2562 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/4c892a6d2d8a57acbc49427d3a7d24e253bab25be2c607ef405d2c4835c7lnn" event={"ID":"b4b3a091-066c-47b8-900f-82ec08f813ca","Type":"ContainerDied","Data":"a356f48198146babd6523bc61e8ac8994e32e4e4c6319629eee53bf6aeebb973"} May 21 13:07:49.157264 ip-10-0-133-64 kubenswrapper[2562]: I0521 13:07:49.157263 2562 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="a356f48198146babd6523bc61e8ac8994e32e4e4c6319629eee53bf6aeebb973" May 21 13:07:49.157264 ip-10-0-133-64 kubenswrapper[2562]: I0521 13:07:49.157234 2562 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/4c892a6d2d8a57acbc49427d3a7d24e253bab25be2c607ef405d2c4835c7lnn" May 21 13:07:57.059732 ip-10-0-133-64 kubenswrapper[2562]: I0521 13:07:57.059699 2562 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-marketplace/c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762aw6mpr"] May 21 13:07:57.060129 ip-10-0-133-64 kubenswrapper[2562]: I0521 13:07:57.059987 2562 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="b4b3a091-066c-47b8-900f-82ec08f813ca" containerName="util" May 21 13:07:57.060129 ip-10-0-133-64 kubenswrapper[2562]: I0521 13:07:57.059998 2562 state_mem.go:107] "Deleted CPUSet assignment" podUID="b4b3a091-066c-47b8-900f-82ec08f813ca" containerName="util" May 21 13:07:57.060129 ip-10-0-133-64 kubenswrapper[2562]: I0521 13:07:57.060017 2562 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="b4b3a091-066c-47b8-900f-82ec08f813ca" containerName="pull" May 21 13:07:57.060129 ip-10-0-133-64 kubenswrapper[2562]: I0521 13:07:57.060022 2562 state_mem.go:107] "Deleted CPUSet assignment" podUID="b4b3a091-066c-47b8-900f-82ec08f813ca" containerName="pull" May 21 13:07:57.060129 ip-10-0-133-64 kubenswrapper[2562]: I0521 13:07:57.060033 2562 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="b4b3a091-066c-47b8-900f-82ec08f813ca" containerName="extract" May 21 13:07:57.060129 ip-10-0-133-64 kubenswrapper[2562]: I0521 13:07:57.060039 2562 state_mem.go:107] "Deleted CPUSet assignment" podUID="b4b3a091-066c-47b8-900f-82ec08f813ca" containerName="extract" May 21 13:07:57.060129 ip-10-0-133-64 kubenswrapper[2562]: I0521 13:07:57.060087 2562 memory_manager.go:356] "RemoveStaleState removing state" podUID="b4b3a091-066c-47b8-900f-82ec08f813ca" containerName="extract" May 21 13:07:57.063079 ip-10-0-133-64 kubenswrapper[2562]: I0521 13:07:57.063059 2562 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762aw6mpr" May 21 13:07:57.067344 ip-10-0-133-64 kubenswrapper[2562]: I0521 13:07:57.067323 2562 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"openshift-service-ca.crt\"" May 21 13:07:57.067445 ip-10-0-133-64 kubenswrapper[2562]: I0521 13:07:57.067326 2562 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"kube-root-ca.crt\"" May 21 13:07:57.068192 ip-10-0-133-64 kubenswrapper[2562]: I0521 13:07:57.068174 2562 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-marketplace\"/\"default-dockercfg-z9cvq\"" May 21 13:07:57.085624 ip-10-0-133-64 kubenswrapper[2562]: I0521 13:07:57.085603 2562 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762aw6mpr"] May 21 13:07:57.140779 ip-10-0-133-64 kubenswrapper[2562]: I0521 13:07:57.140751 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/1da7bdb8-2477-4670-aa49-2571d07c4d82-bundle\") pod \"c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762aw6mpr\" (UID: \"1da7bdb8-2477-4670-aa49-2571d07c4d82\") " pod="openshift-marketplace/c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762aw6mpr" May 21 13:07:57.140970 ip-10-0-133-64 kubenswrapper[2562]: I0521 13:07:57.140865 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/1da7bdb8-2477-4670-aa49-2571d07c4d82-util\") pod \"c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762aw6mpr\" (UID: \"1da7bdb8-2477-4670-aa49-2571d07c4d82\") " pod="openshift-marketplace/c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762aw6mpr" May 21 13:07:57.140970 ip-10-0-133-64 kubenswrapper[2562]: I0521 13:07:57.140903 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-vnb52\" (UniqueName: \"kubernetes.io/projected/1da7bdb8-2477-4670-aa49-2571d07c4d82-kube-api-access-vnb52\") pod \"c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762aw6mpr\" (UID: \"1da7bdb8-2477-4670-aa49-2571d07c4d82\") " pod="openshift-marketplace/c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762aw6mpr" May 21 13:07:57.242026 ip-10-0-133-64 kubenswrapper[2562]: I0521 13:07:57.241987 2562 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/1da7bdb8-2477-4670-aa49-2571d07c4d82-bundle\") pod \"c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762aw6mpr\" (UID: \"1da7bdb8-2477-4670-aa49-2571d07c4d82\") " pod="openshift-marketplace/c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762aw6mpr" May 21 13:07:57.242215 ip-10-0-133-64 kubenswrapper[2562]: I0521 13:07:57.242048 2562 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/1da7bdb8-2477-4670-aa49-2571d07c4d82-util\") pod \"c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762aw6mpr\" (UID: \"1da7bdb8-2477-4670-aa49-2571d07c4d82\") " pod="openshift-marketplace/c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762aw6mpr" May 21 13:07:57.242215 ip-10-0-133-64 kubenswrapper[2562]: I0521 13:07:57.242069 2562 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-vnb52\" (UniqueName: \"kubernetes.io/projected/1da7bdb8-2477-4670-aa49-2571d07c4d82-kube-api-access-vnb52\") pod \"c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762aw6mpr\" (UID: \"1da7bdb8-2477-4670-aa49-2571d07c4d82\") " pod="openshift-marketplace/c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762aw6mpr" May 21 13:07:57.242480 ip-10-0-133-64 kubenswrapper[2562]: I0521 13:07:57.242457 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/1da7bdb8-2477-4670-aa49-2571d07c4d82-bundle\") pod \"c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762aw6mpr\" (UID: \"1da7bdb8-2477-4670-aa49-2571d07c4d82\") " pod="openshift-marketplace/c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762aw6mpr" May 21 13:07:57.242516 ip-10-0-133-64 kubenswrapper[2562]: I0521 13:07:57.242470 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/1da7bdb8-2477-4670-aa49-2571d07c4d82-util\") pod \"c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762aw6mpr\" (UID: \"1da7bdb8-2477-4670-aa49-2571d07c4d82\") " pod="openshift-marketplace/c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762aw6mpr" May 21 13:07:57.252021 ip-10-0-133-64 kubenswrapper[2562]: I0521 13:07:57.251986 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-vnb52\" (UniqueName: \"kubernetes.io/projected/1da7bdb8-2477-4670-aa49-2571d07c4d82-kube-api-access-vnb52\") pod \"c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762aw6mpr\" (UID: \"1da7bdb8-2477-4670-aa49-2571d07c4d82\") " pod="openshift-marketplace/c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762aw6mpr" May 21 13:07:57.372056 ip-10-0-133-64 kubenswrapper[2562]: I0521 13:07:57.371972 2562 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762aw6mpr" May 21 13:07:57.534197 ip-10-0-133-64 kubenswrapper[2562]: I0521 13:07:57.534158 2562 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762aw6mpr"] May 21 13:07:57.541701 ip-10-0-133-64 kubenswrapper[2562]: W0521 13:07:57.541668 2562 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod1da7bdb8_2477_4670_aa49_2571d07c4d82.slice/crio-94fa1c6143bb11a32557e9158020896f7f2b7823eda58206b3503ef21ff0c242 WatchSource:0}: Error finding container 94fa1c6143bb11a32557e9158020896f7f2b7823eda58206b3503ef21ff0c242: Status 404 returned error can't find the container with id 94fa1c6143bb11a32557e9158020896f7f2b7823eda58206b3503ef21ff0c242 May 21 13:07:58.189754 ip-10-0-133-64 kubenswrapper[2562]: I0521 13:07:58.189723 2562 generic.go:358] "Generic (PLEG): container finished" podID="1da7bdb8-2477-4670-aa49-2571d07c4d82" containerID="3dac6d85db3d25a3738df0f91caf24aaaac95ab7906e277cac8605207342f71b" exitCode=0 May 21 13:07:58.190173 ip-10-0-133-64 kubenswrapper[2562]: I0521 13:07:58.189838 2562 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762aw6mpr" event={"ID":"1da7bdb8-2477-4670-aa49-2571d07c4d82","Type":"ContainerDied","Data":"3dac6d85db3d25a3738df0f91caf24aaaac95ab7906e277cac8605207342f71b"} May 21 13:07:58.190173 ip-10-0-133-64 kubenswrapper[2562]: I0521 13:07:58.189877 2562 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762aw6mpr" event={"ID":"1da7bdb8-2477-4670-aa49-2571d07c4d82","Type":"ContainerStarted","Data":"94fa1c6143bb11a32557e9158020896f7f2b7823eda58206b3503ef21ff0c242"} May 21 13:07:59.194880 ip-10-0-133-64 kubenswrapper[2562]: I0521 13:07:59.194854 2562 generic.go:358] "Generic (PLEG): container finished" podID="1da7bdb8-2477-4670-aa49-2571d07c4d82" containerID="6b1babc9fce5665a0ffe7f2b9b0dc2c106138f9dc5613d3a325d2787e18bd830" exitCode=0 May 21 13:07:59.195182 ip-10-0-133-64 kubenswrapper[2562]: I0521 13:07:59.194940 2562 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762aw6mpr" event={"ID":"1da7bdb8-2477-4670-aa49-2571d07c4d82","Type":"ContainerDied","Data":"6b1babc9fce5665a0ffe7f2b9b0dc2c106138f9dc5613d3a325d2787e18bd830"} May 21 13:08:00.200290 ip-10-0-133-64 kubenswrapper[2562]: I0521 13:08:00.200259 2562 generic.go:358] "Generic (PLEG): container finished" podID="1da7bdb8-2477-4670-aa49-2571d07c4d82" containerID="858a8890ad0691eb84b67e02c17c1439783568b97d025997a157e3d6e6b49514" exitCode=0 May 21 13:08:00.200714 ip-10-0-133-64 kubenswrapper[2562]: I0521 13:08:00.200328 2562 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762aw6mpr" event={"ID":"1da7bdb8-2477-4670-aa49-2571d07c4d82","Type":"ContainerDied","Data":"858a8890ad0691eb84b67e02c17c1439783568b97d025997a157e3d6e6b49514"} May 21 13:08:01.332941 ip-10-0-133-64 kubenswrapper[2562]: I0521 13:08:01.332916 2562 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762aw6mpr" May 21 13:08:01.375597 ip-10-0-133-64 kubenswrapper[2562]: I0521 13:08:01.375569 2562 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/1da7bdb8-2477-4670-aa49-2571d07c4d82-util\") pod \"1da7bdb8-2477-4670-aa49-2571d07c4d82\" (UID: \"1da7bdb8-2477-4670-aa49-2571d07c4d82\") " May 21 13:08:01.375755 ip-10-0-133-64 kubenswrapper[2562]: I0521 13:08:01.375628 2562 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-vnb52\" (UniqueName: \"kubernetes.io/projected/1da7bdb8-2477-4670-aa49-2571d07c4d82-kube-api-access-vnb52\") pod \"1da7bdb8-2477-4670-aa49-2571d07c4d82\" (UID: \"1da7bdb8-2477-4670-aa49-2571d07c4d82\") " May 21 13:08:01.375755 ip-10-0-133-64 kubenswrapper[2562]: I0521 13:08:01.375672 2562 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/1da7bdb8-2477-4670-aa49-2571d07c4d82-bundle\") pod \"1da7bdb8-2477-4670-aa49-2571d07c4d82\" (UID: \"1da7bdb8-2477-4670-aa49-2571d07c4d82\") " May 21 13:08:01.376642 ip-10-0-133-64 kubenswrapper[2562]: I0521 13:08:01.376614 2562 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/1da7bdb8-2477-4670-aa49-2571d07c4d82-bundle" (OuterVolumeSpecName: "bundle") pod "1da7bdb8-2477-4670-aa49-2571d07c4d82" (UID: "1da7bdb8-2477-4670-aa49-2571d07c4d82"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" May 21 13:08:01.377827 ip-10-0-133-64 kubenswrapper[2562]: I0521 13:08:01.377772 2562 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/1da7bdb8-2477-4670-aa49-2571d07c4d82-kube-api-access-vnb52" (OuterVolumeSpecName: "kube-api-access-vnb52") pod "1da7bdb8-2477-4670-aa49-2571d07c4d82" (UID: "1da7bdb8-2477-4670-aa49-2571d07c4d82"). InnerVolumeSpecName "kube-api-access-vnb52". PluginName "kubernetes.io/projected", VolumeGIDValue "" May 21 13:08:01.380903 ip-10-0-133-64 kubenswrapper[2562]: I0521 13:08:01.380869 2562 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/1da7bdb8-2477-4670-aa49-2571d07c4d82-util" (OuterVolumeSpecName: "util") pod "1da7bdb8-2477-4670-aa49-2571d07c4d82" (UID: "1da7bdb8-2477-4670-aa49-2571d07c4d82"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" May 21 13:08:01.476724 ip-10-0-133-64 kubenswrapper[2562]: I0521 13:08:01.476690 2562 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/1da7bdb8-2477-4670-aa49-2571d07c4d82-util\") on node \"ip-10-0-133-64.ec2.internal\" DevicePath \"\"" May 21 13:08:01.476724 ip-10-0-133-64 kubenswrapper[2562]: I0521 13:08:01.476718 2562 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-vnb52\" (UniqueName: \"kubernetes.io/projected/1da7bdb8-2477-4670-aa49-2571d07c4d82-kube-api-access-vnb52\") on node \"ip-10-0-133-64.ec2.internal\" DevicePath \"\"" May 21 13:08:01.476946 ip-10-0-133-64 kubenswrapper[2562]: I0521 13:08:01.476731 2562 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/1da7bdb8-2477-4670-aa49-2571d07c4d82-bundle\") on node \"ip-10-0-133-64.ec2.internal\" DevicePath \"\"" May 21 13:08:02.209014 ip-10-0-133-64 kubenswrapper[2562]: I0521 13:08:02.208988 2562 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762aw6mpr" May 21 13:08:02.209190 ip-10-0-133-64 kubenswrapper[2562]: I0521 13:08:02.208988 2562 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762aw6mpr" event={"ID":"1da7bdb8-2477-4670-aa49-2571d07c4d82","Type":"ContainerDied","Data":"94fa1c6143bb11a32557e9158020896f7f2b7823eda58206b3503ef21ff0c242"} May 21 13:08:02.209190 ip-10-0-133-64 kubenswrapper[2562]: I0521 13:08:02.209092 2562 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="94fa1c6143bb11a32557e9158020896f7f2b7823eda58206b3503ef21ff0c242" May 21 13:08:19.132515 ip-10-0-133-64 kubenswrapper[2562]: I0521 13:08:19.132478 2562 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-ingress/data-science-gateway-data-science-gateway-class-686dffbf4bpn7ll"] May 21 13:08:19.133013 ip-10-0-133-64 kubenswrapper[2562]: I0521 13:08:19.132757 2562 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="1da7bdb8-2477-4670-aa49-2571d07c4d82" containerName="util" May 21 13:08:19.133013 ip-10-0-133-64 kubenswrapper[2562]: I0521 13:08:19.132768 2562 state_mem.go:107] "Deleted CPUSet assignment" podUID="1da7bdb8-2477-4670-aa49-2571d07c4d82" containerName="util" May 21 13:08:19.133013 ip-10-0-133-64 kubenswrapper[2562]: I0521 13:08:19.132778 2562 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="1da7bdb8-2477-4670-aa49-2571d07c4d82" containerName="pull" May 21 13:08:19.133013 ip-10-0-133-64 kubenswrapper[2562]: I0521 13:08:19.132784 2562 state_mem.go:107] "Deleted CPUSet assignment" podUID="1da7bdb8-2477-4670-aa49-2571d07c4d82" containerName="pull" May 21 13:08:19.133013 ip-10-0-133-64 kubenswrapper[2562]: I0521 13:08:19.132809 2562 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="1da7bdb8-2477-4670-aa49-2571d07c4d82" containerName="extract" May 21 13:08:19.133013 ip-10-0-133-64 kubenswrapper[2562]: I0521 13:08:19.132815 2562 state_mem.go:107] "Deleted CPUSet assignment" podUID="1da7bdb8-2477-4670-aa49-2571d07c4d82" containerName="extract" May 21 13:08:19.133441 ip-10-0-133-64 kubenswrapper[2562]: I0521 13:08:19.133415 2562 memory_manager.go:356] "RemoveStaleState removing state" podUID="1da7bdb8-2477-4670-aa49-2571d07c4d82" containerName="extract" May 21 13:08:19.139406 ip-10-0-133-64 kubenswrapper[2562]: I0521 13:08:19.139376 2562 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-686dffbf4bpn7ll" May 21 13:08:19.150418 ip-10-0-133-64 kubenswrapper[2562]: I0521 13:08:19.150399 2562 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"data-science-gateway-data-science-gateway-class-dockercfg-m8tlw\"" May 21 13:08:19.150668 ip-10-0-133-64 kubenswrapper[2562]: I0521 13:08:19.150649 2562 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"openshift-gw-ca-root-cert\"" May 21 13:08:19.181842 ip-10-0-133-64 kubenswrapper[2562]: I0521 13:08:19.181794 2562 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/data-science-gateway-data-science-gateway-class-686dffbf4bpn7ll"] May 21 13:08:19.221996 ip-10-0-133-64 kubenswrapper[2562]: I0521 13:08:19.221968 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/27083247-23eb-44d0-af0a-968f3acc818f-istio-token\") pod \"data-science-gateway-data-science-gateway-class-686dffbf4bpn7ll\" (UID: \"27083247-23eb-44d0-af0a-968f3acc818f\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-686dffbf4bpn7ll" May 21 13:08:19.222150 ip-10-0-133-64 kubenswrapper[2562]: I0521 13:08:19.222002 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/27083247-23eb-44d0-af0a-968f3acc818f-istio-data\") pod \"data-science-gateway-data-science-gateway-class-686dffbf4bpn7ll\" (UID: \"27083247-23eb-44d0-af0a-968f3acc818f\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-686dffbf4bpn7ll" May 21 13:08:19.222150 ip-10-0-133-64 kubenswrapper[2562]: I0521 13:08:19.222032 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/27083247-23eb-44d0-af0a-968f3acc818f-workload-socket\") pod \"data-science-gateway-data-science-gateway-class-686dffbf4bpn7ll\" (UID: \"27083247-23eb-44d0-af0a-968f3acc818f\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-686dffbf4bpn7ll" May 21 13:08:19.222150 ip-10-0-133-64 kubenswrapper[2562]: I0521 13:08:19.222051 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/27083247-23eb-44d0-af0a-968f3acc818f-credential-socket\") pod \"data-science-gateway-data-science-gateway-class-686dffbf4bpn7ll\" (UID: \"27083247-23eb-44d0-af0a-968f3acc818f\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-686dffbf4bpn7ll" May 21 13:08:19.222150 ip-10-0-133-64 kubenswrapper[2562]: I0521 13:08:19.222067 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/27083247-23eb-44d0-af0a-968f3acc818f-istiod-ca-cert\") pod \"data-science-gateway-data-science-gateway-class-686dffbf4bpn7ll\" (UID: \"27083247-23eb-44d0-af0a-968f3acc818f\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-686dffbf4bpn7ll" May 21 13:08:19.222150 ip-10-0-133-64 kubenswrapper[2562]: I0521 13:08:19.222101 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/27083247-23eb-44d0-af0a-968f3acc818f-istio-envoy\") pod \"data-science-gateway-data-science-gateway-class-686dffbf4bpn7ll\" (UID: \"27083247-23eb-44d0-af0a-968f3acc818f\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-686dffbf4bpn7ll" May 21 13:08:19.222150 ip-10-0-133-64 kubenswrapper[2562]: I0521 13:08:19.222119 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/27083247-23eb-44d0-af0a-968f3acc818f-workload-certs\") pod \"data-science-gateway-data-science-gateway-class-686dffbf4bpn7ll\" (UID: \"27083247-23eb-44d0-af0a-968f3acc818f\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-686dffbf4bpn7ll" May 21 13:08:19.222150 ip-10-0-133-64 kubenswrapper[2562]: I0521 13:08:19.222137 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/27083247-23eb-44d0-af0a-968f3acc818f-istio-podinfo\") pod \"data-science-gateway-data-science-gateway-class-686dffbf4bpn7ll\" (UID: \"27083247-23eb-44d0-af0a-968f3acc818f\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-686dffbf4bpn7ll" May 21 13:08:19.222375 ip-10-0-133-64 kubenswrapper[2562]: I0521 13:08:19.222196 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-58dbt\" (UniqueName: \"kubernetes.io/projected/27083247-23eb-44d0-af0a-968f3acc818f-kube-api-access-58dbt\") pod \"data-science-gateway-data-science-gateway-class-686dffbf4bpn7ll\" (UID: \"27083247-23eb-44d0-af0a-968f3acc818f\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-686dffbf4bpn7ll" May 21 13:08:19.323107 ip-10-0-133-64 kubenswrapper[2562]: I0521 13:08:19.323068 2562 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/27083247-23eb-44d0-af0a-968f3acc818f-istio-envoy\") pod \"data-science-gateway-data-science-gateway-class-686dffbf4bpn7ll\" (UID: \"27083247-23eb-44d0-af0a-968f3acc818f\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-686dffbf4bpn7ll" May 21 13:08:19.323107 ip-10-0-133-64 kubenswrapper[2562]: I0521 13:08:19.323111 2562 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/27083247-23eb-44d0-af0a-968f3acc818f-workload-certs\") pod \"data-science-gateway-data-science-gateway-class-686dffbf4bpn7ll\" (UID: \"27083247-23eb-44d0-af0a-968f3acc818f\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-686dffbf4bpn7ll" May 21 13:08:19.323327 ip-10-0-133-64 kubenswrapper[2562]: I0521 13:08:19.323138 2562 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/27083247-23eb-44d0-af0a-968f3acc818f-istio-podinfo\") pod \"data-science-gateway-data-science-gateway-class-686dffbf4bpn7ll\" (UID: \"27083247-23eb-44d0-af0a-968f3acc818f\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-686dffbf4bpn7ll" May 21 13:08:19.323327 ip-10-0-133-64 kubenswrapper[2562]: I0521 13:08:19.323162 2562 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-58dbt\" (UniqueName: \"kubernetes.io/projected/27083247-23eb-44d0-af0a-968f3acc818f-kube-api-access-58dbt\") pod \"data-science-gateway-data-science-gateway-class-686dffbf4bpn7ll\" (UID: \"27083247-23eb-44d0-af0a-968f3acc818f\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-686dffbf4bpn7ll" May 21 13:08:19.323327 ip-10-0-133-64 kubenswrapper[2562]: I0521 13:08:19.323215 2562 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/27083247-23eb-44d0-af0a-968f3acc818f-istio-token\") pod \"data-science-gateway-data-science-gateway-class-686dffbf4bpn7ll\" (UID: \"27083247-23eb-44d0-af0a-968f3acc818f\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-686dffbf4bpn7ll" May 21 13:08:19.323327 ip-10-0-133-64 kubenswrapper[2562]: I0521 13:08:19.323239 2562 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/27083247-23eb-44d0-af0a-968f3acc818f-istio-data\") pod \"data-science-gateway-data-science-gateway-class-686dffbf4bpn7ll\" (UID: \"27083247-23eb-44d0-af0a-968f3acc818f\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-686dffbf4bpn7ll" May 21 13:08:19.323327 ip-10-0-133-64 kubenswrapper[2562]: I0521 13:08:19.323266 2562 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/27083247-23eb-44d0-af0a-968f3acc818f-workload-socket\") pod \"data-science-gateway-data-science-gateway-class-686dffbf4bpn7ll\" (UID: \"27083247-23eb-44d0-af0a-968f3acc818f\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-686dffbf4bpn7ll" May 21 13:08:19.323327 ip-10-0-133-64 kubenswrapper[2562]: I0521 13:08:19.323291 2562 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/27083247-23eb-44d0-af0a-968f3acc818f-credential-socket\") pod \"data-science-gateway-data-science-gateway-class-686dffbf4bpn7ll\" (UID: \"27083247-23eb-44d0-af0a-968f3acc818f\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-686dffbf4bpn7ll" May 21 13:08:19.323327 ip-10-0-133-64 kubenswrapper[2562]: I0521 13:08:19.323319 2562 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/27083247-23eb-44d0-af0a-968f3acc818f-istiod-ca-cert\") pod \"data-science-gateway-data-science-gateway-class-686dffbf4bpn7ll\" (UID: \"27083247-23eb-44d0-af0a-968f3acc818f\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-686dffbf4bpn7ll" May 21 13:08:19.323692 ip-10-0-133-64 kubenswrapper[2562]: I0521 13:08:19.323590 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/27083247-23eb-44d0-af0a-968f3acc818f-workload-certs\") pod \"data-science-gateway-data-science-gateway-class-686dffbf4bpn7ll\" (UID: \"27083247-23eb-44d0-af0a-968f3acc818f\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-686dffbf4bpn7ll" May 21 13:08:19.323692 ip-10-0-133-64 kubenswrapper[2562]: I0521 13:08:19.323633 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/27083247-23eb-44d0-af0a-968f3acc818f-workload-socket\") pod \"data-science-gateway-data-science-gateway-class-686dffbf4bpn7ll\" (UID: \"27083247-23eb-44d0-af0a-968f3acc818f\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-686dffbf4bpn7ll" May 21 13:08:19.323771 ip-10-0-133-64 kubenswrapper[2562]: I0521 13:08:19.323700 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/27083247-23eb-44d0-af0a-968f3acc818f-istio-data\") pod \"data-science-gateway-data-science-gateway-class-686dffbf4bpn7ll\" (UID: \"27083247-23eb-44d0-af0a-968f3acc818f\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-686dffbf4bpn7ll" May 21 13:08:19.323870 ip-10-0-133-64 kubenswrapper[2562]: I0521 13:08:19.323851 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/27083247-23eb-44d0-af0a-968f3acc818f-credential-socket\") pod \"data-science-gateway-data-science-gateway-class-686dffbf4bpn7ll\" (UID: \"27083247-23eb-44d0-af0a-968f3acc818f\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-686dffbf4bpn7ll" May 21 13:08:19.323970 ip-10-0-133-64 kubenswrapper[2562]: I0521 13:08:19.323954 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/27083247-23eb-44d0-af0a-968f3acc818f-istiod-ca-cert\") pod \"data-science-gateway-data-science-gateway-class-686dffbf4bpn7ll\" (UID: \"27083247-23eb-44d0-af0a-968f3acc818f\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-686dffbf4bpn7ll" May 21 13:08:19.325892 ip-10-0-133-64 kubenswrapper[2562]: I0521 13:08:19.325873 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/27083247-23eb-44d0-af0a-968f3acc818f-istio-envoy\") pod \"data-science-gateway-data-science-gateway-class-686dffbf4bpn7ll\" (UID: \"27083247-23eb-44d0-af0a-968f3acc818f\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-686dffbf4bpn7ll" May 21 13:08:19.326237 ip-10-0-133-64 kubenswrapper[2562]: I0521 13:08:19.326217 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/27083247-23eb-44d0-af0a-968f3acc818f-istio-podinfo\") pod \"data-science-gateway-data-science-gateway-class-686dffbf4bpn7ll\" (UID: \"27083247-23eb-44d0-af0a-968f3acc818f\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-686dffbf4bpn7ll" May 21 13:08:19.346187 ip-10-0-133-64 kubenswrapper[2562]: I0521 13:08:19.346163 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/27083247-23eb-44d0-af0a-968f3acc818f-istio-token\") pod \"data-science-gateway-data-science-gateway-class-686dffbf4bpn7ll\" (UID: \"27083247-23eb-44d0-af0a-968f3acc818f\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-686dffbf4bpn7ll" May 21 13:08:19.358124 ip-10-0-133-64 kubenswrapper[2562]: I0521 13:08:19.358092 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-58dbt\" (UniqueName: \"kubernetes.io/projected/27083247-23eb-44d0-af0a-968f3acc818f-kube-api-access-58dbt\") pod \"data-science-gateway-data-science-gateway-class-686dffbf4bpn7ll\" (UID: \"27083247-23eb-44d0-af0a-968f3acc818f\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-686dffbf4bpn7ll" May 21 13:08:19.449627 ip-10-0-133-64 kubenswrapper[2562]: I0521 13:08:19.449523 2562 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-686dffbf4bpn7ll" May 21 13:08:19.595407 ip-10-0-133-64 kubenswrapper[2562]: I0521 13:08:19.595381 2562 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/data-science-gateway-data-science-gateway-class-686dffbf4bpn7ll"] May 21 13:08:19.596940 ip-10-0-133-64 kubenswrapper[2562]: W0521 13:08:19.596911 2562 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod27083247_23eb_44d0_af0a_968f3acc818f.slice/crio-1d5a1acef011812286c255d498a0e8bfa5d1277cd057d895dc3308b518bbee2c WatchSource:0}: Error finding container 1d5a1acef011812286c255d498a0e8bfa5d1277cd057d895dc3308b518bbee2c: Status 404 returned error can't find the container with id 1d5a1acef011812286c255d498a0e8bfa5d1277cd057d895dc3308b518bbee2c May 21 13:08:20.268593 ip-10-0-133-64 kubenswrapper[2562]: I0521 13:08:20.268555 2562 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-686dffbf4bpn7ll" event={"ID":"27083247-23eb-44d0-af0a-968f3acc818f","Type":"ContainerStarted","Data":"1d5a1acef011812286c255d498a0e8bfa5d1277cd057d895dc3308b518bbee2c"} May 21 13:08:22.313783 ip-10-0-133-64 kubenswrapper[2562]: I0521 13:08:22.313734 2562 kubelet_resources.go:45] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"} May 21 13:08:22.314093 ip-10-0-133-64 kubenswrapper[2562]: I0521 13:08:22.313839 2562 kubelet_resources.go:45] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"} May 21 13:08:22.314093 ip-10-0-133-64 kubenswrapper[2562]: I0521 13:08:22.313868 2562 kubelet_resources.go:45] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"} May 21 13:08:23.280928 ip-10-0-133-64 kubenswrapper[2562]: I0521 13:08:23.280891 2562 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-686dffbf4bpn7ll" event={"ID":"27083247-23eb-44d0-af0a-968f3acc818f","Type":"ContainerStarted","Data":"26e32bafaa91cc107260c8b8c1c52f7dd78296fc97205c5b03a5122da6ba905e"} May 21 13:08:23.325832 ip-10-0-133-64 kubenswrapper[2562]: I0521 13:08:23.325731 2562 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-686dffbf4bpn7ll" podStartSLOduration=1.610922564 podStartE2EDuration="4.32571847s" podCreationTimestamp="2026-05-21 13:08:19 +0000 UTC" firstStartedPulling="2026-05-21 13:08:19.59870702 +0000 UTC m=+346.148988365" lastFinishedPulling="2026-05-21 13:08:22.313502909 +0000 UTC m=+348.863784271" observedRunningTime="2026-05-21 13:08:23.321840452 +0000 UTC m=+349.872121821" watchObservedRunningTime="2026-05-21 13:08:23.32571847 +0000 UTC m=+349.875999837" May 21 13:08:23.450604 ip-10-0-133-64 kubenswrapper[2562]: I0521 13:08:23.450565 2562 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-686dffbf4bpn7ll" May 21 13:08:23.455916 ip-10-0-133-64 kubenswrapper[2562]: I0521 13:08:23.455883 2562 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-686dffbf4bpn7ll" May 21 13:08:24.284908 ip-10-0-133-64 kubenswrapper[2562]: I0521 13:08:24.284871 2562 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-686dffbf4bpn7ll" May 21 13:08:24.285737 ip-10-0-133-64 kubenswrapper[2562]: I0521 13:08:24.285714 2562 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-686dffbf4bpn7ll" May 21 13:08:32.617994 ip-10-0-133-64 kubenswrapper[2562]: I0521 13:08:32.617957 2562 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["kuadrant-system/kuadrant-operator-catalog-2xqdk"] May 21 13:08:32.622613 ip-10-0-133-64 kubenswrapper[2562]: I0521 13:08:32.622596 2562 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-catalog-2xqdk" May 21 13:08:32.630073 ip-10-0-133-64 kubenswrapper[2562]: I0521 13:08:32.630050 2562 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"kube-root-ca.crt\"" May 21 13:08:32.630192 ip-10-0-133-64 kubenswrapper[2562]: I0521 13:08:32.630050 2562 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"kuadrant-operator-catalog-dockercfg-9hthh\"" May 21 13:08:32.630192 ip-10-0-133-64 kubenswrapper[2562]: I0521 13:08:32.630090 2562 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"openshift-service-ca.crt\"" May 21 13:08:32.632286 ip-10-0-133-64 kubenswrapper[2562]: I0521 13:08:32.632257 2562 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-catalog-2xqdk"] May 21 13:08:32.733713 ip-10-0-133-64 kubenswrapper[2562]: I0521 13:08:32.733678 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-6k7p4\" (UniqueName: \"kubernetes.io/projected/d279c7a7-a728-4039-b5f9-def45b302430-kube-api-access-6k7p4\") pod \"kuadrant-operator-catalog-2xqdk\" (UID: \"d279c7a7-a728-4039-b5f9-def45b302430\") " pod="kuadrant-system/kuadrant-operator-catalog-2xqdk" May 21 13:08:32.834530 ip-10-0-133-64 kubenswrapper[2562]: I0521 13:08:32.834491 2562 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-6k7p4\" (UniqueName: \"kubernetes.io/projected/d279c7a7-a728-4039-b5f9-def45b302430-kube-api-access-6k7p4\") pod \"kuadrant-operator-catalog-2xqdk\" (UID: \"d279c7a7-a728-4039-b5f9-def45b302430\") " pod="kuadrant-system/kuadrant-operator-catalog-2xqdk" May 21 13:08:32.843104 ip-10-0-133-64 kubenswrapper[2562]: I0521 13:08:32.843075 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-6k7p4\" (UniqueName: \"kubernetes.io/projected/d279c7a7-a728-4039-b5f9-def45b302430-kube-api-access-6k7p4\") pod \"kuadrant-operator-catalog-2xqdk\" (UID: \"d279c7a7-a728-4039-b5f9-def45b302430\") " pod="kuadrant-system/kuadrant-operator-catalog-2xqdk" May 21 13:08:32.916661 ip-10-0-133-64 kubenswrapper[2562]: I0521 13:08:32.916580 2562 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-catalog-2xqdk"] May 21 13:08:32.916863 ip-10-0-133-64 kubenswrapper[2562]: I0521 13:08:32.916850 2562 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-catalog-2xqdk" May 21 13:08:33.056705 ip-10-0-133-64 kubenswrapper[2562]: I0521 13:08:33.056677 2562 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-catalog-2xqdk"] May 21 13:08:33.059534 ip-10-0-133-64 kubenswrapper[2562]: W0521 13:08:33.059506 2562 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podd279c7a7_a728_4039_b5f9_def45b302430.slice/crio-f9791f6cb5380860c361abe62888afeff13c3b38a49df9e25f37015fa0358b63 WatchSource:0}: Error finding container f9791f6cb5380860c361abe62888afeff13c3b38a49df9e25f37015fa0358b63: Status 404 returned error can't find the container with id f9791f6cb5380860c361abe62888afeff13c3b38a49df9e25f37015fa0358b63 May 21 13:08:33.125582 ip-10-0-133-64 kubenswrapper[2562]: I0521 13:08:33.125545 2562 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["kuadrant-system/kuadrant-operator-catalog-mrzdq"] May 21 13:08:33.130133 ip-10-0-133-64 kubenswrapper[2562]: I0521 13:08:33.130116 2562 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-catalog-mrzdq" May 21 13:08:33.135727 ip-10-0-133-64 kubenswrapper[2562]: I0521 13:08:33.135703 2562 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-catalog-mrzdq"] May 21 13:08:33.238924 ip-10-0-133-64 kubenswrapper[2562]: I0521 13:08:33.238890 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-w7rhz\" (UniqueName: \"kubernetes.io/projected/ef214c35-b3ac-4586-a58f-0d451ad51c39-kube-api-access-w7rhz\") pod \"kuadrant-operator-catalog-mrzdq\" (UID: \"ef214c35-b3ac-4586-a58f-0d451ad51c39\") " pod="kuadrant-system/kuadrant-operator-catalog-mrzdq" May 21 13:08:33.316867 ip-10-0-133-64 kubenswrapper[2562]: I0521 13:08:33.316830 2562 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-catalog-2xqdk" event={"ID":"d279c7a7-a728-4039-b5f9-def45b302430","Type":"ContainerStarted","Data":"f9791f6cb5380860c361abe62888afeff13c3b38a49df9e25f37015fa0358b63"} May 21 13:08:33.339959 ip-10-0-133-64 kubenswrapper[2562]: I0521 13:08:33.339918 2562 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-w7rhz\" (UniqueName: \"kubernetes.io/projected/ef214c35-b3ac-4586-a58f-0d451ad51c39-kube-api-access-w7rhz\") pod \"kuadrant-operator-catalog-mrzdq\" (UID: \"ef214c35-b3ac-4586-a58f-0d451ad51c39\") " pod="kuadrant-system/kuadrant-operator-catalog-mrzdq" May 21 13:08:33.348707 ip-10-0-133-64 kubenswrapper[2562]: I0521 13:08:33.348684 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-w7rhz\" (UniqueName: \"kubernetes.io/projected/ef214c35-b3ac-4586-a58f-0d451ad51c39-kube-api-access-w7rhz\") pod \"kuadrant-operator-catalog-mrzdq\" (UID: \"ef214c35-b3ac-4586-a58f-0d451ad51c39\") " pod="kuadrant-system/kuadrant-operator-catalog-mrzdq" May 21 13:08:33.440920 ip-10-0-133-64 kubenswrapper[2562]: I0521 13:08:33.440888 2562 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-catalog-mrzdq" May 21 13:08:33.586226 ip-10-0-133-64 kubenswrapper[2562]: I0521 13:08:33.586201 2562 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-catalog-mrzdq"] May 21 13:08:33.587994 ip-10-0-133-64 kubenswrapper[2562]: W0521 13:08:33.587965 2562 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podef214c35_b3ac_4586_a58f_0d451ad51c39.slice/crio-d5b6787d2c02c72d58abf9a48a883277acaefb85275b5c3c1ed702d0966acc74 WatchSource:0}: Error finding container d5b6787d2c02c72d58abf9a48a883277acaefb85275b5c3c1ed702d0966acc74: Status 404 returned error can't find the container with id d5b6787d2c02c72d58abf9a48a883277acaefb85275b5c3c1ed702d0966acc74 May 21 13:08:34.322208 ip-10-0-133-64 kubenswrapper[2562]: I0521 13:08:34.322170 2562 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-catalog-mrzdq" event={"ID":"ef214c35-b3ac-4586-a58f-0d451ad51c39","Type":"ContainerStarted","Data":"d5b6787d2c02c72d58abf9a48a883277acaefb85275b5c3c1ed702d0966acc74"} May 21 13:08:36.330830 ip-10-0-133-64 kubenswrapper[2562]: I0521 13:08:36.330764 2562 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-catalog-mrzdq" event={"ID":"ef214c35-b3ac-4586-a58f-0d451ad51c39","Type":"ContainerStarted","Data":"9062529b032be04cd4663948d4c021ead1b23e41f7041b47eab0f71e1cce6417"} May 21 13:08:36.332110 ip-10-0-133-64 kubenswrapper[2562]: I0521 13:08:36.332088 2562 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-catalog-2xqdk" event={"ID":"d279c7a7-a728-4039-b5f9-def45b302430","Type":"ContainerStarted","Data":"decd009f028175c7e542fd1c335ef05b33e0f17e1080cb9d8dec19de6c1525ba"} May 21 13:08:36.332209 ip-10-0-133-64 kubenswrapper[2562]: I0521 13:08:36.332186 2562 kuberuntime_container.go:864] "Killing container with a grace period" pod="kuadrant-system/kuadrant-operator-catalog-2xqdk" podUID="d279c7a7-a728-4039-b5f9-def45b302430" containerName="registry-server" containerID="cri-o://decd009f028175c7e542fd1c335ef05b33e0f17e1080cb9d8dec19de6c1525ba" gracePeriod=2 May 21 13:08:36.376651 ip-10-0-133-64 kubenswrapper[2562]: I0521 13:08:36.376603 2562 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="kuadrant-system/kuadrant-operator-catalog-2xqdk" podStartSLOduration=1.735904218 podStartE2EDuration="4.376588438s" podCreationTimestamp="2026-05-21 13:08:32 +0000 UTC" firstStartedPulling="2026-05-21 13:08:33.061065802 +0000 UTC m=+359.611347159" lastFinishedPulling="2026-05-21 13:08:35.701750028 +0000 UTC m=+362.252031379" observedRunningTime="2026-05-21 13:08:36.374518934 +0000 UTC m=+362.924800301" watchObservedRunningTime="2026-05-21 13:08:36.376588438 +0000 UTC m=+362.926869830" May 21 13:08:36.377100 ip-10-0-133-64 kubenswrapper[2562]: I0521 13:08:36.377074 2562 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="kuadrant-system/kuadrant-operator-catalog-mrzdq" podStartSLOduration=1.268393041 podStartE2EDuration="3.377067307s" podCreationTimestamp="2026-05-21 13:08:33 +0000 UTC" firstStartedPulling="2026-05-21 13:08:33.589369925 +0000 UTC m=+360.139651270" lastFinishedPulling="2026-05-21 13:08:35.698044186 +0000 UTC m=+362.248325536" observedRunningTime="2026-05-21 13:08:36.356680817 +0000 UTC m=+362.906962184" watchObservedRunningTime="2026-05-21 13:08:36.377067307 +0000 UTC m=+362.927348675" May 21 13:08:36.571579 ip-10-0-133-64 kubenswrapper[2562]: I0521 13:08:36.571555 2562 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-catalog-2xqdk" May 21 13:08:36.663883 ip-10-0-133-64 kubenswrapper[2562]: I0521 13:08:36.663782 2562 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-6k7p4\" (UniqueName: \"kubernetes.io/projected/d279c7a7-a728-4039-b5f9-def45b302430-kube-api-access-6k7p4\") pod \"d279c7a7-a728-4039-b5f9-def45b302430\" (UID: \"d279c7a7-a728-4039-b5f9-def45b302430\") " May 21 13:08:36.665905 ip-10-0-133-64 kubenswrapper[2562]: I0521 13:08:36.665871 2562 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/d279c7a7-a728-4039-b5f9-def45b302430-kube-api-access-6k7p4" (OuterVolumeSpecName: "kube-api-access-6k7p4") pod "d279c7a7-a728-4039-b5f9-def45b302430" (UID: "d279c7a7-a728-4039-b5f9-def45b302430"). InnerVolumeSpecName "kube-api-access-6k7p4". PluginName "kubernetes.io/projected", VolumeGIDValue "" May 21 13:08:36.764402 ip-10-0-133-64 kubenswrapper[2562]: I0521 13:08:36.764371 2562 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-6k7p4\" (UniqueName: \"kubernetes.io/projected/d279c7a7-a728-4039-b5f9-def45b302430-kube-api-access-6k7p4\") on node \"ip-10-0-133-64.ec2.internal\" DevicePath \"\"" May 21 13:08:37.336785 ip-10-0-133-64 kubenswrapper[2562]: I0521 13:08:37.336751 2562 generic.go:358] "Generic (PLEG): container finished" podID="d279c7a7-a728-4039-b5f9-def45b302430" containerID="decd009f028175c7e542fd1c335ef05b33e0f17e1080cb9d8dec19de6c1525ba" exitCode=0 May 21 13:08:37.337253 ip-10-0-133-64 kubenswrapper[2562]: I0521 13:08:37.336839 2562 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-catalog-2xqdk" May 21 13:08:37.337253 ip-10-0-133-64 kubenswrapper[2562]: I0521 13:08:37.336844 2562 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-catalog-2xqdk" event={"ID":"d279c7a7-a728-4039-b5f9-def45b302430","Type":"ContainerDied","Data":"decd009f028175c7e542fd1c335ef05b33e0f17e1080cb9d8dec19de6c1525ba"} May 21 13:08:37.337253 ip-10-0-133-64 kubenswrapper[2562]: I0521 13:08:37.336894 2562 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-catalog-2xqdk" event={"ID":"d279c7a7-a728-4039-b5f9-def45b302430","Type":"ContainerDied","Data":"f9791f6cb5380860c361abe62888afeff13c3b38a49df9e25f37015fa0358b63"} May 21 13:08:37.337253 ip-10-0-133-64 kubenswrapper[2562]: I0521 13:08:37.336911 2562 scope.go:117] "RemoveContainer" containerID="decd009f028175c7e542fd1c335ef05b33e0f17e1080cb9d8dec19de6c1525ba" May 21 13:08:37.345621 ip-10-0-133-64 kubenswrapper[2562]: I0521 13:08:37.345605 2562 scope.go:117] "RemoveContainer" containerID="decd009f028175c7e542fd1c335ef05b33e0f17e1080cb9d8dec19de6c1525ba" May 21 13:08:37.345878 ip-10-0-133-64 kubenswrapper[2562]: E0521 13:08:37.345861 2562 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"decd009f028175c7e542fd1c335ef05b33e0f17e1080cb9d8dec19de6c1525ba\": container with ID starting with decd009f028175c7e542fd1c335ef05b33e0f17e1080cb9d8dec19de6c1525ba not found: ID does not exist" containerID="decd009f028175c7e542fd1c335ef05b33e0f17e1080cb9d8dec19de6c1525ba" May 21 13:08:37.345941 ip-10-0-133-64 kubenswrapper[2562]: I0521 13:08:37.345885 2562 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"decd009f028175c7e542fd1c335ef05b33e0f17e1080cb9d8dec19de6c1525ba"} err="failed to get container status \"decd009f028175c7e542fd1c335ef05b33e0f17e1080cb9d8dec19de6c1525ba\": rpc error: code = NotFound desc = could not find container \"decd009f028175c7e542fd1c335ef05b33e0f17e1080cb9d8dec19de6c1525ba\": container with ID starting with decd009f028175c7e542fd1c335ef05b33e0f17e1080cb9d8dec19de6c1525ba not found: ID does not exist" May 21 13:08:37.360236 ip-10-0-133-64 kubenswrapper[2562]: I0521 13:08:37.360216 2562 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-catalog-2xqdk"] May 21 13:08:37.363499 ip-10-0-133-64 kubenswrapper[2562]: I0521 13:08:37.363477 2562 kubelet.go:2547] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/kuadrant-operator-catalog-2xqdk"] May 21 13:08:38.037436 ip-10-0-133-64 kubenswrapper[2562]: I0521 13:08:38.037400 2562 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="d279c7a7-a728-4039-b5f9-def45b302430" path="/var/lib/kubelet/pods/d279c7a7-a728-4039-b5f9-def45b302430/volumes" May 21 13:08:43.441673 ip-10-0-133-64 kubenswrapper[2562]: I0521 13:08:43.441619 2562 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/kuadrant-operator-catalog-mrzdq" May 21 13:08:43.441673 ip-10-0-133-64 kubenswrapper[2562]: I0521 13:08:43.441673 2562 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="kuadrant-system/kuadrant-operator-catalog-mrzdq" May 21 13:08:43.463286 ip-10-0-133-64 kubenswrapper[2562]: I0521 13:08:43.463257 2562 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="started" pod="kuadrant-system/kuadrant-operator-catalog-mrzdq" May 21 13:08:44.383269 ip-10-0-133-64 kubenswrapper[2562]: I0521 13:08:44.383233 2562 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/kuadrant-operator-catalog-mrzdq" May 21 13:08:48.359604 ip-10-0-133-64 kubenswrapper[2562]: I0521 13:08:48.359566 2562 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759bcbz5"] May 21 13:08:48.360001 ip-10-0-133-64 kubenswrapper[2562]: I0521 13:08:48.359884 2562 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="d279c7a7-a728-4039-b5f9-def45b302430" containerName="registry-server" May 21 13:08:48.360001 ip-10-0-133-64 kubenswrapper[2562]: I0521 13:08:48.359896 2562 state_mem.go:107] "Deleted CPUSet assignment" podUID="d279c7a7-a728-4039-b5f9-def45b302430" containerName="registry-server" May 21 13:08:48.360001 ip-10-0-133-64 kubenswrapper[2562]: I0521 13:08:48.359955 2562 memory_manager.go:356] "RemoveStaleState removing state" podUID="d279c7a7-a728-4039-b5f9-def45b302430" containerName="registry-server" May 21 13:08:48.364309 ip-10-0-133-64 kubenswrapper[2562]: I0521 13:08:48.364291 2562 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759bcbz5" May 21 13:08:48.366494 ip-10-0-133-64 kubenswrapper[2562]: I0521 13:08:48.366472 2562 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"default-dockercfg-zst48\"" May 21 13:08:48.372308 ip-10-0-133-64 kubenswrapper[2562]: I0521 13:08:48.372283 2562 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759bcbz5"] May 21 13:08:48.444474 ip-10-0-133-64 kubenswrapper[2562]: I0521 13:08:48.444431 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/2bdc7f3e-3a40-4937-96dc-ed8a2489ae62-util\") pod \"0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759bcbz5\" (UID: \"2bdc7f3e-3a40-4937-96dc-ed8a2489ae62\") " pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759bcbz5" May 21 13:08:48.444667 ip-10-0-133-64 kubenswrapper[2562]: I0521 13:08:48.444486 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-dxtzb\" (UniqueName: \"kubernetes.io/projected/2bdc7f3e-3a40-4937-96dc-ed8a2489ae62-kube-api-access-dxtzb\") pod \"0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759bcbz5\" (UID: \"2bdc7f3e-3a40-4937-96dc-ed8a2489ae62\") " pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759bcbz5" May 21 13:08:48.444667 ip-10-0-133-64 kubenswrapper[2562]: I0521 13:08:48.444529 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/2bdc7f3e-3a40-4937-96dc-ed8a2489ae62-bundle\") pod \"0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759bcbz5\" (UID: \"2bdc7f3e-3a40-4937-96dc-ed8a2489ae62\") " pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759bcbz5" May 21 13:08:48.545690 ip-10-0-133-64 kubenswrapper[2562]: I0521 13:08:48.545630 2562 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/2bdc7f3e-3a40-4937-96dc-ed8a2489ae62-util\") pod \"0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759bcbz5\" (UID: \"2bdc7f3e-3a40-4937-96dc-ed8a2489ae62\") " pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759bcbz5" May 21 13:08:48.545690 ip-10-0-133-64 kubenswrapper[2562]: I0521 13:08:48.545693 2562 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-dxtzb\" (UniqueName: \"kubernetes.io/projected/2bdc7f3e-3a40-4937-96dc-ed8a2489ae62-kube-api-access-dxtzb\") pod \"0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759bcbz5\" (UID: \"2bdc7f3e-3a40-4937-96dc-ed8a2489ae62\") " pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759bcbz5" May 21 13:08:48.545987 ip-10-0-133-64 kubenswrapper[2562]: I0521 13:08:48.545754 2562 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/2bdc7f3e-3a40-4937-96dc-ed8a2489ae62-bundle\") pod \"0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759bcbz5\" (UID: \"2bdc7f3e-3a40-4937-96dc-ed8a2489ae62\") " pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759bcbz5" May 21 13:08:48.546194 ip-10-0-133-64 kubenswrapper[2562]: I0521 13:08:48.546161 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/2bdc7f3e-3a40-4937-96dc-ed8a2489ae62-util\") pod \"0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759bcbz5\" (UID: \"2bdc7f3e-3a40-4937-96dc-ed8a2489ae62\") " pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759bcbz5" May 21 13:08:48.546231 ip-10-0-133-64 kubenswrapper[2562]: I0521 13:08:48.546182 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/2bdc7f3e-3a40-4937-96dc-ed8a2489ae62-bundle\") pod \"0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759bcbz5\" (UID: \"2bdc7f3e-3a40-4937-96dc-ed8a2489ae62\") " pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759bcbz5" May 21 13:08:48.555102 ip-10-0-133-64 kubenswrapper[2562]: I0521 13:08:48.555081 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-dxtzb\" (UniqueName: \"kubernetes.io/projected/2bdc7f3e-3a40-4937-96dc-ed8a2489ae62-kube-api-access-dxtzb\") pod \"0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759bcbz5\" (UID: \"2bdc7f3e-3a40-4937-96dc-ed8a2489ae62\") " pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759bcbz5" May 21 13:08:48.674056 ip-10-0-133-64 kubenswrapper[2562]: I0521 13:08:48.673970 2562 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759bcbz5" May 21 13:08:48.806073 ip-10-0-133-64 kubenswrapper[2562]: I0521 13:08:48.804065 2562 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759bcbz5"] May 21 13:08:49.163082 ip-10-0-133-64 kubenswrapper[2562]: I0521 13:08:49.163040 2562 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0clz5h"] May 21 13:08:49.166388 ip-10-0-133-64 kubenswrapper[2562]: I0521 13:08:49.166365 2562 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0clz5h" May 21 13:08:49.176026 ip-10-0-133-64 kubenswrapper[2562]: I0521 13:08:49.176001 2562 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0clz5h"] May 21 13:08:49.251992 ip-10-0-133-64 kubenswrapper[2562]: I0521 13:08:49.251960 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/2fc1736c-ed52-4066-a27d-7e173c172d02-util\") pod \"19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0clz5h\" (UID: \"2fc1736c-ed52-4066-a27d-7e173c172d02\") " pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0clz5h" May 21 13:08:49.251992 ip-10-0-133-64 kubenswrapper[2562]: I0521 13:08:49.252004 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-dhwpv\" (UniqueName: \"kubernetes.io/projected/2fc1736c-ed52-4066-a27d-7e173c172d02-kube-api-access-dhwpv\") pod \"19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0clz5h\" (UID: \"2fc1736c-ed52-4066-a27d-7e173c172d02\") " pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0clz5h" May 21 13:08:49.252247 ip-10-0-133-64 kubenswrapper[2562]: I0521 13:08:49.252140 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/2fc1736c-ed52-4066-a27d-7e173c172d02-bundle\") pod \"19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0clz5h\" (UID: \"2fc1736c-ed52-4066-a27d-7e173c172d02\") " pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0clz5h" May 21 13:08:49.353174 ip-10-0-133-64 kubenswrapper[2562]: I0521 13:08:49.353131 2562 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/2fc1736c-ed52-4066-a27d-7e173c172d02-util\") pod \"19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0clz5h\" (UID: \"2fc1736c-ed52-4066-a27d-7e173c172d02\") " pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0clz5h" May 21 13:08:49.353353 ip-10-0-133-64 kubenswrapper[2562]: I0521 13:08:49.353183 2562 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-dhwpv\" (UniqueName: \"kubernetes.io/projected/2fc1736c-ed52-4066-a27d-7e173c172d02-kube-api-access-dhwpv\") pod \"19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0clz5h\" (UID: \"2fc1736c-ed52-4066-a27d-7e173c172d02\") " pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0clz5h" May 21 13:08:49.353353 ip-10-0-133-64 kubenswrapper[2562]: I0521 13:08:49.353228 2562 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/2fc1736c-ed52-4066-a27d-7e173c172d02-bundle\") pod \"19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0clz5h\" (UID: \"2fc1736c-ed52-4066-a27d-7e173c172d02\") " pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0clz5h" May 21 13:08:49.353586 ip-10-0-133-64 kubenswrapper[2562]: I0521 13:08:49.353564 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/2fc1736c-ed52-4066-a27d-7e173c172d02-util\") pod \"19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0clz5h\" (UID: \"2fc1736c-ed52-4066-a27d-7e173c172d02\") " pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0clz5h" May 21 13:08:49.353625 ip-10-0-133-64 kubenswrapper[2562]: I0521 13:08:49.353605 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/2fc1736c-ed52-4066-a27d-7e173c172d02-bundle\") pod \"19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0clz5h\" (UID: \"2fc1736c-ed52-4066-a27d-7e173c172d02\") " pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0clz5h" May 21 13:08:49.362008 ip-10-0-133-64 kubenswrapper[2562]: I0521 13:08:49.361981 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-dhwpv\" (UniqueName: \"kubernetes.io/projected/2fc1736c-ed52-4066-a27d-7e173c172d02-kube-api-access-dhwpv\") pod \"19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0clz5h\" (UID: \"2fc1736c-ed52-4066-a27d-7e173c172d02\") " pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0clz5h" May 21 13:08:49.380759 ip-10-0-133-64 kubenswrapper[2562]: I0521 13:08:49.380726 2562 generic.go:358] "Generic (PLEG): container finished" podID="2bdc7f3e-3a40-4937-96dc-ed8a2489ae62" containerID="a145b4c160268d85e6b7340cba3041ec0e8b93cec3dea90186846e1eb2de4212" exitCode=0 May 21 13:08:49.380900 ip-10-0-133-64 kubenswrapper[2562]: I0521 13:08:49.380782 2562 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759bcbz5" event={"ID":"2bdc7f3e-3a40-4937-96dc-ed8a2489ae62","Type":"ContainerDied","Data":"a145b4c160268d85e6b7340cba3041ec0e8b93cec3dea90186846e1eb2de4212"} May 21 13:08:49.380900 ip-10-0-133-64 kubenswrapper[2562]: I0521 13:08:49.380828 2562 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759bcbz5" event={"ID":"2bdc7f3e-3a40-4937-96dc-ed8a2489ae62","Type":"ContainerStarted","Data":"fd8b4e43db7b1532f2dfd11b6a471671eef5c7a79ffe6f52d32e95efce925f48"} May 21 13:08:49.475575 ip-10-0-133-64 kubenswrapper[2562]: I0521 13:08:49.475549 2562 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0clz5h" May 21 13:08:49.566129 ip-10-0-133-64 kubenswrapper[2562]: I0521 13:08:49.563601 2562 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73tbnj8"] May 21 13:08:49.569074 ip-10-0-133-64 kubenswrapper[2562]: I0521 13:08:49.569049 2562 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73tbnj8" May 21 13:08:49.575437 ip-10-0-133-64 kubenswrapper[2562]: I0521 13:08:49.575229 2562 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73tbnj8"] May 21 13:08:49.606456 ip-10-0-133-64 kubenswrapper[2562]: I0521 13:08:49.606434 2562 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0clz5h"] May 21 13:08:49.607675 ip-10-0-133-64 kubenswrapper[2562]: W0521 13:08:49.607643 2562 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod2fc1736c_ed52_4066_a27d_7e173c172d02.slice/crio-f8c6634ebbc61adc93d4d16c994d734c201f975418304b57e0c1900e37e7229a WatchSource:0}: Error finding container f8c6634ebbc61adc93d4d16c994d734c201f975418304b57e0c1900e37e7229a: Status 404 returned error can't find the container with id f8c6634ebbc61adc93d4d16c994d734c201f975418304b57e0c1900e37e7229a May 21 13:08:49.655593 ip-10-0-133-64 kubenswrapper[2562]: I0521 13:08:49.655566 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/db0f3c7e-935f-41fc-832f-8d7bf067568b-util\") pod \"5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73tbnj8\" (UID: \"db0f3c7e-935f-41fc-832f-8d7bf067568b\") " pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73tbnj8" May 21 13:08:49.655709 ip-10-0-133-64 kubenswrapper[2562]: I0521 13:08:49.655615 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/db0f3c7e-935f-41fc-832f-8d7bf067568b-bundle\") pod \"5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73tbnj8\" (UID: \"db0f3c7e-935f-41fc-832f-8d7bf067568b\") " pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73tbnj8" May 21 13:08:49.655767 ip-10-0-133-64 kubenswrapper[2562]: I0521 13:08:49.655713 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-4l95w\" (UniqueName: \"kubernetes.io/projected/db0f3c7e-935f-41fc-832f-8d7bf067568b-kube-api-access-4l95w\") pod \"5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73tbnj8\" (UID: \"db0f3c7e-935f-41fc-832f-8d7bf067568b\") " pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73tbnj8" May 21 13:08:49.756911 ip-10-0-133-64 kubenswrapper[2562]: I0521 13:08:49.756825 2562 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-4l95w\" (UniqueName: \"kubernetes.io/projected/db0f3c7e-935f-41fc-832f-8d7bf067568b-kube-api-access-4l95w\") pod \"5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73tbnj8\" (UID: \"db0f3c7e-935f-41fc-832f-8d7bf067568b\") " pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73tbnj8" May 21 13:08:49.757053 ip-10-0-133-64 kubenswrapper[2562]: I0521 13:08:49.756930 2562 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/db0f3c7e-935f-41fc-832f-8d7bf067568b-util\") pod \"5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73tbnj8\" (UID: \"db0f3c7e-935f-41fc-832f-8d7bf067568b\") " pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73tbnj8" May 21 13:08:49.757053 ip-10-0-133-64 kubenswrapper[2562]: I0521 13:08:49.756972 2562 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/db0f3c7e-935f-41fc-832f-8d7bf067568b-bundle\") pod \"5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73tbnj8\" (UID: \"db0f3c7e-935f-41fc-832f-8d7bf067568b\") " pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73tbnj8" May 21 13:08:49.757281 ip-10-0-133-64 kubenswrapper[2562]: I0521 13:08:49.757261 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/db0f3c7e-935f-41fc-832f-8d7bf067568b-util\") pod \"5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73tbnj8\" (UID: \"db0f3c7e-935f-41fc-832f-8d7bf067568b\") " pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73tbnj8" May 21 13:08:49.757320 ip-10-0-133-64 kubenswrapper[2562]: I0521 13:08:49.757290 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/db0f3c7e-935f-41fc-832f-8d7bf067568b-bundle\") pod \"5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73tbnj8\" (UID: \"db0f3c7e-935f-41fc-832f-8d7bf067568b\") " pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73tbnj8" May 21 13:08:49.765484 ip-10-0-133-64 kubenswrapper[2562]: I0521 13:08:49.765461 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-4l95w\" (UniqueName: \"kubernetes.io/projected/db0f3c7e-935f-41fc-832f-8d7bf067568b-kube-api-access-4l95w\") pod \"5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73tbnj8\" (UID: \"db0f3c7e-935f-41fc-832f-8d7bf067568b\") " pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73tbnj8" May 21 13:08:49.881565 ip-10-0-133-64 kubenswrapper[2562]: I0521 13:08:49.881526 2562 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73tbnj8" May 21 13:08:49.963673 ip-10-0-133-64 kubenswrapper[2562]: I0521 13:08:49.963627 2562 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1bzd6s"] May 21 13:08:49.968708 ip-10-0-133-64 kubenswrapper[2562]: I0521 13:08:49.968260 2562 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1bzd6s" May 21 13:08:49.976030 ip-10-0-133-64 kubenswrapper[2562]: I0521 13:08:49.975986 2562 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1bzd6s"] May 21 13:08:50.022966 ip-10-0-133-64 kubenswrapper[2562]: I0521 13:08:50.022936 2562 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73tbnj8"] May 21 13:08:50.052275 ip-10-0-133-64 kubenswrapper[2562]: W0521 13:08:50.052243 2562 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poddb0f3c7e_935f_41fc_832f_8d7bf067568b.slice/crio-6b70ef9b8e8ac8dbcf868a14c115797a41725a05f99003cf77bcf548b40a43f1 WatchSource:0}: Error finding container 6b70ef9b8e8ac8dbcf868a14c115797a41725a05f99003cf77bcf548b40a43f1: Status 404 returned error can't find the container with id 6b70ef9b8e8ac8dbcf868a14c115797a41725a05f99003cf77bcf548b40a43f1 May 21 13:08:50.060515 ip-10-0-133-64 kubenswrapper[2562]: I0521 13:08:50.060480 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/f1bd4d97-469b-4d98-aabd-8a5780c68c63-bundle\") pod \"9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1bzd6s\" (UID: \"f1bd4d97-469b-4d98-aabd-8a5780c68c63\") " pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1bzd6s" May 21 13:08:50.060633 ip-10-0-133-64 kubenswrapper[2562]: I0521 13:08:50.060581 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/f1bd4d97-469b-4d98-aabd-8a5780c68c63-util\") pod \"9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1bzd6s\" (UID: \"f1bd4d97-469b-4d98-aabd-8a5780c68c63\") " pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1bzd6s" May 21 13:08:50.060673 ip-10-0-133-64 kubenswrapper[2562]: I0521 13:08:50.060649 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-jssm6\" (UniqueName: \"kubernetes.io/projected/f1bd4d97-469b-4d98-aabd-8a5780c68c63-kube-api-access-jssm6\") pod \"9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1bzd6s\" (UID: \"f1bd4d97-469b-4d98-aabd-8a5780c68c63\") " pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1bzd6s" May 21 13:08:50.161046 ip-10-0-133-64 kubenswrapper[2562]: I0521 13:08:50.161017 2562 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/f1bd4d97-469b-4d98-aabd-8a5780c68c63-util\") pod \"9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1bzd6s\" (UID: \"f1bd4d97-469b-4d98-aabd-8a5780c68c63\") " pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1bzd6s" May 21 13:08:50.161154 ip-10-0-133-64 kubenswrapper[2562]: I0521 13:08:50.161080 2562 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-jssm6\" (UniqueName: \"kubernetes.io/projected/f1bd4d97-469b-4d98-aabd-8a5780c68c63-kube-api-access-jssm6\") pod \"9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1bzd6s\" (UID: \"f1bd4d97-469b-4d98-aabd-8a5780c68c63\") " pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1bzd6s" May 21 13:08:50.161218 ip-10-0-133-64 kubenswrapper[2562]: I0521 13:08:50.161184 2562 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/f1bd4d97-469b-4d98-aabd-8a5780c68c63-bundle\") pod \"9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1bzd6s\" (UID: \"f1bd4d97-469b-4d98-aabd-8a5780c68c63\") " pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1bzd6s" May 21 13:08:50.161382 ip-10-0-133-64 kubenswrapper[2562]: I0521 13:08:50.161360 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/f1bd4d97-469b-4d98-aabd-8a5780c68c63-util\") pod \"9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1bzd6s\" (UID: \"f1bd4d97-469b-4d98-aabd-8a5780c68c63\") " pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1bzd6s" May 21 13:08:50.161439 ip-10-0-133-64 kubenswrapper[2562]: I0521 13:08:50.161426 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/f1bd4d97-469b-4d98-aabd-8a5780c68c63-bundle\") pod \"9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1bzd6s\" (UID: \"f1bd4d97-469b-4d98-aabd-8a5780c68c63\") " pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1bzd6s" May 21 13:08:50.168940 ip-10-0-133-64 kubenswrapper[2562]: I0521 13:08:50.168912 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-jssm6\" (UniqueName: \"kubernetes.io/projected/f1bd4d97-469b-4d98-aabd-8a5780c68c63-kube-api-access-jssm6\") pod \"9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1bzd6s\" (UID: \"f1bd4d97-469b-4d98-aabd-8a5780c68c63\") " pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1bzd6s" May 21 13:08:50.283196 ip-10-0-133-64 kubenswrapper[2562]: I0521 13:08:50.283106 2562 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1bzd6s" May 21 13:08:50.387627 ip-10-0-133-64 kubenswrapper[2562]: I0521 13:08:50.387594 2562 generic.go:358] "Generic (PLEG): container finished" podID="2fc1736c-ed52-4066-a27d-7e173c172d02" containerID="9487cdd91cabc53dfe6a980699af33e387e4dba2812e6c08e42bd3575ea7ee9f" exitCode=0 May 21 13:08:50.388084 ip-10-0-133-64 kubenswrapper[2562]: I0521 13:08:50.387674 2562 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0clz5h" event={"ID":"2fc1736c-ed52-4066-a27d-7e173c172d02","Type":"ContainerDied","Data":"9487cdd91cabc53dfe6a980699af33e387e4dba2812e6c08e42bd3575ea7ee9f"} May 21 13:08:50.388084 ip-10-0-133-64 kubenswrapper[2562]: I0521 13:08:50.387706 2562 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0clz5h" event={"ID":"2fc1736c-ed52-4066-a27d-7e173c172d02","Type":"ContainerStarted","Data":"f8c6634ebbc61adc93d4d16c994d734c201f975418304b57e0c1900e37e7229a"} May 21 13:08:50.389150 ip-10-0-133-64 kubenswrapper[2562]: I0521 13:08:50.389125 2562 generic.go:358] "Generic (PLEG): container finished" podID="db0f3c7e-935f-41fc-832f-8d7bf067568b" containerID="cf97b47185880fb6ba50f2022f17e0c4dd8693c9a95766e30bc1e498a8bb4d95" exitCode=0 May 21 13:08:50.389268 ip-10-0-133-64 kubenswrapper[2562]: I0521 13:08:50.389212 2562 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73tbnj8" event={"ID":"db0f3c7e-935f-41fc-832f-8d7bf067568b","Type":"ContainerDied","Data":"cf97b47185880fb6ba50f2022f17e0c4dd8693c9a95766e30bc1e498a8bb4d95"} May 21 13:08:50.389268 ip-10-0-133-64 kubenswrapper[2562]: I0521 13:08:50.389237 2562 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73tbnj8" event={"ID":"db0f3c7e-935f-41fc-832f-8d7bf067568b","Type":"ContainerStarted","Data":"6b70ef9b8e8ac8dbcf868a14c115797a41725a05f99003cf77bcf548b40a43f1"} May 21 13:08:50.391268 ip-10-0-133-64 kubenswrapper[2562]: I0521 13:08:50.391242 2562 generic.go:358] "Generic (PLEG): container finished" podID="2bdc7f3e-3a40-4937-96dc-ed8a2489ae62" containerID="0eb278e6782a05883dab67925126c33208a4f863a40bf431d85d9f68dd909055" exitCode=0 May 21 13:08:50.391397 ip-10-0-133-64 kubenswrapper[2562]: I0521 13:08:50.391337 2562 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759bcbz5" event={"ID":"2bdc7f3e-3a40-4937-96dc-ed8a2489ae62","Type":"ContainerDied","Data":"0eb278e6782a05883dab67925126c33208a4f863a40bf431d85d9f68dd909055"} May 21 13:08:50.414753 ip-10-0-133-64 kubenswrapper[2562]: I0521 13:08:50.414728 2562 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1bzd6s"] May 21 13:08:50.422938 ip-10-0-133-64 kubenswrapper[2562]: W0521 13:08:50.422901 2562 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podf1bd4d97_469b_4d98_aabd_8a5780c68c63.slice/crio-e1188b381d4e075bd3f0ea5f4102933cd38558b65939e817ed1ad80d2fd462e3 WatchSource:0}: Error finding container e1188b381d4e075bd3f0ea5f4102933cd38558b65939e817ed1ad80d2fd462e3: Status 404 returned error can't find the container with id e1188b381d4e075bd3f0ea5f4102933cd38558b65939e817ed1ad80d2fd462e3 May 21 13:08:51.399577 ip-10-0-133-64 kubenswrapper[2562]: I0521 13:08:51.399489 2562 generic.go:358] "Generic (PLEG): container finished" podID="2bdc7f3e-3a40-4937-96dc-ed8a2489ae62" containerID="c967606b1d66b15010fdeae61115e71e74e372b9d9d20ddeb5d6b0814ee68cf0" exitCode=0 May 21 13:08:51.399982 ip-10-0-133-64 kubenswrapper[2562]: I0521 13:08:51.399568 2562 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759bcbz5" event={"ID":"2bdc7f3e-3a40-4937-96dc-ed8a2489ae62","Type":"ContainerDied","Data":"c967606b1d66b15010fdeae61115e71e74e372b9d9d20ddeb5d6b0814ee68cf0"} May 21 13:08:51.401192 ip-10-0-133-64 kubenswrapper[2562]: I0521 13:08:51.401174 2562 generic.go:358] "Generic (PLEG): container finished" podID="2fc1736c-ed52-4066-a27d-7e173c172d02" containerID="d30ac0c2e0d3cfe38d1c6adb8474359bc8ca5646bed983fd9761eac8c2766f34" exitCode=0 May 21 13:08:51.401286 ip-10-0-133-64 kubenswrapper[2562]: I0521 13:08:51.401256 2562 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0clz5h" event={"ID":"2fc1736c-ed52-4066-a27d-7e173c172d02","Type":"ContainerDied","Data":"d30ac0c2e0d3cfe38d1c6adb8474359bc8ca5646bed983fd9761eac8c2766f34"} May 21 13:08:51.402488 ip-10-0-133-64 kubenswrapper[2562]: I0521 13:08:51.402469 2562 generic.go:358] "Generic (PLEG): container finished" podID="f1bd4d97-469b-4d98-aabd-8a5780c68c63" containerID="fb59e7c79f918527d360e4548d9b310b1d3da907a71feeb61edfbfc03e6bcb45" exitCode=0 May 21 13:08:51.402592 ip-10-0-133-64 kubenswrapper[2562]: I0521 13:08:51.402552 2562 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1bzd6s" event={"ID":"f1bd4d97-469b-4d98-aabd-8a5780c68c63","Type":"ContainerDied","Data":"fb59e7c79f918527d360e4548d9b310b1d3da907a71feeb61edfbfc03e6bcb45"} May 21 13:08:51.402650 ip-10-0-133-64 kubenswrapper[2562]: I0521 13:08:51.402588 2562 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1bzd6s" event={"ID":"f1bd4d97-469b-4d98-aabd-8a5780c68c63","Type":"ContainerStarted","Data":"e1188b381d4e075bd3f0ea5f4102933cd38558b65939e817ed1ad80d2fd462e3"} May 21 13:08:51.404326 ip-10-0-133-64 kubenswrapper[2562]: I0521 13:08:51.404308 2562 generic.go:358] "Generic (PLEG): container finished" podID="db0f3c7e-935f-41fc-832f-8d7bf067568b" containerID="b21d2a94dbde81374c312717820478a7bd5de4d86a4ac67bf31367213f17a819" exitCode=0 May 21 13:08:51.404411 ip-10-0-133-64 kubenswrapper[2562]: I0521 13:08:51.404341 2562 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73tbnj8" event={"ID":"db0f3c7e-935f-41fc-832f-8d7bf067568b","Type":"ContainerDied","Data":"b21d2a94dbde81374c312717820478a7bd5de4d86a4ac67bf31367213f17a819"} May 21 13:08:52.410911 ip-10-0-133-64 kubenswrapper[2562]: I0521 13:08:52.410868 2562 generic.go:358] "Generic (PLEG): container finished" podID="2fc1736c-ed52-4066-a27d-7e173c172d02" containerID="d25023ff80825a863142a4a751cf9bafae6c2fea5123ddd7e3bfdb82f2826320" exitCode=0 May 21 13:08:52.411292 ip-10-0-133-64 kubenswrapper[2562]: I0521 13:08:52.410927 2562 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0clz5h" event={"ID":"2fc1736c-ed52-4066-a27d-7e173c172d02","Type":"ContainerDied","Data":"d25023ff80825a863142a4a751cf9bafae6c2fea5123ddd7e3bfdb82f2826320"} May 21 13:08:52.412425 ip-10-0-133-64 kubenswrapper[2562]: I0521 13:08:52.412405 2562 generic.go:358] "Generic (PLEG): container finished" podID="f1bd4d97-469b-4d98-aabd-8a5780c68c63" containerID="ebb9a7fc9b75b90e4d34c17faf93a4d0ca43f94aa51dfbbf7324724cf9690f3b" exitCode=0 May 21 13:08:52.412530 ip-10-0-133-64 kubenswrapper[2562]: I0521 13:08:52.412482 2562 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1bzd6s" event={"ID":"f1bd4d97-469b-4d98-aabd-8a5780c68c63","Type":"ContainerDied","Data":"ebb9a7fc9b75b90e4d34c17faf93a4d0ca43f94aa51dfbbf7324724cf9690f3b"} May 21 13:08:52.414455 ip-10-0-133-64 kubenswrapper[2562]: I0521 13:08:52.414431 2562 generic.go:358] "Generic (PLEG): container finished" podID="db0f3c7e-935f-41fc-832f-8d7bf067568b" containerID="e6023321fbf6ab070e2d8ce0caf248e3e2bab21cd1935236daf6efaa0b136874" exitCode=0 May 21 13:08:52.414533 ip-10-0-133-64 kubenswrapper[2562]: I0521 13:08:52.414461 2562 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73tbnj8" event={"ID":"db0f3c7e-935f-41fc-832f-8d7bf067568b","Type":"ContainerDied","Data":"e6023321fbf6ab070e2d8ce0caf248e3e2bab21cd1935236daf6efaa0b136874"} May 21 13:08:52.545127 ip-10-0-133-64 kubenswrapper[2562]: I0521 13:08:52.545104 2562 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759bcbz5" May 21 13:08:52.582866 ip-10-0-133-64 kubenswrapper[2562]: I0521 13:08:52.582824 2562 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/2bdc7f3e-3a40-4937-96dc-ed8a2489ae62-bundle\") pod \"2bdc7f3e-3a40-4937-96dc-ed8a2489ae62\" (UID: \"2bdc7f3e-3a40-4937-96dc-ed8a2489ae62\") " May 21 13:08:52.583050 ip-10-0-133-64 kubenswrapper[2562]: I0521 13:08:52.582915 2562 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/2bdc7f3e-3a40-4937-96dc-ed8a2489ae62-util\") pod \"2bdc7f3e-3a40-4937-96dc-ed8a2489ae62\" (UID: \"2bdc7f3e-3a40-4937-96dc-ed8a2489ae62\") " May 21 13:08:52.583050 ip-10-0-133-64 kubenswrapper[2562]: I0521 13:08:52.582948 2562 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-dxtzb\" (UniqueName: \"kubernetes.io/projected/2bdc7f3e-3a40-4937-96dc-ed8a2489ae62-kube-api-access-dxtzb\") pod \"2bdc7f3e-3a40-4937-96dc-ed8a2489ae62\" (UID: \"2bdc7f3e-3a40-4937-96dc-ed8a2489ae62\") " May 21 13:08:52.583301 ip-10-0-133-64 kubenswrapper[2562]: I0521 13:08:52.583273 2562 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/2bdc7f3e-3a40-4937-96dc-ed8a2489ae62-bundle" (OuterVolumeSpecName: "bundle") pod "2bdc7f3e-3a40-4937-96dc-ed8a2489ae62" (UID: "2bdc7f3e-3a40-4937-96dc-ed8a2489ae62"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" May 21 13:08:52.585068 ip-10-0-133-64 kubenswrapper[2562]: I0521 13:08:52.585042 2562 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/2bdc7f3e-3a40-4937-96dc-ed8a2489ae62-kube-api-access-dxtzb" (OuterVolumeSpecName: "kube-api-access-dxtzb") pod "2bdc7f3e-3a40-4937-96dc-ed8a2489ae62" (UID: "2bdc7f3e-3a40-4937-96dc-ed8a2489ae62"). InnerVolumeSpecName "kube-api-access-dxtzb". PluginName "kubernetes.io/projected", VolumeGIDValue "" May 21 13:08:52.588992 ip-10-0-133-64 kubenswrapper[2562]: I0521 13:08:52.588959 2562 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/2bdc7f3e-3a40-4937-96dc-ed8a2489ae62-util" (OuterVolumeSpecName: "util") pod "2bdc7f3e-3a40-4937-96dc-ed8a2489ae62" (UID: "2bdc7f3e-3a40-4937-96dc-ed8a2489ae62"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" May 21 13:08:52.684235 ip-10-0-133-64 kubenswrapper[2562]: I0521 13:08:52.684202 2562 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/2bdc7f3e-3a40-4937-96dc-ed8a2489ae62-bundle\") on node \"ip-10-0-133-64.ec2.internal\" DevicePath \"\"" May 21 13:08:52.684235 ip-10-0-133-64 kubenswrapper[2562]: I0521 13:08:52.684229 2562 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/2bdc7f3e-3a40-4937-96dc-ed8a2489ae62-util\") on node \"ip-10-0-133-64.ec2.internal\" DevicePath \"\"" May 21 13:08:52.684235 ip-10-0-133-64 kubenswrapper[2562]: I0521 13:08:52.684238 2562 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-dxtzb\" (UniqueName: \"kubernetes.io/projected/2bdc7f3e-3a40-4937-96dc-ed8a2489ae62-kube-api-access-dxtzb\") on node \"ip-10-0-133-64.ec2.internal\" DevicePath \"\"" May 21 13:08:53.419815 ip-10-0-133-64 kubenswrapper[2562]: I0521 13:08:53.419769 2562 generic.go:358] "Generic (PLEG): container finished" podID="f1bd4d97-469b-4d98-aabd-8a5780c68c63" containerID="bbf4b1f3120f1f608d5a86ca6ebfccbb4a4239197770089a6b0d05c0629cf817" exitCode=0 May 21 13:08:53.420215 ip-10-0-133-64 kubenswrapper[2562]: I0521 13:08:53.419836 2562 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1bzd6s" event={"ID":"f1bd4d97-469b-4d98-aabd-8a5780c68c63","Type":"ContainerDied","Data":"bbf4b1f3120f1f608d5a86ca6ebfccbb4a4239197770089a6b0d05c0629cf817"} May 21 13:08:53.421648 ip-10-0-133-64 kubenswrapper[2562]: I0521 13:08:53.421629 2562 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759bcbz5" May 21 13:08:53.421730 ip-10-0-133-64 kubenswrapper[2562]: I0521 13:08:53.421649 2562 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759bcbz5" event={"ID":"2bdc7f3e-3a40-4937-96dc-ed8a2489ae62","Type":"ContainerDied","Data":"fd8b4e43db7b1532f2dfd11b6a471671eef5c7a79ffe6f52d32e95efce925f48"} May 21 13:08:53.421730 ip-10-0-133-64 kubenswrapper[2562]: I0521 13:08:53.421677 2562 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="fd8b4e43db7b1532f2dfd11b6a471671eef5c7a79ffe6f52d32e95efce925f48" May 21 13:08:53.586204 ip-10-0-133-64 kubenswrapper[2562]: I0521 13:08:53.586174 2562 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73tbnj8" May 21 13:08:53.589164 ip-10-0-133-64 kubenswrapper[2562]: I0521 13:08:53.589147 2562 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0clz5h" May 21 13:08:53.691579 ip-10-0-133-64 kubenswrapper[2562]: I0521 13:08:53.691490 2562 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/2fc1736c-ed52-4066-a27d-7e173c172d02-bundle\") pod \"2fc1736c-ed52-4066-a27d-7e173c172d02\" (UID: \"2fc1736c-ed52-4066-a27d-7e173c172d02\") " May 21 13:08:53.691579 ip-10-0-133-64 kubenswrapper[2562]: I0521 13:08:53.691539 2562 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/db0f3c7e-935f-41fc-832f-8d7bf067568b-bundle\") pod \"db0f3c7e-935f-41fc-832f-8d7bf067568b\" (UID: \"db0f3c7e-935f-41fc-832f-8d7bf067568b\") " May 21 13:08:53.691579 ip-10-0-133-64 kubenswrapper[2562]: I0521 13:08:53.691570 2562 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/db0f3c7e-935f-41fc-832f-8d7bf067568b-util\") pod \"db0f3c7e-935f-41fc-832f-8d7bf067568b\" (UID: \"db0f3c7e-935f-41fc-832f-8d7bf067568b\") " May 21 13:08:53.691888 ip-10-0-133-64 kubenswrapper[2562]: I0521 13:08:53.691591 2562 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-4l95w\" (UniqueName: \"kubernetes.io/projected/db0f3c7e-935f-41fc-832f-8d7bf067568b-kube-api-access-4l95w\") pod \"db0f3c7e-935f-41fc-832f-8d7bf067568b\" (UID: \"db0f3c7e-935f-41fc-832f-8d7bf067568b\") " May 21 13:08:53.691888 ip-10-0-133-64 kubenswrapper[2562]: I0521 13:08:53.691623 2562 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-dhwpv\" (UniqueName: \"kubernetes.io/projected/2fc1736c-ed52-4066-a27d-7e173c172d02-kube-api-access-dhwpv\") pod \"2fc1736c-ed52-4066-a27d-7e173c172d02\" (UID: \"2fc1736c-ed52-4066-a27d-7e173c172d02\") " May 21 13:08:53.691888 ip-10-0-133-64 kubenswrapper[2562]: I0521 13:08:53.691651 2562 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/2fc1736c-ed52-4066-a27d-7e173c172d02-util\") pod \"2fc1736c-ed52-4066-a27d-7e173c172d02\" (UID: \"2fc1736c-ed52-4066-a27d-7e173c172d02\") " May 21 13:08:53.692171 ip-10-0-133-64 kubenswrapper[2562]: I0521 13:08:53.692144 2562 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/2fc1736c-ed52-4066-a27d-7e173c172d02-bundle" (OuterVolumeSpecName: "bundle") pod "2fc1736c-ed52-4066-a27d-7e173c172d02" (UID: "2fc1736c-ed52-4066-a27d-7e173c172d02"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" May 21 13:08:53.692361 ip-10-0-133-64 kubenswrapper[2562]: I0521 13:08:53.692335 2562 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/db0f3c7e-935f-41fc-832f-8d7bf067568b-bundle" (OuterVolumeSpecName: "bundle") pod "db0f3c7e-935f-41fc-832f-8d7bf067568b" (UID: "db0f3c7e-935f-41fc-832f-8d7bf067568b"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" May 21 13:08:53.694334 ip-10-0-133-64 kubenswrapper[2562]: I0521 13:08:53.694312 2562 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/2fc1736c-ed52-4066-a27d-7e173c172d02-kube-api-access-dhwpv" (OuterVolumeSpecName: "kube-api-access-dhwpv") pod "2fc1736c-ed52-4066-a27d-7e173c172d02" (UID: "2fc1736c-ed52-4066-a27d-7e173c172d02"). InnerVolumeSpecName "kube-api-access-dhwpv". PluginName "kubernetes.io/projected", VolumeGIDValue "" May 21 13:08:53.694334 ip-10-0-133-64 kubenswrapper[2562]: I0521 13:08:53.694322 2562 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/db0f3c7e-935f-41fc-832f-8d7bf067568b-kube-api-access-4l95w" (OuterVolumeSpecName: "kube-api-access-4l95w") pod "db0f3c7e-935f-41fc-832f-8d7bf067568b" (UID: "db0f3c7e-935f-41fc-832f-8d7bf067568b"). InnerVolumeSpecName "kube-api-access-4l95w". PluginName "kubernetes.io/projected", VolumeGIDValue "" May 21 13:08:53.697214 ip-10-0-133-64 kubenswrapper[2562]: I0521 13:08:53.697186 2562 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/2fc1736c-ed52-4066-a27d-7e173c172d02-util" (OuterVolumeSpecName: "util") pod "2fc1736c-ed52-4066-a27d-7e173c172d02" (UID: "2fc1736c-ed52-4066-a27d-7e173c172d02"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" May 21 13:08:53.697621 ip-10-0-133-64 kubenswrapper[2562]: I0521 13:08:53.697603 2562 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/db0f3c7e-935f-41fc-832f-8d7bf067568b-util" (OuterVolumeSpecName: "util") pod "db0f3c7e-935f-41fc-832f-8d7bf067568b" (UID: "db0f3c7e-935f-41fc-832f-8d7bf067568b"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" May 21 13:08:53.792400 ip-10-0-133-64 kubenswrapper[2562]: I0521 13:08:53.792365 2562 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-dhwpv\" (UniqueName: \"kubernetes.io/projected/2fc1736c-ed52-4066-a27d-7e173c172d02-kube-api-access-dhwpv\") on node \"ip-10-0-133-64.ec2.internal\" DevicePath \"\"" May 21 13:08:53.792400 ip-10-0-133-64 kubenswrapper[2562]: I0521 13:08:53.792394 2562 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/2fc1736c-ed52-4066-a27d-7e173c172d02-util\") on node \"ip-10-0-133-64.ec2.internal\" DevicePath \"\"" May 21 13:08:53.792400 ip-10-0-133-64 kubenswrapper[2562]: I0521 13:08:53.792407 2562 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/2fc1736c-ed52-4066-a27d-7e173c172d02-bundle\") on node \"ip-10-0-133-64.ec2.internal\" DevicePath \"\"" May 21 13:08:53.792626 ip-10-0-133-64 kubenswrapper[2562]: I0521 13:08:53.792416 2562 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/db0f3c7e-935f-41fc-832f-8d7bf067568b-bundle\") on node \"ip-10-0-133-64.ec2.internal\" DevicePath \"\"" May 21 13:08:53.792626 ip-10-0-133-64 kubenswrapper[2562]: I0521 13:08:53.792424 2562 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/db0f3c7e-935f-41fc-832f-8d7bf067568b-util\") on node \"ip-10-0-133-64.ec2.internal\" DevicePath \"\"" May 21 13:08:53.792626 ip-10-0-133-64 kubenswrapper[2562]: I0521 13:08:53.792432 2562 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-4l95w\" (UniqueName: \"kubernetes.io/projected/db0f3c7e-935f-41fc-832f-8d7bf067568b-kube-api-access-4l95w\") on node \"ip-10-0-133-64.ec2.internal\" DevicePath \"\"" May 21 13:08:54.427139 ip-10-0-133-64 kubenswrapper[2562]: I0521 13:08:54.427049 2562 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0clz5h" event={"ID":"2fc1736c-ed52-4066-a27d-7e173c172d02","Type":"ContainerDied","Data":"f8c6634ebbc61adc93d4d16c994d734c201f975418304b57e0c1900e37e7229a"} May 21 13:08:54.427139 ip-10-0-133-64 kubenswrapper[2562]: I0521 13:08:54.427075 2562 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0clz5h" May 21 13:08:54.427139 ip-10-0-133-64 kubenswrapper[2562]: I0521 13:08:54.427086 2562 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="f8c6634ebbc61adc93d4d16c994d734c201f975418304b57e0c1900e37e7229a" May 21 13:08:54.428763 ip-10-0-133-64 kubenswrapper[2562]: I0521 13:08:54.428743 2562 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73tbnj8" May 21 13:08:54.428891 ip-10-0-133-64 kubenswrapper[2562]: I0521 13:08:54.428774 2562 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73tbnj8" event={"ID":"db0f3c7e-935f-41fc-832f-8d7bf067568b","Type":"ContainerDied","Data":"6b70ef9b8e8ac8dbcf868a14c115797a41725a05f99003cf77bcf548b40a43f1"} May 21 13:08:54.428891 ip-10-0-133-64 kubenswrapper[2562]: I0521 13:08:54.428823 2562 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="6b70ef9b8e8ac8dbcf868a14c115797a41725a05f99003cf77bcf548b40a43f1" May 21 13:08:54.553855 ip-10-0-133-64 kubenswrapper[2562]: I0521 13:08:54.553830 2562 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1bzd6s" May 21 13:08:54.600524 ip-10-0-133-64 kubenswrapper[2562]: I0521 13:08:54.600491 2562 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-jssm6\" (UniqueName: \"kubernetes.io/projected/f1bd4d97-469b-4d98-aabd-8a5780c68c63-kube-api-access-jssm6\") pod \"f1bd4d97-469b-4d98-aabd-8a5780c68c63\" (UID: \"f1bd4d97-469b-4d98-aabd-8a5780c68c63\") " May 21 13:08:54.600695 ip-10-0-133-64 kubenswrapper[2562]: I0521 13:08:54.600538 2562 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/f1bd4d97-469b-4d98-aabd-8a5780c68c63-bundle\") pod \"f1bd4d97-469b-4d98-aabd-8a5780c68c63\" (UID: \"f1bd4d97-469b-4d98-aabd-8a5780c68c63\") " May 21 13:08:54.600695 ip-10-0-133-64 kubenswrapper[2562]: I0521 13:08:54.600673 2562 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/f1bd4d97-469b-4d98-aabd-8a5780c68c63-util\") pod \"f1bd4d97-469b-4d98-aabd-8a5780c68c63\" (UID: \"f1bd4d97-469b-4d98-aabd-8a5780c68c63\") " May 21 13:08:54.601132 ip-10-0-133-64 kubenswrapper[2562]: I0521 13:08:54.601110 2562 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/f1bd4d97-469b-4d98-aabd-8a5780c68c63-bundle" (OuterVolumeSpecName: "bundle") pod "f1bd4d97-469b-4d98-aabd-8a5780c68c63" (UID: "f1bd4d97-469b-4d98-aabd-8a5780c68c63"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" May 21 13:08:54.602556 ip-10-0-133-64 kubenswrapper[2562]: I0521 13:08:54.602536 2562 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/f1bd4d97-469b-4d98-aabd-8a5780c68c63-kube-api-access-jssm6" (OuterVolumeSpecName: "kube-api-access-jssm6") pod "f1bd4d97-469b-4d98-aabd-8a5780c68c63" (UID: "f1bd4d97-469b-4d98-aabd-8a5780c68c63"). InnerVolumeSpecName "kube-api-access-jssm6". PluginName "kubernetes.io/projected", VolumeGIDValue "" May 21 13:08:54.607999 ip-10-0-133-64 kubenswrapper[2562]: I0521 13:08:54.607944 2562 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/f1bd4d97-469b-4d98-aabd-8a5780c68c63-util" (OuterVolumeSpecName: "util") pod "f1bd4d97-469b-4d98-aabd-8a5780c68c63" (UID: "f1bd4d97-469b-4d98-aabd-8a5780c68c63"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" May 21 13:08:54.702345 ip-10-0-133-64 kubenswrapper[2562]: I0521 13:08:54.702261 2562 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-jssm6\" (UniqueName: \"kubernetes.io/projected/f1bd4d97-469b-4d98-aabd-8a5780c68c63-kube-api-access-jssm6\") on node \"ip-10-0-133-64.ec2.internal\" DevicePath \"\"" May 21 13:08:54.702345 ip-10-0-133-64 kubenswrapper[2562]: I0521 13:08:54.702300 2562 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/f1bd4d97-469b-4d98-aabd-8a5780c68c63-bundle\") on node \"ip-10-0-133-64.ec2.internal\" DevicePath \"\"" May 21 13:08:54.702345 ip-10-0-133-64 kubenswrapper[2562]: I0521 13:08:54.702314 2562 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/f1bd4d97-469b-4d98-aabd-8a5780c68c63-util\") on node \"ip-10-0-133-64.ec2.internal\" DevicePath \"\"" May 21 13:08:55.434365 ip-10-0-133-64 kubenswrapper[2562]: I0521 13:08:55.434334 2562 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1bzd6s" May 21 13:08:55.434747 ip-10-0-133-64 kubenswrapper[2562]: I0521 13:08:55.434330 2562 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1bzd6s" event={"ID":"f1bd4d97-469b-4d98-aabd-8a5780c68c63","Type":"ContainerDied","Data":"e1188b381d4e075bd3f0ea5f4102933cd38558b65939e817ed1ad80d2fd462e3"} May 21 13:08:55.434747 ip-10-0-133-64 kubenswrapper[2562]: I0521 13:08:55.434442 2562 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="e1188b381d4e075bd3f0ea5f4102933cd38558b65939e817ed1ad80d2fd462e3" May 21 13:09:06.947950 ip-10-0-133-64 kubenswrapper[2562]: I0521 13:09:06.947901 2562 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-console/console-69b9c7b6db-t45lf"] May 21 13:09:06.948336 ip-10-0-133-64 kubenswrapper[2562]: I0521 13:09:06.948197 2562 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="2fc1736c-ed52-4066-a27d-7e173c172d02" containerName="pull" May 21 13:09:06.948336 ip-10-0-133-64 kubenswrapper[2562]: I0521 13:09:06.948207 2562 state_mem.go:107] "Deleted CPUSet assignment" podUID="2fc1736c-ed52-4066-a27d-7e173c172d02" containerName="pull" May 21 13:09:06.948336 ip-10-0-133-64 kubenswrapper[2562]: I0521 13:09:06.948217 2562 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="f1bd4d97-469b-4d98-aabd-8a5780c68c63" containerName="pull" May 21 13:09:06.948336 ip-10-0-133-64 kubenswrapper[2562]: I0521 13:09:06.948222 2562 state_mem.go:107] "Deleted CPUSet assignment" podUID="f1bd4d97-469b-4d98-aabd-8a5780c68c63" containerName="pull" May 21 13:09:06.948336 ip-10-0-133-64 kubenswrapper[2562]: I0521 13:09:06.948230 2562 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="2bdc7f3e-3a40-4937-96dc-ed8a2489ae62" containerName="util" May 21 13:09:06.948336 ip-10-0-133-64 kubenswrapper[2562]: I0521 13:09:06.948236 2562 state_mem.go:107] "Deleted CPUSet assignment" podUID="2bdc7f3e-3a40-4937-96dc-ed8a2489ae62" containerName="util" May 21 13:09:06.948336 ip-10-0-133-64 kubenswrapper[2562]: I0521 13:09:06.948241 2562 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="db0f3c7e-935f-41fc-832f-8d7bf067568b" containerName="extract" May 21 13:09:06.948336 ip-10-0-133-64 kubenswrapper[2562]: I0521 13:09:06.948246 2562 state_mem.go:107] "Deleted CPUSet assignment" podUID="db0f3c7e-935f-41fc-832f-8d7bf067568b" containerName="extract" May 21 13:09:06.948336 ip-10-0-133-64 kubenswrapper[2562]: I0521 13:09:06.948252 2562 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="2bdc7f3e-3a40-4937-96dc-ed8a2489ae62" containerName="pull" May 21 13:09:06.948336 ip-10-0-133-64 kubenswrapper[2562]: I0521 13:09:06.948257 2562 state_mem.go:107] "Deleted CPUSet assignment" podUID="2bdc7f3e-3a40-4937-96dc-ed8a2489ae62" containerName="pull" May 21 13:09:06.948336 ip-10-0-133-64 kubenswrapper[2562]: I0521 13:09:06.948263 2562 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="f1bd4d97-469b-4d98-aabd-8a5780c68c63" containerName="util" May 21 13:09:06.948336 ip-10-0-133-64 kubenswrapper[2562]: I0521 13:09:06.948268 2562 state_mem.go:107] "Deleted CPUSet assignment" podUID="f1bd4d97-469b-4d98-aabd-8a5780c68c63" containerName="util" May 21 13:09:06.948336 ip-10-0-133-64 kubenswrapper[2562]: I0521 13:09:06.948281 2562 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="f1bd4d97-469b-4d98-aabd-8a5780c68c63" containerName="extract" May 21 13:09:06.948336 ip-10-0-133-64 kubenswrapper[2562]: I0521 13:09:06.948286 2562 state_mem.go:107] "Deleted CPUSet assignment" podUID="f1bd4d97-469b-4d98-aabd-8a5780c68c63" containerName="extract" May 21 13:09:06.948336 ip-10-0-133-64 kubenswrapper[2562]: I0521 13:09:06.948292 2562 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="2fc1736c-ed52-4066-a27d-7e173c172d02" containerName="extract" May 21 13:09:06.948336 ip-10-0-133-64 kubenswrapper[2562]: I0521 13:09:06.948297 2562 state_mem.go:107] "Deleted CPUSet assignment" podUID="2fc1736c-ed52-4066-a27d-7e173c172d02" containerName="extract" May 21 13:09:06.948336 ip-10-0-133-64 kubenswrapper[2562]: I0521 13:09:06.948304 2562 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="2fc1736c-ed52-4066-a27d-7e173c172d02" containerName="util" May 21 13:09:06.948336 ip-10-0-133-64 kubenswrapper[2562]: I0521 13:09:06.948309 2562 state_mem.go:107] "Deleted CPUSet assignment" podUID="2fc1736c-ed52-4066-a27d-7e173c172d02" containerName="util" May 21 13:09:06.948336 ip-10-0-133-64 kubenswrapper[2562]: I0521 13:09:06.948315 2562 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="2bdc7f3e-3a40-4937-96dc-ed8a2489ae62" containerName="extract" May 21 13:09:06.948336 ip-10-0-133-64 kubenswrapper[2562]: I0521 13:09:06.948321 2562 state_mem.go:107] "Deleted CPUSet assignment" podUID="2bdc7f3e-3a40-4937-96dc-ed8a2489ae62" containerName="extract" May 21 13:09:06.948336 ip-10-0-133-64 kubenswrapper[2562]: I0521 13:09:06.948328 2562 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="db0f3c7e-935f-41fc-832f-8d7bf067568b" containerName="util" May 21 13:09:06.948336 ip-10-0-133-64 kubenswrapper[2562]: I0521 13:09:06.948332 2562 state_mem.go:107] "Deleted CPUSet assignment" podUID="db0f3c7e-935f-41fc-832f-8d7bf067568b" containerName="util" May 21 13:09:06.948336 ip-10-0-133-64 kubenswrapper[2562]: I0521 13:09:06.948339 2562 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="db0f3c7e-935f-41fc-832f-8d7bf067568b" containerName="pull" May 21 13:09:06.948336 ip-10-0-133-64 kubenswrapper[2562]: I0521 13:09:06.948344 2562 state_mem.go:107] "Deleted CPUSet assignment" podUID="db0f3c7e-935f-41fc-832f-8d7bf067568b" containerName="pull" May 21 13:09:06.948981 ip-10-0-133-64 kubenswrapper[2562]: I0521 13:09:06.948390 2562 memory_manager.go:356] "RemoveStaleState removing state" podUID="2fc1736c-ed52-4066-a27d-7e173c172d02" containerName="extract" May 21 13:09:06.948981 ip-10-0-133-64 kubenswrapper[2562]: I0521 13:09:06.948400 2562 memory_manager.go:356] "RemoveStaleState removing state" podUID="f1bd4d97-469b-4d98-aabd-8a5780c68c63" containerName="extract" May 21 13:09:06.948981 ip-10-0-133-64 kubenswrapper[2562]: I0521 13:09:06.948407 2562 memory_manager.go:356] "RemoveStaleState removing state" podUID="db0f3c7e-935f-41fc-832f-8d7bf067568b" containerName="extract" May 21 13:09:06.948981 ip-10-0-133-64 kubenswrapper[2562]: I0521 13:09:06.948414 2562 memory_manager.go:356] "RemoveStaleState removing state" podUID="2bdc7f3e-3a40-4937-96dc-ed8a2489ae62" containerName="extract" May 21 13:09:06.960685 ip-10-0-133-64 kubenswrapper[2562]: I0521 13:09:06.960653 2562 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-69b9c7b6db-t45lf" May 21 13:09:06.963629 ip-10-0-133-64 kubenswrapper[2562]: I0521 13:09:06.963598 2562 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-69b9c7b6db-t45lf"] May 21 13:09:07.007299 ip-10-0-133-64 kubenswrapper[2562]: I0521 13:09:07.007257 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/a22e0a01-ad70-4b54-938e-d8b5630ef0b2-console-serving-cert\") pod \"console-69b9c7b6db-t45lf\" (UID: \"a22e0a01-ad70-4b54-938e-d8b5630ef0b2\") " pod="openshift-console/console-69b9c7b6db-t45lf" May 21 13:09:07.007475 ip-10-0-133-64 kubenswrapper[2562]: I0521 13:09:07.007318 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/a22e0a01-ad70-4b54-938e-d8b5630ef0b2-console-oauth-config\") pod \"console-69b9c7b6db-t45lf\" (UID: \"a22e0a01-ad70-4b54-938e-d8b5630ef0b2\") " pod="openshift-console/console-69b9c7b6db-t45lf" May 21 13:09:07.007475 ip-10-0-133-64 kubenswrapper[2562]: I0521 13:09:07.007353 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/a22e0a01-ad70-4b54-938e-d8b5630ef0b2-console-config\") pod \"console-69b9c7b6db-t45lf\" (UID: \"a22e0a01-ad70-4b54-938e-d8b5630ef0b2\") " pod="openshift-console/console-69b9c7b6db-t45lf" May 21 13:09:07.007475 ip-10-0-133-64 kubenswrapper[2562]: I0521 13:09:07.007378 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/a22e0a01-ad70-4b54-938e-d8b5630ef0b2-oauth-serving-cert\") pod \"console-69b9c7b6db-t45lf\" (UID: \"a22e0a01-ad70-4b54-938e-d8b5630ef0b2\") " pod="openshift-console/console-69b9c7b6db-t45lf" May 21 13:09:07.007475 ip-10-0-133-64 kubenswrapper[2562]: I0521 13:09:07.007394 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/a22e0a01-ad70-4b54-938e-d8b5630ef0b2-service-ca\") pod \"console-69b9c7b6db-t45lf\" (UID: \"a22e0a01-ad70-4b54-938e-d8b5630ef0b2\") " pod="openshift-console/console-69b9c7b6db-t45lf" May 21 13:09:07.007475 ip-10-0-133-64 kubenswrapper[2562]: I0521 13:09:07.007441 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-p49v4\" (UniqueName: \"kubernetes.io/projected/a22e0a01-ad70-4b54-938e-d8b5630ef0b2-kube-api-access-p49v4\") pod \"console-69b9c7b6db-t45lf\" (UID: \"a22e0a01-ad70-4b54-938e-d8b5630ef0b2\") " pod="openshift-console/console-69b9c7b6db-t45lf" May 21 13:09:07.007679 ip-10-0-133-64 kubenswrapper[2562]: I0521 13:09:07.007503 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/a22e0a01-ad70-4b54-938e-d8b5630ef0b2-trusted-ca-bundle\") pod \"console-69b9c7b6db-t45lf\" (UID: \"a22e0a01-ad70-4b54-938e-d8b5630ef0b2\") " pod="openshift-console/console-69b9c7b6db-t45lf" May 21 13:09:07.107934 ip-10-0-133-64 kubenswrapper[2562]: I0521 13:09:07.107900 2562 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-p49v4\" (UniqueName: \"kubernetes.io/projected/a22e0a01-ad70-4b54-938e-d8b5630ef0b2-kube-api-access-p49v4\") pod \"console-69b9c7b6db-t45lf\" (UID: \"a22e0a01-ad70-4b54-938e-d8b5630ef0b2\") " pod="openshift-console/console-69b9c7b6db-t45lf" May 21 13:09:07.108151 ip-10-0-133-64 kubenswrapper[2562]: I0521 13:09:07.107959 2562 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/a22e0a01-ad70-4b54-938e-d8b5630ef0b2-trusted-ca-bundle\") pod \"console-69b9c7b6db-t45lf\" (UID: \"a22e0a01-ad70-4b54-938e-d8b5630ef0b2\") " pod="openshift-console/console-69b9c7b6db-t45lf" May 21 13:09:07.108151 ip-10-0-133-64 kubenswrapper[2562]: I0521 13:09:07.107989 2562 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/a22e0a01-ad70-4b54-938e-d8b5630ef0b2-console-serving-cert\") pod \"console-69b9c7b6db-t45lf\" (UID: \"a22e0a01-ad70-4b54-938e-d8b5630ef0b2\") " pod="openshift-console/console-69b9c7b6db-t45lf" May 21 13:09:07.108151 ip-10-0-133-64 kubenswrapper[2562]: I0521 13:09:07.108023 2562 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/a22e0a01-ad70-4b54-938e-d8b5630ef0b2-console-oauth-config\") pod \"console-69b9c7b6db-t45lf\" (UID: \"a22e0a01-ad70-4b54-938e-d8b5630ef0b2\") " pod="openshift-console/console-69b9c7b6db-t45lf" May 21 13:09:07.108151 ip-10-0-133-64 kubenswrapper[2562]: I0521 13:09:07.108064 2562 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/a22e0a01-ad70-4b54-938e-d8b5630ef0b2-console-config\") pod \"console-69b9c7b6db-t45lf\" (UID: \"a22e0a01-ad70-4b54-938e-d8b5630ef0b2\") " pod="openshift-console/console-69b9c7b6db-t45lf" May 21 13:09:07.108151 ip-10-0-133-64 kubenswrapper[2562]: I0521 13:09:07.108123 2562 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/a22e0a01-ad70-4b54-938e-d8b5630ef0b2-oauth-serving-cert\") pod \"console-69b9c7b6db-t45lf\" (UID: \"a22e0a01-ad70-4b54-938e-d8b5630ef0b2\") " pod="openshift-console/console-69b9c7b6db-t45lf" May 21 13:09:07.108411 ip-10-0-133-64 kubenswrapper[2562]: I0521 13:09:07.108167 2562 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/a22e0a01-ad70-4b54-938e-d8b5630ef0b2-service-ca\") pod \"console-69b9c7b6db-t45lf\" (UID: \"a22e0a01-ad70-4b54-938e-d8b5630ef0b2\") " pod="openshift-console/console-69b9c7b6db-t45lf" May 21 13:09:07.108759 ip-10-0-133-64 kubenswrapper[2562]: I0521 13:09:07.108721 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/a22e0a01-ad70-4b54-938e-d8b5630ef0b2-console-config\") pod \"console-69b9c7b6db-t45lf\" (UID: \"a22e0a01-ad70-4b54-938e-d8b5630ef0b2\") " pod="openshift-console/console-69b9c7b6db-t45lf" May 21 13:09:07.108899 ip-10-0-133-64 kubenswrapper[2562]: I0521 13:09:07.108853 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/a22e0a01-ad70-4b54-938e-d8b5630ef0b2-service-ca\") pod \"console-69b9c7b6db-t45lf\" (UID: \"a22e0a01-ad70-4b54-938e-d8b5630ef0b2\") " pod="openshift-console/console-69b9c7b6db-t45lf" May 21 13:09:07.108899 ip-10-0-133-64 kubenswrapper[2562]: I0521 13:09:07.108885 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/a22e0a01-ad70-4b54-938e-d8b5630ef0b2-oauth-serving-cert\") pod \"console-69b9c7b6db-t45lf\" (UID: \"a22e0a01-ad70-4b54-938e-d8b5630ef0b2\") " pod="openshift-console/console-69b9c7b6db-t45lf" May 21 13:09:07.109066 ip-10-0-133-64 kubenswrapper[2562]: I0521 13:09:07.109041 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/a22e0a01-ad70-4b54-938e-d8b5630ef0b2-trusted-ca-bundle\") pod \"console-69b9c7b6db-t45lf\" (UID: \"a22e0a01-ad70-4b54-938e-d8b5630ef0b2\") " pod="openshift-console/console-69b9c7b6db-t45lf" May 21 13:09:07.110597 ip-10-0-133-64 kubenswrapper[2562]: I0521 13:09:07.110569 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/a22e0a01-ad70-4b54-938e-d8b5630ef0b2-console-oauth-config\") pod \"console-69b9c7b6db-t45lf\" (UID: \"a22e0a01-ad70-4b54-938e-d8b5630ef0b2\") " pod="openshift-console/console-69b9c7b6db-t45lf" May 21 13:09:07.110721 ip-10-0-133-64 kubenswrapper[2562]: I0521 13:09:07.110704 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/a22e0a01-ad70-4b54-938e-d8b5630ef0b2-console-serving-cert\") pod \"console-69b9c7b6db-t45lf\" (UID: \"a22e0a01-ad70-4b54-938e-d8b5630ef0b2\") " pod="openshift-console/console-69b9c7b6db-t45lf" May 21 13:09:07.126195 ip-10-0-133-64 kubenswrapper[2562]: I0521 13:09:07.126168 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-p49v4\" (UniqueName: \"kubernetes.io/projected/a22e0a01-ad70-4b54-938e-d8b5630ef0b2-kube-api-access-p49v4\") pod \"console-69b9c7b6db-t45lf\" (UID: \"a22e0a01-ad70-4b54-938e-d8b5630ef0b2\") " pod="openshift-console/console-69b9c7b6db-t45lf" May 21 13:09:07.271352 ip-10-0-133-64 kubenswrapper[2562]: I0521 13:09:07.271309 2562 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-69b9c7b6db-t45lf" May 21 13:09:07.407146 ip-10-0-133-64 kubenswrapper[2562]: I0521 13:09:07.407116 2562 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-69b9c7b6db-t45lf"] May 21 13:09:07.409534 ip-10-0-133-64 kubenswrapper[2562]: W0521 13:09:07.409506 2562 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poda22e0a01_ad70_4b54_938e_d8b5630ef0b2.slice/crio-a43d85584418e73a23f33562a9b29644cfe7839093a0f2866e1ac4f06bcee0ec WatchSource:0}: Error finding container a43d85584418e73a23f33562a9b29644cfe7839093a0f2866e1ac4f06bcee0ec: Status 404 returned error can't find the container with id a43d85584418e73a23f33562a9b29644cfe7839093a0f2866e1ac4f06bcee0ec May 21 13:09:07.479261 ip-10-0-133-64 kubenswrapper[2562]: I0521 13:09:07.479228 2562 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-69b9c7b6db-t45lf" event={"ID":"a22e0a01-ad70-4b54-938e-d8b5630ef0b2","Type":"ContainerStarted","Data":"01dc00ecfa540a9137b812bf52518cf71796e42adab425962072fc80495e1ee9"} May 21 13:09:07.479383 ip-10-0-133-64 kubenswrapper[2562]: I0521 13:09:07.479266 2562 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-69b9c7b6db-t45lf" event={"ID":"a22e0a01-ad70-4b54-938e-d8b5630ef0b2","Type":"ContainerStarted","Data":"a43d85584418e73a23f33562a9b29644cfe7839093a0f2866e1ac4f06bcee0ec"} May 21 13:09:07.503896 ip-10-0-133-64 kubenswrapper[2562]: I0521 13:09:07.503841 2562 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-console/console-69b9c7b6db-t45lf" podStartSLOduration=1.5038248360000002 podStartE2EDuration="1.503824836s" podCreationTimestamp="2026-05-21 13:09:06 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2026-05-21 13:09:07.501306034 +0000 UTC m=+394.051587403" watchObservedRunningTime="2026-05-21 13:09:07.503824836 +0000 UTC m=+394.054106204" May 21 13:09:08.995361 ip-10-0-133-64 kubenswrapper[2562]: I0521 13:09:08.995328 2562 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["kuadrant-system/authorino-operator-657f44b778-sqhvx"] May 21 13:09:08.998907 ip-10-0-133-64 kubenswrapper[2562]: I0521 13:09:08.998886 2562 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-operator-657f44b778-sqhvx" May 21 13:09:09.001998 ip-10-0-133-64 kubenswrapper[2562]: I0521 13:09:09.001975 2562 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"authorino-operator-dockercfg-w77f9\"" May 21 13:09:09.021391 ip-10-0-133-64 kubenswrapper[2562]: I0521 13:09:09.021360 2562 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-operator-657f44b778-sqhvx"] May 21 13:09:09.125640 ip-10-0-133-64 kubenswrapper[2562]: I0521 13:09:09.125604 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-w2n2s\" (UniqueName: \"kubernetes.io/projected/07361eba-541b-4817-91a2-982293bbe8cc-kube-api-access-w2n2s\") pod \"authorino-operator-657f44b778-sqhvx\" (UID: \"07361eba-541b-4817-91a2-982293bbe8cc\") " pod="kuadrant-system/authorino-operator-657f44b778-sqhvx" May 21 13:09:09.226300 ip-10-0-133-64 kubenswrapper[2562]: I0521 13:09:09.226254 2562 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-w2n2s\" (UniqueName: \"kubernetes.io/projected/07361eba-541b-4817-91a2-982293bbe8cc-kube-api-access-w2n2s\") pod \"authorino-operator-657f44b778-sqhvx\" (UID: \"07361eba-541b-4817-91a2-982293bbe8cc\") " pod="kuadrant-system/authorino-operator-657f44b778-sqhvx" May 21 13:09:09.239293 ip-10-0-133-64 kubenswrapper[2562]: I0521 13:09:09.239260 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-w2n2s\" (UniqueName: \"kubernetes.io/projected/07361eba-541b-4817-91a2-982293bbe8cc-kube-api-access-w2n2s\") pod \"authorino-operator-657f44b778-sqhvx\" (UID: \"07361eba-541b-4817-91a2-982293bbe8cc\") " pod="kuadrant-system/authorino-operator-657f44b778-sqhvx" May 21 13:09:09.309968 ip-10-0-133-64 kubenswrapper[2562]: I0521 13:09:09.309875 2562 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-operator-657f44b778-sqhvx" May 21 13:09:09.445989 ip-10-0-133-64 kubenswrapper[2562]: I0521 13:09:09.445953 2562 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-operator-657f44b778-sqhvx"] May 21 13:09:09.448961 ip-10-0-133-64 kubenswrapper[2562]: W0521 13:09:09.448922 2562 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod07361eba_541b_4817_91a2_982293bbe8cc.slice/crio-fd5090abc54dc92ab680b1dee79a241c776f14676511dfa4b156b974226ea447 WatchSource:0}: Error finding container fd5090abc54dc92ab680b1dee79a241c776f14676511dfa4b156b974226ea447: Status 404 returned error can't find the container with id fd5090abc54dc92ab680b1dee79a241c776f14676511dfa4b156b974226ea447 May 21 13:09:09.487432 ip-10-0-133-64 kubenswrapper[2562]: I0521 13:09:09.487395 2562 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-operator-657f44b778-sqhvx" event={"ID":"07361eba-541b-4817-91a2-982293bbe8cc","Type":"ContainerStarted","Data":"fd5090abc54dc92ab680b1dee79a241c776f14676511dfa4b156b974226ea447"} May 21 13:09:12.462309 ip-10-0-133-64 kubenswrapper[2562]: I0521 13:09:12.462277 2562 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["kuadrant-system/dns-operator-controller-manager-648d5c98bc-8qpln"] May 21 13:09:12.465516 ip-10-0-133-64 kubenswrapper[2562]: I0521 13:09:12.465499 2562 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/dns-operator-controller-manager-648d5c98bc-8qpln" May 21 13:09:12.468723 ip-10-0-133-64 kubenswrapper[2562]: I0521 13:09:12.468695 2562 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"dns-operator-controller-manager-dockercfg-bw4gv\"" May 21 13:09:12.468874 ip-10-0-133-64 kubenswrapper[2562]: I0521 13:09:12.468854 2562 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"dns-operator-controller-env\"" May 21 13:09:12.475887 ip-10-0-133-64 kubenswrapper[2562]: I0521 13:09:12.475866 2562 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/dns-operator-controller-manager-648d5c98bc-8qpln"] May 21 13:09:12.502015 ip-10-0-133-64 kubenswrapper[2562]: I0521 13:09:12.501978 2562 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-operator-657f44b778-sqhvx" event={"ID":"07361eba-541b-4817-91a2-982293bbe8cc","Type":"ContainerStarted","Data":"49136c65aa623ccb78c3d1fd84babffdb98f6b76e8c40c78a71a57749398dc31"} May 21 13:09:12.502202 ip-10-0-133-64 kubenswrapper[2562]: I0521 13:09:12.502094 2562 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/authorino-operator-657f44b778-sqhvx" May 21 13:09:12.525163 ip-10-0-133-64 kubenswrapper[2562]: I0521 13:09:12.525102 2562 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="kuadrant-system/authorino-operator-657f44b778-sqhvx" podStartSLOduration=2.337752242 podStartE2EDuration="4.525081929s" podCreationTimestamp="2026-05-21 13:09:08 +0000 UTC" firstStartedPulling="2026-05-21 13:09:09.450724333 +0000 UTC m=+396.001005682" lastFinishedPulling="2026-05-21 13:09:11.638054019 +0000 UTC m=+398.188335369" observedRunningTime="2026-05-21 13:09:12.524884753 +0000 UTC m=+399.075166121" watchObservedRunningTime="2026-05-21 13:09:12.525081929 +0000 UTC m=+399.075363302" May 21 13:09:12.555303 ip-10-0-133-64 kubenswrapper[2562]: I0521 13:09:12.555263 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-qfmc2\" (UniqueName: \"kubernetes.io/projected/3746b663-4dca-40bc-8afa-728070d11e53-kube-api-access-qfmc2\") pod \"dns-operator-controller-manager-648d5c98bc-8qpln\" (UID: \"3746b663-4dca-40bc-8afa-728070d11e53\") " pod="kuadrant-system/dns-operator-controller-manager-648d5c98bc-8qpln" May 21 13:09:12.655914 ip-10-0-133-64 kubenswrapper[2562]: I0521 13:09:12.655877 2562 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-qfmc2\" (UniqueName: \"kubernetes.io/projected/3746b663-4dca-40bc-8afa-728070d11e53-kube-api-access-qfmc2\") pod \"dns-operator-controller-manager-648d5c98bc-8qpln\" (UID: \"3746b663-4dca-40bc-8afa-728070d11e53\") " pod="kuadrant-system/dns-operator-controller-manager-648d5c98bc-8qpln" May 21 13:09:12.667143 ip-10-0-133-64 kubenswrapper[2562]: I0521 13:09:12.667107 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-qfmc2\" (UniqueName: \"kubernetes.io/projected/3746b663-4dca-40bc-8afa-728070d11e53-kube-api-access-qfmc2\") pod \"dns-operator-controller-manager-648d5c98bc-8qpln\" (UID: \"3746b663-4dca-40bc-8afa-728070d11e53\") " pod="kuadrant-system/dns-operator-controller-manager-648d5c98bc-8qpln" May 21 13:09:12.775836 ip-10-0-133-64 kubenswrapper[2562]: I0521 13:09:12.775736 2562 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/dns-operator-controller-manager-648d5c98bc-8qpln" May 21 13:09:12.926242 ip-10-0-133-64 kubenswrapper[2562]: I0521 13:09:12.926216 2562 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/dns-operator-controller-manager-648d5c98bc-8qpln"] May 21 13:09:12.927567 ip-10-0-133-64 kubenswrapper[2562]: W0521 13:09:12.927529 2562 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod3746b663_4dca_40bc_8afa_728070d11e53.slice/crio-6d528be2aaa51ab8a31e8bc37067558bdf7c527009f76bab61174707a3d9b046 WatchSource:0}: Error finding container 6d528be2aaa51ab8a31e8bc37067558bdf7c527009f76bab61174707a3d9b046: Status 404 returned error can't find the container with id 6d528be2aaa51ab8a31e8bc37067558bdf7c527009f76bab61174707a3d9b046 May 21 13:09:13.507108 ip-10-0-133-64 kubenswrapper[2562]: I0521 13:09:13.507069 2562 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/dns-operator-controller-manager-648d5c98bc-8qpln" event={"ID":"3746b663-4dca-40bc-8afa-728070d11e53","Type":"ContainerStarted","Data":"6d528be2aaa51ab8a31e8bc37067558bdf7c527009f76bab61174707a3d9b046"} May 21 13:09:16.519824 ip-10-0-133-64 kubenswrapper[2562]: I0521 13:09:16.519763 2562 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/dns-operator-controller-manager-648d5c98bc-8qpln" event={"ID":"3746b663-4dca-40bc-8afa-728070d11e53","Type":"ContainerStarted","Data":"bc010325a39fee4df8cbaef7c57b22ff036796eb287008b1dec262e024f1bfac"} May 21 13:09:16.520223 ip-10-0-133-64 kubenswrapper[2562]: I0521 13:09:16.519894 2562 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/dns-operator-controller-manager-648d5c98bc-8qpln" May 21 13:09:16.541734 ip-10-0-133-64 kubenswrapper[2562]: I0521 13:09:16.541677 2562 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="kuadrant-system/dns-operator-controller-manager-648d5c98bc-8qpln" podStartSLOduration=1.813748297 podStartE2EDuration="4.541663288s" podCreationTimestamp="2026-05-21 13:09:12 +0000 UTC" firstStartedPulling="2026-05-21 13:09:12.929645388 +0000 UTC m=+399.479926734" lastFinishedPulling="2026-05-21 13:09:15.657560376 +0000 UTC m=+402.207841725" observedRunningTime="2026-05-21 13:09:16.540979236 +0000 UTC m=+403.091260609" watchObservedRunningTime="2026-05-21 13:09:16.541663288 +0000 UTC m=+403.091944655" May 21 13:09:17.271749 ip-10-0-133-64 kubenswrapper[2562]: I0521 13:09:17.271710 2562 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/console-69b9c7b6db-t45lf" May 21 13:09:17.271749 ip-10-0-133-64 kubenswrapper[2562]: I0521 13:09:17.271753 2562 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-console/console-69b9c7b6db-t45lf" May 21 13:09:17.276817 ip-10-0-133-64 kubenswrapper[2562]: I0521 13:09:17.276778 2562 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-console/console-69b9c7b6db-t45lf" May 21 13:09:17.527447 ip-10-0-133-64 kubenswrapper[2562]: I0521 13:09:17.527371 2562 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console/console-69b9c7b6db-t45lf" May 21 13:09:17.586476 ip-10-0-133-64 kubenswrapper[2562]: I0521 13:09:17.586441 2562 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openshift-console/console-5846c7d4fc-d6vkl"] May 21 13:09:23.509539 ip-10-0-133-64 kubenswrapper[2562]: I0521 13:09:23.509506 2562 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/authorino-operator-657f44b778-sqhvx" May 21 13:09:25.405603 ip-10-0-133-64 kubenswrapper[2562]: I0521 13:09:25.405562 2562 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["kuadrant-system/kuadrant-console-plugin-6cb54b5c86-6kd5h"] May 21 13:09:25.409246 ip-10-0-133-64 kubenswrapper[2562]: I0521 13:09:25.409224 2562 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-console-plugin-6cb54b5c86-6kd5h" May 21 13:09:25.411431 ip-10-0-133-64 kubenswrapper[2562]: I0521 13:09:25.411409 2562 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"plugin-serving-cert\"" May 21 13:09:25.411431 ip-10-0-133-64 kubenswrapper[2562]: I0521 13:09:25.411425 2562 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"kuadrant-console-nginx-conf\"" May 21 13:09:25.411597 ip-10-0-133-64 kubenswrapper[2562]: I0521 13:09:25.411466 2562 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"default-dockercfg-zst48\"" May 21 13:09:25.416113 ip-10-0-133-64 kubenswrapper[2562]: I0521 13:09:25.416090 2562 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-console-plugin-6cb54b5c86-6kd5h"] May 21 13:09:25.572516 ip-10-0-133-64 kubenswrapper[2562]: I0521 13:09:25.572482 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugin-serving-cert\" (UniqueName: \"kubernetes.io/secret/52ecb5cc-48f7-4b5e-ad22-553c76f6c243-plugin-serving-cert\") pod \"kuadrant-console-plugin-6cb54b5c86-6kd5h\" (UID: \"52ecb5cc-48f7-4b5e-ad22-553c76f6c243\") " pod="kuadrant-system/kuadrant-console-plugin-6cb54b5c86-6kd5h" May 21 13:09:25.572516 ip-10-0-133-64 kubenswrapper[2562]: I0521 13:09:25.572531 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-zhsc5\" (UniqueName: \"kubernetes.io/projected/52ecb5cc-48f7-4b5e-ad22-553c76f6c243-kube-api-access-zhsc5\") pod \"kuadrant-console-plugin-6cb54b5c86-6kd5h\" (UID: \"52ecb5cc-48f7-4b5e-ad22-553c76f6c243\") " pod="kuadrant-system/kuadrant-console-plugin-6cb54b5c86-6kd5h" May 21 13:09:25.572838 ip-10-0-133-64 kubenswrapper[2562]: I0521 13:09:25.572646 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"nginx-conf\" (UniqueName: \"kubernetes.io/configmap/52ecb5cc-48f7-4b5e-ad22-553c76f6c243-nginx-conf\") pod \"kuadrant-console-plugin-6cb54b5c86-6kd5h\" (UID: \"52ecb5cc-48f7-4b5e-ad22-553c76f6c243\") " pod="kuadrant-system/kuadrant-console-plugin-6cb54b5c86-6kd5h" May 21 13:09:25.673378 ip-10-0-133-64 kubenswrapper[2562]: I0521 13:09:25.673293 2562 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"plugin-serving-cert\" (UniqueName: \"kubernetes.io/secret/52ecb5cc-48f7-4b5e-ad22-553c76f6c243-plugin-serving-cert\") pod \"kuadrant-console-plugin-6cb54b5c86-6kd5h\" (UID: \"52ecb5cc-48f7-4b5e-ad22-553c76f6c243\") " pod="kuadrant-system/kuadrant-console-plugin-6cb54b5c86-6kd5h" May 21 13:09:25.673378 ip-10-0-133-64 kubenswrapper[2562]: I0521 13:09:25.673337 2562 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-zhsc5\" (UniqueName: \"kubernetes.io/projected/52ecb5cc-48f7-4b5e-ad22-553c76f6c243-kube-api-access-zhsc5\") pod \"kuadrant-console-plugin-6cb54b5c86-6kd5h\" (UID: \"52ecb5cc-48f7-4b5e-ad22-553c76f6c243\") " pod="kuadrant-system/kuadrant-console-plugin-6cb54b5c86-6kd5h" May 21 13:09:25.673564 ip-10-0-133-64 kubenswrapper[2562]: I0521 13:09:25.673388 2562 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"nginx-conf\" (UniqueName: \"kubernetes.io/configmap/52ecb5cc-48f7-4b5e-ad22-553c76f6c243-nginx-conf\") pod \"kuadrant-console-plugin-6cb54b5c86-6kd5h\" (UID: \"52ecb5cc-48f7-4b5e-ad22-553c76f6c243\") " pod="kuadrant-system/kuadrant-console-plugin-6cb54b5c86-6kd5h" May 21 13:09:25.674024 ip-10-0-133-64 kubenswrapper[2562]: I0521 13:09:25.674002 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"nginx-conf\" (UniqueName: \"kubernetes.io/configmap/52ecb5cc-48f7-4b5e-ad22-553c76f6c243-nginx-conf\") pod \"kuadrant-console-plugin-6cb54b5c86-6kd5h\" (UID: \"52ecb5cc-48f7-4b5e-ad22-553c76f6c243\") " pod="kuadrant-system/kuadrant-console-plugin-6cb54b5c86-6kd5h" May 21 13:09:25.675761 ip-10-0-133-64 kubenswrapper[2562]: I0521 13:09:25.675740 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"plugin-serving-cert\" (UniqueName: \"kubernetes.io/secret/52ecb5cc-48f7-4b5e-ad22-553c76f6c243-plugin-serving-cert\") pod \"kuadrant-console-plugin-6cb54b5c86-6kd5h\" (UID: \"52ecb5cc-48f7-4b5e-ad22-553c76f6c243\") " pod="kuadrant-system/kuadrant-console-plugin-6cb54b5c86-6kd5h" May 21 13:09:25.685053 ip-10-0-133-64 kubenswrapper[2562]: I0521 13:09:25.685027 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-zhsc5\" (UniqueName: \"kubernetes.io/projected/52ecb5cc-48f7-4b5e-ad22-553c76f6c243-kube-api-access-zhsc5\") pod \"kuadrant-console-plugin-6cb54b5c86-6kd5h\" (UID: \"52ecb5cc-48f7-4b5e-ad22-553c76f6c243\") " pod="kuadrant-system/kuadrant-console-plugin-6cb54b5c86-6kd5h" May 21 13:09:25.720172 ip-10-0-133-64 kubenswrapper[2562]: I0521 13:09:25.720135 2562 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-console-plugin-6cb54b5c86-6kd5h" May 21 13:09:25.873192 ip-10-0-133-64 kubenswrapper[2562]: I0521 13:09:25.873165 2562 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-console-plugin-6cb54b5c86-6kd5h"] May 21 13:09:25.874960 ip-10-0-133-64 kubenswrapper[2562]: W0521 13:09:25.874933 2562 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod52ecb5cc_48f7_4b5e_ad22_553c76f6c243.slice/crio-0d915987ffa8d8492dc5eb064ddfeb0e81102cd551c8fd454f58f2fc0e5457f0 WatchSource:0}: Error finding container 0d915987ffa8d8492dc5eb064ddfeb0e81102cd551c8fd454f58f2fc0e5457f0: Status 404 returned error can't find the container with id 0d915987ffa8d8492dc5eb064ddfeb0e81102cd551c8fd454f58f2fc0e5457f0 May 21 13:09:26.563878 ip-10-0-133-64 kubenswrapper[2562]: I0521 13:09:26.563835 2562 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-console-plugin-6cb54b5c86-6kd5h" event={"ID":"52ecb5cc-48f7-4b5e-ad22-553c76f6c243","Type":"ContainerStarted","Data":"0d915987ffa8d8492dc5eb064ddfeb0e81102cd551c8fd454f58f2fc0e5457f0"} May 21 13:09:27.526953 ip-10-0-133-64 kubenswrapper[2562]: I0521 13:09:27.526921 2562 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/dns-operator-controller-manager-648d5c98bc-8qpln" May 21 13:09:35.131374 ip-10-0-133-64 kubenswrapper[2562]: I0521 13:09:35.131338 2562 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-6bc9f4c76f-8qx4g"] May 21 13:09:35.135680 ip-10-0-133-64 kubenswrapper[2562]: I0521 13:09:35.135658 2562 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-6bc9f4c76f-8qx4g" May 21 13:09:35.139015 ip-10-0-133-64 kubenswrapper[2562]: I0521 13:09:35.138996 2562 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"kuadrant-operator-controller-manager-dockercfg-s5swn\"" May 21 13:09:35.147968 ip-10-0-133-64 kubenswrapper[2562]: I0521 13:09:35.147940 2562 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-6bc9f4c76f-8qx4g"] May 21 13:09:35.220166 ip-10-0-133-64 kubenswrapper[2562]: I0521 13:09:35.220133 2562 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-6bc9f4c76f-8qx4g"] May 21 13:09:35.220407 ip-10-0-133-64 kubenswrapper[2562]: E0521 13:09:35.220378 2562 pod_workers.go:1301] "Error syncing pod, skipping" err="unmounted volumes=[extensions-socket-volume kube-api-access-pghqm], unattached volumes=[], failed to process volumes=[]: context canceled" pod="kuadrant-system/kuadrant-operator-controller-manager-6bc9f4c76f-8qx4g" podUID="e0c3d322-fb3c-4bae-85dd-33fbbf1b2006" May 21 13:09:35.260281 ip-10-0-133-64 kubenswrapper[2562]: I0521 13:09:35.260241 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-pghqm\" (UniqueName: \"kubernetes.io/projected/e0c3d322-fb3c-4bae-85dd-33fbbf1b2006-kube-api-access-pghqm\") pod \"kuadrant-operator-controller-manager-6bc9f4c76f-8qx4g\" (UID: \"e0c3d322-fb3c-4bae-85dd-33fbbf1b2006\") " pod="kuadrant-system/kuadrant-operator-controller-manager-6bc9f4c76f-8qx4g" May 21 13:09:35.260448 ip-10-0-133-64 kubenswrapper[2562]: I0521 13:09:35.260299 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/e0c3d322-fb3c-4bae-85dd-33fbbf1b2006-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-6bc9f4c76f-8qx4g\" (UID: \"e0c3d322-fb3c-4bae-85dd-33fbbf1b2006\") " pod="kuadrant-system/kuadrant-operator-controller-manager-6bc9f4c76f-8qx4g" May 21 13:09:35.361426 ip-10-0-133-64 kubenswrapper[2562]: I0521 13:09:35.361393 2562 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-pghqm\" (UniqueName: \"kubernetes.io/projected/e0c3d322-fb3c-4bae-85dd-33fbbf1b2006-kube-api-access-pghqm\") pod \"kuadrant-operator-controller-manager-6bc9f4c76f-8qx4g\" (UID: \"e0c3d322-fb3c-4bae-85dd-33fbbf1b2006\") " pod="kuadrant-system/kuadrant-operator-controller-manager-6bc9f4c76f-8qx4g" May 21 13:09:35.361596 ip-10-0-133-64 kubenswrapper[2562]: I0521 13:09:35.361448 2562 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/e0c3d322-fb3c-4bae-85dd-33fbbf1b2006-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-6bc9f4c76f-8qx4g\" (UID: \"e0c3d322-fb3c-4bae-85dd-33fbbf1b2006\") " pod="kuadrant-system/kuadrant-operator-controller-manager-6bc9f4c76f-8qx4g" May 21 13:09:35.361890 ip-10-0-133-64 kubenswrapper[2562]: I0521 13:09:35.361871 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/e0c3d322-fb3c-4bae-85dd-33fbbf1b2006-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-6bc9f4c76f-8qx4g\" (UID: \"e0c3d322-fb3c-4bae-85dd-33fbbf1b2006\") " pod="kuadrant-system/kuadrant-operator-controller-manager-6bc9f4c76f-8qx4g" May 21 13:09:35.375138 ip-10-0-133-64 kubenswrapper[2562]: I0521 13:09:35.375114 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-pghqm\" (UniqueName: \"kubernetes.io/projected/e0c3d322-fb3c-4bae-85dd-33fbbf1b2006-kube-api-access-pghqm\") pod \"kuadrant-operator-controller-manager-6bc9f4c76f-8qx4g\" (UID: \"e0c3d322-fb3c-4bae-85dd-33fbbf1b2006\") " pod="kuadrant-system/kuadrant-operator-controller-manager-6bc9f4c76f-8qx4g" May 21 13:09:35.599467 ip-10-0-133-64 kubenswrapper[2562]: I0521 13:09:35.599432 2562 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-6bc9f4c76f-8qx4g" May 21 13:09:35.604478 ip-10-0-133-64 kubenswrapper[2562]: I0521 13:09:35.604456 2562 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-6bc9f4c76f-8qx4g" May 21 13:09:35.755218 ip-10-0-133-64 kubenswrapper[2562]: I0521 13:09:35.755184 2562 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-6bc9f4c76f-8qx4g"] May 21 13:09:35.764543 ip-10-0-133-64 kubenswrapper[2562]: I0521 13:09:35.764507 2562 kubelet.go:2547] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-6bc9f4c76f-8qx4g"] May 21 13:09:35.765735 ip-10-0-133-64 kubenswrapper[2562]: I0521 13:09:35.765710 2562 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/e0c3d322-fb3c-4bae-85dd-33fbbf1b2006-extensions-socket-volume\") pod \"e0c3d322-fb3c-4bae-85dd-33fbbf1b2006\" (UID: \"e0c3d322-fb3c-4bae-85dd-33fbbf1b2006\") " May 21 13:09:35.765892 ip-10-0-133-64 kubenswrapper[2562]: I0521 13:09:35.765846 2562 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-pghqm\" (UniqueName: \"kubernetes.io/projected/e0c3d322-fb3c-4bae-85dd-33fbbf1b2006-kube-api-access-pghqm\") pod \"e0c3d322-fb3c-4bae-85dd-33fbbf1b2006\" (UID: \"e0c3d322-fb3c-4bae-85dd-33fbbf1b2006\") " May 21 13:09:35.766043 ip-10-0-133-64 kubenswrapper[2562]: I0521 13:09:35.766005 2562 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/e0c3d322-fb3c-4bae-85dd-33fbbf1b2006-extensions-socket-volume" (OuterVolumeSpecName: "extensions-socket-volume") pod "e0c3d322-fb3c-4bae-85dd-33fbbf1b2006" (UID: "e0c3d322-fb3c-4bae-85dd-33fbbf1b2006"). InnerVolumeSpecName "extensions-socket-volume". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" May 21 13:09:35.768330 ip-10-0-133-64 kubenswrapper[2562]: I0521 13:09:35.768303 2562 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/e0c3d322-fb3c-4bae-85dd-33fbbf1b2006-kube-api-access-pghqm" (OuterVolumeSpecName: "kube-api-access-pghqm") pod "e0c3d322-fb3c-4bae-85dd-33fbbf1b2006" (UID: "e0c3d322-fb3c-4bae-85dd-33fbbf1b2006"). InnerVolumeSpecName "kube-api-access-pghqm". PluginName "kubernetes.io/projected", VolumeGIDValue "" May 21 13:09:35.809936 ip-10-0-133-64 kubenswrapper[2562]: I0521 13:09:35.809900 2562 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-84b657d985-xtmns"] May 21 13:09:35.813682 ip-10-0-133-64 kubenswrapper[2562]: I0521 13:09:35.813655 2562 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-84b657d985-xtmns" May 21 13:09:35.828229 ip-10-0-133-64 kubenswrapper[2562]: I0521 13:09:35.828199 2562 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-84b657d985-xtmns"] May 21 13:09:35.867130 ip-10-0-133-64 kubenswrapper[2562]: I0521 13:09:35.867056 2562 reconciler_common.go:299] "Volume detached for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/e0c3d322-fb3c-4bae-85dd-33fbbf1b2006-extensions-socket-volume\") on node \"ip-10-0-133-64.ec2.internal\" DevicePath \"\"" May 21 13:09:35.867130 ip-10-0-133-64 kubenswrapper[2562]: I0521 13:09:35.867086 2562 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-pghqm\" (UniqueName: \"kubernetes.io/projected/e0c3d322-fb3c-4bae-85dd-33fbbf1b2006-kube-api-access-pghqm\") on node \"ip-10-0-133-64.ec2.internal\" DevicePath \"\"" May 21 13:09:35.967810 ip-10-0-133-64 kubenswrapper[2562]: I0521 13:09:35.967765 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-4n4sq\" (UniqueName: \"kubernetes.io/projected/a2a39d33-35e9-4c25-b7bf-f56bfd6ec047-kube-api-access-4n4sq\") pod \"kuadrant-operator-controller-manager-84b657d985-xtmns\" (UID: \"a2a39d33-35e9-4c25-b7bf-f56bfd6ec047\") " pod="kuadrant-system/kuadrant-operator-controller-manager-84b657d985-xtmns" May 21 13:09:35.967996 ip-10-0-133-64 kubenswrapper[2562]: I0521 13:09:35.967912 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/a2a39d33-35e9-4c25-b7bf-f56bfd6ec047-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-84b657d985-xtmns\" (UID: \"a2a39d33-35e9-4c25-b7bf-f56bfd6ec047\") " pod="kuadrant-system/kuadrant-operator-controller-manager-84b657d985-xtmns" May 21 13:09:36.039370 ip-10-0-133-64 kubenswrapper[2562]: I0521 13:09:36.039330 2562 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="e0c3d322-fb3c-4bae-85dd-33fbbf1b2006" path="/var/lib/kubelet/pods/e0c3d322-fb3c-4bae-85dd-33fbbf1b2006/volumes" May 21 13:09:36.069026 ip-10-0-133-64 kubenswrapper[2562]: I0521 13:09:36.068994 2562 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/a2a39d33-35e9-4c25-b7bf-f56bfd6ec047-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-84b657d985-xtmns\" (UID: \"a2a39d33-35e9-4c25-b7bf-f56bfd6ec047\") " pod="kuadrant-system/kuadrant-operator-controller-manager-84b657d985-xtmns" May 21 13:09:36.069163 ip-10-0-133-64 kubenswrapper[2562]: I0521 13:09:36.069076 2562 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-4n4sq\" (UniqueName: \"kubernetes.io/projected/a2a39d33-35e9-4c25-b7bf-f56bfd6ec047-kube-api-access-4n4sq\") pod \"kuadrant-operator-controller-manager-84b657d985-xtmns\" (UID: \"a2a39d33-35e9-4c25-b7bf-f56bfd6ec047\") " pod="kuadrant-system/kuadrant-operator-controller-manager-84b657d985-xtmns" May 21 13:09:36.069457 ip-10-0-133-64 kubenswrapper[2562]: I0521 13:09:36.069431 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/a2a39d33-35e9-4c25-b7bf-f56bfd6ec047-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-84b657d985-xtmns\" (UID: \"a2a39d33-35e9-4c25-b7bf-f56bfd6ec047\") " pod="kuadrant-system/kuadrant-operator-controller-manager-84b657d985-xtmns" May 21 13:09:36.081028 ip-10-0-133-64 kubenswrapper[2562]: I0521 13:09:36.081000 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-4n4sq\" (UniqueName: \"kubernetes.io/projected/a2a39d33-35e9-4c25-b7bf-f56bfd6ec047-kube-api-access-4n4sq\") pod \"kuadrant-operator-controller-manager-84b657d985-xtmns\" (UID: \"a2a39d33-35e9-4c25-b7bf-f56bfd6ec047\") " pod="kuadrant-system/kuadrant-operator-controller-manager-84b657d985-xtmns" May 21 13:09:36.128567 ip-10-0-133-64 kubenswrapper[2562]: I0521 13:09:36.128472 2562 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-84b657d985-xtmns" May 21 13:09:36.298553 ip-10-0-133-64 kubenswrapper[2562]: I0521 13:09:36.298517 2562 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-84b657d985-xtmns"] May 21 13:09:36.299703 ip-10-0-133-64 kubenswrapper[2562]: W0521 13:09:36.299676 2562 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poda2a39d33_35e9_4c25_b7bf_f56bfd6ec047.slice/crio-0434e5aaab74f7cc33079bc882b5ce5735597d1bb68de94fea697bd5780836a2 WatchSource:0}: Error finding container 0434e5aaab74f7cc33079bc882b5ce5735597d1bb68de94fea697bd5780836a2: Status 404 returned error can't find the container with id 0434e5aaab74f7cc33079bc882b5ce5735597d1bb68de94fea697bd5780836a2 May 21 13:09:36.604613 ip-10-0-133-64 kubenswrapper[2562]: I0521 13:09:36.604578 2562 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-6bc9f4c76f-8qx4g" May 21 13:09:36.604820 ip-10-0-133-64 kubenswrapper[2562]: I0521 13:09:36.604579 2562 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-84b657d985-xtmns" event={"ID":"a2a39d33-35e9-4c25-b7bf-f56bfd6ec047","Type":"ContainerStarted","Data":"0434e5aaab74f7cc33079bc882b5ce5735597d1bb68de94fea697bd5780836a2"} May 21 13:09:42.607437 ip-10-0-133-64 kubenswrapper[2562]: I0521 13:09:42.607394 2562 kuberuntime_container.go:864] "Killing container with a grace period" pod="openshift-console/console-5846c7d4fc-d6vkl" podUID="61c9864a-6ce0-4dfa-aed5-be86a6b92a63" containerName="console" containerID="cri-o://ab6e5cf3bb8a3c04eab5e2b054aaa09dbb4c0054f548b61902e62ac4f812b27d" gracePeriod=15 May 21 13:09:49.705699 ip-10-0-133-64 kubenswrapper[2562]: I0521 13:09:49.705644 2562 patch_prober.go:28] interesting pod/console-5846c7d4fc-d6vkl container/console namespace/openshift-console: Readiness probe status=failure output="Get \"https://10.133.0.21:8443/health\": dial tcp 10.133.0.21:8443: connect: connection refused" start-of-body= May 21 13:09:49.706242 ip-10-0-133-64 kubenswrapper[2562]: I0521 13:09:49.705709 2562 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-console/console-5846c7d4fc-d6vkl" podUID="61c9864a-6ce0-4dfa-aed5-be86a6b92a63" containerName="console" probeResult="failure" output="Get \"https://10.133.0.21:8443/health\": dial tcp 10.133.0.21:8443: connect: connection refused" May 21 13:09:51.097828 ip-10-0-133-64 kubenswrapper[2562]: I0521 13:09:51.097786 2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console_console-5846c7d4fc-d6vkl_61c9864a-6ce0-4dfa-aed5-be86a6b92a63/console/0.log" May 21 13:09:51.098171 ip-10-0-133-64 kubenswrapper[2562]: I0521 13:09:51.097877 2562 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-5846c7d4fc-d6vkl" May 21 13:09:51.206214 ip-10-0-133-64 kubenswrapper[2562]: I0521 13:09:51.206180 2562 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/61c9864a-6ce0-4dfa-aed5-be86a6b92a63-console-oauth-config\") pod \"61c9864a-6ce0-4dfa-aed5-be86a6b92a63\" (UID: \"61c9864a-6ce0-4dfa-aed5-be86a6b92a63\") " May 21 13:09:51.206398 ip-10-0-133-64 kubenswrapper[2562]: I0521 13:09:51.206234 2562 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/61c9864a-6ce0-4dfa-aed5-be86a6b92a63-trusted-ca-bundle\") pod \"61c9864a-6ce0-4dfa-aed5-be86a6b92a63\" (UID: \"61c9864a-6ce0-4dfa-aed5-be86a6b92a63\") " May 21 13:09:51.206460 ip-10-0-133-64 kubenswrapper[2562]: I0521 13:09:51.206421 2562 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/61c9864a-6ce0-4dfa-aed5-be86a6b92a63-oauth-serving-cert\") pod \"61c9864a-6ce0-4dfa-aed5-be86a6b92a63\" (UID: \"61c9864a-6ce0-4dfa-aed5-be86a6b92a63\") " May 21 13:09:51.206513 ip-10-0-133-64 kubenswrapper[2562]: I0521 13:09:51.206461 2562 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-lrdzc\" (UniqueName: \"kubernetes.io/projected/61c9864a-6ce0-4dfa-aed5-be86a6b92a63-kube-api-access-lrdzc\") pod \"61c9864a-6ce0-4dfa-aed5-be86a6b92a63\" (UID: \"61c9864a-6ce0-4dfa-aed5-be86a6b92a63\") " May 21 13:09:51.206582 ip-10-0-133-64 kubenswrapper[2562]: I0521 13:09:51.206561 2562 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/61c9864a-6ce0-4dfa-aed5-be86a6b92a63-service-ca\") pod \"61c9864a-6ce0-4dfa-aed5-be86a6b92a63\" (UID: \"61c9864a-6ce0-4dfa-aed5-be86a6b92a63\") " May 21 13:09:51.206649 ip-10-0-133-64 kubenswrapper[2562]: I0521 13:09:51.206626 2562 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/61c9864a-6ce0-4dfa-aed5-be86a6b92a63-console-config\") pod \"61c9864a-6ce0-4dfa-aed5-be86a6b92a63\" (UID: \"61c9864a-6ce0-4dfa-aed5-be86a6b92a63\") " May 21 13:09:51.206707 ip-10-0-133-64 kubenswrapper[2562]: I0521 13:09:51.206661 2562 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/61c9864a-6ce0-4dfa-aed5-be86a6b92a63-trusted-ca-bundle" (OuterVolumeSpecName: "trusted-ca-bundle") pod "61c9864a-6ce0-4dfa-aed5-be86a6b92a63" (UID: "61c9864a-6ce0-4dfa-aed5-be86a6b92a63"). InnerVolumeSpecName "trusted-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue "" May 21 13:09:51.206707 ip-10-0-133-64 kubenswrapper[2562]: I0521 13:09:51.206676 2562 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/61c9864a-6ce0-4dfa-aed5-be86a6b92a63-console-serving-cert\") pod \"61c9864a-6ce0-4dfa-aed5-be86a6b92a63\" (UID: \"61c9864a-6ce0-4dfa-aed5-be86a6b92a63\") " May 21 13:09:51.207366 ip-10-0-133-64 kubenswrapper[2562]: I0521 13:09:51.206980 2562 reconciler_common.go:299] "Volume detached for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/61c9864a-6ce0-4dfa-aed5-be86a6b92a63-trusted-ca-bundle\") on node \"ip-10-0-133-64.ec2.internal\" DevicePath \"\"" May 21 13:09:51.207366 ip-10-0-133-64 kubenswrapper[2562]: I0521 13:09:51.207010 2562 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/61c9864a-6ce0-4dfa-aed5-be86a6b92a63-oauth-serving-cert" (OuterVolumeSpecName: "oauth-serving-cert") pod "61c9864a-6ce0-4dfa-aed5-be86a6b92a63" (UID: "61c9864a-6ce0-4dfa-aed5-be86a6b92a63"). InnerVolumeSpecName "oauth-serving-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue "" May 21 13:09:51.207366 ip-10-0-133-64 kubenswrapper[2562]: I0521 13:09:51.207071 2562 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/61c9864a-6ce0-4dfa-aed5-be86a6b92a63-service-ca" (OuterVolumeSpecName: "service-ca") pod "61c9864a-6ce0-4dfa-aed5-be86a6b92a63" (UID: "61c9864a-6ce0-4dfa-aed5-be86a6b92a63"). InnerVolumeSpecName "service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue "" May 21 13:09:51.207366 ip-10-0-133-64 kubenswrapper[2562]: I0521 13:09:51.207331 2562 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/61c9864a-6ce0-4dfa-aed5-be86a6b92a63-console-config" (OuterVolumeSpecName: "console-config") pod "61c9864a-6ce0-4dfa-aed5-be86a6b92a63" (UID: "61c9864a-6ce0-4dfa-aed5-be86a6b92a63"). InnerVolumeSpecName "console-config". PluginName "kubernetes.io/configmap", VolumeGIDValue "" May 21 13:09:51.208727 ip-10-0-133-64 kubenswrapper[2562]: I0521 13:09:51.208705 2562 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/61c9864a-6ce0-4dfa-aed5-be86a6b92a63-console-oauth-config" (OuterVolumeSpecName: "console-oauth-config") pod "61c9864a-6ce0-4dfa-aed5-be86a6b92a63" (UID: "61c9864a-6ce0-4dfa-aed5-be86a6b92a63"). InnerVolumeSpecName "console-oauth-config". PluginName "kubernetes.io/secret", VolumeGIDValue "" May 21 13:09:51.210169 ip-10-0-133-64 kubenswrapper[2562]: I0521 13:09:51.210145 2562 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/61c9864a-6ce0-4dfa-aed5-be86a6b92a63-console-serving-cert" (OuterVolumeSpecName: "console-serving-cert") pod "61c9864a-6ce0-4dfa-aed5-be86a6b92a63" (UID: "61c9864a-6ce0-4dfa-aed5-be86a6b92a63"). InnerVolumeSpecName "console-serving-cert". PluginName "kubernetes.io/secret", VolumeGIDValue "" May 21 13:09:51.210351 ip-10-0-133-64 kubenswrapper[2562]: I0521 13:09:51.210316 2562 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/61c9864a-6ce0-4dfa-aed5-be86a6b92a63-kube-api-access-lrdzc" (OuterVolumeSpecName: "kube-api-access-lrdzc") pod "61c9864a-6ce0-4dfa-aed5-be86a6b92a63" (UID: "61c9864a-6ce0-4dfa-aed5-be86a6b92a63"). InnerVolumeSpecName "kube-api-access-lrdzc". PluginName "kubernetes.io/projected", VolumeGIDValue "" May 21 13:09:51.307720 ip-10-0-133-64 kubenswrapper[2562]: I0521 13:09:51.307688 2562 reconciler_common.go:299] "Volume detached for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/61c9864a-6ce0-4dfa-aed5-be86a6b92a63-service-ca\") on node \"ip-10-0-133-64.ec2.internal\" DevicePath \"\"" May 21 13:09:51.307720 ip-10-0-133-64 kubenswrapper[2562]: I0521 13:09:51.307715 2562 reconciler_common.go:299] "Volume detached for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/61c9864a-6ce0-4dfa-aed5-be86a6b92a63-console-config\") on node \"ip-10-0-133-64.ec2.internal\" DevicePath \"\"" May 21 13:09:51.307720 ip-10-0-133-64 kubenswrapper[2562]: I0521 13:09:51.307725 2562 reconciler_common.go:299] "Volume detached for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/61c9864a-6ce0-4dfa-aed5-be86a6b92a63-console-serving-cert\") on node \"ip-10-0-133-64.ec2.internal\" DevicePath \"\"" May 21 13:09:51.307986 ip-10-0-133-64 kubenswrapper[2562]: I0521 13:09:51.307735 2562 reconciler_common.go:299] "Volume detached for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/61c9864a-6ce0-4dfa-aed5-be86a6b92a63-console-oauth-config\") on node \"ip-10-0-133-64.ec2.internal\" DevicePath \"\"" May 21 13:09:51.307986 ip-10-0-133-64 kubenswrapper[2562]: I0521 13:09:51.307746 2562 reconciler_common.go:299] "Volume detached for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/61c9864a-6ce0-4dfa-aed5-be86a6b92a63-oauth-serving-cert\") on node \"ip-10-0-133-64.ec2.internal\" DevicePath \"\"" May 21 13:09:51.307986 ip-10-0-133-64 kubenswrapper[2562]: I0521 13:09:51.307755 2562 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-lrdzc\" (UniqueName: \"kubernetes.io/projected/61c9864a-6ce0-4dfa-aed5-be86a6b92a63-kube-api-access-lrdzc\") on node \"ip-10-0-133-64.ec2.internal\" DevicePath \"\"" May 21 13:09:51.671003 ip-10-0-133-64 kubenswrapper[2562]: I0521 13:09:51.670924 2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console_console-5846c7d4fc-d6vkl_61c9864a-6ce0-4dfa-aed5-be86a6b92a63/console/0.log" May 21 13:09:51.671003 ip-10-0-133-64 kubenswrapper[2562]: I0521 13:09:51.670969 2562 generic.go:358] "Generic (PLEG): container finished" podID="61c9864a-6ce0-4dfa-aed5-be86a6b92a63" containerID="ab6e5cf3bb8a3c04eab5e2b054aaa09dbb4c0054f548b61902e62ac4f812b27d" exitCode=2 May 21 13:09:51.671218 ip-10-0-133-64 kubenswrapper[2562]: I0521 13:09:51.671046 2562 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-5846c7d4fc-d6vkl" May 21 13:09:51.671218 ip-10-0-133-64 kubenswrapper[2562]: I0521 13:09:51.671062 2562 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-5846c7d4fc-d6vkl" event={"ID":"61c9864a-6ce0-4dfa-aed5-be86a6b92a63","Type":"ContainerDied","Data":"ab6e5cf3bb8a3c04eab5e2b054aaa09dbb4c0054f548b61902e62ac4f812b27d"} May 21 13:09:51.671218 ip-10-0-133-64 kubenswrapper[2562]: I0521 13:09:51.671098 2562 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-5846c7d4fc-d6vkl" event={"ID":"61c9864a-6ce0-4dfa-aed5-be86a6b92a63","Type":"ContainerDied","Data":"495935d5e21ab6bda3be21b011947a8af5a35df522f781e09fcc643468958cae"} May 21 13:09:51.671218 ip-10-0-133-64 kubenswrapper[2562]: I0521 13:09:51.671118 2562 scope.go:117] "RemoveContainer" containerID="ab6e5cf3bb8a3c04eab5e2b054aaa09dbb4c0054f548b61902e62ac4f812b27d" May 21 13:09:51.672692 ip-10-0-133-64 kubenswrapper[2562]: I0521 13:09:51.672661 2562 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-console-plugin-6cb54b5c86-6kd5h" event={"ID":"52ecb5cc-48f7-4b5e-ad22-553c76f6c243","Type":"ContainerStarted","Data":"a951de53849567ac6f28007e66391014b9f72db606d8e66a1718c33798d6f72e"} May 21 13:09:51.682386 ip-10-0-133-64 kubenswrapper[2562]: I0521 13:09:51.682371 2562 scope.go:117] "RemoveContainer" containerID="ab6e5cf3bb8a3c04eab5e2b054aaa09dbb4c0054f548b61902e62ac4f812b27d" May 21 13:09:51.682638 ip-10-0-133-64 kubenswrapper[2562]: E0521 13:09:51.682618 2562 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"ab6e5cf3bb8a3c04eab5e2b054aaa09dbb4c0054f548b61902e62ac4f812b27d\": container with ID starting with ab6e5cf3bb8a3c04eab5e2b054aaa09dbb4c0054f548b61902e62ac4f812b27d not found: ID does not exist" containerID="ab6e5cf3bb8a3c04eab5e2b054aaa09dbb4c0054f548b61902e62ac4f812b27d" May 21 13:09:51.682709 ip-10-0-133-64 kubenswrapper[2562]: I0521 13:09:51.682648 2562 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"ab6e5cf3bb8a3c04eab5e2b054aaa09dbb4c0054f548b61902e62ac4f812b27d"} err="failed to get container status \"ab6e5cf3bb8a3c04eab5e2b054aaa09dbb4c0054f548b61902e62ac4f812b27d\": rpc error: code = NotFound desc = could not find container \"ab6e5cf3bb8a3c04eab5e2b054aaa09dbb4c0054f548b61902e62ac4f812b27d\": container with ID starting with ab6e5cf3bb8a3c04eab5e2b054aaa09dbb4c0054f548b61902e62ac4f812b27d not found: ID does not exist" May 21 13:09:51.692282 ip-10-0-133-64 kubenswrapper[2562]: I0521 13:09:51.692230 2562 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="kuadrant-system/kuadrant-console-plugin-6cb54b5c86-6kd5h" podStartSLOduration=1.536223656 podStartE2EDuration="26.692215231s" podCreationTimestamp="2026-05-21 13:09:25 +0000 UTC" firstStartedPulling="2026-05-21 13:09:25.876304226 +0000 UTC m=+412.426585576" lastFinishedPulling="2026-05-21 13:09:51.032295806 +0000 UTC m=+437.582577151" observedRunningTime="2026-05-21 13:09:51.690423987 +0000 UTC m=+438.240705355" watchObservedRunningTime="2026-05-21 13:09:51.692215231 +0000 UTC m=+438.242496598" May 21 13:09:51.709751 ip-10-0-133-64 kubenswrapper[2562]: I0521 13:09:51.709726 2562 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openshift-console/console-5846c7d4fc-d6vkl"] May 21 13:09:51.720943 ip-10-0-133-64 kubenswrapper[2562]: I0521 13:09:51.720912 2562 kubelet.go:2547] "SyncLoop REMOVE" source="api" pods=["openshift-console/console-5846c7d4fc-d6vkl"] May 21 13:09:52.037505 ip-10-0-133-64 kubenswrapper[2562]: I0521 13:09:52.037465 2562 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="61c9864a-6ce0-4dfa-aed5-be86a6b92a63" path="/var/lib/kubelet/pods/61c9864a-6ce0-4dfa-aed5-be86a6b92a63/volumes" May 21 13:09:55.690676 ip-10-0-133-64 kubenswrapper[2562]: I0521 13:09:55.690634 2562 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-84b657d985-xtmns" event={"ID":"a2a39d33-35e9-4c25-b7bf-f56bfd6ec047","Type":"ContainerStarted","Data":"2f5e7e8a58a0dc340073bb669683e489b7b2093bf9fda8d3128d9dfc05cda961"} May 21 13:09:55.691109 ip-10-0-133-64 kubenswrapper[2562]: I0521 13:09:55.690743 2562 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/kuadrant-operator-controller-manager-84b657d985-xtmns" May 21 13:09:55.713022 ip-10-0-133-64 kubenswrapper[2562]: I0521 13:09:55.712966 2562 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="kuadrant-system/kuadrant-operator-controller-manager-84b657d985-xtmns" podStartSLOduration=2.119187825 podStartE2EDuration="20.712951846s" podCreationTimestamp="2026-05-21 13:09:35 +0000 UTC" firstStartedPulling="2026-05-21 13:09:36.302962458 +0000 UTC m=+422.853243804" lastFinishedPulling="2026-05-21 13:09:54.896726474 +0000 UTC m=+441.447007825" observedRunningTime="2026-05-21 13:09:55.709391952 +0000 UTC m=+442.259673321" watchObservedRunningTime="2026-05-21 13:09:55.712951846 +0000 UTC m=+442.263233213" May 21 13:10:06.697270 ip-10-0-133-64 kubenswrapper[2562]: I0521 13:10:06.697236 2562 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/kuadrant-operator-controller-manager-84b657d985-xtmns" May 21 13:10:19.247618 ip-10-0-133-64 kubenswrapper[2562]: I0521 13:10:19.247580 2562 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-84b657d985-xtmns"] May 21 13:10:19.248313 ip-10-0-133-64 kubenswrapper[2562]: I0521 13:10:19.247873 2562 kuberuntime_container.go:864] "Killing container with a grace period" pod="kuadrant-system/kuadrant-operator-controller-manager-84b657d985-xtmns" podUID="a2a39d33-35e9-4c25-b7bf-f56bfd6ec047" containerName="manager" containerID="cri-o://2f5e7e8a58a0dc340073bb669683e489b7b2093bf9fda8d3128d9dfc05cda961" gracePeriod=10 May 21 13:10:19.497465 ip-10-0-133-64 kubenswrapper[2562]: I0521 13:10:19.497441 2562 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-84b657d985-xtmns" May 21 13:10:19.658133 ip-10-0-133-64 kubenswrapper[2562]: I0521 13:10:19.658050 2562 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/a2a39d33-35e9-4c25-b7bf-f56bfd6ec047-extensions-socket-volume\") pod \"a2a39d33-35e9-4c25-b7bf-f56bfd6ec047\" (UID: \"a2a39d33-35e9-4c25-b7bf-f56bfd6ec047\") " May 21 13:10:19.658300 ip-10-0-133-64 kubenswrapper[2562]: I0521 13:10:19.658165 2562 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-4n4sq\" (UniqueName: \"kubernetes.io/projected/a2a39d33-35e9-4c25-b7bf-f56bfd6ec047-kube-api-access-4n4sq\") pod \"a2a39d33-35e9-4c25-b7bf-f56bfd6ec047\" (UID: \"a2a39d33-35e9-4c25-b7bf-f56bfd6ec047\") " May 21 13:10:19.658558 ip-10-0-133-64 kubenswrapper[2562]: I0521 13:10:19.658527 2562 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/a2a39d33-35e9-4c25-b7bf-f56bfd6ec047-extensions-socket-volume" (OuterVolumeSpecName: "extensions-socket-volume") pod "a2a39d33-35e9-4c25-b7bf-f56bfd6ec047" (UID: "a2a39d33-35e9-4c25-b7bf-f56bfd6ec047"). InnerVolumeSpecName "extensions-socket-volume". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" May 21 13:10:19.660381 ip-10-0-133-64 kubenswrapper[2562]: I0521 13:10:19.660345 2562 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/a2a39d33-35e9-4c25-b7bf-f56bfd6ec047-kube-api-access-4n4sq" (OuterVolumeSpecName: "kube-api-access-4n4sq") pod "a2a39d33-35e9-4c25-b7bf-f56bfd6ec047" (UID: "a2a39d33-35e9-4c25-b7bf-f56bfd6ec047"). InnerVolumeSpecName "kube-api-access-4n4sq". PluginName "kubernetes.io/projected", VolumeGIDValue "" May 21 13:10:19.759299 ip-10-0-133-64 kubenswrapper[2562]: I0521 13:10:19.759256 2562 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-4n4sq\" (UniqueName: \"kubernetes.io/projected/a2a39d33-35e9-4c25-b7bf-f56bfd6ec047-kube-api-access-4n4sq\") on node \"ip-10-0-133-64.ec2.internal\" DevicePath \"\"" May 21 13:10:19.759299 ip-10-0-133-64 kubenswrapper[2562]: I0521 13:10:19.759293 2562 reconciler_common.go:299] "Volume detached for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/a2a39d33-35e9-4c25-b7bf-f56bfd6ec047-extensions-socket-volume\") on node \"ip-10-0-133-64.ec2.internal\" DevicePath \"\"" May 21 13:10:19.788478 ip-10-0-133-64 kubenswrapper[2562]: I0521 13:10:19.788447 2562 generic.go:358] "Generic (PLEG): container finished" podID="a2a39d33-35e9-4c25-b7bf-f56bfd6ec047" containerID="2f5e7e8a58a0dc340073bb669683e489b7b2093bf9fda8d3128d9dfc05cda961" exitCode=0 May 21 13:10:19.788622 ip-10-0-133-64 kubenswrapper[2562]: I0521 13:10:19.788519 2562 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-84b657d985-xtmns" May 21 13:10:19.788622 ip-10-0-133-64 kubenswrapper[2562]: I0521 13:10:19.788537 2562 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-84b657d985-xtmns" event={"ID":"a2a39d33-35e9-4c25-b7bf-f56bfd6ec047","Type":"ContainerDied","Data":"2f5e7e8a58a0dc340073bb669683e489b7b2093bf9fda8d3128d9dfc05cda961"} May 21 13:10:19.788622 ip-10-0-133-64 kubenswrapper[2562]: I0521 13:10:19.788585 2562 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-84b657d985-xtmns" event={"ID":"a2a39d33-35e9-4c25-b7bf-f56bfd6ec047","Type":"ContainerDied","Data":"0434e5aaab74f7cc33079bc882b5ce5735597d1bb68de94fea697bd5780836a2"} May 21 13:10:19.788622 ip-10-0-133-64 kubenswrapper[2562]: I0521 13:10:19.788602 2562 scope.go:117] "RemoveContainer" containerID="2f5e7e8a58a0dc340073bb669683e489b7b2093bf9fda8d3128d9dfc05cda961" May 21 13:10:19.797884 ip-10-0-133-64 kubenswrapper[2562]: I0521 13:10:19.797867 2562 scope.go:117] "RemoveContainer" containerID="2f5e7e8a58a0dc340073bb669683e489b7b2093bf9fda8d3128d9dfc05cda961" May 21 13:10:19.798124 ip-10-0-133-64 kubenswrapper[2562]: E0521 13:10:19.798103 2562 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"2f5e7e8a58a0dc340073bb669683e489b7b2093bf9fda8d3128d9dfc05cda961\": container with ID starting with 2f5e7e8a58a0dc340073bb669683e489b7b2093bf9fda8d3128d9dfc05cda961 not found: ID does not exist" containerID="2f5e7e8a58a0dc340073bb669683e489b7b2093bf9fda8d3128d9dfc05cda961" May 21 13:10:19.798178 ip-10-0-133-64 kubenswrapper[2562]: I0521 13:10:19.798132 2562 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"2f5e7e8a58a0dc340073bb669683e489b7b2093bf9fda8d3128d9dfc05cda961"} err="failed to get container status \"2f5e7e8a58a0dc340073bb669683e489b7b2093bf9fda8d3128d9dfc05cda961\": rpc error: code = NotFound desc = could not find container \"2f5e7e8a58a0dc340073bb669683e489b7b2093bf9fda8d3128d9dfc05cda961\": container with ID starting with 2f5e7e8a58a0dc340073bb669683e489b7b2093bf9fda8d3128d9dfc05cda961 not found: ID does not exist" May 21 13:10:19.810575 ip-10-0-133-64 kubenswrapper[2562]: I0521 13:10:19.810544 2562 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-84b657d985-xtmns"] May 21 13:10:19.815867 ip-10-0-133-64 kubenswrapper[2562]: I0521 13:10:19.815834 2562 kubelet.go:2547] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-84b657d985-xtmns"] May 21 13:10:20.037989 ip-10-0-133-64 kubenswrapper[2562]: I0521 13:10:20.037962 2562 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="a2a39d33-35e9-4c25-b7bf-f56bfd6ec047" path="/var/lib/kubelet/pods/a2a39d33-35e9-4c25-b7bf-f56bfd6ec047/volumes" May 21 13:10:23.040278 ip-10-0-133-64 kubenswrapper[2562]: I0521 13:10:23.040241 2562 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-ingress/maas-default-gateway-openshift-default-7d6f447cf5-qf64l"] May 21 13:10:23.040914 ip-10-0-133-64 kubenswrapper[2562]: I0521 13:10:23.040723 2562 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="a2a39d33-35e9-4c25-b7bf-f56bfd6ec047" containerName="manager" May 21 13:10:23.040914 ip-10-0-133-64 kubenswrapper[2562]: I0521 13:10:23.040739 2562 state_mem.go:107] "Deleted CPUSet assignment" podUID="a2a39d33-35e9-4c25-b7bf-f56bfd6ec047" containerName="manager" May 21 13:10:23.040914 ip-10-0-133-64 kubenswrapper[2562]: I0521 13:10:23.040758 2562 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="61c9864a-6ce0-4dfa-aed5-be86a6b92a63" containerName="console" May 21 13:10:23.040914 ip-10-0-133-64 kubenswrapper[2562]: I0521 13:10:23.040766 2562 state_mem.go:107] "Deleted CPUSet assignment" podUID="61c9864a-6ce0-4dfa-aed5-be86a6b92a63" containerName="console" May 21 13:10:23.040914 ip-10-0-133-64 kubenswrapper[2562]: I0521 13:10:23.040860 2562 memory_manager.go:356] "RemoveStaleState removing state" podUID="61c9864a-6ce0-4dfa-aed5-be86a6b92a63" containerName="console" May 21 13:10:23.040914 ip-10-0-133-64 kubenswrapper[2562]: I0521 13:10:23.040877 2562 memory_manager.go:356] "RemoveStaleState removing state" podUID="a2a39d33-35e9-4c25-b7bf-f56bfd6ec047" containerName="manager" May 21 13:10:23.075474 ip-10-0-133-64 kubenswrapper[2562]: I0521 13:10:23.075446 2562 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/maas-default-gateway-openshift-default-7d6f447cf5-qf64l"] May 21 13:10:23.075605 ip-10-0-133-64 kubenswrapper[2562]: I0521 13:10:23.075569 2562 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/maas-default-gateway-openshift-default-7d6f447cf5-qf64l" May 21 13:10:23.077969 ip-10-0-133-64 kubenswrapper[2562]: I0521 13:10:23.077940 2562 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"maas-default-gateway-openshift-default-dockercfg-sd8qk\"" May 21 13:10:23.189134 ip-10-0-133-64 kubenswrapper[2562]: I0521 13:10:23.189086 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/f17e38b8-c261-4695-8953-81c8b2b40bc1-istio-token\") pod \"maas-default-gateway-openshift-default-7d6f447cf5-qf64l\" (UID: \"f17e38b8-c261-4695-8953-81c8b2b40bc1\") " pod="openshift-ingress/maas-default-gateway-openshift-default-7d6f447cf5-qf64l" May 21 13:10:23.189134 ip-10-0-133-64 kubenswrapper[2562]: I0521 13:10:23.189133 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-lp7t6\" (UniqueName: \"kubernetes.io/projected/f17e38b8-c261-4695-8953-81c8b2b40bc1-kube-api-access-lp7t6\") pod \"maas-default-gateway-openshift-default-7d6f447cf5-qf64l\" (UID: \"f17e38b8-c261-4695-8953-81c8b2b40bc1\") " pod="openshift-ingress/maas-default-gateway-openshift-default-7d6f447cf5-qf64l" May 21 13:10:23.189379 ip-10-0-133-64 kubenswrapper[2562]: I0521 13:10:23.189186 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/f17e38b8-c261-4695-8953-81c8b2b40bc1-istio-podinfo\") pod \"maas-default-gateway-openshift-default-7d6f447cf5-qf64l\" (UID: \"f17e38b8-c261-4695-8953-81c8b2b40bc1\") " pod="openshift-ingress/maas-default-gateway-openshift-default-7d6f447cf5-qf64l" May 21 13:10:23.189379 ip-10-0-133-64 kubenswrapper[2562]: I0521 13:10:23.189232 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/f17e38b8-c261-4695-8953-81c8b2b40bc1-workload-certs\") pod \"maas-default-gateway-openshift-default-7d6f447cf5-qf64l\" (UID: \"f17e38b8-c261-4695-8953-81c8b2b40bc1\") " pod="openshift-ingress/maas-default-gateway-openshift-default-7d6f447cf5-qf64l" May 21 13:10:23.189379 ip-10-0-133-64 kubenswrapper[2562]: I0521 13:10:23.189257 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/f17e38b8-c261-4695-8953-81c8b2b40bc1-istio-envoy\") pod \"maas-default-gateway-openshift-default-7d6f447cf5-qf64l\" (UID: \"f17e38b8-c261-4695-8953-81c8b2b40bc1\") " pod="openshift-ingress/maas-default-gateway-openshift-default-7d6f447cf5-qf64l" May 21 13:10:23.189379 ip-10-0-133-64 kubenswrapper[2562]: I0521 13:10:23.189344 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/f17e38b8-c261-4695-8953-81c8b2b40bc1-workload-socket\") pod \"maas-default-gateway-openshift-default-7d6f447cf5-qf64l\" (UID: \"f17e38b8-c261-4695-8953-81c8b2b40bc1\") " pod="openshift-ingress/maas-default-gateway-openshift-default-7d6f447cf5-qf64l" May 21 13:10:23.189379 ip-10-0-133-64 kubenswrapper[2562]: I0521 13:10:23.189362 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/f17e38b8-c261-4695-8953-81c8b2b40bc1-istiod-ca-cert\") pod \"maas-default-gateway-openshift-default-7d6f447cf5-qf64l\" (UID: \"f17e38b8-c261-4695-8953-81c8b2b40bc1\") " pod="openshift-ingress/maas-default-gateway-openshift-default-7d6f447cf5-qf64l" May 21 13:10:23.189379 ip-10-0-133-64 kubenswrapper[2562]: I0521 13:10:23.189378 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/f17e38b8-c261-4695-8953-81c8b2b40bc1-istio-data\") pod \"maas-default-gateway-openshift-default-7d6f447cf5-qf64l\" (UID: \"f17e38b8-c261-4695-8953-81c8b2b40bc1\") " pod="openshift-ingress/maas-default-gateway-openshift-default-7d6f447cf5-qf64l" May 21 13:10:23.189593 ip-10-0-133-64 kubenswrapper[2562]: I0521 13:10:23.189411 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/f17e38b8-c261-4695-8953-81c8b2b40bc1-credential-socket\") pod \"maas-default-gateway-openshift-default-7d6f447cf5-qf64l\" (UID: \"f17e38b8-c261-4695-8953-81c8b2b40bc1\") " pod="openshift-ingress/maas-default-gateway-openshift-default-7d6f447cf5-qf64l" May 21 13:10:23.289786 ip-10-0-133-64 kubenswrapper[2562]: I0521 13:10:23.289747 2562 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/f17e38b8-c261-4695-8953-81c8b2b40bc1-istio-data\") pod \"maas-default-gateway-openshift-default-7d6f447cf5-qf64l\" (UID: \"f17e38b8-c261-4695-8953-81c8b2b40bc1\") " pod="openshift-ingress/maas-default-gateway-openshift-default-7d6f447cf5-qf64l" May 21 13:10:23.289996 ip-10-0-133-64 kubenswrapper[2562]: I0521 13:10:23.289815 2562 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/f17e38b8-c261-4695-8953-81c8b2b40bc1-credential-socket\") pod \"maas-default-gateway-openshift-default-7d6f447cf5-qf64l\" (UID: \"f17e38b8-c261-4695-8953-81c8b2b40bc1\") " pod="openshift-ingress/maas-default-gateway-openshift-default-7d6f447cf5-qf64l" May 21 13:10:23.289996 ip-10-0-133-64 kubenswrapper[2562]: I0521 13:10:23.289847 2562 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/f17e38b8-c261-4695-8953-81c8b2b40bc1-istio-token\") pod \"maas-default-gateway-openshift-default-7d6f447cf5-qf64l\" (UID: \"f17e38b8-c261-4695-8953-81c8b2b40bc1\") " pod="openshift-ingress/maas-default-gateway-openshift-default-7d6f447cf5-qf64l" May 21 13:10:23.289996 ip-10-0-133-64 kubenswrapper[2562]: I0521 13:10:23.289870 2562 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-lp7t6\" (UniqueName: \"kubernetes.io/projected/f17e38b8-c261-4695-8953-81c8b2b40bc1-kube-api-access-lp7t6\") pod \"maas-default-gateway-openshift-default-7d6f447cf5-qf64l\" (UID: \"f17e38b8-c261-4695-8953-81c8b2b40bc1\") " pod="openshift-ingress/maas-default-gateway-openshift-default-7d6f447cf5-qf64l" May 21 13:10:23.289996 ip-10-0-133-64 kubenswrapper[2562]: I0521 13:10:23.289902 2562 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/f17e38b8-c261-4695-8953-81c8b2b40bc1-istio-podinfo\") pod \"maas-default-gateway-openshift-default-7d6f447cf5-qf64l\" (UID: \"f17e38b8-c261-4695-8953-81c8b2b40bc1\") " pod="openshift-ingress/maas-default-gateway-openshift-default-7d6f447cf5-qf64l" May 21 13:10:23.289996 ip-10-0-133-64 kubenswrapper[2562]: I0521 13:10:23.289947 2562 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/f17e38b8-c261-4695-8953-81c8b2b40bc1-workload-certs\") pod \"maas-default-gateway-openshift-default-7d6f447cf5-qf64l\" (UID: \"f17e38b8-c261-4695-8953-81c8b2b40bc1\") " pod="openshift-ingress/maas-default-gateway-openshift-default-7d6f447cf5-qf64l" May 21 13:10:23.289996 ip-10-0-133-64 kubenswrapper[2562]: I0521 13:10:23.289979 2562 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/f17e38b8-c261-4695-8953-81c8b2b40bc1-istio-envoy\") pod \"maas-default-gateway-openshift-default-7d6f447cf5-qf64l\" (UID: \"f17e38b8-c261-4695-8953-81c8b2b40bc1\") " pod="openshift-ingress/maas-default-gateway-openshift-default-7d6f447cf5-qf64l" May 21 13:10:23.290342 ip-10-0-133-64 kubenswrapper[2562]: I0521 13:10:23.290072 2562 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/f17e38b8-c261-4695-8953-81c8b2b40bc1-workload-socket\") pod \"maas-default-gateway-openshift-default-7d6f447cf5-qf64l\" (UID: \"f17e38b8-c261-4695-8953-81c8b2b40bc1\") " pod="openshift-ingress/maas-default-gateway-openshift-default-7d6f447cf5-qf64l" May 21 13:10:23.290342 ip-10-0-133-64 kubenswrapper[2562]: I0521 13:10:23.290099 2562 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/f17e38b8-c261-4695-8953-81c8b2b40bc1-istiod-ca-cert\") pod \"maas-default-gateway-openshift-default-7d6f447cf5-qf64l\" (UID: \"f17e38b8-c261-4695-8953-81c8b2b40bc1\") " pod="openshift-ingress/maas-default-gateway-openshift-default-7d6f447cf5-qf64l" May 21 13:10:23.290342 ip-10-0-133-64 kubenswrapper[2562]: I0521 13:10:23.290174 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/f17e38b8-c261-4695-8953-81c8b2b40bc1-istio-data\") pod \"maas-default-gateway-openshift-default-7d6f447cf5-qf64l\" (UID: \"f17e38b8-c261-4695-8953-81c8b2b40bc1\") " pod="openshift-ingress/maas-default-gateway-openshift-default-7d6f447cf5-qf64l" May 21 13:10:23.290342 ip-10-0-133-64 kubenswrapper[2562]: I0521 13:10:23.290228 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/f17e38b8-c261-4695-8953-81c8b2b40bc1-credential-socket\") pod \"maas-default-gateway-openshift-default-7d6f447cf5-qf64l\" (UID: \"f17e38b8-c261-4695-8953-81c8b2b40bc1\") " pod="openshift-ingress/maas-default-gateway-openshift-default-7d6f447cf5-qf64l" May 21 13:10:23.290342 ip-10-0-133-64 kubenswrapper[2562]: I0521 13:10:23.290308 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/f17e38b8-c261-4695-8953-81c8b2b40bc1-workload-certs\") pod \"maas-default-gateway-openshift-default-7d6f447cf5-qf64l\" (UID: \"f17e38b8-c261-4695-8953-81c8b2b40bc1\") " pod="openshift-ingress/maas-default-gateway-openshift-default-7d6f447cf5-qf64l" May 21 13:10:23.290615 ip-10-0-133-64 kubenswrapper[2562]: I0521 13:10:23.290366 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/f17e38b8-c261-4695-8953-81c8b2b40bc1-workload-socket\") pod \"maas-default-gateway-openshift-default-7d6f447cf5-qf64l\" (UID: \"f17e38b8-c261-4695-8953-81c8b2b40bc1\") " pod="openshift-ingress/maas-default-gateway-openshift-default-7d6f447cf5-qf64l" May 21 13:10:23.290821 ip-10-0-133-64 kubenswrapper[2562]: I0521 13:10:23.290770 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/f17e38b8-c261-4695-8953-81c8b2b40bc1-istiod-ca-cert\") pod \"maas-default-gateway-openshift-default-7d6f447cf5-qf64l\" (UID: \"f17e38b8-c261-4695-8953-81c8b2b40bc1\") " pod="openshift-ingress/maas-default-gateway-openshift-default-7d6f447cf5-qf64l" May 21 13:10:23.292243 ip-10-0-133-64 kubenswrapper[2562]: I0521 13:10:23.292222 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/f17e38b8-c261-4695-8953-81c8b2b40bc1-istio-envoy\") pod \"maas-default-gateway-openshift-default-7d6f447cf5-qf64l\" (UID: \"f17e38b8-c261-4695-8953-81c8b2b40bc1\") " pod="openshift-ingress/maas-default-gateway-openshift-default-7d6f447cf5-qf64l" May 21 13:10:23.292348 ip-10-0-133-64 kubenswrapper[2562]: I0521 13:10:23.292334 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/f17e38b8-c261-4695-8953-81c8b2b40bc1-istio-podinfo\") pod \"maas-default-gateway-openshift-default-7d6f447cf5-qf64l\" (UID: \"f17e38b8-c261-4695-8953-81c8b2b40bc1\") " pod="openshift-ingress/maas-default-gateway-openshift-default-7d6f447cf5-qf64l" May 21 13:10:23.297878 ip-10-0-133-64 kubenswrapper[2562]: I0521 13:10:23.297856 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/f17e38b8-c261-4695-8953-81c8b2b40bc1-istio-token\") pod \"maas-default-gateway-openshift-default-7d6f447cf5-qf64l\" (UID: \"f17e38b8-c261-4695-8953-81c8b2b40bc1\") " pod="openshift-ingress/maas-default-gateway-openshift-default-7d6f447cf5-qf64l" May 21 13:10:23.298060 ip-10-0-133-64 kubenswrapper[2562]: I0521 13:10:23.298040 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-lp7t6\" (UniqueName: \"kubernetes.io/projected/f17e38b8-c261-4695-8953-81c8b2b40bc1-kube-api-access-lp7t6\") pod \"maas-default-gateway-openshift-default-7d6f447cf5-qf64l\" (UID: \"f17e38b8-c261-4695-8953-81c8b2b40bc1\") " pod="openshift-ingress/maas-default-gateway-openshift-default-7d6f447cf5-qf64l" May 21 13:10:23.385454 ip-10-0-133-64 kubenswrapper[2562]: I0521 13:10:23.385414 2562 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/maas-default-gateway-openshift-default-7d6f447cf5-qf64l" May 21 13:10:23.517788 ip-10-0-133-64 kubenswrapper[2562]: I0521 13:10:23.517758 2562 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/maas-default-gateway-openshift-default-7d6f447cf5-qf64l"] May 21 13:10:23.521197 ip-10-0-133-64 kubenswrapper[2562]: W0521 13:10:23.521158 2562 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podf17e38b8_c261_4695_8953_81c8b2b40bc1.slice/crio-eaed77ec9f62df097faa17a9044bb0facbdf9cadc4f17b2dc1934e70ef6e41a8 WatchSource:0}: Error finding container eaed77ec9f62df097faa17a9044bb0facbdf9cadc4f17b2dc1934e70ef6e41a8: Status 404 returned error can't find the container with id eaed77ec9f62df097faa17a9044bb0facbdf9cadc4f17b2dc1934e70ef6e41a8 May 21 13:10:23.523847 ip-10-0-133-64 kubenswrapper[2562]: I0521 13:10:23.523813 2562 kubelet_resources.go:45] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"} May 21 13:10:23.523928 ip-10-0-133-64 kubenswrapper[2562]: I0521 13:10:23.523883 2562 kubelet_resources.go:45] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"} May 21 13:10:23.523928 ip-10-0-133-64 kubenswrapper[2562]: I0521 13:10:23.523914 2562 kubelet_resources.go:45] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"} May 21 13:10:23.805400 ip-10-0-133-64 kubenswrapper[2562]: I0521 13:10:23.805301 2562 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/maas-default-gateway-openshift-default-7d6f447cf5-qf64l" event={"ID":"f17e38b8-c261-4695-8953-81c8b2b40bc1","Type":"ContainerStarted","Data":"334e156d5a042f148f0a000584a5ce5ef90d5972bad2cc2c440a6c1e5710c790"} May 21 13:10:23.805400 ip-10-0-133-64 kubenswrapper[2562]: I0521 13:10:23.805337 2562 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/maas-default-gateway-openshift-default-7d6f447cf5-qf64l" event={"ID":"f17e38b8-c261-4695-8953-81c8b2b40bc1","Type":"ContainerStarted","Data":"eaed77ec9f62df097faa17a9044bb0facbdf9cadc4f17b2dc1934e70ef6e41a8"} May 21 13:10:23.825626 ip-10-0-133-64 kubenswrapper[2562]: I0521 13:10:23.825570 2562 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-ingress/maas-default-gateway-openshift-default-7d6f447cf5-qf64l" podStartSLOduration=0.825555102 podStartE2EDuration="825.555102ms" podCreationTimestamp="2026-05-21 13:10:23 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2026-05-21 13:10:23.823643197 +0000 UTC m=+470.373924565" watchObservedRunningTime="2026-05-21 13:10:23.825555102 +0000 UTC m=+470.375836470" May 21 13:10:24.385967 ip-10-0-133-64 kubenswrapper[2562]: I0521 13:10:24.385932 2562 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/maas-default-gateway-openshift-default-7d6f447cf5-qf64l" May 21 13:10:24.390621 ip-10-0-133-64 kubenswrapper[2562]: I0521 13:10:24.390597 2562 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/maas-default-gateway-openshift-default-7d6f447cf5-qf64l" May 21 13:10:24.808520 ip-10-0-133-64 kubenswrapper[2562]: I0521 13:10:24.808487 2562 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/maas-default-gateway-openshift-default-7d6f447cf5-qf64l" May 21 13:10:24.809659 ip-10-0-133-64 kubenswrapper[2562]: I0521 13:10:24.809637 2562 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/maas-default-gateway-openshift-default-7d6f447cf5-qf64l" May 21 13:10:27.347648 ip-10-0-133-64 kubenswrapper[2562]: I0521 13:10:27.347554 2562 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["kuadrant-system/limitador-limitador-7d549b5b-nvbbj"] May 21 13:10:27.369308 ip-10-0-133-64 kubenswrapper[2562]: I0521 13:10:27.369273 2562 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-7d549b5b-nvbbj"] May 21 13:10:27.369501 ip-10-0-133-64 kubenswrapper[2562]: I0521 13:10:27.369389 2562 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-limitador-7d549b5b-nvbbj" May 21 13:10:27.371643 ip-10-0-133-64 kubenswrapper[2562]: I0521 13:10:27.371617 2562 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"limitador-limits-config-limitador\"" May 21 13:10:27.447606 ip-10-0-133-64 kubenswrapper[2562]: I0521 13:10:27.447569 2562 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-7d549b5b-nvbbj"] May 21 13:10:27.529287 ip-10-0-133-64 kubenswrapper[2562]: I0521 13:10:27.529257 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-file\" (UniqueName: \"kubernetes.io/configmap/170fb381-6dad-40ae-b452-f0123987eb5e-config-file\") pod \"limitador-limitador-7d549b5b-nvbbj\" (UID: \"170fb381-6dad-40ae-b452-f0123987eb5e\") " pod="kuadrant-system/limitador-limitador-7d549b5b-nvbbj" May 21 13:10:27.529580 ip-10-0-133-64 kubenswrapper[2562]: I0521 13:10:27.529355 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-h6nx2\" (UniqueName: \"kubernetes.io/projected/170fb381-6dad-40ae-b452-f0123987eb5e-kube-api-access-h6nx2\") pod \"limitador-limitador-7d549b5b-nvbbj\" (UID: \"170fb381-6dad-40ae-b452-f0123987eb5e\") " pod="kuadrant-system/limitador-limitador-7d549b5b-nvbbj" May 21 13:10:27.630148 ip-10-0-133-64 kubenswrapper[2562]: I0521 13:10:27.630053 2562 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-h6nx2\" (UniqueName: \"kubernetes.io/projected/170fb381-6dad-40ae-b452-f0123987eb5e-kube-api-access-h6nx2\") pod \"limitador-limitador-7d549b5b-nvbbj\" (UID: \"170fb381-6dad-40ae-b452-f0123987eb5e\") " pod="kuadrant-system/limitador-limitador-7d549b5b-nvbbj" May 21 13:10:27.630332 ip-10-0-133-64 kubenswrapper[2562]: I0521 13:10:27.630148 2562 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"config-file\" (UniqueName: \"kubernetes.io/configmap/170fb381-6dad-40ae-b452-f0123987eb5e-config-file\") pod \"limitador-limitador-7d549b5b-nvbbj\" (UID: \"170fb381-6dad-40ae-b452-f0123987eb5e\") " pod="kuadrant-system/limitador-limitador-7d549b5b-nvbbj" May 21 13:10:27.630921 ip-10-0-133-64 kubenswrapper[2562]: I0521 13:10:27.630895 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-file\" (UniqueName: \"kubernetes.io/configmap/170fb381-6dad-40ae-b452-f0123987eb5e-config-file\") pod \"limitador-limitador-7d549b5b-nvbbj\" (UID: \"170fb381-6dad-40ae-b452-f0123987eb5e\") " pod="kuadrant-system/limitador-limitador-7d549b5b-nvbbj" May 21 13:10:27.638315 ip-10-0-133-64 kubenswrapper[2562]: I0521 13:10:27.638290 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-h6nx2\" (UniqueName: \"kubernetes.io/projected/170fb381-6dad-40ae-b452-f0123987eb5e-kube-api-access-h6nx2\") pod \"limitador-limitador-7d549b5b-nvbbj\" (UID: \"170fb381-6dad-40ae-b452-f0123987eb5e\") " pod="kuadrant-system/limitador-limitador-7d549b5b-nvbbj" May 21 13:10:27.679879 ip-10-0-133-64 kubenswrapper[2562]: I0521 13:10:27.679847 2562 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-limitador-7d549b5b-nvbbj" May 21 13:10:27.809824 ip-10-0-133-64 kubenswrapper[2562]: I0521 13:10:27.809775 2562 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-7d549b5b-nvbbj"] May 21 13:10:27.812545 ip-10-0-133-64 kubenswrapper[2562]: W0521 13:10:27.812515 2562 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod170fb381_6dad_40ae_b452_f0123987eb5e.slice/crio-8f4a206e091aca0efa5e5ef004f3afd8450eb46e2a85e8f95bf9fa4f144fe2f0 WatchSource:0}: Error finding container 8f4a206e091aca0efa5e5ef004f3afd8450eb46e2a85e8f95bf9fa4f144fe2f0: Status 404 returned error can't find the container with id 8f4a206e091aca0efa5e5ef004f3afd8450eb46e2a85e8f95bf9fa4f144fe2f0 May 21 13:10:27.821311 ip-10-0-133-64 kubenswrapper[2562]: I0521 13:10:27.821278 2562 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-limitador-7d549b5b-nvbbj" event={"ID":"170fb381-6dad-40ae-b452-f0123987eb5e","Type":"ContainerStarted","Data":"8f4a206e091aca0efa5e5ef004f3afd8450eb46e2a85e8f95bf9fa4f144fe2f0"} May 21 13:10:28.199657 ip-10-0-133-64 kubenswrapper[2562]: I0521 13:10:28.199600 2562 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["kuadrant-system/authorino-f99f4b5cd-gxsjd"] May 21 13:10:28.202851 ip-10-0-133-64 kubenswrapper[2562]: I0521 13:10:28.202828 2562 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-f99f4b5cd-gxsjd" May 21 13:10:28.205058 ip-10-0-133-64 kubenswrapper[2562]: I0521 13:10:28.205032 2562 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"authorino-authorino-dockercfg-wb2gs\"" May 21 13:10:28.208622 ip-10-0-133-64 kubenswrapper[2562]: I0521 13:10:28.208601 2562 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-f99f4b5cd-gxsjd"] May 21 13:10:28.336601 ip-10-0-133-64 kubenswrapper[2562]: I0521 13:10:28.336567 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-kkcxk\" (UniqueName: \"kubernetes.io/projected/a48b299c-8707-48ac-8660-f8e60d1791ed-kube-api-access-kkcxk\") pod \"authorino-f99f4b5cd-gxsjd\" (UID: \"a48b299c-8707-48ac-8660-f8e60d1791ed\") " pod="kuadrant-system/authorino-f99f4b5cd-gxsjd" May 21 13:10:28.437554 ip-10-0-133-64 kubenswrapper[2562]: I0521 13:10:28.437511 2562 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-kkcxk\" (UniqueName: \"kubernetes.io/projected/a48b299c-8707-48ac-8660-f8e60d1791ed-kube-api-access-kkcxk\") pod \"authorino-f99f4b5cd-gxsjd\" (UID: \"a48b299c-8707-48ac-8660-f8e60d1791ed\") " pod="kuadrant-system/authorino-f99f4b5cd-gxsjd" May 21 13:10:28.445793 ip-10-0-133-64 kubenswrapper[2562]: I0521 13:10:28.445769 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-kkcxk\" (UniqueName: \"kubernetes.io/projected/a48b299c-8707-48ac-8660-f8e60d1791ed-kube-api-access-kkcxk\") pod \"authorino-f99f4b5cd-gxsjd\" (UID: \"a48b299c-8707-48ac-8660-f8e60d1791ed\") " pod="kuadrant-system/authorino-f99f4b5cd-gxsjd" May 21 13:10:28.512698 ip-10-0-133-64 kubenswrapper[2562]: I0521 13:10:28.512628 2562 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-f99f4b5cd-gxsjd" May 21 13:10:28.694182 ip-10-0-133-64 kubenswrapper[2562]: I0521 13:10:28.694110 2562 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-f99f4b5cd-gxsjd"] May 21 13:10:28.698027 ip-10-0-133-64 kubenswrapper[2562]: W0521 13:10:28.697993 2562 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-poda48b299c_8707_48ac_8660_f8e60d1791ed.slice/crio-b2c5ffda6eddbed808272099e62dac5a2c166ab5dfee07e6b08bff10b07fb7a8 WatchSource:0}: Error finding container b2c5ffda6eddbed808272099e62dac5a2c166ab5dfee07e6b08bff10b07fb7a8: Status 404 returned error can't find the container with id b2c5ffda6eddbed808272099e62dac5a2c166ab5dfee07e6b08bff10b07fb7a8 May 21 13:10:28.828550 ip-10-0-133-64 kubenswrapper[2562]: I0521 13:10:28.828385 2562 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-f99f4b5cd-gxsjd" event={"ID":"a48b299c-8707-48ac-8660-f8e60d1791ed","Type":"ContainerStarted","Data":"b2c5ffda6eddbed808272099e62dac5a2c166ab5dfee07e6b08bff10b07fb7a8"} May 21 13:10:30.841004 ip-10-0-133-64 kubenswrapper[2562]: I0521 13:10:30.840854 2562 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-limitador-7d549b5b-nvbbj" event={"ID":"170fb381-6dad-40ae-b452-f0123987eb5e","Type":"ContainerStarted","Data":"d4898b722bd0373060fa29d4770239cc4ea21d482e3fc14698ea2020004f1acb"} May 21 13:10:30.841004 ip-10-0-133-64 kubenswrapper[2562]: I0521 13:10:30.840913 2562 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/limitador-limitador-7d549b5b-nvbbj" May 21 13:10:30.859491 ip-10-0-133-64 kubenswrapper[2562]: I0521 13:10:30.859363 2562 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="kuadrant-system/limitador-limitador-7d549b5b-nvbbj" podStartSLOduration=1.117030489 podStartE2EDuration="3.858568311s" podCreationTimestamp="2026-05-21 13:10:27 +0000 UTC" firstStartedPulling="2026-05-21 13:10:27.81431239 +0000 UTC m=+474.364593737" lastFinishedPulling="2026-05-21 13:10:30.555850214 +0000 UTC m=+477.106131559" observedRunningTime="2026-05-21 13:10:30.858328461 +0000 UTC m=+477.408609830" watchObservedRunningTime="2026-05-21 13:10:30.858568311 +0000 UTC m=+477.408849680" May 21 13:10:33.308269 ip-10-0-133-64 kubenswrapper[2562]: I0521 13:10:33.308234 2562 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-f99f4b5cd-gxsjd"] May 21 13:10:33.854204 ip-10-0-133-64 kubenswrapper[2562]: I0521 13:10:33.854168 2562 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-f99f4b5cd-gxsjd" event={"ID":"a48b299c-8707-48ac-8660-f8e60d1791ed","Type":"ContainerStarted","Data":"c6730b8b639ce95d7b464ed5953a9afa0bd28af34372ce94fc3050a06cd3c8ba"} May 21 13:10:33.871381 ip-10-0-133-64 kubenswrapper[2562]: I0521 13:10:33.871337 2562 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="kuadrant-system/authorino-f99f4b5cd-gxsjd" podStartSLOduration=1.696290874 podStartE2EDuration="5.871323582s" podCreationTimestamp="2026-05-21 13:10:28 +0000 UTC" firstStartedPulling="2026-05-21 13:10:28.700120775 +0000 UTC m=+475.250402134" lastFinishedPulling="2026-05-21 13:10:32.875153495 +0000 UTC m=+479.425434842" observedRunningTime="2026-05-21 13:10:33.870030402 +0000 UTC m=+480.420311770" watchObservedRunningTime="2026-05-21 13:10:33.871323582 +0000 UTC m=+480.421604979" May 21 13:10:34.857682 ip-10-0-133-64 kubenswrapper[2562]: I0521 13:10:34.857636 2562 kuberuntime_container.go:864] "Killing container with a grace period" pod="kuadrant-system/authorino-f99f4b5cd-gxsjd" podUID="a48b299c-8707-48ac-8660-f8e60d1791ed" containerName="authorino" containerID="cri-o://c6730b8b639ce95d7b464ed5953a9afa0bd28af34372ce94fc3050a06cd3c8ba" gracePeriod=30 May 21 13:10:35.108096 ip-10-0-133-64 kubenswrapper[2562]: I0521 13:10:35.108037 2562 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-f99f4b5cd-gxsjd" May 21 13:10:35.196641 ip-10-0-133-64 kubenswrapper[2562]: I0521 13:10:35.196608 2562 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-kkcxk\" (UniqueName: \"kubernetes.io/projected/a48b299c-8707-48ac-8660-f8e60d1791ed-kube-api-access-kkcxk\") pod \"a48b299c-8707-48ac-8660-f8e60d1791ed\" (UID: \"a48b299c-8707-48ac-8660-f8e60d1791ed\") " May 21 13:10:35.198759 ip-10-0-133-64 kubenswrapper[2562]: I0521 13:10:35.198726 2562 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/a48b299c-8707-48ac-8660-f8e60d1791ed-kube-api-access-kkcxk" (OuterVolumeSpecName: "kube-api-access-kkcxk") pod "a48b299c-8707-48ac-8660-f8e60d1791ed" (UID: "a48b299c-8707-48ac-8660-f8e60d1791ed"). InnerVolumeSpecName "kube-api-access-kkcxk". PluginName "kubernetes.io/projected", VolumeGIDValue "" May 21 13:10:35.298046 ip-10-0-133-64 kubenswrapper[2562]: I0521 13:10:35.298009 2562 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-kkcxk\" (UniqueName: \"kubernetes.io/projected/a48b299c-8707-48ac-8660-f8e60d1791ed-kube-api-access-kkcxk\") on node \"ip-10-0-133-64.ec2.internal\" DevicePath \"\"" May 21 13:10:35.862218 ip-10-0-133-64 kubenswrapper[2562]: I0521 13:10:35.862179 2562 generic.go:358] "Generic (PLEG): container finished" podID="a48b299c-8707-48ac-8660-f8e60d1791ed" containerID="c6730b8b639ce95d7b464ed5953a9afa0bd28af34372ce94fc3050a06cd3c8ba" exitCode=0 May 21 13:10:35.862682 ip-10-0-133-64 kubenswrapper[2562]: I0521 13:10:35.862235 2562 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-f99f4b5cd-gxsjd" May 21 13:10:35.862682 ip-10-0-133-64 kubenswrapper[2562]: I0521 13:10:35.862258 2562 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-f99f4b5cd-gxsjd" event={"ID":"a48b299c-8707-48ac-8660-f8e60d1791ed","Type":"ContainerDied","Data":"c6730b8b639ce95d7b464ed5953a9afa0bd28af34372ce94fc3050a06cd3c8ba"} May 21 13:10:35.862682 ip-10-0-133-64 kubenswrapper[2562]: I0521 13:10:35.862297 2562 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-f99f4b5cd-gxsjd" event={"ID":"a48b299c-8707-48ac-8660-f8e60d1791ed","Type":"ContainerDied","Data":"b2c5ffda6eddbed808272099e62dac5a2c166ab5dfee07e6b08bff10b07fb7a8"} May 21 13:10:35.862682 ip-10-0-133-64 kubenswrapper[2562]: I0521 13:10:35.862316 2562 scope.go:117] "RemoveContainer" containerID="c6730b8b639ce95d7b464ed5953a9afa0bd28af34372ce94fc3050a06cd3c8ba" May 21 13:10:35.870740 ip-10-0-133-64 kubenswrapper[2562]: I0521 13:10:35.870725 2562 scope.go:117] "RemoveContainer" containerID="c6730b8b639ce95d7b464ed5953a9afa0bd28af34372ce94fc3050a06cd3c8ba" May 21 13:10:35.871025 ip-10-0-133-64 kubenswrapper[2562]: E0521 13:10:35.871006 2562 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"c6730b8b639ce95d7b464ed5953a9afa0bd28af34372ce94fc3050a06cd3c8ba\": container with ID starting with c6730b8b639ce95d7b464ed5953a9afa0bd28af34372ce94fc3050a06cd3c8ba not found: ID does not exist" containerID="c6730b8b639ce95d7b464ed5953a9afa0bd28af34372ce94fc3050a06cd3c8ba" May 21 13:10:35.871090 ip-10-0-133-64 kubenswrapper[2562]: I0521 13:10:35.871031 2562 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"c6730b8b639ce95d7b464ed5953a9afa0bd28af34372ce94fc3050a06cd3c8ba"} err="failed to get container status \"c6730b8b639ce95d7b464ed5953a9afa0bd28af34372ce94fc3050a06cd3c8ba\": rpc error: code = NotFound desc = could not find container \"c6730b8b639ce95d7b464ed5953a9afa0bd28af34372ce94fc3050a06cd3c8ba\": container with ID starting with c6730b8b639ce95d7b464ed5953a9afa0bd28af34372ce94fc3050a06cd3c8ba not found: ID does not exist" May 21 13:10:35.882959 ip-10-0-133-64 kubenswrapper[2562]: I0521 13:10:35.882934 2562 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-f99f4b5cd-gxsjd"] May 21 13:10:35.886471 ip-10-0-133-64 kubenswrapper[2562]: I0521 13:10:35.886451 2562 kubelet.go:2547] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/authorino-f99f4b5cd-gxsjd"] May 21 13:10:36.037783 ip-10-0-133-64 kubenswrapper[2562]: I0521 13:10:36.037750 2562 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="a48b299c-8707-48ac-8660-f8e60d1791ed" path="/var/lib/kubelet/pods/a48b299c-8707-48ac-8660-f8e60d1791ed/volumes" May 21 13:10:41.846548 ip-10-0-133-64 kubenswrapper[2562]: I0521 13:10:41.846510 2562 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/limitador-limitador-7d549b5b-nvbbj" May 21 13:10:42.748290 ip-10-0-133-64 kubenswrapper[2562]: I0521 13:10:42.748251 2562 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["kuadrant-system/limitador-limitador-7d549b5b-nvbbj"] May 21 13:10:42.748554 ip-10-0-133-64 kubenswrapper[2562]: I0521 13:10:42.748526 2562 kuberuntime_container.go:864] "Killing container with a grace period" pod="kuadrant-system/limitador-limitador-7d549b5b-nvbbj" podUID="170fb381-6dad-40ae-b452-f0123987eb5e" containerName="limitador" containerID="cri-o://d4898b722bd0373060fa29d4770239cc4ea21d482e3fc14698ea2020004f1acb" gracePeriod=30 May 21 13:10:43.290548 ip-10-0-133-64 kubenswrapper[2562]: I0521 13:10:43.290525 2562 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-limitador-7d549b5b-nvbbj" May 21 13:10:43.367028 ip-10-0-133-64 kubenswrapper[2562]: I0521 13:10:43.366944 2562 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"config-file\" (UniqueName: \"kubernetes.io/configmap/170fb381-6dad-40ae-b452-f0123987eb5e-config-file\") pod \"170fb381-6dad-40ae-b452-f0123987eb5e\" (UID: \"170fb381-6dad-40ae-b452-f0123987eb5e\") " May 21 13:10:43.367028 ip-10-0-133-64 kubenswrapper[2562]: I0521 13:10:43.367027 2562 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-h6nx2\" (UniqueName: \"kubernetes.io/projected/170fb381-6dad-40ae-b452-f0123987eb5e-kube-api-access-h6nx2\") pod \"170fb381-6dad-40ae-b452-f0123987eb5e\" (UID: \"170fb381-6dad-40ae-b452-f0123987eb5e\") " May 21 13:10:43.367302 ip-10-0-133-64 kubenswrapper[2562]: I0521 13:10:43.367279 2562 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/170fb381-6dad-40ae-b452-f0123987eb5e-config-file" (OuterVolumeSpecName: "config-file") pod "170fb381-6dad-40ae-b452-f0123987eb5e" (UID: "170fb381-6dad-40ae-b452-f0123987eb5e"). InnerVolumeSpecName "config-file". PluginName "kubernetes.io/configmap", VolumeGIDValue "" May 21 13:10:43.369043 ip-10-0-133-64 kubenswrapper[2562]: I0521 13:10:43.369022 2562 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/170fb381-6dad-40ae-b452-f0123987eb5e-kube-api-access-h6nx2" (OuterVolumeSpecName: "kube-api-access-h6nx2") pod "170fb381-6dad-40ae-b452-f0123987eb5e" (UID: "170fb381-6dad-40ae-b452-f0123987eb5e"). InnerVolumeSpecName "kube-api-access-h6nx2". PluginName "kubernetes.io/projected", VolumeGIDValue "" May 21 13:10:43.468545 ip-10-0-133-64 kubenswrapper[2562]: I0521 13:10:43.468515 2562 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-h6nx2\" (UniqueName: \"kubernetes.io/projected/170fb381-6dad-40ae-b452-f0123987eb5e-kube-api-access-h6nx2\") on node \"ip-10-0-133-64.ec2.internal\" DevicePath \"\"" May 21 13:10:43.468545 ip-10-0-133-64 kubenswrapper[2562]: I0521 13:10:43.468542 2562 reconciler_common.go:299] "Volume detached for volume \"config-file\" (UniqueName: \"kubernetes.io/configmap/170fb381-6dad-40ae-b452-f0123987eb5e-config-file\") on node \"ip-10-0-133-64.ec2.internal\" DevicePath \"\"" May 21 13:10:43.893009 ip-10-0-133-64 kubenswrapper[2562]: I0521 13:10:43.892970 2562 generic.go:358] "Generic (PLEG): container finished" podID="170fb381-6dad-40ae-b452-f0123987eb5e" containerID="d4898b722bd0373060fa29d4770239cc4ea21d482e3fc14698ea2020004f1acb" exitCode=0 May 21 13:10:43.893208 ip-10-0-133-64 kubenswrapper[2562]: I0521 13:10:43.893030 2562 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-limitador-7d549b5b-nvbbj" May 21 13:10:43.893208 ip-10-0-133-64 kubenswrapper[2562]: I0521 13:10:43.893040 2562 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-limitador-7d549b5b-nvbbj" event={"ID":"170fb381-6dad-40ae-b452-f0123987eb5e","Type":"ContainerDied","Data":"d4898b722bd0373060fa29d4770239cc4ea21d482e3fc14698ea2020004f1acb"} May 21 13:10:43.893208 ip-10-0-133-64 kubenswrapper[2562]: I0521 13:10:43.893075 2562 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-limitador-7d549b5b-nvbbj" event={"ID":"170fb381-6dad-40ae-b452-f0123987eb5e","Type":"ContainerDied","Data":"8f4a206e091aca0efa5e5ef004f3afd8450eb46e2a85e8f95bf9fa4f144fe2f0"} May 21 13:10:43.893208 ip-10-0-133-64 kubenswrapper[2562]: I0521 13:10:43.893094 2562 scope.go:117] "RemoveContainer" containerID="d4898b722bd0373060fa29d4770239cc4ea21d482e3fc14698ea2020004f1acb" May 21 13:10:43.902875 ip-10-0-133-64 kubenswrapper[2562]: I0521 13:10:43.902850 2562 scope.go:117] "RemoveContainer" containerID="d4898b722bd0373060fa29d4770239cc4ea21d482e3fc14698ea2020004f1acb" May 21 13:10:43.903108 ip-10-0-133-64 kubenswrapper[2562]: E0521 13:10:43.903092 2562 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"d4898b722bd0373060fa29d4770239cc4ea21d482e3fc14698ea2020004f1acb\": container with ID starting with d4898b722bd0373060fa29d4770239cc4ea21d482e3fc14698ea2020004f1acb not found: ID does not exist" containerID="d4898b722bd0373060fa29d4770239cc4ea21d482e3fc14698ea2020004f1acb" May 21 13:10:43.903158 ip-10-0-133-64 kubenswrapper[2562]: I0521 13:10:43.903114 2562 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"d4898b722bd0373060fa29d4770239cc4ea21d482e3fc14698ea2020004f1acb"} err="failed to get container status \"d4898b722bd0373060fa29d4770239cc4ea21d482e3fc14698ea2020004f1acb\": rpc error: code = NotFound desc = could not find container \"d4898b722bd0373060fa29d4770239cc4ea21d482e3fc14698ea2020004f1acb\": container with ID starting with d4898b722bd0373060fa29d4770239cc4ea21d482e3fc14698ea2020004f1acb not found: ID does not exist" May 21 13:10:43.915897 ip-10-0-133-64 kubenswrapper[2562]: I0521 13:10:43.915870 2562 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["kuadrant-system/limitador-limitador-7d549b5b-nvbbj"] May 21 13:10:43.920069 ip-10-0-133-64 kubenswrapper[2562]: I0521 13:10:43.920047 2562 kubelet.go:2547] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/limitador-limitador-7d549b5b-nvbbj"] May 21 13:10:44.037638 ip-10-0-133-64 kubenswrapper[2562]: I0521 13:10:44.037606 2562 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="170fb381-6dad-40ae-b452-f0123987eb5e" path="/var/lib/kubelet/pods/170fb381-6dad-40ae-b452-f0123987eb5e/volumes" May 21 13:10:48.601310 ip-10-0-133-64 kubenswrapper[2562]: I0521 13:10:48.601262 2562 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["opendatahub/postgres-68c4fbbd6f-4c2zv"] May 21 13:10:48.601785 ip-10-0-133-64 kubenswrapper[2562]: I0521 13:10:48.601767 2562 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="170fb381-6dad-40ae-b452-f0123987eb5e" containerName="limitador" May 21 13:10:48.601902 ip-10-0-133-64 kubenswrapper[2562]: I0521 13:10:48.601787 2562 state_mem.go:107] "Deleted CPUSet assignment" podUID="170fb381-6dad-40ae-b452-f0123987eb5e" containerName="limitador" May 21 13:10:48.601902 ip-10-0-133-64 kubenswrapper[2562]: I0521 13:10:48.601815 2562 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="a48b299c-8707-48ac-8660-f8e60d1791ed" containerName="authorino" May 21 13:10:48.601902 ip-10-0-133-64 kubenswrapper[2562]: I0521 13:10:48.601824 2562 state_mem.go:107] "Deleted CPUSet assignment" podUID="a48b299c-8707-48ac-8660-f8e60d1791ed" containerName="authorino" May 21 13:10:48.601902 ip-10-0-133-64 kubenswrapper[2562]: I0521 13:10:48.601902 2562 memory_manager.go:356] "RemoveStaleState removing state" podUID="a48b299c-8707-48ac-8660-f8e60d1791ed" containerName="authorino" May 21 13:10:48.602110 ip-10-0-133-64 kubenswrapper[2562]: I0521 13:10:48.601918 2562 memory_manager.go:356] "RemoveStaleState removing state" podUID="170fb381-6dad-40ae-b452-f0123987eb5e" containerName="limitador" May 21 13:10:48.606429 ip-10-0-133-64 kubenswrapper[2562]: I0521 13:10:48.606403 2562 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/postgres-68c4fbbd6f-4c2zv" May 21 13:10:48.609168 ip-10-0-133-64 kubenswrapper[2562]: I0521 13:10:48.609142 2562 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"default-dockercfg-htvw7\"" May 21 13:10:48.609251 ip-10-0-133-64 kubenswrapper[2562]: I0521 13:10:48.609165 2562 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"postgres-creds\"" May 21 13:10:48.613671 ip-10-0-133-64 kubenswrapper[2562]: I0521 13:10:48.613646 2562 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["opendatahub/postgres-68c4fbbd6f-4c2zv"] May 21 13:10:48.714461 ip-10-0-133-64 kubenswrapper[2562]: I0521 13:10:48.714418 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"data\" (UniqueName: \"kubernetes.io/empty-dir/7aa87e02-1849-4d59-a82f-43476c252b0e-data\") pod \"postgres-68c4fbbd6f-4c2zv\" (UID: \"7aa87e02-1849-4d59-a82f-43476c252b0e\") " pod="opendatahub/postgres-68c4fbbd6f-4c2zv" May 21 13:10:48.714650 ip-10-0-133-64 kubenswrapper[2562]: I0521 13:10:48.714547 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-ljs4d\" (UniqueName: \"kubernetes.io/projected/7aa87e02-1849-4d59-a82f-43476c252b0e-kube-api-access-ljs4d\") pod \"postgres-68c4fbbd6f-4c2zv\" (UID: \"7aa87e02-1849-4d59-a82f-43476c252b0e\") " pod="opendatahub/postgres-68c4fbbd6f-4c2zv" May 21 13:10:48.815663 ip-10-0-133-64 kubenswrapper[2562]: I0521 13:10:48.815621 2562 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"data\" (UniqueName: \"kubernetes.io/empty-dir/7aa87e02-1849-4d59-a82f-43476c252b0e-data\") pod \"postgres-68c4fbbd6f-4c2zv\" (UID: \"7aa87e02-1849-4d59-a82f-43476c252b0e\") " pod="opendatahub/postgres-68c4fbbd6f-4c2zv" May 21 13:10:48.815886 ip-10-0-133-64 kubenswrapper[2562]: I0521 13:10:48.815723 2562 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-ljs4d\" (UniqueName: \"kubernetes.io/projected/7aa87e02-1849-4d59-a82f-43476c252b0e-kube-api-access-ljs4d\") pod \"postgres-68c4fbbd6f-4c2zv\" (UID: \"7aa87e02-1849-4d59-a82f-43476c252b0e\") " pod="opendatahub/postgres-68c4fbbd6f-4c2zv" May 21 13:10:48.816035 ip-10-0-133-64 kubenswrapper[2562]: I0521 13:10:48.816012 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"data\" (UniqueName: \"kubernetes.io/empty-dir/7aa87e02-1849-4d59-a82f-43476c252b0e-data\") pod \"postgres-68c4fbbd6f-4c2zv\" (UID: \"7aa87e02-1849-4d59-a82f-43476c252b0e\") " pod="opendatahub/postgres-68c4fbbd6f-4c2zv" May 21 13:10:48.824036 ip-10-0-133-64 kubenswrapper[2562]: I0521 13:10:48.824009 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-ljs4d\" (UniqueName: \"kubernetes.io/projected/7aa87e02-1849-4d59-a82f-43476c252b0e-kube-api-access-ljs4d\") pod \"postgres-68c4fbbd6f-4c2zv\" (UID: \"7aa87e02-1849-4d59-a82f-43476c252b0e\") " pod="opendatahub/postgres-68c4fbbd6f-4c2zv" May 21 13:10:48.920660 ip-10-0-133-64 kubenswrapper[2562]: I0521 13:10:48.920572 2562 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/postgres-68c4fbbd6f-4c2zv" May 21 13:10:49.051064 ip-10-0-133-64 kubenswrapper[2562]: I0521 13:10:49.051038 2562 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["opendatahub/postgres-68c4fbbd6f-4c2zv"] May 21 13:10:49.053239 ip-10-0-133-64 kubenswrapper[2562]: W0521 13:10:49.053199 2562 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod7aa87e02_1849_4d59_a82f_43476c252b0e.slice/crio-8883f06950f854c28fad89b5bd1c355f1c1ef2b7c33a69e2ce8344aaff63850a WatchSource:0}: Error finding container 8883f06950f854c28fad89b5bd1c355f1c1ef2b7c33a69e2ce8344aaff63850a: Status 404 returned error can't find the container with id 8883f06950f854c28fad89b5bd1c355f1c1ef2b7c33a69e2ce8344aaff63850a May 21 13:10:49.917870 ip-10-0-133-64 kubenswrapper[2562]: I0521 13:10:49.917831 2562 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="opendatahub/postgres-68c4fbbd6f-4c2zv" event={"ID":"7aa87e02-1849-4d59-a82f-43476c252b0e","Type":"ContainerStarted","Data":"8883f06950f854c28fad89b5bd1c355f1c1ef2b7c33a69e2ce8344aaff63850a"} May 21 13:10:54.940096 ip-10-0-133-64 kubenswrapper[2562]: I0521 13:10:54.940058 2562 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="opendatahub/postgres-68c4fbbd6f-4c2zv" event={"ID":"7aa87e02-1849-4d59-a82f-43476c252b0e","Type":"ContainerStarted","Data":"d1ab7c79e0a1d545f09b2b2b6616d5e9f6c8aaf6c374d35241d19c59b9920927"} May 21 13:10:54.940517 ip-10-0-133-64 kubenswrapper[2562]: I0521 13:10:54.940149 2562 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/postgres-68c4fbbd6f-4c2zv" May 21 13:10:54.961170 ip-10-0-133-64 kubenswrapper[2562]: I0521 13:10:54.961103 2562 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="opendatahub/postgres-68c4fbbd6f-4c2zv" podStartSLOduration=2.0444481310000002 podStartE2EDuration="6.961087382s" podCreationTimestamp="2026-05-21 13:10:48 +0000 UTC" firstStartedPulling="2026-05-21 13:10:49.054894305 +0000 UTC m=+495.605175651" lastFinishedPulling="2026-05-21 13:10:53.971533545 +0000 UTC m=+500.521814902" observedRunningTime="2026-05-21 13:10:54.958653392 +0000 UTC m=+501.508934761" watchObservedRunningTime="2026-05-21 13:10:54.961087382 +0000 UTC m=+501.511368749" May 21 13:11:00.973921 ip-10-0-133-64 kubenswrapper[2562]: I0521 13:11:00.973885 2562 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/postgres-68c4fbbd6f-4c2zv" May 21 13:11:01.587192 ip-10-0-133-64 kubenswrapper[2562]: I0521 13:11:01.587155 2562 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["kuadrant-system/authorino-8b475cf9f-zmjrp"] May 21 13:11:01.592963 ip-10-0-133-64 kubenswrapper[2562]: I0521 13:11:01.592944 2562 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-8b475cf9f-zmjrp" May 21 13:11:01.600178 ip-10-0-133-64 kubenswrapper[2562]: I0521 13:11:01.600158 2562 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"authorino-authorino-dockercfg-wb2gs\"" May 21 13:11:01.621292 ip-10-0-133-64 kubenswrapper[2562]: I0521 13:11:01.621266 2562 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-8b475cf9f-zmjrp"] May 21 13:11:01.731102 ip-10-0-133-64 kubenswrapper[2562]: I0521 13:11:01.731067 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-st8z9\" (UniqueName: \"kubernetes.io/projected/1198cbbe-04fc-4428-a3eb-5663ee79c01c-kube-api-access-st8z9\") pod \"authorino-8b475cf9f-zmjrp\" (UID: \"1198cbbe-04fc-4428-a3eb-5663ee79c01c\") " pod="kuadrant-system/authorino-8b475cf9f-zmjrp" May 21 13:11:01.780473 ip-10-0-133-64 kubenswrapper[2562]: I0521 13:11:01.780445 2562 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-8b475cf9f-zmjrp"] May 21 13:11:01.780703 ip-10-0-133-64 kubenswrapper[2562]: E0521 13:11:01.780685 2562 pod_workers.go:1301] "Error syncing pod, skipping" err="unmounted volumes=[kube-api-access-st8z9], unattached volumes=[], failed to process volumes=[]: context canceled" pod="kuadrant-system/authorino-8b475cf9f-zmjrp" podUID="1198cbbe-04fc-4428-a3eb-5663ee79c01c" May 21 13:11:01.808956 ip-10-0-133-64 kubenswrapper[2562]: I0521 13:11:01.808928 2562 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["kuadrant-system/authorino-79dfb85877-crzf6"] May 21 13:11:01.812627 ip-10-0-133-64 kubenswrapper[2562]: I0521 13:11:01.812611 2562 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-79dfb85877-crzf6" May 21 13:11:01.818193 ip-10-0-133-64 kubenswrapper[2562]: I0521 13:11:01.818169 2562 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-79dfb85877-crzf6"] May 21 13:11:01.832060 ip-10-0-133-64 kubenswrapper[2562]: I0521 13:11:01.832038 2562 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-st8z9\" (UniqueName: \"kubernetes.io/projected/1198cbbe-04fc-4428-a3eb-5663ee79c01c-kube-api-access-st8z9\") pod \"authorino-8b475cf9f-zmjrp\" (UID: \"1198cbbe-04fc-4428-a3eb-5663ee79c01c\") " pod="kuadrant-system/authorino-8b475cf9f-zmjrp" May 21 13:11:01.840867 ip-10-0-133-64 kubenswrapper[2562]: I0521 13:11:01.840818 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-st8z9\" (UniqueName: \"kubernetes.io/projected/1198cbbe-04fc-4428-a3eb-5663ee79c01c-kube-api-access-st8z9\") pod \"authorino-8b475cf9f-zmjrp\" (UID: \"1198cbbe-04fc-4428-a3eb-5663ee79c01c\") " pod="kuadrant-system/authorino-8b475cf9f-zmjrp" May 21 13:11:01.933186 ip-10-0-133-64 kubenswrapper[2562]: I0521 13:11:01.933148 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-qwtqp\" (UniqueName: \"kubernetes.io/projected/03c24e0f-032b-4cc9-9b86-995227d87f0f-kube-api-access-qwtqp\") pod \"authorino-79dfb85877-crzf6\" (UID: \"03c24e0f-032b-4cc9-9b86-995227d87f0f\") " pod="kuadrant-system/authorino-79dfb85877-crzf6" May 21 13:11:01.943123 ip-10-0-133-64 kubenswrapper[2562]: I0521 13:11:01.943094 2562 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-79dfb85877-crzf6"] May 21 13:11:01.943341 ip-10-0-133-64 kubenswrapper[2562]: E0521 13:11:01.943321 2562 pod_workers.go:1301] "Error syncing pod, skipping" err="unmounted volumes=[kube-api-access-qwtqp], unattached volumes=[], failed to process volumes=[]: context canceled" pod="kuadrant-system/authorino-79dfb85877-crzf6" podUID="03c24e0f-032b-4cc9-9b86-995227d87f0f" May 21 13:11:01.968271 ip-10-0-133-64 kubenswrapper[2562]: I0521 13:11:01.968240 2562 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-79dfb85877-crzf6" May 21 13:11:01.968407 ip-10-0-133-64 kubenswrapper[2562]: I0521 13:11:01.968240 2562 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-8b475cf9f-zmjrp" May 21 13:11:01.973306 ip-10-0-133-64 kubenswrapper[2562]: I0521 13:11:01.973286 2562 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-79dfb85877-crzf6" May 21 13:11:01.976532 ip-10-0-133-64 kubenswrapper[2562]: I0521 13:11:01.976515 2562 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-8b475cf9f-zmjrp" May 21 13:11:02.033492 ip-10-0-133-64 kubenswrapper[2562]: I0521 13:11:02.033470 2562 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-qwtqp\" (UniqueName: \"kubernetes.io/projected/03c24e0f-032b-4cc9-9b86-995227d87f0f-kube-api-access-qwtqp\") pod \"authorino-79dfb85877-crzf6\" (UID: \"03c24e0f-032b-4cc9-9b86-995227d87f0f\") " pod="kuadrant-system/authorino-79dfb85877-crzf6" May 21 13:11:02.042965 ip-10-0-133-64 kubenswrapper[2562]: I0521 13:11:02.042940 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-qwtqp\" (UniqueName: \"kubernetes.io/projected/03c24e0f-032b-4cc9-9b86-995227d87f0f-kube-api-access-qwtqp\") pod \"authorino-79dfb85877-crzf6\" (UID: \"03c24e0f-032b-4cc9-9b86-995227d87f0f\") " pod="kuadrant-system/authorino-79dfb85877-crzf6" May 21 13:11:02.134463 ip-10-0-133-64 kubenswrapper[2562]: I0521 13:11:02.134363 2562 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-st8z9\" (UniqueName: \"kubernetes.io/projected/1198cbbe-04fc-4428-a3eb-5663ee79c01c-kube-api-access-st8z9\") pod \"1198cbbe-04fc-4428-a3eb-5663ee79c01c\" (UID: \"1198cbbe-04fc-4428-a3eb-5663ee79c01c\") " May 21 13:11:02.134635 ip-10-0-133-64 kubenswrapper[2562]: I0521 13:11:02.134485 2562 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-qwtqp\" (UniqueName: \"kubernetes.io/projected/03c24e0f-032b-4cc9-9b86-995227d87f0f-kube-api-access-qwtqp\") pod \"03c24e0f-032b-4cc9-9b86-995227d87f0f\" (UID: \"03c24e0f-032b-4cc9-9b86-995227d87f0f\") " May 21 13:11:02.136522 ip-10-0-133-64 kubenswrapper[2562]: I0521 13:11:02.136496 2562 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/03c24e0f-032b-4cc9-9b86-995227d87f0f-kube-api-access-qwtqp" (OuterVolumeSpecName: "kube-api-access-qwtqp") pod "03c24e0f-032b-4cc9-9b86-995227d87f0f" (UID: "03c24e0f-032b-4cc9-9b86-995227d87f0f"). InnerVolumeSpecName "kube-api-access-qwtqp". PluginName "kubernetes.io/projected", VolumeGIDValue "" May 21 13:11:02.136664 ip-10-0-133-64 kubenswrapper[2562]: I0521 13:11:02.136520 2562 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/1198cbbe-04fc-4428-a3eb-5663ee79c01c-kube-api-access-st8z9" (OuterVolumeSpecName: "kube-api-access-st8z9") pod "1198cbbe-04fc-4428-a3eb-5663ee79c01c" (UID: "1198cbbe-04fc-4428-a3eb-5663ee79c01c"). InnerVolumeSpecName "kube-api-access-st8z9". PluginName "kubernetes.io/projected", VolumeGIDValue "" May 21 13:11:02.235703 ip-10-0-133-64 kubenswrapper[2562]: I0521 13:11:02.235669 2562 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-qwtqp\" (UniqueName: \"kubernetes.io/projected/03c24e0f-032b-4cc9-9b86-995227d87f0f-kube-api-access-qwtqp\") on node \"ip-10-0-133-64.ec2.internal\" DevicePath \"\"" May 21 13:11:02.235703 ip-10-0-133-64 kubenswrapper[2562]: I0521 13:11:02.235696 2562 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-st8z9\" (UniqueName: \"kubernetes.io/projected/1198cbbe-04fc-4428-a3eb-5663ee79c01c-kube-api-access-st8z9\") on node \"ip-10-0-133-64.ec2.internal\" DevicePath \"\"" May 21 13:11:02.971485 ip-10-0-133-64 kubenswrapper[2562]: I0521 13:11:02.971451 2562 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-8b475cf9f-zmjrp" May 21 13:11:02.971637 ip-10-0-133-64 kubenswrapper[2562]: I0521 13:11:02.971454 2562 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-79dfb85877-crzf6" May 21 13:11:03.005168 ip-10-0-133-64 kubenswrapper[2562]: I0521 13:11:03.005133 2562 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-8b475cf9f-zmjrp"] May 21 13:11:03.009709 ip-10-0-133-64 kubenswrapper[2562]: I0521 13:11:03.009687 2562 kubelet.go:2547] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/authorino-8b475cf9f-zmjrp"] May 21 13:11:03.030300 ip-10-0-133-64 kubenswrapper[2562]: I0521 13:11:03.030277 2562 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-79dfb85877-crzf6"] May 21 13:11:03.034099 ip-10-0-133-64 kubenswrapper[2562]: I0521 13:11:03.034079 2562 kubelet.go:2547] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/authorino-79dfb85877-crzf6"] May 21 13:11:04.037662 ip-10-0-133-64 kubenswrapper[2562]: I0521 13:11:04.037629 2562 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="03c24e0f-032b-4cc9-9b86-995227d87f0f" path="/var/lib/kubelet/pods/03c24e0f-032b-4cc9-9b86-995227d87f0f/volumes" May 21 13:11:04.038055 ip-10-0-133-64 kubenswrapper[2562]: I0521 13:11:04.037891 2562 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="1198cbbe-04fc-4428-a3eb-5663ee79c01c" path="/var/lib/kubelet/pods/1198cbbe-04fc-4428-a3eb-5663ee79c01c/volumes" May 21 13:11:06.382747 ip-10-0-133-64 kubenswrapper[2562]: I0521 13:11:06.382706 2562 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["opendatahub/maas-controller-68fb5d86bc-pdb4f"] May 21 13:11:06.494893 ip-10-0-133-64 kubenswrapper[2562]: I0521 13:11:06.494855 2562 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-controller-68fb5d86bc-pdb4f"] May 21 13:11:06.495060 ip-10-0-133-64 kubenswrapper[2562]: I0521 13:11:06.495006 2562 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-68fb5d86bc-pdb4f" May 21 13:11:06.497252 ip-10-0-133-64 kubenswrapper[2562]: I0521 13:11:06.497229 2562 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"maas-parameters\"" May 21 13:11:06.497381 ip-10-0-133-64 kubenswrapper[2562]: I0521 13:11:06.497249 2562 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"maas-controller-dockercfg-4qk68\"" May 21 13:11:06.549436 ip-10-0-133-64 kubenswrapper[2562]: I0521 13:11:06.549399 2562 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["opendatahub/maas-controller-66c97f95bf-pthts"] May 21 13:11:06.569449 ip-10-0-133-64 kubenswrapper[2562]: I0521 13:11:06.569407 2562 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-controller-66c97f95bf-pthts"] May 21 13:11:06.569670 ip-10-0-133-64 kubenswrapper[2562]: I0521 13:11:06.569521 2562 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-66c97f95bf-pthts" May 21 13:11:06.570199 ip-10-0-133-64 kubenswrapper[2562]: I0521 13:11:06.570172 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-4g642\" (UniqueName: \"kubernetes.io/projected/36a97608-4349-4fac-a18a-facf63297956-kube-api-access-4g642\") pod \"maas-controller-68fb5d86bc-pdb4f\" (UID: \"36a97608-4349-4fac-a18a-facf63297956\") " pod="opendatahub/maas-controller-68fb5d86bc-pdb4f" May 21 13:11:06.667920 ip-10-0-133-64 kubenswrapper[2562]: I0521 13:11:06.667833 2562 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["opendatahub/maas-controller-66c97f95bf-pthts"] May 21 13:11:06.668114 ip-10-0-133-64 kubenswrapper[2562]: E0521 13:11:06.668095 2562 pod_workers.go:1301] "Error syncing pod, skipping" err="unmounted volumes=[kube-api-access-pmpk2], unattached volumes=[], failed to process volumes=[]: context canceled" pod="opendatahub/maas-controller-66c97f95bf-pthts" podUID="cb28c37a-8c35-4de0-9572-6fca99502f55" May 21 13:11:06.671379 ip-10-0-133-64 kubenswrapper[2562]: I0521 13:11:06.671344 2562 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-4g642\" (UniqueName: \"kubernetes.io/projected/36a97608-4349-4fac-a18a-facf63297956-kube-api-access-4g642\") pod \"maas-controller-68fb5d86bc-pdb4f\" (UID: \"36a97608-4349-4fac-a18a-facf63297956\") " pod="opendatahub/maas-controller-68fb5d86bc-pdb4f" May 21 13:11:06.671518 ip-10-0-133-64 kubenswrapper[2562]: I0521 13:11:06.671450 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-pmpk2\" (UniqueName: \"kubernetes.io/projected/cb28c37a-8c35-4de0-9572-6fca99502f55-kube-api-access-pmpk2\") pod \"maas-controller-66c97f95bf-pthts\" (UID: \"cb28c37a-8c35-4de0-9572-6fca99502f55\") " pod="opendatahub/maas-controller-66c97f95bf-pthts" May 21 13:11:06.680325 ip-10-0-133-64 kubenswrapper[2562]: I0521 13:11:06.680297 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-4g642\" (UniqueName: \"kubernetes.io/projected/36a97608-4349-4fac-a18a-facf63297956-kube-api-access-4g642\") pod \"maas-controller-68fb5d86bc-pdb4f\" (UID: \"36a97608-4349-4fac-a18a-facf63297956\") " pod="opendatahub/maas-controller-68fb5d86bc-pdb4f" May 21 13:11:06.696542 ip-10-0-133-64 kubenswrapper[2562]: I0521 13:11:06.696517 2562 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["opendatahub/maas-controller-69556b5698-68vm6"] May 21 13:11:06.719314 ip-10-0-133-64 kubenswrapper[2562]: I0521 13:11:06.719279 2562 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-controller-69556b5698-68vm6"] May 21 13:11:06.719521 ip-10-0-133-64 kubenswrapper[2562]: I0521 13:11:06.719410 2562 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-69556b5698-68vm6" May 21 13:11:06.772762 ip-10-0-133-64 kubenswrapper[2562]: I0521 13:11:06.772707 2562 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-pmpk2\" (UniqueName: \"kubernetes.io/projected/cb28c37a-8c35-4de0-9572-6fca99502f55-kube-api-access-pmpk2\") pod \"maas-controller-66c97f95bf-pthts\" (UID: \"cb28c37a-8c35-4de0-9572-6fca99502f55\") " pod="opendatahub/maas-controller-66c97f95bf-pthts" May 21 13:11:06.787937 ip-10-0-133-64 kubenswrapper[2562]: I0521 13:11:06.787896 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-pmpk2\" (UniqueName: \"kubernetes.io/projected/cb28c37a-8c35-4de0-9572-6fca99502f55-kube-api-access-pmpk2\") pod \"maas-controller-66c97f95bf-pthts\" (UID: \"cb28c37a-8c35-4de0-9572-6fca99502f55\") " pod="opendatahub/maas-controller-66c97f95bf-pthts" May 21 13:11:06.805641 ip-10-0-133-64 kubenswrapper[2562]: I0521 13:11:06.805610 2562 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-68fb5d86bc-pdb4f" May 21 13:11:06.874071 ip-10-0-133-64 kubenswrapper[2562]: I0521 13:11:06.874035 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-bhw5f\" (UniqueName: \"kubernetes.io/projected/2742f73d-b040-46b7-a402-06a7e7abdd6e-kube-api-access-bhw5f\") pod \"maas-controller-69556b5698-68vm6\" (UID: \"2742f73d-b040-46b7-a402-06a7e7abdd6e\") " pod="opendatahub/maas-controller-69556b5698-68vm6" May 21 13:11:06.936374 ip-10-0-133-64 kubenswrapper[2562]: I0521 13:11:06.936348 2562 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-controller-68fb5d86bc-pdb4f"] May 21 13:11:06.938443 ip-10-0-133-64 kubenswrapper[2562]: W0521 13:11:06.938414 2562 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod36a97608_4349_4fac_a18a_facf63297956.slice/crio-68d785376b60112053318f21ae2342501104979261bd263421af9fcb67bf9a25 WatchSource:0}: Error finding container 68d785376b60112053318f21ae2342501104979261bd263421af9fcb67bf9a25: Status 404 returned error can't find the container with id 68d785376b60112053318f21ae2342501104979261bd263421af9fcb67bf9a25 May 21 13:11:06.975477 ip-10-0-133-64 kubenswrapper[2562]: I0521 13:11:06.975453 2562 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-bhw5f\" (UniqueName: \"kubernetes.io/projected/2742f73d-b040-46b7-a402-06a7e7abdd6e-kube-api-access-bhw5f\") pod \"maas-controller-69556b5698-68vm6\" (UID: \"2742f73d-b040-46b7-a402-06a7e7abdd6e\") " pod="opendatahub/maas-controller-69556b5698-68vm6" May 21 13:11:06.985287 ip-10-0-133-64 kubenswrapper[2562]: I0521 13:11:06.985259 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-bhw5f\" (UniqueName: \"kubernetes.io/projected/2742f73d-b040-46b7-a402-06a7e7abdd6e-kube-api-access-bhw5f\") pod \"maas-controller-69556b5698-68vm6\" (UID: \"2742f73d-b040-46b7-a402-06a7e7abdd6e\") " pod="opendatahub/maas-controller-69556b5698-68vm6" May 21 13:11:06.987149 ip-10-0-133-64 kubenswrapper[2562]: I0521 13:11:06.987123 2562 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-68fb5d86bc-pdb4f" event={"ID":"36a97608-4349-4fac-a18a-facf63297956","Type":"ContainerStarted","Data":"68d785376b60112053318f21ae2342501104979261bd263421af9fcb67bf9a25"} May 21 13:11:06.987229 ip-10-0-133-64 kubenswrapper[2562]: I0521 13:11:06.987158 2562 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-66c97f95bf-pthts" May 21 13:11:06.991933 ip-10-0-133-64 kubenswrapper[2562]: I0521 13:11:06.991917 2562 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-66c97f95bf-pthts" May 21 13:11:07.029680 ip-10-0-133-64 kubenswrapper[2562]: I0521 13:11:07.029648 2562 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-69556b5698-68vm6" May 21 13:11:07.076210 ip-10-0-133-64 kubenswrapper[2562]: I0521 13:11:07.075926 2562 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-pmpk2\" (UniqueName: \"kubernetes.io/projected/cb28c37a-8c35-4de0-9572-6fca99502f55-kube-api-access-pmpk2\") pod \"cb28c37a-8c35-4de0-9572-6fca99502f55\" (UID: \"cb28c37a-8c35-4de0-9572-6fca99502f55\") " May 21 13:11:07.078909 ip-10-0-133-64 kubenswrapper[2562]: I0521 13:11:07.078875 2562 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/cb28c37a-8c35-4de0-9572-6fca99502f55-kube-api-access-pmpk2" (OuterVolumeSpecName: "kube-api-access-pmpk2") pod "cb28c37a-8c35-4de0-9572-6fca99502f55" (UID: "cb28c37a-8c35-4de0-9572-6fca99502f55"). InnerVolumeSpecName "kube-api-access-pmpk2". PluginName "kubernetes.io/projected", VolumeGIDValue "" May 21 13:11:07.162963 ip-10-0-133-64 kubenswrapper[2562]: I0521 13:11:07.162936 2562 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-controller-69556b5698-68vm6"] May 21 13:11:07.164473 ip-10-0-133-64 kubenswrapper[2562]: W0521 13:11:07.164448 2562 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod2742f73d_b040_46b7_a402_06a7e7abdd6e.slice/crio-89e603c93089a19e6db37714a2f99117d3ba0749be91b61a9d722533291969dc WatchSource:0}: Error finding container 89e603c93089a19e6db37714a2f99117d3ba0749be91b61a9d722533291969dc: Status 404 returned error can't find the container with id 89e603c93089a19e6db37714a2f99117d3ba0749be91b61a9d722533291969dc May 21 13:11:07.177669 ip-10-0-133-64 kubenswrapper[2562]: I0521 13:11:07.177644 2562 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-pmpk2\" (UniqueName: \"kubernetes.io/projected/cb28c37a-8c35-4de0-9572-6fca99502f55-kube-api-access-pmpk2\") on node \"ip-10-0-133-64.ec2.internal\" DevicePath \"\"" May 21 13:11:08.001470 ip-10-0-133-64 kubenswrapper[2562]: I0521 13:11:07.998351 2562 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-66c97f95bf-pthts" May 21 13:11:08.001470 ip-10-0-133-64 kubenswrapper[2562]: I0521 13:11:08.000509 2562 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-69556b5698-68vm6" event={"ID":"2742f73d-b040-46b7-a402-06a7e7abdd6e","Type":"ContainerStarted","Data":"89e603c93089a19e6db37714a2f99117d3ba0749be91b61a9d722533291969dc"} May 21 13:11:08.048190 ip-10-0-133-64 kubenswrapper[2562]: I0521 13:11:08.048155 2562 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["opendatahub/maas-controller-66c97f95bf-pthts"] May 21 13:11:08.051903 ip-10-0-133-64 kubenswrapper[2562]: I0521 13:11:08.051872 2562 kubelet.go:2547] "SyncLoop REMOVE" source="api" pods=["opendatahub/maas-controller-66c97f95bf-pthts"] May 21 13:11:10.038766 ip-10-0-133-64 kubenswrapper[2562]: I0521 13:11:10.038726 2562 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="cb28c37a-8c35-4de0-9572-6fca99502f55" path="/var/lib/kubelet/pods/cb28c37a-8c35-4de0-9572-6fca99502f55/volumes" May 21 13:11:11.013957 ip-10-0-133-64 kubenswrapper[2562]: I0521 13:11:11.013916 2562 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-68fb5d86bc-pdb4f" event={"ID":"36a97608-4349-4fac-a18a-facf63297956","Type":"ContainerStarted","Data":"1e21da829e6a472ab6a87d62554c5576784b72654cef32356590246907dd6f4b"} May 21 13:11:11.014164 ip-10-0-133-64 kubenswrapper[2562]: I0521 13:11:11.014053 2562 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/maas-controller-68fb5d86bc-pdb4f" May 21 13:11:11.015320 ip-10-0-133-64 kubenswrapper[2562]: I0521 13:11:11.015289 2562 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-69556b5698-68vm6" event={"ID":"2742f73d-b040-46b7-a402-06a7e7abdd6e","Type":"ContainerStarted","Data":"6b446c68faa4d4c83b26df5a870c12fd401b1a2417fc8f39752c5bba49ca16fc"} May 21 13:11:11.015413 ip-10-0-133-64 kubenswrapper[2562]: I0521 13:11:11.015394 2562 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/maas-controller-69556b5698-68vm6" May 21 13:11:11.033347 ip-10-0-133-64 kubenswrapper[2562]: I0521 13:11:11.033290 2562 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="opendatahub/maas-controller-68fb5d86bc-pdb4f" podStartSLOduration=1.8453591550000001 podStartE2EDuration="5.033277551s" podCreationTimestamp="2026-05-21 13:11:06 +0000 UTC" firstStartedPulling="2026-05-21 13:11:06.939838325 +0000 UTC m=+513.490119676" lastFinishedPulling="2026-05-21 13:11:10.127756723 +0000 UTC m=+516.678038072" observedRunningTime="2026-05-21 13:11:11.030616414 +0000 UTC m=+517.580897807" watchObservedRunningTime="2026-05-21 13:11:11.033277551 +0000 UTC m=+517.583558918" May 21 13:11:11.048760 ip-10-0-133-64 kubenswrapper[2562]: I0521 13:11:11.048712 2562 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="opendatahub/maas-controller-69556b5698-68vm6" podStartSLOduration=2.083539874 podStartE2EDuration="5.048697928s" podCreationTimestamp="2026-05-21 13:11:06 +0000 UTC" firstStartedPulling="2026-05-21 13:11:07.165691083 +0000 UTC m=+513.715972432" lastFinishedPulling="2026-05-21 13:11:10.13084914 +0000 UTC m=+516.681130486" observedRunningTime="2026-05-21 13:11:11.047344502 +0000 UTC m=+517.597625873" watchObservedRunningTime="2026-05-21 13:11:11.048697928 +0000 UTC m=+517.598979297" May 21 13:11:22.028358 ip-10-0-133-64 kubenswrapper[2562]: I0521 13:11:22.028324 2562 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/maas-controller-69556b5698-68vm6" May 21 13:11:22.028856 ip-10-0-133-64 kubenswrapper[2562]: I0521 13:11:22.028380 2562 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/maas-controller-68fb5d86bc-pdb4f" May 21 13:11:22.108959 ip-10-0-133-64 kubenswrapper[2562]: I0521 13:11:22.108923 2562 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["opendatahub/maas-controller-68fb5d86bc-pdb4f"] May 21 13:11:22.109118 ip-10-0-133-64 kubenswrapper[2562]: I0521 13:11:22.109101 2562 kuberuntime_container.go:864] "Killing container with a grace period" pod="opendatahub/maas-controller-68fb5d86bc-pdb4f" podUID="36a97608-4349-4fac-a18a-facf63297956" containerName="manager" containerID="cri-o://1e21da829e6a472ab6a87d62554c5576784b72654cef32356590246907dd6f4b" gracePeriod=30 May 21 13:11:22.292493 ip-10-0-133-64 kubenswrapper[2562]: I0521 13:11:22.292417 2562 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["opendatahub/maas-controller-85cc5d9594-67cxt"] May 21 13:11:22.295770 ip-10-0-133-64 kubenswrapper[2562]: I0521 13:11:22.295747 2562 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-85cc5d9594-67cxt" May 21 13:11:22.303122 ip-10-0-133-64 kubenswrapper[2562]: I0521 13:11:22.302757 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-nqvkd\" (UniqueName: \"kubernetes.io/projected/ef6f595f-efd7-42fa-b693-3cc62487f51d-kube-api-access-nqvkd\") pod \"maas-controller-85cc5d9594-67cxt\" (UID: \"ef6f595f-efd7-42fa-b693-3cc62487f51d\") " pod="opendatahub/maas-controller-85cc5d9594-67cxt" May 21 13:11:22.305695 ip-10-0-133-64 kubenswrapper[2562]: I0521 13:11:22.305669 2562 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-controller-85cc5d9594-67cxt"] May 21 13:11:22.346120 ip-10-0-133-64 kubenswrapper[2562]: I0521 13:11:22.346094 2562 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-68fb5d86bc-pdb4f" May 21 13:11:22.403963 ip-10-0-133-64 kubenswrapper[2562]: I0521 13:11:22.403939 2562 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-4g642\" (UniqueName: \"kubernetes.io/projected/36a97608-4349-4fac-a18a-facf63297956-kube-api-access-4g642\") pod \"36a97608-4349-4fac-a18a-facf63297956\" (UID: \"36a97608-4349-4fac-a18a-facf63297956\") " May 21 13:11:22.404135 ip-10-0-133-64 kubenswrapper[2562]: I0521 13:11:22.404119 2562 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-nqvkd\" (UniqueName: \"kubernetes.io/projected/ef6f595f-efd7-42fa-b693-3cc62487f51d-kube-api-access-nqvkd\") pod \"maas-controller-85cc5d9594-67cxt\" (UID: \"ef6f595f-efd7-42fa-b693-3cc62487f51d\") " pod="opendatahub/maas-controller-85cc5d9594-67cxt" May 21 13:11:22.406078 ip-10-0-133-64 kubenswrapper[2562]: I0521 13:11:22.406051 2562 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/36a97608-4349-4fac-a18a-facf63297956-kube-api-access-4g642" (OuterVolumeSpecName: "kube-api-access-4g642") pod "36a97608-4349-4fac-a18a-facf63297956" (UID: "36a97608-4349-4fac-a18a-facf63297956"). InnerVolumeSpecName "kube-api-access-4g642". PluginName "kubernetes.io/projected", VolumeGIDValue "" May 21 13:11:22.412758 ip-10-0-133-64 kubenswrapper[2562]: I0521 13:11:22.412735 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-nqvkd\" (UniqueName: \"kubernetes.io/projected/ef6f595f-efd7-42fa-b693-3cc62487f51d-kube-api-access-nqvkd\") pod \"maas-controller-85cc5d9594-67cxt\" (UID: \"ef6f595f-efd7-42fa-b693-3cc62487f51d\") " pod="opendatahub/maas-controller-85cc5d9594-67cxt" May 21 13:11:22.505232 ip-10-0-133-64 kubenswrapper[2562]: I0521 13:11:22.505200 2562 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-4g642\" (UniqueName: \"kubernetes.io/projected/36a97608-4349-4fac-a18a-facf63297956-kube-api-access-4g642\") on node \"ip-10-0-133-64.ec2.internal\" DevicePath \"\"" May 21 13:11:22.607715 ip-10-0-133-64 kubenswrapper[2562]: I0521 13:11:22.607628 2562 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-85cc5d9594-67cxt" May 21 13:11:22.735425 ip-10-0-133-64 kubenswrapper[2562]: I0521 13:11:22.735401 2562 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-controller-85cc5d9594-67cxt"] May 21 13:11:22.737450 ip-10-0-133-64 kubenswrapper[2562]: W0521 13:11:22.737424 2562 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podef6f595f_efd7_42fa_b693_3cc62487f51d.slice/crio-bdf9bf68b5f2db6b849d1b908fc1dc0460960972cf9599bacb720e9244ef4569 WatchSource:0}: Error finding container bdf9bf68b5f2db6b849d1b908fc1dc0460960972cf9599bacb720e9244ef4569: Status 404 returned error can't find the container with id bdf9bf68b5f2db6b849d1b908fc1dc0460960972cf9599bacb720e9244ef4569 May 21 13:11:23.058276 ip-10-0-133-64 kubenswrapper[2562]: I0521 13:11:23.058177 2562 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-85cc5d9594-67cxt" event={"ID":"ef6f595f-efd7-42fa-b693-3cc62487f51d","Type":"ContainerStarted","Data":"bdf9bf68b5f2db6b849d1b908fc1dc0460960972cf9599bacb720e9244ef4569"} May 21 13:11:23.059423 ip-10-0-133-64 kubenswrapper[2562]: I0521 13:11:23.059389 2562 generic.go:358] "Generic (PLEG): container finished" podID="36a97608-4349-4fac-a18a-facf63297956" containerID="1e21da829e6a472ab6a87d62554c5576784b72654cef32356590246907dd6f4b" exitCode=0 May 21 13:11:23.059522 ip-10-0-133-64 kubenswrapper[2562]: I0521 13:11:23.059459 2562 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-68fb5d86bc-pdb4f" May 21 13:11:23.059522 ip-10-0-133-64 kubenswrapper[2562]: I0521 13:11:23.059472 2562 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-68fb5d86bc-pdb4f" event={"ID":"36a97608-4349-4fac-a18a-facf63297956","Type":"ContainerDied","Data":"1e21da829e6a472ab6a87d62554c5576784b72654cef32356590246907dd6f4b"} May 21 13:11:23.059522 ip-10-0-133-64 kubenswrapper[2562]: I0521 13:11:23.059509 2562 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-68fb5d86bc-pdb4f" event={"ID":"36a97608-4349-4fac-a18a-facf63297956","Type":"ContainerDied","Data":"68d785376b60112053318f21ae2342501104979261bd263421af9fcb67bf9a25"} May 21 13:11:23.059668 ip-10-0-133-64 kubenswrapper[2562]: I0521 13:11:23.059526 2562 scope.go:117] "RemoveContainer" containerID="1e21da829e6a472ab6a87d62554c5576784b72654cef32356590246907dd6f4b" May 21 13:11:23.081022 ip-10-0-133-64 kubenswrapper[2562]: I0521 13:11:23.081001 2562 scope.go:117] "RemoveContainer" containerID="1e21da829e6a472ab6a87d62554c5576784b72654cef32356590246907dd6f4b" May 21 13:11:23.081318 ip-10-0-133-64 kubenswrapper[2562]: E0521 13:11:23.081296 2562 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"1e21da829e6a472ab6a87d62554c5576784b72654cef32356590246907dd6f4b\": container with ID starting with 1e21da829e6a472ab6a87d62554c5576784b72654cef32356590246907dd6f4b not found: ID does not exist" containerID="1e21da829e6a472ab6a87d62554c5576784b72654cef32356590246907dd6f4b" May 21 13:11:23.081471 ip-10-0-133-64 kubenswrapper[2562]: I0521 13:11:23.081325 2562 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"1e21da829e6a472ab6a87d62554c5576784b72654cef32356590246907dd6f4b"} err="failed to get container status \"1e21da829e6a472ab6a87d62554c5576784b72654cef32356590246907dd6f4b\": rpc error: code = NotFound desc = could not find container \"1e21da829e6a472ab6a87d62554c5576784b72654cef32356590246907dd6f4b\": container with ID starting with 1e21da829e6a472ab6a87d62554c5576784b72654cef32356590246907dd6f4b not found: ID does not exist" May 21 13:11:23.092399 ip-10-0-133-64 kubenswrapper[2562]: I0521 13:11:23.092295 2562 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["opendatahub/maas-controller-68fb5d86bc-pdb4f"] May 21 13:11:23.095252 ip-10-0-133-64 kubenswrapper[2562]: I0521 13:11:23.095232 2562 kubelet.go:2547] "SyncLoop REMOVE" source="api" pods=["opendatahub/maas-controller-68fb5d86bc-pdb4f"] May 21 13:11:24.037591 ip-10-0-133-64 kubenswrapper[2562]: I0521 13:11:24.037557 2562 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="36a97608-4349-4fac-a18a-facf63297956" path="/var/lib/kubelet/pods/36a97608-4349-4fac-a18a-facf63297956/volumes" May 21 13:11:24.064136 ip-10-0-133-64 kubenswrapper[2562]: I0521 13:11:24.064103 2562 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-85cc5d9594-67cxt" event={"ID":"ef6f595f-efd7-42fa-b693-3cc62487f51d","Type":"ContainerStarted","Data":"7bba4c2e8d2fb221b3916eef7ef49edbef68be6630477dd2885badaae8b5375b"} May 21 13:11:24.064577 ip-10-0-133-64 kubenswrapper[2562]: I0521 13:11:24.064163 2562 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/maas-controller-85cc5d9594-67cxt" May 21 13:11:24.082127 ip-10-0-133-64 kubenswrapper[2562]: I0521 13:11:24.082079 2562 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="opendatahub/maas-controller-85cc5d9594-67cxt" podStartSLOduration=1.7784560969999998 podStartE2EDuration="2.082066988s" podCreationTimestamp="2026-05-21 13:11:22 +0000 UTC" firstStartedPulling="2026-05-21 13:11:22.738701196 +0000 UTC m=+529.288982547" lastFinishedPulling="2026-05-21 13:11:23.042312078 +0000 UTC m=+529.592593438" observedRunningTime="2026-05-21 13:11:24.080021466 +0000 UTC m=+530.630302834" watchObservedRunningTime="2026-05-21 13:11:24.082066988 +0000 UTC m=+530.632348355" May 21 13:11:35.074519 ip-10-0-133-64 kubenswrapper[2562]: I0521 13:11:35.074487 2562 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/maas-controller-85cc5d9594-67cxt" May 21 13:11:35.120680 ip-10-0-133-64 kubenswrapper[2562]: I0521 13:11:35.120640 2562 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["opendatahub/maas-controller-69556b5698-68vm6"] May 21 13:11:35.121053 ip-10-0-133-64 kubenswrapper[2562]: I0521 13:11:35.121024 2562 kuberuntime_container.go:864] "Killing container with a grace period" pod="opendatahub/maas-controller-69556b5698-68vm6" podUID="2742f73d-b040-46b7-a402-06a7e7abdd6e" containerName="manager" containerID="cri-o://6b446c68faa4d4c83b26df5a870c12fd401b1a2417fc8f39752c5bba49ca16fc" gracePeriod=30 May 21 13:11:35.360325 ip-10-0-133-64 kubenswrapper[2562]: I0521 13:11:35.360299 2562 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-69556b5698-68vm6" May 21 13:11:35.413857 ip-10-0-133-64 kubenswrapper[2562]: I0521 13:11:35.413823 2562 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-bhw5f\" (UniqueName: \"kubernetes.io/projected/2742f73d-b040-46b7-a402-06a7e7abdd6e-kube-api-access-bhw5f\") pod \"2742f73d-b040-46b7-a402-06a7e7abdd6e\" (UID: \"2742f73d-b040-46b7-a402-06a7e7abdd6e\") " May 21 13:11:35.415758 ip-10-0-133-64 kubenswrapper[2562]: I0521 13:11:35.415734 2562 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/2742f73d-b040-46b7-a402-06a7e7abdd6e-kube-api-access-bhw5f" (OuterVolumeSpecName: "kube-api-access-bhw5f") pod "2742f73d-b040-46b7-a402-06a7e7abdd6e" (UID: "2742f73d-b040-46b7-a402-06a7e7abdd6e"). InnerVolumeSpecName "kube-api-access-bhw5f". PluginName "kubernetes.io/projected", VolumeGIDValue "" May 21 13:11:35.515205 ip-10-0-133-64 kubenswrapper[2562]: I0521 13:11:35.515166 2562 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-bhw5f\" (UniqueName: \"kubernetes.io/projected/2742f73d-b040-46b7-a402-06a7e7abdd6e-kube-api-access-bhw5f\") on node \"ip-10-0-133-64.ec2.internal\" DevicePath \"\"" May 21 13:11:36.107567 ip-10-0-133-64 kubenswrapper[2562]: I0521 13:11:36.107526 2562 generic.go:358] "Generic (PLEG): container finished" podID="2742f73d-b040-46b7-a402-06a7e7abdd6e" containerID="6b446c68faa4d4c83b26df5a870c12fd401b1a2417fc8f39752c5bba49ca16fc" exitCode=0 May 21 13:11:36.108025 ip-10-0-133-64 kubenswrapper[2562]: I0521 13:11:36.107580 2562 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-69556b5698-68vm6" event={"ID":"2742f73d-b040-46b7-a402-06a7e7abdd6e","Type":"ContainerDied","Data":"6b446c68faa4d4c83b26df5a870c12fd401b1a2417fc8f39752c5bba49ca16fc"} May 21 13:11:36.108025 ip-10-0-133-64 kubenswrapper[2562]: I0521 13:11:36.107591 2562 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-69556b5698-68vm6" May 21 13:11:36.108025 ip-10-0-133-64 kubenswrapper[2562]: I0521 13:11:36.107614 2562 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-69556b5698-68vm6" event={"ID":"2742f73d-b040-46b7-a402-06a7e7abdd6e","Type":"ContainerDied","Data":"89e603c93089a19e6db37714a2f99117d3ba0749be91b61a9d722533291969dc"} May 21 13:11:36.108025 ip-10-0-133-64 kubenswrapper[2562]: I0521 13:11:36.107634 2562 scope.go:117] "RemoveContainer" containerID="6b446c68faa4d4c83b26df5a870c12fd401b1a2417fc8f39752c5bba49ca16fc" May 21 13:11:36.115962 ip-10-0-133-64 kubenswrapper[2562]: I0521 13:11:36.115941 2562 scope.go:117] "RemoveContainer" containerID="6b446c68faa4d4c83b26df5a870c12fd401b1a2417fc8f39752c5bba49ca16fc" May 21 13:11:36.116194 ip-10-0-133-64 kubenswrapper[2562]: E0521 13:11:36.116173 2562 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"6b446c68faa4d4c83b26df5a870c12fd401b1a2417fc8f39752c5bba49ca16fc\": container with ID starting with 6b446c68faa4d4c83b26df5a870c12fd401b1a2417fc8f39752c5bba49ca16fc not found: ID does not exist" containerID="6b446c68faa4d4c83b26df5a870c12fd401b1a2417fc8f39752c5bba49ca16fc" May 21 13:11:36.116248 ip-10-0-133-64 kubenswrapper[2562]: I0521 13:11:36.116201 2562 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"6b446c68faa4d4c83b26df5a870c12fd401b1a2417fc8f39752c5bba49ca16fc"} err="failed to get container status \"6b446c68faa4d4c83b26df5a870c12fd401b1a2417fc8f39752c5bba49ca16fc\": rpc error: code = NotFound desc = could not find container \"6b446c68faa4d4c83b26df5a870c12fd401b1a2417fc8f39752c5bba49ca16fc\": container with ID starting with 6b446c68faa4d4c83b26df5a870c12fd401b1a2417fc8f39752c5bba49ca16fc not found: ID does not exist" May 21 13:11:36.124806 ip-10-0-133-64 kubenswrapper[2562]: I0521 13:11:36.124771 2562 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["opendatahub/maas-controller-69556b5698-68vm6"] May 21 13:11:36.128086 ip-10-0-133-64 kubenswrapper[2562]: I0521 13:11:36.128064 2562 kubelet.go:2547] "SyncLoop REMOVE" source="api" pods=["opendatahub/maas-controller-69556b5698-68vm6"] May 21 13:11:38.037395 ip-10-0-133-64 kubenswrapper[2562]: I0521 13:11:38.037366 2562 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="2742f73d-b040-46b7-a402-06a7e7abdd6e" path="/var/lib/kubelet/pods/2742f73d-b040-46b7-a402-06a7e7abdd6e/volumes" May 21 13:12:09.925094 ip-10-0-133-64 kubenswrapper[2562]: I0521 13:12:09.925052 2562 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["llm/e2e-distinct-simulated-kserve-7bb4cdb4d7-9crgh"] May 21 13:12:09.925630 ip-10-0-133-64 kubenswrapper[2562]: I0521 13:12:09.925525 2562 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="2742f73d-b040-46b7-a402-06a7e7abdd6e" containerName="manager" May 21 13:12:09.925630 ip-10-0-133-64 kubenswrapper[2562]: I0521 13:12:09.925542 2562 state_mem.go:107] "Deleted CPUSet assignment" podUID="2742f73d-b040-46b7-a402-06a7e7abdd6e" containerName="manager" May 21 13:12:09.925630 ip-10-0-133-64 kubenswrapper[2562]: I0521 13:12:09.925565 2562 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="36a97608-4349-4fac-a18a-facf63297956" containerName="manager" May 21 13:12:09.925630 ip-10-0-133-64 kubenswrapper[2562]: I0521 13:12:09.925570 2562 state_mem.go:107] "Deleted CPUSet assignment" podUID="36a97608-4349-4fac-a18a-facf63297956" containerName="manager" May 21 13:12:09.925630 ip-10-0-133-64 kubenswrapper[2562]: I0521 13:12:09.925626 2562 memory_manager.go:356] "RemoveStaleState removing state" podUID="2742f73d-b040-46b7-a402-06a7e7abdd6e" containerName="manager" May 21 13:12:09.925836 ip-10-0-133-64 kubenswrapper[2562]: I0521 13:12:09.925637 2562 memory_manager.go:356] "RemoveStaleState removing state" podUID="36a97608-4349-4fac-a18a-facf63297956" containerName="manager" May 21 13:12:09.934195 ip-10-0-133-64 kubenswrapper[2562]: I0521 13:12:09.934157 2562 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-distinct-simulated-kserve-7bb4cdb4d7-9crgh" May 21 13:12:09.937770 ip-10-0-133-64 kubenswrapper[2562]: I0521 13:12:09.937741 2562 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"llm\"/\"openshift-service-ca.crt\"" May 21 13:12:09.937770 ip-10-0-133-64 kubenswrapper[2562]: I0521 13:12:09.937767 2562 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"llm\"/\"kube-root-ca.crt\"" May 21 13:12:09.938112 ip-10-0-133-64 kubenswrapper[2562]: I0521 13:12:09.938090 2562 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"e2e-distinct-simulated-kserve-self-signed-certs\"" May 21 13:12:09.938196 ip-10-0-133-64 kubenswrapper[2562]: I0521 13:12:09.938089 2562 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"default-dockercfg-g2h66\"" May 21 13:12:09.939894 ip-10-0-133-64 kubenswrapper[2562]: I0521 13:12:09.939867 2562 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["llm/e2e-distinct-simulated-kserve-7bb4cdb4d7-9crgh"] May 21 13:12:10.119545 ip-10-0-133-64 kubenswrapper[2562]: I0521 13:12:10.119509 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/bcfce64e-cb8e-4bf1-a866-f342f41ab442-home\") pod \"e2e-distinct-simulated-kserve-7bb4cdb4d7-9crgh\" (UID: \"bcfce64e-cb8e-4bf1-a866-f342f41ab442\") " pod="llm/e2e-distinct-simulated-kserve-7bb4cdb4d7-9crgh" May 21 13:12:10.119715 ip-10-0-133-64 kubenswrapper[2562]: I0521 13:12:10.119578 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kserve-provision-location\" (UniqueName: \"kubernetes.io/empty-dir/bcfce64e-cb8e-4bf1-a866-f342f41ab442-kserve-provision-location\") pod \"e2e-distinct-simulated-kserve-7bb4cdb4d7-9crgh\" (UID: \"bcfce64e-cb8e-4bf1-a866-f342f41ab442\") " pod="llm/e2e-distinct-simulated-kserve-7bb4cdb4d7-9crgh" May 21 13:12:10.119715 ip-10-0-133-64 kubenswrapper[2562]: I0521 13:12:10.119601 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/bcfce64e-cb8e-4bf1-a866-f342f41ab442-tls-certs\") pod \"e2e-distinct-simulated-kserve-7bb4cdb4d7-9crgh\" (UID: \"bcfce64e-cb8e-4bf1-a866-f342f41ab442\") " pod="llm/e2e-distinct-simulated-kserve-7bb4cdb4d7-9crgh" May 21 13:12:10.119715 ip-10-0-133-64 kubenswrapper[2562]: I0521 13:12:10.119618 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-4kxzs\" (UniqueName: \"kubernetes.io/projected/bcfce64e-cb8e-4bf1-a866-f342f41ab442-kube-api-access-4kxzs\") pod \"e2e-distinct-simulated-kserve-7bb4cdb4d7-9crgh\" (UID: \"bcfce64e-cb8e-4bf1-a866-f342f41ab442\") " pod="llm/e2e-distinct-simulated-kserve-7bb4cdb4d7-9crgh" May 21 13:12:10.119715 ip-10-0-133-64 kubenswrapper[2562]: I0521 13:12:10.119645 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/bcfce64e-cb8e-4bf1-a866-f342f41ab442-dshm\") pod \"e2e-distinct-simulated-kserve-7bb4cdb4d7-9crgh\" (UID: \"bcfce64e-cb8e-4bf1-a866-f342f41ab442\") " pod="llm/e2e-distinct-simulated-kserve-7bb4cdb4d7-9crgh" May 21 13:12:10.119889 ip-10-0-133-64 kubenswrapper[2562]: I0521 13:12:10.119723 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/bcfce64e-cb8e-4bf1-a866-f342f41ab442-model-cache\") pod \"e2e-distinct-simulated-kserve-7bb4cdb4d7-9crgh\" (UID: \"bcfce64e-cb8e-4bf1-a866-f342f41ab442\") " pod="llm/e2e-distinct-simulated-kserve-7bb4cdb4d7-9crgh" May 21 13:12:10.220611 ip-10-0-133-64 kubenswrapper[2562]: I0521 13:12:10.220576 2562 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/bcfce64e-cb8e-4bf1-a866-f342f41ab442-home\") pod \"e2e-distinct-simulated-kserve-7bb4cdb4d7-9crgh\" (UID: \"bcfce64e-cb8e-4bf1-a866-f342f41ab442\") " pod="llm/e2e-distinct-simulated-kserve-7bb4cdb4d7-9crgh" May 21 13:12:10.220838 ip-10-0-133-64 kubenswrapper[2562]: I0521 13:12:10.220656 2562 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kserve-provision-location\" (UniqueName: \"kubernetes.io/empty-dir/bcfce64e-cb8e-4bf1-a866-f342f41ab442-kserve-provision-location\") pod \"e2e-distinct-simulated-kserve-7bb4cdb4d7-9crgh\" (UID: \"bcfce64e-cb8e-4bf1-a866-f342f41ab442\") " pod="llm/e2e-distinct-simulated-kserve-7bb4cdb4d7-9crgh" May 21 13:12:10.220838 ip-10-0-133-64 kubenswrapper[2562]: I0521 13:12:10.220676 2562 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/bcfce64e-cb8e-4bf1-a866-f342f41ab442-tls-certs\") pod \"e2e-distinct-simulated-kserve-7bb4cdb4d7-9crgh\" (UID: \"bcfce64e-cb8e-4bf1-a866-f342f41ab442\") " pod="llm/e2e-distinct-simulated-kserve-7bb4cdb4d7-9crgh" May 21 13:12:10.220838 ip-10-0-133-64 kubenswrapper[2562]: I0521 13:12:10.220695 2562 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-4kxzs\" (UniqueName: \"kubernetes.io/projected/bcfce64e-cb8e-4bf1-a866-f342f41ab442-kube-api-access-4kxzs\") pod \"e2e-distinct-simulated-kserve-7bb4cdb4d7-9crgh\" (UID: \"bcfce64e-cb8e-4bf1-a866-f342f41ab442\") " pod="llm/e2e-distinct-simulated-kserve-7bb4cdb4d7-9crgh" May 21 13:12:10.220838 ip-10-0-133-64 kubenswrapper[2562]: I0521 13:12:10.220724 2562 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/bcfce64e-cb8e-4bf1-a866-f342f41ab442-dshm\") pod \"e2e-distinct-simulated-kserve-7bb4cdb4d7-9crgh\" (UID: \"bcfce64e-cb8e-4bf1-a866-f342f41ab442\") " pod="llm/e2e-distinct-simulated-kserve-7bb4cdb4d7-9crgh" May 21 13:12:10.220838 ip-10-0-133-64 kubenswrapper[2562]: I0521 13:12:10.220756 2562 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/bcfce64e-cb8e-4bf1-a866-f342f41ab442-model-cache\") pod \"e2e-distinct-simulated-kserve-7bb4cdb4d7-9crgh\" (UID: \"bcfce64e-cb8e-4bf1-a866-f342f41ab442\") " pod="llm/e2e-distinct-simulated-kserve-7bb4cdb4d7-9crgh" May 21 13:12:10.221131 ip-10-0-133-64 kubenswrapper[2562]: I0521 13:12:10.221065 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/bcfce64e-cb8e-4bf1-a866-f342f41ab442-home\") pod \"e2e-distinct-simulated-kserve-7bb4cdb4d7-9crgh\" (UID: \"bcfce64e-cb8e-4bf1-a866-f342f41ab442\") " pod="llm/e2e-distinct-simulated-kserve-7bb4cdb4d7-9crgh" May 21 13:12:10.221131 ip-10-0-133-64 kubenswrapper[2562]: I0521 13:12:10.221102 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kserve-provision-location\" (UniqueName: \"kubernetes.io/empty-dir/bcfce64e-cb8e-4bf1-a866-f342f41ab442-kserve-provision-location\") pod \"e2e-distinct-simulated-kserve-7bb4cdb4d7-9crgh\" (UID: \"bcfce64e-cb8e-4bf1-a866-f342f41ab442\") " pod="llm/e2e-distinct-simulated-kserve-7bb4cdb4d7-9crgh" May 21 13:12:10.221212 ip-10-0-133-64 kubenswrapper[2562]: I0521 13:12:10.221170 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/bcfce64e-cb8e-4bf1-a866-f342f41ab442-model-cache\") pod \"e2e-distinct-simulated-kserve-7bb4cdb4d7-9crgh\" (UID: \"bcfce64e-cb8e-4bf1-a866-f342f41ab442\") " pod="llm/e2e-distinct-simulated-kserve-7bb4cdb4d7-9crgh" May 21 13:12:10.223080 ip-10-0-133-64 kubenswrapper[2562]: I0521 13:12:10.223062 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/bcfce64e-cb8e-4bf1-a866-f342f41ab442-dshm\") pod \"e2e-distinct-simulated-kserve-7bb4cdb4d7-9crgh\" (UID: \"bcfce64e-cb8e-4bf1-a866-f342f41ab442\") " pod="llm/e2e-distinct-simulated-kserve-7bb4cdb4d7-9crgh" May 21 13:12:10.223158 ip-10-0-133-64 kubenswrapper[2562]: I0521 13:12:10.223137 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/bcfce64e-cb8e-4bf1-a866-f342f41ab442-tls-certs\") pod \"e2e-distinct-simulated-kserve-7bb4cdb4d7-9crgh\" (UID: \"bcfce64e-cb8e-4bf1-a866-f342f41ab442\") " pod="llm/e2e-distinct-simulated-kserve-7bb4cdb4d7-9crgh" May 21 13:12:10.228860 ip-10-0-133-64 kubenswrapper[2562]: I0521 13:12:10.228838 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-4kxzs\" (UniqueName: \"kubernetes.io/projected/bcfce64e-cb8e-4bf1-a866-f342f41ab442-kube-api-access-4kxzs\") pod \"e2e-distinct-simulated-kserve-7bb4cdb4d7-9crgh\" (UID: \"bcfce64e-cb8e-4bf1-a866-f342f41ab442\") " pod="llm/e2e-distinct-simulated-kserve-7bb4cdb4d7-9crgh" May 21 13:12:10.246179 ip-10-0-133-64 kubenswrapper[2562]: I0521 13:12:10.246153 2562 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-distinct-simulated-kserve-7bb4cdb4d7-9crgh" May 21 13:12:10.380156 ip-10-0-133-64 kubenswrapper[2562]: I0521 13:12:10.380127 2562 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["llm/e2e-distinct-simulated-kserve-7bb4cdb4d7-9crgh"] May 21 13:12:10.381856 ip-10-0-133-64 kubenswrapper[2562]: W0521 13:12:10.381831 2562 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podbcfce64e_cb8e_4bf1_a866_f342f41ab442.slice/crio-4465388aaa5ae00b926e450b0e001be38943416f81a3a6b3b74a38c08134ca53 WatchSource:0}: Error finding container 4465388aaa5ae00b926e450b0e001be38943416f81a3a6b3b74a38c08134ca53: Status 404 returned error can't find the container with id 4465388aaa5ae00b926e450b0e001be38943416f81a3a6b3b74a38c08134ca53 May 21 13:12:11.239329 ip-10-0-133-64 kubenswrapper[2562]: I0521 13:12:11.239295 2562 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="llm/e2e-distinct-simulated-kserve-7bb4cdb4d7-9crgh" event={"ID":"bcfce64e-cb8e-4bf1-a866-f342f41ab442","Type":"ContainerStarted","Data":"4465388aaa5ae00b926e450b0e001be38943416f81a3a6b3b74a38c08134ca53"} May 21 13:12:18.270676 ip-10-0-133-64 kubenswrapper[2562]: I0521 13:12:18.270630 2562 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="llm/e2e-distinct-simulated-kserve-7bb4cdb4d7-9crgh" event={"ID":"bcfce64e-cb8e-4bf1-a866-f342f41ab442","Type":"ContainerStarted","Data":"86d2ddf8bee544b6d820090578ddaa7a7ca0fb0b829d4fc876f5657bfc8b4226"} May 21 13:12:18.816258 ip-10-0-133-64 kubenswrapper[2562]: I0521 13:12:18.816215 2562 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["llm/e2e-distinct-2-simulated-kserve-7f849f6b56-qlznj"] May 21 13:12:18.820577 ip-10-0-133-64 kubenswrapper[2562]: I0521 13:12:18.820551 2562 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-distinct-2-simulated-kserve-7f849f6b56-qlznj" May 21 13:12:18.822830 ip-10-0-133-64 kubenswrapper[2562]: I0521 13:12:18.822792 2562 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"e2e-distinct-2-simulated-kserve-self-signed-certs\"" May 21 13:12:18.828258 ip-10-0-133-64 kubenswrapper[2562]: I0521 13:12:18.828230 2562 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["llm/e2e-distinct-2-simulated-kserve-7f849f6b56-qlznj"] May 21 13:12:18.889905 ip-10-0-133-64 kubenswrapper[2562]: I0521 13:12:18.889866 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/d302afb7-9d9f-4c9d-a8d7-4f65e4b2a246-dshm\") pod \"e2e-distinct-2-simulated-kserve-7f849f6b56-qlznj\" (UID: \"d302afb7-9d9f-4c9d-a8d7-4f65e4b2a246\") " pod="llm/e2e-distinct-2-simulated-kserve-7f849f6b56-qlznj" May 21 13:12:18.889905 ip-10-0-133-64 kubenswrapper[2562]: I0521 13:12:18.889911 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kserve-provision-location\" (UniqueName: \"kubernetes.io/empty-dir/d302afb7-9d9f-4c9d-a8d7-4f65e4b2a246-kserve-provision-location\") pod \"e2e-distinct-2-simulated-kserve-7f849f6b56-qlznj\" (UID: \"d302afb7-9d9f-4c9d-a8d7-4f65e4b2a246\") " pod="llm/e2e-distinct-2-simulated-kserve-7f849f6b56-qlznj" May 21 13:12:18.890140 ip-10-0-133-64 kubenswrapper[2562]: I0521 13:12:18.889939 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/d302afb7-9d9f-4c9d-a8d7-4f65e4b2a246-home\") pod \"e2e-distinct-2-simulated-kserve-7f849f6b56-qlznj\" (UID: \"d302afb7-9d9f-4c9d-a8d7-4f65e4b2a246\") " pod="llm/e2e-distinct-2-simulated-kserve-7f849f6b56-qlznj" May 21 13:12:18.890140 ip-10-0-133-64 kubenswrapper[2562]: I0521 13:12:18.890029 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/d302afb7-9d9f-4c9d-a8d7-4f65e4b2a246-model-cache\") pod \"e2e-distinct-2-simulated-kserve-7f849f6b56-qlznj\" (UID: \"d302afb7-9d9f-4c9d-a8d7-4f65e4b2a246\") " pod="llm/e2e-distinct-2-simulated-kserve-7f849f6b56-qlznj" May 21 13:12:18.890140 ip-10-0-133-64 kubenswrapper[2562]: I0521 13:12:18.890066 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/d302afb7-9d9f-4c9d-a8d7-4f65e4b2a246-tls-certs\") pod \"e2e-distinct-2-simulated-kserve-7f849f6b56-qlznj\" (UID: \"d302afb7-9d9f-4c9d-a8d7-4f65e4b2a246\") " pod="llm/e2e-distinct-2-simulated-kserve-7f849f6b56-qlznj" May 21 13:12:18.890140 ip-10-0-133-64 kubenswrapper[2562]: I0521 13:12:18.890105 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-xlj94\" (UniqueName: \"kubernetes.io/projected/d302afb7-9d9f-4c9d-a8d7-4f65e4b2a246-kube-api-access-xlj94\") pod \"e2e-distinct-2-simulated-kserve-7f849f6b56-qlznj\" (UID: \"d302afb7-9d9f-4c9d-a8d7-4f65e4b2a246\") " pod="llm/e2e-distinct-2-simulated-kserve-7f849f6b56-qlznj" May 21 13:12:18.991140 ip-10-0-133-64 kubenswrapper[2562]: I0521 13:12:18.991100 2562 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-xlj94\" (UniqueName: \"kubernetes.io/projected/d302afb7-9d9f-4c9d-a8d7-4f65e4b2a246-kube-api-access-xlj94\") pod \"e2e-distinct-2-simulated-kserve-7f849f6b56-qlznj\" (UID: \"d302afb7-9d9f-4c9d-a8d7-4f65e4b2a246\") " pod="llm/e2e-distinct-2-simulated-kserve-7f849f6b56-qlznj" May 21 13:12:18.991317 ip-10-0-133-64 kubenswrapper[2562]: I0521 13:12:18.991166 2562 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/d302afb7-9d9f-4c9d-a8d7-4f65e4b2a246-dshm\") pod \"e2e-distinct-2-simulated-kserve-7f849f6b56-qlznj\" (UID: \"d302afb7-9d9f-4c9d-a8d7-4f65e4b2a246\") " pod="llm/e2e-distinct-2-simulated-kserve-7f849f6b56-qlznj" May 21 13:12:18.991317 ip-10-0-133-64 kubenswrapper[2562]: I0521 13:12:18.991201 2562 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kserve-provision-location\" (UniqueName: \"kubernetes.io/empty-dir/d302afb7-9d9f-4c9d-a8d7-4f65e4b2a246-kserve-provision-location\") pod \"e2e-distinct-2-simulated-kserve-7f849f6b56-qlznj\" (UID: \"d302afb7-9d9f-4c9d-a8d7-4f65e4b2a246\") " pod="llm/e2e-distinct-2-simulated-kserve-7f849f6b56-qlznj" May 21 13:12:18.991317 ip-10-0-133-64 kubenswrapper[2562]: I0521 13:12:18.991231 2562 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/d302afb7-9d9f-4c9d-a8d7-4f65e4b2a246-home\") pod \"e2e-distinct-2-simulated-kserve-7f849f6b56-qlznj\" (UID: \"d302afb7-9d9f-4c9d-a8d7-4f65e4b2a246\") " pod="llm/e2e-distinct-2-simulated-kserve-7f849f6b56-qlznj" May 21 13:12:18.991317 ip-10-0-133-64 kubenswrapper[2562]: I0521 13:12:18.991294 2562 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/d302afb7-9d9f-4c9d-a8d7-4f65e4b2a246-model-cache\") pod \"e2e-distinct-2-simulated-kserve-7f849f6b56-qlznj\" (UID: \"d302afb7-9d9f-4c9d-a8d7-4f65e4b2a246\") " pod="llm/e2e-distinct-2-simulated-kserve-7f849f6b56-qlznj" May 21 13:12:18.991523 ip-10-0-133-64 kubenswrapper[2562]: I0521 13:12:18.991319 2562 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/d302afb7-9d9f-4c9d-a8d7-4f65e4b2a246-tls-certs\") pod \"e2e-distinct-2-simulated-kserve-7f849f6b56-qlznj\" (UID: \"d302afb7-9d9f-4c9d-a8d7-4f65e4b2a246\") " pod="llm/e2e-distinct-2-simulated-kserve-7f849f6b56-qlznj" May 21 13:12:18.991657 ip-10-0-133-64 kubenswrapper[2562]: I0521 13:12:18.991630 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/d302afb7-9d9f-4c9d-a8d7-4f65e4b2a246-home\") pod \"e2e-distinct-2-simulated-kserve-7f849f6b56-qlznj\" (UID: \"d302afb7-9d9f-4c9d-a8d7-4f65e4b2a246\") " pod="llm/e2e-distinct-2-simulated-kserve-7f849f6b56-qlznj" May 21 13:12:18.991737 ip-10-0-133-64 kubenswrapper[2562]: I0521 13:12:18.991684 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/d302afb7-9d9f-4c9d-a8d7-4f65e4b2a246-model-cache\") pod \"e2e-distinct-2-simulated-kserve-7f849f6b56-qlznj\" (UID: \"d302afb7-9d9f-4c9d-a8d7-4f65e4b2a246\") " pod="llm/e2e-distinct-2-simulated-kserve-7f849f6b56-qlznj" May 21 13:12:18.992019 ip-10-0-133-64 kubenswrapper[2562]: I0521 13:12:18.991996 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kserve-provision-location\" (UniqueName: \"kubernetes.io/empty-dir/d302afb7-9d9f-4c9d-a8d7-4f65e4b2a246-kserve-provision-location\") pod \"e2e-distinct-2-simulated-kserve-7f849f6b56-qlznj\" (UID: \"d302afb7-9d9f-4c9d-a8d7-4f65e4b2a246\") " pod="llm/e2e-distinct-2-simulated-kserve-7f849f6b56-qlznj" May 21 13:12:18.993674 ip-10-0-133-64 kubenswrapper[2562]: I0521 13:12:18.993647 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/d302afb7-9d9f-4c9d-a8d7-4f65e4b2a246-dshm\") pod \"e2e-distinct-2-simulated-kserve-7f849f6b56-qlznj\" (UID: \"d302afb7-9d9f-4c9d-a8d7-4f65e4b2a246\") " pod="llm/e2e-distinct-2-simulated-kserve-7f849f6b56-qlznj" May 21 13:12:18.993969 ip-10-0-133-64 kubenswrapper[2562]: I0521 13:12:18.993948 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/d302afb7-9d9f-4c9d-a8d7-4f65e4b2a246-tls-certs\") pod \"e2e-distinct-2-simulated-kserve-7f849f6b56-qlznj\" (UID: \"d302afb7-9d9f-4c9d-a8d7-4f65e4b2a246\") " pod="llm/e2e-distinct-2-simulated-kserve-7f849f6b56-qlznj" May 21 13:12:18.999069 ip-10-0-133-64 kubenswrapper[2562]: I0521 13:12:18.999028 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-xlj94\" (UniqueName: \"kubernetes.io/projected/d302afb7-9d9f-4c9d-a8d7-4f65e4b2a246-kube-api-access-xlj94\") pod \"e2e-distinct-2-simulated-kserve-7f849f6b56-qlznj\" (UID: \"d302afb7-9d9f-4c9d-a8d7-4f65e4b2a246\") " pod="llm/e2e-distinct-2-simulated-kserve-7f849f6b56-qlznj" May 21 13:12:19.134194 ip-10-0-133-64 kubenswrapper[2562]: I0521 13:12:19.134112 2562 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-distinct-2-simulated-kserve-7f849f6b56-qlznj" May 21 13:12:19.298684 ip-10-0-133-64 kubenswrapper[2562]: I0521 13:12:19.298626 2562 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["llm/e2e-distinct-2-simulated-kserve-7f849f6b56-qlznj"] May 21 13:12:19.301049 ip-10-0-133-64 kubenswrapper[2562]: W0521 13:12:19.301022 2562 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podd302afb7_9d9f_4c9d_a8d7_4f65e4b2a246.slice/crio-b4d38c8fe369af97dac8f58db68ce1958f9b301bfd2fb65b0fc14ae27389751e WatchSource:0}: Error finding container b4d38c8fe369af97dac8f58db68ce1958f9b301bfd2fb65b0fc14ae27389751e: Status 404 returned error can't find the container with id b4d38c8fe369af97dac8f58db68ce1958f9b301bfd2fb65b0fc14ae27389751e May 21 13:12:20.281446 ip-10-0-133-64 kubenswrapper[2562]: I0521 13:12:20.281396 2562 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="llm/e2e-distinct-2-simulated-kserve-7f849f6b56-qlznj" event={"ID":"d302afb7-9d9f-4c9d-a8d7-4f65e4b2a246","Type":"ContainerStarted","Data":"e3e39dc1750d0a005765f82dc7115801e2a6705c07cb1dbd44f82ed43fde3a3c"} May 21 13:12:20.281446 ip-10-0-133-64 kubenswrapper[2562]: I0521 13:12:20.281446 2562 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="llm/e2e-distinct-2-simulated-kserve-7f849f6b56-qlznj" event={"ID":"d302afb7-9d9f-4c9d-a8d7-4f65e4b2a246","Type":"ContainerStarted","Data":"b4d38c8fe369af97dac8f58db68ce1958f9b301bfd2fb65b0fc14ae27389751e"} May 21 13:12:24.299958 ip-10-0-133-64 kubenswrapper[2562]: I0521 13:12:24.299922 2562 generic.go:358] "Generic (PLEG): container finished" podID="bcfce64e-cb8e-4bf1-a866-f342f41ab442" containerID="86d2ddf8bee544b6d820090578ddaa7a7ca0fb0b829d4fc876f5657bfc8b4226" exitCode=0 May 21 13:12:24.300326 ip-10-0-133-64 kubenswrapper[2562]: I0521 13:12:24.299974 2562 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="llm/e2e-distinct-simulated-kserve-7bb4cdb4d7-9crgh" event={"ID":"bcfce64e-cb8e-4bf1-a866-f342f41ab442","Type":"ContainerDied","Data":"86d2ddf8bee544b6d820090578ddaa7a7ca0fb0b829d4fc876f5657bfc8b4226"} May 21 13:12:26.309060 ip-10-0-133-64 kubenswrapper[2562]: I0521 13:12:26.308958 2562 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="llm/e2e-distinct-simulated-kserve-7bb4cdb4d7-9crgh" event={"ID":"bcfce64e-cb8e-4bf1-a866-f342f41ab442","Type":"ContainerStarted","Data":"9dfcc752163a459cb2922b228af9865db0b7fba04c7759284e4d4ca97b27fb3a"} May 21 13:12:26.309483 ip-10-0-133-64 kubenswrapper[2562]: I0521 13:12:26.309194 2562 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="llm/e2e-distinct-simulated-kserve-7bb4cdb4d7-9crgh" May 21 13:12:26.310244 ip-10-0-133-64 kubenswrapper[2562]: I0521 13:12:26.310216 2562 generic.go:358] "Generic (PLEG): container finished" podID="d302afb7-9d9f-4c9d-a8d7-4f65e4b2a246" containerID="e3e39dc1750d0a005765f82dc7115801e2a6705c07cb1dbd44f82ed43fde3a3c" exitCode=0 May 21 13:12:26.310329 ip-10-0-133-64 kubenswrapper[2562]: I0521 13:12:26.310284 2562 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="llm/e2e-distinct-2-simulated-kserve-7f849f6b56-qlznj" event={"ID":"d302afb7-9d9f-4c9d-a8d7-4f65e4b2a246","Type":"ContainerDied","Data":"e3e39dc1750d0a005765f82dc7115801e2a6705c07cb1dbd44f82ed43fde3a3c"} May 21 13:12:26.329325 ip-10-0-133-64 kubenswrapper[2562]: I0521 13:12:26.329277 2562 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="llm/e2e-distinct-simulated-kserve-7bb4cdb4d7-9crgh" podStartSLOduration=2.041360737 podStartE2EDuration="17.329263676s" podCreationTimestamp="2026-05-21 13:12:09 +0000 UTC" firstStartedPulling="2026-05-21 13:12:10.383643992 +0000 UTC m=+576.933925337" lastFinishedPulling="2026-05-21 13:12:25.67154693 +0000 UTC m=+592.221828276" observedRunningTime="2026-05-21 13:12:26.326198233 +0000 UTC m=+592.876484463" watchObservedRunningTime="2026-05-21 13:12:26.329263676 +0000 UTC m=+592.879545043" May 21 13:12:27.315640 ip-10-0-133-64 kubenswrapper[2562]: I0521 13:12:27.315603 2562 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="llm/e2e-distinct-2-simulated-kserve-7f849f6b56-qlznj" event={"ID":"d302afb7-9d9f-4c9d-a8d7-4f65e4b2a246","Type":"ContainerStarted","Data":"699afba17a3e6424c68c19beab3ca355601d5eb0169d0e2b33ce66569f8b4b5f"} May 21 13:12:27.338864 ip-10-0-133-64 kubenswrapper[2562]: I0521 13:12:27.338818 2562 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="llm/e2e-distinct-2-simulated-kserve-7f849f6b56-qlznj" podStartSLOduration=8.909246125 podStartE2EDuration="9.338789499s" podCreationTimestamp="2026-05-21 13:12:18 +0000 UTC" firstStartedPulling="2026-05-21 13:12:26.310890074 +0000 UTC m=+592.861171423" lastFinishedPulling="2026-05-21 13:12:26.740433451 +0000 UTC m=+593.290714797" observedRunningTime="2026-05-21 13:12:27.33639256 +0000 UTC m=+593.886673928" watchObservedRunningTime="2026-05-21 13:12:27.338789499 +0000 UTC m=+593.889070844" May 21 13:12:37.316400 ip-10-0-133-64 kubenswrapper[2562]: I0521 13:12:37.316367 2562 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="llm/e2e-distinct-2-simulated-kserve-7f849f6b56-qlznj" May 21 13:12:37.390184 ip-10-0-133-64 kubenswrapper[2562]: I0521 13:12:37.328658 2562 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="llm/e2e-distinct-simulated-kserve-7bb4cdb4d7-9crgh" May 21 13:12:37.390184 ip-10-0-133-64 kubenswrapper[2562]: I0521 13:12:37.329482 2562 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="llm/e2e-distinct-2-simulated-kserve-7f849f6b56-qlznj" May 21 13:13:35.706456 ip-10-0-133-64 kubenswrapper[2562]: I0521 13:13:35.706415 2562 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["kuadrant-system/authorino-d657ffb5b-fjjz6"] May 21 13:13:35.709016 ip-10-0-133-64 kubenswrapper[2562]: I0521 13:13:35.708992 2562 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-d657ffb5b-fjjz6" May 21 13:13:35.722691 ip-10-0-133-64 kubenswrapper[2562]: I0521 13:13:35.722674 2562 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"authorino-authorino-dockercfg-wb2gs\"" May 21 13:13:35.722760 ip-10-0-133-64 kubenswrapper[2562]: I0521 13:13:35.722689 2562 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"authorino-server-cert\"" May 21 13:13:35.760706 ip-10-0-133-64 kubenswrapper[2562]: I0521 13:13:35.760677 2562 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-d657ffb5b-fjjz6"] May 21 13:13:35.785572 ip-10-0-133-64 kubenswrapper[2562]: I0521 13:13:35.785507 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/9806cc2a-d6de-4cc0-984e-a975f0cd8963-tls-cert\") pod \"authorino-d657ffb5b-fjjz6\" (UID: \"9806cc2a-d6de-4cc0-984e-a975f0cd8963\") " pod="kuadrant-system/authorino-d657ffb5b-fjjz6" May 21 13:13:35.785739 ip-10-0-133-64 kubenswrapper[2562]: I0521 13:13:35.785664 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-782d4\" (UniqueName: \"kubernetes.io/projected/9806cc2a-d6de-4cc0-984e-a975f0cd8963-kube-api-access-782d4\") pod \"authorino-d657ffb5b-fjjz6\" (UID: \"9806cc2a-d6de-4cc0-984e-a975f0cd8963\") " pod="kuadrant-system/authorino-d657ffb5b-fjjz6" May 21 13:13:35.887307 ip-10-0-133-64 kubenswrapper[2562]: I0521 13:13:35.887253 2562 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/9806cc2a-d6de-4cc0-984e-a975f0cd8963-tls-cert\") pod \"authorino-d657ffb5b-fjjz6\" (UID: \"9806cc2a-d6de-4cc0-984e-a975f0cd8963\") " pod="kuadrant-system/authorino-d657ffb5b-fjjz6" May 21 13:13:35.887307 ip-10-0-133-64 kubenswrapper[2562]: I0521 13:13:35.887318 2562 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-782d4\" (UniqueName: \"kubernetes.io/projected/9806cc2a-d6de-4cc0-984e-a975f0cd8963-kube-api-access-782d4\") pod \"authorino-d657ffb5b-fjjz6\" (UID: \"9806cc2a-d6de-4cc0-984e-a975f0cd8963\") " pod="kuadrant-system/authorino-d657ffb5b-fjjz6" May 21 13:13:35.889672 ip-10-0-133-64 kubenswrapper[2562]: I0521 13:13:35.889649 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/9806cc2a-d6de-4cc0-984e-a975f0cd8963-tls-cert\") pod \"authorino-d657ffb5b-fjjz6\" (UID: \"9806cc2a-d6de-4cc0-984e-a975f0cd8963\") " pod="kuadrant-system/authorino-d657ffb5b-fjjz6" May 21 13:13:35.911060 ip-10-0-133-64 kubenswrapper[2562]: I0521 13:13:35.911030 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-782d4\" (UniqueName: \"kubernetes.io/projected/9806cc2a-d6de-4cc0-984e-a975f0cd8963-kube-api-access-782d4\") pod \"authorino-d657ffb5b-fjjz6\" (UID: \"9806cc2a-d6de-4cc0-984e-a975f0cd8963\") " pod="kuadrant-system/authorino-d657ffb5b-fjjz6" May 21 13:13:36.017704 ip-10-0-133-64 kubenswrapper[2562]: I0521 13:13:36.017618 2562 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-d657ffb5b-fjjz6" May 21 13:13:36.154081 ip-10-0-133-64 kubenswrapper[2562]: I0521 13:13:36.154054 2562 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-d657ffb5b-fjjz6"] May 21 13:13:36.155868 ip-10-0-133-64 kubenswrapper[2562]: W0521 13:13:36.155833 2562 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod9806cc2a_d6de_4cc0_984e_a975f0cd8963.slice/crio-ada9ef7623c00c6cb9b6b98d3bbef7b49e8f78ab071a8c4561a156625c798a4c WatchSource:0}: Error finding container ada9ef7623c00c6cb9b6b98d3bbef7b49e8f78ab071a8c4561a156625c798a4c: Status 404 returned error can't find the container with id ada9ef7623c00c6cb9b6b98d3bbef7b49e8f78ab071a8c4561a156625c798a4c May 21 13:13:36.157104 ip-10-0-133-64 kubenswrapper[2562]: I0521 13:13:36.157084 2562 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider May 21 13:13:36.585152 ip-10-0-133-64 kubenswrapper[2562]: I0521 13:13:36.585112 2562 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-d657ffb5b-fjjz6" event={"ID":"9806cc2a-d6de-4cc0-984e-a975f0cd8963","Type":"ContainerStarted","Data":"ca2fbb14a6efb520447d9f9acaef4a2e3059a16e8a7706ca588a7bfdc1f7fc43"} May 21 13:13:36.585313 ip-10-0-133-64 kubenswrapper[2562]: I0521 13:13:36.585160 2562 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-d657ffb5b-fjjz6" event={"ID":"9806cc2a-d6de-4cc0-984e-a975f0cd8963","Type":"ContainerStarted","Data":"ada9ef7623c00c6cb9b6b98d3bbef7b49e8f78ab071a8c4561a156625c798a4c"} May 21 13:13:36.604008 ip-10-0-133-64 kubenswrapper[2562]: I0521 13:13:36.603963 2562 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="kuadrant-system/authorino-d657ffb5b-fjjz6" podStartSLOduration=1.258762317 podStartE2EDuration="1.603947782s" podCreationTimestamp="2026-05-21 13:13:35 +0000 UTC" firstStartedPulling="2026-05-21 13:13:36.157260347 +0000 UTC m=+662.707541708" lastFinishedPulling="2026-05-21 13:13:36.502445823 +0000 UTC m=+663.052727173" observedRunningTime="2026-05-21 13:13:36.603368767 +0000 UTC m=+663.153650136" watchObservedRunningTime="2026-05-21 13:13:36.603947782 +0000 UTC m=+663.154229158" May 21 13:15:00.149497 ip-10-0-133-64 kubenswrapper[2562]: I0521 13:15:00.149416 2562 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["opendatahub/maas-api-key-cleanup-29656155-dm7jm"] May 21 13:15:00.151683 ip-10-0-133-64 kubenswrapper[2562]: I0521 13:15:00.151666 2562 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-api-key-cleanup-29656155-dm7jm" May 21 13:15:00.154112 ip-10-0-133-64 kubenswrapper[2562]: I0521 13:15:00.154087 2562 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"maas-api-dockercfg-nxpgj\"" May 21 13:15:00.163254 ip-10-0-133-64 kubenswrapper[2562]: I0521 13:15:00.163231 2562 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-api-key-cleanup-29656155-dm7jm"] May 21 13:15:00.242013 ip-10-0-133-64 kubenswrapper[2562]: I0521 13:15:00.241978 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-s25cb\" (UniqueName: \"kubernetes.io/projected/647bb5e9-1390-4b6c-94d5-74c27a385542-kube-api-access-s25cb\") pod \"maas-api-key-cleanup-29656155-dm7jm\" (UID: \"647bb5e9-1390-4b6c-94d5-74c27a385542\") " pod="opendatahub/maas-api-key-cleanup-29656155-dm7jm" May 21 13:15:00.343345 ip-10-0-133-64 kubenswrapper[2562]: I0521 13:15:00.343315 2562 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-s25cb\" (UniqueName: \"kubernetes.io/projected/647bb5e9-1390-4b6c-94d5-74c27a385542-kube-api-access-s25cb\") pod \"maas-api-key-cleanup-29656155-dm7jm\" (UID: \"647bb5e9-1390-4b6c-94d5-74c27a385542\") " pod="opendatahub/maas-api-key-cleanup-29656155-dm7jm" May 21 13:15:00.352236 ip-10-0-133-64 kubenswrapper[2562]: I0521 13:15:00.352217 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-s25cb\" (UniqueName: \"kubernetes.io/projected/647bb5e9-1390-4b6c-94d5-74c27a385542-kube-api-access-s25cb\") pod \"maas-api-key-cleanup-29656155-dm7jm\" (UID: \"647bb5e9-1390-4b6c-94d5-74c27a385542\") " pod="opendatahub/maas-api-key-cleanup-29656155-dm7jm" May 21 13:15:00.462344 ip-10-0-133-64 kubenswrapper[2562]: I0521 13:15:00.462315 2562 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-api-key-cleanup-29656155-dm7jm" May 21 13:15:00.597083 ip-10-0-133-64 kubenswrapper[2562]: I0521 13:15:00.597055 2562 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-api-key-cleanup-29656155-dm7jm"] May 21 13:15:00.598953 ip-10-0-133-64 kubenswrapper[2562]: W0521 13:15:00.598913 2562 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod647bb5e9_1390_4b6c_94d5_74c27a385542.slice/crio-c09e141f6c0a309e5c9728508e9533ec21cad051928e8b034aad2a64d84d0b56 WatchSource:0}: Error finding container c09e141f6c0a309e5c9728508e9533ec21cad051928e8b034aad2a64d84d0b56: Status 404 returned error can't find the container with id c09e141f6c0a309e5c9728508e9533ec21cad051928e8b034aad2a64d84d0b56 May 21 13:15:00.909512 ip-10-0-133-64 kubenswrapper[2562]: I0521 13:15:00.909424 2562 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-api-key-cleanup-29656155-dm7jm" event={"ID":"647bb5e9-1390-4b6c-94d5-74c27a385542","Type":"ContainerStarted","Data":"c09e141f6c0a309e5c9728508e9533ec21cad051928e8b034aad2a64d84d0b56"} May 21 13:15:01.267953 ip-10-0-133-64 kubenswrapper[2562]: I0521 13:15:01.267918 2562 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["opendatahub/maas-controller-85cc5d9594-67cxt"] May 21 13:15:01.268478 ip-10-0-133-64 kubenswrapper[2562]: I0521 13:15:01.268233 2562 kuberuntime_container.go:864] "Killing container with a grace period" pod="opendatahub/maas-controller-85cc5d9594-67cxt" podUID="ef6f595f-efd7-42fa-b693-3cc62487f51d" containerName="manager" containerID="cri-o://7bba4c2e8d2fb221b3916eef7ef49edbef68be6630477dd2885badaae8b5375b" gracePeriod=30 May 21 13:15:01.512377 ip-10-0-133-64 kubenswrapper[2562]: I0521 13:15:01.512344 2562 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-85cc5d9594-67cxt" May 21 13:15:01.555608 ip-10-0-133-64 kubenswrapper[2562]: I0521 13:15:01.555535 2562 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-nqvkd\" (UniqueName: \"kubernetes.io/projected/ef6f595f-efd7-42fa-b693-3cc62487f51d-kube-api-access-nqvkd\") pod \"ef6f595f-efd7-42fa-b693-3cc62487f51d\" (UID: \"ef6f595f-efd7-42fa-b693-3cc62487f51d\") " May 21 13:15:01.557460 ip-10-0-133-64 kubenswrapper[2562]: I0521 13:15:01.557430 2562 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/ef6f595f-efd7-42fa-b693-3cc62487f51d-kube-api-access-nqvkd" (OuterVolumeSpecName: "kube-api-access-nqvkd") pod "ef6f595f-efd7-42fa-b693-3cc62487f51d" (UID: "ef6f595f-efd7-42fa-b693-3cc62487f51d"). InnerVolumeSpecName "kube-api-access-nqvkd". PluginName "kubernetes.io/projected", VolumeGIDValue "" May 21 13:15:01.656496 ip-10-0-133-64 kubenswrapper[2562]: I0521 13:15:01.656463 2562 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-nqvkd\" (UniqueName: \"kubernetes.io/projected/ef6f595f-efd7-42fa-b693-3cc62487f51d-kube-api-access-nqvkd\") on node \"ip-10-0-133-64.ec2.internal\" DevicePath \"\"" May 21 13:15:01.914389 ip-10-0-133-64 kubenswrapper[2562]: I0521 13:15:01.914311 2562 generic.go:358] "Generic (PLEG): container finished" podID="ef6f595f-efd7-42fa-b693-3cc62487f51d" containerID="7bba4c2e8d2fb221b3916eef7ef49edbef68be6630477dd2885badaae8b5375b" exitCode=0 May 21 13:15:01.914389 ip-10-0-133-64 kubenswrapper[2562]: I0521 13:15:01.914373 2562 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-85cc5d9594-67cxt" May 21 13:15:01.914566 ip-10-0-133-64 kubenswrapper[2562]: I0521 13:15:01.914387 2562 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-85cc5d9594-67cxt" event={"ID":"ef6f595f-efd7-42fa-b693-3cc62487f51d","Type":"ContainerDied","Data":"7bba4c2e8d2fb221b3916eef7ef49edbef68be6630477dd2885badaae8b5375b"} May 21 13:15:01.914566 ip-10-0-133-64 kubenswrapper[2562]: I0521 13:15:01.914428 2562 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-85cc5d9594-67cxt" event={"ID":"ef6f595f-efd7-42fa-b693-3cc62487f51d","Type":"ContainerDied","Data":"bdf9bf68b5f2db6b849d1b908fc1dc0460960972cf9599bacb720e9244ef4569"} May 21 13:15:01.914566 ip-10-0-133-64 kubenswrapper[2562]: I0521 13:15:01.914444 2562 scope.go:117] "RemoveContainer" containerID="7bba4c2e8d2fb221b3916eef7ef49edbef68be6630477dd2885badaae8b5375b" May 21 13:15:01.924037 ip-10-0-133-64 kubenswrapper[2562]: I0521 13:15:01.924022 2562 scope.go:117] "RemoveContainer" containerID="7bba4c2e8d2fb221b3916eef7ef49edbef68be6630477dd2885badaae8b5375b" May 21 13:15:01.926111 ip-10-0-133-64 kubenswrapper[2562]: E0521 13:15:01.926005 2562 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"7bba4c2e8d2fb221b3916eef7ef49edbef68be6630477dd2885badaae8b5375b\": container with ID starting with 7bba4c2e8d2fb221b3916eef7ef49edbef68be6630477dd2885badaae8b5375b not found: ID does not exist" containerID="7bba4c2e8d2fb221b3916eef7ef49edbef68be6630477dd2885badaae8b5375b" May 21 13:15:01.926111 ip-10-0-133-64 kubenswrapper[2562]: I0521 13:15:01.926039 2562 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"7bba4c2e8d2fb221b3916eef7ef49edbef68be6630477dd2885badaae8b5375b"} err="failed to get container status \"7bba4c2e8d2fb221b3916eef7ef49edbef68be6630477dd2885badaae8b5375b\": rpc error: code = NotFound desc = could not find container \"7bba4c2e8d2fb221b3916eef7ef49edbef68be6630477dd2885badaae8b5375b\": container with ID starting with 7bba4c2e8d2fb221b3916eef7ef49edbef68be6630477dd2885badaae8b5375b not found: ID does not exist" May 21 13:15:01.950018 ip-10-0-133-64 kubenswrapper[2562]: I0521 13:15:01.949987 2562 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["opendatahub/maas-controller-85cc5d9594-67cxt"] May 21 13:15:01.972323 ip-10-0-133-64 kubenswrapper[2562]: I0521 13:15:01.972295 2562 kubelet.go:2547] "SyncLoop REMOVE" source="api" pods=["opendatahub/maas-controller-85cc5d9594-67cxt"] May 21 13:15:02.039281 ip-10-0-133-64 kubenswrapper[2562]: I0521 13:15:02.039255 2562 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="ef6f595f-efd7-42fa-b693-3cc62487f51d" path="/var/lib/kubelet/pods/ef6f595f-efd7-42fa-b693-3cc62487f51d/volumes" May 21 13:15:02.728957 ip-10-0-133-64 kubenswrapper[2562]: I0521 13:15:02.728924 2562 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["opendatahub/maas-controller-85cc5d9594-wblgm"] May 21 13:15:02.729434 ip-10-0-133-64 kubenswrapper[2562]: I0521 13:15:02.729378 2562 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="ef6f595f-efd7-42fa-b693-3cc62487f51d" containerName="manager" May 21 13:15:02.729434 ip-10-0-133-64 kubenswrapper[2562]: I0521 13:15:02.729399 2562 state_mem.go:107] "Deleted CPUSet assignment" podUID="ef6f595f-efd7-42fa-b693-3cc62487f51d" containerName="manager" May 21 13:15:02.729558 ip-10-0-133-64 kubenswrapper[2562]: I0521 13:15:02.729510 2562 memory_manager.go:356] "RemoveStaleState removing state" podUID="ef6f595f-efd7-42fa-b693-3cc62487f51d" containerName="manager" May 21 13:15:02.734886 ip-10-0-133-64 kubenswrapper[2562]: I0521 13:15:02.734860 2562 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-85cc5d9594-wblgm" May 21 13:15:02.737095 ip-10-0-133-64 kubenswrapper[2562]: I0521 13:15:02.737075 2562 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"maas-parameters\"" May 21 13:15:02.737227 ip-10-0-133-64 kubenswrapper[2562]: I0521 13:15:02.737137 2562 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"maas-controller-dockercfg-4qk68\"" May 21 13:15:02.742973 ip-10-0-133-64 kubenswrapper[2562]: I0521 13:15:02.742952 2562 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-controller-85cc5d9594-wblgm"] May 21 13:15:02.767881 ip-10-0-133-64 kubenswrapper[2562]: I0521 13:15:02.767852 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-x7pw2\" (UniqueName: \"kubernetes.io/projected/cbc9f0ae-14b9-4b0c-a736-a114da49b4de-kube-api-access-x7pw2\") pod \"maas-controller-85cc5d9594-wblgm\" (UID: \"cbc9f0ae-14b9-4b0c-a736-a114da49b4de\") " pod="opendatahub/maas-controller-85cc5d9594-wblgm" May 21 13:15:02.869416 ip-10-0-133-64 kubenswrapper[2562]: I0521 13:15:02.869376 2562 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-x7pw2\" (UniqueName: \"kubernetes.io/projected/cbc9f0ae-14b9-4b0c-a736-a114da49b4de-kube-api-access-x7pw2\") pod \"maas-controller-85cc5d9594-wblgm\" (UID: \"cbc9f0ae-14b9-4b0c-a736-a114da49b4de\") " pod="opendatahub/maas-controller-85cc5d9594-wblgm" May 21 13:15:02.878089 ip-10-0-133-64 kubenswrapper[2562]: I0521 13:15:02.878056 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-x7pw2\" (UniqueName: \"kubernetes.io/projected/cbc9f0ae-14b9-4b0c-a736-a114da49b4de-kube-api-access-x7pw2\") pod \"maas-controller-85cc5d9594-wblgm\" (UID: \"cbc9f0ae-14b9-4b0c-a736-a114da49b4de\") " pod="opendatahub/maas-controller-85cc5d9594-wblgm" May 21 13:15:03.049030 ip-10-0-133-64 kubenswrapper[2562]: I0521 13:15:03.048933 2562 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-85cc5d9594-wblgm" May 21 13:15:03.328224 ip-10-0-133-64 kubenswrapper[2562]: I0521 13:15:03.328192 2562 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-controller-85cc5d9594-wblgm"] May 21 13:15:03.329535 ip-10-0-133-64 kubenswrapper[2562]: W0521 13:15:03.329496 2562 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podcbc9f0ae_14b9_4b0c_a736_a114da49b4de.slice/crio-e72331a14897713428b227bdcd22a7f09f8f9185eddb0bf15ffc370119997ea8 WatchSource:0}: Error finding container e72331a14897713428b227bdcd22a7f09f8f9185eddb0bf15ffc370119997ea8: Status 404 returned error can't find the container with id e72331a14897713428b227bdcd22a7f09f8f9185eddb0bf15ffc370119997ea8 May 21 13:15:03.926841 ip-10-0-133-64 kubenswrapper[2562]: I0521 13:15:03.926772 2562 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-api-key-cleanup-29656155-dm7jm" event={"ID":"647bb5e9-1390-4b6c-94d5-74c27a385542","Type":"ContainerStarted","Data":"f603dbb9fec341281b6b56d78cf4abb8c5718ab2a0e5084a60eefb3e1d65bb7b"} May 21 13:15:03.928255 ip-10-0-133-64 kubenswrapper[2562]: I0521 13:15:03.928227 2562 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-85cc5d9594-wblgm" event={"ID":"cbc9f0ae-14b9-4b0c-a736-a114da49b4de","Type":"ContainerStarted","Data":"b2d8af9f4580942184bea049728e4fdf7e02d8219946145ec94092aab4cc7ff0"} May 21 13:15:03.928388 ip-10-0-133-64 kubenswrapper[2562]: I0521 13:15:03.928258 2562 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-85cc5d9594-wblgm" event={"ID":"cbc9f0ae-14b9-4b0c-a736-a114da49b4de","Type":"ContainerStarted","Data":"e72331a14897713428b227bdcd22a7f09f8f9185eddb0bf15ffc370119997ea8"} May 21 13:15:03.928388 ip-10-0-133-64 kubenswrapper[2562]: I0521 13:15:03.928329 2562 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/maas-controller-85cc5d9594-wblgm" May 21 13:15:03.943641 ip-10-0-133-64 kubenswrapper[2562]: I0521 13:15:03.943594 2562 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="opendatahub/maas-api-key-cleanup-29656155-dm7jm" podStartSLOduration=1.3017590860000001 podStartE2EDuration="3.943581227s" podCreationTimestamp="2026-05-21 13:15:00 +0000 UTC" firstStartedPulling="2026-05-21 13:15:00.600698284 +0000 UTC m=+747.150979630" lastFinishedPulling="2026-05-21 13:15:03.242520422 +0000 UTC m=+749.792801771" observedRunningTime="2026-05-21 13:15:03.941607066 +0000 UTC m=+750.491888433" watchObservedRunningTime="2026-05-21 13:15:03.943581227 +0000 UTC m=+750.493862595" May 21 13:15:03.961431 ip-10-0-133-64 kubenswrapper[2562]: I0521 13:15:03.961383 2562 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="opendatahub/maas-controller-85cc5d9594-wblgm" podStartSLOduration=1.483877608 podStartE2EDuration="1.96136977s" podCreationTimestamp="2026-05-21 13:15:02 +0000 UTC" firstStartedPulling="2026-05-21 13:15:03.330855908 +0000 UTC m=+749.881137253" lastFinishedPulling="2026-05-21 13:15:03.808348068 +0000 UTC m=+750.358629415" observedRunningTime="2026-05-21 13:15:03.959215168 +0000 UTC m=+750.509496527" watchObservedRunningTime="2026-05-21 13:15:03.96136977 +0000 UTC m=+750.511651158" May 21 13:15:04.934885 ip-10-0-133-64 kubenswrapper[2562]: I0521 13:15:04.934848 2562 generic.go:358] "Generic (PLEG): container finished" podID="647bb5e9-1390-4b6c-94d5-74c27a385542" containerID="f603dbb9fec341281b6b56d78cf4abb8c5718ab2a0e5084a60eefb3e1d65bb7b" exitCode=0 May 21 13:15:04.935269 ip-10-0-133-64 kubenswrapper[2562]: I0521 13:15:04.934940 2562 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-api-key-cleanup-29656155-dm7jm" event={"ID":"647bb5e9-1390-4b6c-94d5-74c27a385542","Type":"ContainerDied","Data":"f603dbb9fec341281b6b56d78cf4abb8c5718ab2a0e5084a60eefb3e1d65bb7b"} May 21 13:15:06.074842 ip-10-0-133-64 kubenswrapper[2562]: I0521 13:15:06.074816 2562 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-api-key-cleanup-29656155-dm7jm" May 21 13:15:06.203895 ip-10-0-133-64 kubenswrapper[2562]: I0521 13:15:06.203809 2562 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-s25cb\" (UniqueName: \"kubernetes.io/projected/647bb5e9-1390-4b6c-94d5-74c27a385542-kube-api-access-s25cb\") pod \"647bb5e9-1390-4b6c-94d5-74c27a385542\" (UID: \"647bb5e9-1390-4b6c-94d5-74c27a385542\") " May 21 13:15:06.205859 ip-10-0-133-64 kubenswrapper[2562]: I0521 13:15:06.205833 2562 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/647bb5e9-1390-4b6c-94d5-74c27a385542-kube-api-access-s25cb" (OuterVolumeSpecName: "kube-api-access-s25cb") pod "647bb5e9-1390-4b6c-94d5-74c27a385542" (UID: "647bb5e9-1390-4b6c-94d5-74c27a385542"). InnerVolumeSpecName "kube-api-access-s25cb". PluginName "kubernetes.io/projected", VolumeGIDValue "" May 21 13:15:06.305302 ip-10-0-133-64 kubenswrapper[2562]: I0521 13:15:06.305265 2562 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-s25cb\" (UniqueName: \"kubernetes.io/projected/647bb5e9-1390-4b6c-94d5-74c27a385542-kube-api-access-s25cb\") on node \"ip-10-0-133-64.ec2.internal\" DevicePath \"\"" May 21 13:15:06.943889 ip-10-0-133-64 kubenswrapper[2562]: I0521 13:15:06.943859 2562 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-api-key-cleanup-29656155-dm7jm" May 21 13:15:06.944062 ip-10-0-133-64 kubenswrapper[2562]: I0521 13:15:06.943858 2562 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-api-key-cleanup-29656155-dm7jm" event={"ID":"647bb5e9-1390-4b6c-94d5-74c27a385542","Type":"ContainerDied","Data":"c09e141f6c0a309e5c9728508e9533ec21cad051928e8b034aad2a64d84d0b56"} May 21 13:15:06.944062 ip-10-0-133-64 kubenswrapper[2562]: I0521 13:15:06.943971 2562 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="c09e141f6c0a309e5c9728508e9533ec21cad051928e8b034aad2a64d84d0b56" May 21 13:15:14.941488 ip-10-0-133-64 kubenswrapper[2562]: I0521 13:15:14.941454 2562 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/maas-controller-85cc5d9594-wblgm" May 21 13:30:00.148587 ip-10-0-133-64 kubenswrapper[2562]: I0521 13:30:00.148552 2562 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["opendatahub/maas-api-key-cleanup-29656170-zqx8m"] May 21 13:30:00.151032 ip-10-0-133-64 kubenswrapper[2562]: I0521 13:30:00.148922 2562 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="647bb5e9-1390-4b6c-94d5-74c27a385542" containerName="cleanup" May 21 13:30:00.151032 ip-10-0-133-64 kubenswrapper[2562]: I0521 13:30:00.148933 2562 state_mem.go:107] "Deleted CPUSet assignment" podUID="647bb5e9-1390-4b6c-94d5-74c27a385542" containerName="cleanup" May 21 13:30:00.151032 ip-10-0-133-64 kubenswrapper[2562]: I0521 13:30:00.148995 2562 memory_manager.go:356] "RemoveStaleState removing state" podUID="647bb5e9-1390-4b6c-94d5-74c27a385542" containerName="cleanup" May 21 13:30:00.151930 ip-10-0-133-64 kubenswrapper[2562]: I0521 13:30:00.151913 2562 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-api-key-cleanup-29656170-zqx8m" May 21 13:30:00.154246 ip-10-0-133-64 kubenswrapper[2562]: I0521 13:30:00.154225 2562 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"maas-api-dockercfg-nxpgj\"" May 21 13:30:00.166333 ip-10-0-133-64 kubenswrapper[2562]: I0521 13:30:00.166311 2562 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-api-key-cleanup-29656170-zqx8m"] May 21 13:30:00.169569 ip-10-0-133-64 kubenswrapper[2562]: I0521 13:30:00.169548 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-rws2d\" (UniqueName: \"kubernetes.io/projected/967d7fdb-3f9e-4e63-bf6e-3c4bb13b9599-kube-api-access-rws2d\") pod \"maas-api-key-cleanup-29656170-zqx8m\" (UID: \"967d7fdb-3f9e-4e63-bf6e-3c4bb13b9599\") " pod="opendatahub/maas-api-key-cleanup-29656170-zqx8m" May 21 13:30:00.270247 ip-10-0-133-64 kubenswrapper[2562]: I0521 13:30:00.270219 2562 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-rws2d\" (UniqueName: \"kubernetes.io/projected/967d7fdb-3f9e-4e63-bf6e-3c4bb13b9599-kube-api-access-rws2d\") pod \"maas-api-key-cleanup-29656170-zqx8m\" (UID: \"967d7fdb-3f9e-4e63-bf6e-3c4bb13b9599\") " pod="opendatahub/maas-api-key-cleanup-29656170-zqx8m" May 21 13:30:00.284172 ip-10-0-133-64 kubenswrapper[2562]: I0521 13:30:00.284143 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-rws2d\" (UniqueName: \"kubernetes.io/projected/967d7fdb-3f9e-4e63-bf6e-3c4bb13b9599-kube-api-access-rws2d\") pod \"maas-api-key-cleanup-29656170-zqx8m\" (UID: \"967d7fdb-3f9e-4e63-bf6e-3c4bb13b9599\") " pod="opendatahub/maas-api-key-cleanup-29656170-zqx8m" May 21 13:30:00.461785 ip-10-0-133-64 kubenswrapper[2562]: I0521 13:30:00.461756 2562 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-api-key-cleanup-29656170-zqx8m" May 21 13:30:00.591489 ip-10-0-133-64 kubenswrapper[2562]: I0521 13:30:00.591463 2562 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-api-key-cleanup-29656170-zqx8m"] May 21 13:30:00.592646 ip-10-0-133-64 kubenswrapper[2562]: W0521 13:30:00.592620 2562 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod967d7fdb_3f9e_4e63_bf6e_3c4bb13b9599.slice/crio-c1fe874fe41f60ec30fa5b8121228b57b64b060b2212fa59530f5ad44b6b6944 WatchSource:0}: Error finding container c1fe874fe41f60ec30fa5b8121228b57b64b060b2212fa59530f5ad44b6b6944: Status 404 returned error can't find the container with id c1fe874fe41f60ec30fa5b8121228b57b64b060b2212fa59530f5ad44b6b6944 May 21 13:30:00.594411 ip-10-0-133-64 kubenswrapper[2562]: I0521 13:30:00.594393 2562 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider May 21 13:30:01.356761 ip-10-0-133-64 kubenswrapper[2562]: I0521 13:30:01.356725 2562 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-api-key-cleanup-29656170-zqx8m" event={"ID":"967d7fdb-3f9e-4e63-bf6e-3c4bb13b9599","Type":"ContainerStarted","Data":"b2f74fa3863fa5e2fc6537082ea2857537bf4b323230198cee0804b9075147b4"} May 21 13:30:01.357149 ip-10-0-133-64 kubenswrapper[2562]: I0521 13:30:01.356768 2562 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-api-key-cleanup-29656170-zqx8m" event={"ID":"967d7fdb-3f9e-4e63-bf6e-3c4bb13b9599","Type":"ContainerStarted","Data":"c1fe874fe41f60ec30fa5b8121228b57b64b060b2212fa59530f5ad44b6b6944"} May 21 13:30:01.372629 ip-10-0-133-64 kubenswrapper[2562]: I0521 13:30:01.372586 2562 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="opendatahub/maas-api-key-cleanup-29656170-zqx8m" podStartSLOduration=1.372573055 podStartE2EDuration="1.372573055s" podCreationTimestamp="2026-05-21 13:30:00 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2026-05-21 13:30:01.371477238 +0000 UTC m=+1647.921758605" watchObservedRunningTime="2026-05-21 13:30:01.372573055 +0000 UTC m=+1647.922854423" May 21 13:30:02.361907 ip-10-0-133-64 kubenswrapper[2562]: I0521 13:30:02.361867 2562 generic.go:358] "Generic (PLEG): container finished" podID="967d7fdb-3f9e-4e63-bf6e-3c4bb13b9599" containerID="b2f74fa3863fa5e2fc6537082ea2857537bf4b323230198cee0804b9075147b4" exitCode=0 May 21 13:30:02.362279 ip-10-0-133-64 kubenswrapper[2562]: I0521 13:30:02.361913 2562 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-api-key-cleanup-29656170-zqx8m" event={"ID":"967d7fdb-3f9e-4e63-bf6e-3c4bb13b9599","Type":"ContainerDied","Data":"b2f74fa3863fa5e2fc6537082ea2857537bf4b323230198cee0804b9075147b4"} May 21 13:30:03.497213 ip-10-0-133-64 kubenswrapper[2562]: I0521 13:30:03.497187 2562 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-api-key-cleanup-29656170-zqx8m" May 21 13:30:03.601062 ip-10-0-133-64 kubenswrapper[2562]: I0521 13:30:03.601032 2562 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-rws2d\" (UniqueName: \"kubernetes.io/projected/967d7fdb-3f9e-4e63-bf6e-3c4bb13b9599-kube-api-access-rws2d\") pod \"967d7fdb-3f9e-4e63-bf6e-3c4bb13b9599\" (UID: \"967d7fdb-3f9e-4e63-bf6e-3c4bb13b9599\") " May 21 13:30:03.603070 ip-10-0-133-64 kubenswrapper[2562]: I0521 13:30:03.603049 2562 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/967d7fdb-3f9e-4e63-bf6e-3c4bb13b9599-kube-api-access-rws2d" (OuterVolumeSpecName: "kube-api-access-rws2d") pod "967d7fdb-3f9e-4e63-bf6e-3c4bb13b9599" (UID: "967d7fdb-3f9e-4e63-bf6e-3c4bb13b9599"). InnerVolumeSpecName "kube-api-access-rws2d". PluginName "kubernetes.io/projected", VolumeGIDValue "" May 21 13:30:03.707863 ip-10-0-133-64 kubenswrapper[2562]: I0521 13:30:03.707832 2562 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-rws2d\" (UniqueName: \"kubernetes.io/projected/967d7fdb-3f9e-4e63-bf6e-3c4bb13b9599-kube-api-access-rws2d\") on node \"ip-10-0-133-64.ec2.internal\" DevicePath \"\"" May 21 13:30:04.370442 ip-10-0-133-64 kubenswrapper[2562]: I0521 13:30:04.370345 2562 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-api-key-cleanup-29656170-zqx8m" event={"ID":"967d7fdb-3f9e-4e63-bf6e-3c4bb13b9599","Type":"ContainerDied","Data":"c1fe874fe41f60ec30fa5b8121228b57b64b060b2212fa59530f5ad44b6b6944"} May 21 13:30:04.370442 ip-10-0-133-64 kubenswrapper[2562]: I0521 13:30:04.370384 2562 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="c1fe874fe41f60ec30fa5b8121228b57b64b060b2212fa59530f5ad44b6b6944" May 21 13:30:04.370442 ip-10-0-133-64 kubenswrapper[2562]: I0521 13:30:04.370405 2562 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-api-key-cleanup-29656170-zqx8m" May 21 13:36:10.563194 ip-10-0-133-64 kubenswrapper[2562]: I0521 13:36:10.563162 2562 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_authorino-d657ffb5b-fjjz6_9806cc2a-d6de-4cc0-984e-a975f0cd8963/authorino/0.log" May 21 13:36:15.916358 ip-10-0-133-64 kubenswrapper[2562]: I0521 13:36:15.916334 2562 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_maas-api-key-cleanup-29656155-dm7jm_647bb5e9-1390-4b6c-94d5-74c27a385542/cleanup/0.log" May 21 13:36:16.042822 ip-10-0-133-64 kubenswrapper[2562]: I0521 13:36:16.042770 2562 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_maas-api-key-cleanup-29656170-zqx8m_967d7fdb-3f9e-4e63-bf6e-3c4bb13b9599/cleanup/0.log" May 21 13:36:16.174820 ip-10-0-133-64 kubenswrapper[2562]: I0521 13:36:16.174731 2562 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_maas-controller-85cc5d9594-wblgm_cbc9f0ae-14b9-4b0c-a736-a114da49b4de/manager/0.log" May 21 13:36:16.816283 ip-10-0-133-64 kubenswrapper[2562]: I0521 13:36:16.816255 2562 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-8545859b7d-zzdb2_1e611ccc-dd25-4210-ba16-a99ffc39eb2f/manager/0.log" May 21 13:36:16.949843 ip-10-0-133-64 kubenswrapper[2562]: I0521 13:36:16.949788 2562 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_postgres-68c4fbbd6f-4c2zv_7aa87e02-1849-4d59-a82f-43476c252b0e/postgres/0.log" May 21 13:36:17.852858 ip-10-0-133-64 kubenswrapper[2562]: I0521 13:36:17.852829 2562 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759bcbz5_2bdc7f3e-3a40-4937-96dc-ed8a2489ae62/pull/0.log" May 21 13:36:17.880463 ip-10-0-133-64 kubenswrapper[2562]: I0521 13:36:17.880441 2562 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759bcbz5_2bdc7f3e-3a40-4937-96dc-ed8a2489ae62/extract/0.log" May 21 13:36:17.896728 ip-10-0-133-64 kubenswrapper[2562]: I0521 13:36:17.896704 2562 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759bcbz5_2bdc7f3e-3a40-4937-96dc-ed8a2489ae62/util/0.log" May 21 13:36:18.022592 ip-10-0-133-64 kubenswrapper[2562]: I0521 13:36:18.022571 2562 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0clz5h_2fc1736c-ed52-4066-a27d-7e173c172d02/util/0.log" May 21 13:36:18.042565 ip-10-0-133-64 kubenswrapper[2562]: I0521 13:36:18.042547 2562 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0clz5h_2fc1736c-ed52-4066-a27d-7e173c172d02/pull/0.log" May 21 13:36:18.053656 ip-10-0-133-64 kubenswrapper[2562]: I0521 13:36:18.053639 2562 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0clz5h_2fc1736c-ed52-4066-a27d-7e173c172d02/extract/0.log" May 21 13:36:18.186685 ip-10-0-133-64 kubenswrapper[2562]: I0521 13:36:18.186620 2562 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73tbnj8_db0f3c7e-935f-41fc-832f-8d7bf067568b/util/0.log" May 21 13:36:18.213142 ip-10-0-133-64 kubenswrapper[2562]: I0521 13:36:18.213118 2562 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73tbnj8_db0f3c7e-935f-41fc-832f-8d7bf067568b/pull/0.log" May 21 13:36:18.228989 ip-10-0-133-64 kubenswrapper[2562]: I0521 13:36:18.228966 2562 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73tbnj8_db0f3c7e-935f-41fc-832f-8d7bf067568b/extract/0.log" May 21 13:36:18.359471 ip-10-0-133-64 kubenswrapper[2562]: I0521 13:36:18.359445 2562 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1bzd6s_f1bd4d97-469b-4d98-aabd-8a5780c68c63/util/0.log" May 21 13:36:18.372886 ip-10-0-133-64 kubenswrapper[2562]: I0521 13:36:18.372866 2562 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1bzd6s_f1bd4d97-469b-4d98-aabd-8a5780c68c63/pull/0.log" May 21 13:36:18.383682 ip-10-0-133-64 kubenswrapper[2562]: I0521 13:36:18.383653 2562 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1bzd6s_f1bd4d97-469b-4d98-aabd-8a5780c68c63/extract/0.log" May 21 13:36:18.514761 ip-10-0-133-64 kubenswrapper[2562]: I0521 13:36:18.514736 2562 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_authorino-d657ffb5b-fjjz6_9806cc2a-d6de-4cc0-984e-a975f0cd8963/authorino/0.log" May 21 13:36:18.657059 ip-10-0-133-64 kubenswrapper[2562]: I0521 13:36:18.657029 2562 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_authorino-operator-657f44b778-sqhvx_07361eba-541b-4817-91a2-982293bbe8cc/manager/0.log" May 21 13:36:18.799075 ip-10-0-133-64 kubenswrapper[2562]: I0521 13:36:18.799004 2562 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_dns-operator-controller-manager-648d5c98bc-8qpln_3746b663-4dca-40bc-8afa-728070d11e53/manager/0.log" May 21 13:36:18.936230 ip-10-0-133-64 kubenswrapper[2562]: I0521 13:36:18.936202 2562 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_kuadrant-console-plugin-6cb54b5c86-6kd5h_52ecb5cc-48f7-4b5e-ad22-553c76f6c243/kuadrant-console-plugin/0.log" May 21 13:36:19.092021 ip-10-0-133-64 kubenswrapper[2562]: I0521 13:36:19.091951 2562 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_kuadrant-operator-catalog-mrzdq_ef214c35-b3ac-4586-a58f-0d451ad51c39/registry-server/0.log" May 21 13:36:19.892621 ip-10-0-133-64 kubenswrapper[2562]: I0521 13:36:19.892588 2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_data-science-gateway-data-science-gateway-class-686dffbf4bpn7ll_27083247-23eb-44d0-af0a-968f3acc818f/istio-proxy/0.log" May 21 13:36:20.385093 ip-10-0-133-64 kubenswrapper[2562]: I0521 13:36:20.385064 2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_maas-default-gateway-openshift-default-7d6f447cf5-qf64l_f17e38b8-c261-4695-8953-81c8b2b40bc1/istio-proxy/0.log" May 21 13:36:20.636437 ip-10-0-133-64 kubenswrapper[2562]: I0521 13:36:20.636361 2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_router-default-66c9cf854b-46gbc_7ba99752-9a0f-4032-a47f-8e1df0d52758/router/0.log" May 21 13:36:21.032735 ip-10-0-133-64 kubenswrapper[2562]: I0521 13:36:21.032711 2562 log.go:25] "Finished parsing log file" path="/var/log/pods/llm_e2e-distinct-2-simulated-kserve-7f849f6b56-qlznj_d302afb7-9d9f-4c9d-a8d7-4f65e4b2a246/storage-initializer/0.log" May 21 13:36:21.043129 ip-10-0-133-64 kubenswrapper[2562]: I0521 13:36:21.043112 2562 log.go:25] "Finished parsing log file" path="/var/log/pods/llm_e2e-distinct-2-simulated-kserve-7f849f6b56-qlznj_d302afb7-9d9f-4c9d-a8d7-4f65e4b2a246/main/0.log" May 21 13:36:21.176090 ip-10-0-133-64 kubenswrapper[2562]: I0521 13:36:21.176063 2562 log.go:25] "Finished parsing log file" path="/var/log/pods/llm_e2e-distinct-simulated-kserve-7bb4cdb4d7-9crgh_bcfce64e-cb8e-4bf1-a866-f342f41ab442/storage-initializer/0.log" May 21 13:36:21.200126 ip-10-0-133-64 kubenswrapper[2562]: I0521 13:36:21.200107 2562 log.go:25] "Finished parsing log file" path="/var/log/pods/llm_e2e-distinct-simulated-kserve-7bb4cdb4d7-9crgh_bcfce64e-cb8e-4bf1-a866-f342f41ab442/main/0.log" May 21 13:36:29.286203 ip-10-0-133-64 kubenswrapper[2562]: I0521 13:36:29.286171 2562 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_global-pull-secret-syncer-qw7g7_6a5bcf2e-872d-429c-83dc-c5facd09899f/global-pull-secret-syncer/0.log" May 21 13:36:29.404980 ip-10-0-133-64 kubenswrapper[2562]: I0521 13:36:29.404954 2562 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_konnectivity-agent-4zjmp_b37e4909-8e26-4b8d-856d-34f9d0c5832e/konnectivity-agent/0.log" May 21 13:36:29.527718 ip-10-0-133-64 kubenswrapper[2562]: I0521 13:36:29.527689 2562 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_kube-apiserver-proxy-ip-10-0-133-64.ec2.internal_831fde2011330f939091daa7a5d4d0a8/haproxy/0.log" May 21 13:36:33.709057 ip-10-0-133-64 kubenswrapper[2562]: I0521 13:36:33.709029 2562 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759bcbz5_2bdc7f3e-3a40-4937-96dc-ed8a2489ae62/extract/0.log" May 21 13:36:33.781361 ip-10-0-133-64 kubenswrapper[2562]: I0521 13:36:33.781337 2562 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759bcbz5_2bdc7f3e-3a40-4937-96dc-ed8a2489ae62/util/0.log" May 21 13:36:33.866304 ip-10-0-133-64 kubenswrapper[2562]: I0521 13:36:33.866275 2562 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759bcbz5_2bdc7f3e-3a40-4937-96dc-ed8a2489ae62/pull/0.log" May 21 13:36:33.930206 ip-10-0-133-64 kubenswrapper[2562]: I0521 13:36:33.930181 2562 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0clz5h_2fc1736c-ed52-4066-a27d-7e173c172d02/extract/0.log" May 21 13:36:33.987450 ip-10-0-133-64 kubenswrapper[2562]: I0521 13:36:33.987385 2562 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0clz5h_2fc1736c-ed52-4066-a27d-7e173c172d02/util/0.log" May 21 13:36:34.029350 ip-10-0-133-64 kubenswrapper[2562]: I0521 13:36:34.029328 2562 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0clz5h_2fc1736c-ed52-4066-a27d-7e173c172d02/pull/0.log" May 21 13:36:34.066628 ip-10-0-133-64 kubenswrapper[2562]: I0521 13:36:34.066604 2562 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73tbnj8_db0f3c7e-935f-41fc-832f-8d7bf067568b/extract/0.log" May 21 13:36:34.126057 ip-10-0-133-64 kubenswrapper[2562]: I0521 13:36:34.126031 2562 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73tbnj8_db0f3c7e-935f-41fc-832f-8d7bf067568b/util/0.log" May 21 13:36:34.176548 ip-10-0-133-64 kubenswrapper[2562]: I0521 13:36:34.176523 2562 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73tbnj8_db0f3c7e-935f-41fc-832f-8d7bf067568b/pull/0.log" May 21 13:36:34.260817 ip-10-0-133-64 kubenswrapper[2562]: I0521 13:36:34.260731 2562 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1bzd6s_f1bd4d97-469b-4d98-aabd-8a5780c68c63/extract/0.log" May 21 13:36:34.353352 ip-10-0-133-64 kubenswrapper[2562]: I0521 13:36:34.353321 2562 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1bzd6s_f1bd4d97-469b-4d98-aabd-8a5780c68c63/util/0.log" May 21 13:36:34.397351 ip-10-0-133-64 kubenswrapper[2562]: I0521 13:36:34.397327 2562 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1bzd6s_f1bd4d97-469b-4d98-aabd-8a5780c68c63/pull/0.log" May 21 13:36:34.597817 ip-10-0-133-64 kubenswrapper[2562]: I0521 13:36:34.597713 2562 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_authorino-d657ffb5b-fjjz6_9806cc2a-d6de-4cc0-984e-a975f0cd8963/authorino/0.log" May 21 13:36:34.661576 ip-10-0-133-64 kubenswrapper[2562]: I0521 13:36:34.661548 2562 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_authorino-operator-657f44b778-sqhvx_07361eba-541b-4817-91a2-982293bbe8cc/manager/0.log" May 21 13:36:34.714193 ip-10-0-133-64 kubenswrapper[2562]: I0521 13:36:34.714169 2562 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_dns-operator-controller-manager-648d5c98bc-8qpln_3746b663-4dca-40bc-8afa-728070d11e53/manager/0.log" May 21 13:36:34.759648 ip-10-0-133-64 kubenswrapper[2562]: I0521 13:36:34.759622 2562 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_kuadrant-console-plugin-6cb54b5c86-6kd5h_52ecb5cc-48f7-4b5e-ad22-553c76f6c243/kuadrant-console-plugin/0.log" May 21 13:36:34.852459 ip-10-0-133-64 kubenswrapper[2562]: I0521 13:36:34.852391 2562 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_kuadrant-operator-catalog-mrzdq_ef214c35-b3ac-4586-a58f-0d451ad51c39/registry-server/0.log" May 21 13:36:36.532474 ip-10-0-133-64 kubenswrapper[2562]: I0521 13:36:36.532444 2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_cluster-monitoring-operator-6c75959455-mhvc5_4cf9c09a-0d70-4b12-bf3b-da664ea578a3/cluster-monitoring-operator/0.log" May 21 13:36:36.856645 ip-10-0-133-64 kubenswrapper[2562]: I0521 13:36:36.856563 2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-j52sx_bec846a9-572c-4fce-a95a-492bc285b1d3/node-exporter/0.log" May 21 13:36:36.883762 ip-10-0-133-64 kubenswrapper[2562]: I0521 13:36:36.883734 2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-j52sx_bec846a9-572c-4fce-a95a-492bc285b1d3/kube-rbac-proxy/0.log" May 21 13:36:36.921749 ip-10-0-133-64 kubenswrapper[2562]: I0521 13:36:36.921722 2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-j52sx_bec846a9-572c-4fce-a95a-492bc285b1d3/init-textfile/0.log" May 21 13:36:37.543343 ip-10-0-133-64 kubenswrapper[2562]: I0521 13:36:37.543306 2562 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-must-gather-pn2g5/perf-node-gather-daemonset-fbb2j"] May 21 13:36:37.543744 ip-10-0-133-64 kubenswrapper[2562]: I0521 13:36:37.543680 2562 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="967d7fdb-3f9e-4e63-bf6e-3c4bb13b9599" containerName="cleanup" May 21 13:36:37.543744 ip-10-0-133-64 kubenswrapper[2562]: I0521 13:36:37.543690 2562 state_mem.go:107] "Deleted CPUSet assignment" podUID="967d7fdb-3f9e-4e63-bf6e-3c4bb13b9599" containerName="cleanup" May 21 13:36:37.543860 ip-10-0-133-64 kubenswrapper[2562]: I0521 13:36:37.543752 2562 memory_manager.go:356] "RemoveStaleState removing state" podUID="967d7fdb-3f9e-4e63-bf6e-3c4bb13b9599" containerName="cleanup" May 21 13:36:37.546639 ip-10-0-133-64 kubenswrapper[2562]: I0521 13:36:37.546622 2562 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-pn2g5/perf-node-gather-daemonset-fbb2j" May 21 13:36:37.549677 ip-10-0-133-64 kubenswrapper[2562]: I0521 13:36:37.549652 2562 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-must-gather-pn2g5\"/\"kube-root-ca.crt\"" May 21 13:36:37.550237 ip-10-0-133-64 kubenswrapper[2562]: I0521 13:36:37.550222 2562 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-must-gather-pn2g5\"/\"openshift-service-ca.crt\"" May 21 13:36:37.550478 ip-10-0-133-64 kubenswrapper[2562]: I0521 13:36:37.550465 2562 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-must-gather-pn2g5\"/\"default-dockercfg-dz7nz\"" May 21 13:36:37.562308 ip-10-0-133-64 kubenswrapper[2562]: I0521 13:36:37.562288 2562 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-pn2g5/perf-node-gather-daemonset-fbb2j"] May 21 13:36:37.665318 ip-10-0-133-64 kubenswrapper[2562]: I0521 13:36:37.665290 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/b6727a3f-4661-4e12-86e1-e1d191542ca2-podres\") pod \"perf-node-gather-daemonset-fbb2j\" (UID: \"b6727a3f-4661-4e12-86e1-e1d191542ca2\") " pod="openshift-must-gather-pn2g5/perf-node-gather-daemonset-fbb2j" May 21 13:36:37.665470 ip-10-0-133-64 kubenswrapper[2562]: I0521 13:36:37.665351 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-xf48t\" (UniqueName: \"kubernetes.io/projected/b6727a3f-4661-4e12-86e1-e1d191542ca2-kube-api-access-xf48t\") pod \"perf-node-gather-daemonset-fbb2j\" (UID: \"b6727a3f-4661-4e12-86e1-e1d191542ca2\") " pod="openshift-must-gather-pn2g5/perf-node-gather-daemonset-fbb2j" May 21 13:36:37.665470 ip-10-0-133-64 kubenswrapper[2562]: I0521 13:36:37.665391 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/b6727a3f-4661-4e12-86e1-e1d191542ca2-lib-modules\") pod \"perf-node-gather-daemonset-fbb2j\" (UID: \"b6727a3f-4661-4e12-86e1-e1d191542ca2\") " pod="openshift-must-gather-pn2g5/perf-node-gather-daemonset-fbb2j" May 21 13:36:37.665470 ip-10-0-133-64 kubenswrapper[2562]: I0521 13:36:37.665432 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/b6727a3f-4661-4e12-86e1-e1d191542ca2-sys\") pod \"perf-node-gather-daemonset-fbb2j\" (UID: \"b6727a3f-4661-4e12-86e1-e1d191542ca2\") " pod="openshift-must-gather-pn2g5/perf-node-gather-daemonset-fbb2j" May 21 13:36:37.665470 ip-10-0-133-64 kubenswrapper[2562]: I0521 13:36:37.665456 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/b6727a3f-4661-4e12-86e1-e1d191542ca2-proc\") pod \"perf-node-gather-daemonset-fbb2j\" (UID: \"b6727a3f-4661-4e12-86e1-e1d191542ca2\") " pod="openshift-must-gather-pn2g5/perf-node-gather-daemonset-fbb2j" May 21 13:36:37.694623 ip-10-0-133-64 kubenswrapper[2562]: I0521 13:36:37.694599 2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-operator-admission-webhook-6c4bbc67b7-22k89_a6471fd0-c934-471c-ba70-be8b1a241e84/prometheus-operator-admission-webhook/0.log" May 21 13:36:37.766029 ip-10-0-133-64 kubenswrapper[2562]: I0521 13:36:37.765994 2562 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-xf48t\" (UniqueName: \"kubernetes.io/projected/b6727a3f-4661-4e12-86e1-e1d191542ca2-kube-api-access-xf48t\") pod \"perf-node-gather-daemonset-fbb2j\" (UID: \"b6727a3f-4661-4e12-86e1-e1d191542ca2\") " pod="openshift-must-gather-pn2g5/perf-node-gather-daemonset-fbb2j" May 21 13:36:37.766173 ip-10-0-133-64 kubenswrapper[2562]: I0521 13:36:37.766046 2562 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/b6727a3f-4661-4e12-86e1-e1d191542ca2-lib-modules\") pod \"perf-node-gather-daemonset-fbb2j\" (UID: \"b6727a3f-4661-4e12-86e1-e1d191542ca2\") " pod="openshift-must-gather-pn2g5/perf-node-gather-daemonset-fbb2j" May 21 13:36:37.766173 ip-10-0-133-64 kubenswrapper[2562]: I0521 13:36:37.766097 2562 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/b6727a3f-4661-4e12-86e1-e1d191542ca2-sys\") pod \"perf-node-gather-daemonset-fbb2j\" (UID: \"b6727a3f-4661-4e12-86e1-e1d191542ca2\") " pod="openshift-must-gather-pn2g5/perf-node-gather-daemonset-fbb2j" May 21 13:36:37.766173 ip-10-0-133-64 kubenswrapper[2562]: I0521 13:36:37.766130 2562 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/b6727a3f-4661-4e12-86e1-e1d191542ca2-proc\") pod \"perf-node-gather-daemonset-fbb2j\" (UID: \"b6727a3f-4661-4e12-86e1-e1d191542ca2\") " pod="openshift-must-gather-pn2g5/perf-node-gather-daemonset-fbb2j" May 21 13:36:37.766173 ip-10-0-133-64 kubenswrapper[2562]: I0521 13:36:37.766168 2562 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/b6727a3f-4661-4e12-86e1-e1d191542ca2-podres\") pod \"perf-node-gather-daemonset-fbb2j\" (UID: \"b6727a3f-4661-4e12-86e1-e1d191542ca2\") " pod="openshift-must-gather-pn2g5/perf-node-gather-daemonset-fbb2j" May 21 13:36:37.766332 ip-10-0-133-64 kubenswrapper[2562]: I0521 13:36:37.766185 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/b6727a3f-4661-4e12-86e1-e1d191542ca2-sys\") pod \"perf-node-gather-daemonset-fbb2j\" (UID: \"b6727a3f-4661-4e12-86e1-e1d191542ca2\") " pod="openshift-must-gather-pn2g5/perf-node-gather-daemonset-fbb2j" May 21 13:36:37.766332 ip-10-0-133-64 kubenswrapper[2562]: I0521 13:36:37.766226 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/b6727a3f-4661-4e12-86e1-e1d191542ca2-lib-modules\") pod \"perf-node-gather-daemonset-fbb2j\" (UID: \"b6727a3f-4661-4e12-86e1-e1d191542ca2\") " pod="openshift-must-gather-pn2g5/perf-node-gather-daemonset-fbb2j" May 21 13:36:37.766332 ip-10-0-133-64 kubenswrapper[2562]: I0521 13:36:37.766232 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/b6727a3f-4661-4e12-86e1-e1d191542ca2-proc\") pod \"perf-node-gather-daemonset-fbb2j\" (UID: \"b6727a3f-4661-4e12-86e1-e1d191542ca2\") " pod="openshift-must-gather-pn2g5/perf-node-gather-daemonset-fbb2j" May 21 13:36:37.766332 ip-10-0-133-64 kubenswrapper[2562]: I0521 13:36:37.766286 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/b6727a3f-4661-4e12-86e1-e1d191542ca2-podres\") pod \"perf-node-gather-daemonset-fbb2j\" (UID: \"b6727a3f-4661-4e12-86e1-e1d191542ca2\") " pod="openshift-must-gather-pn2g5/perf-node-gather-daemonset-fbb2j" May 21 13:36:37.777092 ip-10-0-133-64 kubenswrapper[2562]: I0521 13:36:37.777068 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-xf48t\" (UniqueName: \"kubernetes.io/projected/b6727a3f-4661-4e12-86e1-e1d191542ca2-kube-api-access-xf48t\") pod \"perf-node-gather-daemonset-fbb2j\" (UID: \"b6727a3f-4661-4e12-86e1-e1d191542ca2\") " pod="openshift-must-gather-pn2g5/perf-node-gather-daemonset-fbb2j" May 21 13:36:37.857180 ip-10-0-133-64 kubenswrapper[2562]: I0521 13:36:37.857124 2562 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-pn2g5/perf-node-gather-daemonset-fbb2j" May 21 13:36:37.993207 ip-10-0-133-64 kubenswrapper[2562]: I0521 13:36:37.993182 2562 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-pn2g5/perf-node-gather-daemonset-fbb2j"] May 21 13:36:37.995300 ip-10-0-133-64 kubenswrapper[2562]: W0521 13:36:37.995271 2562 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-podb6727a3f_4661_4e12_86e1_e1d191542ca2.slice/crio-16766cbc1314572b112d565a46649fe39d265da7b7e29d0a56a04bae2240e6a6 WatchSource:0}: Error finding container 16766cbc1314572b112d565a46649fe39d265da7b7e29d0a56a04bae2240e6a6: Status 404 returned error can't find the container with id 16766cbc1314572b112d565a46649fe39d265da7b7e29d0a56a04bae2240e6a6 May 21 13:36:37.999935 ip-10-0-133-64 kubenswrapper[2562]: I0521 13:36:37.999910 2562 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider May 21 13:36:38.891313 ip-10-0-133-64 kubenswrapper[2562]: I0521 13:36:38.891275 2562 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-pn2g5/perf-node-gather-daemonset-fbb2j" event={"ID":"b6727a3f-4661-4e12-86e1-e1d191542ca2","Type":"ContainerStarted","Data":"182a89906fde4fc5cc2ebdd4652a91ededa48cc7d060ad30ec56c78e4970ad1a"} May 21 13:36:38.891313 ip-10-0-133-64 kubenswrapper[2562]: I0521 13:36:38.891313 2562 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-pn2g5/perf-node-gather-daemonset-fbb2j" event={"ID":"b6727a3f-4661-4e12-86e1-e1d191542ca2","Type":"ContainerStarted","Data":"16766cbc1314572b112d565a46649fe39d265da7b7e29d0a56a04bae2240e6a6"} May 21 13:36:38.891768 ip-10-0-133-64 kubenswrapper[2562]: I0521 13:36:38.891414 2562 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-must-gather-pn2g5/perf-node-gather-daemonset-fbb2j" May 21 13:36:38.911913 ip-10-0-133-64 kubenswrapper[2562]: I0521 13:36:38.911865 2562 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-must-gather-pn2g5/perf-node-gather-daemonset-fbb2j" podStartSLOduration=1.911851169 podStartE2EDuration="1.911851169s" podCreationTimestamp="2026-05-21 13:36:37 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2026-05-21 13:36:38.909972325 +0000 UTC m=+2045.460253693" watchObservedRunningTime="2026-05-21 13:36:38.911851169 +0000 UTC m=+2045.462132536" May 21 13:36:39.505987 ip-10-0-133-64 kubenswrapper[2562]: I0521 13:36:39.505956 2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-76dff48d59-pt4fg_ef0f845b-ec3c-4e76-873d-f2552c56364c/console-operator/0.log" May 21 13:36:39.994068 ip-10-0-133-64 kubenswrapper[2562]: I0521 13:36:39.994042 2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console_console-69b9c7b6db-t45lf_a22e0a01-ad70-4b54-938e-d8b5630ef0b2/console/0.log" May 21 13:36:40.052720 ip-10-0-133-64 kubenswrapper[2562]: I0521 13:36:40.052690 2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console_downloads-57bd96b888-52n4w_1cbe2845-fe10-40ee-907d-f4425f3ddc35/download-server/0.log" May 21 13:36:40.586956 ip-10-0-133-64 kubenswrapper[2562]: I0521 13:36:40.586924 2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-cluster-storage-operator_volume-data-source-validator-5cf8c89d64-m8jhs_4ca422c1-c6f3-49c0-a3cb-64f1b1793866/volume-data-source-validator/0.log" May 21 13:36:41.478121 ip-10-0-133-64 kubenswrapper[2562]: I0521 13:36:41.478098 2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_dns-default-jmwf6_f0b8359d-d8af-4b73-8592-27cac5c13257/dns/0.log" May 21 13:36:41.504155 ip-10-0-133-64 kubenswrapper[2562]: I0521 13:36:41.504130 2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_dns-default-jmwf6_f0b8359d-d8af-4b73-8592-27cac5c13257/kube-rbac-proxy/0.log" May 21 13:36:41.701666 ip-10-0-133-64 kubenswrapper[2562]: I0521 13:36:41.701638 2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_node-resolver-qqgxp_f025d291-e59b-45b8-9b1a-83d59bcf8609/dns-node-resolver/0.log" May 21 13:36:42.266974 ip-10-0-133-64 kubenswrapper[2562]: I0521 13:36:42.266942 2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_image-registry-59f998bd79-jn4d2_349ca67b-a757-4620-943e-90741bff22ff/registry/0.log" May 21 13:36:42.341113 ip-10-0-133-64 kubenswrapper[2562]: I0521 13:36:42.341087 2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_node-ca-lm4qk_da3fc398-1999-44e7-80b5-5f699d3f7744/node-ca/0.log" May 21 13:36:43.218174 ip-10-0-133-64 kubenswrapper[2562]: I0521 13:36:43.218143 2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_data-science-gateway-data-science-gateway-class-686dffbf4bpn7ll_27083247-23eb-44d0-af0a-968f3acc818f/istio-proxy/0.log" May 21 13:36:43.430692 ip-10-0-133-64 kubenswrapper[2562]: I0521 13:36:43.430663 2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_maas-default-gateway-openshift-default-7d6f447cf5-qf64l_f17e38b8-c261-4695-8953-81c8b2b40bc1/istio-proxy/0.log" May 21 13:36:43.549930 ip-10-0-133-64 kubenswrapper[2562]: I0521 13:36:43.549853 2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_router-default-66c9cf854b-46gbc_7ba99752-9a0f-4032-a47f-8e1df0d52758/router/0.log" May 21 13:36:44.176221 ip-10-0-133-64 kubenswrapper[2562]: I0521 13:36:44.176188 2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress-canary_ingress-canary-6d7rg_ceb9bb27-e558-4ca2-9baf-cc21c0216ef6/serve-healthcheck-canary/0.log" May 21 13:36:44.831004 ip-10-0-133-64 kubenswrapper[2562]: I0521 13:36:44.830979 2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-operator-78bdfb888c-cj42h_d1ebaaa0-5942-4283-8952-713181fda43e/insights-operator/0.log" May 21 13:36:44.859456 ip-10-0-133-64 kubenswrapper[2562]: I0521 13:36:44.859432 2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-jhlks_fe062474-0a60-4dcf-9f4c-b2aa09c03169/kube-rbac-proxy/0.log" May 21 13:36:44.886841 ip-10-0-133-64 kubenswrapper[2562]: I0521 13:36:44.886788 2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-jhlks_fe062474-0a60-4dcf-9f4c-b2aa09c03169/exporter/0.log" May 21 13:36:44.905074 ip-10-0-133-64 kubenswrapper[2562]: I0521 13:36:44.905054 2562 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-must-gather-pn2g5/perf-node-gather-daemonset-fbb2j" May 21 13:36:44.922539 ip-10-0-133-64 kubenswrapper[2562]: I0521 13:36:44.922520 2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-jhlks_fe062474-0a60-4dcf-9f4c-b2aa09c03169/extractor/0.log" May 21 13:36:47.580007 ip-10-0-133-64 kubenswrapper[2562]: I0521 13:36:47.579974 2562 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_maas-api-key-cleanup-29656155-dm7jm_647bb5e9-1390-4b6c-94d5-74c27a385542/cleanup/0.log" May 21 13:36:47.611084 ip-10-0-133-64 kubenswrapper[2562]: I0521 13:36:47.611063 2562 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_maas-api-key-cleanup-29656170-zqx8m_967d7fdb-3f9e-4e63-bf6e-3c4bb13b9599/cleanup/0.log" May 21 13:36:47.683699 ip-10-0-133-64 kubenswrapper[2562]: I0521 13:36:47.683669 2562 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_maas-controller-85cc5d9594-wblgm_cbc9f0ae-14b9-4b0c-a736-a114da49b4de/manager/0.log" May 21 13:36:47.819418 ip-10-0-133-64 kubenswrapper[2562]: I0521 13:36:47.819341 2562 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-8545859b7d-zzdb2_1e611ccc-dd25-4210-ba16-a99ffc39eb2f/manager/0.log" May 21 13:36:47.851729 ip-10-0-133-64 kubenswrapper[2562]: I0521 13:36:47.851701 2562 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_postgres-68c4fbbd6f-4c2zv_7aa87e02-1849-4d59-a82f-43476c252b0e/postgres/0.log" May 21 13:36:49.125900 ip-10-0-133-64 kubenswrapper[2562]: I0521 13:36:49.125822 2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-lws-operator_lws-controller-manager-54666c59c-4rcdz_729b321b-a23b-41d9-b7c2-923d3d3088ac/manager/0.log"