Jun 02 21:33:42.634336 ip-10-0-138-193 systemd[1]: Starting Kubernetes Kubelet... Jun 02 21:33:43.066293 ip-10-0-138-193 kubenswrapper[2578]: Flag --container-runtime-endpoint has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information. Jun 02 21:33:43.066293 ip-10-0-138-193 kubenswrapper[2578]: Flag --minimum-container-ttl-duration has been deprecated, Use --eviction-hard or --eviction-soft instead. Will be removed in a future version. Jun 02 21:33:43.066293 ip-10-0-138-193 kubenswrapper[2578]: Flag --volume-plugin-dir has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information. Jun 02 21:33:43.066293 ip-10-0-138-193 kubenswrapper[2578]: Flag --pod-infra-container-image has been deprecated, will be removed in 1.35. Image garbage collector will get sandbox image information from CRI. Jun 02 21:33:43.066293 ip-10-0-138-193 kubenswrapper[2578]: Flag --system-reserved has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information. Jun 02 21:33:43.067109 ip-10-0-138-193 kubenswrapper[2578]: I0602 21:33:43.067003 2578 server.go:212] "--pod-infra-container-image will not be pruned by the image garbage collector in kubelet and should also be set in the remote runtime" Jun 02 21:33:43.075146 ip-10-0-138-193 kubenswrapper[2578]: W0602 21:33:43.075122 2578 feature_gate.go:328] unrecognized feature gate: Example2 Jun 02 21:33:43.075146 ip-10-0-138-193 kubenswrapper[2578]: W0602 21:33:43.075140 2578 feature_gate.go:328] unrecognized feature gate: InsightsConfigAPI Jun 02 21:33:43.075146 ip-10-0-138-193 kubenswrapper[2578]: W0602 21:33:43.075146 2578 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jun 02 21:33:43.075146 ip-10-0-138-193 kubenswrapper[2578]: W0602 21:33:43.075150 2578 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jun 02 21:33:43.075146 ip-10-0-138-193 kubenswrapper[2578]: W0602 21:33:43.075154 2578 feature_gate.go:328] unrecognized feature gate: SetEIPForNLBIngressController Jun 02 21:33:43.075350 ip-10-0-138-193 kubenswrapper[2578]: W0602 21:33:43.075157 2578 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jun 02 21:33:43.075350 ip-10-0-138-193 kubenswrapper[2578]: W0602 21:33:43.075161 2578 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jun 02 21:33:43.075350 ip-10-0-138-193 kubenswrapper[2578]: W0602 21:33:43.075164 2578 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jun 02 21:33:43.075350 ip-10-0-138-193 kubenswrapper[2578]: W0602 21:33:43.075167 2578 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jun 02 21:33:43.075350 ip-10-0-138-193 kubenswrapper[2578]: W0602 21:33:43.075170 2578 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jun 02 21:33:43.075350 ip-10-0-138-193 kubenswrapper[2578]: W0602 21:33:43.075173 2578 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jun 02 21:33:43.075350 ip-10-0-138-193 kubenswrapper[2578]: W0602 21:33:43.075176 2578 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jun 02 21:33:43.075350 ip-10-0-138-193 kubenswrapper[2578]: W0602 21:33:43.075178 2578 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jun 02 21:33:43.075350 ip-10-0-138-193 kubenswrapper[2578]: W0602 21:33:43.075181 2578 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jun 02 21:33:43.075350 ip-10-0-138-193 kubenswrapper[2578]: W0602 21:33:43.075184 2578 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jun 02 21:33:43.075350 ip-10-0-138-193 kubenswrapper[2578]: W0602 21:33:43.075186 2578 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jun 02 21:33:43.075350 ip-10-0-138-193 kubenswrapper[2578]: W0602 21:33:43.075189 2578 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jun 02 21:33:43.075350 ip-10-0-138-193 kubenswrapper[2578]: W0602 21:33:43.075192 2578 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jun 02 21:33:43.075350 ip-10-0-138-193 kubenswrapper[2578]: W0602 21:33:43.075194 2578 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jun 02 21:33:43.075350 ip-10-0-138-193 kubenswrapper[2578]: W0602 21:33:43.075197 2578 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jun 02 21:33:43.075350 ip-10-0-138-193 kubenswrapper[2578]: W0602 21:33:43.075199 2578 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jun 02 21:33:43.075350 ip-10-0-138-193 kubenswrapper[2578]: W0602 21:33:43.075202 2578 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jun 02 21:33:43.075350 ip-10-0-138-193 kubenswrapper[2578]: W0602 21:33:43.075205 2578 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jun 02 21:33:43.075350 ip-10-0-138-193 kubenswrapper[2578]: W0602 21:33:43.075208 2578 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jun 02 21:33:43.075350 ip-10-0-138-193 kubenswrapper[2578]: W0602 21:33:43.075210 2578 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jun 02 21:33:43.075831 ip-10-0-138-193 kubenswrapper[2578]: W0602 21:33:43.075213 2578 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jun 02 21:33:43.075831 ip-10-0-138-193 kubenswrapper[2578]: W0602 21:33:43.075215 2578 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jun 02 21:33:43.075831 ip-10-0-138-193 kubenswrapper[2578]: W0602 21:33:43.075218 2578 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jun 02 21:33:43.075831 ip-10-0-138-193 kubenswrapper[2578]: W0602 21:33:43.075220 2578 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jun 02 21:33:43.075831 ip-10-0-138-193 kubenswrapper[2578]: W0602 21:33:43.075223 2578 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jun 02 21:33:43.075831 ip-10-0-138-193 kubenswrapper[2578]: W0602 21:33:43.075231 2578 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jun 02 21:33:43.075831 ip-10-0-138-193 kubenswrapper[2578]: W0602 21:33:43.075234 2578 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jun 02 21:33:43.075831 ip-10-0-138-193 kubenswrapper[2578]: W0602 21:33:43.075236 2578 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jun 02 21:33:43.075831 ip-10-0-138-193 kubenswrapper[2578]: W0602 21:33:43.075240 2578 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jun 02 21:33:43.075831 ip-10-0-138-193 kubenswrapper[2578]: W0602 21:33:43.075245 2578 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jun 02 21:33:43.075831 ip-10-0-138-193 kubenswrapper[2578]: W0602 21:33:43.075248 2578 feature_gate.go:328] unrecognized feature gate: NewOLM Jun 02 21:33:43.075831 ip-10-0-138-193 kubenswrapper[2578]: W0602 21:33:43.075250 2578 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jun 02 21:33:43.075831 ip-10-0-138-193 kubenswrapper[2578]: W0602 21:33:43.075253 2578 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jun 02 21:33:43.075831 ip-10-0-138-193 kubenswrapper[2578]: W0602 21:33:43.075257 2578 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jun 02 21:33:43.075831 ip-10-0-138-193 kubenswrapper[2578]: W0602 21:33:43.075260 2578 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jun 02 21:33:43.075831 ip-10-0-138-193 kubenswrapper[2578]: W0602 21:33:43.075263 2578 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jun 02 21:33:43.075831 ip-10-0-138-193 kubenswrapper[2578]: W0602 21:33:43.075265 2578 feature_gate.go:328] unrecognized feature gate: Example Jun 02 21:33:43.075831 ip-10-0-138-193 kubenswrapper[2578]: W0602 21:33:43.075268 2578 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jun 02 21:33:43.075831 ip-10-0-138-193 kubenswrapper[2578]: W0602 21:33:43.075270 2578 feature_gate.go:328] unrecognized feature gate: DualReplica Jun 02 21:33:43.075831 ip-10-0-138-193 kubenswrapper[2578]: W0602 21:33:43.075273 2578 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jun 02 21:33:43.076390 ip-10-0-138-193 kubenswrapper[2578]: W0602 21:33:43.075275 2578 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jun 02 21:33:43.076390 ip-10-0-138-193 kubenswrapper[2578]: W0602 21:33:43.075278 2578 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jun 02 21:33:43.076390 ip-10-0-138-193 kubenswrapper[2578]: W0602 21:33:43.075281 2578 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jun 02 21:33:43.076390 ip-10-0-138-193 kubenswrapper[2578]: W0602 21:33:43.075283 2578 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jun 02 21:33:43.076390 ip-10-0-138-193 kubenswrapper[2578]: W0602 21:33:43.075286 2578 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jun 02 21:33:43.076390 ip-10-0-138-193 kubenswrapper[2578]: W0602 21:33:43.075289 2578 feature_gate.go:328] unrecognized feature gate: OVNObservability Jun 02 21:33:43.076390 ip-10-0-138-193 kubenswrapper[2578]: W0602 21:33:43.075291 2578 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jun 02 21:33:43.076390 ip-10-0-138-193 kubenswrapper[2578]: W0602 21:33:43.075293 2578 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jun 02 21:33:43.076390 ip-10-0-138-193 kubenswrapper[2578]: W0602 21:33:43.075296 2578 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jun 02 21:33:43.076390 ip-10-0-138-193 kubenswrapper[2578]: W0602 21:33:43.075299 2578 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jun 02 21:33:43.076390 ip-10-0-138-193 kubenswrapper[2578]: W0602 21:33:43.075302 2578 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jun 02 21:33:43.076390 ip-10-0-138-193 kubenswrapper[2578]: W0602 21:33:43.075305 2578 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jun 02 21:33:43.076390 ip-10-0-138-193 kubenswrapper[2578]: W0602 21:33:43.075307 2578 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jun 02 21:33:43.076390 ip-10-0-138-193 kubenswrapper[2578]: W0602 21:33:43.075310 2578 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jun 02 21:33:43.076390 ip-10-0-138-193 kubenswrapper[2578]: W0602 21:33:43.075313 2578 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jun 02 21:33:43.076390 ip-10-0-138-193 kubenswrapper[2578]: W0602 21:33:43.075317 2578 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jun 02 21:33:43.076390 ip-10-0-138-193 kubenswrapper[2578]: W0602 21:33:43.075319 2578 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jun 02 21:33:43.076390 ip-10-0-138-193 kubenswrapper[2578]: W0602 21:33:43.075322 2578 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jun 02 21:33:43.076390 ip-10-0-138-193 kubenswrapper[2578]: W0602 21:33:43.075325 2578 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jun 02 21:33:43.076850 ip-10-0-138-193 kubenswrapper[2578]: W0602 21:33:43.075327 2578 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jun 02 21:33:43.076850 ip-10-0-138-193 kubenswrapper[2578]: W0602 21:33:43.075330 2578 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jun 02 21:33:43.076850 ip-10-0-138-193 kubenswrapper[2578]: W0602 21:33:43.075332 2578 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jun 02 21:33:43.076850 ip-10-0-138-193 kubenswrapper[2578]: W0602 21:33:43.075335 2578 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jun 02 21:33:43.076850 ip-10-0-138-193 kubenswrapper[2578]: W0602 21:33:43.075337 2578 feature_gate.go:328] unrecognized feature gate: SignatureStores Jun 02 21:33:43.076850 ip-10-0-138-193 kubenswrapper[2578]: W0602 21:33:43.075340 2578 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jun 02 21:33:43.076850 ip-10-0-138-193 kubenswrapper[2578]: W0602 21:33:43.075343 2578 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jun 02 21:33:43.076850 ip-10-0-138-193 kubenswrapper[2578]: W0602 21:33:43.075345 2578 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jun 02 21:33:43.076850 ip-10-0-138-193 kubenswrapper[2578]: W0602 21:33:43.075348 2578 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jun 02 21:33:43.076850 ip-10-0-138-193 kubenswrapper[2578]: W0602 21:33:43.075351 2578 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jun 02 21:33:43.076850 ip-10-0-138-193 kubenswrapper[2578]: W0602 21:33:43.075354 2578 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterOperations Jun 02 21:33:43.076850 ip-10-0-138-193 kubenswrapper[2578]: W0602 21:33:43.075356 2578 feature_gate.go:328] unrecognized feature gate: IngressControllerLBSubnetsAWS Jun 02 21:33:43.076850 ip-10-0-138-193 kubenswrapper[2578]: W0602 21:33:43.075359 2578 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jun 02 21:33:43.076850 ip-10-0-138-193 kubenswrapper[2578]: W0602 21:33:43.075362 2578 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jun 02 21:33:43.076850 ip-10-0-138-193 kubenswrapper[2578]: W0602 21:33:43.075365 2578 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jun 02 21:33:43.076850 ip-10-0-138-193 kubenswrapper[2578]: W0602 21:33:43.075368 2578 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jun 02 21:33:43.076850 ip-10-0-138-193 kubenswrapper[2578]: W0602 21:33:43.075371 2578 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jun 02 21:33:43.076850 ip-10-0-138-193 kubenswrapper[2578]: W0602 21:33:43.075373 2578 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jun 02 21:33:43.076850 ip-10-0-138-193 kubenswrapper[2578]: W0602 21:33:43.075376 2578 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jun 02 21:33:43.076850 ip-10-0-138-193 kubenswrapper[2578]: W0602 21:33:43.075379 2578 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jun 02 21:33:43.077351 ip-10-0-138-193 kubenswrapper[2578]: W0602 21:33:43.075381 2578 feature_gate.go:328] unrecognized feature gate: PinnedImages Jun 02 21:33:43.077351 ip-10-0-138-193 kubenswrapper[2578]: W0602 21:33:43.075384 2578 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jun 02 21:33:43.077351 ip-10-0-138-193 kubenswrapper[2578]: W0602 21:33:43.075777 2578 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jun 02 21:33:43.077351 ip-10-0-138-193 kubenswrapper[2578]: W0602 21:33:43.075782 2578 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jun 02 21:33:43.077351 ip-10-0-138-193 kubenswrapper[2578]: W0602 21:33:43.075786 2578 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jun 02 21:33:43.077351 ip-10-0-138-193 kubenswrapper[2578]: W0602 21:33:43.075790 2578 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jun 02 21:33:43.077351 ip-10-0-138-193 kubenswrapper[2578]: W0602 21:33:43.075794 2578 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jun 02 21:33:43.077351 ip-10-0-138-193 kubenswrapper[2578]: W0602 21:33:43.075797 2578 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jun 02 21:33:43.077351 ip-10-0-138-193 kubenswrapper[2578]: W0602 21:33:43.075800 2578 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jun 02 21:33:43.077351 ip-10-0-138-193 kubenswrapper[2578]: W0602 21:33:43.075803 2578 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jun 02 21:33:43.077351 ip-10-0-138-193 kubenswrapper[2578]: W0602 21:33:43.075806 2578 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jun 02 21:33:43.077351 ip-10-0-138-193 kubenswrapper[2578]: W0602 21:33:43.075809 2578 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jun 02 21:33:43.077351 ip-10-0-138-193 kubenswrapper[2578]: W0602 21:33:43.075812 2578 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jun 02 21:33:43.077351 ip-10-0-138-193 kubenswrapper[2578]: W0602 21:33:43.075814 2578 feature_gate.go:328] unrecognized feature gate: SetEIPForNLBIngressController Jun 02 21:33:43.077351 ip-10-0-138-193 kubenswrapper[2578]: W0602 21:33:43.075817 2578 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jun 02 21:33:43.077351 ip-10-0-138-193 kubenswrapper[2578]: W0602 21:33:43.075820 2578 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jun 02 21:33:43.077351 ip-10-0-138-193 kubenswrapper[2578]: W0602 21:33:43.075822 2578 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jun 02 21:33:43.077351 ip-10-0-138-193 kubenswrapper[2578]: W0602 21:33:43.075825 2578 feature_gate.go:328] unrecognized feature gate: IngressControllerLBSubnetsAWS Jun 02 21:33:43.077351 ip-10-0-138-193 kubenswrapper[2578]: W0602 21:33:43.075829 2578 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jun 02 21:33:43.077812 ip-10-0-138-193 kubenswrapper[2578]: W0602 21:33:43.075832 2578 feature_gate.go:328] unrecognized feature gate: NewOLM Jun 02 21:33:43.077812 ip-10-0-138-193 kubenswrapper[2578]: W0602 21:33:43.075835 2578 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jun 02 21:33:43.077812 ip-10-0-138-193 kubenswrapper[2578]: W0602 21:33:43.075838 2578 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jun 02 21:33:43.077812 ip-10-0-138-193 kubenswrapper[2578]: W0602 21:33:43.075841 2578 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jun 02 21:33:43.077812 ip-10-0-138-193 kubenswrapper[2578]: W0602 21:33:43.075844 2578 feature_gate.go:328] unrecognized feature gate: SignatureStores Jun 02 21:33:43.077812 ip-10-0-138-193 kubenswrapper[2578]: W0602 21:33:43.075846 2578 feature_gate.go:328] unrecognized feature gate: PinnedImages Jun 02 21:33:43.077812 ip-10-0-138-193 kubenswrapper[2578]: W0602 21:33:43.075849 2578 feature_gate.go:328] unrecognized feature gate: Example2 Jun 02 21:33:43.077812 ip-10-0-138-193 kubenswrapper[2578]: W0602 21:33:43.075852 2578 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jun 02 21:33:43.077812 ip-10-0-138-193 kubenswrapper[2578]: W0602 21:33:43.075855 2578 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterOperations Jun 02 21:33:43.077812 ip-10-0-138-193 kubenswrapper[2578]: W0602 21:33:43.075858 2578 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jun 02 21:33:43.077812 ip-10-0-138-193 kubenswrapper[2578]: W0602 21:33:43.075860 2578 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jun 02 21:33:43.077812 ip-10-0-138-193 kubenswrapper[2578]: W0602 21:33:43.075863 2578 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jun 02 21:33:43.077812 ip-10-0-138-193 kubenswrapper[2578]: W0602 21:33:43.075865 2578 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jun 02 21:33:43.077812 ip-10-0-138-193 kubenswrapper[2578]: W0602 21:33:43.075870 2578 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jun 02 21:33:43.077812 ip-10-0-138-193 kubenswrapper[2578]: W0602 21:33:43.075874 2578 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jun 02 21:33:43.077812 ip-10-0-138-193 kubenswrapper[2578]: W0602 21:33:43.075876 2578 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jun 02 21:33:43.077812 ip-10-0-138-193 kubenswrapper[2578]: W0602 21:33:43.075879 2578 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jun 02 21:33:43.077812 ip-10-0-138-193 kubenswrapper[2578]: W0602 21:33:43.075881 2578 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jun 02 21:33:43.077812 ip-10-0-138-193 kubenswrapper[2578]: W0602 21:33:43.075884 2578 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jun 02 21:33:43.078284 ip-10-0-138-193 kubenswrapper[2578]: W0602 21:33:43.075886 2578 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jun 02 21:33:43.078284 ip-10-0-138-193 kubenswrapper[2578]: W0602 21:33:43.075889 2578 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jun 02 21:33:43.078284 ip-10-0-138-193 kubenswrapper[2578]: W0602 21:33:43.075891 2578 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jun 02 21:33:43.078284 ip-10-0-138-193 kubenswrapper[2578]: W0602 21:33:43.075895 2578 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jun 02 21:33:43.078284 ip-10-0-138-193 kubenswrapper[2578]: W0602 21:33:43.075898 2578 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jun 02 21:33:43.078284 ip-10-0-138-193 kubenswrapper[2578]: W0602 21:33:43.075901 2578 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jun 02 21:33:43.078284 ip-10-0-138-193 kubenswrapper[2578]: W0602 21:33:43.075903 2578 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jun 02 21:33:43.078284 ip-10-0-138-193 kubenswrapper[2578]: W0602 21:33:43.075905 2578 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jun 02 21:33:43.078284 ip-10-0-138-193 kubenswrapper[2578]: W0602 21:33:43.075908 2578 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jun 02 21:33:43.078284 ip-10-0-138-193 kubenswrapper[2578]: W0602 21:33:43.075910 2578 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jun 02 21:33:43.078284 ip-10-0-138-193 kubenswrapper[2578]: W0602 21:33:43.075913 2578 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jun 02 21:33:43.078284 ip-10-0-138-193 kubenswrapper[2578]: W0602 21:33:43.075916 2578 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jun 02 21:33:43.078284 ip-10-0-138-193 kubenswrapper[2578]: W0602 21:33:43.075919 2578 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jun 02 21:33:43.078284 ip-10-0-138-193 kubenswrapper[2578]: W0602 21:33:43.075922 2578 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jun 02 21:33:43.078284 ip-10-0-138-193 kubenswrapper[2578]: W0602 21:33:43.075924 2578 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jun 02 21:33:43.078284 ip-10-0-138-193 kubenswrapper[2578]: W0602 21:33:43.075927 2578 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jun 02 21:33:43.078284 ip-10-0-138-193 kubenswrapper[2578]: W0602 21:33:43.075930 2578 feature_gate.go:328] unrecognized feature gate: DualReplica Jun 02 21:33:43.078284 ip-10-0-138-193 kubenswrapper[2578]: W0602 21:33:43.075932 2578 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jun 02 21:33:43.078284 ip-10-0-138-193 kubenswrapper[2578]: W0602 21:33:43.075934 2578 feature_gate.go:328] unrecognized feature gate: OVNObservability Jun 02 21:33:43.078284 ip-10-0-138-193 kubenswrapper[2578]: W0602 21:33:43.075937 2578 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jun 02 21:33:43.078855 ip-10-0-138-193 kubenswrapper[2578]: W0602 21:33:43.075941 2578 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jun 02 21:33:43.078855 ip-10-0-138-193 kubenswrapper[2578]: W0602 21:33:43.075944 2578 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jun 02 21:33:43.078855 ip-10-0-138-193 kubenswrapper[2578]: W0602 21:33:43.075946 2578 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jun 02 21:33:43.078855 ip-10-0-138-193 kubenswrapper[2578]: W0602 21:33:43.075949 2578 feature_gate.go:328] unrecognized feature gate: Example Jun 02 21:33:43.078855 ip-10-0-138-193 kubenswrapper[2578]: W0602 21:33:43.075951 2578 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jun 02 21:33:43.078855 ip-10-0-138-193 kubenswrapper[2578]: W0602 21:33:43.075954 2578 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jun 02 21:33:43.078855 ip-10-0-138-193 kubenswrapper[2578]: W0602 21:33:43.075956 2578 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jun 02 21:33:43.078855 ip-10-0-138-193 kubenswrapper[2578]: W0602 21:33:43.075959 2578 feature_gate.go:328] unrecognized feature gate: InsightsConfigAPI Jun 02 21:33:43.078855 ip-10-0-138-193 kubenswrapper[2578]: W0602 21:33:43.075962 2578 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jun 02 21:33:43.078855 ip-10-0-138-193 kubenswrapper[2578]: W0602 21:33:43.075964 2578 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jun 02 21:33:43.078855 ip-10-0-138-193 kubenswrapper[2578]: W0602 21:33:43.075967 2578 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jun 02 21:33:43.078855 ip-10-0-138-193 kubenswrapper[2578]: W0602 21:33:43.075969 2578 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jun 02 21:33:43.078855 ip-10-0-138-193 kubenswrapper[2578]: W0602 21:33:43.075972 2578 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jun 02 21:33:43.078855 ip-10-0-138-193 kubenswrapper[2578]: W0602 21:33:43.075974 2578 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jun 02 21:33:43.078855 ip-10-0-138-193 kubenswrapper[2578]: W0602 21:33:43.075977 2578 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jun 02 21:33:43.078855 ip-10-0-138-193 kubenswrapper[2578]: W0602 21:33:43.075979 2578 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jun 02 21:33:43.078855 ip-10-0-138-193 kubenswrapper[2578]: W0602 21:33:43.075982 2578 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jun 02 21:33:43.078855 ip-10-0-138-193 kubenswrapper[2578]: W0602 21:33:43.075985 2578 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jun 02 21:33:43.078855 ip-10-0-138-193 kubenswrapper[2578]: W0602 21:33:43.075987 2578 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jun 02 21:33:43.078855 ip-10-0-138-193 kubenswrapper[2578]: W0602 21:33:43.075990 2578 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jun 02 21:33:43.079356 ip-10-0-138-193 kubenswrapper[2578]: W0602 21:33:43.075992 2578 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jun 02 21:33:43.079356 ip-10-0-138-193 kubenswrapper[2578]: W0602 21:33:43.075995 2578 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jun 02 21:33:43.079356 ip-10-0-138-193 kubenswrapper[2578]: W0602 21:33:43.075997 2578 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jun 02 21:33:43.079356 ip-10-0-138-193 kubenswrapper[2578]: W0602 21:33:43.076000 2578 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jun 02 21:33:43.079356 ip-10-0-138-193 kubenswrapper[2578]: W0602 21:33:43.076002 2578 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jun 02 21:33:43.079356 ip-10-0-138-193 kubenswrapper[2578]: W0602 21:33:43.076005 2578 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jun 02 21:33:43.079356 ip-10-0-138-193 kubenswrapper[2578]: W0602 21:33:43.076008 2578 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jun 02 21:33:43.079356 ip-10-0-138-193 kubenswrapper[2578]: W0602 21:33:43.076010 2578 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jun 02 21:33:43.079356 ip-10-0-138-193 kubenswrapper[2578]: W0602 21:33:43.076013 2578 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jun 02 21:33:43.079356 ip-10-0-138-193 kubenswrapper[2578]: W0602 21:33:43.076016 2578 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jun 02 21:33:43.079356 ip-10-0-138-193 kubenswrapper[2578]: I0602 21:33:43.076117 2578 flags.go:64] FLAG: --address="0.0.0.0" Jun 02 21:33:43.079356 ip-10-0-138-193 kubenswrapper[2578]: I0602 21:33:43.076129 2578 flags.go:64] FLAG: --allowed-unsafe-sysctls="[]" Jun 02 21:33:43.079356 ip-10-0-138-193 kubenswrapper[2578]: I0602 21:33:43.076136 2578 flags.go:64] FLAG: --anonymous-auth="true" Jun 02 21:33:43.079356 ip-10-0-138-193 kubenswrapper[2578]: I0602 21:33:43.076141 2578 flags.go:64] FLAG: --application-metrics-count-limit="100" Jun 02 21:33:43.079356 ip-10-0-138-193 kubenswrapper[2578]: I0602 21:33:43.076146 2578 flags.go:64] FLAG: --authentication-token-webhook="false" Jun 02 21:33:43.079356 ip-10-0-138-193 kubenswrapper[2578]: I0602 21:33:43.076149 2578 flags.go:64] FLAG: --authentication-token-webhook-cache-ttl="2m0s" Jun 02 21:33:43.079356 ip-10-0-138-193 kubenswrapper[2578]: I0602 21:33:43.076153 2578 flags.go:64] FLAG: --authorization-mode="AlwaysAllow" Jun 02 21:33:43.079356 ip-10-0-138-193 kubenswrapper[2578]: I0602 21:33:43.076157 2578 flags.go:64] FLAG: --authorization-webhook-cache-authorized-ttl="5m0s" Jun 02 21:33:43.079356 ip-10-0-138-193 kubenswrapper[2578]: I0602 21:33:43.076161 2578 flags.go:64] FLAG: --authorization-webhook-cache-unauthorized-ttl="30s" Jun 02 21:33:43.079356 ip-10-0-138-193 kubenswrapper[2578]: I0602 21:33:43.076164 2578 flags.go:64] FLAG: --boot-id-file="/proc/sys/kernel/random/boot_id" Jun 02 21:33:43.079356 ip-10-0-138-193 kubenswrapper[2578]: I0602 21:33:43.076167 2578 flags.go:64] FLAG: --bootstrap-kubeconfig="/etc/kubernetes/kubeconfig" Jun 02 21:33:43.079886 ip-10-0-138-193 kubenswrapper[2578]: I0602 21:33:43.076171 2578 flags.go:64] FLAG: --cert-dir="/var/lib/kubelet/pki" Jun 02 21:33:43.079886 ip-10-0-138-193 kubenswrapper[2578]: I0602 21:33:43.076174 2578 flags.go:64] FLAG: --cgroup-driver="cgroupfs" Jun 02 21:33:43.079886 ip-10-0-138-193 kubenswrapper[2578]: I0602 21:33:43.076176 2578 flags.go:64] FLAG: --cgroup-root="" Jun 02 21:33:43.079886 ip-10-0-138-193 kubenswrapper[2578]: I0602 21:33:43.076180 2578 flags.go:64] FLAG: --cgroups-per-qos="true" Jun 02 21:33:43.079886 ip-10-0-138-193 kubenswrapper[2578]: I0602 21:33:43.076182 2578 flags.go:64] FLAG: --client-ca-file="" Jun 02 21:33:43.079886 ip-10-0-138-193 kubenswrapper[2578]: I0602 21:33:43.076185 2578 flags.go:64] FLAG: --cloud-config="" Jun 02 21:33:43.079886 ip-10-0-138-193 kubenswrapper[2578]: I0602 21:33:43.076188 2578 flags.go:64] FLAG: --cloud-provider="external" Jun 02 21:33:43.079886 ip-10-0-138-193 kubenswrapper[2578]: I0602 21:33:43.076191 2578 flags.go:64] FLAG: --cluster-dns="[]" Jun 02 21:33:43.079886 ip-10-0-138-193 kubenswrapper[2578]: I0602 21:33:43.076196 2578 flags.go:64] FLAG: --cluster-domain="" Jun 02 21:33:43.079886 ip-10-0-138-193 kubenswrapper[2578]: I0602 21:33:43.076199 2578 flags.go:64] FLAG: --config="/etc/kubernetes/kubelet.conf" Jun 02 21:33:43.079886 ip-10-0-138-193 kubenswrapper[2578]: I0602 21:33:43.076202 2578 flags.go:64] FLAG: --config-dir="" Jun 02 21:33:43.079886 ip-10-0-138-193 kubenswrapper[2578]: I0602 21:33:43.076205 2578 flags.go:64] FLAG: --container-hints="/etc/cadvisor/container_hints.json" Jun 02 21:33:43.079886 ip-10-0-138-193 kubenswrapper[2578]: I0602 21:33:43.076209 2578 flags.go:64] FLAG: --container-log-max-files="5" Jun 02 21:33:43.079886 ip-10-0-138-193 kubenswrapper[2578]: I0602 21:33:43.076212 2578 flags.go:64] FLAG: --container-log-max-size="10Mi" Jun 02 21:33:43.079886 ip-10-0-138-193 kubenswrapper[2578]: I0602 21:33:43.076215 2578 flags.go:64] FLAG: --container-runtime-endpoint="/var/run/crio/crio.sock" Jun 02 21:33:43.079886 ip-10-0-138-193 kubenswrapper[2578]: I0602 21:33:43.076218 2578 flags.go:64] FLAG: --containerd="/run/containerd/containerd.sock" Jun 02 21:33:43.079886 ip-10-0-138-193 kubenswrapper[2578]: I0602 21:33:43.076221 2578 flags.go:64] FLAG: --containerd-namespace="k8s.io" Jun 02 21:33:43.079886 ip-10-0-138-193 kubenswrapper[2578]: I0602 21:33:43.076224 2578 flags.go:64] FLAG: --contention-profiling="false" Jun 02 21:33:43.079886 ip-10-0-138-193 kubenswrapper[2578]: I0602 21:33:43.076228 2578 flags.go:64] FLAG: --cpu-cfs-quota="true" Jun 02 21:33:43.079886 ip-10-0-138-193 kubenswrapper[2578]: I0602 21:33:43.076231 2578 flags.go:64] FLAG: --cpu-cfs-quota-period="100ms" Jun 02 21:33:43.079886 ip-10-0-138-193 kubenswrapper[2578]: I0602 21:33:43.076234 2578 flags.go:64] FLAG: --cpu-manager-policy="none" Jun 02 21:33:43.079886 ip-10-0-138-193 kubenswrapper[2578]: I0602 21:33:43.076237 2578 flags.go:64] FLAG: --cpu-manager-policy-options="" Jun 02 21:33:43.079886 ip-10-0-138-193 kubenswrapper[2578]: I0602 21:33:43.076241 2578 flags.go:64] FLAG: --cpu-manager-reconcile-period="10s" Jun 02 21:33:43.079886 ip-10-0-138-193 kubenswrapper[2578]: I0602 21:33:43.076244 2578 flags.go:64] FLAG: --enable-controller-attach-detach="true" Jun 02 21:33:43.079886 ip-10-0-138-193 kubenswrapper[2578]: I0602 21:33:43.076247 2578 flags.go:64] FLAG: --enable-debugging-handlers="true" Jun 02 21:33:43.080519 ip-10-0-138-193 kubenswrapper[2578]: I0602 21:33:43.076250 2578 flags.go:64] FLAG: --enable-load-reader="false" Jun 02 21:33:43.080519 ip-10-0-138-193 kubenswrapper[2578]: I0602 21:33:43.076253 2578 flags.go:64] FLAG: --enable-server="true" Jun 02 21:33:43.080519 ip-10-0-138-193 kubenswrapper[2578]: I0602 21:33:43.076256 2578 flags.go:64] FLAG: --enforce-node-allocatable="[pods]" Jun 02 21:33:43.080519 ip-10-0-138-193 kubenswrapper[2578]: I0602 21:33:43.076261 2578 flags.go:64] FLAG: --event-burst="100" Jun 02 21:33:43.080519 ip-10-0-138-193 kubenswrapper[2578]: I0602 21:33:43.076264 2578 flags.go:64] FLAG: --event-qps="50" Jun 02 21:33:43.080519 ip-10-0-138-193 kubenswrapper[2578]: I0602 21:33:43.076266 2578 flags.go:64] FLAG: --event-storage-age-limit="default=0" Jun 02 21:33:43.080519 ip-10-0-138-193 kubenswrapper[2578]: I0602 21:33:43.076269 2578 flags.go:64] FLAG: --event-storage-event-limit="default=0" Jun 02 21:33:43.080519 ip-10-0-138-193 kubenswrapper[2578]: I0602 21:33:43.076273 2578 flags.go:64] FLAG: --eviction-hard="" Jun 02 21:33:43.080519 ip-10-0-138-193 kubenswrapper[2578]: I0602 21:33:43.076276 2578 flags.go:64] FLAG: --eviction-max-pod-grace-period="0" Jun 02 21:33:43.080519 ip-10-0-138-193 kubenswrapper[2578]: I0602 21:33:43.076279 2578 flags.go:64] FLAG: --eviction-minimum-reclaim="" Jun 02 21:33:43.080519 ip-10-0-138-193 kubenswrapper[2578]: I0602 21:33:43.076282 2578 flags.go:64] FLAG: --eviction-pressure-transition-period="5m0s" Jun 02 21:33:43.080519 ip-10-0-138-193 kubenswrapper[2578]: I0602 21:33:43.076285 2578 flags.go:64] FLAG: --eviction-soft="" Jun 02 21:33:43.080519 ip-10-0-138-193 kubenswrapper[2578]: I0602 21:33:43.076288 2578 flags.go:64] FLAG: --eviction-soft-grace-period="" Jun 02 21:33:43.080519 ip-10-0-138-193 kubenswrapper[2578]: I0602 21:33:43.076291 2578 flags.go:64] FLAG: --exit-on-lock-contention="false" Jun 02 21:33:43.080519 ip-10-0-138-193 kubenswrapper[2578]: I0602 21:33:43.076294 2578 flags.go:64] FLAG: --experimental-allocatable-ignore-eviction="false" Jun 02 21:33:43.080519 ip-10-0-138-193 kubenswrapper[2578]: I0602 21:33:43.076297 2578 flags.go:64] FLAG: --experimental-mounter-path="" Jun 02 21:33:43.080519 ip-10-0-138-193 kubenswrapper[2578]: I0602 21:33:43.076300 2578 flags.go:64] FLAG: --fail-cgroupv1="false" Jun 02 21:33:43.080519 ip-10-0-138-193 kubenswrapper[2578]: I0602 21:33:43.076303 2578 flags.go:64] FLAG: --fail-swap-on="true" Jun 02 21:33:43.080519 ip-10-0-138-193 kubenswrapper[2578]: I0602 21:33:43.076305 2578 flags.go:64] FLAG: --feature-gates="" Jun 02 21:33:43.080519 ip-10-0-138-193 kubenswrapper[2578]: I0602 21:33:43.076309 2578 flags.go:64] FLAG: --file-check-frequency="20s" Jun 02 21:33:43.080519 ip-10-0-138-193 kubenswrapper[2578]: I0602 21:33:43.076312 2578 flags.go:64] FLAG: --global-housekeeping-interval="1m0s" Jun 02 21:33:43.080519 ip-10-0-138-193 kubenswrapper[2578]: I0602 21:33:43.076315 2578 flags.go:64] FLAG: --hairpin-mode="promiscuous-bridge" Jun 02 21:33:43.080519 ip-10-0-138-193 kubenswrapper[2578]: I0602 21:33:43.076318 2578 flags.go:64] FLAG: --healthz-bind-address="127.0.0.1" Jun 02 21:33:43.080519 ip-10-0-138-193 kubenswrapper[2578]: I0602 21:33:43.076321 2578 flags.go:64] FLAG: --healthz-port="10248" Jun 02 21:33:43.080519 ip-10-0-138-193 kubenswrapper[2578]: I0602 21:33:43.076324 2578 flags.go:64] FLAG: --help="false" Jun 02 21:33:43.081154 ip-10-0-138-193 kubenswrapper[2578]: I0602 21:33:43.076327 2578 flags.go:64] FLAG: --hostname-override="ip-10-0-138-193.ec2.internal" Jun 02 21:33:43.081154 ip-10-0-138-193 kubenswrapper[2578]: I0602 21:33:43.076330 2578 flags.go:64] FLAG: --housekeeping-interval="10s" Jun 02 21:33:43.081154 ip-10-0-138-193 kubenswrapper[2578]: I0602 21:33:43.076333 2578 flags.go:64] FLAG: --http-check-frequency="20s" Jun 02 21:33:43.081154 ip-10-0-138-193 kubenswrapper[2578]: I0602 21:33:43.076336 2578 flags.go:64] FLAG: --image-credential-provider-bin-dir="/usr/libexec/kubelet-image-credential-provider-plugins" Jun 02 21:33:43.081154 ip-10-0-138-193 kubenswrapper[2578]: I0602 21:33:43.076339 2578 flags.go:64] FLAG: --image-credential-provider-config="/etc/kubernetes/credential-providers/ecr-credential-provider.yaml" Jun 02 21:33:43.081154 ip-10-0-138-193 kubenswrapper[2578]: I0602 21:33:43.076343 2578 flags.go:64] FLAG: --image-gc-high-threshold="85" Jun 02 21:33:43.081154 ip-10-0-138-193 kubenswrapper[2578]: I0602 21:33:43.076346 2578 flags.go:64] FLAG: --image-gc-low-threshold="80" Jun 02 21:33:43.081154 ip-10-0-138-193 kubenswrapper[2578]: I0602 21:33:43.076348 2578 flags.go:64] FLAG: --image-service-endpoint="" Jun 02 21:33:43.081154 ip-10-0-138-193 kubenswrapper[2578]: I0602 21:33:43.076351 2578 flags.go:64] FLAG: --kernel-memcg-notification="false" Jun 02 21:33:43.081154 ip-10-0-138-193 kubenswrapper[2578]: I0602 21:33:43.076355 2578 flags.go:64] FLAG: --kube-api-burst="100" Jun 02 21:33:43.081154 ip-10-0-138-193 kubenswrapper[2578]: I0602 21:33:43.076358 2578 flags.go:64] FLAG: --kube-api-content-type="application/vnd.kubernetes.protobuf" Jun 02 21:33:43.081154 ip-10-0-138-193 kubenswrapper[2578]: I0602 21:33:43.076361 2578 flags.go:64] FLAG: --kube-api-qps="50" Jun 02 21:33:43.081154 ip-10-0-138-193 kubenswrapper[2578]: I0602 21:33:43.076364 2578 flags.go:64] FLAG: --kube-reserved="" Jun 02 21:33:43.081154 ip-10-0-138-193 kubenswrapper[2578]: I0602 21:33:43.076366 2578 flags.go:64] FLAG: --kube-reserved-cgroup="" Jun 02 21:33:43.081154 ip-10-0-138-193 kubenswrapper[2578]: I0602 21:33:43.076369 2578 flags.go:64] FLAG: --kubeconfig="/var/lib/kubelet/kubeconfig" Jun 02 21:33:43.081154 ip-10-0-138-193 kubenswrapper[2578]: I0602 21:33:43.076372 2578 flags.go:64] FLAG: --kubelet-cgroups="" Jun 02 21:33:43.081154 ip-10-0-138-193 kubenswrapper[2578]: I0602 21:33:43.076375 2578 flags.go:64] FLAG: --local-storage-capacity-isolation="true" Jun 02 21:33:43.081154 ip-10-0-138-193 kubenswrapper[2578]: I0602 21:33:43.076382 2578 flags.go:64] FLAG: --lock-file="" Jun 02 21:33:43.081154 ip-10-0-138-193 kubenswrapper[2578]: I0602 21:33:43.076385 2578 flags.go:64] FLAG: --log-cadvisor-usage="false" Jun 02 21:33:43.081154 ip-10-0-138-193 kubenswrapper[2578]: I0602 21:33:43.076388 2578 flags.go:64] FLAG: --log-flush-frequency="5s" Jun 02 21:33:43.081154 ip-10-0-138-193 kubenswrapper[2578]: I0602 21:33:43.076391 2578 flags.go:64] FLAG: --log-json-info-buffer-size="0" Jun 02 21:33:43.081154 ip-10-0-138-193 kubenswrapper[2578]: I0602 21:33:43.076396 2578 flags.go:64] FLAG: --log-json-split-stream="false" Jun 02 21:33:43.081154 ip-10-0-138-193 kubenswrapper[2578]: I0602 21:33:43.076399 2578 flags.go:64] FLAG: --log-text-info-buffer-size="0" Jun 02 21:33:43.081733 ip-10-0-138-193 kubenswrapper[2578]: I0602 21:33:43.076402 2578 flags.go:64] FLAG: --log-text-split-stream="false" Jun 02 21:33:43.081733 ip-10-0-138-193 kubenswrapper[2578]: I0602 21:33:43.076405 2578 flags.go:64] FLAG: --logging-format="text" Jun 02 21:33:43.081733 ip-10-0-138-193 kubenswrapper[2578]: I0602 21:33:43.076408 2578 flags.go:64] FLAG: --machine-id-file="/etc/machine-id,/var/lib/dbus/machine-id" Jun 02 21:33:43.081733 ip-10-0-138-193 kubenswrapper[2578]: I0602 21:33:43.076412 2578 flags.go:64] FLAG: --make-iptables-util-chains="true" Jun 02 21:33:43.081733 ip-10-0-138-193 kubenswrapper[2578]: I0602 21:33:43.076415 2578 flags.go:64] FLAG: --manifest-url="" Jun 02 21:33:43.081733 ip-10-0-138-193 kubenswrapper[2578]: I0602 21:33:43.076418 2578 flags.go:64] FLAG: --manifest-url-header="" Jun 02 21:33:43.081733 ip-10-0-138-193 kubenswrapper[2578]: I0602 21:33:43.076422 2578 flags.go:64] FLAG: --max-housekeeping-interval="15s" Jun 02 21:33:43.081733 ip-10-0-138-193 kubenswrapper[2578]: I0602 21:33:43.076425 2578 flags.go:64] FLAG: --max-open-files="1000000" Jun 02 21:33:43.081733 ip-10-0-138-193 kubenswrapper[2578]: I0602 21:33:43.076429 2578 flags.go:64] FLAG: --max-pods="110" Jun 02 21:33:43.081733 ip-10-0-138-193 kubenswrapper[2578]: I0602 21:33:43.076432 2578 flags.go:64] FLAG: --maximum-dead-containers="-1" Jun 02 21:33:43.081733 ip-10-0-138-193 kubenswrapper[2578]: I0602 21:33:43.076435 2578 flags.go:64] FLAG: --maximum-dead-containers-per-container="1" Jun 02 21:33:43.081733 ip-10-0-138-193 kubenswrapper[2578]: I0602 21:33:43.076438 2578 flags.go:64] FLAG: --memory-manager-policy="None" Jun 02 21:33:43.081733 ip-10-0-138-193 kubenswrapper[2578]: I0602 21:33:43.076441 2578 flags.go:64] FLAG: --minimum-container-ttl-duration="6m0s" Jun 02 21:33:43.081733 ip-10-0-138-193 kubenswrapper[2578]: I0602 21:33:43.076444 2578 flags.go:64] FLAG: --minimum-image-ttl-duration="2m0s" Jun 02 21:33:43.081733 ip-10-0-138-193 kubenswrapper[2578]: I0602 21:33:43.076447 2578 flags.go:64] FLAG: --node-ip="0.0.0.0" Jun 02 21:33:43.081733 ip-10-0-138-193 kubenswrapper[2578]: I0602 21:33:43.076450 2578 flags.go:64] FLAG: --node-labels="node-role.kubernetes.io/worker=,node.openshift.io/os_id=rhel" Jun 02 21:33:43.081733 ip-10-0-138-193 kubenswrapper[2578]: I0602 21:33:43.076457 2578 flags.go:64] FLAG: --node-status-max-images="50" Jun 02 21:33:43.081733 ip-10-0-138-193 kubenswrapper[2578]: I0602 21:33:43.076460 2578 flags.go:64] FLAG: --node-status-update-frequency="10s" Jun 02 21:33:43.081733 ip-10-0-138-193 kubenswrapper[2578]: I0602 21:33:43.076463 2578 flags.go:64] FLAG: --oom-score-adj="-999" Jun 02 21:33:43.081733 ip-10-0-138-193 kubenswrapper[2578]: I0602 21:33:43.076467 2578 flags.go:64] FLAG: --pod-cidr="" Jun 02 21:33:43.081733 ip-10-0-138-193 kubenswrapper[2578]: I0602 21:33:43.076470 2578 flags.go:64] FLAG: --pod-infra-container-image="quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:f1083dc6abd9805f79797fa11c9accacc4a38caa073c94cb99097faffce05983" Jun 02 21:33:43.081733 ip-10-0-138-193 kubenswrapper[2578]: I0602 21:33:43.076475 2578 flags.go:64] FLAG: --pod-manifest-path="" Jun 02 21:33:43.081733 ip-10-0-138-193 kubenswrapper[2578]: I0602 21:33:43.076478 2578 flags.go:64] FLAG: --pod-max-pids="-1" Jun 02 21:33:43.081733 ip-10-0-138-193 kubenswrapper[2578]: I0602 21:33:43.076482 2578 flags.go:64] FLAG: --pods-per-core="0" Jun 02 21:33:43.082334 ip-10-0-138-193 kubenswrapper[2578]: I0602 21:33:43.076485 2578 flags.go:64] FLAG: --port="10250" Jun 02 21:33:43.082334 ip-10-0-138-193 kubenswrapper[2578]: I0602 21:33:43.076489 2578 flags.go:64] FLAG: --protect-kernel-defaults="false" Jun 02 21:33:43.082334 ip-10-0-138-193 kubenswrapper[2578]: I0602 21:33:43.076492 2578 flags.go:64] FLAG: --provider-id="aws:///us-east-1a/i-09e45fe2798d73920" Jun 02 21:33:43.082334 ip-10-0-138-193 kubenswrapper[2578]: I0602 21:33:43.076497 2578 flags.go:64] FLAG: --qos-reserved="" Jun 02 21:33:43.082334 ip-10-0-138-193 kubenswrapper[2578]: I0602 21:33:43.076500 2578 flags.go:64] FLAG: --read-only-port="10255" Jun 02 21:33:43.082334 ip-10-0-138-193 kubenswrapper[2578]: I0602 21:33:43.076503 2578 flags.go:64] FLAG: --register-node="true" Jun 02 21:33:43.082334 ip-10-0-138-193 kubenswrapper[2578]: I0602 21:33:43.076506 2578 flags.go:64] FLAG: --register-schedulable="true" Jun 02 21:33:43.082334 ip-10-0-138-193 kubenswrapper[2578]: I0602 21:33:43.076509 2578 flags.go:64] FLAG: --register-with-taints="" Jun 02 21:33:43.082334 ip-10-0-138-193 kubenswrapper[2578]: I0602 21:33:43.076512 2578 flags.go:64] FLAG: --registry-burst="10" Jun 02 21:33:43.082334 ip-10-0-138-193 kubenswrapper[2578]: I0602 21:33:43.076515 2578 flags.go:64] FLAG: --registry-qps="5" Jun 02 21:33:43.082334 ip-10-0-138-193 kubenswrapper[2578]: I0602 21:33:43.076518 2578 flags.go:64] FLAG: --reserved-cpus="" Jun 02 21:33:43.082334 ip-10-0-138-193 kubenswrapper[2578]: I0602 21:33:43.076521 2578 flags.go:64] FLAG: --reserved-memory="" Jun 02 21:33:43.082334 ip-10-0-138-193 kubenswrapper[2578]: I0602 21:33:43.076525 2578 flags.go:64] FLAG: --resolv-conf="/etc/resolv.conf" Jun 02 21:33:43.082334 ip-10-0-138-193 kubenswrapper[2578]: I0602 21:33:43.076528 2578 flags.go:64] FLAG: --root-dir="/var/lib/kubelet" Jun 02 21:33:43.082334 ip-10-0-138-193 kubenswrapper[2578]: I0602 21:33:43.076531 2578 flags.go:64] FLAG: --rotate-certificates="false" Jun 02 21:33:43.082334 ip-10-0-138-193 kubenswrapper[2578]: I0602 21:33:43.076534 2578 flags.go:64] FLAG: --rotate-server-certificates="false" Jun 02 21:33:43.082334 ip-10-0-138-193 kubenswrapper[2578]: I0602 21:33:43.076537 2578 flags.go:64] FLAG: --runonce="false" Jun 02 21:33:43.082334 ip-10-0-138-193 kubenswrapper[2578]: I0602 21:33:43.076539 2578 flags.go:64] FLAG: --runtime-cgroups="/system.slice/crio.service" Jun 02 21:33:43.082334 ip-10-0-138-193 kubenswrapper[2578]: I0602 21:33:43.076542 2578 flags.go:64] FLAG: --runtime-request-timeout="2m0s" Jun 02 21:33:43.082334 ip-10-0-138-193 kubenswrapper[2578]: I0602 21:33:43.076545 2578 flags.go:64] FLAG: --seccomp-default="false" Jun 02 21:33:43.082334 ip-10-0-138-193 kubenswrapper[2578]: I0602 21:33:43.076548 2578 flags.go:64] FLAG: --serialize-image-pulls="true" Jun 02 21:33:43.082334 ip-10-0-138-193 kubenswrapper[2578]: I0602 21:33:43.076551 2578 flags.go:64] FLAG: --storage-driver-buffer-duration="1m0s" Jun 02 21:33:43.082334 ip-10-0-138-193 kubenswrapper[2578]: I0602 21:33:43.076554 2578 flags.go:64] FLAG: --storage-driver-db="cadvisor" Jun 02 21:33:43.082334 ip-10-0-138-193 kubenswrapper[2578]: I0602 21:33:43.076557 2578 flags.go:64] FLAG: --storage-driver-host="localhost:8086" Jun 02 21:33:43.082334 ip-10-0-138-193 kubenswrapper[2578]: I0602 21:33:43.076560 2578 flags.go:64] FLAG: --storage-driver-password="root" Jun 02 21:33:43.082334 ip-10-0-138-193 kubenswrapper[2578]: I0602 21:33:43.076562 2578 flags.go:64] FLAG: --storage-driver-secure="false" Jun 02 21:33:43.083002 ip-10-0-138-193 kubenswrapper[2578]: I0602 21:33:43.076565 2578 flags.go:64] FLAG: --storage-driver-table="stats" Jun 02 21:33:43.083002 ip-10-0-138-193 kubenswrapper[2578]: I0602 21:33:43.076568 2578 flags.go:64] FLAG: --storage-driver-user="root" Jun 02 21:33:43.083002 ip-10-0-138-193 kubenswrapper[2578]: I0602 21:33:43.076571 2578 flags.go:64] FLAG: --streaming-connection-idle-timeout="4h0m0s" Jun 02 21:33:43.083002 ip-10-0-138-193 kubenswrapper[2578]: I0602 21:33:43.076574 2578 flags.go:64] FLAG: --sync-frequency="1m0s" Jun 02 21:33:43.083002 ip-10-0-138-193 kubenswrapper[2578]: I0602 21:33:43.076577 2578 flags.go:64] FLAG: --system-cgroups="" Jun 02 21:33:43.083002 ip-10-0-138-193 kubenswrapper[2578]: I0602 21:33:43.076580 2578 flags.go:64] FLAG: --system-reserved="cpu=500m,ephemeral-storage=1Gi,memory=1Gi" Jun 02 21:33:43.083002 ip-10-0-138-193 kubenswrapper[2578]: I0602 21:33:43.076585 2578 flags.go:64] FLAG: --system-reserved-cgroup="" Jun 02 21:33:43.083002 ip-10-0-138-193 kubenswrapper[2578]: I0602 21:33:43.076589 2578 flags.go:64] FLAG: --tls-cert-file="" Jun 02 21:33:43.083002 ip-10-0-138-193 kubenswrapper[2578]: I0602 21:33:43.076592 2578 flags.go:64] FLAG: --tls-cipher-suites="[]" Jun 02 21:33:43.083002 ip-10-0-138-193 kubenswrapper[2578]: I0602 21:33:43.076598 2578 flags.go:64] FLAG: --tls-min-version="" Jun 02 21:33:43.083002 ip-10-0-138-193 kubenswrapper[2578]: I0602 21:33:43.076601 2578 flags.go:64] FLAG: --tls-private-key-file="" Jun 02 21:33:43.083002 ip-10-0-138-193 kubenswrapper[2578]: I0602 21:33:43.076603 2578 flags.go:64] FLAG: --topology-manager-policy="none" Jun 02 21:33:43.083002 ip-10-0-138-193 kubenswrapper[2578]: I0602 21:33:43.076606 2578 flags.go:64] FLAG: --topology-manager-policy-options="" Jun 02 21:33:43.083002 ip-10-0-138-193 kubenswrapper[2578]: I0602 21:33:43.076609 2578 flags.go:64] FLAG: --topology-manager-scope="container" Jun 02 21:33:43.083002 ip-10-0-138-193 kubenswrapper[2578]: I0602 21:33:43.076612 2578 flags.go:64] FLAG: --v="2" Jun 02 21:33:43.083002 ip-10-0-138-193 kubenswrapper[2578]: I0602 21:33:43.076617 2578 flags.go:64] FLAG: --version="false" Jun 02 21:33:43.083002 ip-10-0-138-193 kubenswrapper[2578]: I0602 21:33:43.076620 2578 flags.go:64] FLAG: --vmodule="" Jun 02 21:33:43.083002 ip-10-0-138-193 kubenswrapper[2578]: I0602 21:33:43.076624 2578 flags.go:64] FLAG: --volume-plugin-dir="/etc/kubernetes/kubelet-plugins/volume/exec" Jun 02 21:33:43.083002 ip-10-0-138-193 kubenswrapper[2578]: I0602 21:33:43.076628 2578 flags.go:64] FLAG: --volume-stats-agg-period="1m0s" Jun 02 21:33:43.083002 ip-10-0-138-193 kubenswrapper[2578]: W0602 21:33:43.076724 2578 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jun 02 21:33:43.083002 ip-10-0-138-193 kubenswrapper[2578]: W0602 21:33:43.076728 2578 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jun 02 21:33:43.083002 ip-10-0-138-193 kubenswrapper[2578]: W0602 21:33:43.076731 2578 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jun 02 21:33:43.083002 ip-10-0-138-193 kubenswrapper[2578]: W0602 21:33:43.076734 2578 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jun 02 21:33:43.083002 ip-10-0-138-193 kubenswrapper[2578]: W0602 21:33:43.076737 2578 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jun 02 21:33:43.083599 ip-10-0-138-193 kubenswrapper[2578]: W0602 21:33:43.076740 2578 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jun 02 21:33:43.083599 ip-10-0-138-193 kubenswrapper[2578]: W0602 21:33:43.076743 2578 feature_gate.go:328] unrecognized feature gate: OVNObservability Jun 02 21:33:43.083599 ip-10-0-138-193 kubenswrapper[2578]: W0602 21:33:43.076745 2578 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jun 02 21:33:43.083599 ip-10-0-138-193 kubenswrapper[2578]: W0602 21:33:43.076748 2578 feature_gate.go:328] unrecognized feature gate: SignatureStores Jun 02 21:33:43.083599 ip-10-0-138-193 kubenswrapper[2578]: W0602 21:33:43.076750 2578 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jun 02 21:33:43.083599 ip-10-0-138-193 kubenswrapper[2578]: W0602 21:33:43.076753 2578 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jun 02 21:33:43.083599 ip-10-0-138-193 kubenswrapper[2578]: W0602 21:33:43.076756 2578 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jun 02 21:33:43.083599 ip-10-0-138-193 kubenswrapper[2578]: W0602 21:33:43.076759 2578 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jun 02 21:33:43.083599 ip-10-0-138-193 kubenswrapper[2578]: W0602 21:33:43.076761 2578 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jun 02 21:33:43.083599 ip-10-0-138-193 kubenswrapper[2578]: W0602 21:33:43.076764 2578 feature_gate.go:328] unrecognized feature gate: PinnedImages Jun 02 21:33:43.083599 ip-10-0-138-193 kubenswrapper[2578]: W0602 21:33:43.076767 2578 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jun 02 21:33:43.083599 ip-10-0-138-193 kubenswrapper[2578]: W0602 21:33:43.076770 2578 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jun 02 21:33:43.083599 ip-10-0-138-193 kubenswrapper[2578]: W0602 21:33:43.076772 2578 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jun 02 21:33:43.083599 ip-10-0-138-193 kubenswrapper[2578]: W0602 21:33:43.076775 2578 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jun 02 21:33:43.083599 ip-10-0-138-193 kubenswrapper[2578]: W0602 21:33:43.076777 2578 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jun 02 21:33:43.083599 ip-10-0-138-193 kubenswrapper[2578]: W0602 21:33:43.076781 2578 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jun 02 21:33:43.083599 ip-10-0-138-193 kubenswrapper[2578]: W0602 21:33:43.076784 2578 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jun 02 21:33:43.083599 ip-10-0-138-193 kubenswrapper[2578]: W0602 21:33:43.076788 2578 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jun 02 21:33:43.083599 ip-10-0-138-193 kubenswrapper[2578]: W0602 21:33:43.076790 2578 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jun 02 21:33:43.083599 ip-10-0-138-193 kubenswrapper[2578]: W0602 21:33:43.076793 2578 feature_gate.go:328] unrecognized feature gate: SetEIPForNLBIngressController Jun 02 21:33:43.084165 ip-10-0-138-193 kubenswrapper[2578]: W0602 21:33:43.076796 2578 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jun 02 21:33:43.084165 ip-10-0-138-193 kubenswrapper[2578]: W0602 21:33:43.076798 2578 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jun 02 21:33:43.084165 ip-10-0-138-193 kubenswrapper[2578]: W0602 21:33:43.076801 2578 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jun 02 21:33:43.084165 ip-10-0-138-193 kubenswrapper[2578]: W0602 21:33:43.076803 2578 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jun 02 21:33:43.084165 ip-10-0-138-193 kubenswrapper[2578]: W0602 21:33:43.076806 2578 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jun 02 21:33:43.084165 ip-10-0-138-193 kubenswrapper[2578]: W0602 21:33:43.076809 2578 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jun 02 21:33:43.084165 ip-10-0-138-193 kubenswrapper[2578]: W0602 21:33:43.076811 2578 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jun 02 21:33:43.084165 ip-10-0-138-193 kubenswrapper[2578]: W0602 21:33:43.076814 2578 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jun 02 21:33:43.084165 ip-10-0-138-193 kubenswrapper[2578]: W0602 21:33:43.076817 2578 feature_gate.go:328] unrecognized feature gate: IngressControllerLBSubnetsAWS Jun 02 21:33:43.084165 ip-10-0-138-193 kubenswrapper[2578]: W0602 21:33:43.076819 2578 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jun 02 21:33:43.084165 ip-10-0-138-193 kubenswrapper[2578]: W0602 21:33:43.076822 2578 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jun 02 21:33:43.084165 ip-10-0-138-193 kubenswrapper[2578]: W0602 21:33:43.076824 2578 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jun 02 21:33:43.084165 ip-10-0-138-193 kubenswrapper[2578]: W0602 21:33:43.076827 2578 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jun 02 21:33:43.084165 ip-10-0-138-193 kubenswrapper[2578]: W0602 21:33:43.076829 2578 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jun 02 21:33:43.084165 ip-10-0-138-193 kubenswrapper[2578]: W0602 21:33:43.076832 2578 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jun 02 21:33:43.084165 ip-10-0-138-193 kubenswrapper[2578]: W0602 21:33:43.076834 2578 feature_gate.go:328] unrecognized feature gate: DualReplica Jun 02 21:33:43.084165 ip-10-0-138-193 kubenswrapper[2578]: W0602 21:33:43.076837 2578 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jun 02 21:33:43.084165 ip-10-0-138-193 kubenswrapper[2578]: W0602 21:33:43.076839 2578 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jun 02 21:33:43.084165 ip-10-0-138-193 kubenswrapper[2578]: W0602 21:33:43.076842 2578 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jun 02 21:33:43.084165 ip-10-0-138-193 kubenswrapper[2578]: W0602 21:33:43.076845 2578 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jun 02 21:33:43.084670 ip-10-0-138-193 kubenswrapper[2578]: W0602 21:33:43.076847 2578 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jun 02 21:33:43.084670 ip-10-0-138-193 kubenswrapper[2578]: W0602 21:33:43.076850 2578 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jun 02 21:33:43.084670 ip-10-0-138-193 kubenswrapper[2578]: W0602 21:33:43.076853 2578 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jun 02 21:33:43.084670 ip-10-0-138-193 kubenswrapper[2578]: W0602 21:33:43.076856 2578 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jun 02 21:33:43.084670 ip-10-0-138-193 kubenswrapper[2578]: W0602 21:33:43.076859 2578 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jun 02 21:33:43.084670 ip-10-0-138-193 kubenswrapper[2578]: W0602 21:33:43.076862 2578 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jun 02 21:33:43.084670 ip-10-0-138-193 kubenswrapper[2578]: W0602 21:33:43.076864 2578 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jun 02 21:33:43.084670 ip-10-0-138-193 kubenswrapper[2578]: W0602 21:33:43.076868 2578 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jun 02 21:33:43.084670 ip-10-0-138-193 kubenswrapper[2578]: W0602 21:33:43.076871 2578 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jun 02 21:33:43.084670 ip-10-0-138-193 kubenswrapper[2578]: W0602 21:33:43.076875 2578 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jun 02 21:33:43.084670 ip-10-0-138-193 kubenswrapper[2578]: W0602 21:33:43.076878 2578 feature_gate.go:328] unrecognized feature gate: NewOLM Jun 02 21:33:43.084670 ip-10-0-138-193 kubenswrapper[2578]: W0602 21:33:43.076880 2578 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterOperations Jun 02 21:33:43.084670 ip-10-0-138-193 kubenswrapper[2578]: W0602 21:33:43.076883 2578 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jun 02 21:33:43.084670 ip-10-0-138-193 kubenswrapper[2578]: W0602 21:33:43.076886 2578 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jun 02 21:33:43.084670 ip-10-0-138-193 kubenswrapper[2578]: W0602 21:33:43.076888 2578 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jun 02 21:33:43.084670 ip-10-0-138-193 kubenswrapper[2578]: W0602 21:33:43.076891 2578 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jun 02 21:33:43.084670 ip-10-0-138-193 kubenswrapper[2578]: W0602 21:33:43.076893 2578 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jun 02 21:33:43.084670 ip-10-0-138-193 kubenswrapper[2578]: W0602 21:33:43.076896 2578 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jun 02 21:33:43.084670 ip-10-0-138-193 kubenswrapper[2578]: W0602 21:33:43.076898 2578 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jun 02 21:33:43.085183 ip-10-0-138-193 kubenswrapper[2578]: W0602 21:33:43.076901 2578 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jun 02 21:33:43.085183 ip-10-0-138-193 kubenswrapper[2578]: W0602 21:33:43.076903 2578 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jun 02 21:33:43.085183 ip-10-0-138-193 kubenswrapper[2578]: W0602 21:33:43.076906 2578 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jun 02 21:33:43.085183 ip-10-0-138-193 kubenswrapper[2578]: W0602 21:33:43.076909 2578 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jun 02 21:33:43.085183 ip-10-0-138-193 kubenswrapper[2578]: W0602 21:33:43.076912 2578 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jun 02 21:33:43.085183 ip-10-0-138-193 kubenswrapper[2578]: W0602 21:33:43.076915 2578 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jun 02 21:33:43.085183 ip-10-0-138-193 kubenswrapper[2578]: W0602 21:33:43.076920 2578 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jun 02 21:33:43.085183 ip-10-0-138-193 kubenswrapper[2578]: W0602 21:33:43.076924 2578 feature_gate.go:328] unrecognized feature gate: Example Jun 02 21:33:43.085183 ip-10-0-138-193 kubenswrapper[2578]: W0602 21:33:43.076927 2578 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jun 02 21:33:43.085183 ip-10-0-138-193 kubenswrapper[2578]: W0602 21:33:43.076931 2578 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jun 02 21:33:43.085183 ip-10-0-138-193 kubenswrapper[2578]: W0602 21:33:43.076933 2578 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jun 02 21:33:43.085183 ip-10-0-138-193 kubenswrapper[2578]: W0602 21:33:43.076936 2578 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jun 02 21:33:43.085183 ip-10-0-138-193 kubenswrapper[2578]: W0602 21:33:43.076939 2578 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jun 02 21:33:43.085183 ip-10-0-138-193 kubenswrapper[2578]: W0602 21:33:43.076942 2578 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jun 02 21:33:43.085183 ip-10-0-138-193 kubenswrapper[2578]: W0602 21:33:43.076945 2578 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jun 02 21:33:43.085183 ip-10-0-138-193 kubenswrapper[2578]: W0602 21:33:43.076948 2578 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jun 02 21:33:43.085183 ip-10-0-138-193 kubenswrapper[2578]: W0602 21:33:43.076950 2578 feature_gate.go:328] unrecognized feature gate: InsightsConfigAPI Jun 02 21:33:43.085183 ip-10-0-138-193 kubenswrapper[2578]: W0602 21:33:43.076953 2578 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jun 02 21:33:43.085183 ip-10-0-138-193 kubenswrapper[2578]: W0602 21:33:43.076956 2578 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jun 02 21:33:43.085651 ip-10-0-138-193 kubenswrapper[2578]: W0602 21:33:43.076958 2578 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jun 02 21:33:43.085651 ip-10-0-138-193 kubenswrapper[2578]: W0602 21:33:43.076962 2578 feature_gate.go:328] unrecognized feature gate: Example2 Jun 02 21:33:43.085651 ip-10-0-138-193 kubenswrapper[2578]: W0602 21:33:43.076965 2578 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jun 02 21:33:43.085651 ip-10-0-138-193 kubenswrapper[2578]: I0602 21:33:43.077592 2578 feature_gate.go:384] feature gates: {map[DynamicResourceAllocation:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutatingAdmissionPolicy:false NodeSwap:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:false]} Jun 02 21:33:43.085651 ip-10-0-138-193 kubenswrapper[2578]: I0602 21:33:43.083814 2578 server.go:530] "Kubelet version" kubeletVersion="v1.33.12" Jun 02 21:33:43.085651 ip-10-0-138-193 kubenswrapper[2578]: I0602 21:33:43.083832 2578 server.go:532] "Golang settings" GOGC="" GOMAXPROCS="" GOTRACEBACK="" Jun 02 21:33:43.085651 ip-10-0-138-193 kubenswrapper[2578]: W0602 21:33:43.083882 2578 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jun 02 21:33:43.085651 ip-10-0-138-193 kubenswrapper[2578]: W0602 21:33:43.083887 2578 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jun 02 21:33:43.085651 ip-10-0-138-193 kubenswrapper[2578]: W0602 21:33:43.083890 2578 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jun 02 21:33:43.085651 ip-10-0-138-193 kubenswrapper[2578]: W0602 21:33:43.083894 2578 feature_gate.go:328] unrecognized feature gate: InsightsConfigAPI Jun 02 21:33:43.085651 ip-10-0-138-193 kubenswrapper[2578]: W0602 21:33:43.083897 2578 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jun 02 21:33:43.085651 ip-10-0-138-193 kubenswrapper[2578]: W0602 21:33:43.083901 2578 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jun 02 21:33:43.085651 ip-10-0-138-193 kubenswrapper[2578]: W0602 21:33:43.083903 2578 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jun 02 21:33:43.085651 ip-10-0-138-193 kubenswrapper[2578]: W0602 21:33:43.083906 2578 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jun 02 21:33:43.085651 ip-10-0-138-193 kubenswrapper[2578]: W0602 21:33:43.083910 2578 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jun 02 21:33:43.085651 ip-10-0-138-193 kubenswrapper[2578]: W0602 21:33:43.083913 2578 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jun 02 21:33:43.086058 ip-10-0-138-193 kubenswrapper[2578]: W0602 21:33:43.083917 2578 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jun 02 21:33:43.086058 ip-10-0-138-193 kubenswrapper[2578]: W0602 21:33:43.083920 2578 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jun 02 21:33:43.086058 ip-10-0-138-193 kubenswrapper[2578]: W0602 21:33:43.083923 2578 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jun 02 21:33:43.086058 ip-10-0-138-193 kubenswrapper[2578]: W0602 21:33:43.083926 2578 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jun 02 21:33:43.086058 ip-10-0-138-193 kubenswrapper[2578]: W0602 21:33:43.083929 2578 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jun 02 21:33:43.086058 ip-10-0-138-193 kubenswrapper[2578]: W0602 21:33:43.083931 2578 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jun 02 21:33:43.086058 ip-10-0-138-193 kubenswrapper[2578]: W0602 21:33:43.083934 2578 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jun 02 21:33:43.086058 ip-10-0-138-193 kubenswrapper[2578]: W0602 21:33:43.083936 2578 feature_gate.go:328] unrecognized feature gate: IngressControllerLBSubnetsAWS Jun 02 21:33:43.086058 ip-10-0-138-193 kubenswrapper[2578]: W0602 21:33:43.083940 2578 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jun 02 21:33:43.086058 ip-10-0-138-193 kubenswrapper[2578]: W0602 21:33:43.083942 2578 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jun 02 21:33:43.086058 ip-10-0-138-193 kubenswrapper[2578]: W0602 21:33:43.083945 2578 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jun 02 21:33:43.086058 ip-10-0-138-193 kubenswrapper[2578]: W0602 21:33:43.083948 2578 feature_gate.go:328] unrecognized feature gate: SignatureStores Jun 02 21:33:43.086058 ip-10-0-138-193 kubenswrapper[2578]: W0602 21:33:43.083950 2578 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jun 02 21:33:43.086058 ip-10-0-138-193 kubenswrapper[2578]: W0602 21:33:43.083953 2578 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jun 02 21:33:43.086058 ip-10-0-138-193 kubenswrapper[2578]: W0602 21:33:43.083956 2578 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jun 02 21:33:43.086058 ip-10-0-138-193 kubenswrapper[2578]: W0602 21:33:43.083959 2578 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jun 02 21:33:43.086058 ip-10-0-138-193 kubenswrapper[2578]: W0602 21:33:43.083962 2578 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jun 02 21:33:43.086058 ip-10-0-138-193 kubenswrapper[2578]: W0602 21:33:43.083965 2578 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jun 02 21:33:43.086058 ip-10-0-138-193 kubenswrapper[2578]: W0602 21:33:43.083967 2578 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jun 02 21:33:43.086058 ip-10-0-138-193 kubenswrapper[2578]: W0602 21:33:43.083970 2578 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jun 02 21:33:43.086593 ip-10-0-138-193 kubenswrapper[2578]: W0602 21:33:43.083973 2578 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jun 02 21:33:43.086593 ip-10-0-138-193 kubenswrapper[2578]: W0602 21:33:43.083976 2578 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jun 02 21:33:43.086593 ip-10-0-138-193 kubenswrapper[2578]: W0602 21:33:43.083979 2578 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jun 02 21:33:43.086593 ip-10-0-138-193 kubenswrapper[2578]: W0602 21:33:43.083981 2578 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jun 02 21:33:43.086593 ip-10-0-138-193 kubenswrapper[2578]: W0602 21:33:43.083984 2578 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jun 02 21:33:43.086593 ip-10-0-138-193 kubenswrapper[2578]: W0602 21:33:43.083986 2578 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jun 02 21:33:43.086593 ip-10-0-138-193 kubenswrapper[2578]: W0602 21:33:43.083989 2578 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jun 02 21:33:43.086593 ip-10-0-138-193 kubenswrapper[2578]: W0602 21:33:43.083992 2578 feature_gate.go:328] unrecognized feature gate: Example Jun 02 21:33:43.086593 ip-10-0-138-193 kubenswrapper[2578]: W0602 21:33:43.083995 2578 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jun 02 21:33:43.086593 ip-10-0-138-193 kubenswrapper[2578]: W0602 21:33:43.083997 2578 feature_gate.go:328] unrecognized feature gate: NewOLM Jun 02 21:33:43.086593 ip-10-0-138-193 kubenswrapper[2578]: W0602 21:33:43.084000 2578 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jun 02 21:33:43.086593 ip-10-0-138-193 kubenswrapper[2578]: W0602 21:33:43.084002 2578 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jun 02 21:33:43.086593 ip-10-0-138-193 kubenswrapper[2578]: W0602 21:33:43.084005 2578 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jun 02 21:33:43.086593 ip-10-0-138-193 kubenswrapper[2578]: W0602 21:33:43.084008 2578 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jun 02 21:33:43.086593 ip-10-0-138-193 kubenswrapper[2578]: W0602 21:33:43.084011 2578 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jun 02 21:33:43.086593 ip-10-0-138-193 kubenswrapper[2578]: W0602 21:33:43.084013 2578 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jun 02 21:33:43.086593 ip-10-0-138-193 kubenswrapper[2578]: W0602 21:33:43.084016 2578 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jun 02 21:33:43.086593 ip-10-0-138-193 kubenswrapper[2578]: W0602 21:33:43.084019 2578 feature_gate.go:328] unrecognized feature gate: Example2 Jun 02 21:33:43.086593 ip-10-0-138-193 kubenswrapper[2578]: W0602 21:33:43.084021 2578 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jun 02 21:33:43.086593 ip-10-0-138-193 kubenswrapper[2578]: W0602 21:33:43.084024 2578 feature_gate.go:328] unrecognized feature gate: OVNObservability Jun 02 21:33:43.087100 ip-10-0-138-193 kubenswrapper[2578]: W0602 21:33:43.084027 2578 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jun 02 21:33:43.087100 ip-10-0-138-193 kubenswrapper[2578]: W0602 21:33:43.084030 2578 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jun 02 21:33:43.087100 ip-10-0-138-193 kubenswrapper[2578]: W0602 21:33:43.084032 2578 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jun 02 21:33:43.087100 ip-10-0-138-193 kubenswrapper[2578]: W0602 21:33:43.084035 2578 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jun 02 21:33:43.087100 ip-10-0-138-193 kubenswrapper[2578]: W0602 21:33:43.084038 2578 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jun 02 21:33:43.087100 ip-10-0-138-193 kubenswrapper[2578]: W0602 21:33:43.084041 2578 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jun 02 21:33:43.087100 ip-10-0-138-193 kubenswrapper[2578]: W0602 21:33:43.084043 2578 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jun 02 21:33:43.087100 ip-10-0-138-193 kubenswrapper[2578]: W0602 21:33:43.084046 2578 feature_gate.go:328] unrecognized feature gate: PinnedImages Jun 02 21:33:43.087100 ip-10-0-138-193 kubenswrapper[2578]: W0602 21:33:43.084049 2578 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterOperations Jun 02 21:33:43.087100 ip-10-0-138-193 kubenswrapper[2578]: W0602 21:33:43.084051 2578 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jun 02 21:33:43.087100 ip-10-0-138-193 kubenswrapper[2578]: W0602 21:33:43.084054 2578 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jun 02 21:33:43.087100 ip-10-0-138-193 kubenswrapper[2578]: W0602 21:33:43.084057 2578 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jun 02 21:33:43.087100 ip-10-0-138-193 kubenswrapper[2578]: W0602 21:33:43.084059 2578 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jun 02 21:33:43.087100 ip-10-0-138-193 kubenswrapper[2578]: W0602 21:33:43.084063 2578 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jun 02 21:33:43.087100 ip-10-0-138-193 kubenswrapper[2578]: W0602 21:33:43.084065 2578 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jun 02 21:33:43.087100 ip-10-0-138-193 kubenswrapper[2578]: W0602 21:33:43.084068 2578 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jun 02 21:33:43.087100 ip-10-0-138-193 kubenswrapper[2578]: W0602 21:33:43.084087 2578 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jun 02 21:33:43.087100 ip-10-0-138-193 kubenswrapper[2578]: W0602 21:33:43.084092 2578 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jun 02 21:33:43.087100 ip-10-0-138-193 kubenswrapper[2578]: W0602 21:33:43.084094 2578 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jun 02 21:33:43.087100 ip-10-0-138-193 kubenswrapper[2578]: W0602 21:33:43.084097 2578 feature_gate.go:328] unrecognized feature gate: SetEIPForNLBIngressController Jun 02 21:33:43.087601 ip-10-0-138-193 kubenswrapper[2578]: W0602 21:33:43.084101 2578 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jun 02 21:33:43.087601 ip-10-0-138-193 kubenswrapper[2578]: W0602 21:33:43.084106 2578 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jun 02 21:33:43.087601 ip-10-0-138-193 kubenswrapper[2578]: W0602 21:33:43.084111 2578 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jun 02 21:33:43.087601 ip-10-0-138-193 kubenswrapper[2578]: W0602 21:33:43.084114 2578 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jun 02 21:33:43.087601 ip-10-0-138-193 kubenswrapper[2578]: W0602 21:33:43.084117 2578 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jun 02 21:33:43.087601 ip-10-0-138-193 kubenswrapper[2578]: W0602 21:33:43.084120 2578 feature_gate.go:328] unrecognized feature gate: DualReplica Jun 02 21:33:43.087601 ip-10-0-138-193 kubenswrapper[2578]: W0602 21:33:43.084123 2578 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jun 02 21:33:43.087601 ip-10-0-138-193 kubenswrapper[2578]: W0602 21:33:43.084125 2578 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jun 02 21:33:43.087601 ip-10-0-138-193 kubenswrapper[2578]: W0602 21:33:43.084128 2578 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jun 02 21:33:43.087601 ip-10-0-138-193 kubenswrapper[2578]: W0602 21:33:43.084131 2578 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jun 02 21:33:43.087601 ip-10-0-138-193 kubenswrapper[2578]: W0602 21:33:43.084133 2578 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jun 02 21:33:43.087601 ip-10-0-138-193 kubenswrapper[2578]: W0602 21:33:43.084136 2578 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jun 02 21:33:43.087601 ip-10-0-138-193 kubenswrapper[2578]: W0602 21:33:43.084139 2578 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jun 02 21:33:43.087601 ip-10-0-138-193 kubenswrapper[2578]: W0602 21:33:43.084141 2578 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jun 02 21:33:43.087601 ip-10-0-138-193 kubenswrapper[2578]: W0602 21:33:43.084144 2578 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jun 02 21:33:43.087601 ip-10-0-138-193 kubenswrapper[2578]: W0602 21:33:43.084146 2578 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jun 02 21:33:43.088005 ip-10-0-138-193 kubenswrapper[2578]: I0602 21:33:43.084152 2578 feature_gate.go:384] feature gates: {map[DynamicResourceAllocation:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutatingAdmissionPolicy:false NodeSwap:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:false]} Jun 02 21:33:43.088005 ip-10-0-138-193 kubenswrapper[2578]: W0602 21:33:43.084253 2578 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jun 02 21:33:43.088005 ip-10-0-138-193 kubenswrapper[2578]: W0602 21:33:43.084258 2578 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jun 02 21:33:43.088005 ip-10-0-138-193 kubenswrapper[2578]: W0602 21:33:43.084261 2578 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jun 02 21:33:43.088005 ip-10-0-138-193 kubenswrapper[2578]: W0602 21:33:43.084264 2578 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jun 02 21:33:43.088005 ip-10-0-138-193 kubenswrapper[2578]: W0602 21:33:43.084268 2578 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jun 02 21:33:43.088005 ip-10-0-138-193 kubenswrapper[2578]: W0602 21:33:43.084271 2578 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jun 02 21:33:43.088005 ip-10-0-138-193 kubenswrapper[2578]: W0602 21:33:43.084275 2578 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jun 02 21:33:43.088005 ip-10-0-138-193 kubenswrapper[2578]: W0602 21:33:43.084277 2578 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jun 02 21:33:43.088005 ip-10-0-138-193 kubenswrapper[2578]: W0602 21:33:43.084281 2578 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jun 02 21:33:43.088005 ip-10-0-138-193 kubenswrapper[2578]: W0602 21:33:43.084284 2578 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jun 02 21:33:43.088005 ip-10-0-138-193 kubenswrapper[2578]: W0602 21:33:43.084287 2578 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jun 02 21:33:43.088005 ip-10-0-138-193 kubenswrapper[2578]: W0602 21:33:43.084290 2578 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jun 02 21:33:43.088005 ip-10-0-138-193 kubenswrapper[2578]: W0602 21:33:43.084292 2578 feature_gate.go:328] unrecognized feature gate: OVNObservability Jun 02 21:33:43.088005 ip-10-0-138-193 kubenswrapper[2578]: W0602 21:33:43.084295 2578 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jun 02 21:33:43.088005 ip-10-0-138-193 kubenswrapper[2578]: W0602 21:33:43.084297 2578 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jun 02 21:33:43.088474 ip-10-0-138-193 kubenswrapper[2578]: W0602 21:33:43.084300 2578 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jun 02 21:33:43.088474 ip-10-0-138-193 kubenswrapper[2578]: W0602 21:33:43.084302 2578 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jun 02 21:33:43.088474 ip-10-0-138-193 kubenswrapper[2578]: W0602 21:33:43.084305 2578 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jun 02 21:33:43.088474 ip-10-0-138-193 kubenswrapper[2578]: W0602 21:33:43.084308 2578 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jun 02 21:33:43.088474 ip-10-0-138-193 kubenswrapper[2578]: W0602 21:33:43.084310 2578 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jun 02 21:33:43.088474 ip-10-0-138-193 kubenswrapper[2578]: W0602 21:33:43.084313 2578 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jun 02 21:33:43.088474 ip-10-0-138-193 kubenswrapper[2578]: W0602 21:33:43.084315 2578 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jun 02 21:33:43.088474 ip-10-0-138-193 kubenswrapper[2578]: W0602 21:33:43.084318 2578 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jun 02 21:33:43.088474 ip-10-0-138-193 kubenswrapper[2578]: W0602 21:33:43.084321 2578 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jun 02 21:33:43.088474 ip-10-0-138-193 kubenswrapper[2578]: W0602 21:33:43.084323 2578 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jun 02 21:33:43.088474 ip-10-0-138-193 kubenswrapper[2578]: W0602 21:33:43.084326 2578 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jun 02 21:33:43.088474 ip-10-0-138-193 kubenswrapper[2578]: W0602 21:33:43.084328 2578 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jun 02 21:33:43.088474 ip-10-0-138-193 kubenswrapper[2578]: W0602 21:33:43.084331 2578 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jun 02 21:33:43.088474 ip-10-0-138-193 kubenswrapper[2578]: W0602 21:33:43.084334 2578 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jun 02 21:33:43.088474 ip-10-0-138-193 kubenswrapper[2578]: W0602 21:33:43.084336 2578 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jun 02 21:33:43.088474 ip-10-0-138-193 kubenswrapper[2578]: W0602 21:33:43.084338 2578 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jun 02 21:33:43.088474 ip-10-0-138-193 kubenswrapper[2578]: W0602 21:33:43.084341 2578 feature_gate.go:328] unrecognized feature gate: Example2 Jun 02 21:33:43.088474 ip-10-0-138-193 kubenswrapper[2578]: W0602 21:33:43.084343 2578 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jun 02 21:33:43.088474 ip-10-0-138-193 kubenswrapper[2578]: W0602 21:33:43.084346 2578 feature_gate.go:328] unrecognized feature gate: InsightsConfigAPI Jun 02 21:33:43.088474 ip-10-0-138-193 kubenswrapper[2578]: W0602 21:33:43.084348 2578 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jun 02 21:33:43.088967 ip-10-0-138-193 kubenswrapper[2578]: W0602 21:33:43.084351 2578 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jun 02 21:33:43.088967 ip-10-0-138-193 kubenswrapper[2578]: W0602 21:33:43.084354 2578 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jun 02 21:33:43.088967 ip-10-0-138-193 kubenswrapper[2578]: W0602 21:33:43.084357 2578 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jun 02 21:33:43.088967 ip-10-0-138-193 kubenswrapper[2578]: W0602 21:33:43.084360 2578 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jun 02 21:33:43.088967 ip-10-0-138-193 kubenswrapper[2578]: W0602 21:33:43.084363 2578 feature_gate.go:328] unrecognized feature gate: DualReplica Jun 02 21:33:43.088967 ip-10-0-138-193 kubenswrapper[2578]: W0602 21:33:43.084366 2578 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jun 02 21:33:43.088967 ip-10-0-138-193 kubenswrapper[2578]: W0602 21:33:43.084369 2578 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jun 02 21:33:43.088967 ip-10-0-138-193 kubenswrapper[2578]: W0602 21:33:43.084371 2578 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jun 02 21:33:43.088967 ip-10-0-138-193 kubenswrapper[2578]: W0602 21:33:43.084374 2578 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jun 02 21:33:43.088967 ip-10-0-138-193 kubenswrapper[2578]: W0602 21:33:43.084376 2578 feature_gate.go:328] unrecognized feature gate: PinnedImages Jun 02 21:33:43.088967 ip-10-0-138-193 kubenswrapper[2578]: W0602 21:33:43.084379 2578 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jun 02 21:33:43.088967 ip-10-0-138-193 kubenswrapper[2578]: W0602 21:33:43.084381 2578 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jun 02 21:33:43.088967 ip-10-0-138-193 kubenswrapper[2578]: W0602 21:33:43.084384 2578 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jun 02 21:33:43.088967 ip-10-0-138-193 kubenswrapper[2578]: W0602 21:33:43.084386 2578 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jun 02 21:33:43.088967 ip-10-0-138-193 kubenswrapper[2578]: W0602 21:33:43.084389 2578 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jun 02 21:33:43.088967 ip-10-0-138-193 kubenswrapper[2578]: W0602 21:33:43.084391 2578 feature_gate.go:328] unrecognized feature gate: NewOLM Jun 02 21:33:43.088967 ip-10-0-138-193 kubenswrapper[2578]: W0602 21:33:43.084394 2578 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jun 02 21:33:43.088967 ip-10-0-138-193 kubenswrapper[2578]: W0602 21:33:43.084397 2578 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jun 02 21:33:43.088967 ip-10-0-138-193 kubenswrapper[2578]: W0602 21:33:43.084399 2578 feature_gate.go:328] unrecognized feature gate: Example Jun 02 21:33:43.088967 ip-10-0-138-193 kubenswrapper[2578]: W0602 21:33:43.084402 2578 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jun 02 21:33:43.089477 ip-10-0-138-193 kubenswrapper[2578]: W0602 21:33:43.084404 2578 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jun 02 21:33:43.089477 ip-10-0-138-193 kubenswrapper[2578]: W0602 21:33:43.084407 2578 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jun 02 21:33:43.089477 ip-10-0-138-193 kubenswrapper[2578]: W0602 21:33:43.084409 2578 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jun 02 21:33:43.089477 ip-10-0-138-193 kubenswrapper[2578]: W0602 21:33:43.084412 2578 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jun 02 21:33:43.089477 ip-10-0-138-193 kubenswrapper[2578]: W0602 21:33:43.084414 2578 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jun 02 21:33:43.089477 ip-10-0-138-193 kubenswrapper[2578]: W0602 21:33:43.084417 2578 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jun 02 21:33:43.089477 ip-10-0-138-193 kubenswrapper[2578]: W0602 21:33:43.084419 2578 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jun 02 21:33:43.089477 ip-10-0-138-193 kubenswrapper[2578]: W0602 21:33:43.084422 2578 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jun 02 21:33:43.089477 ip-10-0-138-193 kubenswrapper[2578]: W0602 21:33:43.084424 2578 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jun 02 21:33:43.089477 ip-10-0-138-193 kubenswrapper[2578]: W0602 21:33:43.084427 2578 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jun 02 21:33:43.089477 ip-10-0-138-193 kubenswrapper[2578]: W0602 21:33:43.084429 2578 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jun 02 21:33:43.089477 ip-10-0-138-193 kubenswrapper[2578]: W0602 21:33:43.084432 2578 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jun 02 21:33:43.089477 ip-10-0-138-193 kubenswrapper[2578]: W0602 21:33:43.084434 2578 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jun 02 21:33:43.089477 ip-10-0-138-193 kubenswrapper[2578]: W0602 21:33:43.084437 2578 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jun 02 21:33:43.089477 ip-10-0-138-193 kubenswrapper[2578]: W0602 21:33:43.084439 2578 feature_gate.go:328] unrecognized feature gate: IngressControllerLBSubnetsAWS Jun 02 21:33:43.089477 ip-10-0-138-193 kubenswrapper[2578]: W0602 21:33:43.084443 2578 feature_gate.go:328] unrecognized feature gate: SetEIPForNLBIngressController Jun 02 21:33:43.089477 ip-10-0-138-193 kubenswrapper[2578]: W0602 21:33:43.084445 2578 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jun 02 21:33:43.089477 ip-10-0-138-193 kubenswrapper[2578]: W0602 21:33:43.084448 2578 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jun 02 21:33:43.089477 ip-10-0-138-193 kubenswrapper[2578]: W0602 21:33:43.084452 2578 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jun 02 21:33:43.089938 ip-10-0-138-193 kubenswrapper[2578]: W0602 21:33:43.084455 2578 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jun 02 21:33:43.089938 ip-10-0-138-193 kubenswrapper[2578]: W0602 21:33:43.084458 2578 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterOperations Jun 02 21:33:43.089938 ip-10-0-138-193 kubenswrapper[2578]: W0602 21:33:43.084462 2578 feature_gate.go:328] unrecognized feature gate: SignatureStores Jun 02 21:33:43.089938 ip-10-0-138-193 kubenswrapper[2578]: W0602 21:33:43.084464 2578 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jun 02 21:33:43.089938 ip-10-0-138-193 kubenswrapper[2578]: W0602 21:33:43.084467 2578 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jun 02 21:33:43.089938 ip-10-0-138-193 kubenswrapper[2578]: W0602 21:33:43.084470 2578 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jun 02 21:33:43.089938 ip-10-0-138-193 kubenswrapper[2578]: W0602 21:33:43.084473 2578 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jun 02 21:33:43.089938 ip-10-0-138-193 kubenswrapper[2578]: W0602 21:33:43.084475 2578 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jun 02 21:33:43.089938 ip-10-0-138-193 kubenswrapper[2578]: W0602 21:33:43.084478 2578 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jun 02 21:33:43.089938 ip-10-0-138-193 kubenswrapper[2578]: W0602 21:33:43.084480 2578 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jun 02 21:33:43.089938 ip-10-0-138-193 kubenswrapper[2578]: W0602 21:33:43.084484 2578 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jun 02 21:33:43.089938 ip-10-0-138-193 kubenswrapper[2578]: W0602 21:33:43.084487 2578 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jun 02 21:33:43.089938 ip-10-0-138-193 kubenswrapper[2578]: I0602 21:33:43.084493 2578 feature_gate.go:384] feature gates: {map[DynamicResourceAllocation:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutatingAdmissionPolicy:false NodeSwap:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:false]} Jun 02 21:33:43.089938 ip-10-0-138-193 kubenswrapper[2578]: I0602 21:33:43.085119 2578 server.go:962] "Client rotation is on, will bootstrap in background" Jun 02 21:33:43.090304 ip-10-0-138-193 kubenswrapper[2578]: I0602 21:33:43.088434 2578 bootstrap.go:101] "Use the bootstrap credentials to request a cert, and set kubeconfig to point to the certificate dir" Jun 02 21:33:43.090304 ip-10-0-138-193 kubenswrapper[2578]: I0602 21:33:43.089672 2578 server.go:1019] "Starting client certificate rotation" Jun 02 21:33:43.090304 ip-10-0-138-193 kubenswrapper[2578]: I0602 21:33:43.089770 2578 certificate_manager.go:422] "Certificate rotation is enabled" logger="kubernetes.io/kube-apiserver-client-kubelet" Jun 02 21:33:43.090304 ip-10-0-138-193 kubenswrapper[2578]: I0602 21:33:43.089808 2578 certificate_manager.go:566] "Rotating certificates" logger="kubernetes.io/kube-apiserver-client-kubelet" Jun 02 21:33:43.113896 ip-10-0-138-193 kubenswrapper[2578]: I0602 21:33:43.113877 2578 dynamic_cafile_content.go:123] "Loaded a new CA Bundle and Verifier" name="client-ca-bundle::/etc/kubernetes/kubelet-ca.crt" Jun 02 21:33:43.115596 ip-10-0-138-193 kubenswrapper[2578]: I0602 21:33:43.115577 2578 dynamic_cafile_content.go:161] "Starting controller" name="client-ca-bundle::/etc/kubernetes/kubelet-ca.crt" Jun 02 21:33:43.128532 ip-10-0-138-193 kubenswrapper[2578]: I0602 21:33:43.128510 2578 log.go:25] "Validated CRI v1 runtime API" Jun 02 21:33:43.134887 ip-10-0-138-193 kubenswrapper[2578]: I0602 21:33:43.134871 2578 log.go:25] "Validated CRI v1 image API" Jun 02 21:33:43.136230 ip-10-0-138-193 kubenswrapper[2578]: I0602 21:33:43.136215 2578 server.go:1452] "Using cgroup driver setting received from the CRI runtime" cgroupDriver="systemd" Jun 02 21:33:43.139998 ip-10-0-138-193 kubenswrapper[2578]: I0602 21:33:43.139977 2578 fs.go:135] Filesystem UUIDs: map[506526a5-2a73-449d-b4f4-5f9fb0f2f062:/dev/nvme0n1p3 7B77-95E7:/dev/nvme0n1p2 90e5398b-c37a-4365-8db0-64d10d8e7ecf:/dev/nvme0n1p4] Jun 02 21:33:43.140069 ip-10-0-138-193 kubenswrapper[2578]: I0602 21:33:43.139995 2578 fs.go:136] Filesystem partitions: map[/dev/nvme0n1p3:{mountpoint:/boot major:259 minor:3 fsType:ext4 blockSize:0} /dev/nvme0n1p4:{mountpoint:/var major:259 minor:4 fsType:xfs blockSize:0} /dev/shm:{mountpoint:/dev/shm major:0 minor:22 fsType:tmpfs blockSize:0} /run:{mountpoint:/run major:0 minor:24 fsType:tmpfs blockSize:0} /tmp:{mountpoint:/tmp major:0 minor:31 fsType:tmpfs blockSize:0} composefs_0-33:{mountpoint:/ major:0 minor:33 fsType:overlay blockSize:0}] Jun 02 21:33:43.144271 ip-10-0-138-193 kubenswrapper[2578]: I0602 21:33:43.144161 2578 manager.go:217] Machine: {Timestamp:2026-06-02 21:33:43.143654769 +0000 UTC m=+0.395552666 CPUVendorID:GenuineIntel NumCores:8 NumPhysicalCores:4 NumSockets:1 CpuFrequency:3099086 MemoryCapacity:33164500992 SwapCapacity:0 MemoryByType:map[] NVMInfo:{MemoryModeCapacity:0 AppDirectModeCapacity:0 AvgPowerBudget:0} HugePages:[{PageSize:1048576 NumPages:0} {PageSize:2048 NumPages:0}] MachineID:ec2d8924cd1141f0a5a96820433c2525 SystemUUID:ec2d8924-cd11-41f0-a5a9-6820433c2525 BootID:8a95114b-51f2-49e6-8691-6420a2f74bf9 Filesystems:[{Device:/run DeviceMajor:0 DeviceMinor:24 Capacity:6632902656 Type:vfs Inodes:819200 HasInodes:true} {Device:/dev/nvme0n1p4 DeviceMajor:259 DeviceMinor:4 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:composefs_0-33 DeviceMajor:0 DeviceMinor:33 Capacity:6103040 Type:vfs Inodes:18446744073709551615 HasInodes:true} {Device:/tmp DeviceMajor:0 DeviceMinor:31 Capacity:16582250496 Type:vfs Inodes:1048576 HasInodes:true} {Device:/dev/nvme0n1p3 DeviceMajor:259 DeviceMinor:3 Capacity:366869504 Type:vfs Inodes:98304 HasInodes:true} {Device:/dev/shm DeviceMajor:0 DeviceMinor:22 Capacity:16582250496 Type:vfs Inodes:4048401 HasInodes:true}] DiskMap:map[259:0:{Name:nvme0n1 Major:259 Minor:0 Size:128849018880 Scheduler:none}] NetworkDevices:[{Name:br-ex MacAddress:02:c6:c9:af:cb:a3 Speed:0 Mtu:9001} {Name:ens5 MacAddress:02:c6:c9:af:cb:a3 Speed:0 Mtu:9001} {Name:ovs-system MacAddress:0e:9e:8b:36:37:62 Speed:0 Mtu:1500}] Topology:[{Id:0 Memory:33164500992 HugePages:[{PageSize:1048576 NumPages:0} {PageSize:2048 NumPages:0}] Cores:[{Id:0 Threads:[0 4] Caches:[{Id:0 Size:32768 Type:Data Level:1} {Id:0 Size:32768 Type:Instruction Level:1} {Id:0 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:1 Threads:[1 5] Caches:[{Id:1 Size:32768 Type:Data Level:1} {Id:1 Size:32768 Type:Instruction Level:1} {Id:1 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:2 Threads:[2 6] Caches:[{Id:2 Size:32768 Type:Data Level:1} {Id:2 Size:32768 Type:Instruction Level:1} {Id:2 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:3 Threads:[3 7] Caches:[{Id:3 Size:32768 Type:Data Level:1} {Id:3 Size:32768 Type:Instruction Level:1} {Id:3 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:}] Caches:[{Id:0 Size:37486592 Type:Unified Level:3}] Distances:[10]}] CloudProvider:Unknown InstanceType:Unknown InstanceID:None} Jun 02 21:33:43.144872 ip-10-0-138-193 kubenswrapper[2578]: I0602 21:33:43.144862 2578 manager_no_libpfm.go:29] cAdvisor is build without cgo and/or libpfm support. Perf event counters are not available. Jun 02 21:33:43.144956 ip-10-0-138-193 kubenswrapper[2578]: I0602 21:33:43.144944 2578 manager.go:233] Version: {KernelVersion:5.14.0-570.117.1.el9_6.x86_64 ContainerOsVersion:Red Hat Enterprise Linux CoreOS 9.6.20260521-1 (Plow) DockerVersion: DockerAPIVersion: CadvisorVersion: CadvisorRevision:} Jun 02 21:33:43.146688 ip-10-0-138-193 kubenswrapper[2578]: I0602 21:33:43.146664 2578 container_manager_linux.go:270] "Container manager verified user specified cgroup-root exists" cgroupRoot=[] Jun 02 21:33:43.146831 ip-10-0-138-193 kubenswrapper[2578]: I0602 21:33:43.146690 2578 container_manager_linux.go:275] "Creating Container Manager object based on Node Config" nodeConfig={"NodeName":"ip-10-0-138-193.ec2.internal","RuntimeCgroupsName":"/system.slice/crio.service","SystemCgroupsName":"/system.slice","KubeletCgroupsName":"","KubeletOOMScoreAdj":-999,"ContainerRuntime":"","CgroupsPerQOS":true,"CgroupRoot":"/","CgroupDriver":"systemd","KubeletRootDir":"/var/lib/kubelet","ProtectKernelDefaults":true,"KubeReservedCgroupName":"","SystemReservedCgroupName":"","ReservedSystemCPUs":{},"EnforceNodeAllocatable":{"pods":{}},"KubeReserved":null,"SystemReserved":{"cpu":"500m","ephemeral-storage":"1Gi","memory":"1Gi"},"HardEvictionThresholds":[{"Signal":"imagefs.inodesFree","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.05},"GracePeriod":0,"MinReclaim":null},{"Signal":"memory.available","Operator":"LessThan","Value":{"Quantity":"100Mi","Percentage":0},"GracePeriod":0,"MinReclaim":null},{"Signal":"nodefs.available","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.1},"GracePeriod":0,"MinReclaim":null},{"Signal":"nodefs.inodesFree","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.05},"GracePeriod":0,"MinReclaim":null},{"Signal":"imagefs.available","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.15},"GracePeriod":0,"MinReclaim":null}],"QOSReserved":{},"CPUManagerPolicy":"none","CPUManagerPolicyOptions":null,"TopologyManagerScope":"container","CPUManagerReconcilePeriod":10000000000,"MemoryManagerPolicy":"None","MemoryManagerReservedMemory":null,"PodPidsLimit":4096,"EnforceCPULimits":true,"CPUCFSQuotaPeriod":100000000,"TopologyManagerPolicy":"none","TopologyManagerPolicyOptions":null,"CgroupVersion":2} Jun 02 21:33:43.146877 ip-10-0-138-193 kubenswrapper[2578]: I0602 21:33:43.146840 2578 topology_manager.go:138] "Creating topology manager with none policy" Jun 02 21:33:43.146877 ip-10-0-138-193 kubenswrapper[2578]: I0602 21:33:43.146849 2578 container_manager_linux.go:306] "Creating device plugin manager" Jun 02 21:33:43.146877 ip-10-0-138-193 kubenswrapper[2578]: I0602 21:33:43.146857 2578 manager.go:141] "Creating Device Plugin manager" path="/var/lib/kubelet/device-plugins/kubelet.sock" Jun 02 21:33:43.147586 ip-10-0-138-193 kubenswrapper[2578]: I0602 21:33:43.147576 2578 server.go:72] "Creating device plugin registration server" version="v1beta1" socket="/var/lib/kubelet/device-plugins/kubelet.sock" Jun 02 21:33:43.148816 ip-10-0-138-193 kubenswrapper[2578]: I0602 21:33:43.148801 2578 state_mem.go:36] "Initialized new in-memory state store" Jun 02 21:33:43.148921 ip-10-0-138-193 kubenswrapper[2578]: I0602 21:33:43.148912 2578 server.go:1267] "Using root directory" path="/var/lib/kubelet" Jun 02 21:33:43.152144 ip-10-0-138-193 kubenswrapper[2578]: I0602 21:33:43.152134 2578 kubelet.go:491] "Attempting to sync node with API server" Jun 02 21:33:43.152204 ip-10-0-138-193 kubenswrapper[2578]: I0602 21:33:43.152148 2578 kubelet.go:386] "Adding static pod path" path="/etc/kubernetes/manifests" Jun 02 21:33:43.152204 ip-10-0-138-193 kubenswrapper[2578]: I0602 21:33:43.152161 2578 file.go:69] "Watching path" path="/etc/kubernetes/manifests" Jun 02 21:33:43.152204 ip-10-0-138-193 kubenswrapper[2578]: I0602 21:33:43.152171 2578 kubelet.go:397] "Adding apiserver pod source" Jun 02 21:33:43.152204 ip-10-0-138-193 kubenswrapper[2578]: I0602 21:33:43.152179 2578 apiserver.go:42] "Waiting for node sync before watching apiserver pods" Jun 02 21:33:43.153245 ip-10-0-138-193 kubenswrapper[2578]: I0602 21:33:43.153234 2578 state_mem.go:40] "Initialized new in-memory state store for pod resource information tracking" Jun 02 21:33:43.153279 ip-10-0-138-193 kubenswrapper[2578]: I0602 21:33:43.153253 2578 state_mem.go:40] "Initialized new in-memory state store for pod resource information tracking" Jun 02 21:33:43.154121 ip-10-0-138-193 kubenswrapper[2578]: I0602 21:33:43.154103 2578 reflector.go:430] "Caches populated" logger="kubernetes.io/kube-apiserver-client-kubelet" type="*v1.CertificateSigningRequest" reflector="k8s.io/client-go/tools/watch/informerwatcher.go:162" Jun 02 21:33:43.156238 ip-10-0-138-193 kubenswrapper[2578]: I0602 21:33:43.156218 2578 kuberuntime_manager.go:279] "Container runtime initialized" containerRuntime="cri-o" version="1.33.12-3.rhaos4.20.git64c6a00.el9" apiVersion="v1" Jun 02 21:33:43.157895 ip-10-0-138-193 kubenswrapper[2578]: I0602 21:33:43.157881 2578 kubelet.go:953] "Not starting ClusterTrustBundle informer because we are in static kubelet mode or the ClusterTrustBundleProjection featuregate is disabled" Jun 02 21:33:43.159481 ip-10-0-138-193 kubenswrapper[2578]: I0602 21:33:43.159470 2578 plugins.go:616] "Loaded volume plugin" pluginName="kubernetes.io/portworx-volume" Jun 02 21:33:43.159520 ip-10-0-138-193 kubenswrapper[2578]: I0602 21:33:43.159486 2578 plugins.go:616] "Loaded volume plugin" pluginName="kubernetes.io/empty-dir" Jun 02 21:33:43.159520 ip-10-0-138-193 kubenswrapper[2578]: I0602 21:33:43.159492 2578 plugins.go:616] "Loaded volume plugin" pluginName="kubernetes.io/git-repo" Jun 02 21:33:43.159520 ip-10-0-138-193 kubenswrapper[2578]: I0602 21:33:43.159497 2578 plugins.go:616] "Loaded volume plugin" pluginName="kubernetes.io/host-path" Jun 02 21:33:43.159520 ip-10-0-138-193 kubenswrapper[2578]: I0602 21:33:43.159506 2578 plugins.go:616] "Loaded volume plugin" pluginName="kubernetes.io/nfs" Jun 02 21:33:43.159520 ip-10-0-138-193 kubenswrapper[2578]: I0602 21:33:43.159512 2578 plugins.go:616] "Loaded volume plugin" pluginName="kubernetes.io/secret" Jun 02 21:33:43.159520 ip-10-0-138-193 kubenswrapper[2578]: I0602 21:33:43.159517 2578 plugins.go:616] "Loaded volume plugin" pluginName="kubernetes.io/iscsi" Jun 02 21:33:43.159681 ip-10-0-138-193 kubenswrapper[2578]: I0602 21:33:43.159524 2578 plugins.go:616] "Loaded volume plugin" pluginName="kubernetes.io/downward-api" Jun 02 21:33:43.159681 ip-10-0-138-193 kubenswrapper[2578]: I0602 21:33:43.159534 2578 plugins.go:616] "Loaded volume plugin" pluginName="kubernetes.io/fc" Jun 02 21:33:43.159681 ip-10-0-138-193 kubenswrapper[2578]: I0602 21:33:43.159542 2578 plugins.go:616] "Loaded volume plugin" pluginName="kubernetes.io/configmap" Jun 02 21:33:43.159681 ip-10-0-138-193 kubenswrapper[2578]: I0602 21:33:43.159553 2578 plugins.go:616] "Loaded volume plugin" pluginName="kubernetes.io/projected" Jun 02 21:33:43.159681 ip-10-0-138-193 kubenswrapper[2578]: I0602 21:33:43.159561 2578 plugins.go:616] "Loaded volume plugin" pluginName="kubernetes.io/local-volume" Jun 02 21:33:43.160403 ip-10-0-138-193 kubenswrapper[2578]: I0602 21:33:43.160389 2578 plugins.go:616] "Loaded volume plugin" pluginName="kubernetes.io/csi" Jun 02 21:33:43.160470 ip-10-0-138-193 kubenswrapper[2578]: I0602 21:33:43.160421 2578 plugins.go:616] "Loaded volume plugin" pluginName="kubernetes.io/image" Jun 02 21:33:43.163561 ip-10-0-138-193 kubenswrapper[2578]: I0602 21:33:43.163548 2578 watchdog_linux.go:99] "Systemd watchdog is not enabled" Jun 02 21:33:43.163709 ip-10-0-138-193 kubenswrapper[2578]: I0602 21:33:43.163698 2578 server.go:1295] "Started kubelet" Jun 02 21:33:43.163844 ip-10-0-138-193 kubenswrapper[2578]: I0602 21:33:43.163810 2578 ratelimit.go:55] "Setting rate limiting for endpoint" service="podresources" qps=100 burstTokens=10 Jun 02 21:33:43.164580 ip-10-0-138-193 kubenswrapper[2578]: I0602 21:33:43.164548 2578 server_v1.go:47] "podresources" method="list" useActivePods=true Jun 02 21:33:43.164711 ip-10-0-138-193 kubenswrapper[2578]: I0602 21:33:43.164629 2578 server.go:180] "Starting to listen" address="0.0.0.0" port=10250 Jun 02 21:33:43.165700 ip-10-0-138-193 kubenswrapper[2578]: I0602 21:33:43.165686 2578 server.go:255] "Starting to serve the podresources API" endpoint="unix:/var/lib/kubelet/pod-resources/kubelet.sock" Jun 02 21:33:43.166764 ip-10-0-138-193 systemd[1]: Started Kubernetes Kubelet. Jun 02 21:33:43.168686 ip-10-0-138-193 kubenswrapper[2578]: E0602 21:33:43.168656 2578 reflector.go:200] "Failed to watch" err="failed to list *v1.Service: services is forbidden: User \"system:anonymous\" cannot list resource \"services\" in API group \"\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Service" Jun 02 21:33:43.168777 ip-10-0-138-193 kubenswrapper[2578]: I0602 21:33:43.168654 2578 csi_plugin.go:988] Failed to contact API server when waiting for CSINode publishing: csinodes.storage.k8s.io "ip-10-0-138-193.ec2.internal" is forbidden: User "system:anonymous" cannot get resource "csinodes" in API group "storage.k8s.io" at the cluster scope Jun 02 21:33:43.169252 ip-10-0-138-193 kubenswrapper[2578]: E0602 21:33:43.169215 2578 reflector.go:200] "Failed to watch" err="failed to list *v1.Node: nodes \"ip-10-0-138-193.ec2.internal\" is forbidden: User \"system:anonymous\" cannot list resource \"nodes\" in API group \"\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Node" Jun 02 21:33:43.169481 ip-10-0-138-193 kubenswrapper[2578]: I0602 21:33:43.169464 2578 server.go:317] "Adding debug handlers to kubelet server" Jun 02 21:33:43.172560 ip-10-0-138-193 kubenswrapper[2578]: I0602 21:33:43.172537 2578 csr.go:274] "Certificate signing request is approved, waiting to be issued" logger="kubernetes.io/kube-apiserver-client-kubelet" csr="csr-lp49s" Jun 02 21:33:43.173002 ip-10-0-138-193 kubenswrapper[2578]: I0602 21:33:43.172988 2578 fs_resource_analyzer.go:67] "Starting FS ResourceAnalyzer" Jun 02 21:33:43.173119 ip-10-0-138-193 kubenswrapper[2578]: I0602 21:33:43.173003 2578 certificate_manager.go:422] "Certificate rotation is enabled" logger="kubernetes.io/kubelet-serving" Jun 02 21:33:43.173119 ip-10-0-138-193 kubenswrapper[2578]: I0602 21:33:43.173088 2578 volume_manager.go:295] "The desired_state_of_world populator starts" Jun 02 21:33:43.173119 ip-10-0-138-193 kubenswrapper[2578]: I0602 21:33:43.173099 2578 volume_manager.go:297] "Starting Kubelet Volume Manager" Jun 02 21:33:43.173236 ip-10-0-138-193 kubenswrapper[2578]: I0602 21:33:43.173178 2578 desired_state_of_world_populator.go:150] "Desired state populator starts to run" Jun 02 21:33:43.173290 ip-10-0-138-193 kubenswrapper[2578]: I0602 21:33:43.173256 2578 reconstruct.go:97] "Volume reconstruction finished" Jun 02 21:33:43.173290 ip-10-0-138-193 kubenswrapper[2578]: I0602 21:33:43.173264 2578 reconciler.go:26] "Reconciler: start to sync state" Jun 02 21:33:43.173948 ip-10-0-138-193 kubenswrapper[2578]: E0602 21:33:43.173922 2578 kubelet_node_status.go:515] "Error getting the current node from lister" err="node \"ip-10-0-138-193.ec2.internal\" not found" Jun 02 21:33:43.174268 ip-10-0-138-193 kubenswrapper[2578]: I0602 21:33:43.174118 2578 factory.go:55] Registering systemd factory Jun 02 21:33:43.174268 ip-10-0-138-193 kubenswrapper[2578]: I0602 21:33:43.174136 2578 factory.go:223] Registration of the systemd container factory successfully Jun 02 21:33:43.174440 ip-10-0-138-193 kubenswrapper[2578]: I0602 21:33:43.174422 2578 factory.go:153] Registering CRI-O factory Jun 02 21:33:43.174440 ip-10-0-138-193 kubenswrapper[2578]: I0602 21:33:43.174441 2578 factory.go:223] Registration of the crio container factory successfully Jun 02 21:33:43.174579 ip-10-0-138-193 kubenswrapper[2578]: I0602 21:33:43.174494 2578 factory.go:221] Registration of the containerd container factory failed: unable to create containerd client: containerd: cannot unix dial containerd api service: dial unix /run/containerd/containerd.sock: connect: no such file or directory Jun 02 21:33:43.174579 ip-10-0-138-193 kubenswrapper[2578]: I0602 21:33:43.174512 2578 factory.go:103] Registering Raw factory Jun 02 21:33:43.174579 ip-10-0-138-193 kubenswrapper[2578]: I0602 21:33:43.174532 2578 manager.go:1196] Started watching for new ooms in manager Jun 02 21:33:43.174732 ip-10-0-138-193 kubenswrapper[2578]: E0602 21:33:43.173852 2578 event.go:359] "Server rejected event (will not retry!)" err="events is forbidden: User \"system:anonymous\" cannot create resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-138-193.ec2.internal.18b5612141f925fb default 0 0001-01-01 00:00:00 +0000 UTC map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-138-193.ec2.internal,UID:ip-10-0-138-193.ec2.internal,APIVersion:,ResourceVersion:,FieldPath:,},Reason:Starting,Message:Starting kubelet.,Source:EventSource{Component:kubelet,Host:ip-10-0-138-193.ec2.internal,},FirstTimestamp:2026-06-02 21:33:43.163561467 +0000 UTC m=+0.415459363,LastTimestamp:2026-06-02 21:33:43.163561467 +0000 UTC m=+0.415459363,Count:1,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-138-193.ec2.internal,}" Jun 02 21:33:43.175324 ip-10-0-138-193 kubenswrapper[2578]: I0602 21:33:43.175298 2578 manager.go:319] Starting recovery of all containers Jun 02 21:33:43.177362 ip-10-0-138-193 kubenswrapper[2578]: I0602 21:33:43.177333 2578 csr.go:270] "Certificate signing request is issued" logger="kubernetes.io/kube-apiserver-client-kubelet" csr="csr-lp49s" Jun 02 21:33:43.178065 ip-10-0-138-193 kubenswrapper[2578]: E0602 21:33:43.178011 2578 kubelet.go:1618] "Image garbage collection failed once. Stats initialization may not have completed yet" err="failed to get imageFs info: unable to find data in memory cache" Jun 02 21:33:43.184119 ip-10-0-138-193 kubenswrapper[2578]: I0602 21:33:43.183954 2578 manager.go:324] Recovery completed Jun 02 21:33:43.184840 ip-10-0-138-193 kubenswrapper[2578]: I0602 21:33:43.184821 2578 reflector.go:430] "Caches populated" type="*v1.CSIDriver" reflector="k8s.io/client-go/informers/factory.go:160" Jun 02 21:33:43.186607 ip-10-0-138-193 kubenswrapper[2578]: E0602 21:33:43.186589 2578 nodelease.go:49] "Failed to get node when trying to set owner ref to the node lease" err="nodes \"ip-10-0-138-193.ec2.internal\" not found" node="ip-10-0-138-193.ec2.internal" Jun 02 21:33:43.188243 ip-10-0-138-193 kubenswrapper[2578]: I0602 21:33:43.188227 2578 kubelet_node_status.go:413] "Setting node annotation to enable volume controller attach/detach" Jun 02 21:33:43.189902 ip-10-0-138-193 kubenswrapper[2578]: I0602 21:33:43.189887 2578 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-138-193.ec2.internal" event="NodeHasSufficientMemory" Jun 02 21:33:43.189994 ip-10-0-138-193 kubenswrapper[2578]: I0602 21:33:43.189917 2578 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-138-193.ec2.internal" event="NodeHasNoDiskPressure" Jun 02 21:33:43.189994 ip-10-0-138-193 kubenswrapper[2578]: I0602 21:33:43.189938 2578 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-138-193.ec2.internal" event="NodeHasSufficientPID" Jun 02 21:33:43.190422 ip-10-0-138-193 kubenswrapper[2578]: I0602 21:33:43.190409 2578 cpu_manager.go:222] "Starting CPU manager" policy="none" Jun 02 21:33:43.190422 ip-10-0-138-193 kubenswrapper[2578]: I0602 21:33:43.190420 2578 cpu_manager.go:223] "Reconciling" reconcilePeriod="10s" Jun 02 21:33:43.190512 ip-10-0-138-193 kubenswrapper[2578]: I0602 21:33:43.190436 2578 state_mem.go:36] "Initialized new in-memory state store" Jun 02 21:33:43.192597 ip-10-0-138-193 kubenswrapper[2578]: I0602 21:33:43.192585 2578 policy_none.go:49] "None policy: Start" Jun 02 21:33:43.192639 ip-10-0-138-193 kubenswrapper[2578]: I0602 21:33:43.192601 2578 memory_manager.go:186] "Starting memorymanager" policy="None" Jun 02 21:33:43.192639 ip-10-0-138-193 kubenswrapper[2578]: I0602 21:33:43.192613 2578 state_mem.go:35] "Initializing new in-memory state store" Jun 02 21:33:43.231616 ip-10-0-138-193 kubenswrapper[2578]: I0602 21:33:43.231595 2578 manager.go:341] "Starting Device Plugin manager" Jun 02 21:33:43.231734 ip-10-0-138-193 kubenswrapper[2578]: E0602 21:33:43.231636 2578 manager.go:517] "Failed to read data from checkpoint" err="checkpoint is not found" checkpoint="kubelet_internal_checkpoint" Jun 02 21:33:43.231734 ip-10-0-138-193 kubenswrapper[2578]: I0602 21:33:43.231649 2578 server.go:85] "Starting device plugin registration server" Jun 02 21:33:43.231938 ip-10-0-138-193 kubenswrapper[2578]: I0602 21:33:43.231902 2578 eviction_manager.go:189] "Eviction manager: starting control loop" Jun 02 21:33:43.232002 ip-10-0-138-193 kubenswrapper[2578]: I0602 21:33:43.231919 2578 container_log_manager.go:189] "Initializing container log rotate workers" workers=1 monitorPeriod="10s" Jun 02 21:33:43.232137 ip-10-0-138-193 kubenswrapper[2578]: I0602 21:33:43.232118 2578 plugin_watcher.go:51] "Plugin Watcher Start" path="/var/lib/kubelet/plugins_registry" Jun 02 21:33:43.232234 ip-10-0-138-193 kubenswrapper[2578]: I0602 21:33:43.232221 2578 plugin_manager.go:116] "The desired_state_of_world populator (plugin watcher) starts" Jun 02 21:33:43.232234 ip-10-0-138-193 kubenswrapper[2578]: I0602 21:33:43.232234 2578 plugin_manager.go:118] "Starting Kubelet Plugin Manager" Jun 02 21:33:43.232635 ip-10-0-138-193 kubenswrapper[2578]: E0602 21:33:43.232619 2578 eviction_manager.go:267] "eviction manager: failed to check if we have separate container filesystem. Ignoring." err="non-existent label \"crio-containers\"" Jun 02 21:33:43.232695 ip-10-0-138-193 kubenswrapper[2578]: E0602 21:33:43.232659 2578 eviction_manager.go:292] "Eviction manager: failed to get summary stats" err="failed to get node info: node \"ip-10-0-138-193.ec2.internal\" not found" Jun 02 21:33:43.315904 ip-10-0-138-193 kubenswrapper[2578]: I0602 21:33:43.315868 2578 kubelet_network_linux.go:49] "Initialized iptables rules." protocol="IPv4" Jun 02 21:33:43.317116 ip-10-0-138-193 kubenswrapper[2578]: I0602 21:33:43.317053 2578 kubelet_network_linux.go:49] "Initialized iptables rules." protocol="IPv6" Jun 02 21:33:43.317116 ip-10-0-138-193 kubenswrapper[2578]: I0602 21:33:43.317093 2578 status_manager.go:230] "Starting to sync pod status with apiserver" Jun 02 21:33:43.317116 ip-10-0-138-193 kubenswrapper[2578]: I0602 21:33:43.317114 2578 watchdog_linux.go:127] "Systemd watchdog is not enabled or the interval is invalid, so health checking will not be started." Jun 02 21:33:43.317310 ip-10-0-138-193 kubenswrapper[2578]: I0602 21:33:43.317122 2578 kubelet.go:2451] "Starting kubelet main sync loop" Jun 02 21:33:43.317310 ip-10-0-138-193 kubenswrapper[2578]: E0602 21:33:43.317159 2578 kubelet.go:2475] "Skipping pod synchronization" err="PLEG is not healthy: pleg has yet to be successful" Jun 02 21:33:43.320322 ip-10-0-138-193 kubenswrapper[2578]: I0602 21:33:43.320300 2578 reflector.go:430] "Caches populated" type="*v1.RuntimeClass" reflector="k8s.io/client-go/informers/factory.go:160" Jun 02 21:33:43.332057 ip-10-0-138-193 kubenswrapper[2578]: I0602 21:33:43.332038 2578 kubelet_node_status.go:413] "Setting node annotation to enable volume controller attach/detach" Jun 02 21:33:43.333014 ip-10-0-138-193 kubenswrapper[2578]: I0602 21:33:43.332996 2578 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-138-193.ec2.internal" event="NodeHasSufficientMemory" Jun 02 21:33:43.333155 ip-10-0-138-193 kubenswrapper[2578]: I0602 21:33:43.333030 2578 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-138-193.ec2.internal" event="NodeHasNoDiskPressure" Jun 02 21:33:43.333155 ip-10-0-138-193 kubenswrapper[2578]: I0602 21:33:43.333053 2578 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-138-193.ec2.internal" event="NodeHasSufficientPID" Jun 02 21:33:43.333155 ip-10-0-138-193 kubenswrapper[2578]: I0602 21:33:43.333098 2578 kubelet_node_status.go:78] "Attempting to register node" node="ip-10-0-138-193.ec2.internal" Jun 02 21:33:43.340759 ip-10-0-138-193 kubenswrapper[2578]: I0602 21:33:43.340741 2578 kubelet_node_status.go:81] "Successfully registered node" node="ip-10-0-138-193.ec2.internal" Jun 02 21:33:43.340826 ip-10-0-138-193 kubenswrapper[2578]: E0602 21:33:43.340770 2578 kubelet_node_status.go:597] "Error updating node status, will retry" err="error getting node \"ip-10-0-138-193.ec2.internal\": node \"ip-10-0-138-193.ec2.internal\" not found" Jun 02 21:33:43.357932 ip-10-0-138-193 kubenswrapper[2578]: E0602 21:33:43.357904 2578 kubelet_node_status.go:515] "Error getting the current node from lister" err="node \"ip-10-0-138-193.ec2.internal\" not found" Jun 02 21:33:43.418117 ip-10-0-138-193 kubenswrapper[2578]: I0602 21:33:43.418057 2578 kubelet.go:2537] "SyncLoop ADD" source="file" pods=["openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-138-193.ec2.internal","kube-system/kube-apiserver-proxy-ip-10-0-138-193.ec2.internal"] Jun 02 21:33:43.418208 ip-10-0-138-193 kubenswrapper[2578]: I0602 21:33:43.418166 2578 kubelet_node_status.go:413] "Setting node annotation to enable volume controller attach/detach" Jun 02 21:33:43.419350 ip-10-0-138-193 kubenswrapper[2578]: I0602 21:33:43.419335 2578 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-138-193.ec2.internal" event="NodeHasSufficientMemory" Jun 02 21:33:43.419432 ip-10-0-138-193 kubenswrapper[2578]: I0602 21:33:43.419365 2578 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-138-193.ec2.internal" event="NodeHasNoDiskPressure" Jun 02 21:33:43.419432 ip-10-0-138-193 kubenswrapper[2578]: I0602 21:33:43.419382 2578 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-138-193.ec2.internal" event="NodeHasSufficientPID" Jun 02 21:33:43.420585 ip-10-0-138-193 kubenswrapper[2578]: I0602 21:33:43.420573 2578 kubelet_node_status.go:413] "Setting node annotation to enable volume controller attach/detach" Jun 02 21:33:43.420755 ip-10-0-138-193 kubenswrapper[2578]: I0602 21:33:43.420742 2578 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-138-193.ec2.internal" Jun 02 21:33:43.420794 ip-10-0-138-193 kubenswrapper[2578]: I0602 21:33:43.420770 2578 kubelet_node_status.go:413] "Setting node annotation to enable volume controller attach/detach" Jun 02 21:33:43.421302 ip-10-0-138-193 kubenswrapper[2578]: I0602 21:33:43.421284 2578 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-138-193.ec2.internal" event="NodeHasSufficientMemory" Jun 02 21:33:43.421385 ip-10-0-138-193 kubenswrapper[2578]: I0602 21:33:43.421309 2578 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-138-193.ec2.internal" event="NodeHasNoDiskPressure" Jun 02 21:33:43.421385 ip-10-0-138-193 kubenswrapper[2578]: I0602 21:33:43.421322 2578 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-138-193.ec2.internal" event="NodeHasSufficientPID" Jun 02 21:33:43.421460 ip-10-0-138-193 kubenswrapper[2578]: I0602 21:33:43.421383 2578 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-138-193.ec2.internal" event="NodeHasSufficientMemory" Jun 02 21:33:43.421460 ip-10-0-138-193 kubenswrapper[2578]: I0602 21:33:43.421406 2578 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-138-193.ec2.internal" event="NodeHasNoDiskPressure" Jun 02 21:33:43.421460 ip-10-0-138-193 kubenswrapper[2578]: I0602 21:33:43.421419 2578 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-138-193.ec2.internal" event="NodeHasSufficientPID" Jun 02 21:33:43.422359 ip-10-0-138-193 kubenswrapper[2578]: I0602 21:33:43.422347 2578 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/kube-apiserver-proxy-ip-10-0-138-193.ec2.internal" Jun 02 21:33:43.422408 ip-10-0-138-193 kubenswrapper[2578]: I0602 21:33:43.422369 2578 kubelet_node_status.go:413] "Setting node annotation to enable volume controller attach/detach" Jun 02 21:33:43.423033 ip-10-0-138-193 kubenswrapper[2578]: I0602 21:33:43.423019 2578 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-138-193.ec2.internal" event="NodeHasSufficientMemory" Jun 02 21:33:43.423139 ip-10-0-138-193 kubenswrapper[2578]: I0602 21:33:43.423045 2578 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-138-193.ec2.internal" event="NodeHasNoDiskPressure" Jun 02 21:33:43.423139 ip-10-0-138-193 kubenswrapper[2578]: I0602 21:33:43.423057 2578 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-138-193.ec2.internal" event="NodeHasSufficientPID" Jun 02 21:33:43.448915 ip-10-0-138-193 kubenswrapper[2578]: E0602 21:33:43.448882 2578 kubelet.go:3336] "No need to create a mirror pod, since failed to get node info from the cluster" err="node \"ip-10-0-138-193.ec2.internal\" not found" node="ip-10-0-138-193.ec2.internal" Jun 02 21:33:43.453436 ip-10-0-138-193 kubenswrapper[2578]: E0602 21:33:43.453418 2578 kubelet.go:3336] "No need to create a mirror pod, since failed to get node info from the cluster" err="node \"ip-10-0-138-193.ec2.internal\" not found" node="ip-10-0-138-193.ec2.internal" Jun 02 21:33:43.458488 ip-10-0-138-193 kubenswrapper[2578]: E0602 21:33:43.458463 2578 kubelet_node_status.go:515] "Error getting the current node from lister" err="node \"ip-10-0-138-193.ec2.internal\" not found" Jun 02 21:33:43.474304 ip-10-0-138-193 kubenswrapper[2578]: I0602 21:33:43.474269 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/247a6670237571f242d56083262cafaa-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-138-193.ec2.internal\" (UID: \"247a6670237571f242d56083262cafaa\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-138-193.ec2.internal" Jun 02 21:33:43.474304 ip-10-0-138-193 kubenswrapper[2578]: I0602 21:33:43.474309 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/247a6670237571f242d56083262cafaa-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-138-193.ec2.internal\" (UID: \"247a6670237571f242d56083262cafaa\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-138-193.ec2.internal" Jun 02 21:33:43.474475 ip-10-0-138-193 kubenswrapper[2578]: I0602 21:33:43.474333 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/host-path/77f9e070a3a0bb8738701c4daea1dbb2-config\") pod \"kube-apiserver-proxy-ip-10-0-138-193.ec2.internal\" (UID: \"77f9e070a3a0bb8738701c4daea1dbb2\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-138-193.ec2.internal" Jun 02 21:33:43.558918 ip-10-0-138-193 kubenswrapper[2578]: E0602 21:33:43.558889 2578 kubelet_node_status.go:515] "Error getting the current node from lister" err="node \"ip-10-0-138-193.ec2.internal\" not found" Jun 02 21:33:43.575296 ip-10-0-138-193 kubenswrapper[2578]: I0602 21:33:43.575222 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/247a6670237571f242d56083262cafaa-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-138-193.ec2.internal\" (UID: \"247a6670237571f242d56083262cafaa\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-138-193.ec2.internal" Jun 02 21:33:43.575296 ip-10-0-138-193 kubenswrapper[2578]: I0602 21:33:43.575246 2578 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/247a6670237571f242d56083262cafaa-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-138-193.ec2.internal\" (UID: \"247a6670237571f242d56083262cafaa\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-138-193.ec2.internal" Jun 02 21:33:43.575296 ip-10-0-138-193 kubenswrapper[2578]: I0602 21:33:43.575285 2578 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/247a6670237571f242d56083262cafaa-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-138-193.ec2.internal\" (UID: \"247a6670237571f242d56083262cafaa\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-138-193.ec2.internal" Jun 02 21:33:43.575477 ip-10-0-138-193 kubenswrapper[2578]: I0602 21:33:43.575309 2578 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/host-path/77f9e070a3a0bb8738701c4daea1dbb2-config\") pod \"kube-apiserver-proxy-ip-10-0-138-193.ec2.internal\" (UID: \"77f9e070a3a0bb8738701c4daea1dbb2\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-138-193.ec2.internal" Jun 02 21:33:43.575477 ip-10-0-138-193 kubenswrapper[2578]: I0602 21:33:43.575334 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/247a6670237571f242d56083262cafaa-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-138-193.ec2.internal\" (UID: \"247a6670237571f242d56083262cafaa\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-138-193.ec2.internal" Jun 02 21:33:43.575477 ip-10-0-138-193 kubenswrapper[2578]: I0602 21:33:43.575359 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/host-path/77f9e070a3a0bb8738701c4daea1dbb2-config\") pod \"kube-apiserver-proxy-ip-10-0-138-193.ec2.internal\" (UID: \"77f9e070a3a0bb8738701c4daea1dbb2\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-138-193.ec2.internal" Jun 02 21:33:43.659639 ip-10-0-138-193 kubenswrapper[2578]: E0602 21:33:43.659593 2578 kubelet_node_status.go:515] "Error getting the current node from lister" err="node \"ip-10-0-138-193.ec2.internal\" not found" Jun 02 21:33:43.751087 ip-10-0-138-193 kubenswrapper[2578]: I0602 21:33:43.751041 2578 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-138-193.ec2.internal" Jun 02 21:33:43.757549 ip-10-0-138-193 kubenswrapper[2578]: I0602 21:33:43.757531 2578 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/kube-apiserver-proxy-ip-10-0-138-193.ec2.internal" Jun 02 21:33:43.760146 ip-10-0-138-193 kubenswrapper[2578]: E0602 21:33:43.760129 2578 kubelet_node_status.go:515] "Error getting the current node from lister" err="node \"ip-10-0-138-193.ec2.internal\" not found" Jun 02 21:33:43.860638 ip-10-0-138-193 kubenswrapper[2578]: E0602 21:33:43.860551 2578 kubelet_node_status.go:515] "Error getting the current node from lister" err="node \"ip-10-0-138-193.ec2.internal\" not found" Jun 02 21:33:43.961090 ip-10-0-138-193 kubenswrapper[2578]: E0602 21:33:43.961042 2578 kubelet_node_status.go:515] "Error getting the current node from lister" err="node \"ip-10-0-138-193.ec2.internal\" not found" Jun 02 21:33:44.061544 ip-10-0-138-193 kubenswrapper[2578]: E0602 21:33:44.061512 2578 kubelet_node_status.go:515] "Error getting the current node from lister" err="node \"ip-10-0-138-193.ec2.internal\" not found" Jun 02 21:33:44.090004 ip-10-0-138-193 kubenswrapper[2578]: I0602 21:33:44.089973 2578 transport.go:147] "Certificate rotation detected, shutting down client connections to start using new credentials" Jun 02 21:33:44.090550 ip-10-0-138-193 kubenswrapper[2578]: I0602 21:33:44.090147 2578 reflector.go:556] "Warning: watch ended with error" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.RuntimeClass" err="very short watch: k8s.io/client-go/informers/factory.go:160: Unexpected watch close - watch lasted less than a second and no items received" Jun 02 21:33:44.090550 ip-10-0-138-193 kubenswrapper[2578]: I0602 21:33:44.090165 2578 reflector.go:556] "Warning: watch ended with error" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.CSIDriver" err="very short watch: k8s.io/client-go/informers/factory.go:160: Unexpected watch close - watch lasted less than a second and no items received" Jun 02 21:33:44.124478 ip-10-0-138-193 kubenswrapper[2578]: I0602 21:33:44.124411 2578 reflector.go:430] "Caches populated" type="*v1.Service" reflector="k8s.io/client-go/informers/factory.go:160" Jun 02 21:33:44.162138 ip-10-0-138-193 kubenswrapper[2578]: E0602 21:33:44.162109 2578 kubelet_node_status.go:515] "Error getting the current node from lister" err="node \"ip-10-0-138-193.ec2.internal\" not found" Jun 02 21:33:44.173522 ip-10-0-138-193 kubenswrapper[2578]: I0602 21:33:44.173497 2578 certificate_manager.go:566] "Rotating certificates" logger="kubernetes.io/kubelet-serving" Jun 02 21:33:44.178637 ip-10-0-138-193 kubenswrapper[2578]: I0602 21:33:44.178607 2578 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kube-apiserver-client-kubelet" expiration="2028-06-01 21:28:43 +0000 UTC" deadline="2027-11-16 07:42:39.356702525 +0000 UTC" Jun 02 21:33:44.178723 ip-10-0-138-193 kubenswrapper[2578]: I0602 21:33:44.178639 2578 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kube-apiserver-client-kubelet" sleep="12754h8m55.178068459s" Jun 02 21:33:44.207271 ip-10-0-138-193 kubenswrapper[2578]: I0602 21:33:44.207242 2578 reflector.go:430] "Caches populated" logger="kubernetes.io/kubelet-serving" type="*v1.CertificateSigningRequest" reflector="k8s.io/client-go/tools/watch/informerwatcher.go:162" Jun 02 21:33:44.226654 ip-10-0-138-193 kubenswrapper[2578]: I0602 21:33:44.226633 2578 reflector.go:430] "Caches populated" type="*v1.Node" reflector="k8s.io/client-go/informers/factory.go:160" Jun 02 21:33:44.228025 ip-10-0-138-193 kubenswrapper[2578]: W0602 21:33:44.227990 2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod77f9e070a3a0bb8738701c4daea1dbb2.slice/crio-658b21da6632ee08df26104c6a616231fdba2ce985127978baa4002b79ba3698 WatchSource:0}: Error finding container 658b21da6632ee08df26104c6a616231fdba2ce985127978baa4002b79ba3698: Status 404 returned error can't find the container with id 658b21da6632ee08df26104c6a616231fdba2ce985127978baa4002b79ba3698 Jun 02 21:33:44.228250 ip-10-0-138-193 kubenswrapper[2578]: W0602 21:33:44.228231 2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod247a6670237571f242d56083262cafaa.slice/crio-96ed196c9e1943299221326fd51942ca694b35ab2fe9037d08ccde635e1f58f3 WatchSource:0}: Error finding container 96ed196c9e1943299221326fd51942ca694b35ab2fe9037d08ccde635e1f58f3: Status 404 returned error can't find the container with id 96ed196c9e1943299221326fd51942ca694b35ab2fe9037d08ccde635e1f58f3 Jun 02 21:33:44.231843 ip-10-0-138-193 kubenswrapper[2578]: I0602 21:33:44.231829 2578 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider Jun 02 21:33:44.261166 ip-10-0-138-193 kubenswrapper[2578]: I0602 21:33:44.261143 2578 csr.go:274] "Certificate signing request is approved, waiting to be issued" logger="kubernetes.io/kubelet-serving" csr="csr-fst8w" Jun 02 21:33:44.274221 ip-10-0-138-193 kubenswrapper[2578]: I0602 21:33:44.274205 2578 kubelet.go:3340] "Creating a mirror pod for static pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-138-193.ec2.internal" Jun 02 21:33:44.274314 ip-10-0-138-193 kubenswrapper[2578]: I0602 21:33:44.274261 2578 csr.go:270] "Certificate signing request is issued" logger="kubernetes.io/kubelet-serving" csr="csr-fst8w" Jun 02 21:33:44.286591 ip-10-0-138-193 kubenswrapper[2578]: I0602 21:33:44.286567 2578 warnings.go:110] "Warning: metadata.name: this is used in the Pod's hostname, which can result in surprising behavior; a DNS label is recommended: [must not contain dots]" Jun 02 21:33:44.287444 ip-10-0-138-193 kubenswrapper[2578]: I0602 21:33:44.287433 2578 kubelet.go:3340] "Creating a mirror pod for static pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-138-193.ec2.internal" Jun 02 21:33:44.299724 ip-10-0-138-193 kubenswrapper[2578]: I0602 21:33:44.298342 2578 warnings.go:110] "Warning: metadata.name: this is used in the Pod's hostname, which can result in surprising behavior; a DNS label is recommended: [must not contain dots]" Jun 02 21:33:44.320162 ip-10-0-138-193 kubenswrapper[2578]: I0602 21:33:44.320111 2578 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-138-193.ec2.internal" event={"ID":"77f9e070a3a0bb8738701c4daea1dbb2","Type":"ContainerStarted","Data":"658b21da6632ee08df26104c6a616231fdba2ce985127978baa4002b79ba3698"} Jun 02 21:33:44.320949 ip-10-0-138-193 kubenswrapper[2578]: I0602 21:33:44.320931 2578 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-138-193.ec2.internal" event={"ID":"247a6670237571f242d56083262cafaa","Type":"ContainerStarted","Data":"96ed196c9e1943299221326fd51942ca694b35ab2fe9037d08ccde635e1f58f3"} Jun 02 21:33:44.922152 ip-10-0-138-193 kubenswrapper[2578]: I0602 21:33:44.921931 2578 reflector.go:430] "Caches populated" type="*v1.RuntimeClass" reflector="k8s.io/client-go/informers/factory.go:160" Jun 02 21:33:45.153536 ip-10-0-138-193 kubenswrapper[2578]: I0602 21:33:45.153502 2578 apiserver.go:52] "Watching apiserver" Jun 02 21:33:45.161417 ip-10-0-138-193 kubenswrapper[2578]: I0602 21:33:45.161390 2578 reflector.go:430] "Caches populated" type="*v1.Pod" reflector="pkg/kubelet/config/apiserver.go:66" Jun 02 21:33:45.162374 ip-10-0-138-193 kubenswrapper[2578]: I0602 21:33:45.162342 2578 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-cluster-node-tuning-operator/tuned-297ws","openshift-dns/node-resolver-vfdfn","openshift-image-registry/node-ca-mnnsl","openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-138-193.ec2.internal","openshift-multus/multus-p74k8","openshift-multus/network-metrics-daemon-k2vdd","kube-system/konnectivity-agent-q78cn","kube-system/kube-apiserver-proxy-ip-10-0-138-193.ec2.internal","openshift-multus/multus-additional-cni-plugins-s7sgt","openshift-network-diagnostics/network-check-target-r92gd","openshift-network-operator/iptables-alerter-xbl27","openshift-ovn-kubernetes/ovnkube-node-5zgzd","kube-system/global-pull-secret-syncer-rf8cp","openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-9xsr6"] Jun 02 21:33:45.163827 ip-10-0-138-193 kubenswrapper[2578]: I0602 21:33:45.163803 2578 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-r92gd" Jun 02 21:33:45.163960 ip-10-0-138-193 kubenswrapper[2578]: E0602 21:33:45.163938 2578 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-r92gd" podUID="950ec20f-2c4b-4e1b-96ba-c02f9a6d124a" Jun 02 21:33:45.164871 ip-10-0-138-193 kubenswrapper[2578]: I0602 21:33:45.164849 2578 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-operator/iptables-alerter-xbl27" Jun 02 21:33:45.166929 ip-10-0-138-193 kubenswrapper[2578]: I0602 21:33:45.166906 2578 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/node-ca-mnnsl" Jun 02 21:33:45.167402 ip-10-0-138-193 kubenswrapper[2578]: I0602 21:33:45.167370 2578 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"kube-root-ca.crt\"" Jun 02 21:33:45.167402 ip-10-0-138-193 kubenswrapper[2578]: I0602 21:33:45.167398 2578 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-operator\"/\"iptables-alerter-dockercfg-kfnf4\"" Jun 02 21:33:45.167578 ip-10-0-138-193 kubenswrapper[2578]: I0602 21:33:45.167447 2578 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"iptables-alerter-script\"" Jun 02 21:33:45.167822 ip-10-0-138-193 kubenswrapper[2578]: I0602 21:33:45.167668 2578 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"openshift-service-ca.crt\"" Jun 02 21:33:45.168479 ip-10-0-138-193 kubenswrapper[2578]: I0602 21:33:45.168176 2578 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-9xsr6" Jun 02 21:33:45.168479 ip-10-0-138-193 kubenswrapper[2578]: I0602 21:33:45.168252 2578 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-p74k8" Jun 02 21:33:45.169595 ip-10-0-138-193 kubenswrapper[2578]: I0602 21:33:45.169331 2578 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-k2vdd" Jun 02 21:33:45.169595 ip-10-0-138-193 kubenswrapper[2578]: I0602 21:33:45.169404 2578 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"kube-root-ca.crt\"" Jun 02 21:33:45.169595 ip-10-0-138-193 kubenswrapper[2578]: E0602 21:33:45.169394 2578 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-k2vdd" podUID="adfce93b-f07e-480a-af26-5dc7df23fa48" Jun 02 21:33:45.169595 ip-10-0-138-193 kubenswrapper[2578]: I0602 21:33:45.169574 2578 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"node-ca-dockercfg-dbd9d\"" Jun 02 21:33:45.169839 ip-10-0-138-193 kubenswrapper[2578]: I0602 21:33:45.169632 2578 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"image-registry-certificates\"" Jun 02 21:33:45.169839 ip-10-0-138-193 kubenswrapper[2578]: I0602 21:33:45.169703 2578 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"openshift-service-ca.crt\"" Jun 02 21:33:45.170059 ip-10-0-138-193 kubenswrapper[2578]: I0602 21:33:45.170041 2578 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-csi-drivers\"/\"aws-ebs-csi-driver-node-metrics-serving-cert\"" Jun 02 21:33:45.170376 ip-10-0-138-193 kubenswrapper[2578]: I0602 21:33:45.170358 2578 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-csi-drivers\"/\"openshift-service-ca.crt\"" Jun 02 21:33:45.170483 ip-10-0-138-193 kubenswrapper[2578]: I0602 21:33:45.170454 2578 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-csi-drivers\"/\"aws-ebs-csi-driver-node-sa-dockercfg-nn8m7\"" Jun 02 21:33:45.170483 ip-10-0-138-193 kubenswrapper[2578]: I0602 21:33:45.170474 2578 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"cni-copy-resources\"" Jun 02 21:33:45.170599 ip-10-0-138-193 kubenswrapper[2578]: I0602 21:33:45.170493 2578 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"openshift-service-ca.crt\"" Jun 02 21:33:45.170708 ip-10-0-138-193 kubenswrapper[2578]: I0602 21:33:45.170692 2578 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-csi-drivers\"/\"kube-root-ca.crt\"" Jun 02 21:33:45.170769 ip-10-0-138-193 kubenswrapper[2578]: I0602 21:33:45.170751 2578 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"multus-daemon-config\"" Jun 02 21:33:45.170995 ip-10-0-138-193 kubenswrapper[2578]: I0602 21:33:45.170830 2578 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"default-dockercfg-8922f\"" Jun 02 21:33:45.170995 ip-10-0-138-193 kubenswrapper[2578]: I0602 21:33:45.170859 2578 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"kube-root-ca.crt\"" Jun 02 21:33:45.171916 ip-10-0-138-193 kubenswrapper[2578]: I0602 21:33:45.171898 2578 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-additional-cni-plugins-s7sgt" Jun 02 21:33:45.172451 ip-10-0-138-193 kubenswrapper[2578]: I0602 21:33:45.172402 2578 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ovn-kubernetes/ovnkube-node-5zgzd" Jun 02 21:33:45.174478 ip-10-0-138-193 kubenswrapper[2578]: I0602 21:33:45.174350 2578 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"whereabouts-flatfile-config\"" Jun 02 21:33:45.174691 ip-10-0-138-193 kubenswrapper[2578]: I0602 21:33:45.174661 2578 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"default-cni-sysctl-allowlist\"" Jun 02 21:33:45.174880 ip-10-0-138-193 kubenswrapper[2578]: I0602 21:33:45.174863 2578 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"ovnkube-config\"" Jun 02 21:33:45.175192 ip-10-0-138-193 kubenswrapper[2578]: I0602 21:33:45.175176 2578 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/node-resolver-vfdfn" Jun 02 21:33:45.175952 ip-10-0-138-193 kubenswrapper[2578]: I0602 21:33:45.175934 2578 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"env-overrides\"" Jun 02 21:33:45.176835 ip-10-0-138-193 kubenswrapper[2578]: I0602 21:33:45.176815 2578 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"kube-root-ca.crt\"" Jun 02 21:33:45.176930 ip-10-0-138-193 kubenswrapper[2578]: I0602 21:33:45.176883 2578 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ovn-kubernetes\"/\"ovn-node-metrics-cert\"" Jun 02 21:33:45.177121 ip-10-0-138-193 kubenswrapper[2578]: I0602 21:33:45.177100 2578 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"ovnkube-script-lib\"" Jun 02 21:33:45.177121 ip-10-0-138-193 kubenswrapper[2578]: I0602 21:33:45.177115 2578 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"openshift-service-ca.crt\"" Jun 02 21:33:45.177254 ip-10-0-138-193 kubenswrapper[2578]: I0602 21:33:45.177184 2578 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ovn-kubernetes\"/\"ovn-kubernetes-node-dockercfg-6gcvk\"" Jun 02 21:33:45.177514 ip-10-0-138-193 kubenswrapper[2578]: I0602 21:33:45.177357 2578 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"multus-ancillary-tools-dockercfg-x5bbk\"" Jun 02 21:33:45.177514 ip-10-0-138-193 kubenswrapper[2578]: I0602 21:33:45.177394 2578 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"kube-root-ca.crt\"" Jun 02 21:33:45.177514 ip-10-0-138-193 kubenswrapper[2578]: I0602 21:33:45.177365 2578 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"openshift-service-ca.crt\"" Jun 02 21:33:45.177514 ip-10-0-138-193 kubenswrapper[2578]: I0602 21:33:45.177428 2578 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"node-resolver-dockercfg-rvkzg\"" Jun 02 21:33:45.178335 ip-10-0-138-193 kubenswrapper[2578]: I0602 21:33:45.178317 2578 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-node-tuning-operator/tuned-297ws" Jun 02 21:33:45.178591 ip-10-0-138-193 kubenswrapper[2578]: I0602 21:33:45.178459 2578 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/konnectivity-agent-q78cn" Jun 02 21:33:45.179699 ip-10-0-138-193 kubenswrapper[2578]: I0602 21:33:45.179683 2578 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-rf8cp" Jun 02 21:33:45.179783 ip-10-0-138-193 kubenswrapper[2578]: E0602 21:33:45.179744 2578 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-rf8cp" podUID="9963c656-171f-412f-b531-d4e89671117c" Jun 02 21:33:45.181355 ip-10-0-138-193 kubenswrapper[2578]: I0602 21:33:45.181313 2578 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kube-system\"/\"konnectivity-ca-bundle\"" Jun 02 21:33:45.181355 ip-10-0-138-193 kubenswrapper[2578]: I0602 21:33:45.181326 2578 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"default-dockercfg-jbfwk\"" Jun 02 21:33:45.181562 ip-10-0-138-193 kubenswrapper[2578]: I0602 21:33:45.181353 2578 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"openshift-service-ca.crt\"" Jun 02 21:33:45.181562 ip-10-0-138-193 kubenswrapper[2578]: I0602 21:33:45.181417 2578 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"kube-root-ca.crt\"" Jun 02 21:33:45.181562 ip-10-0-138-193 kubenswrapper[2578]: I0602 21:33:45.181313 2578 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"tuned-dockercfg-54nlb\"" Jun 02 21:33:45.181690 ip-10-0-138-193 kubenswrapper[2578]: I0602 21:33:45.181583 2578 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"konnectivity-agent\"" Jun 02 21:33:45.184714 ip-10-0-138-193 kubenswrapper[2578]: I0602 21:33:45.184691 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-njxlp\" (UniqueName: \"kubernetes.io/projected/adf5f00d-bf02-4037-b6e7-92c6485f3e38-kube-api-access-njxlp\") pod \"iptables-alerter-xbl27\" (UID: \"adf5f00d-bf02-4037-b6e7-92c6485f3e38\") " pod="openshift-network-operator/iptables-alerter-xbl27" Jun 02 21:33:45.184811 ip-10-0-138-193 kubenswrapper[2578]: I0602 21:33:45.184733 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/3ea59100-2e7e-4a44-8ec1-c3f7e3472835-host-run-k8s-cni-cncf-io\") pod \"multus-p74k8\" (UID: \"3ea59100-2e7e-4a44-8ec1-c3f7e3472835\") " pod="openshift-multus/multus-p74k8" Jun 02 21:33:45.184811 ip-10-0-138-193 kubenswrapper[2578]: I0602 21:33:45.184756 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/3ea59100-2e7e-4a44-8ec1-c3f7e3472835-multus-daemon-config\") pod \"multus-p74k8\" (UID: \"3ea59100-2e7e-4a44-8ec1-c3f7e3472835\") " pod="openshift-multus/multus-p74k8" Jun 02 21:33:45.184811 ip-10-0-138-193 kubenswrapper[2578]: I0602 21:33:45.184783 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/4d2236cd-d674-4c20-821e-7173b6db4b74-hosts-file\") pod \"node-resolver-vfdfn\" (UID: \"4d2236cd-d674-4c20-821e-7173b6db4b74\") " pod="openshift-dns/node-resolver-vfdfn" Jun 02 21:33:45.184811 ip-10-0-138-193 kubenswrapper[2578]: I0602 21:33:45.184806 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/96c320b0-e239-4e96-aaae-28255100dae4-registration-dir\") pod \"aws-ebs-csi-driver-node-9xsr6\" (UID: \"96c320b0-e239-4e96-aaae-28255100dae4\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-9xsr6" Jun 02 21:33:45.185044 ip-10-0-138-193 kubenswrapper[2578]: I0602 21:33:45.184830 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/96c320b0-e239-4e96-aaae-28255100dae4-device-dir\") pod \"aws-ebs-csi-driver-node-9xsr6\" (UID: \"96c320b0-e239-4e96-aaae-28255100dae4\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-9xsr6" Jun 02 21:33:45.185044 ip-10-0-138-193 kubenswrapper[2578]: I0602 21:33:45.184853 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/f2c18898-cc9a-4645-bab8-9ac55c476c7f-os-release\") pod \"multus-additional-cni-plugins-s7sgt\" (UID: \"f2c18898-cc9a-4645-bab8-9ac55c476c7f\") " pod="openshift-multus/multus-additional-cni-plugins-s7sgt" Jun 02 21:33:45.185044 ip-10-0-138-193 kubenswrapper[2578]: I0602 21:33:45.184868 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/ecde3d34-b3a4-422b-9a2d-c8a4541cc718-ovn-node-metrics-cert\") pod \"ovnkube-node-5zgzd\" (UID: \"ecde3d34-b3a4-422b-9a2d-c8a4541cc718\") " pod="openshift-ovn-kubernetes/ovnkube-node-5zgzd" Jun 02 21:33:45.185044 ip-10-0-138-193 kubenswrapper[2578]: I0602 21:33:45.184890 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/3ea59100-2e7e-4a44-8ec1-c3f7e3472835-multus-socket-dir-parent\") pod \"multus-p74k8\" (UID: \"3ea59100-2e7e-4a44-8ec1-c3f7e3472835\") " pod="openshift-multus/multus-p74k8" Jun 02 21:33:45.185044 ip-10-0-138-193 kubenswrapper[2578]: I0602 21:33:45.184905 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/3ea59100-2e7e-4a44-8ec1-c3f7e3472835-hostroot\") pod \"multus-p74k8\" (UID: \"3ea59100-2e7e-4a44-8ec1-c3f7e3472835\") " pod="openshift-multus/multus-p74k8" Jun 02 21:33:45.185044 ip-10-0-138-193 kubenswrapper[2578]: I0602 21:33:45.184932 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/f2c18898-cc9a-4645-bab8-9ac55c476c7f-system-cni-dir\") pod \"multus-additional-cni-plugins-s7sgt\" (UID: \"f2c18898-cc9a-4645-bab8-9ac55c476c7f\") " pod="openshift-multus/multus-additional-cni-plugins-s7sgt" Jun 02 21:33:45.185044 ip-10-0-138-193 kubenswrapper[2578]: I0602 21:33:45.184959 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/adf5f00d-bf02-4037-b6e7-92c6485f3e38-iptables-alerter-script\") pod \"iptables-alerter-xbl27\" (UID: \"adf5f00d-bf02-4037-b6e7-92c6485f3e38\") " pod="openshift-network-operator/iptables-alerter-xbl27" Jun 02 21:33:45.185044 ip-10-0-138-193 kubenswrapper[2578]: I0602 21:33:45.184984 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-8nvbg\" (UniqueName: \"kubernetes.io/projected/3ea59100-2e7e-4a44-8ec1-c3f7e3472835-kube-api-access-8nvbg\") pod \"multus-p74k8\" (UID: \"3ea59100-2e7e-4a44-8ec1-c3f7e3472835\") " pod="openshift-multus/multus-p74k8" Jun 02 21:33:45.185044 ip-10-0-138-193 kubenswrapper[2578]: I0602 21:33:45.185003 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-7tfkv\" (UniqueName: \"kubernetes.io/projected/adfce93b-f07e-480a-af26-5dc7df23fa48-kube-api-access-7tfkv\") pod \"network-metrics-daemon-k2vdd\" (UID: \"adfce93b-f07e-480a-af26-5dc7df23fa48\") " pod="openshift-multus/network-metrics-daemon-k2vdd" Jun 02 21:33:45.185044 ip-10-0-138-193 kubenswrapper[2578]: I0602 21:33:45.185019 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-d5dnb\" (UniqueName: \"kubernetes.io/projected/950ec20f-2c4b-4e1b-96ba-c02f9a6d124a-kube-api-access-d5dnb\") pod \"network-check-target-r92gd\" (UID: \"950ec20f-2c4b-4e1b-96ba-c02f9a6d124a\") " pod="openshift-network-diagnostics/network-check-target-r92gd" Jun 02 21:33:45.185044 ip-10-0-138-193 kubenswrapper[2578]: I0602 21:33:45.185035 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/f2c18898-cc9a-4645-bab8-9ac55c476c7f-tuning-conf-dir\") pod \"multus-additional-cni-plugins-s7sgt\" (UID: \"f2c18898-cc9a-4645-bab8-9ac55c476c7f\") " pod="openshift-multus/multus-additional-cni-plugins-s7sgt" Jun 02 21:33:45.185539 ip-10-0-138-193 kubenswrapper[2578]: I0602 21:33:45.185064 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/ecde3d34-b3a4-422b-9a2d-c8a4541cc718-host-kubelet\") pod \"ovnkube-node-5zgzd\" (UID: \"ecde3d34-b3a4-422b-9a2d-c8a4541cc718\") " pod="openshift-ovn-kubernetes/ovnkube-node-5zgzd" Jun 02 21:33:45.185539 ip-10-0-138-193 kubenswrapper[2578]: I0602 21:33:45.185100 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/ecde3d34-b3a4-422b-9a2d-c8a4541cc718-log-socket\") pod \"ovnkube-node-5zgzd\" (UID: \"ecde3d34-b3a4-422b-9a2d-c8a4541cc718\") " pod="openshift-ovn-kubernetes/ovnkube-node-5zgzd" Jun 02 21:33:45.185539 ip-10-0-138-193 kubenswrapper[2578]: I0602 21:33:45.185122 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/ecde3d34-b3a4-422b-9a2d-c8a4541cc718-host-cni-netd\") pod \"ovnkube-node-5zgzd\" (UID: \"ecde3d34-b3a4-422b-9a2d-c8a4541cc718\") " pod="openshift-ovn-kubernetes/ovnkube-node-5zgzd" Jun 02 21:33:45.185539 ip-10-0-138-193 kubenswrapper[2578]: I0602 21:33:45.185136 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/ecde3d34-b3a4-422b-9a2d-c8a4541cc718-ovnkube-config\") pod \"ovnkube-node-5zgzd\" (UID: \"ecde3d34-b3a4-422b-9a2d-c8a4541cc718\") " pod="openshift-ovn-kubernetes/ovnkube-node-5zgzd" Jun 02 21:33:45.185539 ip-10-0-138-193 kubenswrapper[2578]: I0602 21:33:45.185155 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/4d2236cd-d674-4c20-821e-7173b6db4b74-tmp-dir\") pod \"node-resolver-vfdfn\" (UID: \"4d2236cd-d674-4c20-821e-7173b6db4b74\") " pod="openshift-dns/node-resolver-vfdfn" Jun 02 21:33:45.185539 ip-10-0-138-193 kubenswrapper[2578]: I0602 21:33:45.185176 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/fd30f6e0-874c-411b-b8c6-0df250364c15-serviceca\") pod \"node-ca-mnnsl\" (UID: \"fd30f6e0-874c-411b-b8c6-0df250364c15\") " pod="openshift-image-registry/node-ca-mnnsl" Jun 02 21:33:45.185539 ip-10-0-138-193 kubenswrapper[2578]: I0602 21:33:45.185211 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/ecde3d34-b3a4-422b-9a2d-c8a4541cc718-run-ovn\") pod \"ovnkube-node-5zgzd\" (UID: \"ecde3d34-b3a4-422b-9a2d-c8a4541cc718\") " pod="openshift-ovn-kubernetes/ovnkube-node-5zgzd" Jun 02 21:33:45.185539 ip-10-0-138-193 kubenswrapper[2578]: I0602 21:33:45.185243 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/3ea59100-2e7e-4a44-8ec1-c3f7e3472835-host-run-multus-certs\") pod \"multus-p74k8\" (UID: \"3ea59100-2e7e-4a44-8ec1-c3f7e3472835\") " pod="openshift-multus/multus-p74k8" Jun 02 21:33:45.185539 ip-10-0-138-193 kubenswrapper[2578]: I0602 21:33:45.185265 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/96c320b0-e239-4e96-aaae-28255100dae4-sys-fs\") pod \"aws-ebs-csi-driver-node-9xsr6\" (UID: \"96c320b0-e239-4e96-aaae-28255100dae4\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-9xsr6" Jun 02 21:33:45.185539 ip-10-0-138-193 kubenswrapper[2578]: I0602 21:33:45.185281 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-444ql\" (UniqueName: \"kubernetes.io/projected/fd30f6e0-874c-411b-b8c6-0df250364c15-kube-api-access-444ql\") pod \"node-ca-mnnsl\" (UID: \"fd30f6e0-874c-411b-b8c6-0df250364c15\") " pod="openshift-image-registry/node-ca-mnnsl" Jun 02 21:33:45.185539 ip-10-0-138-193 kubenswrapper[2578]: I0602 21:33:45.185316 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-nb7zn\" (UniqueName: \"kubernetes.io/projected/96c320b0-e239-4e96-aaae-28255100dae4-kube-api-access-nb7zn\") pod \"aws-ebs-csi-driver-node-9xsr6\" (UID: \"96c320b0-e239-4e96-aaae-28255100dae4\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-9xsr6" Jun 02 21:33:45.185539 ip-10-0-138-193 kubenswrapper[2578]: I0602 21:33:45.185339 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/3ea59100-2e7e-4a44-8ec1-c3f7e3472835-host-var-lib-cni-multus\") pod \"multus-p74k8\" (UID: \"3ea59100-2e7e-4a44-8ec1-c3f7e3472835\") " pod="openshift-multus/multus-p74k8" Jun 02 21:33:45.185539 ip-10-0-138-193 kubenswrapper[2578]: I0602 21:33:45.185355 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/ecde3d34-b3a4-422b-9a2d-c8a4541cc718-var-lib-openvswitch\") pod \"ovnkube-node-5zgzd\" (UID: \"ecde3d34-b3a4-422b-9a2d-c8a4541cc718\") " pod="openshift-ovn-kubernetes/ovnkube-node-5zgzd" Jun 02 21:33:45.185539 ip-10-0-138-193 kubenswrapper[2578]: I0602 21:33:45.185373 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/3ea59100-2e7e-4a44-8ec1-c3f7e3472835-host-run-netns\") pod \"multus-p74k8\" (UID: \"3ea59100-2e7e-4a44-8ec1-c3f7e3472835\") " pod="openshift-multus/multus-p74k8" Jun 02 21:33:45.185539 ip-10-0-138-193 kubenswrapper[2578]: I0602 21:33:45.185392 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/adfce93b-f07e-480a-af26-5dc7df23fa48-metrics-certs\") pod \"network-metrics-daemon-k2vdd\" (UID: \"adfce93b-f07e-480a-af26-5dc7df23fa48\") " pod="openshift-multus/network-metrics-daemon-k2vdd" Jun 02 21:33:45.185539 ip-10-0-138-193 kubenswrapper[2578]: I0602 21:33:45.185413 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/f2c18898-cc9a-4645-bab8-9ac55c476c7f-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-s7sgt\" (UID: \"f2c18898-cc9a-4645-bab8-9ac55c476c7f\") " pod="openshift-multus/multus-additional-cni-plugins-s7sgt" Jun 02 21:33:45.186151 ip-10-0-138-193 kubenswrapper[2578]: I0602 21:33:45.185431 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/adf5f00d-bf02-4037-b6e7-92c6485f3e38-host-slash\") pod \"iptables-alerter-xbl27\" (UID: \"adf5f00d-bf02-4037-b6e7-92c6485f3e38\") " pod="openshift-network-operator/iptables-alerter-xbl27" Jun 02 21:33:45.186151 ip-10-0-138-193 kubenswrapper[2578]: I0602 21:33:45.185449 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/ecde3d34-b3a4-422b-9a2d-c8a4541cc718-systemd-units\") pod \"ovnkube-node-5zgzd\" (UID: \"ecde3d34-b3a4-422b-9a2d-c8a4541cc718\") " pod="openshift-ovn-kubernetes/ovnkube-node-5zgzd" Jun 02 21:33:45.186151 ip-10-0-138-193 kubenswrapper[2578]: I0602 21:33:45.185470 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/ecde3d34-b3a4-422b-9a2d-c8a4541cc718-run-systemd\") pod \"ovnkube-node-5zgzd\" (UID: \"ecde3d34-b3a4-422b-9a2d-c8a4541cc718\") " pod="openshift-ovn-kubernetes/ovnkube-node-5zgzd" Jun 02 21:33:45.186151 ip-10-0-138-193 kubenswrapper[2578]: I0602 21:33:45.185487 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/ecde3d34-b3a4-422b-9a2d-c8a4541cc718-etc-openvswitch\") pod \"ovnkube-node-5zgzd\" (UID: \"ecde3d34-b3a4-422b-9a2d-c8a4541cc718\") " pod="openshift-ovn-kubernetes/ovnkube-node-5zgzd" Jun 02 21:33:45.186151 ip-10-0-138-193 kubenswrapper[2578]: I0602 21:33:45.185511 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/ecde3d34-b3a4-422b-9a2d-c8a4541cc718-run-openvswitch\") pod \"ovnkube-node-5zgzd\" (UID: \"ecde3d34-b3a4-422b-9a2d-c8a4541cc718\") " pod="openshift-ovn-kubernetes/ovnkube-node-5zgzd" Jun 02 21:33:45.186151 ip-10-0-138-193 kubenswrapper[2578]: I0602 21:33:45.185533 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/3ea59100-2e7e-4a44-8ec1-c3f7e3472835-multus-conf-dir\") pod \"multus-p74k8\" (UID: \"3ea59100-2e7e-4a44-8ec1-c3f7e3472835\") " pod="openshift-multus/multus-p74k8" Jun 02 21:33:45.186151 ip-10-0-138-193 kubenswrapper[2578]: I0602 21:33:45.185549 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/fd30f6e0-874c-411b-b8c6-0df250364c15-host\") pod \"node-ca-mnnsl\" (UID: \"fd30f6e0-874c-411b-b8c6-0df250364c15\") " pod="openshift-image-registry/node-ca-mnnsl" Jun 02 21:33:45.186151 ip-10-0-138-193 kubenswrapper[2578]: I0602 21:33:45.185582 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/96c320b0-e239-4e96-aaae-28255100dae4-kubelet-dir\") pod \"aws-ebs-csi-driver-node-9xsr6\" (UID: \"96c320b0-e239-4e96-aaae-28255100dae4\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-9xsr6" Jun 02 21:33:45.186151 ip-10-0-138-193 kubenswrapper[2578]: I0602 21:33:45.185616 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/3ea59100-2e7e-4a44-8ec1-c3f7e3472835-system-cni-dir\") pod \"multus-p74k8\" (UID: \"3ea59100-2e7e-4a44-8ec1-c3f7e3472835\") " pod="openshift-multus/multus-p74k8" Jun 02 21:33:45.186151 ip-10-0-138-193 kubenswrapper[2578]: I0602 21:33:45.185652 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/96c320b0-e239-4e96-aaae-28255100dae4-etc-selinux\") pod \"aws-ebs-csi-driver-node-9xsr6\" (UID: \"96c320b0-e239-4e96-aaae-28255100dae4\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-9xsr6" Jun 02 21:33:45.186151 ip-10-0-138-193 kubenswrapper[2578]: I0602 21:33:45.185687 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/f2c18898-cc9a-4645-bab8-9ac55c476c7f-cnibin\") pod \"multus-additional-cni-plugins-s7sgt\" (UID: \"f2c18898-cc9a-4645-bab8-9ac55c476c7f\") " pod="openshift-multus/multus-additional-cni-plugins-s7sgt" Jun 02 21:33:45.186151 ip-10-0-138-193 kubenswrapper[2578]: I0602 21:33:45.185712 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/f2c18898-cc9a-4645-bab8-9ac55c476c7f-cni-binary-copy\") pod \"multus-additional-cni-plugins-s7sgt\" (UID: \"f2c18898-cc9a-4645-bab8-9ac55c476c7f\") " pod="openshift-multus/multus-additional-cni-plugins-s7sgt" Jun 02 21:33:45.186151 ip-10-0-138-193 kubenswrapper[2578]: I0602 21:33:45.185736 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/ecde3d34-b3a4-422b-9a2d-c8a4541cc718-host-slash\") pod \"ovnkube-node-5zgzd\" (UID: \"ecde3d34-b3a4-422b-9a2d-c8a4541cc718\") " pod="openshift-ovn-kubernetes/ovnkube-node-5zgzd" Jun 02 21:33:45.186151 ip-10-0-138-193 kubenswrapper[2578]: I0602 21:33:45.185761 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/ecde3d34-b3a4-422b-9a2d-c8a4541cc718-node-log\") pod \"ovnkube-node-5zgzd\" (UID: \"ecde3d34-b3a4-422b-9a2d-c8a4541cc718\") " pod="openshift-ovn-kubernetes/ovnkube-node-5zgzd" Jun 02 21:33:45.186151 ip-10-0-138-193 kubenswrapper[2578]: I0602 21:33:45.185783 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/ecde3d34-b3a4-422b-9a2d-c8a4541cc718-host-run-ovn-kubernetes\") pod \"ovnkube-node-5zgzd\" (UID: \"ecde3d34-b3a4-422b-9a2d-c8a4541cc718\") " pod="openshift-ovn-kubernetes/ovnkube-node-5zgzd" Jun 02 21:33:45.186151 ip-10-0-138-193 kubenswrapper[2578]: I0602 21:33:45.185809 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/3ea59100-2e7e-4a44-8ec1-c3f7e3472835-host-var-lib-cni-bin\") pod \"multus-p74k8\" (UID: \"3ea59100-2e7e-4a44-8ec1-c3f7e3472835\") " pod="openshift-multus/multus-p74k8" Jun 02 21:33:45.186739 ip-10-0-138-193 kubenswrapper[2578]: I0602 21:33:45.185832 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/3ea59100-2e7e-4a44-8ec1-c3f7e3472835-host-var-lib-kubelet\") pod \"multus-p74k8\" (UID: \"3ea59100-2e7e-4a44-8ec1-c3f7e3472835\") " pod="openshift-multus/multus-p74k8" Jun 02 21:33:45.186739 ip-10-0-138-193 kubenswrapper[2578]: I0602 21:33:45.185857 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/96c320b0-e239-4e96-aaae-28255100dae4-socket-dir\") pod \"aws-ebs-csi-driver-node-9xsr6\" (UID: \"96c320b0-e239-4e96-aaae-28255100dae4\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-9xsr6" Jun 02 21:33:45.186739 ip-10-0-138-193 kubenswrapper[2578]: I0602 21:33:45.185883 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/f2c18898-cc9a-4645-bab8-9ac55c476c7f-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-s7sgt\" (UID: \"f2c18898-cc9a-4645-bab8-9ac55c476c7f\") " pod="openshift-multus/multus-additional-cni-plugins-s7sgt" Jun 02 21:33:45.186739 ip-10-0-138-193 kubenswrapper[2578]: I0602 21:33:45.185907 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/ecde3d34-b3a4-422b-9a2d-c8a4541cc718-host-cni-bin\") pod \"ovnkube-node-5zgzd\" (UID: \"ecde3d34-b3a4-422b-9a2d-c8a4541cc718\") " pod="openshift-ovn-kubernetes/ovnkube-node-5zgzd" Jun 02 21:33:45.186739 ip-10-0-138-193 kubenswrapper[2578]: I0602 21:33:45.185928 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-7nkd4\" (UniqueName: \"kubernetes.io/projected/4d2236cd-d674-4c20-821e-7173b6db4b74-kube-api-access-7nkd4\") pod \"node-resolver-vfdfn\" (UID: \"4d2236cd-d674-4c20-821e-7173b6db4b74\") " pod="openshift-dns/node-resolver-vfdfn" Jun 02 21:33:45.186739 ip-10-0-138-193 kubenswrapper[2578]: I0602 21:33:45.185951 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/ecde3d34-b3a4-422b-9a2d-c8a4541cc718-env-overrides\") pod \"ovnkube-node-5zgzd\" (UID: \"ecde3d34-b3a4-422b-9a2d-c8a4541cc718\") " pod="openshift-ovn-kubernetes/ovnkube-node-5zgzd" Jun 02 21:33:45.186739 ip-10-0-138-193 kubenswrapper[2578]: I0602 21:33:45.185977 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/3ea59100-2e7e-4a44-8ec1-c3f7e3472835-cni-binary-copy\") pod \"multus-p74k8\" (UID: \"3ea59100-2e7e-4a44-8ec1-c3f7e3472835\") " pod="openshift-multus/multus-p74k8" Jun 02 21:33:45.186739 ip-10-0-138-193 kubenswrapper[2578]: I0602 21:33:45.185999 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/3ea59100-2e7e-4a44-8ec1-c3f7e3472835-etc-kubernetes\") pod \"multus-p74k8\" (UID: \"3ea59100-2e7e-4a44-8ec1-c3f7e3472835\") " pod="openshift-multus/multus-p74k8" Jun 02 21:33:45.186739 ip-10-0-138-193 kubenswrapper[2578]: I0602 21:33:45.186022 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-cbxtf\" (UniqueName: \"kubernetes.io/projected/ecde3d34-b3a4-422b-9a2d-c8a4541cc718-kube-api-access-cbxtf\") pod \"ovnkube-node-5zgzd\" (UID: \"ecde3d34-b3a4-422b-9a2d-c8a4541cc718\") " pod="openshift-ovn-kubernetes/ovnkube-node-5zgzd" Jun 02 21:33:45.186739 ip-10-0-138-193 kubenswrapper[2578]: I0602 21:33:45.186055 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-pqg2m\" (UniqueName: \"kubernetes.io/projected/f2c18898-cc9a-4645-bab8-9ac55c476c7f-kube-api-access-pqg2m\") pod \"multus-additional-cni-plugins-s7sgt\" (UID: \"f2c18898-cc9a-4645-bab8-9ac55c476c7f\") " pod="openshift-multus/multus-additional-cni-plugins-s7sgt" Jun 02 21:33:45.186739 ip-10-0-138-193 kubenswrapper[2578]: I0602 21:33:45.186096 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/ecde3d34-b3a4-422b-9a2d-c8a4541cc718-host-run-netns\") pod \"ovnkube-node-5zgzd\" (UID: \"ecde3d34-b3a4-422b-9a2d-c8a4541cc718\") " pod="openshift-ovn-kubernetes/ovnkube-node-5zgzd" Jun 02 21:33:45.186739 ip-10-0-138-193 kubenswrapper[2578]: I0602 21:33:45.186120 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/3ea59100-2e7e-4a44-8ec1-c3f7e3472835-multus-cni-dir\") pod \"multus-p74k8\" (UID: \"3ea59100-2e7e-4a44-8ec1-c3f7e3472835\") " pod="openshift-multus/multus-p74k8" Jun 02 21:33:45.186739 ip-10-0-138-193 kubenswrapper[2578]: I0602 21:33:45.186146 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/3ea59100-2e7e-4a44-8ec1-c3f7e3472835-cnibin\") pod \"multus-p74k8\" (UID: \"3ea59100-2e7e-4a44-8ec1-c3f7e3472835\") " pod="openshift-multus/multus-p74k8" Jun 02 21:33:45.186739 ip-10-0-138-193 kubenswrapper[2578]: I0602 21:33:45.186167 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/3ea59100-2e7e-4a44-8ec1-c3f7e3472835-os-release\") pod \"multus-p74k8\" (UID: \"3ea59100-2e7e-4a44-8ec1-c3f7e3472835\") " pod="openshift-multus/multus-p74k8" Jun 02 21:33:45.186739 ip-10-0-138-193 kubenswrapper[2578]: I0602 21:33:45.186410 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/ecde3d34-b3a4-422b-9a2d-c8a4541cc718-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-5zgzd\" (UID: \"ecde3d34-b3a4-422b-9a2d-c8a4541cc718\") " pod="openshift-ovn-kubernetes/ovnkube-node-5zgzd" Jun 02 21:33:45.186739 ip-10-0-138-193 kubenswrapper[2578]: I0602 21:33:45.186446 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/ecde3d34-b3a4-422b-9a2d-c8a4541cc718-ovnkube-script-lib\") pod \"ovnkube-node-5zgzd\" (UID: \"ecde3d34-b3a4-422b-9a2d-c8a4541cc718\") " pod="openshift-ovn-kubernetes/ovnkube-node-5zgzd" Jun 02 21:33:45.274067 ip-10-0-138-193 kubenswrapper[2578]: I0602 21:33:45.274039 2578 desired_state_of_world_populator.go:158] "Finished populating initial desired state of world" Jun 02 21:33:45.275665 ip-10-0-138-193 kubenswrapper[2578]: I0602 21:33:45.275637 2578 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kubelet-serving" expiration="2028-06-01 21:28:44 +0000 UTC" deadline="2027-11-29 04:23:22.474684729 +0000 UTC" Jun 02 21:33:45.275665 ip-10-0-138-193 kubenswrapper[2578]: I0602 21:33:45.275665 2578 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kubelet-serving" sleep="13062h49m37.199022895s" Jun 02 21:33:45.287186 ip-10-0-138-193 kubenswrapper[2578]: I0602 21:33:45.287158 2578 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/3ea59100-2e7e-4a44-8ec1-c3f7e3472835-host-run-netns\") pod \"multus-p74k8\" (UID: \"3ea59100-2e7e-4a44-8ec1-c3f7e3472835\") " pod="openshift-multus/multus-p74k8" Jun 02 21:33:45.287309 ip-10-0-138-193 kubenswrapper[2578]: I0602 21:33:45.287193 2578 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/adfce93b-f07e-480a-af26-5dc7df23fa48-metrics-certs\") pod \"network-metrics-daemon-k2vdd\" (UID: \"adfce93b-f07e-480a-af26-5dc7df23fa48\") " pod="openshift-multus/network-metrics-daemon-k2vdd" Jun 02 21:33:45.287309 ip-10-0-138-193 kubenswrapper[2578]: I0602 21:33:45.287210 2578 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/f2c18898-cc9a-4645-bab8-9ac55c476c7f-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-s7sgt\" (UID: \"f2c18898-cc9a-4645-bab8-9ac55c476c7f\") " pod="openshift-multus/multus-additional-cni-plugins-s7sgt" Jun 02 21:33:45.287309 ip-10-0-138-193 kubenswrapper[2578]: I0602 21:33:45.287235 2578 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/adf5f00d-bf02-4037-b6e7-92c6485f3e38-host-slash\") pod \"iptables-alerter-xbl27\" (UID: \"adf5f00d-bf02-4037-b6e7-92c6485f3e38\") " pod="openshift-network-operator/iptables-alerter-xbl27" Jun 02 21:33:45.287309 ip-10-0-138-193 kubenswrapper[2578]: I0602 21:33:45.287262 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/ebd8238d-c142-4303-9f5c-e61073fd0920-agent-certs\") pod \"konnectivity-agent-q78cn\" (UID: \"ebd8238d-c142-4303-9f5c-e61073fd0920\") " pod="kube-system/konnectivity-agent-q78cn" Jun 02 21:33:45.287309 ip-10-0-138-193 kubenswrapper[2578]: I0602 21:33:45.287281 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/3ea59100-2e7e-4a44-8ec1-c3f7e3472835-host-run-netns\") pod \"multus-p74k8\" (UID: \"3ea59100-2e7e-4a44-8ec1-c3f7e3472835\") " pod="openshift-multus/multus-p74k8" Jun 02 21:33:45.287309 ip-10-0-138-193 kubenswrapper[2578]: I0602 21:33:45.287285 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/52db7cf8-54c4-4dce-a960-843c4cc11168-sys\") pod \"tuned-297ws\" (UID: \"52db7cf8-54c4-4dce-a960-843c4cc11168\") " pod="openshift-cluster-node-tuning-operator/tuned-297ws" Jun 02 21:33:45.287564 ip-10-0-138-193 kubenswrapper[2578]: I0602 21:33:45.287327 2578 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/ecde3d34-b3a4-422b-9a2d-c8a4541cc718-systemd-units\") pod \"ovnkube-node-5zgzd\" (UID: \"ecde3d34-b3a4-422b-9a2d-c8a4541cc718\") " pod="openshift-ovn-kubernetes/ovnkube-node-5zgzd" Jun 02 21:33:45.287564 ip-10-0-138-193 kubenswrapper[2578]: E0602 21:33:45.287333 2578 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jun 02 21:33:45.287564 ip-10-0-138-193 kubenswrapper[2578]: I0602 21:33:45.287347 2578 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/ecde3d34-b3a4-422b-9a2d-c8a4541cc718-run-systemd\") pod \"ovnkube-node-5zgzd\" (UID: \"ecde3d34-b3a4-422b-9a2d-c8a4541cc718\") " pod="openshift-ovn-kubernetes/ovnkube-node-5zgzd" Jun 02 21:33:45.287564 ip-10-0-138-193 kubenswrapper[2578]: I0602 21:33:45.287368 2578 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/ecde3d34-b3a4-422b-9a2d-c8a4541cc718-etc-openvswitch\") pod \"ovnkube-node-5zgzd\" (UID: \"ecde3d34-b3a4-422b-9a2d-c8a4541cc718\") " pod="openshift-ovn-kubernetes/ovnkube-node-5zgzd" Jun 02 21:33:45.287564 ip-10-0-138-193 kubenswrapper[2578]: E0602 21:33:45.287402 2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/adfce93b-f07e-480a-af26-5dc7df23fa48-metrics-certs podName:adfce93b-f07e-480a-af26-5dc7df23fa48 nodeName:}" failed. No retries permitted until 2026-06-02 21:33:45.787373418 +0000 UTC m=+3.039271316 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/adfce93b-f07e-480a-af26-5dc7df23fa48-metrics-certs") pod "network-metrics-daemon-k2vdd" (UID: "adfce93b-f07e-480a-af26-5dc7df23fa48") : object "openshift-multus"/"metrics-daemon-secret" not registered Jun 02 21:33:45.287564 ip-10-0-138-193 kubenswrapper[2578]: I0602 21:33:45.287407 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/ecde3d34-b3a4-422b-9a2d-c8a4541cc718-etc-openvswitch\") pod \"ovnkube-node-5zgzd\" (UID: \"ecde3d34-b3a4-422b-9a2d-c8a4541cc718\") " pod="openshift-ovn-kubernetes/ovnkube-node-5zgzd" Jun 02 21:33:45.287564 ip-10-0-138-193 kubenswrapper[2578]: I0602 21:33:45.287429 2578 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/ecde3d34-b3a4-422b-9a2d-c8a4541cc718-run-openvswitch\") pod \"ovnkube-node-5zgzd\" (UID: \"ecde3d34-b3a4-422b-9a2d-c8a4541cc718\") " pod="openshift-ovn-kubernetes/ovnkube-node-5zgzd" Jun 02 21:33:45.287564 ip-10-0-138-193 kubenswrapper[2578]: I0602 21:33:45.287439 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/ecde3d34-b3a4-422b-9a2d-c8a4541cc718-systemd-units\") pod \"ovnkube-node-5zgzd\" (UID: \"ecde3d34-b3a4-422b-9a2d-c8a4541cc718\") " pod="openshift-ovn-kubernetes/ovnkube-node-5zgzd" Jun 02 21:33:45.287564 ip-10-0-138-193 kubenswrapper[2578]: I0602 21:33:45.287456 2578 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/3ea59100-2e7e-4a44-8ec1-c3f7e3472835-multus-conf-dir\") pod \"multus-p74k8\" (UID: \"3ea59100-2e7e-4a44-8ec1-c3f7e3472835\") " pod="openshift-multus/multus-p74k8" Jun 02 21:33:45.287564 ip-10-0-138-193 kubenswrapper[2578]: I0602 21:33:45.287468 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/ecde3d34-b3a4-422b-9a2d-c8a4541cc718-run-systemd\") pod \"ovnkube-node-5zgzd\" (UID: \"ecde3d34-b3a4-422b-9a2d-c8a4541cc718\") " pod="openshift-ovn-kubernetes/ovnkube-node-5zgzd" Jun 02 21:33:45.287564 ip-10-0-138-193 kubenswrapper[2578]: I0602 21:33:45.287481 2578 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/fd30f6e0-874c-411b-b8c6-0df250364c15-host\") pod \"node-ca-mnnsl\" (UID: \"fd30f6e0-874c-411b-b8c6-0df250364c15\") " pod="openshift-image-registry/node-ca-mnnsl" Jun 02 21:33:45.287564 ip-10-0-138-193 kubenswrapper[2578]: I0602 21:33:45.287492 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/ecde3d34-b3a4-422b-9a2d-c8a4541cc718-run-openvswitch\") pod \"ovnkube-node-5zgzd\" (UID: \"ecde3d34-b3a4-422b-9a2d-c8a4541cc718\") " pod="openshift-ovn-kubernetes/ovnkube-node-5zgzd" Jun 02 21:33:45.287564 ip-10-0-138-193 kubenswrapper[2578]: I0602 21:33:45.287508 2578 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/96c320b0-e239-4e96-aaae-28255100dae4-kubelet-dir\") pod \"aws-ebs-csi-driver-node-9xsr6\" (UID: \"96c320b0-e239-4e96-aaae-28255100dae4\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-9xsr6" Jun 02 21:33:45.287564 ip-10-0-138-193 kubenswrapper[2578]: I0602 21:33:45.287535 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/52db7cf8-54c4-4dce-a960-843c4cc11168-etc-kubernetes\") pod \"tuned-297ws\" (UID: \"52db7cf8-54c4-4dce-a960-843c4cc11168\") " pod="openshift-cluster-node-tuning-operator/tuned-297ws" Jun 02 21:33:45.287564 ip-10-0-138-193 kubenswrapper[2578]: I0602 21:33:45.287560 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/52db7cf8-54c4-4dce-a960-843c4cc11168-etc-sysctl-conf\") pod \"tuned-297ws\" (UID: \"52db7cf8-54c4-4dce-a960-843c4cc11168\") " pod="openshift-cluster-node-tuning-operator/tuned-297ws" Jun 02 21:33:45.288197 ip-10-0-138-193 kubenswrapper[2578]: I0602 21:33:45.287583 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/52db7cf8-54c4-4dce-a960-843c4cc11168-tmp\") pod \"tuned-297ws\" (UID: \"52db7cf8-54c4-4dce-a960-843c4cc11168\") " pod="openshift-cluster-node-tuning-operator/tuned-297ws" Jun 02 21:33:45.288197 ip-10-0-138-193 kubenswrapper[2578]: I0602 21:33:45.287608 2578 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/3ea59100-2e7e-4a44-8ec1-c3f7e3472835-system-cni-dir\") pod \"multus-p74k8\" (UID: \"3ea59100-2e7e-4a44-8ec1-c3f7e3472835\") " pod="openshift-multus/multus-p74k8" Jun 02 21:33:45.288197 ip-10-0-138-193 kubenswrapper[2578]: I0602 21:33:45.287632 2578 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/96c320b0-e239-4e96-aaae-28255100dae4-etc-selinux\") pod \"aws-ebs-csi-driver-node-9xsr6\" (UID: \"96c320b0-e239-4e96-aaae-28255100dae4\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-9xsr6" Jun 02 21:33:45.288197 ip-10-0-138-193 kubenswrapper[2578]: I0602 21:33:45.287660 2578 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/f2c18898-cc9a-4645-bab8-9ac55c476c7f-cnibin\") pod \"multus-additional-cni-plugins-s7sgt\" (UID: \"f2c18898-cc9a-4645-bab8-9ac55c476c7f\") " pod="openshift-multus/multus-additional-cni-plugins-s7sgt" Jun 02 21:33:45.288197 ip-10-0-138-193 kubenswrapper[2578]: I0602 21:33:45.287696 2578 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/f2c18898-cc9a-4645-bab8-9ac55c476c7f-cni-binary-copy\") pod \"multus-additional-cni-plugins-s7sgt\" (UID: \"f2c18898-cc9a-4645-bab8-9ac55c476c7f\") " pod="openshift-multus/multus-additional-cni-plugins-s7sgt" Jun 02 21:33:45.288197 ip-10-0-138-193 kubenswrapper[2578]: I0602 21:33:45.287709 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/f2c18898-cc9a-4645-bab8-9ac55c476c7f-cnibin\") pod \"multus-additional-cni-plugins-s7sgt\" (UID: \"f2c18898-cc9a-4645-bab8-9ac55c476c7f\") " pod="openshift-multus/multus-additional-cni-plugins-s7sgt" Jun 02 21:33:45.288197 ip-10-0-138-193 kubenswrapper[2578]: I0602 21:33:45.287723 2578 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/ecde3d34-b3a4-422b-9a2d-c8a4541cc718-host-slash\") pod \"ovnkube-node-5zgzd\" (UID: \"ecde3d34-b3a4-422b-9a2d-c8a4541cc718\") " pod="openshift-ovn-kubernetes/ovnkube-node-5zgzd" Jun 02 21:33:45.288197 ip-10-0-138-193 kubenswrapper[2578]: I0602 21:33:45.287742 2578 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/ecde3d34-b3a4-422b-9a2d-c8a4541cc718-node-log\") pod \"ovnkube-node-5zgzd\" (UID: \"ecde3d34-b3a4-422b-9a2d-c8a4541cc718\") " pod="openshift-ovn-kubernetes/ovnkube-node-5zgzd" Jun 02 21:33:45.288197 ip-10-0-138-193 kubenswrapper[2578]: I0602 21:33:45.287750 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/adf5f00d-bf02-4037-b6e7-92c6485f3e38-host-slash\") pod \"iptables-alerter-xbl27\" (UID: \"adf5f00d-bf02-4037-b6e7-92c6485f3e38\") " pod="openshift-network-operator/iptables-alerter-xbl27" Jun 02 21:33:45.288197 ip-10-0-138-193 kubenswrapper[2578]: I0602 21:33:45.287757 2578 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/ecde3d34-b3a4-422b-9a2d-c8a4541cc718-host-run-ovn-kubernetes\") pod \"ovnkube-node-5zgzd\" (UID: \"ecde3d34-b3a4-422b-9a2d-c8a4541cc718\") " pod="openshift-ovn-kubernetes/ovnkube-node-5zgzd" Jun 02 21:33:45.288197 ip-10-0-138-193 kubenswrapper[2578]: I0602 21:33:45.287804 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/52db7cf8-54c4-4dce-a960-843c4cc11168-host\") pod \"tuned-297ws\" (UID: \"52db7cf8-54c4-4dce-a960-843c4cc11168\") " pod="openshift-cluster-node-tuning-operator/tuned-297ws" Jun 02 21:33:45.288197 ip-10-0-138-193 kubenswrapper[2578]: I0602 21:33:45.287805 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/f2c18898-cc9a-4645-bab8-9ac55c476c7f-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-s7sgt\" (UID: \"f2c18898-cc9a-4645-bab8-9ac55c476c7f\") " pod="openshift-multus/multus-additional-cni-plugins-s7sgt" Jun 02 21:33:45.288197 ip-10-0-138-193 kubenswrapper[2578]: I0602 21:33:45.287844 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/3ea59100-2e7e-4a44-8ec1-c3f7e3472835-system-cni-dir\") pod \"multus-p74k8\" (UID: \"3ea59100-2e7e-4a44-8ec1-c3f7e3472835\") " pod="openshift-multus/multus-p74k8" Jun 02 21:33:45.288197 ip-10-0-138-193 kubenswrapper[2578]: I0602 21:33:45.287857 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/96c320b0-e239-4e96-aaae-28255100dae4-kubelet-dir\") pod \"aws-ebs-csi-driver-node-9xsr6\" (UID: \"96c320b0-e239-4e96-aaae-28255100dae4\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-9xsr6" Jun 02 21:33:45.288197 ip-10-0-138-193 kubenswrapper[2578]: I0602 21:33:45.287896 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/ecde3d34-b3a4-422b-9a2d-c8a4541cc718-host-run-ovn-kubernetes\") pod \"ovnkube-node-5zgzd\" (UID: \"ecde3d34-b3a4-422b-9a2d-c8a4541cc718\") " pod="openshift-ovn-kubernetes/ovnkube-node-5zgzd" Jun 02 21:33:45.288197 ip-10-0-138-193 kubenswrapper[2578]: I0602 21:33:45.287905 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/ecde3d34-b3a4-422b-9a2d-c8a4541cc718-node-log\") pod \"ovnkube-node-5zgzd\" (UID: \"ecde3d34-b3a4-422b-9a2d-c8a4541cc718\") " pod="openshift-ovn-kubernetes/ovnkube-node-5zgzd" Jun 02 21:33:45.288197 ip-10-0-138-193 kubenswrapper[2578]: I0602 21:33:45.287929 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/ecde3d34-b3a4-422b-9a2d-c8a4541cc718-host-slash\") pod \"ovnkube-node-5zgzd\" (UID: \"ecde3d34-b3a4-422b-9a2d-c8a4541cc718\") " pod="openshift-ovn-kubernetes/ovnkube-node-5zgzd" Jun 02 21:33:45.288956 ip-10-0-138-193 kubenswrapper[2578]: I0602 21:33:45.287970 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/3ea59100-2e7e-4a44-8ec1-c3f7e3472835-multus-conf-dir\") pod \"multus-p74k8\" (UID: \"3ea59100-2e7e-4a44-8ec1-c3f7e3472835\") " pod="openshift-multus/multus-p74k8" Jun 02 21:33:45.288956 ip-10-0-138-193 kubenswrapper[2578]: I0602 21:33:45.287984 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host\" (UniqueName: \"kubernetes.io/host-path/fd30f6e0-874c-411b-b8c6-0df250364c15-host\") pod \"node-ca-mnnsl\" (UID: \"fd30f6e0-874c-411b-b8c6-0df250364c15\") " pod="openshift-image-registry/node-ca-mnnsl" Jun 02 21:33:45.288956 ip-10-0-138-193 kubenswrapper[2578]: I0602 21:33:45.287977 2578 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/3ea59100-2e7e-4a44-8ec1-c3f7e3472835-host-var-lib-cni-bin\") pod \"multus-p74k8\" (UID: \"3ea59100-2e7e-4a44-8ec1-c3f7e3472835\") " pod="openshift-multus/multus-p74k8" Jun 02 21:33:45.288956 ip-10-0-138-193 kubenswrapper[2578]: I0602 21:33:45.288026 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/3ea59100-2e7e-4a44-8ec1-c3f7e3472835-host-var-lib-cni-bin\") pod \"multus-p74k8\" (UID: \"3ea59100-2e7e-4a44-8ec1-c3f7e3472835\") " pod="openshift-multus/multus-p74k8" Jun 02 21:33:45.288956 ip-10-0-138-193 kubenswrapper[2578]: I0602 21:33:45.288025 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/96c320b0-e239-4e96-aaae-28255100dae4-etc-selinux\") pod \"aws-ebs-csi-driver-node-9xsr6\" (UID: \"96c320b0-e239-4e96-aaae-28255100dae4\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-9xsr6" Jun 02 21:33:45.288956 ip-10-0-138-193 kubenswrapper[2578]: I0602 21:33:45.288065 2578 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/3ea59100-2e7e-4a44-8ec1-c3f7e3472835-host-var-lib-kubelet\") pod \"multus-p74k8\" (UID: \"3ea59100-2e7e-4a44-8ec1-c3f7e3472835\") " pod="openshift-multus/multus-p74k8" Jun 02 21:33:45.288956 ip-10-0-138-193 kubenswrapper[2578]: I0602 21:33:45.288108 2578 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/96c320b0-e239-4e96-aaae-28255100dae4-socket-dir\") pod \"aws-ebs-csi-driver-node-9xsr6\" (UID: \"96c320b0-e239-4e96-aaae-28255100dae4\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-9xsr6" Jun 02 21:33:45.288956 ip-10-0-138-193 kubenswrapper[2578]: I0602 21:33:45.288116 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/3ea59100-2e7e-4a44-8ec1-c3f7e3472835-host-var-lib-kubelet\") pod \"multus-p74k8\" (UID: \"3ea59100-2e7e-4a44-8ec1-c3f7e3472835\") " pod="openshift-multus/multus-p74k8" Jun 02 21:33:45.288956 ip-10-0-138-193 kubenswrapper[2578]: I0602 21:33:45.288181 2578 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/f2c18898-cc9a-4645-bab8-9ac55c476c7f-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-s7sgt\" (UID: \"f2c18898-cc9a-4645-bab8-9ac55c476c7f\") " pod="openshift-multus/multus-additional-cni-plugins-s7sgt" Jun 02 21:33:45.288956 ip-10-0-138-193 kubenswrapper[2578]: I0602 21:33:45.288220 2578 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/ecde3d34-b3a4-422b-9a2d-c8a4541cc718-host-cni-bin\") pod \"ovnkube-node-5zgzd\" (UID: \"ecde3d34-b3a4-422b-9a2d-c8a4541cc718\") " pod="openshift-ovn-kubernetes/ovnkube-node-5zgzd" Jun 02 21:33:45.288956 ip-10-0-138-193 kubenswrapper[2578]: I0602 21:33:45.288224 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/96c320b0-e239-4e96-aaae-28255100dae4-socket-dir\") pod \"aws-ebs-csi-driver-node-9xsr6\" (UID: \"96c320b0-e239-4e96-aaae-28255100dae4\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-9xsr6" Jun 02 21:33:45.288956 ip-10-0-138-193 kubenswrapper[2578]: I0602 21:33:45.288245 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/52db7cf8-54c4-4dce-a960-843c4cc11168-etc-systemd\") pod \"tuned-297ws\" (UID: \"52db7cf8-54c4-4dce-a960-843c4cc11168\") " pod="openshift-cluster-node-tuning-operator/tuned-297ws" Jun 02 21:33:45.288956 ip-10-0-138-193 kubenswrapper[2578]: I0602 21:33:45.288267 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-s9xb7\" (UniqueName: \"kubernetes.io/projected/52db7cf8-54c4-4dce-a960-843c4cc11168-kube-api-access-s9xb7\") pod \"tuned-297ws\" (UID: \"52db7cf8-54c4-4dce-a960-843c4cc11168\") " pod="openshift-cluster-node-tuning-operator/tuned-297ws" Jun 02 21:33:45.288956 ip-10-0-138-193 kubenswrapper[2578]: I0602 21:33:45.288266 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/f2c18898-cc9a-4645-bab8-9ac55c476c7f-cni-binary-copy\") pod \"multus-additional-cni-plugins-s7sgt\" (UID: \"f2c18898-cc9a-4645-bab8-9ac55c476c7f\") " pod="openshift-multus/multus-additional-cni-plugins-s7sgt" Jun 02 21:33:45.288956 ip-10-0-138-193 kubenswrapper[2578]: I0602 21:33:45.288274 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/ecde3d34-b3a4-422b-9a2d-c8a4541cc718-host-cni-bin\") pod \"ovnkube-node-5zgzd\" (UID: \"ecde3d34-b3a4-422b-9a2d-c8a4541cc718\") " pod="openshift-ovn-kubernetes/ovnkube-node-5zgzd" Jun 02 21:33:45.288956 ip-10-0-138-193 kubenswrapper[2578]: I0602 21:33:45.288305 2578 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-7nkd4\" (UniqueName: \"kubernetes.io/projected/4d2236cd-d674-4c20-821e-7173b6db4b74-kube-api-access-7nkd4\") pod \"node-resolver-vfdfn\" (UID: \"4d2236cd-d674-4c20-821e-7173b6db4b74\") " pod="openshift-dns/node-resolver-vfdfn" Jun 02 21:33:45.288956 ip-10-0-138-193 kubenswrapper[2578]: I0602 21:33:45.288328 2578 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/ecde3d34-b3a4-422b-9a2d-c8a4541cc718-env-overrides\") pod \"ovnkube-node-5zgzd\" (UID: \"ecde3d34-b3a4-422b-9a2d-c8a4541cc718\") " pod="openshift-ovn-kubernetes/ovnkube-node-5zgzd" Jun 02 21:33:45.289698 ip-10-0-138-193 kubenswrapper[2578]: I0602 21:33:45.288351 2578 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/3ea59100-2e7e-4a44-8ec1-c3f7e3472835-cni-binary-copy\") pod \"multus-p74k8\" (UID: \"3ea59100-2e7e-4a44-8ec1-c3f7e3472835\") " pod="openshift-multus/multus-p74k8" Jun 02 21:33:45.289698 ip-10-0-138-193 kubenswrapper[2578]: I0602 21:33:45.288375 2578 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/3ea59100-2e7e-4a44-8ec1-c3f7e3472835-etc-kubernetes\") pod \"multus-p74k8\" (UID: \"3ea59100-2e7e-4a44-8ec1-c3f7e3472835\") " pod="openshift-multus/multus-p74k8" Jun 02 21:33:45.289698 ip-10-0-138-193 kubenswrapper[2578]: I0602 21:33:45.288399 2578 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-cbxtf\" (UniqueName: \"kubernetes.io/projected/ecde3d34-b3a4-422b-9a2d-c8a4541cc718-kube-api-access-cbxtf\") pod \"ovnkube-node-5zgzd\" (UID: \"ecde3d34-b3a4-422b-9a2d-c8a4541cc718\") " pod="openshift-ovn-kubernetes/ovnkube-node-5zgzd" Jun 02 21:33:45.289698 ip-10-0-138-193 kubenswrapper[2578]: I0602 21:33:45.288430 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/ebd8238d-c142-4303-9f5c-e61073fd0920-konnectivity-ca\") pod \"konnectivity-agent-q78cn\" (UID: \"ebd8238d-c142-4303-9f5c-e61073fd0920\") " pod="kube-system/konnectivity-agent-q78cn" Jun 02 21:33:45.289698 ip-10-0-138-193 kubenswrapper[2578]: I0602 21:33:45.288456 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run\" (UniqueName: \"kubernetes.io/host-path/52db7cf8-54c4-4dce-a960-843c4cc11168-run\") pod \"tuned-297ws\" (UID: \"52db7cf8-54c4-4dce-a960-843c4cc11168\") " pod="openshift-cluster-node-tuning-operator/tuned-297ws" Jun 02 21:33:45.289698 ip-10-0-138-193 kubenswrapper[2578]: I0602 21:33:45.288473 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/3ea59100-2e7e-4a44-8ec1-c3f7e3472835-etc-kubernetes\") pod \"multus-p74k8\" (UID: \"3ea59100-2e7e-4a44-8ec1-c3f7e3472835\") " pod="openshift-multus/multus-p74k8" Jun 02 21:33:45.289698 ip-10-0-138-193 kubenswrapper[2578]: I0602 21:33:45.288479 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/52db7cf8-54c4-4dce-a960-843c4cc11168-lib-modules\") pod \"tuned-297ws\" (UID: \"52db7cf8-54c4-4dce-a960-843c4cc11168\") " pod="openshift-cluster-node-tuning-operator/tuned-297ws" Jun 02 21:33:45.289698 ip-10-0-138-193 kubenswrapper[2578]: I0602 21:33:45.288503 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/52db7cf8-54c4-4dce-a960-843c4cc11168-var-lib-kubelet\") pod \"tuned-297ws\" (UID: \"52db7cf8-54c4-4dce-a960-843c4cc11168\") " pod="openshift-cluster-node-tuning-operator/tuned-297ws" Jun 02 21:33:45.289698 ip-10-0-138-193 kubenswrapper[2578]: I0602 21:33:45.288531 2578 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-pqg2m\" (UniqueName: \"kubernetes.io/projected/f2c18898-cc9a-4645-bab8-9ac55c476c7f-kube-api-access-pqg2m\") pod \"multus-additional-cni-plugins-s7sgt\" (UID: \"f2c18898-cc9a-4645-bab8-9ac55c476c7f\") " pod="openshift-multus/multus-additional-cni-plugins-s7sgt" Jun 02 21:33:45.289698 ip-10-0-138-193 kubenswrapper[2578]: I0602 21:33:45.288557 2578 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/ecde3d34-b3a4-422b-9a2d-c8a4541cc718-host-run-netns\") pod \"ovnkube-node-5zgzd\" (UID: \"ecde3d34-b3a4-422b-9a2d-c8a4541cc718\") " pod="openshift-ovn-kubernetes/ovnkube-node-5zgzd" Jun 02 21:33:45.289698 ip-10-0-138-193 kubenswrapper[2578]: I0602 21:33:45.288581 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/52db7cf8-54c4-4dce-a960-843c4cc11168-etc-sysctl-d\") pod \"tuned-297ws\" (UID: \"52db7cf8-54c4-4dce-a960-843c4cc11168\") " pod="openshift-cluster-node-tuning-operator/tuned-297ws" Jun 02 21:33:45.289698 ip-10-0-138-193 kubenswrapper[2578]: I0602 21:33:45.288606 2578 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/3ea59100-2e7e-4a44-8ec1-c3f7e3472835-multus-cni-dir\") pod \"multus-p74k8\" (UID: \"3ea59100-2e7e-4a44-8ec1-c3f7e3472835\") " pod="openshift-multus/multus-p74k8" Jun 02 21:33:45.289698 ip-10-0-138-193 kubenswrapper[2578]: I0602 21:33:45.288639 2578 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/3ea59100-2e7e-4a44-8ec1-c3f7e3472835-cnibin\") pod \"multus-p74k8\" (UID: \"3ea59100-2e7e-4a44-8ec1-c3f7e3472835\") " pod="openshift-multus/multus-p74k8" Jun 02 21:33:45.289698 ip-10-0-138-193 kubenswrapper[2578]: I0602 21:33:45.288634 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/ecde3d34-b3a4-422b-9a2d-c8a4541cc718-host-run-netns\") pod \"ovnkube-node-5zgzd\" (UID: \"ecde3d34-b3a4-422b-9a2d-c8a4541cc718\") " pod="openshift-ovn-kubernetes/ovnkube-node-5zgzd" Jun 02 21:33:45.289698 ip-10-0-138-193 kubenswrapper[2578]: I0602 21:33:45.288681 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/f2c18898-cc9a-4645-bab8-9ac55c476c7f-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-s7sgt\" (UID: \"f2c18898-cc9a-4645-bab8-9ac55c476c7f\") " pod="openshift-multus/multus-additional-cni-plugins-s7sgt" Jun 02 21:33:45.289698 ip-10-0-138-193 kubenswrapper[2578]: I0602 21:33:45.288695 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/3ea59100-2e7e-4a44-8ec1-c3f7e3472835-multus-cni-dir\") pod \"multus-p74k8\" (UID: \"3ea59100-2e7e-4a44-8ec1-c3f7e3472835\") " pod="openshift-multus/multus-p74k8" Jun 02 21:33:45.289698 ip-10-0-138-193 kubenswrapper[2578]: I0602 21:33:45.288719 2578 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/3ea59100-2e7e-4a44-8ec1-c3f7e3472835-os-release\") pod \"multus-p74k8\" (UID: \"3ea59100-2e7e-4a44-8ec1-c3f7e3472835\") " pod="openshift-multus/multus-p74k8" Jun 02 21:33:45.289698 ip-10-0-138-193 kubenswrapper[2578]: I0602 21:33:45.288725 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/3ea59100-2e7e-4a44-8ec1-c3f7e3472835-cnibin\") pod \"multus-p74k8\" (UID: \"3ea59100-2e7e-4a44-8ec1-c3f7e3472835\") " pod="openshift-multus/multus-p74k8" Jun 02 21:33:45.290521 ip-10-0-138-193 kubenswrapper[2578]: I0602 21:33:45.288754 2578 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/ecde3d34-b3a4-422b-9a2d-c8a4541cc718-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-5zgzd\" (UID: \"ecde3d34-b3a4-422b-9a2d-c8a4541cc718\") " pod="openshift-ovn-kubernetes/ovnkube-node-5zgzd" Jun 02 21:33:45.290521 ip-10-0-138-193 kubenswrapper[2578]: I0602 21:33:45.288794 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/ecde3d34-b3a4-422b-9a2d-c8a4541cc718-env-overrides\") pod \"ovnkube-node-5zgzd\" (UID: \"ecde3d34-b3a4-422b-9a2d-c8a4541cc718\") " pod="openshift-ovn-kubernetes/ovnkube-node-5zgzd" Jun 02 21:33:45.290521 ip-10-0-138-193 kubenswrapper[2578]: I0602 21:33:45.288796 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/3ea59100-2e7e-4a44-8ec1-c3f7e3472835-os-release\") pod \"multus-p74k8\" (UID: \"3ea59100-2e7e-4a44-8ec1-c3f7e3472835\") " pod="openshift-multus/multus-p74k8" Jun 02 21:33:45.290521 ip-10-0-138-193 kubenswrapper[2578]: I0602 21:33:45.288805 2578 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/ecde3d34-b3a4-422b-9a2d-c8a4541cc718-ovnkube-script-lib\") pod \"ovnkube-node-5zgzd\" (UID: \"ecde3d34-b3a4-422b-9a2d-c8a4541cc718\") " pod="openshift-ovn-kubernetes/ovnkube-node-5zgzd" Jun 02 21:33:45.290521 ip-10-0-138-193 kubenswrapper[2578]: I0602 21:33:45.288827 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/ecde3d34-b3a4-422b-9a2d-c8a4541cc718-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-5zgzd\" (UID: \"ecde3d34-b3a4-422b-9a2d-c8a4541cc718\") " pod="openshift-ovn-kubernetes/ovnkube-node-5zgzd" Jun 02 21:33:45.290521 ip-10-0-138-193 kubenswrapper[2578]: I0602 21:33:45.288858 2578 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-njxlp\" (UniqueName: \"kubernetes.io/projected/adf5f00d-bf02-4037-b6e7-92c6485f3e38-kube-api-access-njxlp\") pod \"iptables-alerter-xbl27\" (UID: \"adf5f00d-bf02-4037-b6e7-92c6485f3e38\") " pod="openshift-network-operator/iptables-alerter-xbl27" Jun 02 21:33:45.290521 ip-10-0-138-193 kubenswrapper[2578]: I0602 21:33:45.288881 2578 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/3ea59100-2e7e-4a44-8ec1-c3f7e3472835-host-run-k8s-cni-cncf-io\") pod \"multus-p74k8\" (UID: \"3ea59100-2e7e-4a44-8ec1-c3f7e3472835\") " pod="openshift-multus/multus-p74k8" Jun 02 21:33:45.290521 ip-10-0-138-193 kubenswrapper[2578]: I0602 21:33:45.288901 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/3ea59100-2e7e-4a44-8ec1-c3f7e3472835-cni-binary-copy\") pod \"multus-p74k8\" (UID: \"3ea59100-2e7e-4a44-8ec1-c3f7e3472835\") " pod="openshift-multus/multus-p74k8" Jun 02 21:33:45.290521 ip-10-0-138-193 kubenswrapper[2578]: I0602 21:33:45.288994 2578 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/3ea59100-2e7e-4a44-8ec1-c3f7e3472835-multus-daemon-config\") pod \"multus-p74k8\" (UID: \"3ea59100-2e7e-4a44-8ec1-c3f7e3472835\") " pod="openshift-multus/multus-p74k8" Jun 02 21:33:45.290521 ip-10-0-138-193 kubenswrapper[2578]: I0602 21:33:45.289031 2578 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/4d2236cd-d674-4c20-821e-7173b6db4b74-hosts-file\") pod \"node-resolver-vfdfn\" (UID: \"4d2236cd-d674-4c20-821e-7173b6db4b74\") " pod="openshift-dns/node-resolver-vfdfn" Jun 02 21:33:45.290521 ip-10-0-138-193 kubenswrapper[2578]: I0602 21:33:45.289090 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/3ea59100-2e7e-4a44-8ec1-c3f7e3472835-host-run-k8s-cni-cncf-io\") pod \"multus-p74k8\" (UID: \"3ea59100-2e7e-4a44-8ec1-c3f7e3472835\") " pod="openshift-multus/multus-p74k8" Jun 02 21:33:45.290521 ip-10-0-138-193 kubenswrapper[2578]: I0602 21:33:45.289118 2578 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/96c320b0-e239-4e96-aaae-28255100dae4-registration-dir\") pod \"aws-ebs-csi-driver-node-9xsr6\" (UID: \"96c320b0-e239-4e96-aaae-28255100dae4\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-9xsr6" Jun 02 21:33:45.290521 ip-10-0-138-193 kubenswrapper[2578]: I0602 21:33:45.289118 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/4d2236cd-d674-4c20-821e-7173b6db4b74-hosts-file\") pod \"node-resolver-vfdfn\" (UID: \"4d2236cd-d674-4c20-821e-7173b6db4b74\") " pod="openshift-dns/node-resolver-vfdfn" Jun 02 21:33:45.290521 ip-10-0-138-193 kubenswrapper[2578]: I0602 21:33:45.289158 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/96c320b0-e239-4e96-aaae-28255100dae4-registration-dir\") pod \"aws-ebs-csi-driver-node-9xsr6\" (UID: \"96c320b0-e239-4e96-aaae-28255100dae4\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-9xsr6" Jun 02 21:33:45.290521 ip-10-0-138-193 kubenswrapper[2578]: I0602 21:33:45.289159 2578 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/96c320b0-e239-4e96-aaae-28255100dae4-device-dir\") pod \"aws-ebs-csi-driver-node-9xsr6\" (UID: \"96c320b0-e239-4e96-aaae-28255100dae4\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-9xsr6" Jun 02 21:33:45.290521 ip-10-0-138-193 kubenswrapper[2578]: I0602 21:33:45.289189 2578 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/f2c18898-cc9a-4645-bab8-9ac55c476c7f-os-release\") pod \"multus-additional-cni-plugins-s7sgt\" (UID: \"f2c18898-cc9a-4645-bab8-9ac55c476c7f\") " pod="openshift-multus/multus-additional-cni-plugins-s7sgt" Jun 02 21:33:45.290521 ip-10-0-138-193 kubenswrapper[2578]: I0602 21:33:45.289190 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/96c320b0-e239-4e96-aaae-28255100dae4-device-dir\") pod \"aws-ebs-csi-driver-node-9xsr6\" (UID: \"96c320b0-e239-4e96-aaae-28255100dae4\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-9xsr6" Jun 02 21:33:45.291175 ip-10-0-138-193 kubenswrapper[2578]: I0602 21:33:45.289211 2578 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/ecde3d34-b3a4-422b-9a2d-c8a4541cc718-ovn-node-metrics-cert\") pod \"ovnkube-node-5zgzd\" (UID: \"ecde3d34-b3a4-422b-9a2d-c8a4541cc718\") " pod="openshift-ovn-kubernetes/ovnkube-node-5zgzd" Jun 02 21:33:45.291175 ip-10-0-138-193 kubenswrapper[2578]: I0602 21:33:45.289231 2578 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/3ea59100-2e7e-4a44-8ec1-c3f7e3472835-multus-socket-dir-parent\") pod \"multus-p74k8\" (UID: \"3ea59100-2e7e-4a44-8ec1-c3f7e3472835\") " pod="openshift-multus/multus-p74k8" Jun 02 21:33:45.291175 ip-10-0-138-193 kubenswrapper[2578]: I0602 21:33:45.289235 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/f2c18898-cc9a-4645-bab8-9ac55c476c7f-os-release\") pod \"multus-additional-cni-plugins-s7sgt\" (UID: \"f2c18898-cc9a-4645-bab8-9ac55c476c7f\") " pod="openshift-multus/multus-additional-cni-plugins-s7sgt" Jun 02 21:33:45.291175 ip-10-0-138-193 kubenswrapper[2578]: I0602 21:33:45.289255 2578 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/3ea59100-2e7e-4a44-8ec1-c3f7e3472835-hostroot\") pod \"multus-p74k8\" (UID: \"3ea59100-2e7e-4a44-8ec1-c3f7e3472835\") " pod="openshift-multus/multus-p74k8" Jun 02 21:33:45.291175 ip-10-0-138-193 kubenswrapper[2578]: I0602 21:33:45.289279 2578 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/f2c18898-cc9a-4645-bab8-9ac55c476c7f-system-cni-dir\") pod \"multus-additional-cni-plugins-s7sgt\" (UID: \"f2c18898-cc9a-4645-bab8-9ac55c476c7f\") " pod="openshift-multus/multus-additional-cni-plugins-s7sgt" Jun 02 21:33:45.291175 ip-10-0-138-193 kubenswrapper[2578]: I0602 21:33:45.289287 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/3ea59100-2e7e-4a44-8ec1-c3f7e3472835-multus-socket-dir-parent\") pod \"multus-p74k8\" (UID: \"3ea59100-2e7e-4a44-8ec1-c3f7e3472835\") " pod="openshift-multus/multus-p74k8" Jun 02 21:33:45.291175 ip-10-0-138-193 kubenswrapper[2578]: I0602 21:33:45.289303 2578 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/adf5f00d-bf02-4037-b6e7-92c6485f3e38-iptables-alerter-script\") pod \"iptables-alerter-xbl27\" (UID: \"adf5f00d-bf02-4037-b6e7-92c6485f3e38\") " pod="openshift-network-operator/iptables-alerter-xbl27" Jun 02 21:33:45.291175 ip-10-0-138-193 kubenswrapper[2578]: I0602 21:33:45.289331 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/52db7cf8-54c4-4dce-a960-843c4cc11168-etc-tuned\") pod \"tuned-297ws\" (UID: \"52db7cf8-54c4-4dce-a960-843c4cc11168\") " pod="openshift-cluster-node-tuning-operator/tuned-297ws" Jun 02 21:33:45.291175 ip-10-0-138-193 kubenswrapper[2578]: I0602 21:33:45.289347 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/f2c18898-cc9a-4645-bab8-9ac55c476c7f-system-cni-dir\") pod \"multus-additional-cni-plugins-s7sgt\" (UID: \"f2c18898-cc9a-4645-bab8-9ac55c476c7f\") " pod="openshift-multus/multus-additional-cni-plugins-s7sgt" Jun 02 21:33:45.291175 ip-10-0-138-193 kubenswrapper[2578]: I0602 21:33:45.289344 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/3ea59100-2e7e-4a44-8ec1-c3f7e3472835-hostroot\") pod \"multus-p74k8\" (UID: \"3ea59100-2e7e-4a44-8ec1-c3f7e3472835\") " pod="openshift-multus/multus-p74k8" Jun 02 21:33:45.291175 ip-10-0-138-193 kubenswrapper[2578]: I0602 21:33:45.289360 2578 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-8nvbg\" (UniqueName: \"kubernetes.io/projected/3ea59100-2e7e-4a44-8ec1-c3f7e3472835-kube-api-access-8nvbg\") pod \"multus-p74k8\" (UID: \"3ea59100-2e7e-4a44-8ec1-c3f7e3472835\") " pod="openshift-multus/multus-p74k8" Jun 02 21:33:45.291175 ip-10-0-138-193 kubenswrapper[2578]: I0602 21:33:45.289488 2578 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-7tfkv\" (UniqueName: \"kubernetes.io/projected/adfce93b-f07e-480a-af26-5dc7df23fa48-kube-api-access-7tfkv\") pod \"network-metrics-daemon-k2vdd\" (UID: \"adfce93b-f07e-480a-af26-5dc7df23fa48\") " pod="openshift-multus/network-metrics-daemon-k2vdd" Jun 02 21:33:45.291175 ip-10-0-138-193 kubenswrapper[2578]: I0602 21:33:45.289515 2578 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-d5dnb\" (UniqueName: \"kubernetes.io/projected/950ec20f-2c4b-4e1b-96ba-c02f9a6d124a-kube-api-access-d5dnb\") pod \"network-check-target-r92gd\" (UID: \"950ec20f-2c4b-4e1b-96ba-c02f9a6d124a\") " pod="openshift-network-diagnostics/network-check-target-r92gd" Jun 02 21:33:45.291175 ip-10-0-138-193 kubenswrapper[2578]: I0602 21:33:45.289514 2578 swap_util.go:74] "error creating dir to test if tmpfs noswap is enabled. Assuming not supported" mount path="" error="stat /var/lib/kubelet/plugins/kubernetes.io/empty-dir: no such file or directory" Jun 02 21:33:45.291175 ip-10-0-138-193 kubenswrapper[2578]: I0602 21:33:45.289550 2578 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/f2c18898-cc9a-4645-bab8-9ac55c476c7f-tuning-conf-dir\") pod \"multus-additional-cni-plugins-s7sgt\" (UID: \"f2c18898-cc9a-4645-bab8-9ac55c476c7f\") " pod="openshift-multus/multus-additional-cni-plugins-s7sgt" Jun 02 21:33:45.291175 ip-10-0-138-193 kubenswrapper[2578]: I0602 21:33:45.289578 2578 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/ecde3d34-b3a4-422b-9a2d-c8a4541cc718-host-kubelet\") pod \"ovnkube-node-5zgzd\" (UID: \"ecde3d34-b3a4-422b-9a2d-c8a4541cc718\") " pod="openshift-ovn-kubernetes/ovnkube-node-5zgzd" Jun 02 21:33:45.291175 ip-10-0-138-193 kubenswrapper[2578]: I0602 21:33:45.289598 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/ecde3d34-b3a4-422b-9a2d-c8a4541cc718-ovnkube-script-lib\") pod \"ovnkube-node-5zgzd\" (UID: \"ecde3d34-b3a4-422b-9a2d-c8a4541cc718\") " pod="openshift-ovn-kubernetes/ovnkube-node-5zgzd" Jun 02 21:33:45.291763 ip-10-0-138-193 kubenswrapper[2578]: I0602 21:33:45.289601 2578 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/ecde3d34-b3a4-422b-9a2d-c8a4541cc718-log-socket\") pod \"ovnkube-node-5zgzd\" (UID: \"ecde3d34-b3a4-422b-9a2d-c8a4541cc718\") " pod="openshift-ovn-kubernetes/ovnkube-node-5zgzd" Jun 02 21:33:45.291763 ip-10-0-138-193 kubenswrapper[2578]: I0602 21:33:45.289632 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/ecde3d34-b3a4-422b-9a2d-c8a4541cc718-log-socket\") pod \"ovnkube-node-5zgzd\" (UID: \"ecde3d34-b3a4-422b-9a2d-c8a4541cc718\") " pod="openshift-ovn-kubernetes/ovnkube-node-5zgzd" Jun 02 21:33:45.291763 ip-10-0-138-193 kubenswrapper[2578]: I0602 21:33:45.289634 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/3ea59100-2e7e-4a44-8ec1-c3f7e3472835-multus-daemon-config\") pod \"multus-p74k8\" (UID: \"3ea59100-2e7e-4a44-8ec1-c3f7e3472835\") " pod="openshift-multus/multus-p74k8" Jun 02 21:33:45.291763 ip-10-0-138-193 kubenswrapper[2578]: I0602 21:33:45.289658 2578 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/ecde3d34-b3a4-422b-9a2d-c8a4541cc718-host-cni-netd\") pod \"ovnkube-node-5zgzd\" (UID: \"ecde3d34-b3a4-422b-9a2d-c8a4541cc718\") " pod="openshift-ovn-kubernetes/ovnkube-node-5zgzd" Jun 02 21:33:45.291763 ip-10-0-138-193 kubenswrapper[2578]: I0602 21:33:45.289711 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/ecde3d34-b3a4-422b-9a2d-c8a4541cc718-host-cni-netd\") pod \"ovnkube-node-5zgzd\" (UID: \"ecde3d34-b3a4-422b-9a2d-c8a4541cc718\") " pod="openshift-ovn-kubernetes/ovnkube-node-5zgzd" Jun 02 21:33:45.291763 ip-10-0-138-193 kubenswrapper[2578]: I0602 21:33:45.289723 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/ecde3d34-b3a4-422b-9a2d-c8a4541cc718-host-kubelet\") pod \"ovnkube-node-5zgzd\" (UID: \"ecde3d34-b3a4-422b-9a2d-c8a4541cc718\") " pod="openshift-ovn-kubernetes/ovnkube-node-5zgzd" Jun 02 21:33:45.291763 ip-10-0-138-193 kubenswrapper[2578]: I0602 21:33:45.289763 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/f2c18898-cc9a-4645-bab8-9ac55c476c7f-tuning-conf-dir\") pod \"multus-additional-cni-plugins-s7sgt\" (UID: \"f2c18898-cc9a-4645-bab8-9ac55c476c7f\") " pod="openshift-multus/multus-additional-cni-plugins-s7sgt" Jun 02 21:33:45.291763 ip-10-0-138-193 kubenswrapper[2578]: I0602 21:33:45.289811 2578 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/ecde3d34-b3a4-422b-9a2d-c8a4541cc718-ovnkube-config\") pod \"ovnkube-node-5zgzd\" (UID: \"ecde3d34-b3a4-422b-9a2d-c8a4541cc718\") " pod="openshift-ovn-kubernetes/ovnkube-node-5zgzd" Jun 02 21:33:45.291763 ip-10-0-138-193 kubenswrapper[2578]: I0602 21:33:45.289850 2578 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/4d2236cd-d674-4c20-821e-7173b6db4b74-tmp-dir\") pod \"node-resolver-vfdfn\" (UID: \"4d2236cd-d674-4c20-821e-7173b6db4b74\") " pod="openshift-dns/node-resolver-vfdfn" Jun 02 21:33:45.291763 ip-10-0-138-193 kubenswrapper[2578]: I0602 21:33:45.289871 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/adf5f00d-bf02-4037-b6e7-92c6485f3e38-iptables-alerter-script\") pod \"iptables-alerter-xbl27\" (UID: \"adf5f00d-bf02-4037-b6e7-92c6485f3e38\") " pod="openshift-network-operator/iptables-alerter-xbl27" Jun 02 21:33:45.291763 ip-10-0-138-193 kubenswrapper[2578]: I0602 21:33:45.289876 2578 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/fd30f6e0-874c-411b-b8c6-0df250364c15-serviceca\") pod \"node-ca-mnnsl\" (UID: \"fd30f6e0-874c-411b-b8c6-0df250364c15\") " pod="openshift-image-registry/node-ca-mnnsl" Jun 02 21:33:45.291763 ip-10-0-138-193 kubenswrapper[2578]: I0602 21:33:45.289928 2578 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/ecde3d34-b3a4-422b-9a2d-c8a4541cc718-run-ovn\") pod \"ovnkube-node-5zgzd\" (UID: \"ecde3d34-b3a4-422b-9a2d-c8a4541cc718\") " pod="openshift-ovn-kubernetes/ovnkube-node-5zgzd" Jun 02 21:33:45.291763 ip-10-0-138-193 kubenswrapper[2578]: I0602 21:33:45.289960 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/9963c656-171f-412f-b531-d4e89671117c-dbus\") pod \"global-pull-secret-syncer-rf8cp\" (UID: \"9963c656-171f-412f-b531-d4e89671117c\") " pod="kube-system/global-pull-secret-syncer-rf8cp" Jun 02 21:33:45.291763 ip-10-0-138-193 kubenswrapper[2578]: I0602 21:33:45.289987 2578 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/3ea59100-2e7e-4a44-8ec1-c3f7e3472835-host-run-multus-certs\") pod \"multus-p74k8\" (UID: \"3ea59100-2e7e-4a44-8ec1-c3f7e3472835\") " pod="openshift-multus/multus-p74k8" Jun 02 21:33:45.291763 ip-10-0-138-193 kubenswrapper[2578]: I0602 21:33:45.290013 2578 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/96c320b0-e239-4e96-aaae-28255100dae4-sys-fs\") pod \"aws-ebs-csi-driver-node-9xsr6\" (UID: \"96c320b0-e239-4e96-aaae-28255100dae4\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-9xsr6" Jun 02 21:33:45.291763 ip-10-0-138-193 kubenswrapper[2578]: I0602 21:33:45.290028 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/ecde3d34-b3a4-422b-9a2d-c8a4541cc718-run-ovn\") pod \"ovnkube-node-5zgzd\" (UID: \"ecde3d34-b3a4-422b-9a2d-c8a4541cc718\") " pod="openshift-ovn-kubernetes/ovnkube-node-5zgzd" Jun 02 21:33:45.291763 ip-10-0-138-193 kubenswrapper[2578]: I0602 21:33:45.290038 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/9963c656-171f-412f-b531-d4e89671117c-kubelet-config\") pod \"global-pull-secret-syncer-rf8cp\" (UID: \"9963c656-171f-412f-b531-d4e89671117c\") " pod="kube-system/global-pull-secret-syncer-rf8cp" Jun 02 21:33:45.292398 ip-10-0-138-193 kubenswrapper[2578]: I0602 21:33:45.290067 2578 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-444ql\" (UniqueName: \"kubernetes.io/projected/fd30f6e0-874c-411b-b8c6-0df250364c15-kube-api-access-444ql\") pod \"node-ca-mnnsl\" (UID: \"fd30f6e0-874c-411b-b8c6-0df250364c15\") " pod="openshift-image-registry/node-ca-mnnsl" Jun 02 21:33:45.292398 ip-10-0-138-193 kubenswrapper[2578]: I0602 21:33:45.290097 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/3ea59100-2e7e-4a44-8ec1-c3f7e3472835-host-run-multus-certs\") pod \"multus-p74k8\" (UID: \"3ea59100-2e7e-4a44-8ec1-c3f7e3472835\") " pod="openshift-multus/multus-p74k8" Jun 02 21:33:45.292398 ip-10-0-138-193 kubenswrapper[2578]: I0602 21:33:45.290126 2578 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-nb7zn\" (UniqueName: \"kubernetes.io/projected/96c320b0-e239-4e96-aaae-28255100dae4-kube-api-access-nb7zn\") pod \"aws-ebs-csi-driver-node-9xsr6\" (UID: \"96c320b0-e239-4e96-aaae-28255100dae4\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-9xsr6" Jun 02 21:33:45.292398 ip-10-0-138-193 kubenswrapper[2578]: I0602 21:33:45.290161 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/52db7cf8-54c4-4dce-a960-843c4cc11168-etc-sysconfig\") pod \"tuned-297ws\" (UID: \"52db7cf8-54c4-4dce-a960-843c4cc11168\") " pod="openshift-cluster-node-tuning-operator/tuned-297ws" Jun 02 21:33:45.292398 ip-10-0-138-193 kubenswrapper[2578]: I0602 21:33:45.290194 2578 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/3ea59100-2e7e-4a44-8ec1-c3f7e3472835-host-var-lib-cni-multus\") pod \"multus-p74k8\" (UID: \"3ea59100-2e7e-4a44-8ec1-c3f7e3472835\") " pod="openshift-multus/multus-p74k8" Jun 02 21:33:45.292398 ip-10-0-138-193 kubenswrapper[2578]: I0602 21:33:45.290218 2578 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/ecde3d34-b3a4-422b-9a2d-c8a4541cc718-var-lib-openvswitch\") pod \"ovnkube-node-5zgzd\" (UID: \"ecde3d34-b3a4-422b-9a2d-c8a4541cc718\") " pod="openshift-ovn-kubernetes/ovnkube-node-5zgzd" Jun 02 21:33:45.292398 ip-10-0-138-193 kubenswrapper[2578]: I0602 21:33:45.290236 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/4d2236cd-d674-4c20-821e-7173b6db4b74-tmp-dir\") pod \"node-resolver-vfdfn\" (UID: \"4d2236cd-d674-4c20-821e-7173b6db4b74\") " pod="openshift-dns/node-resolver-vfdfn" Jun 02 21:33:45.292398 ip-10-0-138-193 kubenswrapper[2578]: I0602 21:33:45.290245 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/9963c656-171f-412f-b531-d4e89671117c-original-pull-secret\") pod \"global-pull-secret-syncer-rf8cp\" (UID: \"9963c656-171f-412f-b531-d4e89671117c\") " pod="kube-system/global-pull-secret-syncer-rf8cp" Jun 02 21:33:45.292398 ip-10-0-138-193 kubenswrapper[2578]: I0602 21:33:45.290274 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/52db7cf8-54c4-4dce-a960-843c4cc11168-etc-modprobe-d\") pod \"tuned-297ws\" (UID: \"52db7cf8-54c4-4dce-a960-843c4cc11168\") " pod="openshift-cluster-node-tuning-operator/tuned-297ws" Jun 02 21:33:45.292398 ip-10-0-138-193 kubenswrapper[2578]: I0602 21:33:45.290302 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/fd30f6e0-874c-411b-b8c6-0df250364c15-serviceca\") pod \"node-ca-mnnsl\" (UID: \"fd30f6e0-874c-411b-b8c6-0df250364c15\") " pod="openshift-image-registry/node-ca-mnnsl" Jun 02 21:33:45.292398 ip-10-0-138-193 kubenswrapper[2578]: I0602 21:33:45.290353 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/ecde3d34-b3a4-422b-9a2d-c8a4541cc718-var-lib-openvswitch\") pod \"ovnkube-node-5zgzd\" (UID: \"ecde3d34-b3a4-422b-9a2d-c8a4541cc718\") " pod="openshift-ovn-kubernetes/ovnkube-node-5zgzd" Jun 02 21:33:45.292398 ip-10-0-138-193 kubenswrapper[2578]: I0602 21:33:45.290353 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/3ea59100-2e7e-4a44-8ec1-c3f7e3472835-host-var-lib-cni-multus\") pod \"multus-p74k8\" (UID: \"3ea59100-2e7e-4a44-8ec1-c3f7e3472835\") " pod="openshift-multus/multus-p74k8" Jun 02 21:33:45.292398 ip-10-0-138-193 kubenswrapper[2578]: I0602 21:33:45.290415 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/ecde3d34-b3a4-422b-9a2d-c8a4541cc718-ovnkube-config\") pod \"ovnkube-node-5zgzd\" (UID: \"ecde3d34-b3a4-422b-9a2d-c8a4541cc718\") " pod="openshift-ovn-kubernetes/ovnkube-node-5zgzd" Jun 02 21:33:45.292398 ip-10-0-138-193 kubenswrapper[2578]: I0602 21:33:45.290492 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/96c320b0-e239-4e96-aaae-28255100dae4-sys-fs\") pod \"aws-ebs-csi-driver-node-9xsr6\" (UID: \"96c320b0-e239-4e96-aaae-28255100dae4\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-9xsr6" Jun 02 21:33:45.292957 ip-10-0-138-193 kubenswrapper[2578]: I0602 21:33:45.292945 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/ecde3d34-b3a4-422b-9a2d-c8a4541cc718-ovn-node-metrics-cert\") pod \"ovnkube-node-5zgzd\" (UID: \"ecde3d34-b3a4-422b-9a2d-c8a4541cc718\") " pod="openshift-ovn-kubernetes/ovnkube-node-5zgzd" Jun 02 21:33:45.297126 ip-10-0-138-193 kubenswrapper[2578]: E0602 21:33:45.297101 2578 projected.go:289] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jun 02 21:33:45.297126 ip-10-0-138-193 kubenswrapper[2578]: E0602 21:33:45.297129 2578 projected.go:289] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jun 02 21:33:45.297286 ip-10-0-138-193 kubenswrapper[2578]: E0602 21:33:45.297145 2578 projected.go:194] Error preparing data for projected volume kube-api-access-d5dnb for pod openshift-network-diagnostics/network-check-target-r92gd: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 02 21:33:45.297286 ip-10-0-138-193 kubenswrapper[2578]: E0602 21:33:45.297220 2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/950ec20f-2c4b-4e1b-96ba-c02f9a6d124a-kube-api-access-d5dnb podName:950ec20f-2c4b-4e1b-96ba-c02f9a6d124a nodeName:}" failed. No retries permitted until 2026-06-02 21:33:45.79719763 +0000 UTC m=+3.049095528 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "kube-api-access-d5dnb" (UniqueName: "kubernetes.io/projected/950ec20f-2c4b-4e1b-96ba-c02f9a6d124a-kube-api-access-d5dnb") pod "network-check-target-r92gd" (UID: "950ec20f-2c4b-4e1b-96ba-c02f9a6d124a") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 02 21:33:45.299250 ip-10-0-138-193 kubenswrapper[2578]: I0602 21:33:45.299223 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-7nkd4\" (UniqueName: \"kubernetes.io/projected/4d2236cd-d674-4c20-821e-7173b6db4b74-kube-api-access-7nkd4\") pod \"node-resolver-vfdfn\" (UID: \"4d2236cd-d674-4c20-821e-7173b6db4b74\") " pod="openshift-dns/node-resolver-vfdfn" Jun 02 21:33:45.299374 ip-10-0-138-193 kubenswrapper[2578]: I0602 21:33:45.299314 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-pqg2m\" (UniqueName: \"kubernetes.io/projected/f2c18898-cc9a-4645-bab8-9ac55c476c7f-kube-api-access-pqg2m\") pod \"multus-additional-cni-plugins-s7sgt\" (UID: \"f2c18898-cc9a-4645-bab8-9ac55c476c7f\") " pod="openshift-multus/multus-additional-cni-plugins-s7sgt" Jun 02 21:33:45.299778 ip-10-0-138-193 kubenswrapper[2578]: I0602 21:33:45.299753 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-njxlp\" (UniqueName: \"kubernetes.io/projected/adf5f00d-bf02-4037-b6e7-92c6485f3e38-kube-api-access-njxlp\") pod \"iptables-alerter-xbl27\" (UID: \"adf5f00d-bf02-4037-b6e7-92c6485f3e38\") " pod="openshift-network-operator/iptables-alerter-xbl27" Jun 02 21:33:45.299890 ip-10-0-138-193 kubenswrapper[2578]: I0602 21:33:45.299814 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-cbxtf\" (UniqueName: \"kubernetes.io/projected/ecde3d34-b3a4-422b-9a2d-c8a4541cc718-kube-api-access-cbxtf\") pod \"ovnkube-node-5zgzd\" (UID: \"ecde3d34-b3a4-422b-9a2d-c8a4541cc718\") " pod="openshift-ovn-kubernetes/ovnkube-node-5zgzd" Jun 02 21:33:45.300558 ip-10-0-138-193 kubenswrapper[2578]: I0602 21:33:45.300533 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-8nvbg\" (UniqueName: \"kubernetes.io/projected/3ea59100-2e7e-4a44-8ec1-c3f7e3472835-kube-api-access-8nvbg\") pod \"multus-p74k8\" (UID: \"3ea59100-2e7e-4a44-8ec1-c3f7e3472835\") " pod="openshift-multus/multus-p74k8" Jun 02 21:33:45.300829 ip-10-0-138-193 kubenswrapper[2578]: I0602 21:33:45.300798 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-444ql\" (UniqueName: \"kubernetes.io/projected/fd30f6e0-874c-411b-b8c6-0df250364c15-kube-api-access-444ql\") pod \"node-ca-mnnsl\" (UID: \"fd30f6e0-874c-411b-b8c6-0df250364c15\") " pod="openshift-image-registry/node-ca-mnnsl" Jun 02 21:33:45.301183 ip-10-0-138-193 kubenswrapper[2578]: I0602 21:33:45.301165 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-7tfkv\" (UniqueName: \"kubernetes.io/projected/adfce93b-f07e-480a-af26-5dc7df23fa48-kube-api-access-7tfkv\") pod \"network-metrics-daemon-k2vdd\" (UID: \"adfce93b-f07e-480a-af26-5dc7df23fa48\") " pod="openshift-multus/network-metrics-daemon-k2vdd" Jun 02 21:33:45.301268 ip-10-0-138-193 kubenswrapper[2578]: I0602 21:33:45.301225 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-nb7zn\" (UniqueName: \"kubernetes.io/projected/96c320b0-e239-4e96-aaae-28255100dae4-kube-api-access-nb7zn\") pod \"aws-ebs-csi-driver-node-9xsr6\" (UID: \"96c320b0-e239-4e96-aaae-28255100dae4\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-9xsr6" Jun 02 21:33:45.334211 ip-10-0-138-193 kubenswrapper[2578]: I0602 21:33:45.334186 2578 reflector.go:430] "Caches populated" type="*v1.CSIDriver" reflector="k8s.io/client-go/informers/factory.go:160" Jun 02 21:33:45.390605 ip-10-0-138-193 kubenswrapper[2578]: I0602 21:33:45.390577 2578 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/9963c656-171f-412f-b531-d4e89671117c-original-pull-secret\") pod \"global-pull-secret-syncer-rf8cp\" (UID: \"9963c656-171f-412f-b531-d4e89671117c\") " pod="kube-system/global-pull-secret-syncer-rf8cp" Jun 02 21:33:45.390605 ip-10-0-138-193 kubenswrapper[2578]: I0602 21:33:45.390608 2578 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/52db7cf8-54c4-4dce-a960-843c4cc11168-etc-modprobe-d\") pod \"tuned-297ws\" (UID: \"52db7cf8-54c4-4dce-a960-843c4cc11168\") " pod="openshift-cluster-node-tuning-operator/tuned-297ws" Jun 02 21:33:45.390813 ip-10-0-138-193 kubenswrapper[2578]: I0602 21:33:45.390643 2578 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/ebd8238d-c142-4303-9f5c-e61073fd0920-agent-certs\") pod \"konnectivity-agent-q78cn\" (UID: \"ebd8238d-c142-4303-9f5c-e61073fd0920\") " pod="kube-system/konnectivity-agent-q78cn" Jun 02 21:33:45.390813 ip-10-0-138-193 kubenswrapper[2578]: E0602 21:33:45.390743 2578 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jun 02 21:33:45.390813 ip-10-0-138-193 kubenswrapper[2578]: I0602 21:33:45.390795 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/52db7cf8-54c4-4dce-a960-843c4cc11168-etc-modprobe-d\") pod \"tuned-297ws\" (UID: \"52db7cf8-54c4-4dce-a960-843c4cc11168\") " pod="openshift-cluster-node-tuning-operator/tuned-297ws" Jun 02 21:33:45.390948 ip-10-0-138-193 kubenswrapper[2578]: E0602 21:33:45.390808 2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/9963c656-171f-412f-b531-d4e89671117c-original-pull-secret podName:9963c656-171f-412f-b531-d4e89671117c nodeName:}" failed. No retries permitted until 2026-06-02 21:33:45.890787521 +0000 UTC m=+3.142685424 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/9963c656-171f-412f-b531-d4e89671117c-original-pull-secret") pod "global-pull-secret-syncer-rf8cp" (UID: "9963c656-171f-412f-b531-d4e89671117c") : object "kube-system"/"original-pull-secret" not registered Jun 02 21:33:45.390948 ip-10-0-138-193 kubenswrapper[2578]: I0602 21:33:45.390853 2578 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/52db7cf8-54c4-4dce-a960-843c4cc11168-sys\") pod \"tuned-297ws\" (UID: \"52db7cf8-54c4-4dce-a960-843c4cc11168\") " pod="openshift-cluster-node-tuning-operator/tuned-297ws" Jun 02 21:33:45.390948 ip-10-0-138-193 kubenswrapper[2578]: I0602 21:33:45.390888 2578 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/52db7cf8-54c4-4dce-a960-843c4cc11168-etc-kubernetes\") pod \"tuned-297ws\" (UID: \"52db7cf8-54c4-4dce-a960-843c4cc11168\") " pod="openshift-cluster-node-tuning-operator/tuned-297ws" Jun 02 21:33:45.390948 ip-10-0-138-193 kubenswrapper[2578]: I0602 21:33:45.390913 2578 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/52db7cf8-54c4-4dce-a960-843c4cc11168-etc-sysctl-conf\") pod \"tuned-297ws\" (UID: \"52db7cf8-54c4-4dce-a960-843c4cc11168\") " pod="openshift-cluster-node-tuning-operator/tuned-297ws" Jun 02 21:33:45.390948 ip-10-0-138-193 kubenswrapper[2578]: I0602 21:33:45.390937 2578 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/52db7cf8-54c4-4dce-a960-843c4cc11168-tmp\") pod \"tuned-297ws\" (UID: \"52db7cf8-54c4-4dce-a960-843c4cc11168\") " pod="openshift-cluster-node-tuning-operator/tuned-297ws" Jun 02 21:33:45.391267 ip-10-0-138-193 kubenswrapper[2578]: I0602 21:33:45.390964 2578 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/52db7cf8-54c4-4dce-a960-843c4cc11168-host\") pod \"tuned-297ws\" (UID: \"52db7cf8-54c4-4dce-a960-843c4cc11168\") " pod="openshift-cluster-node-tuning-operator/tuned-297ws" Jun 02 21:33:45.391267 ip-10-0-138-193 kubenswrapper[2578]: I0602 21:33:45.390986 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/52db7cf8-54c4-4dce-a960-843c4cc11168-sys\") pod \"tuned-297ws\" (UID: \"52db7cf8-54c4-4dce-a960-843c4cc11168\") " pod="openshift-cluster-node-tuning-operator/tuned-297ws" Jun 02 21:33:45.391267 ip-10-0-138-193 kubenswrapper[2578]: I0602 21:33:45.390991 2578 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/52db7cf8-54c4-4dce-a960-843c4cc11168-etc-systemd\") pod \"tuned-297ws\" (UID: \"52db7cf8-54c4-4dce-a960-843c4cc11168\") " pod="openshift-cluster-node-tuning-operator/tuned-297ws" Jun 02 21:33:45.391267 ip-10-0-138-193 kubenswrapper[2578]: I0602 21:33:45.391034 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/52db7cf8-54c4-4dce-a960-843c4cc11168-etc-systemd\") pod \"tuned-297ws\" (UID: \"52db7cf8-54c4-4dce-a960-843c4cc11168\") " pod="openshift-cluster-node-tuning-operator/tuned-297ws" Jun 02 21:33:45.391267 ip-10-0-138-193 kubenswrapper[2578]: I0602 21:33:45.391032 2578 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-s9xb7\" (UniqueName: \"kubernetes.io/projected/52db7cf8-54c4-4dce-a960-843c4cc11168-kube-api-access-s9xb7\") pod \"tuned-297ws\" (UID: \"52db7cf8-54c4-4dce-a960-843c4cc11168\") " pod="openshift-cluster-node-tuning-operator/tuned-297ws" Jun 02 21:33:45.391267 ip-10-0-138-193 kubenswrapper[2578]: I0602 21:33:45.391167 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/52db7cf8-54c4-4dce-a960-843c4cc11168-etc-sysctl-conf\") pod \"tuned-297ws\" (UID: \"52db7cf8-54c4-4dce-a960-843c4cc11168\") " pod="openshift-cluster-node-tuning-operator/tuned-297ws" Jun 02 21:33:45.391267 ip-10-0-138-193 kubenswrapper[2578]: I0602 21:33:45.391216 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/52db7cf8-54c4-4dce-a960-843c4cc11168-etc-kubernetes\") pod \"tuned-297ws\" (UID: \"52db7cf8-54c4-4dce-a960-843c4cc11168\") " pod="openshift-cluster-node-tuning-operator/tuned-297ws" Jun 02 21:33:45.391267 ip-10-0-138-193 kubenswrapper[2578]: I0602 21:33:45.391217 2578 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/ebd8238d-c142-4303-9f5c-e61073fd0920-konnectivity-ca\") pod \"konnectivity-agent-q78cn\" (UID: \"ebd8238d-c142-4303-9f5c-e61073fd0920\") " pod="kube-system/konnectivity-agent-q78cn" Jun 02 21:33:45.391267 ip-10-0-138-193 kubenswrapper[2578]: I0602 21:33:45.391262 2578 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"run\" (UniqueName: \"kubernetes.io/host-path/52db7cf8-54c4-4dce-a960-843c4cc11168-run\") pod \"tuned-297ws\" (UID: \"52db7cf8-54c4-4dce-a960-843c4cc11168\") " pod="openshift-cluster-node-tuning-operator/tuned-297ws" Jun 02 21:33:45.391701 ip-10-0-138-193 kubenswrapper[2578]: I0602 21:33:45.391289 2578 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/52db7cf8-54c4-4dce-a960-843c4cc11168-lib-modules\") pod \"tuned-297ws\" (UID: \"52db7cf8-54c4-4dce-a960-843c4cc11168\") " pod="openshift-cluster-node-tuning-operator/tuned-297ws" Jun 02 21:33:45.391701 ip-10-0-138-193 kubenswrapper[2578]: I0602 21:33:45.391298 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host\" (UniqueName: \"kubernetes.io/host-path/52db7cf8-54c4-4dce-a960-843c4cc11168-host\") pod \"tuned-297ws\" (UID: \"52db7cf8-54c4-4dce-a960-843c4cc11168\") " pod="openshift-cluster-node-tuning-operator/tuned-297ws" Jun 02 21:33:45.391701 ip-10-0-138-193 kubenswrapper[2578]: I0602 21:33:45.391314 2578 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/52db7cf8-54c4-4dce-a960-843c4cc11168-var-lib-kubelet\") pod \"tuned-297ws\" (UID: \"52db7cf8-54c4-4dce-a960-843c4cc11168\") " pod="openshift-cluster-node-tuning-operator/tuned-297ws" Jun 02 21:33:45.391701 ip-10-0-138-193 kubenswrapper[2578]: I0602 21:33:45.391341 2578 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/52db7cf8-54c4-4dce-a960-843c4cc11168-etc-sysctl-d\") pod \"tuned-297ws\" (UID: \"52db7cf8-54c4-4dce-a960-843c4cc11168\") " pod="openshift-cluster-node-tuning-operator/tuned-297ws" Jun 02 21:33:45.391701 ip-10-0-138-193 kubenswrapper[2578]: I0602 21:33:45.391354 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"run\" (UniqueName: \"kubernetes.io/host-path/52db7cf8-54c4-4dce-a960-843c4cc11168-run\") pod \"tuned-297ws\" (UID: \"52db7cf8-54c4-4dce-a960-843c4cc11168\") " pod="openshift-cluster-node-tuning-operator/tuned-297ws" Jun 02 21:33:45.391701 ip-10-0-138-193 kubenswrapper[2578]: I0602 21:33:45.391386 2578 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/52db7cf8-54c4-4dce-a960-843c4cc11168-etc-tuned\") pod \"tuned-297ws\" (UID: \"52db7cf8-54c4-4dce-a960-843c4cc11168\") " pod="openshift-cluster-node-tuning-operator/tuned-297ws" Jun 02 21:33:45.391701 ip-10-0-138-193 kubenswrapper[2578]: I0602 21:33:45.391423 2578 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/9963c656-171f-412f-b531-d4e89671117c-dbus\") pod \"global-pull-secret-syncer-rf8cp\" (UID: \"9963c656-171f-412f-b531-d4e89671117c\") " pod="kube-system/global-pull-secret-syncer-rf8cp" Jun 02 21:33:45.391701 ip-10-0-138-193 kubenswrapper[2578]: I0602 21:33:45.391446 2578 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/9963c656-171f-412f-b531-d4e89671117c-kubelet-config\") pod \"global-pull-secret-syncer-rf8cp\" (UID: \"9963c656-171f-412f-b531-d4e89671117c\") " pod="kube-system/global-pull-secret-syncer-rf8cp" Jun 02 21:33:45.391701 ip-10-0-138-193 kubenswrapper[2578]: I0602 21:33:45.391463 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/52db7cf8-54c4-4dce-a960-843c4cc11168-etc-sysctl-d\") pod \"tuned-297ws\" (UID: \"52db7cf8-54c4-4dce-a960-843c4cc11168\") " pod="openshift-cluster-node-tuning-operator/tuned-297ws" Jun 02 21:33:45.391701 ip-10-0-138-193 kubenswrapper[2578]: I0602 21:33:45.391472 2578 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/52db7cf8-54c4-4dce-a960-843c4cc11168-etc-sysconfig\") pod \"tuned-297ws\" (UID: \"52db7cf8-54c4-4dce-a960-843c4cc11168\") " pod="openshift-cluster-node-tuning-operator/tuned-297ws" Jun 02 21:33:45.391701 ip-10-0-138-193 kubenswrapper[2578]: I0602 21:33:45.391478 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/52db7cf8-54c4-4dce-a960-843c4cc11168-lib-modules\") pod \"tuned-297ws\" (UID: \"52db7cf8-54c4-4dce-a960-843c4cc11168\") " pod="openshift-cluster-node-tuning-operator/tuned-297ws" Jun 02 21:33:45.391701 ip-10-0-138-193 kubenswrapper[2578]: I0602 21:33:45.391507 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/52db7cf8-54c4-4dce-a960-843c4cc11168-var-lib-kubelet\") pod \"tuned-297ws\" (UID: \"52db7cf8-54c4-4dce-a960-843c4cc11168\") " pod="openshift-cluster-node-tuning-operator/tuned-297ws" Jun 02 21:33:45.391701 ip-10-0-138-193 kubenswrapper[2578]: I0602 21:33:45.391533 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/52db7cf8-54c4-4dce-a960-843c4cc11168-etc-sysconfig\") pod \"tuned-297ws\" (UID: \"52db7cf8-54c4-4dce-a960-843c4cc11168\") " pod="openshift-cluster-node-tuning-operator/tuned-297ws" Jun 02 21:33:45.391701 ip-10-0-138-193 kubenswrapper[2578]: I0602 21:33:45.391567 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/9963c656-171f-412f-b531-d4e89671117c-kubelet-config\") pod \"global-pull-secret-syncer-rf8cp\" (UID: \"9963c656-171f-412f-b531-d4e89671117c\") " pod="kube-system/global-pull-secret-syncer-rf8cp" Jun 02 21:33:45.391701 ip-10-0-138-193 kubenswrapper[2578]: I0602 21:33:45.391629 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/9963c656-171f-412f-b531-d4e89671117c-dbus\") pod \"global-pull-secret-syncer-rf8cp\" (UID: \"9963c656-171f-412f-b531-d4e89671117c\") " pod="kube-system/global-pull-secret-syncer-rf8cp" Jun 02 21:33:45.392421 ip-10-0-138-193 kubenswrapper[2578]: I0602 21:33:45.392321 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/ebd8238d-c142-4303-9f5c-e61073fd0920-konnectivity-ca\") pod \"konnectivity-agent-q78cn\" (UID: \"ebd8238d-c142-4303-9f5c-e61073fd0920\") " pod="kube-system/konnectivity-agent-q78cn" Jun 02 21:33:45.393466 ip-10-0-138-193 kubenswrapper[2578]: I0602 21:33:45.393441 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/ebd8238d-c142-4303-9f5c-e61073fd0920-agent-certs\") pod \"konnectivity-agent-q78cn\" (UID: \"ebd8238d-c142-4303-9f5c-e61073fd0920\") " pod="kube-system/konnectivity-agent-q78cn" Jun 02 21:33:45.393592 ip-10-0-138-193 kubenswrapper[2578]: I0602 21:33:45.393542 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/52db7cf8-54c4-4dce-a960-843c4cc11168-tmp\") pod \"tuned-297ws\" (UID: \"52db7cf8-54c4-4dce-a960-843c4cc11168\") " pod="openshift-cluster-node-tuning-operator/tuned-297ws" Jun 02 21:33:45.393734 ip-10-0-138-193 kubenswrapper[2578]: I0602 21:33:45.393717 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/52db7cf8-54c4-4dce-a960-843c4cc11168-etc-tuned\") pod \"tuned-297ws\" (UID: \"52db7cf8-54c4-4dce-a960-843c4cc11168\") " pod="openshift-cluster-node-tuning-operator/tuned-297ws" Jun 02 21:33:45.398522 ip-10-0-138-193 kubenswrapper[2578]: I0602 21:33:45.398499 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-s9xb7\" (UniqueName: \"kubernetes.io/projected/52db7cf8-54c4-4dce-a960-843c4cc11168-kube-api-access-s9xb7\") pod \"tuned-297ws\" (UID: \"52db7cf8-54c4-4dce-a960-843c4cc11168\") " pod="openshift-cluster-node-tuning-operator/tuned-297ws" Jun 02 21:33:45.480668 ip-10-0-138-193 kubenswrapper[2578]: I0602 21:33:45.480577 2578 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-operator/iptables-alerter-xbl27" Jun 02 21:33:45.485216 ip-10-0-138-193 kubenswrapper[2578]: I0602 21:33:45.485195 2578 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/node-ca-mnnsl" Jun 02 21:33:45.493896 ip-10-0-138-193 kubenswrapper[2578]: I0602 21:33:45.493874 2578 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-9xsr6" Jun 02 21:33:45.499480 ip-10-0-138-193 kubenswrapper[2578]: I0602 21:33:45.499460 2578 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-p74k8" Jun 02 21:33:45.505009 ip-10-0-138-193 kubenswrapper[2578]: I0602 21:33:45.504989 2578 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-additional-cni-plugins-s7sgt" Jun 02 21:33:45.511678 ip-10-0-138-193 kubenswrapper[2578]: I0602 21:33:45.511608 2578 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ovn-kubernetes/ovnkube-node-5zgzd" Jun 02 21:33:45.518386 ip-10-0-138-193 kubenswrapper[2578]: I0602 21:33:45.518368 2578 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/node-resolver-vfdfn" Jun 02 21:33:45.525906 ip-10-0-138-193 kubenswrapper[2578]: I0602 21:33:45.525890 2578 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-node-tuning-operator/tuned-297ws" Jun 02 21:33:45.533392 ip-10-0-138-193 kubenswrapper[2578]: I0602 21:33:45.533373 2578 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/konnectivity-agent-q78cn" Jun 02 21:33:45.794119 ip-10-0-138-193 kubenswrapper[2578]: I0602 21:33:45.794034 2578 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/adfce93b-f07e-480a-af26-5dc7df23fa48-metrics-certs\") pod \"network-metrics-daemon-k2vdd\" (UID: \"adfce93b-f07e-480a-af26-5dc7df23fa48\") " pod="openshift-multus/network-metrics-daemon-k2vdd" Jun 02 21:33:45.794238 ip-10-0-138-193 kubenswrapper[2578]: E0602 21:33:45.794205 2578 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jun 02 21:33:45.794294 ip-10-0-138-193 kubenswrapper[2578]: E0602 21:33:45.794283 2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/adfce93b-f07e-480a-af26-5dc7df23fa48-metrics-certs podName:adfce93b-f07e-480a-af26-5dc7df23fa48 nodeName:}" failed. No retries permitted until 2026-06-02 21:33:46.794266536 +0000 UTC m=+4.046164426 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/adfce93b-f07e-480a-af26-5dc7df23fa48-metrics-certs") pod "network-metrics-daemon-k2vdd" (UID: "adfce93b-f07e-480a-af26-5dc7df23fa48") : object "openshift-multus"/"metrics-daemon-secret" not registered Jun 02 21:33:45.829024 ip-10-0-138-193 kubenswrapper[2578]: W0602 21:33:45.828986 2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod52db7cf8_54c4_4dce_a960_843c4cc11168.slice/crio-652fb26a98c5276fc661097980bfba3211b63e228085dfc925cb1e533a234930 WatchSource:0}: Error finding container 652fb26a98c5276fc661097980bfba3211b63e228085dfc925cb1e533a234930: Status 404 returned error can't find the container with id 652fb26a98c5276fc661097980bfba3211b63e228085dfc925cb1e533a234930 Jun 02 21:33:45.830369 ip-10-0-138-193 kubenswrapper[2578]: W0602 21:33:45.830332 2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod3ea59100_2e7e_4a44_8ec1_c3f7e3472835.slice/crio-dccf641da5aa535c01304bd4405a4fe543277d09a299f011e64d80e959bc998a WatchSource:0}: Error finding container dccf641da5aa535c01304bd4405a4fe543277d09a299f011e64d80e959bc998a: Status 404 returned error can't find the container with id dccf641da5aa535c01304bd4405a4fe543277d09a299f011e64d80e959bc998a Jun 02 21:33:45.831364 ip-10-0-138-193 kubenswrapper[2578]: W0602 21:33:45.831319 2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podf2c18898_cc9a_4645_bab8_9ac55c476c7f.slice/crio-c3b04497dcf125509f7c0945ff162a24bc395ed5d31081fae3e16b048361a3ca WatchSource:0}: Error finding container c3b04497dcf125509f7c0945ff162a24bc395ed5d31081fae3e16b048361a3ca: Status 404 returned error can't find the container with id c3b04497dcf125509f7c0945ff162a24bc395ed5d31081fae3e16b048361a3ca Jun 02 21:33:45.833212 ip-10-0-138-193 kubenswrapper[2578]: W0602 21:33:45.833047 2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podebd8238d_c142_4303_9f5c_e61073fd0920.slice/crio-fd466fd8aa81c5633b6704b3a8991159fad8c1dbbda007233aa77872d0ed2098 WatchSource:0}: Error finding container fd466fd8aa81c5633b6704b3a8991159fad8c1dbbda007233aa77872d0ed2098: Status 404 returned error can't find the container with id fd466fd8aa81c5633b6704b3a8991159fad8c1dbbda007233aa77872d0ed2098 Jun 02 21:33:45.833648 ip-10-0-138-193 kubenswrapper[2578]: W0602 21:33:45.833616 2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podadf5f00d_bf02_4037_b6e7_92c6485f3e38.slice/crio-e7152fd2465cd733c35c0773bb502e531817a899d95986d619f45a79e0e55950 WatchSource:0}: Error finding container e7152fd2465cd733c35c0773bb502e531817a899d95986d619f45a79e0e55950: Status 404 returned error can't find the container with id e7152fd2465cd733c35c0773bb502e531817a899d95986d619f45a79e0e55950 Jun 02 21:33:45.836348 ip-10-0-138-193 kubenswrapper[2578]: W0602 21:33:45.836250 2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod4d2236cd_d674_4c20_821e_7173b6db4b74.slice/crio-59e98cd7e02242ba410bff122e78a12a15e2c231e972cc3927620522e9f6fe21 WatchSource:0}: Error finding container 59e98cd7e02242ba410bff122e78a12a15e2c231e972cc3927620522e9f6fe21: Status 404 returned error can't find the container with id 59e98cd7e02242ba410bff122e78a12a15e2c231e972cc3927620522e9f6fe21 Jun 02 21:33:45.840301 ip-10-0-138-193 kubenswrapper[2578]: W0602 21:33:45.840264 2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod96c320b0_e239_4e96_aaae_28255100dae4.slice/crio-ae40f63baddb4d8c68a875b83324ff3bd7f74bc88a87cc175fef3d502b031404 WatchSource:0}: Error finding container ae40f63baddb4d8c68a875b83324ff3bd7f74bc88a87cc175fef3d502b031404: Status 404 returned error can't find the container with id ae40f63baddb4d8c68a875b83324ff3bd7f74bc88a87cc175fef3d502b031404 Jun 02 21:33:45.840585 ip-10-0-138-193 kubenswrapper[2578]: W0602 21:33:45.840524 2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podecde3d34_b3a4_422b_9a2d_c8a4541cc718.slice/crio-68017682b786d205e718729b168b4e4421ea542e0672f16d0a5a5fd50775869e WatchSource:0}: Error finding container 68017682b786d205e718729b168b4e4421ea542e0672f16d0a5a5fd50775869e: Status 404 returned error can't find the container with id 68017682b786d205e718729b168b4e4421ea542e0672f16d0a5a5fd50775869e Jun 02 21:33:45.895177 ip-10-0-138-193 kubenswrapper[2578]: I0602 21:33:45.895031 2578 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-d5dnb\" (UniqueName: \"kubernetes.io/projected/950ec20f-2c4b-4e1b-96ba-c02f9a6d124a-kube-api-access-d5dnb\") pod \"network-check-target-r92gd\" (UID: \"950ec20f-2c4b-4e1b-96ba-c02f9a6d124a\") " pod="openshift-network-diagnostics/network-check-target-r92gd" Jun 02 21:33:45.895266 ip-10-0-138-193 kubenswrapper[2578]: E0602 21:33:45.895180 2578 projected.go:289] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jun 02 21:33:45.895266 ip-10-0-138-193 kubenswrapper[2578]: E0602 21:33:45.895196 2578 projected.go:289] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jun 02 21:33:45.895266 ip-10-0-138-193 kubenswrapper[2578]: E0602 21:33:45.895205 2578 projected.go:194] Error preparing data for projected volume kube-api-access-d5dnb for pod openshift-network-diagnostics/network-check-target-r92gd: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 02 21:33:45.895266 ip-10-0-138-193 kubenswrapper[2578]: E0602 21:33:45.895242 2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/950ec20f-2c4b-4e1b-96ba-c02f9a6d124a-kube-api-access-d5dnb podName:950ec20f-2c4b-4e1b-96ba-c02f9a6d124a nodeName:}" failed. No retries permitted until 2026-06-02 21:33:46.895229438 +0000 UTC m=+4.147127323 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "kube-api-access-d5dnb" (UniqueName: "kubernetes.io/projected/950ec20f-2c4b-4e1b-96ba-c02f9a6d124a-kube-api-access-d5dnb") pod "network-check-target-r92gd" (UID: "950ec20f-2c4b-4e1b-96ba-c02f9a6d124a") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 02 21:33:45.895266 ip-10-0-138-193 kubenswrapper[2578]: E0602 21:33:45.895263 2578 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jun 02 21:33:45.895462 ip-10-0-138-193 kubenswrapper[2578]: E0602 21:33:45.895303 2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/9963c656-171f-412f-b531-d4e89671117c-original-pull-secret podName:9963c656-171f-412f-b531-d4e89671117c nodeName:}" failed. No retries permitted until 2026-06-02 21:33:46.895291275 +0000 UTC m=+4.147189159 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/9963c656-171f-412f-b531-d4e89671117c-original-pull-secret") pod "global-pull-secret-syncer-rf8cp" (UID: "9963c656-171f-412f-b531-d4e89671117c") : object "kube-system"/"original-pull-secret" not registered Jun 02 21:33:45.895462 ip-10-0-138-193 kubenswrapper[2578]: I0602 21:33:45.895202 2578 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/9963c656-171f-412f-b531-d4e89671117c-original-pull-secret\") pod \"global-pull-secret-syncer-rf8cp\" (UID: \"9963c656-171f-412f-b531-d4e89671117c\") " pod="kube-system/global-pull-secret-syncer-rf8cp" Jun 02 21:33:46.276749 ip-10-0-138-193 kubenswrapper[2578]: I0602 21:33:46.276700 2578 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kubelet-serving" expiration="2028-06-01 21:28:44 +0000 UTC" deadline="2027-11-04 05:29:03.482130608 +0000 UTC" Jun 02 21:33:46.277307 ip-10-0-138-193 kubenswrapper[2578]: I0602 21:33:46.276793 2578 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kubelet-serving" sleep="12463h55m17.205341639s" Jun 02 21:33:46.332401 ip-10-0-138-193 kubenswrapper[2578]: I0602 21:33:46.332320 2578 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-dns/node-resolver-vfdfn" event={"ID":"4d2236cd-d674-4c20-821e-7173b6db4b74","Type":"ContainerStarted","Data":"59e98cd7e02242ba410bff122e78a12a15e2c231e972cc3927620522e9f6fe21"} Jun 02 21:33:46.337007 ip-10-0-138-193 kubenswrapper[2578]: I0602 21:33:46.336871 2578 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-node-tuning-operator/tuned-297ws" event={"ID":"52db7cf8-54c4-4dce-a960-843c4cc11168","Type":"ContainerStarted","Data":"652fb26a98c5276fc661097980bfba3211b63e228085dfc925cb1e533a234930"} Jun 02 21:33:46.357625 ip-10-0-138-193 kubenswrapper[2578]: I0602 21:33:46.357585 2578 generic.go:358] "Generic (PLEG): container finished" podID="247a6670237571f242d56083262cafaa" containerID="39d4ba4d1fa0fbf601a1f04a2bd2e9a02df0bd9ce4a2f9754fc6fc633661d584" exitCode=0 Jun 02 21:33:46.357766 ip-10-0-138-193 kubenswrapper[2578]: I0602 21:33:46.357657 2578 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-138-193.ec2.internal" event={"ID":"247a6670237571f242d56083262cafaa","Type":"ContainerDied","Data":"39d4ba4d1fa0fbf601a1f04a2bd2e9a02df0bd9ce4a2f9754fc6fc633661d584"} Jun 02 21:33:46.373469 ip-10-0-138-193 kubenswrapper[2578]: I0602 21:33:46.373441 2578 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-5zgzd" event={"ID":"ecde3d34-b3a4-422b-9a2d-c8a4541cc718","Type":"ContainerStarted","Data":"68017682b786d205e718729b168b4e4421ea542e0672f16d0a5a5fd50775869e"} Jun 02 21:33:46.393795 ip-10-0-138-193 kubenswrapper[2578]: I0602 21:33:46.393762 2578 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-9xsr6" event={"ID":"96c320b0-e239-4e96-aaae-28255100dae4","Type":"ContainerStarted","Data":"ae40f63baddb4d8c68a875b83324ff3bd7f74bc88a87cc175fef3d502b031404"} Jun 02 21:33:46.406344 ip-10-0-138-193 kubenswrapper[2578]: I0602 21:33:46.406314 2578 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/node-ca-mnnsl" event={"ID":"fd30f6e0-874c-411b-b8c6-0df250364c15","Type":"ContainerStarted","Data":"fc39fafd7b85ca9fdee533e0a19dc5c9dec2f7216e201745c5cf922ccda106f6"} Jun 02 21:33:46.422268 ip-10-0-138-193 kubenswrapper[2578]: I0602 21:33:46.422241 2578 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-s7sgt" event={"ID":"f2c18898-cc9a-4645-bab8-9ac55c476c7f","Type":"ContainerStarted","Data":"c3b04497dcf125509f7c0945ff162a24bc395ed5d31081fae3e16b048361a3ca"} Jun 02 21:33:46.434628 ip-10-0-138-193 kubenswrapper[2578]: I0602 21:33:46.434601 2578 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-network-operator/iptables-alerter-xbl27" event={"ID":"adf5f00d-bf02-4037-b6e7-92c6485f3e38","Type":"ContainerStarted","Data":"e7152fd2465cd733c35c0773bb502e531817a899d95986d619f45a79e0e55950"} Jun 02 21:33:46.450401 ip-10-0-138-193 kubenswrapper[2578]: I0602 21:33:46.450375 2578 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kube-system/konnectivity-agent-q78cn" event={"ID":"ebd8238d-c142-4303-9f5c-e61073fd0920","Type":"ContainerStarted","Data":"fd466fd8aa81c5633b6704b3a8991159fad8c1dbbda007233aa77872d0ed2098"} Jun 02 21:33:46.465233 ip-10-0-138-193 kubenswrapper[2578]: I0602 21:33:46.465193 2578 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-p74k8" event={"ID":"3ea59100-2e7e-4a44-8ec1-c3f7e3472835","Type":"ContainerStarted","Data":"dccf641da5aa535c01304bd4405a4fe543277d09a299f011e64d80e959bc998a"} Jun 02 21:33:46.481796 ip-10-0-138-193 kubenswrapper[2578]: I0602 21:33:46.481773 2578 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-138-193.ec2.internal" event={"ID":"77f9e070a3a0bb8738701c4daea1dbb2","Type":"ContainerStarted","Data":"900549c2a2f5a38bc72b4af75036e807fcd8230de9af8358cab5f86287b10f51"} Jun 02 21:33:46.805635 ip-10-0-138-193 kubenswrapper[2578]: I0602 21:33:46.804992 2578 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/adfce93b-f07e-480a-af26-5dc7df23fa48-metrics-certs\") pod \"network-metrics-daemon-k2vdd\" (UID: \"adfce93b-f07e-480a-af26-5dc7df23fa48\") " pod="openshift-multus/network-metrics-daemon-k2vdd" Jun 02 21:33:46.805635 ip-10-0-138-193 kubenswrapper[2578]: E0602 21:33:46.805194 2578 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jun 02 21:33:46.805635 ip-10-0-138-193 kubenswrapper[2578]: E0602 21:33:46.805264 2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/adfce93b-f07e-480a-af26-5dc7df23fa48-metrics-certs podName:adfce93b-f07e-480a-af26-5dc7df23fa48 nodeName:}" failed. No retries permitted until 2026-06-02 21:33:48.805244149 +0000 UTC m=+6.057142050 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/adfce93b-f07e-480a-af26-5dc7df23fa48-metrics-certs") pod "network-metrics-daemon-k2vdd" (UID: "adfce93b-f07e-480a-af26-5dc7df23fa48") : object "openshift-multus"/"metrics-daemon-secret" not registered Jun 02 21:33:46.905778 ip-10-0-138-193 kubenswrapper[2578]: I0602 21:33:46.905742 2578 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-d5dnb\" (UniqueName: \"kubernetes.io/projected/950ec20f-2c4b-4e1b-96ba-c02f9a6d124a-kube-api-access-d5dnb\") pod \"network-check-target-r92gd\" (UID: \"950ec20f-2c4b-4e1b-96ba-c02f9a6d124a\") " pod="openshift-network-diagnostics/network-check-target-r92gd" Jun 02 21:33:46.905957 ip-10-0-138-193 kubenswrapper[2578]: I0602 21:33:46.905803 2578 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/9963c656-171f-412f-b531-d4e89671117c-original-pull-secret\") pod \"global-pull-secret-syncer-rf8cp\" (UID: \"9963c656-171f-412f-b531-d4e89671117c\") " pod="kube-system/global-pull-secret-syncer-rf8cp" Jun 02 21:33:46.906021 ip-10-0-138-193 kubenswrapper[2578]: E0602 21:33:46.905959 2578 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jun 02 21:33:46.906112 ip-10-0-138-193 kubenswrapper[2578]: E0602 21:33:46.906024 2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/9963c656-171f-412f-b531-d4e89671117c-original-pull-secret podName:9963c656-171f-412f-b531-d4e89671117c nodeName:}" failed. No retries permitted until 2026-06-02 21:33:48.906005938 +0000 UTC m=+6.157903830 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/9963c656-171f-412f-b531-d4e89671117c-original-pull-secret") pod "global-pull-secret-syncer-rf8cp" (UID: "9963c656-171f-412f-b531-d4e89671117c") : object "kube-system"/"original-pull-secret" not registered Jun 02 21:33:46.906327 ip-10-0-138-193 kubenswrapper[2578]: E0602 21:33:46.906185 2578 projected.go:289] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jun 02 21:33:46.906327 ip-10-0-138-193 kubenswrapper[2578]: E0602 21:33:46.906202 2578 projected.go:289] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jun 02 21:33:46.906327 ip-10-0-138-193 kubenswrapper[2578]: E0602 21:33:46.906214 2578 projected.go:194] Error preparing data for projected volume kube-api-access-d5dnb for pod openshift-network-diagnostics/network-check-target-r92gd: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 02 21:33:46.906327 ip-10-0-138-193 kubenswrapper[2578]: E0602 21:33:46.906293 2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/950ec20f-2c4b-4e1b-96ba-c02f9a6d124a-kube-api-access-d5dnb podName:950ec20f-2c4b-4e1b-96ba-c02f9a6d124a nodeName:}" failed. No retries permitted until 2026-06-02 21:33:48.90627923 +0000 UTC m=+6.158177121 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "kube-api-access-d5dnb" (UniqueName: "kubernetes.io/projected/950ec20f-2c4b-4e1b-96ba-c02f9a6d124a-kube-api-access-d5dnb") pod "network-check-target-r92gd" (UID: "950ec20f-2c4b-4e1b-96ba-c02f9a6d124a") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 02 21:33:47.320875 ip-10-0-138-193 kubenswrapper[2578]: I0602 21:33:47.318229 2578 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-r92gd" Jun 02 21:33:47.320875 ip-10-0-138-193 kubenswrapper[2578]: E0602 21:33:47.318359 2578 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-r92gd" podUID="950ec20f-2c4b-4e1b-96ba-c02f9a6d124a" Jun 02 21:33:47.320875 ip-10-0-138-193 kubenswrapper[2578]: I0602 21:33:47.318800 2578 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-rf8cp" Jun 02 21:33:47.320875 ip-10-0-138-193 kubenswrapper[2578]: E0602 21:33:47.318894 2578 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-rf8cp" podUID="9963c656-171f-412f-b531-d4e89671117c" Jun 02 21:33:47.320875 ip-10-0-138-193 kubenswrapper[2578]: I0602 21:33:47.318981 2578 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-k2vdd" Jun 02 21:33:47.320875 ip-10-0-138-193 kubenswrapper[2578]: E0602 21:33:47.319063 2578 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-k2vdd" podUID="adfce93b-f07e-480a-af26-5dc7df23fa48" Jun 02 21:33:47.500453 ip-10-0-138-193 kubenswrapper[2578]: I0602 21:33:47.500231 2578 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-138-193.ec2.internal" event={"ID":"247a6670237571f242d56083262cafaa","Type":"ContainerStarted","Data":"204694869ceadecb9fae245ce53a87152ef3cccd960c46d4f1b5d827c9b74a56"} Jun 02 21:33:47.512785 ip-10-0-138-193 kubenswrapper[2578]: I0602 21:33:47.512709 2578 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="kube-system/kube-apiserver-proxy-ip-10-0-138-193.ec2.internal" podStartSLOduration=3.512689597 podStartE2EDuration="3.512689597s" podCreationTimestamp="2026-06-02 21:33:44 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2026-06-02 21:33:46.502048536 +0000 UTC m=+3.753946444" watchObservedRunningTime="2026-06-02 21:33:47.512689597 +0000 UTC m=+4.764587503" Jun 02 21:33:48.821056 ip-10-0-138-193 kubenswrapper[2578]: I0602 21:33:48.821010 2578 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/adfce93b-f07e-480a-af26-5dc7df23fa48-metrics-certs\") pod \"network-metrics-daemon-k2vdd\" (UID: \"adfce93b-f07e-480a-af26-5dc7df23fa48\") " pod="openshift-multus/network-metrics-daemon-k2vdd" Jun 02 21:33:48.821527 ip-10-0-138-193 kubenswrapper[2578]: E0602 21:33:48.821133 2578 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jun 02 21:33:48.821527 ip-10-0-138-193 kubenswrapper[2578]: E0602 21:33:48.821206 2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/adfce93b-f07e-480a-af26-5dc7df23fa48-metrics-certs podName:adfce93b-f07e-480a-af26-5dc7df23fa48 nodeName:}" failed. No retries permitted until 2026-06-02 21:33:52.821186253 +0000 UTC m=+10.073084152 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/adfce93b-f07e-480a-af26-5dc7df23fa48-metrics-certs") pod "network-metrics-daemon-k2vdd" (UID: "adfce93b-f07e-480a-af26-5dc7df23fa48") : object "openshift-multus"/"metrics-daemon-secret" not registered Jun 02 21:33:48.921759 ip-10-0-138-193 kubenswrapper[2578]: I0602 21:33:48.921722 2578 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-d5dnb\" (UniqueName: \"kubernetes.io/projected/950ec20f-2c4b-4e1b-96ba-c02f9a6d124a-kube-api-access-d5dnb\") pod \"network-check-target-r92gd\" (UID: \"950ec20f-2c4b-4e1b-96ba-c02f9a6d124a\") " pod="openshift-network-diagnostics/network-check-target-r92gd" Jun 02 21:33:48.921943 ip-10-0-138-193 kubenswrapper[2578]: I0602 21:33:48.921783 2578 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/9963c656-171f-412f-b531-d4e89671117c-original-pull-secret\") pod \"global-pull-secret-syncer-rf8cp\" (UID: \"9963c656-171f-412f-b531-d4e89671117c\") " pod="kube-system/global-pull-secret-syncer-rf8cp" Jun 02 21:33:48.922014 ip-10-0-138-193 kubenswrapper[2578]: E0602 21:33:48.921993 2578 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jun 02 21:33:48.922354 ip-10-0-138-193 kubenswrapper[2578]: E0602 21:33:48.922058 2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/9963c656-171f-412f-b531-d4e89671117c-original-pull-secret podName:9963c656-171f-412f-b531-d4e89671117c nodeName:}" failed. No retries permitted until 2026-06-02 21:33:52.922040322 +0000 UTC m=+10.173938210 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/9963c656-171f-412f-b531-d4e89671117c-original-pull-secret") pod "global-pull-secret-syncer-rf8cp" (UID: "9963c656-171f-412f-b531-d4e89671117c") : object "kube-system"/"original-pull-secret" not registered Jun 02 21:33:48.922354 ip-10-0-138-193 kubenswrapper[2578]: E0602 21:33:48.922204 2578 projected.go:289] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jun 02 21:33:48.922354 ip-10-0-138-193 kubenswrapper[2578]: E0602 21:33:48.922231 2578 projected.go:289] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jun 02 21:33:48.922354 ip-10-0-138-193 kubenswrapper[2578]: E0602 21:33:48.922245 2578 projected.go:194] Error preparing data for projected volume kube-api-access-d5dnb for pod openshift-network-diagnostics/network-check-target-r92gd: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 02 21:33:48.922354 ip-10-0-138-193 kubenswrapper[2578]: E0602 21:33:48.922295 2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/950ec20f-2c4b-4e1b-96ba-c02f9a6d124a-kube-api-access-d5dnb podName:950ec20f-2c4b-4e1b-96ba-c02f9a6d124a nodeName:}" failed. No retries permitted until 2026-06-02 21:33:52.922279454 +0000 UTC m=+10.174177358 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "kube-api-access-d5dnb" (UniqueName: "kubernetes.io/projected/950ec20f-2c4b-4e1b-96ba-c02f9a6d124a-kube-api-access-d5dnb") pod "network-check-target-r92gd" (UID: "950ec20f-2c4b-4e1b-96ba-c02f9a6d124a") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 02 21:33:49.318337 ip-10-0-138-193 kubenswrapper[2578]: I0602 21:33:49.317857 2578 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-rf8cp" Jun 02 21:33:49.318337 ip-10-0-138-193 kubenswrapper[2578]: I0602 21:33:49.317996 2578 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-k2vdd" Jun 02 21:33:49.318337 ip-10-0-138-193 kubenswrapper[2578]: E0602 21:33:49.317990 2578 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-rf8cp" podUID="9963c656-171f-412f-b531-d4e89671117c" Jun 02 21:33:49.318337 ip-10-0-138-193 kubenswrapper[2578]: I0602 21:33:49.318087 2578 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-r92gd" Jun 02 21:33:49.318337 ip-10-0-138-193 kubenswrapper[2578]: E0602 21:33:49.318174 2578 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-k2vdd" podUID="adfce93b-f07e-480a-af26-5dc7df23fa48" Jun 02 21:33:49.318337 ip-10-0-138-193 kubenswrapper[2578]: E0602 21:33:49.318248 2578 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-r92gd" podUID="950ec20f-2c4b-4e1b-96ba-c02f9a6d124a" Jun 02 21:33:51.318650 ip-10-0-138-193 kubenswrapper[2578]: I0602 21:33:51.318318 2578 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-rf8cp" Jun 02 21:33:51.318650 ip-10-0-138-193 kubenswrapper[2578]: E0602 21:33:51.318446 2578 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-rf8cp" podUID="9963c656-171f-412f-b531-d4e89671117c" Jun 02 21:33:51.318650 ip-10-0-138-193 kubenswrapper[2578]: I0602 21:33:51.318460 2578 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-r92gd" Jun 02 21:33:51.318650 ip-10-0-138-193 kubenswrapper[2578]: E0602 21:33:51.318536 2578 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-r92gd" podUID="950ec20f-2c4b-4e1b-96ba-c02f9a6d124a" Jun 02 21:33:51.318650 ip-10-0-138-193 kubenswrapper[2578]: I0602 21:33:51.318318 2578 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-k2vdd" Jun 02 21:33:51.318650 ip-10-0-138-193 kubenswrapper[2578]: E0602 21:33:51.318618 2578 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-k2vdd" podUID="adfce93b-f07e-480a-af26-5dc7df23fa48" Jun 02 21:33:52.854901 ip-10-0-138-193 kubenswrapper[2578]: I0602 21:33:52.854312 2578 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/adfce93b-f07e-480a-af26-5dc7df23fa48-metrics-certs\") pod \"network-metrics-daemon-k2vdd\" (UID: \"adfce93b-f07e-480a-af26-5dc7df23fa48\") " pod="openshift-multus/network-metrics-daemon-k2vdd" Jun 02 21:33:52.854901 ip-10-0-138-193 kubenswrapper[2578]: E0602 21:33:52.854503 2578 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jun 02 21:33:52.854901 ip-10-0-138-193 kubenswrapper[2578]: E0602 21:33:52.854569 2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/adfce93b-f07e-480a-af26-5dc7df23fa48-metrics-certs podName:adfce93b-f07e-480a-af26-5dc7df23fa48 nodeName:}" failed. No retries permitted until 2026-06-02 21:34:00.854547437 +0000 UTC m=+18.106445321 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/adfce93b-f07e-480a-af26-5dc7df23fa48-metrics-certs") pod "network-metrics-daemon-k2vdd" (UID: "adfce93b-f07e-480a-af26-5dc7df23fa48") : object "openshift-multus"/"metrics-daemon-secret" not registered Jun 02 21:33:52.954760 ip-10-0-138-193 kubenswrapper[2578]: I0602 21:33:52.954723 2578 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-d5dnb\" (UniqueName: \"kubernetes.io/projected/950ec20f-2c4b-4e1b-96ba-c02f9a6d124a-kube-api-access-d5dnb\") pod \"network-check-target-r92gd\" (UID: \"950ec20f-2c4b-4e1b-96ba-c02f9a6d124a\") " pod="openshift-network-diagnostics/network-check-target-r92gd" Jun 02 21:33:52.954760 ip-10-0-138-193 kubenswrapper[2578]: I0602 21:33:52.954777 2578 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/9963c656-171f-412f-b531-d4e89671117c-original-pull-secret\") pod \"global-pull-secret-syncer-rf8cp\" (UID: \"9963c656-171f-412f-b531-d4e89671117c\") " pod="kube-system/global-pull-secret-syncer-rf8cp" Jun 02 21:33:52.955015 ip-10-0-138-193 kubenswrapper[2578]: E0602 21:33:52.954881 2578 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jun 02 21:33:52.955015 ip-10-0-138-193 kubenswrapper[2578]: E0602 21:33:52.954907 2578 projected.go:289] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jun 02 21:33:52.955015 ip-10-0-138-193 kubenswrapper[2578]: E0602 21:33:52.954931 2578 projected.go:289] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jun 02 21:33:52.955015 ip-10-0-138-193 kubenswrapper[2578]: E0602 21:33:52.954945 2578 projected.go:194] Error preparing data for projected volume kube-api-access-d5dnb for pod openshift-network-diagnostics/network-check-target-r92gd: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 02 21:33:52.955015 ip-10-0-138-193 kubenswrapper[2578]: E0602 21:33:52.954934 2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/9963c656-171f-412f-b531-d4e89671117c-original-pull-secret podName:9963c656-171f-412f-b531-d4e89671117c nodeName:}" failed. No retries permitted until 2026-06-02 21:34:00.95491581 +0000 UTC m=+18.206813710 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/9963c656-171f-412f-b531-d4e89671117c-original-pull-secret") pod "global-pull-secret-syncer-rf8cp" (UID: "9963c656-171f-412f-b531-d4e89671117c") : object "kube-system"/"original-pull-secret" not registered Jun 02 21:33:52.955015 ip-10-0-138-193 kubenswrapper[2578]: E0602 21:33:52.955011 2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/950ec20f-2c4b-4e1b-96ba-c02f9a6d124a-kube-api-access-d5dnb podName:950ec20f-2c4b-4e1b-96ba-c02f9a6d124a nodeName:}" failed. No retries permitted until 2026-06-02 21:34:00.954994308 +0000 UTC m=+18.206892198 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "kube-api-access-d5dnb" (UniqueName: "kubernetes.io/projected/950ec20f-2c4b-4e1b-96ba-c02f9a6d124a-kube-api-access-d5dnb") pod "network-check-target-r92gd" (UID: "950ec20f-2c4b-4e1b-96ba-c02f9a6d124a") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 02 21:33:53.319569 ip-10-0-138-193 kubenswrapper[2578]: I0602 21:33:53.318834 2578 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-k2vdd" Jun 02 21:33:53.319569 ip-10-0-138-193 kubenswrapper[2578]: E0602 21:33:53.318951 2578 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-k2vdd" podUID="adfce93b-f07e-480a-af26-5dc7df23fa48" Jun 02 21:33:53.319569 ip-10-0-138-193 kubenswrapper[2578]: I0602 21:33:53.319323 2578 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-r92gd" Jun 02 21:33:53.319569 ip-10-0-138-193 kubenswrapper[2578]: E0602 21:33:53.319417 2578 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-r92gd" podUID="950ec20f-2c4b-4e1b-96ba-c02f9a6d124a" Jun 02 21:33:53.319569 ip-10-0-138-193 kubenswrapper[2578]: I0602 21:33:53.319465 2578 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-rf8cp" Jun 02 21:33:53.319569 ip-10-0-138-193 kubenswrapper[2578]: E0602 21:33:53.319533 2578 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-rf8cp" podUID="9963c656-171f-412f-b531-d4e89671117c" Jun 02 21:33:55.318111 ip-10-0-138-193 kubenswrapper[2578]: I0602 21:33:55.317914 2578 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-k2vdd" Jun 02 21:33:55.318111 ip-10-0-138-193 kubenswrapper[2578]: I0602 21:33:55.317949 2578 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-r92gd" Jun 02 21:33:55.318111 ip-10-0-138-193 kubenswrapper[2578]: E0602 21:33:55.318053 2578 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-k2vdd" podUID="adfce93b-f07e-480a-af26-5dc7df23fa48" Jun 02 21:33:55.318756 ip-10-0-138-193 kubenswrapper[2578]: E0602 21:33:55.318132 2578 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-r92gd" podUID="950ec20f-2c4b-4e1b-96ba-c02f9a6d124a" Jun 02 21:33:55.318756 ip-10-0-138-193 kubenswrapper[2578]: I0602 21:33:55.318184 2578 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-rf8cp" Jun 02 21:33:55.318756 ip-10-0-138-193 kubenswrapper[2578]: E0602 21:33:55.318254 2578 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-rf8cp" podUID="9963c656-171f-412f-b531-d4e89671117c" Jun 02 21:33:57.317984 ip-10-0-138-193 kubenswrapper[2578]: I0602 21:33:57.317946 2578 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-r92gd" Jun 02 21:33:57.318421 ip-10-0-138-193 kubenswrapper[2578]: I0602 21:33:57.317949 2578 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-rf8cp" Jun 02 21:33:57.318421 ip-10-0-138-193 kubenswrapper[2578]: E0602 21:33:57.318057 2578 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-r92gd" podUID="950ec20f-2c4b-4e1b-96ba-c02f9a6d124a" Jun 02 21:33:57.318421 ip-10-0-138-193 kubenswrapper[2578]: I0602 21:33:57.318064 2578 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-k2vdd" Jun 02 21:33:57.318707 ip-10-0-138-193 kubenswrapper[2578]: E0602 21:33:57.318660 2578 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-rf8cp" podUID="9963c656-171f-412f-b531-d4e89671117c" Jun 02 21:33:57.318869 ip-10-0-138-193 kubenswrapper[2578]: E0602 21:33:57.318848 2578 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-k2vdd" podUID="adfce93b-f07e-480a-af26-5dc7df23fa48" Jun 02 21:33:59.317802 ip-10-0-138-193 kubenswrapper[2578]: I0602 21:33:59.317761 2578 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-k2vdd" Jun 02 21:33:59.318291 ip-10-0-138-193 kubenswrapper[2578]: I0602 21:33:59.317807 2578 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-r92gd" Jun 02 21:33:59.318291 ip-10-0-138-193 kubenswrapper[2578]: I0602 21:33:59.317781 2578 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-rf8cp" Jun 02 21:33:59.318291 ip-10-0-138-193 kubenswrapper[2578]: E0602 21:33:59.317875 2578 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-k2vdd" podUID="adfce93b-f07e-480a-af26-5dc7df23fa48" Jun 02 21:33:59.318291 ip-10-0-138-193 kubenswrapper[2578]: E0602 21:33:59.317951 2578 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-rf8cp" podUID="9963c656-171f-412f-b531-d4e89671117c" Jun 02 21:33:59.318291 ip-10-0-138-193 kubenswrapper[2578]: E0602 21:33:59.318017 2578 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-r92gd" podUID="950ec20f-2c4b-4e1b-96ba-c02f9a6d124a" Jun 02 21:34:00.912764 ip-10-0-138-193 kubenswrapper[2578]: I0602 21:34:00.912722 2578 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/adfce93b-f07e-480a-af26-5dc7df23fa48-metrics-certs\") pod \"network-metrics-daemon-k2vdd\" (UID: \"adfce93b-f07e-480a-af26-5dc7df23fa48\") " pod="openshift-multus/network-metrics-daemon-k2vdd" Jun 02 21:34:00.913165 ip-10-0-138-193 kubenswrapper[2578]: E0602 21:34:00.912911 2578 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jun 02 21:34:00.913165 ip-10-0-138-193 kubenswrapper[2578]: E0602 21:34:00.912994 2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/adfce93b-f07e-480a-af26-5dc7df23fa48-metrics-certs podName:adfce93b-f07e-480a-af26-5dc7df23fa48 nodeName:}" failed. No retries permitted until 2026-06-02 21:34:16.912970322 +0000 UTC m=+34.164868220 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/adfce93b-f07e-480a-af26-5dc7df23fa48-metrics-certs") pod "network-metrics-daemon-k2vdd" (UID: "adfce93b-f07e-480a-af26-5dc7df23fa48") : object "openshift-multus"/"metrics-daemon-secret" not registered Jun 02 21:34:01.013525 ip-10-0-138-193 kubenswrapper[2578]: I0602 21:34:01.013490 2578 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-d5dnb\" (UniqueName: \"kubernetes.io/projected/950ec20f-2c4b-4e1b-96ba-c02f9a6d124a-kube-api-access-d5dnb\") pod \"network-check-target-r92gd\" (UID: \"950ec20f-2c4b-4e1b-96ba-c02f9a6d124a\") " pod="openshift-network-diagnostics/network-check-target-r92gd" Jun 02 21:34:01.013727 ip-10-0-138-193 kubenswrapper[2578]: I0602 21:34:01.013536 2578 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/9963c656-171f-412f-b531-d4e89671117c-original-pull-secret\") pod \"global-pull-secret-syncer-rf8cp\" (UID: \"9963c656-171f-412f-b531-d4e89671117c\") " pod="kube-system/global-pull-secret-syncer-rf8cp" Jun 02 21:34:01.013727 ip-10-0-138-193 kubenswrapper[2578]: E0602 21:34:01.013644 2578 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jun 02 21:34:01.013727 ip-10-0-138-193 kubenswrapper[2578]: E0602 21:34:01.013663 2578 projected.go:289] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jun 02 21:34:01.013727 ip-10-0-138-193 kubenswrapper[2578]: E0602 21:34:01.013687 2578 projected.go:289] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jun 02 21:34:01.013727 ip-10-0-138-193 kubenswrapper[2578]: E0602 21:34:01.013702 2578 projected.go:194] Error preparing data for projected volume kube-api-access-d5dnb for pod openshift-network-diagnostics/network-check-target-r92gd: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 02 21:34:01.013727 ip-10-0-138-193 kubenswrapper[2578]: E0602 21:34:01.013716 2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/9963c656-171f-412f-b531-d4e89671117c-original-pull-secret podName:9963c656-171f-412f-b531-d4e89671117c nodeName:}" failed. No retries permitted until 2026-06-02 21:34:17.013694272 +0000 UTC m=+34.265592174 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/9963c656-171f-412f-b531-d4e89671117c-original-pull-secret") pod "global-pull-secret-syncer-rf8cp" (UID: "9963c656-171f-412f-b531-d4e89671117c") : object "kube-system"/"original-pull-secret" not registered Jun 02 21:34:01.014022 ip-10-0-138-193 kubenswrapper[2578]: E0602 21:34:01.013746 2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/950ec20f-2c4b-4e1b-96ba-c02f9a6d124a-kube-api-access-d5dnb podName:950ec20f-2c4b-4e1b-96ba-c02f9a6d124a nodeName:}" failed. No retries permitted until 2026-06-02 21:34:17.013733643 +0000 UTC m=+34.265631540 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "kube-api-access-d5dnb" (UniqueName: "kubernetes.io/projected/950ec20f-2c4b-4e1b-96ba-c02f9a6d124a-kube-api-access-d5dnb") pod "network-check-target-r92gd" (UID: "950ec20f-2c4b-4e1b-96ba-c02f9a6d124a") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 02 21:34:01.317573 ip-10-0-138-193 kubenswrapper[2578]: I0602 21:34:01.317485 2578 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-rf8cp" Jun 02 21:34:01.317723 ip-10-0-138-193 kubenswrapper[2578]: E0602 21:34:01.317626 2578 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-rf8cp" podUID="9963c656-171f-412f-b531-d4e89671117c" Jun 02 21:34:01.317723 ip-10-0-138-193 kubenswrapper[2578]: I0602 21:34:01.317640 2578 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-k2vdd" Jun 02 21:34:01.317835 ip-10-0-138-193 kubenswrapper[2578]: E0602 21:34:01.317770 2578 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-k2vdd" podUID="adfce93b-f07e-480a-af26-5dc7df23fa48" Jun 02 21:34:01.317835 ip-10-0-138-193 kubenswrapper[2578]: I0602 21:34:01.317824 2578 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-r92gd" Jun 02 21:34:01.317937 ip-10-0-138-193 kubenswrapper[2578]: E0602 21:34:01.317901 2578 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-r92gd" podUID="950ec20f-2c4b-4e1b-96ba-c02f9a6d124a" Jun 02 21:34:03.318924 ip-10-0-138-193 kubenswrapper[2578]: I0602 21:34:03.318887 2578 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-r92gd" Jun 02 21:34:03.319441 ip-10-0-138-193 kubenswrapper[2578]: I0602 21:34:03.318936 2578 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-rf8cp" Jun 02 21:34:03.319441 ip-10-0-138-193 kubenswrapper[2578]: E0602 21:34:03.319005 2578 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-r92gd" podUID="950ec20f-2c4b-4e1b-96ba-c02f9a6d124a" Jun 02 21:34:03.319441 ip-10-0-138-193 kubenswrapper[2578]: I0602 21:34:03.319068 2578 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-k2vdd" Jun 02 21:34:03.319441 ip-10-0-138-193 kubenswrapper[2578]: E0602 21:34:03.319178 2578 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-k2vdd" podUID="adfce93b-f07e-480a-af26-5dc7df23fa48" Jun 02 21:34:03.319441 ip-10-0-138-193 kubenswrapper[2578]: E0602 21:34:03.319264 2578 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-rf8cp" podUID="9963c656-171f-412f-b531-d4e89671117c" Jun 02 21:34:04.530881 ip-10-0-138-193 kubenswrapper[2578]: I0602 21:34:04.530488 2578 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/node-ca-mnnsl" event={"ID":"fd30f6e0-874c-411b-b8c6-0df250364c15","Type":"ContainerStarted","Data":"9ef54d3bb5b755c8383602456521b21aface454ca3367fde50c8c91724de1207"} Jun 02 21:34:04.532386 ip-10-0-138-193 kubenswrapper[2578]: I0602 21:34:04.532355 2578 generic.go:358] "Generic (PLEG): container finished" podID="f2c18898-cc9a-4645-bab8-9ac55c476c7f" containerID="b46d34213bea40d456321fb7fe968a6976f36d5b20102b5123d09c657ac8f3c9" exitCode=0 Jun 02 21:34:04.532513 ip-10-0-138-193 kubenswrapper[2578]: I0602 21:34:04.532425 2578 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-s7sgt" event={"ID":"f2c18898-cc9a-4645-bab8-9ac55c476c7f","Type":"ContainerDied","Data":"b46d34213bea40d456321fb7fe968a6976f36d5b20102b5123d09c657ac8f3c9"} Jun 02 21:34:04.533943 ip-10-0-138-193 kubenswrapper[2578]: I0602 21:34:04.533855 2578 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kube-system/konnectivity-agent-q78cn" event={"ID":"ebd8238d-c142-4303-9f5c-e61073fd0920","Type":"ContainerStarted","Data":"17ffcfb41e78ae6257379864d02454298259deafea2e7cd427c575c08cf636af"} Jun 02 21:34:04.536616 ip-10-0-138-193 kubenswrapper[2578]: I0602 21:34:04.536592 2578 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-p74k8" event={"ID":"3ea59100-2e7e-4a44-8ec1-c3f7e3472835","Type":"ContainerStarted","Data":"4ce7bd899b003db3ecdf02b3e2bc828aac958ec98bd74272447eeb809d4283f8"} Jun 02 21:34:04.538159 ip-10-0-138-193 kubenswrapper[2578]: I0602 21:34:04.538139 2578 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-dns/node-resolver-vfdfn" event={"ID":"4d2236cd-d674-4c20-821e-7173b6db4b74","Type":"ContainerStarted","Data":"a2320c2f352da4a229b2a5fbb8a577049829aedfc71ed7b9ee2b2a6693ec0dc8"} Jun 02 21:34:04.539520 ip-10-0-138-193 kubenswrapper[2578]: I0602 21:34:04.539500 2578 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-node-tuning-operator/tuned-297ws" event={"ID":"52db7cf8-54c4-4dce-a960-843c4cc11168","Type":"ContainerStarted","Data":"e3837a7ea685d62f5ab0554be0fcd9eaa676d70aecf3a4e7f395c02e6d562e41"} Jun 02 21:34:04.542366 ip-10-0-138-193 kubenswrapper[2578]: I0602 21:34:04.542349 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-5zgzd_ecde3d34-b3a4-422b-9a2d-c8a4541cc718/ovn-acl-logging/0.log" Jun 02 21:34:04.542695 ip-10-0-138-193 kubenswrapper[2578]: I0602 21:34:04.542671 2578 generic.go:358] "Generic (PLEG): container finished" podID="ecde3d34-b3a4-422b-9a2d-c8a4541cc718" containerID="a2f1a4968b91894669650250ce59d84506b01e7fa32800ac693f103f09515120" exitCode=1 Jun 02 21:34:04.542750 ip-10-0-138-193 kubenswrapper[2578]: I0602 21:34:04.542720 2578 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-5zgzd" event={"ID":"ecde3d34-b3a4-422b-9a2d-c8a4541cc718","Type":"ContainerStarted","Data":"07d8a3d5f107f6e3feef3de985a40d3c7c9490e39ad9021a7c616bcf2ae81229"} Jun 02 21:34:04.542803 ip-10-0-138-193 kubenswrapper[2578]: I0602 21:34:04.542748 2578 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-5zgzd" event={"ID":"ecde3d34-b3a4-422b-9a2d-c8a4541cc718","Type":"ContainerStarted","Data":"50a609b422898e8684414fd220f6ff2644946a885672b858706dc953b6198e6b"} Jun 02 21:34:04.542803 ip-10-0-138-193 kubenswrapper[2578]: I0602 21:34:04.542772 2578 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-5zgzd" event={"ID":"ecde3d34-b3a4-422b-9a2d-c8a4541cc718","Type":"ContainerStarted","Data":"3dcef41e15dee30d8fed5f8919ef96bc11fefc57753425f6947c0abf7731c90f"} Jun 02 21:34:04.542803 ip-10-0-138-193 kubenswrapper[2578]: I0602 21:34:04.542790 2578 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-5zgzd" event={"ID":"ecde3d34-b3a4-422b-9a2d-c8a4541cc718","Type":"ContainerStarted","Data":"09f083d1249d87a28dbb2a5aac05b24cc6f2726d2881c33bc023d7f7c7c5bdc8"} Jun 02 21:34:04.542936 ip-10-0-138-193 kubenswrapper[2578]: I0602 21:34:04.542802 2578 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-5zgzd" event={"ID":"ecde3d34-b3a4-422b-9a2d-c8a4541cc718","Type":"ContainerDied","Data":"a2f1a4968b91894669650250ce59d84506b01e7fa32800ac693f103f09515120"} Jun 02 21:34:04.542936 ip-10-0-138-193 kubenswrapper[2578]: I0602 21:34:04.542817 2578 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-5zgzd" event={"ID":"ecde3d34-b3a4-422b-9a2d-c8a4541cc718","Type":"ContainerStarted","Data":"f3e18a566e8b309583964b8b6af1ac12be12d548c0904aef5b013fd23eae2d0b"} Jun 02 21:34:04.544159 ip-10-0-138-193 kubenswrapper[2578]: I0602 21:34:04.544138 2578 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-9xsr6" event={"ID":"96c320b0-e239-4e96-aaae-28255100dae4","Type":"ContainerStarted","Data":"0b68a96915020a5f7b37bef778bed63b6ec37757ff1d9b450dfbdc7fdc23fc61"} Jun 02 21:34:04.549479 ip-10-0-138-193 kubenswrapper[2578]: I0602 21:34:04.549442 2578 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-image-registry/node-ca-mnnsl" podStartSLOduration=3.862037469 podStartE2EDuration="21.549431719s" podCreationTimestamp="2026-06-02 21:33:43 +0000 UTC" firstStartedPulling="2026-06-02 21:33:45.841448835 +0000 UTC m=+3.093346733" lastFinishedPulling="2026-06-02 21:34:03.528843091 +0000 UTC m=+20.780740983" observedRunningTime="2026-06-02 21:34:04.549304826 +0000 UTC m=+21.801202733" watchObservedRunningTime="2026-06-02 21:34:04.549431719 +0000 UTC m=+21.801329615" Jun 02 21:34:04.549568 ip-10-0-138-193 kubenswrapper[2578]: I0602 21:34:04.549508 2578 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-138-193.ec2.internal" podStartSLOduration=20.54950432 podStartE2EDuration="20.54950432s" podCreationTimestamp="2026-06-02 21:33:44 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2026-06-02 21:33:47.51386042 +0000 UTC m=+4.765758329" watchObservedRunningTime="2026-06-02 21:34:04.54950432 +0000 UTC m=+21.801402225" Jun 02 21:34:04.565024 ip-10-0-138-193 kubenswrapper[2578]: I0602 21:34:04.564982 2578 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-dns/node-resolver-vfdfn" podStartSLOduration=3.868528784 podStartE2EDuration="21.564971499s" podCreationTimestamp="2026-06-02 21:33:43 +0000 UTC" firstStartedPulling="2026-06-02 21:33:45.838280938 +0000 UTC m=+3.090178830" lastFinishedPulling="2026-06-02 21:34:03.534723647 +0000 UTC m=+20.786621545" observedRunningTime="2026-06-02 21:34:04.564543734 +0000 UTC m=+21.816441640" watchObservedRunningTime="2026-06-02 21:34:04.564971499 +0000 UTC m=+21.816869405" Jun 02 21:34:04.607936 ip-10-0-138-193 kubenswrapper[2578]: I0602 21:34:04.607893 2578 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-cluster-node-tuning-operator/tuned-297ws" podStartSLOduration=3.8532290380000003 podStartE2EDuration="21.60787705s" podCreationTimestamp="2026-06-02 21:33:43 +0000 UTC" firstStartedPulling="2026-06-02 21:33:45.831838365 +0000 UTC m=+3.083736263" lastFinishedPulling="2026-06-02 21:34:03.586486388 +0000 UTC m=+20.838384275" observedRunningTime="2026-06-02 21:34:04.607361194 +0000 UTC m=+21.859259101" watchObservedRunningTime="2026-06-02 21:34:04.60787705 +0000 UTC m=+21.859774958" Jun 02 21:34:04.622857 ip-10-0-138-193 kubenswrapper[2578]: I0602 21:34:04.622819 2578 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="kube-system/konnectivity-agent-q78cn" podStartSLOduration=4.000304825 podStartE2EDuration="21.622808808s" podCreationTimestamp="2026-06-02 21:33:43 +0000 UTC" firstStartedPulling="2026-06-02 21:33:45.835296054 +0000 UTC m=+3.087193938" lastFinishedPulling="2026-06-02 21:34:03.457800036 +0000 UTC m=+20.709697921" observedRunningTime="2026-06-02 21:34:04.622534835 +0000 UTC m=+21.874432741" watchObservedRunningTime="2026-06-02 21:34:04.622808808 +0000 UTC m=+21.874706714" Jun 02 21:34:04.642965 ip-10-0-138-193 kubenswrapper[2578]: I0602 21:34:04.642926 2578 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-multus/multus-p74k8" podStartSLOduration=3.6015097259999997 podStartE2EDuration="21.642916226s" podCreationTimestamp="2026-06-02 21:33:43 +0000 UTC" firstStartedPulling="2026-06-02 21:33:45.833441221 +0000 UTC m=+3.085339106" lastFinishedPulling="2026-06-02 21:34:03.874847705 +0000 UTC m=+21.126745606" observedRunningTime="2026-06-02 21:34:04.642642197 +0000 UTC m=+21.894540102" watchObservedRunningTime="2026-06-02 21:34:04.642916226 +0000 UTC m=+21.894814132" Jun 02 21:34:05.206358 ip-10-0-138-193 kubenswrapper[2578]: I0602 21:34:05.206341 2578 plugin_watcher.go:194] "Adding socket path or updating timestamp to desired state cache" path="/var/lib/kubelet/plugins_registry/ebs.csi.aws.com-reg.sock" Jun 02 21:34:05.246776 ip-10-0-138-193 kubenswrapper[2578]: I0602 21:34:05.246694 2578 reconciler.go:161] "OperationExecutor.RegisterPlugin started" plugin={"SocketPath":"/var/lib/kubelet/plugins_registry/ebs.csi.aws.com-reg.sock","Timestamp":"2026-06-02T21:34:05.206358553Z","UUID":"a5d20f85-54bb-46db-94b2-ab781eb028c3","Handler":null,"Name":"","Endpoint":""} Jun 02 21:34:05.248434 ip-10-0-138-193 kubenswrapper[2578]: I0602 21:34:05.248412 2578 csi_plugin.go:106] kubernetes.io/csi: Trying to validate a new CSI Driver with name: ebs.csi.aws.com endpoint: /var/lib/kubelet/plugins/ebs.csi.aws.com/csi.sock versions: 1.0.0 Jun 02 21:34:05.248434 ip-10-0-138-193 kubenswrapper[2578]: I0602 21:34:05.248438 2578 csi_plugin.go:119] kubernetes.io/csi: Register new plugin with name: ebs.csi.aws.com at endpoint: /var/lib/kubelet/plugins/ebs.csi.aws.com/csi.sock Jun 02 21:34:05.317522 ip-10-0-138-193 kubenswrapper[2578]: I0602 21:34:05.317487 2578 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-rf8cp" Jun 02 21:34:05.317623 ip-10-0-138-193 kubenswrapper[2578]: I0602 21:34:05.317492 2578 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-k2vdd" Jun 02 21:34:05.317702 ip-10-0-138-193 kubenswrapper[2578]: I0602 21:34:05.317490 2578 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-r92gd" Jun 02 21:34:05.317772 ip-10-0-138-193 kubenswrapper[2578]: E0602 21:34:05.317696 2578 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-k2vdd" podUID="adfce93b-f07e-480a-af26-5dc7df23fa48" Jun 02 21:34:05.317829 ip-10-0-138-193 kubenswrapper[2578]: E0602 21:34:05.317582 2578 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-rf8cp" podUID="9963c656-171f-412f-b531-d4e89671117c" Jun 02 21:34:05.317829 ip-10-0-138-193 kubenswrapper[2578]: E0602 21:34:05.317802 2578 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-r92gd" podUID="950ec20f-2c4b-4e1b-96ba-c02f9a6d124a" Jun 02 21:34:05.552891 ip-10-0-138-193 kubenswrapper[2578]: I0602 21:34:05.552852 2578 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-network-operator/iptables-alerter-xbl27" event={"ID":"adf5f00d-bf02-4037-b6e7-92c6485f3e38","Type":"ContainerStarted","Data":"9d72925daddee187d813b93894da8bbdaa872536fb4ab0c575fa77be7b3dcc55"} Jun 02 21:34:05.554474 ip-10-0-138-193 kubenswrapper[2578]: I0602 21:34:05.554449 2578 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-9xsr6" event={"ID":"96c320b0-e239-4e96-aaae-28255100dae4","Type":"ContainerStarted","Data":"ef83e37af22dba682ff7db03f674f8f6fde127cc48b143026f5156c181744aea"} Jun 02 21:34:05.570817 ip-10-0-138-193 kubenswrapper[2578]: I0602 21:34:05.570774 2578 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-network-operator/iptables-alerter-xbl27" podStartSLOduration=4.877536272 podStartE2EDuration="22.570763443s" podCreationTimestamp="2026-06-02 21:33:43 +0000 UTC" firstStartedPulling="2026-06-02 21:33:45.83562703 +0000 UTC m=+3.087524918" lastFinishedPulling="2026-06-02 21:34:03.528854199 +0000 UTC m=+20.780752089" observedRunningTime="2026-06-02 21:34:05.570641103 +0000 UTC m=+22.822539011" watchObservedRunningTime="2026-06-02 21:34:05.570763443 +0000 UTC m=+22.822661348" Jun 02 21:34:05.573810 ip-10-0-138-193 kubenswrapper[2578]: I0602 21:34:05.573790 2578 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="kube-system/konnectivity-agent-q78cn" Jun 02 21:34:05.574341 ip-10-0-138-193 kubenswrapper[2578]: I0602 21:34:05.574321 2578 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="started" pod="kube-system/konnectivity-agent-q78cn" Jun 02 21:34:06.556606 ip-10-0-138-193 kubenswrapper[2578]: I0602 21:34:06.556578 2578 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kube-system/konnectivity-agent-q78cn" Jun 02 21:34:06.557189 ip-10-0-138-193 kubenswrapper[2578]: I0602 21:34:06.557170 2578 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="kube-system/konnectivity-agent-q78cn" Jun 02 21:34:07.317675 ip-10-0-138-193 kubenswrapper[2578]: I0602 21:34:07.317499 2578 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-r92gd" Jun 02 21:34:07.317829 ip-10-0-138-193 kubenswrapper[2578]: I0602 21:34:07.317558 2578 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-rf8cp" Jun 02 21:34:07.317829 ip-10-0-138-193 kubenswrapper[2578]: E0602 21:34:07.317741 2578 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-r92gd" podUID="950ec20f-2c4b-4e1b-96ba-c02f9a6d124a" Jun 02 21:34:07.317921 ip-10-0-138-193 kubenswrapper[2578]: E0602 21:34:07.317841 2578 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-rf8cp" podUID="9963c656-171f-412f-b531-d4e89671117c" Jun 02 21:34:07.317921 ip-10-0-138-193 kubenswrapper[2578]: I0602 21:34:07.317576 2578 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-k2vdd" Jun 02 21:34:07.317983 ip-10-0-138-193 kubenswrapper[2578]: E0602 21:34:07.317951 2578 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-k2vdd" podUID="adfce93b-f07e-480a-af26-5dc7df23fa48" Jun 02 21:34:07.560857 ip-10-0-138-193 kubenswrapper[2578]: I0602 21:34:07.560822 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-5zgzd_ecde3d34-b3a4-422b-9a2d-c8a4541cc718/ovn-acl-logging/0.log" Jun 02 21:34:07.561302 ip-10-0-138-193 kubenswrapper[2578]: I0602 21:34:07.561156 2578 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-5zgzd" event={"ID":"ecde3d34-b3a4-422b-9a2d-c8a4541cc718","Type":"ContainerStarted","Data":"5099a7c10dae3bbcea85346579e7c76eb77a298be1700b3a74d33a20f2ed0eb5"} Jun 02 21:34:07.562761 ip-10-0-138-193 kubenswrapper[2578]: I0602 21:34:07.562737 2578 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-9xsr6" event={"ID":"96c320b0-e239-4e96-aaae-28255100dae4","Type":"ContainerStarted","Data":"11adacf8bb53a5a9b895094a149fbbd463ee3e7a9f7e7e02598f1cf93340b89a"} Jun 02 21:34:07.579870 ip-10-0-138-193 kubenswrapper[2578]: I0602 21:34:07.579789 2578 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-9xsr6" podStartSLOduration=3.810466945 podStartE2EDuration="24.579777554s" podCreationTimestamp="2026-06-02 21:33:43 +0000 UTC" firstStartedPulling="2026-06-02 21:33:45.841920731 +0000 UTC m=+3.093818616" lastFinishedPulling="2026-06-02 21:34:06.611231322 +0000 UTC m=+23.863129225" observedRunningTime="2026-06-02 21:34:07.579749488 +0000 UTC m=+24.831647393" watchObservedRunningTime="2026-06-02 21:34:07.579777554 +0000 UTC m=+24.831675460" Jun 02 21:34:09.317337 ip-10-0-138-193 kubenswrapper[2578]: I0602 21:34:09.317301 2578 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-r92gd" Jun 02 21:34:09.317919 ip-10-0-138-193 kubenswrapper[2578]: E0602 21:34:09.317446 2578 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-r92gd" podUID="950ec20f-2c4b-4e1b-96ba-c02f9a6d124a" Jun 02 21:34:09.317919 ip-10-0-138-193 kubenswrapper[2578]: I0602 21:34:09.317523 2578 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-rf8cp" Jun 02 21:34:09.317919 ip-10-0-138-193 kubenswrapper[2578]: E0602 21:34:09.317614 2578 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-rf8cp" podUID="9963c656-171f-412f-b531-d4e89671117c" Jun 02 21:34:09.317919 ip-10-0-138-193 kubenswrapper[2578]: I0602 21:34:09.317661 2578 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-k2vdd" Jun 02 21:34:09.317919 ip-10-0-138-193 kubenswrapper[2578]: E0602 21:34:09.317740 2578 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-k2vdd" podUID="adfce93b-f07e-480a-af26-5dc7df23fa48" Jun 02 21:34:10.570755 ip-10-0-138-193 kubenswrapper[2578]: I0602 21:34:10.570579 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-5zgzd_ecde3d34-b3a4-422b-9a2d-c8a4541cc718/ovn-acl-logging/0.log" Jun 02 21:34:10.571422 ip-10-0-138-193 kubenswrapper[2578]: I0602 21:34:10.571067 2578 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-5zgzd" event={"ID":"ecde3d34-b3a4-422b-9a2d-c8a4541cc718","Type":"ContainerStarted","Data":"e9f1d5677ec73bd629cf21303e72a03d69802f06479c07ae4cc0394b6f352b51"} Jun 02 21:34:10.571501 ip-10-0-138-193 kubenswrapper[2578]: I0602 21:34:10.571422 2578 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-5zgzd" Jun 02 21:34:10.571501 ip-10-0-138-193 kubenswrapper[2578]: I0602 21:34:10.571453 2578 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-5zgzd" Jun 02 21:34:10.571646 ip-10-0-138-193 kubenswrapper[2578]: I0602 21:34:10.571631 2578 scope.go:117] "RemoveContainer" containerID="a2f1a4968b91894669650250ce59d84506b01e7fa32800ac693f103f09515120" Jun 02 21:34:10.572758 ip-10-0-138-193 kubenswrapper[2578]: I0602 21:34:10.572735 2578 generic.go:358] "Generic (PLEG): container finished" podID="f2c18898-cc9a-4645-bab8-9ac55c476c7f" containerID="c56dc9cf70d90906829f120b4edb39a0ec7448dc23fd86d61dd432ffc05b370d" exitCode=0 Jun 02 21:34:10.572854 ip-10-0-138-193 kubenswrapper[2578]: I0602 21:34:10.572782 2578 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-s7sgt" event={"ID":"f2c18898-cc9a-4645-bab8-9ac55c476c7f","Type":"ContainerDied","Data":"c56dc9cf70d90906829f120b4edb39a0ec7448dc23fd86d61dd432ffc05b370d"} Jun 02 21:34:10.588375 ip-10-0-138-193 kubenswrapper[2578]: I0602 21:34:10.588353 2578 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-5zgzd" Jun 02 21:34:11.317701 ip-10-0-138-193 kubenswrapper[2578]: I0602 21:34:11.317668 2578 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-k2vdd" Jun 02 21:34:11.317819 ip-10-0-138-193 kubenswrapper[2578]: I0602 21:34:11.317666 2578 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-r92gd" Jun 02 21:34:11.317819 ip-10-0-138-193 kubenswrapper[2578]: E0602 21:34:11.317795 2578 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-k2vdd" podUID="adfce93b-f07e-480a-af26-5dc7df23fa48" Jun 02 21:34:11.317929 ip-10-0-138-193 kubenswrapper[2578]: E0602 21:34:11.317865 2578 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-r92gd" podUID="950ec20f-2c4b-4e1b-96ba-c02f9a6d124a" Jun 02 21:34:11.317929 ip-10-0-138-193 kubenswrapper[2578]: I0602 21:34:11.317666 2578 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-rf8cp" Jun 02 21:34:11.318013 ip-10-0-138-193 kubenswrapper[2578]: E0602 21:34:11.317949 2578 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-rf8cp" podUID="9963c656-171f-412f-b531-d4e89671117c" Jun 02 21:34:11.578170 ip-10-0-138-193 kubenswrapper[2578]: I0602 21:34:11.578063 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-5zgzd_ecde3d34-b3a4-422b-9a2d-c8a4541cc718/ovn-acl-logging/0.log" Jun 02 21:34:11.578612 ip-10-0-138-193 kubenswrapper[2578]: I0602 21:34:11.578422 2578 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-5zgzd" event={"ID":"ecde3d34-b3a4-422b-9a2d-c8a4541cc718","Type":"ContainerStarted","Data":"b3f6246a7ab79fc225683ba78f00221640cc7e6ea27b3b8119adc6f3e00264e1"} Jun 02 21:34:11.578684 ip-10-0-138-193 kubenswrapper[2578]: I0602 21:34:11.578668 2578 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-5zgzd" Jun 02 21:34:11.580498 ip-10-0-138-193 kubenswrapper[2578]: I0602 21:34:11.580473 2578 generic.go:358] "Generic (PLEG): container finished" podID="f2c18898-cc9a-4645-bab8-9ac55c476c7f" containerID="51c52cf7f262d7abb27e64e8a4549d5cfebaffa1fb1082c37b29a5f8d7e4691b" exitCode=0 Jun 02 21:34:11.580607 ip-10-0-138-193 kubenswrapper[2578]: I0602 21:34:11.580513 2578 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-s7sgt" event={"ID":"f2c18898-cc9a-4645-bab8-9ac55c476c7f","Type":"ContainerDied","Data":"51c52cf7f262d7abb27e64e8a4549d5cfebaffa1fb1082c37b29a5f8d7e4691b"} Jun 02 21:34:11.594584 ip-10-0-138-193 kubenswrapper[2578]: I0602 21:34:11.594564 2578 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-5zgzd" Jun 02 21:34:11.604350 ip-10-0-138-193 kubenswrapper[2578]: I0602 21:34:11.604314 2578 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-ovn-kubernetes/ovnkube-node-5zgzd" podStartSLOduration=10.890364541 podStartE2EDuration="28.604301779s" podCreationTimestamp="2026-06-02 21:33:43 +0000 UTC" firstStartedPulling="2026-06-02 21:33:45.842098564 +0000 UTC m=+3.093996454" lastFinishedPulling="2026-06-02 21:34:03.556035808 +0000 UTC m=+20.807933692" observedRunningTime="2026-06-02 21:34:11.602821213 +0000 UTC m=+28.854719129" watchObservedRunningTime="2026-06-02 21:34:11.604301779 +0000 UTC m=+28.856199686" Jun 02 21:34:11.695412 ip-10-0-138-193 kubenswrapper[2578]: I0602 21:34:11.695346 2578 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kube-system/global-pull-secret-syncer-rf8cp"] Jun 02 21:34:11.695576 ip-10-0-138-193 kubenswrapper[2578]: I0602 21:34:11.695460 2578 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-rf8cp" Jun 02 21:34:11.695645 ip-10-0-138-193 kubenswrapper[2578]: E0602 21:34:11.695602 2578 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-rf8cp" podUID="9963c656-171f-412f-b531-d4e89671117c" Jun 02 21:34:11.696193 ip-10-0-138-193 kubenswrapper[2578]: I0602 21:34:11.696173 2578 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-target-r92gd"] Jun 02 21:34:11.696296 ip-10-0-138-193 kubenswrapper[2578]: I0602 21:34:11.696256 2578 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-r92gd" Jun 02 21:34:11.696360 ip-10-0-138-193 kubenswrapper[2578]: E0602 21:34:11.696317 2578 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-r92gd" podUID="950ec20f-2c4b-4e1b-96ba-c02f9a6d124a" Jun 02 21:34:11.697553 ip-10-0-138-193 kubenswrapper[2578]: I0602 21:34:11.697530 2578 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-multus/network-metrics-daemon-k2vdd"] Jun 02 21:34:11.697650 ip-10-0-138-193 kubenswrapper[2578]: I0602 21:34:11.697638 2578 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-k2vdd" Jun 02 21:34:11.697760 ip-10-0-138-193 kubenswrapper[2578]: E0602 21:34:11.697743 2578 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-k2vdd" podUID="adfce93b-f07e-480a-af26-5dc7df23fa48" Jun 02 21:34:12.584401 ip-10-0-138-193 kubenswrapper[2578]: I0602 21:34:12.584309 2578 generic.go:358] "Generic (PLEG): container finished" podID="f2c18898-cc9a-4645-bab8-9ac55c476c7f" containerID="702c6e38b15dbe3fefef0b42c00be0b10b4fe9b13bbf2c06cb7883d8cc2e5502" exitCode=0 Jun 02 21:34:12.584401 ip-10-0-138-193 kubenswrapper[2578]: I0602 21:34:12.584385 2578 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-s7sgt" event={"ID":"f2c18898-cc9a-4645-bab8-9ac55c476c7f","Type":"ContainerDied","Data":"702c6e38b15dbe3fefef0b42c00be0b10b4fe9b13bbf2c06cb7883d8cc2e5502"} Jun 02 21:34:13.319713 ip-10-0-138-193 kubenswrapper[2578]: I0602 21:34:13.319335 2578 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-k2vdd" Jun 02 21:34:13.319876 ip-10-0-138-193 kubenswrapper[2578]: I0602 21:34:13.319379 2578 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-r92gd" Jun 02 21:34:13.319876 ip-10-0-138-193 kubenswrapper[2578]: E0602 21:34:13.319764 2578 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-k2vdd" podUID="adfce93b-f07e-480a-af26-5dc7df23fa48" Jun 02 21:34:13.319876 ip-10-0-138-193 kubenswrapper[2578]: I0602 21:34:13.319592 2578 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-rf8cp" Jun 02 21:34:13.320034 ip-10-0-138-193 kubenswrapper[2578]: E0602 21:34:13.319817 2578 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-r92gd" podUID="950ec20f-2c4b-4e1b-96ba-c02f9a6d124a" Jun 02 21:34:13.320034 ip-10-0-138-193 kubenswrapper[2578]: E0602 21:34:13.319933 2578 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-rf8cp" podUID="9963c656-171f-412f-b531-d4e89671117c" Jun 02 21:34:15.318086 ip-10-0-138-193 kubenswrapper[2578]: I0602 21:34:15.318037 2578 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-rf8cp" Jun 02 21:34:15.318607 ip-10-0-138-193 kubenswrapper[2578]: I0602 21:34:15.318037 2578 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-r92gd" Jun 02 21:34:15.318607 ip-10-0-138-193 kubenswrapper[2578]: E0602 21:34:15.318188 2578 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-rf8cp" podUID="9963c656-171f-412f-b531-d4e89671117c" Jun 02 21:34:15.318607 ip-10-0-138-193 kubenswrapper[2578]: I0602 21:34:15.318037 2578 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-k2vdd" Jun 02 21:34:15.318607 ip-10-0-138-193 kubenswrapper[2578]: E0602 21:34:15.318234 2578 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-r92gd" podUID="950ec20f-2c4b-4e1b-96ba-c02f9a6d124a" Jun 02 21:34:15.318607 ip-10-0-138-193 kubenswrapper[2578]: E0602 21:34:15.318337 2578 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-k2vdd" podUID="adfce93b-f07e-480a-af26-5dc7df23fa48" Jun 02 21:34:16.573508 ip-10-0-138-193 kubenswrapper[2578]: I0602 21:34:16.573475 2578 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-138-193.ec2.internal" event="NodeReady" Jun 02 21:34:16.574106 ip-10-0-138-193 kubenswrapper[2578]: I0602 21:34:16.573619 2578 kubelet_node_status.go:550] "Fast updating node status as it just became ready" Jun 02 21:34:16.615115 ip-10-0-138-193 kubenswrapper[2578]: I0602 21:34:16.615030 2578 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-ingress-canary/ingress-canary-7jp8d"] Jun 02 21:34:16.618044 ip-10-0-138-193 kubenswrapper[2578]: I0602 21:34:16.618023 2578 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-dns/dns-default-c44qt"] Jun 02 21:34:16.618198 ip-10-0-138-193 kubenswrapper[2578]: I0602 21:34:16.618180 2578 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress-canary/ingress-canary-7jp8d" Jun 02 21:34:16.620770 ip-10-0-138-193 kubenswrapper[2578]: I0602 21:34:16.620751 2578 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-c44qt" Jun 02 21:34:16.621135 ip-10-0-138-193 kubenswrapper[2578]: I0602 21:34:16.621114 2578 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-canary\"/\"default-dockercfg-2lz6l\"" Jun 02 21:34:16.621508 ip-10-0-138-193 kubenswrapper[2578]: I0602 21:34:16.621488 2578 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-canary\"/\"canary-serving-cert\"" Jun 02 21:34:16.621661 ip-10-0-138-193 kubenswrapper[2578]: I0602 21:34:16.621493 2578 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress-canary\"/\"openshift-service-ca.crt\"" Jun 02 21:34:16.621661 ip-10-0-138-193 kubenswrapper[2578]: I0602 21:34:16.621497 2578 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress-canary\"/\"kube-root-ca.crt\"" Jun 02 21:34:16.623008 ip-10-0-138-193 kubenswrapper[2578]: I0602 21:34:16.622990 2578 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-default-metrics-tls\"" Jun 02 21:34:16.623118 ip-10-0-138-193 kubenswrapper[2578]: I0602 21:34:16.623103 2578 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"dns-default\"" Jun 02 21:34:16.623207 ip-10-0-138-193 kubenswrapper[2578]: I0602 21:34:16.623190 2578 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-dockercfg-gs96v\"" Jun 02 21:34:16.625971 ip-10-0-138-193 kubenswrapper[2578]: I0602 21:34:16.625950 2578 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-ingress-canary/ingress-canary-7jp8d"] Jun 02 21:34:16.629528 ip-10-0-138-193 kubenswrapper[2578]: I0602 21:34:16.629508 2578 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-dns/dns-default-c44qt"] Jun 02 21:34:16.730824 ip-10-0-138-193 kubenswrapper[2578]: I0602 21:34:16.730797 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-clw2h\" (UniqueName: \"kubernetes.io/projected/70e914f4-4b44-4c79-926d-ee58ea32639d-kube-api-access-clw2h\") pod \"dns-default-c44qt\" (UID: \"70e914f4-4b44-4c79-926d-ee58ea32639d\") " pod="openshift-dns/dns-default-c44qt" Jun 02 21:34:16.730979 ip-10-0-138-193 kubenswrapper[2578]: I0602 21:34:16.730829 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/70e914f4-4b44-4c79-926d-ee58ea32639d-metrics-tls\") pod \"dns-default-c44qt\" (UID: \"70e914f4-4b44-4c79-926d-ee58ea32639d\") " pod="openshift-dns/dns-default-c44qt" Jun 02 21:34:16.730979 ip-10-0-138-193 kubenswrapper[2578]: I0602 21:34:16.730899 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/70e914f4-4b44-4c79-926d-ee58ea32639d-config-volume\") pod \"dns-default-c44qt\" (UID: \"70e914f4-4b44-4c79-926d-ee58ea32639d\") " pod="openshift-dns/dns-default-c44qt" Jun 02 21:34:16.730979 ip-10-0-138-193 kubenswrapper[2578]: I0602 21:34:16.730926 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/70e914f4-4b44-4c79-926d-ee58ea32639d-tmp-dir\") pod \"dns-default-c44qt\" (UID: \"70e914f4-4b44-4c79-926d-ee58ea32639d\") " pod="openshift-dns/dns-default-c44qt" Jun 02 21:34:16.731146 ip-10-0-138-193 kubenswrapper[2578]: I0602 21:34:16.731028 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/39b30769-802d-4bcb-906a-fcbb4eee94b6-cert\") pod \"ingress-canary-7jp8d\" (UID: \"39b30769-802d-4bcb-906a-fcbb4eee94b6\") " pod="openshift-ingress-canary/ingress-canary-7jp8d" Jun 02 21:34:16.731146 ip-10-0-138-193 kubenswrapper[2578]: I0602 21:34:16.731067 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-ctj4k\" (UniqueName: \"kubernetes.io/projected/39b30769-802d-4bcb-906a-fcbb4eee94b6-kube-api-access-ctj4k\") pod \"ingress-canary-7jp8d\" (UID: \"39b30769-802d-4bcb-906a-fcbb4eee94b6\") " pod="openshift-ingress-canary/ingress-canary-7jp8d" Jun 02 21:34:16.832139 ip-10-0-138-193 kubenswrapper[2578]: I0602 21:34:16.832100 2578 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/70e914f4-4b44-4c79-926d-ee58ea32639d-tmp-dir\") pod \"dns-default-c44qt\" (UID: \"70e914f4-4b44-4c79-926d-ee58ea32639d\") " pod="openshift-dns/dns-default-c44qt" Jun 02 21:34:16.832318 ip-10-0-138-193 kubenswrapper[2578]: I0602 21:34:16.832158 2578 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/39b30769-802d-4bcb-906a-fcbb4eee94b6-cert\") pod \"ingress-canary-7jp8d\" (UID: \"39b30769-802d-4bcb-906a-fcbb4eee94b6\") " pod="openshift-ingress-canary/ingress-canary-7jp8d" Jun 02 21:34:16.832318 ip-10-0-138-193 kubenswrapper[2578]: I0602 21:34:16.832186 2578 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-ctj4k\" (UniqueName: \"kubernetes.io/projected/39b30769-802d-4bcb-906a-fcbb4eee94b6-kube-api-access-ctj4k\") pod \"ingress-canary-7jp8d\" (UID: \"39b30769-802d-4bcb-906a-fcbb4eee94b6\") " pod="openshift-ingress-canary/ingress-canary-7jp8d" Jun 02 21:34:16.832318 ip-10-0-138-193 kubenswrapper[2578]: I0602 21:34:16.832233 2578 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-clw2h\" (UniqueName: \"kubernetes.io/projected/70e914f4-4b44-4c79-926d-ee58ea32639d-kube-api-access-clw2h\") pod \"dns-default-c44qt\" (UID: \"70e914f4-4b44-4c79-926d-ee58ea32639d\") " pod="openshift-dns/dns-default-c44qt" Jun 02 21:34:16.832318 ip-10-0-138-193 kubenswrapper[2578]: I0602 21:34:16.832258 2578 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/70e914f4-4b44-4c79-926d-ee58ea32639d-metrics-tls\") pod \"dns-default-c44qt\" (UID: \"70e914f4-4b44-4c79-926d-ee58ea32639d\") " pod="openshift-dns/dns-default-c44qt" Jun 02 21:34:16.832318 ip-10-0-138-193 kubenswrapper[2578]: I0602 21:34:16.832309 2578 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/70e914f4-4b44-4c79-926d-ee58ea32639d-config-volume\") pod \"dns-default-c44qt\" (UID: \"70e914f4-4b44-4c79-926d-ee58ea32639d\") " pod="openshift-dns/dns-default-c44qt" Jun 02 21:34:16.832569 ip-10-0-138-193 kubenswrapper[2578]: E0602 21:34:16.832334 2578 secret.go:189] Couldn't get secret openshift-ingress-canary/canary-serving-cert: secret "canary-serving-cert" not found Jun 02 21:34:16.832569 ip-10-0-138-193 kubenswrapper[2578]: E0602 21:34:16.832396 2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/39b30769-802d-4bcb-906a-fcbb4eee94b6-cert podName:39b30769-802d-4bcb-906a-fcbb4eee94b6 nodeName:}" failed. No retries permitted until 2026-06-02 21:34:17.332377763 +0000 UTC m=+34.584275664 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "cert" (UniqueName: "kubernetes.io/secret/39b30769-802d-4bcb-906a-fcbb4eee94b6-cert") pod "ingress-canary-7jp8d" (UID: "39b30769-802d-4bcb-906a-fcbb4eee94b6") : secret "canary-serving-cert" not found Jun 02 21:34:16.832569 ip-10-0-138-193 kubenswrapper[2578]: E0602 21:34:16.832503 2578 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jun 02 21:34:16.832569 ip-10-0-138-193 kubenswrapper[2578]: I0602 21:34:16.832510 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/70e914f4-4b44-4c79-926d-ee58ea32639d-tmp-dir\") pod \"dns-default-c44qt\" (UID: \"70e914f4-4b44-4c79-926d-ee58ea32639d\") " pod="openshift-dns/dns-default-c44qt" Jun 02 21:34:16.832751 ip-10-0-138-193 kubenswrapper[2578]: E0602 21:34:16.832592 2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/70e914f4-4b44-4c79-926d-ee58ea32639d-metrics-tls podName:70e914f4-4b44-4c79-926d-ee58ea32639d nodeName:}" failed. No retries permitted until 2026-06-02 21:34:17.332573062 +0000 UTC m=+34.584470959 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/70e914f4-4b44-4c79-926d-ee58ea32639d-metrics-tls") pod "dns-default-c44qt" (UID: "70e914f4-4b44-4c79-926d-ee58ea32639d") : secret "dns-default-metrics-tls" not found Jun 02 21:34:16.832822 ip-10-0-138-193 kubenswrapper[2578]: I0602 21:34:16.832806 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/70e914f4-4b44-4c79-926d-ee58ea32639d-config-volume\") pod \"dns-default-c44qt\" (UID: \"70e914f4-4b44-4c79-926d-ee58ea32639d\") " pod="openshift-dns/dns-default-c44qt" Jun 02 21:34:16.844658 ip-10-0-138-193 kubenswrapper[2578]: I0602 21:34:16.844616 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-clw2h\" (UniqueName: \"kubernetes.io/projected/70e914f4-4b44-4c79-926d-ee58ea32639d-kube-api-access-clw2h\") pod \"dns-default-c44qt\" (UID: \"70e914f4-4b44-4c79-926d-ee58ea32639d\") " pod="openshift-dns/dns-default-c44qt" Jun 02 21:34:16.844865 ip-10-0-138-193 kubenswrapper[2578]: I0602 21:34:16.844838 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-ctj4k\" (UniqueName: \"kubernetes.io/projected/39b30769-802d-4bcb-906a-fcbb4eee94b6-kube-api-access-ctj4k\") pod \"ingress-canary-7jp8d\" (UID: \"39b30769-802d-4bcb-906a-fcbb4eee94b6\") " pod="openshift-ingress-canary/ingress-canary-7jp8d" Jun 02 21:34:16.933011 ip-10-0-138-193 kubenswrapper[2578]: I0602 21:34:16.932973 2578 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/adfce93b-f07e-480a-af26-5dc7df23fa48-metrics-certs\") pod \"network-metrics-daemon-k2vdd\" (UID: \"adfce93b-f07e-480a-af26-5dc7df23fa48\") " pod="openshift-multus/network-metrics-daemon-k2vdd" Jun 02 21:34:16.933259 ip-10-0-138-193 kubenswrapper[2578]: E0602 21:34:16.933153 2578 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jun 02 21:34:16.933259 ip-10-0-138-193 kubenswrapper[2578]: E0602 21:34:16.933244 2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/adfce93b-f07e-480a-af26-5dc7df23fa48-metrics-certs podName:adfce93b-f07e-480a-af26-5dc7df23fa48 nodeName:}" failed. No retries permitted until 2026-06-02 21:34:48.933222817 +0000 UTC m=+66.185120720 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/adfce93b-f07e-480a-af26-5dc7df23fa48-metrics-certs") pod "network-metrics-daemon-k2vdd" (UID: "adfce93b-f07e-480a-af26-5dc7df23fa48") : object "openshift-multus"/"metrics-daemon-secret" not registered Jun 02 21:34:17.033541 ip-10-0-138-193 kubenswrapper[2578]: I0602 21:34:17.033500 2578 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-d5dnb\" (UniqueName: \"kubernetes.io/projected/950ec20f-2c4b-4e1b-96ba-c02f9a6d124a-kube-api-access-d5dnb\") pod \"network-check-target-r92gd\" (UID: \"950ec20f-2c4b-4e1b-96ba-c02f9a6d124a\") " pod="openshift-network-diagnostics/network-check-target-r92gd" Jun 02 21:34:17.033726 ip-10-0-138-193 kubenswrapper[2578]: I0602 21:34:17.033643 2578 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/9963c656-171f-412f-b531-d4e89671117c-original-pull-secret\") pod \"global-pull-secret-syncer-rf8cp\" (UID: \"9963c656-171f-412f-b531-d4e89671117c\") " pod="kube-system/global-pull-secret-syncer-rf8cp" Jun 02 21:34:17.033726 ip-10-0-138-193 kubenswrapper[2578]: E0602 21:34:17.033676 2578 projected.go:289] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jun 02 21:34:17.033726 ip-10-0-138-193 kubenswrapper[2578]: E0602 21:34:17.033703 2578 projected.go:289] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jun 02 21:34:17.033726 ip-10-0-138-193 kubenswrapper[2578]: E0602 21:34:17.033717 2578 projected.go:194] Error preparing data for projected volume kube-api-access-d5dnb for pod openshift-network-diagnostics/network-check-target-r92gd: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 02 21:34:17.033935 ip-10-0-138-193 kubenswrapper[2578]: E0602 21:34:17.033768 2578 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jun 02 21:34:17.033935 ip-10-0-138-193 kubenswrapper[2578]: E0602 21:34:17.033785 2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/950ec20f-2c4b-4e1b-96ba-c02f9a6d124a-kube-api-access-d5dnb podName:950ec20f-2c4b-4e1b-96ba-c02f9a6d124a nodeName:}" failed. No retries permitted until 2026-06-02 21:34:49.033765374 +0000 UTC m=+66.285663262 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "kube-api-access-d5dnb" (UniqueName: "kubernetes.io/projected/950ec20f-2c4b-4e1b-96ba-c02f9a6d124a-kube-api-access-d5dnb") pod "network-check-target-r92gd" (UID: "950ec20f-2c4b-4e1b-96ba-c02f9a6d124a") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 02 21:34:17.033935 ip-10-0-138-193 kubenswrapper[2578]: E0602 21:34:17.033820 2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/9963c656-171f-412f-b531-d4e89671117c-original-pull-secret podName:9963c656-171f-412f-b531-d4e89671117c nodeName:}" failed. No retries permitted until 2026-06-02 21:34:49.033805392 +0000 UTC m=+66.285703289 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/9963c656-171f-412f-b531-d4e89671117c-original-pull-secret") pod "global-pull-secret-syncer-rf8cp" (UID: "9963c656-171f-412f-b531-d4e89671117c") : object "kube-system"/"original-pull-secret" not registered Jun 02 21:34:17.318095 ip-10-0-138-193 kubenswrapper[2578]: I0602 21:34:17.317999 2578 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-r92gd" Jun 02 21:34:17.318264 ip-10-0-138-193 kubenswrapper[2578]: I0602 21:34:17.317999 2578 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-rf8cp" Jun 02 21:34:17.318264 ip-10-0-138-193 kubenswrapper[2578]: I0602 21:34:17.318001 2578 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-k2vdd" Jun 02 21:34:17.320663 ip-10-0-138-193 kubenswrapper[2578]: I0602 21:34:17.320639 2578 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-secret\"" Jun 02 21:34:17.320788 ip-10-0-138-193 kubenswrapper[2578]: I0602 21:34:17.320680 2578 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"openshift-service-ca.crt\"" Jun 02 21:34:17.320788 ip-10-0-138-193 kubenswrapper[2578]: I0602 21:34:17.320680 2578 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-sa-dockercfg-4s2f5\"" Jun 02 21:34:17.321647 ip-10-0-138-193 kubenswrapper[2578]: I0602 21:34:17.321623 2578 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"default-dockercfg-txpc4\"" Jun 02 21:34:17.321778 ip-10-0-138-193 kubenswrapper[2578]: I0602 21:34:17.321627 2578 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"original-pull-secret\"" Jun 02 21:34:17.321778 ip-10-0-138-193 kubenswrapper[2578]: I0602 21:34:17.321672 2578 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"kube-root-ca.crt\"" Jun 02 21:34:17.335685 ip-10-0-138-193 kubenswrapper[2578]: I0602 21:34:17.335659 2578 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/39b30769-802d-4bcb-906a-fcbb4eee94b6-cert\") pod \"ingress-canary-7jp8d\" (UID: \"39b30769-802d-4bcb-906a-fcbb4eee94b6\") " pod="openshift-ingress-canary/ingress-canary-7jp8d" Jun 02 21:34:17.335791 ip-10-0-138-193 kubenswrapper[2578]: I0602 21:34:17.335723 2578 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/70e914f4-4b44-4c79-926d-ee58ea32639d-metrics-tls\") pod \"dns-default-c44qt\" (UID: \"70e914f4-4b44-4c79-926d-ee58ea32639d\") " pod="openshift-dns/dns-default-c44qt" Jun 02 21:34:17.335850 ip-10-0-138-193 kubenswrapper[2578]: E0602 21:34:17.335815 2578 secret.go:189] Couldn't get secret openshift-ingress-canary/canary-serving-cert: secret "canary-serving-cert" not found Jun 02 21:34:17.335850 ip-10-0-138-193 kubenswrapper[2578]: E0602 21:34:17.335823 2578 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jun 02 21:34:17.335943 ip-10-0-138-193 kubenswrapper[2578]: E0602 21:34:17.335873 2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/70e914f4-4b44-4c79-926d-ee58ea32639d-metrics-tls podName:70e914f4-4b44-4c79-926d-ee58ea32639d nodeName:}" failed. No retries permitted until 2026-06-02 21:34:18.335856478 +0000 UTC m=+35.587754362 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/70e914f4-4b44-4c79-926d-ee58ea32639d-metrics-tls") pod "dns-default-c44qt" (UID: "70e914f4-4b44-4c79-926d-ee58ea32639d") : secret "dns-default-metrics-tls" not found Jun 02 21:34:17.335943 ip-10-0-138-193 kubenswrapper[2578]: E0602 21:34:17.335886 2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/39b30769-802d-4bcb-906a-fcbb4eee94b6-cert podName:39b30769-802d-4bcb-906a-fcbb4eee94b6 nodeName:}" failed. No retries permitted until 2026-06-02 21:34:18.335881093 +0000 UTC m=+35.587778976 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "cert" (UniqueName: "kubernetes.io/secret/39b30769-802d-4bcb-906a-fcbb4eee94b6-cert") pod "ingress-canary-7jp8d" (UID: "39b30769-802d-4bcb-906a-fcbb4eee94b6") : secret "canary-serving-cert" not found Jun 02 21:34:18.343106 ip-10-0-138-193 kubenswrapper[2578]: I0602 21:34:18.343054 2578 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/39b30769-802d-4bcb-906a-fcbb4eee94b6-cert\") pod \"ingress-canary-7jp8d\" (UID: \"39b30769-802d-4bcb-906a-fcbb4eee94b6\") " pod="openshift-ingress-canary/ingress-canary-7jp8d" Jun 02 21:34:18.343722 ip-10-0-138-193 kubenswrapper[2578]: I0602 21:34:18.343214 2578 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/70e914f4-4b44-4c79-926d-ee58ea32639d-metrics-tls\") pod \"dns-default-c44qt\" (UID: \"70e914f4-4b44-4c79-926d-ee58ea32639d\") " pod="openshift-dns/dns-default-c44qt" Jun 02 21:34:18.343722 ip-10-0-138-193 kubenswrapper[2578]: E0602 21:34:18.343233 2578 secret.go:189] Couldn't get secret openshift-ingress-canary/canary-serving-cert: secret "canary-serving-cert" not found Jun 02 21:34:18.343722 ip-10-0-138-193 kubenswrapper[2578]: E0602 21:34:18.343309 2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/39b30769-802d-4bcb-906a-fcbb4eee94b6-cert podName:39b30769-802d-4bcb-906a-fcbb4eee94b6 nodeName:}" failed. No retries permitted until 2026-06-02 21:34:20.34328783 +0000 UTC m=+37.595185730 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "cert" (UniqueName: "kubernetes.io/secret/39b30769-802d-4bcb-906a-fcbb4eee94b6-cert") pod "ingress-canary-7jp8d" (UID: "39b30769-802d-4bcb-906a-fcbb4eee94b6") : secret "canary-serving-cert" not found Jun 02 21:34:18.343722 ip-10-0-138-193 kubenswrapper[2578]: E0602 21:34:18.343369 2578 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jun 02 21:34:18.343722 ip-10-0-138-193 kubenswrapper[2578]: E0602 21:34:18.343433 2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/70e914f4-4b44-4c79-926d-ee58ea32639d-metrics-tls podName:70e914f4-4b44-4c79-926d-ee58ea32639d nodeName:}" failed. No retries permitted until 2026-06-02 21:34:20.343415535 +0000 UTC m=+37.595313444 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/70e914f4-4b44-4c79-926d-ee58ea32639d-metrics-tls") pod "dns-default-c44qt" (UID: "70e914f4-4b44-4c79-926d-ee58ea32639d") : secret "dns-default-metrics-tls" not found Jun 02 21:34:19.600316 ip-10-0-138-193 kubenswrapper[2578]: I0602 21:34:19.600280 2578 generic.go:358] "Generic (PLEG): container finished" podID="f2c18898-cc9a-4645-bab8-9ac55c476c7f" containerID="442f8673c508684ba13a8e53531e3adc18bc1e4b326afdaa874a49d218db1ffe" exitCode=0 Jun 02 21:34:19.600945 ip-10-0-138-193 kubenswrapper[2578]: I0602 21:34:19.600333 2578 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-s7sgt" event={"ID":"f2c18898-cc9a-4645-bab8-9ac55c476c7f","Type":"ContainerDied","Data":"442f8673c508684ba13a8e53531e3adc18bc1e4b326afdaa874a49d218db1ffe"} Jun 02 21:34:20.358607 ip-10-0-138-193 kubenswrapper[2578]: I0602 21:34:20.358567 2578 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/39b30769-802d-4bcb-906a-fcbb4eee94b6-cert\") pod \"ingress-canary-7jp8d\" (UID: \"39b30769-802d-4bcb-906a-fcbb4eee94b6\") " pod="openshift-ingress-canary/ingress-canary-7jp8d" Jun 02 21:34:20.358756 ip-10-0-138-193 kubenswrapper[2578]: I0602 21:34:20.358623 2578 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/70e914f4-4b44-4c79-926d-ee58ea32639d-metrics-tls\") pod \"dns-default-c44qt\" (UID: \"70e914f4-4b44-4c79-926d-ee58ea32639d\") " pod="openshift-dns/dns-default-c44qt" Jun 02 21:34:20.358756 ip-10-0-138-193 kubenswrapper[2578]: E0602 21:34:20.358710 2578 secret.go:189] Couldn't get secret openshift-ingress-canary/canary-serving-cert: secret "canary-serving-cert" not found Jun 02 21:34:20.358839 ip-10-0-138-193 kubenswrapper[2578]: E0602 21:34:20.358776 2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/39b30769-802d-4bcb-906a-fcbb4eee94b6-cert podName:39b30769-802d-4bcb-906a-fcbb4eee94b6 nodeName:}" failed. No retries permitted until 2026-06-02 21:34:24.358761348 +0000 UTC m=+41.610659231 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "cert" (UniqueName: "kubernetes.io/secret/39b30769-802d-4bcb-906a-fcbb4eee94b6-cert") pod "ingress-canary-7jp8d" (UID: "39b30769-802d-4bcb-906a-fcbb4eee94b6") : secret "canary-serving-cert" not found Jun 02 21:34:20.358839 ip-10-0-138-193 kubenswrapper[2578]: E0602 21:34:20.358715 2578 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jun 02 21:34:20.358910 ip-10-0-138-193 kubenswrapper[2578]: E0602 21:34:20.358853 2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/70e914f4-4b44-4c79-926d-ee58ea32639d-metrics-tls podName:70e914f4-4b44-4c79-926d-ee58ea32639d nodeName:}" failed. No retries permitted until 2026-06-02 21:34:24.358838699 +0000 UTC m=+41.610736586 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/70e914f4-4b44-4c79-926d-ee58ea32639d-metrics-tls") pod "dns-default-c44qt" (UID: "70e914f4-4b44-4c79-926d-ee58ea32639d") : secret "dns-default-metrics-tls" not found Jun 02 21:34:20.604508 ip-10-0-138-193 kubenswrapper[2578]: I0602 21:34:20.604472 2578 generic.go:358] "Generic (PLEG): container finished" podID="f2c18898-cc9a-4645-bab8-9ac55c476c7f" containerID="8fa631bd001707b67f8b1da596a83a0af0a84bba1d9efa868c9d0cfcea37f426" exitCode=0 Jun 02 21:34:20.604856 ip-10-0-138-193 kubenswrapper[2578]: I0602 21:34:20.604527 2578 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-s7sgt" event={"ID":"f2c18898-cc9a-4645-bab8-9ac55c476c7f","Type":"ContainerDied","Data":"8fa631bd001707b67f8b1da596a83a0af0a84bba1d9efa868c9d0cfcea37f426"} Jun 02 21:34:21.609584 ip-10-0-138-193 kubenswrapper[2578]: I0602 21:34:21.609335 2578 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-s7sgt" event={"ID":"f2c18898-cc9a-4645-bab8-9ac55c476c7f","Type":"ContainerStarted","Data":"89637e5c971f8e881a258091dc910d5e03502ee6bd5af3e59628c560787207d5"} Jun 02 21:34:21.631226 ip-10-0-138-193 kubenswrapper[2578]: I0602 21:34:21.631172 2578 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-multus/multus-additional-cni-plugins-s7sgt" podStartSLOduration=5.212211154 podStartE2EDuration="38.63116015s" podCreationTimestamp="2026-06-02 21:33:43 +0000 UTC" firstStartedPulling="2026-06-02 21:33:45.834331352 +0000 UTC m=+3.086229250" lastFinishedPulling="2026-06-02 21:34:19.253280358 +0000 UTC m=+36.505178246" observedRunningTime="2026-06-02 21:34:21.629936611 +0000 UTC m=+38.881834516" watchObservedRunningTime="2026-06-02 21:34:21.63116015 +0000 UTC m=+38.883058055" Jun 02 21:34:24.388164 ip-10-0-138-193 kubenswrapper[2578]: I0602 21:34:24.388125 2578 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/39b30769-802d-4bcb-906a-fcbb4eee94b6-cert\") pod \"ingress-canary-7jp8d\" (UID: \"39b30769-802d-4bcb-906a-fcbb4eee94b6\") " pod="openshift-ingress-canary/ingress-canary-7jp8d" Jun 02 21:34:24.388580 ip-10-0-138-193 kubenswrapper[2578]: I0602 21:34:24.388180 2578 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/70e914f4-4b44-4c79-926d-ee58ea32639d-metrics-tls\") pod \"dns-default-c44qt\" (UID: \"70e914f4-4b44-4c79-926d-ee58ea32639d\") " pod="openshift-dns/dns-default-c44qt" Jun 02 21:34:24.388580 ip-10-0-138-193 kubenswrapper[2578]: E0602 21:34:24.388297 2578 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jun 02 21:34:24.388580 ip-10-0-138-193 kubenswrapper[2578]: E0602 21:34:24.388367 2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/70e914f4-4b44-4c79-926d-ee58ea32639d-metrics-tls podName:70e914f4-4b44-4c79-926d-ee58ea32639d nodeName:}" failed. No retries permitted until 2026-06-02 21:34:32.38835135 +0000 UTC m=+49.640249234 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/70e914f4-4b44-4c79-926d-ee58ea32639d-metrics-tls") pod "dns-default-c44qt" (UID: "70e914f4-4b44-4c79-926d-ee58ea32639d") : secret "dns-default-metrics-tls" not found Jun 02 21:34:24.388580 ip-10-0-138-193 kubenswrapper[2578]: E0602 21:34:24.388297 2578 secret.go:189] Couldn't get secret openshift-ingress-canary/canary-serving-cert: secret "canary-serving-cert" not found Jun 02 21:34:24.388580 ip-10-0-138-193 kubenswrapper[2578]: E0602 21:34:24.388421 2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/39b30769-802d-4bcb-906a-fcbb4eee94b6-cert podName:39b30769-802d-4bcb-906a-fcbb4eee94b6 nodeName:}" failed. No retries permitted until 2026-06-02 21:34:32.388409665 +0000 UTC m=+49.640307563 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "cert" (UniqueName: "kubernetes.io/secret/39b30769-802d-4bcb-906a-fcbb4eee94b6-cert") pod "ingress-canary-7jp8d" (UID: "39b30769-802d-4bcb-906a-fcbb4eee94b6") : secret "canary-serving-cert" not found Jun 02 21:34:32.449793 ip-10-0-138-193 kubenswrapper[2578]: I0602 21:34:32.449747 2578 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/39b30769-802d-4bcb-906a-fcbb4eee94b6-cert\") pod \"ingress-canary-7jp8d\" (UID: \"39b30769-802d-4bcb-906a-fcbb4eee94b6\") " pod="openshift-ingress-canary/ingress-canary-7jp8d" Jun 02 21:34:32.450275 ip-10-0-138-193 kubenswrapper[2578]: I0602 21:34:32.449813 2578 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/70e914f4-4b44-4c79-926d-ee58ea32639d-metrics-tls\") pod \"dns-default-c44qt\" (UID: \"70e914f4-4b44-4c79-926d-ee58ea32639d\") " pod="openshift-dns/dns-default-c44qt" Jun 02 21:34:32.450275 ip-10-0-138-193 kubenswrapper[2578]: E0602 21:34:32.449922 2578 secret.go:189] Couldn't get secret openshift-ingress-canary/canary-serving-cert: secret "canary-serving-cert" not found Jun 02 21:34:32.450275 ip-10-0-138-193 kubenswrapper[2578]: E0602 21:34:32.449992 2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/39b30769-802d-4bcb-906a-fcbb4eee94b6-cert podName:39b30769-802d-4bcb-906a-fcbb4eee94b6 nodeName:}" failed. No retries permitted until 2026-06-02 21:34:48.449975754 +0000 UTC m=+65.701873638 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "cert" (UniqueName: "kubernetes.io/secret/39b30769-802d-4bcb-906a-fcbb4eee94b6-cert") pod "ingress-canary-7jp8d" (UID: "39b30769-802d-4bcb-906a-fcbb4eee94b6") : secret "canary-serving-cert" not found Jun 02 21:34:32.450275 ip-10-0-138-193 kubenswrapper[2578]: E0602 21:34:32.449922 2578 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jun 02 21:34:32.450275 ip-10-0-138-193 kubenswrapper[2578]: E0602 21:34:32.450025 2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/70e914f4-4b44-4c79-926d-ee58ea32639d-metrics-tls podName:70e914f4-4b44-4c79-926d-ee58ea32639d nodeName:}" failed. No retries permitted until 2026-06-02 21:34:48.450018735 +0000 UTC m=+65.701916619 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/70e914f4-4b44-4c79-926d-ee58ea32639d-metrics-tls") pod "dns-default-c44qt" (UID: "70e914f4-4b44-4c79-926d-ee58ea32639d") : secret "dns-default-metrics-tls" not found Jun 02 21:34:43.596841 ip-10-0-138-193 kubenswrapper[2578]: I0602 21:34:43.596809 2578 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-5zgzd" Jun 02 21:34:48.461720 ip-10-0-138-193 kubenswrapper[2578]: I0602 21:34:48.461659 2578 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/70e914f4-4b44-4c79-926d-ee58ea32639d-metrics-tls\") pod \"dns-default-c44qt\" (UID: \"70e914f4-4b44-4c79-926d-ee58ea32639d\") " pod="openshift-dns/dns-default-c44qt" Jun 02 21:34:48.462286 ip-10-0-138-193 kubenswrapper[2578]: I0602 21:34:48.461753 2578 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/39b30769-802d-4bcb-906a-fcbb4eee94b6-cert\") pod \"ingress-canary-7jp8d\" (UID: \"39b30769-802d-4bcb-906a-fcbb4eee94b6\") " pod="openshift-ingress-canary/ingress-canary-7jp8d" Jun 02 21:34:48.462286 ip-10-0-138-193 kubenswrapper[2578]: E0602 21:34:48.461836 2578 secret.go:189] Couldn't get secret openshift-ingress-canary/canary-serving-cert: secret "canary-serving-cert" not found Jun 02 21:34:48.462286 ip-10-0-138-193 kubenswrapper[2578]: E0602 21:34:48.461893 2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/39b30769-802d-4bcb-906a-fcbb4eee94b6-cert podName:39b30769-802d-4bcb-906a-fcbb4eee94b6 nodeName:}" failed. No retries permitted until 2026-06-02 21:35:20.461878292 +0000 UTC m=+97.713776175 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "cert" (UniqueName: "kubernetes.io/secret/39b30769-802d-4bcb-906a-fcbb4eee94b6-cert") pod "ingress-canary-7jp8d" (UID: "39b30769-802d-4bcb-906a-fcbb4eee94b6") : secret "canary-serving-cert" not found Jun 02 21:34:48.462286 ip-10-0-138-193 kubenswrapper[2578]: E0602 21:34:48.461834 2578 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jun 02 21:34:48.462286 ip-10-0-138-193 kubenswrapper[2578]: E0602 21:34:48.461993 2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/70e914f4-4b44-4c79-926d-ee58ea32639d-metrics-tls podName:70e914f4-4b44-4c79-926d-ee58ea32639d nodeName:}" failed. No retries permitted until 2026-06-02 21:35:20.461971473 +0000 UTC m=+97.713869371 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/70e914f4-4b44-4c79-926d-ee58ea32639d-metrics-tls") pod "dns-default-c44qt" (UID: "70e914f4-4b44-4c79-926d-ee58ea32639d") : secret "dns-default-metrics-tls" not found Jun 02 21:34:48.965861 ip-10-0-138-193 kubenswrapper[2578]: I0602 21:34:48.965817 2578 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/adfce93b-f07e-480a-af26-5dc7df23fa48-metrics-certs\") pod \"network-metrics-daemon-k2vdd\" (UID: \"adfce93b-f07e-480a-af26-5dc7df23fa48\") " pod="openshift-multus/network-metrics-daemon-k2vdd" Jun 02 21:34:48.968537 ip-10-0-138-193 kubenswrapper[2578]: I0602 21:34:48.968515 2578 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-secret\"" Jun 02 21:34:48.976349 ip-10-0-138-193 kubenswrapper[2578]: E0602 21:34:48.976325 2578 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: secret "metrics-daemon-secret" not found Jun 02 21:34:48.976423 ip-10-0-138-193 kubenswrapper[2578]: E0602 21:34:48.976411 2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/adfce93b-f07e-480a-af26-5dc7df23fa48-metrics-certs podName:adfce93b-f07e-480a-af26-5dc7df23fa48 nodeName:}" failed. No retries permitted until 2026-06-02 21:35:52.97639067 +0000 UTC m=+130.228288555 (durationBeforeRetry 1m4s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/adfce93b-f07e-480a-af26-5dc7df23fa48-metrics-certs") pod "network-metrics-daemon-k2vdd" (UID: "adfce93b-f07e-480a-af26-5dc7df23fa48") : secret "metrics-daemon-secret" not found Jun 02 21:34:49.066857 ip-10-0-138-193 kubenswrapper[2578]: I0602 21:34:49.066811 2578 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-d5dnb\" (UniqueName: \"kubernetes.io/projected/950ec20f-2c4b-4e1b-96ba-c02f9a6d124a-kube-api-access-d5dnb\") pod \"network-check-target-r92gd\" (UID: \"950ec20f-2c4b-4e1b-96ba-c02f9a6d124a\") " pod="openshift-network-diagnostics/network-check-target-r92gd" Jun 02 21:34:49.067008 ip-10-0-138-193 kubenswrapper[2578]: I0602 21:34:49.066879 2578 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/9963c656-171f-412f-b531-d4e89671117c-original-pull-secret\") pod \"global-pull-secret-syncer-rf8cp\" (UID: \"9963c656-171f-412f-b531-d4e89671117c\") " pod="kube-system/global-pull-secret-syncer-rf8cp" Jun 02 21:34:49.069641 ip-10-0-138-193 kubenswrapper[2578]: I0602 21:34:49.069620 2578 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"original-pull-secret\"" Jun 02 21:34:49.069744 ip-10-0-138-193 kubenswrapper[2578]: I0602 21:34:49.069625 2578 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"kube-root-ca.crt\"" Jun 02 21:34:49.079557 ip-10-0-138-193 kubenswrapper[2578]: I0602 21:34:49.079530 2578 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"openshift-service-ca.crt\"" Jun 02 21:34:49.080863 ip-10-0-138-193 kubenswrapper[2578]: I0602 21:34:49.080844 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/9963c656-171f-412f-b531-d4e89671117c-original-pull-secret\") pod \"global-pull-secret-syncer-rf8cp\" (UID: \"9963c656-171f-412f-b531-d4e89671117c\") " pod="kube-system/global-pull-secret-syncer-rf8cp" Jun 02 21:34:49.090615 ip-10-0-138-193 kubenswrapper[2578]: I0602 21:34:49.090594 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-d5dnb\" (UniqueName: \"kubernetes.io/projected/950ec20f-2c4b-4e1b-96ba-c02f9a6d124a-kube-api-access-d5dnb\") pod \"network-check-target-r92gd\" (UID: \"950ec20f-2c4b-4e1b-96ba-c02f9a6d124a\") " pod="openshift-network-diagnostics/network-check-target-r92gd" Jun 02 21:34:49.134804 ip-10-0-138-193 kubenswrapper[2578]: I0602 21:34:49.134768 2578 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"default-dockercfg-txpc4\"" Jun 02 21:34:49.137591 ip-10-0-138-193 kubenswrapper[2578]: I0602 21:34:49.137565 2578 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-rf8cp" Jun 02 21:34:49.141794 ip-10-0-138-193 kubenswrapper[2578]: I0602 21:34:49.141757 2578 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-r92gd" Jun 02 21:34:49.277108 ip-10-0-138-193 kubenswrapper[2578]: I0602 21:34:49.277064 2578 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-target-r92gd"] Jun 02 21:34:49.280590 ip-10-0-138-193 kubenswrapper[2578]: W0602 21:34:49.280559 2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod950ec20f_2c4b_4e1b_96ba_c02f9a6d124a.slice/crio-2dbd1a5935b9d434608bbb5859fb1d6812ba513cf2733902d0df16b7ac3d7772 WatchSource:0}: Error finding container 2dbd1a5935b9d434608bbb5859fb1d6812ba513cf2733902d0df16b7ac3d7772: Status 404 returned error can't find the container with id 2dbd1a5935b9d434608bbb5859fb1d6812ba513cf2733902d0df16b7ac3d7772 Jun 02 21:34:49.289789 ip-10-0-138-193 kubenswrapper[2578]: I0602 21:34:49.289740 2578 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kube-system/global-pull-secret-syncer-rf8cp"] Jun 02 21:34:49.293764 ip-10-0-138-193 kubenswrapper[2578]: W0602 21:34:49.293739 2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod9963c656_171f_412f_b531_d4e89671117c.slice/crio-3940703b0e1a096fd57be1b593ed74904377dbf544c0309f28e2bbe5cac7d901 WatchSource:0}: Error finding container 3940703b0e1a096fd57be1b593ed74904377dbf544c0309f28e2bbe5cac7d901: Status 404 returned error can't find the container with id 3940703b0e1a096fd57be1b593ed74904377dbf544c0309f28e2bbe5cac7d901 Jun 02 21:34:49.661223 ip-10-0-138-193 kubenswrapper[2578]: I0602 21:34:49.661184 2578 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-target-r92gd" event={"ID":"950ec20f-2c4b-4e1b-96ba-c02f9a6d124a","Type":"ContainerStarted","Data":"2dbd1a5935b9d434608bbb5859fb1d6812ba513cf2733902d0df16b7ac3d7772"} Jun 02 21:34:49.662162 ip-10-0-138-193 kubenswrapper[2578]: I0602 21:34:49.662140 2578 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kube-system/global-pull-secret-syncer-rf8cp" event={"ID":"9963c656-171f-412f-b531-d4e89671117c","Type":"ContainerStarted","Data":"3940703b0e1a096fd57be1b593ed74904377dbf544c0309f28e2bbe5cac7d901"} Jun 02 21:34:54.672772 ip-10-0-138-193 kubenswrapper[2578]: I0602 21:34:54.672727 2578 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-target-r92gd" event={"ID":"950ec20f-2c4b-4e1b-96ba-c02f9a6d124a","Type":"ContainerStarted","Data":"19642b78fffbb279a0723946e5d8220fb795a1fad8443b52e18f66cbc73b4298"} Jun 02 21:34:54.673253 ip-10-0-138-193 kubenswrapper[2578]: I0602 21:34:54.672946 2578 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-network-diagnostics/network-check-target-r92gd" Jun 02 21:34:54.673977 ip-10-0-138-193 kubenswrapper[2578]: I0602 21:34:54.673951 2578 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kube-system/global-pull-secret-syncer-rf8cp" event={"ID":"9963c656-171f-412f-b531-d4e89671117c","Type":"ContainerStarted","Data":"8af272c9edad345cb698057bb45719ac9348b720651e11bec754d22c7df2c6cd"} Jun 02 21:34:54.688668 ip-10-0-138-193 kubenswrapper[2578]: I0602 21:34:54.688606 2578 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-network-diagnostics/network-check-target-r92gd" podStartSLOduration=67.041739461 podStartE2EDuration="1m11.688589674s" podCreationTimestamp="2026-06-02 21:33:43 +0000 UTC" firstStartedPulling="2026-06-02 21:34:49.282582576 +0000 UTC m=+66.534480466" lastFinishedPulling="2026-06-02 21:34:53.929432786 +0000 UTC m=+71.181330679" observedRunningTime="2026-06-02 21:34:54.688287231 +0000 UTC m=+71.940185137" watchObservedRunningTime="2026-06-02 21:34:54.688589674 +0000 UTC m=+71.940487582" Jun 02 21:34:54.701935 ip-10-0-138-193 kubenswrapper[2578]: I0602 21:34:54.701890 2578 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="kube-system/global-pull-secret-syncer-rf8cp" podStartSLOduration=66.065562495 podStartE2EDuration="1m10.701879148s" podCreationTimestamp="2026-06-02 21:33:44 +0000 UTC" firstStartedPulling="2026-06-02 21:34:49.295465343 +0000 UTC m=+66.547363227" lastFinishedPulling="2026-06-02 21:34:53.931781991 +0000 UTC m=+71.183679880" observedRunningTime="2026-06-02 21:34:54.701163656 +0000 UTC m=+71.953061556" watchObservedRunningTime="2026-06-02 21:34:54.701879148 +0000 UTC m=+71.953777054" Jun 02 21:35:20.491132 ip-10-0-138-193 kubenswrapper[2578]: I0602 21:35:20.491085 2578 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/39b30769-802d-4bcb-906a-fcbb4eee94b6-cert\") pod \"ingress-canary-7jp8d\" (UID: \"39b30769-802d-4bcb-906a-fcbb4eee94b6\") " pod="openshift-ingress-canary/ingress-canary-7jp8d" Jun 02 21:35:20.491132 ip-10-0-138-193 kubenswrapper[2578]: I0602 21:35:20.491132 2578 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/70e914f4-4b44-4c79-926d-ee58ea32639d-metrics-tls\") pod \"dns-default-c44qt\" (UID: \"70e914f4-4b44-4c79-926d-ee58ea32639d\") " pod="openshift-dns/dns-default-c44qt" Jun 02 21:35:20.491628 ip-10-0-138-193 kubenswrapper[2578]: E0602 21:35:20.491220 2578 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jun 02 21:35:20.491628 ip-10-0-138-193 kubenswrapper[2578]: E0602 21:35:20.491272 2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/70e914f4-4b44-4c79-926d-ee58ea32639d-metrics-tls podName:70e914f4-4b44-4c79-926d-ee58ea32639d nodeName:}" failed. No retries permitted until 2026-06-02 21:36:24.491258267 +0000 UTC m=+161.743156152 (durationBeforeRetry 1m4s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/70e914f4-4b44-4c79-926d-ee58ea32639d-metrics-tls") pod "dns-default-c44qt" (UID: "70e914f4-4b44-4c79-926d-ee58ea32639d") : secret "dns-default-metrics-tls" not found Jun 02 21:35:20.491628 ip-10-0-138-193 kubenswrapper[2578]: E0602 21:35:20.491221 2578 secret.go:189] Couldn't get secret openshift-ingress-canary/canary-serving-cert: secret "canary-serving-cert" not found Jun 02 21:35:20.491628 ip-10-0-138-193 kubenswrapper[2578]: E0602 21:35:20.491357 2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/39b30769-802d-4bcb-906a-fcbb4eee94b6-cert podName:39b30769-802d-4bcb-906a-fcbb4eee94b6 nodeName:}" failed. No retries permitted until 2026-06-02 21:36:24.49134085 +0000 UTC m=+161.743238755 (durationBeforeRetry 1m4s). Error: MountVolume.SetUp failed for volume "cert" (UniqueName: "kubernetes.io/secret/39b30769-802d-4bcb-906a-fcbb4eee94b6-cert") pod "ingress-canary-7jp8d" (UID: "39b30769-802d-4bcb-906a-fcbb4eee94b6") : secret "canary-serving-cert" not found Jun 02 21:35:25.677913 ip-10-0-138-193 kubenswrapper[2578]: I0602 21:35:25.677883 2578 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-network-diagnostics/network-check-target-r92gd" Jun 02 21:35:49.758490 ip-10-0-138-193 kubenswrapper[2578]: I0602 21:35:49.758454 2578 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-insights/insights-operator-788bf58df5-qx7z2"] Jun 02 21:35:49.760963 ip-10-0-138-193 kubenswrapper[2578]: I0602 21:35:49.760944 2578 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-operator-788bf58df5-qx7z2" Jun 02 21:35:49.763608 ip-10-0-138-193 kubenswrapper[2578]: I0602 21:35:49.763587 2578 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"openshift-service-ca.crt\"" Jun 02 21:35:49.763752 ip-10-0-138-193 kubenswrapper[2578]: I0602 21:35:49.763587 2578 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"service-ca-bundle\"" Jun 02 21:35:49.763823 ip-10-0-138-193 kubenswrapper[2578]: I0602 21:35:49.763772 2578 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"operator-dockercfg-hsgt8\"" Jun 02 21:35:49.764563 ip-10-0-138-193 kubenswrapper[2578]: I0602 21:35:49.764548 2578 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"openshift-insights-serving-cert\"" Jun 02 21:35:49.764727 ip-10-0-138-193 kubenswrapper[2578]: I0602 21:35:49.764687 2578 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"kube-root-ca.crt\"" Jun 02 21:35:49.768376 ip-10-0-138-193 kubenswrapper[2578]: I0602 21:35:49.768359 2578 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"trusted-ca-bundle\"" Jun 02 21:35:49.774002 ip-10-0-138-193 kubenswrapper[2578]: I0602 21:35:49.773980 2578 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-operator-788bf58df5-qx7z2"] Jun 02 21:35:49.890320 ip-10-0-138-193 kubenswrapper[2578]: I0602 21:35:49.890284 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/e01a3390-21d1-4294-a868-751c800fc665-tmp\") pod \"insights-operator-788bf58df5-qx7z2\" (UID: \"e01a3390-21d1-4294-a868-751c800fc665\") " pod="openshift-insights/insights-operator-788bf58df5-qx7z2" Jun 02 21:35:49.890500 ip-10-0-138-193 kubenswrapper[2578]: I0602 21:35:49.890349 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/e01a3390-21d1-4294-a868-751c800fc665-trusted-ca-bundle\") pod \"insights-operator-788bf58df5-qx7z2\" (UID: \"e01a3390-21d1-4294-a868-751c800fc665\") " pod="openshift-insights/insights-operator-788bf58df5-qx7z2" Jun 02 21:35:49.890500 ip-10-0-138-193 kubenswrapper[2578]: I0602 21:35:49.890379 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/e01a3390-21d1-4294-a868-751c800fc665-serving-cert\") pod \"insights-operator-788bf58df5-qx7z2\" (UID: \"e01a3390-21d1-4294-a868-751c800fc665\") " pod="openshift-insights/insights-operator-788bf58df5-qx7z2" Jun 02 21:35:49.890500 ip-10-0-138-193 kubenswrapper[2578]: I0602 21:35:49.890395 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-dkwsz\" (UniqueName: \"kubernetes.io/projected/e01a3390-21d1-4294-a868-751c800fc665-kube-api-access-dkwsz\") pod \"insights-operator-788bf58df5-qx7z2\" (UID: \"e01a3390-21d1-4294-a868-751c800fc665\") " pod="openshift-insights/insights-operator-788bf58df5-qx7z2" Jun 02 21:35:49.890500 ip-10-0-138-193 kubenswrapper[2578]: I0602 21:35:49.890417 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"snapshots\" (UniqueName: \"kubernetes.io/empty-dir/e01a3390-21d1-4294-a868-751c800fc665-snapshots\") pod \"insights-operator-788bf58df5-qx7z2\" (UID: \"e01a3390-21d1-4294-a868-751c800fc665\") " pod="openshift-insights/insights-operator-788bf58df5-qx7z2" Jun 02 21:35:49.890500 ip-10-0-138-193 kubenswrapper[2578]: I0602 21:35:49.890435 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/e01a3390-21d1-4294-a868-751c800fc665-service-ca-bundle\") pod \"insights-operator-788bf58df5-qx7z2\" (UID: \"e01a3390-21d1-4294-a868-751c800fc665\") " pod="openshift-insights/insights-operator-788bf58df5-qx7z2" Jun 02 21:35:49.991747 ip-10-0-138-193 kubenswrapper[2578]: I0602 21:35:49.991696 2578 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/e01a3390-21d1-4294-a868-751c800fc665-service-ca-bundle\") pod \"insights-operator-788bf58df5-qx7z2\" (UID: \"e01a3390-21d1-4294-a868-751c800fc665\") " pod="openshift-insights/insights-operator-788bf58df5-qx7z2" Jun 02 21:35:49.991747 ip-10-0-138-193 kubenswrapper[2578]: I0602 21:35:49.991761 2578 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/e01a3390-21d1-4294-a868-751c800fc665-tmp\") pod \"insights-operator-788bf58df5-qx7z2\" (UID: \"e01a3390-21d1-4294-a868-751c800fc665\") " pod="openshift-insights/insights-operator-788bf58df5-qx7z2" Jun 02 21:35:49.991949 ip-10-0-138-193 kubenswrapper[2578]: I0602 21:35:49.991804 2578 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/e01a3390-21d1-4294-a868-751c800fc665-trusted-ca-bundle\") pod \"insights-operator-788bf58df5-qx7z2\" (UID: \"e01a3390-21d1-4294-a868-751c800fc665\") " pod="openshift-insights/insights-operator-788bf58df5-qx7z2" Jun 02 21:35:49.991949 ip-10-0-138-193 kubenswrapper[2578]: I0602 21:35:49.991819 2578 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/e01a3390-21d1-4294-a868-751c800fc665-serving-cert\") pod \"insights-operator-788bf58df5-qx7z2\" (UID: \"e01a3390-21d1-4294-a868-751c800fc665\") " pod="openshift-insights/insights-operator-788bf58df5-qx7z2" Jun 02 21:35:49.991949 ip-10-0-138-193 kubenswrapper[2578]: I0602 21:35:49.991834 2578 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-dkwsz\" (UniqueName: \"kubernetes.io/projected/e01a3390-21d1-4294-a868-751c800fc665-kube-api-access-dkwsz\") pod \"insights-operator-788bf58df5-qx7z2\" (UID: \"e01a3390-21d1-4294-a868-751c800fc665\") " pod="openshift-insights/insights-operator-788bf58df5-qx7z2" Jun 02 21:35:49.991949 ip-10-0-138-193 kubenswrapper[2578]: I0602 21:35:49.991861 2578 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"snapshots\" (UniqueName: \"kubernetes.io/empty-dir/e01a3390-21d1-4294-a868-751c800fc665-snapshots\") pod \"insights-operator-788bf58df5-qx7z2\" (UID: \"e01a3390-21d1-4294-a868-751c800fc665\") " pod="openshift-insights/insights-operator-788bf58df5-qx7z2" Jun 02 21:35:49.992386 ip-10-0-138-193 kubenswrapper[2578]: I0602 21:35:49.992365 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/e01a3390-21d1-4294-a868-751c800fc665-service-ca-bundle\") pod \"insights-operator-788bf58df5-qx7z2\" (UID: \"e01a3390-21d1-4294-a868-751c800fc665\") " pod="openshift-insights/insights-operator-788bf58df5-qx7z2" Jun 02 21:35:49.992463 ip-10-0-138-193 kubenswrapper[2578]: I0602 21:35:49.992432 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/e01a3390-21d1-4294-a868-751c800fc665-tmp\") pod \"insights-operator-788bf58df5-qx7z2\" (UID: \"e01a3390-21d1-4294-a868-751c800fc665\") " pod="openshift-insights/insights-operator-788bf58df5-qx7z2" Jun 02 21:35:49.992518 ip-10-0-138-193 kubenswrapper[2578]: I0602 21:35:49.992501 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"snapshots\" (UniqueName: \"kubernetes.io/empty-dir/e01a3390-21d1-4294-a868-751c800fc665-snapshots\") pod \"insights-operator-788bf58df5-qx7z2\" (UID: \"e01a3390-21d1-4294-a868-751c800fc665\") " pod="openshift-insights/insights-operator-788bf58df5-qx7z2" Jun 02 21:35:49.992672 ip-10-0-138-193 kubenswrapper[2578]: I0602 21:35:49.992653 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/e01a3390-21d1-4294-a868-751c800fc665-trusted-ca-bundle\") pod \"insights-operator-788bf58df5-qx7z2\" (UID: \"e01a3390-21d1-4294-a868-751c800fc665\") " pod="openshift-insights/insights-operator-788bf58df5-qx7z2" Jun 02 21:35:49.994218 ip-10-0-138-193 kubenswrapper[2578]: I0602 21:35:49.994199 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/e01a3390-21d1-4294-a868-751c800fc665-serving-cert\") pod \"insights-operator-788bf58df5-qx7z2\" (UID: \"e01a3390-21d1-4294-a868-751c800fc665\") " pod="openshift-insights/insights-operator-788bf58df5-qx7z2" Jun 02 21:35:50.000199 ip-10-0-138-193 kubenswrapper[2578]: I0602 21:35:50.000179 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-dkwsz\" (UniqueName: \"kubernetes.io/projected/e01a3390-21d1-4294-a868-751c800fc665-kube-api-access-dkwsz\") pod \"insights-operator-788bf58df5-qx7z2\" (UID: \"e01a3390-21d1-4294-a868-751c800fc665\") " pod="openshift-insights/insights-operator-788bf58df5-qx7z2" Jun 02 21:35:50.070366 ip-10-0-138-193 kubenswrapper[2578]: I0602 21:35:50.070283 2578 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-operator-788bf58df5-qx7z2" Jun 02 21:35:50.185696 ip-10-0-138-193 kubenswrapper[2578]: I0602 21:35:50.185658 2578 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-operator-788bf58df5-qx7z2"] Jun 02 21:35:50.189364 ip-10-0-138-193 kubenswrapper[2578]: W0602 21:35:50.189332 2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pode01a3390_21d1_4294_a868_751c800fc665.slice/crio-3b1c9736c3134d9a7b72545ae4c8ff024744cc777049b94cded10d648a7e3140 WatchSource:0}: Error finding container 3b1c9736c3134d9a7b72545ae4c8ff024744cc777049b94cded10d648a7e3140: Status 404 returned error can't find the container with id 3b1c9736c3134d9a7b72545ae4c8ff024744cc777049b94cded10d648a7e3140 Jun 02 21:35:50.780790 ip-10-0-138-193 kubenswrapper[2578]: I0602 21:35:50.780753 2578 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-operator-788bf58df5-qx7z2" event={"ID":"e01a3390-21d1-4294-a868-751c800fc665","Type":"ContainerStarted","Data":"3b1c9736c3134d9a7b72545ae4c8ff024744cc777049b94cded10d648a7e3140"} Jun 02 21:35:52.786064 ip-10-0-138-193 kubenswrapper[2578]: I0602 21:35:52.786029 2578 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-operator-788bf58df5-qx7z2" event={"ID":"e01a3390-21d1-4294-a868-751c800fc665","Type":"ContainerStarted","Data":"89e2f84cd4a4466d2a4b716c20a7bd8dae51c08d1c7ed8fdcfd84ab3faeed60d"} Jun 02 21:35:52.803834 ip-10-0-138-193 kubenswrapper[2578]: I0602 21:35:52.803784 2578 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-insights/insights-operator-788bf58df5-qx7z2" podStartSLOduration=1.6456250460000001 podStartE2EDuration="3.803772083s" podCreationTimestamp="2026-06-02 21:35:49 +0000 UTC" firstStartedPulling="2026-06-02 21:35:50.191058122 +0000 UTC m=+127.442956010" lastFinishedPulling="2026-06-02 21:35:52.349205153 +0000 UTC m=+129.601103047" observedRunningTime="2026-06-02 21:35:52.803156105 +0000 UTC m=+130.055054012" watchObservedRunningTime="2026-06-02 21:35:52.803772083 +0000 UTC m=+130.055669986" Jun 02 21:35:53.013739 ip-10-0-138-193 kubenswrapper[2578]: I0602 21:35:53.013709 2578 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/adfce93b-f07e-480a-af26-5dc7df23fa48-metrics-certs\") pod \"network-metrics-daemon-k2vdd\" (UID: \"adfce93b-f07e-480a-af26-5dc7df23fa48\") " pod="openshift-multus/network-metrics-daemon-k2vdd" Jun 02 21:35:53.013887 ip-10-0-138-193 kubenswrapper[2578]: E0602 21:35:53.013796 2578 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: secret "metrics-daemon-secret" not found Jun 02 21:35:53.013887 ip-10-0-138-193 kubenswrapper[2578]: E0602 21:35:53.013841 2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/adfce93b-f07e-480a-af26-5dc7df23fa48-metrics-certs podName:adfce93b-f07e-480a-af26-5dc7df23fa48 nodeName:}" failed. No retries permitted until 2026-06-02 21:37:55.013827771 +0000 UTC m=+252.265725656 (durationBeforeRetry 2m2s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/adfce93b-f07e-480a-af26-5dc7df23fa48-metrics-certs") pod "network-metrics-daemon-k2vdd" (UID: "adfce93b-f07e-480a-af26-5dc7df23fa48") : secret "metrics-daemon-secret" not found Jun 02 21:35:53.735677 ip-10-0-138-193 kubenswrapper[2578]: I0602 21:35:53.735641 2578 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-cluster-samples-operator/cluster-samples-operator-755bbf9bfb-kfw7q"] Jun 02 21:35:53.739154 ip-10-0-138-193 kubenswrapper[2578]: I0602 21:35:53.739132 2578 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-samples-operator/cluster-samples-operator-755bbf9bfb-kfw7q" Jun 02 21:35:53.741305 ip-10-0-138-193 kubenswrapper[2578]: I0602 21:35:53.741275 2578 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-samples-operator\"/\"samples-operator-tls\"" Jun 02 21:35:53.741427 ip-10-0-138-193 kubenswrapper[2578]: I0602 21:35:53.741327 2578 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-samples-operator\"/\"openshift-service-ca.crt\"" Jun 02 21:35:53.741427 ip-10-0-138-193 kubenswrapper[2578]: I0602 21:35:53.741327 2578 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-samples-operator\"/\"kube-root-ca.crt\"" Jun 02 21:35:53.741427 ip-10-0-138-193 kubenswrapper[2578]: I0602 21:35:53.741341 2578 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-samples-operator\"/\"cluster-samples-operator-dockercfg-7kbl8\"" Jun 02 21:35:53.748195 ip-10-0-138-193 kubenswrapper[2578]: I0602 21:35:53.748174 2578 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-cluster-samples-operator/cluster-samples-operator-755bbf9bfb-kfw7q"] Jun 02 21:35:53.820107 ip-10-0-138-193 kubenswrapper[2578]: I0602 21:35:53.820059 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/d1572395-b2de-4278-91a6-a49c5487dc26-samples-operator-tls\") pod \"cluster-samples-operator-755bbf9bfb-kfw7q\" (UID: \"d1572395-b2de-4278-91a6-a49c5487dc26\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-755bbf9bfb-kfw7q" Jun 02 21:35:53.820447 ip-10-0-138-193 kubenswrapper[2578]: I0602 21:35:53.820138 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-qxbwz\" (UniqueName: \"kubernetes.io/projected/d1572395-b2de-4278-91a6-a49c5487dc26-kube-api-access-qxbwz\") pod \"cluster-samples-operator-755bbf9bfb-kfw7q\" (UID: \"d1572395-b2de-4278-91a6-a49c5487dc26\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-755bbf9bfb-kfw7q" Jun 02 21:35:53.920586 ip-10-0-138-193 kubenswrapper[2578]: I0602 21:35:53.920544 2578 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-qxbwz\" (UniqueName: \"kubernetes.io/projected/d1572395-b2de-4278-91a6-a49c5487dc26-kube-api-access-qxbwz\") pod \"cluster-samples-operator-755bbf9bfb-kfw7q\" (UID: \"d1572395-b2de-4278-91a6-a49c5487dc26\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-755bbf9bfb-kfw7q" Jun 02 21:35:53.920824 ip-10-0-138-193 kubenswrapper[2578]: I0602 21:35:53.920799 2578 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/d1572395-b2de-4278-91a6-a49c5487dc26-samples-operator-tls\") pod \"cluster-samples-operator-755bbf9bfb-kfw7q\" (UID: \"d1572395-b2de-4278-91a6-a49c5487dc26\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-755bbf9bfb-kfw7q" Jun 02 21:35:53.920919 ip-10-0-138-193 kubenswrapper[2578]: E0602 21:35:53.920882 2578 secret.go:189] Couldn't get secret openshift-cluster-samples-operator/samples-operator-tls: secret "samples-operator-tls" not found Jun 02 21:35:53.920981 ip-10-0-138-193 kubenswrapper[2578]: E0602 21:35:53.920958 2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/d1572395-b2de-4278-91a6-a49c5487dc26-samples-operator-tls podName:d1572395-b2de-4278-91a6-a49c5487dc26 nodeName:}" failed. No retries permitted until 2026-06-02 21:35:54.420941156 +0000 UTC m=+131.672839044 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "samples-operator-tls" (UniqueName: "kubernetes.io/secret/d1572395-b2de-4278-91a6-a49c5487dc26-samples-operator-tls") pod "cluster-samples-operator-755bbf9bfb-kfw7q" (UID: "d1572395-b2de-4278-91a6-a49c5487dc26") : secret "samples-operator-tls" not found Jun 02 21:35:53.931932 ip-10-0-138-193 kubenswrapper[2578]: I0602 21:35:53.931905 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-qxbwz\" (UniqueName: \"kubernetes.io/projected/d1572395-b2de-4278-91a6-a49c5487dc26-kube-api-access-qxbwz\") pod \"cluster-samples-operator-755bbf9bfb-kfw7q\" (UID: \"d1572395-b2de-4278-91a6-a49c5487dc26\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-755bbf9bfb-kfw7q" Jun 02 21:35:54.424048 ip-10-0-138-193 kubenswrapper[2578]: I0602 21:35:54.424010 2578 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/d1572395-b2de-4278-91a6-a49c5487dc26-samples-operator-tls\") pod \"cluster-samples-operator-755bbf9bfb-kfw7q\" (UID: \"d1572395-b2de-4278-91a6-a49c5487dc26\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-755bbf9bfb-kfw7q" Jun 02 21:35:54.424231 ip-10-0-138-193 kubenswrapper[2578]: E0602 21:35:54.424129 2578 secret.go:189] Couldn't get secret openshift-cluster-samples-operator/samples-operator-tls: secret "samples-operator-tls" not found Jun 02 21:35:54.424231 ip-10-0-138-193 kubenswrapper[2578]: E0602 21:35:54.424191 2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/d1572395-b2de-4278-91a6-a49c5487dc26-samples-operator-tls podName:d1572395-b2de-4278-91a6-a49c5487dc26 nodeName:}" failed. No retries permitted until 2026-06-02 21:35:55.424175746 +0000 UTC m=+132.676073629 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "samples-operator-tls" (UniqueName: "kubernetes.io/secret/d1572395-b2de-4278-91a6-a49c5487dc26-samples-operator-tls") pod "cluster-samples-operator-755bbf9bfb-kfw7q" (UID: "d1572395-b2de-4278-91a6-a49c5487dc26") : secret "samples-operator-tls" not found Jun 02 21:35:54.731917 ip-10-0-138-193 kubenswrapper[2578]: I0602 21:35:54.731835 2578 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-cluster-storage-operator/volume-data-source-validator-7598fd5bd-8zpds"] Jun 02 21:35:54.734901 ip-10-0-138-193 kubenswrapper[2578]: I0602 21:35:54.734879 2578 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-storage-operator/volume-data-source-validator-7598fd5bd-8zpds" Jun 02 21:35:54.737329 ip-10-0-138-193 kubenswrapper[2578]: I0602 21:35:54.737302 2578 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-storage-operator\"/\"kube-root-ca.crt\"" Jun 02 21:35:54.737460 ip-10-0-138-193 kubenswrapper[2578]: I0602 21:35:54.737362 2578 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-storage-operator\"/\"openshift-service-ca.crt\"" Jun 02 21:35:54.738159 ip-10-0-138-193 kubenswrapper[2578]: I0602 21:35:54.738141 2578 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-storage-operator\"/\"volume-data-source-validator-dockercfg-7bqk4\"" Jun 02 21:35:54.741436 ip-10-0-138-193 kubenswrapper[2578]: I0602 21:35:54.741414 2578 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-cluster-storage-operator/volume-data-source-validator-7598fd5bd-8zpds"] Jun 02 21:35:54.828220 ip-10-0-138-193 kubenswrapper[2578]: I0602 21:35:54.828178 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-wfqrj\" (UniqueName: \"kubernetes.io/projected/4b5289fa-39df-48e0-b902-4a4d22134c2f-kube-api-access-wfqrj\") pod \"volume-data-source-validator-7598fd5bd-8zpds\" (UID: \"4b5289fa-39df-48e0-b902-4a4d22134c2f\") " pod="openshift-cluster-storage-operator/volume-data-source-validator-7598fd5bd-8zpds" Jun 02 21:35:54.928737 ip-10-0-138-193 kubenswrapper[2578]: I0602 21:35:54.928702 2578 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-wfqrj\" (UniqueName: \"kubernetes.io/projected/4b5289fa-39df-48e0-b902-4a4d22134c2f-kube-api-access-wfqrj\") pod \"volume-data-source-validator-7598fd5bd-8zpds\" (UID: \"4b5289fa-39df-48e0-b902-4a4d22134c2f\") " pod="openshift-cluster-storage-operator/volume-data-source-validator-7598fd5bd-8zpds" Jun 02 21:35:54.936636 ip-10-0-138-193 kubenswrapper[2578]: I0602 21:35:54.936601 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-wfqrj\" (UniqueName: \"kubernetes.io/projected/4b5289fa-39df-48e0-b902-4a4d22134c2f-kube-api-access-wfqrj\") pod \"volume-data-source-validator-7598fd5bd-8zpds\" (UID: \"4b5289fa-39df-48e0-b902-4a4d22134c2f\") " pod="openshift-cluster-storage-operator/volume-data-source-validator-7598fd5bd-8zpds" Jun 02 21:35:55.044124 ip-10-0-138-193 kubenswrapper[2578]: I0602 21:35:55.044015 2578 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-storage-operator/volume-data-source-validator-7598fd5bd-8zpds" Jun 02 21:35:55.162616 ip-10-0-138-193 kubenswrapper[2578]: I0602 21:35:55.162585 2578 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-cluster-storage-operator/volume-data-source-validator-7598fd5bd-8zpds"] Jun 02 21:35:55.165903 ip-10-0-138-193 kubenswrapper[2578]: W0602 21:35:55.165872 2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod4b5289fa_39df_48e0_b902_4a4d22134c2f.slice/crio-5f222a66dedb91871757abae17b8f6eaf8218530c18d6b0b2690022b4fef7d2e WatchSource:0}: Error finding container 5f222a66dedb91871757abae17b8f6eaf8218530c18d6b0b2690022b4fef7d2e: Status 404 returned error can't find the container with id 5f222a66dedb91871757abae17b8f6eaf8218530c18d6b0b2690022b4fef7d2e Jun 02 21:35:55.433065 ip-10-0-138-193 kubenswrapper[2578]: I0602 21:35:55.433024 2578 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/d1572395-b2de-4278-91a6-a49c5487dc26-samples-operator-tls\") pod \"cluster-samples-operator-755bbf9bfb-kfw7q\" (UID: \"d1572395-b2de-4278-91a6-a49c5487dc26\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-755bbf9bfb-kfw7q" Jun 02 21:35:55.433362 ip-10-0-138-193 kubenswrapper[2578]: E0602 21:35:55.433170 2578 secret.go:189] Couldn't get secret openshift-cluster-samples-operator/samples-operator-tls: secret "samples-operator-tls" not found Jun 02 21:35:55.433362 ip-10-0-138-193 kubenswrapper[2578]: E0602 21:35:55.433246 2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/d1572395-b2de-4278-91a6-a49c5487dc26-samples-operator-tls podName:d1572395-b2de-4278-91a6-a49c5487dc26 nodeName:}" failed. No retries permitted until 2026-06-02 21:35:57.43322319 +0000 UTC m=+134.685121078 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "samples-operator-tls" (UniqueName: "kubernetes.io/secret/d1572395-b2de-4278-91a6-a49c5487dc26-samples-operator-tls") pod "cluster-samples-operator-755bbf9bfb-kfw7q" (UID: "d1572395-b2de-4278-91a6-a49c5487dc26") : secret "samples-operator-tls" not found Jun 02 21:35:55.671958 ip-10-0-138-193 kubenswrapper[2578]: I0602 21:35:55.671930 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_node-resolver-vfdfn_4d2236cd-d674-4c20-821e-7173b6db4b74/dns-node-resolver/0.log" Jun 02 21:35:55.791667 ip-10-0-138-193 kubenswrapper[2578]: I0602 21:35:55.791478 2578 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-storage-operator/volume-data-source-validator-7598fd5bd-8zpds" event={"ID":"4b5289fa-39df-48e0-b902-4a4d22134c2f","Type":"ContainerStarted","Data":"5f222a66dedb91871757abae17b8f6eaf8218530c18d6b0b2690022b4fef7d2e"} Jun 02 21:35:56.672009 ip-10-0-138-193 kubenswrapper[2578]: I0602 21:35:56.671979 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_node-ca-mnnsl_fd30f6e0-874c-411b-b8c6-0df250364c15/node-ca/0.log" Jun 02 21:35:57.451972 ip-10-0-138-193 kubenswrapper[2578]: I0602 21:35:57.451933 2578 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/d1572395-b2de-4278-91a6-a49c5487dc26-samples-operator-tls\") pod \"cluster-samples-operator-755bbf9bfb-kfw7q\" (UID: \"d1572395-b2de-4278-91a6-a49c5487dc26\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-755bbf9bfb-kfw7q" Jun 02 21:35:57.452153 ip-10-0-138-193 kubenswrapper[2578]: E0602 21:35:57.452121 2578 secret.go:189] Couldn't get secret openshift-cluster-samples-operator/samples-operator-tls: secret "samples-operator-tls" not found Jun 02 21:35:57.452220 ip-10-0-138-193 kubenswrapper[2578]: E0602 21:35:57.452194 2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/d1572395-b2de-4278-91a6-a49c5487dc26-samples-operator-tls podName:d1572395-b2de-4278-91a6-a49c5487dc26 nodeName:}" failed. No retries permitted until 2026-06-02 21:36:01.452172948 +0000 UTC m=+138.704070851 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "samples-operator-tls" (UniqueName: "kubernetes.io/secret/d1572395-b2de-4278-91a6-a49c5487dc26-samples-operator-tls") pod "cluster-samples-operator-755bbf9bfb-kfw7q" (UID: "d1572395-b2de-4278-91a6-a49c5487dc26") : secret "samples-operator-tls" not found Jun 02 21:35:57.796108 ip-10-0-138-193 kubenswrapper[2578]: I0602 21:35:57.795992 2578 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-storage-operator/volume-data-source-validator-7598fd5bd-8zpds" event={"ID":"4b5289fa-39df-48e0-b902-4a4d22134c2f","Type":"ContainerStarted","Data":"c02743dc14f7396e52fb1f61898e9a019ad59f28cc94a619044cd9a1167174c6"} Jun 02 21:35:57.810718 ip-10-0-138-193 kubenswrapper[2578]: I0602 21:35:57.810669 2578 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-cluster-storage-operator/volume-data-source-validator-7598fd5bd-8zpds" podStartSLOduration=2.155548528 podStartE2EDuration="3.810656346s" podCreationTimestamp="2026-06-02 21:35:54 +0000 UTC" firstStartedPulling="2026-06-02 21:35:55.16765859 +0000 UTC m=+132.419556477" lastFinishedPulling="2026-06-02 21:35:56.822766408 +0000 UTC m=+134.074664295" observedRunningTime="2026-06-02 21:35:57.810516196 +0000 UTC m=+135.062414103" watchObservedRunningTime="2026-06-02 21:35:57.810656346 +0000 UTC m=+135.062554254" Jun 02 21:35:59.737186 ip-10-0-138-193 kubenswrapper[2578]: I0602 21:35:59.737152 2578 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-96ddc787c-jlmt8"] Jun 02 21:35:59.740098 ip-10-0-138-193 kubenswrapper[2578]: I0602 21:35:59.740062 2578 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-96ddc787c-jlmt8" Jun 02 21:35:59.742597 ip-10-0-138-193 kubenswrapper[2578]: I0602 21:35:59.742573 2578 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-kube-storage-version-migrator-operator\"/\"openshift-service-ca.crt\"" Jun 02 21:35:59.742706 ip-10-0-138-193 kubenswrapper[2578]: I0602 21:35:59.742573 2578 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-kube-storage-version-migrator-operator\"/\"config\"" Jun 02 21:35:59.742706 ip-10-0-138-193 kubenswrapper[2578]: I0602 21:35:59.742633 2578 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-kube-storage-version-migrator-operator\"/\"kube-storage-version-migrator-operator-dockercfg-prclp\"" Jun 02 21:35:59.743638 ip-10-0-138-193 kubenswrapper[2578]: I0602 21:35:59.743622 2578 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-kube-storage-version-migrator-operator\"/\"serving-cert\"" Jun 02 21:35:59.743709 ip-10-0-138-193 kubenswrapper[2578]: I0602 21:35:59.743622 2578 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-kube-storage-version-migrator-operator\"/\"kube-root-ca.crt\"" Jun 02 21:35:59.751588 ip-10-0-138-193 kubenswrapper[2578]: I0602 21:35:59.751569 2578 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-96ddc787c-jlmt8"] Jun 02 21:35:59.845333 ip-10-0-138-193 kubenswrapper[2578]: I0602 21:35:59.845299 2578 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-service-ca-operator/service-ca-operator-69877444c-tnjl6"] Jun 02 21:35:59.848167 ip-10-0-138-193 kubenswrapper[2578]: I0602 21:35:59.848152 2578 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-service-ca-operator/service-ca-operator-69877444c-tnjl6" Jun 02 21:35:59.850637 ip-10-0-138-193 kubenswrapper[2578]: I0602 21:35:59.850618 2578 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-service-ca-operator\"/\"openshift-service-ca.crt\"" Jun 02 21:35:59.850748 ip-10-0-138-193 kubenswrapper[2578]: I0602 21:35:59.850682 2578 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-service-ca-operator\"/\"service-ca-operator-config\"" Jun 02 21:35:59.850748 ip-10-0-138-193 kubenswrapper[2578]: I0602 21:35:59.850686 2578 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-service-ca-operator\"/\"serving-cert\"" Jun 02 21:35:59.850863 ip-10-0-138-193 kubenswrapper[2578]: I0602 21:35:59.850847 2578 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-service-ca-operator\"/\"service-ca-operator-dockercfg-xwmv2\"" Jun 02 21:35:59.851031 ip-10-0-138-193 kubenswrapper[2578]: I0602 21:35:59.851018 2578 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-service-ca-operator\"/\"kube-root-ca.crt\"" Jun 02 21:35:59.858272 ip-10-0-138-193 kubenswrapper[2578]: I0602 21:35:59.858252 2578 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-service-ca-operator/service-ca-operator-69877444c-tnjl6"] Jun 02 21:35:59.870404 ip-10-0-138-193 kubenswrapper[2578]: I0602 21:35:59.870380 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/ab209a6c-c2ef-450d-b14d-4f8438dfebfa-config\") pod \"kube-storage-version-migrator-operator-96ddc787c-jlmt8\" (UID: \"ab209a6c-c2ef-450d-b14d-4f8438dfebfa\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-96ddc787c-jlmt8" Jun 02 21:35:59.870493 ip-10-0-138-193 kubenswrapper[2578]: I0602 21:35:59.870425 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-lw68k\" (UniqueName: \"kubernetes.io/projected/ab209a6c-c2ef-450d-b14d-4f8438dfebfa-kube-api-access-lw68k\") pod \"kube-storage-version-migrator-operator-96ddc787c-jlmt8\" (UID: \"ab209a6c-c2ef-450d-b14d-4f8438dfebfa\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-96ddc787c-jlmt8" Jun 02 21:35:59.870493 ip-10-0-138-193 kubenswrapper[2578]: I0602 21:35:59.870474 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/ab209a6c-c2ef-450d-b14d-4f8438dfebfa-serving-cert\") pod \"kube-storage-version-migrator-operator-96ddc787c-jlmt8\" (UID: \"ab209a6c-c2ef-450d-b14d-4f8438dfebfa\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-96ddc787c-jlmt8" Jun 02 21:35:59.970928 ip-10-0-138-193 kubenswrapper[2578]: I0602 21:35:59.970890 2578 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/ab209a6c-c2ef-450d-b14d-4f8438dfebfa-serving-cert\") pod \"kube-storage-version-migrator-operator-96ddc787c-jlmt8\" (UID: \"ab209a6c-c2ef-450d-b14d-4f8438dfebfa\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-96ddc787c-jlmt8" Jun 02 21:35:59.971125 ip-10-0-138-193 kubenswrapper[2578]: I0602 21:35:59.970937 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/3787e4f5-1948-41f9-8b70-28eac6aa5b99-config\") pod \"service-ca-operator-69877444c-tnjl6\" (UID: \"3787e4f5-1948-41f9-8b70-28eac6aa5b99\") " pod="openshift-service-ca-operator/service-ca-operator-69877444c-tnjl6" Jun 02 21:35:59.971125 ip-10-0-138-193 kubenswrapper[2578]: I0602 21:35:59.970999 2578 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/ab209a6c-c2ef-450d-b14d-4f8438dfebfa-config\") pod \"kube-storage-version-migrator-operator-96ddc787c-jlmt8\" (UID: \"ab209a6c-c2ef-450d-b14d-4f8438dfebfa\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-96ddc787c-jlmt8" Jun 02 21:35:59.971125 ip-10-0-138-193 kubenswrapper[2578]: I0602 21:35:59.971022 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-q7q48\" (UniqueName: \"kubernetes.io/projected/3787e4f5-1948-41f9-8b70-28eac6aa5b99-kube-api-access-q7q48\") pod \"service-ca-operator-69877444c-tnjl6\" (UID: \"3787e4f5-1948-41f9-8b70-28eac6aa5b99\") " pod="openshift-service-ca-operator/service-ca-operator-69877444c-tnjl6" Jun 02 21:35:59.971125 ip-10-0-138-193 kubenswrapper[2578]: I0602 21:35:59.971115 2578 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-lw68k\" (UniqueName: \"kubernetes.io/projected/ab209a6c-c2ef-450d-b14d-4f8438dfebfa-kube-api-access-lw68k\") pod \"kube-storage-version-migrator-operator-96ddc787c-jlmt8\" (UID: \"ab209a6c-c2ef-450d-b14d-4f8438dfebfa\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-96ddc787c-jlmt8" Jun 02 21:35:59.971265 ip-10-0-138-193 kubenswrapper[2578]: I0602 21:35:59.971146 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/3787e4f5-1948-41f9-8b70-28eac6aa5b99-serving-cert\") pod \"service-ca-operator-69877444c-tnjl6\" (UID: \"3787e4f5-1948-41f9-8b70-28eac6aa5b99\") " pod="openshift-service-ca-operator/service-ca-operator-69877444c-tnjl6" Jun 02 21:35:59.971602 ip-10-0-138-193 kubenswrapper[2578]: I0602 21:35:59.971578 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/configmap/ab209a6c-c2ef-450d-b14d-4f8438dfebfa-config\") pod \"kube-storage-version-migrator-operator-96ddc787c-jlmt8\" (UID: \"ab209a6c-c2ef-450d-b14d-4f8438dfebfa\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-96ddc787c-jlmt8" Jun 02 21:35:59.973171 ip-10-0-138-193 kubenswrapper[2578]: I0602 21:35:59.973142 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/ab209a6c-c2ef-450d-b14d-4f8438dfebfa-serving-cert\") pod \"kube-storage-version-migrator-operator-96ddc787c-jlmt8\" (UID: \"ab209a6c-c2ef-450d-b14d-4f8438dfebfa\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-96ddc787c-jlmt8" Jun 02 21:35:59.978591 ip-10-0-138-193 kubenswrapper[2578]: I0602 21:35:59.978570 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-lw68k\" (UniqueName: \"kubernetes.io/projected/ab209a6c-c2ef-450d-b14d-4f8438dfebfa-kube-api-access-lw68k\") pod \"kube-storage-version-migrator-operator-96ddc787c-jlmt8\" (UID: \"ab209a6c-c2ef-450d-b14d-4f8438dfebfa\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-96ddc787c-jlmt8" Jun 02 21:36:00.048786 ip-10-0-138-193 kubenswrapper[2578]: I0602 21:36:00.048698 2578 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-96ddc787c-jlmt8" Jun 02 21:36:00.071625 ip-10-0-138-193 kubenswrapper[2578]: I0602 21:36:00.071597 2578 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/3787e4f5-1948-41f9-8b70-28eac6aa5b99-config\") pod \"service-ca-operator-69877444c-tnjl6\" (UID: \"3787e4f5-1948-41f9-8b70-28eac6aa5b99\") " pod="openshift-service-ca-operator/service-ca-operator-69877444c-tnjl6" Jun 02 21:36:00.071763 ip-10-0-138-193 kubenswrapper[2578]: I0602 21:36:00.071660 2578 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-q7q48\" (UniqueName: \"kubernetes.io/projected/3787e4f5-1948-41f9-8b70-28eac6aa5b99-kube-api-access-q7q48\") pod \"service-ca-operator-69877444c-tnjl6\" (UID: \"3787e4f5-1948-41f9-8b70-28eac6aa5b99\") " pod="openshift-service-ca-operator/service-ca-operator-69877444c-tnjl6" Jun 02 21:36:00.071763 ip-10-0-138-193 kubenswrapper[2578]: I0602 21:36:00.071698 2578 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/3787e4f5-1948-41f9-8b70-28eac6aa5b99-serving-cert\") pod \"service-ca-operator-69877444c-tnjl6\" (UID: \"3787e4f5-1948-41f9-8b70-28eac6aa5b99\") " pod="openshift-service-ca-operator/service-ca-operator-69877444c-tnjl6" Jun 02 21:36:00.072104 ip-10-0-138-193 kubenswrapper[2578]: I0602 21:36:00.072064 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/configmap/3787e4f5-1948-41f9-8b70-28eac6aa5b99-config\") pod \"service-ca-operator-69877444c-tnjl6\" (UID: \"3787e4f5-1948-41f9-8b70-28eac6aa5b99\") " pod="openshift-service-ca-operator/service-ca-operator-69877444c-tnjl6" Jun 02 21:36:00.073800 ip-10-0-138-193 kubenswrapper[2578]: I0602 21:36:00.073778 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/3787e4f5-1948-41f9-8b70-28eac6aa5b99-serving-cert\") pod \"service-ca-operator-69877444c-tnjl6\" (UID: \"3787e4f5-1948-41f9-8b70-28eac6aa5b99\") " pod="openshift-service-ca-operator/service-ca-operator-69877444c-tnjl6" Jun 02 21:36:00.079462 ip-10-0-138-193 kubenswrapper[2578]: I0602 21:36:00.079440 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-q7q48\" (UniqueName: \"kubernetes.io/projected/3787e4f5-1948-41f9-8b70-28eac6aa5b99-kube-api-access-q7q48\") pod \"service-ca-operator-69877444c-tnjl6\" (UID: \"3787e4f5-1948-41f9-8b70-28eac6aa5b99\") " pod="openshift-service-ca-operator/service-ca-operator-69877444c-tnjl6" Jun 02 21:36:00.156534 ip-10-0-138-193 kubenswrapper[2578]: I0602 21:36:00.156490 2578 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-service-ca-operator/service-ca-operator-69877444c-tnjl6" Jun 02 21:36:00.170209 ip-10-0-138-193 kubenswrapper[2578]: I0602 21:36:00.170180 2578 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-96ddc787c-jlmt8"] Jun 02 21:36:00.173187 ip-10-0-138-193 kubenswrapper[2578]: W0602 21:36:00.173163 2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podab209a6c_c2ef_450d_b14d_4f8438dfebfa.slice/crio-e79d9b6ab1ba9038ea242fcc80f3636fbf2af50a3a73dcf8bc9a6963e1ec31be WatchSource:0}: Error finding container e79d9b6ab1ba9038ea242fcc80f3636fbf2af50a3a73dcf8bc9a6963e1ec31be: Status 404 returned error can't find the container with id e79d9b6ab1ba9038ea242fcc80f3636fbf2af50a3a73dcf8bc9a6963e1ec31be Jun 02 21:36:00.275172 ip-10-0-138-193 kubenswrapper[2578]: I0602 21:36:00.275138 2578 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-service-ca-operator/service-ca-operator-69877444c-tnjl6"] Jun 02 21:36:00.278447 ip-10-0-138-193 kubenswrapper[2578]: W0602 21:36:00.278418 2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod3787e4f5_1948_41f9_8b70_28eac6aa5b99.slice/crio-83795e72f13193198a4a6764bf62f2ea78060bc1d7c7eb65ab68044914031ce7 WatchSource:0}: Error finding container 83795e72f13193198a4a6764bf62f2ea78060bc1d7c7eb65ab68044914031ce7: Status 404 returned error can't find the container with id 83795e72f13193198a4a6764bf62f2ea78060bc1d7c7eb65ab68044914031ce7 Jun 02 21:36:00.767411 ip-10-0-138-193 kubenswrapper[2578]: I0602 21:36:00.765262 2578 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-network-diagnostics/network-check-source-56d84b9f44-hdqmf"] Jun 02 21:36:00.770819 ip-10-0-138-193 kubenswrapper[2578]: I0602 21:36:00.770800 2578 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-source-56d84b9f44-hdqmf" Jun 02 21:36:00.773139 ip-10-0-138-193 kubenswrapper[2578]: I0602 21:36:00.773106 2578 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"network-diagnostics-dockercfg-zk5d8\"" Jun 02 21:36:00.774167 ip-10-0-138-193 kubenswrapper[2578]: I0602 21:36:00.774144 2578 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-source-56d84b9f44-hdqmf"] Jun 02 21:36:00.802325 ip-10-0-138-193 kubenswrapper[2578]: I0602 21:36:00.802291 2578 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-96ddc787c-jlmt8" event={"ID":"ab209a6c-c2ef-450d-b14d-4f8438dfebfa","Type":"ContainerStarted","Data":"e79d9b6ab1ba9038ea242fcc80f3636fbf2af50a3a73dcf8bc9a6963e1ec31be"} Jun 02 21:36:00.803247 ip-10-0-138-193 kubenswrapper[2578]: I0602 21:36:00.803216 2578 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-service-ca-operator/service-ca-operator-69877444c-tnjl6" event={"ID":"3787e4f5-1948-41f9-8b70-28eac6aa5b99","Type":"ContainerStarted","Data":"83795e72f13193198a4a6764bf62f2ea78060bc1d7c7eb65ab68044914031ce7"} Jun 02 21:36:00.877878 ip-10-0-138-193 kubenswrapper[2578]: I0602 21:36:00.877828 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-tbrss\" (UniqueName: \"kubernetes.io/projected/90a1018a-87f7-4af4-9be4-c0fc75cac2fc-kube-api-access-tbrss\") pod \"network-check-source-56d84b9f44-hdqmf\" (UID: \"90a1018a-87f7-4af4-9be4-c0fc75cac2fc\") " pod="openshift-network-diagnostics/network-check-source-56d84b9f44-hdqmf" Jun 02 21:36:00.978935 ip-10-0-138-193 kubenswrapper[2578]: I0602 21:36:00.978898 2578 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-tbrss\" (UniqueName: \"kubernetes.io/projected/90a1018a-87f7-4af4-9be4-c0fc75cac2fc-kube-api-access-tbrss\") pod \"network-check-source-56d84b9f44-hdqmf\" (UID: \"90a1018a-87f7-4af4-9be4-c0fc75cac2fc\") " pod="openshift-network-diagnostics/network-check-source-56d84b9f44-hdqmf" Jun 02 21:36:00.987708 ip-10-0-138-193 kubenswrapper[2578]: I0602 21:36:00.987681 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-tbrss\" (UniqueName: \"kubernetes.io/projected/90a1018a-87f7-4af4-9be4-c0fc75cac2fc-kube-api-access-tbrss\") pod \"network-check-source-56d84b9f44-hdqmf\" (UID: \"90a1018a-87f7-4af4-9be4-c0fc75cac2fc\") " pod="openshift-network-diagnostics/network-check-source-56d84b9f44-hdqmf" Jun 02 21:36:01.080022 ip-10-0-138-193 kubenswrapper[2578]: I0602 21:36:01.079947 2578 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-source-56d84b9f44-hdqmf" Jun 02 21:36:01.136153 ip-10-0-138-193 kubenswrapper[2578]: I0602 21:36:01.136107 2578 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-image-registry/image-registry-86b67cd59c-hgcf6"] Jun 02 21:36:01.140562 ip-10-0-138-193 kubenswrapper[2578]: I0602 21:36:01.140540 2578 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-86b67cd59c-hgcf6" Jun 02 21:36:01.143140 ip-10-0-138-193 kubenswrapper[2578]: I0602 21:36:01.143116 2578 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"installation-pull-secrets\"" Jun 02 21:36:01.143360 ip-10-0-138-193 kubenswrapper[2578]: I0602 21:36:01.143342 2578 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"image-registry-private-configuration\"" Jun 02 21:36:01.143563 ip-10-0-138-193 kubenswrapper[2578]: I0602 21:36:01.143545 2578 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"registry-dockercfg-x4k7h\"" Jun 02 21:36:01.143772 ip-10-0-138-193 kubenswrapper[2578]: I0602 21:36:01.143756 2578 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"image-registry-tls\"" Jun 02 21:36:01.156745 ip-10-0-138-193 kubenswrapper[2578]: I0602 21:36:01.156667 2578 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-image-registry/image-registry-86b67cd59c-hgcf6"] Jun 02 21:36:01.160456 ip-10-0-138-193 kubenswrapper[2578]: I0602 21:36:01.160274 2578 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"trusted-ca\"" Jun 02 21:36:01.226551 ip-10-0-138-193 kubenswrapper[2578]: I0602 21:36:01.226516 2578 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-source-56d84b9f44-hdqmf"] Jun 02 21:36:01.231643 ip-10-0-138-193 kubenswrapper[2578]: W0602 21:36:01.230771 2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod90a1018a_87f7_4af4_9be4_c0fc75cac2fc.slice/crio-a7543b9befa9c84ad8889571d8dfc93584282e7139864d6bb16bb6f842d6ecd1 WatchSource:0}: Error finding container a7543b9befa9c84ad8889571d8dfc93584282e7139864d6bb16bb6f842d6ecd1: Status 404 returned error can't find the container with id a7543b9befa9c84ad8889571d8dfc93584282e7139864d6bb16bb6f842d6ecd1 Jun 02 21:36:01.281195 ip-10-0-138-193 kubenswrapper[2578]: I0602 21:36:01.281163 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/9ac0b008-cf1a-404c-b5da-a5d8d29a1de6-ca-trust-extracted\") pod \"image-registry-86b67cd59c-hgcf6\" (UID: \"9ac0b008-cf1a-404c-b5da-a5d8d29a1de6\") " pod="openshift-image-registry/image-registry-86b67cd59c-hgcf6" Jun 02 21:36:01.281321 ip-10-0-138-193 kubenswrapper[2578]: I0602 21:36:01.281211 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/9ac0b008-cf1a-404c-b5da-a5d8d29a1de6-image-registry-private-configuration\") pod \"image-registry-86b67cd59c-hgcf6\" (UID: \"9ac0b008-cf1a-404c-b5da-a5d8d29a1de6\") " pod="openshift-image-registry/image-registry-86b67cd59c-hgcf6" Jun 02 21:36:01.281321 ip-10-0-138-193 kubenswrapper[2578]: I0602 21:36:01.281243 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/9ac0b008-cf1a-404c-b5da-a5d8d29a1de6-installation-pull-secrets\") pod \"image-registry-86b67cd59c-hgcf6\" (UID: \"9ac0b008-cf1a-404c-b5da-a5d8d29a1de6\") " pod="openshift-image-registry/image-registry-86b67cd59c-hgcf6" Jun 02 21:36:01.281321 ip-10-0-138-193 kubenswrapper[2578]: I0602 21:36:01.281273 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-vrggb\" (UniqueName: \"kubernetes.io/projected/9ac0b008-cf1a-404c-b5da-a5d8d29a1de6-kube-api-access-vrggb\") pod \"image-registry-86b67cd59c-hgcf6\" (UID: \"9ac0b008-cf1a-404c-b5da-a5d8d29a1de6\") " pod="openshift-image-registry/image-registry-86b67cd59c-hgcf6" Jun 02 21:36:01.281321 ip-10-0-138-193 kubenswrapper[2578]: I0602 21:36:01.281300 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/9ac0b008-cf1a-404c-b5da-a5d8d29a1de6-bound-sa-token\") pod \"image-registry-86b67cd59c-hgcf6\" (UID: \"9ac0b008-cf1a-404c-b5da-a5d8d29a1de6\") " pod="openshift-image-registry/image-registry-86b67cd59c-hgcf6" Jun 02 21:36:01.281521 ip-10-0-138-193 kubenswrapper[2578]: I0602 21:36:01.281336 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/9ac0b008-cf1a-404c-b5da-a5d8d29a1de6-trusted-ca\") pod \"image-registry-86b67cd59c-hgcf6\" (UID: \"9ac0b008-cf1a-404c-b5da-a5d8d29a1de6\") " pod="openshift-image-registry/image-registry-86b67cd59c-hgcf6" Jun 02 21:36:01.281521 ip-10-0-138-193 kubenswrapper[2578]: I0602 21:36:01.281393 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/9ac0b008-cf1a-404c-b5da-a5d8d29a1de6-registry-certificates\") pod \"image-registry-86b67cd59c-hgcf6\" (UID: \"9ac0b008-cf1a-404c-b5da-a5d8d29a1de6\") " pod="openshift-image-registry/image-registry-86b67cd59c-hgcf6" Jun 02 21:36:01.281521 ip-10-0-138-193 kubenswrapper[2578]: I0602 21:36:01.281423 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/9ac0b008-cf1a-404c-b5da-a5d8d29a1de6-registry-tls\") pod \"image-registry-86b67cd59c-hgcf6\" (UID: \"9ac0b008-cf1a-404c-b5da-a5d8d29a1de6\") " pod="openshift-image-registry/image-registry-86b67cd59c-hgcf6" Jun 02 21:36:01.382558 ip-10-0-138-193 kubenswrapper[2578]: I0602 21:36:01.382450 2578 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/9ac0b008-cf1a-404c-b5da-a5d8d29a1de6-installation-pull-secrets\") pod \"image-registry-86b67cd59c-hgcf6\" (UID: \"9ac0b008-cf1a-404c-b5da-a5d8d29a1de6\") " pod="openshift-image-registry/image-registry-86b67cd59c-hgcf6" Jun 02 21:36:01.382558 ip-10-0-138-193 kubenswrapper[2578]: I0602 21:36:01.382499 2578 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-vrggb\" (UniqueName: \"kubernetes.io/projected/9ac0b008-cf1a-404c-b5da-a5d8d29a1de6-kube-api-access-vrggb\") pod \"image-registry-86b67cd59c-hgcf6\" (UID: \"9ac0b008-cf1a-404c-b5da-a5d8d29a1de6\") " pod="openshift-image-registry/image-registry-86b67cd59c-hgcf6" Jun 02 21:36:01.382558 ip-10-0-138-193 kubenswrapper[2578]: I0602 21:36:01.382533 2578 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/9ac0b008-cf1a-404c-b5da-a5d8d29a1de6-bound-sa-token\") pod \"image-registry-86b67cd59c-hgcf6\" (UID: \"9ac0b008-cf1a-404c-b5da-a5d8d29a1de6\") " pod="openshift-image-registry/image-registry-86b67cd59c-hgcf6" Jun 02 21:36:01.382825 ip-10-0-138-193 kubenswrapper[2578]: I0602 21:36:01.382568 2578 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/9ac0b008-cf1a-404c-b5da-a5d8d29a1de6-trusted-ca\") pod \"image-registry-86b67cd59c-hgcf6\" (UID: \"9ac0b008-cf1a-404c-b5da-a5d8d29a1de6\") " pod="openshift-image-registry/image-registry-86b67cd59c-hgcf6" Jun 02 21:36:01.382825 ip-10-0-138-193 kubenswrapper[2578]: I0602 21:36:01.382625 2578 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/9ac0b008-cf1a-404c-b5da-a5d8d29a1de6-registry-certificates\") pod \"image-registry-86b67cd59c-hgcf6\" (UID: \"9ac0b008-cf1a-404c-b5da-a5d8d29a1de6\") " pod="openshift-image-registry/image-registry-86b67cd59c-hgcf6" Jun 02 21:36:01.382825 ip-10-0-138-193 kubenswrapper[2578]: I0602 21:36:01.382653 2578 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/9ac0b008-cf1a-404c-b5da-a5d8d29a1de6-registry-tls\") pod \"image-registry-86b67cd59c-hgcf6\" (UID: \"9ac0b008-cf1a-404c-b5da-a5d8d29a1de6\") " pod="openshift-image-registry/image-registry-86b67cd59c-hgcf6" Jun 02 21:36:01.382825 ip-10-0-138-193 kubenswrapper[2578]: I0602 21:36:01.382737 2578 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/9ac0b008-cf1a-404c-b5da-a5d8d29a1de6-ca-trust-extracted\") pod \"image-registry-86b67cd59c-hgcf6\" (UID: \"9ac0b008-cf1a-404c-b5da-a5d8d29a1de6\") " pod="openshift-image-registry/image-registry-86b67cd59c-hgcf6" Jun 02 21:36:01.382825 ip-10-0-138-193 kubenswrapper[2578]: I0602 21:36:01.382767 2578 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/9ac0b008-cf1a-404c-b5da-a5d8d29a1de6-image-registry-private-configuration\") pod \"image-registry-86b67cd59c-hgcf6\" (UID: \"9ac0b008-cf1a-404c-b5da-a5d8d29a1de6\") " pod="openshift-image-registry/image-registry-86b67cd59c-hgcf6" Jun 02 21:36:01.383099 ip-10-0-138-193 kubenswrapper[2578]: E0602 21:36:01.382944 2578 projected.go:264] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found Jun 02 21:36:01.383099 ip-10-0-138-193 kubenswrapper[2578]: E0602 21:36:01.382963 2578 projected.go:194] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-86b67cd59c-hgcf6: secret "image-registry-tls" not found Jun 02 21:36:01.383099 ip-10-0-138-193 kubenswrapper[2578]: E0602 21:36:01.383015 2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/9ac0b008-cf1a-404c-b5da-a5d8d29a1de6-registry-tls podName:9ac0b008-cf1a-404c-b5da-a5d8d29a1de6 nodeName:}" failed. No retries permitted until 2026-06-02 21:36:01.882996315 +0000 UTC m=+139.134894207 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/9ac0b008-cf1a-404c-b5da-a5d8d29a1de6-registry-tls") pod "image-registry-86b67cd59c-hgcf6" (UID: "9ac0b008-cf1a-404c-b5da-a5d8d29a1de6") : secret "image-registry-tls" not found Jun 02 21:36:01.383479 ip-10-0-138-193 kubenswrapper[2578]: I0602 21:36:01.383452 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/9ac0b008-cf1a-404c-b5da-a5d8d29a1de6-registry-certificates\") pod \"image-registry-86b67cd59c-hgcf6\" (UID: \"9ac0b008-cf1a-404c-b5da-a5d8d29a1de6\") " pod="openshift-image-registry/image-registry-86b67cd59c-hgcf6" Jun 02 21:36:01.383706 ip-10-0-138-193 kubenswrapper[2578]: I0602 21:36:01.383647 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/9ac0b008-cf1a-404c-b5da-a5d8d29a1de6-ca-trust-extracted\") pod \"image-registry-86b67cd59c-hgcf6\" (UID: \"9ac0b008-cf1a-404c-b5da-a5d8d29a1de6\") " pod="openshift-image-registry/image-registry-86b67cd59c-hgcf6" Jun 02 21:36:01.384524 ip-10-0-138-193 kubenswrapper[2578]: I0602 21:36:01.384498 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/9ac0b008-cf1a-404c-b5da-a5d8d29a1de6-trusted-ca\") pod \"image-registry-86b67cd59c-hgcf6\" (UID: \"9ac0b008-cf1a-404c-b5da-a5d8d29a1de6\") " pod="openshift-image-registry/image-registry-86b67cd59c-hgcf6" Jun 02 21:36:01.385558 ip-10-0-138-193 kubenswrapper[2578]: I0602 21:36:01.385511 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/9ac0b008-cf1a-404c-b5da-a5d8d29a1de6-image-registry-private-configuration\") pod \"image-registry-86b67cd59c-hgcf6\" (UID: \"9ac0b008-cf1a-404c-b5da-a5d8d29a1de6\") " pod="openshift-image-registry/image-registry-86b67cd59c-hgcf6" Jun 02 21:36:01.385844 ip-10-0-138-193 kubenswrapper[2578]: I0602 21:36:01.385826 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/9ac0b008-cf1a-404c-b5da-a5d8d29a1de6-installation-pull-secrets\") pod \"image-registry-86b67cd59c-hgcf6\" (UID: \"9ac0b008-cf1a-404c-b5da-a5d8d29a1de6\") " pod="openshift-image-registry/image-registry-86b67cd59c-hgcf6" Jun 02 21:36:01.391247 ip-10-0-138-193 kubenswrapper[2578]: I0602 21:36:01.391205 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-vrggb\" (UniqueName: \"kubernetes.io/projected/9ac0b008-cf1a-404c-b5da-a5d8d29a1de6-kube-api-access-vrggb\") pod \"image-registry-86b67cd59c-hgcf6\" (UID: \"9ac0b008-cf1a-404c-b5da-a5d8d29a1de6\") " pod="openshift-image-registry/image-registry-86b67cd59c-hgcf6" Jun 02 21:36:01.391411 ip-10-0-138-193 kubenswrapper[2578]: I0602 21:36:01.391388 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/9ac0b008-cf1a-404c-b5da-a5d8d29a1de6-bound-sa-token\") pod \"image-registry-86b67cd59c-hgcf6\" (UID: \"9ac0b008-cf1a-404c-b5da-a5d8d29a1de6\") " pod="openshift-image-registry/image-registry-86b67cd59c-hgcf6" Jun 02 21:36:01.484090 ip-10-0-138-193 kubenswrapper[2578]: I0602 21:36:01.484003 2578 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/d1572395-b2de-4278-91a6-a49c5487dc26-samples-operator-tls\") pod \"cluster-samples-operator-755bbf9bfb-kfw7q\" (UID: \"d1572395-b2de-4278-91a6-a49c5487dc26\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-755bbf9bfb-kfw7q" Jun 02 21:36:01.484263 ip-10-0-138-193 kubenswrapper[2578]: E0602 21:36:01.484170 2578 secret.go:189] Couldn't get secret openshift-cluster-samples-operator/samples-operator-tls: secret "samples-operator-tls" not found Jun 02 21:36:01.484263 ip-10-0-138-193 kubenswrapper[2578]: E0602 21:36:01.484235 2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/d1572395-b2de-4278-91a6-a49c5487dc26-samples-operator-tls podName:d1572395-b2de-4278-91a6-a49c5487dc26 nodeName:}" failed. No retries permitted until 2026-06-02 21:36:09.484216137 +0000 UTC m=+146.736114036 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "samples-operator-tls" (UniqueName: "kubernetes.io/secret/d1572395-b2de-4278-91a6-a49c5487dc26-samples-operator-tls") pod "cluster-samples-operator-755bbf9bfb-kfw7q" (UID: "d1572395-b2de-4278-91a6-a49c5487dc26") : secret "samples-operator-tls" not found Jun 02 21:36:01.808913 ip-10-0-138-193 kubenswrapper[2578]: I0602 21:36:01.808878 2578 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-source-56d84b9f44-hdqmf" event={"ID":"90a1018a-87f7-4af4-9be4-c0fc75cac2fc","Type":"ContainerStarted","Data":"21e4d3597afcd260c63f9aebcc1480406c3ca7a62a295de80f61f024c1d41d55"} Jun 02 21:36:01.808913 ip-10-0-138-193 kubenswrapper[2578]: I0602 21:36:01.808918 2578 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-source-56d84b9f44-hdqmf" event={"ID":"90a1018a-87f7-4af4-9be4-c0fc75cac2fc","Type":"ContainerStarted","Data":"a7543b9befa9c84ad8889571d8dfc93584282e7139864d6bb16bb6f842d6ecd1"} Jun 02 21:36:01.823309 ip-10-0-138-193 kubenswrapper[2578]: I0602 21:36:01.823266 2578 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-network-diagnostics/network-check-source-56d84b9f44-hdqmf" podStartSLOduration=1.8232531600000002 podStartE2EDuration="1.82325316s" podCreationTimestamp="2026-06-02 21:36:00 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2026-06-02 21:36:01.82292674 +0000 UTC m=+139.074824646" watchObservedRunningTime="2026-06-02 21:36:01.82325316 +0000 UTC m=+139.075151066" Jun 02 21:36:01.887418 ip-10-0-138-193 kubenswrapper[2578]: I0602 21:36:01.887371 2578 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/9ac0b008-cf1a-404c-b5da-a5d8d29a1de6-registry-tls\") pod \"image-registry-86b67cd59c-hgcf6\" (UID: \"9ac0b008-cf1a-404c-b5da-a5d8d29a1de6\") " pod="openshift-image-registry/image-registry-86b67cd59c-hgcf6" Jun 02 21:36:01.887571 ip-10-0-138-193 kubenswrapper[2578]: E0602 21:36:01.887494 2578 projected.go:264] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found Jun 02 21:36:01.887571 ip-10-0-138-193 kubenswrapper[2578]: E0602 21:36:01.887507 2578 projected.go:194] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-86b67cd59c-hgcf6: secret "image-registry-tls" not found Jun 02 21:36:01.887571 ip-10-0-138-193 kubenswrapper[2578]: E0602 21:36:01.887558 2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/9ac0b008-cf1a-404c-b5da-a5d8d29a1de6-registry-tls podName:9ac0b008-cf1a-404c-b5da-a5d8d29a1de6 nodeName:}" failed. No retries permitted until 2026-06-02 21:36:02.887540887 +0000 UTC m=+140.139438772 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/9ac0b008-cf1a-404c-b5da-a5d8d29a1de6-registry-tls") pod "image-registry-86b67cd59c-hgcf6" (UID: "9ac0b008-cf1a-404c-b5da-a5d8d29a1de6") : secret "image-registry-tls" not found Jun 02 21:36:02.896133 ip-10-0-138-193 kubenswrapper[2578]: I0602 21:36:02.896087 2578 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/9ac0b008-cf1a-404c-b5da-a5d8d29a1de6-registry-tls\") pod \"image-registry-86b67cd59c-hgcf6\" (UID: \"9ac0b008-cf1a-404c-b5da-a5d8d29a1de6\") " pod="openshift-image-registry/image-registry-86b67cd59c-hgcf6" Jun 02 21:36:02.896552 ip-10-0-138-193 kubenswrapper[2578]: E0602 21:36:02.896200 2578 projected.go:264] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found Jun 02 21:36:02.896552 ip-10-0-138-193 kubenswrapper[2578]: E0602 21:36:02.896225 2578 projected.go:194] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-86b67cd59c-hgcf6: secret "image-registry-tls" not found Jun 02 21:36:02.896552 ip-10-0-138-193 kubenswrapper[2578]: E0602 21:36:02.896292 2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/9ac0b008-cf1a-404c-b5da-a5d8d29a1de6-registry-tls podName:9ac0b008-cf1a-404c-b5da-a5d8d29a1de6 nodeName:}" failed. No retries permitted until 2026-06-02 21:36:04.89627565 +0000 UTC m=+142.148173540 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/9ac0b008-cf1a-404c-b5da-a5d8d29a1de6-registry-tls") pod "image-registry-86b67cd59c-hgcf6" (UID: "9ac0b008-cf1a-404c-b5da-a5d8d29a1de6") : secret "image-registry-tls" not found Jun 02 21:36:03.815671 ip-10-0-138-193 kubenswrapper[2578]: I0602 21:36:03.815626 2578 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-96ddc787c-jlmt8" event={"ID":"ab209a6c-c2ef-450d-b14d-4f8438dfebfa","Type":"ContainerStarted","Data":"92e9500586ee56775840ef64e8b3b831284aa97e551f073c3746350f7128aa53"} Jun 02 21:36:03.817027 ip-10-0-138-193 kubenswrapper[2578]: I0602 21:36:03.816992 2578 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-service-ca-operator/service-ca-operator-69877444c-tnjl6" event={"ID":"3787e4f5-1948-41f9-8b70-28eac6aa5b99","Type":"ContainerStarted","Data":"d1fff42a1d881b1a6091c6f9c1294de7314281d46fbad2320b438b5c12422e75"} Jun 02 21:36:03.833274 ip-10-0-138-193 kubenswrapper[2578]: I0602 21:36:03.833209 2578 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-96ddc787c-jlmt8" podStartSLOduration=1.745366353 podStartE2EDuration="4.833189792s" podCreationTimestamp="2026-06-02 21:35:59 +0000 UTC" firstStartedPulling="2026-06-02 21:36:00.175220224 +0000 UTC m=+137.427118112" lastFinishedPulling="2026-06-02 21:36:03.263043666 +0000 UTC m=+140.514941551" observedRunningTime="2026-06-02 21:36:03.832319148 +0000 UTC m=+141.084217056" watchObservedRunningTime="2026-06-02 21:36:03.833189792 +0000 UTC m=+141.085087699" Jun 02 21:36:03.846777 ip-10-0-138-193 kubenswrapper[2578]: I0602 21:36:03.846726 2578 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-service-ca-operator/service-ca-operator-69877444c-tnjl6" podStartSLOduration=1.860624284 podStartE2EDuration="4.846709121s" podCreationTimestamp="2026-06-02 21:35:59 +0000 UTC" firstStartedPulling="2026-06-02 21:36:00.280217182 +0000 UTC m=+137.532115067" lastFinishedPulling="2026-06-02 21:36:03.266302015 +0000 UTC m=+140.518199904" observedRunningTime="2026-06-02 21:36:03.845720105 +0000 UTC m=+141.097618216" watchObservedRunningTime="2026-06-02 21:36:03.846709121 +0000 UTC m=+141.098607041" Jun 02 21:36:04.912831 ip-10-0-138-193 kubenswrapper[2578]: I0602 21:36:04.912790 2578 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/9ac0b008-cf1a-404c-b5da-a5d8d29a1de6-registry-tls\") pod \"image-registry-86b67cd59c-hgcf6\" (UID: \"9ac0b008-cf1a-404c-b5da-a5d8d29a1de6\") " pod="openshift-image-registry/image-registry-86b67cd59c-hgcf6" Jun 02 21:36:04.913363 ip-10-0-138-193 kubenswrapper[2578]: E0602 21:36:04.913271 2578 projected.go:264] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found Jun 02 21:36:04.913363 ip-10-0-138-193 kubenswrapper[2578]: E0602 21:36:04.913287 2578 projected.go:194] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-86b67cd59c-hgcf6: secret "image-registry-tls" not found Jun 02 21:36:04.913363 ip-10-0-138-193 kubenswrapper[2578]: E0602 21:36:04.913338 2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/9ac0b008-cf1a-404c-b5da-a5d8d29a1de6-registry-tls podName:9ac0b008-cf1a-404c-b5da-a5d8d29a1de6 nodeName:}" failed. No retries permitted until 2026-06-02 21:36:08.913320308 +0000 UTC m=+146.165218197 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/9ac0b008-cf1a-404c-b5da-a5d8d29a1de6-registry-tls") pod "image-registry-86b67cd59c-hgcf6" (UID: "9ac0b008-cf1a-404c-b5da-a5d8d29a1de6") : secret "image-registry-tls" not found Jun 02 21:36:07.136204 ip-10-0-138-193 kubenswrapper[2578]: I0602 21:36:07.136168 2578 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-insights/insights-runtime-extractor-rphbc"] Jun 02 21:36:07.140503 ip-10-0-138-193 kubenswrapper[2578]: I0602 21:36:07.140482 2578 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-runtime-extractor-rphbc" Jun 02 21:36:07.142679 ip-10-0-138-193 kubenswrapper[2578]: I0602 21:36:07.142659 2578 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"kube-rbac-proxy\"" Jun 02 21:36:07.142812 ip-10-0-138-193 kubenswrapper[2578]: I0602 21:36:07.142690 2578 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-tls\"" Jun 02 21:36:07.142812 ip-10-0-138-193 kubenswrapper[2578]: I0602 21:36:07.142751 2578 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-sa-dockercfg-stqmt\"" Jun 02 21:36:07.151161 ip-10-0-138-193 kubenswrapper[2578]: I0602 21:36:07.151142 2578 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-runtime-extractor-rphbc"] Jun 02 21:36:07.232441 ip-10-0-138-193 kubenswrapper[2578]: I0602 21:36:07.232403 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/7e6ef832-0fa4-4e85-ade0-fa3ab9f3c7f6-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-rphbc\" (UID: \"7e6ef832-0fa4-4e85-ade0-fa3ab9f3c7f6\") " pod="openshift-insights/insights-runtime-extractor-rphbc" Jun 02 21:36:07.232623 ip-10-0-138-193 kubenswrapper[2578]: I0602 21:36:07.232471 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-76x2g\" (UniqueName: \"kubernetes.io/projected/7e6ef832-0fa4-4e85-ade0-fa3ab9f3c7f6-kube-api-access-76x2g\") pod \"insights-runtime-extractor-rphbc\" (UID: \"7e6ef832-0fa4-4e85-ade0-fa3ab9f3c7f6\") " pod="openshift-insights/insights-runtime-extractor-rphbc" Jun 02 21:36:07.232623 ip-10-0-138-193 kubenswrapper[2578]: I0602 21:36:07.232527 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/7e6ef832-0fa4-4e85-ade0-fa3ab9f3c7f6-crio-socket\") pod \"insights-runtime-extractor-rphbc\" (UID: \"7e6ef832-0fa4-4e85-ade0-fa3ab9f3c7f6\") " pod="openshift-insights/insights-runtime-extractor-rphbc" Jun 02 21:36:07.232623 ip-10-0-138-193 kubenswrapper[2578]: I0602 21:36:07.232589 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/7e6ef832-0fa4-4e85-ade0-fa3ab9f3c7f6-data-volume\") pod \"insights-runtime-extractor-rphbc\" (UID: \"7e6ef832-0fa4-4e85-ade0-fa3ab9f3c7f6\") " pod="openshift-insights/insights-runtime-extractor-rphbc" Jun 02 21:36:07.232749 ip-10-0-138-193 kubenswrapper[2578]: I0602 21:36:07.232640 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/7e6ef832-0fa4-4e85-ade0-fa3ab9f3c7f6-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-rphbc\" (UID: \"7e6ef832-0fa4-4e85-ade0-fa3ab9f3c7f6\") " pod="openshift-insights/insights-runtime-extractor-rphbc" Jun 02 21:36:07.253655 ip-10-0-138-193 kubenswrapper[2578]: I0602 21:36:07.253621 2578 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-service-ca/service-ca-685df94d57-wpr68"] Jun 02 21:36:07.256627 ip-10-0-138-193 kubenswrapper[2578]: I0602 21:36:07.256612 2578 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-service-ca/service-ca-685df94d57-wpr68" Jun 02 21:36:07.259314 ip-10-0-138-193 kubenswrapper[2578]: I0602 21:36:07.259288 2578 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-service-ca\"/\"openshift-service-ca.crt\"" Jun 02 21:36:07.259314 ip-10-0-138-193 kubenswrapper[2578]: I0602 21:36:07.259296 2578 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-service-ca\"/\"kube-root-ca.crt\"" Jun 02 21:36:07.259500 ip-10-0-138-193 kubenswrapper[2578]: I0602 21:36:07.259330 2578 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-service-ca\"/\"signing-key\"" Jun 02 21:36:07.259500 ip-10-0-138-193 kubenswrapper[2578]: I0602 21:36:07.259340 2578 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-service-ca\"/\"signing-cabundle\"" Jun 02 21:36:07.259621 ip-10-0-138-193 kubenswrapper[2578]: I0602 21:36:07.259607 2578 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-service-ca\"/\"service-ca-dockercfg-47ht5\"" Jun 02 21:36:07.265870 ip-10-0-138-193 kubenswrapper[2578]: I0602 21:36:07.265846 2578 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-service-ca/service-ca-685df94d57-wpr68"] Jun 02 21:36:07.333346 ip-10-0-138-193 kubenswrapper[2578]: I0602 21:36:07.333317 2578 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/7e6ef832-0fa4-4e85-ade0-fa3ab9f3c7f6-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-rphbc\" (UID: \"7e6ef832-0fa4-4e85-ade0-fa3ab9f3c7f6\") " pod="openshift-insights/insights-runtime-extractor-rphbc" Jun 02 21:36:07.333346 ip-10-0-138-193 kubenswrapper[2578]: I0602 21:36:07.333349 2578 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-76x2g\" (UniqueName: \"kubernetes.io/projected/7e6ef832-0fa4-4e85-ade0-fa3ab9f3c7f6-kube-api-access-76x2g\") pod \"insights-runtime-extractor-rphbc\" (UID: \"7e6ef832-0fa4-4e85-ade0-fa3ab9f3c7f6\") " pod="openshift-insights/insights-runtime-extractor-rphbc" Jun 02 21:36:07.333591 ip-10-0-138-193 kubenswrapper[2578]: I0602 21:36:07.333379 2578 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/7e6ef832-0fa4-4e85-ade0-fa3ab9f3c7f6-crio-socket\") pod \"insights-runtime-extractor-rphbc\" (UID: \"7e6ef832-0fa4-4e85-ade0-fa3ab9f3c7f6\") " pod="openshift-insights/insights-runtime-extractor-rphbc" Jun 02 21:36:07.333591 ip-10-0-138-193 kubenswrapper[2578]: I0602 21:36:07.333402 2578 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/7e6ef832-0fa4-4e85-ade0-fa3ab9f3c7f6-data-volume\") pod \"insights-runtime-extractor-rphbc\" (UID: \"7e6ef832-0fa4-4e85-ade0-fa3ab9f3c7f6\") " pod="openshift-insights/insights-runtime-extractor-rphbc" Jun 02 21:36:07.333591 ip-10-0-138-193 kubenswrapper[2578]: I0602 21:36:07.333442 2578 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/7e6ef832-0fa4-4e85-ade0-fa3ab9f3c7f6-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-rphbc\" (UID: \"7e6ef832-0fa4-4e85-ade0-fa3ab9f3c7f6\") " pod="openshift-insights/insights-runtime-extractor-rphbc" Jun 02 21:36:07.333591 ip-10-0-138-193 kubenswrapper[2578]: E0602 21:36:07.333471 2578 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found Jun 02 21:36:07.333591 ip-10-0-138-193 kubenswrapper[2578]: I0602 21:36:07.333489 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/7e6ef832-0fa4-4e85-ade0-fa3ab9f3c7f6-crio-socket\") pod \"insights-runtime-extractor-rphbc\" (UID: \"7e6ef832-0fa4-4e85-ade0-fa3ab9f3c7f6\") " pod="openshift-insights/insights-runtime-extractor-rphbc" Jun 02 21:36:07.333591 ip-10-0-138-193 kubenswrapper[2578]: E0602 21:36:07.333547 2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/7e6ef832-0fa4-4e85-ade0-fa3ab9f3c7f6-insights-runtime-extractor-tls podName:7e6ef832-0fa4-4e85-ade0-fa3ab9f3c7f6 nodeName:}" failed. No retries permitted until 2026-06-02 21:36:07.833527174 +0000 UTC m=+145.085425072 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/7e6ef832-0fa4-4e85-ade0-fa3ab9f3c7f6-insights-runtime-extractor-tls") pod "insights-runtime-extractor-rphbc" (UID: "7e6ef832-0fa4-4e85-ade0-fa3ab9f3c7f6") : secret "insights-runtime-extractor-tls" not found Jun 02 21:36:07.333825 ip-10-0-138-193 kubenswrapper[2578]: I0602 21:36:07.333794 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/7e6ef832-0fa4-4e85-ade0-fa3ab9f3c7f6-data-volume\") pod \"insights-runtime-extractor-rphbc\" (UID: \"7e6ef832-0fa4-4e85-ade0-fa3ab9f3c7f6\") " pod="openshift-insights/insights-runtime-extractor-rphbc" Jun 02 21:36:07.333981 ip-10-0-138-193 kubenswrapper[2578]: I0602 21:36:07.333964 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/7e6ef832-0fa4-4e85-ade0-fa3ab9f3c7f6-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-rphbc\" (UID: \"7e6ef832-0fa4-4e85-ade0-fa3ab9f3c7f6\") " pod="openshift-insights/insights-runtime-extractor-rphbc" Jun 02 21:36:07.342101 ip-10-0-138-193 kubenswrapper[2578]: I0602 21:36:07.342056 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-76x2g\" (UniqueName: \"kubernetes.io/projected/7e6ef832-0fa4-4e85-ade0-fa3ab9f3c7f6-kube-api-access-76x2g\") pod \"insights-runtime-extractor-rphbc\" (UID: \"7e6ef832-0fa4-4e85-ade0-fa3ab9f3c7f6\") " pod="openshift-insights/insights-runtime-extractor-rphbc" Jun 02 21:36:07.434558 ip-10-0-138-193 kubenswrapper[2578]: I0602 21:36:07.434523 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"signing-cabundle\" (UniqueName: \"kubernetes.io/configmap/cd7b2289-1985-4041-a233-041987aa8dec-signing-cabundle\") pod \"service-ca-685df94d57-wpr68\" (UID: \"cd7b2289-1985-4041-a233-041987aa8dec\") " pod="openshift-service-ca/service-ca-685df94d57-wpr68" Jun 02 21:36:07.434729 ip-10-0-138-193 kubenswrapper[2578]: I0602 21:36:07.434585 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"signing-key\" (UniqueName: \"kubernetes.io/secret/cd7b2289-1985-4041-a233-041987aa8dec-signing-key\") pod \"service-ca-685df94d57-wpr68\" (UID: \"cd7b2289-1985-4041-a233-041987aa8dec\") " pod="openshift-service-ca/service-ca-685df94d57-wpr68" Jun 02 21:36:07.434729 ip-10-0-138-193 kubenswrapper[2578]: I0602 21:36:07.434688 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-gmrjb\" (UniqueName: \"kubernetes.io/projected/cd7b2289-1985-4041-a233-041987aa8dec-kube-api-access-gmrjb\") pod \"service-ca-685df94d57-wpr68\" (UID: \"cd7b2289-1985-4041-a233-041987aa8dec\") " pod="openshift-service-ca/service-ca-685df94d57-wpr68" Jun 02 21:36:07.535928 ip-10-0-138-193 kubenswrapper[2578]: I0602 21:36:07.535887 2578 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"signing-key\" (UniqueName: \"kubernetes.io/secret/cd7b2289-1985-4041-a233-041987aa8dec-signing-key\") pod \"service-ca-685df94d57-wpr68\" (UID: \"cd7b2289-1985-4041-a233-041987aa8dec\") " pod="openshift-service-ca/service-ca-685df94d57-wpr68" Jun 02 21:36:07.536128 ip-10-0-138-193 kubenswrapper[2578]: I0602 21:36:07.535955 2578 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-gmrjb\" (UniqueName: \"kubernetes.io/projected/cd7b2289-1985-4041-a233-041987aa8dec-kube-api-access-gmrjb\") pod \"service-ca-685df94d57-wpr68\" (UID: \"cd7b2289-1985-4041-a233-041987aa8dec\") " pod="openshift-service-ca/service-ca-685df94d57-wpr68" Jun 02 21:36:07.536128 ip-10-0-138-193 kubenswrapper[2578]: I0602 21:36:07.536012 2578 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"signing-cabundle\" (UniqueName: \"kubernetes.io/configmap/cd7b2289-1985-4041-a233-041987aa8dec-signing-cabundle\") pod \"service-ca-685df94d57-wpr68\" (UID: \"cd7b2289-1985-4041-a233-041987aa8dec\") " pod="openshift-service-ca/service-ca-685df94d57-wpr68" Jun 02 21:36:07.536653 ip-10-0-138-193 kubenswrapper[2578]: I0602 21:36:07.536620 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"signing-cabundle\" (UniqueName: \"kubernetes.io/configmap/cd7b2289-1985-4041-a233-041987aa8dec-signing-cabundle\") pod \"service-ca-685df94d57-wpr68\" (UID: \"cd7b2289-1985-4041-a233-041987aa8dec\") " pod="openshift-service-ca/service-ca-685df94d57-wpr68" Jun 02 21:36:07.538354 ip-10-0-138-193 kubenswrapper[2578]: I0602 21:36:07.538337 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"signing-key\" (UniqueName: \"kubernetes.io/secret/cd7b2289-1985-4041-a233-041987aa8dec-signing-key\") pod \"service-ca-685df94d57-wpr68\" (UID: \"cd7b2289-1985-4041-a233-041987aa8dec\") " pod="openshift-service-ca/service-ca-685df94d57-wpr68" Jun 02 21:36:07.544713 ip-10-0-138-193 kubenswrapper[2578]: I0602 21:36:07.544690 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-gmrjb\" (UniqueName: \"kubernetes.io/projected/cd7b2289-1985-4041-a233-041987aa8dec-kube-api-access-gmrjb\") pod \"service-ca-685df94d57-wpr68\" (UID: \"cd7b2289-1985-4041-a233-041987aa8dec\") " pod="openshift-service-ca/service-ca-685df94d57-wpr68" Jun 02 21:36:07.565702 ip-10-0-138-193 kubenswrapper[2578]: I0602 21:36:07.565670 2578 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-service-ca/service-ca-685df94d57-wpr68" Jun 02 21:36:07.691632 ip-10-0-138-193 kubenswrapper[2578]: I0602 21:36:07.691558 2578 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-service-ca/service-ca-685df94d57-wpr68"] Jun 02 21:36:07.694370 ip-10-0-138-193 kubenswrapper[2578]: W0602 21:36:07.694343 2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podcd7b2289_1985_4041_a233_041987aa8dec.slice/crio-3b8b334ca25d34c2d1ca37a1d3ccfd55c6908ccef4e0cb815cfa82e8b408fe2e WatchSource:0}: Error finding container 3b8b334ca25d34c2d1ca37a1d3ccfd55c6908ccef4e0cb815cfa82e8b408fe2e: Status 404 returned error can't find the container with id 3b8b334ca25d34c2d1ca37a1d3ccfd55c6908ccef4e0cb815cfa82e8b408fe2e Jun 02 21:36:07.829531 ip-10-0-138-193 kubenswrapper[2578]: I0602 21:36:07.829496 2578 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-service-ca/service-ca-685df94d57-wpr68" event={"ID":"cd7b2289-1985-4041-a233-041987aa8dec","Type":"ContainerStarted","Data":"b9c6a55d83045700f6329c38bb9c828e2e615826bb22b107b62f13faabad39da"} Jun 02 21:36:07.829531 ip-10-0-138-193 kubenswrapper[2578]: I0602 21:36:07.829536 2578 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-service-ca/service-ca-685df94d57-wpr68" event={"ID":"cd7b2289-1985-4041-a233-041987aa8dec","Type":"ContainerStarted","Data":"3b8b334ca25d34c2d1ca37a1d3ccfd55c6908ccef4e0cb815cfa82e8b408fe2e"} Jun 02 21:36:07.838537 ip-10-0-138-193 kubenswrapper[2578]: I0602 21:36:07.838509 2578 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/7e6ef832-0fa4-4e85-ade0-fa3ab9f3c7f6-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-rphbc\" (UID: \"7e6ef832-0fa4-4e85-ade0-fa3ab9f3c7f6\") " pod="openshift-insights/insights-runtime-extractor-rphbc" Jun 02 21:36:07.838653 ip-10-0-138-193 kubenswrapper[2578]: E0602 21:36:07.838639 2578 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found Jun 02 21:36:07.838714 ip-10-0-138-193 kubenswrapper[2578]: E0602 21:36:07.838703 2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/7e6ef832-0fa4-4e85-ade0-fa3ab9f3c7f6-insights-runtime-extractor-tls podName:7e6ef832-0fa4-4e85-ade0-fa3ab9f3c7f6 nodeName:}" failed. No retries permitted until 2026-06-02 21:36:08.838686124 +0000 UTC m=+146.090584013 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/7e6ef832-0fa4-4e85-ade0-fa3ab9f3c7f6-insights-runtime-extractor-tls") pod "insights-runtime-extractor-rphbc" (UID: "7e6ef832-0fa4-4e85-ade0-fa3ab9f3c7f6") : secret "insights-runtime-extractor-tls" not found Jun 02 21:36:07.847514 ip-10-0-138-193 kubenswrapper[2578]: I0602 21:36:07.847471 2578 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-service-ca/service-ca-685df94d57-wpr68" podStartSLOduration=0.847459952 podStartE2EDuration="847.459952ms" podCreationTimestamp="2026-06-02 21:36:07 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2026-06-02 21:36:07.846255054 +0000 UTC m=+145.098152972" watchObservedRunningTime="2026-06-02 21:36:07.847459952 +0000 UTC m=+145.099357858" Jun 02 21:36:08.846003 ip-10-0-138-193 kubenswrapper[2578]: I0602 21:36:08.845952 2578 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/7e6ef832-0fa4-4e85-ade0-fa3ab9f3c7f6-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-rphbc\" (UID: \"7e6ef832-0fa4-4e85-ade0-fa3ab9f3c7f6\") " pod="openshift-insights/insights-runtime-extractor-rphbc" Jun 02 21:36:08.846519 ip-10-0-138-193 kubenswrapper[2578]: E0602 21:36:08.846127 2578 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found Jun 02 21:36:08.846519 ip-10-0-138-193 kubenswrapper[2578]: E0602 21:36:08.846196 2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/7e6ef832-0fa4-4e85-ade0-fa3ab9f3c7f6-insights-runtime-extractor-tls podName:7e6ef832-0fa4-4e85-ade0-fa3ab9f3c7f6 nodeName:}" failed. No retries permitted until 2026-06-02 21:36:10.846174694 +0000 UTC m=+148.098072583 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/7e6ef832-0fa4-4e85-ade0-fa3ab9f3c7f6-insights-runtime-extractor-tls") pod "insights-runtime-extractor-rphbc" (UID: "7e6ef832-0fa4-4e85-ade0-fa3ab9f3c7f6") : secret "insights-runtime-extractor-tls" not found Jun 02 21:36:08.946943 ip-10-0-138-193 kubenswrapper[2578]: I0602 21:36:08.946896 2578 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/9ac0b008-cf1a-404c-b5da-a5d8d29a1de6-registry-tls\") pod \"image-registry-86b67cd59c-hgcf6\" (UID: \"9ac0b008-cf1a-404c-b5da-a5d8d29a1de6\") " pod="openshift-image-registry/image-registry-86b67cd59c-hgcf6" Jun 02 21:36:08.947285 ip-10-0-138-193 kubenswrapper[2578]: E0602 21:36:08.947035 2578 projected.go:264] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found Jun 02 21:36:08.947445 ip-10-0-138-193 kubenswrapper[2578]: E0602 21:36:08.947433 2578 projected.go:194] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-86b67cd59c-hgcf6: secret "image-registry-tls" not found Jun 02 21:36:08.947591 ip-10-0-138-193 kubenswrapper[2578]: E0602 21:36:08.947575 2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/9ac0b008-cf1a-404c-b5da-a5d8d29a1de6-registry-tls podName:9ac0b008-cf1a-404c-b5da-a5d8d29a1de6 nodeName:}" failed. No retries permitted until 2026-06-02 21:36:16.947553119 +0000 UTC m=+154.199451016 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/9ac0b008-cf1a-404c-b5da-a5d8d29a1de6-registry-tls") pod "image-registry-86b67cd59c-hgcf6" (UID: "9ac0b008-cf1a-404c-b5da-a5d8d29a1de6") : secret "image-registry-tls" not found Jun 02 21:36:09.551825 ip-10-0-138-193 kubenswrapper[2578]: I0602 21:36:09.551761 2578 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/d1572395-b2de-4278-91a6-a49c5487dc26-samples-operator-tls\") pod \"cluster-samples-operator-755bbf9bfb-kfw7q\" (UID: \"d1572395-b2de-4278-91a6-a49c5487dc26\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-755bbf9bfb-kfw7q" Jun 02 21:36:09.554303 ip-10-0-138-193 kubenswrapper[2578]: I0602 21:36:09.554281 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/d1572395-b2de-4278-91a6-a49c5487dc26-samples-operator-tls\") pod \"cluster-samples-operator-755bbf9bfb-kfw7q\" (UID: \"d1572395-b2de-4278-91a6-a49c5487dc26\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-755bbf9bfb-kfw7q" Jun 02 21:36:09.647521 ip-10-0-138-193 kubenswrapper[2578]: I0602 21:36:09.647474 2578 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-samples-operator/cluster-samples-operator-755bbf9bfb-kfw7q" Jun 02 21:36:09.773953 ip-10-0-138-193 kubenswrapper[2578]: I0602 21:36:09.773922 2578 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-cluster-samples-operator/cluster-samples-operator-755bbf9bfb-kfw7q"] Jun 02 21:36:09.835309 ip-10-0-138-193 kubenswrapper[2578]: I0602 21:36:09.835270 2578 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-samples-operator/cluster-samples-operator-755bbf9bfb-kfw7q" event={"ID":"d1572395-b2de-4278-91a6-a49c5487dc26","Type":"ContainerStarted","Data":"ecebc5906ab82e49e07dc4153373b0c99adaeefcc9427c2c5b3e07a331c17909"} Jun 02 21:36:10.861790 ip-10-0-138-193 kubenswrapper[2578]: I0602 21:36:10.861655 2578 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/7e6ef832-0fa4-4e85-ade0-fa3ab9f3c7f6-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-rphbc\" (UID: \"7e6ef832-0fa4-4e85-ade0-fa3ab9f3c7f6\") " pod="openshift-insights/insights-runtime-extractor-rphbc" Jun 02 21:36:10.861790 ip-10-0-138-193 kubenswrapper[2578]: E0602 21:36:10.861774 2578 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found Jun 02 21:36:10.862351 ip-10-0-138-193 kubenswrapper[2578]: E0602 21:36:10.861861 2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/7e6ef832-0fa4-4e85-ade0-fa3ab9f3c7f6-insights-runtime-extractor-tls podName:7e6ef832-0fa4-4e85-ade0-fa3ab9f3c7f6 nodeName:}" failed. No retries permitted until 2026-06-02 21:36:14.861838045 +0000 UTC m=+152.113735936 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/7e6ef832-0fa4-4e85-ade0-fa3ab9f3c7f6-insights-runtime-extractor-tls") pod "insights-runtime-extractor-rphbc" (UID: "7e6ef832-0fa4-4e85-ade0-fa3ab9f3c7f6") : secret "insights-runtime-extractor-tls" not found Jun 02 21:36:12.847816 ip-10-0-138-193 kubenswrapper[2578]: I0602 21:36:12.847774 2578 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-samples-operator/cluster-samples-operator-755bbf9bfb-kfw7q" event={"ID":"d1572395-b2de-4278-91a6-a49c5487dc26","Type":"ContainerStarted","Data":"83edb89d56286f8a640883975eced7b6d32a2625a266c3c69f2f940cfd0dda1d"} Jun 02 21:36:12.847816 ip-10-0-138-193 kubenswrapper[2578]: I0602 21:36:12.847815 2578 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-samples-operator/cluster-samples-operator-755bbf9bfb-kfw7q" event={"ID":"d1572395-b2de-4278-91a6-a49c5487dc26","Type":"ContainerStarted","Data":"2e1070db825b86debc7dd6fad4fb09122a03b607132a35d91fc7a014236026ae"} Jun 02 21:36:12.864745 ip-10-0-138-193 kubenswrapper[2578]: I0602 21:36:12.864683 2578 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-cluster-samples-operator/cluster-samples-operator-755bbf9bfb-kfw7q" podStartSLOduration=17.871635368 podStartE2EDuration="19.864668415s" podCreationTimestamp="2026-06-02 21:35:53 +0000 UTC" firstStartedPulling="2026-06-02 21:36:09.813148407 +0000 UTC m=+147.065046291" lastFinishedPulling="2026-06-02 21:36:11.806181451 +0000 UTC m=+149.058079338" observedRunningTime="2026-06-02 21:36:12.863774076 +0000 UTC m=+150.115671981" watchObservedRunningTime="2026-06-02 21:36:12.864668415 +0000 UTC m=+150.116566336" Jun 02 21:36:14.896046 ip-10-0-138-193 kubenswrapper[2578]: I0602 21:36:14.896009 2578 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/7e6ef832-0fa4-4e85-ade0-fa3ab9f3c7f6-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-rphbc\" (UID: \"7e6ef832-0fa4-4e85-ade0-fa3ab9f3c7f6\") " pod="openshift-insights/insights-runtime-extractor-rphbc" Jun 02 21:36:14.898294 ip-10-0-138-193 kubenswrapper[2578]: I0602 21:36:14.898274 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/7e6ef832-0fa4-4e85-ade0-fa3ab9f3c7f6-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-rphbc\" (UID: \"7e6ef832-0fa4-4e85-ade0-fa3ab9f3c7f6\") " pod="openshift-insights/insights-runtime-extractor-rphbc" Jun 02 21:36:14.949454 ip-10-0-138-193 kubenswrapper[2578]: I0602 21:36:14.949421 2578 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-runtime-extractor-rphbc" Jun 02 21:36:15.097903 ip-10-0-138-193 kubenswrapper[2578]: I0602 21:36:15.097855 2578 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-runtime-extractor-rphbc"] Jun 02 21:36:15.101209 ip-10-0-138-193 kubenswrapper[2578]: W0602 21:36:15.101179 2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod7e6ef832_0fa4_4e85_ade0_fa3ab9f3c7f6.slice/crio-d2c249b588d9e2452ffda62c34451cfe3497608a0c883d0ab5fdd98e1fb0b606 WatchSource:0}: Error finding container d2c249b588d9e2452ffda62c34451cfe3497608a0c883d0ab5fdd98e1fb0b606: Status 404 returned error can't find the container with id d2c249b588d9e2452ffda62c34451cfe3497608a0c883d0ab5fdd98e1fb0b606 Jun 02 21:36:15.857320 ip-10-0-138-193 kubenswrapper[2578]: I0602 21:36:15.857278 2578 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-rphbc" event={"ID":"7e6ef832-0fa4-4e85-ade0-fa3ab9f3c7f6","Type":"ContainerStarted","Data":"c21e5c1610c5734ab3dbd0a9aad51b3c798f4172247257d0a7cb1b37945826ad"} Jun 02 21:36:15.857320 ip-10-0-138-193 kubenswrapper[2578]: I0602 21:36:15.857321 2578 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-rphbc" event={"ID":"7e6ef832-0fa4-4e85-ade0-fa3ab9f3c7f6","Type":"ContainerStarted","Data":"d2c249b588d9e2452ffda62c34451cfe3497608a0c883d0ab5fdd98e1fb0b606"} Jun 02 21:36:16.861734 ip-10-0-138-193 kubenswrapper[2578]: I0602 21:36:16.861682 2578 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-rphbc" event={"ID":"7e6ef832-0fa4-4e85-ade0-fa3ab9f3c7f6","Type":"ContainerStarted","Data":"8deb4e812fcafe40b7e6b3246ce28aea21fb0aec760daefe46c8ba799c9c4fee"} Jun 02 21:36:17.014487 ip-10-0-138-193 kubenswrapper[2578]: I0602 21:36:17.014444 2578 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/9ac0b008-cf1a-404c-b5da-a5d8d29a1de6-registry-tls\") pod \"image-registry-86b67cd59c-hgcf6\" (UID: \"9ac0b008-cf1a-404c-b5da-a5d8d29a1de6\") " pod="openshift-image-registry/image-registry-86b67cd59c-hgcf6" Jun 02 21:36:17.017286 ip-10-0-138-193 kubenswrapper[2578]: I0602 21:36:17.017229 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/9ac0b008-cf1a-404c-b5da-a5d8d29a1de6-registry-tls\") pod \"image-registry-86b67cd59c-hgcf6\" (UID: \"9ac0b008-cf1a-404c-b5da-a5d8d29a1de6\") " pod="openshift-image-registry/image-registry-86b67cd59c-hgcf6" Jun 02 21:36:17.059735 ip-10-0-138-193 kubenswrapper[2578]: I0602 21:36:17.059694 2578 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-86b67cd59c-hgcf6" Jun 02 21:36:17.512740 ip-10-0-138-193 kubenswrapper[2578]: I0602 21:36:17.512707 2578 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-image-registry/image-registry-86b67cd59c-hgcf6"] Jun 02 21:36:17.516369 ip-10-0-138-193 kubenswrapper[2578]: W0602 21:36:17.516339 2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod9ac0b008_cf1a_404c_b5da_a5d8d29a1de6.slice/crio-89b870a2d0b612091d23eb9f54f9f7e91ece89324b75eb5520a05bc9c56b540b WatchSource:0}: Error finding container 89b870a2d0b612091d23eb9f54f9f7e91ece89324b75eb5520a05bc9c56b540b: Status 404 returned error can't find the container with id 89b870a2d0b612091d23eb9f54f9f7e91ece89324b75eb5520a05bc9c56b540b Jun 02 21:36:17.866849 ip-10-0-138-193 kubenswrapper[2578]: I0602 21:36:17.866760 2578 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-rphbc" event={"ID":"7e6ef832-0fa4-4e85-ade0-fa3ab9f3c7f6","Type":"ContainerStarted","Data":"8dd1b91bf7456f145d7924cf77e366f1e54e3e43cc0c0bd8826539e68e576052"} Jun 02 21:36:17.868273 ip-10-0-138-193 kubenswrapper[2578]: I0602 21:36:17.868239 2578 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-86b67cd59c-hgcf6" event={"ID":"9ac0b008-cf1a-404c-b5da-a5d8d29a1de6","Type":"ContainerStarted","Data":"c492475167dc12396d5dbb13e8a7c8ae82e3c2f443c30d4b1158aba1ac43cb8c"} Jun 02 21:36:17.868273 ip-10-0-138-193 kubenswrapper[2578]: I0602 21:36:17.868272 2578 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-86b67cd59c-hgcf6" event={"ID":"9ac0b008-cf1a-404c-b5da-a5d8d29a1de6","Type":"ContainerStarted","Data":"89b870a2d0b612091d23eb9f54f9f7e91ece89324b75eb5520a05bc9c56b540b"} Jun 02 21:36:17.868443 ip-10-0-138-193 kubenswrapper[2578]: I0602 21:36:17.868371 2578 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-image-registry/image-registry-86b67cd59c-hgcf6" Jun 02 21:36:17.884639 ip-10-0-138-193 kubenswrapper[2578]: I0602 21:36:17.884581 2578 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-insights/insights-runtime-extractor-rphbc" podStartSLOduration=8.606678521 podStartE2EDuration="10.884562023s" podCreationTimestamp="2026-06-02 21:36:07 +0000 UTC" firstStartedPulling="2026-06-02 21:36:15.163399572 +0000 UTC m=+152.415297456" lastFinishedPulling="2026-06-02 21:36:17.441283055 +0000 UTC m=+154.693180958" observedRunningTime="2026-06-02 21:36:17.884327136 +0000 UTC m=+155.136225061" watchObservedRunningTime="2026-06-02 21:36:17.884562023 +0000 UTC m=+155.136459930" Jun 02 21:36:17.902122 ip-10-0-138-193 kubenswrapper[2578]: I0602 21:36:17.902035 2578 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-image-registry/image-registry-86b67cd59c-hgcf6" podStartSLOduration=16.902020958 podStartE2EDuration="16.902020958s" podCreationTimestamp="2026-06-02 21:36:01 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2026-06-02 21:36:17.901018254 +0000 UTC m=+155.152916160" watchObservedRunningTime="2026-06-02 21:36:17.902020958 +0000 UTC m=+155.153918863" Jun 02 21:36:19.629262 ip-10-0-138-193 kubenswrapper[2578]: E0602 21:36:19.629214 2578 pod_workers.go:1301] "Error syncing pod, skipping" err="unmounted volumes=[cert], unattached volumes=[], failed to process volumes=[]: context deadline exceeded" pod="openshift-ingress-canary/ingress-canary-7jp8d" podUID="39b30769-802d-4bcb-906a-fcbb4eee94b6" Jun 02 21:36:19.634337 ip-10-0-138-193 kubenswrapper[2578]: E0602 21:36:19.634307 2578 pod_workers.go:1301] "Error syncing pod, skipping" err="unmounted volumes=[metrics-tls], unattached volumes=[], failed to process volumes=[]: context deadline exceeded" pod="openshift-dns/dns-default-c44qt" podUID="70e914f4-4b44-4c79-926d-ee58ea32639d" Jun 02 21:36:19.874045 ip-10-0-138-193 kubenswrapper[2578]: I0602 21:36:19.874006 2578 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress-canary/ingress-canary-7jp8d" Jun 02 21:36:19.874234 ip-10-0-138-193 kubenswrapper[2578]: I0602 21:36:19.874096 2578 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-c44qt" Jun 02 21:36:20.344636 ip-10-0-138-193 kubenswrapper[2578]: E0602 21:36:20.344591 2578 pod_workers.go:1301] "Error syncing pod, skipping" err="unmounted volumes=[metrics-certs], unattached volumes=[], failed to process volumes=[]: context deadline exceeded" pod="openshift-multus/network-metrics-daemon-k2vdd" podUID="adfce93b-f07e-480a-af26-5dc7df23fa48" Jun 02 21:36:24.576205 ip-10-0-138-193 kubenswrapper[2578]: I0602 21:36:24.576099 2578 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/39b30769-802d-4bcb-906a-fcbb4eee94b6-cert\") pod \"ingress-canary-7jp8d\" (UID: \"39b30769-802d-4bcb-906a-fcbb4eee94b6\") " pod="openshift-ingress-canary/ingress-canary-7jp8d" Jun 02 21:36:24.576661 ip-10-0-138-193 kubenswrapper[2578]: I0602 21:36:24.576209 2578 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/70e914f4-4b44-4c79-926d-ee58ea32639d-metrics-tls\") pod \"dns-default-c44qt\" (UID: \"70e914f4-4b44-4c79-926d-ee58ea32639d\") " pod="openshift-dns/dns-default-c44qt" Jun 02 21:36:24.578534 ip-10-0-138-193 kubenswrapper[2578]: I0602 21:36:24.578502 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/39b30769-802d-4bcb-906a-fcbb4eee94b6-cert\") pod \"ingress-canary-7jp8d\" (UID: \"39b30769-802d-4bcb-906a-fcbb4eee94b6\") " pod="openshift-ingress-canary/ingress-canary-7jp8d" Jun 02 21:36:24.578534 ip-10-0-138-193 kubenswrapper[2578]: I0602 21:36:24.578519 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/70e914f4-4b44-4c79-926d-ee58ea32639d-metrics-tls\") pod \"dns-default-c44qt\" (UID: \"70e914f4-4b44-4c79-926d-ee58ea32639d\") " pod="openshift-dns/dns-default-c44qt" Jun 02 21:36:24.677132 ip-10-0-138-193 kubenswrapper[2578]: I0602 21:36:24.677069 2578 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-dockercfg-gs96v\"" Jun 02 21:36:24.677989 ip-10-0-138-193 kubenswrapper[2578]: I0602 21:36:24.677972 2578 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-canary\"/\"default-dockercfg-2lz6l\"" Jun 02 21:36:24.684858 ip-10-0-138-193 kubenswrapper[2578]: I0602 21:36:24.684836 2578 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress-canary/ingress-canary-7jp8d" Jun 02 21:36:24.684935 ip-10-0-138-193 kubenswrapper[2578]: I0602 21:36:24.684860 2578 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-c44qt" Jun 02 21:36:24.819787 ip-10-0-138-193 kubenswrapper[2578]: I0602 21:36:24.819756 2578 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-dns/dns-default-c44qt"] Jun 02 21:36:24.823457 ip-10-0-138-193 kubenswrapper[2578]: W0602 21:36:24.823410 2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod70e914f4_4b44_4c79_926d_ee58ea32639d.slice/crio-efa39056646feb010ddc71b37d80ff83d363530a192b0a5392236b3b3e2e856e WatchSource:0}: Error finding container efa39056646feb010ddc71b37d80ff83d363530a192b0a5392236b3b3e2e856e: Status 404 returned error can't find the container with id efa39056646feb010ddc71b37d80ff83d363530a192b0a5392236b3b3e2e856e Jun 02 21:36:24.836258 ip-10-0-138-193 kubenswrapper[2578]: I0602 21:36:24.836067 2578 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-ingress-canary/ingress-canary-7jp8d"] Jun 02 21:36:24.838663 ip-10-0-138-193 kubenswrapper[2578]: W0602 21:36:24.838633 2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod39b30769_802d_4bcb_906a_fcbb4eee94b6.slice/crio-8069357ac4864b0f3bdcf186873d26666ae0d9a84ab93019fab054dd024f6cd6 WatchSource:0}: Error finding container 8069357ac4864b0f3bdcf186873d26666ae0d9a84ab93019fab054dd024f6cd6: Status 404 returned error can't find the container with id 8069357ac4864b0f3bdcf186873d26666ae0d9a84ab93019fab054dd024f6cd6 Jun 02 21:36:24.888343 ip-10-0-138-193 kubenswrapper[2578]: I0602 21:36:24.888300 2578 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-ingress-canary/ingress-canary-7jp8d" event={"ID":"39b30769-802d-4bcb-906a-fcbb4eee94b6","Type":"ContainerStarted","Data":"8069357ac4864b0f3bdcf186873d26666ae0d9a84ab93019fab054dd024f6cd6"} Jun 02 21:36:24.889427 ip-10-0-138-193 kubenswrapper[2578]: I0602 21:36:24.889399 2578 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-c44qt" event={"ID":"70e914f4-4b44-4c79-926d-ee58ea32639d","Type":"ContainerStarted","Data":"efa39056646feb010ddc71b37d80ff83d363530a192b0a5392236b3b3e2e856e"} Jun 02 21:36:26.278926 ip-10-0-138-193 kubenswrapper[2578]: I0602 21:36:26.278888 2578 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openshift-image-registry/image-registry-86b67cd59c-hgcf6"] Jun 02 21:36:26.300758 ip-10-0-138-193 kubenswrapper[2578]: I0602 21:36:26.300716 2578 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-monitoring/prometheus-operator-admission-webhook-59b7f8756b-d7xnh"] Jun 02 21:36:26.304358 ip-10-0-138-193 kubenswrapper[2578]: I0602 21:36:26.304328 2578 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-operator-admission-webhook-59b7f8756b-d7xnh" Jun 02 21:36:26.306649 ip-10-0-138-193 kubenswrapper[2578]: I0602 21:36:26.306620 2578 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-operator-admission-webhook-dockercfg-9mmx2\"" Jun 02 21:36:26.306803 ip-10-0-138-193 kubenswrapper[2578]: I0602 21:36:26.306670 2578 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-operator-admission-webhook-tls\"" Jun 02 21:36:26.315670 ip-10-0-138-193 kubenswrapper[2578]: I0602 21:36:26.315616 2578 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-operator-admission-webhook-59b7f8756b-d7xnh"] Jun 02 21:36:26.395144 ip-10-0-138-193 kubenswrapper[2578]: I0602 21:36:26.395100 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certificates\" (UniqueName: \"kubernetes.io/secret/86979873-9b09-4d29-8035-cc93792f749d-tls-certificates\") pod \"prometheus-operator-admission-webhook-59b7f8756b-d7xnh\" (UID: \"86979873-9b09-4d29-8035-cc93792f749d\") " pod="openshift-monitoring/prometheus-operator-admission-webhook-59b7f8756b-d7xnh" Jun 02 21:36:26.496338 ip-10-0-138-193 kubenswrapper[2578]: I0602 21:36:26.496302 2578 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"tls-certificates\" (UniqueName: \"kubernetes.io/secret/86979873-9b09-4d29-8035-cc93792f749d-tls-certificates\") pod \"prometheus-operator-admission-webhook-59b7f8756b-d7xnh\" (UID: \"86979873-9b09-4d29-8035-cc93792f749d\") " pod="openshift-monitoring/prometheus-operator-admission-webhook-59b7f8756b-d7xnh" Jun 02 21:36:26.499203 ip-10-0-138-193 kubenswrapper[2578]: I0602 21:36:26.499146 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-certificates\" (UniqueName: \"kubernetes.io/secret/86979873-9b09-4d29-8035-cc93792f749d-tls-certificates\") pod \"prometheus-operator-admission-webhook-59b7f8756b-d7xnh\" (UID: \"86979873-9b09-4d29-8035-cc93792f749d\") " pod="openshift-monitoring/prometheus-operator-admission-webhook-59b7f8756b-d7xnh" Jun 02 21:36:26.616684 ip-10-0-138-193 kubenswrapper[2578]: I0602 21:36:26.616596 2578 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-operator-admission-webhook-59b7f8756b-d7xnh" Jun 02 21:36:26.894285 ip-10-0-138-193 kubenswrapper[2578]: I0602 21:36:26.894230 2578 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-operator-admission-webhook-59b7f8756b-d7xnh"] Jun 02 21:36:26.899705 ip-10-0-138-193 kubenswrapper[2578]: I0602 21:36:26.899675 2578 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-ingress-canary/ingress-canary-7jp8d" event={"ID":"39b30769-802d-4bcb-906a-fcbb4eee94b6","Type":"ContainerStarted","Data":"3b1b442a5c6799150cb4cbdfefd01fa8b81eac4f357ba6b461e197150719fa04"} Jun 02 21:36:26.899833 ip-10-0-138-193 kubenswrapper[2578]: W0602 21:36:26.899816 2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod86979873_9b09_4d29_8035_cc93792f749d.slice/crio-1fa26bffa5251c3fdf1abb70e48eb58bc4b8aa3741a2708d4bd4b606555060b6 WatchSource:0}: Error finding container 1fa26bffa5251c3fdf1abb70e48eb58bc4b8aa3741a2708d4bd4b606555060b6: Status 404 returned error can't find the container with id 1fa26bffa5251c3fdf1abb70e48eb58bc4b8aa3741a2708d4bd4b606555060b6 Jun 02 21:36:26.901929 ip-10-0-138-193 kubenswrapper[2578]: I0602 21:36:26.901903 2578 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-c44qt" event={"ID":"70e914f4-4b44-4c79-926d-ee58ea32639d","Type":"ContainerStarted","Data":"46d6dfffcd276e13f0d6321ee6b54e36d67ed86de62f4b22b34d376676f6a16b"} Jun 02 21:36:26.916437 ip-10-0-138-193 kubenswrapper[2578]: I0602 21:36:26.916383 2578 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-ingress-canary/ingress-canary-7jp8d" podStartSLOduration=129.007558747 podStartE2EDuration="2m10.916366426s" podCreationTimestamp="2026-06-02 21:34:16 +0000 UTC" firstStartedPulling="2026-06-02 21:36:24.840644635 +0000 UTC m=+162.092542519" lastFinishedPulling="2026-06-02 21:36:26.749452313 +0000 UTC m=+164.001350198" observedRunningTime="2026-06-02 21:36:26.914744055 +0000 UTC m=+164.166641978" watchObservedRunningTime="2026-06-02 21:36:26.916366426 +0000 UTC m=+164.168264333" Jun 02 21:36:27.907586 ip-10-0-138-193 kubenswrapper[2578]: I0602 21:36:27.907546 2578 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-c44qt" event={"ID":"70e914f4-4b44-4c79-926d-ee58ea32639d","Type":"ContainerStarted","Data":"18c56f9bcf7596ae3b75ad476561b9a12269f5509a6fa7c660da5a9e0ab836f9"} Jun 02 21:36:27.908055 ip-10-0-138-193 kubenswrapper[2578]: I0602 21:36:27.907690 2578 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-dns/dns-default-c44qt" Jun 02 21:36:27.908824 ip-10-0-138-193 kubenswrapper[2578]: I0602 21:36:27.908794 2578 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-operator-admission-webhook-59b7f8756b-d7xnh" event={"ID":"86979873-9b09-4d29-8035-cc93792f749d","Type":"ContainerStarted","Data":"1fa26bffa5251c3fdf1abb70e48eb58bc4b8aa3741a2708d4bd4b606555060b6"} Jun 02 21:36:27.927810 ip-10-0-138-193 kubenswrapper[2578]: I0602 21:36:27.927741 2578 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-dns/dns-default-c44qt" podStartSLOduration=130.009443576 podStartE2EDuration="2m11.927721079s" podCreationTimestamp="2026-06-02 21:34:16 +0000 UTC" firstStartedPulling="2026-06-02 21:36:24.825522502 +0000 UTC m=+162.077420385" lastFinishedPulling="2026-06-02 21:36:26.743799988 +0000 UTC m=+163.995697888" observedRunningTime="2026-06-02 21:36:27.926476545 +0000 UTC m=+165.178374451" watchObservedRunningTime="2026-06-02 21:36:27.927721079 +0000 UTC m=+165.179618992" Jun 02 21:36:28.912805 ip-10-0-138-193 kubenswrapper[2578]: I0602 21:36:28.912766 2578 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-operator-admission-webhook-59b7f8756b-d7xnh" event={"ID":"86979873-9b09-4d29-8035-cc93792f749d","Type":"ContainerStarted","Data":"48e988622da6c8b7295ddb1629293538b3f7862160e5ce18d63975c177943b80"} Jun 02 21:36:28.927378 ip-10-0-138-193 kubenswrapper[2578]: I0602 21:36:28.927242 2578 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-monitoring/prometheus-operator-admission-webhook-59b7f8756b-d7xnh" podStartSLOduration=1.817947428 podStartE2EDuration="2.927226836s" podCreationTimestamp="2026-06-02 21:36:26 +0000 UTC" firstStartedPulling="2026-06-02 21:36:26.90216886 +0000 UTC m=+164.154066747" lastFinishedPulling="2026-06-02 21:36:28.011448272 +0000 UTC m=+165.263346155" observedRunningTime="2026-06-02 21:36:28.926855534 +0000 UTC m=+166.178753435" watchObservedRunningTime="2026-06-02 21:36:28.927226836 +0000 UTC m=+166.179124741" Jun 02 21:36:29.915837 ip-10-0-138-193 kubenswrapper[2578]: I0602 21:36:29.915794 2578 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-monitoring/prometheus-operator-admission-webhook-59b7f8756b-d7xnh" Jun 02 21:36:29.920711 ip-10-0-138-193 kubenswrapper[2578]: I0602 21:36:29.920685 2578 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-monitoring/prometheus-operator-admission-webhook-59b7f8756b-d7xnh" Jun 02 21:36:30.986735 ip-10-0-138-193 kubenswrapper[2578]: I0602 21:36:30.986699 2578 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-monitoring/prometheus-operator-658bcd8bdf-sgh62"] Jun 02 21:36:30.989998 ip-10-0-138-193 kubenswrapper[2578]: I0602 21:36:30.989981 2578 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-operator-658bcd8bdf-sgh62" Jun 02 21:36:30.992463 ip-10-0-138-193 kubenswrapper[2578]: I0602 21:36:30.992440 2578 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-operator-dockercfg-xwf76\"" Jun 02 21:36:30.992598 ip-10-0-138-193 kubenswrapper[2578]: I0602 21:36:30.992442 2578 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-operator-kube-rbac-proxy-config\"" Jun 02 21:36:30.993597 ip-10-0-138-193 kubenswrapper[2578]: I0602 21:36:30.993574 2578 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-operator-tls\"" Jun 02 21:36:30.993711 ip-10-0-138-193 kubenswrapper[2578]: I0602 21:36:30.993575 2578 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"openshift-service-ca.crt\"" Jun 02 21:36:30.993711 ip-10-0-138-193 kubenswrapper[2578]: I0602 21:36:30.993665 2578 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"metrics-client-ca\"" Jun 02 21:36:30.993711 ip-10-0-138-193 kubenswrapper[2578]: I0602 21:36:30.993616 2578 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"kube-root-ca.crt\"" Jun 02 21:36:30.999235 ip-10-0-138-193 kubenswrapper[2578]: I0602 21:36:30.999212 2578 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-operator-658bcd8bdf-sgh62"] Jun 02 21:36:31.030824 ip-10-0-138-193 kubenswrapper[2578]: I0602 21:36:31.030782 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-zhsjg\" (UniqueName: \"kubernetes.io/projected/fc115b1d-a47c-4a79-b53a-e7ac72fb6967-kube-api-access-zhsjg\") pod \"prometheus-operator-658bcd8bdf-sgh62\" (UID: \"fc115b1d-a47c-4a79-b53a-e7ac72fb6967\") " pod="openshift-monitoring/prometheus-operator-658bcd8bdf-sgh62" Jun 02 21:36:31.031016 ip-10-0-138-193 kubenswrapper[2578]: I0602 21:36:31.030839 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-operator-tls\" (UniqueName: \"kubernetes.io/secret/fc115b1d-a47c-4a79-b53a-e7ac72fb6967-prometheus-operator-tls\") pod \"prometheus-operator-658bcd8bdf-sgh62\" (UID: \"fc115b1d-a47c-4a79-b53a-e7ac72fb6967\") " pod="openshift-monitoring/prometheus-operator-658bcd8bdf-sgh62" Jun 02 21:36:31.031016 ip-10-0-138-193 kubenswrapper[2578]: I0602 21:36:31.030862 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/fc115b1d-a47c-4a79-b53a-e7ac72fb6967-metrics-client-ca\") pod \"prometheus-operator-658bcd8bdf-sgh62\" (UID: \"fc115b1d-a47c-4a79-b53a-e7ac72fb6967\") " pod="openshift-monitoring/prometheus-operator-658bcd8bdf-sgh62" Jun 02 21:36:31.031016 ip-10-0-138-193 kubenswrapper[2578]: I0602 21:36:31.030932 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-operator-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/fc115b1d-a47c-4a79-b53a-e7ac72fb6967-prometheus-operator-kube-rbac-proxy-config\") pod \"prometheus-operator-658bcd8bdf-sgh62\" (UID: \"fc115b1d-a47c-4a79-b53a-e7ac72fb6967\") " pod="openshift-monitoring/prometheus-operator-658bcd8bdf-sgh62" Jun 02 21:36:31.131402 ip-10-0-138-193 kubenswrapper[2578]: I0602 21:36:31.131365 2578 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-zhsjg\" (UniqueName: \"kubernetes.io/projected/fc115b1d-a47c-4a79-b53a-e7ac72fb6967-kube-api-access-zhsjg\") pod \"prometheus-operator-658bcd8bdf-sgh62\" (UID: \"fc115b1d-a47c-4a79-b53a-e7ac72fb6967\") " pod="openshift-monitoring/prometheus-operator-658bcd8bdf-sgh62" Jun 02 21:36:31.131623 ip-10-0-138-193 kubenswrapper[2578]: I0602 21:36:31.131417 2578 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"prometheus-operator-tls\" (UniqueName: \"kubernetes.io/secret/fc115b1d-a47c-4a79-b53a-e7ac72fb6967-prometheus-operator-tls\") pod \"prometheus-operator-658bcd8bdf-sgh62\" (UID: \"fc115b1d-a47c-4a79-b53a-e7ac72fb6967\") " pod="openshift-monitoring/prometheus-operator-658bcd8bdf-sgh62" Jun 02 21:36:31.131623 ip-10-0-138-193 kubenswrapper[2578]: I0602 21:36:31.131480 2578 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/fc115b1d-a47c-4a79-b53a-e7ac72fb6967-metrics-client-ca\") pod \"prometheus-operator-658bcd8bdf-sgh62\" (UID: \"fc115b1d-a47c-4a79-b53a-e7ac72fb6967\") " pod="openshift-monitoring/prometheus-operator-658bcd8bdf-sgh62" Jun 02 21:36:31.131623 ip-10-0-138-193 kubenswrapper[2578]: E0602 21:36:31.131521 2578 secret.go:189] Couldn't get secret openshift-monitoring/prometheus-operator-tls: secret "prometheus-operator-tls" not found Jun 02 21:36:31.131623 ip-10-0-138-193 kubenswrapper[2578]: I0602 21:36:31.131546 2578 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"prometheus-operator-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/fc115b1d-a47c-4a79-b53a-e7ac72fb6967-prometheus-operator-kube-rbac-proxy-config\") pod \"prometheus-operator-658bcd8bdf-sgh62\" (UID: \"fc115b1d-a47c-4a79-b53a-e7ac72fb6967\") " pod="openshift-monitoring/prometheus-operator-658bcd8bdf-sgh62" Jun 02 21:36:31.131623 ip-10-0-138-193 kubenswrapper[2578]: E0602 21:36:31.131594 2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/fc115b1d-a47c-4a79-b53a-e7ac72fb6967-prometheus-operator-tls podName:fc115b1d-a47c-4a79-b53a-e7ac72fb6967 nodeName:}" failed. No retries permitted until 2026-06-02 21:36:31.631572221 +0000 UTC m=+168.883470105 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "prometheus-operator-tls" (UniqueName: "kubernetes.io/secret/fc115b1d-a47c-4a79-b53a-e7ac72fb6967-prometheus-operator-tls") pod "prometheus-operator-658bcd8bdf-sgh62" (UID: "fc115b1d-a47c-4a79-b53a-e7ac72fb6967") : secret "prometheus-operator-tls" not found Jun 02 21:36:31.132241 ip-10-0-138-193 kubenswrapper[2578]: I0602 21:36:31.132215 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/fc115b1d-a47c-4a79-b53a-e7ac72fb6967-metrics-client-ca\") pod \"prometheus-operator-658bcd8bdf-sgh62\" (UID: \"fc115b1d-a47c-4a79-b53a-e7ac72fb6967\") " pod="openshift-monitoring/prometheus-operator-658bcd8bdf-sgh62" Jun 02 21:36:31.134038 ip-10-0-138-193 kubenswrapper[2578]: I0602 21:36:31.134013 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"prometheus-operator-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/fc115b1d-a47c-4a79-b53a-e7ac72fb6967-prometheus-operator-kube-rbac-proxy-config\") pod \"prometheus-operator-658bcd8bdf-sgh62\" (UID: \"fc115b1d-a47c-4a79-b53a-e7ac72fb6967\") " pod="openshift-monitoring/prometheus-operator-658bcd8bdf-sgh62" Jun 02 21:36:31.140366 ip-10-0-138-193 kubenswrapper[2578]: I0602 21:36:31.140338 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-zhsjg\" (UniqueName: \"kubernetes.io/projected/fc115b1d-a47c-4a79-b53a-e7ac72fb6967-kube-api-access-zhsjg\") pod \"prometheus-operator-658bcd8bdf-sgh62\" (UID: \"fc115b1d-a47c-4a79-b53a-e7ac72fb6967\") " pod="openshift-monitoring/prometheus-operator-658bcd8bdf-sgh62" Jun 02 21:36:31.635711 ip-10-0-138-193 kubenswrapper[2578]: I0602 21:36:31.635663 2578 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"prometheus-operator-tls\" (UniqueName: \"kubernetes.io/secret/fc115b1d-a47c-4a79-b53a-e7ac72fb6967-prometheus-operator-tls\") pod \"prometheus-operator-658bcd8bdf-sgh62\" (UID: \"fc115b1d-a47c-4a79-b53a-e7ac72fb6967\") " pod="openshift-monitoring/prometheus-operator-658bcd8bdf-sgh62" Jun 02 21:36:31.638179 ip-10-0-138-193 kubenswrapper[2578]: I0602 21:36:31.638151 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"prometheus-operator-tls\" (UniqueName: \"kubernetes.io/secret/fc115b1d-a47c-4a79-b53a-e7ac72fb6967-prometheus-operator-tls\") pod \"prometheus-operator-658bcd8bdf-sgh62\" (UID: \"fc115b1d-a47c-4a79-b53a-e7ac72fb6967\") " pod="openshift-monitoring/prometheus-operator-658bcd8bdf-sgh62" Jun 02 21:36:31.900787 ip-10-0-138-193 kubenswrapper[2578]: I0602 21:36:31.900760 2578 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-operator-658bcd8bdf-sgh62" Jun 02 21:36:32.024705 ip-10-0-138-193 kubenswrapper[2578]: I0602 21:36:32.024563 2578 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-operator-658bcd8bdf-sgh62"] Jun 02 21:36:32.027149 ip-10-0-138-193 kubenswrapper[2578]: W0602 21:36:32.027121 2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podfc115b1d_a47c_4a79_b53a_e7ac72fb6967.slice/crio-be92b781926d98017adda409318c918fe5e6f3c06f2c7ef4beee3fad42d09572 WatchSource:0}: Error finding container be92b781926d98017adda409318c918fe5e6f3c06f2c7ef4beee3fad42d09572: Status 404 returned error can't find the container with id be92b781926d98017adda409318c918fe5e6f3c06f2c7ef4beee3fad42d09572 Jun 02 21:36:32.925213 ip-10-0-138-193 kubenswrapper[2578]: I0602 21:36:32.925173 2578 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-operator-658bcd8bdf-sgh62" event={"ID":"fc115b1d-a47c-4a79-b53a-e7ac72fb6967","Type":"ContainerStarted","Data":"be92b781926d98017adda409318c918fe5e6f3c06f2c7ef4beee3fad42d09572"} Jun 02 21:36:33.930133 ip-10-0-138-193 kubenswrapper[2578]: I0602 21:36:33.930095 2578 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-operator-658bcd8bdf-sgh62" event={"ID":"fc115b1d-a47c-4a79-b53a-e7ac72fb6967","Type":"ContainerStarted","Data":"d509bf793e1158643cb3c7748cbf98a845db96c35c858596a83fbe86d0ea94e5"} Jun 02 21:36:33.930133 ip-10-0-138-193 kubenswrapper[2578]: I0602 21:36:33.930135 2578 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-operator-658bcd8bdf-sgh62" event={"ID":"fc115b1d-a47c-4a79-b53a-e7ac72fb6967","Type":"ContainerStarted","Data":"ace5906e4daa0347cc0ef782eb3d01e5caea1609241b434a81d51ca86190bbde"} Jun 02 21:36:33.945861 ip-10-0-138-193 kubenswrapper[2578]: I0602 21:36:33.945815 2578 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-monitoring/prometheus-operator-658bcd8bdf-sgh62" podStartSLOduration=2.6528548 podStartE2EDuration="3.945801449s" podCreationTimestamp="2026-06-02 21:36:30 +0000 UTC" firstStartedPulling="2026-06-02 21:36:32.028977689 +0000 UTC m=+169.280875572" lastFinishedPulling="2026-06-02 21:36:33.321924322 +0000 UTC m=+170.573822221" observedRunningTime="2026-06-02 21:36:33.944718466 +0000 UTC m=+171.196616369" watchObservedRunningTime="2026-06-02 21:36:33.945801449 +0000 UTC m=+171.197699354" Jun 02 21:36:34.317501 ip-10-0-138-193 kubenswrapper[2578]: I0602 21:36:34.317403 2578 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-k2vdd" Jun 02 21:36:35.372272 ip-10-0-138-193 kubenswrapper[2578]: I0602 21:36:35.372236 2578 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-monitoring/node-exporter-nbg2h"] Jun 02 21:36:35.376047 ip-10-0-138-193 kubenswrapper[2578]: I0602 21:36:35.376022 2578 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/node-exporter-nbg2h" Jun 02 21:36:35.379431 ip-10-0-138-193 kubenswrapper[2578]: I0602 21:36:35.379207 2578 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-kube-rbac-proxy-config\"" Jun 02 21:36:35.379431 ip-10-0-138-193 kubenswrapper[2578]: I0602 21:36:35.379287 2578 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-tls\"" Jun 02 21:36:35.379733 ip-10-0-138-193 kubenswrapper[2578]: I0602 21:36:35.379712 2578 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"node-exporter-accelerators-collector-config\"" Jun 02 21:36:35.380394 ip-10-0-138-193 kubenswrapper[2578]: I0602 21:36:35.380371 2578 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-dockercfg-htktv\"" Jun 02 21:36:35.469393 ip-10-0-138-193 kubenswrapper[2578]: I0602 21:36:35.469359 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/32725eb7-49a8-4200-a955-b9ce9361c502-node-exporter-tls\") pod \"node-exporter-nbg2h\" (UID: \"32725eb7-49a8-4200-a955-b9ce9361c502\") " pod="openshift-monitoring/node-exporter-nbg2h" Jun 02 21:36:35.469393 ip-10-0-138-193 kubenswrapper[2578]: I0602 21:36:35.469399 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/32725eb7-49a8-4200-a955-b9ce9361c502-metrics-client-ca\") pod \"node-exporter-nbg2h\" (UID: \"32725eb7-49a8-4200-a955-b9ce9361c502\") " pod="openshift-monitoring/node-exporter-nbg2h" Jun 02 21:36:35.469661 ip-10-0-138-193 kubenswrapper[2578]: I0602 21:36:35.469421 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/32725eb7-49a8-4200-a955-b9ce9361c502-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-nbg2h\" (UID: \"32725eb7-49a8-4200-a955-b9ce9361c502\") " pod="openshift-monitoring/node-exporter-nbg2h" Jun 02 21:36:35.469661 ip-10-0-138-193 kubenswrapper[2578]: I0602 21:36:35.469488 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/32725eb7-49a8-4200-a955-b9ce9361c502-node-exporter-accelerators-collector-config\") pod \"node-exporter-nbg2h\" (UID: \"32725eb7-49a8-4200-a955-b9ce9361c502\") " pod="openshift-monitoring/node-exporter-nbg2h" Jun 02 21:36:35.469661 ip-10-0-138-193 kubenswrapper[2578]: I0602 21:36:35.469544 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/32725eb7-49a8-4200-a955-b9ce9361c502-node-exporter-wtmp\") pod \"node-exporter-nbg2h\" (UID: \"32725eb7-49a8-4200-a955-b9ce9361c502\") " pod="openshift-monitoring/node-exporter-nbg2h" Jun 02 21:36:35.469661 ip-10-0-138-193 kubenswrapper[2578]: I0602 21:36:35.469576 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/32725eb7-49a8-4200-a955-b9ce9361c502-node-exporter-textfile\") pod \"node-exporter-nbg2h\" (UID: \"32725eb7-49a8-4200-a955-b9ce9361c502\") " pod="openshift-monitoring/node-exporter-nbg2h" Jun 02 21:36:35.469661 ip-10-0-138-193 kubenswrapper[2578]: I0602 21:36:35.469646 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/32725eb7-49a8-4200-a955-b9ce9361c502-sys\") pod \"node-exporter-nbg2h\" (UID: \"32725eb7-49a8-4200-a955-b9ce9361c502\") " pod="openshift-monitoring/node-exporter-nbg2h" Jun 02 21:36:35.469904 ip-10-0-138-193 kubenswrapper[2578]: I0602 21:36:35.469714 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"root\" (UniqueName: \"kubernetes.io/host-path/32725eb7-49a8-4200-a955-b9ce9361c502-root\") pod \"node-exporter-nbg2h\" (UID: \"32725eb7-49a8-4200-a955-b9ce9361c502\") " pod="openshift-monitoring/node-exporter-nbg2h" Jun 02 21:36:35.469904 ip-10-0-138-193 kubenswrapper[2578]: I0602 21:36:35.469737 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-rljzq\" (UniqueName: \"kubernetes.io/projected/32725eb7-49a8-4200-a955-b9ce9361c502-kube-api-access-rljzq\") pod \"node-exporter-nbg2h\" (UID: \"32725eb7-49a8-4200-a955-b9ce9361c502\") " pod="openshift-monitoring/node-exporter-nbg2h" Jun 02 21:36:35.570702 ip-10-0-138-193 kubenswrapper[2578]: I0602 21:36:35.570654 2578 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/32725eb7-49a8-4200-a955-b9ce9361c502-sys\") pod \"node-exporter-nbg2h\" (UID: \"32725eb7-49a8-4200-a955-b9ce9361c502\") " pod="openshift-monitoring/node-exporter-nbg2h" Jun 02 21:36:35.570903 ip-10-0-138-193 kubenswrapper[2578]: I0602 21:36:35.570752 2578 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"root\" (UniqueName: \"kubernetes.io/host-path/32725eb7-49a8-4200-a955-b9ce9361c502-root\") pod \"node-exporter-nbg2h\" (UID: \"32725eb7-49a8-4200-a955-b9ce9361c502\") " pod="openshift-monitoring/node-exporter-nbg2h" Jun 02 21:36:35.570903 ip-10-0-138-193 kubenswrapper[2578]: I0602 21:36:35.570776 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/32725eb7-49a8-4200-a955-b9ce9361c502-sys\") pod \"node-exporter-nbg2h\" (UID: \"32725eb7-49a8-4200-a955-b9ce9361c502\") " pod="openshift-monitoring/node-exporter-nbg2h" Jun 02 21:36:35.570903 ip-10-0-138-193 kubenswrapper[2578]: I0602 21:36:35.570782 2578 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-rljzq\" (UniqueName: \"kubernetes.io/projected/32725eb7-49a8-4200-a955-b9ce9361c502-kube-api-access-rljzq\") pod \"node-exporter-nbg2h\" (UID: \"32725eb7-49a8-4200-a955-b9ce9361c502\") " pod="openshift-monitoring/node-exporter-nbg2h" Jun 02 21:36:35.570903 ip-10-0-138-193 kubenswrapper[2578]: I0602 21:36:35.570861 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"root\" (UniqueName: \"kubernetes.io/host-path/32725eb7-49a8-4200-a955-b9ce9361c502-root\") pod \"node-exporter-nbg2h\" (UID: \"32725eb7-49a8-4200-a955-b9ce9361c502\") " pod="openshift-monitoring/node-exporter-nbg2h" Jun 02 21:36:35.570903 ip-10-0-138-193 kubenswrapper[2578]: I0602 21:36:35.570877 2578 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/32725eb7-49a8-4200-a955-b9ce9361c502-node-exporter-tls\") pod \"node-exporter-nbg2h\" (UID: \"32725eb7-49a8-4200-a955-b9ce9361c502\") " pod="openshift-monitoring/node-exporter-nbg2h" Jun 02 21:36:35.571200 ip-10-0-138-193 kubenswrapper[2578]: I0602 21:36:35.570922 2578 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/32725eb7-49a8-4200-a955-b9ce9361c502-metrics-client-ca\") pod \"node-exporter-nbg2h\" (UID: \"32725eb7-49a8-4200-a955-b9ce9361c502\") " pod="openshift-monitoring/node-exporter-nbg2h" Jun 02 21:36:35.571200 ip-10-0-138-193 kubenswrapper[2578]: I0602 21:36:35.570959 2578 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/32725eb7-49a8-4200-a955-b9ce9361c502-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-nbg2h\" (UID: \"32725eb7-49a8-4200-a955-b9ce9361c502\") " pod="openshift-monitoring/node-exporter-nbg2h" Jun 02 21:36:35.571200 ip-10-0-138-193 kubenswrapper[2578]: E0602 21:36:35.570967 2578 secret.go:189] Couldn't get secret openshift-monitoring/node-exporter-tls: secret "node-exporter-tls" not found Jun 02 21:36:35.571200 ip-10-0-138-193 kubenswrapper[2578]: I0602 21:36:35.570986 2578 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/32725eb7-49a8-4200-a955-b9ce9361c502-node-exporter-accelerators-collector-config\") pod \"node-exporter-nbg2h\" (UID: \"32725eb7-49a8-4200-a955-b9ce9361c502\") " pod="openshift-monitoring/node-exporter-nbg2h" Jun 02 21:36:35.571200 ip-10-0-138-193 kubenswrapper[2578]: I0602 21:36:35.571020 2578 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/32725eb7-49a8-4200-a955-b9ce9361c502-node-exporter-wtmp\") pod \"node-exporter-nbg2h\" (UID: \"32725eb7-49a8-4200-a955-b9ce9361c502\") " pod="openshift-monitoring/node-exporter-nbg2h" Jun 02 21:36:35.571200 ip-10-0-138-193 kubenswrapper[2578]: E0602 21:36:35.571035 2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/32725eb7-49a8-4200-a955-b9ce9361c502-node-exporter-tls podName:32725eb7-49a8-4200-a955-b9ce9361c502 nodeName:}" failed. No retries permitted until 2026-06-02 21:36:36.071013682 +0000 UTC m=+173.322911573 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "node-exporter-tls" (UniqueName: "kubernetes.io/secret/32725eb7-49a8-4200-a955-b9ce9361c502-node-exporter-tls") pod "node-exporter-nbg2h" (UID: "32725eb7-49a8-4200-a955-b9ce9361c502") : secret "node-exporter-tls" not found Jun 02 21:36:35.571200 ip-10-0-138-193 kubenswrapper[2578]: I0602 21:36:35.571175 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/32725eb7-49a8-4200-a955-b9ce9361c502-node-exporter-wtmp\") pod \"node-exporter-nbg2h\" (UID: \"32725eb7-49a8-4200-a955-b9ce9361c502\") " pod="openshift-monitoring/node-exporter-nbg2h" Jun 02 21:36:35.571200 ip-10-0-138-193 kubenswrapper[2578]: I0602 21:36:35.571176 2578 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/32725eb7-49a8-4200-a955-b9ce9361c502-node-exporter-textfile\") pod \"node-exporter-nbg2h\" (UID: \"32725eb7-49a8-4200-a955-b9ce9361c502\") " pod="openshift-monitoring/node-exporter-nbg2h" Jun 02 21:36:35.571554 ip-10-0-138-193 kubenswrapper[2578]: I0602 21:36:35.571531 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/32725eb7-49a8-4200-a955-b9ce9361c502-node-exporter-textfile\") pod \"node-exporter-nbg2h\" (UID: \"32725eb7-49a8-4200-a955-b9ce9361c502\") " pod="openshift-monitoring/node-exporter-nbg2h" Jun 02 21:36:35.571689 ip-10-0-138-193 kubenswrapper[2578]: I0602 21:36:35.571667 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/32725eb7-49a8-4200-a955-b9ce9361c502-metrics-client-ca\") pod \"node-exporter-nbg2h\" (UID: \"32725eb7-49a8-4200-a955-b9ce9361c502\") " pod="openshift-monitoring/node-exporter-nbg2h" Jun 02 21:36:35.571754 ip-10-0-138-193 kubenswrapper[2578]: I0602 21:36:35.571717 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/32725eb7-49a8-4200-a955-b9ce9361c502-node-exporter-accelerators-collector-config\") pod \"node-exporter-nbg2h\" (UID: \"32725eb7-49a8-4200-a955-b9ce9361c502\") " pod="openshift-monitoring/node-exporter-nbg2h" Jun 02 21:36:35.573550 ip-10-0-138-193 kubenswrapper[2578]: I0602 21:36:35.573528 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/32725eb7-49a8-4200-a955-b9ce9361c502-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-nbg2h\" (UID: \"32725eb7-49a8-4200-a955-b9ce9361c502\") " pod="openshift-monitoring/node-exporter-nbg2h" Jun 02 21:36:35.594582 ip-10-0-138-193 kubenswrapper[2578]: I0602 21:36:35.594545 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-rljzq\" (UniqueName: \"kubernetes.io/projected/32725eb7-49a8-4200-a955-b9ce9361c502-kube-api-access-rljzq\") pod \"node-exporter-nbg2h\" (UID: \"32725eb7-49a8-4200-a955-b9ce9361c502\") " pod="openshift-monitoring/node-exporter-nbg2h" Jun 02 21:36:36.076808 ip-10-0-138-193 kubenswrapper[2578]: I0602 21:36:36.076769 2578 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/32725eb7-49a8-4200-a955-b9ce9361c502-node-exporter-tls\") pod \"node-exporter-nbg2h\" (UID: \"32725eb7-49a8-4200-a955-b9ce9361c502\") " pod="openshift-monitoring/node-exporter-nbg2h" Jun 02 21:36:36.079096 ip-10-0-138-193 kubenswrapper[2578]: I0602 21:36:36.079062 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/32725eb7-49a8-4200-a955-b9ce9361c502-node-exporter-tls\") pod \"node-exporter-nbg2h\" (UID: \"32725eb7-49a8-4200-a955-b9ce9361c502\") " pod="openshift-monitoring/node-exporter-nbg2h" Jun 02 21:36:36.284200 ip-10-0-138-193 kubenswrapper[2578]: I0602 21:36:36.284145 2578 patch_prober.go:28] interesting pod/image-registry-86b67cd59c-hgcf6 container/registry namespace/openshift-image-registry: Readiness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body={"errors":[{"code":"UNAVAILABLE","message":"service unavailable","detail":"health check failed: please see /debug/health"}]} Jun 02 21:36:36.284371 ip-10-0-138-193 kubenswrapper[2578]: I0602 21:36:36.284219 2578 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-image-registry/image-registry-86b67cd59c-hgcf6" podUID="9ac0b008-cf1a-404c-b5da-a5d8d29a1de6" containerName="registry" probeResult="failure" output="HTTP probe failed with statuscode: 503" Jun 02 21:36:36.288912 ip-10-0-138-193 kubenswrapper[2578]: I0602 21:36:36.287407 2578 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/node-exporter-nbg2h" Jun 02 21:36:36.297724 ip-10-0-138-193 kubenswrapper[2578]: W0602 21:36:36.296989 2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod32725eb7_49a8_4200_a955_b9ce9361c502.slice/crio-312e28ee2dc663f4323a6626172bd761828247e9d6c5f9065722fbd254f66924 WatchSource:0}: Error finding container 312e28ee2dc663f4323a6626172bd761828247e9d6c5f9065722fbd254f66924: Status 404 returned error can't find the container with id 312e28ee2dc663f4323a6626172bd761828247e9d6c5f9065722fbd254f66924 Jun 02 21:36:36.439712 ip-10-0-138-193 kubenswrapper[2578]: I0602 21:36:36.439675 2578 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-monitoring/alertmanager-main-0"] Jun 02 21:36:36.444887 ip-10-0-138-193 kubenswrapper[2578]: I0602 21:36:36.444853 2578 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/alertmanager-main-0" Jun 02 21:36:36.447545 ip-10-0-138-193 kubenswrapper[2578]: I0602 21:36:36.447520 2578 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-dockercfg-l86hw\"" Jun 02 21:36:36.447678 ip-10-0-138-193 kubenswrapper[2578]: I0602 21:36:36.447566 2578 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-kube-rbac-proxy-web\"" Jun 02 21:36:36.447678 ip-10-0-138-193 kubenswrapper[2578]: I0602 21:36:36.447653 2578 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-cluster-tls-config\"" Jun 02 21:36:36.447790 ip-10-0-138-193 kubenswrapper[2578]: I0602 21:36:36.447654 2578 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-generated\"" Jun 02 21:36:36.447790 ip-10-0-138-193 kubenswrapper[2578]: I0602 21:36:36.447695 2578 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-tls\"" Jun 02 21:36:36.447790 ip-10-0-138-193 kubenswrapper[2578]: I0602 21:36:36.447741 2578 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-web-config\"" Jun 02 21:36:36.447930 ip-10-0-138-193 kubenswrapper[2578]: I0602 21:36:36.447814 2578 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-kube-rbac-proxy-metric\"" Jun 02 21:36:36.447981 ip-10-0-138-193 kubenswrapper[2578]: I0602 21:36:36.447961 2578 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-tls-assets-0\"" Jun 02 21:36:36.448028 ip-10-0-138-193 kubenswrapper[2578]: I0602 21:36:36.448001 2578 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-kube-rbac-proxy\"" Jun 02 21:36:36.448103 ip-10-0-138-193 kubenswrapper[2578]: I0602 21:36:36.448036 2578 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"alertmanager-trusted-ca-bundle\"" Jun 02 21:36:36.457888 ip-10-0-138-193 kubenswrapper[2578]: I0602 21:36:36.457850 2578 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/alertmanager-main-0"] Jun 02 21:36:36.580666 ip-10-0-138-193 kubenswrapper[2578]: I0602 21:36:36.580612 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/baa4d909-6719-4060-8b71-ae4ef3dd2372-alertmanager-trusted-ca-bundle\") pod \"alertmanager-main-0\" (UID: \"baa4d909-6719-4060-8b71-ae4ef3dd2372\") " pod="openshift-monitoring/alertmanager-main-0" Jun 02 21:36:36.580666 ip-10-0-138-193 kubenswrapper[2578]: I0602 21:36:36.580667 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/baa4d909-6719-4060-8b71-ae4ef3dd2372-cluster-tls-config\") pod \"alertmanager-main-0\" (UID: \"baa4d909-6719-4060-8b71-ae4ef3dd2372\") " pod="openshift-monitoring/alertmanager-main-0" Jun 02 21:36:36.580891 ip-10-0-138-193 kubenswrapper[2578]: I0602 21:36:36.580752 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/baa4d909-6719-4060-8b71-ae4ef3dd2372-secret-alertmanager-main-tls\") pod \"alertmanager-main-0\" (UID: \"baa4d909-6719-4060-8b71-ae4ef3dd2372\") " pod="openshift-monitoring/alertmanager-main-0" Jun 02 21:36:36.580891 ip-10-0-138-193 kubenswrapper[2578]: I0602 21:36:36.580805 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/baa4d909-6719-4060-8b71-ae4ef3dd2372-metrics-client-ca\") pod \"alertmanager-main-0\" (UID: \"baa4d909-6719-4060-8b71-ae4ef3dd2372\") " pod="openshift-monitoring/alertmanager-main-0" Jun 02 21:36:36.580891 ip-10-0-138-193 kubenswrapper[2578]: I0602 21:36:36.580851 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/baa4d909-6719-4060-8b71-ae4ef3dd2372-secret-alertmanager-kube-rbac-proxy\") pod \"alertmanager-main-0\" (UID: \"baa4d909-6719-4060-8b71-ae4ef3dd2372\") " pod="openshift-monitoring/alertmanager-main-0" Jun 02 21:36:36.580891 ip-10-0-138-193 kubenswrapper[2578]: I0602 21:36:36.580875 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/baa4d909-6719-4060-8b71-ae4ef3dd2372-secret-alertmanager-kube-rbac-proxy-web\") pod \"alertmanager-main-0\" (UID: \"baa4d909-6719-4060-8b71-ae4ef3dd2372\") " pod="openshift-monitoring/alertmanager-main-0" Jun 02 21:36:36.581012 ip-10-0-138-193 kubenswrapper[2578]: I0602 21:36:36.580901 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/baa4d909-6719-4060-8b71-ae4ef3dd2372-config-out\") pod \"alertmanager-main-0\" (UID: \"baa4d909-6719-4060-8b71-ae4ef3dd2372\") " pod="openshift-monitoring/alertmanager-main-0" Jun 02 21:36:36.581012 ip-10-0-138-193 kubenswrapper[2578]: I0602 21:36:36.580922 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-t2kbc\" (UniqueName: \"kubernetes.io/projected/baa4d909-6719-4060-8b71-ae4ef3dd2372-kube-api-access-t2kbc\") pod \"alertmanager-main-0\" (UID: \"baa4d909-6719-4060-8b71-ae4ef3dd2372\") " pod="openshift-monitoring/alertmanager-main-0" Jun 02 21:36:36.581012 ip-10-0-138-193 kubenswrapper[2578]: I0602 21:36:36.580952 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/baa4d909-6719-4060-8b71-ae4ef3dd2372-alertmanager-main-db\") pod \"alertmanager-main-0\" (UID: \"baa4d909-6719-4060-8b71-ae4ef3dd2372\") " pod="openshift-monitoring/alertmanager-main-0" Jun 02 21:36:36.581012 ip-10-0-138-193 kubenswrapper[2578]: I0602 21:36:36.580979 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/baa4d909-6719-4060-8b71-ae4ef3dd2372-secret-alertmanager-kube-rbac-proxy-metric\") pod \"alertmanager-main-0\" (UID: \"baa4d909-6719-4060-8b71-ae4ef3dd2372\") " pod="openshift-monitoring/alertmanager-main-0" Jun 02 21:36:36.581167 ip-10-0-138-193 kubenswrapper[2578]: I0602 21:36:36.581038 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/baa4d909-6719-4060-8b71-ae4ef3dd2372-config-volume\") pod \"alertmanager-main-0\" (UID: \"baa4d909-6719-4060-8b71-ae4ef3dd2372\") " pod="openshift-monitoring/alertmanager-main-0" Jun 02 21:36:36.581167 ip-10-0-138-193 kubenswrapper[2578]: I0602 21:36:36.581108 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/baa4d909-6719-4060-8b71-ae4ef3dd2372-tls-assets\") pod \"alertmanager-main-0\" (UID: \"baa4d909-6719-4060-8b71-ae4ef3dd2372\") " pod="openshift-monitoring/alertmanager-main-0" Jun 02 21:36:36.581167 ip-10-0-138-193 kubenswrapper[2578]: I0602 21:36:36.581153 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/baa4d909-6719-4060-8b71-ae4ef3dd2372-web-config\") pod \"alertmanager-main-0\" (UID: \"baa4d909-6719-4060-8b71-ae4ef3dd2372\") " pod="openshift-monitoring/alertmanager-main-0" Jun 02 21:36:36.682447 ip-10-0-138-193 kubenswrapper[2578]: I0602 21:36:36.682395 2578 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/baa4d909-6719-4060-8b71-ae4ef3dd2372-metrics-client-ca\") pod \"alertmanager-main-0\" (UID: \"baa4d909-6719-4060-8b71-ae4ef3dd2372\") " pod="openshift-monitoring/alertmanager-main-0" Jun 02 21:36:36.682447 ip-10-0-138-193 kubenswrapper[2578]: I0602 21:36:36.682447 2578 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/baa4d909-6719-4060-8b71-ae4ef3dd2372-secret-alertmanager-kube-rbac-proxy\") pod \"alertmanager-main-0\" (UID: \"baa4d909-6719-4060-8b71-ae4ef3dd2372\") " pod="openshift-monitoring/alertmanager-main-0" Jun 02 21:36:36.682718 ip-10-0-138-193 kubenswrapper[2578]: I0602 21:36:36.682465 2578 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/baa4d909-6719-4060-8b71-ae4ef3dd2372-secret-alertmanager-kube-rbac-proxy-web\") pod \"alertmanager-main-0\" (UID: \"baa4d909-6719-4060-8b71-ae4ef3dd2372\") " pod="openshift-monitoring/alertmanager-main-0" Jun 02 21:36:36.682718 ip-10-0-138-193 kubenswrapper[2578]: I0602 21:36:36.682486 2578 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/baa4d909-6719-4060-8b71-ae4ef3dd2372-config-out\") pod \"alertmanager-main-0\" (UID: \"baa4d909-6719-4060-8b71-ae4ef3dd2372\") " pod="openshift-monitoring/alertmanager-main-0" Jun 02 21:36:36.682718 ip-10-0-138-193 kubenswrapper[2578]: I0602 21:36:36.682505 2578 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-t2kbc\" (UniqueName: \"kubernetes.io/projected/baa4d909-6719-4060-8b71-ae4ef3dd2372-kube-api-access-t2kbc\") pod \"alertmanager-main-0\" (UID: \"baa4d909-6719-4060-8b71-ae4ef3dd2372\") " pod="openshift-monitoring/alertmanager-main-0" Jun 02 21:36:36.682718 ip-10-0-138-193 kubenswrapper[2578]: I0602 21:36:36.682532 2578 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/baa4d909-6719-4060-8b71-ae4ef3dd2372-alertmanager-main-db\") pod \"alertmanager-main-0\" (UID: \"baa4d909-6719-4060-8b71-ae4ef3dd2372\") " pod="openshift-monitoring/alertmanager-main-0" Jun 02 21:36:36.682718 ip-10-0-138-193 kubenswrapper[2578]: I0602 21:36:36.682559 2578 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/baa4d909-6719-4060-8b71-ae4ef3dd2372-secret-alertmanager-kube-rbac-proxy-metric\") pod \"alertmanager-main-0\" (UID: \"baa4d909-6719-4060-8b71-ae4ef3dd2372\") " pod="openshift-monitoring/alertmanager-main-0" Jun 02 21:36:36.682718 ip-10-0-138-193 kubenswrapper[2578]: I0602 21:36:36.682582 2578 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/baa4d909-6719-4060-8b71-ae4ef3dd2372-config-volume\") pod \"alertmanager-main-0\" (UID: \"baa4d909-6719-4060-8b71-ae4ef3dd2372\") " pod="openshift-monitoring/alertmanager-main-0" Jun 02 21:36:36.682718 ip-10-0-138-193 kubenswrapper[2578]: I0602 21:36:36.682601 2578 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/baa4d909-6719-4060-8b71-ae4ef3dd2372-tls-assets\") pod \"alertmanager-main-0\" (UID: \"baa4d909-6719-4060-8b71-ae4ef3dd2372\") " pod="openshift-monitoring/alertmanager-main-0" Jun 02 21:36:36.682718 ip-10-0-138-193 kubenswrapper[2578]: I0602 21:36:36.682636 2578 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/baa4d909-6719-4060-8b71-ae4ef3dd2372-web-config\") pod \"alertmanager-main-0\" (UID: \"baa4d909-6719-4060-8b71-ae4ef3dd2372\") " pod="openshift-monitoring/alertmanager-main-0" Jun 02 21:36:36.682718 ip-10-0-138-193 kubenswrapper[2578]: I0602 21:36:36.682667 2578 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/baa4d909-6719-4060-8b71-ae4ef3dd2372-alertmanager-trusted-ca-bundle\") pod \"alertmanager-main-0\" (UID: \"baa4d909-6719-4060-8b71-ae4ef3dd2372\") " pod="openshift-monitoring/alertmanager-main-0" Jun 02 21:36:36.683141 ip-10-0-138-193 kubenswrapper[2578]: I0602 21:36:36.682708 2578 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/baa4d909-6719-4060-8b71-ae4ef3dd2372-cluster-tls-config\") pod \"alertmanager-main-0\" (UID: \"baa4d909-6719-4060-8b71-ae4ef3dd2372\") " pod="openshift-monitoring/alertmanager-main-0" Jun 02 21:36:36.683141 ip-10-0-138-193 kubenswrapper[2578]: I0602 21:36:36.682870 2578 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/baa4d909-6719-4060-8b71-ae4ef3dd2372-secret-alertmanager-main-tls\") pod \"alertmanager-main-0\" (UID: \"baa4d909-6719-4060-8b71-ae4ef3dd2372\") " pod="openshift-monitoring/alertmanager-main-0" Jun 02 21:36:36.683141 ip-10-0-138-193 kubenswrapper[2578]: I0602 21:36:36.682989 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/baa4d909-6719-4060-8b71-ae4ef3dd2372-alertmanager-main-db\") pod \"alertmanager-main-0\" (UID: \"baa4d909-6719-4060-8b71-ae4ef3dd2372\") " pod="openshift-monitoring/alertmanager-main-0" Jun 02 21:36:36.683874 ip-10-0-138-193 kubenswrapper[2578]: E0602 21:36:36.683612 2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/baa4d909-6719-4060-8b71-ae4ef3dd2372-alertmanager-trusted-ca-bundle podName:baa4d909-6719-4060-8b71-ae4ef3dd2372 nodeName:}" failed. No retries permitted until 2026-06-02 21:36:37.183588775 +0000 UTC m=+174.435486679 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "alertmanager-trusted-ca-bundle" (UniqueName: "kubernetes.io/configmap/baa4d909-6719-4060-8b71-ae4ef3dd2372-alertmanager-trusted-ca-bundle") pod "alertmanager-main-0" (UID: "baa4d909-6719-4060-8b71-ae4ef3dd2372") : configmap references non-existent config key: ca-bundle.crt Jun 02 21:36:36.683874 ip-10-0-138-193 kubenswrapper[2578]: I0602 21:36:36.683813 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/baa4d909-6719-4060-8b71-ae4ef3dd2372-metrics-client-ca\") pod \"alertmanager-main-0\" (UID: \"baa4d909-6719-4060-8b71-ae4ef3dd2372\") " pod="openshift-monitoring/alertmanager-main-0" Jun 02 21:36:36.685930 ip-10-0-138-193 kubenswrapper[2578]: I0602 21:36:36.685903 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/baa4d909-6719-4060-8b71-ae4ef3dd2372-config-out\") pod \"alertmanager-main-0\" (UID: \"baa4d909-6719-4060-8b71-ae4ef3dd2372\") " pod="openshift-monitoring/alertmanager-main-0" Jun 02 21:36:36.686041 ip-10-0-138-193 kubenswrapper[2578]: I0602 21:36:36.685943 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/baa4d909-6719-4060-8b71-ae4ef3dd2372-secret-alertmanager-kube-rbac-proxy-metric\") pod \"alertmanager-main-0\" (UID: \"baa4d909-6719-4060-8b71-ae4ef3dd2372\") " pod="openshift-monitoring/alertmanager-main-0" Jun 02 21:36:36.686041 ip-10-0-138-193 kubenswrapper[2578]: I0602 21:36:36.685967 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/baa4d909-6719-4060-8b71-ae4ef3dd2372-config-volume\") pod \"alertmanager-main-0\" (UID: \"baa4d909-6719-4060-8b71-ae4ef3dd2372\") " pod="openshift-monitoring/alertmanager-main-0" Jun 02 21:36:36.686195 ip-10-0-138-193 kubenswrapper[2578]: I0602 21:36:36.686175 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/baa4d909-6719-4060-8b71-ae4ef3dd2372-secret-alertmanager-kube-rbac-proxy\") pod \"alertmanager-main-0\" (UID: \"baa4d909-6719-4060-8b71-ae4ef3dd2372\") " pod="openshift-monitoring/alertmanager-main-0" Jun 02 21:36:36.686355 ip-10-0-138-193 kubenswrapper[2578]: I0602 21:36:36.686335 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/baa4d909-6719-4060-8b71-ae4ef3dd2372-tls-assets\") pod \"alertmanager-main-0\" (UID: \"baa4d909-6719-4060-8b71-ae4ef3dd2372\") " pod="openshift-monitoring/alertmanager-main-0" Jun 02 21:36:36.686499 ip-10-0-138-193 kubenswrapper[2578]: I0602 21:36:36.686471 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/baa4d909-6719-4060-8b71-ae4ef3dd2372-web-config\") pod \"alertmanager-main-0\" (UID: \"baa4d909-6719-4060-8b71-ae4ef3dd2372\") " pod="openshift-monitoring/alertmanager-main-0" Jun 02 21:36:36.686587 ip-10-0-138-193 kubenswrapper[2578]: I0602 21:36:36.686524 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/baa4d909-6719-4060-8b71-ae4ef3dd2372-secret-alertmanager-main-tls\") pod \"alertmanager-main-0\" (UID: \"baa4d909-6719-4060-8b71-ae4ef3dd2372\") " pod="openshift-monitoring/alertmanager-main-0" Jun 02 21:36:36.686863 ip-10-0-138-193 kubenswrapper[2578]: I0602 21:36:36.686841 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/baa4d909-6719-4060-8b71-ae4ef3dd2372-cluster-tls-config\") pod \"alertmanager-main-0\" (UID: \"baa4d909-6719-4060-8b71-ae4ef3dd2372\") " pod="openshift-monitoring/alertmanager-main-0" Jun 02 21:36:36.687566 ip-10-0-138-193 kubenswrapper[2578]: I0602 21:36:36.687543 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/baa4d909-6719-4060-8b71-ae4ef3dd2372-secret-alertmanager-kube-rbac-proxy-web\") pod \"alertmanager-main-0\" (UID: \"baa4d909-6719-4060-8b71-ae4ef3dd2372\") " pod="openshift-monitoring/alertmanager-main-0" Jun 02 21:36:36.694387 ip-10-0-138-193 kubenswrapper[2578]: I0602 21:36:36.694330 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-t2kbc\" (UniqueName: \"kubernetes.io/projected/baa4d909-6719-4060-8b71-ae4ef3dd2372-kube-api-access-t2kbc\") pod \"alertmanager-main-0\" (UID: \"baa4d909-6719-4060-8b71-ae4ef3dd2372\") " pod="openshift-monitoring/alertmanager-main-0" Jun 02 21:36:36.940441 ip-10-0-138-193 kubenswrapper[2578]: I0602 21:36:36.940399 2578 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-nbg2h" event={"ID":"32725eb7-49a8-4200-a955-b9ce9361c502","Type":"ContainerStarted","Data":"312e28ee2dc663f4323a6626172bd761828247e9d6c5f9065722fbd254f66924"} Jun 02 21:36:37.188005 ip-10-0-138-193 kubenswrapper[2578]: I0602 21:36:37.187961 2578 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/baa4d909-6719-4060-8b71-ae4ef3dd2372-alertmanager-trusted-ca-bundle\") pod \"alertmanager-main-0\" (UID: \"baa4d909-6719-4060-8b71-ae4ef3dd2372\") " pod="openshift-monitoring/alertmanager-main-0" Jun 02 21:36:37.188884 ip-10-0-138-193 kubenswrapper[2578]: I0602 21:36:37.188862 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/baa4d909-6719-4060-8b71-ae4ef3dd2372-alertmanager-trusted-ca-bundle\") pod \"alertmanager-main-0\" (UID: \"baa4d909-6719-4060-8b71-ae4ef3dd2372\") " pod="openshift-monitoring/alertmanager-main-0" Jun 02 21:36:37.359616 ip-10-0-138-193 kubenswrapper[2578]: I0602 21:36:37.359589 2578 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/alertmanager-main-0" Jun 02 21:36:37.502161 ip-10-0-138-193 kubenswrapper[2578]: I0602 21:36:37.502134 2578 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/alertmanager-main-0"] Jun 02 21:36:37.508991 ip-10-0-138-193 kubenswrapper[2578]: W0602 21:36:37.508959 2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podbaa4d909_6719_4060_8b71_ae4ef3dd2372.slice/crio-f573d96be1a6b565e76d531fc9edf3bae241aafb1ad5efaec559878a86380f3c WatchSource:0}: Error finding container f573d96be1a6b565e76d531fc9edf3bae241aafb1ad5efaec559878a86380f3c: Status 404 returned error can't find the container with id f573d96be1a6b565e76d531fc9edf3bae241aafb1ad5efaec559878a86380f3c Jun 02 21:36:37.915015 ip-10-0-138-193 kubenswrapper[2578]: I0602 21:36:37.914986 2578 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-dns/dns-default-c44qt" Jun 02 21:36:37.945195 ip-10-0-138-193 kubenswrapper[2578]: I0602 21:36:37.945154 2578 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"baa4d909-6719-4060-8b71-ae4ef3dd2372","Type":"ContainerStarted","Data":"f573d96be1a6b565e76d531fc9edf3bae241aafb1ad5efaec559878a86380f3c"} Jun 02 21:36:37.946839 ip-10-0-138-193 kubenswrapper[2578]: I0602 21:36:37.946813 2578 generic.go:358] "Generic (PLEG): container finished" podID="32725eb7-49a8-4200-a955-b9ce9361c502" containerID="431e6d659d25ed3047e39b5040338529ccbf7e06f38bfa6573c59756ad3f6d73" exitCode=0 Jun 02 21:36:37.946978 ip-10-0-138-193 kubenswrapper[2578]: I0602 21:36:37.946850 2578 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-nbg2h" event={"ID":"32725eb7-49a8-4200-a955-b9ce9361c502","Type":"ContainerDied","Data":"431e6d659d25ed3047e39b5040338529ccbf7e06f38bfa6573c59756ad3f6d73"} Jun 02 21:36:38.951127 ip-10-0-138-193 kubenswrapper[2578]: I0602 21:36:38.951087 2578 generic.go:358] "Generic (PLEG): container finished" podID="baa4d909-6719-4060-8b71-ae4ef3dd2372" containerID="52584b7ff07887f3a236b6d4446414c286c6dd83c9bf5f84e145329f89395f86" exitCode=0 Jun 02 21:36:38.951534 ip-10-0-138-193 kubenswrapper[2578]: I0602 21:36:38.951166 2578 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"baa4d909-6719-4060-8b71-ae4ef3dd2372","Type":"ContainerDied","Data":"52584b7ff07887f3a236b6d4446414c286c6dd83c9bf5f84e145329f89395f86"} Jun 02 21:36:38.953844 ip-10-0-138-193 kubenswrapper[2578]: I0602 21:36:38.953783 2578 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-nbg2h" event={"ID":"32725eb7-49a8-4200-a955-b9ce9361c502","Type":"ContainerStarted","Data":"5a11c54093c2378ac5eb37b4789b66be417b22b87da639faa0c70216e80b84fc"} Jun 02 21:36:38.953935 ip-10-0-138-193 kubenswrapper[2578]: I0602 21:36:38.953854 2578 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-nbg2h" event={"ID":"32725eb7-49a8-4200-a955-b9ce9361c502","Type":"ContainerStarted","Data":"252cfc8d315f4ecf5497d8c8154a74094b81487990087ed4a1637edfc939200a"} Jun 02 21:36:39.011936 ip-10-0-138-193 kubenswrapper[2578]: I0602 21:36:39.011828 2578 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-monitoring/node-exporter-nbg2h" podStartSLOduration=3.006239363 podStartE2EDuration="4.011813604s" podCreationTimestamp="2026-06-02 21:36:35 +0000 UTC" firstStartedPulling="2026-06-02 21:36:36.299268643 +0000 UTC m=+173.551166534" lastFinishedPulling="2026-06-02 21:36:37.304842888 +0000 UTC m=+174.556740775" observedRunningTime="2026-06-02 21:36:39.011372297 +0000 UTC m=+176.263270203" watchObservedRunningTime="2026-06-02 21:36:39.011813604 +0000 UTC m=+176.263711510" Jun 02 21:36:39.854625 ip-10-0-138-193 kubenswrapper[2578]: I0602 21:36:39.854585 2578 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-monitoring/metrics-server-7768f4bdf8-tbc26"] Jun 02 21:36:39.857939 ip-10-0-138-193 kubenswrapper[2578]: I0602 21:36:39.857907 2578 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/metrics-server-7768f4bdf8-tbc26" Jun 02 21:36:39.862450 ip-10-0-138-193 kubenswrapper[2578]: I0602 21:36:39.862422 2578 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"metrics-server-audit-profiles\"" Jun 02 21:36:39.863398 ip-10-0-138-193 kubenswrapper[2578]: I0602 21:36:39.863373 2578 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"metrics-server-dockercfg-gvn9z\"" Jun 02 21:36:39.863398 ip-10-0-138-193 kubenswrapper[2578]: I0602 21:36:39.863381 2578 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"metrics-server-tls\"" Jun 02 21:36:39.863592 ip-10-0-138-193 kubenswrapper[2578]: I0602 21:36:39.863412 2578 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"metrics-server-fqfmq6u63h4c\"" Jun 02 21:36:39.863592 ip-10-0-138-193 kubenswrapper[2578]: I0602 21:36:39.863465 2578 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"kubelet-serving-ca-bundle\"" Jun 02 21:36:39.863592 ip-10-0-138-193 kubenswrapper[2578]: I0602 21:36:39.863495 2578 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"metrics-server-client-certs\"" Jun 02 21:36:39.871058 ip-10-0-138-193 kubenswrapper[2578]: I0602 21:36:39.870996 2578 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/metrics-server-7768f4bdf8-tbc26"] Jun 02 21:36:40.016834 ip-10-0-138-193 kubenswrapper[2578]: I0602 21:36:40.016791 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/1be428fe-f15c-4cfd-99c4-9de41e5e9897-configmap-kubelet-serving-ca-bundle\") pod \"metrics-server-7768f4bdf8-tbc26\" (UID: \"1be428fe-f15c-4cfd-99c4-9de41e5e9897\") " pod="openshift-monitoring/metrics-server-7768f4bdf8-tbc26" Jun 02 21:36:40.017361 ip-10-0-138-193 kubenswrapper[2578]: I0602 21:36:40.016945 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-metrics-server-client-certs\" (UniqueName: \"kubernetes.io/secret/1be428fe-f15c-4cfd-99c4-9de41e5e9897-secret-metrics-server-client-certs\") pod \"metrics-server-7768f4bdf8-tbc26\" (UID: \"1be428fe-f15c-4cfd-99c4-9de41e5e9897\") " pod="openshift-monitoring/metrics-server-7768f4bdf8-tbc26" Jun 02 21:36:40.017361 ip-10-0-138-193 kubenswrapper[2578]: I0602 21:36:40.016985 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-zb8lr\" (UniqueName: \"kubernetes.io/projected/1be428fe-f15c-4cfd-99c4-9de41e5e9897-kube-api-access-zb8lr\") pod \"metrics-server-7768f4bdf8-tbc26\" (UID: \"1be428fe-f15c-4cfd-99c4-9de41e5e9897\") " pod="openshift-monitoring/metrics-server-7768f4bdf8-tbc26" Jun 02 21:36:40.017361 ip-10-0-138-193 kubenswrapper[2578]: I0602 21:36:40.017027 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-server-audit-profiles\" (UniqueName: \"kubernetes.io/configmap/1be428fe-f15c-4cfd-99c4-9de41e5e9897-metrics-server-audit-profiles\") pod \"metrics-server-7768f4bdf8-tbc26\" (UID: \"1be428fe-f15c-4cfd-99c4-9de41e5e9897\") " pod="openshift-monitoring/metrics-server-7768f4bdf8-tbc26" Jun 02 21:36:40.017361 ip-10-0-138-193 kubenswrapper[2578]: I0602 21:36:40.017068 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-metrics-server-tls\" (UniqueName: \"kubernetes.io/secret/1be428fe-f15c-4cfd-99c4-9de41e5e9897-secret-metrics-server-tls\") pod \"metrics-server-7768f4bdf8-tbc26\" (UID: \"1be428fe-f15c-4cfd-99c4-9de41e5e9897\") " pod="openshift-monitoring/metrics-server-7768f4bdf8-tbc26" Jun 02 21:36:40.017361 ip-10-0-138-193 kubenswrapper[2578]: I0602 21:36:40.017151 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"audit-log\" (UniqueName: \"kubernetes.io/empty-dir/1be428fe-f15c-4cfd-99c4-9de41e5e9897-audit-log\") pod \"metrics-server-7768f4bdf8-tbc26\" (UID: \"1be428fe-f15c-4cfd-99c4-9de41e5e9897\") " pod="openshift-monitoring/metrics-server-7768f4bdf8-tbc26" Jun 02 21:36:40.017361 ip-10-0-138-193 kubenswrapper[2578]: I0602 21:36:40.017348 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"client-ca-bundle\" (UniqueName: \"kubernetes.io/secret/1be428fe-f15c-4cfd-99c4-9de41e5e9897-client-ca-bundle\") pod \"metrics-server-7768f4bdf8-tbc26\" (UID: \"1be428fe-f15c-4cfd-99c4-9de41e5e9897\") " pod="openshift-monitoring/metrics-server-7768f4bdf8-tbc26" Jun 02 21:36:40.118509 ip-10-0-138-193 kubenswrapper[2578]: I0602 21:36:40.118409 2578 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"secret-metrics-server-client-certs\" (UniqueName: \"kubernetes.io/secret/1be428fe-f15c-4cfd-99c4-9de41e5e9897-secret-metrics-server-client-certs\") pod \"metrics-server-7768f4bdf8-tbc26\" (UID: \"1be428fe-f15c-4cfd-99c4-9de41e5e9897\") " pod="openshift-monitoring/metrics-server-7768f4bdf8-tbc26" Jun 02 21:36:40.118509 ip-10-0-138-193 kubenswrapper[2578]: I0602 21:36:40.118455 2578 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-zb8lr\" (UniqueName: \"kubernetes.io/projected/1be428fe-f15c-4cfd-99c4-9de41e5e9897-kube-api-access-zb8lr\") pod \"metrics-server-7768f4bdf8-tbc26\" (UID: \"1be428fe-f15c-4cfd-99c4-9de41e5e9897\") " pod="openshift-monitoring/metrics-server-7768f4bdf8-tbc26" Jun 02 21:36:40.118746 ip-10-0-138-193 kubenswrapper[2578]: I0602 21:36:40.118592 2578 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-server-audit-profiles\" (UniqueName: \"kubernetes.io/configmap/1be428fe-f15c-4cfd-99c4-9de41e5e9897-metrics-server-audit-profiles\") pod \"metrics-server-7768f4bdf8-tbc26\" (UID: \"1be428fe-f15c-4cfd-99c4-9de41e5e9897\") " pod="openshift-monitoring/metrics-server-7768f4bdf8-tbc26" Jun 02 21:36:40.118746 ip-10-0-138-193 kubenswrapper[2578]: I0602 21:36:40.118645 2578 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"secret-metrics-server-tls\" (UniqueName: \"kubernetes.io/secret/1be428fe-f15c-4cfd-99c4-9de41e5e9897-secret-metrics-server-tls\") pod \"metrics-server-7768f4bdf8-tbc26\" (UID: \"1be428fe-f15c-4cfd-99c4-9de41e5e9897\") " pod="openshift-monitoring/metrics-server-7768f4bdf8-tbc26" Jun 02 21:36:40.118746 ip-10-0-138-193 kubenswrapper[2578]: I0602 21:36:40.118687 2578 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"audit-log\" (UniqueName: \"kubernetes.io/empty-dir/1be428fe-f15c-4cfd-99c4-9de41e5e9897-audit-log\") pod \"metrics-server-7768f4bdf8-tbc26\" (UID: \"1be428fe-f15c-4cfd-99c4-9de41e5e9897\") " pod="openshift-monitoring/metrics-server-7768f4bdf8-tbc26" Jun 02 21:36:40.118897 ip-10-0-138-193 kubenswrapper[2578]: I0602 21:36:40.118758 2578 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"client-ca-bundle\" (UniqueName: \"kubernetes.io/secret/1be428fe-f15c-4cfd-99c4-9de41e5e9897-client-ca-bundle\") pod \"metrics-server-7768f4bdf8-tbc26\" (UID: \"1be428fe-f15c-4cfd-99c4-9de41e5e9897\") " pod="openshift-monitoring/metrics-server-7768f4bdf8-tbc26" Jun 02 21:36:40.118897 ip-10-0-138-193 kubenswrapper[2578]: I0602 21:36:40.118819 2578 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/1be428fe-f15c-4cfd-99c4-9de41e5e9897-configmap-kubelet-serving-ca-bundle\") pod \"metrics-server-7768f4bdf8-tbc26\" (UID: \"1be428fe-f15c-4cfd-99c4-9de41e5e9897\") " pod="openshift-monitoring/metrics-server-7768f4bdf8-tbc26" Jun 02 21:36:40.119869 ip-10-0-138-193 kubenswrapper[2578]: I0602 21:36:40.119250 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"audit-log\" (UniqueName: \"kubernetes.io/empty-dir/1be428fe-f15c-4cfd-99c4-9de41e5e9897-audit-log\") pod \"metrics-server-7768f4bdf8-tbc26\" (UID: \"1be428fe-f15c-4cfd-99c4-9de41e5e9897\") " pod="openshift-monitoring/metrics-server-7768f4bdf8-tbc26" Jun 02 21:36:40.119869 ip-10-0-138-193 kubenswrapper[2578]: I0602 21:36:40.119810 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/1be428fe-f15c-4cfd-99c4-9de41e5e9897-configmap-kubelet-serving-ca-bundle\") pod \"metrics-server-7768f4bdf8-tbc26\" (UID: \"1be428fe-f15c-4cfd-99c4-9de41e5e9897\") " pod="openshift-monitoring/metrics-server-7768f4bdf8-tbc26" Jun 02 21:36:40.120046 ip-10-0-138-193 kubenswrapper[2578]: I0602 21:36:40.119920 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-server-audit-profiles\" (UniqueName: \"kubernetes.io/configmap/1be428fe-f15c-4cfd-99c4-9de41e5e9897-metrics-server-audit-profiles\") pod \"metrics-server-7768f4bdf8-tbc26\" (UID: \"1be428fe-f15c-4cfd-99c4-9de41e5e9897\") " pod="openshift-monitoring/metrics-server-7768f4bdf8-tbc26" Jun 02 21:36:40.121715 ip-10-0-138-193 kubenswrapper[2578]: I0602 21:36:40.121690 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-metrics-server-tls\" (UniqueName: \"kubernetes.io/secret/1be428fe-f15c-4cfd-99c4-9de41e5e9897-secret-metrics-server-tls\") pod \"metrics-server-7768f4bdf8-tbc26\" (UID: \"1be428fe-f15c-4cfd-99c4-9de41e5e9897\") " pod="openshift-monitoring/metrics-server-7768f4bdf8-tbc26" Jun 02 21:36:40.121896 ip-10-0-138-193 kubenswrapper[2578]: I0602 21:36:40.121799 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"client-ca-bundle\" (UniqueName: \"kubernetes.io/secret/1be428fe-f15c-4cfd-99c4-9de41e5e9897-client-ca-bundle\") pod \"metrics-server-7768f4bdf8-tbc26\" (UID: \"1be428fe-f15c-4cfd-99c4-9de41e5e9897\") " pod="openshift-monitoring/metrics-server-7768f4bdf8-tbc26" Jun 02 21:36:40.122157 ip-10-0-138-193 kubenswrapper[2578]: I0602 21:36:40.122131 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-metrics-server-client-certs\" (UniqueName: \"kubernetes.io/secret/1be428fe-f15c-4cfd-99c4-9de41e5e9897-secret-metrics-server-client-certs\") pod \"metrics-server-7768f4bdf8-tbc26\" (UID: \"1be428fe-f15c-4cfd-99c4-9de41e5e9897\") " pod="openshift-monitoring/metrics-server-7768f4bdf8-tbc26" Jun 02 21:36:40.130121 ip-10-0-138-193 kubenswrapper[2578]: I0602 21:36:40.130101 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-zb8lr\" (UniqueName: \"kubernetes.io/projected/1be428fe-f15c-4cfd-99c4-9de41e5e9897-kube-api-access-zb8lr\") pod \"metrics-server-7768f4bdf8-tbc26\" (UID: \"1be428fe-f15c-4cfd-99c4-9de41e5e9897\") " pod="openshift-monitoring/metrics-server-7768f4bdf8-tbc26" Jun 02 21:36:40.170274 ip-10-0-138-193 kubenswrapper[2578]: I0602 21:36:40.170234 2578 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/metrics-server-7768f4bdf8-tbc26" Jun 02 21:36:40.330257 ip-10-0-138-193 kubenswrapper[2578]: I0602 21:36:40.330230 2578 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/metrics-server-7768f4bdf8-tbc26"] Jun 02 21:36:40.332584 ip-10-0-138-193 kubenswrapper[2578]: W0602 21:36:40.332552 2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod1be428fe_f15c_4cfd_99c4_9de41e5e9897.slice/crio-ff580e5b2e3dd3f19081682af09ca78a911c6691a84316cf7e892ad1ed357287 WatchSource:0}: Error finding container ff580e5b2e3dd3f19081682af09ca78a911c6691a84316cf7e892ad1ed357287: Status 404 returned error can't find the container with id ff580e5b2e3dd3f19081682af09ca78a911c6691a84316cf7e892ad1ed357287 Jun 02 21:36:40.960357 ip-10-0-138-193 kubenswrapper[2578]: I0602 21:36:40.960326 2578 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/metrics-server-7768f4bdf8-tbc26" event={"ID":"1be428fe-f15c-4cfd-99c4-9de41e5e9897","Type":"ContainerStarted","Data":"ff580e5b2e3dd3f19081682af09ca78a911c6691a84316cf7e892ad1ed357287"} Jun 02 21:36:40.963933 ip-10-0-138-193 kubenswrapper[2578]: I0602 21:36:40.963906 2578 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"baa4d909-6719-4060-8b71-ae4ef3dd2372","Type":"ContainerStarted","Data":"37a189c94cd2d9e909b97eda3a53be4138ca864b588b9e0ab05cea7c84f7e2f3"} Jun 02 21:36:41.973199 ip-10-0-138-193 kubenswrapper[2578]: I0602 21:36:41.973150 2578 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"baa4d909-6719-4060-8b71-ae4ef3dd2372","Type":"ContainerStarted","Data":"cf9d8861d397be33bbd242293ebe2436f230fba70f1596ebcbe3190cf41dbc89"} Jun 02 21:36:41.973199 ip-10-0-138-193 kubenswrapper[2578]: I0602 21:36:41.973199 2578 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"baa4d909-6719-4060-8b71-ae4ef3dd2372","Type":"ContainerStarted","Data":"ea7f8c5fff268e06f4e55fb748ce5e2474f31fb6972422ea2719f0ff2caa7742"} Jun 02 21:36:41.973199 ip-10-0-138-193 kubenswrapper[2578]: I0602 21:36:41.973209 2578 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"baa4d909-6719-4060-8b71-ae4ef3dd2372","Type":"ContainerStarted","Data":"a8df779c28dd05b8c732b3cb399dd1e97cd377c224a781e1c6570f193f35ec32"} Jun 02 21:36:41.973675 ip-10-0-138-193 kubenswrapper[2578]: I0602 21:36:41.973219 2578 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"baa4d909-6719-4060-8b71-ae4ef3dd2372","Type":"ContainerStarted","Data":"a608358a144306b7e58b1c0a1de2e5f9ce65338c8cc53e7f0f517c6dd9625844"} Jun 02 21:36:42.977613 ip-10-0-138-193 kubenswrapper[2578]: I0602 21:36:42.977526 2578 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/metrics-server-7768f4bdf8-tbc26" event={"ID":"1be428fe-f15c-4cfd-99c4-9de41e5e9897","Type":"ContainerStarted","Data":"a5b241cda232ea772c1028cdabfee95ac6447fbe2dbb728181be0420f244219c"} Jun 02 21:36:42.982181 ip-10-0-138-193 kubenswrapper[2578]: I0602 21:36:42.980587 2578 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"baa4d909-6719-4060-8b71-ae4ef3dd2372","Type":"ContainerStarted","Data":"e7950e75fcaff43cd167693105597dfcb046b010bede7a64f19757954a1ce74b"} Jun 02 21:36:42.999793 ip-10-0-138-193 kubenswrapper[2578]: I0602 21:36:42.999746 2578 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-monitoring/metrics-server-7768f4bdf8-tbc26" podStartSLOduration=2.206015153 podStartE2EDuration="3.99973406s" podCreationTimestamp="2026-06-02 21:36:39 +0000 UTC" firstStartedPulling="2026-06-02 21:36:40.335127703 +0000 UTC m=+177.587025586" lastFinishedPulling="2026-06-02 21:36:42.128846609 +0000 UTC m=+179.380744493" observedRunningTime="2026-06-02 21:36:42.997627743 +0000 UTC m=+180.249525640" watchObservedRunningTime="2026-06-02 21:36:42.99973406 +0000 UTC m=+180.251631966" Jun 02 21:36:43.054164 ip-10-0-138-193 kubenswrapper[2578]: I0602 21:36:43.054109 2578 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-monitoring/alertmanager-main-0" podStartSLOduration=1.852949717 podStartE2EDuration="7.054094138s" podCreationTimestamp="2026-06-02 21:36:36 +0000 UTC" firstStartedPulling="2026-06-02 21:36:37.510976151 +0000 UTC m=+174.762874038" lastFinishedPulling="2026-06-02 21:36:42.712120574 +0000 UTC m=+179.964018459" observedRunningTime="2026-06-02 21:36:43.05197963 +0000 UTC m=+180.303877538" watchObservedRunningTime="2026-06-02 21:36:43.054094138 +0000 UTC m=+180.305992050" Jun 02 21:36:46.283699 ip-10-0-138-193 kubenswrapper[2578]: I0602 21:36:46.283669 2578 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-image-registry/image-registry-86b67cd59c-hgcf6" Jun 02 21:36:48.643859 ip-10-0-138-193 kubenswrapper[2578]: I0602 21:36:48.643815 2578 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-console/downloads-c65b8dc4b-k8cbf"] Jun 02 21:36:48.649205 ip-10-0-138-193 kubenswrapper[2578]: I0602 21:36:48.649181 2578 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/downloads-c65b8dc4b-k8cbf" Jun 02 21:36:48.653050 ip-10-0-138-193 kubenswrapper[2578]: I0602 21:36:48.653024 2578 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"kube-root-ca.crt\"" Jun 02 21:36:48.653216 ip-10-0-138-193 kubenswrapper[2578]: I0602 21:36:48.653152 2578 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"default-dockercfg-hgtgq\"" Jun 02 21:36:48.653216 ip-10-0-138-193 kubenswrapper[2578]: I0602 21:36:48.653192 2578 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"openshift-service-ca.crt\"" Jun 02 21:36:48.659461 ip-10-0-138-193 kubenswrapper[2578]: I0602 21:36:48.659434 2578 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-console/downloads-c65b8dc4b-k8cbf"] Jun 02 21:36:48.793776 ip-10-0-138-193 kubenswrapper[2578]: I0602 21:36:48.793726 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-spc22\" (UniqueName: \"kubernetes.io/projected/baba2ed5-2e13-4c51-8936-6b4b8a34ed6a-kube-api-access-spc22\") pod \"downloads-c65b8dc4b-k8cbf\" (UID: \"baba2ed5-2e13-4c51-8936-6b4b8a34ed6a\") " pod="openshift-console/downloads-c65b8dc4b-k8cbf" Jun 02 21:36:48.894444 ip-10-0-138-193 kubenswrapper[2578]: I0602 21:36:48.894365 2578 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-spc22\" (UniqueName: \"kubernetes.io/projected/baba2ed5-2e13-4c51-8936-6b4b8a34ed6a-kube-api-access-spc22\") pod \"downloads-c65b8dc4b-k8cbf\" (UID: \"baba2ed5-2e13-4c51-8936-6b4b8a34ed6a\") " pod="openshift-console/downloads-c65b8dc4b-k8cbf" Jun 02 21:36:48.903520 ip-10-0-138-193 kubenswrapper[2578]: I0602 21:36:48.903497 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-spc22\" (UniqueName: \"kubernetes.io/projected/baba2ed5-2e13-4c51-8936-6b4b8a34ed6a-kube-api-access-spc22\") pod \"downloads-c65b8dc4b-k8cbf\" (UID: \"baba2ed5-2e13-4c51-8936-6b4b8a34ed6a\") " pod="openshift-console/downloads-c65b8dc4b-k8cbf" Jun 02 21:36:48.959555 ip-10-0-138-193 kubenswrapper[2578]: I0602 21:36:48.959511 2578 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/downloads-c65b8dc4b-k8cbf" Jun 02 21:36:49.095292 ip-10-0-138-193 kubenswrapper[2578]: I0602 21:36:49.095258 2578 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-console/downloads-c65b8dc4b-k8cbf"] Jun 02 21:36:49.098228 ip-10-0-138-193 kubenswrapper[2578]: W0602 21:36:49.098197 2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podbaba2ed5_2e13_4c51_8936_6b4b8a34ed6a.slice/crio-f29b3dfb5064ca8df410b0590a1e60a455917da68f21a28f8260e284c4ff2496 WatchSource:0}: Error finding container f29b3dfb5064ca8df410b0590a1e60a455917da68f21a28f8260e284c4ff2496: Status 404 returned error can't find the container with id f29b3dfb5064ca8df410b0590a1e60a455917da68f21a28f8260e284c4ff2496 Jun 02 21:36:50.001398 ip-10-0-138-193 kubenswrapper[2578]: I0602 21:36:50.001355 2578 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-console/downloads-c65b8dc4b-k8cbf" event={"ID":"baba2ed5-2e13-4c51-8936-6b4b8a34ed6a","Type":"ContainerStarted","Data":"f29b3dfb5064ca8df410b0590a1e60a455917da68f21a28f8260e284c4ff2496"} Jun 02 21:36:51.304481 ip-10-0-138-193 kubenswrapper[2578]: I0602 21:36:51.304421 2578 kuberuntime_container.go:864] "Killing container with a grace period" pod="openshift-image-registry/image-registry-86b67cd59c-hgcf6" podUID="9ac0b008-cf1a-404c-b5da-a5d8d29a1de6" containerName="registry" containerID="cri-o://c492475167dc12396d5dbb13e8a7c8ae82e3c2f443c30d4b1158aba1ac43cb8c" gracePeriod=30 Jun 02 21:36:51.566406 ip-10-0-138-193 kubenswrapper[2578]: I0602 21:36:51.566380 2578 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-86b67cd59c-hgcf6" Jun 02 21:36:51.724007 ip-10-0-138-193 kubenswrapper[2578]: I0602 21:36:51.723972 2578 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/9ac0b008-cf1a-404c-b5da-a5d8d29a1de6-registry-tls\") pod \"9ac0b008-cf1a-404c-b5da-a5d8d29a1de6\" (UID: \"9ac0b008-cf1a-404c-b5da-a5d8d29a1de6\") " Jun 02 21:36:51.724188 ip-10-0-138-193 kubenswrapper[2578]: I0602 21:36:51.724015 2578 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/9ac0b008-cf1a-404c-b5da-a5d8d29a1de6-installation-pull-secrets\") pod \"9ac0b008-cf1a-404c-b5da-a5d8d29a1de6\" (UID: \"9ac0b008-cf1a-404c-b5da-a5d8d29a1de6\") " Jun 02 21:36:51.724188 ip-10-0-138-193 kubenswrapper[2578]: I0602 21:36:51.724049 2578 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/9ac0b008-cf1a-404c-b5da-a5d8d29a1de6-image-registry-private-configuration\") pod \"9ac0b008-cf1a-404c-b5da-a5d8d29a1de6\" (UID: \"9ac0b008-cf1a-404c-b5da-a5d8d29a1de6\") " Jun 02 21:36:51.724188 ip-10-0-138-193 kubenswrapper[2578]: I0602 21:36:51.724115 2578 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-vrggb\" (UniqueName: \"kubernetes.io/projected/9ac0b008-cf1a-404c-b5da-a5d8d29a1de6-kube-api-access-vrggb\") pod \"9ac0b008-cf1a-404c-b5da-a5d8d29a1de6\" (UID: \"9ac0b008-cf1a-404c-b5da-a5d8d29a1de6\") " Jun 02 21:36:51.724188 ip-10-0-138-193 kubenswrapper[2578]: I0602 21:36:51.724183 2578 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/9ac0b008-cf1a-404c-b5da-a5d8d29a1de6-bound-sa-token\") pod \"9ac0b008-cf1a-404c-b5da-a5d8d29a1de6\" (UID: \"9ac0b008-cf1a-404c-b5da-a5d8d29a1de6\") " Jun 02 21:36:51.724360 ip-10-0-138-193 kubenswrapper[2578]: I0602 21:36:51.724220 2578 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/9ac0b008-cf1a-404c-b5da-a5d8d29a1de6-trusted-ca\") pod \"9ac0b008-cf1a-404c-b5da-a5d8d29a1de6\" (UID: \"9ac0b008-cf1a-404c-b5da-a5d8d29a1de6\") " Jun 02 21:36:51.724360 ip-10-0-138-193 kubenswrapper[2578]: I0602 21:36:51.724273 2578 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/9ac0b008-cf1a-404c-b5da-a5d8d29a1de6-ca-trust-extracted\") pod \"9ac0b008-cf1a-404c-b5da-a5d8d29a1de6\" (UID: \"9ac0b008-cf1a-404c-b5da-a5d8d29a1de6\") " Jun 02 21:36:51.724360 ip-10-0-138-193 kubenswrapper[2578]: I0602 21:36:51.724304 2578 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/9ac0b008-cf1a-404c-b5da-a5d8d29a1de6-registry-certificates\") pod \"9ac0b008-cf1a-404c-b5da-a5d8d29a1de6\" (UID: \"9ac0b008-cf1a-404c-b5da-a5d8d29a1de6\") " Jun 02 21:36:51.725156 ip-10-0-138-193 kubenswrapper[2578]: I0602 21:36:51.725096 2578 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/9ac0b008-cf1a-404c-b5da-a5d8d29a1de6-trusted-ca" (OuterVolumeSpecName: "trusted-ca") pod "9ac0b008-cf1a-404c-b5da-a5d8d29a1de6" (UID: "9ac0b008-cf1a-404c-b5da-a5d8d29a1de6"). InnerVolumeSpecName "trusted-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jun 02 21:36:51.725307 ip-10-0-138-193 kubenswrapper[2578]: I0602 21:36:51.725233 2578 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/9ac0b008-cf1a-404c-b5da-a5d8d29a1de6-registry-certificates" (OuterVolumeSpecName: "registry-certificates") pod "9ac0b008-cf1a-404c-b5da-a5d8d29a1de6" (UID: "9ac0b008-cf1a-404c-b5da-a5d8d29a1de6"). InnerVolumeSpecName "registry-certificates". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jun 02 21:36:51.727068 ip-10-0-138-193 kubenswrapper[2578]: I0602 21:36:51.727022 2578 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/9ac0b008-cf1a-404c-b5da-a5d8d29a1de6-installation-pull-secrets" (OuterVolumeSpecName: "installation-pull-secrets") pod "9ac0b008-cf1a-404c-b5da-a5d8d29a1de6" (UID: "9ac0b008-cf1a-404c-b5da-a5d8d29a1de6"). InnerVolumeSpecName "installation-pull-secrets". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jun 02 21:36:51.727432 ip-10-0-138-193 kubenswrapper[2578]: I0602 21:36:51.727404 2578 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/9ac0b008-cf1a-404c-b5da-a5d8d29a1de6-image-registry-private-configuration" (OuterVolumeSpecName: "image-registry-private-configuration") pod "9ac0b008-cf1a-404c-b5da-a5d8d29a1de6" (UID: "9ac0b008-cf1a-404c-b5da-a5d8d29a1de6"). InnerVolumeSpecName "image-registry-private-configuration". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jun 02 21:36:51.727544 ip-10-0-138-193 kubenswrapper[2578]: I0602 21:36:51.727483 2578 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/9ac0b008-cf1a-404c-b5da-a5d8d29a1de6-registry-tls" (OuterVolumeSpecName: "registry-tls") pod "9ac0b008-cf1a-404c-b5da-a5d8d29a1de6" (UID: "9ac0b008-cf1a-404c-b5da-a5d8d29a1de6"). InnerVolumeSpecName "registry-tls". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 02 21:36:51.727661 ip-10-0-138-193 kubenswrapper[2578]: I0602 21:36:51.727632 2578 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/9ac0b008-cf1a-404c-b5da-a5d8d29a1de6-bound-sa-token" (OuterVolumeSpecName: "bound-sa-token") pod "9ac0b008-cf1a-404c-b5da-a5d8d29a1de6" (UID: "9ac0b008-cf1a-404c-b5da-a5d8d29a1de6"). InnerVolumeSpecName "bound-sa-token". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 02 21:36:51.727956 ip-10-0-138-193 kubenswrapper[2578]: I0602 21:36:51.727914 2578 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/9ac0b008-cf1a-404c-b5da-a5d8d29a1de6-kube-api-access-vrggb" (OuterVolumeSpecName: "kube-api-access-vrggb") pod "9ac0b008-cf1a-404c-b5da-a5d8d29a1de6" (UID: "9ac0b008-cf1a-404c-b5da-a5d8d29a1de6"). InnerVolumeSpecName "kube-api-access-vrggb". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 02 21:36:51.737131 ip-10-0-138-193 kubenswrapper[2578]: I0602 21:36:51.737104 2578 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/9ac0b008-cf1a-404c-b5da-a5d8d29a1de6-ca-trust-extracted" (OuterVolumeSpecName: "ca-trust-extracted") pod "9ac0b008-cf1a-404c-b5da-a5d8d29a1de6" (UID: "9ac0b008-cf1a-404c-b5da-a5d8d29a1de6"). InnerVolumeSpecName "ca-trust-extracted". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jun 02 21:36:51.825574 ip-10-0-138-193 kubenswrapper[2578]: I0602 21:36:51.825469 2578 reconciler_common.go:299] "Volume detached for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/9ac0b008-cf1a-404c-b5da-a5d8d29a1de6-registry-certificates\") on node \"ip-10-0-138-193.ec2.internal\" DevicePath \"\"" Jun 02 21:36:51.825574 ip-10-0-138-193 kubenswrapper[2578]: I0602 21:36:51.825502 2578 reconciler_common.go:299] "Volume detached for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/9ac0b008-cf1a-404c-b5da-a5d8d29a1de6-registry-tls\") on node \"ip-10-0-138-193.ec2.internal\" DevicePath \"\"" Jun 02 21:36:51.825574 ip-10-0-138-193 kubenswrapper[2578]: I0602 21:36:51.825512 2578 reconciler_common.go:299] "Volume detached for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/9ac0b008-cf1a-404c-b5da-a5d8d29a1de6-installation-pull-secrets\") on node \"ip-10-0-138-193.ec2.internal\" DevicePath \"\"" Jun 02 21:36:51.825574 ip-10-0-138-193 kubenswrapper[2578]: I0602 21:36:51.825522 2578 reconciler_common.go:299] "Volume detached for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/9ac0b008-cf1a-404c-b5da-a5d8d29a1de6-image-registry-private-configuration\") on node \"ip-10-0-138-193.ec2.internal\" DevicePath \"\"" Jun 02 21:36:51.825574 ip-10-0-138-193 kubenswrapper[2578]: I0602 21:36:51.825535 2578 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-vrggb\" (UniqueName: \"kubernetes.io/projected/9ac0b008-cf1a-404c-b5da-a5d8d29a1de6-kube-api-access-vrggb\") on node \"ip-10-0-138-193.ec2.internal\" DevicePath \"\"" Jun 02 21:36:51.825574 ip-10-0-138-193 kubenswrapper[2578]: I0602 21:36:51.825549 2578 reconciler_common.go:299] "Volume detached for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/9ac0b008-cf1a-404c-b5da-a5d8d29a1de6-bound-sa-token\") on node \"ip-10-0-138-193.ec2.internal\" DevicePath \"\"" Jun 02 21:36:51.825574 ip-10-0-138-193 kubenswrapper[2578]: I0602 21:36:51.825561 2578 reconciler_common.go:299] "Volume detached for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/9ac0b008-cf1a-404c-b5da-a5d8d29a1de6-trusted-ca\") on node \"ip-10-0-138-193.ec2.internal\" DevicePath \"\"" Jun 02 21:36:51.825574 ip-10-0-138-193 kubenswrapper[2578]: I0602 21:36:51.825574 2578 reconciler_common.go:299] "Volume detached for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/9ac0b008-cf1a-404c-b5da-a5d8d29a1de6-ca-trust-extracted\") on node \"ip-10-0-138-193.ec2.internal\" DevicePath \"\"" Jun 02 21:36:52.008928 ip-10-0-138-193 kubenswrapper[2578]: I0602 21:36:52.008891 2578 generic.go:358] "Generic (PLEG): container finished" podID="9ac0b008-cf1a-404c-b5da-a5d8d29a1de6" containerID="c492475167dc12396d5dbb13e8a7c8ae82e3c2f443c30d4b1158aba1ac43cb8c" exitCode=0 Jun 02 21:36:52.009121 ip-10-0-138-193 kubenswrapper[2578]: I0602 21:36:52.008957 2578 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-86b67cd59c-hgcf6" event={"ID":"9ac0b008-cf1a-404c-b5da-a5d8d29a1de6","Type":"ContainerDied","Data":"c492475167dc12396d5dbb13e8a7c8ae82e3c2f443c30d4b1158aba1ac43cb8c"} Jun 02 21:36:52.009121 ip-10-0-138-193 kubenswrapper[2578]: I0602 21:36:52.008977 2578 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-86b67cd59c-hgcf6" Jun 02 21:36:52.009121 ip-10-0-138-193 kubenswrapper[2578]: I0602 21:36:52.008996 2578 scope.go:117] "RemoveContainer" containerID="c492475167dc12396d5dbb13e8a7c8ae82e3c2f443c30d4b1158aba1ac43cb8c" Jun 02 21:36:52.009121 ip-10-0-138-193 kubenswrapper[2578]: I0602 21:36:52.008986 2578 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-86b67cd59c-hgcf6" event={"ID":"9ac0b008-cf1a-404c-b5da-a5d8d29a1de6","Type":"ContainerDied","Data":"89b870a2d0b612091d23eb9f54f9f7e91ece89324b75eb5520a05bc9c56b540b"} Jun 02 21:36:52.022174 ip-10-0-138-193 kubenswrapper[2578]: I0602 21:36:52.022153 2578 scope.go:117] "RemoveContainer" containerID="c492475167dc12396d5dbb13e8a7c8ae82e3c2f443c30d4b1158aba1ac43cb8c" Jun 02 21:36:52.022437 ip-10-0-138-193 kubenswrapper[2578]: E0602 21:36:52.022416 2578 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"c492475167dc12396d5dbb13e8a7c8ae82e3c2f443c30d4b1158aba1ac43cb8c\": container with ID starting with c492475167dc12396d5dbb13e8a7c8ae82e3c2f443c30d4b1158aba1ac43cb8c not found: ID does not exist" containerID="c492475167dc12396d5dbb13e8a7c8ae82e3c2f443c30d4b1158aba1ac43cb8c" Jun 02 21:36:52.022524 ip-10-0-138-193 kubenswrapper[2578]: I0602 21:36:52.022443 2578 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"c492475167dc12396d5dbb13e8a7c8ae82e3c2f443c30d4b1158aba1ac43cb8c"} err="failed to get container status \"c492475167dc12396d5dbb13e8a7c8ae82e3c2f443c30d4b1158aba1ac43cb8c\": rpc error: code = NotFound desc = could not find container \"c492475167dc12396d5dbb13e8a7c8ae82e3c2f443c30d4b1158aba1ac43cb8c\": container with ID starting with c492475167dc12396d5dbb13e8a7c8ae82e3c2f443c30d4b1158aba1ac43cb8c not found: ID does not exist" Jun 02 21:36:52.032052 ip-10-0-138-193 kubenswrapper[2578]: I0602 21:36:52.032027 2578 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openshift-image-registry/image-registry-86b67cd59c-hgcf6"] Jun 02 21:36:52.035824 ip-10-0-138-193 kubenswrapper[2578]: I0602 21:36:52.035803 2578 kubelet.go:2547] "SyncLoop REMOVE" source="api" pods=["openshift-image-registry/image-registry-86b67cd59c-hgcf6"] Jun 02 21:36:53.323719 ip-10-0-138-193 kubenswrapper[2578]: I0602 21:36:53.323692 2578 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="9ac0b008-cf1a-404c-b5da-a5d8d29a1de6" path="/var/lib/kubelet/pods/9ac0b008-cf1a-404c-b5da-a5d8d29a1de6/volumes" Jun 02 21:36:58.360627 ip-10-0-138-193 kubenswrapper[2578]: I0602 21:36:58.360589 2578 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-console/console-67966c666b-6c9pj"] Jun 02 21:36:58.361107 ip-10-0-138-193 kubenswrapper[2578]: I0602 21:36:58.361031 2578 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="9ac0b008-cf1a-404c-b5da-a5d8d29a1de6" containerName="registry" Jun 02 21:36:58.361107 ip-10-0-138-193 kubenswrapper[2578]: I0602 21:36:58.361053 2578 state_mem.go:107] "Deleted CPUSet assignment" podUID="9ac0b008-cf1a-404c-b5da-a5d8d29a1de6" containerName="registry" Jun 02 21:36:58.361272 ip-10-0-138-193 kubenswrapper[2578]: I0602 21:36:58.361156 2578 memory_manager.go:356] "RemoveStaleState removing state" podUID="9ac0b008-cf1a-404c-b5da-a5d8d29a1de6" containerName="registry" Jun 02 21:36:58.363787 ip-10-0-138-193 kubenswrapper[2578]: I0602 21:36:58.363760 2578 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-67966c666b-6c9pj" Jun 02 21:36:58.368749 ip-10-0-138-193 kubenswrapper[2578]: I0602 21:36:58.368726 2578 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"service-ca\"" Jun 02 21:36:58.370676 ip-10-0-138-193 kubenswrapper[2578]: I0602 21:36:58.370654 2578 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"oauth-serving-cert\"" Jun 02 21:36:58.370773 ip-10-0-138-193 kubenswrapper[2578]: I0602 21:36:58.370700 2578 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-dockercfg-qcs7h\"" Jun 02 21:36:58.370826 ip-10-0-138-193 kubenswrapper[2578]: I0602 21:36:58.370784 2578 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-serving-cert\"" Jun 02 21:36:58.370826 ip-10-0-138-193 kubenswrapper[2578]: I0602 21:36:58.370783 2578 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"console-config\"" Jun 02 21:36:58.371029 ip-10-0-138-193 kubenswrapper[2578]: I0602 21:36:58.370848 2578 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-oauth-config\"" Jun 02 21:36:58.378526 ip-10-0-138-193 kubenswrapper[2578]: I0602 21:36:58.378505 2578 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-67966c666b-6c9pj"] Jun 02 21:36:58.385022 ip-10-0-138-193 kubenswrapper[2578]: I0602 21:36:58.384999 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-tdtf6\" (UniqueName: \"kubernetes.io/projected/b0e24f6d-64ce-4733-a498-800750d26bd6-kube-api-access-tdtf6\") pod \"console-67966c666b-6c9pj\" (UID: \"b0e24f6d-64ce-4733-a498-800750d26bd6\") " pod="openshift-console/console-67966c666b-6c9pj" Jun 02 21:36:58.385146 ip-10-0-138-193 kubenswrapper[2578]: I0602 21:36:58.385038 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/b0e24f6d-64ce-4733-a498-800750d26bd6-console-config\") pod \"console-67966c666b-6c9pj\" (UID: \"b0e24f6d-64ce-4733-a498-800750d26bd6\") " pod="openshift-console/console-67966c666b-6c9pj" Jun 02 21:36:58.385236 ip-10-0-138-193 kubenswrapper[2578]: I0602 21:36:58.385139 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/b0e24f6d-64ce-4733-a498-800750d26bd6-service-ca\") pod \"console-67966c666b-6c9pj\" (UID: \"b0e24f6d-64ce-4733-a498-800750d26bd6\") " pod="openshift-console/console-67966c666b-6c9pj" Jun 02 21:36:58.385236 ip-10-0-138-193 kubenswrapper[2578]: I0602 21:36:58.385196 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/b0e24f6d-64ce-4733-a498-800750d26bd6-console-serving-cert\") pod \"console-67966c666b-6c9pj\" (UID: \"b0e24f6d-64ce-4733-a498-800750d26bd6\") " pod="openshift-console/console-67966c666b-6c9pj" Jun 02 21:36:58.385236 ip-10-0-138-193 kubenswrapper[2578]: I0602 21:36:58.385217 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/b0e24f6d-64ce-4733-a498-800750d26bd6-oauth-serving-cert\") pod \"console-67966c666b-6c9pj\" (UID: \"b0e24f6d-64ce-4733-a498-800750d26bd6\") " pod="openshift-console/console-67966c666b-6c9pj" Jun 02 21:36:58.385396 ip-10-0-138-193 kubenswrapper[2578]: I0602 21:36:58.385248 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/b0e24f6d-64ce-4733-a498-800750d26bd6-console-oauth-config\") pod \"console-67966c666b-6c9pj\" (UID: \"b0e24f6d-64ce-4733-a498-800750d26bd6\") " pod="openshift-console/console-67966c666b-6c9pj" Jun 02 21:36:58.486568 ip-10-0-138-193 kubenswrapper[2578]: I0602 21:36:58.486526 2578 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-tdtf6\" (UniqueName: \"kubernetes.io/projected/b0e24f6d-64ce-4733-a498-800750d26bd6-kube-api-access-tdtf6\") pod \"console-67966c666b-6c9pj\" (UID: \"b0e24f6d-64ce-4733-a498-800750d26bd6\") " pod="openshift-console/console-67966c666b-6c9pj" Jun 02 21:36:58.486754 ip-10-0-138-193 kubenswrapper[2578]: I0602 21:36:58.486592 2578 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/b0e24f6d-64ce-4733-a498-800750d26bd6-console-config\") pod \"console-67966c666b-6c9pj\" (UID: \"b0e24f6d-64ce-4733-a498-800750d26bd6\") " pod="openshift-console/console-67966c666b-6c9pj" Jun 02 21:36:58.486754 ip-10-0-138-193 kubenswrapper[2578]: I0602 21:36:58.486625 2578 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/b0e24f6d-64ce-4733-a498-800750d26bd6-service-ca\") pod \"console-67966c666b-6c9pj\" (UID: \"b0e24f6d-64ce-4733-a498-800750d26bd6\") " pod="openshift-console/console-67966c666b-6c9pj" Jun 02 21:36:58.486754 ip-10-0-138-193 kubenswrapper[2578]: I0602 21:36:58.486654 2578 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/b0e24f6d-64ce-4733-a498-800750d26bd6-console-serving-cert\") pod \"console-67966c666b-6c9pj\" (UID: \"b0e24f6d-64ce-4733-a498-800750d26bd6\") " pod="openshift-console/console-67966c666b-6c9pj" Jun 02 21:36:58.486754 ip-10-0-138-193 kubenswrapper[2578]: I0602 21:36:58.486670 2578 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/b0e24f6d-64ce-4733-a498-800750d26bd6-oauth-serving-cert\") pod \"console-67966c666b-6c9pj\" (UID: \"b0e24f6d-64ce-4733-a498-800750d26bd6\") " pod="openshift-console/console-67966c666b-6c9pj" Jun 02 21:36:58.486967 ip-10-0-138-193 kubenswrapper[2578]: I0602 21:36:58.486881 2578 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/b0e24f6d-64ce-4733-a498-800750d26bd6-console-oauth-config\") pod \"console-67966c666b-6c9pj\" (UID: \"b0e24f6d-64ce-4733-a498-800750d26bd6\") " pod="openshift-console/console-67966c666b-6c9pj" Jun 02 21:36:58.487478 ip-10-0-138-193 kubenswrapper[2578]: I0602 21:36:58.487427 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/b0e24f6d-64ce-4733-a498-800750d26bd6-oauth-serving-cert\") pod \"console-67966c666b-6c9pj\" (UID: \"b0e24f6d-64ce-4733-a498-800750d26bd6\") " pod="openshift-console/console-67966c666b-6c9pj" Jun 02 21:36:58.487478 ip-10-0-138-193 kubenswrapper[2578]: I0602 21:36:58.487427 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/b0e24f6d-64ce-4733-a498-800750d26bd6-service-ca\") pod \"console-67966c666b-6c9pj\" (UID: \"b0e24f6d-64ce-4733-a498-800750d26bd6\") " pod="openshift-console/console-67966c666b-6c9pj" Jun 02 21:36:58.487679 ip-10-0-138-193 kubenswrapper[2578]: I0602 21:36:58.487520 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/b0e24f6d-64ce-4733-a498-800750d26bd6-console-config\") pod \"console-67966c666b-6c9pj\" (UID: \"b0e24f6d-64ce-4733-a498-800750d26bd6\") " pod="openshift-console/console-67966c666b-6c9pj" Jun 02 21:36:58.489967 ip-10-0-138-193 kubenswrapper[2578]: I0602 21:36:58.489945 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/b0e24f6d-64ce-4733-a498-800750d26bd6-console-serving-cert\") pod \"console-67966c666b-6c9pj\" (UID: \"b0e24f6d-64ce-4733-a498-800750d26bd6\") " pod="openshift-console/console-67966c666b-6c9pj" Jun 02 21:36:58.489967 ip-10-0-138-193 kubenswrapper[2578]: I0602 21:36:58.489956 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/b0e24f6d-64ce-4733-a498-800750d26bd6-console-oauth-config\") pod \"console-67966c666b-6c9pj\" (UID: \"b0e24f6d-64ce-4733-a498-800750d26bd6\") " pod="openshift-console/console-67966c666b-6c9pj" Jun 02 21:36:58.495604 ip-10-0-138-193 kubenswrapper[2578]: I0602 21:36:58.495578 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-tdtf6\" (UniqueName: \"kubernetes.io/projected/b0e24f6d-64ce-4733-a498-800750d26bd6-kube-api-access-tdtf6\") pod \"console-67966c666b-6c9pj\" (UID: \"b0e24f6d-64ce-4733-a498-800750d26bd6\") " pod="openshift-console/console-67966c666b-6c9pj" Jun 02 21:36:58.675812 ip-10-0-138-193 kubenswrapper[2578]: I0602 21:36:58.675776 2578 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-67966c666b-6c9pj" Jun 02 21:37:00.170668 ip-10-0-138-193 kubenswrapper[2578]: I0602 21:37:00.170630 2578 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-monitoring/metrics-server-7768f4bdf8-tbc26" Jun 02 21:37:00.171264 ip-10-0-138-193 kubenswrapper[2578]: I0602 21:37:00.170964 2578 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-monitoring/metrics-server-7768f4bdf8-tbc26" Jun 02 21:37:04.800720 ip-10-0-138-193 kubenswrapper[2578]: I0602 21:37:04.800572 2578 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-67966c666b-6c9pj"] Jun 02 21:37:04.802733 ip-10-0-138-193 kubenswrapper[2578]: W0602 21:37:04.802703 2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podb0e24f6d_64ce_4733_a498_800750d26bd6.slice/crio-7b0b30531d586490c72eab41219ef36e0a78bab290e82f06da1e069a1963c057 WatchSource:0}: Error finding container 7b0b30531d586490c72eab41219ef36e0a78bab290e82f06da1e069a1963c057: Status 404 returned error can't find the container with id 7b0b30531d586490c72eab41219ef36e0a78bab290e82f06da1e069a1963c057 Jun 02 21:37:05.051060 ip-10-0-138-193 kubenswrapper[2578]: I0602 21:37:05.050984 2578 generic.go:358] "Generic (PLEG): container finished" podID="e01a3390-21d1-4294-a868-751c800fc665" containerID="89e2f84cd4a4466d2a4b716c20a7bd8dae51c08d1c7ed8fdcfd84ab3faeed60d" exitCode=0 Jun 02 21:37:05.051246 ip-10-0-138-193 kubenswrapper[2578]: I0602 21:37:05.051086 2578 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-operator-788bf58df5-qx7z2" event={"ID":"e01a3390-21d1-4294-a868-751c800fc665","Type":"ContainerDied","Data":"89e2f84cd4a4466d2a4b716c20a7bd8dae51c08d1c7ed8fdcfd84ab3faeed60d"} Jun 02 21:37:05.051465 ip-10-0-138-193 kubenswrapper[2578]: I0602 21:37:05.051447 2578 scope.go:117] "RemoveContainer" containerID="89e2f84cd4a4466d2a4b716c20a7bd8dae51c08d1c7ed8fdcfd84ab3faeed60d" Jun 02 21:37:05.052965 ip-10-0-138-193 kubenswrapper[2578]: I0602 21:37:05.052922 2578 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-67966c666b-6c9pj" event={"ID":"b0e24f6d-64ce-4733-a498-800750d26bd6","Type":"ContainerStarted","Data":"7b0b30531d586490c72eab41219ef36e0a78bab290e82f06da1e069a1963c057"} Jun 02 21:37:05.055692 ip-10-0-138-193 kubenswrapper[2578]: I0602 21:37:05.054583 2578 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-console/downloads-c65b8dc4b-k8cbf" event={"ID":"baba2ed5-2e13-4c51-8936-6b4b8a34ed6a","Type":"ContainerStarted","Data":"5b7eaaacfc715ff8bdf00cb8263712a9120941fb4011c34bae232a651e9c44bf"} Jun 02 21:37:05.055692 ip-10-0-138-193 kubenswrapper[2578]: I0602 21:37:05.055287 2578 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/downloads-c65b8dc4b-k8cbf" Jun 02 21:37:05.071151 ip-10-0-138-193 kubenswrapper[2578]: I0602 21:37:05.071067 2578 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console/downloads-c65b8dc4b-k8cbf" Jun 02 21:37:05.085176 ip-10-0-138-193 kubenswrapper[2578]: I0602 21:37:05.085135 2578 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-console/downloads-c65b8dc4b-k8cbf" podStartSLOduration=1.42627294 podStartE2EDuration="17.085120352s" podCreationTimestamp="2026-06-02 21:36:48 +0000 UTC" firstStartedPulling="2026-06-02 21:36:49.10012672 +0000 UTC m=+186.352024605" lastFinishedPulling="2026-06-02 21:37:04.758974119 +0000 UTC m=+202.010872017" observedRunningTime="2026-06-02 21:37:05.084387293 +0000 UTC m=+202.336285202" watchObservedRunningTime="2026-06-02 21:37:05.085120352 +0000 UTC m=+202.337018258" Jun 02 21:37:06.067306 ip-10-0-138-193 kubenswrapper[2578]: I0602 21:37:06.067054 2578 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-operator-788bf58df5-qx7z2" event={"ID":"e01a3390-21d1-4294-a868-751c800fc665","Type":"ContainerStarted","Data":"01e84059db0d1ceba9bf1fa3a61aa41b61de6784ce651d007bb8194a65db2370"} Jun 02 21:37:06.156525 ip-10-0-138-193 kubenswrapper[2578]: I0602 21:37:06.156277 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress-canary_ingress-canary-7jp8d_39b30769-802d-4bcb-906a-fcbb4eee94b6/serve-healthcheck-canary/0.log" Jun 02 21:37:06.542195 ip-10-0-138-193 kubenswrapper[2578]: I0602 21:37:06.542144 2578 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-console/console-9668769f-vv59c"] Jun 02 21:37:06.549424 ip-10-0-138-193 kubenswrapper[2578]: I0602 21:37:06.548804 2578 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-9668769f-vv59c" Jun 02 21:37:06.561129 ip-10-0-138-193 kubenswrapper[2578]: I0602 21:37:06.560746 2578 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"trusted-ca-bundle\"" Jun 02 21:37:06.562273 ip-10-0-138-193 kubenswrapper[2578]: I0602 21:37:06.562238 2578 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-9668769f-vv59c"] Jun 02 21:37:06.678208 ip-10-0-138-193 kubenswrapper[2578]: I0602 21:37:06.677702 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/96b2dbd7-d125-467b-b055-5868b667f1c6-console-serving-cert\") pod \"console-9668769f-vv59c\" (UID: \"96b2dbd7-d125-467b-b055-5868b667f1c6\") " pod="openshift-console/console-9668769f-vv59c" Jun 02 21:37:06.678208 ip-10-0-138-193 kubenswrapper[2578]: I0602 21:37:06.677768 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/96b2dbd7-d125-467b-b055-5868b667f1c6-console-oauth-config\") pod \"console-9668769f-vv59c\" (UID: \"96b2dbd7-d125-467b-b055-5868b667f1c6\") " pod="openshift-console/console-9668769f-vv59c" Jun 02 21:37:06.678208 ip-10-0-138-193 kubenswrapper[2578]: I0602 21:37:06.677834 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/96b2dbd7-d125-467b-b055-5868b667f1c6-oauth-serving-cert\") pod \"console-9668769f-vv59c\" (UID: \"96b2dbd7-d125-467b-b055-5868b667f1c6\") " pod="openshift-console/console-9668769f-vv59c" Jun 02 21:37:06.678208 ip-10-0-138-193 kubenswrapper[2578]: I0602 21:37:06.677890 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/96b2dbd7-d125-467b-b055-5868b667f1c6-trusted-ca-bundle\") pod \"console-9668769f-vv59c\" (UID: \"96b2dbd7-d125-467b-b055-5868b667f1c6\") " pod="openshift-console/console-9668769f-vv59c" Jun 02 21:37:06.678208 ip-10-0-138-193 kubenswrapper[2578]: I0602 21:37:06.677913 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/96b2dbd7-d125-467b-b055-5868b667f1c6-service-ca\") pod \"console-9668769f-vv59c\" (UID: \"96b2dbd7-d125-467b-b055-5868b667f1c6\") " pod="openshift-console/console-9668769f-vv59c" Jun 02 21:37:06.678208 ip-10-0-138-193 kubenswrapper[2578]: I0602 21:37:06.677949 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/96b2dbd7-d125-467b-b055-5868b667f1c6-console-config\") pod \"console-9668769f-vv59c\" (UID: \"96b2dbd7-d125-467b-b055-5868b667f1c6\") " pod="openshift-console/console-9668769f-vv59c" Jun 02 21:37:06.678208 ip-10-0-138-193 kubenswrapper[2578]: I0602 21:37:06.677972 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-czspl\" (UniqueName: \"kubernetes.io/projected/96b2dbd7-d125-467b-b055-5868b667f1c6-kube-api-access-czspl\") pod \"console-9668769f-vv59c\" (UID: \"96b2dbd7-d125-467b-b055-5868b667f1c6\") " pod="openshift-console/console-9668769f-vv59c" Jun 02 21:37:06.779631 ip-10-0-138-193 kubenswrapper[2578]: I0602 21:37:06.778897 2578 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/96b2dbd7-d125-467b-b055-5868b667f1c6-console-serving-cert\") pod \"console-9668769f-vv59c\" (UID: \"96b2dbd7-d125-467b-b055-5868b667f1c6\") " pod="openshift-console/console-9668769f-vv59c" Jun 02 21:37:06.779631 ip-10-0-138-193 kubenswrapper[2578]: I0602 21:37:06.778967 2578 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/96b2dbd7-d125-467b-b055-5868b667f1c6-console-oauth-config\") pod \"console-9668769f-vv59c\" (UID: \"96b2dbd7-d125-467b-b055-5868b667f1c6\") " pod="openshift-console/console-9668769f-vv59c" Jun 02 21:37:06.779631 ip-10-0-138-193 kubenswrapper[2578]: I0602 21:37:06.779012 2578 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/96b2dbd7-d125-467b-b055-5868b667f1c6-oauth-serving-cert\") pod \"console-9668769f-vv59c\" (UID: \"96b2dbd7-d125-467b-b055-5868b667f1c6\") " pod="openshift-console/console-9668769f-vv59c" Jun 02 21:37:06.779631 ip-10-0-138-193 kubenswrapper[2578]: I0602 21:37:06.779057 2578 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/96b2dbd7-d125-467b-b055-5868b667f1c6-trusted-ca-bundle\") pod \"console-9668769f-vv59c\" (UID: \"96b2dbd7-d125-467b-b055-5868b667f1c6\") " pod="openshift-console/console-9668769f-vv59c" Jun 02 21:37:06.779631 ip-10-0-138-193 kubenswrapper[2578]: I0602 21:37:06.779106 2578 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/96b2dbd7-d125-467b-b055-5868b667f1c6-service-ca\") pod \"console-9668769f-vv59c\" (UID: \"96b2dbd7-d125-467b-b055-5868b667f1c6\") " pod="openshift-console/console-9668769f-vv59c" Jun 02 21:37:06.779631 ip-10-0-138-193 kubenswrapper[2578]: I0602 21:37:06.779146 2578 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/96b2dbd7-d125-467b-b055-5868b667f1c6-console-config\") pod \"console-9668769f-vv59c\" (UID: \"96b2dbd7-d125-467b-b055-5868b667f1c6\") " pod="openshift-console/console-9668769f-vv59c" Jun 02 21:37:06.779631 ip-10-0-138-193 kubenswrapper[2578]: I0602 21:37:06.779171 2578 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-czspl\" (UniqueName: \"kubernetes.io/projected/96b2dbd7-d125-467b-b055-5868b667f1c6-kube-api-access-czspl\") pod \"console-9668769f-vv59c\" (UID: \"96b2dbd7-d125-467b-b055-5868b667f1c6\") " pod="openshift-console/console-9668769f-vv59c" Jun 02 21:37:06.780927 ip-10-0-138-193 kubenswrapper[2578]: I0602 21:37:06.780319 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/96b2dbd7-d125-467b-b055-5868b667f1c6-trusted-ca-bundle\") pod \"console-9668769f-vv59c\" (UID: \"96b2dbd7-d125-467b-b055-5868b667f1c6\") " pod="openshift-console/console-9668769f-vv59c" Jun 02 21:37:06.780927 ip-10-0-138-193 kubenswrapper[2578]: I0602 21:37:06.780879 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/96b2dbd7-d125-467b-b055-5868b667f1c6-console-config\") pod \"console-9668769f-vv59c\" (UID: \"96b2dbd7-d125-467b-b055-5868b667f1c6\") " pod="openshift-console/console-9668769f-vv59c" Jun 02 21:37:06.781701 ip-10-0-138-193 kubenswrapper[2578]: I0602 21:37:06.781658 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/96b2dbd7-d125-467b-b055-5868b667f1c6-oauth-serving-cert\") pod \"console-9668769f-vv59c\" (UID: \"96b2dbd7-d125-467b-b055-5868b667f1c6\") " pod="openshift-console/console-9668769f-vv59c" Jun 02 21:37:06.782458 ip-10-0-138-193 kubenswrapper[2578]: I0602 21:37:06.782430 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/96b2dbd7-d125-467b-b055-5868b667f1c6-console-serving-cert\") pod \"console-9668769f-vv59c\" (UID: \"96b2dbd7-d125-467b-b055-5868b667f1c6\") " pod="openshift-console/console-9668769f-vv59c" Jun 02 21:37:06.784201 ip-10-0-138-193 kubenswrapper[2578]: I0602 21:37:06.784174 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/96b2dbd7-d125-467b-b055-5868b667f1c6-service-ca\") pod \"console-9668769f-vv59c\" (UID: \"96b2dbd7-d125-467b-b055-5868b667f1c6\") " pod="openshift-console/console-9668769f-vv59c" Jun 02 21:37:06.784560 ip-10-0-138-193 kubenswrapper[2578]: I0602 21:37:06.784519 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/96b2dbd7-d125-467b-b055-5868b667f1c6-console-oauth-config\") pod \"console-9668769f-vv59c\" (UID: \"96b2dbd7-d125-467b-b055-5868b667f1c6\") " pod="openshift-console/console-9668769f-vv59c" Jun 02 21:37:06.796690 ip-10-0-138-193 kubenswrapper[2578]: I0602 21:37:06.796600 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-czspl\" (UniqueName: \"kubernetes.io/projected/96b2dbd7-d125-467b-b055-5868b667f1c6-kube-api-access-czspl\") pod \"console-9668769f-vv59c\" (UID: \"96b2dbd7-d125-467b-b055-5868b667f1c6\") " pod="openshift-console/console-9668769f-vv59c" Jun 02 21:37:06.864536 ip-10-0-138-193 kubenswrapper[2578]: I0602 21:37:06.864486 2578 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-9668769f-vv59c" Jun 02 21:37:07.016201 ip-10-0-138-193 kubenswrapper[2578]: I0602 21:37:07.016120 2578 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-9668769f-vv59c"] Jun 02 21:37:08.248867 ip-10-0-138-193 kubenswrapper[2578]: W0602 21:37:08.248829 2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod96b2dbd7_d125_467b_b055_5868b667f1c6.slice/crio-85eace839bb1e8580776140bb99093461ca2ed2e56741e70433924c00c35f976 WatchSource:0}: Error finding container 85eace839bb1e8580776140bb99093461ca2ed2e56741e70433924c00c35f976: Status 404 returned error can't find the container with id 85eace839bb1e8580776140bb99093461ca2ed2e56741e70433924c00c35f976 Jun 02 21:37:09.079441 ip-10-0-138-193 kubenswrapper[2578]: I0602 21:37:09.079401 2578 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-67966c666b-6c9pj" event={"ID":"b0e24f6d-64ce-4733-a498-800750d26bd6","Type":"ContainerStarted","Data":"88f230c9afd0ef92935cb6dd0fa4246e29e654809ae829e5bc9c46131d153a8a"} Jun 02 21:37:09.081210 ip-10-0-138-193 kubenswrapper[2578]: I0602 21:37:09.081169 2578 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-9668769f-vv59c" event={"ID":"96b2dbd7-d125-467b-b055-5868b667f1c6","Type":"ContainerStarted","Data":"ab5ebcd6d3f78bb480e8dde3461e4da90e78d78efcf6a3d7ef7670181adc7d31"} Jun 02 21:37:09.081319 ip-10-0-138-193 kubenswrapper[2578]: I0602 21:37:09.081217 2578 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-9668769f-vv59c" event={"ID":"96b2dbd7-d125-467b-b055-5868b667f1c6","Type":"ContainerStarted","Data":"85eace839bb1e8580776140bb99093461ca2ed2e56741e70433924c00c35f976"} Jun 02 21:37:09.099250 ip-10-0-138-193 kubenswrapper[2578]: I0602 21:37:09.099199 2578 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-console/console-67966c666b-6c9pj" podStartSLOduration=7.257929906 podStartE2EDuration="11.099185138s" podCreationTimestamp="2026-06-02 21:36:58 +0000 UTC" firstStartedPulling="2026-06-02 21:37:04.804577283 +0000 UTC m=+202.056475166" lastFinishedPulling="2026-06-02 21:37:08.645832509 +0000 UTC m=+205.897730398" observedRunningTime="2026-06-02 21:37:09.097810153 +0000 UTC m=+206.349708070" watchObservedRunningTime="2026-06-02 21:37:09.099185138 +0000 UTC m=+206.351083044" Jun 02 21:37:09.114621 ip-10-0-138-193 kubenswrapper[2578]: I0602 21:37:09.114574 2578 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-console/console-9668769f-vv59c" podStartSLOduration=2.577960227 podStartE2EDuration="3.114561673s" podCreationTimestamp="2026-06-02 21:37:06 +0000 UTC" firstStartedPulling="2026-06-02 21:37:08.251232182 +0000 UTC m=+205.503130067" lastFinishedPulling="2026-06-02 21:37:08.787833616 +0000 UTC m=+206.039731513" observedRunningTime="2026-06-02 21:37:09.113896013 +0000 UTC m=+206.365793920" watchObservedRunningTime="2026-06-02 21:37:09.114561673 +0000 UTC m=+206.366459578" Jun 02 21:37:16.865456 ip-10-0-138-193 kubenswrapper[2578]: I0602 21:37:16.865418 2578 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-console/console-9668769f-vv59c" Jun 02 21:37:16.865456 ip-10-0-138-193 kubenswrapper[2578]: I0602 21:37:16.865465 2578 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/console-9668769f-vv59c" Jun 02 21:37:16.870265 ip-10-0-138-193 kubenswrapper[2578]: I0602 21:37:16.870240 2578 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-console/console-9668769f-vv59c" Jun 02 21:37:17.110977 ip-10-0-138-193 kubenswrapper[2578]: I0602 21:37:17.110946 2578 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console/console-9668769f-vv59c" Jun 02 21:37:17.159229 ip-10-0-138-193 kubenswrapper[2578]: I0602 21:37:17.159197 2578 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openshift-console/console-67966c666b-6c9pj"] Jun 02 21:37:18.676948 ip-10-0-138-193 kubenswrapper[2578]: I0602 21:37:18.676909 2578 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/console-67966c666b-6c9pj" Jun 02 21:37:19.117656 ip-10-0-138-193 kubenswrapper[2578]: I0602 21:37:19.117626 2578 generic.go:358] "Generic (PLEG): container finished" podID="3787e4f5-1948-41f9-8b70-28eac6aa5b99" containerID="d1fff42a1d881b1a6091c6f9c1294de7314281d46fbad2320b438b5c12422e75" exitCode=0 Jun 02 21:37:19.117822 ip-10-0-138-193 kubenswrapper[2578]: I0602 21:37:19.117705 2578 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-service-ca-operator/service-ca-operator-69877444c-tnjl6" event={"ID":"3787e4f5-1948-41f9-8b70-28eac6aa5b99","Type":"ContainerDied","Data":"d1fff42a1d881b1a6091c6f9c1294de7314281d46fbad2320b438b5c12422e75"} Jun 02 21:37:19.118205 ip-10-0-138-193 kubenswrapper[2578]: I0602 21:37:19.118184 2578 scope.go:117] "RemoveContainer" containerID="d1fff42a1d881b1a6091c6f9c1294de7314281d46fbad2320b438b5c12422e75" Jun 02 21:37:20.122350 ip-10-0-138-193 kubenswrapper[2578]: I0602 21:37:20.122318 2578 generic.go:358] "Generic (PLEG): container finished" podID="ab209a6c-c2ef-450d-b14d-4f8438dfebfa" containerID="92e9500586ee56775840ef64e8b3b831284aa97e551f073c3746350f7128aa53" exitCode=0 Jun 02 21:37:20.122822 ip-10-0-138-193 kubenswrapper[2578]: I0602 21:37:20.122392 2578 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-96ddc787c-jlmt8" event={"ID":"ab209a6c-c2ef-450d-b14d-4f8438dfebfa","Type":"ContainerDied","Data":"92e9500586ee56775840ef64e8b3b831284aa97e551f073c3746350f7128aa53"} Jun 02 21:37:20.122822 ip-10-0-138-193 kubenswrapper[2578]: I0602 21:37:20.122801 2578 scope.go:117] "RemoveContainer" containerID="92e9500586ee56775840ef64e8b3b831284aa97e551f073c3746350f7128aa53" Jun 02 21:37:20.124016 ip-10-0-138-193 kubenswrapper[2578]: I0602 21:37:20.123994 2578 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-service-ca-operator/service-ca-operator-69877444c-tnjl6" event={"ID":"3787e4f5-1948-41f9-8b70-28eac6aa5b99","Type":"ContainerStarted","Data":"5d6f7ae55fdfdc31aa6dcfce0cafd31f3a1319074a6eb01ad36c5a0c86abb300"} Jun 02 21:37:20.176558 ip-10-0-138-193 kubenswrapper[2578]: I0602 21:37:20.176533 2578 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-monitoring/metrics-server-7768f4bdf8-tbc26" Jun 02 21:37:20.180862 ip-10-0-138-193 kubenswrapper[2578]: I0602 21:37:20.180837 2578 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-monitoring/metrics-server-7768f4bdf8-tbc26" Jun 02 21:37:21.129668 ip-10-0-138-193 kubenswrapper[2578]: I0602 21:37:21.129632 2578 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-96ddc787c-jlmt8" event={"ID":"ab209a6c-c2ef-450d-b14d-4f8438dfebfa","Type":"ContainerStarted","Data":"91a75e9e82ce721974cf4a7160a9d3d5985fad6ac43cf04f0c941c47d50aaca9"} Jun 02 21:37:42.185693 ip-10-0-138-193 kubenswrapper[2578]: I0602 21:37:42.185633 2578 kuberuntime_container.go:864] "Killing container with a grace period" pod="openshift-console/console-67966c666b-6c9pj" podUID="b0e24f6d-64ce-4733-a498-800750d26bd6" containerName="console" containerID="cri-o://88f230c9afd0ef92935cb6dd0fa4246e29e654809ae829e5bc9c46131d153a8a" gracePeriod=15 Jun 02 21:37:42.490807 ip-10-0-138-193 kubenswrapper[2578]: I0602 21:37:42.490776 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console_console-67966c666b-6c9pj_b0e24f6d-64ce-4733-a498-800750d26bd6/console/0.log" Jun 02 21:37:42.490936 ip-10-0-138-193 kubenswrapper[2578]: I0602 21:37:42.490836 2578 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-67966c666b-6c9pj" Jun 02 21:37:42.607936 ip-10-0-138-193 kubenswrapper[2578]: I0602 21:37:42.607901 2578 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/b0e24f6d-64ce-4733-a498-800750d26bd6-oauth-serving-cert\") pod \"b0e24f6d-64ce-4733-a498-800750d26bd6\" (UID: \"b0e24f6d-64ce-4733-a498-800750d26bd6\") " Jun 02 21:37:42.608141 ip-10-0-138-193 kubenswrapper[2578]: I0602 21:37:42.607951 2578 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/b0e24f6d-64ce-4733-a498-800750d26bd6-console-config\") pod \"b0e24f6d-64ce-4733-a498-800750d26bd6\" (UID: \"b0e24f6d-64ce-4733-a498-800750d26bd6\") " Jun 02 21:37:42.608141 ip-10-0-138-193 kubenswrapper[2578]: I0602 21:37:42.607989 2578 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/b0e24f6d-64ce-4733-a498-800750d26bd6-console-serving-cert\") pod \"b0e24f6d-64ce-4733-a498-800750d26bd6\" (UID: \"b0e24f6d-64ce-4733-a498-800750d26bd6\") " Jun 02 21:37:42.608141 ip-10-0-138-193 kubenswrapper[2578]: I0602 21:37:42.608025 2578 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/b0e24f6d-64ce-4733-a498-800750d26bd6-console-oauth-config\") pod \"b0e24f6d-64ce-4733-a498-800750d26bd6\" (UID: \"b0e24f6d-64ce-4733-a498-800750d26bd6\") " Jun 02 21:37:42.608141 ip-10-0-138-193 kubenswrapper[2578]: I0602 21:37:42.608058 2578 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-tdtf6\" (UniqueName: \"kubernetes.io/projected/b0e24f6d-64ce-4733-a498-800750d26bd6-kube-api-access-tdtf6\") pod \"b0e24f6d-64ce-4733-a498-800750d26bd6\" (UID: \"b0e24f6d-64ce-4733-a498-800750d26bd6\") " Jun 02 21:37:42.608369 ip-10-0-138-193 kubenswrapper[2578]: I0602 21:37:42.608189 2578 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/b0e24f6d-64ce-4733-a498-800750d26bd6-service-ca\") pod \"b0e24f6d-64ce-4733-a498-800750d26bd6\" (UID: \"b0e24f6d-64ce-4733-a498-800750d26bd6\") " Jun 02 21:37:42.608460 ip-10-0-138-193 kubenswrapper[2578]: I0602 21:37:42.608434 2578 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/b0e24f6d-64ce-4733-a498-800750d26bd6-console-config" (OuterVolumeSpecName: "console-config") pod "b0e24f6d-64ce-4733-a498-800750d26bd6" (UID: "b0e24f6d-64ce-4733-a498-800750d26bd6"). InnerVolumeSpecName "console-config". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jun 02 21:37:42.608521 ip-10-0-138-193 kubenswrapper[2578]: I0602 21:37:42.608365 2578 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/b0e24f6d-64ce-4733-a498-800750d26bd6-oauth-serving-cert" (OuterVolumeSpecName: "oauth-serving-cert") pod "b0e24f6d-64ce-4733-a498-800750d26bd6" (UID: "b0e24f6d-64ce-4733-a498-800750d26bd6"). InnerVolumeSpecName "oauth-serving-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jun 02 21:37:42.608563 ip-10-0-138-193 kubenswrapper[2578]: I0602 21:37:42.608519 2578 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/b0e24f6d-64ce-4733-a498-800750d26bd6-service-ca" (OuterVolumeSpecName: "service-ca") pod "b0e24f6d-64ce-4733-a498-800750d26bd6" (UID: "b0e24f6d-64ce-4733-a498-800750d26bd6"). InnerVolumeSpecName "service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jun 02 21:37:42.610430 ip-10-0-138-193 kubenswrapper[2578]: I0602 21:37:42.610405 2578 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/b0e24f6d-64ce-4733-a498-800750d26bd6-console-serving-cert" (OuterVolumeSpecName: "console-serving-cert") pod "b0e24f6d-64ce-4733-a498-800750d26bd6" (UID: "b0e24f6d-64ce-4733-a498-800750d26bd6"). InnerVolumeSpecName "console-serving-cert". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jun 02 21:37:42.610561 ip-10-0-138-193 kubenswrapper[2578]: I0602 21:37:42.610426 2578 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/b0e24f6d-64ce-4733-a498-800750d26bd6-kube-api-access-tdtf6" (OuterVolumeSpecName: "kube-api-access-tdtf6") pod "b0e24f6d-64ce-4733-a498-800750d26bd6" (UID: "b0e24f6d-64ce-4733-a498-800750d26bd6"). InnerVolumeSpecName "kube-api-access-tdtf6". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 02 21:37:42.610561 ip-10-0-138-193 kubenswrapper[2578]: I0602 21:37:42.610428 2578 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/b0e24f6d-64ce-4733-a498-800750d26bd6-console-oauth-config" (OuterVolumeSpecName: "console-oauth-config") pod "b0e24f6d-64ce-4733-a498-800750d26bd6" (UID: "b0e24f6d-64ce-4733-a498-800750d26bd6"). InnerVolumeSpecName "console-oauth-config". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jun 02 21:37:42.708976 ip-10-0-138-193 kubenswrapper[2578]: I0602 21:37:42.708940 2578 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-tdtf6\" (UniqueName: \"kubernetes.io/projected/b0e24f6d-64ce-4733-a498-800750d26bd6-kube-api-access-tdtf6\") on node \"ip-10-0-138-193.ec2.internal\" DevicePath \"\"" Jun 02 21:37:42.708976 ip-10-0-138-193 kubenswrapper[2578]: I0602 21:37:42.708970 2578 reconciler_common.go:299] "Volume detached for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/b0e24f6d-64ce-4733-a498-800750d26bd6-service-ca\") on node \"ip-10-0-138-193.ec2.internal\" DevicePath \"\"" Jun 02 21:37:42.708976 ip-10-0-138-193 kubenswrapper[2578]: I0602 21:37:42.708980 2578 reconciler_common.go:299] "Volume detached for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/b0e24f6d-64ce-4733-a498-800750d26bd6-oauth-serving-cert\") on node \"ip-10-0-138-193.ec2.internal\" DevicePath \"\"" Jun 02 21:37:42.709236 ip-10-0-138-193 kubenswrapper[2578]: I0602 21:37:42.708989 2578 reconciler_common.go:299] "Volume detached for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/b0e24f6d-64ce-4733-a498-800750d26bd6-console-config\") on node \"ip-10-0-138-193.ec2.internal\" DevicePath \"\"" Jun 02 21:37:42.709236 ip-10-0-138-193 kubenswrapper[2578]: I0602 21:37:42.708998 2578 reconciler_common.go:299] "Volume detached for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/b0e24f6d-64ce-4733-a498-800750d26bd6-console-serving-cert\") on node \"ip-10-0-138-193.ec2.internal\" DevicePath \"\"" Jun 02 21:37:42.709236 ip-10-0-138-193 kubenswrapper[2578]: I0602 21:37:42.709007 2578 reconciler_common.go:299] "Volume detached for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/b0e24f6d-64ce-4733-a498-800750d26bd6-console-oauth-config\") on node \"ip-10-0-138-193.ec2.internal\" DevicePath \"\"" Jun 02 21:37:43.191246 ip-10-0-138-193 kubenswrapper[2578]: I0602 21:37:43.191223 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console_console-67966c666b-6c9pj_b0e24f6d-64ce-4733-a498-800750d26bd6/console/0.log" Jun 02 21:37:43.191513 ip-10-0-138-193 kubenswrapper[2578]: I0602 21:37:43.191265 2578 generic.go:358] "Generic (PLEG): container finished" podID="b0e24f6d-64ce-4733-a498-800750d26bd6" containerID="88f230c9afd0ef92935cb6dd0fa4246e29e654809ae829e5bc9c46131d153a8a" exitCode=2 Jun 02 21:37:43.191513 ip-10-0-138-193 kubenswrapper[2578]: I0602 21:37:43.191332 2578 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-67966c666b-6c9pj" Jun 02 21:37:43.191513 ip-10-0-138-193 kubenswrapper[2578]: I0602 21:37:43.191354 2578 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-67966c666b-6c9pj" event={"ID":"b0e24f6d-64ce-4733-a498-800750d26bd6","Type":"ContainerDied","Data":"88f230c9afd0ef92935cb6dd0fa4246e29e654809ae829e5bc9c46131d153a8a"} Jun 02 21:37:43.191513 ip-10-0-138-193 kubenswrapper[2578]: I0602 21:37:43.191395 2578 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-67966c666b-6c9pj" event={"ID":"b0e24f6d-64ce-4733-a498-800750d26bd6","Type":"ContainerDied","Data":"7b0b30531d586490c72eab41219ef36e0a78bab290e82f06da1e069a1963c057"} Jun 02 21:37:43.191513 ip-10-0-138-193 kubenswrapper[2578]: I0602 21:37:43.191415 2578 scope.go:117] "RemoveContainer" containerID="88f230c9afd0ef92935cb6dd0fa4246e29e654809ae829e5bc9c46131d153a8a" Jun 02 21:37:43.200667 ip-10-0-138-193 kubenswrapper[2578]: I0602 21:37:43.200650 2578 scope.go:117] "RemoveContainer" containerID="88f230c9afd0ef92935cb6dd0fa4246e29e654809ae829e5bc9c46131d153a8a" Jun 02 21:37:43.201112 ip-10-0-138-193 kubenswrapper[2578]: E0602 21:37:43.200916 2578 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"88f230c9afd0ef92935cb6dd0fa4246e29e654809ae829e5bc9c46131d153a8a\": container with ID starting with 88f230c9afd0ef92935cb6dd0fa4246e29e654809ae829e5bc9c46131d153a8a not found: ID does not exist" containerID="88f230c9afd0ef92935cb6dd0fa4246e29e654809ae829e5bc9c46131d153a8a" Jun 02 21:37:43.201112 ip-10-0-138-193 kubenswrapper[2578]: I0602 21:37:43.200941 2578 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"88f230c9afd0ef92935cb6dd0fa4246e29e654809ae829e5bc9c46131d153a8a"} err="failed to get container status \"88f230c9afd0ef92935cb6dd0fa4246e29e654809ae829e5bc9c46131d153a8a\": rpc error: code = NotFound desc = could not find container \"88f230c9afd0ef92935cb6dd0fa4246e29e654809ae829e5bc9c46131d153a8a\": container with ID starting with 88f230c9afd0ef92935cb6dd0fa4246e29e654809ae829e5bc9c46131d153a8a not found: ID does not exist" Jun 02 21:37:43.214622 ip-10-0-138-193 kubenswrapper[2578]: I0602 21:37:43.214594 2578 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openshift-console/console-67966c666b-6c9pj"] Jun 02 21:37:43.218111 ip-10-0-138-193 kubenswrapper[2578]: I0602 21:37:43.218066 2578 kubelet.go:2547] "SyncLoop REMOVE" source="api" pods=["openshift-console/console-67966c666b-6c9pj"] Jun 02 21:37:43.321779 ip-10-0-138-193 kubenswrapper[2578]: I0602 21:37:43.321749 2578 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="b0e24f6d-64ce-4733-a498-800750d26bd6" path="/var/lib/kubelet/pods/b0e24f6d-64ce-4733-a498-800750d26bd6/volumes" Jun 02 21:37:55.018609 ip-10-0-138-193 kubenswrapper[2578]: I0602 21:37:55.018505 2578 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/adfce93b-f07e-480a-af26-5dc7df23fa48-metrics-certs\") pod \"network-metrics-daemon-k2vdd\" (UID: \"adfce93b-f07e-480a-af26-5dc7df23fa48\") " pod="openshift-multus/network-metrics-daemon-k2vdd" Jun 02 21:37:55.020832 ip-10-0-138-193 kubenswrapper[2578]: I0602 21:37:55.020808 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/adfce93b-f07e-480a-af26-5dc7df23fa48-metrics-certs\") pod \"network-metrics-daemon-k2vdd\" (UID: \"adfce93b-f07e-480a-af26-5dc7df23fa48\") " pod="openshift-multus/network-metrics-daemon-k2vdd" Jun 02 21:37:55.320679 ip-10-0-138-193 kubenswrapper[2578]: I0602 21:37:55.320579 2578 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-sa-dockercfg-4s2f5\"" Jun 02 21:37:55.328560 ip-10-0-138-193 kubenswrapper[2578]: I0602 21:37:55.328534 2578 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-k2vdd" Jun 02 21:37:55.454616 ip-10-0-138-193 kubenswrapper[2578]: I0602 21:37:55.454591 2578 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-multus/network-metrics-daemon-k2vdd"] Jun 02 21:37:55.456774 ip-10-0-138-193 kubenswrapper[2578]: W0602 21:37:55.456747 2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podadfce93b_f07e_480a_af26_5dc7df23fa48.slice/crio-51b98fa3bc9b8253966669445ae006f78eb44b5dc47fb874392fb23764f88156 WatchSource:0}: Error finding container 51b98fa3bc9b8253966669445ae006f78eb44b5dc47fb874392fb23764f88156: Status 404 returned error can't find the container with id 51b98fa3bc9b8253966669445ae006f78eb44b5dc47fb874392fb23764f88156 Jun 02 21:37:55.583641 ip-10-0-138-193 kubenswrapper[2578]: I0602 21:37:55.583552 2578 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openshift-monitoring/alertmanager-main-0"] Jun 02 21:37:55.584039 ip-10-0-138-193 kubenswrapper[2578]: I0602 21:37:55.583996 2578 kuberuntime_container.go:864] "Killing container with a grace period" pod="openshift-monitoring/alertmanager-main-0" podUID="baa4d909-6719-4060-8b71-ae4ef3dd2372" containerName="alertmanager" containerID="cri-o://37a189c94cd2d9e909b97eda3a53be4138ca864b588b9e0ab05cea7c84f7e2f3" gracePeriod=120 Jun 02 21:37:55.584124 ip-10-0-138-193 kubenswrapper[2578]: I0602 21:37:55.584055 2578 kuberuntime_container.go:864] "Killing container with a grace period" pod="openshift-monitoring/alertmanager-main-0" podUID="baa4d909-6719-4060-8b71-ae4ef3dd2372" containerName="kube-rbac-proxy-metric" containerID="cri-o://cf9d8861d397be33bbd242293ebe2436f230fba70f1596ebcbe3190cf41dbc89" gracePeriod=120 Jun 02 21:37:55.584192 ip-10-0-138-193 kubenswrapper[2578]: I0602 21:37:55.584127 2578 kuberuntime_container.go:864] "Killing container with a grace period" pod="openshift-monitoring/alertmanager-main-0" podUID="baa4d909-6719-4060-8b71-ae4ef3dd2372" containerName="kube-rbac-proxy-web" containerID="cri-o://a8df779c28dd05b8c732b3cb399dd1e97cd377c224a781e1c6570f193f35ec32" gracePeriod=120 Jun 02 21:37:55.584192 ip-10-0-138-193 kubenswrapper[2578]: I0602 21:37:55.584134 2578 kuberuntime_container.go:864] "Killing container with a grace period" pod="openshift-monitoring/alertmanager-main-0" podUID="baa4d909-6719-4060-8b71-ae4ef3dd2372" containerName="prom-label-proxy" containerID="cri-o://e7950e75fcaff43cd167693105597dfcb046b010bede7a64f19757954a1ce74b" gracePeriod=120 Jun 02 21:37:55.584290 ip-10-0-138-193 kubenswrapper[2578]: I0602 21:37:55.584172 2578 kuberuntime_container.go:864] "Killing container with a grace period" pod="openshift-monitoring/alertmanager-main-0" podUID="baa4d909-6719-4060-8b71-ae4ef3dd2372" containerName="config-reloader" containerID="cri-o://a608358a144306b7e58b1c0a1de2e5f9ce65338c8cc53e7f0f517c6dd9625844" gracePeriod=120 Jun 02 21:37:55.584290 ip-10-0-138-193 kubenswrapper[2578]: I0602 21:37:55.584172 2578 kuberuntime_container.go:864] "Killing container with a grace period" pod="openshift-monitoring/alertmanager-main-0" podUID="baa4d909-6719-4060-8b71-ae4ef3dd2372" containerName="kube-rbac-proxy" containerID="cri-o://ea7f8c5fff268e06f4e55fb748ce5e2474f31fb6972422ea2719f0ff2caa7742" gracePeriod=120 Jun 02 21:37:56.234432 ip-10-0-138-193 kubenswrapper[2578]: I0602 21:37:56.234388 2578 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-k2vdd" event={"ID":"adfce93b-f07e-480a-af26-5dc7df23fa48","Type":"ContainerStarted","Data":"51b98fa3bc9b8253966669445ae006f78eb44b5dc47fb874392fb23764f88156"} Jun 02 21:37:56.237848 ip-10-0-138-193 kubenswrapper[2578]: I0602 21:37:56.237818 2578 generic.go:358] "Generic (PLEG): container finished" podID="baa4d909-6719-4060-8b71-ae4ef3dd2372" containerID="e7950e75fcaff43cd167693105597dfcb046b010bede7a64f19757954a1ce74b" exitCode=0 Jun 02 21:37:56.237848 ip-10-0-138-193 kubenswrapper[2578]: I0602 21:37:56.237844 2578 generic.go:358] "Generic (PLEG): container finished" podID="baa4d909-6719-4060-8b71-ae4ef3dd2372" containerID="ea7f8c5fff268e06f4e55fb748ce5e2474f31fb6972422ea2719f0ff2caa7742" exitCode=0 Jun 02 21:37:56.237848 ip-10-0-138-193 kubenswrapper[2578]: I0602 21:37:56.237850 2578 generic.go:358] "Generic (PLEG): container finished" podID="baa4d909-6719-4060-8b71-ae4ef3dd2372" containerID="a608358a144306b7e58b1c0a1de2e5f9ce65338c8cc53e7f0f517c6dd9625844" exitCode=0 Jun 02 21:37:56.237848 ip-10-0-138-193 kubenswrapper[2578]: I0602 21:37:56.237856 2578 generic.go:358] "Generic (PLEG): container finished" podID="baa4d909-6719-4060-8b71-ae4ef3dd2372" containerID="37a189c94cd2d9e909b97eda3a53be4138ca864b588b9e0ab05cea7c84f7e2f3" exitCode=0 Jun 02 21:37:56.238124 ip-10-0-138-193 kubenswrapper[2578]: I0602 21:37:56.237893 2578 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"baa4d909-6719-4060-8b71-ae4ef3dd2372","Type":"ContainerDied","Data":"e7950e75fcaff43cd167693105597dfcb046b010bede7a64f19757954a1ce74b"} Jun 02 21:37:56.238124 ip-10-0-138-193 kubenswrapper[2578]: I0602 21:37:56.237928 2578 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"baa4d909-6719-4060-8b71-ae4ef3dd2372","Type":"ContainerDied","Data":"ea7f8c5fff268e06f4e55fb748ce5e2474f31fb6972422ea2719f0ff2caa7742"} Jun 02 21:37:56.238124 ip-10-0-138-193 kubenswrapper[2578]: I0602 21:37:56.237942 2578 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"baa4d909-6719-4060-8b71-ae4ef3dd2372","Type":"ContainerDied","Data":"a608358a144306b7e58b1c0a1de2e5f9ce65338c8cc53e7f0f517c6dd9625844"} Jun 02 21:37:56.238124 ip-10-0-138-193 kubenswrapper[2578]: I0602 21:37:56.237955 2578 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"baa4d909-6719-4060-8b71-ae4ef3dd2372","Type":"ContainerDied","Data":"37a189c94cd2d9e909b97eda3a53be4138ca864b588b9e0ab05cea7c84f7e2f3"} Jun 02 21:37:56.819211 ip-10-0-138-193 kubenswrapper[2578]: I0602 21:37:56.819187 2578 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/alertmanager-main-0" Jun 02 21:37:56.934218 ip-10-0-138-193 kubenswrapper[2578]: I0602 21:37:56.934178 2578 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/baa4d909-6719-4060-8b71-ae4ef3dd2372-alertmanager-main-db\") pod \"baa4d909-6719-4060-8b71-ae4ef3dd2372\" (UID: \"baa4d909-6719-4060-8b71-ae4ef3dd2372\") " Jun 02 21:37:56.934394 ip-10-0-138-193 kubenswrapper[2578]: I0602 21:37:56.934237 2578 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/baa4d909-6719-4060-8b71-ae4ef3dd2372-config-out\") pod \"baa4d909-6719-4060-8b71-ae4ef3dd2372\" (UID: \"baa4d909-6719-4060-8b71-ae4ef3dd2372\") " Jun 02 21:37:56.934394 ip-10-0-138-193 kubenswrapper[2578]: I0602 21:37:56.934254 2578 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/baa4d909-6719-4060-8b71-ae4ef3dd2372-tls-assets\") pod \"baa4d909-6719-4060-8b71-ae4ef3dd2372\" (UID: \"baa4d909-6719-4060-8b71-ae4ef3dd2372\") " Jun 02 21:37:56.934394 ip-10-0-138-193 kubenswrapper[2578]: I0602 21:37:56.934271 2578 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/baa4d909-6719-4060-8b71-ae4ef3dd2372-alertmanager-trusted-ca-bundle\") pod \"baa4d909-6719-4060-8b71-ae4ef3dd2372\" (UID: \"baa4d909-6719-4060-8b71-ae4ef3dd2372\") " Jun 02 21:37:56.934394 ip-10-0-138-193 kubenswrapper[2578]: I0602 21:37:56.934295 2578 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/baa4d909-6719-4060-8b71-ae4ef3dd2372-secret-alertmanager-kube-rbac-proxy-web\") pod \"baa4d909-6719-4060-8b71-ae4ef3dd2372\" (UID: \"baa4d909-6719-4060-8b71-ae4ef3dd2372\") " Jun 02 21:37:56.934394 ip-10-0-138-193 kubenswrapper[2578]: I0602 21:37:56.934322 2578 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/baa4d909-6719-4060-8b71-ae4ef3dd2372-metrics-client-ca\") pod \"baa4d909-6719-4060-8b71-ae4ef3dd2372\" (UID: \"baa4d909-6719-4060-8b71-ae4ef3dd2372\") " Jun 02 21:37:56.934655 ip-10-0-138-193 kubenswrapper[2578]: I0602 21:37:56.934404 2578 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-t2kbc\" (UniqueName: \"kubernetes.io/projected/baa4d909-6719-4060-8b71-ae4ef3dd2372-kube-api-access-t2kbc\") pod \"baa4d909-6719-4060-8b71-ae4ef3dd2372\" (UID: \"baa4d909-6719-4060-8b71-ae4ef3dd2372\") " Jun 02 21:37:56.934655 ip-10-0-138-193 kubenswrapper[2578]: I0602 21:37:56.934452 2578 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/baa4d909-6719-4060-8b71-ae4ef3dd2372-secret-alertmanager-kube-rbac-proxy-metric\") pod \"baa4d909-6719-4060-8b71-ae4ef3dd2372\" (UID: \"baa4d909-6719-4060-8b71-ae4ef3dd2372\") " Jun 02 21:37:56.934655 ip-10-0-138-193 kubenswrapper[2578]: I0602 21:37:56.934485 2578 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/baa4d909-6719-4060-8b71-ae4ef3dd2372-config-volume\") pod \"baa4d909-6719-4060-8b71-ae4ef3dd2372\" (UID: \"baa4d909-6719-4060-8b71-ae4ef3dd2372\") " Jun 02 21:37:56.934655 ip-10-0-138-193 kubenswrapper[2578]: I0602 21:37:56.934547 2578 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/baa4d909-6719-4060-8b71-ae4ef3dd2372-secret-alertmanager-kube-rbac-proxy\") pod \"baa4d909-6719-4060-8b71-ae4ef3dd2372\" (UID: \"baa4d909-6719-4060-8b71-ae4ef3dd2372\") " Jun 02 21:37:56.934655 ip-10-0-138-193 kubenswrapper[2578]: I0602 21:37:56.934580 2578 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/baa4d909-6719-4060-8b71-ae4ef3dd2372-web-config\") pod \"baa4d909-6719-4060-8b71-ae4ef3dd2372\" (UID: \"baa4d909-6719-4060-8b71-ae4ef3dd2372\") " Jun 02 21:37:56.934655 ip-10-0-138-193 kubenswrapper[2578]: I0602 21:37:56.934539 2578 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/baa4d909-6719-4060-8b71-ae4ef3dd2372-alertmanager-main-db" (OuterVolumeSpecName: "alertmanager-main-db") pod "baa4d909-6719-4060-8b71-ae4ef3dd2372" (UID: "baa4d909-6719-4060-8b71-ae4ef3dd2372"). InnerVolumeSpecName "alertmanager-main-db". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jun 02 21:37:56.934655 ip-10-0-138-193 kubenswrapper[2578]: I0602 21:37:56.934610 2578 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/baa4d909-6719-4060-8b71-ae4ef3dd2372-cluster-tls-config\") pod \"baa4d909-6719-4060-8b71-ae4ef3dd2372\" (UID: \"baa4d909-6719-4060-8b71-ae4ef3dd2372\") " Jun 02 21:37:56.934655 ip-10-0-138-193 kubenswrapper[2578]: I0602 21:37:56.934645 2578 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/baa4d909-6719-4060-8b71-ae4ef3dd2372-secret-alertmanager-main-tls\") pod \"baa4d909-6719-4060-8b71-ae4ef3dd2372\" (UID: \"baa4d909-6719-4060-8b71-ae4ef3dd2372\") " Jun 02 21:37:56.935042 ip-10-0-138-193 kubenswrapper[2578]: I0602 21:37:56.934663 2578 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/baa4d909-6719-4060-8b71-ae4ef3dd2372-alertmanager-trusted-ca-bundle" (OuterVolumeSpecName: "alertmanager-trusted-ca-bundle") pod "baa4d909-6719-4060-8b71-ae4ef3dd2372" (UID: "baa4d909-6719-4060-8b71-ae4ef3dd2372"). InnerVolumeSpecName "alertmanager-trusted-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jun 02 21:37:56.935042 ip-10-0-138-193 kubenswrapper[2578]: I0602 21:37:56.934694 2578 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/baa4d909-6719-4060-8b71-ae4ef3dd2372-metrics-client-ca" (OuterVolumeSpecName: "metrics-client-ca") pod "baa4d909-6719-4060-8b71-ae4ef3dd2372" (UID: "baa4d909-6719-4060-8b71-ae4ef3dd2372"). InnerVolumeSpecName "metrics-client-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jun 02 21:37:56.935042 ip-10-0-138-193 kubenswrapper[2578]: I0602 21:37:56.934897 2578 reconciler_common.go:299] "Volume detached for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/baa4d909-6719-4060-8b71-ae4ef3dd2372-alertmanager-main-db\") on node \"ip-10-0-138-193.ec2.internal\" DevicePath \"\"" Jun 02 21:37:56.935042 ip-10-0-138-193 kubenswrapper[2578]: I0602 21:37:56.934920 2578 reconciler_common.go:299] "Volume detached for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/baa4d909-6719-4060-8b71-ae4ef3dd2372-alertmanager-trusted-ca-bundle\") on node \"ip-10-0-138-193.ec2.internal\" DevicePath \"\"" Jun 02 21:37:56.935042 ip-10-0-138-193 kubenswrapper[2578]: I0602 21:37:56.934942 2578 reconciler_common.go:299] "Volume detached for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/baa4d909-6719-4060-8b71-ae4ef3dd2372-metrics-client-ca\") on node \"ip-10-0-138-193.ec2.internal\" DevicePath \"\"" Jun 02 21:37:56.937446 ip-10-0-138-193 kubenswrapper[2578]: I0602 21:37:56.937417 2578 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/baa4d909-6719-4060-8b71-ae4ef3dd2372-config-volume" (OuterVolumeSpecName: "config-volume") pod "baa4d909-6719-4060-8b71-ae4ef3dd2372" (UID: "baa4d909-6719-4060-8b71-ae4ef3dd2372"). InnerVolumeSpecName "config-volume". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jun 02 21:37:56.937885 ip-10-0-138-193 kubenswrapper[2578]: I0602 21:37:56.937844 2578 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/baa4d909-6719-4060-8b71-ae4ef3dd2372-config-out" (OuterVolumeSpecName: "config-out") pod "baa4d909-6719-4060-8b71-ae4ef3dd2372" (UID: "baa4d909-6719-4060-8b71-ae4ef3dd2372"). InnerVolumeSpecName "config-out". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jun 02 21:37:56.938004 ip-10-0-138-193 kubenswrapper[2578]: I0602 21:37:56.937884 2578 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/baa4d909-6719-4060-8b71-ae4ef3dd2372-secret-alertmanager-main-tls" (OuterVolumeSpecName: "secret-alertmanager-main-tls") pod "baa4d909-6719-4060-8b71-ae4ef3dd2372" (UID: "baa4d909-6719-4060-8b71-ae4ef3dd2372"). InnerVolumeSpecName "secret-alertmanager-main-tls". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jun 02 21:37:56.938004 ip-10-0-138-193 kubenswrapper[2578]: I0602 21:37:56.937979 2578 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/baa4d909-6719-4060-8b71-ae4ef3dd2372-secret-alertmanager-kube-rbac-proxy-metric" (OuterVolumeSpecName: "secret-alertmanager-kube-rbac-proxy-metric") pod "baa4d909-6719-4060-8b71-ae4ef3dd2372" (UID: "baa4d909-6719-4060-8b71-ae4ef3dd2372"). InnerVolumeSpecName "secret-alertmanager-kube-rbac-proxy-metric". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jun 02 21:37:56.938198 ip-10-0-138-193 kubenswrapper[2578]: I0602 21:37:56.938155 2578 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/baa4d909-6719-4060-8b71-ae4ef3dd2372-secret-alertmanager-kube-rbac-proxy" (OuterVolumeSpecName: "secret-alertmanager-kube-rbac-proxy") pod "baa4d909-6719-4060-8b71-ae4ef3dd2372" (UID: "baa4d909-6719-4060-8b71-ae4ef3dd2372"). InnerVolumeSpecName "secret-alertmanager-kube-rbac-proxy". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jun 02 21:37:56.938307 ip-10-0-138-193 kubenswrapper[2578]: I0602 21:37:56.938280 2578 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/baa4d909-6719-4060-8b71-ae4ef3dd2372-kube-api-access-t2kbc" (OuterVolumeSpecName: "kube-api-access-t2kbc") pod "baa4d909-6719-4060-8b71-ae4ef3dd2372" (UID: "baa4d909-6719-4060-8b71-ae4ef3dd2372"). InnerVolumeSpecName "kube-api-access-t2kbc". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 02 21:37:56.938388 ip-10-0-138-193 kubenswrapper[2578]: I0602 21:37:56.938362 2578 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/baa4d909-6719-4060-8b71-ae4ef3dd2372-tls-assets" (OuterVolumeSpecName: "tls-assets") pod "baa4d909-6719-4060-8b71-ae4ef3dd2372" (UID: "baa4d909-6719-4060-8b71-ae4ef3dd2372"). InnerVolumeSpecName "tls-assets". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 02 21:37:56.938610 ip-10-0-138-193 kubenswrapper[2578]: I0602 21:37:56.938590 2578 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/baa4d909-6719-4060-8b71-ae4ef3dd2372-secret-alertmanager-kube-rbac-proxy-web" (OuterVolumeSpecName: "secret-alertmanager-kube-rbac-proxy-web") pod "baa4d909-6719-4060-8b71-ae4ef3dd2372" (UID: "baa4d909-6719-4060-8b71-ae4ef3dd2372"). InnerVolumeSpecName "secret-alertmanager-kube-rbac-proxy-web". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jun 02 21:37:56.941685 ip-10-0-138-193 kubenswrapper[2578]: I0602 21:37:56.941659 2578 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/baa4d909-6719-4060-8b71-ae4ef3dd2372-cluster-tls-config" (OuterVolumeSpecName: "cluster-tls-config") pod "baa4d909-6719-4060-8b71-ae4ef3dd2372" (UID: "baa4d909-6719-4060-8b71-ae4ef3dd2372"). InnerVolumeSpecName "cluster-tls-config". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jun 02 21:37:56.948054 ip-10-0-138-193 kubenswrapper[2578]: I0602 21:37:56.948032 2578 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/baa4d909-6719-4060-8b71-ae4ef3dd2372-web-config" (OuterVolumeSpecName: "web-config") pod "baa4d909-6719-4060-8b71-ae4ef3dd2372" (UID: "baa4d909-6719-4060-8b71-ae4ef3dd2372"). InnerVolumeSpecName "web-config". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jun 02 21:37:57.035600 ip-10-0-138-193 kubenswrapper[2578]: I0602 21:37:57.035571 2578 reconciler_common.go:299] "Volume detached for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/baa4d909-6719-4060-8b71-ae4ef3dd2372-secret-alertmanager-kube-rbac-proxy\") on node \"ip-10-0-138-193.ec2.internal\" DevicePath \"\"" Jun 02 21:37:57.035751 ip-10-0-138-193 kubenswrapper[2578]: I0602 21:37:57.035603 2578 reconciler_common.go:299] "Volume detached for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/baa4d909-6719-4060-8b71-ae4ef3dd2372-web-config\") on node \"ip-10-0-138-193.ec2.internal\" DevicePath \"\"" Jun 02 21:37:57.035751 ip-10-0-138-193 kubenswrapper[2578]: I0602 21:37:57.035619 2578 reconciler_common.go:299] "Volume detached for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/baa4d909-6719-4060-8b71-ae4ef3dd2372-cluster-tls-config\") on node \"ip-10-0-138-193.ec2.internal\" DevicePath \"\"" Jun 02 21:37:57.035751 ip-10-0-138-193 kubenswrapper[2578]: I0602 21:37:57.035632 2578 reconciler_common.go:299] "Volume detached for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/baa4d909-6719-4060-8b71-ae4ef3dd2372-secret-alertmanager-main-tls\") on node \"ip-10-0-138-193.ec2.internal\" DevicePath \"\"" Jun 02 21:37:57.035751 ip-10-0-138-193 kubenswrapper[2578]: I0602 21:37:57.035645 2578 reconciler_common.go:299] "Volume detached for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/baa4d909-6719-4060-8b71-ae4ef3dd2372-config-out\") on node \"ip-10-0-138-193.ec2.internal\" DevicePath \"\"" Jun 02 21:37:57.035751 ip-10-0-138-193 kubenswrapper[2578]: I0602 21:37:57.035658 2578 reconciler_common.go:299] "Volume detached for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/baa4d909-6719-4060-8b71-ae4ef3dd2372-tls-assets\") on node \"ip-10-0-138-193.ec2.internal\" DevicePath \"\"" Jun 02 21:37:57.035751 ip-10-0-138-193 kubenswrapper[2578]: I0602 21:37:57.035670 2578 reconciler_common.go:299] "Volume detached for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/baa4d909-6719-4060-8b71-ae4ef3dd2372-secret-alertmanager-kube-rbac-proxy-web\") on node \"ip-10-0-138-193.ec2.internal\" DevicePath \"\"" Jun 02 21:37:57.035751 ip-10-0-138-193 kubenswrapper[2578]: I0602 21:37:57.035682 2578 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-t2kbc\" (UniqueName: \"kubernetes.io/projected/baa4d909-6719-4060-8b71-ae4ef3dd2372-kube-api-access-t2kbc\") on node \"ip-10-0-138-193.ec2.internal\" DevicePath \"\"" Jun 02 21:37:57.035751 ip-10-0-138-193 kubenswrapper[2578]: I0602 21:37:57.035695 2578 reconciler_common.go:299] "Volume detached for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/baa4d909-6719-4060-8b71-ae4ef3dd2372-secret-alertmanager-kube-rbac-proxy-metric\") on node \"ip-10-0-138-193.ec2.internal\" DevicePath \"\"" Jun 02 21:37:57.035751 ip-10-0-138-193 kubenswrapper[2578]: I0602 21:37:57.035710 2578 reconciler_common.go:299] "Volume detached for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/baa4d909-6719-4060-8b71-ae4ef3dd2372-config-volume\") on node \"ip-10-0-138-193.ec2.internal\" DevicePath \"\"" Jun 02 21:37:57.242944 ip-10-0-138-193 kubenswrapper[2578]: I0602 21:37:57.242902 2578 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-k2vdd" event={"ID":"adfce93b-f07e-480a-af26-5dc7df23fa48","Type":"ContainerStarted","Data":"a40e667b8c8665a7242f02debb8e4e8bda915163dc59e923f13b4b9d70f51939"} Jun 02 21:37:57.242944 ip-10-0-138-193 kubenswrapper[2578]: I0602 21:37:57.242949 2578 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-k2vdd" event={"ID":"adfce93b-f07e-480a-af26-5dc7df23fa48","Type":"ContainerStarted","Data":"0280d84235ffb08c993de3b4cc48775eb8fbf936ca78d7c032886f21339b68fd"} Jun 02 21:37:57.245538 ip-10-0-138-193 kubenswrapper[2578]: I0602 21:37:57.245510 2578 generic.go:358] "Generic (PLEG): container finished" podID="baa4d909-6719-4060-8b71-ae4ef3dd2372" containerID="cf9d8861d397be33bbd242293ebe2436f230fba70f1596ebcbe3190cf41dbc89" exitCode=0 Jun 02 21:37:57.245538 ip-10-0-138-193 kubenswrapper[2578]: I0602 21:37:57.245538 2578 generic.go:358] "Generic (PLEG): container finished" podID="baa4d909-6719-4060-8b71-ae4ef3dd2372" containerID="a8df779c28dd05b8c732b3cb399dd1e97cd377c224a781e1c6570f193f35ec32" exitCode=0 Jun 02 21:37:57.245672 ip-10-0-138-193 kubenswrapper[2578]: I0602 21:37:57.245593 2578 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"baa4d909-6719-4060-8b71-ae4ef3dd2372","Type":"ContainerDied","Data":"cf9d8861d397be33bbd242293ebe2436f230fba70f1596ebcbe3190cf41dbc89"} Jun 02 21:37:57.245672 ip-10-0-138-193 kubenswrapper[2578]: I0602 21:37:57.245631 2578 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/alertmanager-main-0" Jun 02 21:37:57.245672 ip-10-0-138-193 kubenswrapper[2578]: I0602 21:37:57.245642 2578 scope.go:117] "RemoveContainer" containerID="e7950e75fcaff43cd167693105597dfcb046b010bede7a64f19757954a1ce74b" Jun 02 21:37:57.245781 ip-10-0-138-193 kubenswrapper[2578]: I0602 21:37:57.245632 2578 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"baa4d909-6719-4060-8b71-ae4ef3dd2372","Type":"ContainerDied","Data":"a8df779c28dd05b8c732b3cb399dd1e97cd377c224a781e1c6570f193f35ec32"} Jun 02 21:37:57.245831 ip-10-0-138-193 kubenswrapper[2578]: I0602 21:37:57.245775 2578 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"baa4d909-6719-4060-8b71-ae4ef3dd2372","Type":"ContainerDied","Data":"f573d96be1a6b565e76d531fc9edf3bae241aafb1ad5efaec559878a86380f3c"} Jun 02 21:37:57.253246 ip-10-0-138-193 kubenswrapper[2578]: I0602 21:37:57.253148 2578 scope.go:117] "RemoveContainer" containerID="cf9d8861d397be33bbd242293ebe2436f230fba70f1596ebcbe3190cf41dbc89" Jun 02 21:37:57.260348 ip-10-0-138-193 kubenswrapper[2578]: I0602 21:37:57.260309 2578 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-multus/network-metrics-daemon-k2vdd" podStartSLOduration=253.303746195 podStartE2EDuration="4m14.260295892s" podCreationTimestamp="2026-06-02 21:33:43 +0000 UTC" firstStartedPulling="2026-06-02 21:37:55.458571799 +0000 UTC m=+252.710469682" lastFinishedPulling="2026-06-02 21:37:56.415121482 +0000 UTC m=+253.667019379" observedRunningTime="2026-06-02 21:37:57.258453739 +0000 UTC m=+254.510351646" watchObservedRunningTime="2026-06-02 21:37:57.260295892 +0000 UTC m=+254.512193797" Jun 02 21:37:57.260984 ip-10-0-138-193 kubenswrapper[2578]: I0602 21:37:57.260968 2578 scope.go:117] "RemoveContainer" containerID="ea7f8c5fff268e06f4e55fb748ce5e2474f31fb6972422ea2719f0ff2caa7742" Jun 02 21:37:57.267977 ip-10-0-138-193 kubenswrapper[2578]: I0602 21:37:57.267961 2578 scope.go:117] "RemoveContainer" containerID="a8df779c28dd05b8c732b3cb399dd1e97cd377c224a781e1c6570f193f35ec32" Jun 02 21:37:57.274608 ip-10-0-138-193 kubenswrapper[2578]: I0602 21:37:57.274536 2578 scope.go:117] "RemoveContainer" containerID="a608358a144306b7e58b1c0a1de2e5f9ce65338c8cc53e7f0f517c6dd9625844" Jun 02 21:37:57.275974 ip-10-0-138-193 kubenswrapper[2578]: I0602 21:37:57.275909 2578 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openshift-monitoring/alertmanager-main-0"] Jun 02 21:37:57.278194 ip-10-0-138-193 kubenswrapper[2578]: I0602 21:37:57.278172 2578 kubelet.go:2547] "SyncLoop REMOVE" source="api" pods=["openshift-monitoring/alertmanager-main-0"] Jun 02 21:37:57.282290 ip-10-0-138-193 kubenswrapper[2578]: I0602 21:37:57.282270 2578 scope.go:117] "RemoveContainer" containerID="37a189c94cd2d9e909b97eda3a53be4138ca864b588b9e0ab05cea7c84f7e2f3" Jun 02 21:37:57.288571 ip-10-0-138-193 kubenswrapper[2578]: I0602 21:37:57.288553 2578 scope.go:117] "RemoveContainer" containerID="52584b7ff07887f3a236b6d4446414c286c6dd83c9bf5f84e145329f89395f86" Jun 02 21:37:57.294966 ip-10-0-138-193 kubenswrapper[2578]: I0602 21:37:57.294950 2578 scope.go:117] "RemoveContainer" containerID="e7950e75fcaff43cd167693105597dfcb046b010bede7a64f19757954a1ce74b" Jun 02 21:37:57.295240 ip-10-0-138-193 kubenswrapper[2578]: E0602 21:37:57.295222 2578 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"e7950e75fcaff43cd167693105597dfcb046b010bede7a64f19757954a1ce74b\": container with ID starting with e7950e75fcaff43cd167693105597dfcb046b010bede7a64f19757954a1ce74b not found: ID does not exist" containerID="e7950e75fcaff43cd167693105597dfcb046b010bede7a64f19757954a1ce74b" Jun 02 21:37:57.295302 ip-10-0-138-193 kubenswrapper[2578]: I0602 21:37:57.295248 2578 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"e7950e75fcaff43cd167693105597dfcb046b010bede7a64f19757954a1ce74b"} err="failed to get container status \"e7950e75fcaff43cd167693105597dfcb046b010bede7a64f19757954a1ce74b\": rpc error: code = NotFound desc = could not find container \"e7950e75fcaff43cd167693105597dfcb046b010bede7a64f19757954a1ce74b\": container with ID starting with e7950e75fcaff43cd167693105597dfcb046b010bede7a64f19757954a1ce74b not found: ID does not exist" Jun 02 21:37:57.295302 ip-10-0-138-193 kubenswrapper[2578]: I0602 21:37:57.295266 2578 scope.go:117] "RemoveContainer" containerID="cf9d8861d397be33bbd242293ebe2436f230fba70f1596ebcbe3190cf41dbc89" Jun 02 21:37:57.295507 ip-10-0-138-193 kubenswrapper[2578]: E0602 21:37:57.295490 2578 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"cf9d8861d397be33bbd242293ebe2436f230fba70f1596ebcbe3190cf41dbc89\": container with ID starting with cf9d8861d397be33bbd242293ebe2436f230fba70f1596ebcbe3190cf41dbc89 not found: ID does not exist" containerID="cf9d8861d397be33bbd242293ebe2436f230fba70f1596ebcbe3190cf41dbc89" Jun 02 21:37:57.295567 ip-10-0-138-193 kubenswrapper[2578]: I0602 21:37:57.295517 2578 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"cf9d8861d397be33bbd242293ebe2436f230fba70f1596ebcbe3190cf41dbc89"} err="failed to get container status \"cf9d8861d397be33bbd242293ebe2436f230fba70f1596ebcbe3190cf41dbc89\": rpc error: code = NotFound desc = could not find container \"cf9d8861d397be33bbd242293ebe2436f230fba70f1596ebcbe3190cf41dbc89\": container with ID starting with cf9d8861d397be33bbd242293ebe2436f230fba70f1596ebcbe3190cf41dbc89 not found: ID does not exist" Jun 02 21:37:57.295567 ip-10-0-138-193 kubenswrapper[2578]: I0602 21:37:57.295542 2578 scope.go:117] "RemoveContainer" containerID="ea7f8c5fff268e06f4e55fb748ce5e2474f31fb6972422ea2719f0ff2caa7742" Jun 02 21:37:57.295781 ip-10-0-138-193 kubenswrapper[2578]: E0602 21:37:57.295763 2578 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"ea7f8c5fff268e06f4e55fb748ce5e2474f31fb6972422ea2719f0ff2caa7742\": container with ID starting with ea7f8c5fff268e06f4e55fb748ce5e2474f31fb6972422ea2719f0ff2caa7742 not found: ID does not exist" containerID="ea7f8c5fff268e06f4e55fb748ce5e2474f31fb6972422ea2719f0ff2caa7742" Jun 02 21:37:57.295817 ip-10-0-138-193 kubenswrapper[2578]: I0602 21:37:57.295786 2578 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"ea7f8c5fff268e06f4e55fb748ce5e2474f31fb6972422ea2719f0ff2caa7742"} err="failed to get container status \"ea7f8c5fff268e06f4e55fb748ce5e2474f31fb6972422ea2719f0ff2caa7742\": rpc error: code = NotFound desc = could not find container \"ea7f8c5fff268e06f4e55fb748ce5e2474f31fb6972422ea2719f0ff2caa7742\": container with ID starting with ea7f8c5fff268e06f4e55fb748ce5e2474f31fb6972422ea2719f0ff2caa7742 not found: ID does not exist" Jun 02 21:37:57.295817 ip-10-0-138-193 kubenswrapper[2578]: I0602 21:37:57.295801 2578 scope.go:117] "RemoveContainer" containerID="a8df779c28dd05b8c732b3cb399dd1e97cd377c224a781e1c6570f193f35ec32" Jun 02 21:37:57.296015 ip-10-0-138-193 kubenswrapper[2578]: E0602 21:37:57.295996 2578 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"a8df779c28dd05b8c732b3cb399dd1e97cd377c224a781e1c6570f193f35ec32\": container with ID starting with a8df779c28dd05b8c732b3cb399dd1e97cd377c224a781e1c6570f193f35ec32 not found: ID does not exist" containerID="a8df779c28dd05b8c732b3cb399dd1e97cd377c224a781e1c6570f193f35ec32" Jun 02 21:37:57.296056 ip-10-0-138-193 kubenswrapper[2578]: I0602 21:37:57.296020 2578 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"a8df779c28dd05b8c732b3cb399dd1e97cd377c224a781e1c6570f193f35ec32"} err="failed to get container status \"a8df779c28dd05b8c732b3cb399dd1e97cd377c224a781e1c6570f193f35ec32\": rpc error: code = NotFound desc = could not find container \"a8df779c28dd05b8c732b3cb399dd1e97cd377c224a781e1c6570f193f35ec32\": container with ID starting with a8df779c28dd05b8c732b3cb399dd1e97cd377c224a781e1c6570f193f35ec32 not found: ID does not exist" Jun 02 21:37:57.296056 ip-10-0-138-193 kubenswrapper[2578]: I0602 21:37:57.296035 2578 scope.go:117] "RemoveContainer" containerID="a608358a144306b7e58b1c0a1de2e5f9ce65338c8cc53e7f0f517c6dd9625844" Jun 02 21:37:57.296279 ip-10-0-138-193 kubenswrapper[2578]: E0602 21:37:57.296263 2578 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"a608358a144306b7e58b1c0a1de2e5f9ce65338c8cc53e7f0f517c6dd9625844\": container with ID starting with a608358a144306b7e58b1c0a1de2e5f9ce65338c8cc53e7f0f517c6dd9625844 not found: ID does not exist" containerID="a608358a144306b7e58b1c0a1de2e5f9ce65338c8cc53e7f0f517c6dd9625844" Jun 02 21:37:57.296340 ip-10-0-138-193 kubenswrapper[2578]: I0602 21:37:57.296286 2578 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"a608358a144306b7e58b1c0a1de2e5f9ce65338c8cc53e7f0f517c6dd9625844"} err="failed to get container status \"a608358a144306b7e58b1c0a1de2e5f9ce65338c8cc53e7f0f517c6dd9625844\": rpc error: code = NotFound desc = could not find container \"a608358a144306b7e58b1c0a1de2e5f9ce65338c8cc53e7f0f517c6dd9625844\": container with ID starting with a608358a144306b7e58b1c0a1de2e5f9ce65338c8cc53e7f0f517c6dd9625844 not found: ID does not exist" Jun 02 21:37:57.296340 ip-10-0-138-193 kubenswrapper[2578]: I0602 21:37:57.296309 2578 scope.go:117] "RemoveContainer" containerID="37a189c94cd2d9e909b97eda3a53be4138ca864b588b9e0ab05cea7c84f7e2f3" Jun 02 21:37:57.296531 ip-10-0-138-193 kubenswrapper[2578]: E0602 21:37:57.296516 2578 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"37a189c94cd2d9e909b97eda3a53be4138ca864b588b9e0ab05cea7c84f7e2f3\": container with ID starting with 37a189c94cd2d9e909b97eda3a53be4138ca864b588b9e0ab05cea7c84f7e2f3 not found: ID does not exist" containerID="37a189c94cd2d9e909b97eda3a53be4138ca864b588b9e0ab05cea7c84f7e2f3" Jun 02 21:37:57.296571 ip-10-0-138-193 kubenswrapper[2578]: I0602 21:37:57.296535 2578 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"37a189c94cd2d9e909b97eda3a53be4138ca864b588b9e0ab05cea7c84f7e2f3"} err="failed to get container status \"37a189c94cd2d9e909b97eda3a53be4138ca864b588b9e0ab05cea7c84f7e2f3\": rpc error: code = NotFound desc = could not find container \"37a189c94cd2d9e909b97eda3a53be4138ca864b588b9e0ab05cea7c84f7e2f3\": container with ID starting with 37a189c94cd2d9e909b97eda3a53be4138ca864b588b9e0ab05cea7c84f7e2f3 not found: ID does not exist" Jun 02 21:37:57.296571 ip-10-0-138-193 kubenswrapper[2578]: I0602 21:37:57.296550 2578 scope.go:117] "RemoveContainer" containerID="52584b7ff07887f3a236b6d4446414c286c6dd83c9bf5f84e145329f89395f86" Jun 02 21:37:57.296732 ip-10-0-138-193 kubenswrapper[2578]: E0602 21:37:57.296715 2578 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"52584b7ff07887f3a236b6d4446414c286c6dd83c9bf5f84e145329f89395f86\": container with ID starting with 52584b7ff07887f3a236b6d4446414c286c6dd83c9bf5f84e145329f89395f86 not found: ID does not exist" containerID="52584b7ff07887f3a236b6d4446414c286c6dd83c9bf5f84e145329f89395f86" Jun 02 21:37:57.296781 ip-10-0-138-193 kubenswrapper[2578]: I0602 21:37:57.296738 2578 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"52584b7ff07887f3a236b6d4446414c286c6dd83c9bf5f84e145329f89395f86"} err="failed to get container status \"52584b7ff07887f3a236b6d4446414c286c6dd83c9bf5f84e145329f89395f86\": rpc error: code = NotFound desc = could not find container \"52584b7ff07887f3a236b6d4446414c286c6dd83c9bf5f84e145329f89395f86\": container with ID starting with 52584b7ff07887f3a236b6d4446414c286c6dd83c9bf5f84e145329f89395f86 not found: ID does not exist" Jun 02 21:37:57.296781 ip-10-0-138-193 kubenswrapper[2578]: I0602 21:37:57.296752 2578 scope.go:117] "RemoveContainer" containerID="e7950e75fcaff43cd167693105597dfcb046b010bede7a64f19757954a1ce74b" Jun 02 21:37:57.296932 ip-10-0-138-193 kubenswrapper[2578]: I0602 21:37:57.296916 2578 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"e7950e75fcaff43cd167693105597dfcb046b010bede7a64f19757954a1ce74b"} err="failed to get container status \"e7950e75fcaff43cd167693105597dfcb046b010bede7a64f19757954a1ce74b\": rpc error: code = NotFound desc = could not find container \"e7950e75fcaff43cd167693105597dfcb046b010bede7a64f19757954a1ce74b\": container with ID starting with e7950e75fcaff43cd167693105597dfcb046b010bede7a64f19757954a1ce74b not found: ID does not exist" Jun 02 21:37:57.296932 ip-10-0-138-193 kubenswrapper[2578]: I0602 21:37:57.296931 2578 scope.go:117] "RemoveContainer" containerID="cf9d8861d397be33bbd242293ebe2436f230fba70f1596ebcbe3190cf41dbc89" Jun 02 21:37:57.297192 ip-10-0-138-193 kubenswrapper[2578]: I0602 21:37:57.297162 2578 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"cf9d8861d397be33bbd242293ebe2436f230fba70f1596ebcbe3190cf41dbc89"} err="failed to get container status \"cf9d8861d397be33bbd242293ebe2436f230fba70f1596ebcbe3190cf41dbc89\": rpc error: code = NotFound desc = could not find container \"cf9d8861d397be33bbd242293ebe2436f230fba70f1596ebcbe3190cf41dbc89\": container with ID starting with cf9d8861d397be33bbd242293ebe2436f230fba70f1596ebcbe3190cf41dbc89 not found: ID does not exist" Jun 02 21:37:57.297192 ip-10-0-138-193 kubenswrapper[2578]: I0602 21:37:57.297185 2578 scope.go:117] "RemoveContainer" containerID="ea7f8c5fff268e06f4e55fb748ce5e2474f31fb6972422ea2719f0ff2caa7742" Jun 02 21:37:57.297381 ip-10-0-138-193 kubenswrapper[2578]: I0602 21:37:57.297364 2578 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"ea7f8c5fff268e06f4e55fb748ce5e2474f31fb6972422ea2719f0ff2caa7742"} err="failed to get container status \"ea7f8c5fff268e06f4e55fb748ce5e2474f31fb6972422ea2719f0ff2caa7742\": rpc error: code = NotFound desc = could not find container \"ea7f8c5fff268e06f4e55fb748ce5e2474f31fb6972422ea2719f0ff2caa7742\": container with ID starting with ea7f8c5fff268e06f4e55fb748ce5e2474f31fb6972422ea2719f0ff2caa7742 not found: ID does not exist" Jun 02 21:37:57.297381 ip-10-0-138-193 kubenswrapper[2578]: I0602 21:37:57.297381 2578 scope.go:117] "RemoveContainer" containerID="a8df779c28dd05b8c732b3cb399dd1e97cd377c224a781e1c6570f193f35ec32" Jun 02 21:37:57.297549 ip-10-0-138-193 kubenswrapper[2578]: I0602 21:37:57.297534 2578 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"a8df779c28dd05b8c732b3cb399dd1e97cd377c224a781e1c6570f193f35ec32"} err="failed to get container status \"a8df779c28dd05b8c732b3cb399dd1e97cd377c224a781e1c6570f193f35ec32\": rpc error: code = NotFound desc = could not find container \"a8df779c28dd05b8c732b3cb399dd1e97cd377c224a781e1c6570f193f35ec32\": container with ID starting with a8df779c28dd05b8c732b3cb399dd1e97cd377c224a781e1c6570f193f35ec32 not found: ID does not exist" Jun 02 21:37:57.297592 ip-10-0-138-193 kubenswrapper[2578]: I0602 21:37:57.297549 2578 scope.go:117] "RemoveContainer" containerID="a608358a144306b7e58b1c0a1de2e5f9ce65338c8cc53e7f0f517c6dd9625844" Jun 02 21:37:57.297734 ip-10-0-138-193 kubenswrapper[2578]: I0602 21:37:57.297720 2578 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"a608358a144306b7e58b1c0a1de2e5f9ce65338c8cc53e7f0f517c6dd9625844"} err="failed to get container status \"a608358a144306b7e58b1c0a1de2e5f9ce65338c8cc53e7f0f517c6dd9625844\": rpc error: code = NotFound desc = could not find container \"a608358a144306b7e58b1c0a1de2e5f9ce65338c8cc53e7f0f517c6dd9625844\": container with ID starting with a608358a144306b7e58b1c0a1de2e5f9ce65338c8cc53e7f0f517c6dd9625844 not found: ID does not exist" Jun 02 21:37:57.297734 ip-10-0-138-193 kubenswrapper[2578]: I0602 21:37:57.297734 2578 scope.go:117] "RemoveContainer" containerID="37a189c94cd2d9e909b97eda3a53be4138ca864b588b9e0ab05cea7c84f7e2f3" Jun 02 21:37:57.297918 ip-10-0-138-193 kubenswrapper[2578]: I0602 21:37:57.297903 2578 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"37a189c94cd2d9e909b97eda3a53be4138ca864b588b9e0ab05cea7c84f7e2f3"} err="failed to get container status \"37a189c94cd2d9e909b97eda3a53be4138ca864b588b9e0ab05cea7c84f7e2f3\": rpc error: code = NotFound desc = could not find container \"37a189c94cd2d9e909b97eda3a53be4138ca864b588b9e0ab05cea7c84f7e2f3\": container with ID starting with 37a189c94cd2d9e909b97eda3a53be4138ca864b588b9e0ab05cea7c84f7e2f3 not found: ID does not exist" Jun 02 21:37:57.297961 ip-10-0-138-193 kubenswrapper[2578]: I0602 21:37:57.297918 2578 scope.go:117] "RemoveContainer" containerID="52584b7ff07887f3a236b6d4446414c286c6dd83c9bf5f84e145329f89395f86" Jun 02 21:37:57.298163 ip-10-0-138-193 kubenswrapper[2578]: I0602 21:37:57.298145 2578 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"52584b7ff07887f3a236b6d4446414c286c6dd83c9bf5f84e145329f89395f86"} err="failed to get container status \"52584b7ff07887f3a236b6d4446414c286c6dd83c9bf5f84e145329f89395f86\": rpc error: code = NotFound desc = could not find container \"52584b7ff07887f3a236b6d4446414c286c6dd83c9bf5f84e145329f89395f86\": container with ID starting with 52584b7ff07887f3a236b6d4446414c286c6dd83c9bf5f84e145329f89395f86 not found: ID does not exist" Jun 02 21:37:57.311689 ip-10-0-138-193 kubenswrapper[2578]: I0602 21:37:57.311667 2578 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-monitoring/alertmanager-main-0"] Jun 02 21:37:57.311966 ip-10-0-138-193 kubenswrapper[2578]: I0602 21:37:57.311952 2578 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="baa4d909-6719-4060-8b71-ae4ef3dd2372" containerName="prom-label-proxy" Jun 02 21:37:57.312022 ip-10-0-138-193 kubenswrapper[2578]: I0602 21:37:57.311969 2578 state_mem.go:107] "Deleted CPUSet assignment" podUID="baa4d909-6719-4060-8b71-ae4ef3dd2372" containerName="prom-label-proxy" Jun 02 21:37:57.312022 ip-10-0-138-193 kubenswrapper[2578]: I0602 21:37:57.311992 2578 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="baa4d909-6719-4060-8b71-ae4ef3dd2372" containerName="kube-rbac-proxy" Jun 02 21:37:57.312022 ip-10-0-138-193 kubenswrapper[2578]: I0602 21:37:57.312000 2578 state_mem.go:107] "Deleted CPUSet assignment" podUID="baa4d909-6719-4060-8b71-ae4ef3dd2372" containerName="kube-rbac-proxy" Jun 02 21:37:57.312022 ip-10-0-138-193 kubenswrapper[2578]: I0602 21:37:57.312008 2578 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="baa4d909-6719-4060-8b71-ae4ef3dd2372" containerName="alertmanager" Jun 02 21:37:57.312022 ip-10-0-138-193 kubenswrapper[2578]: I0602 21:37:57.312013 2578 state_mem.go:107] "Deleted CPUSet assignment" podUID="baa4d909-6719-4060-8b71-ae4ef3dd2372" containerName="alertmanager" Jun 02 21:37:57.312022 ip-10-0-138-193 kubenswrapper[2578]: I0602 21:37:57.312020 2578 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="baa4d909-6719-4060-8b71-ae4ef3dd2372" containerName="config-reloader" Jun 02 21:37:57.312251 ip-10-0-138-193 kubenswrapper[2578]: I0602 21:37:57.312027 2578 state_mem.go:107] "Deleted CPUSet assignment" podUID="baa4d909-6719-4060-8b71-ae4ef3dd2372" containerName="config-reloader" Jun 02 21:37:57.312251 ip-10-0-138-193 kubenswrapper[2578]: I0602 21:37:57.312038 2578 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="b0e24f6d-64ce-4733-a498-800750d26bd6" containerName="console" Jun 02 21:37:57.312251 ip-10-0-138-193 kubenswrapper[2578]: I0602 21:37:57.312043 2578 state_mem.go:107] "Deleted CPUSet assignment" podUID="b0e24f6d-64ce-4733-a498-800750d26bd6" containerName="console" Jun 02 21:37:57.312251 ip-10-0-138-193 kubenswrapper[2578]: I0602 21:37:57.312050 2578 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="baa4d909-6719-4060-8b71-ae4ef3dd2372" containerName="init-config-reloader" Jun 02 21:37:57.312251 ip-10-0-138-193 kubenswrapper[2578]: I0602 21:37:57.312056 2578 state_mem.go:107] "Deleted CPUSet assignment" podUID="baa4d909-6719-4060-8b71-ae4ef3dd2372" containerName="init-config-reloader" Jun 02 21:37:57.312251 ip-10-0-138-193 kubenswrapper[2578]: I0602 21:37:57.312062 2578 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="baa4d909-6719-4060-8b71-ae4ef3dd2372" containerName="kube-rbac-proxy-web" Jun 02 21:37:57.312251 ip-10-0-138-193 kubenswrapper[2578]: I0602 21:37:57.312067 2578 state_mem.go:107] "Deleted CPUSet assignment" podUID="baa4d909-6719-4060-8b71-ae4ef3dd2372" containerName="kube-rbac-proxy-web" Jun 02 21:37:57.312251 ip-10-0-138-193 kubenswrapper[2578]: I0602 21:37:57.312087 2578 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="baa4d909-6719-4060-8b71-ae4ef3dd2372" containerName="kube-rbac-proxy-metric" Jun 02 21:37:57.312251 ip-10-0-138-193 kubenswrapper[2578]: I0602 21:37:57.312094 2578 state_mem.go:107] "Deleted CPUSet assignment" podUID="baa4d909-6719-4060-8b71-ae4ef3dd2372" containerName="kube-rbac-proxy-metric" Jun 02 21:37:57.312251 ip-10-0-138-193 kubenswrapper[2578]: I0602 21:37:57.312144 2578 memory_manager.go:356] "RemoveStaleState removing state" podUID="baa4d909-6719-4060-8b71-ae4ef3dd2372" containerName="kube-rbac-proxy-web" Jun 02 21:37:57.312251 ip-10-0-138-193 kubenswrapper[2578]: I0602 21:37:57.312152 2578 memory_manager.go:356] "RemoveStaleState removing state" podUID="baa4d909-6719-4060-8b71-ae4ef3dd2372" containerName="alertmanager" Jun 02 21:37:57.312251 ip-10-0-138-193 kubenswrapper[2578]: I0602 21:37:57.312159 2578 memory_manager.go:356] "RemoveStaleState removing state" podUID="baa4d909-6719-4060-8b71-ae4ef3dd2372" containerName="config-reloader" Jun 02 21:37:57.312251 ip-10-0-138-193 kubenswrapper[2578]: I0602 21:37:57.312165 2578 memory_manager.go:356] "RemoveStaleState removing state" podUID="baa4d909-6719-4060-8b71-ae4ef3dd2372" containerName="kube-rbac-proxy" Jun 02 21:37:57.312251 ip-10-0-138-193 kubenswrapper[2578]: I0602 21:37:57.312173 2578 memory_manager.go:356] "RemoveStaleState removing state" podUID="baa4d909-6719-4060-8b71-ae4ef3dd2372" containerName="prom-label-proxy" Jun 02 21:37:57.312251 ip-10-0-138-193 kubenswrapper[2578]: I0602 21:37:57.312180 2578 memory_manager.go:356] "RemoveStaleState removing state" podUID="baa4d909-6719-4060-8b71-ae4ef3dd2372" containerName="kube-rbac-proxy-metric" Jun 02 21:37:57.312251 ip-10-0-138-193 kubenswrapper[2578]: I0602 21:37:57.312186 2578 memory_manager.go:356] "RemoveStaleState removing state" podUID="b0e24f6d-64ce-4733-a498-800750d26bd6" containerName="console" Jun 02 21:37:57.315752 ip-10-0-138-193 kubenswrapper[2578]: I0602 21:37:57.315738 2578 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/alertmanager-main-0" Jun 02 21:37:57.319394 ip-10-0-138-193 kubenswrapper[2578]: I0602 21:37:57.319370 2578 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-kube-rbac-proxy\"" Jun 02 21:37:57.319645 ip-10-0-138-193 kubenswrapper[2578]: I0602 21:37:57.319614 2578 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-tls-assets-0\"" Jun 02 21:37:57.319742 ip-10-0-138-193 kubenswrapper[2578]: I0602 21:37:57.319645 2578 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-kube-rbac-proxy-web\"" Jun 02 21:37:57.319742 ip-10-0-138-193 kubenswrapper[2578]: I0602 21:37:57.319660 2578 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-generated\"" Jun 02 21:37:57.320236 ip-10-0-138-193 kubenswrapper[2578]: I0602 21:37:57.320176 2578 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-cluster-tls-config\"" Jun 02 21:37:57.320440 ip-10-0-138-193 kubenswrapper[2578]: I0602 21:37:57.320423 2578 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-tls\"" Jun 02 21:37:57.320672 ip-10-0-138-193 kubenswrapper[2578]: I0602 21:37:57.320640 2578 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-web-config\"" Jun 02 21:37:57.321065 ip-10-0-138-193 kubenswrapper[2578]: I0602 21:37:57.321048 2578 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-dockercfg-l86hw\"" Jun 02 21:37:57.321187 ip-10-0-138-193 kubenswrapper[2578]: I0602 21:37:57.321105 2578 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-kube-rbac-proxy-metric\"" Jun 02 21:37:57.322866 ip-10-0-138-193 kubenswrapper[2578]: I0602 21:37:57.322704 2578 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="baa4d909-6719-4060-8b71-ae4ef3dd2372" path="/var/lib/kubelet/pods/baa4d909-6719-4060-8b71-ae4ef3dd2372/volumes" Jun 02 21:37:57.338958 ip-10-0-138-193 kubenswrapper[2578]: I0602 21:37:57.338936 2578 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"alertmanager-trusted-ca-bundle\"" Jun 02 21:37:57.342011 ip-10-0-138-193 kubenswrapper[2578]: I0602 21:37:57.341988 2578 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/alertmanager-main-0"] Jun 02 21:37:57.438834 ip-10-0-138-193 kubenswrapper[2578]: I0602 21:37:57.438787 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/a98d84f5-9c2b-4da3-9f4c-d1a076b46567-web-config\") pod \"alertmanager-main-0\" (UID: \"a98d84f5-9c2b-4da3-9f4c-d1a076b46567\") " pod="openshift-monitoring/alertmanager-main-0" Jun 02 21:37:57.438834 ip-10-0-138-193 kubenswrapper[2578]: I0602 21:37:57.438840 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/a98d84f5-9c2b-4da3-9f4c-d1a076b46567-alertmanager-main-db\") pod \"alertmanager-main-0\" (UID: \"a98d84f5-9c2b-4da3-9f4c-d1a076b46567\") " pod="openshift-monitoring/alertmanager-main-0" Jun 02 21:37:57.439059 ip-10-0-138-193 kubenswrapper[2578]: I0602 21:37:57.438868 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/a98d84f5-9c2b-4da3-9f4c-d1a076b46567-secret-alertmanager-main-tls\") pod \"alertmanager-main-0\" (UID: \"a98d84f5-9c2b-4da3-9f4c-d1a076b46567\") " pod="openshift-monitoring/alertmanager-main-0" Jun 02 21:37:57.439059 ip-10-0-138-193 kubenswrapper[2578]: I0602 21:37:57.438921 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/a98d84f5-9c2b-4da3-9f4c-d1a076b46567-tls-assets\") pod \"alertmanager-main-0\" (UID: \"a98d84f5-9c2b-4da3-9f4c-d1a076b46567\") " pod="openshift-monitoring/alertmanager-main-0" Jun 02 21:37:57.439059 ip-10-0-138-193 kubenswrapper[2578]: I0602 21:37:57.438961 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/a98d84f5-9c2b-4da3-9f4c-d1a076b46567-secret-alertmanager-kube-rbac-proxy-metric\") pod \"alertmanager-main-0\" (UID: \"a98d84f5-9c2b-4da3-9f4c-d1a076b46567\") " pod="openshift-monitoring/alertmanager-main-0" Jun 02 21:37:57.439059 ip-10-0-138-193 kubenswrapper[2578]: I0602 21:37:57.438988 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/a98d84f5-9c2b-4da3-9f4c-d1a076b46567-metrics-client-ca\") pod \"alertmanager-main-0\" (UID: \"a98d84f5-9c2b-4da3-9f4c-d1a076b46567\") " pod="openshift-monitoring/alertmanager-main-0" Jun 02 21:37:57.439059 ip-10-0-138-193 kubenswrapper[2578]: I0602 21:37:57.439017 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/a98d84f5-9c2b-4da3-9f4c-d1a076b46567-secret-alertmanager-kube-rbac-proxy-web\") pod \"alertmanager-main-0\" (UID: \"a98d84f5-9c2b-4da3-9f4c-d1a076b46567\") " pod="openshift-monitoring/alertmanager-main-0" Jun 02 21:37:57.439059 ip-10-0-138-193 kubenswrapper[2578]: I0602 21:37:57.439056 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/a98d84f5-9c2b-4da3-9f4c-d1a076b46567-config-out\") pod \"alertmanager-main-0\" (UID: \"a98d84f5-9c2b-4da3-9f4c-d1a076b46567\") " pod="openshift-monitoring/alertmanager-main-0" Jun 02 21:37:57.439322 ip-10-0-138-193 kubenswrapper[2578]: I0602 21:37:57.439109 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-4c99g\" (UniqueName: \"kubernetes.io/projected/a98d84f5-9c2b-4da3-9f4c-d1a076b46567-kube-api-access-4c99g\") pod \"alertmanager-main-0\" (UID: \"a98d84f5-9c2b-4da3-9f4c-d1a076b46567\") " pod="openshift-monitoring/alertmanager-main-0" Jun 02 21:37:57.439322 ip-10-0-138-193 kubenswrapper[2578]: I0602 21:37:57.439153 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/a98d84f5-9c2b-4da3-9f4c-d1a076b46567-cluster-tls-config\") pod \"alertmanager-main-0\" (UID: \"a98d84f5-9c2b-4da3-9f4c-d1a076b46567\") " pod="openshift-monitoring/alertmanager-main-0" Jun 02 21:37:57.439322 ip-10-0-138-193 kubenswrapper[2578]: I0602 21:37:57.439170 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/a98d84f5-9c2b-4da3-9f4c-d1a076b46567-alertmanager-trusted-ca-bundle\") pod \"alertmanager-main-0\" (UID: \"a98d84f5-9c2b-4da3-9f4c-d1a076b46567\") " pod="openshift-monitoring/alertmanager-main-0" Jun 02 21:37:57.439322 ip-10-0-138-193 kubenswrapper[2578]: I0602 21:37:57.439229 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/a98d84f5-9c2b-4da3-9f4c-d1a076b46567-config-volume\") pod \"alertmanager-main-0\" (UID: \"a98d84f5-9c2b-4da3-9f4c-d1a076b46567\") " pod="openshift-monitoring/alertmanager-main-0" Jun 02 21:37:57.439322 ip-10-0-138-193 kubenswrapper[2578]: I0602 21:37:57.439275 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/a98d84f5-9c2b-4da3-9f4c-d1a076b46567-secret-alertmanager-kube-rbac-proxy\") pod \"alertmanager-main-0\" (UID: \"a98d84f5-9c2b-4da3-9f4c-d1a076b46567\") " pod="openshift-monitoring/alertmanager-main-0" Jun 02 21:37:57.540263 ip-10-0-138-193 kubenswrapper[2578]: I0602 21:37:57.540165 2578 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/a98d84f5-9c2b-4da3-9f4c-d1a076b46567-secret-alertmanager-kube-rbac-proxy-web\") pod \"alertmanager-main-0\" (UID: \"a98d84f5-9c2b-4da3-9f4c-d1a076b46567\") " pod="openshift-monitoring/alertmanager-main-0" Jun 02 21:37:57.540263 ip-10-0-138-193 kubenswrapper[2578]: I0602 21:37:57.540219 2578 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/a98d84f5-9c2b-4da3-9f4c-d1a076b46567-config-out\") pod \"alertmanager-main-0\" (UID: \"a98d84f5-9c2b-4da3-9f4c-d1a076b46567\") " pod="openshift-monitoring/alertmanager-main-0" Jun 02 21:37:57.540263 ip-10-0-138-193 kubenswrapper[2578]: I0602 21:37:57.540251 2578 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-4c99g\" (UniqueName: \"kubernetes.io/projected/a98d84f5-9c2b-4da3-9f4c-d1a076b46567-kube-api-access-4c99g\") pod \"alertmanager-main-0\" (UID: \"a98d84f5-9c2b-4da3-9f4c-d1a076b46567\") " pod="openshift-monitoring/alertmanager-main-0" Jun 02 21:37:57.540538 ip-10-0-138-193 kubenswrapper[2578]: I0602 21:37:57.540297 2578 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/a98d84f5-9c2b-4da3-9f4c-d1a076b46567-cluster-tls-config\") pod \"alertmanager-main-0\" (UID: \"a98d84f5-9c2b-4da3-9f4c-d1a076b46567\") " pod="openshift-monitoring/alertmanager-main-0" Jun 02 21:37:57.540538 ip-10-0-138-193 kubenswrapper[2578]: I0602 21:37:57.540333 2578 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/a98d84f5-9c2b-4da3-9f4c-d1a076b46567-alertmanager-trusted-ca-bundle\") pod \"alertmanager-main-0\" (UID: \"a98d84f5-9c2b-4da3-9f4c-d1a076b46567\") " pod="openshift-monitoring/alertmanager-main-0" Jun 02 21:37:57.540538 ip-10-0-138-193 kubenswrapper[2578]: I0602 21:37:57.540362 2578 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/a98d84f5-9c2b-4da3-9f4c-d1a076b46567-config-volume\") pod \"alertmanager-main-0\" (UID: \"a98d84f5-9c2b-4da3-9f4c-d1a076b46567\") " pod="openshift-monitoring/alertmanager-main-0" Jun 02 21:37:57.540538 ip-10-0-138-193 kubenswrapper[2578]: I0602 21:37:57.540386 2578 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/a98d84f5-9c2b-4da3-9f4c-d1a076b46567-secret-alertmanager-kube-rbac-proxy\") pod \"alertmanager-main-0\" (UID: \"a98d84f5-9c2b-4da3-9f4c-d1a076b46567\") " pod="openshift-monitoring/alertmanager-main-0" Jun 02 21:37:57.540538 ip-10-0-138-193 kubenswrapper[2578]: I0602 21:37:57.540427 2578 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/a98d84f5-9c2b-4da3-9f4c-d1a076b46567-web-config\") pod \"alertmanager-main-0\" (UID: \"a98d84f5-9c2b-4da3-9f4c-d1a076b46567\") " pod="openshift-monitoring/alertmanager-main-0" Jun 02 21:37:57.540538 ip-10-0-138-193 kubenswrapper[2578]: I0602 21:37:57.540482 2578 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/a98d84f5-9c2b-4da3-9f4c-d1a076b46567-alertmanager-main-db\") pod \"alertmanager-main-0\" (UID: \"a98d84f5-9c2b-4da3-9f4c-d1a076b46567\") " pod="openshift-monitoring/alertmanager-main-0" Jun 02 21:37:57.540538 ip-10-0-138-193 kubenswrapper[2578]: I0602 21:37:57.540513 2578 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/a98d84f5-9c2b-4da3-9f4c-d1a076b46567-secret-alertmanager-main-tls\") pod \"alertmanager-main-0\" (UID: \"a98d84f5-9c2b-4da3-9f4c-d1a076b46567\") " pod="openshift-monitoring/alertmanager-main-0" Jun 02 21:37:57.540898 ip-10-0-138-193 kubenswrapper[2578]: I0602 21:37:57.540843 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/a98d84f5-9c2b-4da3-9f4c-d1a076b46567-alertmanager-main-db\") pod \"alertmanager-main-0\" (UID: \"a98d84f5-9c2b-4da3-9f4c-d1a076b46567\") " pod="openshift-monitoring/alertmanager-main-0" Jun 02 21:37:57.542161 ip-10-0-138-193 kubenswrapper[2578]: I0602 21:37:57.540984 2578 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/a98d84f5-9c2b-4da3-9f4c-d1a076b46567-tls-assets\") pod \"alertmanager-main-0\" (UID: \"a98d84f5-9c2b-4da3-9f4c-d1a076b46567\") " pod="openshift-monitoring/alertmanager-main-0" Jun 02 21:37:57.542161 ip-10-0-138-193 kubenswrapper[2578]: I0602 21:37:57.541037 2578 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/a98d84f5-9c2b-4da3-9f4c-d1a076b46567-secret-alertmanager-kube-rbac-proxy-metric\") pod \"alertmanager-main-0\" (UID: \"a98d84f5-9c2b-4da3-9f4c-d1a076b46567\") " pod="openshift-monitoring/alertmanager-main-0" Jun 02 21:37:57.542161 ip-10-0-138-193 kubenswrapper[2578]: I0602 21:37:57.541106 2578 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/a98d84f5-9c2b-4da3-9f4c-d1a076b46567-metrics-client-ca\") pod \"alertmanager-main-0\" (UID: \"a98d84f5-9c2b-4da3-9f4c-d1a076b46567\") " pod="openshift-monitoring/alertmanager-main-0" Jun 02 21:37:57.542161 ip-10-0-138-193 kubenswrapper[2578]: I0602 21:37:57.541719 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/a98d84f5-9c2b-4da3-9f4c-d1a076b46567-alertmanager-trusted-ca-bundle\") pod \"alertmanager-main-0\" (UID: \"a98d84f5-9c2b-4da3-9f4c-d1a076b46567\") " pod="openshift-monitoring/alertmanager-main-0" Jun 02 21:37:57.542161 ip-10-0-138-193 kubenswrapper[2578]: I0602 21:37:57.541809 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/a98d84f5-9c2b-4da3-9f4c-d1a076b46567-metrics-client-ca\") pod \"alertmanager-main-0\" (UID: \"a98d84f5-9c2b-4da3-9f4c-d1a076b46567\") " pod="openshift-monitoring/alertmanager-main-0" Jun 02 21:37:57.543174 ip-10-0-138-193 kubenswrapper[2578]: I0602 21:37:57.543125 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/a98d84f5-9c2b-4da3-9f4c-d1a076b46567-config-out\") pod \"alertmanager-main-0\" (UID: \"a98d84f5-9c2b-4da3-9f4c-d1a076b46567\") " pod="openshift-monitoring/alertmanager-main-0" Jun 02 21:37:57.543595 ip-10-0-138-193 kubenswrapper[2578]: I0602 21:37:57.543434 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/a98d84f5-9c2b-4da3-9f4c-d1a076b46567-secret-alertmanager-kube-rbac-proxy\") pod \"alertmanager-main-0\" (UID: \"a98d84f5-9c2b-4da3-9f4c-d1a076b46567\") " pod="openshift-monitoring/alertmanager-main-0" Jun 02 21:37:57.543683 ip-10-0-138-193 kubenswrapper[2578]: I0602 21:37:57.543622 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/a98d84f5-9c2b-4da3-9f4c-d1a076b46567-web-config\") pod \"alertmanager-main-0\" (UID: \"a98d84f5-9c2b-4da3-9f4c-d1a076b46567\") " pod="openshift-monitoring/alertmanager-main-0" Jun 02 21:37:57.543982 ip-10-0-138-193 kubenswrapper[2578]: I0602 21:37:57.543961 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/a98d84f5-9c2b-4da3-9f4c-d1a076b46567-cluster-tls-config\") pod \"alertmanager-main-0\" (UID: \"a98d84f5-9c2b-4da3-9f4c-d1a076b46567\") " pod="openshift-monitoring/alertmanager-main-0" Jun 02 21:37:57.544206 ip-10-0-138-193 kubenswrapper[2578]: I0602 21:37:57.544188 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/a98d84f5-9c2b-4da3-9f4c-d1a076b46567-secret-alertmanager-kube-rbac-proxy-web\") pod \"alertmanager-main-0\" (UID: \"a98d84f5-9c2b-4da3-9f4c-d1a076b46567\") " pod="openshift-monitoring/alertmanager-main-0" Jun 02 21:37:57.544420 ip-10-0-138-193 kubenswrapper[2578]: I0602 21:37:57.544398 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/a98d84f5-9c2b-4da3-9f4c-d1a076b46567-secret-alertmanager-main-tls\") pod \"alertmanager-main-0\" (UID: \"a98d84f5-9c2b-4da3-9f4c-d1a076b46567\") " pod="openshift-monitoring/alertmanager-main-0" Jun 02 21:37:57.544626 ip-10-0-138-193 kubenswrapper[2578]: I0602 21:37:57.544609 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/a98d84f5-9c2b-4da3-9f4c-d1a076b46567-config-volume\") pod \"alertmanager-main-0\" (UID: \"a98d84f5-9c2b-4da3-9f4c-d1a076b46567\") " pod="openshift-monitoring/alertmanager-main-0" Jun 02 21:37:57.544709 ip-10-0-138-193 kubenswrapper[2578]: I0602 21:37:57.544694 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/a98d84f5-9c2b-4da3-9f4c-d1a076b46567-tls-assets\") pod \"alertmanager-main-0\" (UID: \"a98d84f5-9c2b-4da3-9f4c-d1a076b46567\") " pod="openshift-monitoring/alertmanager-main-0" Jun 02 21:37:57.545371 ip-10-0-138-193 kubenswrapper[2578]: I0602 21:37:57.545355 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/a98d84f5-9c2b-4da3-9f4c-d1a076b46567-secret-alertmanager-kube-rbac-proxy-metric\") pod \"alertmanager-main-0\" (UID: \"a98d84f5-9c2b-4da3-9f4c-d1a076b46567\") " pod="openshift-monitoring/alertmanager-main-0" Jun 02 21:37:57.547585 ip-10-0-138-193 kubenswrapper[2578]: I0602 21:37:57.547565 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-4c99g\" (UniqueName: \"kubernetes.io/projected/a98d84f5-9c2b-4da3-9f4c-d1a076b46567-kube-api-access-4c99g\") pod \"alertmanager-main-0\" (UID: \"a98d84f5-9c2b-4da3-9f4c-d1a076b46567\") " pod="openshift-monitoring/alertmanager-main-0" Jun 02 21:37:57.625821 ip-10-0-138-193 kubenswrapper[2578]: I0602 21:37:57.625770 2578 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/alertmanager-main-0" Jun 02 21:37:57.757905 ip-10-0-138-193 kubenswrapper[2578]: I0602 21:37:57.757877 2578 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/alertmanager-main-0"] Jun 02 21:37:57.760366 ip-10-0-138-193 kubenswrapper[2578]: W0602 21:37:57.760340 2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poda98d84f5_9c2b_4da3_9f4c_d1a076b46567.slice/crio-5b2e5aed0b58a8702bc271f0cde0f0b9ac1bc68a1197f944dfc5db5b79541a62 WatchSource:0}: Error finding container 5b2e5aed0b58a8702bc271f0cde0f0b9ac1bc68a1197f944dfc5db5b79541a62: Status 404 returned error can't find the container with id 5b2e5aed0b58a8702bc271f0cde0f0b9ac1bc68a1197f944dfc5db5b79541a62 Jun 02 21:37:58.258060 ip-10-0-138-193 kubenswrapper[2578]: I0602 21:37:58.258021 2578 generic.go:358] "Generic (PLEG): container finished" podID="a98d84f5-9c2b-4da3-9f4c-d1a076b46567" containerID="873e042236f4fadc8ec6ccbfa473285f6d0a00ed29c8e264a80703e855e65449" exitCode=0 Jun 02 21:37:58.258452 ip-10-0-138-193 kubenswrapper[2578]: I0602 21:37:58.258107 2578 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"a98d84f5-9c2b-4da3-9f4c-d1a076b46567","Type":"ContainerDied","Data":"873e042236f4fadc8ec6ccbfa473285f6d0a00ed29c8e264a80703e855e65449"} Jun 02 21:37:58.258452 ip-10-0-138-193 kubenswrapper[2578]: I0602 21:37:58.258145 2578 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"a98d84f5-9c2b-4da3-9f4c-d1a076b46567","Type":"ContainerStarted","Data":"5b2e5aed0b58a8702bc271f0cde0f0b9ac1bc68a1197f944dfc5db5b79541a62"} Jun 02 21:37:59.266807 ip-10-0-138-193 kubenswrapper[2578]: I0602 21:37:59.266771 2578 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"a98d84f5-9c2b-4da3-9f4c-d1a076b46567","Type":"ContainerStarted","Data":"731ccde19abe0e2137e2e3c2d5388613e01969daec7af19dbc8a4f3e9b5c0a1a"} Jun 02 21:37:59.266807 ip-10-0-138-193 kubenswrapper[2578]: I0602 21:37:59.266806 2578 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"a98d84f5-9c2b-4da3-9f4c-d1a076b46567","Type":"ContainerStarted","Data":"71b41072e53a8d4db04ac3c3269cf034ff55f4c57096eafaeffcc12505ac1c05"} Jun 02 21:37:59.266807 ip-10-0-138-193 kubenswrapper[2578]: I0602 21:37:59.266816 2578 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"a98d84f5-9c2b-4da3-9f4c-d1a076b46567","Type":"ContainerStarted","Data":"7b633e907a5c3c233a8b424366de8d579b7b3b8fbe1bd7c814a3636ac60f76aa"} Jun 02 21:37:59.267255 ip-10-0-138-193 kubenswrapper[2578]: I0602 21:37:59.266824 2578 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"a98d84f5-9c2b-4da3-9f4c-d1a076b46567","Type":"ContainerStarted","Data":"27dbd1aa2de411e79cadf2bba8e96d7f602a792b0e2a69c7500e4160c63a3e8c"} Jun 02 21:37:59.267255 ip-10-0-138-193 kubenswrapper[2578]: I0602 21:37:59.266834 2578 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"a98d84f5-9c2b-4da3-9f4c-d1a076b46567","Type":"ContainerStarted","Data":"3c46f465419207027e3e3c4aff9c202606ae005787ba032c13c2201bfb7bcd19"} Jun 02 21:37:59.267255 ip-10-0-138-193 kubenswrapper[2578]: I0602 21:37:59.266843 2578 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"a98d84f5-9c2b-4da3-9f4c-d1a076b46567","Type":"ContainerStarted","Data":"9f9812ee478d8c9ff1bad97ac47d8ef178800a3ec0c78f8ed6a0b385fab5e63b"} Jun 02 21:37:59.295483 ip-10-0-138-193 kubenswrapper[2578]: I0602 21:37:59.295438 2578 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-monitoring/alertmanager-main-0" podStartSLOduration=2.29542484 podStartE2EDuration="2.29542484s" podCreationTimestamp="2026-06-02 21:37:57 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2026-06-02 21:37:59.295273582 +0000 UTC m=+256.547171510" watchObservedRunningTime="2026-06-02 21:37:59.29542484 +0000 UTC m=+256.547322743" Jun 02 21:37:59.615189 ip-10-0-138-193 kubenswrapper[2578]: I0602 21:37:59.615098 2578 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-monitoring/telemeter-client-6cc667f67-dd7pw"] Jun 02 21:37:59.617926 ip-10-0-138-193 kubenswrapper[2578]: I0602 21:37:59.617899 2578 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/telemeter-client-6cc667f67-dd7pw" Jun 02 21:37:59.620958 ip-10-0-138-193 kubenswrapper[2578]: I0602 21:37:59.620927 2578 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"telemeter-client-kube-rbac-proxy-config\"" Jun 02 21:37:59.621137 ip-10-0-138-193 kubenswrapper[2578]: I0602 21:37:59.620929 2578 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"telemeter-client\"" Jun 02 21:37:59.621137 ip-10-0-138-193 kubenswrapper[2578]: I0602 21:37:59.620979 2578 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"telemeter-client-dockercfg-ftp58\"" Jun 02 21:37:59.621412 ip-10-0-138-193 kubenswrapper[2578]: I0602 21:37:59.621397 2578 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"telemeter-client-tls\"" Jun 02 21:37:59.621489 ip-10-0-138-193 kubenswrapper[2578]: I0602 21:37:59.621445 2578 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"federate-client-certs\"" Jun 02 21:37:59.621489 ip-10-0-138-193 kubenswrapper[2578]: I0602 21:37:59.621447 2578 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"telemeter-client-serving-certs-ca-bundle\"" Jun 02 21:37:59.626680 ip-10-0-138-193 kubenswrapper[2578]: I0602 21:37:59.626653 2578 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"telemeter-trusted-ca-bundle-8i12ta5c71j38\"" Jun 02 21:37:59.633466 ip-10-0-138-193 kubenswrapper[2578]: I0602 21:37:59.633443 2578 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/telemeter-client-6cc667f67-dd7pw"] Jun 02 21:37:59.760802 ip-10-0-138-193 kubenswrapper[2578]: I0602 21:37:59.760766 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-telemeter-client-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/d714db6b-3c79-471c-b77b-22dd0609a6ae-secret-telemeter-client-kube-rbac-proxy-config\") pod \"telemeter-client-6cc667f67-dd7pw\" (UID: \"d714db6b-3c79-471c-b77b-22dd0609a6ae\") " pod="openshift-monitoring/telemeter-client-6cc667f67-dd7pw" Jun 02 21:37:59.761041 ip-10-0-138-193 kubenswrapper[2578]: I0602 21:37:59.761022 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"telemeter-client-tls\" (UniqueName: \"kubernetes.io/secret/d714db6b-3c79-471c-b77b-22dd0609a6ae-telemeter-client-tls\") pod \"telemeter-client-6cc667f67-dd7pw\" (UID: \"d714db6b-3c79-471c-b77b-22dd0609a6ae\") " pod="openshift-monitoring/telemeter-client-6cc667f67-dd7pw" Jun 02 21:37:59.761197 ip-10-0-138-193 kubenswrapper[2578]: I0602 21:37:59.761179 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"telemeter-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/d714db6b-3c79-471c-b77b-22dd0609a6ae-telemeter-trusted-ca-bundle\") pod \"telemeter-client-6cc667f67-dd7pw\" (UID: \"d714db6b-3c79-471c-b77b-22dd0609a6ae\") " pod="openshift-monitoring/telemeter-client-6cc667f67-dd7pw" Jun 02 21:37:59.761421 ip-10-0-138-193 kubenswrapper[2578]: I0602 21:37:59.761404 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/d714db6b-3c79-471c-b77b-22dd0609a6ae-serving-certs-ca-bundle\") pod \"telemeter-client-6cc667f67-dd7pw\" (UID: \"d714db6b-3c79-471c-b77b-22dd0609a6ae\") " pod="openshift-monitoring/telemeter-client-6cc667f67-dd7pw" Jun 02 21:37:59.761528 ip-10-0-138-193 kubenswrapper[2578]: I0602 21:37:59.761516 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-26kwg\" (UniqueName: \"kubernetes.io/projected/d714db6b-3c79-471c-b77b-22dd0609a6ae-kube-api-access-26kwg\") pod \"telemeter-client-6cc667f67-dd7pw\" (UID: \"d714db6b-3c79-471c-b77b-22dd0609a6ae\") " pod="openshift-monitoring/telemeter-client-6cc667f67-dd7pw" Jun 02 21:37:59.761641 ip-10-0-138-193 kubenswrapper[2578]: I0602 21:37:59.761616 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"federate-client-tls\" (UniqueName: \"kubernetes.io/secret/d714db6b-3c79-471c-b77b-22dd0609a6ae-federate-client-tls\") pod \"telemeter-client-6cc667f67-dd7pw\" (UID: \"d714db6b-3c79-471c-b77b-22dd0609a6ae\") " pod="openshift-monitoring/telemeter-client-6cc667f67-dd7pw" Jun 02 21:37:59.761641 ip-10-0-138-193 kubenswrapper[2578]: I0602 21:37:59.761644 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/d714db6b-3c79-471c-b77b-22dd0609a6ae-metrics-client-ca\") pod \"telemeter-client-6cc667f67-dd7pw\" (UID: \"d714db6b-3c79-471c-b77b-22dd0609a6ae\") " pod="openshift-monitoring/telemeter-client-6cc667f67-dd7pw" Jun 02 21:37:59.761816 ip-10-0-138-193 kubenswrapper[2578]: I0602 21:37:59.761730 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-telemeter-client\" (UniqueName: \"kubernetes.io/secret/d714db6b-3c79-471c-b77b-22dd0609a6ae-secret-telemeter-client\") pod \"telemeter-client-6cc667f67-dd7pw\" (UID: \"d714db6b-3c79-471c-b77b-22dd0609a6ae\") " pod="openshift-monitoring/telemeter-client-6cc667f67-dd7pw" Jun 02 21:37:59.862443 ip-10-0-138-193 kubenswrapper[2578]: I0602 21:37:59.862406 2578 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"telemeter-client-tls\" (UniqueName: \"kubernetes.io/secret/d714db6b-3c79-471c-b77b-22dd0609a6ae-telemeter-client-tls\") pod \"telemeter-client-6cc667f67-dd7pw\" (UID: \"d714db6b-3c79-471c-b77b-22dd0609a6ae\") " pod="openshift-monitoring/telemeter-client-6cc667f67-dd7pw" Jun 02 21:37:59.862443 ip-10-0-138-193 kubenswrapper[2578]: I0602 21:37:59.862443 2578 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"telemeter-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/d714db6b-3c79-471c-b77b-22dd0609a6ae-telemeter-trusted-ca-bundle\") pod \"telemeter-client-6cc667f67-dd7pw\" (UID: \"d714db6b-3c79-471c-b77b-22dd0609a6ae\") " pod="openshift-monitoring/telemeter-client-6cc667f67-dd7pw" Jun 02 21:37:59.862681 ip-10-0-138-193 kubenswrapper[2578]: I0602 21:37:59.862481 2578 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/d714db6b-3c79-471c-b77b-22dd0609a6ae-serving-certs-ca-bundle\") pod \"telemeter-client-6cc667f67-dd7pw\" (UID: \"d714db6b-3c79-471c-b77b-22dd0609a6ae\") " pod="openshift-monitoring/telemeter-client-6cc667f67-dd7pw" Jun 02 21:37:59.862681 ip-10-0-138-193 kubenswrapper[2578]: I0602 21:37:59.862517 2578 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-26kwg\" (UniqueName: \"kubernetes.io/projected/d714db6b-3c79-471c-b77b-22dd0609a6ae-kube-api-access-26kwg\") pod \"telemeter-client-6cc667f67-dd7pw\" (UID: \"d714db6b-3c79-471c-b77b-22dd0609a6ae\") " pod="openshift-monitoring/telemeter-client-6cc667f67-dd7pw" Jun 02 21:37:59.862681 ip-10-0-138-193 kubenswrapper[2578]: I0602 21:37:59.862556 2578 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"federate-client-tls\" (UniqueName: \"kubernetes.io/secret/d714db6b-3c79-471c-b77b-22dd0609a6ae-federate-client-tls\") pod \"telemeter-client-6cc667f67-dd7pw\" (UID: \"d714db6b-3c79-471c-b77b-22dd0609a6ae\") " pod="openshift-monitoring/telemeter-client-6cc667f67-dd7pw" Jun 02 21:37:59.862681 ip-10-0-138-193 kubenswrapper[2578]: I0602 21:37:59.862590 2578 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/d714db6b-3c79-471c-b77b-22dd0609a6ae-metrics-client-ca\") pod \"telemeter-client-6cc667f67-dd7pw\" (UID: \"d714db6b-3c79-471c-b77b-22dd0609a6ae\") " pod="openshift-monitoring/telemeter-client-6cc667f67-dd7pw" Jun 02 21:37:59.862860 ip-10-0-138-193 kubenswrapper[2578]: I0602 21:37:59.862809 2578 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"secret-telemeter-client\" (UniqueName: \"kubernetes.io/secret/d714db6b-3c79-471c-b77b-22dd0609a6ae-secret-telemeter-client\") pod \"telemeter-client-6cc667f67-dd7pw\" (UID: \"d714db6b-3c79-471c-b77b-22dd0609a6ae\") " pod="openshift-monitoring/telemeter-client-6cc667f67-dd7pw" Jun 02 21:37:59.862913 ip-10-0-138-193 kubenswrapper[2578]: I0602 21:37:59.862870 2578 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"secret-telemeter-client-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/d714db6b-3c79-471c-b77b-22dd0609a6ae-secret-telemeter-client-kube-rbac-proxy-config\") pod \"telemeter-client-6cc667f67-dd7pw\" (UID: \"d714db6b-3c79-471c-b77b-22dd0609a6ae\") " pod="openshift-monitoring/telemeter-client-6cc667f67-dd7pw" Jun 02 21:37:59.863410 ip-10-0-138-193 kubenswrapper[2578]: I0602 21:37:59.863384 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/d714db6b-3c79-471c-b77b-22dd0609a6ae-metrics-client-ca\") pod \"telemeter-client-6cc667f67-dd7pw\" (UID: \"d714db6b-3c79-471c-b77b-22dd0609a6ae\") " pod="openshift-monitoring/telemeter-client-6cc667f67-dd7pw" Jun 02 21:37:59.863534 ip-10-0-138-193 kubenswrapper[2578]: I0602 21:37:59.863427 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"telemeter-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/d714db6b-3c79-471c-b77b-22dd0609a6ae-telemeter-trusted-ca-bundle\") pod \"telemeter-client-6cc667f67-dd7pw\" (UID: \"d714db6b-3c79-471c-b77b-22dd0609a6ae\") " pod="openshift-monitoring/telemeter-client-6cc667f67-dd7pw" Jun 02 21:37:59.863601 ip-10-0-138-193 kubenswrapper[2578]: I0602 21:37:59.863543 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/d714db6b-3c79-471c-b77b-22dd0609a6ae-serving-certs-ca-bundle\") pod \"telemeter-client-6cc667f67-dd7pw\" (UID: \"d714db6b-3c79-471c-b77b-22dd0609a6ae\") " pod="openshift-monitoring/telemeter-client-6cc667f67-dd7pw" Jun 02 21:37:59.865491 ip-10-0-138-193 kubenswrapper[2578]: I0602 21:37:59.865438 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-telemeter-client-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/d714db6b-3c79-471c-b77b-22dd0609a6ae-secret-telemeter-client-kube-rbac-proxy-config\") pod \"telemeter-client-6cc667f67-dd7pw\" (UID: \"d714db6b-3c79-471c-b77b-22dd0609a6ae\") " pod="openshift-monitoring/telemeter-client-6cc667f67-dd7pw" Jun 02 21:37:59.865491 ip-10-0-138-193 kubenswrapper[2578]: I0602 21:37:59.865444 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-telemeter-client\" (UniqueName: \"kubernetes.io/secret/d714db6b-3c79-471c-b77b-22dd0609a6ae-secret-telemeter-client\") pod \"telemeter-client-6cc667f67-dd7pw\" (UID: \"d714db6b-3c79-471c-b77b-22dd0609a6ae\") " pod="openshift-monitoring/telemeter-client-6cc667f67-dd7pw" Jun 02 21:37:59.865491 ip-10-0-138-193 kubenswrapper[2578]: I0602 21:37:59.865450 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"telemeter-client-tls\" (UniqueName: \"kubernetes.io/secret/d714db6b-3c79-471c-b77b-22dd0609a6ae-telemeter-client-tls\") pod \"telemeter-client-6cc667f67-dd7pw\" (UID: \"d714db6b-3c79-471c-b77b-22dd0609a6ae\") " pod="openshift-monitoring/telemeter-client-6cc667f67-dd7pw" Jun 02 21:37:59.865627 ip-10-0-138-193 kubenswrapper[2578]: I0602 21:37:59.865536 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"federate-client-tls\" (UniqueName: \"kubernetes.io/secret/d714db6b-3c79-471c-b77b-22dd0609a6ae-federate-client-tls\") pod \"telemeter-client-6cc667f67-dd7pw\" (UID: \"d714db6b-3c79-471c-b77b-22dd0609a6ae\") " pod="openshift-monitoring/telemeter-client-6cc667f67-dd7pw" Jun 02 21:37:59.870884 ip-10-0-138-193 kubenswrapper[2578]: I0602 21:37:59.870865 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-26kwg\" (UniqueName: \"kubernetes.io/projected/d714db6b-3c79-471c-b77b-22dd0609a6ae-kube-api-access-26kwg\") pod \"telemeter-client-6cc667f67-dd7pw\" (UID: \"d714db6b-3c79-471c-b77b-22dd0609a6ae\") " pod="openshift-monitoring/telemeter-client-6cc667f67-dd7pw" Jun 02 21:37:59.928467 ip-10-0-138-193 kubenswrapper[2578]: I0602 21:37:59.928432 2578 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/telemeter-client-6cc667f67-dd7pw" Jun 02 21:38:00.081601 ip-10-0-138-193 kubenswrapper[2578]: I0602 21:38:00.081441 2578 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/telemeter-client-6cc667f67-dd7pw"] Jun 02 21:38:00.085611 ip-10-0-138-193 kubenswrapper[2578]: W0602 21:38:00.085582 2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podd714db6b_3c79_471c_b77b_22dd0609a6ae.slice/crio-21f7ce94b0d9c8ec2def83dd614daff42315ac89d46bb4ad5f38ea0e1205efe5 WatchSource:0}: Error finding container 21f7ce94b0d9c8ec2def83dd614daff42315ac89d46bb4ad5f38ea0e1205efe5: Status 404 returned error can't find the container with id 21f7ce94b0d9c8ec2def83dd614daff42315ac89d46bb4ad5f38ea0e1205efe5 Jun 02 21:38:00.271231 ip-10-0-138-193 kubenswrapper[2578]: I0602 21:38:00.271199 2578 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/telemeter-client-6cc667f67-dd7pw" event={"ID":"d714db6b-3c79-471c-b77b-22dd0609a6ae","Type":"ContainerStarted","Data":"21f7ce94b0d9c8ec2def83dd614daff42315ac89d46bb4ad5f38ea0e1205efe5"} Jun 02 21:38:02.280941 ip-10-0-138-193 kubenswrapper[2578]: I0602 21:38:02.280851 2578 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/telemeter-client-6cc667f67-dd7pw" event={"ID":"d714db6b-3c79-471c-b77b-22dd0609a6ae","Type":"ContainerStarted","Data":"eed7ebf519e69c558af34237187fdf60d9a34a1c3faf5fc56c21ed541585dc22"} Jun 02 21:38:02.280941 ip-10-0-138-193 kubenswrapper[2578]: I0602 21:38:02.280890 2578 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/telemeter-client-6cc667f67-dd7pw" event={"ID":"d714db6b-3c79-471c-b77b-22dd0609a6ae","Type":"ContainerStarted","Data":"ad5a90f1ecc7c5ac077f2ea298e15b92528f8318484eed926e540d182328bf28"} Jun 02 21:38:02.280941 ip-10-0-138-193 kubenswrapper[2578]: I0602 21:38:02.280899 2578 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/telemeter-client-6cc667f67-dd7pw" event={"ID":"d714db6b-3c79-471c-b77b-22dd0609a6ae","Type":"ContainerStarted","Data":"798390882a1c26a83d83ef6e2cf024b3b7f188ceb7d20975540b01ac73ef2a93"} Jun 02 21:38:02.301189 ip-10-0-138-193 kubenswrapper[2578]: I0602 21:38:02.301138 2578 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-monitoring/telemeter-client-6cc667f67-dd7pw" podStartSLOduration=1.45643564 podStartE2EDuration="3.301125028s" podCreationTimestamp="2026-06-02 21:37:59 +0000 UTC" firstStartedPulling="2026-06-02 21:38:00.087969155 +0000 UTC m=+257.339867053" lastFinishedPulling="2026-06-02 21:38:01.932658542 +0000 UTC m=+259.184556441" observedRunningTime="2026-06-02 21:38:02.299788144 +0000 UTC m=+259.551686049" watchObservedRunningTime="2026-06-02 21:38:02.301125028 +0000 UTC m=+259.553022933" Jun 02 21:38:02.979690 ip-10-0-138-193 kubenswrapper[2578]: I0602 21:38:02.979658 2578 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-console/console-7bd6468cf9-pv9xk"] Jun 02 21:38:02.981972 ip-10-0-138-193 kubenswrapper[2578]: I0602 21:38:02.981949 2578 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-7bd6468cf9-pv9xk" Jun 02 21:38:02.995110 ip-10-0-138-193 kubenswrapper[2578]: I0602 21:38:02.995085 2578 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-7bd6468cf9-pv9xk"] Jun 02 21:38:03.090744 ip-10-0-138-193 kubenswrapper[2578]: I0602 21:38:03.090714 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/4399b683-a1d2-4ba0-9ffd-4dfcda2b7717-trusted-ca-bundle\") pod \"console-7bd6468cf9-pv9xk\" (UID: \"4399b683-a1d2-4ba0-9ffd-4dfcda2b7717\") " pod="openshift-console/console-7bd6468cf9-pv9xk" Jun 02 21:38:03.090744 ip-10-0-138-193 kubenswrapper[2578]: I0602 21:38:03.090750 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/4399b683-a1d2-4ba0-9ffd-4dfcda2b7717-console-serving-cert\") pod \"console-7bd6468cf9-pv9xk\" (UID: \"4399b683-a1d2-4ba0-9ffd-4dfcda2b7717\") " pod="openshift-console/console-7bd6468cf9-pv9xk" Jun 02 21:38:03.090946 ip-10-0-138-193 kubenswrapper[2578]: I0602 21:38:03.090769 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/4399b683-a1d2-4ba0-9ffd-4dfcda2b7717-service-ca\") pod \"console-7bd6468cf9-pv9xk\" (UID: \"4399b683-a1d2-4ba0-9ffd-4dfcda2b7717\") " pod="openshift-console/console-7bd6468cf9-pv9xk" Jun 02 21:38:03.090946 ip-10-0-138-193 kubenswrapper[2578]: I0602 21:38:03.090786 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/4399b683-a1d2-4ba0-9ffd-4dfcda2b7717-oauth-serving-cert\") pod \"console-7bd6468cf9-pv9xk\" (UID: \"4399b683-a1d2-4ba0-9ffd-4dfcda2b7717\") " pod="openshift-console/console-7bd6468cf9-pv9xk" Jun 02 21:38:03.090946 ip-10-0-138-193 kubenswrapper[2578]: I0602 21:38:03.090827 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-gn8kx\" (UniqueName: \"kubernetes.io/projected/4399b683-a1d2-4ba0-9ffd-4dfcda2b7717-kube-api-access-gn8kx\") pod \"console-7bd6468cf9-pv9xk\" (UID: \"4399b683-a1d2-4ba0-9ffd-4dfcda2b7717\") " pod="openshift-console/console-7bd6468cf9-pv9xk" Jun 02 21:38:03.090946 ip-10-0-138-193 kubenswrapper[2578]: I0602 21:38:03.090847 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/4399b683-a1d2-4ba0-9ffd-4dfcda2b7717-console-oauth-config\") pod \"console-7bd6468cf9-pv9xk\" (UID: \"4399b683-a1d2-4ba0-9ffd-4dfcda2b7717\") " pod="openshift-console/console-7bd6468cf9-pv9xk" Jun 02 21:38:03.090946 ip-10-0-138-193 kubenswrapper[2578]: I0602 21:38:03.090868 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/4399b683-a1d2-4ba0-9ffd-4dfcda2b7717-console-config\") pod \"console-7bd6468cf9-pv9xk\" (UID: \"4399b683-a1d2-4ba0-9ffd-4dfcda2b7717\") " pod="openshift-console/console-7bd6468cf9-pv9xk" Jun 02 21:38:03.191636 ip-10-0-138-193 kubenswrapper[2578]: I0602 21:38:03.191602 2578 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/4399b683-a1d2-4ba0-9ffd-4dfcda2b7717-console-oauth-config\") pod \"console-7bd6468cf9-pv9xk\" (UID: \"4399b683-a1d2-4ba0-9ffd-4dfcda2b7717\") " pod="openshift-console/console-7bd6468cf9-pv9xk" Jun 02 21:38:03.191815 ip-10-0-138-193 kubenswrapper[2578]: I0602 21:38:03.191644 2578 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/4399b683-a1d2-4ba0-9ffd-4dfcda2b7717-console-config\") pod \"console-7bd6468cf9-pv9xk\" (UID: \"4399b683-a1d2-4ba0-9ffd-4dfcda2b7717\") " pod="openshift-console/console-7bd6468cf9-pv9xk" Jun 02 21:38:03.191815 ip-10-0-138-193 kubenswrapper[2578]: I0602 21:38:03.191744 2578 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/4399b683-a1d2-4ba0-9ffd-4dfcda2b7717-trusted-ca-bundle\") pod \"console-7bd6468cf9-pv9xk\" (UID: \"4399b683-a1d2-4ba0-9ffd-4dfcda2b7717\") " pod="openshift-console/console-7bd6468cf9-pv9xk" Jun 02 21:38:03.191815 ip-10-0-138-193 kubenswrapper[2578]: I0602 21:38:03.191771 2578 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/4399b683-a1d2-4ba0-9ffd-4dfcda2b7717-console-serving-cert\") pod \"console-7bd6468cf9-pv9xk\" (UID: \"4399b683-a1d2-4ba0-9ffd-4dfcda2b7717\") " pod="openshift-console/console-7bd6468cf9-pv9xk" Jun 02 21:38:03.191815 ip-10-0-138-193 kubenswrapper[2578]: I0602 21:38:03.191801 2578 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/4399b683-a1d2-4ba0-9ffd-4dfcda2b7717-service-ca\") pod \"console-7bd6468cf9-pv9xk\" (UID: \"4399b683-a1d2-4ba0-9ffd-4dfcda2b7717\") " pod="openshift-console/console-7bd6468cf9-pv9xk" Jun 02 21:38:03.192021 ip-10-0-138-193 kubenswrapper[2578]: I0602 21:38:03.191824 2578 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/4399b683-a1d2-4ba0-9ffd-4dfcda2b7717-oauth-serving-cert\") pod \"console-7bd6468cf9-pv9xk\" (UID: \"4399b683-a1d2-4ba0-9ffd-4dfcda2b7717\") " pod="openshift-console/console-7bd6468cf9-pv9xk" Jun 02 21:38:03.192021 ip-10-0-138-193 kubenswrapper[2578]: I0602 21:38:03.191852 2578 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-gn8kx\" (UniqueName: \"kubernetes.io/projected/4399b683-a1d2-4ba0-9ffd-4dfcda2b7717-kube-api-access-gn8kx\") pod \"console-7bd6468cf9-pv9xk\" (UID: \"4399b683-a1d2-4ba0-9ffd-4dfcda2b7717\") " pod="openshift-console/console-7bd6468cf9-pv9xk" Jun 02 21:38:03.192576 ip-10-0-138-193 kubenswrapper[2578]: I0602 21:38:03.192546 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/4399b683-a1d2-4ba0-9ffd-4dfcda2b7717-console-config\") pod \"console-7bd6468cf9-pv9xk\" (UID: \"4399b683-a1d2-4ba0-9ffd-4dfcda2b7717\") " pod="openshift-console/console-7bd6468cf9-pv9xk" Jun 02 21:38:03.192682 ip-10-0-138-193 kubenswrapper[2578]: I0602 21:38:03.192603 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/4399b683-a1d2-4ba0-9ffd-4dfcda2b7717-service-ca\") pod \"console-7bd6468cf9-pv9xk\" (UID: \"4399b683-a1d2-4ba0-9ffd-4dfcda2b7717\") " pod="openshift-console/console-7bd6468cf9-pv9xk" Jun 02 21:38:03.192682 ip-10-0-138-193 kubenswrapper[2578]: I0602 21:38:03.192629 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/4399b683-a1d2-4ba0-9ffd-4dfcda2b7717-trusted-ca-bundle\") pod \"console-7bd6468cf9-pv9xk\" (UID: \"4399b683-a1d2-4ba0-9ffd-4dfcda2b7717\") " pod="openshift-console/console-7bd6468cf9-pv9xk" Jun 02 21:38:03.192682 ip-10-0-138-193 kubenswrapper[2578]: I0602 21:38:03.192654 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/4399b683-a1d2-4ba0-9ffd-4dfcda2b7717-oauth-serving-cert\") pod \"console-7bd6468cf9-pv9xk\" (UID: \"4399b683-a1d2-4ba0-9ffd-4dfcda2b7717\") " pod="openshift-console/console-7bd6468cf9-pv9xk" Jun 02 21:38:03.194120 ip-10-0-138-193 kubenswrapper[2578]: I0602 21:38:03.194097 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/4399b683-a1d2-4ba0-9ffd-4dfcda2b7717-console-oauth-config\") pod \"console-7bd6468cf9-pv9xk\" (UID: \"4399b683-a1d2-4ba0-9ffd-4dfcda2b7717\") " pod="openshift-console/console-7bd6468cf9-pv9xk" Jun 02 21:38:03.194362 ip-10-0-138-193 kubenswrapper[2578]: I0602 21:38:03.194343 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/4399b683-a1d2-4ba0-9ffd-4dfcda2b7717-console-serving-cert\") pod \"console-7bd6468cf9-pv9xk\" (UID: \"4399b683-a1d2-4ba0-9ffd-4dfcda2b7717\") " pod="openshift-console/console-7bd6468cf9-pv9xk" Jun 02 21:38:03.200026 ip-10-0-138-193 kubenswrapper[2578]: I0602 21:38:03.200002 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-gn8kx\" (UniqueName: \"kubernetes.io/projected/4399b683-a1d2-4ba0-9ffd-4dfcda2b7717-kube-api-access-gn8kx\") pod \"console-7bd6468cf9-pv9xk\" (UID: \"4399b683-a1d2-4ba0-9ffd-4dfcda2b7717\") " pod="openshift-console/console-7bd6468cf9-pv9xk" Jun 02 21:38:03.290744 ip-10-0-138-193 kubenswrapper[2578]: I0602 21:38:03.290668 2578 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-7bd6468cf9-pv9xk" Jun 02 21:38:03.416970 ip-10-0-138-193 kubenswrapper[2578]: I0602 21:38:03.416944 2578 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-7bd6468cf9-pv9xk"] Jun 02 21:38:03.419560 ip-10-0-138-193 kubenswrapper[2578]: W0602 21:38:03.419526 2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod4399b683_a1d2_4ba0_9ffd_4dfcda2b7717.slice/crio-45a31931cec4877baee3d7642fef8c7a607523736ff18e0608840cefbabbad89 WatchSource:0}: Error finding container 45a31931cec4877baee3d7642fef8c7a607523736ff18e0608840cefbabbad89: Status 404 returned error can't find the container with id 45a31931cec4877baee3d7642fef8c7a607523736ff18e0608840cefbabbad89 Jun 02 21:38:04.289016 ip-10-0-138-193 kubenswrapper[2578]: I0602 21:38:04.288977 2578 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-7bd6468cf9-pv9xk" event={"ID":"4399b683-a1d2-4ba0-9ffd-4dfcda2b7717","Type":"ContainerStarted","Data":"3cd32d2587558f71133ee4d524f44bdf626d4529c51fc31ec4881c5e20498e97"} Jun 02 21:38:04.289016 ip-10-0-138-193 kubenswrapper[2578]: I0602 21:38:04.289020 2578 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-7bd6468cf9-pv9xk" event={"ID":"4399b683-a1d2-4ba0-9ffd-4dfcda2b7717","Type":"ContainerStarted","Data":"45a31931cec4877baee3d7642fef8c7a607523736ff18e0608840cefbabbad89"} Jun 02 21:38:04.306351 ip-10-0-138-193 kubenswrapper[2578]: I0602 21:38:04.306311 2578 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-console/console-7bd6468cf9-pv9xk" podStartSLOduration=2.306298558 podStartE2EDuration="2.306298558s" podCreationTimestamp="2026-06-02 21:38:02 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2026-06-02 21:38:04.304722874 +0000 UTC m=+261.556620776" watchObservedRunningTime="2026-06-02 21:38:04.306298558 +0000 UTC m=+261.558196464" Jun 02 21:38:13.290833 ip-10-0-138-193 kubenswrapper[2578]: I0602 21:38:13.290796 2578 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-console/console-7bd6468cf9-pv9xk" Jun 02 21:38:13.290833 ip-10-0-138-193 kubenswrapper[2578]: I0602 21:38:13.290843 2578 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/console-7bd6468cf9-pv9xk" Jun 02 21:38:13.295474 ip-10-0-138-193 kubenswrapper[2578]: I0602 21:38:13.295449 2578 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-console/console-7bd6468cf9-pv9xk" Jun 02 21:38:13.323941 ip-10-0-138-193 kubenswrapper[2578]: I0602 21:38:13.323916 2578 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console/console-7bd6468cf9-pv9xk" Jun 02 21:38:13.365587 ip-10-0-138-193 kubenswrapper[2578]: I0602 21:38:13.365550 2578 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openshift-console/console-9668769f-vv59c"] Jun 02 21:38:38.385800 ip-10-0-138-193 kubenswrapper[2578]: I0602 21:38:38.385754 2578 kuberuntime_container.go:864] "Killing container with a grace period" pod="openshift-console/console-9668769f-vv59c" podUID="96b2dbd7-d125-467b-b055-5868b667f1c6" containerName="console" containerID="cri-o://ab5ebcd6d3f78bb480e8dde3461e4da90e78d78efcf6a3d7ef7670181adc7d31" gracePeriod=15 Jun 02 21:38:38.626064 ip-10-0-138-193 kubenswrapper[2578]: I0602 21:38:38.626034 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console_console-9668769f-vv59c_96b2dbd7-d125-467b-b055-5868b667f1c6/console/0.log" Jun 02 21:38:38.626218 ip-10-0-138-193 kubenswrapper[2578]: I0602 21:38:38.626132 2578 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-9668769f-vv59c" Jun 02 21:38:38.701619 ip-10-0-138-193 kubenswrapper[2578]: I0602 21:38:38.701577 2578 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-czspl\" (UniqueName: \"kubernetes.io/projected/96b2dbd7-d125-467b-b055-5868b667f1c6-kube-api-access-czspl\") pod \"96b2dbd7-d125-467b-b055-5868b667f1c6\" (UID: \"96b2dbd7-d125-467b-b055-5868b667f1c6\") " Jun 02 21:38:38.701817 ip-10-0-138-193 kubenswrapper[2578]: I0602 21:38:38.701632 2578 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/96b2dbd7-d125-467b-b055-5868b667f1c6-oauth-serving-cert\") pod \"96b2dbd7-d125-467b-b055-5868b667f1c6\" (UID: \"96b2dbd7-d125-467b-b055-5868b667f1c6\") " Jun 02 21:38:38.701817 ip-10-0-138-193 kubenswrapper[2578]: I0602 21:38:38.701664 2578 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/96b2dbd7-d125-467b-b055-5868b667f1c6-console-oauth-config\") pod \"96b2dbd7-d125-467b-b055-5868b667f1c6\" (UID: \"96b2dbd7-d125-467b-b055-5868b667f1c6\") " Jun 02 21:38:38.701817 ip-10-0-138-193 kubenswrapper[2578]: I0602 21:38:38.701685 2578 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/96b2dbd7-d125-467b-b055-5868b667f1c6-service-ca\") pod \"96b2dbd7-d125-467b-b055-5868b667f1c6\" (UID: \"96b2dbd7-d125-467b-b055-5868b667f1c6\") " Jun 02 21:38:38.701817 ip-10-0-138-193 kubenswrapper[2578]: I0602 21:38:38.701742 2578 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/96b2dbd7-d125-467b-b055-5868b667f1c6-trusted-ca-bundle\") pod \"96b2dbd7-d125-467b-b055-5868b667f1c6\" (UID: \"96b2dbd7-d125-467b-b055-5868b667f1c6\") " Jun 02 21:38:38.701817 ip-10-0-138-193 kubenswrapper[2578]: I0602 21:38:38.701782 2578 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/96b2dbd7-d125-467b-b055-5868b667f1c6-console-config\") pod \"96b2dbd7-d125-467b-b055-5868b667f1c6\" (UID: \"96b2dbd7-d125-467b-b055-5868b667f1c6\") " Jun 02 21:38:38.702057 ip-10-0-138-193 kubenswrapper[2578]: I0602 21:38:38.701838 2578 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/96b2dbd7-d125-467b-b055-5868b667f1c6-console-serving-cert\") pod \"96b2dbd7-d125-467b-b055-5868b667f1c6\" (UID: \"96b2dbd7-d125-467b-b055-5868b667f1c6\") " Jun 02 21:38:38.702225 ip-10-0-138-193 kubenswrapper[2578]: I0602 21:38:38.702200 2578 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/96b2dbd7-d125-467b-b055-5868b667f1c6-service-ca" (OuterVolumeSpecName: "service-ca") pod "96b2dbd7-d125-467b-b055-5868b667f1c6" (UID: "96b2dbd7-d125-467b-b055-5868b667f1c6"). InnerVolumeSpecName "service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jun 02 21:38:38.702299 ip-10-0-138-193 kubenswrapper[2578]: I0602 21:38:38.702232 2578 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/96b2dbd7-d125-467b-b055-5868b667f1c6-console-config" (OuterVolumeSpecName: "console-config") pod "96b2dbd7-d125-467b-b055-5868b667f1c6" (UID: "96b2dbd7-d125-467b-b055-5868b667f1c6"). InnerVolumeSpecName "console-config". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jun 02 21:38:38.702299 ip-10-0-138-193 kubenswrapper[2578]: I0602 21:38:38.702237 2578 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/96b2dbd7-d125-467b-b055-5868b667f1c6-trusted-ca-bundle" (OuterVolumeSpecName: "trusted-ca-bundle") pod "96b2dbd7-d125-467b-b055-5868b667f1c6" (UID: "96b2dbd7-d125-467b-b055-5868b667f1c6"). InnerVolumeSpecName "trusted-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jun 02 21:38:38.702440 ip-10-0-138-193 kubenswrapper[2578]: I0602 21:38:38.702392 2578 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/96b2dbd7-d125-467b-b055-5868b667f1c6-oauth-serving-cert" (OuterVolumeSpecName: "oauth-serving-cert") pod "96b2dbd7-d125-467b-b055-5868b667f1c6" (UID: "96b2dbd7-d125-467b-b055-5868b667f1c6"). InnerVolumeSpecName "oauth-serving-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jun 02 21:38:38.703915 ip-10-0-138-193 kubenswrapper[2578]: I0602 21:38:38.703888 2578 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/96b2dbd7-d125-467b-b055-5868b667f1c6-console-oauth-config" (OuterVolumeSpecName: "console-oauth-config") pod "96b2dbd7-d125-467b-b055-5868b667f1c6" (UID: "96b2dbd7-d125-467b-b055-5868b667f1c6"). InnerVolumeSpecName "console-oauth-config". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jun 02 21:38:38.704021 ip-10-0-138-193 kubenswrapper[2578]: I0602 21:38:38.703932 2578 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/96b2dbd7-d125-467b-b055-5868b667f1c6-console-serving-cert" (OuterVolumeSpecName: "console-serving-cert") pod "96b2dbd7-d125-467b-b055-5868b667f1c6" (UID: "96b2dbd7-d125-467b-b055-5868b667f1c6"). InnerVolumeSpecName "console-serving-cert". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jun 02 21:38:38.704021 ip-10-0-138-193 kubenswrapper[2578]: I0602 21:38:38.703943 2578 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/96b2dbd7-d125-467b-b055-5868b667f1c6-kube-api-access-czspl" (OuterVolumeSpecName: "kube-api-access-czspl") pod "96b2dbd7-d125-467b-b055-5868b667f1c6" (UID: "96b2dbd7-d125-467b-b055-5868b667f1c6"). InnerVolumeSpecName "kube-api-access-czspl". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 02 21:38:38.803329 ip-10-0-138-193 kubenswrapper[2578]: I0602 21:38:38.803291 2578 reconciler_common.go:299] "Volume detached for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/96b2dbd7-d125-467b-b055-5868b667f1c6-oauth-serving-cert\") on node \"ip-10-0-138-193.ec2.internal\" DevicePath \"\"" Jun 02 21:38:38.803329 ip-10-0-138-193 kubenswrapper[2578]: I0602 21:38:38.803322 2578 reconciler_common.go:299] "Volume detached for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/96b2dbd7-d125-467b-b055-5868b667f1c6-console-oauth-config\") on node \"ip-10-0-138-193.ec2.internal\" DevicePath \"\"" Jun 02 21:38:38.803329 ip-10-0-138-193 kubenswrapper[2578]: I0602 21:38:38.803333 2578 reconciler_common.go:299] "Volume detached for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/96b2dbd7-d125-467b-b055-5868b667f1c6-service-ca\") on node \"ip-10-0-138-193.ec2.internal\" DevicePath \"\"" Jun 02 21:38:38.803564 ip-10-0-138-193 kubenswrapper[2578]: I0602 21:38:38.803343 2578 reconciler_common.go:299] "Volume detached for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/96b2dbd7-d125-467b-b055-5868b667f1c6-trusted-ca-bundle\") on node \"ip-10-0-138-193.ec2.internal\" DevicePath \"\"" Jun 02 21:38:38.803564 ip-10-0-138-193 kubenswrapper[2578]: I0602 21:38:38.803353 2578 reconciler_common.go:299] "Volume detached for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/96b2dbd7-d125-467b-b055-5868b667f1c6-console-config\") on node \"ip-10-0-138-193.ec2.internal\" DevicePath \"\"" Jun 02 21:38:38.803564 ip-10-0-138-193 kubenswrapper[2578]: I0602 21:38:38.803362 2578 reconciler_common.go:299] "Volume detached for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/96b2dbd7-d125-467b-b055-5868b667f1c6-console-serving-cert\") on node \"ip-10-0-138-193.ec2.internal\" DevicePath \"\"" Jun 02 21:38:38.803564 ip-10-0-138-193 kubenswrapper[2578]: I0602 21:38:38.803370 2578 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-czspl\" (UniqueName: \"kubernetes.io/projected/96b2dbd7-d125-467b-b055-5868b667f1c6-kube-api-access-czspl\") on node \"ip-10-0-138-193.ec2.internal\" DevicePath \"\"" Jun 02 21:38:39.404487 ip-10-0-138-193 kubenswrapper[2578]: I0602 21:38:39.404457 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console_console-9668769f-vv59c_96b2dbd7-d125-467b-b055-5868b667f1c6/console/0.log" Jun 02 21:38:39.404908 ip-10-0-138-193 kubenswrapper[2578]: I0602 21:38:39.404499 2578 generic.go:358] "Generic (PLEG): container finished" podID="96b2dbd7-d125-467b-b055-5868b667f1c6" containerID="ab5ebcd6d3f78bb480e8dde3461e4da90e78d78efcf6a3d7ef7670181adc7d31" exitCode=2 Jun 02 21:38:39.404908 ip-10-0-138-193 kubenswrapper[2578]: I0602 21:38:39.404535 2578 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-9668769f-vv59c" event={"ID":"96b2dbd7-d125-467b-b055-5868b667f1c6","Type":"ContainerDied","Data":"ab5ebcd6d3f78bb480e8dde3461e4da90e78d78efcf6a3d7ef7670181adc7d31"} Jun 02 21:38:39.404908 ip-10-0-138-193 kubenswrapper[2578]: I0602 21:38:39.404584 2578 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-9668769f-vv59c" event={"ID":"96b2dbd7-d125-467b-b055-5868b667f1c6","Type":"ContainerDied","Data":"85eace839bb1e8580776140bb99093461ca2ed2e56741e70433924c00c35f976"} Jun 02 21:38:39.404908 ip-10-0-138-193 kubenswrapper[2578]: I0602 21:38:39.404603 2578 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-9668769f-vv59c" Jun 02 21:38:39.404908 ip-10-0-138-193 kubenswrapper[2578]: I0602 21:38:39.404605 2578 scope.go:117] "RemoveContainer" containerID="ab5ebcd6d3f78bb480e8dde3461e4da90e78d78efcf6a3d7ef7670181adc7d31" Jun 02 21:38:39.413278 ip-10-0-138-193 kubenswrapper[2578]: I0602 21:38:39.413258 2578 scope.go:117] "RemoveContainer" containerID="ab5ebcd6d3f78bb480e8dde3461e4da90e78d78efcf6a3d7ef7670181adc7d31" Jun 02 21:38:39.413534 ip-10-0-138-193 kubenswrapper[2578]: E0602 21:38:39.413515 2578 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"ab5ebcd6d3f78bb480e8dde3461e4da90e78d78efcf6a3d7ef7670181adc7d31\": container with ID starting with ab5ebcd6d3f78bb480e8dde3461e4da90e78d78efcf6a3d7ef7670181adc7d31 not found: ID does not exist" containerID="ab5ebcd6d3f78bb480e8dde3461e4da90e78d78efcf6a3d7ef7670181adc7d31" Jun 02 21:38:39.413596 ip-10-0-138-193 kubenswrapper[2578]: I0602 21:38:39.413541 2578 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"ab5ebcd6d3f78bb480e8dde3461e4da90e78d78efcf6a3d7ef7670181adc7d31"} err="failed to get container status \"ab5ebcd6d3f78bb480e8dde3461e4da90e78d78efcf6a3d7ef7670181adc7d31\": rpc error: code = NotFound desc = could not find container \"ab5ebcd6d3f78bb480e8dde3461e4da90e78d78efcf6a3d7ef7670181adc7d31\": container with ID starting with ab5ebcd6d3f78bb480e8dde3461e4da90e78d78efcf6a3d7ef7670181adc7d31 not found: ID does not exist" Jun 02 21:38:39.421050 ip-10-0-138-193 kubenswrapper[2578]: I0602 21:38:39.421027 2578 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openshift-console/console-9668769f-vv59c"] Jun 02 21:38:39.427496 ip-10-0-138-193 kubenswrapper[2578]: I0602 21:38:39.427472 2578 kubelet.go:2547] "SyncLoop REMOVE" source="api" pods=["openshift-console/console-9668769f-vv59c"] Jun 02 21:38:41.322301 ip-10-0-138-193 kubenswrapper[2578]: I0602 21:38:41.322266 2578 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="96b2dbd7-d125-467b-b055-5868b667f1c6" path="/var/lib/kubelet/pods/96b2dbd7-d125-467b-b055-5868b667f1c6/volumes" Jun 02 21:38:43.196068 ip-10-0-138-193 kubenswrapper[2578]: I0602 21:38:43.196029 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-5zgzd_ecde3d34-b3a4-422b-9a2d-c8a4541cc718/ovn-acl-logging/0.log" Jun 02 21:38:43.196508 ip-10-0-138-193 kubenswrapper[2578]: I0602 21:38:43.196029 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-5zgzd_ecde3d34-b3a4-422b-9a2d-c8a4541cc718/ovn-acl-logging/0.log" Jun 02 21:38:43.209256 ip-10-0-138-193 kubenswrapper[2578]: I0602 21:38:43.209237 2578 kubelet.go:1628] "Image garbage collection succeeded" Jun 02 21:39:41.136045 ip-10-0-138-193 kubenswrapper[2578]: I0602 21:39:41.136010 2578 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-console/console-6b5f69b87-7qjqs"] Jun 02 21:39:41.136508 ip-10-0-138-193 kubenswrapper[2578]: I0602 21:39:41.136360 2578 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="96b2dbd7-d125-467b-b055-5868b667f1c6" containerName="console" Jun 02 21:39:41.136508 ip-10-0-138-193 kubenswrapper[2578]: I0602 21:39:41.136372 2578 state_mem.go:107] "Deleted CPUSet assignment" podUID="96b2dbd7-d125-467b-b055-5868b667f1c6" containerName="console" Jun 02 21:39:41.136508 ip-10-0-138-193 kubenswrapper[2578]: I0602 21:39:41.136429 2578 memory_manager.go:356] "RemoveStaleState removing state" podUID="96b2dbd7-d125-467b-b055-5868b667f1c6" containerName="console" Jun 02 21:39:41.139459 ip-10-0-138-193 kubenswrapper[2578]: I0602 21:39:41.139438 2578 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-6b5f69b87-7qjqs" Jun 02 21:39:41.148630 ip-10-0-138-193 kubenswrapper[2578]: I0602 21:39:41.148602 2578 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-6b5f69b87-7qjqs"] Jun 02 21:39:41.227918 ip-10-0-138-193 kubenswrapper[2578]: I0602 21:39:41.227887 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/abaf0c4c-d177-4ffe-9480-b30e1d2b3761-console-oauth-config\") pod \"console-6b5f69b87-7qjqs\" (UID: \"abaf0c4c-d177-4ffe-9480-b30e1d2b3761\") " pod="openshift-console/console-6b5f69b87-7qjqs" Jun 02 21:39:41.228118 ip-10-0-138-193 kubenswrapper[2578]: I0602 21:39:41.227949 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/abaf0c4c-d177-4ffe-9480-b30e1d2b3761-oauth-serving-cert\") pod \"console-6b5f69b87-7qjqs\" (UID: \"abaf0c4c-d177-4ffe-9480-b30e1d2b3761\") " pod="openshift-console/console-6b5f69b87-7qjqs" Jun 02 21:39:41.228118 ip-10-0-138-193 kubenswrapper[2578]: I0602 21:39:41.228015 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/abaf0c4c-d177-4ffe-9480-b30e1d2b3761-console-config\") pod \"console-6b5f69b87-7qjqs\" (UID: \"abaf0c4c-d177-4ffe-9480-b30e1d2b3761\") " pod="openshift-console/console-6b5f69b87-7qjqs" Jun 02 21:39:41.228118 ip-10-0-138-193 kubenswrapper[2578]: I0602 21:39:41.228044 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/abaf0c4c-d177-4ffe-9480-b30e1d2b3761-trusted-ca-bundle\") pod \"console-6b5f69b87-7qjqs\" (UID: \"abaf0c4c-d177-4ffe-9480-b30e1d2b3761\") " pod="openshift-console/console-6b5f69b87-7qjqs" Jun 02 21:39:41.228118 ip-10-0-138-193 kubenswrapper[2578]: I0602 21:39:41.228103 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/abaf0c4c-d177-4ffe-9480-b30e1d2b3761-console-serving-cert\") pod \"console-6b5f69b87-7qjqs\" (UID: \"abaf0c4c-d177-4ffe-9480-b30e1d2b3761\") " pod="openshift-console/console-6b5f69b87-7qjqs" Jun 02 21:39:41.228251 ip-10-0-138-193 kubenswrapper[2578]: I0602 21:39:41.228129 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/abaf0c4c-d177-4ffe-9480-b30e1d2b3761-service-ca\") pod \"console-6b5f69b87-7qjqs\" (UID: \"abaf0c4c-d177-4ffe-9480-b30e1d2b3761\") " pod="openshift-console/console-6b5f69b87-7qjqs" Jun 02 21:39:41.228251 ip-10-0-138-193 kubenswrapper[2578]: I0602 21:39:41.228148 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-2nm9x\" (UniqueName: \"kubernetes.io/projected/abaf0c4c-d177-4ffe-9480-b30e1d2b3761-kube-api-access-2nm9x\") pod \"console-6b5f69b87-7qjqs\" (UID: \"abaf0c4c-d177-4ffe-9480-b30e1d2b3761\") " pod="openshift-console/console-6b5f69b87-7qjqs" Jun 02 21:39:41.328822 ip-10-0-138-193 kubenswrapper[2578]: I0602 21:39:41.328789 2578 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/abaf0c4c-d177-4ffe-9480-b30e1d2b3761-oauth-serving-cert\") pod \"console-6b5f69b87-7qjqs\" (UID: \"abaf0c4c-d177-4ffe-9480-b30e1d2b3761\") " pod="openshift-console/console-6b5f69b87-7qjqs" Jun 02 21:39:41.328822 ip-10-0-138-193 kubenswrapper[2578]: I0602 21:39:41.328823 2578 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/abaf0c4c-d177-4ffe-9480-b30e1d2b3761-console-config\") pod \"console-6b5f69b87-7qjqs\" (UID: \"abaf0c4c-d177-4ffe-9480-b30e1d2b3761\") " pod="openshift-console/console-6b5f69b87-7qjqs" Jun 02 21:39:41.329113 ip-10-0-138-193 kubenswrapper[2578]: I0602 21:39:41.328840 2578 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/abaf0c4c-d177-4ffe-9480-b30e1d2b3761-trusted-ca-bundle\") pod \"console-6b5f69b87-7qjqs\" (UID: \"abaf0c4c-d177-4ffe-9480-b30e1d2b3761\") " pod="openshift-console/console-6b5f69b87-7qjqs" Jun 02 21:39:41.329113 ip-10-0-138-193 kubenswrapper[2578]: I0602 21:39:41.328877 2578 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/abaf0c4c-d177-4ffe-9480-b30e1d2b3761-console-serving-cert\") pod \"console-6b5f69b87-7qjqs\" (UID: \"abaf0c4c-d177-4ffe-9480-b30e1d2b3761\") " pod="openshift-console/console-6b5f69b87-7qjqs" Jun 02 21:39:41.329113 ip-10-0-138-193 kubenswrapper[2578]: I0602 21:39:41.328896 2578 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/abaf0c4c-d177-4ffe-9480-b30e1d2b3761-service-ca\") pod \"console-6b5f69b87-7qjqs\" (UID: \"abaf0c4c-d177-4ffe-9480-b30e1d2b3761\") " pod="openshift-console/console-6b5f69b87-7qjqs" Jun 02 21:39:41.329113 ip-10-0-138-193 kubenswrapper[2578]: I0602 21:39:41.328918 2578 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-2nm9x\" (UniqueName: \"kubernetes.io/projected/abaf0c4c-d177-4ffe-9480-b30e1d2b3761-kube-api-access-2nm9x\") pod \"console-6b5f69b87-7qjqs\" (UID: \"abaf0c4c-d177-4ffe-9480-b30e1d2b3761\") " pod="openshift-console/console-6b5f69b87-7qjqs" Jun 02 21:39:41.329113 ip-10-0-138-193 kubenswrapper[2578]: I0602 21:39:41.328939 2578 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/abaf0c4c-d177-4ffe-9480-b30e1d2b3761-console-oauth-config\") pod \"console-6b5f69b87-7qjqs\" (UID: \"abaf0c4c-d177-4ffe-9480-b30e1d2b3761\") " pod="openshift-console/console-6b5f69b87-7qjqs" Jun 02 21:39:41.329653 ip-10-0-138-193 kubenswrapper[2578]: I0602 21:39:41.329622 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/abaf0c4c-d177-4ffe-9480-b30e1d2b3761-console-config\") pod \"console-6b5f69b87-7qjqs\" (UID: \"abaf0c4c-d177-4ffe-9480-b30e1d2b3761\") " pod="openshift-console/console-6b5f69b87-7qjqs" Jun 02 21:39:41.329653 ip-10-0-138-193 kubenswrapper[2578]: I0602 21:39:41.329648 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/abaf0c4c-d177-4ffe-9480-b30e1d2b3761-service-ca\") pod \"console-6b5f69b87-7qjqs\" (UID: \"abaf0c4c-d177-4ffe-9480-b30e1d2b3761\") " pod="openshift-console/console-6b5f69b87-7qjqs" Jun 02 21:39:41.329841 ip-10-0-138-193 kubenswrapper[2578]: I0602 21:39:41.329724 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/abaf0c4c-d177-4ffe-9480-b30e1d2b3761-oauth-serving-cert\") pod \"console-6b5f69b87-7qjqs\" (UID: \"abaf0c4c-d177-4ffe-9480-b30e1d2b3761\") " pod="openshift-console/console-6b5f69b87-7qjqs" Jun 02 21:39:41.329841 ip-10-0-138-193 kubenswrapper[2578]: I0602 21:39:41.329781 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/abaf0c4c-d177-4ffe-9480-b30e1d2b3761-trusted-ca-bundle\") pod \"console-6b5f69b87-7qjqs\" (UID: \"abaf0c4c-d177-4ffe-9480-b30e1d2b3761\") " pod="openshift-console/console-6b5f69b87-7qjqs" Jun 02 21:39:41.331463 ip-10-0-138-193 kubenswrapper[2578]: I0602 21:39:41.331435 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/abaf0c4c-d177-4ffe-9480-b30e1d2b3761-console-oauth-config\") pod \"console-6b5f69b87-7qjqs\" (UID: \"abaf0c4c-d177-4ffe-9480-b30e1d2b3761\") " pod="openshift-console/console-6b5f69b87-7qjqs" Jun 02 21:39:41.331597 ip-10-0-138-193 kubenswrapper[2578]: I0602 21:39:41.331583 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/abaf0c4c-d177-4ffe-9480-b30e1d2b3761-console-serving-cert\") pod \"console-6b5f69b87-7qjqs\" (UID: \"abaf0c4c-d177-4ffe-9480-b30e1d2b3761\") " pod="openshift-console/console-6b5f69b87-7qjqs" Jun 02 21:39:41.336540 ip-10-0-138-193 kubenswrapper[2578]: I0602 21:39:41.336522 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-2nm9x\" (UniqueName: \"kubernetes.io/projected/abaf0c4c-d177-4ffe-9480-b30e1d2b3761-kube-api-access-2nm9x\") pod \"console-6b5f69b87-7qjqs\" (UID: \"abaf0c4c-d177-4ffe-9480-b30e1d2b3761\") " pod="openshift-console/console-6b5f69b87-7qjqs" Jun 02 21:39:41.450262 ip-10-0-138-193 kubenswrapper[2578]: I0602 21:39:41.450218 2578 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-6b5f69b87-7qjqs" Jun 02 21:39:41.581054 ip-10-0-138-193 kubenswrapper[2578]: I0602 21:39:41.581023 2578 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-6b5f69b87-7qjqs"] Jun 02 21:39:41.584604 ip-10-0-138-193 kubenswrapper[2578]: W0602 21:39:41.584574 2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podabaf0c4c_d177_4ffe_9480_b30e1d2b3761.slice/crio-591613417b39d2c9b14e2debebbb78caa8521fdca0ddc2455fdae1d549dfe434 WatchSource:0}: Error finding container 591613417b39d2c9b14e2debebbb78caa8521fdca0ddc2455fdae1d549dfe434: Status 404 returned error can't find the container with id 591613417b39d2c9b14e2debebbb78caa8521fdca0ddc2455fdae1d549dfe434 Jun 02 21:39:41.586465 ip-10-0-138-193 kubenswrapper[2578]: I0602 21:39:41.586445 2578 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider Jun 02 21:39:41.595313 ip-10-0-138-193 kubenswrapper[2578]: I0602 21:39:41.595280 2578 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-6b5f69b87-7qjqs" event={"ID":"abaf0c4c-d177-4ffe-9480-b30e1d2b3761","Type":"ContainerStarted","Data":"591613417b39d2c9b14e2debebbb78caa8521fdca0ddc2455fdae1d549dfe434"} Jun 02 21:39:42.599676 ip-10-0-138-193 kubenswrapper[2578]: I0602 21:39:42.599638 2578 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-6b5f69b87-7qjqs" event={"ID":"abaf0c4c-d177-4ffe-9480-b30e1d2b3761","Type":"ContainerStarted","Data":"7ea1e10c41aa47f9eb585de040449352cb41d5be9a7ea6670f4271cb3f4397d1"} Jun 02 21:39:42.616886 ip-10-0-138-193 kubenswrapper[2578]: I0602 21:39:42.616843 2578 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-console/console-6b5f69b87-7qjqs" podStartSLOduration=1.616828612 podStartE2EDuration="1.616828612s" podCreationTimestamp="2026-06-02 21:39:41 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2026-06-02 21:39:42.615840875 +0000 UTC m=+359.867738781" watchObservedRunningTime="2026-06-02 21:39:42.616828612 +0000 UTC m=+359.868726518" Jun 02 21:39:51.451350 ip-10-0-138-193 kubenswrapper[2578]: I0602 21:39:51.451313 2578 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/console-6b5f69b87-7qjqs" Jun 02 21:39:51.451751 ip-10-0-138-193 kubenswrapper[2578]: I0602 21:39:51.451463 2578 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-console/console-6b5f69b87-7qjqs" Jun 02 21:39:51.456412 ip-10-0-138-193 kubenswrapper[2578]: I0602 21:39:51.456388 2578 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-console/console-6b5f69b87-7qjqs" Jun 02 21:39:51.630376 ip-10-0-138-193 kubenswrapper[2578]: I0602 21:39:51.630349 2578 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console/console-6b5f69b87-7qjqs" Jun 02 21:39:51.675508 ip-10-0-138-193 kubenswrapper[2578]: I0602 21:39:51.675474 2578 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openshift-console/console-7bd6468cf9-pv9xk"] Jun 02 21:40:16.698843 ip-10-0-138-193 kubenswrapper[2578]: I0602 21:40:16.698785 2578 kuberuntime_container.go:864] "Killing container with a grace period" pod="openshift-console/console-7bd6468cf9-pv9xk" podUID="4399b683-a1d2-4ba0-9ffd-4dfcda2b7717" containerName="console" containerID="cri-o://3cd32d2587558f71133ee4d524f44bdf626d4529c51fc31ec4881c5e20498e97" gracePeriod=15 Jun 02 21:40:16.941930 ip-10-0-138-193 kubenswrapper[2578]: I0602 21:40:16.941908 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console_console-7bd6468cf9-pv9xk_4399b683-a1d2-4ba0-9ffd-4dfcda2b7717/console/0.log" Jun 02 21:40:16.942037 ip-10-0-138-193 kubenswrapper[2578]: I0602 21:40:16.941969 2578 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-7bd6468cf9-pv9xk" Jun 02 21:40:17.033606 ip-10-0-138-193 kubenswrapper[2578]: I0602 21:40:17.033514 2578 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/4399b683-a1d2-4ba0-9ffd-4dfcda2b7717-console-config\") pod \"4399b683-a1d2-4ba0-9ffd-4dfcda2b7717\" (UID: \"4399b683-a1d2-4ba0-9ffd-4dfcda2b7717\") " Jun 02 21:40:17.033606 ip-10-0-138-193 kubenswrapper[2578]: I0602 21:40:17.033574 2578 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/4399b683-a1d2-4ba0-9ffd-4dfcda2b7717-console-serving-cert\") pod \"4399b683-a1d2-4ba0-9ffd-4dfcda2b7717\" (UID: \"4399b683-a1d2-4ba0-9ffd-4dfcda2b7717\") " Jun 02 21:40:17.033838 ip-10-0-138-193 kubenswrapper[2578]: I0602 21:40:17.033612 2578 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/4399b683-a1d2-4ba0-9ffd-4dfcda2b7717-oauth-serving-cert\") pod \"4399b683-a1d2-4ba0-9ffd-4dfcda2b7717\" (UID: \"4399b683-a1d2-4ba0-9ffd-4dfcda2b7717\") " Jun 02 21:40:17.033838 ip-10-0-138-193 kubenswrapper[2578]: I0602 21:40:17.033647 2578 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/4399b683-a1d2-4ba0-9ffd-4dfcda2b7717-trusted-ca-bundle\") pod \"4399b683-a1d2-4ba0-9ffd-4dfcda2b7717\" (UID: \"4399b683-a1d2-4ba0-9ffd-4dfcda2b7717\") " Jun 02 21:40:17.033838 ip-10-0-138-193 kubenswrapper[2578]: I0602 21:40:17.033663 2578 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/4399b683-a1d2-4ba0-9ffd-4dfcda2b7717-service-ca\") pod \"4399b683-a1d2-4ba0-9ffd-4dfcda2b7717\" (UID: \"4399b683-a1d2-4ba0-9ffd-4dfcda2b7717\") " Jun 02 21:40:17.033838 ip-10-0-138-193 kubenswrapper[2578]: I0602 21:40:17.033706 2578 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/4399b683-a1d2-4ba0-9ffd-4dfcda2b7717-console-oauth-config\") pod \"4399b683-a1d2-4ba0-9ffd-4dfcda2b7717\" (UID: \"4399b683-a1d2-4ba0-9ffd-4dfcda2b7717\") " Jun 02 21:40:17.033838 ip-10-0-138-193 kubenswrapper[2578]: I0602 21:40:17.033732 2578 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-gn8kx\" (UniqueName: \"kubernetes.io/projected/4399b683-a1d2-4ba0-9ffd-4dfcda2b7717-kube-api-access-gn8kx\") pod \"4399b683-a1d2-4ba0-9ffd-4dfcda2b7717\" (UID: \"4399b683-a1d2-4ba0-9ffd-4dfcda2b7717\") " Jun 02 21:40:17.034107 ip-10-0-138-193 kubenswrapper[2578]: I0602 21:40:17.034004 2578 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/4399b683-a1d2-4ba0-9ffd-4dfcda2b7717-console-config" (OuterVolumeSpecName: "console-config") pod "4399b683-a1d2-4ba0-9ffd-4dfcda2b7717" (UID: "4399b683-a1d2-4ba0-9ffd-4dfcda2b7717"). InnerVolumeSpecName "console-config". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jun 02 21:40:17.034107 ip-10-0-138-193 kubenswrapper[2578]: I0602 21:40:17.034045 2578 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/4399b683-a1d2-4ba0-9ffd-4dfcda2b7717-oauth-serving-cert" (OuterVolumeSpecName: "oauth-serving-cert") pod "4399b683-a1d2-4ba0-9ffd-4dfcda2b7717" (UID: "4399b683-a1d2-4ba0-9ffd-4dfcda2b7717"). InnerVolumeSpecName "oauth-serving-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jun 02 21:40:17.034226 ip-10-0-138-193 kubenswrapper[2578]: I0602 21:40:17.034134 2578 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/4399b683-a1d2-4ba0-9ffd-4dfcda2b7717-trusted-ca-bundle" (OuterVolumeSpecName: "trusted-ca-bundle") pod "4399b683-a1d2-4ba0-9ffd-4dfcda2b7717" (UID: "4399b683-a1d2-4ba0-9ffd-4dfcda2b7717"). InnerVolumeSpecName "trusted-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jun 02 21:40:17.034226 ip-10-0-138-193 kubenswrapper[2578]: I0602 21:40:17.034149 2578 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/4399b683-a1d2-4ba0-9ffd-4dfcda2b7717-service-ca" (OuterVolumeSpecName: "service-ca") pod "4399b683-a1d2-4ba0-9ffd-4dfcda2b7717" (UID: "4399b683-a1d2-4ba0-9ffd-4dfcda2b7717"). InnerVolumeSpecName "service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jun 02 21:40:17.035778 ip-10-0-138-193 kubenswrapper[2578]: I0602 21:40:17.035751 2578 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/4399b683-a1d2-4ba0-9ffd-4dfcda2b7717-console-serving-cert" (OuterVolumeSpecName: "console-serving-cert") pod "4399b683-a1d2-4ba0-9ffd-4dfcda2b7717" (UID: "4399b683-a1d2-4ba0-9ffd-4dfcda2b7717"). InnerVolumeSpecName "console-serving-cert". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jun 02 21:40:17.035908 ip-10-0-138-193 kubenswrapper[2578]: I0602 21:40:17.035791 2578 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/4399b683-a1d2-4ba0-9ffd-4dfcda2b7717-console-oauth-config" (OuterVolumeSpecName: "console-oauth-config") pod "4399b683-a1d2-4ba0-9ffd-4dfcda2b7717" (UID: "4399b683-a1d2-4ba0-9ffd-4dfcda2b7717"). InnerVolumeSpecName "console-oauth-config". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jun 02 21:40:17.035908 ip-10-0-138-193 kubenswrapper[2578]: I0602 21:40:17.035893 2578 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/4399b683-a1d2-4ba0-9ffd-4dfcda2b7717-kube-api-access-gn8kx" (OuterVolumeSpecName: "kube-api-access-gn8kx") pod "4399b683-a1d2-4ba0-9ffd-4dfcda2b7717" (UID: "4399b683-a1d2-4ba0-9ffd-4dfcda2b7717"). InnerVolumeSpecName "kube-api-access-gn8kx". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 02 21:40:17.134833 ip-10-0-138-193 kubenswrapper[2578]: I0602 21:40:17.134797 2578 reconciler_common.go:299] "Volume detached for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/4399b683-a1d2-4ba0-9ffd-4dfcda2b7717-console-serving-cert\") on node \"ip-10-0-138-193.ec2.internal\" DevicePath \"\"" Jun 02 21:40:17.134833 ip-10-0-138-193 kubenswrapper[2578]: I0602 21:40:17.134826 2578 reconciler_common.go:299] "Volume detached for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/4399b683-a1d2-4ba0-9ffd-4dfcda2b7717-oauth-serving-cert\") on node \"ip-10-0-138-193.ec2.internal\" DevicePath \"\"" Jun 02 21:40:17.134833 ip-10-0-138-193 kubenswrapper[2578]: I0602 21:40:17.134835 2578 reconciler_common.go:299] "Volume detached for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/4399b683-a1d2-4ba0-9ffd-4dfcda2b7717-trusted-ca-bundle\") on node \"ip-10-0-138-193.ec2.internal\" DevicePath \"\"" Jun 02 21:40:17.134833 ip-10-0-138-193 kubenswrapper[2578]: I0602 21:40:17.134844 2578 reconciler_common.go:299] "Volume detached for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/4399b683-a1d2-4ba0-9ffd-4dfcda2b7717-service-ca\") on node \"ip-10-0-138-193.ec2.internal\" DevicePath \"\"" Jun 02 21:40:17.135110 ip-10-0-138-193 kubenswrapper[2578]: I0602 21:40:17.134854 2578 reconciler_common.go:299] "Volume detached for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/4399b683-a1d2-4ba0-9ffd-4dfcda2b7717-console-oauth-config\") on node \"ip-10-0-138-193.ec2.internal\" DevicePath \"\"" Jun 02 21:40:17.135110 ip-10-0-138-193 kubenswrapper[2578]: I0602 21:40:17.134863 2578 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-gn8kx\" (UniqueName: \"kubernetes.io/projected/4399b683-a1d2-4ba0-9ffd-4dfcda2b7717-kube-api-access-gn8kx\") on node \"ip-10-0-138-193.ec2.internal\" DevicePath \"\"" Jun 02 21:40:17.135110 ip-10-0-138-193 kubenswrapper[2578]: I0602 21:40:17.134873 2578 reconciler_common.go:299] "Volume detached for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/4399b683-a1d2-4ba0-9ffd-4dfcda2b7717-console-config\") on node \"ip-10-0-138-193.ec2.internal\" DevicePath \"\"" Jun 02 21:40:17.706373 ip-10-0-138-193 kubenswrapper[2578]: I0602 21:40:17.706349 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console_console-7bd6468cf9-pv9xk_4399b683-a1d2-4ba0-9ffd-4dfcda2b7717/console/0.log" Jun 02 21:40:17.706838 ip-10-0-138-193 kubenswrapper[2578]: I0602 21:40:17.706389 2578 generic.go:358] "Generic (PLEG): container finished" podID="4399b683-a1d2-4ba0-9ffd-4dfcda2b7717" containerID="3cd32d2587558f71133ee4d524f44bdf626d4529c51fc31ec4881c5e20498e97" exitCode=2 Jun 02 21:40:17.706838 ip-10-0-138-193 kubenswrapper[2578]: I0602 21:40:17.706424 2578 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-7bd6468cf9-pv9xk" event={"ID":"4399b683-a1d2-4ba0-9ffd-4dfcda2b7717","Type":"ContainerDied","Data":"3cd32d2587558f71133ee4d524f44bdf626d4529c51fc31ec4881c5e20498e97"} Jun 02 21:40:17.706838 ip-10-0-138-193 kubenswrapper[2578]: I0602 21:40:17.706459 2578 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-7bd6468cf9-pv9xk" Jun 02 21:40:17.706838 ip-10-0-138-193 kubenswrapper[2578]: I0602 21:40:17.706474 2578 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-7bd6468cf9-pv9xk" event={"ID":"4399b683-a1d2-4ba0-9ffd-4dfcda2b7717","Type":"ContainerDied","Data":"45a31931cec4877baee3d7642fef8c7a607523736ff18e0608840cefbabbad89"} Jun 02 21:40:17.706838 ip-10-0-138-193 kubenswrapper[2578]: I0602 21:40:17.706497 2578 scope.go:117] "RemoveContainer" containerID="3cd32d2587558f71133ee4d524f44bdf626d4529c51fc31ec4881c5e20498e97" Jun 02 21:40:17.714428 ip-10-0-138-193 kubenswrapper[2578]: I0602 21:40:17.714411 2578 scope.go:117] "RemoveContainer" containerID="3cd32d2587558f71133ee4d524f44bdf626d4529c51fc31ec4881c5e20498e97" Jun 02 21:40:17.714680 ip-10-0-138-193 kubenswrapper[2578]: E0602 21:40:17.714660 2578 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"3cd32d2587558f71133ee4d524f44bdf626d4529c51fc31ec4881c5e20498e97\": container with ID starting with 3cd32d2587558f71133ee4d524f44bdf626d4529c51fc31ec4881c5e20498e97 not found: ID does not exist" containerID="3cd32d2587558f71133ee4d524f44bdf626d4529c51fc31ec4881c5e20498e97" Jun 02 21:40:17.714743 ip-10-0-138-193 kubenswrapper[2578]: I0602 21:40:17.714687 2578 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"3cd32d2587558f71133ee4d524f44bdf626d4529c51fc31ec4881c5e20498e97"} err="failed to get container status \"3cd32d2587558f71133ee4d524f44bdf626d4529c51fc31ec4881c5e20498e97\": rpc error: code = NotFound desc = could not find container \"3cd32d2587558f71133ee4d524f44bdf626d4529c51fc31ec4881c5e20498e97\": container with ID starting with 3cd32d2587558f71133ee4d524f44bdf626d4529c51fc31ec4881c5e20498e97 not found: ID does not exist" Jun 02 21:40:17.725548 ip-10-0-138-193 kubenswrapper[2578]: I0602 21:40:17.725522 2578 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openshift-console/console-7bd6468cf9-pv9xk"] Jun 02 21:40:17.730853 ip-10-0-138-193 kubenswrapper[2578]: I0602 21:40:17.730833 2578 kubelet.go:2547] "SyncLoop REMOVE" source="api" pods=["openshift-console/console-7bd6468cf9-pv9xk"] Jun 02 21:40:18.915734 ip-10-0-138-193 kubenswrapper[2578]: I0602 21:40:18.915699 2578 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-marketplace/2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19dcbzxj"] Jun 02 21:40:18.916128 ip-10-0-138-193 kubenswrapper[2578]: I0602 21:40:18.916020 2578 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="4399b683-a1d2-4ba0-9ffd-4dfcda2b7717" containerName="console" Jun 02 21:40:18.916128 ip-10-0-138-193 kubenswrapper[2578]: I0602 21:40:18.916030 2578 state_mem.go:107] "Deleted CPUSet assignment" podUID="4399b683-a1d2-4ba0-9ffd-4dfcda2b7717" containerName="console" Jun 02 21:40:18.916206 ip-10-0-138-193 kubenswrapper[2578]: I0602 21:40:18.916136 2578 memory_manager.go:356] "RemoveStaleState removing state" podUID="4399b683-a1d2-4ba0-9ffd-4dfcda2b7717" containerName="console" Jun 02 21:40:18.920635 ip-10-0-138-193 kubenswrapper[2578]: I0602 21:40:18.920617 2578 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19dcbzxj" Jun 02 21:40:18.924930 ip-10-0-138-193 kubenswrapper[2578]: I0602 21:40:18.924899 2578 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"kube-root-ca.crt\"" Jun 02 21:40:18.925100 ip-10-0-138-193 kubenswrapper[2578]: I0602 21:40:18.924952 2578 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-marketplace\"/\"default-dockercfg-hfgcz\"" Jun 02 21:40:18.925710 ip-10-0-138-193 kubenswrapper[2578]: I0602 21:40:18.925688 2578 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"openshift-service-ca.crt\"" Jun 02 21:40:18.928806 ip-10-0-138-193 kubenswrapper[2578]: I0602 21:40:18.928784 2578 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19dcbzxj"] Jun 02 21:40:18.950173 ip-10-0-138-193 kubenswrapper[2578]: I0602 21:40:18.950135 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-z9x42\" (UniqueName: \"kubernetes.io/projected/4ccdf603-2d43-4c01-9da6-2cd6c47154e3-kube-api-access-z9x42\") pod \"2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19dcbzxj\" (UID: \"4ccdf603-2d43-4c01-9da6-2cd6c47154e3\") " pod="openshift-marketplace/2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19dcbzxj" Jun 02 21:40:18.950334 ip-10-0-138-193 kubenswrapper[2578]: I0602 21:40:18.950180 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/4ccdf603-2d43-4c01-9da6-2cd6c47154e3-util\") pod \"2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19dcbzxj\" (UID: \"4ccdf603-2d43-4c01-9da6-2cd6c47154e3\") " pod="openshift-marketplace/2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19dcbzxj" Jun 02 21:40:18.950334 ip-10-0-138-193 kubenswrapper[2578]: I0602 21:40:18.950302 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/4ccdf603-2d43-4c01-9da6-2cd6c47154e3-bundle\") pod \"2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19dcbzxj\" (UID: \"4ccdf603-2d43-4c01-9da6-2cd6c47154e3\") " pod="openshift-marketplace/2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19dcbzxj" Jun 02 21:40:19.051625 ip-10-0-138-193 kubenswrapper[2578]: I0602 21:40:19.051581 2578 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-z9x42\" (UniqueName: \"kubernetes.io/projected/4ccdf603-2d43-4c01-9da6-2cd6c47154e3-kube-api-access-z9x42\") pod \"2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19dcbzxj\" (UID: \"4ccdf603-2d43-4c01-9da6-2cd6c47154e3\") " pod="openshift-marketplace/2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19dcbzxj" Jun 02 21:40:19.051625 ip-10-0-138-193 kubenswrapper[2578]: I0602 21:40:19.051626 2578 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/4ccdf603-2d43-4c01-9da6-2cd6c47154e3-util\") pod \"2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19dcbzxj\" (UID: \"4ccdf603-2d43-4c01-9da6-2cd6c47154e3\") " pod="openshift-marketplace/2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19dcbzxj" Jun 02 21:40:19.051843 ip-10-0-138-193 kubenswrapper[2578]: I0602 21:40:19.051682 2578 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/4ccdf603-2d43-4c01-9da6-2cd6c47154e3-bundle\") pod \"2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19dcbzxj\" (UID: \"4ccdf603-2d43-4c01-9da6-2cd6c47154e3\") " pod="openshift-marketplace/2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19dcbzxj" Jun 02 21:40:19.052016 ip-10-0-138-193 kubenswrapper[2578]: I0602 21:40:19.052002 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/4ccdf603-2d43-4c01-9da6-2cd6c47154e3-bundle\") pod \"2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19dcbzxj\" (UID: \"4ccdf603-2d43-4c01-9da6-2cd6c47154e3\") " pod="openshift-marketplace/2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19dcbzxj" Jun 02 21:40:19.052113 ip-10-0-138-193 kubenswrapper[2578]: I0602 21:40:19.052065 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/4ccdf603-2d43-4c01-9da6-2cd6c47154e3-util\") pod \"2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19dcbzxj\" (UID: \"4ccdf603-2d43-4c01-9da6-2cd6c47154e3\") " pod="openshift-marketplace/2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19dcbzxj" Jun 02 21:40:19.059586 ip-10-0-138-193 kubenswrapper[2578]: I0602 21:40:19.059568 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-z9x42\" (UniqueName: \"kubernetes.io/projected/4ccdf603-2d43-4c01-9da6-2cd6c47154e3-kube-api-access-z9x42\") pod \"2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19dcbzxj\" (UID: \"4ccdf603-2d43-4c01-9da6-2cd6c47154e3\") " pod="openshift-marketplace/2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19dcbzxj" Jun 02 21:40:19.229897 ip-10-0-138-193 kubenswrapper[2578]: I0602 21:40:19.229799 2578 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19dcbzxj" Jun 02 21:40:19.322118 ip-10-0-138-193 kubenswrapper[2578]: I0602 21:40:19.322068 2578 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="4399b683-a1d2-4ba0-9ffd-4dfcda2b7717" path="/var/lib/kubelet/pods/4399b683-a1d2-4ba0-9ffd-4dfcda2b7717/volumes" Jun 02 21:40:19.352154 ip-10-0-138-193 kubenswrapper[2578]: I0602 21:40:19.352110 2578 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19dcbzxj"] Jun 02 21:40:19.354452 ip-10-0-138-193 kubenswrapper[2578]: W0602 21:40:19.354430 2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod4ccdf603_2d43_4c01_9da6_2cd6c47154e3.slice/crio-170747f483c841ca77a628f65664556904d2bc7f8bcaf2385d76e453f3a13f9b WatchSource:0}: Error finding container 170747f483c841ca77a628f65664556904d2bc7f8bcaf2385d76e453f3a13f9b: Status 404 returned error can't find the container with id 170747f483c841ca77a628f65664556904d2bc7f8bcaf2385d76e453f3a13f9b Jun 02 21:40:19.714138 ip-10-0-138-193 kubenswrapper[2578]: I0602 21:40:19.714104 2578 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19dcbzxj" event={"ID":"4ccdf603-2d43-4c01-9da6-2cd6c47154e3","Type":"ContainerStarted","Data":"170747f483c841ca77a628f65664556904d2bc7f8bcaf2385d76e453f3a13f9b"} Jun 02 21:40:25.734329 ip-10-0-138-193 kubenswrapper[2578]: I0602 21:40:25.734293 2578 generic.go:358] "Generic (PLEG): container finished" podID="4ccdf603-2d43-4c01-9da6-2cd6c47154e3" containerID="e8a2427320866e9bff82f983f2b7c859923f7770f7c231cee3f0554dbbb7a175" exitCode=0 Jun 02 21:40:25.734701 ip-10-0-138-193 kubenswrapper[2578]: I0602 21:40:25.734378 2578 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19dcbzxj" event={"ID":"4ccdf603-2d43-4c01-9da6-2cd6c47154e3","Type":"ContainerDied","Data":"e8a2427320866e9bff82f983f2b7c859923f7770f7c231cee3f0554dbbb7a175"} Jun 02 21:40:28.745408 ip-10-0-138-193 kubenswrapper[2578]: I0602 21:40:28.745369 2578 generic.go:358] "Generic (PLEG): container finished" podID="4ccdf603-2d43-4c01-9da6-2cd6c47154e3" containerID="d4a6aa21d7bc61cf8721b12dc96297b8648f733f33ccd3ade155adb2232bc96d" exitCode=0 Jun 02 21:40:28.745804 ip-10-0-138-193 kubenswrapper[2578]: I0602 21:40:28.745445 2578 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19dcbzxj" event={"ID":"4ccdf603-2d43-4c01-9da6-2cd6c47154e3","Type":"ContainerDied","Data":"d4a6aa21d7bc61cf8721b12dc96297b8648f733f33ccd3ade155adb2232bc96d"} Jun 02 21:40:35.771544 ip-10-0-138-193 kubenswrapper[2578]: I0602 21:40:35.771503 2578 generic.go:358] "Generic (PLEG): container finished" podID="4ccdf603-2d43-4c01-9da6-2cd6c47154e3" containerID="c7d9bcd66dd648aa0a9a6fdcb55c54476cc132859563ecf63b45dc81cb3e310d" exitCode=0 Jun 02 21:40:35.771890 ip-10-0-138-193 kubenswrapper[2578]: I0602 21:40:35.771592 2578 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19dcbzxj" event={"ID":"4ccdf603-2d43-4c01-9da6-2cd6c47154e3","Type":"ContainerDied","Data":"c7d9bcd66dd648aa0a9a6fdcb55c54476cc132859563ecf63b45dc81cb3e310d"} Jun 02 21:40:36.901135 ip-10-0-138-193 kubenswrapper[2578]: I0602 21:40:36.901105 2578 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19dcbzxj" Jun 02 21:40:37.003688 ip-10-0-138-193 kubenswrapper[2578]: I0602 21:40:37.003654 2578 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/4ccdf603-2d43-4c01-9da6-2cd6c47154e3-util\") pod \"4ccdf603-2d43-4c01-9da6-2cd6c47154e3\" (UID: \"4ccdf603-2d43-4c01-9da6-2cd6c47154e3\") " Jun 02 21:40:37.003848 ip-10-0-138-193 kubenswrapper[2578]: I0602 21:40:37.003731 2578 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/4ccdf603-2d43-4c01-9da6-2cd6c47154e3-bundle\") pod \"4ccdf603-2d43-4c01-9da6-2cd6c47154e3\" (UID: \"4ccdf603-2d43-4c01-9da6-2cd6c47154e3\") " Jun 02 21:40:37.003848 ip-10-0-138-193 kubenswrapper[2578]: I0602 21:40:37.003753 2578 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-z9x42\" (UniqueName: \"kubernetes.io/projected/4ccdf603-2d43-4c01-9da6-2cd6c47154e3-kube-api-access-z9x42\") pod \"4ccdf603-2d43-4c01-9da6-2cd6c47154e3\" (UID: \"4ccdf603-2d43-4c01-9da6-2cd6c47154e3\") " Jun 02 21:40:37.004355 ip-10-0-138-193 kubenswrapper[2578]: I0602 21:40:37.004331 2578 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/4ccdf603-2d43-4c01-9da6-2cd6c47154e3-bundle" (OuterVolumeSpecName: "bundle") pod "4ccdf603-2d43-4c01-9da6-2cd6c47154e3" (UID: "4ccdf603-2d43-4c01-9da6-2cd6c47154e3"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jun 02 21:40:37.005956 ip-10-0-138-193 kubenswrapper[2578]: I0602 21:40:37.005931 2578 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/4ccdf603-2d43-4c01-9da6-2cd6c47154e3-kube-api-access-z9x42" (OuterVolumeSpecName: "kube-api-access-z9x42") pod "4ccdf603-2d43-4c01-9da6-2cd6c47154e3" (UID: "4ccdf603-2d43-4c01-9da6-2cd6c47154e3"). InnerVolumeSpecName "kube-api-access-z9x42". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 02 21:40:37.008001 ip-10-0-138-193 kubenswrapper[2578]: I0602 21:40:37.007981 2578 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/4ccdf603-2d43-4c01-9da6-2cd6c47154e3-util" (OuterVolumeSpecName: "util") pod "4ccdf603-2d43-4c01-9da6-2cd6c47154e3" (UID: "4ccdf603-2d43-4c01-9da6-2cd6c47154e3"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jun 02 21:40:37.104425 ip-10-0-138-193 kubenswrapper[2578]: I0602 21:40:37.104346 2578 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/4ccdf603-2d43-4c01-9da6-2cd6c47154e3-util\") on node \"ip-10-0-138-193.ec2.internal\" DevicePath \"\"" Jun 02 21:40:37.104425 ip-10-0-138-193 kubenswrapper[2578]: I0602 21:40:37.104373 2578 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/4ccdf603-2d43-4c01-9da6-2cd6c47154e3-bundle\") on node \"ip-10-0-138-193.ec2.internal\" DevicePath \"\"" Jun 02 21:40:37.104425 ip-10-0-138-193 kubenswrapper[2578]: I0602 21:40:37.104387 2578 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-z9x42\" (UniqueName: \"kubernetes.io/projected/4ccdf603-2d43-4c01-9da6-2cd6c47154e3-kube-api-access-z9x42\") on node \"ip-10-0-138-193.ec2.internal\" DevicePath \"\"" Jun 02 21:40:37.779488 ip-10-0-138-193 kubenswrapper[2578]: I0602 21:40:37.779449 2578 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19dcbzxj" event={"ID":"4ccdf603-2d43-4c01-9da6-2cd6c47154e3","Type":"ContainerDied","Data":"170747f483c841ca77a628f65664556904d2bc7f8bcaf2385d76e453f3a13f9b"} Jun 02 21:40:37.779488 ip-10-0-138-193 kubenswrapper[2578]: I0602 21:40:37.779487 2578 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="170747f483c841ca77a628f65664556904d2bc7f8bcaf2385d76e453f3a13f9b" Jun 02 21:40:37.779488 ip-10-0-138-193 kubenswrapper[2578]: I0602 21:40:37.779465 2578 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19dcbzxj" Jun 02 21:40:41.803625 ip-10-0-138-193 kubenswrapper[2578]: I0602 21:40:41.803589 2578 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["cert-manager-operator/cert-manager-operator-controller-manager-54b9655956-f76tg"] Jun 02 21:40:41.804020 ip-10-0-138-193 kubenswrapper[2578]: I0602 21:40:41.803919 2578 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="4ccdf603-2d43-4c01-9da6-2cd6c47154e3" containerName="extract" Jun 02 21:40:41.804020 ip-10-0-138-193 kubenswrapper[2578]: I0602 21:40:41.803931 2578 state_mem.go:107] "Deleted CPUSet assignment" podUID="4ccdf603-2d43-4c01-9da6-2cd6c47154e3" containerName="extract" Jun 02 21:40:41.804020 ip-10-0-138-193 kubenswrapper[2578]: I0602 21:40:41.803940 2578 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="4ccdf603-2d43-4c01-9da6-2cd6c47154e3" containerName="pull" Jun 02 21:40:41.804020 ip-10-0-138-193 kubenswrapper[2578]: I0602 21:40:41.803946 2578 state_mem.go:107] "Deleted CPUSet assignment" podUID="4ccdf603-2d43-4c01-9da6-2cd6c47154e3" containerName="pull" Jun 02 21:40:41.804020 ip-10-0-138-193 kubenswrapper[2578]: I0602 21:40:41.803964 2578 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="4ccdf603-2d43-4c01-9da6-2cd6c47154e3" containerName="util" Jun 02 21:40:41.804020 ip-10-0-138-193 kubenswrapper[2578]: I0602 21:40:41.803969 2578 state_mem.go:107] "Deleted CPUSet assignment" podUID="4ccdf603-2d43-4c01-9da6-2cd6c47154e3" containerName="util" Jun 02 21:40:41.804020 ip-10-0-138-193 kubenswrapper[2578]: I0602 21:40:41.804017 2578 memory_manager.go:356] "RemoveStaleState removing state" podUID="4ccdf603-2d43-4c01-9da6-2cd6c47154e3" containerName="extract" Jun 02 21:40:41.807977 ip-10-0-138-193 kubenswrapper[2578]: I0602 21:40:41.807962 2578 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager-operator/cert-manager-operator-controller-manager-54b9655956-f76tg" Jun 02 21:40:41.810624 ip-10-0-138-193 kubenswrapper[2578]: I0602 21:40:41.810602 2578 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"cert-manager-operator\"/\"cert-manager-operator-controller-manager-dockercfg-wgl5s\"" Jun 02 21:40:41.810811 ip-10-0-138-193 kubenswrapper[2578]: I0602 21:40:41.810790 2578 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"cert-manager-operator\"/\"openshift-service-ca.crt\"" Jun 02 21:40:41.810885 ip-10-0-138-193 kubenswrapper[2578]: I0602 21:40:41.810851 2578 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"cert-manager-operator\"/\"kube-root-ca.crt\"" Jun 02 21:40:41.819097 ip-10-0-138-193 kubenswrapper[2578]: I0602 21:40:41.819055 2578 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["cert-manager-operator/cert-manager-operator-controller-manager-54b9655956-f76tg"] Jun 02 21:40:41.949052 ip-10-0-138-193 kubenswrapper[2578]: I0602 21:40:41.949011 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-q9pjw\" (UniqueName: \"kubernetes.io/projected/97fba2c5-a18e-4de6-b4e1-4600fab9dae4-kube-api-access-q9pjw\") pod \"cert-manager-operator-controller-manager-54b9655956-f76tg\" (UID: \"97fba2c5-a18e-4de6-b4e1-4600fab9dae4\") " pod="cert-manager-operator/cert-manager-operator-controller-manager-54b9655956-f76tg" Jun 02 21:40:41.949274 ip-10-0-138-193 kubenswrapper[2578]: I0602 21:40:41.949067 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/97fba2c5-a18e-4de6-b4e1-4600fab9dae4-tmp\") pod \"cert-manager-operator-controller-manager-54b9655956-f76tg\" (UID: \"97fba2c5-a18e-4de6-b4e1-4600fab9dae4\") " pod="cert-manager-operator/cert-manager-operator-controller-manager-54b9655956-f76tg" Jun 02 21:40:42.049893 ip-10-0-138-193 kubenswrapper[2578]: I0602 21:40:42.049856 2578 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/97fba2c5-a18e-4de6-b4e1-4600fab9dae4-tmp\") pod \"cert-manager-operator-controller-manager-54b9655956-f76tg\" (UID: \"97fba2c5-a18e-4de6-b4e1-4600fab9dae4\") " pod="cert-manager-operator/cert-manager-operator-controller-manager-54b9655956-f76tg" Jun 02 21:40:42.050060 ip-10-0-138-193 kubenswrapper[2578]: I0602 21:40:42.049942 2578 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-q9pjw\" (UniqueName: \"kubernetes.io/projected/97fba2c5-a18e-4de6-b4e1-4600fab9dae4-kube-api-access-q9pjw\") pod \"cert-manager-operator-controller-manager-54b9655956-f76tg\" (UID: \"97fba2c5-a18e-4de6-b4e1-4600fab9dae4\") " pod="cert-manager-operator/cert-manager-operator-controller-manager-54b9655956-f76tg" Jun 02 21:40:42.050330 ip-10-0-138-193 kubenswrapper[2578]: I0602 21:40:42.050306 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/97fba2c5-a18e-4de6-b4e1-4600fab9dae4-tmp\") pod \"cert-manager-operator-controller-manager-54b9655956-f76tg\" (UID: \"97fba2c5-a18e-4de6-b4e1-4600fab9dae4\") " pod="cert-manager-operator/cert-manager-operator-controller-manager-54b9655956-f76tg" Jun 02 21:40:42.058736 ip-10-0-138-193 kubenswrapper[2578]: I0602 21:40:42.058674 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-q9pjw\" (UniqueName: \"kubernetes.io/projected/97fba2c5-a18e-4de6-b4e1-4600fab9dae4-kube-api-access-q9pjw\") pod \"cert-manager-operator-controller-manager-54b9655956-f76tg\" (UID: \"97fba2c5-a18e-4de6-b4e1-4600fab9dae4\") " pod="cert-manager-operator/cert-manager-operator-controller-manager-54b9655956-f76tg" Jun 02 21:40:42.117574 ip-10-0-138-193 kubenswrapper[2578]: I0602 21:40:42.117542 2578 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager-operator/cert-manager-operator-controller-manager-54b9655956-f76tg" Jun 02 21:40:42.245257 ip-10-0-138-193 kubenswrapper[2578]: I0602 21:40:42.245234 2578 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["cert-manager-operator/cert-manager-operator-controller-manager-54b9655956-f76tg"] Jun 02 21:40:42.247426 ip-10-0-138-193 kubenswrapper[2578]: W0602 21:40:42.247400 2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod97fba2c5_a18e_4de6_b4e1_4600fab9dae4.slice/crio-e34db50af5ff7b55548dfc9176635aac264078fdf535a7c9d35cebd06e05431e WatchSource:0}: Error finding container e34db50af5ff7b55548dfc9176635aac264078fdf535a7c9d35cebd06e05431e: Status 404 returned error can't find the container with id e34db50af5ff7b55548dfc9176635aac264078fdf535a7c9d35cebd06e05431e Jun 02 21:40:42.797250 ip-10-0-138-193 kubenswrapper[2578]: I0602 21:40:42.797213 2578 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="cert-manager-operator/cert-manager-operator-controller-manager-54b9655956-f76tg" event={"ID":"97fba2c5-a18e-4de6-b4e1-4600fab9dae4","Type":"ContainerStarted","Data":"e34db50af5ff7b55548dfc9176635aac264078fdf535a7c9d35cebd06e05431e"} Jun 02 21:40:44.806046 ip-10-0-138-193 kubenswrapper[2578]: I0602 21:40:44.806004 2578 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="cert-manager-operator/cert-manager-operator-controller-manager-54b9655956-f76tg" event={"ID":"97fba2c5-a18e-4de6-b4e1-4600fab9dae4","Type":"ContainerStarted","Data":"9cbd5daf8fa786d6abc942b475e435d3f62297cab6f61accaab65e6c67947845"} Jun 02 21:40:44.826646 ip-10-0-138-193 kubenswrapper[2578]: I0602 21:40:44.826595 2578 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="cert-manager-operator/cert-manager-operator-controller-manager-54b9655956-f76tg" podStartSLOduration=1.8816784119999999 podStartE2EDuration="3.82658194s" podCreationTimestamp="2026-06-02 21:40:41 +0000 UTC" firstStartedPulling="2026-06-02 21:40:42.249959679 +0000 UTC m=+419.501857577" lastFinishedPulling="2026-06-02 21:40:44.194863208 +0000 UTC m=+421.446761105" observedRunningTime="2026-06-02 21:40:44.824944058 +0000 UTC m=+422.076841963" watchObservedRunningTime="2026-06-02 21:40:44.82658194 +0000 UTC m=+422.078479845" Jun 02 21:40:45.940800 ip-10-0-138-193 kubenswrapper[2578]: I0602 21:40:45.940758 2578 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87frlfb9"] Jun 02 21:40:45.944462 ip-10-0-138-193 kubenswrapper[2578]: I0602 21:40:45.944437 2578 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87frlfb9" Jun 02 21:40:45.948657 ip-10-0-138-193 kubenswrapper[2578]: I0602 21:40:45.948635 2578 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"kube-root-ca.crt\"" Jun 02 21:40:45.949460 ip-10-0-138-193 kubenswrapper[2578]: I0602 21:40:45.949441 2578 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"openshift-service-ca.crt\"" Jun 02 21:40:45.949547 ip-10-0-138-193 kubenswrapper[2578]: I0602 21:40:45.949446 2578 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-marketplace\"/\"default-dockercfg-hfgcz\"" Jun 02 21:40:45.959929 ip-10-0-138-193 kubenswrapper[2578]: I0602 21:40:45.959907 2578 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87frlfb9"] Jun 02 21:40:46.087341 ip-10-0-138-193 kubenswrapper[2578]: I0602 21:40:46.087306 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-5hhkl\" (UniqueName: \"kubernetes.io/projected/f0b5a6b6-2ecb-4b8f-b97f-113c9fc436eb-kube-api-access-5hhkl\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87frlfb9\" (UID: \"f0b5a6b6-2ecb-4b8f-b97f-113c9fc436eb\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87frlfb9" Jun 02 21:40:46.087508 ip-10-0-138-193 kubenswrapper[2578]: I0602 21:40:46.087363 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/f0b5a6b6-2ecb-4b8f-b97f-113c9fc436eb-bundle\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87frlfb9\" (UID: \"f0b5a6b6-2ecb-4b8f-b97f-113c9fc436eb\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87frlfb9" Jun 02 21:40:46.087508 ip-10-0-138-193 kubenswrapper[2578]: I0602 21:40:46.087384 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/f0b5a6b6-2ecb-4b8f-b97f-113c9fc436eb-util\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87frlfb9\" (UID: \"f0b5a6b6-2ecb-4b8f-b97f-113c9fc436eb\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87frlfb9" Jun 02 21:40:46.187817 ip-10-0-138-193 kubenswrapper[2578]: I0602 21:40:46.187765 2578 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/f0b5a6b6-2ecb-4b8f-b97f-113c9fc436eb-bundle\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87frlfb9\" (UID: \"f0b5a6b6-2ecb-4b8f-b97f-113c9fc436eb\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87frlfb9" Jun 02 21:40:46.187817 ip-10-0-138-193 kubenswrapper[2578]: I0602 21:40:46.187819 2578 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/f0b5a6b6-2ecb-4b8f-b97f-113c9fc436eb-util\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87frlfb9\" (UID: \"f0b5a6b6-2ecb-4b8f-b97f-113c9fc436eb\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87frlfb9" Jun 02 21:40:46.188032 ip-10-0-138-193 kubenswrapper[2578]: I0602 21:40:46.187881 2578 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-5hhkl\" (UniqueName: \"kubernetes.io/projected/f0b5a6b6-2ecb-4b8f-b97f-113c9fc436eb-kube-api-access-5hhkl\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87frlfb9\" (UID: \"f0b5a6b6-2ecb-4b8f-b97f-113c9fc436eb\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87frlfb9" Jun 02 21:40:46.188216 ip-10-0-138-193 kubenswrapper[2578]: I0602 21:40:46.188183 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/f0b5a6b6-2ecb-4b8f-b97f-113c9fc436eb-bundle\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87frlfb9\" (UID: \"f0b5a6b6-2ecb-4b8f-b97f-113c9fc436eb\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87frlfb9" Jun 02 21:40:46.188257 ip-10-0-138-193 kubenswrapper[2578]: I0602 21:40:46.188214 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/f0b5a6b6-2ecb-4b8f-b97f-113c9fc436eb-util\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87frlfb9\" (UID: \"f0b5a6b6-2ecb-4b8f-b97f-113c9fc436eb\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87frlfb9" Jun 02 21:40:46.213683 ip-10-0-138-193 kubenswrapper[2578]: I0602 21:40:46.213604 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-5hhkl\" (UniqueName: \"kubernetes.io/projected/f0b5a6b6-2ecb-4b8f-b97f-113c9fc436eb-kube-api-access-5hhkl\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87frlfb9\" (UID: \"f0b5a6b6-2ecb-4b8f-b97f-113c9fc436eb\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87frlfb9" Jun 02 21:40:46.253314 ip-10-0-138-193 kubenswrapper[2578]: I0602 21:40:46.253279 2578 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87frlfb9" Jun 02 21:40:46.380977 ip-10-0-138-193 kubenswrapper[2578]: I0602 21:40:46.380883 2578 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87frlfb9"] Jun 02 21:40:46.383012 ip-10-0-138-193 kubenswrapper[2578]: W0602 21:40:46.382982 2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podf0b5a6b6_2ecb_4b8f_b97f_113c9fc436eb.slice/crio-08b79b959fbf21d0fb1396845873a100405de82017f015562550e917a393b61d WatchSource:0}: Error finding container 08b79b959fbf21d0fb1396845873a100405de82017f015562550e917a393b61d: Status 404 returned error can't find the container with id 08b79b959fbf21d0fb1396845873a100405de82017f015562550e917a393b61d Jun 02 21:40:46.814137 ip-10-0-138-193 kubenswrapper[2578]: I0602 21:40:46.814017 2578 generic.go:358] "Generic (PLEG): container finished" podID="f0b5a6b6-2ecb-4b8f-b97f-113c9fc436eb" containerID="03d7b514795eab8f54680ef01daf3f1049e38bc50a4eeaa5d6ef8e61abc7bffb" exitCode=0 Jun 02 21:40:46.814137 ip-10-0-138-193 kubenswrapper[2578]: I0602 21:40:46.814057 2578 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87frlfb9" event={"ID":"f0b5a6b6-2ecb-4b8f-b97f-113c9fc436eb","Type":"ContainerDied","Data":"03d7b514795eab8f54680ef01daf3f1049e38bc50a4eeaa5d6ef8e61abc7bffb"} Jun 02 21:40:46.814137 ip-10-0-138-193 kubenswrapper[2578]: I0602 21:40:46.814124 2578 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87frlfb9" event={"ID":"f0b5a6b6-2ecb-4b8f-b97f-113c9fc436eb","Type":"ContainerStarted","Data":"08b79b959fbf21d0fb1396845873a100405de82017f015562550e917a393b61d"} Jun 02 21:40:47.113333 ip-10-0-138-193 kubenswrapper[2578]: I0602 21:40:47.113252 2578 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["cert-manager/cert-manager-webhook-587ccfb98-crdg4"] Jun 02 21:40:47.116807 ip-10-0-138-193 kubenswrapper[2578]: I0602 21:40:47.116790 2578 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager/cert-manager-webhook-587ccfb98-crdg4" Jun 02 21:40:47.119056 ip-10-0-138-193 kubenswrapper[2578]: I0602 21:40:47.119035 2578 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"cert-manager\"/\"kube-root-ca.crt\"" Jun 02 21:40:47.119189 ip-10-0-138-193 kubenswrapper[2578]: I0602 21:40:47.119165 2578 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"cert-manager\"/\"openshift-service-ca.crt\"" Jun 02 21:40:47.119233 ip-10-0-138-193 kubenswrapper[2578]: I0602 21:40:47.119181 2578 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"cert-manager\"/\"cert-manager-webhook-dockercfg-4zlmg\"" Jun 02 21:40:47.126009 ip-10-0-138-193 kubenswrapper[2578]: I0602 21:40:47.125987 2578 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["cert-manager/cert-manager-webhook-587ccfb98-crdg4"] Jun 02 21:40:47.195300 ip-10-0-138-193 kubenswrapper[2578]: I0602 21:40:47.195257 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-mdt6r\" (UniqueName: \"kubernetes.io/projected/98c12356-b656-43b7-a2b2-c5077fecbfff-kube-api-access-mdt6r\") pod \"cert-manager-webhook-587ccfb98-crdg4\" (UID: \"98c12356-b656-43b7-a2b2-c5077fecbfff\") " pod="cert-manager/cert-manager-webhook-587ccfb98-crdg4" Jun 02 21:40:47.195492 ip-10-0-138-193 kubenswrapper[2578]: I0602 21:40:47.195420 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/98c12356-b656-43b7-a2b2-c5077fecbfff-bound-sa-token\") pod \"cert-manager-webhook-587ccfb98-crdg4\" (UID: \"98c12356-b656-43b7-a2b2-c5077fecbfff\") " pod="cert-manager/cert-manager-webhook-587ccfb98-crdg4" Jun 02 21:40:47.296404 ip-10-0-138-193 kubenswrapper[2578]: I0602 21:40:47.296366 2578 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/98c12356-b656-43b7-a2b2-c5077fecbfff-bound-sa-token\") pod \"cert-manager-webhook-587ccfb98-crdg4\" (UID: \"98c12356-b656-43b7-a2b2-c5077fecbfff\") " pod="cert-manager/cert-manager-webhook-587ccfb98-crdg4" Jun 02 21:40:47.296586 ip-10-0-138-193 kubenswrapper[2578]: I0602 21:40:47.296412 2578 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-mdt6r\" (UniqueName: \"kubernetes.io/projected/98c12356-b656-43b7-a2b2-c5077fecbfff-kube-api-access-mdt6r\") pod \"cert-manager-webhook-587ccfb98-crdg4\" (UID: \"98c12356-b656-43b7-a2b2-c5077fecbfff\") " pod="cert-manager/cert-manager-webhook-587ccfb98-crdg4" Jun 02 21:40:47.304035 ip-10-0-138-193 kubenswrapper[2578]: I0602 21:40:47.304011 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/98c12356-b656-43b7-a2b2-c5077fecbfff-bound-sa-token\") pod \"cert-manager-webhook-587ccfb98-crdg4\" (UID: \"98c12356-b656-43b7-a2b2-c5077fecbfff\") " pod="cert-manager/cert-manager-webhook-587ccfb98-crdg4" Jun 02 21:40:47.304255 ip-10-0-138-193 kubenswrapper[2578]: I0602 21:40:47.304235 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-mdt6r\" (UniqueName: \"kubernetes.io/projected/98c12356-b656-43b7-a2b2-c5077fecbfff-kube-api-access-mdt6r\") pod \"cert-manager-webhook-587ccfb98-crdg4\" (UID: \"98c12356-b656-43b7-a2b2-c5077fecbfff\") " pod="cert-manager/cert-manager-webhook-587ccfb98-crdg4" Jun 02 21:40:47.444225 ip-10-0-138-193 kubenswrapper[2578]: I0602 21:40:47.444134 2578 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager/cert-manager-webhook-587ccfb98-crdg4" Jun 02 21:40:47.581872 ip-10-0-138-193 kubenswrapper[2578]: I0602 21:40:47.581843 2578 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["cert-manager/cert-manager-webhook-587ccfb98-crdg4"] Jun 02 21:40:47.585410 ip-10-0-138-193 kubenswrapper[2578]: W0602 21:40:47.585380 2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod98c12356_b656_43b7_a2b2_c5077fecbfff.slice/crio-3f00790494acda944354dc67fd618a1de1c8adb73dae98218e9ec03d8e83fcf8 WatchSource:0}: Error finding container 3f00790494acda944354dc67fd618a1de1c8adb73dae98218e9ec03d8e83fcf8: Status 404 returned error can't find the container with id 3f00790494acda944354dc67fd618a1de1c8adb73dae98218e9ec03d8e83fcf8 Jun 02 21:40:47.819000 ip-10-0-138-193 kubenswrapper[2578]: I0602 21:40:47.818915 2578 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="cert-manager/cert-manager-webhook-587ccfb98-crdg4" event={"ID":"98c12356-b656-43b7-a2b2-c5077fecbfff","Type":"ContainerStarted","Data":"3f00790494acda944354dc67fd618a1de1c8adb73dae98218e9ec03d8e83fcf8"} Jun 02 21:40:48.414678 ip-10-0-138-193 kubenswrapper[2578]: I0602 21:40:48.414646 2578 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["cert-manager/cert-manager-cainjector-68b757865b-cphnr"] Jun 02 21:40:48.419130 ip-10-0-138-193 kubenswrapper[2578]: I0602 21:40:48.419114 2578 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager/cert-manager-cainjector-68b757865b-cphnr" Jun 02 21:40:48.421324 ip-10-0-138-193 kubenswrapper[2578]: I0602 21:40:48.421302 2578 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"cert-manager\"/\"cert-manager-cainjector-dockercfg-bpq6x\"" Jun 02 21:40:48.424287 ip-10-0-138-193 kubenswrapper[2578]: I0602 21:40:48.424264 2578 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["cert-manager/cert-manager-cainjector-68b757865b-cphnr"] Jun 02 21:40:48.508149 ip-10-0-138-193 kubenswrapper[2578]: I0602 21:40:48.508113 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-zbvgl\" (UniqueName: \"kubernetes.io/projected/23bca904-0d7a-498b-b18f-d1192282c41f-kube-api-access-zbvgl\") pod \"cert-manager-cainjector-68b757865b-cphnr\" (UID: \"23bca904-0d7a-498b-b18f-d1192282c41f\") " pod="cert-manager/cert-manager-cainjector-68b757865b-cphnr" Jun 02 21:40:48.508149 ip-10-0-138-193 kubenswrapper[2578]: I0602 21:40:48.508151 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/23bca904-0d7a-498b-b18f-d1192282c41f-bound-sa-token\") pod \"cert-manager-cainjector-68b757865b-cphnr\" (UID: \"23bca904-0d7a-498b-b18f-d1192282c41f\") " pod="cert-manager/cert-manager-cainjector-68b757865b-cphnr" Jun 02 21:40:48.608839 ip-10-0-138-193 kubenswrapper[2578]: I0602 21:40:48.608804 2578 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-zbvgl\" (UniqueName: \"kubernetes.io/projected/23bca904-0d7a-498b-b18f-d1192282c41f-kube-api-access-zbvgl\") pod \"cert-manager-cainjector-68b757865b-cphnr\" (UID: \"23bca904-0d7a-498b-b18f-d1192282c41f\") " pod="cert-manager/cert-manager-cainjector-68b757865b-cphnr" Jun 02 21:40:48.608839 ip-10-0-138-193 kubenswrapper[2578]: I0602 21:40:48.608844 2578 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/23bca904-0d7a-498b-b18f-d1192282c41f-bound-sa-token\") pod \"cert-manager-cainjector-68b757865b-cphnr\" (UID: \"23bca904-0d7a-498b-b18f-d1192282c41f\") " pod="cert-manager/cert-manager-cainjector-68b757865b-cphnr" Jun 02 21:40:48.616461 ip-10-0-138-193 kubenswrapper[2578]: I0602 21:40:48.616432 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/23bca904-0d7a-498b-b18f-d1192282c41f-bound-sa-token\") pod \"cert-manager-cainjector-68b757865b-cphnr\" (UID: \"23bca904-0d7a-498b-b18f-d1192282c41f\") " pod="cert-manager/cert-manager-cainjector-68b757865b-cphnr" Jun 02 21:40:48.616703 ip-10-0-138-193 kubenswrapper[2578]: I0602 21:40:48.616680 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-zbvgl\" (UniqueName: \"kubernetes.io/projected/23bca904-0d7a-498b-b18f-d1192282c41f-kube-api-access-zbvgl\") pod \"cert-manager-cainjector-68b757865b-cphnr\" (UID: \"23bca904-0d7a-498b-b18f-d1192282c41f\") " pod="cert-manager/cert-manager-cainjector-68b757865b-cphnr" Jun 02 21:40:48.729528 ip-10-0-138-193 kubenswrapper[2578]: I0602 21:40:48.729435 2578 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager/cert-manager-cainjector-68b757865b-cphnr" Jun 02 21:40:48.884773 ip-10-0-138-193 kubenswrapper[2578]: I0602 21:40:48.884443 2578 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["cert-manager/cert-manager-cainjector-68b757865b-cphnr"] Jun 02 21:40:49.599679 ip-10-0-138-193 kubenswrapper[2578]: W0602 21:40:49.599646 2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod23bca904_0d7a_498b_b18f_d1192282c41f.slice/crio-9f23947b4e497bc405cf4d0c70c5d1e2394794d38c213ed650ee70950f12852c WatchSource:0}: Error finding container 9f23947b4e497bc405cf4d0c70c5d1e2394794d38c213ed650ee70950f12852c: Status 404 returned error can't find the container with id 9f23947b4e497bc405cf4d0c70c5d1e2394794d38c213ed650ee70950f12852c Jun 02 21:40:49.828427 ip-10-0-138-193 kubenswrapper[2578]: I0602 21:40:49.828384 2578 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="cert-manager/cert-manager-cainjector-68b757865b-cphnr" event={"ID":"23bca904-0d7a-498b-b18f-d1192282c41f","Type":"ContainerStarted","Data":"9f23947b4e497bc405cf4d0c70c5d1e2394794d38c213ed650ee70950f12852c"} Jun 02 21:40:49.830546 ip-10-0-138-193 kubenswrapper[2578]: I0602 21:40:49.830518 2578 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87frlfb9" event={"ID":"f0b5a6b6-2ecb-4b8f-b97f-113c9fc436eb","Type":"ContainerStarted","Data":"23f6e51af7539043692c841bb13e5042c5eaf4c42d394dbddd77007e3fe418fe"} Jun 02 21:40:50.838315 ip-10-0-138-193 kubenswrapper[2578]: I0602 21:40:50.838289 2578 generic.go:358] "Generic (PLEG): container finished" podID="f0b5a6b6-2ecb-4b8f-b97f-113c9fc436eb" containerID="23f6e51af7539043692c841bb13e5042c5eaf4c42d394dbddd77007e3fe418fe" exitCode=0 Jun 02 21:40:50.838654 ip-10-0-138-193 kubenswrapper[2578]: I0602 21:40:50.838369 2578 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87frlfb9" event={"ID":"f0b5a6b6-2ecb-4b8f-b97f-113c9fc436eb","Type":"ContainerDied","Data":"23f6e51af7539043692c841bb13e5042c5eaf4c42d394dbddd77007e3fe418fe"} Jun 02 21:40:51.843783 ip-10-0-138-193 kubenswrapper[2578]: I0602 21:40:51.843738 2578 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="cert-manager/cert-manager-cainjector-68b757865b-cphnr" event={"ID":"23bca904-0d7a-498b-b18f-d1192282c41f","Type":"ContainerStarted","Data":"3f031c8a25df3738f1cadfc213f47c68b55aea4d4a990d35743c62b718f8bedb"} Jun 02 21:40:51.845751 ip-10-0-138-193 kubenswrapper[2578]: I0602 21:40:51.845726 2578 generic.go:358] "Generic (PLEG): container finished" podID="f0b5a6b6-2ecb-4b8f-b97f-113c9fc436eb" containerID="6f1bf95acb6b9edca1af201da9d958126bf8ce4432832cba0867200c58f8e581" exitCode=0 Jun 02 21:40:51.845891 ip-10-0-138-193 kubenswrapper[2578]: I0602 21:40:51.845807 2578 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87frlfb9" event={"ID":"f0b5a6b6-2ecb-4b8f-b97f-113c9fc436eb","Type":"ContainerDied","Data":"6f1bf95acb6b9edca1af201da9d958126bf8ce4432832cba0867200c58f8e581"} Jun 02 21:40:51.847108 ip-10-0-138-193 kubenswrapper[2578]: I0602 21:40:51.847088 2578 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="cert-manager/cert-manager-webhook-587ccfb98-crdg4" event={"ID":"98c12356-b656-43b7-a2b2-c5077fecbfff","Type":"ContainerStarted","Data":"b2db8e00da26cd918d8a60e787721e7f7a3bb6f1c7ac1501b0d96f5686fc7297"} Jun 02 21:40:51.847248 ip-10-0-138-193 kubenswrapper[2578]: I0602 21:40:51.847235 2578 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="cert-manager/cert-manager-webhook-587ccfb98-crdg4" Jun 02 21:40:51.859545 ip-10-0-138-193 kubenswrapper[2578]: I0602 21:40:51.859504 2578 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="cert-manager/cert-manager-cainjector-68b757865b-cphnr" podStartSLOduration=2.699178843 podStartE2EDuration="3.859493953s" podCreationTimestamp="2026-06-02 21:40:48 +0000 UTC" firstStartedPulling="2026-06-02 21:40:49.60206811 +0000 UTC m=+426.853965995" lastFinishedPulling="2026-06-02 21:40:50.762383213 +0000 UTC m=+428.014281105" observedRunningTime="2026-06-02 21:40:51.857359137 +0000 UTC m=+429.109257042" watchObservedRunningTime="2026-06-02 21:40:51.859493953 +0000 UTC m=+429.111391859" Jun 02 21:40:51.894102 ip-10-0-138-193 kubenswrapper[2578]: I0602 21:40:51.894024 2578 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="cert-manager/cert-manager-webhook-587ccfb98-crdg4" podStartSLOduration=1.720063776 podStartE2EDuration="4.894007369s" podCreationTimestamp="2026-06-02 21:40:47 +0000 UTC" firstStartedPulling="2026-06-02 21:40:47.587654215 +0000 UTC m=+424.839552113" lastFinishedPulling="2026-06-02 21:40:50.761597822 +0000 UTC m=+428.013495706" observedRunningTime="2026-06-02 21:40:51.891505086 +0000 UTC m=+429.143402993" watchObservedRunningTime="2026-06-02 21:40:51.894007369 +0000 UTC m=+429.145905280" Jun 02 21:40:52.978587 ip-10-0-138-193 kubenswrapper[2578]: I0602 21:40:52.978565 2578 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87frlfb9" Jun 02 21:40:53.151154 ip-10-0-138-193 kubenswrapper[2578]: I0602 21:40:53.151123 2578 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-5hhkl\" (UniqueName: \"kubernetes.io/projected/f0b5a6b6-2ecb-4b8f-b97f-113c9fc436eb-kube-api-access-5hhkl\") pod \"f0b5a6b6-2ecb-4b8f-b97f-113c9fc436eb\" (UID: \"f0b5a6b6-2ecb-4b8f-b97f-113c9fc436eb\") " Jun 02 21:40:53.151319 ip-10-0-138-193 kubenswrapper[2578]: I0602 21:40:53.151170 2578 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/f0b5a6b6-2ecb-4b8f-b97f-113c9fc436eb-bundle\") pod \"f0b5a6b6-2ecb-4b8f-b97f-113c9fc436eb\" (UID: \"f0b5a6b6-2ecb-4b8f-b97f-113c9fc436eb\") " Jun 02 21:40:53.151319 ip-10-0-138-193 kubenswrapper[2578]: I0602 21:40:53.151206 2578 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/f0b5a6b6-2ecb-4b8f-b97f-113c9fc436eb-util\") pod \"f0b5a6b6-2ecb-4b8f-b97f-113c9fc436eb\" (UID: \"f0b5a6b6-2ecb-4b8f-b97f-113c9fc436eb\") " Jun 02 21:40:53.151587 ip-10-0-138-193 kubenswrapper[2578]: I0602 21:40:53.151559 2578 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/f0b5a6b6-2ecb-4b8f-b97f-113c9fc436eb-bundle" (OuterVolumeSpecName: "bundle") pod "f0b5a6b6-2ecb-4b8f-b97f-113c9fc436eb" (UID: "f0b5a6b6-2ecb-4b8f-b97f-113c9fc436eb"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jun 02 21:40:53.153362 ip-10-0-138-193 kubenswrapper[2578]: I0602 21:40:53.153341 2578 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/f0b5a6b6-2ecb-4b8f-b97f-113c9fc436eb-kube-api-access-5hhkl" (OuterVolumeSpecName: "kube-api-access-5hhkl") pod "f0b5a6b6-2ecb-4b8f-b97f-113c9fc436eb" (UID: "f0b5a6b6-2ecb-4b8f-b97f-113c9fc436eb"). InnerVolumeSpecName "kube-api-access-5hhkl". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 02 21:40:53.158258 ip-10-0-138-193 kubenswrapper[2578]: I0602 21:40:53.158217 2578 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/f0b5a6b6-2ecb-4b8f-b97f-113c9fc436eb-util" (OuterVolumeSpecName: "util") pod "f0b5a6b6-2ecb-4b8f-b97f-113c9fc436eb" (UID: "f0b5a6b6-2ecb-4b8f-b97f-113c9fc436eb"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jun 02 21:40:53.252582 ip-10-0-138-193 kubenswrapper[2578]: I0602 21:40:53.252529 2578 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/f0b5a6b6-2ecb-4b8f-b97f-113c9fc436eb-bundle\") on node \"ip-10-0-138-193.ec2.internal\" DevicePath \"\"" Jun 02 21:40:53.252582 ip-10-0-138-193 kubenswrapper[2578]: I0602 21:40:53.252575 2578 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/f0b5a6b6-2ecb-4b8f-b97f-113c9fc436eb-util\") on node \"ip-10-0-138-193.ec2.internal\" DevicePath \"\"" Jun 02 21:40:53.252582 ip-10-0-138-193 kubenswrapper[2578]: I0602 21:40:53.252589 2578 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-5hhkl\" (UniqueName: \"kubernetes.io/projected/f0b5a6b6-2ecb-4b8f-b97f-113c9fc436eb-kube-api-access-5hhkl\") on node \"ip-10-0-138-193.ec2.internal\" DevicePath \"\"" Jun 02 21:40:53.856904 ip-10-0-138-193 kubenswrapper[2578]: I0602 21:40:53.856858 2578 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87frlfb9" event={"ID":"f0b5a6b6-2ecb-4b8f-b97f-113c9fc436eb","Type":"ContainerDied","Data":"08b79b959fbf21d0fb1396845873a100405de82017f015562550e917a393b61d"} Jun 02 21:40:53.856904 ip-10-0-138-193 kubenswrapper[2578]: I0602 21:40:53.856908 2578 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="08b79b959fbf21d0fb1396845873a100405de82017f015562550e917a393b61d" Jun 02 21:40:53.857228 ip-10-0-138-193 kubenswrapper[2578]: I0602 21:40:53.857097 2578 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87frlfb9" Jun 02 21:40:57.852655 ip-10-0-138-193 kubenswrapper[2578]: I0602 21:40:57.852618 2578 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="cert-manager/cert-manager-webhook-587ccfb98-crdg4" Jun 02 21:41:05.680207 ip-10-0-138-193 kubenswrapper[2578]: I0602 21:41:05.680170 2578 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["cert-manager/cert-manager-79c8d999ff-lhn9l"] Jun 02 21:41:05.680694 ip-10-0-138-193 kubenswrapper[2578]: I0602 21:41:05.680490 2578 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="f0b5a6b6-2ecb-4b8f-b97f-113c9fc436eb" containerName="pull" Jun 02 21:41:05.680694 ip-10-0-138-193 kubenswrapper[2578]: I0602 21:41:05.680501 2578 state_mem.go:107] "Deleted CPUSet assignment" podUID="f0b5a6b6-2ecb-4b8f-b97f-113c9fc436eb" containerName="pull" Jun 02 21:41:05.680694 ip-10-0-138-193 kubenswrapper[2578]: I0602 21:41:05.680517 2578 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="f0b5a6b6-2ecb-4b8f-b97f-113c9fc436eb" containerName="extract" Jun 02 21:41:05.680694 ip-10-0-138-193 kubenswrapper[2578]: I0602 21:41:05.680523 2578 state_mem.go:107] "Deleted CPUSet assignment" podUID="f0b5a6b6-2ecb-4b8f-b97f-113c9fc436eb" containerName="extract" Jun 02 21:41:05.680694 ip-10-0-138-193 kubenswrapper[2578]: I0602 21:41:05.680534 2578 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="f0b5a6b6-2ecb-4b8f-b97f-113c9fc436eb" containerName="util" Jun 02 21:41:05.680694 ip-10-0-138-193 kubenswrapper[2578]: I0602 21:41:05.680539 2578 state_mem.go:107] "Deleted CPUSet assignment" podUID="f0b5a6b6-2ecb-4b8f-b97f-113c9fc436eb" containerName="util" Jun 02 21:41:05.680694 ip-10-0-138-193 kubenswrapper[2578]: I0602 21:41:05.680588 2578 memory_manager.go:356] "RemoveStaleState removing state" podUID="f0b5a6b6-2ecb-4b8f-b97f-113c9fc436eb" containerName="extract" Jun 02 21:41:05.683655 ip-10-0-138-193 kubenswrapper[2578]: I0602 21:41:05.683638 2578 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager/cert-manager-79c8d999ff-lhn9l" Jun 02 21:41:05.686019 ip-10-0-138-193 kubenswrapper[2578]: I0602 21:41:05.685998 2578 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"cert-manager\"/\"cert-manager-dockercfg-tzcv8\"" Jun 02 21:41:05.690527 ip-10-0-138-193 kubenswrapper[2578]: I0602 21:41:05.690457 2578 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["cert-manager/cert-manager-79c8d999ff-lhn9l"] Jun 02 21:41:05.755044 ip-10-0-138-193 kubenswrapper[2578]: I0602 21:41:05.755015 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-qv9ps\" (UniqueName: \"kubernetes.io/projected/81dbfc67-d3b8-497f-b6be-d5ee330ecabb-kube-api-access-qv9ps\") pod \"cert-manager-79c8d999ff-lhn9l\" (UID: \"81dbfc67-d3b8-497f-b6be-d5ee330ecabb\") " pod="cert-manager/cert-manager-79c8d999ff-lhn9l" Jun 02 21:41:05.755044 ip-10-0-138-193 kubenswrapper[2578]: I0602 21:41:05.755048 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/81dbfc67-d3b8-497f-b6be-d5ee330ecabb-bound-sa-token\") pod \"cert-manager-79c8d999ff-lhn9l\" (UID: \"81dbfc67-d3b8-497f-b6be-d5ee330ecabb\") " pod="cert-manager/cert-manager-79c8d999ff-lhn9l" Jun 02 21:41:05.856103 ip-10-0-138-193 kubenswrapper[2578]: I0602 21:41:05.856035 2578 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-qv9ps\" (UniqueName: \"kubernetes.io/projected/81dbfc67-d3b8-497f-b6be-d5ee330ecabb-kube-api-access-qv9ps\") pod \"cert-manager-79c8d999ff-lhn9l\" (UID: \"81dbfc67-d3b8-497f-b6be-d5ee330ecabb\") " pod="cert-manager/cert-manager-79c8d999ff-lhn9l" Jun 02 21:41:05.856282 ip-10-0-138-193 kubenswrapper[2578]: I0602 21:41:05.856185 2578 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/81dbfc67-d3b8-497f-b6be-d5ee330ecabb-bound-sa-token\") pod \"cert-manager-79c8d999ff-lhn9l\" (UID: \"81dbfc67-d3b8-497f-b6be-d5ee330ecabb\") " pod="cert-manager/cert-manager-79c8d999ff-lhn9l" Jun 02 21:41:05.863744 ip-10-0-138-193 kubenswrapper[2578]: I0602 21:41:05.863716 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/81dbfc67-d3b8-497f-b6be-d5ee330ecabb-bound-sa-token\") pod \"cert-manager-79c8d999ff-lhn9l\" (UID: \"81dbfc67-d3b8-497f-b6be-d5ee330ecabb\") " pod="cert-manager/cert-manager-79c8d999ff-lhn9l" Jun 02 21:41:05.863869 ip-10-0-138-193 kubenswrapper[2578]: I0602 21:41:05.863781 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-qv9ps\" (UniqueName: \"kubernetes.io/projected/81dbfc67-d3b8-497f-b6be-d5ee330ecabb-kube-api-access-qv9ps\") pod \"cert-manager-79c8d999ff-lhn9l\" (UID: \"81dbfc67-d3b8-497f-b6be-d5ee330ecabb\") " pod="cert-manager/cert-manager-79c8d999ff-lhn9l" Jun 02 21:41:05.994255 ip-10-0-138-193 kubenswrapper[2578]: I0602 21:41:05.994153 2578 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager/cert-manager-79c8d999ff-lhn9l" Jun 02 21:41:06.123152 ip-10-0-138-193 kubenswrapper[2578]: I0602 21:41:06.123125 2578 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["cert-manager/cert-manager-79c8d999ff-lhn9l"] Jun 02 21:41:06.125281 ip-10-0-138-193 kubenswrapper[2578]: W0602 21:41:06.125250 2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod81dbfc67_d3b8_497f_b6be_d5ee330ecabb.slice/crio-9be2c215a1c75e75ca75a44c73ca920a5a7e6a95f66da7346a9e0cac1f4a5a99 WatchSource:0}: Error finding container 9be2c215a1c75e75ca75a44c73ca920a5a7e6a95f66da7346a9e0cac1f4a5a99: Status 404 returned error can't find the container with id 9be2c215a1c75e75ca75a44c73ca920a5a7e6a95f66da7346a9e0cac1f4a5a99 Jun 02 21:41:06.911451 ip-10-0-138-193 kubenswrapper[2578]: I0602 21:41:06.911409 2578 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="cert-manager/cert-manager-79c8d999ff-lhn9l" event={"ID":"81dbfc67-d3b8-497f-b6be-d5ee330ecabb","Type":"ContainerStarted","Data":"8e2daf72239e1dba9fb22238a0775cd71d8edf2e3eae77b4672abf789a683f68"} Jun 02 21:41:06.911451 ip-10-0-138-193 kubenswrapper[2578]: I0602 21:41:06.911454 2578 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="cert-manager/cert-manager-79c8d999ff-lhn9l" event={"ID":"81dbfc67-d3b8-497f-b6be-d5ee330ecabb","Type":"ContainerStarted","Data":"9be2c215a1c75e75ca75a44c73ca920a5a7e6a95f66da7346a9e0cac1f4a5a99"} Jun 02 21:41:06.931199 ip-10-0-138-193 kubenswrapper[2578]: I0602 21:41:06.931139 2578 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="cert-manager/cert-manager-79c8d999ff-lhn9l" podStartSLOduration=1.9311205839999999 podStartE2EDuration="1.931120584s" podCreationTimestamp="2026-06-02 21:41:05 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2026-06-02 21:41:06.929408282 +0000 UTC m=+444.181306182" watchObservedRunningTime="2026-06-02 21:41:06.931120584 +0000 UTC m=+444.183018487" Jun 02 21:41:13.154623 ip-10-0-138-193 kubenswrapper[2578]: I0602 21:41:13.154588 2578 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-marketplace/410e69f41462d9d02a48f76ad929b5f41ed146182df7ab38cf9ce4e1cd9ll52"] Jun 02 21:41:13.157208 ip-10-0-138-193 kubenswrapper[2578]: I0602 21:41:13.157190 2578 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/410e69f41462d9d02a48f76ad929b5f41ed146182df7ab38cf9ce4e1cd9ll52" Jun 02 21:41:13.159573 ip-10-0-138-193 kubenswrapper[2578]: I0602 21:41:13.159547 2578 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-marketplace\"/\"default-dockercfg-hfgcz\"" Jun 02 21:41:13.159675 ip-10-0-138-193 kubenswrapper[2578]: I0602 21:41:13.159593 2578 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"openshift-service-ca.crt\"" Jun 02 21:41:13.160548 ip-10-0-138-193 kubenswrapper[2578]: I0602 21:41:13.160529 2578 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"kube-root-ca.crt\"" Jun 02 21:41:13.164327 ip-10-0-138-193 kubenswrapper[2578]: I0602 21:41:13.164299 2578 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/410e69f41462d9d02a48f76ad929b5f41ed146182df7ab38cf9ce4e1cd9ll52"] Jun 02 21:41:13.221684 ip-10-0-138-193 kubenswrapper[2578]: I0602 21:41:13.221645 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-6mlw9\" (UniqueName: \"kubernetes.io/projected/6c39f982-5c69-48f0-a1fc-938941dcb333-kube-api-access-6mlw9\") pod \"410e69f41462d9d02a48f76ad929b5f41ed146182df7ab38cf9ce4e1cd9ll52\" (UID: \"6c39f982-5c69-48f0-a1fc-938941dcb333\") " pod="openshift-marketplace/410e69f41462d9d02a48f76ad929b5f41ed146182df7ab38cf9ce4e1cd9ll52" Jun 02 21:41:13.221888 ip-10-0-138-193 kubenswrapper[2578]: I0602 21:41:13.221709 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/6c39f982-5c69-48f0-a1fc-938941dcb333-bundle\") pod \"410e69f41462d9d02a48f76ad929b5f41ed146182df7ab38cf9ce4e1cd9ll52\" (UID: \"6c39f982-5c69-48f0-a1fc-938941dcb333\") " pod="openshift-marketplace/410e69f41462d9d02a48f76ad929b5f41ed146182df7ab38cf9ce4e1cd9ll52" Jun 02 21:41:13.221888 ip-10-0-138-193 kubenswrapper[2578]: I0602 21:41:13.221756 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/6c39f982-5c69-48f0-a1fc-938941dcb333-util\") pod \"410e69f41462d9d02a48f76ad929b5f41ed146182df7ab38cf9ce4e1cd9ll52\" (UID: \"6c39f982-5c69-48f0-a1fc-938941dcb333\") " pod="openshift-marketplace/410e69f41462d9d02a48f76ad929b5f41ed146182df7ab38cf9ce4e1cd9ll52" Jun 02 21:41:13.322263 ip-10-0-138-193 kubenswrapper[2578]: I0602 21:41:13.322230 2578 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-6mlw9\" (UniqueName: \"kubernetes.io/projected/6c39f982-5c69-48f0-a1fc-938941dcb333-kube-api-access-6mlw9\") pod \"410e69f41462d9d02a48f76ad929b5f41ed146182df7ab38cf9ce4e1cd9ll52\" (UID: \"6c39f982-5c69-48f0-a1fc-938941dcb333\") " pod="openshift-marketplace/410e69f41462d9d02a48f76ad929b5f41ed146182df7ab38cf9ce4e1cd9ll52" Jun 02 21:41:13.322470 ip-10-0-138-193 kubenswrapper[2578]: I0602 21:41:13.322281 2578 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/6c39f982-5c69-48f0-a1fc-938941dcb333-bundle\") pod \"410e69f41462d9d02a48f76ad929b5f41ed146182df7ab38cf9ce4e1cd9ll52\" (UID: \"6c39f982-5c69-48f0-a1fc-938941dcb333\") " pod="openshift-marketplace/410e69f41462d9d02a48f76ad929b5f41ed146182df7ab38cf9ce4e1cd9ll52" Jun 02 21:41:13.322470 ip-10-0-138-193 kubenswrapper[2578]: I0602 21:41:13.322312 2578 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/6c39f982-5c69-48f0-a1fc-938941dcb333-util\") pod \"410e69f41462d9d02a48f76ad929b5f41ed146182df7ab38cf9ce4e1cd9ll52\" (UID: \"6c39f982-5c69-48f0-a1fc-938941dcb333\") " pod="openshift-marketplace/410e69f41462d9d02a48f76ad929b5f41ed146182df7ab38cf9ce4e1cd9ll52" Jun 02 21:41:13.322687 ip-10-0-138-193 kubenswrapper[2578]: I0602 21:41:13.322666 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/6c39f982-5c69-48f0-a1fc-938941dcb333-bundle\") pod \"410e69f41462d9d02a48f76ad929b5f41ed146182df7ab38cf9ce4e1cd9ll52\" (UID: \"6c39f982-5c69-48f0-a1fc-938941dcb333\") " pod="openshift-marketplace/410e69f41462d9d02a48f76ad929b5f41ed146182df7ab38cf9ce4e1cd9ll52" Jun 02 21:41:13.322782 ip-10-0-138-193 kubenswrapper[2578]: I0602 21:41:13.322701 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/6c39f982-5c69-48f0-a1fc-938941dcb333-util\") pod \"410e69f41462d9d02a48f76ad929b5f41ed146182df7ab38cf9ce4e1cd9ll52\" (UID: \"6c39f982-5c69-48f0-a1fc-938941dcb333\") " pod="openshift-marketplace/410e69f41462d9d02a48f76ad929b5f41ed146182df7ab38cf9ce4e1cd9ll52" Jun 02 21:41:13.330660 ip-10-0-138-193 kubenswrapper[2578]: I0602 21:41:13.330630 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-6mlw9\" (UniqueName: \"kubernetes.io/projected/6c39f982-5c69-48f0-a1fc-938941dcb333-kube-api-access-6mlw9\") pod \"410e69f41462d9d02a48f76ad929b5f41ed146182df7ab38cf9ce4e1cd9ll52\" (UID: \"6c39f982-5c69-48f0-a1fc-938941dcb333\") " pod="openshift-marketplace/410e69f41462d9d02a48f76ad929b5f41ed146182df7ab38cf9ce4e1cd9ll52" Jun 02 21:41:13.468744 ip-10-0-138-193 kubenswrapper[2578]: I0602 21:41:13.468650 2578 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/410e69f41462d9d02a48f76ad929b5f41ed146182df7ab38cf9ce4e1cd9ll52" Jun 02 21:41:13.627307 ip-10-0-138-193 kubenswrapper[2578]: I0602 21:41:13.627187 2578 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/410e69f41462d9d02a48f76ad929b5f41ed146182df7ab38cf9ce4e1cd9ll52"] Jun 02 21:41:13.630112 ip-10-0-138-193 kubenswrapper[2578]: W0602 21:41:13.630064 2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod6c39f982_5c69_48f0_a1fc_938941dcb333.slice/crio-e6519ccd2e28cd6682e83e5dc1b91d896c51e02b9090d112e7d3e2c57e6516db WatchSource:0}: Error finding container e6519ccd2e28cd6682e83e5dc1b91d896c51e02b9090d112e7d3e2c57e6516db: Status 404 returned error can't find the container with id e6519ccd2e28cd6682e83e5dc1b91d896c51e02b9090d112e7d3e2c57e6516db Jun 02 21:41:13.936892 ip-10-0-138-193 kubenswrapper[2578]: I0602 21:41:13.936857 2578 generic.go:358] "Generic (PLEG): container finished" podID="6c39f982-5c69-48f0-a1fc-938941dcb333" containerID="d3d5c145c5efa477a7bd720e90440bbee1fb318bf205992cfa6b5fde8cb83292" exitCode=0 Jun 02 21:41:13.937110 ip-10-0-138-193 kubenswrapper[2578]: I0602 21:41:13.936946 2578 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/410e69f41462d9d02a48f76ad929b5f41ed146182df7ab38cf9ce4e1cd9ll52" event={"ID":"6c39f982-5c69-48f0-a1fc-938941dcb333","Type":"ContainerDied","Data":"d3d5c145c5efa477a7bd720e90440bbee1fb318bf205992cfa6b5fde8cb83292"} Jun 02 21:41:13.937110 ip-10-0-138-193 kubenswrapper[2578]: I0602 21:41:13.936984 2578 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/410e69f41462d9d02a48f76ad929b5f41ed146182df7ab38cf9ce4e1cd9ll52" event={"ID":"6c39f982-5c69-48f0-a1fc-938941dcb333","Type":"ContainerStarted","Data":"e6519ccd2e28cd6682e83e5dc1b91d896c51e02b9090d112e7d3e2c57e6516db"} Jun 02 21:41:14.942408 ip-10-0-138-193 kubenswrapper[2578]: I0602 21:41:14.942371 2578 generic.go:358] "Generic (PLEG): container finished" podID="6c39f982-5c69-48f0-a1fc-938941dcb333" containerID="ee615f98452839423a6c39dc1fc71108531671eb0b1627e426a07f8b9015ed85" exitCode=0 Jun 02 21:41:14.942895 ip-10-0-138-193 kubenswrapper[2578]: I0602 21:41:14.942454 2578 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/410e69f41462d9d02a48f76ad929b5f41ed146182df7ab38cf9ce4e1cd9ll52" event={"ID":"6c39f982-5c69-48f0-a1fc-938941dcb333","Type":"ContainerDied","Data":"ee615f98452839423a6c39dc1fc71108531671eb0b1627e426a07f8b9015ed85"} Jun 02 21:41:15.948104 ip-10-0-138-193 kubenswrapper[2578]: I0602 21:41:15.948057 2578 generic.go:358] "Generic (PLEG): container finished" podID="6c39f982-5c69-48f0-a1fc-938941dcb333" containerID="6e9a312de0b37aea29c6017a996bc50625d1129c3b8d86d53579b7e51adf0ec9" exitCode=0 Jun 02 21:41:15.948546 ip-10-0-138-193 kubenswrapper[2578]: I0602 21:41:15.948107 2578 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/410e69f41462d9d02a48f76ad929b5f41ed146182df7ab38cf9ce4e1cd9ll52" event={"ID":"6c39f982-5c69-48f0-a1fc-938941dcb333","Type":"ContainerDied","Data":"6e9a312de0b37aea29c6017a996bc50625d1129c3b8d86d53579b7e51adf0ec9"} Jun 02 21:41:17.084647 ip-10-0-138-193 kubenswrapper[2578]: I0602 21:41:17.084624 2578 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/410e69f41462d9d02a48f76ad929b5f41ed146182df7ab38cf9ce4e1cd9ll52" Jun 02 21:41:17.158720 ip-10-0-138-193 kubenswrapper[2578]: I0602 21:41:17.158686 2578 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/6c39f982-5c69-48f0-a1fc-938941dcb333-bundle\") pod \"6c39f982-5c69-48f0-a1fc-938941dcb333\" (UID: \"6c39f982-5c69-48f0-a1fc-938941dcb333\") " Jun 02 21:41:17.158926 ip-10-0-138-193 kubenswrapper[2578]: I0602 21:41:17.158819 2578 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-6mlw9\" (UniqueName: \"kubernetes.io/projected/6c39f982-5c69-48f0-a1fc-938941dcb333-kube-api-access-6mlw9\") pod \"6c39f982-5c69-48f0-a1fc-938941dcb333\" (UID: \"6c39f982-5c69-48f0-a1fc-938941dcb333\") " Jun 02 21:41:17.158926 ip-10-0-138-193 kubenswrapper[2578]: I0602 21:41:17.158851 2578 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/6c39f982-5c69-48f0-a1fc-938941dcb333-util\") pod \"6c39f982-5c69-48f0-a1fc-938941dcb333\" (UID: \"6c39f982-5c69-48f0-a1fc-938941dcb333\") " Jun 02 21:41:17.159569 ip-10-0-138-193 kubenswrapper[2578]: I0602 21:41:17.159538 2578 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/6c39f982-5c69-48f0-a1fc-938941dcb333-bundle" (OuterVolumeSpecName: "bundle") pod "6c39f982-5c69-48f0-a1fc-938941dcb333" (UID: "6c39f982-5c69-48f0-a1fc-938941dcb333"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jun 02 21:41:17.161087 ip-10-0-138-193 kubenswrapper[2578]: I0602 21:41:17.161052 2578 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/6c39f982-5c69-48f0-a1fc-938941dcb333-kube-api-access-6mlw9" (OuterVolumeSpecName: "kube-api-access-6mlw9") pod "6c39f982-5c69-48f0-a1fc-938941dcb333" (UID: "6c39f982-5c69-48f0-a1fc-938941dcb333"). InnerVolumeSpecName "kube-api-access-6mlw9". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 02 21:41:17.164361 ip-10-0-138-193 kubenswrapper[2578]: I0602 21:41:17.164335 2578 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/6c39f982-5c69-48f0-a1fc-938941dcb333-util" (OuterVolumeSpecName: "util") pod "6c39f982-5c69-48f0-a1fc-938941dcb333" (UID: "6c39f982-5c69-48f0-a1fc-938941dcb333"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jun 02 21:41:17.260231 ip-10-0-138-193 kubenswrapper[2578]: I0602 21:41:17.260138 2578 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-6mlw9\" (UniqueName: \"kubernetes.io/projected/6c39f982-5c69-48f0-a1fc-938941dcb333-kube-api-access-6mlw9\") on node \"ip-10-0-138-193.ec2.internal\" DevicePath \"\"" Jun 02 21:41:17.260231 ip-10-0-138-193 kubenswrapper[2578]: I0602 21:41:17.260171 2578 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/6c39f982-5c69-48f0-a1fc-938941dcb333-util\") on node \"ip-10-0-138-193.ec2.internal\" DevicePath \"\"" Jun 02 21:41:17.260231 ip-10-0-138-193 kubenswrapper[2578]: I0602 21:41:17.260189 2578 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/6c39f982-5c69-48f0-a1fc-938941dcb333-bundle\") on node \"ip-10-0-138-193.ec2.internal\" DevicePath \"\"" Jun 02 21:41:17.957169 ip-10-0-138-193 kubenswrapper[2578]: I0602 21:41:17.957131 2578 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/410e69f41462d9d02a48f76ad929b5f41ed146182df7ab38cf9ce4e1cd9ll52" event={"ID":"6c39f982-5c69-48f0-a1fc-938941dcb333","Type":"ContainerDied","Data":"e6519ccd2e28cd6682e83e5dc1b91d896c51e02b9090d112e7d3e2c57e6516db"} Jun 02 21:41:17.957169 ip-10-0-138-193 kubenswrapper[2578]: I0602 21:41:17.957169 2578 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="e6519ccd2e28cd6682e83e5dc1b91d896c51e02b9090d112e7d3e2c57e6516db" Jun 02 21:41:17.957169 ip-10-0-138-193 kubenswrapper[2578]: I0602 21:41:17.957152 2578 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/410e69f41462d9d02a48f76ad929b5f41ed146182df7ab38cf9ce4e1cd9ll52" Jun 02 21:41:24.679155 ip-10-0-138-193 kubenswrapper[2578]: I0602 21:41:24.679108 2578 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-8b78d96d9-jvff6"] Jun 02 21:41:24.679608 ip-10-0-138-193 kubenswrapper[2578]: I0602 21:41:24.679589 2578 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="6c39f982-5c69-48f0-a1fc-938941dcb333" containerName="pull" Jun 02 21:41:24.679652 ip-10-0-138-193 kubenswrapper[2578]: I0602 21:41:24.679611 2578 state_mem.go:107] "Deleted CPUSet assignment" podUID="6c39f982-5c69-48f0-a1fc-938941dcb333" containerName="pull" Jun 02 21:41:24.679652 ip-10-0-138-193 kubenswrapper[2578]: I0602 21:41:24.679640 2578 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="6c39f982-5c69-48f0-a1fc-938941dcb333" containerName="extract" Jun 02 21:41:24.679652 ip-10-0-138-193 kubenswrapper[2578]: I0602 21:41:24.679648 2578 state_mem.go:107] "Deleted CPUSet assignment" podUID="6c39f982-5c69-48f0-a1fc-938941dcb333" containerName="extract" Jun 02 21:41:24.679742 ip-10-0-138-193 kubenswrapper[2578]: I0602 21:41:24.679662 2578 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="6c39f982-5c69-48f0-a1fc-938941dcb333" containerName="util" Jun 02 21:41:24.679742 ip-10-0-138-193 kubenswrapper[2578]: I0602 21:41:24.679671 2578 state_mem.go:107] "Deleted CPUSet assignment" podUID="6c39f982-5c69-48f0-a1fc-938941dcb333" containerName="util" Jun 02 21:41:24.679804 ip-10-0-138-193 kubenswrapper[2578]: I0602 21:41:24.679751 2578 memory_manager.go:356] "RemoveStaleState removing state" podUID="6c39f982-5c69-48f0-a1fc-938941dcb333" containerName="extract" Jun 02 21:41:24.682762 ip-10-0-138-193 kubenswrapper[2578]: I0602 21:41:24.682745 2578 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/opendatahub-operator-controller-manager-8b78d96d9-jvff6" Jun 02 21:41:24.685514 ip-10-0-138-193 kubenswrapper[2578]: I0602 21:41:24.685314 2578 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-webhook-cert\"" Jun 02 21:41:24.685514 ip-10-0-138-193 kubenswrapper[2578]: I0602 21:41:24.685348 2578 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"kube-root-ca.crt\"" Jun 02 21:41:24.685514 ip-10-0-138-193 kubenswrapper[2578]: I0602 21:41:24.685387 2578 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-manager-dockercfg-77t8f\"" Jun 02 21:41:24.685514 ip-10-0-138-193 kubenswrapper[2578]: I0602 21:41:24.685413 2578 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-manager-service-cert\"" Jun 02 21:41:24.685798 ip-10-0-138-193 kubenswrapper[2578]: I0602 21:41:24.685725 2578 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"openshift-service-ca.crt\"" Jun 02 21:41:24.697188 ip-10-0-138-193 kubenswrapper[2578]: I0602 21:41:24.697161 2578 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-8b78d96d9-jvff6"] Jun 02 21:41:24.727300 ip-10-0-138-193 kubenswrapper[2578]: I0602 21:41:24.727262 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/656790e6-33df-4988-af65-c88bc533c318-manifests\") pod \"opendatahub-operator-controller-manager-8b78d96d9-jvff6\" (UID: \"656790e6-33df-4988-af65-c88bc533c318\") " pod="opendatahub/opendatahub-operator-controller-manager-8b78d96d9-jvff6" Jun 02 21:41:24.727300 ip-10-0-138-193 kubenswrapper[2578]: I0602 21:41:24.727304 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-5vsdw\" (UniqueName: \"kubernetes.io/projected/656790e6-33df-4988-af65-c88bc533c318-kube-api-access-5vsdw\") pod \"opendatahub-operator-controller-manager-8b78d96d9-jvff6\" (UID: \"656790e6-33df-4988-af65-c88bc533c318\") " pod="opendatahub/opendatahub-operator-controller-manager-8b78d96d9-jvff6" Jun 02 21:41:24.727521 ip-10-0-138-193 kubenswrapper[2578]: I0602 21:41:24.727372 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/656790e6-33df-4988-af65-c88bc533c318-apiservice-cert\") pod \"opendatahub-operator-controller-manager-8b78d96d9-jvff6\" (UID: \"656790e6-33df-4988-af65-c88bc533c318\") " pod="opendatahub/opendatahub-operator-controller-manager-8b78d96d9-jvff6" Jun 02 21:41:24.727521 ip-10-0-138-193 kubenswrapper[2578]: I0602 21:41:24.727449 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/656790e6-33df-4988-af65-c88bc533c318-webhook-cert\") pod \"opendatahub-operator-controller-manager-8b78d96d9-jvff6\" (UID: \"656790e6-33df-4988-af65-c88bc533c318\") " pod="opendatahub/opendatahub-operator-controller-manager-8b78d96d9-jvff6" Jun 02 21:41:24.727521 ip-10-0-138-193 kubenswrapper[2578]: I0602 21:41:24.727514 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/656790e6-33df-4988-af65-c88bc533c318-tmp\") pod \"opendatahub-operator-controller-manager-8b78d96d9-jvff6\" (UID: \"656790e6-33df-4988-af65-c88bc533c318\") " pod="opendatahub/opendatahub-operator-controller-manager-8b78d96d9-jvff6" Jun 02 21:41:24.828396 ip-10-0-138-193 kubenswrapper[2578]: I0602 21:41:24.828354 2578 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/656790e6-33df-4988-af65-c88bc533c318-webhook-cert\") pod \"opendatahub-operator-controller-manager-8b78d96d9-jvff6\" (UID: \"656790e6-33df-4988-af65-c88bc533c318\") " pod="opendatahub/opendatahub-operator-controller-manager-8b78d96d9-jvff6" Jun 02 21:41:24.828613 ip-10-0-138-193 kubenswrapper[2578]: I0602 21:41:24.828428 2578 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/656790e6-33df-4988-af65-c88bc533c318-tmp\") pod \"opendatahub-operator-controller-manager-8b78d96d9-jvff6\" (UID: \"656790e6-33df-4988-af65-c88bc533c318\") " pod="opendatahub/opendatahub-operator-controller-manager-8b78d96d9-jvff6" Jun 02 21:41:24.828613 ip-10-0-138-193 kubenswrapper[2578]: I0602 21:41:24.828459 2578 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/656790e6-33df-4988-af65-c88bc533c318-manifests\") pod \"opendatahub-operator-controller-manager-8b78d96d9-jvff6\" (UID: \"656790e6-33df-4988-af65-c88bc533c318\") " pod="opendatahub/opendatahub-operator-controller-manager-8b78d96d9-jvff6" Jun 02 21:41:24.828613 ip-10-0-138-193 kubenswrapper[2578]: I0602 21:41:24.828479 2578 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-5vsdw\" (UniqueName: \"kubernetes.io/projected/656790e6-33df-4988-af65-c88bc533c318-kube-api-access-5vsdw\") pod \"opendatahub-operator-controller-manager-8b78d96d9-jvff6\" (UID: \"656790e6-33df-4988-af65-c88bc533c318\") " pod="opendatahub/opendatahub-operator-controller-manager-8b78d96d9-jvff6" Jun 02 21:41:24.828613 ip-10-0-138-193 kubenswrapper[2578]: I0602 21:41:24.828503 2578 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/656790e6-33df-4988-af65-c88bc533c318-apiservice-cert\") pod \"opendatahub-operator-controller-manager-8b78d96d9-jvff6\" (UID: \"656790e6-33df-4988-af65-c88bc533c318\") " pod="opendatahub/opendatahub-operator-controller-manager-8b78d96d9-jvff6" Jun 02 21:41:24.828952 ip-10-0-138-193 kubenswrapper[2578]: I0602 21:41:24.828926 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/656790e6-33df-4988-af65-c88bc533c318-manifests\") pod \"opendatahub-operator-controller-manager-8b78d96d9-jvff6\" (UID: \"656790e6-33df-4988-af65-c88bc533c318\") " pod="opendatahub/opendatahub-operator-controller-manager-8b78d96d9-jvff6" Jun 02 21:41:24.830894 ip-10-0-138-193 kubenswrapper[2578]: I0602 21:41:24.830867 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/656790e6-33df-4988-af65-c88bc533c318-tmp\") pod \"opendatahub-operator-controller-manager-8b78d96d9-jvff6\" (UID: \"656790e6-33df-4988-af65-c88bc533c318\") " pod="opendatahub/opendatahub-operator-controller-manager-8b78d96d9-jvff6" Jun 02 21:41:24.830995 ip-10-0-138-193 kubenswrapper[2578]: I0602 21:41:24.830963 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/656790e6-33df-4988-af65-c88bc533c318-webhook-cert\") pod \"opendatahub-operator-controller-manager-8b78d96d9-jvff6\" (UID: \"656790e6-33df-4988-af65-c88bc533c318\") " pod="opendatahub/opendatahub-operator-controller-manager-8b78d96d9-jvff6" Jun 02 21:41:24.831112 ip-10-0-138-193 kubenswrapper[2578]: I0602 21:41:24.831096 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/656790e6-33df-4988-af65-c88bc533c318-apiservice-cert\") pod \"opendatahub-operator-controller-manager-8b78d96d9-jvff6\" (UID: \"656790e6-33df-4988-af65-c88bc533c318\") " pod="opendatahub/opendatahub-operator-controller-manager-8b78d96d9-jvff6" Jun 02 21:41:24.842031 ip-10-0-138-193 kubenswrapper[2578]: I0602 21:41:24.841994 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-5vsdw\" (UniqueName: \"kubernetes.io/projected/656790e6-33df-4988-af65-c88bc533c318-kube-api-access-5vsdw\") pod \"opendatahub-operator-controller-manager-8b78d96d9-jvff6\" (UID: \"656790e6-33df-4988-af65-c88bc533c318\") " pod="opendatahub/opendatahub-operator-controller-manager-8b78d96d9-jvff6" Jun 02 21:41:24.994029 ip-10-0-138-193 kubenswrapper[2578]: I0602 21:41:24.993988 2578 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/opendatahub-operator-controller-manager-8b78d96d9-jvff6" Jun 02 21:41:25.142935 ip-10-0-138-193 kubenswrapper[2578]: I0602 21:41:25.142904 2578 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-8b78d96d9-jvff6"] Jun 02 21:41:25.145139 ip-10-0-138-193 kubenswrapper[2578]: W0602 21:41:25.145097 2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod656790e6_33df_4988_af65_c88bc533c318.slice/crio-43933587fad7d9672093ad43193722b6212c22a9f0c9cb7b7c3a532e2f5f0fc5 WatchSource:0}: Error finding container 43933587fad7d9672093ad43193722b6212c22a9f0c9cb7b7c3a532e2f5f0fc5: Status 404 returned error can't find the container with id 43933587fad7d9672093ad43193722b6212c22a9f0c9cb7b7c3a532e2f5f0fc5 Jun 02 21:41:25.986732 ip-10-0-138-193 kubenswrapper[2578]: I0602 21:41:25.986691 2578 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-8b78d96d9-jvff6" event={"ID":"656790e6-33df-4988-af65-c88bc533c318","Type":"ContainerStarted","Data":"43933587fad7d9672093ad43193722b6212c22a9f0c9cb7b7c3a532e2f5f0fc5"} Jun 02 21:41:29.001492 ip-10-0-138-193 kubenswrapper[2578]: I0602 21:41:29.001446 2578 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-8b78d96d9-jvff6" event={"ID":"656790e6-33df-4988-af65-c88bc533c318","Type":"ContainerStarted","Data":"473ac826ac80ad6e3c6bd4fc4bdb5a6e9eb0722a3c9be28cbf08c40becf67210"} Jun 02 21:41:30.006575 ip-10-0-138-193 kubenswrapper[2578]: I0602 21:41:30.006538 2578 generic.go:358] "Generic (PLEG): container finished" podID="656790e6-33df-4988-af65-c88bc533c318" containerID="473ac826ac80ad6e3c6bd4fc4bdb5a6e9eb0722a3c9be28cbf08c40becf67210" exitCode=0 Jun 02 21:41:30.006950 ip-10-0-138-193 kubenswrapper[2578]: I0602 21:41:30.006625 2578 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-8b78d96d9-jvff6" event={"ID":"656790e6-33df-4988-af65-c88bc533c318","Type":"ContainerDied","Data":"473ac826ac80ad6e3c6bd4fc4bdb5a6e9eb0722a3c9be28cbf08c40becf67210"} Jun 02 21:41:31.012046 ip-10-0-138-193 kubenswrapper[2578]: I0602 21:41:31.012016 2578 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-8b78d96d9-jvff6" event={"ID":"656790e6-33df-4988-af65-c88bc533c318","Type":"ContainerStarted","Data":"e5e9869a462734913231a5316a633074d84ca2c81ac43e73966aba07550fcf92"} Jun 02 21:41:31.012471 ip-10-0-138-193 kubenswrapper[2578]: I0602 21:41:31.012134 2578 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/opendatahub-operator-controller-manager-8b78d96d9-jvff6" Jun 02 21:41:31.034903 ip-10-0-138-193 kubenswrapper[2578]: I0602 21:41:31.034852 2578 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="opendatahub/opendatahub-operator-controller-manager-8b78d96d9-jvff6" podStartSLOduration=1.8434885140000001 podStartE2EDuration="7.034836653s" podCreationTimestamp="2026-06-02 21:41:24 +0000 UTC" firstStartedPulling="2026-06-02 21:41:25.146898772 +0000 UTC m=+462.398796656" lastFinishedPulling="2026-06-02 21:41:30.338246898 +0000 UTC m=+467.590144795" observedRunningTime="2026-06-02 21:41:31.03197718 +0000 UTC m=+468.283875086" watchObservedRunningTime="2026-06-02 21:41:31.034836653 +0000 UTC m=+468.286734655" Jun 02 21:41:42.017564 ip-10-0-138-193 kubenswrapper[2578]: I0602 21:41:42.017536 2578 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/opendatahub-operator-controller-manager-8b78d96d9-jvff6" Jun 02 21:41:44.353532 ip-10-0-138-193 kubenswrapper[2578]: I0602 21:41:44.353497 2578 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-ingress/kube-auth-proxy-dcdbb48fb-z54k4"] Jun 02 21:41:44.358972 ip-10-0-138-193 kubenswrapper[2578]: I0602 21:41:44.358954 2578 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/kube-auth-proxy-dcdbb48fb-z54k4" Jun 02 21:41:44.362912 ip-10-0-138-193 kubenswrapper[2578]: I0602 21:41:44.362882 2578 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"kube-auth-proxy-tls\"" Jun 02 21:41:44.362912 ip-10-0-138-193 kubenswrapper[2578]: I0602 21:41:44.362907 2578 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"kube-auth-proxy-creds\"" Jun 02 21:41:44.363114 ip-10-0-138-193 kubenswrapper[2578]: I0602 21:41:44.362929 2578 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"openshift-service-ca.crt\"" Jun 02 21:41:44.363114 ip-10-0-138-193 kubenswrapper[2578]: I0602 21:41:44.362892 2578 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"kube-root-ca.crt\"" Jun 02 21:41:44.363114 ip-10-0-138-193 kubenswrapper[2578]: I0602 21:41:44.362886 2578 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"kube-auth-proxy-dockercfg-98lv6\"" Jun 02 21:41:44.372667 ip-10-0-138-193 kubenswrapper[2578]: I0602 21:41:44.372637 2578 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/kube-auth-proxy-dcdbb48fb-z54k4"] Jun 02 21:41:44.510613 ip-10-0-138-193 kubenswrapper[2578]: I0602 21:41:44.510578 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/2a04e179-e45c-4c54-b177-a5dd97cf0861-tmp\") pod \"kube-auth-proxy-dcdbb48fb-z54k4\" (UID: \"2a04e179-e45c-4c54-b177-a5dd97cf0861\") " pod="openshift-ingress/kube-auth-proxy-dcdbb48fb-z54k4" Jun 02 21:41:44.510613 ip-10-0-138-193 kubenswrapper[2578]: I0602 21:41:44.510612 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-k2dwf\" (UniqueName: \"kubernetes.io/projected/2a04e179-e45c-4c54-b177-a5dd97cf0861-kube-api-access-k2dwf\") pod \"kube-auth-proxy-dcdbb48fb-z54k4\" (UID: \"2a04e179-e45c-4c54-b177-a5dd97cf0861\") " pod="openshift-ingress/kube-auth-proxy-dcdbb48fb-z54k4" Jun 02 21:41:44.510820 ip-10-0-138-193 kubenswrapper[2578]: I0602 21:41:44.510737 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/2a04e179-e45c-4c54-b177-a5dd97cf0861-tls-certs\") pod \"kube-auth-proxy-dcdbb48fb-z54k4\" (UID: \"2a04e179-e45c-4c54-b177-a5dd97cf0861\") " pod="openshift-ingress/kube-auth-proxy-dcdbb48fb-z54k4" Jun 02 21:41:44.611921 ip-10-0-138-193 kubenswrapper[2578]: I0602 21:41:44.611816 2578 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/2a04e179-e45c-4c54-b177-a5dd97cf0861-tls-certs\") pod \"kube-auth-proxy-dcdbb48fb-z54k4\" (UID: \"2a04e179-e45c-4c54-b177-a5dd97cf0861\") " pod="openshift-ingress/kube-auth-proxy-dcdbb48fb-z54k4" Jun 02 21:41:44.611921 ip-10-0-138-193 kubenswrapper[2578]: I0602 21:41:44.611891 2578 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/2a04e179-e45c-4c54-b177-a5dd97cf0861-tmp\") pod \"kube-auth-proxy-dcdbb48fb-z54k4\" (UID: \"2a04e179-e45c-4c54-b177-a5dd97cf0861\") " pod="openshift-ingress/kube-auth-proxy-dcdbb48fb-z54k4" Jun 02 21:41:44.612181 ip-10-0-138-193 kubenswrapper[2578]: I0602 21:41:44.611918 2578 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-k2dwf\" (UniqueName: \"kubernetes.io/projected/2a04e179-e45c-4c54-b177-a5dd97cf0861-kube-api-access-k2dwf\") pod \"kube-auth-proxy-dcdbb48fb-z54k4\" (UID: \"2a04e179-e45c-4c54-b177-a5dd97cf0861\") " pod="openshift-ingress/kube-auth-proxy-dcdbb48fb-z54k4" Jun 02 21:41:44.614184 ip-10-0-138-193 kubenswrapper[2578]: I0602 21:41:44.614157 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/2a04e179-e45c-4c54-b177-a5dd97cf0861-tmp\") pod \"kube-auth-proxy-dcdbb48fb-z54k4\" (UID: \"2a04e179-e45c-4c54-b177-a5dd97cf0861\") " pod="openshift-ingress/kube-auth-proxy-dcdbb48fb-z54k4" Jun 02 21:41:44.614371 ip-10-0-138-193 kubenswrapper[2578]: I0602 21:41:44.614352 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/2a04e179-e45c-4c54-b177-a5dd97cf0861-tls-certs\") pod \"kube-auth-proxy-dcdbb48fb-z54k4\" (UID: \"2a04e179-e45c-4c54-b177-a5dd97cf0861\") " pod="openshift-ingress/kube-auth-proxy-dcdbb48fb-z54k4" Jun 02 21:41:44.632649 ip-10-0-138-193 kubenswrapper[2578]: I0602 21:41:44.632624 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-k2dwf\" (UniqueName: \"kubernetes.io/projected/2a04e179-e45c-4c54-b177-a5dd97cf0861-kube-api-access-k2dwf\") pod \"kube-auth-proxy-dcdbb48fb-z54k4\" (UID: \"2a04e179-e45c-4c54-b177-a5dd97cf0861\") " pod="openshift-ingress/kube-auth-proxy-dcdbb48fb-z54k4" Jun 02 21:41:44.669341 ip-10-0-138-193 kubenswrapper[2578]: I0602 21:41:44.669312 2578 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/kube-auth-proxy-dcdbb48fb-z54k4" Jun 02 21:41:44.815022 ip-10-0-138-193 kubenswrapper[2578]: I0602 21:41:44.814994 2578 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/kube-auth-proxy-dcdbb48fb-z54k4"] Jun 02 21:41:44.817449 ip-10-0-138-193 kubenswrapper[2578]: W0602 21:41:44.817420 2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod2a04e179_e45c_4c54_b177_a5dd97cf0861.slice/crio-aa97a62e41dc928772741f3315bf201f907c5e5a5ed42a969b5e86c929254c68 WatchSource:0}: Error finding container aa97a62e41dc928772741f3315bf201f907c5e5a5ed42a969b5e86c929254c68: Status 404 returned error can't find the container with id aa97a62e41dc928772741f3315bf201f907c5e5a5ed42a969b5e86c929254c68 Jun 02 21:41:45.061143 ip-10-0-138-193 kubenswrapper[2578]: I0602 21:41:45.061094 2578 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/kube-auth-proxy-dcdbb48fb-z54k4" event={"ID":"2a04e179-e45c-4c54-b177-a5dd97cf0861","Type":"ContainerStarted","Data":"aa97a62e41dc928772741f3315bf201f907c5e5a5ed42a969b5e86c929254c68"} Jun 02 21:41:45.209314 ip-10-0-138-193 kubenswrapper[2578]: I0602 21:41:45.209278 2578 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["opendatahub/model-serving-api-6577596cd5-qrtph"] Jun 02 21:41:45.212235 ip-10-0-138-193 kubenswrapper[2578]: I0602 21:41:45.212215 2578 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/model-serving-api-6577596cd5-qrtph" Jun 02 21:41:45.214467 ip-10-0-138-193 kubenswrapper[2578]: I0602 21:41:45.214447 2578 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"model-serving-api-tls\"" Jun 02 21:41:45.223026 ip-10-0-138-193 kubenswrapper[2578]: I0602 21:41:45.223001 2578 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["opendatahub/model-serving-api-6577596cd5-qrtph"] Jun 02 21:41:45.317789 ip-10-0-138-193 kubenswrapper[2578]: I0602 21:41:45.317689 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/6afe9127-42ef-46e0-8971-cfd2dde15517-tls-certs\") pod \"model-serving-api-6577596cd5-qrtph\" (UID: \"6afe9127-42ef-46e0-8971-cfd2dde15517\") " pod="opendatahub/model-serving-api-6577596cd5-qrtph" Jun 02 21:41:45.317789 ip-10-0-138-193 kubenswrapper[2578]: I0602 21:41:45.317760 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-gz8xq\" (UniqueName: \"kubernetes.io/projected/6afe9127-42ef-46e0-8971-cfd2dde15517-kube-api-access-gz8xq\") pod \"model-serving-api-6577596cd5-qrtph\" (UID: \"6afe9127-42ef-46e0-8971-cfd2dde15517\") " pod="opendatahub/model-serving-api-6577596cd5-qrtph" Jun 02 21:41:45.418577 ip-10-0-138-193 kubenswrapper[2578]: I0602 21:41:45.418529 2578 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-gz8xq\" (UniqueName: \"kubernetes.io/projected/6afe9127-42ef-46e0-8971-cfd2dde15517-kube-api-access-gz8xq\") pod \"model-serving-api-6577596cd5-qrtph\" (UID: \"6afe9127-42ef-46e0-8971-cfd2dde15517\") " pod="opendatahub/model-serving-api-6577596cd5-qrtph" Jun 02 21:41:45.419031 ip-10-0-138-193 kubenswrapper[2578]: I0602 21:41:45.418636 2578 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/6afe9127-42ef-46e0-8971-cfd2dde15517-tls-certs\") pod \"model-serving-api-6577596cd5-qrtph\" (UID: \"6afe9127-42ef-46e0-8971-cfd2dde15517\") " pod="opendatahub/model-serving-api-6577596cd5-qrtph" Jun 02 21:41:45.419273 ip-10-0-138-193 kubenswrapper[2578]: E0602 21:41:45.419247 2578 secret.go:189] Couldn't get secret opendatahub/model-serving-api-tls: secret "model-serving-api-tls" not found Jun 02 21:41:45.419380 ip-10-0-138-193 kubenswrapper[2578]: E0602 21:41:45.419343 2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/6afe9127-42ef-46e0-8971-cfd2dde15517-tls-certs podName:6afe9127-42ef-46e0-8971-cfd2dde15517 nodeName:}" failed. No retries permitted until 2026-06-02 21:41:45.91931825 +0000 UTC m=+483.171216151 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "tls-certs" (UniqueName: "kubernetes.io/secret/6afe9127-42ef-46e0-8971-cfd2dde15517-tls-certs") pod "model-serving-api-6577596cd5-qrtph" (UID: "6afe9127-42ef-46e0-8971-cfd2dde15517") : secret "model-serving-api-tls" not found Jun 02 21:41:45.428465 ip-10-0-138-193 kubenswrapper[2578]: I0602 21:41:45.428436 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-gz8xq\" (UniqueName: \"kubernetes.io/projected/6afe9127-42ef-46e0-8971-cfd2dde15517-kube-api-access-gz8xq\") pod \"model-serving-api-6577596cd5-qrtph\" (UID: \"6afe9127-42ef-46e0-8971-cfd2dde15517\") " pod="opendatahub/model-serving-api-6577596cd5-qrtph" Jun 02 21:41:45.922607 ip-10-0-138-193 kubenswrapper[2578]: I0602 21:41:45.922570 2578 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/6afe9127-42ef-46e0-8971-cfd2dde15517-tls-certs\") pod \"model-serving-api-6577596cd5-qrtph\" (UID: \"6afe9127-42ef-46e0-8971-cfd2dde15517\") " pod="opendatahub/model-serving-api-6577596cd5-qrtph" Jun 02 21:41:45.925027 ip-10-0-138-193 kubenswrapper[2578]: I0602 21:41:45.924992 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/6afe9127-42ef-46e0-8971-cfd2dde15517-tls-certs\") pod \"model-serving-api-6577596cd5-qrtph\" (UID: \"6afe9127-42ef-46e0-8971-cfd2dde15517\") " pod="opendatahub/model-serving-api-6577596cd5-qrtph" Jun 02 21:41:46.116488 ip-10-0-138-193 kubenswrapper[2578]: I0602 21:41:46.116455 2578 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-marketplace/4c892a6d2d8a57acbc49427d3a7d24e253bab25be2c607ef405d2c4835b9gxm"] Jun 02 21:41:46.119603 ip-10-0-138-193 kubenswrapper[2578]: I0602 21:41:46.119577 2578 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/4c892a6d2d8a57acbc49427d3a7d24e253bab25be2c607ef405d2c4835b9gxm" Jun 02 21:41:46.122283 ip-10-0-138-193 kubenswrapper[2578]: I0602 21:41:46.122254 2578 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"openshift-service-ca.crt\"" Jun 02 21:41:46.122462 ip-10-0-138-193 kubenswrapper[2578]: I0602 21:41:46.122318 2578 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-marketplace\"/\"default-dockercfg-hfgcz\"" Jun 02 21:41:46.123325 ip-10-0-138-193 kubenswrapper[2578]: I0602 21:41:46.123301 2578 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"kube-root-ca.crt\"" Jun 02 21:41:46.124314 ip-10-0-138-193 kubenswrapper[2578]: I0602 21:41:46.123943 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/ee16b677-9785-4f0c-9c97-a6e04a90edf9-bundle\") pod \"4c892a6d2d8a57acbc49427d3a7d24e253bab25be2c607ef405d2c4835b9gxm\" (UID: \"ee16b677-9785-4f0c-9c97-a6e04a90edf9\") " pod="openshift-marketplace/4c892a6d2d8a57acbc49427d3a7d24e253bab25be2c607ef405d2c4835b9gxm" Jun 02 21:41:46.124314 ip-10-0-138-193 kubenswrapper[2578]: I0602 21:41:46.123979 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/ee16b677-9785-4f0c-9c97-a6e04a90edf9-util\") pod \"4c892a6d2d8a57acbc49427d3a7d24e253bab25be2c607ef405d2c4835b9gxm\" (UID: \"ee16b677-9785-4f0c-9c97-a6e04a90edf9\") " pod="openshift-marketplace/4c892a6d2d8a57acbc49427d3a7d24e253bab25be2c607ef405d2c4835b9gxm" Jun 02 21:41:46.124314 ip-10-0-138-193 kubenswrapper[2578]: I0602 21:41:46.124015 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-bxk82\" (UniqueName: \"kubernetes.io/projected/ee16b677-9785-4f0c-9c97-a6e04a90edf9-kube-api-access-bxk82\") pod \"4c892a6d2d8a57acbc49427d3a7d24e253bab25be2c607ef405d2c4835b9gxm\" (UID: \"ee16b677-9785-4f0c-9c97-a6e04a90edf9\") " pod="openshift-marketplace/4c892a6d2d8a57acbc49427d3a7d24e253bab25be2c607ef405d2c4835b9gxm" Jun 02 21:41:46.124314 ip-10-0-138-193 kubenswrapper[2578]: I0602 21:41:46.124111 2578 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/model-serving-api-6577596cd5-qrtph" Jun 02 21:41:46.129491 ip-10-0-138-193 kubenswrapper[2578]: I0602 21:41:46.129449 2578 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/4c892a6d2d8a57acbc49427d3a7d24e253bab25be2c607ef405d2c4835b9gxm"] Jun 02 21:41:46.227667 ip-10-0-138-193 kubenswrapper[2578]: I0602 21:41:46.224872 2578 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/ee16b677-9785-4f0c-9c97-a6e04a90edf9-bundle\") pod \"4c892a6d2d8a57acbc49427d3a7d24e253bab25be2c607ef405d2c4835b9gxm\" (UID: \"ee16b677-9785-4f0c-9c97-a6e04a90edf9\") " pod="openshift-marketplace/4c892a6d2d8a57acbc49427d3a7d24e253bab25be2c607ef405d2c4835b9gxm" Jun 02 21:41:46.227667 ip-10-0-138-193 kubenswrapper[2578]: I0602 21:41:46.224922 2578 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/ee16b677-9785-4f0c-9c97-a6e04a90edf9-util\") pod \"4c892a6d2d8a57acbc49427d3a7d24e253bab25be2c607ef405d2c4835b9gxm\" (UID: \"ee16b677-9785-4f0c-9c97-a6e04a90edf9\") " pod="openshift-marketplace/4c892a6d2d8a57acbc49427d3a7d24e253bab25be2c607ef405d2c4835b9gxm" Jun 02 21:41:46.227667 ip-10-0-138-193 kubenswrapper[2578]: I0602 21:41:46.224967 2578 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-bxk82\" (UniqueName: \"kubernetes.io/projected/ee16b677-9785-4f0c-9c97-a6e04a90edf9-kube-api-access-bxk82\") pod \"4c892a6d2d8a57acbc49427d3a7d24e253bab25be2c607ef405d2c4835b9gxm\" (UID: \"ee16b677-9785-4f0c-9c97-a6e04a90edf9\") " pod="openshift-marketplace/4c892a6d2d8a57acbc49427d3a7d24e253bab25be2c607ef405d2c4835b9gxm" Jun 02 21:41:46.227667 ip-10-0-138-193 kubenswrapper[2578]: I0602 21:41:46.225752 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/ee16b677-9785-4f0c-9c97-a6e04a90edf9-bundle\") pod \"4c892a6d2d8a57acbc49427d3a7d24e253bab25be2c607ef405d2c4835b9gxm\" (UID: \"ee16b677-9785-4f0c-9c97-a6e04a90edf9\") " pod="openshift-marketplace/4c892a6d2d8a57acbc49427d3a7d24e253bab25be2c607ef405d2c4835b9gxm" Jun 02 21:41:46.227667 ip-10-0-138-193 kubenswrapper[2578]: I0602 21:41:46.226014 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/ee16b677-9785-4f0c-9c97-a6e04a90edf9-util\") pod \"4c892a6d2d8a57acbc49427d3a7d24e253bab25be2c607ef405d2c4835b9gxm\" (UID: \"ee16b677-9785-4f0c-9c97-a6e04a90edf9\") " pod="openshift-marketplace/4c892a6d2d8a57acbc49427d3a7d24e253bab25be2c607ef405d2c4835b9gxm" Jun 02 21:41:46.235305 ip-10-0-138-193 kubenswrapper[2578]: I0602 21:41:46.235246 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-bxk82\" (UniqueName: \"kubernetes.io/projected/ee16b677-9785-4f0c-9c97-a6e04a90edf9-kube-api-access-bxk82\") pod \"4c892a6d2d8a57acbc49427d3a7d24e253bab25be2c607ef405d2c4835b9gxm\" (UID: \"ee16b677-9785-4f0c-9c97-a6e04a90edf9\") " pod="openshift-marketplace/4c892a6d2d8a57acbc49427d3a7d24e253bab25be2c607ef405d2c4835b9gxm" Jun 02 21:41:46.284740 ip-10-0-138-193 kubenswrapper[2578]: I0602 21:41:46.284700 2578 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["opendatahub/model-serving-api-6577596cd5-qrtph"] Jun 02 21:41:46.458550 ip-10-0-138-193 kubenswrapper[2578]: I0602 21:41:46.458456 2578 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/4c892a6d2d8a57acbc49427d3a7d24e253bab25be2c607ef405d2c4835b9gxm" Jun 02 21:41:46.927441 ip-10-0-138-193 kubenswrapper[2578]: W0602 21:41:46.927406 2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod6afe9127_42ef_46e0_8971_cfd2dde15517.slice/crio-0b31bc3dd93efdab03dfca581a1b001b3ff4abe360c732ea1894498b57dc2d5d WatchSource:0}: Error finding container 0b31bc3dd93efdab03dfca581a1b001b3ff4abe360c732ea1894498b57dc2d5d: Status 404 returned error can't find the container with id 0b31bc3dd93efdab03dfca581a1b001b3ff4abe360c732ea1894498b57dc2d5d Jun 02 21:41:47.064919 ip-10-0-138-193 kubenswrapper[2578]: I0602 21:41:47.064881 2578 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/4c892a6d2d8a57acbc49427d3a7d24e253bab25be2c607ef405d2c4835b9gxm"] Jun 02 21:41:47.071649 ip-10-0-138-193 kubenswrapper[2578]: I0602 21:41:47.071609 2578 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="opendatahub/model-serving-api-6577596cd5-qrtph" event={"ID":"6afe9127-42ef-46e0-8971-cfd2dde15517","Type":"ContainerStarted","Data":"0b31bc3dd93efdab03dfca581a1b001b3ff4abe360c732ea1894498b57dc2d5d"} Jun 02 21:41:47.629453 ip-10-0-138-193 kubenswrapper[2578]: W0602 21:41:47.629418 2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podee16b677_9785_4f0c_9c97_a6e04a90edf9.slice/crio-2b010a6624882db20b41b37b5d556e1d52e49ba737299c1887cabf53d24567e3 WatchSource:0}: Error finding container 2b010a6624882db20b41b37b5d556e1d52e49ba737299c1887cabf53d24567e3: Status 404 returned error can't find the container with id 2b010a6624882db20b41b37b5d556e1d52e49ba737299c1887cabf53d24567e3 Jun 02 21:41:48.078241 ip-10-0-138-193 kubenswrapper[2578]: I0602 21:41:48.078135 2578 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/kube-auth-proxy-dcdbb48fb-z54k4" event={"ID":"2a04e179-e45c-4c54-b177-a5dd97cf0861","Type":"ContainerStarted","Data":"aa0d003eb597057689a8888a06f33e0b863ffa7d4e63ec7b1cc59db6ec4383b6"} Jun 02 21:41:48.079873 ip-10-0-138-193 kubenswrapper[2578]: I0602 21:41:48.079840 2578 generic.go:358] "Generic (PLEG): container finished" podID="ee16b677-9785-4f0c-9c97-a6e04a90edf9" containerID="fe69eb394abc29c733d0744152eba77eb5df84bbec9669ae9c61252e4c8531df" exitCode=0 Jun 02 21:41:48.080002 ip-10-0-138-193 kubenswrapper[2578]: I0602 21:41:48.079899 2578 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/4c892a6d2d8a57acbc49427d3a7d24e253bab25be2c607ef405d2c4835b9gxm" event={"ID":"ee16b677-9785-4f0c-9c97-a6e04a90edf9","Type":"ContainerDied","Data":"fe69eb394abc29c733d0744152eba77eb5df84bbec9669ae9c61252e4c8531df"} Jun 02 21:41:48.080002 ip-10-0-138-193 kubenswrapper[2578]: I0602 21:41:48.079926 2578 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/4c892a6d2d8a57acbc49427d3a7d24e253bab25be2c607ef405d2c4835b9gxm" event={"ID":"ee16b677-9785-4f0c-9c97-a6e04a90edf9","Type":"ContainerStarted","Data":"2b010a6624882db20b41b37b5d556e1d52e49ba737299c1887cabf53d24567e3"} Jun 02 21:41:48.095949 ip-10-0-138-193 kubenswrapper[2578]: I0602 21:41:48.095891 2578 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-ingress/kube-auth-proxy-dcdbb48fb-z54k4" podStartSLOduration=1.250393314 podStartE2EDuration="4.095869646s" podCreationTimestamp="2026-06-02 21:41:44 +0000 UTC" firstStartedPulling="2026-06-02 21:41:44.819337692 +0000 UTC m=+482.071235576" lastFinishedPulling="2026-06-02 21:41:47.66481402 +0000 UTC m=+484.916711908" observedRunningTime="2026-06-02 21:41:48.094413107 +0000 UTC m=+485.346311013" watchObservedRunningTime="2026-06-02 21:41:48.095869646 +0000 UTC m=+485.347767553" Jun 02 21:41:50.087801 ip-10-0-138-193 kubenswrapper[2578]: I0602 21:41:50.087769 2578 generic.go:358] "Generic (PLEG): container finished" podID="ee16b677-9785-4f0c-9c97-a6e04a90edf9" containerID="697296e1e141ccab4c3bea3124c2900a0b2036e9d4b36272f166f8b933c7ad6f" exitCode=0 Jun 02 21:41:50.088258 ip-10-0-138-193 kubenswrapper[2578]: I0602 21:41:50.087856 2578 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/4c892a6d2d8a57acbc49427d3a7d24e253bab25be2c607ef405d2c4835b9gxm" event={"ID":"ee16b677-9785-4f0c-9c97-a6e04a90edf9","Type":"ContainerDied","Data":"697296e1e141ccab4c3bea3124c2900a0b2036e9d4b36272f166f8b933c7ad6f"} Jun 02 21:41:50.089252 ip-10-0-138-193 kubenswrapper[2578]: I0602 21:41:50.089223 2578 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="opendatahub/model-serving-api-6577596cd5-qrtph" event={"ID":"6afe9127-42ef-46e0-8971-cfd2dde15517","Type":"ContainerStarted","Data":"b61935673d6643d17c4985618aaab15c46712d73206928d85c02ca78325134b0"} Jun 02 21:41:50.089370 ip-10-0-138-193 kubenswrapper[2578]: I0602 21:41:50.089319 2578 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/model-serving-api-6577596cd5-qrtph" Jun 02 21:41:50.123247 ip-10-0-138-193 kubenswrapper[2578]: I0602 21:41:50.123202 2578 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="opendatahub/model-serving-api-6577596cd5-qrtph" podStartSLOduration=2.959618362 podStartE2EDuration="5.12318852s" podCreationTimestamp="2026-06-02 21:41:45 +0000 UTC" firstStartedPulling="2026-06-02 21:41:46.93039955 +0000 UTC m=+484.182297436" lastFinishedPulling="2026-06-02 21:41:49.093969689 +0000 UTC m=+486.345867594" observedRunningTime="2026-06-02 21:41:50.121467614 +0000 UTC m=+487.373365520" watchObservedRunningTime="2026-06-02 21:41:50.12318852 +0000 UTC m=+487.375086428" Jun 02 21:41:51.095424 ip-10-0-138-193 kubenswrapper[2578]: I0602 21:41:51.095385 2578 generic.go:358] "Generic (PLEG): container finished" podID="ee16b677-9785-4f0c-9c97-a6e04a90edf9" containerID="93927bfb6642c38fe3ce30eb92dd907a3368dd7956fc3bfc04ecbfd15eab971f" exitCode=0 Jun 02 21:41:51.095955 ip-10-0-138-193 kubenswrapper[2578]: I0602 21:41:51.095473 2578 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/4c892a6d2d8a57acbc49427d3a7d24e253bab25be2c607ef405d2c4835b9gxm" event={"ID":"ee16b677-9785-4f0c-9c97-a6e04a90edf9","Type":"ContainerDied","Data":"93927bfb6642c38fe3ce30eb92dd907a3368dd7956fc3bfc04ecbfd15eab971f"} Jun 02 21:41:52.231454 ip-10-0-138-193 kubenswrapper[2578]: I0602 21:41:52.231430 2578 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/4c892a6d2d8a57acbc49427d3a7d24e253bab25be2c607ef405d2c4835b9gxm" Jun 02 21:41:52.281221 ip-10-0-138-193 kubenswrapper[2578]: I0602 21:41:52.281189 2578 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/ee16b677-9785-4f0c-9c97-a6e04a90edf9-util\") pod \"ee16b677-9785-4f0c-9c97-a6e04a90edf9\" (UID: \"ee16b677-9785-4f0c-9c97-a6e04a90edf9\") " Jun 02 21:41:52.281454 ip-10-0-138-193 kubenswrapper[2578]: I0602 21:41:52.281244 2578 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/ee16b677-9785-4f0c-9c97-a6e04a90edf9-bundle\") pod \"ee16b677-9785-4f0c-9c97-a6e04a90edf9\" (UID: \"ee16b677-9785-4f0c-9c97-a6e04a90edf9\") " Jun 02 21:41:52.281454 ip-10-0-138-193 kubenswrapper[2578]: I0602 21:41:52.281319 2578 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-bxk82\" (UniqueName: \"kubernetes.io/projected/ee16b677-9785-4f0c-9c97-a6e04a90edf9-kube-api-access-bxk82\") pod \"ee16b677-9785-4f0c-9c97-a6e04a90edf9\" (UID: \"ee16b677-9785-4f0c-9c97-a6e04a90edf9\") " Jun 02 21:41:52.282416 ip-10-0-138-193 kubenswrapper[2578]: I0602 21:41:52.282385 2578 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/ee16b677-9785-4f0c-9c97-a6e04a90edf9-bundle" (OuterVolumeSpecName: "bundle") pod "ee16b677-9785-4f0c-9c97-a6e04a90edf9" (UID: "ee16b677-9785-4f0c-9c97-a6e04a90edf9"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jun 02 21:41:52.283648 ip-10-0-138-193 kubenswrapper[2578]: I0602 21:41:52.283628 2578 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/ee16b677-9785-4f0c-9c97-a6e04a90edf9-kube-api-access-bxk82" (OuterVolumeSpecName: "kube-api-access-bxk82") pod "ee16b677-9785-4f0c-9c97-a6e04a90edf9" (UID: "ee16b677-9785-4f0c-9c97-a6e04a90edf9"). InnerVolumeSpecName "kube-api-access-bxk82". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 02 21:41:52.286114 ip-10-0-138-193 kubenswrapper[2578]: I0602 21:41:52.286086 2578 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/ee16b677-9785-4f0c-9c97-a6e04a90edf9-util" (OuterVolumeSpecName: "util") pod "ee16b677-9785-4f0c-9c97-a6e04a90edf9" (UID: "ee16b677-9785-4f0c-9c97-a6e04a90edf9"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jun 02 21:41:52.382495 ip-10-0-138-193 kubenswrapper[2578]: I0602 21:41:52.382403 2578 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/ee16b677-9785-4f0c-9c97-a6e04a90edf9-util\") on node \"ip-10-0-138-193.ec2.internal\" DevicePath \"\"" Jun 02 21:41:52.382495 ip-10-0-138-193 kubenswrapper[2578]: I0602 21:41:52.382438 2578 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/ee16b677-9785-4f0c-9c97-a6e04a90edf9-bundle\") on node \"ip-10-0-138-193.ec2.internal\" DevicePath \"\"" Jun 02 21:41:52.382495 ip-10-0-138-193 kubenswrapper[2578]: I0602 21:41:52.382448 2578 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-bxk82\" (UniqueName: \"kubernetes.io/projected/ee16b677-9785-4f0c-9c97-a6e04a90edf9-kube-api-access-bxk82\") on node \"ip-10-0-138-193.ec2.internal\" DevicePath \"\"" Jun 02 21:41:53.105172 ip-10-0-138-193 kubenswrapper[2578]: I0602 21:41:53.105133 2578 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/4c892a6d2d8a57acbc49427d3a7d24e253bab25be2c607ef405d2c4835b9gxm" event={"ID":"ee16b677-9785-4f0c-9c97-a6e04a90edf9","Type":"ContainerDied","Data":"2b010a6624882db20b41b37b5d556e1d52e49ba737299c1887cabf53d24567e3"} Jun 02 21:41:53.105172 ip-10-0-138-193 kubenswrapper[2578]: I0602 21:41:53.105177 2578 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="2b010a6624882db20b41b37b5d556e1d52e49ba737299c1887cabf53d24567e3" Jun 02 21:41:53.105384 ip-10-0-138-193 kubenswrapper[2578]: I0602 21:41:53.105152 2578 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/4c892a6d2d8a57acbc49427d3a7d24e253bab25be2c607ef405d2c4835b9gxm" Jun 02 21:41:54.611939 ip-10-0-138-193 kubenswrapper[2578]: I0602 21:41:54.611895 2578 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["opendatahub/kserve-controller-manager-7c99ffcdcd-8fjxd"] Jun 02 21:41:54.612332 ip-10-0-138-193 kubenswrapper[2578]: I0602 21:41:54.612316 2578 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="ee16b677-9785-4f0c-9c97-a6e04a90edf9" containerName="extract" Jun 02 21:41:54.612332 ip-10-0-138-193 kubenswrapper[2578]: I0602 21:41:54.612330 2578 state_mem.go:107] "Deleted CPUSet assignment" podUID="ee16b677-9785-4f0c-9c97-a6e04a90edf9" containerName="extract" Jun 02 21:41:54.612451 ip-10-0-138-193 kubenswrapper[2578]: I0602 21:41:54.612344 2578 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="ee16b677-9785-4f0c-9c97-a6e04a90edf9" containerName="util" Jun 02 21:41:54.612451 ip-10-0-138-193 kubenswrapper[2578]: I0602 21:41:54.612349 2578 state_mem.go:107] "Deleted CPUSet assignment" podUID="ee16b677-9785-4f0c-9c97-a6e04a90edf9" containerName="util" Jun 02 21:41:54.612451 ip-10-0-138-193 kubenswrapper[2578]: I0602 21:41:54.612363 2578 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="ee16b677-9785-4f0c-9c97-a6e04a90edf9" containerName="pull" Jun 02 21:41:54.612451 ip-10-0-138-193 kubenswrapper[2578]: I0602 21:41:54.612368 2578 state_mem.go:107] "Deleted CPUSet assignment" podUID="ee16b677-9785-4f0c-9c97-a6e04a90edf9" containerName="pull" Jun 02 21:41:54.612451 ip-10-0-138-193 kubenswrapper[2578]: I0602 21:41:54.612427 2578 memory_manager.go:356] "RemoveStaleState removing state" podUID="ee16b677-9785-4f0c-9c97-a6e04a90edf9" containerName="extract" Jun 02 21:41:54.615514 ip-10-0-138-193 kubenswrapper[2578]: I0602 21:41:54.615483 2578 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/kserve-controller-manager-7c99ffcdcd-8fjxd" Jun 02 21:41:54.617946 ip-10-0-138-193 kubenswrapper[2578]: I0602 21:41:54.617920 2578 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"kserve-webhook-server-cert\"" Jun 02 21:41:54.618100 ip-10-0-138-193 kubenswrapper[2578]: I0602 21:41:54.617927 2578 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"kserve-controller-manager-dockercfg-pcwn5\"" Jun 02 21:41:54.628241 ip-10-0-138-193 kubenswrapper[2578]: I0602 21:41:54.628216 2578 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["opendatahub/kserve-controller-manager-7c99ffcdcd-8fjxd"] Jun 02 21:41:54.630298 ip-10-0-138-193 kubenswrapper[2578]: I0602 21:41:54.630275 2578 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["opendatahub/llmisvc-controller-manager-c6b9847d7-f6h7k"] Jun 02 21:41:54.633932 ip-10-0-138-193 kubenswrapper[2578]: I0602 21:41:54.633911 2578 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/llmisvc-controller-manager-c6b9847d7-f6h7k" Jun 02 21:41:54.636398 ip-10-0-138-193 kubenswrapper[2578]: I0602 21:41:54.636375 2578 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"llmisvc-controller-manager-dockercfg-cnblg\"" Jun 02 21:41:54.636532 ip-10-0-138-193 kubenswrapper[2578]: I0602 21:41:54.636414 2578 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"llmisvc-webhook-server-cert\"" Jun 02 21:41:54.644197 ip-10-0-138-193 kubenswrapper[2578]: I0602 21:41:54.644173 2578 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["opendatahub/llmisvc-controller-manager-c6b9847d7-f6h7k"] Jun 02 21:41:54.705209 ip-10-0-138-193 kubenswrapper[2578]: I0602 21:41:54.705170 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-f55gc\" (UniqueName: \"kubernetes.io/projected/2faafa98-aeb5-4ddc-af54-52c9d393e96b-kube-api-access-f55gc\") pod \"llmisvc-controller-manager-c6b9847d7-f6h7k\" (UID: \"2faafa98-aeb5-4ddc-af54-52c9d393e96b\") " pod="opendatahub/llmisvc-controller-manager-c6b9847d7-f6h7k" Jun 02 21:41:54.705209 ip-10-0-138-193 kubenswrapper[2578]: I0602 21:41:54.705216 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/2faafa98-aeb5-4ddc-af54-52c9d393e96b-cert\") pod \"llmisvc-controller-manager-c6b9847d7-f6h7k\" (UID: \"2faafa98-aeb5-4ddc-af54-52c9d393e96b\") " pod="opendatahub/llmisvc-controller-manager-c6b9847d7-f6h7k" Jun 02 21:41:54.705490 ip-10-0-138-193 kubenswrapper[2578]: I0602 21:41:54.705243 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-8kklk\" (UniqueName: \"kubernetes.io/projected/02c1307a-01b3-41fb-964c-e9e39a209d43-kube-api-access-8kklk\") pod \"kserve-controller-manager-7c99ffcdcd-8fjxd\" (UID: \"02c1307a-01b3-41fb-964c-e9e39a209d43\") " pod="opendatahub/kserve-controller-manager-7c99ffcdcd-8fjxd" Jun 02 21:41:54.705490 ip-10-0-138-193 kubenswrapper[2578]: I0602 21:41:54.705326 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/02c1307a-01b3-41fb-964c-e9e39a209d43-cert\") pod \"kserve-controller-manager-7c99ffcdcd-8fjxd\" (UID: \"02c1307a-01b3-41fb-964c-e9e39a209d43\") " pod="opendatahub/kserve-controller-manager-7c99ffcdcd-8fjxd" Jun 02 21:41:54.806194 ip-10-0-138-193 kubenswrapper[2578]: I0602 21:41:54.806155 2578 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/2faafa98-aeb5-4ddc-af54-52c9d393e96b-cert\") pod \"llmisvc-controller-manager-c6b9847d7-f6h7k\" (UID: \"2faafa98-aeb5-4ddc-af54-52c9d393e96b\") " pod="opendatahub/llmisvc-controller-manager-c6b9847d7-f6h7k" Jun 02 21:41:54.806384 ip-10-0-138-193 kubenswrapper[2578]: I0602 21:41:54.806205 2578 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-8kklk\" (UniqueName: \"kubernetes.io/projected/02c1307a-01b3-41fb-964c-e9e39a209d43-kube-api-access-8kklk\") pod \"kserve-controller-manager-7c99ffcdcd-8fjxd\" (UID: \"02c1307a-01b3-41fb-964c-e9e39a209d43\") " pod="opendatahub/kserve-controller-manager-7c99ffcdcd-8fjxd" Jun 02 21:41:54.806384 ip-10-0-138-193 kubenswrapper[2578]: I0602 21:41:54.806251 2578 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/02c1307a-01b3-41fb-964c-e9e39a209d43-cert\") pod \"kserve-controller-manager-7c99ffcdcd-8fjxd\" (UID: \"02c1307a-01b3-41fb-964c-e9e39a209d43\") " pod="opendatahub/kserve-controller-manager-7c99ffcdcd-8fjxd" Jun 02 21:41:54.806384 ip-10-0-138-193 kubenswrapper[2578]: I0602 21:41:54.806369 2578 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-f55gc\" (UniqueName: \"kubernetes.io/projected/2faafa98-aeb5-4ddc-af54-52c9d393e96b-kube-api-access-f55gc\") pod \"llmisvc-controller-manager-c6b9847d7-f6h7k\" (UID: \"2faafa98-aeb5-4ddc-af54-52c9d393e96b\") " pod="opendatahub/llmisvc-controller-manager-c6b9847d7-f6h7k" Jun 02 21:41:54.806510 ip-10-0-138-193 kubenswrapper[2578]: E0602 21:41:54.806422 2578 secret.go:189] Couldn't get secret opendatahub/kserve-webhook-server-cert: secret "kserve-webhook-server-cert" not found Jun 02 21:41:54.806510 ip-10-0-138-193 kubenswrapper[2578]: E0602 21:41:54.806498 2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/02c1307a-01b3-41fb-964c-e9e39a209d43-cert podName:02c1307a-01b3-41fb-964c-e9e39a209d43 nodeName:}" failed. No retries permitted until 2026-06-02 21:41:55.306473132 +0000 UTC m=+492.558371035 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "cert" (UniqueName: "kubernetes.io/secret/02c1307a-01b3-41fb-964c-e9e39a209d43-cert") pod "kserve-controller-manager-7c99ffcdcd-8fjxd" (UID: "02c1307a-01b3-41fb-964c-e9e39a209d43") : secret "kserve-webhook-server-cert" not found Jun 02 21:41:54.808817 ip-10-0-138-193 kubenswrapper[2578]: I0602 21:41:54.808796 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/2faafa98-aeb5-4ddc-af54-52c9d393e96b-cert\") pod \"llmisvc-controller-manager-c6b9847d7-f6h7k\" (UID: \"2faafa98-aeb5-4ddc-af54-52c9d393e96b\") " pod="opendatahub/llmisvc-controller-manager-c6b9847d7-f6h7k" Jun 02 21:41:54.830584 ip-10-0-138-193 kubenswrapper[2578]: I0602 21:41:54.823748 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-8kklk\" (UniqueName: \"kubernetes.io/projected/02c1307a-01b3-41fb-964c-e9e39a209d43-kube-api-access-8kklk\") pod \"kserve-controller-manager-7c99ffcdcd-8fjxd\" (UID: \"02c1307a-01b3-41fb-964c-e9e39a209d43\") " pod="opendatahub/kserve-controller-manager-7c99ffcdcd-8fjxd" Jun 02 21:41:54.830584 ip-10-0-138-193 kubenswrapper[2578]: I0602 21:41:54.823976 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-f55gc\" (UniqueName: \"kubernetes.io/projected/2faafa98-aeb5-4ddc-af54-52c9d393e96b-kube-api-access-f55gc\") pod \"llmisvc-controller-manager-c6b9847d7-f6h7k\" (UID: \"2faafa98-aeb5-4ddc-af54-52c9d393e96b\") " pod="opendatahub/llmisvc-controller-manager-c6b9847d7-f6h7k" Jun 02 21:41:54.946643 ip-10-0-138-193 kubenswrapper[2578]: I0602 21:41:54.946592 2578 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/llmisvc-controller-manager-c6b9847d7-f6h7k" Jun 02 21:41:55.087100 ip-10-0-138-193 kubenswrapper[2578]: I0602 21:41:55.087056 2578 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["opendatahub/llmisvc-controller-manager-c6b9847d7-f6h7k"] Jun 02 21:41:55.089064 ip-10-0-138-193 kubenswrapper[2578]: W0602 21:41:55.089033 2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-pod2faafa98_aeb5_4ddc_af54_52c9d393e96b.slice/crio-ffb6e4d33fa952d179bf171ed31cd88400c082bf493636d156ac50cac826d60d WatchSource:0}: Error finding container ffb6e4d33fa952d179bf171ed31cd88400c082bf493636d156ac50cac826d60d: Status 404 returned error can't find the container with id ffb6e4d33fa952d179bf171ed31cd88400c082bf493636d156ac50cac826d60d Jun 02 21:41:55.113529 ip-10-0-138-193 kubenswrapper[2578]: I0602 21:41:55.113487 2578 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="opendatahub/llmisvc-controller-manager-c6b9847d7-f6h7k" event={"ID":"2faafa98-aeb5-4ddc-af54-52c9d393e96b","Type":"ContainerStarted","Data":"ffb6e4d33fa952d179bf171ed31cd88400c082bf493636d156ac50cac826d60d"} Jun 02 21:41:55.311527 ip-10-0-138-193 kubenswrapper[2578]: I0602 21:41:55.311433 2578 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/02c1307a-01b3-41fb-964c-e9e39a209d43-cert\") pod \"kserve-controller-manager-7c99ffcdcd-8fjxd\" (UID: \"02c1307a-01b3-41fb-964c-e9e39a209d43\") " pod="opendatahub/kserve-controller-manager-7c99ffcdcd-8fjxd" Jun 02 21:41:55.314064 ip-10-0-138-193 kubenswrapper[2578]: I0602 21:41:55.314040 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/02c1307a-01b3-41fb-964c-e9e39a209d43-cert\") pod \"kserve-controller-manager-7c99ffcdcd-8fjxd\" (UID: \"02c1307a-01b3-41fb-964c-e9e39a209d43\") " pod="opendatahub/kserve-controller-manager-7c99ffcdcd-8fjxd" Jun 02 21:41:55.527096 ip-10-0-138-193 kubenswrapper[2578]: I0602 21:41:55.527053 2578 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/kserve-controller-manager-7c99ffcdcd-8fjxd" Jun 02 21:41:55.682748 ip-10-0-138-193 kubenswrapper[2578]: I0602 21:41:55.682706 2578 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["opendatahub/kserve-controller-manager-7c99ffcdcd-8fjxd"] Jun 02 21:41:55.685827 ip-10-0-138-193 kubenswrapper[2578]: W0602 21:41:55.685795 2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod02c1307a_01b3_41fb_964c_e9e39a209d43.slice/crio-58c6946601e088f898795d927bdbf3fe27cb83ffc4e11c43c29ee9db0b699746 WatchSource:0}: Error finding container 58c6946601e088f898795d927bdbf3fe27cb83ffc4e11c43c29ee9db0b699746: Status 404 returned error can't find the container with id 58c6946601e088f898795d927bdbf3fe27cb83ffc4e11c43c29ee9db0b699746 Jun 02 21:41:56.119248 ip-10-0-138-193 kubenswrapper[2578]: I0602 21:41:56.119205 2578 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="opendatahub/kserve-controller-manager-7c99ffcdcd-8fjxd" event={"ID":"02c1307a-01b3-41fb-964c-e9e39a209d43","Type":"ContainerStarted","Data":"58c6946601e088f898795d927bdbf3fe27cb83ffc4e11c43c29ee9db0b699746"} Jun 02 21:41:59.135047 ip-10-0-138-193 kubenswrapper[2578]: I0602 21:41:59.135013 2578 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="opendatahub/llmisvc-controller-manager-c6b9847d7-f6h7k" event={"ID":"2faafa98-aeb5-4ddc-af54-52c9d393e96b","Type":"ContainerStarted","Data":"d61acbfb4f663765b1bfb7ec8c104f620e15d67c08b9805d864b2b505a040aa9"} Jun 02 21:41:59.135466 ip-10-0-138-193 kubenswrapper[2578]: I0602 21:41:59.135101 2578 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/llmisvc-controller-manager-c6b9847d7-f6h7k" Jun 02 21:41:59.157731 ip-10-0-138-193 kubenswrapper[2578]: I0602 21:41:59.157067 2578 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="opendatahub/llmisvc-controller-manager-c6b9847d7-f6h7k" podStartSLOduration=1.280653297 podStartE2EDuration="5.157048517s" podCreationTimestamp="2026-06-02 21:41:54 +0000 UTC" firstStartedPulling="2026-06-02 21:41:55.090486348 +0000 UTC m=+492.342384232" lastFinishedPulling="2026-06-02 21:41:58.966881564 +0000 UTC m=+496.218779452" observedRunningTime="2026-06-02 21:41:59.151217135 +0000 UTC m=+496.403115045" watchObservedRunningTime="2026-06-02 21:41:59.157048517 +0000 UTC m=+496.408946425" Jun 02 21:42:00.140549 ip-10-0-138-193 kubenswrapper[2578]: I0602 21:42:00.140511 2578 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="opendatahub/kserve-controller-manager-7c99ffcdcd-8fjxd" event={"ID":"02c1307a-01b3-41fb-964c-e9e39a209d43","Type":"ContainerStarted","Data":"d7bf1409edacb0fce1444d0c3b6d6817cbf7960a41f58dac4ceec56e18891d0a"} Jun 02 21:42:00.141250 ip-10-0-138-193 kubenswrapper[2578]: I0602 21:42:00.140590 2578 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/kserve-controller-manager-7c99ffcdcd-8fjxd" Jun 02 21:42:00.199953 ip-10-0-138-193 kubenswrapper[2578]: I0602 21:42:00.199895 2578 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="opendatahub/kserve-controller-manager-7c99ffcdcd-8fjxd" podStartSLOduration=2.580270328 podStartE2EDuration="6.199881111s" podCreationTimestamp="2026-06-02 21:41:54 +0000 UTC" firstStartedPulling="2026-06-02 21:41:55.68800558 +0000 UTC m=+492.939903464" lastFinishedPulling="2026-06-02 21:41:59.307616364 +0000 UTC m=+496.559514247" observedRunningTime="2026-06-02 21:42:00.196795662 +0000 UTC m=+497.448693567" watchObservedRunningTime="2026-06-02 21:42:00.199881111 +0000 UTC m=+497.451779017" Jun 02 21:42:00.982867 ip-10-0-138-193 kubenswrapper[2578]: I0602 21:42:00.982815 2578 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-marketplace/c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762ap9k9q"] Jun 02 21:42:00.986452 ip-10-0-138-193 kubenswrapper[2578]: I0602 21:42:00.986427 2578 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762ap9k9q" Jun 02 21:42:00.990170 ip-10-0-138-193 kubenswrapper[2578]: I0602 21:42:00.990145 2578 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"openshift-service-ca.crt\"" Jun 02 21:42:00.990528 ip-10-0-138-193 kubenswrapper[2578]: I0602 21:42:00.990204 2578 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"kube-root-ca.crt\"" Jun 02 21:42:00.991172 ip-10-0-138-193 kubenswrapper[2578]: I0602 21:42:00.991149 2578 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-marketplace\"/\"default-dockercfg-hfgcz\"" Jun 02 21:42:00.999687 ip-10-0-138-193 kubenswrapper[2578]: I0602 21:42:00.999663 2578 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762ap9k9q"] Jun 02 21:42:01.071004 ip-10-0-138-193 kubenswrapper[2578]: I0602 21:42:01.070966 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/246971a8-3750-486b-8ba9-54b24ae1c76e-util\") pod \"c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762ap9k9q\" (UID: \"246971a8-3750-486b-8ba9-54b24ae1c76e\") " pod="openshift-marketplace/c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762ap9k9q" Jun 02 21:42:01.071197 ip-10-0-138-193 kubenswrapper[2578]: I0602 21:42:01.071128 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-4tg22\" (UniqueName: \"kubernetes.io/projected/246971a8-3750-486b-8ba9-54b24ae1c76e-kube-api-access-4tg22\") pod \"c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762ap9k9q\" (UID: \"246971a8-3750-486b-8ba9-54b24ae1c76e\") " pod="openshift-marketplace/c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762ap9k9q" Jun 02 21:42:01.071197 ip-10-0-138-193 kubenswrapper[2578]: I0602 21:42:01.071157 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/246971a8-3750-486b-8ba9-54b24ae1c76e-bundle\") pod \"c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762ap9k9q\" (UID: \"246971a8-3750-486b-8ba9-54b24ae1c76e\") " pod="openshift-marketplace/c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762ap9k9q" Jun 02 21:42:01.099572 ip-10-0-138-193 kubenswrapper[2578]: I0602 21:42:01.099545 2578 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/model-serving-api-6577596cd5-qrtph" Jun 02 21:42:01.171690 ip-10-0-138-193 kubenswrapper[2578]: I0602 21:42:01.171652 2578 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-4tg22\" (UniqueName: \"kubernetes.io/projected/246971a8-3750-486b-8ba9-54b24ae1c76e-kube-api-access-4tg22\") pod \"c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762ap9k9q\" (UID: \"246971a8-3750-486b-8ba9-54b24ae1c76e\") " pod="openshift-marketplace/c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762ap9k9q" Jun 02 21:42:01.172088 ip-10-0-138-193 kubenswrapper[2578]: I0602 21:42:01.171702 2578 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/246971a8-3750-486b-8ba9-54b24ae1c76e-bundle\") pod \"c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762ap9k9q\" (UID: \"246971a8-3750-486b-8ba9-54b24ae1c76e\") " pod="openshift-marketplace/c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762ap9k9q" Jun 02 21:42:01.172088 ip-10-0-138-193 kubenswrapper[2578]: I0602 21:42:01.171752 2578 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/246971a8-3750-486b-8ba9-54b24ae1c76e-util\") pod \"c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762ap9k9q\" (UID: \"246971a8-3750-486b-8ba9-54b24ae1c76e\") " pod="openshift-marketplace/c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762ap9k9q" Jun 02 21:42:01.172189 ip-10-0-138-193 kubenswrapper[2578]: I0602 21:42:01.172106 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/246971a8-3750-486b-8ba9-54b24ae1c76e-bundle\") pod \"c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762ap9k9q\" (UID: \"246971a8-3750-486b-8ba9-54b24ae1c76e\") " pod="openshift-marketplace/c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762ap9k9q" Jun 02 21:42:01.172189 ip-10-0-138-193 kubenswrapper[2578]: I0602 21:42:01.172160 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/246971a8-3750-486b-8ba9-54b24ae1c76e-util\") pod \"c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762ap9k9q\" (UID: \"246971a8-3750-486b-8ba9-54b24ae1c76e\") " pod="openshift-marketplace/c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762ap9k9q" Jun 02 21:42:01.182545 ip-10-0-138-193 kubenswrapper[2578]: I0602 21:42:01.182521 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-4tg22\" (UniqueName: \"kubernetes.io/projected/246971a8-3750-486b-8ba9-54b24ae1c76e-kube-api-access-4tg22\") pod \"c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762ap9k9q\" (UID: \"246971a8-3750-486b-8ba9-54b24ae1c76e\") " pod="openshift-marketplace/c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762ap9k9q" Jun 02 21:42:01.299476 ip-10-0-138-193 kubenswrapper[2578]: I0602 21:42:01.299389 2578 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762ap9k9q" Jun 02 21:42:01.466164 ip-10-0-138-193 kubenswrapper[2578]: I0602 21:42:01.466131 2578 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762ap9k9q"] Jun 02 21:42:01.466772 ip-10-0-138-193 kubenswrapper[2578]: W0602 21:42:01.466748 2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod246971a8_3750_486b_8ba9_54b24ae1c76e.slice/crio-43a902702453286059d51694211cc719735f9f8b81cbee3e4c617e01df4edb84 WatchSource:0}: Error finding container 43a902702453286059d51694211cc719735f9f8b81cbee3e4c617e01df4edb84: Status 404 returned error can't find the container with id 43a902702453286059d51694211cc719735f9f8b81cbee3e4c617e01df4edb84 Jun 02 21:42:02.138065 ip-10-0-138-193 kubenswrapper[2578]: I0602 21:42:02.138024 2578 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-operators/servicemesh-operator3-55f49c5f94-s9qqj"] Jun 02 21:42:02.140865 ip-10-0-138-193 kubenswrapper[2578]: I0602 21:42:02.140836 2578 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-operators/servicemesh-operator3-55f49c5f94-s9qqj" Jun 02 21:42:02.143167 ip-10-0-138-193 kubenswrapper[2578]: I0602 21:42:02.143145 2578 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-operators\"/\"kube-root-ca.crt\"" Jun 02 21:42:02.143290 ip-10-0-138-193 kubenswrapper[2578]: I0602 21:42:02.143225 2578 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-operators\"/\"servicemesh-operator3-dockercfg-v9xz8\"" Jun 02 21:42:02.143425 ip-10-0-138-193 kubenswrapper[2578]: I0602 21:42:02.143407 2578 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-operators\"/\"openshift-service-ca.crt\"" Jun 02 21:42:02.149659 ip-10-0-138-193 kubenswrapper[2578]: I0602 21:42:02.149635 2578 generic.go:358] "Generic (PLEG): container finished" podID="246971a8-3750-486b-8ba9-54b24ae1c76e" containerID="7a3ac4fa8299e63f82a63f710b89e02e85f1824074aa3ea8f8cb135e68c80572" exitCode=0 Jun 02 21:42:02.149808 ip-10-0-138-193 kubenswrapper[2578]: I0602 21:42:02.149791 2578 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762ap9k9q" event={"ID":"246971a8-3750-486b-8ba9-54b24ae1c76e","Type":"ContainerDied","Data":"7a3ac4fa8299e63f82a63f710b89e02e85f1824074aa3ea8f8cb135e68c80572"} Jun 02 21:42:02.149874 ip-10-0-138-193 kubenswrapper[2578]: I0602 21:42:02.149824 2578 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762ap9k9q" event={"ID":"246971a8-3750-486b-8ba9-54b24ae1c76e","Type":"ContainerStarted","Data":"43a902702453286059d51694211cc719735f9f8b81cbee3e4c617e01df4edb84"} Jun 02 21:42:02.152438 ip-10-0-138-193 kubenswrapper[2578]: I0602 21:42:02.152420 2578 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-operators/servicemesh-operator3-55f49c5f94-s9qqj"] Jun 02 21:42:02.286449 ip-10-0-138-193 kubenswrapper[2578]: I0602 21:42:02.286408 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-kfdsw\" (UniqueName: \"kubernetes.io/projected/0f32ef8b-aa5c-4fa0-b89c-1877e829201d-kube-api-access-kfdsw\") pod \"servicemesh-operator3-55f49c5f94-s9qqj\" (UID: \"0f32ef8b-aa5c-4fa0-b89c-1877e829201d\") " pod="openshift-operators/servicemesh-operator3-55f49c5f94-s9qqj" Jun 02 21:42:02.286826 ip-10-0-138-193 kubenswrapper[2578]: I0602 21:42:02.286466 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"operator-config\" (UniqueName: \"kubernetes.io/downward-api/0f32ef8b-aa5c-4fa0-b89c-1877e829201d-operator-config\") pod \"servicemesh-operator3-55f49c5f94-s9qqj\" (UID: \"0f32ef8b-aa5c-4fa0-b89c-1877e829201d\") " pod="openshift-operators/servicemesh-operator3-55f49c5f94-s9qqj" Jun 02 21:42:02.387335 ip-10-0-138-193 kubenswrapper[2578]: I0602 21:42:02.387299 2578 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-kfdsw\" (UniqueName: \"kubernetes.io/projected/0f32ef8b-aa5c-4fa0-b89c-1877e829201d-kube-api-access-kfdsw\") pod \"servicemesh-operator3-55f49c5f94-s9qqj\" (UID: \"0f32ef8b-aa5c-4fa0-b89c-1877e829201d\") " pod="openshift-operators/servicemesh-operator3-55f49c5f94-s9qqj" Jun 02 21:42:02.387511 ip-10-0-138-193 kubenswrapper[2578]: I0602 21:42:02.387346 2578 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"operator-config\" (UniqueName: \"kubernetes.io/downward-api/0f32ef8b-aa5c-4fa0-b89c-1877e829201d-operator-config\") pod \"servicemesh-operator3-55f49c5f94-s9qqj\" (UID: \"0f32ef8b-aa5c-4fa0-b89c-1877e829201d\") " pod="openshift-operators/servicemesh-operator3-55f49c5f94-s9qqj" Jun 02 21:42:02.389799 ip-10-0-138-193 kubenswrapper[2578]: I0602 21:42:02.389736 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"operator-config\" (UniqueName: \"kubernetes.io/downward-api/0f32ef8b-aa5c-4fa0-b89c-1877e829201d-operator-config\") pod \"servicemesh-operator3-55f49c5f94-s9qqj\" (UID: \"0f32ef8b-aa5c-4fa0-b89c-1877e829201d\") " pod="openshift-operators/servicemesh-operator3-55f49c5f94-s9qqj" Jun 02 21:42:02.405572 ip-10-0-138-193 kubenswrapper[2578]: I0602 21:42:02.405548 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-kfdsw\" (UniqueName: \"kubernetes.io/projected/0f32ef8b-aa5c-4fa0-b89c-1877e829201d-kube-api-access-kfdsw\") pod \"servicemesh-operator3-55f49c5f94-s9qqj\" (UID: \"0f32ef8b-aa5c-4fa0-b89c-1877e829201d\") " pod="openshift-operators/servicemesh-operator3-55f49c5f94-s9qqj" Jun 02 21:42:02.451299 ip-10-0-138-193 kubenswrapper[2578]: I0602 21:42:02.451266 2578 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-operators/servicemesh-operator3-55f49c5f94-s9qqj" Jun 02 21:42:02.590491 ip-10-0-138-193 kubenswrapper[2578]: I0602 21:42:02.590461 2578 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-operators/servicemesh-operator3-55f49c5f94-s9qqj"] Jun 02 21:42:02.592221 ip-10-0-138-193 kubenswrapper[2578]: W0602 21:42:02.592190 2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod0f32ef8b_aa5c_4fa0_b89c_1877e829201d.slice/crio-45c1396391f87fb5474f5e44a1fe55208d5da6f6d7df9bab881712dac533dcca WatchSource:0}: Error finding container 45c1396391f87fb5474f5e44a1fe55208d5da6f6d7df9bab881712dac533dcca: Status 404 returned error can't find the container with id 45c1396391f87fb5474f5e44a1fe55208d5da6f6d7df9bab881712dac533dcca Jun 02 21:42:03.162174 ip-10-0-138-193 kubenswrapper[2578]: I0602 21:42:03.162137 2578 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-operators/servicemesh-operator3-55f49c5f94-s9qqj" event={"ID":"0f32ef8b-aa5c-4fa0-b89c-1877e829201d","Type":"ContainerStarted","Data":"45c1396391f87fb5474f5e44a1fe55208d5da6f6d7df9bab881712dac533dcca"} Jun 02 21:42:04.168706 ip-10-0-138-193 kubenswrapper[2578]: I0602 21:42:04.168675 2578 generic.go:358] "Generic (PLEG): container finished" podID="246971a8-3750-486b-8ba9-54b24ae1c76e" containerID="f33869b4b79afd5b32787d97d51ae81d28a384287f88d07e7d061d9455f233dd" exitCode=0 Jun 02 21:42:04.169246 ip-10-0-138-193 kubenswrapper[2578]: I0602 21:42:04.168744 2578 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762ap9k9q" event={"ID":"246971a8-3750-486b-8ba9-54b24ae1c76e","Type":"ContainerDied","Data":"f33869b4b79afd5b32787d97d51ae81d28a384287f88d07e7d061d9455f233dd"} Jun 02 21:42:06.180530 ip-10-0-138-193 kubenswrapper[2578]: I0602 21:42:06.180492 2578 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-operators/servicemesh-operator3-55f49c5f94-s9qqj" event={"ID":"0f32ef8b-aa5c-4fa0-b89c-1877e829201d","Type":"ContainerStarted","Data":"564893e3a84a233df52569c351b2713ebd904d26c18e198bfb5b35f73011cd99"} Jun 02 21:42:06.180967 ip-10-0-138-193 kubenswrapper[2578]: I0602 21:42:06.180567 2578 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-operators/servicemesh-operator3-55f49c5f94-s9qqj" Jun 02 21:42:06.182335 ip-10-0-138-193 kubenswrapper[2578]: I0602 21:42:06.182305 2578 generic.go:358] "Generic (PLEG): container finished" podID="246971a8-3750-486b-8ba9-54b24ae1c76e" containerID="2cb8e2f304bfed103fbe4d5eed584984b0672dc15edf4a98530cc3ca9f2289ed" exitCode=0 Jun 02 21:42:06.182448 ip-10-0-138-193 kubenswrapper[2578]: I0602 21:42:06.182382 2578 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762ap9k9q" event={"ID":"246971a8-3750-486b-8ba9-54b24ae1c76e","Type":"ContainerDied","Data":"2cb8e2f304bfed103fbe4d5eed584984b0672dc15edf4a98530cc3ca9f2289ed"} Jun 02 21:42:06.199303 ip-10-0-138-193 kubenswrapper[2578]: I0602 21:42:06.199262 2578 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-operators/servicemesh-operator3-55f49c5f94-s9qqj" podStartSLOduration=1.642355302 podStartE2EDuration="4.199247033s" podCreationTimestamp="2026-06-02 21:42:02 +0000 UTC" firstStartedPulling="2026-06-02 21:42:02.59471663 +0000 UTC m=+499.846614514" lastFinishedPulling="2026-06-02 21:42:05.151608358 +0000 UTC m=+502.403506245" observedRunningTime="2026-06-02 21:42:06.198069956 +0000 UTC m=+503.449967861" watchObservedRunningTime="2026-06-02 21:42:06.199247033 +0000 UTC m=+503.451144938" Jun 02 21:42:07.328674 ip-10-0-138-193 kubenswrapper[2578]: I0602 21:42:07.328647 2578 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762ap9k9q" Jun 02 21:42:07.434251 ip-10-0-138-193 kubenswrapper[2578]: I0602 21:42:07.434219 2578 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/246971a8-3750-486b-8ba9-54b24ae1c76e-util\") pod \"246971a8-3750-486b-8ba9-54b24ae1c76e\" (UID: \"246971a8-3750-486b-8ba9-54b24ae1c76e\") " Jun 02 21:42:07.434424 ip-10-0-138-193 kubenswrapper[2578]: I0602 21:42:07.434260 2578 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/246971a8-3750-486b-8ba9-54b24ae1c76e-bundle\") pod \"246971a8-3750-486b-8ba9-54b24ae1c76e\" (UID: \"246971a8-3750-486b-8ba9-54b24ae1c76e\") " Jun 02 21:42:07.434424 ip-10-0-138-193 kubenswrapper[2578]: I0602 21:42:07.434289 2578 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-4tg22\" (UniqueName: \"kubernetes.io/projected/246971a8-3750-486b-8ba9-54b24ae1c76e-kube-api-access-4tg22\") pod \"246971a8-3750-486b-8ba9-54b24ae1c76e\" (UID: \"246971a8-3750-486b-8ba9-54b24ae1c76e\") " Jun 02 21:42:07.435406 ip-10-0-138-193 kubenswrapper[2578]: I0602 21:42:07.435372 2578 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/246971a8-3750-486b-8ba9-54b24ae1c76e-bundle" (OuterVolumeSpecName: "bundle") pod "246971a8-3750-486b-8ba9-54b24ae1c76e" (UID: "246971a8-3750-486b-8ba9-54b24ae1c76e"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jun 02 21:42:07.436630 ip-10-0-138-193 kubenswrapper[2578]: I0602 21:42:07.436599 2578 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/246971a8-3750-486b-8ba9-54b24ae1c76e-kube-api-access-4tg22" (OuterVolumeSpecName: "kube-api-access-4tg22") pod "246971a8-3750-486b-8ba9-54b24ae1c76e" (UID: "246971a8-3750-486b-8ba9-54b24ae1c76e"). InnerVolumeSpecName "kube-api-access-4tg22". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 02 21:42:07.438650 ip-10-0-138-193 kubenswrapper[2578]: I0602 21:42:07.438607 2578 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/246971a8-3750-486b-8ba9-54b24ae1c76e-util" (OuterVolumeSpecName: "util") pod "246971a8-3750-486b-8ba9-54b24ae1c76e" (UID: "246971a8-3750-486b-8ba9-54b24ae1c76e"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jun 02 21:42:07.536180 ip-10-0-138-193 kubenswrapper[2578]: I0602 21:42:07.536137 2578 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/246971a8-3750-486b-8ba9-54b24ae1c76e-util\") on node \"ip-10-0-138-193.ec2.internal\" DevicePath \"\"" Jun 02 21:42:07.536180 ip-10-0-138-193 kubenswrapper[2578]: I0602 21:42:07.536172 2578 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/246971a8-3750-486b-8ba9-54b24ae1c76e-bundle\") on node \"ip-10-0-138-193.ec2.internal\" DevicePath \"\"" Jun 02 21:42:07.536180 ip-10-0-138-193 kubenswrapper[2578]: I0602 21:42:07.536186 2578 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-4tg22\" (UniqueName: \"kubernetes.io/projected/246971a8-3750-486b-8ba9-54b24ae1c76e-kube-api-access-4tg22\") on node \"ip-10-0-138-193.ec2.internal\" DevicePath \"\"" Jun 02 21:42:08.192480 ip-10-0-138-193 kubenswrapper[2578]: I0602 21:42:08.192444 2578 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762ap9k9q" event={"ID":"246971a8-3750-486b-8ba9-54b24ae1c76e","Type":"ContainerDied","Data":"43a902702453286059d51694211cc719735f9f8b81cbee3e4c617e01df4edb84"} Jun 02 21:42:08.192480 ip-10-0-138-193 kubenswrapper[2578]: I0602 21:42:08.192480 2578 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="43a902702453286059d51694211cc719735f9f8b81cbee3e4c617e01df4edb84" Jun 02 21:42:08.192733 ip-10-0-138-193 kubenswrapper[2578]: I0602 21:42:08.192478 2578 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762ap9k9q" Jun 02 21:42:12.642588 ip-10-0-138-193 kubenswrapper[2578]: I0602 21:42:12.642552 2578 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-ingress/istiod-openshift-gateway-798958bb55-t8q5x"] Jun 02 21:42:12.642956 ip-10-0-138-193 kubenswrapper[2578]: I0602 21:42:12.642917 2578 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="246971a8-3750-486b-8ba9-54b24ae1c76e" containerName="pull" Jun 02 21:42:12.642956 ip-10-0-138-193 kubenswrapper[2578]: I0602 21:42:12.642928 2578 state_mem.go:107] "Deleted CPUSet assignment" podUID="246971a8-3750-486b-8ba9-54b24ae1c76e" containerName="pull" Jun 02 21:42:12.642956 ip-10-0-138-193 kubenswrapper[2578]: I0602 21:42:12.642935 2578 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="246971a8-3750-486b-8ba9-54b24ae1c76e" containerName="util" Jun 02 21:42:12.642956 ip-10-0-138-193 kubenswrapper[2578]: I0602 21:42:12.642941 2578 state_mem.go:107] "Deleted CPUSet assignment" podUID="246971a8-3750-486b-8ba9-54b24ae1c76e" containerName="util" Jun 02 21:42:12.642956 ip-10-0-138-193 kubenswrapper[2578]: I0602 21:42:12.642947 2578 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="246971a8-3750-486b-8ba9-54b24ae1c76e" containerName="extract" Jun 02 21:42:12.642956 ip-10-0-138-193 kubenswrapper[2578]: I0602 21:42:12.642953 2578 state_mem.go:107] "Deleted CPUSet assignment" podUID="246971a8-3750-486b-8ba9-54b24ae1c76e" containerName="extract" Jun 02 21:42:12.643177 ip-10-0-138-193 kubenswrapper[2578]: I0602 21:42:12.643009 2578 memory_manager.go:356] "RemoveStaleState removing state" podUID="246971a8-3750-486b-8ba9-54b24ae1c76e" containerName="extract" Jun 02 21:42:12.648295 ip-10-0-138-193 kubenswrapper[2578]: I0602 21:42:12.648276 2578 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/istiod-openshift-gateway-798958bb55-t8q5x" Jun 02 21:42:12.650750 ip-10-0-138-193 kubenswrapper[2578]: I0602 21:42:12.650728 2578 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"istiod-tls\"" Jun 02 21:42:12.650866 ip-10-0-138-193 kubenswrapper[2578]: I0602 21:42:12.650757 2578 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"cacerts\"" Jun 02 21:42:12.650866 ip-10-0-138-193 kubenswrapper[2578]: I0602 21:42:12.650757 2578 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"openshift-gw-ca-root-cert\"" Jun 02 21:42:12.650866 ip-10-0-138-193 kubenswrapper[2578]: I0602 21:42:12.650824 2578 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"istiod-openshift-gateway-dockercfg-v6w7x\"" Jun 02 21:42:12.650866 ip-10-0-138-193 kubenswrapper[2578]: I0602 21:42:12.650728 2578 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"istio-kubeconfig\"" Jun 02 21:42:12.657245 ip-10-0-138-193 kubenswrapper[2578]: I0602 21:42:12.657224 2578 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/istiod-openshift-gateway-798958bb55-t8q5x"] Jun 02 21:42:12.788352 ip-10-0-138-193 kubenswrapper[2578]: I0602 21:42:12.788315 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cacerts\" (UniqueName: \"kubernetes.io/secret/33520bf2-da60-4111-b419-432d4d73a0fd-cacerts\") pod \"istiod-openshift-gateway-798958bb55-t8q5x\" (UID: \"33520bf2-da60-4111-b419-432d4d73a0fd\") " pod="openshift-ingress/istiod-openshift-gateway-798958bb55-t8q5x" Jun 02 21:42:12.788352 ip-10-0-138-193 kubenswrapper[2578]: I0602 21:42:12.788354 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-kubeconfig\" (UniqueName: \"kubernetes.io/secret/33520bf2-da60-4111-b419-432d4d73a0fd-istio-kubeconfig\") pod \"istiod-openshift-gateway-798958bb55-t8q5x\" (UID: \"33520bf2-da60-4111-b419-432d4d73a0fd\") " pod="openshift-ingress/istiod-openshift-gateway-798958bb55-t8q5x" Jun 02 21:42:12.788631 ip-10-0-138-193 kubenswrapper[2578]: I0602 21:42:12.788392 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/33520bf2-da60-4111-b419-432d4d73a0fd-istio-token\") pod \"istiod-openshift-gateway-798958bb55-t8q5x\" (UID: \"33520bf2-da60-4111-b419-432d4d73a0fd\") " pod="openshift-ingress/istiod-openshift-gateway-798958bb55-t8q5x" Jun 02 21:42:12.788631 ip-10-0-138-193 kubenswrapper[2578]: I0602 21:42:12.788416 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-csr-ca-configmap\" (UniqueName: \"kubernetes.io/configmap/33520bf2-da60-4111-b419-432d4d73a0fd-istio-csr-ca-configmap\") pod \"istiod-openshift-gateway-798958bb55-t8q5x\" (UID: \"33520bf2-da60-4111-b419-432d4d73a0fd\") " pod="openshift-ingress/istiod-openshift-gateway-798958bb55-t8q5x" Jun 02 21:42:12.788631 ip-10-0-138-193 kubenswrapper[2578]: I0602 21:42:12.788439 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-csr-dns-cert\" (UniqueName: \"kubernetes.io/secret/33520bf2-da60-4111-b419-432d4d73a0fd-istio-csr-dns-cert\") pod \"istiod-openshift-gateway-798958bb55-t8q5x\" (UID: \"33520bf2-da60-4111-b419-432d4d73a0fd\") " pod="openshift-ingress/istiod-openshift-gateway-798958bb55-t8q5x" Jun 02 21:42:12.788631 ip-10-0-138-193 kubenswrapper[2578]: I0602 21:42:12.788548 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"local-certs\" (UniqueName: \"kubernetes.io/empty-dir/33520bf2-da60-4111-b419-432d4d73a0fd-local-certs\") pod \"istiod-openshift-gateway-798958bb55-t8q5x\" (UID: \"33520bf2-da60-4111-b419-432d4d73a0fd\") " pod="openshift-ingress/istiod-openshift-gateway-798958bb55-t8q5x" Jun 02 21:42:12.788631 ip-10-0-138-193 kubenswrapper[2578]: I0602 21:42:12.788617 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-j6sc8\" (UniqueName: \"kubernetes.io/projected/33520bf2-da60-4111-b419-432d4d73a0fd-kube-api-access-j6sc8\") pod \"istiod-openshift-gateway-798958bb55-t8q5x\" (UID: \"33520bf2-da60-4111-b419-432d4d73a0fd\") " pod="openshift-ingress/istiod-openshift-gateway-798958bb55-t8q5x" Jun 02 21:42:12.890561 ip-10-0-138-193 kubenswrapper[2578]: I0602 21:42:12.889760 2578 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-j6sc8\" (UniqueName: \"kubernetes.io/projected/33520bf2-da60-4111-b419-432d4d73a0fd-kube-api-access-j6sc8\") pod \"istiod-openshift-gateway-798958bb55-t8q5x\" (UID: \"33520bf2-da60-4111-b419-432d4d73a0fd\") " pod="openshift-ingress/istiod-openshift-gateway-798958bb55-t8q5x" Jun 02 21:42:12.890561 ip-10-0-138-193 kubenswrapper[2578]: I0602 21:42:12.889830 2578 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cacerts\" (UniqueName: \"kubernetes.io/secret/33520bf2-da60-4111-b419-432d4d73a0fd-cacerts\") pod \"istiod-openshift-gateway-798958bb55-t8q5x\" (UID: \"33520bf2-da60-4111-b419-432d4d73a0fd\") " pod="openshift-ingress/istiod-openshift-gateway-798958bb55-t8q5x" Jun 02 21:42:12.890561 ip-10-0-138-193 kubenswrapper[2578]: I0602 21:42:12.889855 2578 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"istio-kubeconfig\" (UniqueName: \"kubernetes.io/secret/33520bf2-da60-4111-b419-432d4d73a0fd-istio-kubeconfig\") pod \"istiod-openshift-gateway-798958bb55-t8q5x\" (UID: \"33520bf2-da60-4111-b419-432d4d73a0fd\") " pod="openshift-ingress/istiod-openshift-gateway-798958bb55-t8q5x" Jun 02 21:42:12.890561 ip-10-0-138-193 kubenswrapper[2578]: I0602 21:42:12.889888 2578 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/33520bf2-da60-4111-b419-432d4d73a0fd-istio-token\") pod \"istiod-openshift-gateway-798958bb55-t8q5x\" (UID: \"33520bf2-da60-4111-b419-432d4d73a0fd\") " pod="openshift-ingress/istiod-openshift-gateway-798958bb55-t8q5x" Jun 02 21:42:12.890561 ip-10-0-138-193 kubenswrapper[2578]: I0602 21:42:12.889912 2578 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"istio-csr-ca-configmap\" (UniqueName: \"kubernetes.io/configmap/33520bf2-da60-4111-b419-432d4d73a0fd-istio-csr-ca-configmap\") pod \"istiod-openshift-gateway-798958bb55-t8q5x\" (UID: \"33520bf2-da60-4111-b419-432d4d73a0fd\") " pod="openshift-ingress/istiod-openshift-gateway-798958bb55-t8q5x" Jun 02 21:42:12.890561 ip-10-0-138-193 kubenswrapper[2578]: I0602 21:42:12.889940 2578 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"istio-csr-dns-cert\" (UniqueName: \"kubernetes.io/secret/33520bf2-da60-4111-b419-432d4d73a0fd-istio-csr-dns-cert\") pod \"istiod-openshift-gateway-798958bb55-t8q5x\" (UID: \"33520bf2-da60-4111-b419-432d4d73a0fd\") " pod="openshift-ingress/istiod-openshift-gateway-798958bb55-t8q5x" Jun 02 21:42:12.890561 ip-10-0-138-193 kubenswrapper[2578]: I0602 21:42:12.890022 2578 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"local-certs\" (UniqueName: \"kubernetes.io/empty-dir/33520bf2-da60-4111-b419-432d4d73a0fd-local-certs\") pod \"istiod-openshift-gateway-798958bb55-t8q5x\" (UID: \"33520bf2-da60-4111-b419-432d4d73a0fd\") " pod="openshift-ingress/istiod-openshift-gateway-798958bb55-t8q5x" Jun 02 21:42:12.891986 ip-10-0-138-193 kubenswrapper[2578]: I0602 21:42:12.891961 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-csr-ca-configmap\" (UniqueName: \"kubernetes.io/configmap/33520bf2-da60-4111-b419-432d4d73a0fd-istio-csr-ca-configmap\") pod \"istiod-openshift-gateway-798958bb55-t8q5x\" (UID: \"33520bf2-da60-4111-b419-432d4d73a0fd\") " pod="openshift-ingress/istiod-openshift-gateway-798958bb55-t8q5x" Jun 02 21:42:12.895880 ip-10-0-138-193 kubenswrapper[2578]: I0602 21:42:12.895784 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"local-certs\" (UniqueName: \"kubernetes.io/empty-dir/33520bf2-da60-4111-b419-432d4d73a0fd-local-certs\") pod \"istiod-openshift-gateway-798958bb55-t8q5x\" (UID: \"33520bf2-da60-4111-b419-432d4d73a0fd\") " pod="openshift-ingress/istiod-openshift-gateway-798958bb55-t8q5x" Jun 02 21:42:12.896220 ip-10-0-138-193 kubenswrapper[2578]: I0602 21:42:12.896195 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-kubeconfig\" (UniqueName: \"kubernetes.io/secret/33520bf2-da60-4111-b419-432d4d73a0fd-istio-kubeconfig\") pod \"istiod-openshift-gateway-798958bb55-t8q5x\" (UID: \"33520bf2-da60-4111-b419-432d4d73a0fd\") " pod="openshift-ingress/istiod-openshift-gateway-798958bb55-t8q5x" Jun 02 21:42:12.896340 ip-10-0-138-193 kubenswrapper[2578]: I0602 21:42:12.896318 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cacerts\" (UniqueName: \"kubernetes.io/secret/33520bf2-da60-4111-b419-432d4d73a0fd-cacerts\") pod \"istiod-openshift-gateway-798958bb55-t8q5x\" (UID: \"33520bf2-da60-4111-b419-432d4d73a0fd\") " pod="openshift-ingress/istiod-openshift-gateway-798958bb55-t8q5x" Jun 02 21:42:12.896627 ip-10-0-138-193 kubenswrapper[2578]: I0602 21:42:12.896608 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-csr-dns-cert\" (UniqueName: \"kubernetes.io/secret/33520bf2-da60-4111-b419-432d4d73a0fd-istio-csr-dns-cert\") pod \"istiod-openshift-gateway-798958bb55-t8q5x\" (UID: \"33520bf2-da60-4111-b419-432d4d73a0fd\") " pod="openshift-ingress/istiod-openshift-gateway-798958bb55-t8q5x" Jun 02 21:42:12.902702 ip-10-0-138-193 kubenswrapper[2578]: I0602 21:42:12.902677 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/33520bf2-da60-4111-b419-432d4d73a0fd-istio-token\") pod \"istiod-openshift-gateway-798958bb55-t8q5x\" (UID: \"33520bf2-da60-4111-b419-432d4d73a0fd\") " pod="openshift-ingress/istiod-openshift-gateway-798958bb55-t8q5x" Jun 02 21:42:12.903137 ip-10-0-138-193 kubenswrapper[2578]: I0602 21:42:12.903068 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-j6sc8\" (UniqueName: \"kubernetes.io/projected/33520bf2-da60-4111-b419-432d4d73a0fd-kube-api-access-j6sc8\") pod \"istiod-openshift-gateway-798958bb55-t8q5x\" (UID: \"33520bf2-da60-4111-b419-432d4d73a0fd\") " pod="openshift-ingress/istiod-openshift-gateway-798958bb55-t8q5x" Jun 02 21:42:12.959089 ip-10-0-138-193 kubenswrapper[2578]: I0602 21:42:12.959046 2578 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/istiod-openshift-gateway-798958bb55-t8q5x" Jun 02 21:42:13.095202 ip-10-0-138-193 kubenswrapper[2578]: I0602 21:42:13.095177 2578 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/istiod-openshift-gateway-798958bb55-t8q5x"] Jun 02 21:42:13.097347 ip-10-0-138-193 kubenswrapper[2578]: W0602 21:42:13.097320 2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod33520bf2_da60_4111_b419_432d4d73a0fd.slice/crio-1ca153fbee20db6c7f6f2c7b27d648f9613c25c15db1f77fc4962e34d728f220 WatchSource:0}: Error finding container 1ca153fbee20db6c7f6f2c7b27d648f9613c25c15db1f77fc4962e34d728f220: Status 404 returned error can't find the container with id 1ca153fbee20db6c7f6f2c7b27d648f9613c25c15db1f77fc4962e34d728f220 Jun 02 21:42:13.212637 ip-10-0-138-193 kubenswrapper[2578]: I0602 21:42:13.212551 2578 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/istiod-openshift-gateway-798958bb55-t8q5x" event={"ID":"33520bf2-da60-4111-b419-432d4d73a0fd","Type":"ContainerStarted","Data":"1ca153fbee20db6c7f6f2c7b27d648f9613c25c15db1f77fc4962e34d728f220"} Jun 02 21:42:15.565145 ip-10-0-138-193 kubenswrapper[2578]: I0602 21:42:15.565098 2578 kubelet_resources.go:45] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236232Ki","pods":"250"} Jun 02 21:42:15.565395 ip-10-0-138-193 kubenswrapper[2578]: I0602 21:42:15.565184 2578 kubelet_resources.go:45] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236232Ki","pods":"250"} Jun 02 21:42:16.228723 ip-10-0-138-193 kubenswrapper[2578]: I0602 21:42:16.228685 2578 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/istiod-openshift-gateway-798958bb55-t8q5x" event={"ID":"33520bf2-da60-4111-b419-432d4d73a0fd","Type":"ContainerStarted","Data":"9aecc4bf5cd190e0ee67a0583afe174491c392f8e11b7b35a768ec52b1adc1aa"} Jun 02 21:42:16.228926 ip-10-0-138-193 kubenswrapper[2578]: I0602 21:42:16.228903 2578 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/istiod-openshift-gateway-798958bb55-t8q5x" Jun 02 21:42:16.230726 ip-10-0-138-193 kubenswrapper[2578]: I0602 21:42:16.230698 2578 patch_prober.go:28] interesting pod/istiod-openshift-gateway-798958bb55-t8q5x container/discovery namespace/openshift-ingress: Readiness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body= Jun 02 21:42:16.230854 ip-10-0-138-193 kubenswrapper[2578]: I0602 21:42:16.230749 2578 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/istiod-openshift-gateway-798958bb55-t8q5x" podUID="33520bf2-da60-4111-b419-432d4d73a0fd" containerName="discovery" probeResult="failure" output="HTTP probe failed with statuscode: 503" Jun 02 21:42:16.247902 ip-10-0-138-193 kubenswrapper[2578]: I0602 21:42:16.247851 2578 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-ingress/istiod-openshift-gateway-798958bb55-t8q5x" podStartSLOduration=1.7827628519999998 podStartE2EDuration="4.247835409s" podCreationTimestamp="2026-06-02 21:42:12 +0000 UTC" firstStartedPulling="2026-06-02 21:42:13.099709019 +0000 UTC m=+510.351606904" lastFinishedPulling="2026-06-02 21:42:15.564781573 +0000 UTC m=+512.816679461" observedRunningTime="2026-06-02 21:42:16.24603639 +0000 UTC m=+513.497934293" watchObservedRunningTime="2026-06-02 21:42:16.247835409 +0000 UTC m=+513.499733316" Jun 02 21:42:17.188716 ip-10-0-138-193 kubenswrapper[2578]: I0602 21:42:17.188683 2578 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-operators/servicemesh-operator3-55f49c5f94-s9qqj" Jun 02 21:42:17.233856 ip-10-0-138-193 kubenswrapper[2578]: I0602 21:42:17.233823 2578 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/istiod-openshift-gateway-798958bb55-t8q5x" Jun 02 21:42:20.114684 ip-10-0-138-193 kubenswrapper[2578]: I0602 21:42:20.114648 2578 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["opendatahub/dashboard-redirect-5465dccb5c-pr685"] Jun 02 21:42:20.119145 ip-10-0-138-193 kubenswrapper[2578]: I0602 21:42:20.119120 2578 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/dashboard-redirect-5465dccb5c-pr685" Jun 02 21:42:20.121555 ip-10-0-138-193 kubenswrapper[2578]: I0602 21:42:20.121532 2578 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"default-dockercfg-rmgsq\"" Jun 02 21:42:20.121668 ip-10-0-138-193 kubenswrapper[2578]: I0602 21:42:20.121647 2578 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"dashboard-redirect-config\"" Jun 02 21:42:20.130611 ip-10-0-138-193 kubenswrapper[2578]: I0602 21:42:20.130589 2578 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["opendatahub/dashboard-redirect-5465dccb5c-pr685"] Jun 02 21:42:20.267674 ip-10-0-138-193 kubenswrapper[2578]: I0602 21:42:20.267644 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"redirect-config\" (UniqueName: \"kubernetes.io/configmap/e16bb753-b4d4-472f-abb1-278f9e7de2d4-redirect-config\") pod \"dashboard-redirect-5465dccb5c-pr685\" (UID: \"e16bb753-b4d4-472f-abb1-278f9e7de2d4\") " pod="opendatahub/dashboard-redirect-5465dccb5c-pr685" Jun 02 21:42:20.267674 ip-10-0-138-193 kubenswrapper[2578]: I0602 21:42:20.267680 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-l64lh\" (UniqueName: \"kubernetes.io/projected/e16bb753-b4d4-472f-abb1-278f9e7de2d4-kube-api-access-l64lh\") pod \"dashboard-redirect-5465dccb5c-pr685\" (UID: \"e16bb753-b4d4-472f-abb1-278f9e7de2d4\") " pod="opendatahub/dashboard-redirect-5465dccb5c-pr685" Jun 02 21:42:20.368380 ip-10-0-138-193 kubenswrapper[2578]: I0602 21:42:20.368289 2578 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"redirect-config\" (UniqueName: \"kubernetes.io/configmap/e16bb753-b4d4-472f-abb1-278f9e7de2d4-redirect-config\") pod \"dashboard-redirect-5465dccb5c-pr685\" (UID: \"e16bb753-b4d4-472f-abb1-278f9e7de2d4\") " pod="opendatahub/dashboard-redirect-5465dccb5c-pr685" Jun 02 21:42:20.368380 ip-10-0-138-193 kubenswrapper[2578]: I0602 21:42:20.368332 2578 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-l64lh\" (UniqueName: \"kubernetes.io/projected/e16bb753-b4d4-472f-abb1-278f9e7de2d4-kube-api-access-l64lh\") pod \"dashboard-redirect-5465dccb5c-pr685\" (UID: \"e16bb753-b4d4-472f-abb1-278f9e7de2d4\") " pod="opendatahub/dashboard-redirect-5465dccb5c-pr685" Jun 02 21:42:20.368985 ip-10-0-138-193 kubenswrapper[2578]: I0602 21:42:20.368963 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"redirect-config\" (UniqueName: \"kubernetes.io/configmap/e16bb753-b4d4-472f-abb1-278f9e7de2d4-redirect-config\") pod \"dashboard-redirect-5465dccb5c-pr685\" (UID: \"e16bb753-b4d4-472f-abb1-278f9e7de2d4\") " pod="opendatahub/dashboard-redirect-5465dccb5c-pr685" Jun 02 21:42:20.377015 ip-10-0-138-193 kubenswrapper[2578]: I0602 21:42:20.376983 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-l64lh\" (UniqueName: \"kubernetes.io/projected/e16bb753-b4d4-472f-abb1-278f9e7de2d4-kube-api-access-l64lh\") pod \"dashboard-redirect-5465dccb5c-pr685\" (UID: \"e16bb753-b4d4-472f-abb1-278f9e7de2d4\") " pod="opendatahub/dashboard-redirect-5465dccb5c-pr685" Jun 02 21:42:20.431411 ip-10-0-138-193 kubenswrapper[2578]: I0602 21:42:20.431378 2578 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/dashboard-redirect-5465dccb5c-pr685" Jun 02 21:42:20.573967 ip-10-0-138-193 kubenswrapper[2578]: I0602 21:42:20.573939 2578 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["opendatahub/dashboard-redirect-5465dccb5c-pr685"] Jun 02 21:42:20.576052 ip-10-0-138-193 kubenswrapper[2578]: W0602 21:42:20.576022 2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pode16bb753_b4d4_472f_abb1_278f9e7de2d4.slice/crio-111fbcc59cefec85e0322f47fef2ab7fafb121f6af9363663c0913dfde518feb WatchSource:0}: Error finding container 111fbcc59cefec85e0322f47fef2ab7fafb121f6af9363663c0913dfde518feb: Status 404 returned error can't find the container with id 111fbcc59cefec85e0322f47fef2ab7fafb121f6af9363663c0913dfde518feb Jun 02 21:42:21.250842 ip-10-0-138-193 kubenswrapper[2578]: I0602 21:42:21.250807 2578 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="opendatahub/dashboard-redirect-5465dccb5c-pr685" event={"ID":"e16bb753-b4d4-472f-abb1-278f9e7de2d4","Type":"ContainerStarted","Data":"111fbcc59cefec85e0322f47fef2ab7fafb121f6af9363663c0913dfde518feb"} Jun 02 21:42:23.260224 ip-10-0-138-193 kubenswrapper[2578]: I0602 21:42:23.260184 2578 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="opendatahub/dashboard-redirect-5465dccb5c-pr685" event={"ID":"e16bb753-b4d4-472f-abb1-278f9e7de2d4","Type":"ContainerStarted","Data":"13c62c98c8a2c64037f353d392a2ec8718af3e22e5496a3891cc2b91283f5212"} Jun 02 21:42:23.275578 ip-10-0-138-193 kubenswrapper[2578]: I0602 21:42:23.275529 2578 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="opendatahub/dashboard-redirect-5465dccb5c-pr685" podStartSLOduration=1.102440416 podStartE2EDuration="3.275514679s" podCreationTimestamp="2026-06-02 21:42:20 +0000 UTC" firstStartedPulling="2026-06-02 21:42:20.577517561 +0000 UTC m=+517.829415445" lastFinishedPulling="2026-06-02 21:42:22.750591821 +0000 UTC m=+520.002489708" observedRunningTime="2026-06-02 21:42:23.273871103 +0000 UTC m=+520.525769009" watchObservedRunningTime="2026-06-02 21:42:23.275514679 +0000 UTC m=+520.527412584" Jun 02 21:42:30.143468 ip-10-0-138-193 kubenswrapper[2578]: I0602 21:42:30.143431 2578 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/llmisvc-controller-manager-c6b9847d7-f6h7k" Jun 02 21:42:31.149519 ip-10-0-138-193 kubenswrapper[2578]: I0602 21:42:31.149489 2578 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/kserve-controller-manager-7c99ffcdcd-8fjxd" Jun 02 21:43:00.749594 ip-10-0-138-193 kubenswrapper[2578]: I0602 21:43:00.749558 2578 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1x5l9t"] Jun 02 21:43:00.760206 ip-10-0-138-193 kubenswrapper[2578]: I0602 21:43:00.760177 2578 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1x5l9t"] Jun 02 21:43:00.760383 ip-10-0-138-193 kubenswrapper[2578]: I0602 21:43:00.760309 2578 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1x5l9t" Jun 02 21:43:00.762906 ip-10-0-138-193 kubenswrapper[2578]: I0602 21:43:00.762879 2578 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"default-dockercfg-2ng5x\"" Jun 02 21:43:00.763033 ip-10-0-138-193 kubenswrapper[2578]: I0602 21:43:00.762933 2578 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"kube-root-ca.crt\"" Jun 02 21:43:00.763752 ip-10-0-138-193 kubenswrapper[2578]: I0602 21:43:00.763730 2578 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"openshift-service-ca.crt\"" Jun 02 21:43:00.929195 ip-10-0-138-193 kubenswrapper[2578]: I0602 21:43:00.929157 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/f44c4e83-da4f-4bbb-9718-c91b64f402e0-bundle\") pod \"9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1x5l9t\" (UID: \"f44c4e83-da4f-4bbb-9718-c91b64f402e0\") " pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1x5l9t" Jun 02 21:43:00.929195 ip-10-0-138-193 kubenswrapper[2578]: I0602 21:43:00.929199 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/f44c4e83-da4f-4bbb-9718-c91b64f402e0-util\") pod \"9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1x5l9t\" (UID: \"f44c4e83-da4f-4bbb-9718-c91b64f402e0\") " pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1x5l9t" Jun 02 21:43:00.929431 ip-10-0-138-193 kubenswrapper[2578]: I0602 21:43:00.929239 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-hx4rz\" (UniqueName: \"kubernetes.io/projected/f44c4e83-da4f-4bbb-9718-c91b64f402e0-kube-api-access-hx4rz\") pod \"9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1x5l9t\" (UID: \"f44c4e83-da4f-4bbb-9718-c91b64f402e0\") " pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1x5l9t" Jun 02 21:43:01.030566 ip-10-0-138-193 kubenswrapper[2578]: I0602 21:43:01.030465 2578 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/f44c4e83-da4f-4bbb-9718-c91b64f402e0-bundle\") pod \"9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1x5l9t\" (UID: \"f44c4e83-da4f-4bbb-9718-c91b64f402e0\") " pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1x5l9t" Jun 02 21:43:01.030566 ip-10-0-138-193 kubenswrapper[2578]: I0602 21:43:01.030513 2578 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/f44c4e83-da4f-4bbb-9718-c91b64f402e0-util\") pod \"9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1x5l9t\" (UID: \"f44c4e83-da4f-4bbb-9718-c91b64f402e0\") " pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1x5l9t" Jun 02 21:43:01.030773 ip-10-0-138-193 kubenswrapper[2578]: I0602 21:43:01.030566 2578 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-hx4rz\" (UniqueName: \"kubernetes.io/projected/f44c4e83-da4f-4bbb-9718-c91b64f402e0-kube-api-access-hx4rz\") pod \"9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1x5l9t\" (UID: \"f44c4e83-da4f-4bbb-9718-c91b64f402e0\") " pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1x5l9t" Jun 02 21:43:01.030870 ip-10-0-138-193 kubenswrapper[2578]: I0602 21:43:01.030847 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/f44c4e83-da4f-4bbb-9718-c91b64f402e0-bundle\") pod \"9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1x5l9t\" (UID: \"f44c4e83-da4f-4bbb-9718-c91b64f402e0\") " pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1x5l9t" Jun 02 21:43:01.030911 ip-10-0-138-193 kubenswrapper[2578]: I0602 21:43:01.030856 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/f44c4e83-da4f-4bbb-9718-c91b64f402e0-util\") pod \"9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1x5l9t\" (UID: \"f44c4e83-da4f-4bbb-9718-c91b64f402e0\") " pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1x5l9t" Jun 02 21:43:01.039118 ip-10-0-138-193 kubenswrapper[2578]: I0602 21:43:01.039061 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-hx4rz\" (UniqueName: \"kubernetes.io/projected/f44c4e83-da4f-4bbb-9718-c91b64f402e0-kube-api-access-hx4rz\") pod \"9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1x5l9t\" (UID: \"f44c4e83-da4f-4bbb-9718-c91b64f402e0\") " pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1x5l9t" Jun 02 21:43:01.070915 ip-10-0-138-193 kubenswrapper[2578]: I0602 21:43:01.070891 2578 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1x5l9t" Jun 02 21:43:01.199169 ip-10-0-138-193 kubenswrapper[2578]: I0602 21:43:01.199135 2578 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1x5l9t"] Jun 02 21:43:01.200729 ip-10-0-138-193 kubenswrapper[2578]: W0602 21:43:01.200703 2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podf44c4e83_da4f_4bbb_9718_c91b64f402e0.slice/crio-8c16a7dd571d538a28963e81f57c43ce4676ed168167e028b2db6433d70bc4e7 WatchSource:0}: Error finding container 8c16a7dd571d538a28963e81f57c43ce4676ed168167e028b2db6433d70bc4e7: Status 404 returned error can't find the container with id 8c16a7dd571d538a28963e81f57c43ce4676ed168167e028b2db6433d70bc4e7 Jun 02 21:43:01.344568 ip-10-0-138-193 kubenswrapper[2578]: I0602 21:43:01.344539 2578 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0xzwbf"] Jun 02 21:43:01.348244 ip-10-0-138-193 kubenswrapper[2578]: I0602 21:43:01.348224 2578 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0xzwbf" Jun 02 21:43:01.354194 ip-10-0-138-193 kubenswrapper[2578]: I0602 21:43:01.354170 2578 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0xzwbf"] Jun 02 21:43:01.407242 ip-10-0-138-193 kubenswrapper[2578]: I0602 21:43:01.407213 2578 generic.go:358] "Generic (PLEG): container finished" podID="f44c4e83-da4f-4bbb-9718-c91b64f402e0" containerID="aecc55da2bcc2ad2b218d4d3a6b802471d5fe70425bf6443a0799d3c50e33167" exitCode=0 Jun 02 21:43:01.407345 ip-10-0-138-193 kubenswrapper[2578]: I0602 21:43:01.407299 2578 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1x5l9t" event={"ID":"f44c4e83-da4f-4bbb-9718-c91b64f402e0","Type":"ContainerDied","Data":"aecc55da2bcc2ad2b218d4d3a6b802471d5fe70425bf6443a0799d3c50e33167"} Jun 02 21:43:01.407345 ip-10-0-138-193 kubenswrapper[2578]: I0602 21:43:01.407329 2578 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1x5l9t" event={"ID":"f44c4e83-da4f-4bbb-9718-c91b64f402e0","Type":"ContainerStarted","Data":"8c16a7dd571d538a28963e81f57c43ce4676ed168167e028b2db6433d70bc4e7"} Jun 02 21:43:01.537165 ip-10-0-138-193 kubenswrapper[2578]: I0602 21:43:01.537132 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-s64mk\" (UniqueName: \"kubernetes.io/projected/27c2b3fa-8f2b-4dd8-9456-d2fab70b1175-kube-api-access-s64mk\") pod \"19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0xzwbf\" (UID: \"27c2b3fa-8f2b-4dd8-9456-d2fab70b1175\") " pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0xzwbf" Jun 02 21:43:01.537347 ip-10-0-138-193 kubenswrapper[2578]: I0602 21:43:01.537192 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/27c2b3fa-8f2b-4dd8-9456-d2fab70b1175-bundle\") pod \"19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0xzwbf\" (UID: \"27c2b3fa-8f2b-4dd8-9456-d2fab70b1175\") " pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0xzwbf" Jun 02 21:43:01.537347 ip-10-0-138-193 kubenswrapper[2578]: I0602 21:43:01.537284 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/27c2b3fa-8f2b-4dd8-9456-d2fab70b1175-util\") pod \"19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0xzwbf\" (UID: \"27c2b3fa-8f2b-4dd8-9456-d2fab70b1175\") " pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0xzwbf" Jun 02 21:43:01.638444 ip-10-0-138-193 kubenswrapper[2578]: I0602 21:43:01.638420 2578 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-s64mk\" (UniqueName: \"kubernetes.io/projected/27c2b3fa-8f2b-4dd8-9456-d2fab70b1175-kube-api-access-s64mk\") pod \"19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0xzwbf\" (UID: \"27c2b3fa-8f2b-4dd8-9456-d2fab70b1175\") " pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0xzwbf" Jun 02 21:43:01.638602 ip-10-0-138-193 kubenswrapper[2578]: I0602 21:43:01.638470 2578 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/27c2b3fa-8f2b-4dd8-9456-d2fab70b1175-bundle\") pod \"19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0xzwbf\" (UID: \"27c2b3fa-8f2b-4dd8-9456-d2fab70b1175\") " pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0xzwbf" Jun 02 21:43:01.638602 ip-10-0-138-193 kubenswrapper[2578]: I0602 21:43:01.638517 2578 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/27c2b3fa-8f2b-4dd8-9456-d2fab70b1175-util\") pod \"19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0xzwbf\" (UID: \"27c2b3fa-8f2b-4dd8-9456-d2fab70b1175\") " pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0xzwbf" Jun 02 21:43:01.638839 ip-10-0-138-193 kubenswrapper[2578]: I0602 21:43:01.638821 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/27c2b3fa-8f2b-4dd8-9456-d2fab70b1175-bundle\") pod \"19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0xzwbf\" (UID: \"27c2b3fa-8f2b-4dd8-9456-d2fab70b1175\") " pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0xzwbf" Jun 02 21:43:01.638879 ip-10-0-138-193 kubenswrapper[2578]: I0602 21:43:01.638846 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/27c2b3fa-8f2b-4dd8-9456-d2fab70b1175-util\") pod \"19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0xzwbf\" (UID: \"27c2b3fa-8f2b-4dd8-9456-d2fab70b1175\") " pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0xzwbf" Jun 02 21:43:01.645820 ip-10-0-138-193 kubenswrapper[2578]: I0602 21:43:01.645795 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-s64mk\" (UniqueName: \"kubernetes.io/projected/27c2b3fa-8f2b-4dd8-9456-d2fab70b1175-kube-api-access-s64mk\") pod \"19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0xzwbf\" (UID: \"27c2b3fa-8f2b-4dd8-9456-d2fab70b1175\") " pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0xzwbf" Jun 02 21:43:01.673900 ip-10-0-138-193 kubenswrapper[2578]: I0602 21:43:01.673881 2578 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0xzwbf" Jun 02 21:43:01.799729 ip-10-0-138-193 kubenswrapper[2578]: I0602 21:43:01.799706 2578 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0xzwbf"] Jun 02 21:43:01.801221 ip-10-0-138-193 kubenswrapper[2578]: W0602 21:43:01.801192 2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod27c2b3fa_8f2b_4dd8_9456_d2fab70b1175.slice/crio-c669ef31774254efeefae0b82aeb8ce1a7fc281aa7ef61062b78e98883e74083 WatchSource:0}: Error finding container c669ef31774254efeefae0b82aeb8ce1a7fc281aa7ef61062b78e98883e74083: Status 404 returned error can't find the container with id c669ef31774254efeefae0b82aeb8ce1a7fc281aa7ef61062b78e98883e74083 Jun 02 21:43:01.947934 ip-10-0-138-193 kubenswrapper[2578]: I0602 21:43:01.947905 2578 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759tn29v"] Jun 02 21:43:01.952019 ip-10-0-138-193 kubenswrapper[2578]: I0602 21:43:01.952001 2578 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759tn29v" Jun 02 21:43:01.956895 ip-10-0-138-193 kubenswrapper[2578]: I0602 21:43:01.956868 2578 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759tn29v"] Jun 02 21:43:02.043175 ip-10-0-138-193 kubenswrapper[2578]: I0602 21:43:02.043129 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-qrshd\" (UniqueName: \"kubernetes.io/projected/f3084f1b-4f7b-4f79-b903-67f3e60d4be3-kube-api-access-qrshd\") pod \"0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759tn29v\" (UID: \"f3084f1b-4f7b-4f79-b903-67f3e60d4be3\") " pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759tn29v" Jun 02 21:43:02.043347 ip-10-0-138-193 kubenswrapper[2578]: I0602 21:43:02.043275 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/f3084f1b-4f7b-4f79-b903-67f3e60d4be3-bundle\") pod \"0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759tn29v\" (UID: \"f3084f1b-4f7b-4f79-b903-67f3e60d4be3\") " pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759tn29v" Jun 02 21:43:02.043347 ip-10-0-138-193 kubenswrapper[2578]: I0602 21:43:02.043334 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/f3084f1b-4f7b-4f79-b903-67f3e60d4be3-util\") pod \"0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759tn29v\" (UID: \"f3084f1b-4f7b-4f79-b903-67f3e60d4be3\") " pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759tn29v" Jun 02 21:43:02.144500 ip-10-0-138-193 kubenswrapper[2578]: I0602 21:43:02.144464 2578 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/f3084f1b-4f7b-4f79-b903-67f3e60d4be3-bundle\") pod \"0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759tn29v\" (UID: \"f3084f1b-4f7b-4f79-b903-67f3e60d4be3\") " pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759tn29v" Jun 02 21:43:02.144500 ip-10-0-138-193 kubenswrapper[2578]: I0602 21:43:02.144510 2578 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/f3084f1b-4f7b-4f79-b903-67f3e60d4be3-util\") pod \"0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759tn29v\" (UID: \"f3084f1b-4f7b-4f79-b903-67f3e60d4be3\") " pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759tn29v" Jun 02 21:43:02.144760 ip-10-0-138-193 kubenswrapper[2578]: I0602 21:43:02.144548 2578 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-qrshd\" (UniqueName: \"kubernetes.io/projected/f3084f1b-4f7b-4f79-b903-67f3e60d4be3-kube-api-access-qrshd\") pod \"0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759tn29v\" (UID: \"f3084f1b-4f7b-4f79-b903-67f3e60d4be3\") " pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759tn29v" Jun 02 21:43:02.144902 ip-10-0-138-193 kubenswrapper[2578]: I0602 21:43:02.144880 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/f3084f1b-4f7b-4f79-b903-67f3e60d4be3-util\") pod \"0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759tn29v\" (UID: \"f3084f1b-4f7b-4f79-b903-67f3e60d4be3\") " pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759tn29v" Jun 02 21:43:02.144962 ip-10-0-138-193 kubenswrapper[2578]: I0602 21:43:02.144885 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/f3084f1b-4f7b-4f79-b903-67f3e60d4be3-bundle\") pod \"0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759tn29v\" (UID: \"f3084f1b-4f7b-4f79-b903-67f3e60d4be3\") " pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759tn29v" Jun 02 21:43:02.152306 ip-10-0-138-193 kubenswrapper[2578]: I0602 21:43:02.152287 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-qrshd\" (UniqueName: \"kubernetes.io/projected/f3084f1b-4f7b-4f79-b903-67f3e60d4be3-kube-api-access-qrshd\") pod \"0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759tn29v\" (UID: \"f3084f1b-4f7b-4f79-b903-67f3e60d4be3\") " pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759tn29v" Jun 02 21:43:02.263725 ip-10-0-138-193 kubenswrapper[2578]: I0602 21:43:02.263687 2578 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759tn29v" Jun 02 21:43:02.352913 ip-10-0-138-193 kubenswrapper[2578]: I0602 21:43:02.352876 2578 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73t4pqf"] Jun 02 21:43:02.357854 ip-10-0-138-193 kubenswrapper[2578]: I0602 21:43:02.357838 2578 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73t4pqf" Jun 02 21:43:02.364209 ip-10-0-138-193 kubenswrapper[2578]: I0602 21:43:02.364170 2578 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73t4pqf"] Jun 02 21:43:02.393634 ip-10-0-138-193 kubenswrapper[2578]: I0602 21:43:02.393613 2578 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759tn29v"] Jun 02 21:43:02.395108 ip-10-0-138-193 kubenswrapper[2578]: W0602 21:43:02.395063 2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podf3084f1b_4f7b_4f79_b903_67f3e60d4be3.slice/crio-a5554c2809808cd4a1bc5697dcdc16bfa56095430715ba39a3d5b6e45d50b570 WatchSource:0}: Error finding container a5554c2809808cd4a1bc5697dcdc16bfa56095430715ba39a3d5b6e45d50b570: Status 404 returned error can't find the container with id a5554c2809808cd4a1bc5697dcdc16bfa56095430715ba39a3d5b6e45d50b570 Jun 02 21:43:02.413556 ip-10-0-138-193 kubenswrapper[2578]: I0602 21:43:02.413531 2578 generic.go:358] "Generic (PLEG): container finished" podID="f44c4e83-da4f-4bbb-9718-c91b64f402e0" containerID="23d1604afa283e66c35201f198600f5669e3c8f770b96c7fcc922ccc26f2a42f" exitCode=0 Jun 02 21:43:02.413645 ip-10-0-138-193 kubenswrapper[2578]: I0602 21:43:02.413595 2578 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1x5l9t" event={"ID":"f44c4e83-da4f-4bbb-9718-c91b64f402e0","Type":"ContainerDied","Data":"23d1604afa283e66c35201f198600f5669e3c8f770b96c7fcc922ccc26f2a42f"} Jun 02 21:43:02.414777 ip-10-0-138-193 kubenswrapper[2578]: I0602 21:43:02.414753 2578 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759tn29v" event={"ID":"f3084f1b-4f7b-4f79-b903-67f3e60d4be3","Type":"ContainerStarted","Data":"a5554c2809808cd4a1bc5697dcdc16bfa56095430715ba39a3d5b6e45d50b570"} Jun 02 21:43:02.416192 ip-10-0-138-193 kubenswrapper[2578]: I0602 21:43:02.416169 2578 generic.go:358] "Generic (PLEG): container finished" podID="27c2b3fa-8f2b-4dd8-9456-d2fab70b1175" containerID="1f93f431e5f405a51fc43479e42acd93d0e75ed25d8cdff2d01bffd439e65647" exitCode=0 Jun 02 21:43:02.416284 ip-10-0-138-193 kubenswrapper[2578]: I0602 21:43:02.416254 2578 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0xzwbf" event={"ID":"27c2b3fa-8f2b-4dd8-9456-d2fab70b1175","Type":"ContainerDied","Data":"1f93f431e5f405a51fc43479e42acd93d0e75ed25d8cdff2d01bffd439e65647"} Jun 02 21:43:02.416331 ip-10-0-138-193 kubenswrapper[2578]: I0602 21:43:02.416283 2578 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0xzwbf" event={"ID":"27c2b3fa-8f2b-4dd8-9456-d2fab70b1175","Type":"ContainerStarted","Data":"c669ef31774254efeefae0b82aeb8ce1a7fc281aa7ef61062b78e98883e74083"} Jun 02 21:43:02.548157 ip-10-0-138-193 kubenswrapper[2578]: I0602 21:43:02.548117 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/4d243294-8ef4-40c4-98e3-706837f6f029-util\") pod \"5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73t4pqf\" (UID: \"4d243294-8ef4-40c4-98e3-706837f6f029\") " pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73t4pqf" Jun 02 21:43:02.548314 ip-10-0-138-193 kubenswrapper[2578]: I0602 21:43:02.548237 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-mdpsr\" (UniqueName: \"kubernetes.io/projected/4d243294-8ef4-40c4-98e3-706837f6f029-kube-api-access-mdpsr\") pod \"5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73t4pqf\" (UID: \"4d243294-8ef4-40c4-98e3-706837f6f029\") " pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73t4pqf" Jun 02 21:43:02.548314 ip-10-0-138-193 kubenswrapper[2578]: I0602 21:43:02.548299 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/4d243294-8ef4-40c4-98e3-706837f6f029-bundle\") pod \"5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73t4pqf\" (UID: \"4d243294-8ef4-40c4-98e3-706837f6f029\") " pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73t4pqf" Jun 02 21:43:02.649427 ip-10-0-138-193 kubenswrapper[2578]: I0602 21:43:02.649386 2578 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/4d243294-8ef4-40c4-98e3-706837f6f029-util\") pod \"5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73t4pqf\" (UID: \"4d243294-8ef4-40c4-98e3-706837f6f029\") " pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73t4pqf" Jun 02 21:43:02.649627 ip-10-0-138-193 kubenswrapper[2578]: I0602 21:43:02.649450 2578 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-mdpsr\" (UniqueName: \"kubernetes.io/projected/4d243294-8ef4-40c4-98e3-706837f6f029-kube-api-access-mdpsr\") pod \"5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73t4pqf\" (UID: \"4d243294-8ef4-40c4-98e3-706837f6f029\") " pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73t4pqf" Jun 02 21:43:02.649627 ip-10-0-138-193 kubenswrapper[2578]: I0602 21:43:02.649479 2578 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/4d243294-8ef4-40c4-98e3-706837f6f029-bundle\") pod \"5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73t4pqf\" (UID: \"4d243294-8ef4-40c4-98e3-706837f6f029\") " pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73t4pqf" Jun 02 21:43:02.649852 ip-10-0-138-193 kubenswrapper[2578]: I0602 21:43:02.649828 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/4d243294-8ef4-40c4-98e3-706837f6f029-util\") pod \"5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73t4pqf\" (UID: \"4d243294-8ef4-40c4-98e3-706837f6f029\") " pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73t4pqf" Jun 02 21:43:02.649852 ip-10-0-138-193 kubenswrapper[2578]: I0602 21:43:02.649843 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/4d243294-8ef4-40c4-98e3-706837f6f029-bundle\") pod \"5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73t4pqf\" (UID: \"4d243294-8ef4-40c4-98e3-706837f6f029\") " pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73t4pqf" Jun 02 21:43:02.657711 ip-10-0-138-193 kubenswrapper[2578]: I0602 21:43:02.657658 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-mdpsr\" (UniqueName: \"kubernetes.io/projected/4d243294-8ef4-40c4-98e3-706837f6f029-kube-api-access-mdpsr\") pod \"5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73t4pqf\" (UID: \"4d243294-8ef4-40c4-98e3-706837f6f029\") " pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73t4pqf" Jun 02 21:43:02.670459 ip-10-0-138-193 kubenswrapper[2578]: I0602 21:43:02.670439 2578 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73t4pqf" Jun 02 21:43:02.797222 ip-10-0-138-193 kubenswrapper[2578]: I0602 21:43:02.797197 2578 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73t4pqf"] Jun 02 21:43:02.798471 ip-10-0-138-193 kubenswrapper[2578]: W0602 21:43:02.798444 2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod4d243294_8ef4_40c4_98e3_706837f6f029.slice/crio-e459c03ba5c1b259ef4cf238717351f7a2d276a7278c457724520c237eebd4a2 WatchSource:0}: Error finding container e459c03ba5c1b259ef4cf238717351f7a2d276a7278c457724520c237eebd4a2: Status 404 returned error can't find the container with id e459c03ba5c1b259ef4cf238717351f7a2d276a7278c457724520c237eebd4a2 Jun 02 21:43:03.422364 ip-10-0-138-193 kubenswrapper[2578]: I0602 21:43:03.422333 2578 generic.go:358] "Generic (PLEG): container finished" podID="f44c4e83-da4f-4bbb-9718-c91b64f402e0" containerID="f392151964d92e6ca3e1717821dd972434da9e833901f9408ecf969273d72b9e" exitCode=0 Jun 02 21:43:03.422802 ip-10-0-138-193 kubenswrapper[2578]: I0602 21:43:03.422397 2578 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1x5l9t" event={"ID":"f44c4e83-da4f-4bbb-9718-c91b64f402e0","Type":"ContainerDied","Data":"f392151964d92e6ca3e1717821dd972434da9e833901f9408ecf969273d72b9e"} Jun 02 21:43:03.423654 ip-10-0-138-193 kubenswrapper[2578]: I0602 21:43:03.423623 2578 generic.go:358] "Generic (PLEG): container finished" podID="f3084f1b-4f7b-4f79-b903-67f3e60d4be3" containerID="73e9fc3ee4a0d81b214d2f81b521183eb62c3859ebe79dafd0c191252b7deaf3" exitCode=0 Jun 02 21:43:03.423789 ip-10-0-138-193 kubenswrapper[2578]: I0602 21:43:03.423698 2578 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759tn29v" event={"ID":"f3084f1b-4f7b-4f79-b903-67f3e60d4be3","Type":"ContainerDied","Data":"73e9fc3ee4a0d81b214d2f81b521183eb62c3859ebe79dafd0c191252b7deaf3"} Jun 02 21:43:03.425332 ip-10-0-138-193 kubenswrapper[2578]: I0602 21:43:03.425311 2578 generic.go:358] "Generic (PLEG): container finished" podID="27c2b3fa-8f2b-4dd8-9456-d2fab70b1175" containerID="8cdac42c7c4f0b0cca9bd8bb6d852d2ece2e45c6a9b567d575f4e65a4655d57f" exitCode=0 Jun 02 21:43:03.425439 ip-10-0-138-193 kubenswrapper[2578]: I0602 21:43:03.425370 2578 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0xzwbf" event={"ID":"27c2b3fa-8f2b-4dd8-9456-d2fab70b1175","Type":"ContainerDied","Data":"8cdac42c7c4f0b0cca9bd8bb6d852d2ece2e45c6a9b567d575f4e65a4655d57f"} Jun 02 21:43:03.426837 ip-10-0-138-193 kubenswrapper[2578]: I0602 21:43:03.426817 2578 generic.go:358] "Generic (PLEG): container finished" podID="4d243294-8ef4-40c4-98e3-706837f6f029" containerID="e4ad788c55796bfa22a8bcb45aada2ac90d6b7b4a59092ee5b4d9291a85fff25" exitCode=0 Jun 02 21:43:03.426940 ip-10-0-138-193 kubenswrapper[2578]: I0602 21:43:03.426878 2578 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73t4pqf" event={"ID":"4d243294-8ef4-40c4-98e3-706837f6f029","Type":"ContainerDied","Data":"e4ad788c55796bfa22a8bcb45aada2ac90d6b7b4a59092ee5b4d9291a85fff25"} Jun 02 21:43:03.426940 ip-10-0-138-193 kubenswrapper[2578]: I0602 21:43:03.426899 2578 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73t4pqf" event={"ID":"4d243294-8ef4-40c4-98e3-706837f6f029","Type":"ContainerStarted","Data":"e459c03ba5c1b259ef4cf238717351f7a2d276a7278c457724520c237eebd4a2"} Jun 02 21:43:04.436549 ip-10-0-138-193 kubenswrapper[2578]: I0602 21:43:04.436464 2578 generic.go:358] "Generic (PLEG): container finished" podID="f3084f1b-4f7b-4f79-b903-67f3e60d4be3" containerID="f6ec2ba05c44506cdd992f498c50d54bb1a1e174a0461257c1981f60409d8622" exitCode=0 Jun 02 21:43:04.436549 ip-10-0-138-193 kubenswrapper[2578]: I0602 21:43:04.436535 2578 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759tn29v" event={"ID":"f3084f1b-4f7b-4f79-b903-67f3e60d4be3","Type":"ContainerDied","Data":"f6ec2ba05c44506cdd992f498c50d54bb1a1e174a0461257c1981f60409d8622"} Jun 02 21:43:04.438455 ip-10-0-138-193 kubenswrapper[2578]: I0602 21:43:04.438428 2578 generic.go:358] "Generic (PLEG): container finished" podID="27c2b3fa-8f2b-4dd8-9456-d2fab70b1175" containerID="a96ebe4d022f7aa6680d43b6151d1d3a84634fe8746b490a50a5405cdaeb86a5" exitCode=0 Jun 02 21:43:04.438542 ip-10-0-138-193 kubenswrapper[2578]: I0602 21:43:04.438508 2578 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0xzwbf" event={"ID":"27c2b3fa-8f2b-4dd8-9456-d2fab70b1175","Type":"ContainerDied","Data":"a96ebe4d022f7aa6680d43b6151d1d3a84634fe8746b490a50a5405cdaeb86a5"} Jun 02 21:43:04.440024 ip-10-0-138-193 kubenswrapper[2578]: I0602 21:43:04.439999 2578 generic.go:358] "Generic (PLEG): container finished" podID="4d243294-8ef4-40c4-98e3-706837f6f029" containerID="dae0ff3a3f1fcaf226b0708d3104baef34b4ebddd02a8424fc7e804061f1f52a" exitCode=0 Jun 02 21:43:04.440122 ip-10-0-138-193 kubenswrapper[2578]: I0602 21:43:04.440056 2578 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73t4pqf" event={"ID":"4d243294-8ef4-40c4-98e3-706837f6f029","Type":"ContainerDied","Data":"dae0ff3a3f1fcaf226b0708d3104baef34b4ebddd02a8424fc7e804061f1f52a"} Jun 02 21:43:04.577872 ip-10-0-138-193 kubenswrapper[2578]: I0602 21:43:04.577839 2578 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1x5l9t" Jun 02 21:43:04.769758 ip-10-0-138-193 kubenswrapper[2578]: I0602 21:43:04.769673 2578 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/f44c4e83-da4f-4bbb-9718-c91b64f402e0-bundle\") pod \"f44c4e83-da4f-4bbb-9718-c91b64f402e0\" (UID: \"f44c4e83-da4f-4bbb-9718-c91b64f402e0\") " Jun 02 21:43:04.769758 ip-10-0-138-193 kubenswrapper[2578]: I0602 21:43:04.769728 2578 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/f44c4e83-da4f-4bbb-9718-c91b64f402e0-util\") pod \"f44c4e83-da4f-4bbb-9718-c91b64f402e0\" (UID: \"f44c4e83-da4f-4bbb-9718-c91b64f402e0\") " Jun 02 21:43:04.769951 ip-10-0-138-193 kubenswrapper[2578]: I0602 21:43:04.769786 2578 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-hx4rz\" (UniqueName: \"kubernetes.io/projected/f44c4e83-da4f-4bbb-9718-c91b64f402e0-kube-api-access-hx4rz\") pod \"f44c4e83-da4f-4bbb-9718-c91b64f402e0\" (UID: \"f44c4e83-da4f-4bbb-9718-c91b64f402e0\") " Jun 02 21:43:04.770227 ip-10-0-138-193 kubenswrapper[2578]: I0602 21:43:04.770202 2578 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/f44c4e83-da4f-4bbb-9718-c91b64f402e0-bundle" (OuterVolumeSpecName: "bundle") pod "f44c4e83-da4f-4bbb-9718-c91b64f402e0" (UID: "f44c4e83-da4f-4bbb-9718-c91b64f402e0"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jun 02 21:43:04.772000 ip-10-0-138-193 kubenswrapper[2578]: I0602 21:43:04.771974 2578 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/f44c4e83-da4f-4bbb-9718-c91b64f402e0-kube-api-access-hx4rz" (OuterVolumeSpecName: "kube-api-access-hx4rz") pod "f44c4e83-da4f-4bbb-9718-c91b64f402e0" (UID: "f44c4e83-da4f-4bbb-9718-c91b64f402e0"). InnerVolumeSpecName "kube-api-access-hx4rz". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 02 21:43:04.774495 ip-10-0-138-193 kubenswrapper[2578]: I0602 21:43:04.774457 2578 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/f44c4e83-da4f-4bbb-9718-c91b64f402e0-util" (OuterVolumeSpecName: "util") pod "f44c4e83-da4f-4bbb-9718-c91b64f402e0" (UID: "f44c4e83-da4f-4bbb-9718-c91b64f402e0"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jun 02 21:43:04.870712 ip-10-0-138-193 kubenswrapper[2578]: I0602 21:43:04.870681 2578 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-hx4rz\" (UniqueName: \"kubernetes.io/projected/f44c4e83-da4f-4bbb-9718-c91b64f402e0-kube-api-access-hx4rz\") on node \"ip-10-0-138-193.ec2.internal\" DevicePath \"\"" Jun 02 21:43:04.870712 ip-10-0-138-193 kubenswrapper[2578]: I0602 21:43:04.870702 2578 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/f44c4e83-da4f-4bbb-9718-c91b64f402e0-bundle\") on node \"ip-10-0-138-193.ec2.internal\" DevicePath \"\"" Jun 02 21:43:04.870712 ip-10-0-138-193 kubenswrapper[2578]: I0602 21:43:04.870712 2578 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/f44c4e83-da4f-4bbb-9718-c91b64f402e0-util\") on node \"ip-10-0-138-193.ec2.internal\" DevicePath \"\"" Jun 02 21:43:05.446118 ip-10-0-138-193 kubenswrapper[2578]: I0602 21:43:05.446056 2578 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1x5l9t" event={"ID":"f44c4e83-da4f-4bbb-9718-c91b64f402e0","Type":"ContainerDied","Data":"8c16a7dd571d538a28963e81f57c43ce4676ed168167e028b2db6433d70bc4e7"} Jun 02 21:43:05.446118 ip-10-0-138-193 kubenswrapper[2578]: I0602 21:43:05.446116 2578 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1x5l9t" Jun 02 21:43:05.446586 ip-10-0-138-193 kubenswrapper[2578]: I0602 21:43:05.446118 2578 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="8c16a7dd571d538a28963e81f57c43ce4676ed168167e028b2db6433d70bc4e7" Jun 02 21:43:05.448106 ip-10-0-138-193 kubenswrapper[2578]: I0602 21:43:05.448063 2578 generic.go:358] "Generic (PLEG): container finished" podID="f3084f1b-4f7b-4f79-b903-67f3e60d4be3" containerID="78d71005e87fd0f2aa11ccea94584d32e0519d549d36edf851446e3b073ce67e" exitCode=0 Jun 02 21:43:05.448254 ip-10-0-138-193 kubenswrapper[2578]: I0602 21:43:05.448168 2578 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759tn29v" event={"ID":"f3084f1b-4f7b-4f79-b903-67f3e60d4be3","Type":"ContainerDied","Data":"78d71005e87fd0f2aa11ccea94584d32e0519d549d36edf851446e3b073ce67e"} Jun 02 21:43:05.450237 ip-10-0-138-193 kubenswrapper[2578]: I0602 21:43:05.450213 2578 generic.go:358] "Generic (PLEG): container finished" podID="4d243294-8ef4-40c4-98e3-706837f6f029" containerID="7312781eddef31788efd0f5875b6c0379540daa6889667b289dfeb9b8d6a8b6f" exitCode=0 Jun 02 21:43:05.450314 ip-10-0-138-193 kubenswrapper[2578]: I0602 21:43:05.450286 2578 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73t4pqf" event={"ID":"4d243294-8ef4-40c4-98e3-706837f6f029","Type":"ContainerDied","Data":"7312781eddef31788efd0f5875b6c0379540daa6889667b289dfeb9b8d6a8b6f"} Jun 02 21:43:05.579747 ip-10-0-138-193 kubenswrapper[2578]: I0602 21:43:05.579726 2578 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0xzwbf" Jun 02 21:43:05.778402 ip-10-0-138-193 kubenswrapper[2578]: I0602 21:43:05.778320 2578 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-s64mk\" (UniqueName: \"kubernetes.io/projected/27c2b3fa-8f2b-4dd8-9456-d2fab70b1175-kube-api-access-s64mk\") pod \"27c2b3fa-8f2b-4dd8-9456-d2fab70b1175\" (UID: \"27c2b3fa-8f2b-4dd8-9456-d2fab70b1175\") " Jun 02 21:43:05.778402 ip-10-0-138-193 kubenswrapper[2578]: I0602 21:43:05.778390 2578 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/27c2b3fa-8f2b-4dd8-9456-d2fab70b1175-bundle\") pod \"27c2b3fa-8f2b-4dd8-9456-d2fab70b1175\" (UID: \"27c2b3fa-8f2b-4dd8-9456-d2fab70b1175\") " Jun 02 21:43:05.778571 ip-10-0-138-193 kubenswrapper[2578]: I0602 21:43:05.778504 2578 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/27c2b3fa-8f2b-4dd8-9456-d2fab70b1175-util\") pod \"27c2b3fa-8f2b-4dd8-9456-d2fab70b1175\" (UID: \"27c2b3fa-8f2b-4dd8-9456-d2fab70b1175\") " Jun 02 21:43:05.778977 ip-10-0-138-193 kubenswrapper[2578]: I0602 21:43:05.778947 2578 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/27c2b3fa-8f2b-4dd8-9456-d2fab70b1175-bundle" (OuterVolumeSpecName: "bundle") pod "27c2b3fa-8f2b-4dd8-9456-d2fab70b1175" (UID: "27c2b3fa-8f2b-4dd8-9456-d2fab70b1175"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jun 02 21:43:05.780403 ip-10-0-138-193 kubenswrapper[2578]: I0602 21:43:05.780370 2578 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/27c2b3fa-8f2b-4dd8-9456-d2fab70b1175-kube-api-access-s64mk" (OuterVolumeSpecName: "kube-api-access-s64mk") pod "27c2b3fa-8f2b-4dd8-9456-d2fab70b1175" (UID: "27c2b3fa-8f2b-4dd8-9456-d2fab70b1175"). InnerVolumeSpecName "kube-api-access-s64mk". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 02 21:43:05.784228 ip-10-0-138-193 kubenswrapper[2578]: I0602 21:43:05.784208 2578 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/27c2b3fa-8f2b-4dd8-9456-d2fab70b1175-util" (OuterVolumeSpecName: "util") pod "27c2b3fa-8f2b-4dd8-9456-d2fab70b1175" (UID: "27c2b3fa-8f2b-4dd8-9456-d2fab70b1175"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jun 02 21:43:05.879805 ip-10-0-138-193 kubenswrapper[2578]: I0602 21:43:05.879777 2578 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/27c2b3fa-8f2b-4dd8-9456-d2fab70b1175-util\") on node \"ip-10-0-138-193.ec2.internal\" DevicePath \"\"" Jun 02 21:43:05.879805 ip-10-0-138-193 kubenswrapper[2578]: I0602 21:43:05.879802 2578 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-s64mk\" (UniqueName: \"kubernetes.io/projected/27c2b3fa-8f2b-4dd8-9456-d2fab70b1175-kube-api-access-s64mk\") on node \"ip-10-0-138-193.ec2.internal\" DevicePath \"\"" Jun 02 21:43:05.879977 ip-10-0-138-193 kubenswrapper[2578]: I0602 21:43:05.879813 2578 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/27c2b3fa-8f2b-4dd8-9456-d2fab70b1175-bundle\") on node \"ip-10-0-138-193.ec2.internal\" DevicePath \"\"" Jun 02 21:43:06.456100 ip-10-0-138-193 kubenswrapper[2578]: I0602 21:43:06.456060 2578 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0xzwbf" Jun 02 21:43:06.456542 ip-10-0-138-193 kubenswrapper[2578]: I0602 21:43:06.456060 2578 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0xzwbf" event={"ID":"27c2b3fa-8f2b-4dd8-9456-d2fab70b1175","Type":"ContainerDied","Data":"c669ef31774254efeefae0b82aeb8ce1a7fc281aa7ef61062b78e98883e74083"} Jun 02 21:43:06.456542 ip-10-0-138-193 kubenswrapper[2578]: I0602 21:43:06.456171 2578 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="c669ef31774254efeefae0b82aeb8ce1a7fc281aa7ef61062b78e98883e74083" Jun 02 21:43:06.597199 ip-10-0-138-193 kubenswrapper[2578]: I0602 21:43:06.597174 2578 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759tn29v" Jun 02 21:43:06.625898 ip-10-0-138-193 kubenswrapper[2578]: I0602 21:43:06.625875 2578 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73t4pqf" Jun 02 21:43:06.684398 ip-10-0-138-193 kubenswrapper[2578]: I0602 21:43:06.684366 2578 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/f3084f1b-4f7b-4f79-b903-67f3e60d4be3-bundle\") pod \"f3084f1b-4f7b-4f79-b903-67f3e60d4be3\" (UID: \"f3084f1b-4f7b-4f79-b903-67f3e60d4be3\") " Jun 02 21:43:06.684398 ip-10-0-138-193 kubenswrapper[2578]: I0602 21:43:06.684408 2578 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/4d243294-8ef4-40c4-98e3-706837f6f029-util\") pod \"4d243294-8ef4-40c4-98e3-706837f6f029\" (UID: \"4d243294-8ef4-40c4-98e3-706837f6f029\") " Jun 02 21:43:06.684677 ip-10-0-138-193 kubenswrapper[2578]: I0602 21:43:06.684445 2578 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-mdpsr\" (UniqueName: \"kubernetes.io/projected/4d243294-8ef4-40c4-98e3-706837f6f029-kube-api-access-mdpsr\") pod \"4d243294-8ef4-40c4-98e3-706837f6f029\" (UID: \"4d243294-8ef4-40c4-98e3-706837f6f029\") " Jun 02 21:43:06.684677 ip-10-0-138-193 kubenswrapper[2578]: I0602 21:43:06.684486 2578 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/4d243294-8ef4-40c4-98e3-706837f6f029-bundle\") pod \"4d243294-8ef4-40c4-98e3-706837f6f029\" (UID: \"4d243294-8ef4-40c4-98e3-706837f6f029\") " Jun 02 21:43:06.684677 ip-10-0-138-193 kubenswrapper[2578]: I0602 21:43:06.684609 2578 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-qrshd\" (UniqueName: \"kubernetes.io/projected/f3084f1b-4f7b-4f79-b903-67f3e60d4be3-kube-api-access-qrshd\") pod \"f3084f1b-4f7b-4f79-b903-67f3e60d4be3\" (UID: \"f3084f1b-4f7b-4f79-b903-67f3e60d4be3\") " Jun 02 21:43:06.684677 ip-10-0-138-193 kubenswrapper[2578]: I0602 21:43:06.684649 2578 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/f3084f1b-4f7b-4f79-b903-67f3e60d4be3-util\") pod \"f3084f1b-4f7b-4f79-b903-67f3e60d4be3\" (UID: \"f3084f1b-4f7b-4f79-b903-67f3e60d4be3\") " Jun 02 21:43:06.685306 ip-10-0-138-193 kubenswrapper[2578]: I0602 21:43:06.685264 2578 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/4d243294-8ef4-40c4-98e3-706837f6f029-bundle" (OuterVolumeSpecName: "bundle") pod "4d243294-8ef4-40c4-98e3-706837f6f029" (UID: "4d243294-8ef4-40c4-98e3-706837f6f029"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jun 02 21:43:06.685450 ip-10-0-138-193 kubenswrapper[2578]: I0602 21:43:06.685332 2578 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/f3084f1b-4f7b-4f79-b903-67f3e60d4be3-bundle" (OuterVolumeSpecName: "bundle") pod "f3084f1b-4f7b-4f79-b903-67f3e60d4be3" (UID: "f3084f1b-4f7b-4f79-b903-67f3e60d4be3"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jun 02 21:43:06.686740 ip-10-0-138-193 kubenswrapper[2578]: I0602 21:43:06.686710 2578 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/f3084f1b-4f7b-4f79-b903-67f3e60d4be3-kube-api-access-qrshd" (OuterVolumeSpecName: "kube-api-access-qrshd") pod "f3084f1b-4f7b-4f79-b903-67f3e60d4be3" (UID: "f3084f1b-4f7b-4f79-b903-67f3e60d4be3"). InnerVolumeSpecName "kube-api-access-qrshd". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 02 21:43:06.686740 ip-10-0-138-193 kubenswrapper[2578]: I0602 21:43:06.686730 2578 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/4d243294-8ef4-40c4-98e3-706837f6f029-kube-api-access-mdpsr" (OuterVolumeSpecName: "kube-api-access-mdpsr") pod "4d243294-8ef4-40c4-98e3-706837f6f029" (UID: "4d243294-8ef4-40c4-98e3-706837f6f029"). InnerVolumeSpecName "kube-api-access-mdpsr". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 02 21:43:06.693308 ip-10-0-138-193 kubenswrapper[2578]: I0602 21:43:06.693281 2578 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/4d243294-8ef4-40c4-98e3-706837f6f029-util" (OuterVolumeSpecName: "util") pod "4d243294-8ef4-40c4-98e3-706837f6f029" (UID: "4d243294-8ef4-40c4-98e3-706837f6f029"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jun 02 21:43:06.693452 ip-10-0-138-193 kubenswrapper[2578]: I0602 21:43:06.693390 2578 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/f3084f1b-4f7b-4f79-b903-67f3e60d4be3-util" (OuterVolumeSpecName: "util") pod "f3084f1b-4f7b-4f79-b903-67f3e60d4be3" (UID: "f3084f1b-4f7b-4f79-b903-67f3e60d4be3"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jun 02 21:43:06.785595 ip-10-0-138-193 kubenswrapper[2578]: I0602 21:43:06.785481 2578 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-mdpsr\" (UniqueName: \"kubernetes.io/projected/4d243294-8ef4-40c4-98e3-706837f6f029-kube-api-access-mdpsr\") on node \"ip-10-0-138-193.ec2.internal\" DevicePath \"\"" Jun 02 21:43:06.785595 ip-10-0-138-193 kubenswrapper[2578]: I0602 21:43:06.785530 2578 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/4d243294-8ef4-40c4-98e3-706837f6f029-bundle\") on node \"ip-10-0-138-193.ec2.internal\" DevicePath \"\"" Jun 02 21:43:06.785595 ip-10-0-138-193 kubenswrapper[2578]: I0602 21:43:06.785546 2578 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-qrshd\" (UniqueName: \"kubernetes.io/projected/f3084f1b-4f7b-4f79-b903-67f3e60d4be3-kube-api-access-qrshd\") on node \"ip-10-0-138-193.ec2.internal\" DevicePath \"\"" Jun 02 21:43:06.785595 ip-10-0-138-193 kubenswrapper[2578]: I0602 21:43:06.785560 2578 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/f3084f1b-4f7b-4f79-b903-67f3e60d4be3-util\") on node \"ip-10-0-138-193.ec2.internal\" DevicePath \"\"" Jun 02 21:43:06.785595 ip-10-0-138-193 kubenswrapper[2578]: I0602 21:43:06.785573 2578 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/f3084f1b-4f7b-4f79-b903-67f3e60d4be3-bundle\") on node \"ip-10-0-138-193.ec2.internal\" DevicePath \"\"" Jun 02 21:43:06.785595 ip-10-0-138-193 kubenswrapper[2578]: I0602 21:43:06.785584 2578 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/4d243294-8ef4-40c4-98e3-706837f6f029-util\") on node \"ip-10-0-138-193.ec2.internal\" DevicePath \"\"" Jun 02 21:43:07.462062 ip-10-0-138-193 kubenswrapper[2578]: I0602 21:43:07.462025 2578 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759tn29v" event={"ID":"f3084f1b-4f7b-4f79-b903-67f3e60d4be3","Type":"ContainerDied","Data":"a5554c2809808cd4a1bc5697dcdc16bfa56095430715ba39a3d5b6e45d50b570"} Jun 02 21:43:07.462062 ip-10-0-138-193 kubenswrapper[2578]: I0602 21:43:07.462056 2578 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759tn29v" Jun 02 21:43:07.462062 ip-10-0-138-193 kubenswrapper[2578]: I0602 21:43:07.462063 2578 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="a5554c2809808cd4a1bc5697dcdc16bfa56095430715ba39a3d5b6e45d50b570" Jun 02 21:43:07.463912 ip-10-0-138-193 kubenswrapper[2578]: I0602 21:43:07.463890 2578 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73t4pqf" Jun 02 21:43:07.464047 ip-10-0-138-193 kubenswrapper[2578]: I0602 21:43:07.463894 2578 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73t4pqf" event={"ID":"4d243294-8ef4-40c4-98e3-706837f6f029","Type":"ContainerDied","Data":"e459c03ba5c1b259ef4cf238717351f7a2d276a7278c457724520c237eebd4a2"} Jun 02 21:43:07.464047 ip-10-0-138-193 kubenswrapper[2578]: I0602 21:43:07.463984 2578 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="e459c03ba5c1b259ef4cf238717351f7a2d276a7278c457724520c237eebd4a2" Jun 02 21:43:13.051596 ip-10-0-138-193 kubenswrapper[2578]: I0602 21:43:13.051557 2578 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-console/console-7f9dc49f9c-hbtw6"] Jun 02 21:43:13.052048 ip-10-0-138-193 kubenswrapper[2578]: I0602 21:43:13.051943 2578 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="4d243294-8ef4-40c4-98e3-706837f6f029" containerName="util" Jun 02 21:43:13.052048 ip-10-0-138-193 kubenswrapper[2578]: I0602 21:43:13.051956 2578 state_mem.go:107] "Deleted CPUSet assignment" podUID="4d243294-8ef4-40c4-98e3-706837f6f029" containerName="util" Jun 02 21:43:13.052048 ip-10-0-138-193 kubenswrapper[2578]: I0602 21:43:13.051968 2578 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="27c2b3fa-8f2b-4dd8-9456-d2fab70b1175" containerName="extract" Jun 02 21:43:13.052048 ip-10-0-138-193 kubenswrapper[2578]: I0602 21:43:13.051973 2578 state_mem.go:107] "Deleted CPUSet assignment" podUID="27c2b3fa-8f2b-4dd8-9456-d2fab70b1175" containerName="extract" Jun 02 21:43:13.052048 ip-10-0-138-193 kubenswrapper[2578]: I0602 21:43:13.051981 2578 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="f44c4e83-da4f-4bbb-9718-c91b64f402e0" containerName="util" Jun 02 21:43:13.052048 ip-10-0-138-193 kubenswrapper[2578]: I0602 21:43:13.051986 2578 state_mem.go:107] "Deleted CPUSet assignment" podUID="f44c4e83-da4f-4bbb-9718-c91b64f402e0" containerName="util" Jun 02 21:43:13.052048 ip-10-0-138-193 kubenswrapper[2578]: I0602 21:43:13.051995 2578 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="4d243294-8ef4-40c4-98e3-706837f6f029" containerName="pull" Jun 02 21:43:13.052048 ip-10-0-138-193 kubenswrapper[2578]: I0602 21:43:13.052000 2578 state_mem.go:107] "Deleted CPUSet assignment" podUID="4d243294-8ef4-40c4-98e3-706837f6f029" containerName="pull" Jun 02 21:43:13.052048 ip-10-0-138-193 kubenswrapper[2578]: I0602 21:43:13.052006 2578 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="f3084f1b-4f7b-4f79-b903-67f3e60d4be3" containerName="extract" Jun 02 21:43:13.052048 ip-10-0-138-193 kubenswrapper[2578]: I0602 21:43:13.052011 2578 state_mem.go:107] "Deleted CPUSet assignment" podUID="f3084f1b-4f7b-4f79-b903-67f3e60d4be3" containerName="extract" Jun 02 21:43:13.052048 ip-10-0-138-193 kubenswrapper[2578]: I0602 21:43:13.052018 2578 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="f3084f1b-4f7b-4f79-b903-67f3e60d4be3" containerName="pull" Jun 02 21:43:13.052048 ip-10-0-138-193 kubenswrapper[2578]: I0602 21:43:13.052024 2578 state_mem.go:107] "Deleted CPUSet assignment" podUID="f3084f1b-4f7b-4f79-b903-67f3e60d4be3" containerName="pull" Jun 02 21:43:13.052048 ip-10-0-138-193 kubenswrapper[2578]: I0602 21:43:13.052038 2578 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="27c2b3fa-8f2b-4dd8-9456-d2fab70b1175" containerName="util" Jun 02 21:43:13.052048 ip-10-0-138-193 kubenswrapper[2578]: I0602 21:43:13.052043 2578 state_mem.go:107] "Deleted CPUSet assignment" podUID="27c2b3fa-8f2b-4dd8-9456-d2fab70b1175" containerName="util" Jun 02 21:43:13.052048 ip-10-0-138-193 kubenswrapper[2578]: I0602 21:43:13.052047 2578 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="f3084f1b-4f7b-4f79-b903-67f3e60d4be3" containerName="util" Jun 02 21:43:13.052048 ip-10-0-138-193 kubenswrapper[2578]: I0602 21:43:13.052052 2578 state_mem.go:107] "Deleted CPUSet assignment" podUID="f3084f1b-4f7b-4f79-b903-67f3e60d4be3" containerName="util" Jun 02 21:43:13.052048 ip-10-0-138-193 kubenswrapper[2578]: I0602 21:43:13.052058 2578 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="27c2b3fa-8f2b-4dd8-9456-d2fab70b1175" containerName="pull" Jun 02 21:43:13.052615 ip-10-0-138-193 kubenswrapper[2578]: I0602 21:43:13.052063 2578 state_mem.go:107] "Deleted CPUSet assignment" podUID="27c2b3fa-8f2b-4dd8-9456-d2fab70b1175" containerName="pull" Jun 02 21:43:13.052615 ip-10-0-138-193 kubenswrapper[2578]: I0602 21:43:13.052068 2578 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="4d243294-8ef4-40c4-98e3-706837f6f029" containerName="extract" Jun 02 21:43:13.052615 ip-10-0-138-193 kubenswrapper[2578]: I0602 21:43:13.052087 2578 state_mem.go:107] "Deleted CPUSet assignment" podUID="4d243294-8ef4-40c4-98e3-706837f6f029" containerName="extract" Jun 02 21:43:13.052615 ip-10-0-138-193 kubenswrapper[2578]: I0602 21:43:13.052096 2578 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="f44c4e83-da4f-4bbb-9718-c91b64f402e0" containerName="pull" Jun 02 21:43:13.052615 ip-10-0-138-193 kubenswrapper[2578]: I0602 21:43:13.052101 2578 state_mem.go:107] "Deleted CPUSet assignment" podUID="f44c4e83-da4f-4bbb-9718-c91b64f402e0" containerName="pull" Jun 02 21:43:13.052615 ip-10-0-138-193 kubenswrapper[2578]: I0602 21:43:13.052107 2578 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="f44c4e83-da4f-4bbb-9718-c91b64f402e0" containerName="extract" Jun 02 21:43:13.052615 ip-10-0-138-193 kubenswrapper[2578]: I0602 21:43:13.052113 2578 state_mem.go:107] "Deleted CPUSet assignment" podUID="f44c4e83-da4f-4bbb-9718-c91b64f402e0" containerName="extract" Jun 02 21:43:13.052615 ip-10-0-138-193 kubenswrapper[2578]: I0602 21:43:13.052164 2578 memory_manager.go:356] "RemoveStaleState removing state" podUID="27c2b3fa-8f2b-4dd8-9456-d2fab70b1175" containerName="extract" Jun 02 21:43:13.052615 ip-10-0-138-193 kubenswrapper[2578]: I0602 21:43:13.052171 2578 memory_manager.go:356] "RemoveStaleState removing state" podUID="f3084f1b-4f7b-4f79-b903-67f3e60d4be3" containerName="extract" Jun 02 21:43:13.052615 ip-10-0-138-193 kubenswrapper[2578]: I0602 21:43:13.052178 2578 memory_manager.go:356] "RemoveStaleState removing state" podUID="4d243294-8ef4-40c4-98e3-706837f6f029" containerName="extract" Jun 02 21:43:13.052615 ip-10-0-138-193 kubenswrapper[2578]: I0602 21:43:13.052187 2578 memory_manager.go:356] "RemoveStaleState removing state" podUID="f44c4e83-da4f-4bbb-9718-c91b64f402e0" containerName="extract" Jun 02 21:43:13.056736 ip-10-0-138-193 kubenswrapper[2578]: I0602 21:43:13.056715 2578 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-7f9dc49f9c-hbtw6" Jun 02 21:43:13.063991 ip-10-0-138-193 kubenswrapper[2578]: I0602 21:43:13.063964 2578 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-7f9dc49f9c-hbtw6"] Jun 02 21:43:13.134357 ip-10-0-138-193 kubenswrapper[2578]: I0602 21:43:13.134320 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/491e7e65-ef20-492a-a4e8-49f7d8546802-trusted-ca-bundle\") pod \"console-7f9dc49f9c-hbtw6\" (UID: \"491e7e65-ef20-492a-a4e8-49f7d8546802\") " pod="openshift-console/console-7f9dc49f9c-hbtw6" Jun 02 21:43:13.134527 ip-10-0-138-193 kubenswrapper[2578]: I0602 21:43:13.134382 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-jlxlm\" (UniqueName: \"kubernetes.io/projected/491e7e65-ef20-492a-a4e8-49f7d8546802-kube-api-access-jlxlm\") pod \"console-7f9dc49f9c-hbtw6\" (UID: \"491e7e65-ef20-492a-a4e8-49f7d8546802\") " pod="openshift-console/console-7f9dc49f9c-hbtw6" Jun 02 21:43:13.134527 ip-10-0-138-193 kubenswrapper[2578]: I0602 21:43:13.134419 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/491e7e65-ef20-492a-a4e8-49f7d8546802-console-serving-cert\") pod \"console-7f9dc49f9c-hbtw6\" (UID: \"491e7e65-ef20-492a-a4e8-49f7d8546802\") " pod="openshift-console/console-7f9dc49f9c-hbtw6" Jun 02 21:43:13.134527 ip-10-0-138-193 kubenswrapper[2578]: I0602 21:43:13.134434 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/491e7e65-ef20-492a-a4e8-49f7d8546802-console-config\") pod \"console-7f9dc49f9c-hbtw6\" (UID: \"491e7e65-ef20-492a-a4e8-49f7d8546802\") " pod="openshift-console/console-7f9dc49f9c-hbtw6" Jun 02 21:43:13.134527 ip-10-0-138-193 kubenswrapper[2578]: I0602 21:43:13.134465 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/491e7e65-ef20-492a-a4e8-49f7d8546802-console-oauth-config\") pod \"console-7f9dc49f9c-hbtw6\" (UID: \"491e7e65-ef20-492a-a4e8-49f7d8546802\") " pod="openshift-console/console-7f9dc49f9c-hbtw6" Jun 02 21:43:13.134702 ip-10-0-138-193 kubenswrapper[2578]: I0602 21:43:13.134551 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/491e7e65-ef20-492a-a4e8-49f7d8546802-service-ca\") pod \"console-7f9dc49f9c-hbtw6\" (UID: \"491e7e65-ef20-492a-a4e8-49f7d8546802\") " pod="openshift-console/console-7f9dc49f9c-hbtw6" Jun 02 21:43:13.134702 ip-10-0-138-193 kubenswrapper[2578]: I0602 21:43:13.134587 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/491e7e65-ef20-492a-a4e8-49f7d8546802-oauth-serving-cert\") pod \"console-7f9dc49f9c-hbtw6\" (UID: \"491e7e65-ef20-492a-a4e8-49f7d8546802\") " pod="openshift-console/console-7f9dc49f9c-hbtw6" Jun 02 21:43:13.235223 ip-10-0-138-193 kubenswrapper[2578]: I0602 21:43:13.235183 2578 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-jlxlm\" (UniqueName: \"kubernetes.io/projected/491e7e65-ef20-492a-a4e8-49f7d8546802-kube-api-access-jlxlm\") pod \"console-7f9dc49f9c-hbtw6\" (UID: \"491e7e65-ef20-492a-a4e8-49f7d8546802\") " pod="openshift-console/console-7f9dc49f9c-hbtw6" Jun 02 21:43:13.235410 ip-10-0-138-193 kubenswrapper[2578]: I0602 21:43:13.235241 2578 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/491e7e65-ef20-492a-a4e8-49f7d8546802-console-serving-cert\") pod \"console-7f9dc49f9c-hbtw6\" (UID: \"491e7e65-ef20-492a-a4e8-49f7d8546802\") " pod="openshift-console/console-7f9dc49f9c-hbtw6" Jun 02 21:43:13.235410 ip-10-0-138-193 kubenswrapper[2578]: I0602 21:43:13.235265 2578 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/491e7e65-ef20-492a-a4e8-49f7d8546802-console-config\") pod \"console-7f9dc49f9c-hbtw6\" (UID: \"491e7e65-ef20-492a-a4e8-49f7d8546802\") " pod="openshift-console/console-7f9dc49f9c-hbtw6" Jun 02 21:43:13.235410 ip-10-0-138-193 kubenswrapper[2578]: I0602 21:43:13.235292 2578 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/491e7e65-ef20-492a-a4e8-49f7d8546802-console-oauth-config\") pod \"console-7f9dc49f9c-hbtw6\" (UID: \"491e7e65-ef20-492a-a4e8-49f7d8546802\") " pod="openshift-console/console-7f9dc49f9c-hbtw6" Jun 02 21:43:13.235410 ip-10-0-138-193 kubenswrapper[2578]: I0602 21:43:13.235330 2578 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/491e7e65-ef20-492a-a4e8-49f7d8546802-service-ca\") pod \"console-7f9dc49f9c-hbtw6\" (UID: \"491e7e65-ef20-492a-a4e8-49f7d8546802\") " pod="openshift-console/console-7f9dc49f9c-hbtw6" Jun 02 21:43:13.235410 ip-10-0-138-193 kubenswrapper[2578]: I0602 21:43:13.235362 2578 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/491e7e65-ef20-492a-a4e8-49f7d8546802-oauth-serving-cert\") pod \"console-7f9dc49f9c-hbtw6\" (UID: \"491e7e65-ef20-492a-a4e8-49f7d8546802\") " pod="openshift-console/console-7f9dc49f9c-hbtw6" Jun 02 21:43:13.235677 ip-10-0-138-193 kubenswrapper[2578]: I0602 21:43:13.235413 2578 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/491e7e65-ef20-492a-a4e8-49f7d8546802-trusted-ca-bundle\") pod \"console-7f9dc49f9c-hbtw6\" (UID: \"491e7e65-ef20-492a-a4e8-49f7d8546802\") " pod="openshift-console/console-7f9dc49f9c-hbtw6" Jun 02 21:43:13.236221 ip-10-0-138-193 kubenswrapper[2578]: I0602 21:43:13.236194 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/491e7e65-ef20-492a-a4e8-49f7d8546802-service-ca\") pod \"console-7f9dc49f9c-hbtw6\" (UID: \"491e7e65-ef20-492a-a4e8-49f7d8546802\") " pod="openshift-console/console-7f9dc49f9c-hbtw6" Jun 02 21:43:13.236369 ip-10-0-138-193 kubenswrapper[2578]: I0602 21:43:13.236230 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/491e7e65-ef20-492a-a4e8-49f7d8546802-console-config\") pod \"console-7f9dc49f9c-hbtw6\" (UID: \"491e7e65-ef20-492a-a4e8-49f7d8546802\") " pod="openshift-console/console-7f9dc49f9c-hbtw6" Jun 02 21:43:13.236369 ip-10-0-138-193 kubenswrapper[2578]: I0602 21:43:13.236281 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/491e7e65-ef20-492a-a4e8-49f7d8546802-oauth-serving-cert\") pod \"console-7f9dc49f9c-hbtw6\" (UID: \"491e7e65-ef20-492a-a4e8-49f7d8546802\") " pod="openshift-console/console-7f9dc49f9c-hbtw6" Jun 02 21:43:13.236491 ip-10-0-138-193 kubenswrapper[2578]: I0602 21:43:13.236379 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/491e7e65-ef20-492a-a4e8-49f7d8546802-trusted-ca-bundle\") pod \"console-7f9dc49f9c-hbtw6\" (UID: \"491e7e65-ef20-492a-a4e8-49f7d8546802\") " pod="openshift-console/console-7f9dc49f9c-hbtw6" Jun 02 21:43:13.237849 ip-10-0-138-193 kubenswrapper[2578]: I0602 21:43:13.237830 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/491e7e65-ef20-492a-a4e8-49f7d8546802-console-oauth-config\") pod \"console-7f9dc49f9c-hbtw6\" (UID: \"491e7e65-ef20-492a-a4e8-49f7d8546802\") " pod="openshift-console/console-7f9dc49f9c-hbtw6" Jun 02 21:43:13.237950 ip-10-0-138-193 kubenswrapper[2578]: I0602 21:43:13.237904 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/491e7e65-ef20-492a-a4e8-49f7d8546802-console-serving-cert\") pod \"console-7f9dc49f9c-hbtw6\" (UID: \"491e7e65-ef20-492a-a4e8-49f7d8546802\") " pod="openshift-console/console-7f9dc49f9c-hbtw6" Jun 02 21:43:13.243247 ip-10-0-138-193 kubenswrapper[2578]: I0602 21:43:13.243228 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-jlxlm\" (UniqueName: \"kubernetes.io/projected/491e7e65-ef20-492a-a4e8-49f7d8546802-kube-api-access-jlxlm\") pod \"console-7f9dc49f9c-hbtw6\" (UID: \"491e7e65-ef20-492a-a4e8-49f7d8546802\") " pod="openshift-console/console-7f9dc49f9c-hbtw6" Jun 02 21:43:13.367627 ip-10-0-138-193 kubenswrapper[2578]: I0602 21:43:13.367535 2578 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-7f9dc49f9c-hbtw6" Jun 02 21:43:13.514254 ip-10-0-138-193 kubenswrapper[2578]: I0602 21:43:13.514217 2578 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-7f9dc49f9c-hbtw6"] Jun 02 21:43:13.515740 ip-10-0-138-193 kubenswrapper[2578]: W0602 21:43:13.515713 2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod491e7e65_ef20_492a_a4e8_49f7d8546802.slice/crio-1986405d0a5dbcf17aaceb0e96c49ee139568b15bcc31adb5ec68a3d37b9919c WatchSource:0}: Error finding container 1986405d0a5dbcf17aaceb0e96c49ee139568b15bcc31adb5ec68a3d37b9919c: Status 404 returned error can't find the container with id 1986405d0a5dbcf17aaceb0e96c49ee139568b15bcc31adb5ec68a3d37b9919c Jun 02 21:43:14.494257 ip-10-0-138-193 kubenswrapper[2578]: I0602 21:43:14.494215 2578 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-7f9dc49f9c-hbtw6" event={"ID":"491e7e65-ef20-492a-a4e8-49f7d8546802","Type":"ContainerStarted","Data":"7b64ef1486515a1518f092d81e89d25cd8e17a486b0d50c0d684c441b66aa188"} Jun 02 21:43:14.494257 ip-10-0-138-193 kubenswrapper[2578]: I0602 21:43:14.494254 2578 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-7f9dc49f9c-hbtw6" event={"ID":"491e7e65-ef20-492a-a4e8-49f7d8546802","Type":"ContainerStarted","Data":"1986405d0a5dbcf17aaceb0e96c49ee139568b15bcc31adb5ec68a3d37b9919c"} Jun 02 21:43:14.511274 ip-10-0-138-193 kubenswrapper[2578]: I0602 21:43:14.511222 2578 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-console/console-7f9dc49f9c-hbtw6" podStartSLOduration=1.511207459 podStartE2EDuration="1.511207459s" podCreationTimestamp="2026-06-02 21:43:13 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2026-06-02 21:43:14.509336709 +0000 UTC m=+571.761234628" watchObservedRunningTime="2026-06-02 21:43:14.511207459 +0000 UTC m=+571.763105364" Jun 02 21:43:23.368326 ip-10-0-138-193 kubenswrapper[2578]: I0602 21:43:23.368293 2578 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/console-7f9dc49f9c-hbtw6" Jun 02 21:43:23.368326 ip-10-0-138-193 kubenswrapper[2578]: I0602 21:43:23.368333 2578 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-console/console-7f9dc49f9c-hbtw6" Jun 02 21:43:23.373402 ip-10-0-138-193 kubenswrapper[2578]: I0602 21:43:23.373374 2578 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-console/console-7f9dc49f9c-hbtw6" Jun 02 21:43:23.539151 ip-10-0-138-193 kubenswrapper[2578]: I0602 21:43:23.539125 2578 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console/console-7f9dc49f9c-hbtw6" Jun 02 21:43:23.586110 ip-10-0-138-193 kubenswrapper[2578]: I0602 21:43:23.586059 2578 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openshift-console/console-6b5f69b87-7qjqs"] Jun 02 21:43:25.196191 ip-10-0-138-193 kubenswrapper[2578]: I0602 21:43:25.196151 2578 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-5f895dd7d5-xcjn5"] Jun 02 21:43:25.199885 ip-10-0-138-193 kubenswrapper[2578]: I0602 21:43:25.199859 2578 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-5f895dd7d5-xcjn5" Jun 02 21:43:25.202627 ip-10-0-138-193 kubenswrapper[2578]: I0602 21:43:25.202607 2578 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"openshift-service-ca.crt\"" Jun 02 21:43:25.202710 ip-10-0-138-193 kubenswrapper[2578]: I0602 21:43:25.202607 2578 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"kuadrant-operator-controller-manager-dockercfg-87zqm\"" Jun 02 21:43:25.202710 ip-10-0-138-193 kubenswrapper[2578]: I0602 21:43:25.202607 2578 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"kube-root-ca.crt\"" Jun 02 21:43:25.216974 ip-10-0-138-193 kubenswrapper[2578]: I0602 21:43:25.216945 2578 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-5f895dd7d5-xcjn5"] Jun 02 21:43:25.253481 ip-10-0-138-193 kubenswrapper[2578]: I0602 21:43:25.253443 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-c87nd\" (UniqueName: \"kubernetes.io/projected/a7ecc669-e5b2-4985-81a7-d1aa2c3a4764-kube-api-access-c87nd\") pod \"kuadrant-operator-controller-manager-5f895dd7d5-xcjn5\" (UID: \"a7ecc669-e5b2-4985-81a7-d1aa2c3a4764\") " pod="kuadrant-system/kuadrant-operator-controller-manager-5f895dd7d5-xcjn5" Jun 02 21:43:25.253640 ip-10-0-138-193 kubenswrapper[2578]: I0602 21:43:25.253488 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/a7ecc669-e5b2-4985-81a7-d1aa2c3a4764-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-5f895dd7d5-xcjn5\" (UID: \"a7ecc669-e5b2-4985-81a7-d1aa2c3a4764\") " pod="kuadrant-system/kuadrant-operator-controller-manager-5f895dd7d5-xcjn5" Jun 02 21:43:25.355019 ip-10-0-138-193 kubenswrapper[2578]: I0602 21:43:25.354976 2578 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-c87nd\" (UniqueName: \"kubernetes.io/projected/a7ecc669-e5b2-4985-81a7-d1aa2c3a4764-kube-api-access-c87nd\") pod \"kuadrant-operator-controller-manager-5f895dd7d5-xcjn5\" (UID: \"a7ecc669-e5b2-4985-81a7-d1aa2c3a4764\") " pod="kuadrant-system/kuadrant-operator-controller-manager-5f895dd7d5-xcjn5" Jun 02 21:43:25.355019 ip-10-0-138-193 kubenswrapper[2578]: I0602 21:43:25.355027 2578 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/a7ecc669-e5b2-4985-81a7-d1aa2c3a4764-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-5f895dd7d5-xcjn5\" (UID: \"a7ecc669-e5b2-4985-81a7-d1aa2c3a4764\") " pod="kuadrant-system/kuadrant-operator-controller-manager-5f895dd7d5-xcjn5" Jun 02 21:43:25.355445 ip-10-0-138-193 kubenswrapper[2578]: I0602 21:43:25.355424 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/a7ecc669-e5b2-4985-81a7-d1aa2c3a4764-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-5f895dd7d5-xcjn5\" (UID: \"a7ecc669-e5b2-4985-81a7-d1aa2c3a4764\") " pod="kuadrant-system/kuadrant-operator-controller-manager-5f895dd7d5-xcjn5" Jun 02 21:43:25.363003 ip-10-0-138-193 kubenswrapper[2578]: I0602 21:43:25.362970 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-c87nd\" (UniqueName: \"kubernetes.io/projected/a7ecc669-e5b2-4985-81a7-d1aa2c3a4764-kube-api-access-c87nd\") pod \"kuadrant-operator-controller-manager-5f895dd7d5-xcjn5\" (UID: \"a7ecc669-e5b2-4985-81a7-d1aa2c3a4764\") " pod="kuadrant-system/kuadrant-operator-controller-manager-5f895dd7d5-xcjn5" Jun 02 21:43:25.511251 ip-10-0-138-193 kubenswrapper[2578]: I0602 21:43:25.511155 2578 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-5f895dd7d5-xcjn5" Jun 02 21:43:25.648321 ip-10-0-138-193 kubenswrapper[2578]: I0602 21:43:25.648293 2578 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-5f895dd7d5-xcjn5"] Jun 02 21:43:25.651453 ip-10-0-138-193 kubenswrapper[2578]: W0602 21:43:25.651421 2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poda7ecc669_e5b2_4985_81a7_d1aa2c3a4764.slice/crio-3b8e73f88f2752c71fbc6c548fb7eca47421ef0ef5b6bf8ea48b3ea5f30dad61 WatchSource:0}: Error finding container 3b8e73f88f2752c71fbc6c548fb7eca47421ef0ef5b6bf8ea48b3ea5f30dad61: Status 404 returned error can't find the container with id 3b8e73f88f2752c71fbc6c548fb7eca47421ef0ef5b6bf8ea48b3ea5f30dad61 Jun 02 21:43:26.545341 ip-10-0-138-193 kubenswrapper[2578]: I0602 21:43:26.545305 2578 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-5f895dd7d5-xcjn5" event={"ID":"a7ecc669-e5b2-4985-81a7-d1aa2c3a4764","Type":"ContainerStarted","Data":"3b8e73f88f2752c71fbc6c548fb7eca47421ef0ef5b6bf8ea48b3ea5f30dad61"} Jun 02 21:43:31.567848 ip-10-0-138-193 kubenswrapper[2578]: I0602 21:43:31.567811 2578 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-5f895dd7d5-xcjn5" event={"ID":"a7ecc669-e5b2-4985-81a7-d1aa2c3a4764","Type":"ContainerStarted","Data":"86507acf0b671a36eea86fce4d943bdcbe347461fe98fe0513439dea03808ae6"} Jun 02 21:43:31.568361 ip-10-0-138-193 kubenswrapper[2578]: I0602 21:43:31.567971 2578 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/kuadrant-operator-controller-manager-5f895dd7d5-xcjn5" Jun 02 21:43:31.594664 ip-10-0-138-193 kubenswrapper[2578]: I0602 21:43:31.594618 2578 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="kuadrant-system/kuadrant-operator-controller-manager-5f895dd7d5-xcjn5" podStartSLOduration=1.325036485 podStartE2EDuration="6.594603361s" podCreationTimestamp="2026-06-02 21:43:25 +0000 UTC" firstStartedPulling="2026-06-02 21:43:25.653988077 +0000 UTC m=+582.905885964" lastFinishedPulling="2026-06-02 21:43:30.923554955 +0000 UTC m=+588.175452840" observedRunningTime="2026-06-02 21:43:31.592648275 +0000 UTC m=+588.844546193" watchObservedRunningTime="2026-06-02 21:43:31.594603361 +0000 UTC m=+588.846501267" Jun 02 21:43:42.574602 ip-10-0-138-193 kubenswrapper[2578]: I0602 21:43:42.574569 2578 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/kuadrant-operator-controller-manager-5f895dd7d5-xcjn5" Jun 02 21:43:43.238361 ip-10-0-138-193 kubenswrapper[2578]: I0602 21:43:43.238331 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-5zgzd_ecde3d34-b3a4-422b-9a2d-c8a4541cc718/ovn-acl-logging/0.log" Jun 02 21:43:43.239000 ip-10-0-138-193 kubenswrapper[2578]: I0602 21:43:43.238977 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-5zgzd_ecde3d34-b3a4-422b-9a2d-c8a4541cc718/ovn-acl-logging/0.log" Jun 02 21:43:43.656277 ip-10-0-138-193 kubenswrapper[2578]: I0602 21:43:43.656232 2578 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-6bc9f4c76f-pzpvp"] Jun 02 21:43:43.661600 ip-10-0-138-193 kubenswrapper[2578]: I0602 21:43:43.661582 2578 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-6bc9f4c76f-pzpvp" Jun 02 21:43:43.680281 ip-10-0-138-193 kubenswrapper[2578]: I0602 21:43:43.680247 2578 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-6bc9f4c76f-pzpvp"] Jun 02 21:43:43.834767 ip-10-0-138-193 kubenswrapper[2578]: I0602 21:43:43.834709 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-krh9t\" (UniqueName: \"kubernetes.io/projected/9bfd0c93-9448-41c0-9bc9-489dece41deb-kube-api-access-krh9t\") pod \"kuadrant-operator-controller-manager-6bc9f4c76f-pzpvp\" (UID: \"9bfd0c93-9448-41c0-9bc9-489dece41deb\") " pod="kuadrant-system/kuadrant-operator-controller-manager-6bc9f4c76f-pzpvp" Jun 02 21:43:43.834970 ip-10-0-138-193 kubenswrapper[2578]: I0602 21:43:43.834846 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/9bfd0c93-9448-41c0-9bc9-489dece41deb-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-6bc9f4c76f-pzpvp\" (UID: \"9bfd0c93-9448-41c0-9bc9-489dece41deb\") " pod="kuadrant-system/kuadrant-operator-controller-manager-6bc9f4c76f-pzpvp" Jun 02 21:43:43.935992 ip-10-0-138-193 kubenswrapper[2578]: I0602 21:43:43.935886 2578 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-krh9t\" (UniqueName: \"kubernetes.io/projected/9bfd0c93-9448-41c0-9bc9-489dece41deb-kube-api-access-krh9t\") pod \"kuadrant-operator-controller-manager-6bc9f4c76f-pzpvp\" (UID: \"9bfd0c93-9448-41c0-9bc9-489dece41deb\") " pod="kuadrant-system/kuadrant-operator-controller-manager-6bc9f4c76f-pzpvp" Jun 02 21:43:43.935992 ip-10-0-138-193 kubenswrapper[2578]: I0602 21:43:43.935986 2578 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/9bfd0c93-9448-41c0-9bc9-489dece41deb-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-6bc9f4c76f-pzpvp\" (UID: \"9bfd0c93-9448-41c0-9bc9-489dece41deb\") " pod="kuadrant-system/kuadrant-operator-controller-manager-6bc9f4c76f-pzpvp" Jun 02 21:43:43.936423 ip-10-0-138-193 kubenswrapper[2578]: I0602 21:43:43.936400 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/9bfd0c93-9448-41c0-9bc9-489dece41deb-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-6bc9f4c76f-pzpvp\" (UID: \"9bfd0c93-9448-41c0-9bc9-489dece41deb\") " pod="kuadrant-system/kuadrant-operator-controller-manager-6bc9f4c76f-pzpvp" Jun 02 21:43:43.944441 ip-10-0-138-193 kubenswrapper[2578]: I0602 21:43:43.944412 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-krh9t\" (UniqueName: \"kubernetes.io/projected/9bfd0c93-9448-41c0-9bc9-489dece41deb-kube-api-access-krh9t\") pod \"kuadrant-operator-controller-manager-6bc9f4c76f-pzpvp\" (UID: \"9bfd0c93-9448-41c0-9bc9-489dece41deb\") " pod="kuadrant-system/kuadrant-operator-controller-manager-6bc9f4c76f-pzpvp" Jun 02 21:43:43.972261 ip-10-0-138-193 kubenswrapper[2578]: I0602 21:43:43.972224 2578 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-6bc9f4c76f-pzpvp" Jun 02 21:43:44.111605 ip-10-0-138-193 kubenswrapper[2578]: I0602 21:43:44.111578 2578 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-6bc9f4c76f-pzpvp"] Jun 02 21:43:44.113726 ip-10-0-138-193 kubenswrapper[2578]: W0602 21:43:44.113684 2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod9bfd0c93_9448_41c0_9bc9_489dece41deb.slice/crio-22350c340bda4552419347fec09f3925983be39484f86db9c1c73be6b2368f0b WatchSource:0}: Error finding container 22350c340bda4552419347fec09f3925983be39484f86db9c1c73be6b2368f0b: Status 404 returned error can't find the container with id 22350c340bda4552419347fec09f3925983be39484f86db9c1c73be6b2368f0b Jun 02 21:43:44.305517 ip-10-0-138-193 kubenswrapper[2578]: I0602 21:43:44.305431 2578 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-5f895dd7d5-xcjn5"] Jun 02 21:43:44.305720 ip-10-0-138-193 kubenswrapper[2578]: I0602 21:43:44.305673 2578 kuberuntime_container.go:864] "Killing container with a grace period" pod="kuadrant-system/kuadrant-operator-controller-manager-5f895dd7d5-xcjn5" podUID="a7ecc669-e5b2-4985-81a7-d1aa2c3a4764" containerName="manager" containerID="cri-o://86507acf0b671a36eea86fce4d943bdcbe347461fe98fe0513439dea03808ae6" gracePeriod=2 Jun 02 21:43:44.313528 ip-10-0-138-193 kubenswrapper[2578]: I0602 21:43:44.313500 2578 kubelet.go:2547] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-5f895dd7d5-xcjn5"] Jun 02 21:43:44.323914 ip-10-0-138-193 kubenswrapper[2578]: I0602 21:43:44.323853 2578 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-5f895dd7d5-84rdj"] Jun 02 21:43:44.332140 ip-10-0-138-193 kubenswrapper[2578]: I0602 21:43:44.325191 2578 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="a7ecc669-e5b2-4985-81a7-d1aa2c3a4764" containerName="manager" Jun 02 21:43:44.332140 ip-10-0-138-193 kubenswrapper[2578]: I0602 21:43:44.325218 2578 state_mem.go:107] "Deleted CPUSet assignment" podUID="a7ecc669-e5b2-4985-81a7-d1aa2c3a4764" containerName="manager" Jun 02 21:43:44.332140 ip-10-0-138-193 kubenswrapper[2578]: I0602 21:43:44.325923 2578 memory_manager.go:356] "RemoveStaleState removing state" podUID="a7ecc669-e5b2-4985-81a7-d1aa2c3a4764" containerName="manager" Jun 02 21:43:44.341586 ip-10-0-138-193 kubenswrapper[2578]: I0602 21:43:44.341542 2578 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-6bc9f4c76f-pzpvp"] Jun 02 21:43:44.341755 ip-10-0-138-193 kubenswrapper[2578]: I0602 21:43:44.341706 2578 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-5f895dd7d5-84rdj" Jun 02 21:43:44.343758 ip-10-0-138-193 kubenswrapper[2578]: I0602 21:43:44.343718 2578 kubelet.go:2547] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-6bc9f4c76f-pzpvp"] Jun 02 21:43:44.345519 ip-10-0-138-193 kubenswrapper[2578]: I0602 21:43:44.345485 2578 status_manager.go:895] "Failed to get status for pod" podUID="a7ecc669-e5b2-4985-81a7-d1aa2c3a4764" pod="kuadrant-system/kuadrant-operator-controller-manager-5f895dd7d5-xcjn5" err="pods \"kuadrant-operator-controller-manager-5f895dd7d5-xcjn5\" is forbidden: User \"system:node:ip-10-0-138-193.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-138-193.ec2.internal' and this object" Jun 02 21:43:44.346306 ip-10-0-138-193 kubenswrapper[2578]: I0602 21:43:44.346284 2578 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-5f895dd7d5-84rdj"] Jun 02 21:43:44.352112 ip-10-0-138-193 kubenswrapper[2578]: I0602 21:43:44.352086 2578 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-6bc9f4c76f-m8fjc"] Jun 02 21:43:44.352801 ip-10-0-138-193 kubenswrapper[2578]: I0602 21:43:44.352724 2578 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="9bfd0c93-9448-41c0-9bc9-489dece41deb" containerName="manager" Jun 02 21:43:44.352801 ip-10-0-138-193 kubenswrapper[2578]: I0602 21:43:44.352747 2578 state_mem.go:107] "Deleted CPUSet assignment" podUID="9bfd0c93-9448-41c0-9bc9-489dece41deb" containerName="manager" Jun 02 21:43:44.352979 ip-10-0-138-193 kubenswrapper[2578]: I0602 21:43:44.352884 2578 memory_manager.go:356] "RemoveStaleState removing state" podUID="9bfd0c93-9448-41c0-9bc9-489dece41deb" containerName="manager" Jun 02 21:43:44.356394 ip-10-0-138-193 kubenswrapper[2578]: I0602 21:43:44.356278 2578 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-6bc9f4c76f-m8fjc" Jun 02 21:43:44.367643 ip-10-0-138-193 kubenswrapper[2578]: I0602 21:43:44.367614 2578 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-6bc9f4c76f-m8fjc"] Jun 02 21:43:44.375171 ip-10-0-138-193 kubenswrapper[2578]: I0602 21:43:44.375139 2578 status_manager.go:895] "Failed to get status for pod" podUID="a7ecc669-e5b2-4985-81a7-d1aa2c3a4764" pod="kuadrant-system/kuadrant-operator-controller-manager-5f895dd7d5-xcjn5" err="pods \"kuadrant-operator-controller-manager-5f895dd7d5-xcjn5\" is forbidden: User \"system:node:ip-10-0-138-193.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-138-193.ec2.internal' and this object" Jun 02 21:43:44.440613 ip-10-0-138-193 kubenswrapper[2578]: I0602 21:43:44.440570 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-tvvcz\" (UniqueName: \"kubernetes.io/projected/f30e83ab-883b-428c-902a-32a578e3b241-kube-api-access-tvvcz\") pod \"kuadrant-operator-controller-manager-6bc9f4c76f-m8fjc\" (UID: \"f30e83ab-883b-428c-902a-32a578e3b241\") " pod="kuadrant-system/kuadrant-operator-controller-manager-6bc9f4c76f-m8fjc" Jun 02 21:43:44.440613 ip-10-0-138-193 kubenswrapper[2578]: I0602 21:43:44.440615 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-z6dxc\" (UniqueName: \"kubernetes.io/projected/dfb257a8-c185-44ae-bbe0-cfc1a557945b-kube-api-access-z6dxc\") pod \"kuadrant-operator-controller-manager-5f895dd7d5-84rdj\" (UID: \"dfb257a8-c185-44ae-bbe0-cfc1a557945b\") " pod="kuadrant-system/kuadrant-operator-controller-manager-5f895dd7d5-84rdj" Jun 02 21:43:44.440873 ip-10-0-138-193 kubenswrapper[2578]: I0602 21:43:44.440689 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/f30e83ab-883b-428c-902a-32a578e3b241-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-6bc9f4c76f-m8fjc\" (UID: \"f30e83ab-883b-428c-902a-32a578e3b241\") " pod="kuadrant-system/kuadrant-operator-controller-manager-6bc9f4c76f-m8fjc" Jun 02 21:43:44.440873 ip-10-0-138-193 kubenswrapper[2578]: I0602 21:43:44.440769 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/dfb257a8-c185-44ae-bbe0-cfc1a557945b-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-5f895dd7d5-84rdj\" (UID: \"dfb257a8-c185-44ae-bbe0-cfc1a557945b\") " pod="kuadrant-system/kuadrant-operator-controller-manager-5f895dd7d5-84rdj" Jun 02 21:43:44.534195 ip-10-0-138-193 kubenswrapper[2578]: I0602 21:43:44.534172 2578 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-5f895dd7d5-xcjn5" Jun 02 21:43:44.536854 ip-10-0-138-193 kubenswrapper[2578]: I0602 21:43:44.536830 2578 status_manager.go:895] "Failed to get status for pod" podUID="a7ecc669-e5b2-4985-81a7-d1aa2c3a4764" pod="kuadrant-system/kuadrant-operator-controller-manager-5f895dd7d5-xcjn5" err="pods \"kuadrant-operator-controller-manager-5f895dd7d5-xcjn5\" is forbidden: User \"system:node:ip-10-0-138-193.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-138-193.ec2.internal' and this object" Jun 02 21:43:44.542261 ip-10-0-138-193 kubenswrapper[2578]: I0602 21:43:44.542237 2578 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/dfb257a8-c185-44ae-bbe0-cfc1a557945b-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-5f895dd7d5-84rdj\" (UID: \"dfb257a8-c185-44ae-bbe0-cfc1a557945b\") " pod="kuadrant-system/kuadrant-operator-controller-manager-5f895dd7d5-84rdj" Jun 02 21:43:44.542365 ip-10-0-138-193 kubenswrapper[2578]: I0602 21:43:44.542340 2578 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-tvvcz\" (UniqueName: \"kubernetes.io/projected/f30e83ab-883b-428c-902a-32a578e3b241-kube-api-access-tvvcz\") pod \"kuadrant-operator-controller-manager-6bc9f4c76f-m8fjc\" (UID: \"f30e83ab-883b-428c-902a-32a578e3b241\") " pod="kuadrant-system/kuadrant-operator-controller-manager-6bc9f4c76f-m8fjc" Jun 02 21:43:44.542430 ip-10-0-138-193 kubenswrapper[2578]: I0602 21:43:44.542372 2578 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-z6dxc\" (UniqueName: \"kubernetes.io/projected/dfb257a8-c185-44ae-bbe0-cfc1a557945b-kube-api-access-z6dxc\") pod \"kuadrant-operator-controller-manager-5f895dd7d5-84rdj\" (UID: \"dfb257a8-c185-44ae-bbe0-cfc1a557945b\") " pod="kuadrant-system/kuadrant-operator-controller-manager-5f895dd7d5-84rdj" Jun 02 21:43:44.542484 ip-10-0-138-193 kubenswrapper[2578]: I0602 21:43:44.542437 2578 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/f30e83ab-883b-428c-902a-32a578e3b241-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-6bc9f4c76f-m8fjc\" (UID: \"f30e83ab-883b-428c-902a-32a578e3b241\") " pod="kuadrant-system/kuadrant-operator-controller-manager-6bc9f4c76f-m8fjc" Jun 02 21:43:44.542636 ip-10-0-138-193 kubenswrapper[2578]: I0602 21:43:44.542615 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/dfb257a8-c185-44ae-bbe0-cfc1a557945b-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-5f895dd7d5-84rdj\" (UID: \"dfb257a8-c185-44ae-bbe0-cfc1a557945b\") " pod="kuadrant-system/kuadrant-operator-controller-manager-5f895dd7d5-84rdj" Jun 02 21:43:44.542815 ip-10-0-138-193 kubenswrapper[2578]: I0602 21:43:44.542797 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/f30e83ab-883b-428c-902a-32a578e3b241-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-6bc9f4c76f-m8fjc\" (UID: \"f30e83ab-883b-428c-902a-32a578e3b241\") " pod="kuadrant-system/kuadrant-operator-controller-manager-6bc9f4c76f-m8fjc" Jun 02 21:43:44.550907 ip-10-0-138-193 kubenswrapper[2578]: I0602 21:43:44.550885 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-tvvcz\" (UniqueName: \"kubernetes.io/projected/f30e83ab-883b-428c-902a-32a578e3b241-kube-api-access-tvvcz\") pod \"kuadrant-operator-controller-manager-6bc9f4c76f-m8fjc\" (UID: \"f30e83ab-883b-428c-902a-32a578e3b241\") " pod="kuadrant-system/kuadrant-operator-controller-manager-6bc9f4c76f-m8fjc" Jun 02 21:43:44.550989 ip-10-0-138-193 kubenswrapper[2578]: I0602 21:43:44.550952 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-z6dxc\" (UniqueName: \"kubernetes.io/projected/dfb257a8-c185-44ae-bbe0-cfc1a557945b-kube-api-access-z6dxc\") pod \"kuadrant-operator-controller-manager-5f895dd7d5-84rdj\" (UID: \"dfb257a8-c185-44ae-bbe0-cfc1a557945b\") " pod="kuadrant-system/kuadrant-operator-controller-manager-5f895dd7d5-84rdj" Jun 02 21:43:44.625254 ip-10-0-138-193 kubenswrapper[2578]: I0602 21:43:44.625158 2578 generic.go:358] "Generic (PLEG): container finished" podID="a7ecc669-e5b2-4985-81a7-d1aa2c3a4764" containerID="86507acf0b671a36eea86fce4d943bdcbe347461fe98fe0513439dea03808ae6" exitCode=0 Jun 02 21:43:44.625254 ip-10-0-138-193 kubenswrapper[2578]: I0602 21:43:44.625199 2578 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-5f895dd7d5-xcjn5" Jun 02 21:43:44.625254 ip-10-0-138-193 kubenswrapper[2578]: I0602 21:43:44.625250 2578 scope.go:117] "RemoveContainer" containerID="86507acf0b671a36eea86fce4d943bdcbe347461fe98fe0513439dea03808ae6" Jun 02 21:43:44.626996 ip-10-0-138-193 kubenswrapper[2578]: E0602 21:43:44.626978 2578 kuberuntime_manager.go:623] "Missing actuated resource record" pod="kuadrant-system/kuadrant-operator-controller-manager-6bc9f4c76f-pzpvp" container="manager" Jun 02 21:43:44.627532 ip-10-0-138-193 kubenswrapper[2578]: I0602 21:43:44.627508 2578 status_manager.go:895] "Failed to get status for pod" podUID="a7ecc669-e5b2-4985-81a7-d1aa2c3a4764" pod="kuadrant-system/kuadrant-operator-controller-manager-5f895dd7d5-xcjn5" err="pods \"kuadrant-operator-controller-manager-5f895dd7d5-xcjn5\" is forbidden: User \"system:node:ip-10-0-138-193.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-138-193.ec2.internal' and this object" Jun 02 21:43:44.629257 ip-10-0-138-193 kubenswrapper[2578]: I0602 21:43:44.629231 2578 status_manager.go:895] "Failed to get status for pod" podUID="a7ecc669-e5b2-4985-81a7-d1aa2c3a4764" pod="kuadrant-system/kuadrant-operator-controller-manager-5f895dd7d5-xcjn5" err="pods \"kuadrant-operator-controller-manager-5f895dd7d5-xcjn5\" is forbidden: User \"system:node:ip-10-0-138-193.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-138-193.ec2.internal' and this object" Jun 02 21:43:44.631063 ip-10-0-138-193 kubenswrapper[2578]: I0602 21:43:44.631038 2578 status_manager.go:895] "Failed to get status for pod" podUID="9bfd0c93-9448-41c0-9bc9-489dece41deb" pod="kuadrant-system/kuadrant-operator-controller-manager-6bc9f4c76f-pzpvp" err="pods \"kuadrant-operator-controller-manager-6bc9f4c76f-pzpvp\" is forbidden: User \"system:node:ip-10-0-138-193.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-138-193.ec2.internal' and this object" Jun 02 21:43:44.634647 ip-10-0-138-193 kubenswrapper[2578]: I0602 21:43:44.634631 2578 scope.go:117] "RemoveContainer" containerID="86507acf0b671a36eea86fce4d943bdcbe347461fe98fe0513439dea03808ae6" Jun 02 21:43:44.634899 ip-10-0-138-193 kubenswrapper[2578]: E0602 21:43:44.634881 2578 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"86507acf0b671a36eea86fce4d943bdcbe347461fe98fe0513439dea03808ae6\": container with ID starting with 86507acf0b671a36eea86fce4d943bdcbe347461fe98fe0513439dea03808ae6 not found: ID does not exist" containerID="86507acf0b671a36eea86fce4d943bdcbe347461fe98fe0513439dea03808ae6" Jun 02 21:43:44.634979 ip-10-0-138-193 kubenswrapper[2578]: I0602 21:43:44.634906 2578 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"86507acf0b671a36eea86fce4d943bdcbe347461fe98fe0513439dea03808ae6"} err="failed to get container status \"86507acf0b671a36eea86fce4d943bdcbe347461fe98fe0513439dea03808ae6\": rpc error: code = NotFound desc = could not find container \"86507acf0b671a36eea86fce4d943bdcbe347461fe98fe0513439dea03808ae6\": container with ID starting with 86507acf0b671a36eea86fce4d943bdcbe347461fe98fe0513439dea03808ae6 not found: ID does not exist" Jun 02 21:43:44.643698 ip-10-0-138-193 kubenswrapper[2578]: I0602 21:43:44.643672 2578 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/a7ecc669-e5b2-4985-81a7-d1aa2c3a4764-extensions-socket-volume\") pod \"a7ecc669-e5b2-4985-81a7-d1aa2c3a4764\" (UID: \"a7ecc669-e5b2-4985-81a7-d1aa2c3a4764\") " Jun 02 21:43:44.643785 ip-10-0-138-193 kubenswrapper[2578]: I0602 21:43:44.643744 2578 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-c87nd\" (UniqueName: \"kubernetes.io/projected/a7ecc669-e5b2-4985-81a7-d1aa2c3a4764-kube-api-access-c87nd\") pod \"a7ecc669-e5b2-4985-81a7-d1aa2c3a4764\" (UID: \"a7ecc669-e5b2-4985-81a7-d1aa2c3a4764\") " Jun 02 21:43:44.644119 ip-10-0-138-193 kubenswrapper[2578]: I0602 21:43:44.644092 2578 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/a7ecc669-e5b2-4985-81a7-d1aa2c3a4764-extensions-socket-volume" (OuterVolumeSpecName: "extensions-socket-volume") pod "a7ecc669-e5b2-4985-81a7-d1aa2c3a4764" (UID: "a7ecc669-e5b2-4985-81a7-d1aa2c3a4764"). InnerVolumeSpecName "extensions-socket-volume". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jun 02 21:43:44.645659 ip-10-0-138-193 kubenswrapper[2578]: I0602 21:43:44.645639 2578 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/a7ecc669-e5b2-4985-81a7-d1aa2c3a4764-kube-api-access-c87nd" (OuterVolumeSpecName: "kube-api-access-c87nd") pod "a7ecc669-e5b2-4985-81a7-d1aa2c3a4764" (UID: "a7ecc669-e5b2-4985-81a7-d1aa2c3a4764"). InnerVolumeSpecName "kube-api-access-c87nd". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 02 21:43:44.689859 ip-10-0-138-193 kubenswrapper[2578]: I0602 21:43:44.689826 2578 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-5f895dd7d5-84rdj" Jun 02 21:43:44.695625 ip-10-0-138-193 kubenswrapper[2578]: I0602 21:43:44.695600 2578 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-6bc9f4c76f-m8fjc" Jun 02 21:43:44.746715 ip-10-0-138-193 kubenswrapper[2578]: I0602 21:43:44.745476 2578 reconciler_common.go:299] "Volume detached for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/a7ecc669-e5b2-4985-81a7-d1aa2c3a4764-extensions-socket-volume\") on node \"ip-10-0-138-193.ec2.internal\" DevicePath \"\"" Jun 02 21:43:44.746715 ip-10-0-138-193 kubenswrapper[2578]: I0602 21:43:44.745511 2578 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-c87nd\" (UniqueName: \"kubernetes.io/projected/a7ecc669-e5b2-4985-81a7-d1aa2c3a4764-kube-api-access-c87nd\") on node \"ip-10-0-138-193.ec2.internal\" DevicePath \"\"" Jun 02 21:43:44.841900 ip-10-0-138-193 kubenswrapper[2578]: I0602 21:43:44.841864 2578 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-5f895dd7d5-84rdj"] Jun 02 21:43:44.845292 ip-10-0-138-193 kubenswrapper[2578]: W0602 21:43:44.845262 2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poddfb257a8_c185_44ae_bbe0_cfc1a557945b.slice/crio-2b05bf31c93d0176762dc09160b75bdadd951aa69225cbe95a10ab741a922454 WatchSource:0}: Error finding container 2b05bf31c93d0176762dc09160b75bdadd951aa69225cbe95a10ab741a922454: Status 404 returned error can't find the container with id 2b05bf31c93d0176762dc09160b75bdadd951aa69225cbe95a10ab741a922454 Jun 02 21:43:44.866053 ip-10-0-138-193 kubenswrapper[2578]: I0602 21:43:44.866029 2578 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-6bc9f4c76f-m8fjc"] Jun 02 21:43:44.867284 ip-10-0-138-193 kubenswrapper[2578]: W0602 21:43:44.867257 2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podf30e83ab_883b_428c_902a_32a578e3b241.slice/crio-e5be3e79d248e99d1820d6807dca0e3b7e70a447dc5a075fb110e47d1accf4e0 WatchSource:0}: Error finding container e5be3e79d248e99d1820d6807dca0e3b7e70a447dc5a075fb110e47d1accf4e0: Status 404 returned error can't find the container with id e5be3e79d248e99d1820d6807dca0e3b7e70a447dc5a075fb110e47d1accf4e0 Jun 02 21:43:44.936038 ip-10-0-138-193 kubenswrapper[2578]: I0602 21:43:44.936006 2578 status_manager.go:895] "Failed to get status for pod" podUID="a7ecc669-e5b2-4985-81a7-d1aa2c3a4764" pod="kuadrant-system/kuadrant-operator-controller-manager-5f895dd7d5-xcjn5" err="pods \"kuadrant-operator-controller-manager-5f895dd7d5-xcjn5\" is forbidden: User \"system:node:ip-10-0-138-193.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-138-193.ec2.internal' and this object" Jun 02 21:43:44.937971 ip-10-0-138-193 kubenswrapper[2578]: I0602 21:43:44.937945 2578 status_manager.go:895] "Failed to get status for pod" podUID="9bfd0c93-9448-41c0-9bc9-489dece41deb" pod="kuadrant-system/kuadrant-operator-controller-manager-6bc9f4c76f-pzpvp" err="pods \"kuadrant-operator-controller-manager-6bc9f4c76f-pzpvp\" is forbidden: User \"system:node:ip-10-0-138-193.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-138-193.ec2.internal' and this object" Jun 02 21:43:45.327971 ip-10-0-138-193 kubenswrapper[2578]: I0602 21:43:45.327551 2578 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="a7ecc669-e5b2-4985-81a7-d1aa2c3a4764" path="/var/lib/kubelet/pods/a7ecc669-e5b2-4985-81a7-d1aa2c3a4764/volumes" Jun 02 21:43:45.635021 ip-10-0-138-193 kubenswrapper[2578]: I0602 21:43:45.634921 2578 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-6bc9f4c76f-m8fjc" event={"ID":"f30e83ab-883b-428c-902a-32a578e3b241","Type":"ContainerStarted","Data":"cf72f8605ac24bf98cbab80c1b939ba30e280059cae923e5b5ddd487b77a2bfe"} Jun 02 21:43:45.635021 ip-10-0-138-193 kubenswrapper[2578]: I0602 21:43:45.634973 2578 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-6bc9f4c76f-m8fjc" event={"ID":"f30e83ab-883b-428c-902a-32a578e3b241","Type":"ContainerStarted","Data":"e5be3e79d248e99d1820d6807dca0e3b7e70a447dc5a075fb110e47d1accf4e0"} Jun 02 21:43:45.635345 ip-10-0-138-193 kubenswrapper[2578]: I0602 21:43:45.635034 2578 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/kuadrant-operator-controller-manager-6bc9f4c76f-m8fjc" Jun 02 21:43:45.636786 ip-10-0-138-193 kubenswrapper[2578]: I0602 21:43:45.636753 2578 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-5f895dd7d5-84rdj" event={"ID":"dfb257a8-c185-44ae-bbe0-cfc1a557945b","Type":"ContainerStarted","Data":"b8df8b85221a1c3c3f61ecb6e7c9d3f94b4112d765592821819e444960bc3cac"} Jun 02 21:43:45.636931 ip-10-0-138-193 kubenswrapper[2578]: I0602 21:43:45.636793 2578 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-5f895dd7d5-84rdj" event={"ID":"dfb257a8-c185-44ae-bbe0-cfc1a557945b","Type":"ContainerStarted","Data":"2b05bf31c93d0176762dc09160b75bdadd951aa69225cbe95a10ab741a922454"} Jun 02 21:43:45.636931 ip-10-0-138-193 kubenswrapper[2578]: I0602 21:43:45.636857 2578 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/kuadrant-operator-controller-manager-5f895dd7d5-84rdj" Jun 02 21:43:45.639761 ip-10-0-138-193 kubenswrapper[2578]: I0602 21:43:45.639734 2578 kuberuntime_container.go:864] "Killing container with a grace period" pod="kuadrant-system/kuadrant-operator-controller-manager-6bc9f4c76f-pzpvp" podUID="9bfd0c93-9448-41c0-9bc9-489dece41deb" containerName="manager" containerID="cri-o://1baeeae83d6bc7968dda92a10f97fe34756a643f8c53898d8b4d377666a6ca78" gracePeriod=2 Jun 02 21:43:45.659832 ip-10-0-138-193 kubenswrapper[2578]: I0602 21:43:45.659789 2578 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="kuadrant-system/kuadrant-operator-controller-manager-6bc9f4c76f-m8fjc" podStartSLOduration=1.659775002 podStartE2EDuration="1.659775002s" podCreationTimestamp="2026-06-02 21:43:44 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2026-06-02 21:43:45.659142613 +0000 UTC m=+602.911040519" watchObservedRunningTime="2026-06-02 21:43:45.659775002 +0000 UTC m=+602.911672907" Jun 02 21:43:45.682105 ip-10-0-138-193 kubenswrapper[2578]: I0602 21:43:45.682043 2578 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="kuadrant-system/kuadrant-operator-controller-manager-5f895dd7d5-84rdj" podStartSLOduration=1.682029362 podStartE2EDuration="1.682029362s" podCreationTimestamp="2026-06-02 21:43:44 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2026-06-02 21:43:45.680928799 +0000 UTC m=+602.932826705" watchObservedRunningTime="2026-06-02 21:43:45.682029362 +0000 UTC m=+602.933927268" Jun 02 21:43:45.882790 ip-10-0-138-193 kubenswrapper[2578]: I0602 21:43:45.882769 2578 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-6bc9f4c76f-pzpvp" Jun 02 21:43:45.884855 ip-10-0-138-193 kubenswrapper[2578]: I0602 21:43:45.884830 2578 status_manager.go:895] "Failed to get status for pod" podUID="9bfd0c93-9448-41c0-9bc9-489dece41deb" pod="kuadrant-system/kuadrant-operator-controller-manager-6bc9f4c76f-pzpvp" err="pods \"kuadrant-operator-controller-manager-6bc9f4c76f-pzpvp\" is forbidden: User \"system:node:ip-10-0-138-193.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-138-193.ec2.internal' and this object" Jun 02 21:43:46.056517 ip-10-0-138-193 kubenswrapper[2578]: I0602 21:43:46.056481 2578 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-krh9t\" (UniqueName: \"kubernetes.io/projected/9bfd0c93-9448-41c0-9bc9-489dece41deb-kube-api-access-krh9t\") pod \"9bfd0c93-9448-41c0-9bc9-489dece41deb\" (UID: \"9bfd0c93-9448-41c0-9bc9-489dece41deb\") " Jun 02 21:43:46.056726 ip-10-0-138-193 kubenswrapper[2578]: I0602 21:43:46.056577 2578 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/9bfd0c93-9448-41c0-9bc9-489dece41deb-extensions-socket-volume\") pod \"9bfd0c93-9448-41c0-9bc9-489dece41deb\" (UID: \"9bfd0c93-9448-41c0-9bc9-489dece41deb\") " Jun 02 21:43:46.056867 ip-10-0-138-193 kubenswrapper[2578]: I0602 21:43:46.056841 2578 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/9bfd0c93-9448-41c0-9bc9-489dece41deb-extensions-socket-volume" (OuterVolumeSpecName: "extensions-socket-volume") pod "9bfd0c93-9448-41c0-9bc9-489dece41deb" (UID: "9bfd0c93-9448-41c0-9bc9-489dece41deb"). InnerVolumeSpecName "extensions-socket-volume". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jun 02 21:43:46.058593 ip-10-0-138-193 kubenswrapper[2578]: I0602 21:43:46.058571 2578 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/9bfd0c93-9448-41c0-9bc9-489dece41deb-kube-api-access-krh9t" (OuterVolumeSpecName: "kube-api-access-krh9t") pod "9bfd0c93-9448-41c0-9bc9-489dece41deb" (UID: "9bfd0c93-9448-41c0-9bc9-489dece41deb"). InnerVolumeSpecName "kube-api-access-krh9t". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 02 21:43:46.157496 ip-10-0-138-193 kubenswrapper[2578]: I0602 21:43:46.157463 2578 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-krh9t\" (UniqueName: \"kubernetes.io/projected/9bfd0c93-9448-41c0-9bc9-489dece41deb-kube-api-access-krh9t\") on node \"ip-10-0-138-193.ec2.internal\" DevicePath \"\"" Jun 02 21:43:46.157496 ip-10-0-138-193 kubenswrapper[2578]: I0602 21:43:46.157490 2578 reconciler_common.go:299] "Volume detached for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/9bfd0c93-9448-41c0-9bc9-489dece41deb-extensions-socket-volume\") on node \"ip-10-0-138-193.ec2.internal\" DevicePath \"\"" Jun 02 21:43:46.644934 ip-10-0-138-193 kubenswrapper[2578]: I0602 21:43:46.644892 2578 generic.go:358] "Generic (PLEG): container finished" podID="9bfd0c93-9448-41c0-9bc9-489dece41deb" containerID="1baeeae83d6bc7968dda92a10f97fe34756a643f8c53898d8b4d377666a6ca78" exitCode=2 Jun 02 21:43:46.644934 ip-10-0-138-193 kubenswrapper[2578]: I0602 21:43:46.644933 2578 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-6bc9f4c76f-pzpvp" Jun 02 21:43:46.645234 ip-10-0-138-193 kubenswrapper[2578]: I0602 21:43:46.644992 2578 scope.go:117] "RemoveContainer" containerID="1baeeae83d6bc7968dda92a10f97fe34756a643f8c53898d8b4d377666a6ca78" Jun 02 21:43:46.647185 ip-10-0-138-193 kubenswrapper[2578]: I0602 21:43:46.647162 2578 status_manager.go:895] "Failed to get status for pod" podUID="9bfd0c93-9448-41c0-9bc9-489dece41deb" pod="kuadrant-system/kuadrant-operator-controller-manager-6bc9f4c76f-pzpvp" err="pods \"kuadrant-operator-controller-manager-6bc9f4c76f-pzpvp\" is forbidden: User \"system:node:ip-10-0-138-193.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-138-193.ec2.internal' and this object" Jun 02 21:43:46.654771 ip-10-0-138-193 kubenswrapper[2578]: I0602 21:43:46.654754 2578 scope.go:117] "RemoveContainer" containerID="1baeeae83d6bc7968dda92a10f97fe34756a643f8c53898d8b4d377666a6ca78" Jun 02 21:43:46.655063 ip-10-0-138-193 kubenswrapper[2578]: E0602 21:43:46.655045 2578 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"1baeeae83d6bc7968dda92a10f97fe34756a643f8c53898d8b4d377666a6ca78\": container with ID starting with 1baeeae83d6bc7968dda92a10f97fe34756a643f8c53898d8b4d377666a6ca78 not found: ID does not exist" containerID="1baeeae83d6bc7968dda92a10f97fe34756a643f8c53898d8b4d377666a6ca78" Jun 02 21:43:46.655119 ip-10-0-138-193 kubenswrapper[2578]: I0602 21:43:46.655088 2578 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"1baeeae83d6bc7968dda92a10f97fe34756a643f8c53898d8b4d377666a6ca78"} err="failed to get container status \"1baeeae83d6bc7968dda92a10f97fe34756a643f8c53898d8b4d377666a6ca78\": rpc error: code = NotFound desc = could not find container \"1baeeae83d6bc7968dda92a10f97fe34756a643f8c53898d8b4d377666a6ca78\": container with ID starting with 1baeeae83d6bc7968dda92a10f97fe34756a643f8c53898d8b4d377666a6ca78 not found: ID does not exist" Jun 02 21:43:46.655382 ip-10-0-138-193 kubenswrapper[2578]: I0602 21:43:46.655359 2578 status_manager.go:895] "Failed to get status for pod" podUID="9bfd0c93-9448-41c0-9bc9-489dece41deb" pod="kuadrant-system/kuadrant-operator-controller-manager-6bc9f4c76f-pzpvp" err="pods \"kuadrant-operator-controller-manager-6bc9f4c76f-pzpvp\" is forbidden: User \"system:node:ip-10-0-138-193.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-138-193.ec2.internal' and this object" Jun 02 21:43:47.323392 ip-10-0-138-193 kubenswrapper[2578]: I0602 21:43:47.323359 2578 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="9bfd0c93-9448-41c0-9bc9-489dece41deb" path="/var/lib/kubelet/pods/9bfd0c93-9448-41c0-9bc9-489dece41deb/volumes" Jun 02 21:43:48.607393 ip-10-0-138-193 kubenswrapper[2578]: I0602 21:43:48.607334 2578 kuberuntime_container.go:864] "Killing container with a grace period" pod="openshift-console/console-6b5f69b87-7qjqs" podUID="abaf0c4c-d177-4ffe-9480-b30e1d2b3761" containerName="console" containerID="cri-o://7ea1e10c41aa47f9eb585de040449352cb41d5be9a7ea6670f4271cb3f4397d1" gracePeriod=15 Jun 02 21:43:48.872560 ip-10-0-138-193 kubenswrapper[2578]: I0602 21:43:48.872493 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console_console-6b5f69b87-7qjqs_abaf0c4c-d177-4ffe-9480-b30e1d2b3761/console/0.log" Jun 02 21:43:48.872560 ip-10-0-138-193 kubenswrapper[2578]: I0602 21:43:48.872554 2578 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-6b5f69b87-7qjqs" Jun 02 21:43:48.986900 ip-10-0-138-193 kubenswrapper[2578]: I0602 21:43:48.986863 2578 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/abaf0c4c-d177-4ffe-9480-b30e1d2b3761-service-ca\") pod \"abaf0c4c-d177-4ffe-9480-b30e1d2b3761\" (UID: \"abaf0c4c-d177-4ffe-9480-b30e1d2b3761\") " Jun 02 21:43:48.986900 ip-10-0-138-193 kubenswrapper[2578]: I0602 21:43:48.986915 2578 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/abaf0c4c-d177-4ffe-9480-b30e1d2b3761-console-config\") pod \"abaf0c4c-d177-4ffe-9480-b30e1d2b3761\" (UID: \"abaf0c4c-d177-4ffe-9480-b30e1d2b3761\") " Jun 02 21:43:48.987183 ip-10-0-138-193 kubenswrapper[2578]: I0602 21:43:48.986981 2578 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/abaf0c4c-d177-4ffe-9480-b30e1d2b3761-console-serving-cert\") pod \"abaf0c4c-d177-4ffe-9480-b30e1d2b3761\" (UID: \"abaf0c4c-d177-4ffe-9480-b30e1d2b3761\") " Jun 02 21:43:48.987183 ip-10-0-138-193 kubenswrapper[2578]: I0602 21:43:48.987001 2578 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/abaf0c4c-d177-4ffe-9480-b30e1d2b3761-oauth-serving-cert\") pod \"abaf0c4c-d177-4ffe-9480-b30e1d2b3761\" (UID: \"abaf0c4c-d177-4ffe-9480-b30e1d2b3761\") " Jun 02 21:43:48.987183 ip-10-0-138-193 kubenswrapper[2578]: I0602 21:43:48.987018 2578 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-2nm9x\" (UniqueName: \"kubernetes.io/projected/abaf0c4c-d177-4ffe-9480-b30e1d2b3761-kube-api-access-2nm9x\") pod \"abaf0c4c-d177-4ffe-9480-b30e1d2b3761\" (UID: \"abaf0c4c-d177-4ffe-9480-b30e1d2b3761\") " Jun 02 21:43:48.987183 ip-10-0-138-193 kubenswrapper[2578]: I0602 21:43:48.987105 2578 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/abaf0c4c-d177-4ffe-9480-b30e1d2b3761-console-oauth-config\") pod \"abaf0c4c-d177-4ffe-9480-b30e1d2b3761\" (UID: \"abaf0c4c-d177-4ffe-9480-b30e1d2b3761\") " Jun 02 21:43:48.987183 ip-10-0-138-193 kubenswrapper[2578]: I0602 21:43:48.987128 2578 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/abaf0c4c-d177-4ffe-9480-b30e1d2b3761-trusted-ca-bundle\") pod \"abaf0c4c-d177-4ffe-9480-b30e1d2b3761\" (UID: \"abaf0c4c-d177-4ffe-9480-b30e1d2b3761\") " Jun 02 21:43:48.987451 ip-10-0-138-193 kubenswrapper[2578]: I0602 21:43:48.987375 2578 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/abaf0c4c-d177-4ffe-9480-b30e1d2b3761-service-ca" (OuterVolumeSpecName: "service-ca") pod "abaf0c4c-d177-4ffe-9480-b30e1d2b3761" (UID: "abaf0c4c-d177-4ffe-9480-b30e1d2b3761"). InnerVolumeSpecName "service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jun 02 21:43:48.987517 ip-10-0-138-193 kubenswrapper[2578]: I0602 21:43:48.987494 2578 reconciler_common.go:299] "Volume detached for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/abaf0c4c-d177-4ffe-9480-b30e1d2b3761-service-ca\") on node \"ip-10-0-138-193.ec2.internal\" DevicePath \"\"" Jun 02 21:43:48.987517 ip-10-0-138-193 kubenswrapper[2578]: I0602 21:43:48.987501 2578 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/abaf0c4c-d177-4ffe-9480-b30e1d2b3761-oauth-serving-cert" (OuterVolumeSpecName: "oauth-serving-cert") pod "abaf0c4c-d177-4ffe-9480-b30e1d2b3761" (UID: "abaf0c4c-d177-4ffe-9480-b30e1d2b3761"). InnerVolumeSpecName "oauth-serving-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jun 02 21:43:48.987614 ip-10-0-138-193 kubenswrapper[2578]: I0602 21:43:48.987537 2578 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/abaf0c4c-d177-4ffe-9480-b30e1d2b3761-console-config" (OuterVolumeSpecName: "console-config") pod "abaf0c4c-d177-4ffe-9480-b30e1d2b3761" (UID: "abaf0c4c-d177-4ffe-9480-b30e1d2b3761"). InnerVolumeSpecName "console-config". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jun 02 21:43:48.987661 ip-10-0-138-193 kubenswrapper[2578]: I0602 21:43:48.987636 2578 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/abaf0c4c-d177-4ffe-9480-b30e1d2b3761-trusted-ca-bundle" (OuterVolumeSpecName: "trusted-ca-bundle") pod "abaf0c4c-d177-4ffe-9480-b30e1d2b3761" (UID: "abaf0c4c-d177-4ffe-9480-b30e1d2b3761"). InnerVolumeSpecName "trusted-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jun 02 21:43:48.989457 ip-10-0-138-193 kubenswrapper[2578]: I0602 21:43:48.989427 2578 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/abaf0c4c-d177-4ffe-9480-b30e1d2b3761-console-serving-cert" (OuterVolumeSpecName: "console-serving-cert") pod "abaf0c4c-d177-4ffe-9480-b30e1d2b3761" (UID: "abaf0c4c-d177-4ffe-9480-b30e1d2b3761"). InnerVolumeSpecName "console-serving-cert". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jun 02 21:43:48.989590 ip-10-0-138-193 kubenswrapper[2578]: I0602 21:43:48.989497 2578 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/abaf0c4c-d177-4ffe-9480-b30e1d2b3761-console-oauth-config" (OuterVolumeSpecName: "console-oauth-config") pod "abaf0c4c-d177-4ffe-9480-b30e1d2b3761" (UID: "abaf0c4c-d177-4ffe-9480-b30e1d2b3761"). InnerVolumeSpecName "console-oauth-config". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jun 02 21:43:48.989590 ip-10-0-138-193 kubenswrapper[2578]: I0602 21:43:48.989535 2578 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/abaf0c4c-d177-4ffe-9480-b30e1d2b3761-kube-api-access-2nm9x" (OuterVolumeSpecName: "kube-api-access-2nm9x") pod "abaf0c4c-d177-4ffe-9480-b30e1d2b3761" (UID: "abaf0c4c-d177-4ffe-9480-b30e1d2b3761"). InnerVolumeSpecName "kube-api-access-2nm9x". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 02 21:43:49.088916 ip-10-0-138-193 kubenswrapper[2578]: I0602 21:43:49.088882 2578 reconciler_common.go:299] "Volume detached for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/abaf0c4c-d177-4ffe-9480-b30e1d2b3761-console-serving-cert\") on node \"ip-10-0-138-193.ec2.internal\" DevicePath \"\"" Jun 02 21:43:49.088916 ip-10-0-138-193 kubenswrapper[2578]: I0602 21:43:49.088911 2578 reconciler_common.go:299] "Volume detached for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/abaf0c4c-d177-4ffe-9480-b30e1d2b3761-oauth-serving-cert\") on node \"ip-10-0-138-193.ec2.internal\" DevicePath \"\"" Jun 02 21:43:49.088916 ip-10-0-138-193 kubenswrapper[2578]: I0602 21:43:49.088921 2578 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-2nm9x\" (UniqueName: \"kubernetes.io/projected/abaf0c4c-d177-4ffe-9480-b30e1d2b3761-kube-api-access-2nm9x\") on node \"ip-10-0-138-193.ec2.internal\" DevicePath \"\"" Jun 02 21:43:49.089186 ip-10-0-138-193 kubenswrapper[2578]: I0602 21:43:49.088930 2578 reconciler_common.go:299] "Volume detached for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/abaf0c4c-d177-4ffe-9480-b30e1d2b3761-console-oauth-config\") on node \"ip-10-0-138-193.ec2.internal\" DevicePath \"\"" Jun 02 21:43:49.089186 ip-10-0-138-193 kubenswrapper[2578]: I0602 21:43:49.088939 2578 reconciler_common.go:299] "Volume detached for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/abaf0c4c-d177-4ffe-9480-b30e1d2b3761-trusted-ca-bundle\") on node \"ip-10-0-138-193.ec2.internal\" DevicePath \"\"" Jun 02 21:43:49.089186 ip-10-0-138-193 kubenswrapper[2578]: I0602 21:43:49.088949 2578 reconciler_common.go:299] "Volume detached for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/abaf0c4c-d177-4ffe-9480-b30e1d2b3761-console-config\") on node \"ip-10-0-138-193.ec2.internal\" DevicePath \"\"" Jun 02 21:43:49.659769 ip-10-0-138-193 kubenswrapper[2578]: I0602 21:43:49.659745 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console_console-6b5f69b87-7qjqs_abaf0c4c-d177-4ffe-9480-b30e1d2b3761/console/0.log" Jun 02 21:43:49.660260 ip-10-0-138-193 kubenswrapper[2578]: I0602 21:43:49.659782 2578 generic.go:358] "Generic (PLEG): container finished" podID="abaf0c4c-d177-4ffe-9480-b30e1d2b3761" containerID="7ea1e10c41aa47f9eb585de040449352cb41d5be9a7ea6670f4271cb3f4397d1" exitCode=2 Jun 02 21:43:49.660260 ip-10-0-138-193 kubenswrapper[2578]: I0602 21:43:49.659852 2578 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-6b5f69b87-7qjqs" Jun 02 21:43:49.660260 ip-10-0-138-193 kubenswrapper[2578]: I0602 21:43:49.659881 2578 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-6b5f69b87-7qjqs" event={"ID":"abaf0c4c-d177-4ffe-9480-b30e1d2b3761","Type":"ContainerDied","Data":"7ea1e10c41aa47f9eb585de040449352cb41d5be9a7ea6670f4271cb3f4397d1"} Jun 02 21:43:49.660260 ip-10-0-138-193 kubenswrapper[2578]: I0602 21:43:49.659932 2578 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-6b5f69b87-7qjqs" event={"ID":"abaf0c4c-d177-4ffe-9480-b30e1d2b3761","Type":"ContainerDied","Data":"591613417b39d2c9b14e2debebbb78caa8521fdca0ddc2455fdae1d549dfe434"} Jun 02 21:43:49.660260 ip-10-0-138-193 kubenswrapper[2578]: I0602 21:43:49.659952 2578 scope.go:117] "RemoveContainer" containerID="7ea1e10c41aa47f9eb585de040449352cb41d5be9a7ea6670f4271cb3f4397d1" Jun 02 21:43:49.668806 ip-10-0-138-193 kubenswrapper[2578]: I0602 21:43:49.668789 2578 scope.go:117] "RemoveContainer" containerID="7ea1e10c41aa47f9eb585de040449352cb41d5be9a7ea6670f4271cb3f4397d1" Jun 02 21:43:49.669050 ip-10-0-138-193 kubenswrapper[2578]: E0602 21:43:49.669031 2578 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"7ea1e10c41aa47f9eb585de040449352cb41d5be9a7ea6670f4271cb3f4397d1\": container with ID starting with 7ea1e10c41aa47f9eb585de040449352cb41d5be9a7ea6670f4271cb3f4397d1 not found: ID does not exist" containerID="7ea1e10c41aa47f9eb585de040449352cb41d5be9a7ea6670f4271cb3f4397d1" Jun 02 21:43:49.669149 ip-10-0-138-193 kubenswrapper[2578]: I0602 21:43:49.669060 2578 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"7ea1e10c41aa47f9eb585de040449352cb41d5be9a7ea6670f4271cb3f4397d1"} err="failed to get container status \"7ea1e10c41aa47f9eb585de040449352cb41d5be9a7ea6670f4271cb3f4397d1\": rpc error: code = NotFound desc = could not find container \"7ea1e10c41aa47f9eb585de040449352cb41d5be9a7ea6670f4271cb3f4397d1\": container with ID starting with 7ea1e10c41aa47f9eb585de040449352cb41d5be9a7ea6670f4271cb3f4397d1 not found: ID does not exist" Jun 02 21:43:49.690292 ip-10-0-138-193 kubenswrapper[2578]: I0602 21:43:49.690266 2578 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openshift-console/console-6b5f69b87-7qjqs"] Jun 02 21:43:49.706765 ip-10-0-138-193 kubenswrapper[2578]: I0602 21:43:49.706740 2578 kubelet.go:2547] "SyncLoop REMOVE" source="api" pods=["openshift-console/console-6b5f69b87-7qjqs"] Jun 02 21:43:51.323598 ip-10-0-138-193 kubenswrapper[2578]: I0602 21:43:51.323561 2578 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="abaf0c4c-d177-4ffe-9480-b30e1d2b3761" path="/var/lib/kubelet/pods/abaf0c4c-d177-4ffe-9480-b30e1d2b3761/volumes" Jun 02 21:43:56.647327 ip-10-0-138-193 kubenswrapper[2578]: I0602 21:43:56.647256 2578 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/kuadrant-operator-controller-manager-6bc9f4c76f-m8fjc" Jun 02 21:43:56.647327 ip-10-0-138-193 kubenswrapper[2578]: I0602 21:43:56.647308 2578 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/kuadrant-operator-controller-manager-5f895dd7d5-84rdj" Jun 02 21:43:56.712524 ip-10-0-138-193 kubenswrapper[2578]: I0602 21:43:56.712485 2578 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-5f895dd7d5-84rdj"] Jun 02 21:43:56.712735 ip-10-0-138-193 kubenswrapper[2578]: I0602 21:43:56.712710 2578 kuberuntime_container.go:864] "Killing container with a grace period" pod="kuadrant-system/kuadrant-operator-controller-manager-5f895dd7d5-84rdj" podUID="dfb257a8-c185-44ae-bbe0-cfc1a557945b" containerName="manager" containerID="cri-o://b8df8b85221a1c3c3f61ecb6e7c9d3f94b4112d765592821819e444960bc3cac" gracePeriod=10 Jun 02 21:43:56.968852 ip-10-0-138-193 kubenswrapper[2578]: I0602 21:43:56.968825 2578 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-5f895dd7d5-84rdj" Jun 02 21:43:56.983748 ip-10-0-138-193 kubenswrapper[2578]: I0602 21:43:56.983710 2578 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-55c7f4c975-dbbcf"] Jun 02 21:43:56.984142 ip-10-0-138-193 kubenswrapper[2578]: I0602 21:43:56.984129 2578 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="dfb257a8-c185-44ae-bbe0-cfc1a557945b" containerName="manager" Jun 02 21:43:56.984208 ip-10-0-138-193 kubenswrapper[2578]: I0602 21:43:56.984145 2578 state_mem.go:107] "Deleted CPUSet assignment" podUID="dfb257a8-c185-44ae-bbe0-cfc1a557945b" containerName="manager" Jun 02 21:43:56.984208 ip-10-0-138-193 kubenswrapper[2578]: I0602 21:43:56.984171 2578 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="abaf0c4c-d177-4ffe-9480-b30e1d2b3761" containerName="console" Jun 02 21:43:56.984208 ip-10-0-138-193 kubenswrapper[2578]: I0602 21:43:56.984176 2578 state_mem.go:107] "Deleted CPUSet assignment" podUID="abaf0c4c-d177-4ffe-9480-b30e1d2b3761" containerName="console" Jun 02 21:43:56.984313 ip-10-0-138-193 kubenswrapper[2578]: I0602 21:43:56.984240 2578 memory_manager.go:356] "RemoveStaleState removing state" podUID="dfb257a8-c185-44ae-bbe0-cfc1a557945b" containerName="manager" Jun 02 21:43:56.984313 ip-10-0-138-193 kubenswrapper[2578]: I0602 21:43:56.984251 2578 memory_manager.go:356] "RemoveStaleState removing state" podUID="abaf0c4c-d177-4ffe-9480-b30e1d2b3761" containerName="console" Jun 02 21:43:56.987497 ip-10-0-138-193 kubenswrapper[2578]: I0602 21:43:56.987473 2578 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-55c7f4c975-dbbcf" Jun 02 21:43:57.002631 ip-10-0-138-193 kubenswrapper[2578]: I0602 21:43:57.002609 2578 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-55c7f4c975-dbbcf"] Jun 02 21:43:57.057390 ip-10-0-138-193 kubenswrapper[2578]: I0602 21:43:57.057354 2578 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/dfb257a8-c185-44ae-bbe0-cfc1a557945b-extensions-socket-volume\") pod \"dfb257a8-c185-44ae-bbe0-cfc1a557945b\" (UID: \"dfb257a8-c185-44ae-bbe0-cfc1a557945b\") " Jun 02 21:43:57.057574 ip-10-0-138-193 kubenswrapper[2578]: I0602 21:43:57.057457 2578 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-z6dxc\" (UniqueName: \"kubernetes.io/projected/dfb257a8-c185-44ae-bbe0-cfc1a557945b-kube-api-access-z6dxc\") pod \"dfb257a8-c185-44ae-bbe0-cfc1a557945b\" (UID: \"dfb257a8-c185-44ae-bbe0-cfc1a557945b\") " Jun 02 21:43:57.057678 ip-10-0-138-193 kubenswrapper[2578]: I0602 21:43:57.057659 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-w9784\" (UniqueName: \"kubernetes.io/projected/2d526ec3-d797-4041-a368-6015f1ca9ee2-kube-api-access-w9784\") pod \"kuadrant-operator-controller-manager-55c7f4c975-dbbcf\" (UID: \"2d526ec3-d797-4041-a368-6015f1ca9ee2\") " pod="kuadrant-system/kuadrant-operator-controller-manager-55c7f4c975-dbbcf" Jun 02 21:43:57.057753 ip-10-0-138-193 kubenswrapper[2578]: I0602 21:43:57.057697 2578 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/dfb257a8-c185-44ae-bbe0-cfc1a557945b-extensions-socket-volume" (OuterVolumeSpecName: "extensions-socket-volume") pod "dfb257a8-c185-44ae-bbe0-cfc1a557945b" (UID: "dfb257a8-c185-44ae-bbe0-cfc1a557945b"). InnerVolumeSpecName "extensions-socket-volume". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jun 02 21:43:57.057753 ip-10-0-138-193 kubenswrapper[2578]: I0602 21:43:57.057711 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/2d526ec3-d797-4041-a368-6015f1ca9ee2-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-55c7f4c975-dbbcf\" (UID: \"2d526ec3-d797-4041-a368-6015f1ca9ee2\") " pod="kuadrant-system/kuadrant-operator-controller-manager-55c7f4c975-dbbcf" Jun 02 21:43:57.057849 ip-10-0-138-193 kubenswrapper[2578]: I0602 21:43:57.057831 2578 reconciler_common.go:299] "Volume detached for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/dfb257a8-c185-44ae-bbe0-cfc1a557945b-extensions-socket-volume\") on node \"ip-10-0-138-193.ec2.internal\" DevicePath \"\"" Jun 02 21:43:57.059605 ip-10-0-138-193 kubenswrapper[2578]: I0602 21:43:57.059584 2578 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/dfb257a8-c185-44ae-bbe0-cfc1a557945b-kube-api-access-z6dxc" (OuterVolumeSpecName: "kube-api-access-z6dxc") pod "dfb257a8-c185-44ae-bbe0-cfc1a557945b" (UID: "dfb257a8-c185-44ae-bbe0-cfc1a557945b"). InnerVolumeSpecName "kube-api-access-z6dxc". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 02 21:43:57.158564 ip-10-0-138-193 kubenswrapper[2578]: I0602 21:43:57.158524 2578 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/2d526ec3-d797-4041-a368-6015f1ca9ee2-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-55c7f4c975-dbbcf\" (UID: \"2d526ec3-d797-4041-a368-6015f1ca9ee2\") " pod="kuadrant-system/kuadrant-operator-controller-manager-55c7f4c975-dbbcf" Jun 02 21:43:57.158974 ip-10-0-138-193 kubenswrapper[2578]: I0602 21:43:57.158649 2578 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-w9784\" (UniqueName: \"kubernetes.io/projected/2d526ec3-d797-4041-a368-6015f1ca9ee2-kube-api-access-w9784\") pod \"kuadrant-operator-controller-manager-55c7f4c975-dbbcf\" (UID: \"2d526ec3-d797-4041-a368-6015f1ca9ee2\") " pod="kuadrant-system/kuadrant-operator-controller-manager-55c7f4c975-dbbcf" Jun 02 21:43:57.158974 ip-10-0-138-193 kubenswrapper[2578]: I0602 21:43:57.158690 2578 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-z6dxc\" (UniqueName: \"kubernetes.io/projected/dfb257a8-c185-44ae-bbe0-cfc1a557945b-kube-api-access-z6dxc\") on node \"ip-10-0-138-193.ec2.internal\" DevicePath \"\"" Jun 02 21:43:57.159144 ip-10-0-138-193 kubenswrapper[2578]: I0602 21:43:57.158985 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/2d526ec3-d797-4041-a368-6015f1ca9ee2-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-55c7f4c975-dbbcf\" (UID: \"2d526ec3-d797-4041-a368-6015f1ca9ee2\") " pod="kuadrant-system/kuadrant-operator-controller-manager-55c7f4c975-dbbcf" Jun 02 21:43:57.166969 ip-10-0-138-193 kubenswrapper[2578]: I0602 21:43:57.166909 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-w9784\" (UniqueName: \"kubernetes.io/projected/2d526ec3-d797-4041-a368-6015f1ca9ee2-kube-api-access-w9784\") pod \"kuadrant-operator-controller-manager-55c7f4c975-dbbcf\" (UID: \"2d526ec3-d797-4041-a368-6015f1ca9ee2\") " pod="kuadrant-system/kuadrant-operator-controller-manager-55c7f4c975-dbbcf" Jun 02 21:43:57.301627 ip-10-0-138-193 kubenswrapper[2578]: I0602 21:43:57.301589 2578 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-55c7f4c975-dbbcf" Jun 02 21:43:57.437578 ip-10-0-138-193 kubenswrapper[2578]: I0602 21:43:57.437546 2578 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-55c7f4c975-dbbcf"] Jun 02 21:43:57.439376 ip-10-0-138-193 kubenswrapper[2578]: W0602 21:43:57.439348 2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod2d526ec3_d797_4041_a368_6015f1ca9ee2.slice/crio-5d68520245b29c1583da4c6a3df9cf3ef1a78e2e0af6decfa3c856cf31b70b4f WatchSource:0}: Error finding container 5d68520245b29c1583da4c6a3df9cf3ef1a78e2e0af6decfa3c856cf31b70b4f: Status 404 returned error can't find the container with id 5d68520245b29c1583da4c6a3df9cf3ef1a78e2e0af6decfa3c856cf31b70b4f Jun 02 21:43:57.696776 ip-10-0-138-193 kubenswrapper[2578]: I0602 21:43:57.696685 2578 generic.go:358] "Generic (PLEG): container finished" podID="dfb257a8-c185-44ae-bbe0-cfc1a557945b" containerID="b8df8b85221a1c3c3f61ecb6e7c9d3f94b4112d765592821819e444960bc3cac" exitCode=0 Jun 02 21:43:57.696776 ip-10-0-138-193 kubenswrapper[2578]: I0602 21:43:57.696747 2578 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-5f895dd7d5-84rdj" Jun 02 21:43:57.697331 ip-10-0-138-193 kubenswrapper[2578]: I0602 21:43:57.696773 2578 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-5f895dd7d5-84rdj" event={"ID":"dfb257a8-c185-44ae-bbe0-cfc1a557945b","Type":"ContainerDied","Data":"b8df8b85221a1c3c3f61ecb6e7c9d3f94b4112d765592821819e444960bc3cac"} Jun 02 21:43:57.697331 ip-10-0-138-193 kubenswrapper[2578]: I0602 21:43:57.696809 2578 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-5f895dd7d5-84rdj" event={"ID":"dfb257a8-c185-44ae-bbe0-cfc1a557945b","Type":"ContainerDied","Data":"2b05bf31c93d0176762dc09160b75bdadd951aa69225cbe95a10ab741a922454"} Jun 02 21:43:57.697331 ip-10-0-138-193 kubenswrapper[2578]: I0602 21:43:57.696832 2578 scope.go:117] "RemoveContainer" containerID="b8df8b85221a1c3c3f61ecb6e7c9d3f94b4112d765592821819e444960bc3cac" Jun 02 21:43:57.698608 ip-10-0-138-193 kubenswrapper[2578]: I0602 21:43:57.698580 2578 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-55c7f4c975-dbbcf" event={"ID":"2d526ec3-d797-4041-a368-6015f1ca9ee2","Type":"ContainerStarted","Data":"d94c9035ecd2fa39e037ebda1bb9c08c08a49738eb4d132aca161517c92b5366"} Jun 02 21:43:57.698820 ip-10-0-138-193 kubenswrapper[2578]: I0602 21:43:57.698618 2578 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-55c7f4c975-dbbcf" event={"ID":"2d526ec3-d797-4041-a368-6015f1ca9ee2","Type":"ContainerStarted","Data":"5d68520245b29c1583da4c6a3df9cf3ef1a78e2e0af6decfa3c856cf31b70b4f"} Jun 02 21:43:57.698820 ip-10-0-138-193 kubenswrapper[2578]: I0602 21:43:57.698734 2578 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/kuadrant-operator-controller-manager-55c7f4c975-dbbcf" Jun 02 21:43:57.706251 ip-10-0-138-193 kubenswrapper[2578]: I0602 21:43:57.706232 2578 scope.go:117] "RemoveContainer" containerID="b8df8b85221a1c3c3f61ecb6e7c9d3f94b4112d765592821819e444960bc3cac" Jun 02 21:43:57.706548 ip-10-0-138-193 kubenswrapper[2578]: E0602 21:43:57.706532 2578 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"b8df8b85221a1c3c3f61ecb6e7c9d3f94b4112d765592821819e444960bc3cac\": container with ID starting with b8df8b85221a1c3c3f61ecb6e7c9d3f94b4112d765592821819e444960bc3cac not found: ID does not exist" containerID="b8df8b85221a1c3c3f61ecb6e7c9d3f94b4112d765592821819e444960bc3cac" Jun 02 21:43:57.706619 ip-10-0-138-193 kubenswrapper[2578]: I0602 21:43:57.706559 2578 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"b8df8b85221a1c3c3f61ecb6e7c9d3f94b4112d765592821819e444960bc3cac"} err="failed to get container status \"b8df8b85221a1c3c3f61ecb6e7c9d3f94b4112d765592821819e444960bc3cac\": rpc error: code = NotFound desc = could not find container \"b8df8b85221a1c3c3f61ecb6e7c9d3f94b4112d765592821819e444960bc3cac\": container with ID starting with b8df8b85221a1c3c3f61ecb6e7c9d3f94b4112d765592821819e444960bc3cac not found: ID does not exist" Jun 02 21:43:57.717276 ip-10-0-138-193 kubenswrapper[2578]: I0602 21:43:57.714465 2578 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-5f895dd7d5-84rdj"] Jun 02 21:43:57.730587 ip-10-0-138-193 kubenswrapper[2578]: I0602 21:43:57.730553 2578 kubelet.go:2547] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-5f895dd7d5-84rdj"] Jun 02 21:43:57.748706 ip-10-0-138-193 kubenswrapper[2578]: I0602 21:43:57.748645 2578 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="kuadrant-system/kuadrant-operator-controller-manager-55c7f4c975-dbbcf" podStartSLOduration=1.7486275409999998 podStartE2EDuration="1.748627541s" podCreationTimestamp="2026-06-02 21:43:56 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2026-06-02 21:43:57.748016223 +0000 UTC m=+614.999914130" watchObservedRunningTime="2026-06-02 21:43:57.748627541 +0000 UTC m=+615.000525446" Jun 02 21:43:59.322891 ip-10-0-138-193 kubenswrapper[2578]: I0602 21:43:59.322849 2578 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="dfb257a8-c185-44ae-bbe0-cfc1a557945b" path="/var/lib/kubelet/pods/dfb257a8-c185-44ae-bbe0-cfc1a557945b/volumes" Jun 02 21:44:08.707544 ip-10-0-138-193 kubenswrapper[2578]: I0602 21:44:08.707513 2578 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/kuadrant-operator-controller-manager-55c7f4c975-dbbcf" Jun 02 21:44:08.756543 ip-10-0-138-193 kubenswrapper[2578]: I0602 21:44:08.756514 2578 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-6bc9f4c76f-m8fjc"] Jun 02 21:44:08.756776 ip-10-0-138-193 kubenswrapper[2578]: I0602 21:44:08.756741 2578 kuberuntime_container.go:864] "Killing container with a grace period" pod="kuadrant-system/kuadrant-operator-controller-manager-6bc9f4c76f-m8fjc" podUID="f30e83ab-883b-428c-902a-32a578e3b241" containerName="manager" containerID="cri-o://cf72f8605ac24bf98cbab80c1b939ba30e280059cae923e5b5ddd487b77a2bfe" gracePeriod=10 Jun 02 21:44:09.013761 ip-10-0-138-193 kubenswrapper[2578]: I0602 21:44:09.013736 2578 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-6bc9f4c76f-m8fjc" Jun 02 21:44:09.067246 ip-10-0-138-193 kubenswrapper[2578]: I0602 21:44:09.067212 2578 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-tvvcz\" (UniqueName: \"kubernetes.io/projected/f30e83ab-883b-428c-902a-32a578e3b241-kube-api-access-tvvcz\") pod \"f30e83ab-883b-428c-902a-32a578e3b241\" (UID: \"f30e83ab-883b-428c-902a-32a578e3b241\") " Jun 02 21:44:09.067441 ip-10-0-138-193 kubenswrapper[2578]: I0602 21:44:09.067269 2578 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/f30e83ab-883b-428c-902a-32a578e3b241-extensions-socket-volume\") pod \"f30e83ab-883b-428c-902a-32a578e3b241\" (UID: \"f30e83ab-883b-428c-902a-32a578e3b241\") " Jun 02 21:44:09.067679 ip-10-0-138-193 kubenswrapper[2578]: I0602 21:44:09.067655 2578 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/f30e83ab-883b-428c-902a-32a578e3b241-extensions-socket-volume" (OuterVolumeSpecName: "extensions-socket-volume") pod "f30e83ab-883b-428c-902a-32a578e3b241" (UID: "f30e83ab-883b-428c-902a-32a578e3b241"). InnerVolumeSpecName "extensions-socket-volume". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jun 02 21:44:09.069387 ip-10-0-138-193 kubenswrapper[2578]: I0602 21:44:09.069358 2578 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/f30e83ab-883b-428c-902a-32a578e3b241-kube-api-access-tvvcz" (OuterVolumeSpecName: "kube-api-access-tvvcz") pod "f30e83ab-883b-428c-902a-32a578e3b241" (UID: "f30e83ab-883b-428c-902a-32a578e3b241"). InnerVolumeSpecName "kube-api-access-tvvcz". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 02 21:44:09.168499 ip-10-0-138-193 kubenswrapper[2578]: I0602 21:44:09.168462 2578 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-tvvcz\" (UniqueName: \"kubernetes.io/projected/f30e83ab-883b-428c-902a-32a578e3b241-kube-api-access-tvvcz\") on node \"ip-10-0-138-193.ec2.internal\" DevicePath \"\"" Jun 02 21:44:09.168499 ip-10-0-138-193 kubenswrapper[2578]: I0602 21:44:09.168490 2578 reconciler_common.go:299] "Volume detached for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/f30e83ab-883b-428c-902a-32a578e3b241-extensions-socket-volume\") on node \"ip-10-0-138-193.ec2.internal\" DevicePath \"\"" Jun 02 21:44:09.755767 ip-10-0-138-193 kubenswrapper[2578]: I0602 21:44:09.755729 2578 generic.go:358] "Generic (PLEG): container finished" podID="f30e83ab-883b-428c-902a-32a578e3b241" containerID="cf72f8605ac24bf98cbab80c1b939ba30e280059cae923e5b5ddd487b77a2bfe" exitCode=0 Jun 02 21:44:09.756291 ip-10-0-138-193 kubenswrapper[2578]: I0602 21:44:09.755785 2578 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-6bc9f4c76f-m8fjc" Jun 02 21:44:09.756291 ip-10-0-138-193 kubenswrapper[2578]: I0602 21:44:09.755819 2578 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-6bc9f4c76f-m8fjc" event={"ID":"f30e83ab-883b-428c-902a-32a578e3b241","Type":"ContainerDied","Data":"cf72f8605ac24bf98cbab80c1b939ba30e280059cae923e5b5ddd487b77a2bfe"} Jun 02 21:44:09.756291 ip-10-0-138-193 kubenswrapper[2578]: I0602 21:44:09.755864 2578 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-6bc9f4c76f-m8fjc" event={"ID":"f30e83ab-883b-428c-902a-32a578e3b241","Type":"ContainerDied","Data":"e5be3e79d248e99d1820d6807dca0e3b7e70a447dc5a075fb110e47d1accf4e0"} Jun 02 21:44:09.756291 ip-10-0-138-193 kubenswrapper[2578]: I0602 21:44:09.755886 2578 scope.go:117] "RemoveContainer" containerID="cf72f8605ac24bf98cbab80c1b939ba30e280059cae923e5b5ddd487b77a2bfe" Jun 02 21:44:09.765357 ip-10-0-138-193 kubenswrapper[2578]: I0602 21:44:09.765125 2578 scope.go:117] "RemoveContainer" containerID="cf72f8605ac24bf98cbab80c1b939ba30e280059cae923e5b5ddd487b77a2bfe" Jun 02 21:44:09.765435 ip-10-0-138-193 kubenswrapper[2578]: E0602 21:44:09.765415 2578 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"cf72f8605ac24bf98cbab80c1b939ba30e280059cae923e5b5ddd487b77a2bfe\": container with ID starting with cf72f8605ac24bf98cbab80c1b939ba30e280059cae923e5b5ddd487b77a2bfe not found: ID does not exist" containerID="cf72f8605ac24bf98cbab80c1b939ba30e280059cae923e5b5ddd487b77a2bfe" Jun 02 21:44:09.765473 ip-10-0-138-193 kubenswrapper[2578]: I0602 21:44:09.765444 2578 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"cf72f8605ac24bf98cbab80c1b939ba30e280059cae923e5b5ddd487b77a2bfe"} err="failed to get container status \"cf72f8605ac24bf98cbab80c1b939ba30e280059cae923e5b5ddd487b77a2bfe\": rpc error: code = NotFound desc = could not find container \"cf72f8605ac24bf98cbab80c1b939ba30e280059cae923e5b5ddd487b77a2bfe\": container with ID starting with cf72f8605ac24bf98cbab80c1b939ba30e280059cae923e5b5ddd487b77a2bfe not found: ID does not exist" Jun 02 21:44:09.787545 ip-10-0-138-193 kubenswrapper[2578]: I0602 21:44:09.787507 2578 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-6bc9f4c76f-m8fjc"] Jun 02 21:44:09.794475 ip-10-0-138-193 kubenswrapper[2578]: I0602 21:44:09.794446 2578 kubelet.go:2547] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-6bc9f4c76f-m8fjc"] Jun 02 21:44:11.323264 ip-10-0-138-193 kubenswrapper[2578]: I0602 21:44:11.323225 2578 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="f30e83ab-883b-428c-902a-32a578e3b241" path="/var/lib/kubelet/pods/f30e83ab-883b-428c-902a-32a578e3b241/volumes" Jun 02 21:44:28.787609 ip-10-0-138-193 kubenswrapper[2578]: I0602 21:44:28.787571 2578 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["kuadrant-system/limitador-limitador-7d549b5b-9546h"] Jun 02 21:44:28.788028 ip-10-0-138-193 kubenswrapper[2578]: I0602 21:44:28.787981 2578 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="f30e83ab-883b-428c-902a-32a578e3b241" containerName="manager" Jun 02 21:44:28.788028 ip-10-0-138-193 kubenswrapper[2578]: I0602 21:44:28.787992 2578 state_mem.go:107] "Deleted CPUSet assignment" podUID="f30e83ab-883b-428c-902a-32a578e3b241" containerName="manager" Jun 02 21:44:28.788153 ip-10-0-138-193 kubenswrapper[2578]: I0602 21:44:28.788117 2578 memory_manager.go:356] "RemoveStaleState removing state" podUID="f30e83ab-883b-428c-902a-32a578e3b241" containerName="manager" Jun 02 21:44:28.791318 ip-10-0-138-193 kubenswrapper[2578]: I0602 21:44:28.791299 2578 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-limitador-7d549b5b-9546h" Jun 02 21:44:28.793680 ip-10-0-138-193 kubenswrapper[2578]: I0602 21:44:28.793661 2578 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"default-dockercfg-2ng5x\"" Jun 02 21:44:28.793784 ip-10-0-138-193 kubenswrapper[2578]: I0602 21:44:28.793665 2578 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"limitador-limits-config-limitador\"" Jun 02 21:44:28.798131 ip-10-0-138-193 kubenswrapper[2578]: I0602 21:44:28.798099 2578 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-7d549b5b-9546h"] Jun 02 21:44:28.878235 ip-10-0-138-193 kubenswrapper[2578]: I0602 21:44:28.878201 2578 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-7d549b5b-9546h"] Jun 02 21:44:28.957860 ip-10-0-138-193 kubenswrapper[2578]: I0602 21:44:28.957825 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-file\" (UniqueName: \"kubernetes.io/configmap/678bf1d9-0cb2-4be9-b121-99fb65e00774-config-file\") pod \"limitador-limitador-7d549b5b-9546h\" (UID: \"678bf1d9-0cb2-4be9-b121-99fb65e00774\") " pod="kuadrant-system/limitador-limitador-7d549b5b-9546h" Jun 02 21:44:28.957860 ip-10-0-138-193 kubenswrapper[2578]: I0602 21:44:28.957858 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-rsgpb\" (UniqueName: \"kubernetes.io/projected/678bf1d9-0cb2-4be9-b121-99fb65e00774-kube-api-access-rsgpb\") pod \"limitador-limitador-7d549b5b-9546h\" (UID: \"678bf1d9-0cb2-4be9-b121-99fb65e00774\") " pod="kuadrant-system/limitador-limitador-7d549b5b-9546h" Jun 02 21:44:29.059372 ip-10-0-138-193 kubenswrapper[2578]: I0602 21:44:29.059291 2578 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"config-file\" (UniqueName: \"kubernetes.io/configmap/678bf1d9-0cb2-4be9-b121-99fb65e00774-config-file\") pod \"limitador-limitador-7d549b5b-9546h\" (UID: \"678bf1d9-0cb2-4be9-b121-99fb65e00774\") " pod="kuadrant-system/limitador-limitador-7d549b5b-9546h" Jun 02 21:44:29.059372 ip-10-0-138-193 kubenswrapper[2578]: I0602 21:44:29.059329 2578 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-rsgpb\" (UniqueName: \"kubernetes.io/projected/678bf1d9-0cb2-4be9-b121-99fb65e00774-kube-api-access-rsgpb\") pod \"limitador-limitador-7d549b5b-9546h\" (UID: \"678bf1d9-0cb2-4be9-b121-99fb65e00774\") " pod="kuadrant-system/limitador-limitador-7d549b5b-9546h" Jun 02 21:44:29.059890 ip-10-0-138-193 kubenswrapper[2578]: I0602 21:44:29.059872 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-file\" (UniqueName: \"kubernetes.io/configmap/678bf1d9-0cb2-4be9-b121-99fb65e00774-config-file\") pod \"limitador-limitador-7d549b5b-9546h\" (UID: \"678bf1d9-0cb2-4be9-b121-99fb65e00774\") " pod="kuadrant-system/limitador-limitador-7d549b5b-9546h" Jun 02 21:44:29.068622 ip-10-0-138-193 kubenswrapper[2578]: I0602 21:44:29.068595 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-rsgpb\" (UniqueName: \"kubernetes.io/projected/678bf1d9-0cb2-4be9-b121-99fb65e00774-kube-api-access-rsgpb\") pod \"limitador-limitador-7d549b5b-9546h\" (UID: \"678bf1d9-0cb2-4be9-b121-99fb65e00774\") " pod="kuadrant-system/limitador-limitador-7d549b5b-9546h" Jun 02 21:44:29.103602 ip-10-0-138-193 kubenswrapper[2578]: I0602 21:44:29.103573 2578 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-limitador-7d549b5b-9546h" Jun 02 21:44:29.240253 ip-10-0-138-193 kubenswrapper[2578]: I0602 21:44:29.240218 2578 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-7d549b5b-9546h"] Jun 02 21:44:29.241551 ip-10-0-138-193 kubenswrapper[2578]: W0602 21:44:29.241524 2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod678bf1d9_0cb2_4be9_b121_99fb65e00774.slice/crio-414b2a16bd89b18fdb632d4fa58740f61eb130d89e0d8e4482d77911efbf0142 WatchSource:0}: Error finding container 414b2a16bd89b18fdb632d4fa58740f61eb130d89e0d8e4482d77911efbf0142: Status 404 returned error can't find the container with id 414b2a16bd89b18fdb632d4fa58740f61eb130d89e0d8e4482d77911efbf0142 Jun 02 21:44:29.840264 ip-10-0-138-193 kubenswrapper[2578]: I0602 21:44:29.840227 2578 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-limitador-7d549b5b-9546h" event={"ID":"678bf1d9-0cb2-4be9-b121-99fb65e00774","Type":"ContainerStarted","Data":"414b2a16bd89b18fdb632d4fa58740f61eb130d89e0d8e4482d77911efbf0142"} Jun 02 21:44:32.855068 ip-10-0-138-193 kubenswrapper[2578]: I0602 21:44:32.855037 2578 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-limitador-7d549b5b-9546h" event={"ID":"678bf1d9-0cb2-4be9-b121-99fb65e00774","Type":"ContainerStarted","Data":"aac1ddf2bf7e9fa4dbe39db1ba043774accb82e2703be902759f69bf588f5210"} Jun 02 21:44:32.855472 ip-10-0-138-193 kubenswrapper[2578]: I0602 21:44:32.855187 2578 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/limitador-limitador-7d549b5b-9546h" Jun 02 21:44:32.871655 ip-10-0-138-193 kubenswrapper[2578]: I0602 21:44:32.871609 2578 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="kuadrant-system/limitador-limitador-7d549b5b-9546h" podStartSLOduration=2.208373461 podStartE2EDuration="4.871594269s" podCreationTimestamp="2026-06-02 21:44:28 +0000 UTC" firstStartedPulling="2026-06-02 21:44:29.243615913 +0000 UTC m=+646.495513810" lastFinishedPulling="2026-06-02 21:44:31.906836734 +0000 UTC m=+649.158734618" observedRunningTime="2026-06-02 21:44:32.870251493 +0000 UTC m=+650.122149399" watchObservedRunningTime="2026-06-02 21:44:32.871594269 +0000 UTC m=+650.123492173" Jun 02 21:44:43.259001 ip-10-0-138-193 kubenswrapper[2578]: I0602 21:44:43.258971 2578 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["kuadrant-system/limitador-limitador-7d549b5b-9546h"] Jun 02 21:44:43.259463 ip-10-0-138-193 kubenswrapper[2578]: I0602 21:44:43.259236 2578 kuberuntime_container.go:864] "Killing container with a grace period" pod="kuadrant-system/limitador-limitador-7d549b5b-9546h" podUID="678bf1d9-0cb2-4be9-b121-99fb65e00774" containerName="limitador" containerID="cri-o://aac1ddf2bf7e9fa4dbe39db1ba043774accb82e2703be902759f69bf588f5210" gracePeriod=30 Jun 02 21:44:43.259908 ip-10-0-138-193 kubenswrapper[2578]: I0602 21:44:43.259884 2578 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/limitador-limitador-7d549b5b-9546h" Jun 02 21:44:43.900052 ip-10-0-138-193 kubenswrapper[2578]: I0602 21:44:43.900022 2578 generic.go:358] "Generic (PLEG): container finished" podID="678bf1d9-0cb2-4be9-b121-99fb65e00774" containerID="aac1ddf2bf7e9fa4dbe39db1ba043774accb82e2703be902759f69bf588f5210" exitCode=0 Jun 02 21:44:43.900259 ip-10-0-138-193 kubenswrapper[2578]: I0602 21:44:43.900098 2578 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-limitador-7d549b5b-9546h" event={"ID":"678bf1d9-0cb2-4be9-b121-99fb65e00774","Type":"ContainerDied","Data":"aac1ddf2bf7e9fa4dbe39db1ba043774accb82e2703be902759f69bf588f5210"} Jun 02 21:44:44.213481 ip-10-0-138-193 kubenswrapper[2578]: I0602 21:44:44.213456 2578 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-limitador-7d549b5b-9546h" Jun 02 21:44:44.302768 ip-10-0-138-193 kubenswrapper[2578]: I0602 21:44:44.302739 2578 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"config-file\" (UniqueName: \"kubernetes.io/configmap/678bf1d9-0cb2-4be9-b121-99fb65e00774-config-file\") pod \"678bf1d9-0cb2-4be9-b121-99fb65e00774\" (UID: \"678bf1d9-0cb2-4be9-b121-99fb65e00774\") " Jun 02 21:44:44.303249 ip-10-0-138-193 kubenswrapper[2578]: I0602 21:44:44.302822 2578 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-rsgpb\" (UniqueName: \"kubernetes.io/projected/678bf1d9-0cb2-4be9-b121-99fb65e00774-kube-api-access-rsgpb\") pod \"678bf1d9-0cb2-4be9-b121-99fb65e00774\" (UID: \"678bf1d9-0cb2-4be9-b121-99fb65e00774\") " Jun 02 21:44:44.303249 ip-10-0-138-193 kubenswrapper[2578]: I0602 21:44:44.303066 2578 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/678bf1d9-0cb2-4be9-b121-99fb65e00774-config-file" (OuterVolumeSpecName: "config-file") pod "678bf1d9-0cb2-4be9-b121-99fb65e00774" (UID: "678bf1d9-0cb2-4be9-b121-99fb65e00774"). InnerVolumeSpecName "config-file". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jun 02 21:44:44.303249 ip-10-0-138-193 kubenswrapper[2578]: I0602 21:44:44.303206 2578 reconciler_common.go:299] "Volume detached for volume \"config-file\" (UniqueName: \"kubernetes.io/configmap/678bf1d9-0cb2-4be9-b121-99fb65e00774-config-file\") on node \"ip-10-0-138-193.ec2.internal\" DevicePath \"\"" Jun 02 21:44:44.304891 ip-10-0-138-193 kubenswrapper[2578]: I0602 21:44:44.304862 2578 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/678bf1d9-0cb2-4be9-b121-99fb65e00774-kube-api-access-rsgpb" (OuterVolumeSpecName: "kube-api-access-rsgpb") pod "678bf1d9-0cb2-4be9-b121-99fb65e00774" (UID: "678bf1d9-0cb2-4be9-b121-99fb65e00774"). InnerVolumeSpecName "kube-api-access-rsgpb". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 02 21:44:44.404274 ip-10-0-138-193 kubenswrapper[2578]: I0602 21:44:44.404253 2578 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-rsgpb\" (UniqueName: \"kubernetes.io/projected/678bf1d9-0cb2-4be9-b121-99fb65e00774-kube-api-access-rsgpb\") on node \"ip-10-0-138-193.ec2.internal\" DevicePath \"\"" Jun 02 21:44:44.906144 ip-10-0-138-193 kubenswrapper[2578]: I0602 21:44:44.906115 2578 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-limitador-7d549b5b-9546h" Jun 02 21:44:44.906310 ip-10-0-138-193 kubenswrapper[2578]: I0602 21:44:44.906105 2578 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-limitador-7d549b5b-9546h" event={"ID":"678bf1d9-0cb2-4be9-b121-99fb65e00774","Type":"ContainerDied","Data":"414b2a16bd89b18fdb632d4fa58740f61eb130d89e0d8e4482d77911efbf0142"} Jun 02 21:44:44.906310 ip-10-0-138-193 kubenswrapper[2578]: I0602 21:44:44.906234 2578 scope.go:117] "RemoveContainer" containerID="aac1ddf2bf7e9fa4dbe39db1ba043774accb82e2703be902759f69bf588f5210" Jun 02 21:44:44.930690 ip-10-0-138-193 kubenswrapper[2578]: I0602 21:44:44.930657 2578 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["kuadrant-system/limitador-limitador-7d549b5b-9546h"] Jun 02 21:44:44.933051 ip-10-0-138-193 kubenswrapper[2578]: I0602 21:44:44.933026 2578 kubelet.go:2547] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/limitador-limitador-7d549b5b-9546h"] Jun 02 21:44:45.329145 ip-10-0-138-193 kubenswrapper[2578]: I0602 21:44:45.329024 2578 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="678bf1d9-0cb2-4be9-b121-99fb65e00774" path="/var/lib/kubelet/pods/678bf1d9-0cb2-4be9-b121-99fb65e00774/volumes" Jun 02 21:44:48.523335 ip-10-0-138-193 kubenswrapper[2578]: I0602 21:44:48.523293 2578 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["opendatahub/postgres-68c4fbbd6f-mtfqj"] Jun 02 21:44:48.523858 ip-10-0-138-193 kubenswrapper[2578]: I0602 21:44:48.523837 2578 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="678bf1d9-0cb2-4be9-b121-99fb65e00774" containerName="limitador" Jun 02 21:44:48.523951 ip-10-0-138-193 kubenswrapper[2578]: I0602 21:44:48.523861 2578 state_mem.go:107] "Deleted CPUSet assignment" podUID="678bf1d9-0cb2-4be9-b121-99fb65e00774" containerName="limitador" Jun 02 21:44:48.524005 ip-10-0-138-193 kubenswrapper[2578]: I0602 21:44:48.523973 2578 memory_manager.go:356] "RemoveStaleState removing state" podUID="678bf1d9-0cb2-4be9-b121-99fb65e00774" containerName="limitador" Jun 02 21:44:48.528492 ip-10-0-138-193 kubenswrapper[2578]: I0602 21:44:48.528470 2578 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/postgres-68c4fbbd6f-mtfqj" Jun 02 21:44:48.531258 ip-10-0-138-193 kubenswrapper[2578]: I0602 21:44:48.531232 2578 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"postgres-creds\"" Jun 02 21:44:48.533607 ip-10-0-138-193 kubenswrapper[2578]: I0602 21:44:48.533585 2578 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["opendatahub/postgres-68c4fbbd6f-mtfqj"] Jun 02 21:44:48.641798 ip-10-0-138-193 kubenswrapper[2578]: I0602 21:44:48.641760 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-8nz2b\" (UniqueName: \"kubernetes.io/projected/798891bc-fe0b-41d4-af45-bc30ac629870-kube-api-access-8nz2b\") pod \"postgres-68c4fbbd6f-mtfqj\" (UID: \"798891bc-fe0b-41d4-af45-bc30ac629870\") " pod="opendatahub/postgres-68c4fbbd6f-mtfqj" Jun 02 21:44:48.641975 ip-10-0-138-193 kubenswrapper[2578]: I0602 21:44:48.641847 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"data\" (UniqueName: \"kubernetes.io/empty-dir/798891bc-fe0b-41d4-af45-bc30ac629870-data\") pod \"postgres-68c4fbbd6f-mtfqj\" (UID: \"798891bc-fe0b-41d4-af45-bc30ac629870\") " pod="opendatahub/postgres-68c4fbbd6f-mtfqj" Jun 02 21:44:48.743248 ip-10-0-138-193 kubenswrapper[2578]: I0602 21:44:48.743208 2578 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"data\" (UniqueName: \"kubernetes.io/empty-dir/798891bc-fe0b-41d4-af45-bc30ac629870-data\") pod \"postgres-68c4fbbd6f-mtfqj\" (UID: \"798891bc-fe0b-41d4-af45-bc30ac629870\") " pod="opendatahub/postgres-68c4fbbd6f-mtfqj" Jun 02 21:44:48.743429 ip-10-0-138-193 kubenswrapper[2578]: I0602 21:44:48.743289 2578 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-8nz2b\" (UniqueName: \"kubernetes.io/projected/798891bc-fe0b-41d4-af45-bc30ac629870-kube-api-access-8nz2b\") pod \"postgres-68c4fbbd6f-mtfqj\" (UID: \"798891bc-fe0b-41d4-af45-bc30ac629870\") " pod="opendatahub/postgres-68c4fbbd6f-mtfqj" Jun 02 21:44:48.743621 ip-10-0-138-193 kubenswrapper[2578]: I0602 21:44:48.743602 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"data\" (UniqueName: \"kubernetes.io/empty-dir/798891bc-fe0b-41d4-af45-bc30ac629870-data\") pod \"postgres-68c4fbbd6f-mtfqj\" (UID: \"798891bc-fe0b-41d4-af45-bc30ac629870\") " pod="opendatahub/postgres-68c4fbbd6f-mtfqj" Jun 02 21:44:48.751534 ip-10-0-138-193 kubenswrapper[2578]: I0602 21:44:48.751507 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-8nz2b\" (UniqueName: \"kubernetes.io/projected/798891bc-fe0b-41d4-af45-bc30ac629870-kube-api-access-8nz2b\") pod \"postgres-68c4fbbd6f-mtfqj\" (UID: \"798891bc-fe0b-41d4-af45-bc30ac629870\") " pod="opendatahub/postgres-68c4fbbd6f-mtfqj" Jun 02 21:44:48.841266 ip-10-0-138-193 kubenswrapper[2578]: I0602 21:44:48.841170 2578 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/postgres-68c4fbbd6f-mtfqj" Jun 02 21:44:48.979857 ip-10-0-138-193 kubenswrapper[2578]: I0602 21:44:48.979830 2578 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["opendatahub/postgres-68c4fbbd6f-mtfqj"] Jun 02 21:44:48.981642 ip-10-0-138-193 kubenswrapper[2578]: W0602 21:44:48.981610 2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod798891bc_fe0b_41d4_af45_bc30ac629870.slice/crio-700bb434e8242216251d372f231cf214e822d928b94046513d2efbe2b6cd11c2 WatchSource:0}: Error finding container 700bb434e8242216251d372f231cf214e822d928b94046513d2efbe2b6cd11c2: Status 404 returned error can't find the container with id 700bb434e8242216251d372f231cf214e822d928b94046513d2efbe2b6cd11c2 Jun 02 21:44:48.982928 ip-10-0-138-193 kubenswrapper[2578]: I0602 21:44:48.982911 2578 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider Jun 02 21:44:49.928952 ip-10-0-138-193 kubenswrapper[2578]: I0602 21:44:49.928919 2578 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="opendatahub/postgres-68c4fbbd6f-mtfqj" event={"ID":"798891bc-fe0b-41d4-af45-bc30ac629870","Type":"ContainerStarted","Data":"700bb434e8242216251d372f231cf214e822d928b94046513d2efbe2b6cd11c2"} Jun 02 21:44:52.944358 ip-10-0-138-193 kubenswrapper[2578]: I0602 21:44:52.944320 2578 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="opendatahub/postgres-68c4fbbd6f-mtfqj" event={"ID":"798891bc-fe0b-41d4-af45-bc30ac629870","Type":"ContainerStarted","Data":"147d3e4df81856c74adc8e87b6f69cfacaa1513e3fea1710a5765a0c3d0b5d3d"} Jun 02 21:44:52.944744 ip-10-0-138-193 kubenswrapper[2578]: I0602 21:44:52.944507 2578 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/postgres-68c4fbbd6f-mtfqj" Jun 02 21:44:52.961575 ip-10-0-138-193 kubenswrapper[2578]: I0602 21:44:52.961512 2578 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="opendatahub/postgres-68c4fbbd6f-mtfqj" podStartSLOduration=1.860322526 podStartE2EDuration="4.961491867s" podCreationTimestamp="2026-06-02 21:44:48 +0000 UTC" firstStartedPulling="2026-06-02 21:44:48.98303115 +0000 UTC m=+666.234929034" lastFinishedPulling="2026-06-02 21:44:52.084200491 +0000 UTC m=+669.336098375" observedRunningTime="2026-06-02 21:44:52.958948964 +0000 UTC m=+670.210846928" watchObservedRunningTime="2026-06-02 21:44:52.961491867 +0000 UTC m=+670.213389775" Jun 02 21:44:58.983125 ip-10-0-138-193 kubenswrapper[2578]: I0602 21:44:58.983092 2578 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/postgres-68c4fbbd6f-mtfqj" Jun 02 21:45:05.804974 ip-10-0-138-193 kubenswrapper[2578]: I0602 21:45:05.804935 2578 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-marketplace/32684d7096c88e320aaae000f43b8c5ea50d1c3368188ae50aa1502a70vpmtj"] Jun 02 21:45:05.812289 ip-10-0-138-193 kubenswrapper[2578]: I0602 21:45:05.812264 2578 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/32684d7096c88e320aaae000f43b8c5ea50d1c3368188ae50aa1502a70vpmtj" Jun 02 21:45:05.815314 ip-10-0-138-193 kubenswrapper[2578]: I0602 21:45:05.815280 2578 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"openshift-service-ca.crt\"" Jun 02 21:45:05.816069 ip-10-0-138-193 kubenswrapper[2578]: I0602 21:45:05.816043 2578 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-marketplace\"/\"default-dockercfg-hfgcz\"" Jun 02 21:45:05.816237 ip-10-0-138-193 kubenswrapper[2578]: I0602 21:45:05.816108 2578 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"kube-root-ca.crt\"" Jun 02 21:45:05.817764 ip-10-0-138-193 kubenswrapper[2578]: I0602 21:45:05.817733 2578 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/32684d7096c88e320aaae000f43b8c5ea50d1c3368188ae50aa1502a70vpmtj"] Jun 02 21:45:05.907188 ip-10-0-138-193 kubenswrapper[2578]: I0602 21:45:05.907140 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-zp6v4\" (UniqueName: \"kubernetes.io/projected/1256ce72-5fbd-4acf-9205-9e65dc16a169-kube-api-access-zp6v4\") pod \"32684d7096c88e320aaae000f43b8c5ea50d1c3368188ae50aa1502a70vpmtj\" (UID: \"1256ce72-5fbd-4acf-9205-9e65dc16a169\") " pod="openshift-marketplace/32684d7096c88e320aaae000f43b8c5ea50d1c3368188ae50aa1502a70vpmtj" Jun 02 21:45:05.907368 ip-10-0-138-193 kubenswrapper[2578]: I0602 21:45:05.907241 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/1256ce72-5fbd-4acf-9205-9e65dc16a169-util\") pod \"32684d7096c88e320aaae000f43b8c5ea50d1c3368188ae50aa1502a70vpmtj\" (UID: \"1256ce72-5fbd-4acf-9205-9e65dc16a169\") " pod="openshift-marketplace/32684d7096c88e320aaae000f43b8c5ea50d1c3368188ae50aa1502a70vpmtj" Jun 02 21:45:05.907368 ip-10-0-138-193 kubenswrapper[2578]: I0602 21:45:05.907358 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/1256ce72-5fbd-4acf-9205-9e65dc16a169-bundle\") pod \"32684d7096c88e320aaae000f43b8c5ea50d1c3368188ae50aa1502a70vpmtj\" (UID: \"1256ce72-5fbd-4acf-9205-9e65dc16a169\") " pod="openshift-marketplace/32684d7096c88e320aaae000f43b8c5ea50d1c3368188ae50aa1502a70vpmtj" Jun 02 21:45:06.008113 ip-10-0-138-193 kubenswrapper[2578]: I0602 21:45:06.008052 2578 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/1256ce72-5fbd-4acf-9205-9e65dc16a169-util\") pod \"32684d7096c88e320aaae000f43b8c5ea50d1c3368188ae50aa1502a70vpmtj\" (UID: \"1256ce72-5fbd-4acf-9205-9e65dc16a169\") " pod="openshift-marketplace/32684d7096c88e320aaae000f43b8c5ea50d1c3368188ae50aa1502a70vpmtj" Jun 02 21:45:06.008320 ip-10-0-138-193 kubenswrapper[2578]: I0602 21:45:06.008178 2578 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/1256ce72-5fbd-4acf-9205-9e65dc16a169-bundle\") pod \"32684d7096c88e320aaae000f43b8c5ea50d1c3368188ae50aa1502a70vpmtj\" (UID: \"1256ce72-5fbd-4acf-9205-9e65dc16a169\") " pod="openshift-marketplace/32684d7096c88e320aaae000f43b8c5ea50d1c3368188ae50aa1502a70vpmtj" Jun 02 21:45:06.008320 ip-10-0-138-193 kubenswrapper[2578]: I0602 21:45:06.008211 2578 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-zp6v4\" (UniqueName: \"kubernetes.io/projected/1256ce72-5fbd-4acf-9205-9e65dc16a169-kube-api-access-zp6v4\") pod \"32684d7096c88e320aaae000f43b8c5ea50d1c3368188ae50aa1502a70vpmtj\" (UID: \"1256ce72-5fbd-4acf-9205-9e65dc16a169\") " pod="openshift-marketplace/32684d7096c88e320aaae000f43b8c5ea50d1c3368188ae50aa1502a70vpmtj" Jun 02 21:45:06.008528 ip-10-0-138-193 kubenswrapper[2578]: I0602 21:45:06.008500 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/1256ce72-5fbd-4acf-9205-9e65dc16a169-util\") pod \"32684d7096c88e320aaae000f43b8c5ea50d1c3368188ae50aa1502a70vpmtj\" (UID: \"1256ce72-5fbd-4acf-9205-9e65dc16a169\") " pod="openshift-marketplace/32684d7096c88e320aaae000f43b8c5ea50d1c3368188ae50aa1502a70vpmtj" Jun 02 21:45:06.008623 ip-10-0-138-193 kubenswrapper[2578]: I0602 21:45:06.008511 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/1256ce72-5fbd-4acf-9205-9e65dc16a169-bundle\") pod \"32684d7096c88e320aaae000f43b8c5ea50d1c3368188ae50aa1502a70vpmtj\" (UID: \"1256ce72-5fbd-4acf-9205-9e65dc16a169\") " pod="openshift-marketplace/32684d7096c88e320aaae000f43b8c5ea50d1c3368188ae50aa1502a70vpmtj" Jun 02 21:45:06.019204 ip-10-0-138-193 kubenswrapper[2578]: I0602 21:45:06.019177 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-zp6v4\" (UniqueName: \"kubernetes.io/projected/1256ce72-5fbd-4acf-9205-9e65dc16a169-kube-api-access-zp6v4\") pod \"32684d7096c88e320aaae000f43b8c5ea50d1c3368188ae50aa1502a70vpmtj\" (UID: \"1256ce72-5fbd-4acf-9205-9e65dc16a169\") " pod="openshift-marketplace/32684d7096c88e320aaae000f43b8c5ea50d1c3368188ae50aa1502a70vpmtj" Jun 02 21:45:06.123682 ip-10-0-138-193 kubenswrapper[2578]: I0602 21:45:06.123586 2578 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/32684d7096c88e320aaae000f43b8c5ea50d1c3368188ae50aa1502a70vpmtj" Jun 02 21:45:06.259421 ip-10-0-138-193 kubenswrapper[2578]: I0602 21:45:06.259385 2578 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/32684d7096c88e320aaae000f43b8c5ea50d1c3368188ae50aa1502a70vpmtj"] Jun 02 21:45:06.263252 ip-10-0-138-193 kubenswrapper[2578]: W0602 21:45:06.263219 2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod1256ce72_5fbd_4acf_9205_9e65dc16a169.slice/crio-7338d56af495805bbee4f4df477d532a231bc7ca1c248555f17178679110dcbe WatchSource:0}: Error finding container 7338d56af495805bbee4f4df477d532a231bc7ca1c248555f17178679110dcbe: Status 404 returned error can't find the container with id 7338d56af495805bbee4f4df477d532a231bc7ca1c248555f17178679110dcbe Jun 02 21:45:07.003792 ip-10-0-138-193 kubenswrapper[2578]: I0602 21:45:07.003751 2578 generic.go:358] "Generic (PLEG): container finished" podID="1256ce72-5fbd-4acf-9205-9e65dc16a169" containerID="ee8a636c8d27c2463538eb2e36b27b3cb18a95fb95b08f12866f0a403b6578c9" exitCode=0 Jun 02 21:45:07.004211 ip-10-0-138-193 kubenswrapper[2578]: I0602 21:45:07.003819 2578 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/32684d7096c88e320aaae000f43b8c5ea50d1c3368188ae50aa1502a70vpmtj" event={"ID":"1256ce72-5fbd-4acf-9205-9e65dc16a169","Type":"ContainerDied","Data":"ee8a636c8d27c2463538eb2e36b27b3cb18a95fb95b08f12866f0a403b6578c9"} Jun 02 21:45:07.004211 ip-10-0-138-193 kubenswrapper[2578]: I0602 21:45:07.003858 2578 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/32684d7096c88e320aaae000f43b8c5ea50d1c3368188ae50aa1502a70vpmtj" event={"ID":"1256ce72-5fbd-4acf-9205-9e65dc16a169","Type":"ContainerStarted","Data":"7338d56af495805bbee4f4df477d532a231bc7ca1c248555f17178679110dcbe"} Jun 02 21:45:08.009906 ip-10-0-138-193 kubenswrapper[2578]: I0602 21:45:08.009815 2578 generic.go:358] "Generic (PLEG): container finished" podID="1256ce72-5fbd-4acf-9205-9e65dc16a169" containerID="276ae3534e27477b18e2fb5fbdd270be3045bc9aaac56dfb904fe3770a457aab" exitCode=0 Jun 02 21:45:08.009906 ip-10-0-138-193 kubenswrapper[2578]: I0602 21:45:08.009877 2578 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/32684d7096c88e320aaae000f43b8c5ea50d1c3368188ae50aa1502a70vpmtj" event={"ID":"1256ce72-5fbd-4acf-9205-9e65dc16a169","Type":"ContainerDied","Data":"276ae3534e27477b18e2fb5fbdd270be3045bc9aaac56dfb904fe3770a457aab"} Jun 02 21:45:09.016560 ip-10-0-138-193 kubenswrapper[2578]: I0602 21:45:09.016529 2578 generic.go:358] "Generic (PLEG): container finished" podID="1256ce72-5fbd-4acf-9205-9e65dc16a169" containerID="e75dd745cc8904ea04518fd4744fde6b0918e29fab2e662ca83ce3693bb5b4f8" exitCode=0 Jun 02 21:45:09.016973 ip-10-0-138-193 kubenswrapper[2578]: I0602 21:45:09.016615 2578 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/32684d7096c88e320aaae000f43b8c5ea50d1c3368188ae50aa1502a70vpmtj" event={"ID":"1256ce72-5fbd-4acf-9205-9e65dc16a169","Type":"ContainerDied","Data":"e75dd745cc8904ea04518fd4744fde6b0918e29fab2e662ca83ce3693bb5b4f8"} Jun 02 21:45:10.161006 ip-10-0-138-193 kubenswrapper[2578]: I0602 21:45:10.160982 2578 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/32684d7096c88e320aaae000f43b8c5ea50d1c3368188ae50aa1502a70vpmtj" Jun 02 21:45:10.248952 ip-10-0-138-193 kubenswrapper[2578]: I0602 21:45:10.248915 2578 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-zp6v4\" (UniqueName: \"kubernetes.io/projected/1256ce72-5fbd-4acf-9205-9e65dc16a169-kube-api-access-zp6v4\") pod \"1256ce72-5fbd-4acf-9205-9e65dc16a169\" (UID: \"1256ce72-5fbd-4acf-9205-9e65dc16a169\") " Jun 02 21:45:10.249197 ip-10-0-138-193 kubenswrapper[2578]: I0602 21:45:10.248980 2578 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/1256ce72-5fbd-4acf-9205-9e65dc16a169-bundle\") pod \"1256ce72-5fbd-4acf-9205-9e65dc16a169\" (UID: \"1256ce72-5fbd-4acf-9205-9e65dc16a169\") " Jun 02 21:45:10.249197 ip-10-0-138-193 kubenswrapper[2578]: I0602 21:45:10.249007 2578 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/1256ce72-5fbd-4acf-9205-9e65dc16a169-util\") pod \"1256ce72-5fbd-4acf-9205-9e65dc16a169\" (UID: \"1256ce72-5fbd-4acf-9205-9e65dc16a169\") " Jun 02 21:45:10.249578 ip-10-0-138-193 kubenswrapper[2578]: I0602 21:45:10.249554 2578 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/1256ce72-5fbd-4acf-9205-9e65dc16a169-bundle" (OuterVolumeSpecName: "bundle") pod "1256ce72-5fbd-4acf-9205-9e65dc16a169" (UID: "1256ce72-5fbd-4acf-9205-9e65dc16a169"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jun 02 21:45:10.251222 ip-10-0-138-193 kubenswrapper[2578]: I0602 21:45:10.251198 2578 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/1256ce72-5fbd-4acf-9205-9e65dc16a169-kube-api-access-zp6v4" (OuterVolumeSpecName: "kube-api-access-zp6v4") pod "1256ce72-5fbd-4acf-9205-9e65dc16a169" (UID: "1256ce72-5fbd-4acf-9205-9e65dc16a169"). InnerVolumeSpecName "kube-api-access-zp6v4". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 02 21:45:10.254202 ip-10-0-138-193 kubenswrapper[2578]: I0602 21:45:10.254172 2578 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/1256ce72-5fbd-4acf-9205-9e65dc16a169-util" (OuterVolumeSpecName: "util") pod "1256ce72-5fbd-4acf-9205-9e65dc16a169" (UID: "1256ce72-5fbd-4acf-9205-9e65dc16a169"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jun 02 21:45:10.350064 ip-10-0-138-193 kubenswrapper[2578]: I0602 21:45:10.349953 2578 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-zp6v4\" (UniqueName: \"kubernetes.io/projected/1256ce72-5fbd-4acf-9205-9e65dc16a169-kube-api-access-zp6v4\") on node \"ip-10-0-138-193.ec2.internal\" DevicePath \"\"" Jun 02 21:45:10.350064 ip-10-0-138-193 kubenswrapper[2578]: I0602 21:45:10.350007 2578 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/1256ce72-5fbd-4acf-9205-9e65dc16a169-bundle\") on node \"ip-10-0-138-193.ec2.internal\" DevicePath \"\"" Jun 02 21:45:10.350064 ip-10-0-138-193 kubenswrapper[2578]: I0602 21:45:10.350018 2578 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/1256ce72-5fbd-4acf-9205-9e65dc16a169-util\") on node \"ip-10-0-138-193.ec2.internal\" DevicePath \"\"" Jun 02 21:45:11.026615 ip-10-0-138-193 kubenswrapper[2578]: I0602 21:45:11.026577 2578 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/32684d7096c88e320aaae000f43b8c5ea50d1c3368188ae50aa1502a70vpmtj" event={"ID":"1256ce72-5fbd-4acf-9205-9e65dc16a169","Type":"ContainerDied","Data":"7338d56af495805bbee4f4df477d532a231bc7ca1c248555f17178679110dcbe"} Jun 02 21:45:11.026834 ip-10-0-138-193 kubenswrapper[2578]: I0602 21:45:11.026625 2578 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="7338d56af495805bbee4f4df477d532a231bc7ca1c248555f17178679110dcbe" Jun 02 21:45:11.026834 ip-10-0-138-193 kubenswrapper[2578]: I0602 21:45:11.026593 2578 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/32684d7096c88e320aaae000f43b8c5ea50d1c3368188ae50aa1502a70vpmtj" Jun 02 21:45:13.094042 ip-10-0-138-193 kubenswrapper[2578]: I0602 21:45:13.094010 2578 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["keycloak-system/keycloak-operator-7864d68cbd-sbfsh"] Jun 02 21:45:13.094577 ip-10-0-138-193 kubenswrapper[2578]: I0602 21:45:13.094559 2578 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="1256ce72-5fbd-4acf-9205-9e65dc16a169" containerName="util" Jun 02 21:45:13.094577 ip-10-0-138-193 kubenswrapper[2578]: I0602 21:45:13.094579 2578 state_mem.go:107] "Deleted CPUSet assignment" podUID="1256ce72-5fbd-4acf-9205-9e65dc16a169" containerName="util" Jun 02 21:45:13.094676 ip-10-0-138-193 kubenswrapper[2578]: I0602 21:45:13.094599 2578 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="1256ce72-5fbd-4acf-9205-9e65dc16a169" containerName="pull" Jun 02 21:45:13.094676 ip-10-0-138-193 kubenswrapper[2578]: I0602 21:45:13.094607 2578 state_mem.go:107] "Deleted CPUSet assignment" podUID="1256ce72-5fbd-4acf-9205-9e65dc16a169" containerName="pull" Jun 02 21:45:13.094676 ip-10-0-138-193 kubenswrapper[2578]: I0602 21:45:13.094626 2578 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="1256ce72-5fbd-4acf-9205-9e65dc16a169" containerName="extract" Jun 02 21:45:13.094676 ip-10-0-138-193 kubenswrapper[2578]: I0602 21:45:13.094632 2578 state_mem.go:107] "Deleted CPUSet assignment" podUID="1256ce72-5fbd-4acf-9205-9e65dc16a169" containerName="extract" Jun 02 21:45:13.094829 ip-10-0-138-193 kubenswrapper[2578]: I0602 21:45:13.094696 2578 memory_manager.go:356] "RemoveStaleState removing state" podUID="1256ce72-5fbd-4acf-9205-9e65dc16a169" containerName="extract" Jun 02 21:45:13.097979 ip-10-0-138-193 kubenswrapper[2578]: I0602 21:45:13.097962 2578 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="keycloak-system/keycloak-operator-7864d68cbd-sbfsh" Jun 02 21:45:13.100389 ip-10-0-138-193 kubenswrapper[2578]: I0602 21:45:13.100359 2578 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"keycloak-system\"/\"openshift-service-ca.crt\"" Jun 02 21:45:13.100585 ip-10-0-138-193 kubenswrapper[2578]: I0602 21:45:13.100416 2578 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"keycloak-system\"/\"kube-root-ca.crt\"" Jun 02 21:45:13.101383 ip-10-0-138-193 kubenswrapper[2578]: I0602 21:45:13.101363 2578 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"keycloak-system\"/\"keycloak-operator-dockercfg-vt4hl\"" Jun 02 21:45:13.104424 ip-10-0-138-193 kubenswrapper[2578]: I0602 21:45:13.104402 2578 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["keycloak-system/keycloak-operator-7864d68cbd-sbfsh"] Jun 02 21:45:13.277903 ip-10-0-138-193 kubenswrapper[2578]: I0602 21:45:13.277855 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-wqf4k\" (UniqueName: \"kubernetes.io/projected/d1a08e25-da4f-469a-8cc8-2d13ede97d68-kube-api-access-wqf4k\") pod \"keycloak-operator-7864d68cbd-sbfsh\" (UID: \"d1a08e25-da4f-469a-8cc8-2d13ede97d68\") " pod="keycloak-system/keycloak-operator-7864d68cbd-sbfsh" Jun 02 21:45:13.378525 ip-10-0-138-193 kubenswrapper[2578]: I0602 21:45:13.378431 2578 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-wqf4k\" (UniqueName: \"kubernetes.io/projected/d1a08e25-da4f-469a-8cc8-2d13ede97d68-kube-api-access-wqf4k\") pod \"keycloak-operator-7864d68cbd-sbfsh\" (UID: \"d1a08e25-da4f-469a-8cc8-2d13ede97d68\") " pod="keycloak-system/keycloak-operator-7864d68cbd-sbfsh" Jun 02 21:45:13.386438 ip-10-0-138-193 kubenswrapper[2578]: I0602 21:45:13.386406 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-wqf4k\" (UniqueName: \"kubernetes.io/projected/d1a08e25-da4f-469a-8cc8-2d13ede97d68-kube-api-access-wqf4k\") pod \"keycloak-operator-7864d68cbd-sbfsh\" (UID: \"d1a08e25-da4f-469a-8cc8-2d13ede97d68\") " pod="keycloak-system/keycloak-operator-7864d68cbd-sbfsh" Jun 02 21:45:13.409163 ip-10-0-138-193 kubenswrapper[2578]: I0602 21:45:13.409127 2578 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="keycloak-system/keycloak-operator-7864d68cbd-sbfsh" Jun 02 21:45:13.547183 ip-10-0-138-193 kubenswrapper[2578]: I0602 21:45:13.547158 2578 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["keycloak-system/keycloak-operator-7864d68cbd-sbfsh"] Jun 02 21:45:13.548835 ip-10-0-138-193 kubenswrapper[2578]: W0602 21:45:13.548808 2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podd1a08e25_da4f_469a_8cc8_2d13ede97d68.slice/crio-dbf78184b3226904bb5ef2d11666245fd8446235550f659e374da1595f04d07e WatchSource:0}: Error finding container dbf78184b3226904bb5ef2d11666245fd8446235550f659e374da1595f04d07e: Status 404 returned error can't find the container with id dbf78184b3226904bb5ef2d11666245fd8446235550f659e374da1595f04d07e Jun 02 21:45:14.043893 ip-10-0-138-193 kubenswrapper[2578]: I0602 21:45:14.043850 2578 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="keycloak-system/keycloak-operator-7864d68cbd-sbfsh" event={"ID":"d1a08e25-da4f-469a-8cc8-2d13ede97d68","Type":"ContainerStarted","Data":"dbf78184b3226904bb5ef2d11666245fd8446235550f659e374da1595f04d07e"} Jun 02 21:45:20.073047 ip-10-0-138-193 kubenswrapper[2578]: I0602 21:45:20.072954 2578 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="keycloak-system/keycloak-operator-7864d68cbd-sbfsh" event={"ID":"d1a08e25-da4f-469a-8cc8-2d13ede97d68","Type":"ContainerStarted","Data":"e8a859470bb6fe185d31444513e215774bfc59314eac31471a71d9ab906468f1"} Jun 02 21:45:20.091878 ip-10-0-138-193 kubenswrapper[2578]: I0602 21:45:20.091832 2578 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="keycloak-system/keycloak-operator-7864d68cbd-sbfsh" podStartSLOduration=0.986316453 podStartE2EDuration="7.091817415s" podCreationTimestamp="2026-06-02 21:45:13 +0000 UTC" firstStartedPulling="2026-06-02 21:45:13.550311664 +0000 UTC m=+690.802209549" lastFinishedPulling="2026-06-02 21:45:19.655812626 +0000 UTC m=+696.907710511" observedRunningTime="2026-06-02 21:45:20.090309323 +0000 UTC m=+697.342207230" watchObservedRunningTime="2026-06-02 21:45:20.091817415 +0000 UTC m=+697.343715321" Jun 02 21:46:37.164662 ip-10-0-138-193 kubenswrapper[2578]: I0602 21:46:37.164628 2578 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-processing-58b6c8fdc7-l2fkw"] Jun 02 21:46:37.167473 ip-10-0-138-193 kubenswrapper[2578]: I0602 21:46:37.167449 2578 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-58b6c8fdc7-l2fkw" Jun 02 21:46:37.170171 ip-10-0-138-193 kubenswrapper[2578]: I0602 21:46:37.170148 2578 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"payload-processing-plugins\"" Jun 02 21:46:37.170277 ip-10-0-138-193 kubenswrapper[2578]: I0602 21:46:37.170150 2578 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"payload-processing-dockercfg-m6q79\"" Jun 02 21:46:37.176230 ip-10-0-138-193 kubenswrapper[2578]: I0602 21:46:37.176207 2578 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-58b6c8fdc7-l2fkw"] Jun 02 21:46:37.264745 ip-10-0-138-193 kubenswrapper[2578]: I0602 21:46:37.264712 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-l6s9k\" (UniqueName: \"kubernetes.io/projected/aaa9e86f-afac-467c-8e90-924bb2e1f031-kube-api-access-l6s9k\") pod \"payload-processing-58b6c8fdc7-l2fkw\" (UID: \"aaa9e86f-afac-467c-8e90-924bb2e1f031\") " pod="openshift-ingress/payload-processing-58b6c8fdc7-l2fkw" Jun 02 21:46:37.365601 ip-10-0-138-193 kubenswrapper[2578]: I0602 21:46:37.365564 2578 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-l6s9k\" (UniqueName: \"kubernetes.io/projected/aaa9e86f-afac-467c-8e90-924bb2e1f031-kube-api-access-l6s9k\") pod \"payload-processing-58b6c8fdc7-l2fkw\" (UID: \"aaa9e86f-afac-467c-8e90-924bb2e1f031\") " pod="openshift-ingress/payload-processing-58b6c8fdc7-l2fkw" Jun 02 21:46:37.375552 ip-10-0-138-193 kubenswrapper[2578]: I0602 21:46:37.375522 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-l6s9k\" (UniqueName: \"kubernetes.io/projected/aaa9e86f-afac-467c-8e90-924bb2e1f031-kube-api-access-l6s9k\") pod \"payload-processing-58b6c8fdc7-l2fkw\" (UID: \"aaa9e86f-afac-467c-8e90-924bb2e1f031\") " pod="openshift-ingress/payload-processing-58b6c8fdc7-l2fkw" Jun 02 21:46:37.480344 ip-10-0-138-193 kubenswrapper[2578]: I0602 21:46:37.480261 2578 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-58b6c8fdc7-l2fkw" Jun 02 21:46:37.622110 ip-10-0-138-193 kubenswrapper[2578]: I0602 21:46:37.622061 2578 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-58b6c8fdc7-l2fkw"] Jun 02 21:46:37.623486 ip-10-0-138-193 kubenswrapper[2578]: W0602 21:46:37.623459 2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podaaa9e86f_afac_467c_8e90_924bb2e1f031.slice/crio-7483832dd9248a699c22a3933a9602650897e403b429a23c121b22ad6c5931ef WatchSource:0}: Error finding container 7483832dd9248a699c22a3933a9602650897e403b429a23c121b22ad6c5931ef: Status 404 returned error can't find the container with id 7483832dd9248a699c22a3933a9602650897e403b429a23c121b22ad6c5931ef Jun 02 21:46:38.402385 ip-10-0-138-193 kubenswrapper[2578]: I0602 21:46:38.402345 2578 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-58b6c8fdc7-l2fkw" event={"ID":"aaa9e86f-afac-467c-8e90-924bb2e1f031","Type":"ContainerStarted","Data":"7483832dd9248a699c22a3933a9602650897e403b429a23c121b22ad6c5931ef"} Jun 02 21:46:40.412881 ip-10-0-138-193 kubenswrapper[2578]: I0602 21:46:40.412842 2578 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-58b6c8fdc7-l2fkw" event={"ID":"aaa9e86f-afac-467c-8e90-924bb2e1f031","Type":"ContainerStarted","Data":"0f1e3501510d77f02d9d4168efb747542405d58aaeecd6becd2fb5473dda1111"} Jun 02 21:46:40.413313 ip-10-0-138-193 kubenswrapper[2578]: I0602 21:46:40.412889 2578 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-processing-58b6c8fdc7-l2fkw" Jun 02 21:46:40.428839 ip-10-0-138-193 kubenswrapper[2578]: I0602 21:46:40.428789 2578 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-ingress/payload-processing-58b6c8fdc7-l2fkw" podStartSLOduration=1.15213687 podStartE2EDuration="3.428774859s" podCreationTimestamp="2026-06-02 21:46:37 +0000 UTC" firstStartedPulling="2026-06-02 21:46:37.625283264 +0000 UTC m=+774.877181151" lastFinishedPulling="2026-06-02 21:46:39.901921239 +0000 UTC m=+777.153819140" observedRunningTime="2026-06-02 21:46:40.427733827 +0000 UTC m=+777.679631735" watchObservedRunningTime="2026-06-02 21:46:40.428774859 +0000 UTC m=+777.680672765" Jun 02 21:46:51.418682 ip-10-0-138-193 kubenswrapper[2578]: I0602 21:46:51.418645 2578 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-processing-58b6c8fdc7-l2fkw" Jun 02 21:47:32.008477 ip-10-0-138-193 kubenswrapper[2578]: I0602 21:47:32.008418 2578 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["llm/e2e-distinct-2-simulated-kserve-8595bdc8d4-fqhp7"] Jun 02 21:47:32.012492 ip-10-0-138-193 kubenswrapper[2578]: I0602 21:47:32.012471 2578 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-distinct-2-simulated-kserve-8595bdc8d4-fqhp7" Jun 02 21:47:32.014929 ip-10-0-138-193 kubenswrapper[2578]: I0602 21:47:32.014903 2578 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"llm\"/\"kube-root-ca.crt\"" Jun 02 21:47:32.015986 ip-10-0-138-193 kubenswrapper[2578]: I0602 21:47:32.015965 2578 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"default-dockercfg-h8v7p\"" Jun 02 21:47:32.016114 ip-10-0-138-193 kubenswrapper[2578]: I0602 21:47:32.015969 2578 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"llm\"/\"openshift-service-ca.crt\"" Jun 02 21:47:32.016114 ip-10-0-138-193 kubenswrapper[2578]: I0602 21:47:32.015990 2578 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"e2e-distinct-2-simulated-kserve-self-signed-certs\"" Jun 02 21:47:32.022540 ip-10-0-138-193 kubenswrapper[2578]: I0602 21:47:32.022521 2578 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["llm/e2e-distinct-2-simulated-kserve-8595bdc8d4-fqhp7"] Jun 02 21:47:32.083921 ip-10-0-138-193 kubenswrapper[2578]: I0602 21:47:32.083886 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/1351bf62-657f-4151-8a04-7706edf89499-dshm\") pod \"e2e-distinct-2-simulated-kserve-8595bdc8d4-fqhp7\" (UID: \"1351bf62-657f-4151-8a04-7706edf89499\") " pod="llm/e2e-distinct-2-simulated-kserve-8595bdc8d4-fqhp7" Jun 02 21:47:32.083921 ip-10-0-138-193 kubenswrapper[2578]: I0602 21:47:32.083925 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/1351bf62-657f-4151-8a04-7706edf89499-tls-certs\") pod \"e2e-distinct-2-simulated-kserve-8595bdc8d4-fqhp7\" (UID: \"1351bf62-657f-4151-8a04-7706edf89499\") " pod="llm/e2e-distinct-2-simulated-kserve-8595bdc8d4-fqhp7" Jun 02 21:47:32.084159 ip-10-0-138-193 kubenswrapper[2578]: I0602 21:47:32.084006 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kserve-provision-location\" (UniqueName: \"kubernetes.io/empty-dir/1351bf62-657f-4151-8a04-7706edf89499-kserve-provision-location\") pod \"e2e-distinct-2-simulated-kserve-8595bdc8d4-fqhp7\" (UID: \"1351bf62-657f-4151-8a04-7706edf89499\") " pod="llm/e2e-distinct-2-simulated-kserve-8595bdc8d4-fqhp7" Jun 02 21:47:32.084159 ip-10-0-138-193 kubenswrapper[2578]: I0602 21:47:32.084052 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-gl6jf\" (UniqueName: \"kubernetes.io/projected/1351bf62-657f-4151-8a04-7706edf89499-kube-api-access-gl6jf\") pod \"e2e-distinct-2-simulated-kserve-8595bdc8d4-fqhp7\" (UID: \"1351bf62-657f-4151-8a04-7706edf89499\") " pod="llm/e2e-distinct-2-simulated-kserve-8595bdc8d4-fqhp7" Jun 02 21:47:32.084159 ip-10-0-138-193 kubenswrapper[2578]: I0602 21:47:32.084105 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/1351bf62-657f-4151-8a04-7706edf89499-model-cache\") pod \"e2e-distinct-2-simulated-kserve-8595bdc8d4-fqhp7\" (UID: \"1351bf62-657f-4151-8a04-7706edf89499\") " pod="llm/e2e-distinct-2-simulated-kserve-8595bdc8d4-fqhp7" Jun 02 21:47:32.084159 ip-10-0-138-193 kubenswrapper[2578]: I0602 21:47:32.084148 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/1351bf62-657f-4151-8a04-7706edf89499-home\") pod \"e2e-distinct-2-simulated-kserve-8595bdc8d4-fqhp7\" (UID: \"1351bf62-657f-4151-8a04-7706edf89499\") " pod="llm/e2e-distinct-2-simulated-kserve-8595bdc8d4-fqhp7" Jun 02 21:47:32.184856 ip-10-0-138-193 kubenswrapper[2578]: I0602 21:47:32.184814 2578 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/1351bf62-657f-4151-8a04-7706edf89499-model-cache\") pod \"e2e-distinct-2-simulated-kserve-8595bdc8d4-fqhp7\" (UID: \"1351bf62-657f-4151-8a04-7706edf89499\") " pod="llm/e2e-distinct-2-simulated-kserve-8595bdc8d4-fqhp7" Jun 02 21:47:32.184856 ip-10-0-138-193 kubenswrapper[2578]: I0602 21:47:32.184861 2578 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/1351bf62-657f-4151-8a04-7706edf89499-home\") pod \"e2e-distinct-2-simulated-kserve-8595bdc8d4-fqhp7\" (UID: \"1351bf62-657f-4151-8a04-7706edf89499\") " pod="llm/e2e-distinct-2-simulated-kserve-8595bdc8d4-fqhp7" Jun 02 21:47:32.185124 ip-10-0-138-193 kubenswrapper[2578]: I0602 21:47:32.184907 2578 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/1351bf62-657f-4151-8a04-7706edf89499-dshm\") pod \"e2e-distinct-2-simulated-kserve-8595bdc8d4-fqhp7\" (UID: \"1351bf62-657f-4151-8a04-7706edf89499\") " pod="llm/e2e-distinct-2-simulated-kserve-8595bdc8d4-fqhp7" Jun 02 21:47:32.185124 ip-10-0-138-193 kubenswrapper[2578]: I0602 21:47:32.184931 2578 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/1351bf62-657f-4151-8a04-7706edf89499-tls-certs\") pod \"e2e-distinct-2-simulated-kserve-8595bdc8d4-fqhp7\" (UID: \"1351bf62-657f-4151-8a04-7706edf89499\") " pod="llm/e2e-distinct-2-simulated-kserve-8595bdc8d4-fqhp7" Jun 02 21:47:32.185124 ip-10-0-138-193 kubenswrapper[2578]: I0602 21:47:32.185002 2578 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kserve-provision-location\" (UniqueName: \"kubernetes.io/empty-dir/1351bf62-657f-4151-8a04-7706edf89499-kserve-provision-location\") pod \"e2e-distinct-2-simulated-kserve-8595bdc8d4-fqhp7\" (UID: \"1351bf62-657f-4151-8a04-7706edf89499\") " pod="llm/e2e-distinct-2-simulated-kserve-8595bdc8d4-fqhp7" Jun 02 21:47:32.185124 ip-10-0-138-193 kubenswrapper[2578]: I0602 21:47:32.185028 2578 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-gl6jf\" (UniqueName: \"kubernetes.io/projected/1351bf62-657f-4151-8a04-7706edf89499-kube-api-access-gl6jf\") pod \"e2e-distinct-2-simulated-kserve-8595bdc8d4-fqhp7\" (UID: \"1351bf62-657f-4151-8a04-7706edf89499\") " pod="llm/e2e-distinct-2-simulated-kserve-8595bdc8d4-fqhp7" Jun 02 21:47:32.185362 ip-10-0-138-193 kubenswrapper[2578]: I0602 21:47:32.185338 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/1351bf62-657f-4151-8a04-7706edf89499-model-cache\") pod \"e2e-distinct-2-simulated-kserve-8595bdc8d4-fqhp7\" (UID: \"1351bf62-657f-4151-8a04-7706edf89499\") " pod="llm/e2e-distinct-2-simulated-kserve-8595bdc8d4-fqhp7" Jun 02 21:47:32.185422 ip-10-0-138-193 kubenswrapper[2578]: I0602 21:47:32.185363 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/1351bf62-657f-4151-8a04-7706edf89499-home\") pod \"e2e-distinct-2-simulated-kserve-8595bdc8d4-fqhp7\" (UID: \"1351bf62-657f-4151-8a04-7706edf89499\") " pod="llm/e2e-distinct-2-simulated-kserve-8595bdc8d4-fqhp7" Jun 02 21:47:32.185422 ip-10-0-138-193 kubenswrapper[2578]: I0602 21:47:32.185397 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kserve-provision-location\" (UniqueName: \"kubernetes.io/empty-dir/1351bf62-657f-4151-8a04-7706edf89499-kserve-provision-location\") pod \"e2e-distinct-2-simulated-kserve-8595bdc8d4-fqhp7\" (UID: \"1351bf62-657f-4151-8a04-7706edf89499\") " pod="llm/e2e-distinct-2-simulated-kserve-8595bdc8d4-fqhp7" Jun 02 21:47:32.187330 ip-10-0-138-193 kubenswrapper[2578]: I0602 21:47:32.187307 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/1351bf62-657f-4151-8a04-7706edf89499-dshm\") pod \"e2e-distinct-2-simulated-kserve-8595bdc8d4-fqhp7\" (UID: \"1351bf62-657f-4151-8a04-7706edf89499\") " pod="llm/e2e-distinct-2-simulated-kserve-8595bdc8d4-fqhp7" Jun 02 21:47:32.187572 ip-10-0-138-193 kubenswrapper[2578]: I0602 21:47:32.187554 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/1351bf62-657f-4151-8a04-7706edf89499-tls-certs\") pod \"e2e-distinct-2-simulated-kserve-8595bdc8d4-fqhp7\" (UID: \"1351bf62-657f-4151-8a04-7706edf89499\") " pod="llm/e2e-distinct-2-simulated-kserve-8595bdc8d4-fqhp7" Jun 02 21:47:32.200761 ip-10-0-138-193 kubenswrapper[2578]: I0602 21:47:32.200725 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-gl6jf\" (UniqueName: \"kubernetes.io/projected/1351bf62-657f-4151-8a04-7706edf89499-kube-api-access-gl6jf\") pod \"e2e-distinct-2-simulated-kserve-8595bdc8d4-fqhp7\" (UID: \"1351bf62-657f-4151-8a04-7706edf89499\") " pod="llm/e2e-distinct-2-simulated-kserve-8595bdc8d4-fqhp7" Jun 02 21:47:32.324663 ip-10-0-138-193 kubenswrapper[2578]: I0602 21:47:32.324564 2578 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-distinct-2-simulated-kserve-8595bdc8d4-fqhp7" Jun 02 21:47:32.471933 ip-10-0-138-193 kubenswrapper[2578]: I0602 21:47:32.471897 2578 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["llm/e2e-distinct-2-simulated-kserve-8595bdc8d4-fqhp7"] Jun 02 21:47:32.474143 ip-10-0-138-193 kubenswrapper[2578]: W0602 21:47:32.474101 2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod1351bf62_657f_4151_8a04_7706edf89499.slice/crio-f584053fafaabfc1a70b8cec38ca9829e2f53f8fbb2e096806ec9a2e7cbec400 WatchSource:0}: Error finding container f584053fafaabfc1a70b8cec38ca9829e2f53f8fbb2e096806ec9a2e7cbec400: Status 404 returned error can't find the container with id f584053fafaabfc1a70b8cec38ca9829e2f53f8fbb2e096806ec9a2e7cbec400 Jun 02 21:47:32.647125 ip-10-0-138-193 kubenswrapper[2578]: I0602 21:47:32.647086 2578 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="llm/e2e-distinct-2-simulated-kserve-8595bdc8d4-fqhp7" event={"ID":"1351bf62-657f-4151-8a04-7706edf89499","Type":"ContainerStarted","Data":"f584053fafaabfc1a70b8cec38ca9829e2f53f8fbb2e096806ec9a2e7cbec400"} Jun 02 21:47:36.667061 ip-10-0-138-193 kubenswrapper[2578]: I0602 21:47:36.667023 2578 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="llm/e2e-distinct-2-simulated-kserve-8595bdc8d4-fqhp7" event={"ID":"1351bf62-657f-4151-8a04-7706edf89499","Type":"ContainerStarted","Data":"5669d24035125e3d09bd71ea22228213d2278242bc55fb668642dc1e72245b9b"} Jun 02 21:47:38.677165 ip-10-0-138-193 kubenswrapper[2578]: I0602 21:47:38.677127 2578 generic.go:358] "Generic (PLEG): container finished" podID="1351bf62-657f-4151-8a04-7706edf89499" containerID="5669d24035125e3d09bd71ea22228213d2278242bc55fb668642dc1e72245b9b" exitCode=0 Jun 02 21:47:38.677667 ip-10-0-138-193 kubenswrapper[2578]: I0602 21:47:38.677204 2578 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="llm/e2e-distinct-2-simulated-kserve-8595bdc8d4-fqhp7" event={"ID":"1351bf62-657f-4151-8a04-7706edf89499","Type":"ContainerDied","Data":"5669d24035125e3d09bd71ea22228213d2278242bc55fb668642dc1e72245b9b"} Jun 02 21:47:40.687963 ip-10-0-138-193 kubenswrapper[2578]: I0602 21:47:40.687932 2578 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="llm/e2e-distinct-2-simulated-kserve-8595bdc8d4-fqhp7" event={"ID":"1351bf62-657f-4151-8a04-7706edf89499","Type":"ContainerStarted","Data":"82bf1700dbd15036c11e65cd99642be118b3b08c6cdb8030cb9fb4958361ff45"} Jun 02 21:47:40.707419 ip-10-0-138-193 kubenswrapper[2578]: I0602 21:47:40.707367 2578 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="llm/e2e-distinct-2-simulated-kserve-8595bdc8d4-fqhp7" podStartSLOduration=2.460854127 podStartE2EDuration="9.707351639s" podCreationTimestamp="2026-06-02 21:47:31 +0000 UTC" firstStartedPulling="2026-06-02 21:47:32.476741776 +0000 UTC m=+829.728639659" lastFinishedPulling="2026-06-02 21:47:39.723239284 +0000 UTC m=+836.975137171" observedRunningTime="2026-06-02 21:47:40.70646217 +0000 UTC m=+837.958360077" watchObservedRunningTime="2026-06-02 21:47:40.707351639 +0000 UTC m=+837.959249544" Jun 02 21:47:42.325354 ip-10-0-138-193 kubenswrapper[2578]: I0602 21:47:42.325312 2578 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="llm/e2e-distinct-2-simulated-kserve-8595bdc8d4-fqhp7" Jun 02 21:47:42.325354 ip-10-0-138-193 kubenswrapper[2578]: I0602 21:47:42.325364 2578 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="llm/e2e-distinct-2-simulated-kserve-8595bdc8d4-fqhp7" Jun 02 21:47:42.341795 ip-10-0-138-193 kubenswrapper[2578]: I0602 21:47:42.341764 2578 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="started" pod="llm/e2e-distinct-2-simulated-kserve-8595bdc8d4-fqhp7" Jun 02 21:47:42.708872 ip-10-0-138-193 kubenswrapper[2578]: I0602 21:47:42.708845 2578 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="llm/e2e-distinct-2-simulated-kserve-8595bdc8d4-fqhp7" Jun 02 21:48:43.273852 ip-10-0-138-193 kubenswrapper[2578]: I0602 21:48:43.273759 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-5zgzd_ecde3d34-b3a4-422b-9a2d-c8a4541cc718/ovn-acl-logging/0.log" Jun 02 21:48:43.277298 ip-10-0-138-193 kubenswrapper[2578]: I0602 21:48:43.277277 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-5zgzd_ecde3d34-b3a4-422b-9a2d-c8a4541cc718/ovn-acl-logging/0.log" Jun 02 21:53:43.319744 ip-10-0-138-193 kubenswrapper[2578]: I0602 21:53:43.319705 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-5zgzd_ecde3d34-b3a4-422b-9a2d-c8a4541cc718/ovn-acl-logging/0.log" Jun 02 21:53:43.324690 ip-10-0-138-193 kubenswrapper[2578]: I0602 21:53:43.324670 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-5zgzd_ecde3d34-b3a4-422b-9a2d-c8a4541cc718/ovn-acl-logging/0.log" Jun 02 21:58:43.362228 ip-10-0-138-193 kubenswrapper[2578]: I0602 21:58:43.362201 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-5zgzd_ecde3d34-b3a4-422b-9a2d-c8a4541cc718/ovn-acl-logging/0.log" Jun 02 21:58:43.363439 ip-10-0-138-193 kubenswrapper[2578]: I0602 21:58:43.363419 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-5zgzd_ecde3d34-b3a4-422b-9a2d-c8a4541cc718/ovn-acl-logging/0.log" Jun 02 22:00:00.144368 ip-10-0-138-193 kubenswrapper[2578]: I0602 22:00:00.144329 2578 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["opendatahub/maas-api-key-cleanup-29673960-69vm7"] Jun 02 22:00:00.147965 ip-10-0-138-193 kubenswrapper[2578]: I0602 22:00:00.147948 2578 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-api-key-cleanup-29673960-69vm7" Jun 02 22:00:00.150311 ip-10-0-138-193 kubenswrapper[2578]: I0602 22:00:00.150288 2578 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"maas-api-dockercfg-r2mw2\"" Jun 02 22:00:00.161883 ip-10-0-138-193 kubenswrapper[2578]: I0602 22:00:00.161855 2578 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-api-key-cleanup-29673960-69vm7"] Jun 02 22:00:00.305083 ip-10-0-138-193 kubenswrapper[2578]: I0602 22:00:00.305032 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-ddpmf\" (UniqueName: \"kubernetes.io/projected/5437f7af-f0bc-420d-8ec9-fd718601273d-kube-api-access-ddpmf\") pod \"maas-api-key-cleanup-29673960-69vm7\" (UID: \"5437f7af-f0bc-420d-8ec9-fd718601273d\") " pod="opendatahub/maas-api-key-cleanup-29673960-69vm7" Jun 02 22:00:00.406575 ip-10-0-138-193 kubenswrapper[2578]: I0602 22:00:00.406474 2578 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-ddpmf\" (UniqueName: \"kubernetes.io/projected/5437f7af-f0bc-420d-8ec9-fd718601273d-kube-api-access-ddpmf\") pod \"maas-api-key-cleanup-29673960-69vm7\" (UID: \"5437f7af-f0bc-420d-8ec9-fd718601273d\") " pod="opendatahub/maas-api-key-cleanup-29673960-69vm7" Jun 02 22:00:00.415357 ip-10-0-138-193 kubenswrapper[2578]: I0602 22:00:00.415334 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-ddpmf\" (UniqueName: \"kubernetes.io/projected/5437f7af-f0bc-420d-8ec9-fd718601273d-kube-api-access-ddpmf\") pod \"maas-api-key-cleanup-29673960-69vm7\" (UID: \"5437f7af-f0bc-420d-8ec9-fd718601273d\") " pod="opendatahub/maas-api-key-cleanup-29673960-69vm7" Jun 02 22:00:00.459315 ip-10-0-138-193 kubenswrapper[2578]: I0602 22:00:00.459278 2578 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-api-key-cleanup-29673960-69vm7" Jun 02 22:00:00.605163 ip-10-0-138-193 kubenswrapper[2578]: I0602 22:00:00.605127 2578 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-api-key-cleanup-29673960-69vm7"] Jun 02 22:00:00.606653 ip-10-0-138-193 kubenswrapper[2578]: W0602 22:00:00.606623 2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod5437f7af_f0bc_420d_8ec9_fd718601273d.slice/crio-148bb57565c2c09ec21e3b4e2457b3826ae71b787ded6e9630c8d426b20364f0 WatchSource:0}: Error finding container 148bb57565c2c09ec21e3b4e2457b3826ae71b787ded6e9630c8d426b20364f0: Status 404 returned error can't find the container with id 148bb57565c2c09ec21e3b4e2457b3826ae71b787ded6e9630c8d426b20364f0 Jun 02 22:00:00.608504 ip-10-0-138-193 kubenswrapper[2578]: I0602 22:00:00.608487 2578 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider Jun 02 22:00:00.818516 ip-10-0-138-193 kubenswrapper[2578]: I0602 22:00:00.818428 2578 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-api-key-cleanup-29673960-69vm7" event={"ID":"5437f7af-f0bc-420d-8ec9-fd718601273d","Type":"ContainerStarted","Data":"148bb57565c2c09ec21e3b4e2457b3826ae71b787ded6e9630c8d426b20364f0"} Jun 02 22:00:04.838165 ip-10-0-138-193 kubenswrapper[2578]: I0602 22:00:04.838050 2578 generic.go:358] "Generic (PLEG): container finished" podID="5437f7af-f0bc-420d-8ec9-fd718601273d" containerID="d60db059bc0c526b368573c64364db4f6f047ad87fa59146c9cf5dbc5455eed8" exitCode=0 Jun 02 22:00:04.838165 ip-10-0-138-193 kubenswrapper[2578]: I0602 22:00:04.838139 2578 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-api-key-cleanup-29673960-69vm7" event={"ID":"5437f7af-f0bc-420d-8ec9-fd718601273d","Type":"ContainerDied","Data":"d60db059bc0c526b368573c64364db4f6f047ad87fa59146c9cf5dbc5455eed8"} Jun 02 22:00:05.979999 ip-10-0-138-193 kubenswrapper[2578]: I0602 22:00:05.979970 2578 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-api-key-cleanup-29673960-69vm7" Jun 02 22:00:06.059517 ip-10-0-138-193 kubenswrapper[2578]: I0602 22:00:06.059485 2578 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-ddpmf\" (UniqueName: \"kubernetes.io/projected/5437f7af-f0bc-420d-8ec9-fd718601273d-kube-api-access-ddpmf\") pod \"5437f7af-f0bc-420d-8ec9-fd718601273d\" (UID: \"5437f7af-f0bc-420d-8ec9-fd718601273d\") " Jun 02 22:00:06.061755 ip-10-0-138-193 kubenswrapper[2578]: I0602 22:00:06.061727 2578 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/5437f7af-f0bc-420d-8ec9-fd718601273d-kube-api-access-ddpmf" (OuterVolumeSpecName: "kube-api-access-ddpmf") pod "5437f7af-f0bc-420d-8ec9-fd718601273d" (UID: "5437f7af-f0bc-420d-8ec9-fd718601273d"). InnerVolumeSpecName "kube-api-access-ddpmf". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 02 22:00:06.161015 ip-10-0-138-193 kubenswrapper[2578]: I0602 22:00:06.160978 2578 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-ddpmf\" (UniqueName: \"kubernetes.io/projected/5437f7af-f0bc-420d-8ec9-fd718601273d-kube-api-access-ddpmf\") on node \"ip-10-0-138-193.ec2.internal\" DevicePath \"\"" Jun 02 22:00:06.847840 ip-10-0-138-193 kubenswrapper[2578]: I0602 22:00:06.847806 2578 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-api-key-cleanup-29673960-69vm7" event={"ID":"5437f7af-f0bc-420d-8ec9-fd718601273d","Type":"ContainerDied","Data":"148bb57565c2c09ec21e3b4e2457b3826ae71b787ded6e9630c8d426b20364f0"} Jun 02 22:00:06.847840 ip-10-0-138-193 kubenswrapper[2578]: I0602 22:00:06.847844 2578 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="148bb57565c2c09ec21e3b4e2457b3826ae71b787ded6e9630c8d426b20364f0" Jun 02 22:00:06.848046 ip-10-0-138-193 kubenswrapper[2578]: I0602 22:00:06.847815 2578 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-api-key-cleanup-29673960-69vm7" Jun 02 22:01:31.852107 ip-10-0-138-193 kubenswrapper[2578]: I0602 22:01:31.852051 2578 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-55c7f4c975-dbbcf"] Jun 02 22:01:31.852662 ip-10-0-138-193 kubenswrapper[2578]: I0602 22:01:31.852306 2578 kuberuntime_container.go:864] "Killing container with a grace period" pod="kuadrant-system/kuadrant-operator-controller-manager-55c7f4c975-dbbcf" podUID="2d526ec3-d797-4041-a368-6015f1ca9ee2" containerName="manager" containerID="cri-o://d94c9035ecd2fa39e037ebda1bb9c08c08a49738eb4d132aca161517c92b5366" gracePeriod=10 Jun 02 22:01:32.113714 ip-10-0-138-193 kubenswrapper[2578]: I0602 22:01:32.113658 2578 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-55c7f4c975-dbbcf" Jun 02 22:01:32.173911 ip-10-0-138-193 kubenswrapper[2578]: I0602 22:01:32.173879 2578 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/2d526ec3-d797-4041-a368-6015f1ca9ee2-extensions-socket-volume\") pod \"2d526ec3-d797-4041-a368-6015f1ca9ee2\" (UID: \"2d526ec3-d797-4041-a368-6015f1ca9ee2\") " Jun 02 22:01:32.174066 ip-10-0-138-193 kubenswrapper[2578]: I0602 22:01:32.173996 2578 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-w9784\" (UniqueName: \"kubernetes.io/projected/2d526ec3-d797-4041-a368-6015f1ca9ee2-kube-api-access-w9784\") pod \"2d526ec3-d797-4041-a368-6015f1ca9ee2\" (UID: \"2d526ec3-d797-4041-a368-6015f1ca9ee2\") " Jun 02 22:01:32.174324 ip-10-0-138-193 kubenswrapper[2578]: I0602 22:01:32.174300 2578 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/2d526ec3-d797-4041-a368-6015f1ca9ee2-extensions-socket-volume" (OuterVolumeSpecName: "extensions-socket-volume") pod "2d526ec3-d797-4041-a368-6015f1ca9ee2" (UID: "2d526ec3-d797-4041-a368-6015f1ca9ee2"). InnerVolumeSpecName "extensions-socket-volume". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jun 02 22:01:32.176025 ip-10-0-138-193 kubenswrapper[2578]: I0602 22:01:32.175999 2578 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/2d526ec3-d797-4041-a368-6015f1ca9ee2-kube-api-access-w9784" (OuterVolumeSpecName: "kube-api-access-w9784") pod "2d526ec3-d797-4041-a368-6015f1ca9ee2" (UID: "2d526ec3-d797-4041-a368-6015f1ca9ee2"). InnerVolumeSpecName "kube-api-access-w9784". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 02 22:01:32.241407 ip-10-0-138-193 kubenswrapper[2578]: I0602 22:01:32.241381 2578 generic.go:358] "Generic (PLEG): container finished" podID="2d526ec3-d797-4041-a368-6015f1ca9ee2" containerID="d94c9035ecd2fa39e037ebda1bb9c08c08a49738eb4d132aca161517c92b5366" exitCode=0 Jun 02 22:01:32.241509 ip-10-0-138-193 kubenswrapper[2578]: I0602 22:01:32.241446 2578 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-55c7f4c975-dbbcf" Jun 02 22:01:32.241509 ip-10-0-138-193 kubenswrapper[2578]: I0602 22:01:32.241457 2578 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-55c7f4c975-dbbcf" event={"ID":"2d526ec3-d797-4041-a368-6015f1ca9ee2","Type":"ContainerDied","Data":"d94c9035ecd2fa39e037ebda1bb9c08c08a49738eb4d132aca161517c92b5366"} Jun 02 22:01:32.241509 ip-10-0-138-193 kubenswrapper[2578]: I0602 22:01:32.241497 2578 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-55c7f4c975-dbbcf" event={"ID":"2d526ec3-d797-4041-a368-6015f1ca9ee2","Type":"ContainerDied","Data":"5d68520245b29c1583da4c6a3df9cf3ef1a78e2e0af6decfa3c856cf31b70b4f"} Jun 02 22:01:32.241622 ip-10-0-138-193 kubenswrapper[2578]: I0602 22:01:32.241516 2578 scope.go:117] "RemoveContainer" containerID="d94c9035ecd2fa39e037ebda1bb9c08c08a49738eb4d132aca161517c92b5366" Jun 02 22:01:32.251479 ip-10-0-138-193 kubenswrapper[2578]: I0602 22:01:32.251465 2578 scope.go:117] "RemoveContainer" containerID="d94c9035ecd2fa39e037ebda1bb9c08c08a49738eb4d132aca161517c92b5366" Jun 02 22:01:32.251713 ip-10-0-138-193 kubenswrapper[2578]: E0602 22:01:32.251693 2578 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"d94c9035ecd2fa39e037ebda1bb9c08c08a49738eb4d132aca161517c92b5366\": container with ID starting with d94c9035ecd2fa39e037ebda1bb9c08c08a49738eb4d132aca161517c92b5366 not found: ID does not exist" containerID="d94c9035ecd2fa39e037ebda1bb9c08c08a49738eb4d132aca161517c92b5366" Jun 02 22:01:32.251755 ip-10-0-138-193 kubenswrapper[2578]: I0602 22:01:32.251722 2578 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"d94c9035ecd2fa39e037ebda1bb9c08c08a49738eb4d132aca161517c92b5366"} err="failed to get container status \"d94c9035ecd2fa39e037ebda1bb9c08c08a49738eb4d132aca161517c92b5366\": rpc error: code = NotFound desc = could not find container \"d94c9035ecd2fa39e037ebda1bb9c08c08a49738eb4d132aca161517c92b5366\": container with ID starting with d94c9035ecd2fa39e037ebda1bb9c08c08a49738eb4d132aca161517c92b5366 not found: ID does not exist" Jun 02 22:01:32.263793 ip-10-0-138-193 kubenswrapper[2578]: I0602 22:01:32.263769 2578 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-55c7f4c975-dbbcf"] Jun 02 22:01:32.267974 ip-10-0-138-193 kubenswrapper[2578]: I0602 22:01:32.267945 2578 kubelet.go:2547] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-55c7f4c975-dbbcf"] Jun 02 22:01:32.274789 ip-10-0-138-193 kubenswrapper[2578]: I0602 22:01:32.274768 2578 reconciler_common.go:299] "Volume detached for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/2d526ec3-d797-4041-a368-6015f1ca9ee2-extensions-socket-volume\") on node \"ip-10-0-138-193.ec2.internal\" DevicePath \"\"" Jun 02 22:01:32.274789 ip-10-0-138-193 kubenswrapper[2578]: I0602 22:01:32.274791 2578 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-w9784\" (UniqueName: \"kubernetes.io/projected/2d526ec3-d797-4041-a368-6015f1ca9ee2-kube-api-access-w9784\") on node \"ip-10-0-138-193.ec2.internal\" DevicePath \"\"" Jun 02 22:01:33.323748 ip-10-0-138-193 kubenswrapper[2578]: I0602 22:01:33.323715 2578 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="2d526ec3-d797-4041-a368-6015f1ca9ee2" path="/var/lib/kubelet/pods/2d526ec3-d797-4041-a368-6015f1ca9ee2/volumes" Jun 02 22:02:37.959627 ip-10-0-138-193 kubenswrapper[2578]: I0602 22:02:37.959590 2578 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-55c7f4c975-zfv9t"] Jun 02 22:02:37.960051 ip-10-0-138-193 kubenswrapper[2578]: I0602 22:02:37.960033 2578 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="2d526ec3-d797-4041-a368-6015f1ca9ee2" containerName="manager" Jun 02 22:02:37.960051 ip-10-0-138-193 kubenswrapper[2578]: I0602 22:02:37.960048 2578 state_mem.go:107] "Deleted CPUSet assignment" podUID="2d526ec3-d797-4041-a368-6015f1ca9ee2" containerName="manager" Jun 02 22:02:37.960172 ip-10-0-138-193 kubenswrapper[2578]: I0602 22:02:37.960067 2578 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="5437f7af-f0bc-420d-8ec9-fd718601273d" containerName="cleanup" Jun 02 22:02:37.960172 ip-10-0-138-193 kubenswrapper[2578]: I0602 22:02:37.960090 2578 state_mem.go:107] "Deleted CPUSet assignment" podUID="5437f7af-f0bc-420d-8ec9-fd718601273d" containerName="cleanup" Jun 02 22:02:37.960172 ip-10-0-138-193 kubenswrapper[2578]: I0602 22:02:37.960155 2578 memory_manager.go:356] "RemoveStaleState removing state" podUID="2d526ec3-d797-4041-a368-6015f1ca9ee2" containerName="manager" Jun 02 22:02:37.960172 ip-10-0-138-193 kubenswrapper[2578]: I0602 22:02:37.960166 2578 memory_manager.go:356] "RemoveStaleState removing state" podUID="5437f7af-f0bc-420d-8ec9-fd718601273d" containerName="cleanup" Jun 02 22:02:37.963403 ip-10-0-138-193 kubenswrapper[2578]: I0602 22:02:37.963387 2578 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-55c7f4c975-zfv9t" Jun 02 22:02:37.965928 ip-10-0-138-193 kubenswrapper[2578]: I0602 22:02:37.965896 2578 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"openshift-service-ca.crt\"" Jun 02 22:02:37.966103 ip-10-0-138-193 kubenswrapper[2578]: I0602 22:02:37.965986 2578 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"kube-root-ca.crt\"" Jun 02 22:02:37.966168 ip-10-0-138-193 kubenswrapper[2578]: I0602 22:02:37.966126 2578 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"kuadrant-operator-controller-manager-dockercfg-87zqm\"" Jun 02 22:02:37.976461 ip-10-0-138-193 kubenswrapper[2578]: I0602 22:02:37.976426 2578 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-55c7f4c975-zfv9t"] Jun 02 22:02:38.087201 ip-10-0-138-193 kubenswrapper[2578]: I0602 22:02:38.087165 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/c2f07c91-6da8-490c-aeb4-f27c02ca95b1-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-55c7f4c975-zfv9t\" (UID: \"c2f07c91-6da8-490c-aeb4-f27c02ca95b1\") " pod="kuadrant-system/kuadrant-operator-controller-manager-55c7f4c975-zfv9t" Jun 02 22:02:38.087392 ip-10-0-138-193 kubenswrapper[2578]: I0602 22:02:38.087291 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-l5zm7\" (UniqueName: \"kubernetes.io/projected/c2f07c91-6da8-490c-aeb4-f27c02ca95b1-kube-api-access-l5zm7\") pod \"kuadrant-operator-controller-manager-55c7f4c975-zfv9t\" (UID: \"c2f07c91-6da8-490c-aeb4-f27c02ca95b1\") " pod="kuadrant-system/kuadrant-operator-controller-manager-55c7f4c975-zfv9t" Jun 02 22:02:38.187776 ip-10-0-138-193 kubenswrapper[2578]: I0602 22:02:38.187735 2578 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/c2f07c91-6da8-490c-aeb4-f27c02ca95b1-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-55c7f4c975-zfv9t\" (UID: \"c2f07c91-6da8-490c-aeb4-f27c02ca95b1\") " pod="kuadrant-system/kuadrant-operator-controller-manager-55c7f4c975-zfv9t" Jun 02 22:02:38.187951 ip-10-0-138-193 kubenswrapper[2578]: I0602 22:02:38.187830 2578 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-l5zm7\" (UniqueName: \"kubernetes.io/projected/c2f07c91-6da8-490c-aeb4-f27c02ca95b1-kube-api-access-l5zm7\") pod \"kuadrant-operator-controller-manager-55c7f4c975-zfv9t\" (UID: \"c2f07c91-6da8-490c-aeb4-f27c02ca95b1\") " pod="kuadrant-system/kuadrant-operator-controller-manager-55c7f4c975-zfv9t" Jun 02 22:02:38.188161 ip-10-0-138-193 kubenswrapper[2578]: I0602 22:02:38.188139 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/c2f07c91-6da8-490c-aeb4-f27c02ca95b1-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-55c7f4c975-zfv9t\" (UID: \"c2f07c91-6da8-490c-aeb4-f27c02ca95b1\") " pod="kuadrant-system/kuadrant-operator-controller-manager-55c7f4c975-zfv9t" Jun 02 22:02:38.197628 ip-10-0-138-193 kubenswrapper[2578]: I0602 22:02:38.197595 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-l5zm7\" (UniqueName: \"kubernetes.io/projected/c2f07c91-6da8-490c-aeb4-f27c02ca95b1-kube-api-access-l5zm7\") pod \"kuadrant-operator-controller-manager-55c7f4c975-zfv9t\" (UID: \"c2f07c91-6da8-490c-aeb4-f27c02ca95b1\") " pod="kuadrant-system/kuadrant-operator-controller-manager-55c7f4c975-zfv9t" Jun 02 22:02:38.275757 ip-10-0-138-193 kubenswrapper[2578]: I0602 22:02:38.275670 2578 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-55c7f4c975-zfv9t" Jun 02 22:02:38.426739 ip-10-0-138-193 kubenswrapper[2578]: I0602 22:02:38.426708 2578 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-55c7f4c975-zfv9t"] Jun 02 22:02:38.428321 ip-10-0-138-193 kubenswrapper[2578]: W0602 22:02:38.428292 2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podc2f07c91_6da8_490c_aeb4_f27c02ca95b1.slice/crio-c0115796272e3742129ff6ad8d1c16aaeef147518fa556f1fc9c8b073441b7b4 WatchSource:0}: Error finding container c0115796272e3742129ff6ad8d1c16aaeef147518fa556f1fc9c8b073441b7b4: Status 404 returned error can't find the container with id c0115796272e3742129ff6ad8d1c16aaeef147518fa556f1fc9c8b073441b7b4 Jun 02 22:02:38.524220 ip-10-0-138-193 kubenswrapper[2578]: I0602 22:02:38.524181 2578 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-55c7f4c975-zfv9t" event={"ID":"c2f07c91-6da8-490c-aeb4-f27c02ca95b1","Type":"ContainerStarted","Data":"aa36f05d72410d72e0fa8906c74ed18b49b96980ba7efefbb539d5fe25d469a7"} Jun 02 22:02:38.524220 ip-10-0-138-193 kubenswrapper[2578]: I0602 22:02:38.524221 2578 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-55c7f4c975-zfv9t" event={"ID":"c2f07c91-6da8-490c-aeb4-f27c02ca95b1","Type":"ContainerStarted","Data":"c0115796272e3742129ff6ad8d1c16aaeef147518fa556f1fc9c8b073441b7b4"} Jun 02 22:02:38.524445 ip-10-0-138-193 kubenswrapper[2578]: I0602 22:02:38.524300 2578 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/kuadrant-operator-controller-manager-55c7f4c975-zfv9t" Jun 02 22:02:38.551414 ip-10-0-138-193 kubenswrapper[2578]: I0602 22:02:38.551308 2578 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="kuadrant-system/kuadrant-operator-controller-manager-55c7f4c975-zfv9t" podStartSLOduration=1.551291371 podStartE2EDuration="1.551291371s" podCreationTimestamp="2026-06-02 22:02:37 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2026-06-02 22:02:38.548384683 +0000 UTC m=+1735.800282613" watchObservedRunningTime="2026-06-02 22:02:38.551291371 +0000 UTC m=+1735.803189277" Jun 02 22:02:49.531585 ip-10-0-138-193 kubenswrapper[2578]: I0602 22:02:49.531554 2578 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/kuadrant-operator-controller-manager-55c7f4c975-zfv9t" Jun 02 22:03:43.401057 ip-10-0-138-193 kubenswrapper[2578]: I0602 22:03:43.401027 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-5zgzd_ecde3d34-b3a4-422b-9a2d-c8a4541cc718/ovn-acl-logging/0.log" Jun 02 22:03:43.405282 ip-10-0-138-193 kubenswrapper[2578]: I0602 22:03:43.405256 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-5zgzd_ecde3d34-b3a4-422b-9a2d-c8a4541cc718/ovn-acl-logging/0.log" Jun 02 22:08:43.440301 ip-10-0-138-193 kubenswrapper[2578]: I0602 22:08:43.440271 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-5zgzd_ecde3d34-b3a4-422b-9a2d-c8a4541cc718/ovn-acl-logging/0.log" Jun 02 22:08:43.443828 ip-10-0-138-193 kubenswrapper[2578]: I0602 22:08:43.443797 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-5zgzd_ecde3d34-b3a4-422b-9a2d-c8a4541cc718/ovn-acl-logging/0.log" Jun 02 22:12:43.353373 ip-10-0-138-193 kubenswrapper[2578]: I0602 22:12:43.353321 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_dashboard-redirect-5465dccb5c-pr685_e16bb753-b4d4-472f-abb1-278f9e7de2d4/nginx/0.log" Jun 02 22:12:43.467442 ip-10-0-138-193 kubenswrapper[2578]: I0602 22:12:43.467403 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_kserve-controller-manager-7c99ffcdcd-8fjxd_02c1307a-01b3-41fb-964c-e9e39a209d43/manager/0.log" Jun 02 22:12:43.587396 ip-10-0-138-193 kubenswrapper[2578]: I0602 22:12:43.587338 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_llmisvc-controller-manager-c6b9847d7-f6h7k_2faafa98-aeb5-4ddc-af54-52c9d393e96b/manager/0.log" Jun 02 22:12:43.816602 ip-10-0-138-193 kubenswrapper[2578]: I0602 22:12:43.816573 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_maas-api-key-cleanup-29673960-69vm7_5437f7af-f0bc-420d-8ec9-fd718601273d/cleanup/0.log" Jun 02 22:12:44.059206 ip-10-0-138-193 kubenswrapper[2578]: I0602 22:12:44.059180 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_model-serving-api-6577596cd5-qrtph_6afe9127-42ef-46e0-8971-cfd2dde15517/server/0.log" Jun 02 22:12:44.291904 ip-10-0-138-193 kubenswrapper[2578]: I0602 22:12:44.291874 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-8b78d96d9-jvff6_656790e6-33df-4988-af65-c88bc533c318/copy-manifests/0.log" Jun 02 22:12:44.297652 ip-10-0-138-193 kubenswrapper[2578]: I0602 22:12:44.297631 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-8b78d96d9-jvff6_656790e6-33df-4988-af65-c88bc533c318/manager/0.log" Jun 02 22:12:44.661067 ip-10-0-138-193 kubenswrapper[2578]: I0602 22:12:44.661037 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_postgres-68c4fbbd6f-mtfqj_798891bc-fe0b-41d4-af45-bc30ac629870/postgres/0.log" Jun 02 22:12:45.438126 ip-10-0-138-193 kubenswrapper[2578]: I0602 22:12:45.438067 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759tn29v_f3084f1b-4f7b-4f79-b903-67f3e60d4be3/extract/0.log" Jun 02 22:12:45.443550 ip-10-0-138-193 kubenswrapper[2578]: I0602 22:12:45.443516 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759tn29v_f3084f1b-4f7b-4f79-b903-67f3e60d4be3/util/0.log" Jun 02 22:12:45.449098 ip-10-0-138-193 kubenswrapper[2578]: I0602 22:12:45.449062 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759tn29v_f3084f1b-4f7b-4f79-b903-67f3e60d4be3/pull/0.log" Jun 02 22:12:45.560960 ip-10-0-138-193 kubenswrapper[2578]: I0602 22:12:45.560928 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0xzwbf_27c2b3fa-8f2b-4dd8-9456-d2fab70b1175/util/0.log" Jun 02 22:12:45.566253 ip-10-0-138-193 kubenswrapper[2578]: I0602 22:12:45.566234 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0xzwbf_27c2b3fa-8f2b-4dd8-9456-d2fab70b1175/pull/0.log" Jun 02 22:12:45.571669 ip-10-0-138-193 kubenswrapper[2578]: I0602 22:12:45.571652 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0xzwbf_27c2b3fa-8f2b-4dd8-9456-d2fab70b1175/extract/0.log" Jun 02 22:12:45.687618 ip-10-0-138-193 kubenswrapper[2578]: I0602 22:12:45.687590 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73t4pqf_4d243294-8ef4-40c4-98e3-706837f6f029/extract/0.log" Jun 02 22:12:45.693324 ip-10-0-138-193 kubenswrapper[2578]: I0602 22:12:45.693248 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73t4pqf_4d243294-8ef4-40c4-98e3-706837f6f029/util/0.log" Jun 02 22:12:45.699009 ip-10-0-138-193 kubenswrapper[2578]: I0602 22:12:45.698990 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73t4pqf_4d243294-8ef4-40c4-98e3-706837f6f029/pull/0.log" Jun 02 22:12:45.810450 ip-10-0-138-193 kubenswrapper[2578]: I0602 22:12:45.810413 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1x5l9t_f44c4e83-da4f-4bbb-9718-c91b64f402e0/extract/0.log" Jun 02 22:12:45.815615 ip-10-0-138-193 kubenswrapper[2578]: I0602 22:12:45.815588 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1x5l9t_f44c4e83-da4f-4bbb-9718-c91b64f402e0/util/0.log" Jun 02 22:12:45.821089 ip-10-0-138-193 kubenswrapper[2578]: I0602 22:12:45.821051 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1x5l9t_f44c4e83-da4f-4bbb-9718-c91b64f402e0/pull/0.log" Jun 02 22:12:46.507927 ip-10-0-138-193 kubenswrapper[2578]: I0602 22:12:46.507883 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_kuadrant-operator-controller-manager-55c7f4c975-zfv9t_c2f07c91-6da8-490c-aeb4-f27c02ca95b1/manager/0.log" Jun 02 22:12:47.185693 ip-10-0-138-193 kubenswrapper[2578]: I0602 22:12:47.185663 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_istiod-openshift-gateway-798958bb55-t8q5x_33520bf2-da60-4111-b419-432d4d73a0fd/discovery/0.log" Jun 02 22:12:47.399326 ip-10-0-138-193 kubenswrapper[2578]: I0602 22:12:47.399296 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_kube-auth-proxy-dcdbb48fb-z54k4_2a04e179-e45c-4c54-b177-a5dd97cf0861/kube-auth-proxy/0.log" Jun 02 22:12:47.622571 ip-10-0-138-193 kubenswrapper[2578]: I0602 22:12:47.622497 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-processing-58b6c8fdc7-l2fkw_aaa9e86f-afac-467c-8e90-924bb2e1f031/payload-processing/0.log" Jun 02 22:12:48.060607 ip-10-0-138-193 kubenswrapper[2578]: I0602 22:12:48.060579 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/llm_e2e-distinct-2-simulated-kserve-8595bdc8d4-fqhp7_1351bf62-657f-4151-8a04-7706edf89499/storage-initializer/0.log" Jun 02 22:12:48.067549 ip-10-0-138-193 kubenswrapper[2578]: I0602 22:12:48.067527 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/llm_e2e-distinct-2-simulated-kserve-8595bdc8d4-fqhp7_1351bf62-657f-4151-8a04-7706edf89499/main/0.log" Jun 02 22:12:56.092221 ip-10-0-138-193 kubenswrapper[2578]: I0602 22:12:56.092190 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_global-pull-secret-syncer-rf8cp_9963c656-171f-412f-b531-d4e89671117c/global-pull-secret-syncer/0.log" Jun 02 22:12:56.198521 ip-10-0-138-193 kubenswrapper[2578]: I0602 22:12:56.198494 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_konnectivity-agent-q78cn_ebd8238d-c142-4303-9f5c-e61073fd0920/konnectivity-agent/0.log" Jun 02 22:12:56.263576 ip-10-0-138-193 kubenswrapper[2578]: I0602 22:12:56.263543 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_kube-apiserver-proxy-ip-10-0-138-193.ec2.internal_77f9e070a3a0bb8738701c4daea1dbb2/haproxy/0.log" Jun 02 22:12:59.962668 ip-10-0-138-193 kubenswrapper[2578]: I0602 22:12:59.962640 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759tn29v_f3084f1b-4f7b-4f79-b903-67f3e60d4be3/extract/0.log" Jun 02 22:12:59.981452 ip-10-0-138-193 kubenswrapper[2578]: I0602 22:12:59.981409 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759tn29v_f3084f1b-4f7b-4f79-b903-67f3e60d4be3/util/0.log" Jun 02 22:12:59.999350 ip-10-0-138-193 kubenswrapper[2578]: I0602 22:12:59.999318 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759tn29v_f3084f1b-4f7b-4f79-b903-67f3e60d4be3/pull/0.log" Jun 02 22:13:00.024517 ip-10-0-138-193 kubenswrapper[2578]: I0602 22:13:00.024492 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0xzwbf_27c2b3fa-8f2b-4dd8-9456-d2fab70b1175/extract/0.log" Jun 02 22:13:00.045978 ip-10-0-138-193 kubenswrapper[2578]: I0602 22:13:00.045950 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0xzwbf_27c2b3fa-8f2b-4dd8-9456-d2fab70b1175/util/0.log" Jun 02 22:13:00.067670 ip-10-0-138-193 kubenswrapper[2578]: I0602 22:13:00.067644 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0xzwbf_27c2b3fa-8f2b-4dd8-9456-d2fab70b1175/pull/0.log" Jun 02 22:13:00.103930 ip-10-0-138-193 kubenswrapper[2578]: I0602 22:13:00.103905 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73t4pqf_4d243294-8ef4-40c4-98e3-706837f6f029/extract/0.log" Jun 02 22:13:00.125207 ip-10-0-138-193 kubenswrapper[2578]: I0602 22:13:00.125184 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73t4pqf_4d243294-8ef4-40c4-98e3-706837f6f029/util/0.log" Jun 02 22:13:00.143712 ip-10-0-138-193 kubenswrapper[2578]: I0602 22:13:00.143690 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73t4pqf_4d243294-8ef4-40c4-98e3-706837f6f029/pull/0.log" Jun 02 22:13:00.166912 ip-10-0-138-193 kubenswrapper[2578]: I0602 22:13:00.166888 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1x5l9t_f44c4e83-da4f-4bbb-9718-c91b64f402e0/extract/0.log" Jun 02 22:13:00.184257 ip-10-0-138-193 kubenswrapper[2578]: I0602 22:13:00.184228 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1x5l9t_f44c4e83-da4f-4bbb-9718-c91b64f402e0/util/0.log" Jun 02 22:13:00.209672 ip-10-0-138-193 kubenswrapper[2578]: I0602 22:13:00.209650 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1x5l9t_f44c4e83-da4f-4bbb-9718-c91b64f402e0/pull/0.log" Jun 02 22:13:00.631257 ip-10-0-138-193 kubenswrapper[2578]: I0602 22:13:00.631227 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_kuadrant-operator-controller-manager-55c7f4c975-zfv9t_c2f07c91-6da8-490c-aeb4-f27c02ca95b1/manager/0.log" Jun 02 22:13:01.980431 ip-10-0-138-193 kubenswrapper[2578]: I0602 22:13:01.980396 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_a98d84f5-9c2b-4da3-9f4c-d1a076b46567/alertmanager/0.log" Jun 02 22:13:02.015588 ip-10-0-138-193 kubenswrapper[2578]: I0602 22:13:02.015563 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_a98d84f5-9c2b-4da3-9f4c-d1a076b46567/config-reloader/0.log" Jun 02 22:13:02.051706 ip-10-0-138-193 kubenswrapper[2578]: I0602 22:13:02.051669 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_a98d84f5-9c2b-4da3-9f4c-d1a076b46567/kube-rbac-proxy-web/0.log" Jun 02 22:13:02.087300 ip-10-0-138-193 kubenswrapper[2578]: I0602 22:13:02.087269 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_a98d84f5-9c2b-4da3-9f4c-d1a076b46567/kube-rbac-proxy/0.log" Jun 02 22:13:02.118219 ip-10-0-138-193 kubenswrapper[2578]: I0602 22:13:02.118195 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_a98d84f5-9c2b-4da3-9f4c-d1a076b46567/kube-rbac-proxy-metric/0.log" Jun 02 22:13:02.149134 ip-10-0-138-193 kubenswrapper[2578]: I0602 22:13:02.149108 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_a98d84f5-9c2b-4da3-9f4c-d1a076b46567/prom-label-proxy/0.log" Jun 02 22:13:02.187764 ip-10-0-138-193 kubenswrapper[2578]: I0602 22:13:02.187736 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_a98d84f5-9c2b-4da3-9f4c-d1a076b46567/init-config-reloader/0.log" Jun 02 22:13:02.399657 ip-10-0-138-193 kubenswrapper[2578]: I0602 22:13:02.399629 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_metrics-server-7768f4bdf8-tbc26_1be428fe-f15c-4cfd-99c4-9de41e5e9897/metrics-server/0.log" Jun 02 22:13:02.794118 ip-10-0-138-193 kubenswrapper[2578]: I0602 22:13:02.794004 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-nbg2h_32725eb7-49a8-4200-a955-b9ce9361c502/node-exporter/0.log" Jun 02 22:13:02.825331 ip-10-0-138-193 kubenswrapper[2578]: I0602 22:13:02.825307 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-nbg2h_32725eb7-49a8-4200-a955-b9ce9361c502/kube-rbac-proxy/0.log" Jun 02 22:13:02.863298 ip-10-0-138-193 kubenswrapper[2578]: I0602 22:13:02.863269 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-nbg2h_32725eb7-49a8-4200-a955-b9ce9361c502/init-textfile/0.log" Jun 02 22:13:03.264606 ip-10-0-138-193 kubenswrapper[2578]: I0602 22:13:03.264563 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-operator-658bcd8bdf-sgh62_fc115b1d-a47c-4a79-b53a-e7ac72fb6967/prometheus-operator/0.log" Jun 02 22:13:03.281828 ip-10-0-138-193 kubenswrapper[2578]: I0602 22:13:03.281802 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-operator-658bcd8bdf-sgh62_fc115b1d-a47c-4a79-b53a-e7ac72fb6967/kube-rbac-proxy/0.log" Jun 02 22:13:03.305433 ip-10-0-138-193 kubenswrapper[2578]: I0602 22:13:03.305406 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-operator-admission-webhook-59b7f8756b-d7xnh_86979873-9b09-4d29-8035-cc93792f749d/prometheus-operator-admission-webhook/0.log" Jun 02 22:13:03.332708 ip-10-0-138-193 kubenswrapper[2578]: I0602 22:13:03.332681 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_telemeter-client-6cc667f67-dd7pw_d714db6b-3c79-471c-b77b-22dd0609a6ae/telemeter-client/0.log" Jun 02 22:13:03.352581 ip-10-0-138-193 kubenswrapper[2578]: I0602 22:13:03.352550 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_telemeter-client-6cc667f67-dd7pw_d714db6b-3c79-471c-b77b-22dd0609a6ae/reload/0.log" Jun 02 22:13:03.370567 ip-10-0-138-193 kubenswrapper[2578]: I0602 22:13:03.370541 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_telemeter-client-6cc667f67-dd7pw_d714db6b-3c79-471c-b77b-22dd0609a6ae/kube-rbac-proxy/0.log" Jun 02 22:13:05.682734 ip-10-0-138-193 kubenswrapper[2578]: I0602 22:13:05.682704 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console_console-7f9dc49f9c-hbtw6_491e7e65-ef20-492a-a4e8-49f7d8546802/console/0.log" Jun 02 22:13:05.712110 ip-10-0-138-193 kubenswrapper[2578]: I0602 22:13:05.712062 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console_downloads-c65b8dc4b-k8cbf_baba2ed5-2e13-4c51-8936-6b4b8a34ed6a/download-server/0.log" Jun 02 22:13:06.264749 ip-10-0-138-193 kubenswrapper[2578]: I0602 22:13:06.264718 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-cluster-storage-operator_volume-data-source-validator-7598fd5bd-8zpds_4b5289fa-39df-48e0-b902-4a4d22134c2f/volume-data-source-validator/0.log" Jun 02 22:13:07.094052 ip-10-0-138-193 kubenswrapper[2578]: I0602 22:13:07.094018 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_dns-default-c44qt_70e914f4-4b44-4c79-926d-ee58ea32639d/dns/0.log" Jun 02 22:13:07.113006 ip-10-0-138-193 kubenswrapper[2578]: I0602 22:13:07.112980 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_dns-default-c44qt_70e914f4-4b44-4c79-926d-ee58ea32639d/kube-rbac-proxy/0.log" Jun 02 22:13:07.194718 ip-10-0-138-193 kubenswrapper[2578]: I0602 22:13:07.194691 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_node-resolver-vfdfn_4d2236cd-d674-4c20-821e-7173b6db4b74/dns-node-resolver/0.log" Jun 02 22:13:07.305611 ip-10-0-138-193 kubenswrapper[2578]: I0602 22:13:07.305576 2578 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-must-gather-6k8gj/perf-node-gather-daemonset-tvx7w"] Jun 02 22:13:07.309350 ip-10-0-138-193 kubenswrapper[2578]: I0602 22:13:07.309321 2578 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-6k8gj/perf-node-gather-daemonset-tvx7w" Jun 02 22:13:07.311552 ip-10-0-138-193 kubenswrapper[2578]: I0602 22:13:07.311524 2578 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-must-gather-6k8gj\"/\"openshift-service-ca.crt\"" Jun 02 22:13:07.311732 ip-10-0-138-193 kubenswrapper[2578]: I0602 22:13:07.311714 2578 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-must-gather-6k8gj\"/\"kube-root-ca.crt\"" Jun 02 22:13:07.312582 ip-10-0-138-193 kubenswrapper[2578]: I0602 22:13:07.312565 2578 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-must-gather-6k8gj\"/\"default-dockercfg-77j6s\"" Jun 02 22:13:07.316826 ip-10-0-138-193 kubenswrapper[2578]: I0602 22:13:07.316805 2578 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-6k8gj/perf-node-gather-daemonset-tvx7w"] Jun 02 22:13:07.459329 ip-10-0-138-193 kubenswrapper[2578]: I0602 22:13:07.459287 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/f1e139f8-3a1d-4824-ab2f-38f4996161d8-sys\") pod \"perf-node-gather-daemonset-tvx7w\" (UID: \"f1e139f8-3a1d-4824-ab2f-38f4996161d8\") " pod="openshift-must-gather-6k8gj/perf-node-gather-daemonset-tvx7w" Jun 02 22:13:07.459520 ip-10-0-138-193 kubenswrapper[2578]: I0602 22:13:07.459369 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-xfc8q\" (UniqueName: \"kubernetes.io/projected/f1e139f8-3a1d-4824-ab2f-38f4996161d8-kube-api-access-xfc8q\") pod \"perf-node-gather-daemonset-tvx7w\" (UID: \"f1e139f8-3a1d-4824-ab2f-38f4996161d8\") " pod="openshift-must-gather-6k8gj/perf-node-gather-daemonset-tvx7w" Jun 02 22:13:07.459520 ip-10-0-138-193 kubenswrapper[2578]: I0602 22:13:07.459394 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/f1e139f8-3a1d-4824-ab2f-38f4996161d8-lib-modules\") pod \"perf-node-gather-daemonset-tvx7w\" (UID: \"f1e139f8-3a1d-4824-ab2f-38f4996161d8\") " pod="openshift-must-gather-6k8gj/perf-node-gather-daemonset-tvx7w" Jun 02 22:13:07.459520 ip-10-0-138-193 kubenswrapper[2578]: I0602 22:13:07.459473 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/f1e139f8-3a1d-4824-ab2f-38f4996161d8-podres\") pod \"perf-node-gather-daemonset-tvx7w\" (UID: \"f1e139f8-3a1d-4824-ab2f-38f4996161d8\") " pod="openshift-must-gather-6k8gj/perf-node-gather-daemonset-tvx7w" Jun 02 22:13:07.459680 ip-10-0-138-193 kubenswrapper[2578]: I0602 22:13:07.459543 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/f1e139f8-3a1d-4824-ab2f-38f4996161d8-proc\") pod \"perf-node-gather-daemonset-tvx7w\" (UID: \"f1e139f8-3a1d-4824-ab2f-38f4996161d8\") " pod="openshift-must-gather-6k8gj/perf-node-gather-daemonset-tvx7w" Jun 02 22:13:07.560786 ip-10-0-138-193 kubenswrapper[2578]: I0602 22:13:07.560745 2578 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/f1e139f8-3a1d-4824-ab2f-38f4996161d8-podres\") pod \"perf-node-gather-daemonset-tvx7w\" (UID: \"f1e139f8-3a1d-4824-ab2f-38f4996161d8\") " pod="openshift-must-gather-6k8gj/perf-node-gather-daemonset-tvx7w" Jun 02 22:13:07.560980 ip-10-0-138-193 kubenswrapper[2578]: I0602 22:13:07.560804 2578 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/f1e139f8-3a1d-4824-ab2f-38f4996161d8-proc\") pod \"perf-node-gather-daemonset-tvx7w\" (UID: \"f1e139f8-3a1d-4824-ab2f-38f4996161d8\") " pod="openshift-must-gather-6k8gj/perf-node-gather-daemonset-tvx7w" Jun 02 22:13:07.560980 ip-10-0-138-193 kubenswrapper[2578]: I0602 22:13:07.560849 2578 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/f1e139f8-3a1d-4824-ab2f-38f4996161d8-sys\") pod \"perf-node-gather-daemonset-tvx7w\" (UID: \"f1e139f8-3a1d-4824-ab2f-38f4996161d8\") " pod="openshift-must-gather-6k8gj/perf-node-gather-daemonset-tvx7w" Jun 02 22:13:07.560980 ip-10-0-138-193 kubenswrapper[2578]: I0602 22:13:07.560890 2578 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-xfc8q\" (UniqueName: \"kubernetes.io/projected/f1e139f8-3a1d-4824-ab2f-38f4996161d8-kube-api-access-xfc8q\") pod \"perf-node-gather-daemonset-tvx7w\" (UID: \"f1e139f8-3a1d-4824-ab2f-38f4996161d8\") " pod="openshift-must-gather-6k8gj/perf-node-gather-daemonset-tvx7w" Jun 02 22:13:07.560980 ip-10-0-138-193 kubenswrapper[2578]: I0602 22:13:07.560897 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/f1e139f8-3a1d-4824-ab2f-38f4996161d8-proc\") pod \"perf-node-gather-daemonset-tvx7w\" (UID: \"f1e139f8-3a1d-4824-ab2f-38f4996161d8\") " pod="openshift-must-gather-6k8gj/perf-node-gather-daemonset-tvx7w" Jun 02 22:13:07.560980 ip-10-0-138-193 kubenswrapper[2578]: I0602 22:13:07.560919 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/f1e139f8-3a1d-4824-ab2f-38f4996161d8-podres\") pod \"perf-node-gather-daemonset-tvx7w\" (UID: \"f1e139f8-3a1d-4824-ab2f-38f4996161d8\") " pod="openshift-must-gather-6k8gj/perf-node-gather-daemonset-tvx7w" Jun 02 22:13:07.560980 ip-10-0-138-193 kubenswrapper[2578]: I0602 22:13:07.560905 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/f1e139f8-3a1d-4824-ab2f-38f4996161d8-sys\") pod \"perf-node-gather-daemonset-tvx7w\" (UID: \"f1e139f8-3a1d-4824-ab2f-38f4996161d8\") " pod="openshift-must-gather-6k8gj/perf-node-gather-daemonset-tvx7w" Jun 02 22:13:07.560980 ip-10-0-138-193 kubenswrapper[2578]: I0602 22:13:07.560909 2578 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/f1e139f8-3a1d-4824-ab2f-38f4996161d8-lib-modules\") pod \"perf-node-gather-daemonset-tvx7w\" (UID: \"f1e139f8-3a1d-4824-ab2f-38f4996161d8\") " pod="openshift-must-gather-6k8gj/perf-node-gather-daemonset-tvx7w" Jun 02 22:13:07.561290 ip-10-0-138-193 kubenswrapper[2578]: I0602 22:13:07.560993 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/f1e139f8-3a1d-4824-ab2f-38f4996161d8-lib-modules\") pod \"perf-node-gather-daemonset-tvx7w\" (UID: \"f1e139f8-3a1d-4824-ab2f-38f4996161d8\") " pod="openshift-must-gather-6k8gj/perf-node-gather-daemonset-tvx7w" Jun 02 22:13:07.582402 ip-10-0-138-193 kubenswrapper[2578]: I0602 22:13:07.582377 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-xfc8q\" (UniqueName: \"kubernetes.io/projected/f1e139f8-3a1d-4824-ab2f-38f4996161d8-kube-api-access-xfc8q\") pod \"perf-node-gather-daemonset-tvx7w\" (UID: \"f1e139f8-3a1d-4824-ab2f-38f4996161d8\") " pod="openshift-must-gather-6k8gj/perf-node-gather-daemonset-tvx7w" Jun 02 22:13:07.621177 ip-10-0-138-193 kubenswrapper[2578]: I0602 22:13:07.621138 2578 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-6k8gj/perf-node-gather-daemonset-tvx7w" Jun 02 22:13:07.769188 ip-10-0-138-193 kubenswrapper[2578]: I0602 22:13:07.764797 2578 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-6k8gj/perf-node-gather-daemonset-tvx7w"] Jun 02 22:13:07.774162 ip-10-0-138-193 kubenswrapper[2578]: I0602 22:13:07.774135 2578 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider Jun 02 22:13:07.836881 ip-10-0-138-193 kubenswrapper[2578]: I0602 22:13:07.836857 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_node-ca-mnnsl_fd30f6e0-874c-411b-b8c6-0df250364c15/node-ca/0.log" Jun 02 22:13:08.257033 ip-10-0-138-193 kubenswrapper[2578]: I0602 22:13:08.256993 2578 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-6k8gj/perf-node-gather-daemonset-tvx7w" event={"ID":"f1e139f8-3a1d-4824-ab2f-38f4996161d8","Type":"ContainerStarted","Data":"2e6ad5c0b23bb3f13ff8b04c3e7f5966f47a6d7aaed5b9358564ef32651a3841"} Jun 02 22:13:08.257033 ip-10-0-138-193 kubenswrapper[2578]: I0602 22:13:08.257035 2578 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-6k8gj/perf-node-gather-daemonset-tvx7w" event={"ID":"f1e139f8-3a1d-4824-ab2f-38f4996161d8","Type":"ContainerStarted","Data":"3fe35cbc8ffc825c62bf4781ff4ee35f22075946d51003d15a7f94b98f542d76"} Jun 02 22:13:08.257514 ip-10-0-138-193 kubenswrapper[2578]: I0602 22:13:08.257096 2578 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-must-gather-6k8gj/perf-node-gather-daemonset-tvx7w" Jun 02 22:13:08.273544 ip-10-0-138-193 kubenswrapper[2578]: I0602 22:13:08.273493 2578 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-must-gather-6k8gj/perf-node-gather-daemonset-tvx7w" podStartSLOduration=1.273478738 podStartE2EDuration="1.273478738s" podCreationTimestamp="2026-06-02 22:13:07 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2026-06-02 22:13:08.271000488 +0000 UTC m=+2365.522898388" watchObservedRunningTime="2026-06-02 22:13:08.273478738 +0000 UTC m=+2365.525376689" Jun 02 22:13:08.703089 ip-10-0-138-193 kubenswrapper[2578]: I0602 22:13:08.703052 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_istiod-openshift-gateway-798958bb55-t8q5x_33520bf2-da60-4111-b419-432d4d73a0fd/discovery/0.log" Jun 02 22:13:08.742892 ip-10-0-138-193 kubenswrapper[2578]: I0602 22:13:08.742858 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_kube-auth-proxy-dcdbb48fb-z54k4_2a04e179-e45c-4c54-b177-a5dd97cf0861/kube-auth-proxy/0.log" Jun 02 22:13:08.861534 ip-10-0-138-193 kubenswrapper[2578]: I0602 22:13:08.861502 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-processing-58b6c8fdc7-l2fkw_aaa9e86f-afac-467c-8e90-924bb2e1f031/payload-processing/0.log" Jun 02 22:13:09.370503 ip-10-0-138-193 kubenswrapper[2578]: I0602 22:13:09.370473 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress-canary_ingress-canary-7jp8d_39b30769-802d-4bcb-906a-fcbb4eee94b6/serve-healthcheck-canary/0.log" Jun 02 22:13:09.834797 ip-10-0-138-193 kubenswrapper[2578]: I0602 22:13:09.834752 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-operator-788bf58df5-qx7z2_e01a3390-21d1-4294-a868-751c800fc665/insights-operator/0.log" Jun 02 22:13:09.835665 ip-10-0-138-193 kubenswrapper[2578]: I0602 22:13:09.835635 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-operator-788bf58df5-qx7z2_e01a3390-21d1-4294-a868-751c800fc665/insights-operator/1.log" Jun 02 22:13:09.987152 ip-10-0-138-193 kubenswrapper[2578]: I0602 22:13:09.987113 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-rphbc_7e6ef832-0fa4-4e85-ade0-fa3ab9f3c7f6/kube-rbac-proxy/0.log" Jun 02 22:13:10.005755 ip-10-0-138-193 kubenswrapper[2578]: I0602 22:13:10.005728 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-rphbc_7e6ef832-0fa4-4e85-ade0-fa3ab9f3c7f6/exporter/0.log" Jun 02 22:13:10.025090 ip-10-0-138-193 kubenswrapper[2578]: I0602 22:13:10.025048 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-rphbc_7e6ef832-0fa4-4e85-ade0-fa3ab9f3c7f6/extractor/0.log" Jun 02 22:13:12.055699 ip-10-0-138-193 kubenswrapper[2578]: I0602 22:13:12.055670 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_dashboard-redirect-5465dccb5c-pr685_e16bb753-b4d4-472f-abb1-278f9e7de2d4/nginx/0.log" Jun 02 22:13:12.078634 ip-10-0-138-193 kubenswrapper[2578]: I0602 22:13:12.078606 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_kserve-controller-manager-7c99ffcdcd-8fjxd_02c1307a-01b3-41fb-964c-e9e39a209d43/manager/0.log" Jun 02 22:13:12.156669 ip-10-0-138-193 kubenswrapper[2578]: I0602 22:13:12.156638 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_llmisvc-controller-manager-c6b9847d7-f6h7k_2faafa98-aeb5-4ddc-af54-52c9d393e96b/manager/0.log" Jun 02 22:13:12.202859 ip-10-0-138-193 kubenswrapper[2578]: I0602 22:13:12.202829 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_maas-api-key-cleanup-29673960-69vm7_5437f7af-f0bc-420d-8ec9-fd718601273d/cleanup/0.log" Jun 02 22:13:12.291099 ip-10-0-138-193 kubenswrapper[2578]: I0602 22:13:12.291046 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_model-serving-api-6577596cd5-qrtph_6afe9127-42ef-46e0-8971-cfd2dde15517/server/0.log" Jun 02 22:13:12.353116 ip-10-0-138-193 kubenswrapper[2578]: I0602 22:13:12.353026 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-8b78d96d9-jvff6_656790e6-33df-4988-af65-c88bc533c318/manager/0.log" Jun 02 22:13:12.369514 ip-10-0-138-193 kubenswrapper[2578]: I0602 22:13:12.369492 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-8b78d96d9-jvff6_656790e6-33df-4988-af65-c88bc533c318/copy-manifests/0.log" Jun 02 22:13:12.548611 ip-10-0-138-193 kubenswrapper[2578]: I0602 22:13:12.548583 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_postgres-68c4fbbd6f-mtfqj_798891bc-fe0b-41d4-af45-bc30ac629870/postgres/0.log" Jun 02 22:13:14.271117 ip-10-0-138-193 kubenswrapper[2578]: I0602 22:13:14.271088 2578 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-must-gather-6k8gj/perf-node-gather-daemonset-tvx7w" Jun 02 22:13:18.863171 ip-10-0-138-193 kubenswrapper[2578]: I0602 22:13:18.863119 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-kube-storage-version-migrator-operator_kube-storage-version-migrator-operator-96ddc787c-jlmt8_ab209a6c-c2ef-450d-b14d-4f8438dfebfa/kube-storage-version-migrator-operator/1.log" Jun 02 22:13:18.863869 ip-10-0-138-193 kubenswrapper[2578]: I0602 22:13:18.863849 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-kube-storage-version-migrator-operator_kube-storage-version-migrator-operator-96ddc787c-jlmt8_ab209a6c-c2ef-450d-b14d-4f8438dfebfa/kube-storage-version-migrator-operator/0.log" Jun 02 22:13:20.069390 ip-10-0-138-193 kubenswrapper[2578]: I0602 22:13:20.069359 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-s7sgt_f2c18898-cc9a-4645-bab8-9ac55c476c7f/kube-multus-additional-cni-plugins/0.log" Jun 02 22:13:20.090402 ip-10-0-138-193 kubenswrapper[2578]: I0602 22:13:20.090371 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-s7sgt_f2c18898-cc9a-4645-bab8-9ac55c476c7f/egress-router-binary-copy/0.log" Jun 02 22:13:20.108508 ip-10-0-138-193 kubenswrapper[2578]: I0602 22:13:20.108484 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-s7sgt_f2c18898-cc9a-4645-bab8-9ac55c476c7f/cni-plugins/0.log" Jun 02 22:13:20.126996 ip-10-0-138-193 kubenswrapper[2578]: I0602 22:13:20.126967 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-s7sgt_f2c18898-cc9a-4645-bab8-9ac55c476c7f/bond-cni-plugin/0.log" Jun 02 22:13:20.146818 ip-10-0-138-193 kubenswrapper[2578]: I0602 22:13:20.146789 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-s7sgt_f2c18898-cc9a-4645-bab8-9ac55c476c7f/routeoverride-cni/0.log" Jun 02 22:13:20.167626 ip-10-0-138-193 kubenswrapper[2578]: I0602 22:13:20.167601 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-s7sgt_f2c18898-cc9a-4645-bab8-9ac55c476c7f/whereabouts-cni-bincopy/0.log" Jun 02 22:13:20.184856 ip-10-0-138-193 kubenswrapper[2578]: I0602 22:13:20.184836 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-s7sgt_f2c18898-cc9a-4645-bab8-9ac55c476c7f/whereabouts-cni/0.log" Jun 02 22:13:20.244287 ip-10-0-138-193 kubenswrapper[2578]: I0602 22:13:20.244252 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-p74k8_3ea59100-2e7e-4a44-8ec1-c3f7e3472835/kube-multus/0.log" Jun 02 22:13:20.295760 ip-10-0-138-193 kubenswrapper[2578]: I0602 22:13:20.295733 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_network-metrics-daemon-k2vdd_adfce93b-f07e-480a-af26-5dc7df23fa48/network-metrics-daemon/0.log" Jun 02 22:13:20.313759 ip-10-0-138-193 kubenswrapper[2578]: I0602 22:13:20.313714 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_network-metrics-daemon-k2vdd_adfce93b-f07e-480a-af26-5dc7df23fa48/kube-rbac-proxy/0.log" Jun 02 22:13:21.433348 ip-10-0-138-193 kubenswrapper[2578]: I0602 22:13:21.433316 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-5zgzd_ecde3d34-b3a4-422b-9a2d-c8a4541cc718/ovn-controller/0.log" Jun 02 22:13:21.447804 ip-10-0-138-193 kubenswrapper[2578]: I0602 22:13:21.447780 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-5zgzd_ecde3d34-b3a4-422b-9a2d-c8a4541cc718/ovn-acl-logging/0.log" Jun 02 22:13:21.457281 ip-10-0-138-193 kubenswrapper[2578]: I0602 22:13:21.457260 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-5zgzd_ecde3d34-b3a4-422b-9a2d-c8a4541cc718/ovn-acl-logging/1.log" Jun 02 22:13:21.476997 ip-10-0-138-193 kubenswrapper[2578]: I0602 22:13:21.476974 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-5zgzd_ecde3d34-b3a4-422b-9a2d-c8a4541cc718/kube-rbac-proxy-node/0.log" Jun 02 22:13:21.495951 ip-10-0-138-193 kubenswrapper[2578]: I0602 22:13:21.495922 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-5zgzd_ecde3d34-b3a4-422b-9a2d-c8a4541cc718/kube-rbac-proxy-ovn-metrics/0.log" Jun 02 22:13:21.510796 ip-10-0-138-193 kubenswrapper[2578]: I0602 22:13:21.510770 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-5zgzd_ecde3d34-b3a4-422b-9a2d-c8a4541cc718/northd/0.log" Jun 02 22:13:21.529284 ip-10-0-138-193 kubenswrapper[2578]: I0602 22:13:21.529259 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-5zgzd_ecde3d34-b3a4-422b-9a2d-c8a4541cc718/nbdb/0.log" Jun 02 22:13:21.547507 ip-10-0-138-193 kubenswrapper[2578]: I0602 22:13:21.547485 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-5zgzd_ecde3d34-b3a4-422b-9a2d-c8a4541cc718/sbdb/0.log" Jun 02 22:13:21.661656 ip-10-0-138-193 kubenswrapper[2578]: I0602 22:13:21.661627 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-5zgzd_ecde3d34-b3a4-422b-9a2d-c8a4541cc718/ovnkube-controller/0.log" Jun 02 22:13:22.963776 ip-10-0-138-193 kubenswrapper[2578]: I0602 22:13:22.963743 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-network-diagnostics_network-check-source-56d84b9f44-hdqmf_90a1018a-87f7-4af4-9be4-c0fc75cac2fc/check-endpoints/0.log" Jun 02 22:13:22.983390 ip-10-0-138-193 kubenswrapper[2578]: I0602 22:13:22.983363 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-network-diagnostics_network-check-target-r92gd_950ec20f-2c4b-4e1b-96ba-c02f9a6d124a/network-check-target-container/0.log" Jun 02 22:13:24.046135 ip-10-0-138-193 kubenswrapper[2578]: I0602 22:13:24.046095 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-network-operator_iptables-alerter-xbl27_adf5f00d-bf02-4037-b6e7-92c6485f3e38/iptables-alerter/0.log"