Jun 03 01:04:36.710523 ip-10-0-138-55 systemd[1]: Starting Kubernetes Kubelet... Jun 03 01:04:37.313096 ip-10-0-138-55 kubenswrapper[2566]: Flag --container-runtime-endpoint has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information. Jun 03 01:04:37.313096 ip-10-0-138-55 kubenswrapper[2566]: Flag --minimum-container-ttl-duration has been deprecated, Use --eviction-hard or --eviction-soft instead. Will be removed in a future version. Jun 03 01:04:37.313096 ip-10-0-138-55 kubenswrapper[2566]: Flag --volume-plugin-dir has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information. Jun 03 01:04:37.313096 ip-10-0-138-55 kubenswrapper[2566]: Flag --pod-infra-container-image has been deprecated, will be removed in 1.35. Image garbage collector will get sandbox image information from CRI. Jun 03 01:04:37.313096 ip-10-0-138-55 kubenswrapper[2566]: Flag --system-reserved has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information. Jun 03 01:04:37.317430 ip-10-0-138-55 kubenswrapper[2566]: I0603 01:04:37.317338 2566 server.go:212] "--pod-infra-container-image will not be pruned by the image garbage collector in kubelet and should also be set in the remote runtime" Jun 03 01:04:37.320231 ip-10-0-138-55 kubenswrapper[2566]: W0603 01:04:37.320208 2566 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jun 03 01:04:37.320272 ip-10-0-138-55 kubenswrapper[2566]: W0603 01:04:37.320236 2566 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jun 03 01:04:37.320272 ip-10-0-138-55 kubenswrapper[2566]: W0603 01:04:37.320241 2566 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jun 03 01:04:37.320272 ip-10-0-138-55 kubenswrapper[2566]: W0603 01:04:37.320244 2566 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jun 03 01:04:37.320272 ip-10-0-138-55 kubenswrapper[2566]: W0603 01:04:37.320247 2566 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jun 03 01:04:37.320272 ip-10-0-138-55 kubenswrapper[2566]: W0603 01:04:37.320250 2566 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jun 03 01:04:37.320272 ip-10-0-138-55 kubenswrapper[2566]: W0603 01:04:37.320253 2566 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jun 03 01:04:37.320272 ip-10-0-138-55 kubenswrapper[2566]: W0603 01:04:37.320256 2566 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jun 03 01:04:37.320272 ip-10-0-138-55 kubenswrapper[2566]: W0603 01:04:37.320258 2566 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jun 03 01:04:37.320272 ip-10-0-138-55 kubenswrapper[2566]: W0603 01:04:37.320261 2566 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jun 03 01:04:37.320272 ip-10-0-138-55 kubenswrapper[2566]: W0603 01:04:37.320264 2566 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jun 03 01:04:37.320272 ip-10-0-138-55 kubenswrapper[2566]: W0603 01:04:37.320267 2566 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jun 03 01:04:37.320272 ip-10-0-138-55 kubenswrapper[2566]: W0603 01:04:37.320270 2566 feature_gate.go:328] unrecognized feature gate: PinnedImages Jun 03 01:04:37.320272 ip-10-0-138-55 kubenswrapper[2566]: W0603 01:04:37.320273 2566 feature_gate.go:328] unrecognized feature gate: Example Jun 03 01:04:37.320272 ip-10-0-138-55 kubenswrapper[2566]: W0603 01:04:37.320275 2566 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jun 03 01:04:37.320272 ip-10-0-138-55 kubenswrapper[2566]: W0603 01:04:37.320278 2566 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jun 03 01:04:37.320628 ip-10-0-138-55 kubenswrapper[2566]: W0603 01:04:37.320281 2566 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jun 03 01:04:37.320628 ip-10-0-138-55 kubenswrapper[2566]: W0603 01:04:37.320284 2566 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterOperations Jun 03 01:04:37.320628 ip-10-0-138-55 kubenswrapper[2566]: W0603 01:04:37.320286 2566 feature_gate.go:328] unrecognized feature gate: InsightsConfigAPI Jun 03 01:04:37.320628 ip-10-0-138-55 kubenswrapper[2566]: W0603 01:04:37.320289 2566 feature_gate.go:328] unrecognized feature gate: Example2 Jun 03 01:04:37.320628 ip-10-0-138-55 kubenswrapper[2566]: W0603 01:04:37.320291 2566 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jun 03 01:04:37.320628 ip-10-0-138-55 kubenswrapper[2566]: W0603 01:04:37.320294 2566 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jun 03 01:04:37.320628 ip-10-0-138-55 kubenswrapper[2566]: W0603 01:04:37.320296 2566 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jun 03 01:04:37.320628 ip-10-0-138-55 kubenswrapper[2566]: W0603 01:04:37.320299 2566 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jun 03 01:04:37.320628 ip-10-0-138-55 kubenswrapper[2566]: W0603 01:04:37.320302 2566 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jun 03 01:04:37.320628 ip-10-0-138-55 kubenswrapper[2566]: W0603 01:04:37.320304 2566 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jun 03 01:04:37.320628 ip-10-0-138-55 kubenswrapper[2566]: W0603 01:04:37.320307 2566 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jun 03 01:04:37.320628 ip-10-0-138-55 kubenswrapper[2566]: W0603 01:04:37.320310 2566 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jun 03 01:04:37.320628 ip-10-0-138-55 kubenswrapper[2566]: W0603 01:04:37.320313 2566 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jun 03 01:04:37.320628 ip-10-0-138-55 kubenswrapper[2566]: W0603 01:04:37.320315 2566 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jun 03 01:04:37.320628 ip-10-0-138-55 kubenswrapper[2566]: W0603 01:04:37.320319 2566 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jun 03 01:04:37.320628 ip-10-0-138-55 kubenswrapper[2566]: W0603 01:04:37.320321 2566 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jun 03 01:04:37.320628 ip-10-0-138-55 kubenswrapper[2566]: W0603 01:04:37.320323 2566 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jun 03 01:04:37.320628 ip-10-0-138-55 kubenswrapper[2566]: W0603 01:04:37.320326 2566 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jun 03 01:04:37.320628 ip-10-0-138-55 kubenswrapper[2566]: W0603 01:04:37.320329 2566 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jun 03 01:04:37.320628 ip-10-0-138-55 kubenswrapper[2566]: W0603 01:04:37.320331 2566 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jun 03 01:04:37.321259 ip-10-0-138-55 kubenswrapper[2566]: W0603 01:04:37.320334 2566 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jun 03 01:04:37.321259 ip-10-0-138-55 kubenswrapper[2566]: W0603 01:04:37.320336 2566 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jun 03 01:04:37.321259 ip-10-0-138-55 kubenswrapper[2566]: W0603 01:04:37.320339 2566 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jun 03 01:04:37.321259 ip-10-0-138-55 kubenswrapper[2566]: W0603 01:04:37.320342 2566 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jun 03 01:04:37.321259 ip-10-0-138-55 kubenswrapper[2566]: W0603 01:04:37.320344 2566 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jun 03 01:04:37.321259 ip-10-0-138-55 kubenswrapper[2566]: W0603 01:04:37.320347 2566 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jun 03 01:04:37.321259 ip-10-0-138-55 kubenswrapper[2566]: W0603 01:04:37.320349 2566 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jun 03 01:04:37.321259 ip-10-0-138-55 kubenswrapper[2566]: W0603 01:04:37.320352 2566 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jun 03 01:04:37.321259 ip-10-0-138-55 kubenswrapper[2566]: W0603 01:04:37.320354 2566 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jun 03 01:04:37.321259 ip-10-0-138-55 kubenswrapper[2566]: W0603 01:04:37.320357 2566 feature_gate.go:328] unrecognized feature gate: OVNObservability Jun 03 01:04:37.321259 ip-10-0-138-55 kubenswrapper[2566]: W0603 01:04:37.320359 2566 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jun 03 01:04:37.321259 ip-10-0-138-55 kubenswrapper[2566]: W0603 01:04:37.320361 2566 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jun 03 01:04:37.321259 ip-10-0-138-55 kubenswrapper[2566]: W0603 01:04:37.320364 2566 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jun 03 01:04:37.321259 ip-10-0-138-55 kubenswrapper[2566]: W0603 01:04:37.320368 2566 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jun 03 01:04:37.321259 ip-10-0-138-55 kubenswrapper[2566]: W0603 01:04:37.320371 2566 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jun 03 01:04:37.321259 ip-10-0-138-55 kubenswrapper[2566]: W0603 01:04:37.320373 2566 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jun 03 01:04:37.321259 ip-10-0-138-55 kubenswrapper[2566]: W0603 01:04:37.320376 2566 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jun 03 01:04:37.321259 ip-10-0-138-55 kubenswrapper[2566]: W0603 01:04:37.320378 2566 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jun 03 01:04:37.321259 ip-10-0-138-55 kubenswrapper[2566]: W0603 01:04:37.320381 2566 feature_gate.go:328] unrecognized feature gate: SetEIPForNLBIngressController Jun 03 01:04:37.321259 ip-10-0-138-55 kubenswrapper[2566]: W0603 01:04:37.320383 2566 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jun 03 01:04:37.321992 ip-10-0-138-55 kubenswrapper[2566]: W0603 01:04:37.320386 2566 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jun 03 01:04:37.321992 ip-10-0-138-55 kubenswrapper[2566]: W0603 01:04:37.320389 2566 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jun 03 01:04:37.321992 ip-10-0-138-55 kubenswrapper[2566]: W0603 01:04:37.320392 2566 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jun 03 01:04:37.321992 ip-10-0-138-55 kubenswrapper[2566]: W0603 01:04:37.320394 2566 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jun 03 01:04:37.321992 ip-10-0-138-55 kubenswrapper[2566]: W0603 01:04:37.320397 2566 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jun 03 01:04:37.321992 ip-10-0-138-55 kubenswrapper[2566]: W0603 01:04:37.320399 2566 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jun 03 01:04:37.321992 ip-10-0-138-55 kubenswrapper[2566]: W0603 01:04:37.320402 2566 feature_gate.go:328] unrecognized feature gate: NewOLM Jun 03 01:04:37.321992 ip-10-0-138-55 kubenswrapper[2566]: W0603 01:04:37.320405 2566 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jun 03 01:04:37.321992 ip-10-0-138-55 kubenswrapper[2566]: W0603 01:04:37.320407 2566 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jun 03 01:04:37.321992 ip-10-0-138-55 kubenswrapper[2566]: W0603 01:04:37.320410 2566 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jun 03 01:04:37.321992 ip-10-0-138-55 kubenswrapper[2566]: W0603 01:04:37.320413 2566 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jun 03 01:04:37.321992 ip-10-0-138-55 kubenswrapper[2566]: W0603 01:04:37.320415 2566 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jun 03 01:04:37.321992 ip-10-0-138-55 kubenswrapper[2566]: W0603 01:04:37.320418 2566 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jun 03 01:04:37.321992 ip-10-0-138-55 kubenswrapper[2566]: W0603 01:04:37.320420 2566 feature_gate.go:328] unrecognized feature gate: SignatureStores Jun 03 01:04:37.321992 ip-10-0-138-55 kubenswrapper[2566]: W0603 01:04:37.320422 2566 feature_gate.go:328] unrecognized feature gate: DualReplica Jun 03 01:04:37.321992 ip-10-0-138-55 kubenswrapper[2566]: W0603 01:04:37.320426 2566 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jun 03 01:04:37.321992 ip-10-0-138-55 kubenswrapper[2566]: W0603 01:04:37.320429 2566 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jun 03 01:04:37.321992 ip-10-0-138-55 kubenswrapper[2566]: W0603 01:04:37.320433 2566 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jun 03 01:04:37.321992 ip-10-0-138-55 kubenswrapper[2566]: W0603 01:04:37.320436 2566 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jun 03 01:04:37.321992 ip-10-0-138-55 kubenswrapper[2566]: W0603 01:04:37.320439 2566 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jun 03 01:04:37.322508 ip-10-0-138-55 kubenswrapper[2566]: W0603 01:04:37.320441 2566 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jun 03 01:04:37.322508 ip-10-0-138-55 kubenswrapper[2566]: W0603 01:04:37.320444 2566 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jun 03 01:04:37.322508 ip-10-0-138-55 kubenswrapper[2566]: W0603 01:04:37.320452 2566 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jun 03 01:04:37.322508 ip-10-0-138-55 kubenswrapper[2566]: W0603 01:04:37.320455 2566 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jun 03 01:04:37.322508 ip-10-0-138-55 kubenswrapper[2566]: W0603 01:04:37.320458 2566 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jun 03 01:04:37.322508 ip-10-0-138-55 kubenswrapper[2566]: W0603 01:04:37.320463 2566 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jun 03 01:04:37.322508 ip-10-0-138-55 kubenswrapper[2566]: W0603 01:04:37.320467 2566 feature_gate.go:328] unrecognized feature gate: IngressControllerLBSubnetsAWS Jun 03 01:04:37.322508 ip-10-0-138-55 kubenswrapper[2566]: W0603 01:04:37.320470 2566 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jun 03 01:04:37.322508 ip-10-0-138-55 kubenswrapper[2566]: W0603 01:04:37.320473 2566 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jun 03 01:04:37.322508 ip-10-0-138-55 kubenswrapper[2566]: W0603 01:04:37.320475 2566 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jun 03 01:04:37.322508 ip-10-0-138-55 kubenswrapper[2566]: W0603 01:04:37.320853 2566 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jun 03 01:04:37.322508 ip-10-0-138-55 kubenswrapper[2566]: W0603 01:04:37.320858 2566 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jun 03 01:04:37.322508 ip-10-0-138-55 kubenswrapper[2566]: W0603 01:04:37.320860 2566 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jun 03 01:04:37.322508 ip-10-0-138-55 kubenswrapper[2566]: W0603 01:04:37.320863 2566 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jun 03 01:04:37.322508 ip-10-0-138-55 kubenswrapper[2566]: W0603 01:04:37.320865 2566 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jun 03 01:04:37.322508 ip-10-0-138-55 kubenswrapper[2566]: W0603 01:04:37.320868 2566 feature_gate.go:328] unrecognized feature gate: Example Jun 03 01:04:37.322508 ip-10-0-138-55 kubenswrapper[2566]: W0603 01:04:37.320871 2566 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jun 03 01:04:37.322508 ip-10-0-138-55 kubenswrapper[2566]: W0603 01:04:37.320873 2566 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jun 03 01:04:37.322508 ip-10-0-138-55 kubenswrapper[2566]: W0603 01:04:37.320875 2566 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jun 03 01:04:37.322976 ip-10-0-138-55 kubenswrapper[2566]: W0603 01:04:37.320912 2566 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jun 03 01:04:37.322976 ip-10-0-138-55 kubenswrapper[2566]: W0603 01:04:37.320960 2566 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jun 03 01:04:37.322976 ip-10-0-138-55 kubenswrapper[2566]: W0603 01:04:37.320964 2566 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jun 03 01:04:37.322976 ip-10-0-138-55 kubenswrapper[2566]: W0603 01:04:37.320967 2566 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jun 03 01:04:37.322976 ip-10-0-138-55 kubenswrapper[2566]: W0603 01:04:37.320969 2566 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jun 03 01:04:37.322976 ip-10-0-138-55 kubenswrapper[2566]: W0603 01:04:37.320972 2566 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jun 03 01:04:37.322976 ip-10-0-138-55 kubenswrapper[2566]: W0603 01:04:37.320975 2566 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jun 03 01:04:37.322976 ip-10-0-138-55 kubenswrapper[2566]: W0603 01:04:37.320977 2566 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jun 03 01:04:37.322976 ip-10-0-138-55 kubenswrapper[2566]: W0603 01:04:37.320980 2566 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jun 03 01:04:37.322976 ip-10-0-138-55 kubenswrapper[2566]: W0603 01:04:37.320983 2566 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jun 03 01:04:37.322976 ip-10-0-138-55 kubenswrapper[2566]: W0603 01:04:37.320985 2566 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jun 03 01:04:37.322976 ip-10-0-138-55 kubenswrapper[2566]: W0603 01:04:37.320988 2566 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jun 03 01:04:37.322976 ip-10-0-138-55 kubenswrapper[2566]: W0603 01:04:37.320991 2566 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jun 03 01:04:37.322976 ip-10-0-138-55 kubenswrapper[2566]: W0603 01:04:37.320997 2566 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jun 03 01:04:37.322976 ip-10-0-138-55 kubenswrapper[2566]: W0603 01:04:37.321000 2566 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jun 03 01:04:37.322976 ip-10-0-138-55 kubenswrapper[2566]: W0603 01:04:37.321002 2566 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jun 03 01:04:37.322976 ip-10-0-138-55 kubenswrapper[2566]: W0603 01:04:37.321005 2566 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jun 03 01:04:37.322976 ip-10-0-138-55 kubenswrapper[2566]: W0603 01:04:37.321008 2566 feature_gate.go:328] unrecognized feature gate: IngressControllerLBSubnetsAWS Jun 03 01:04:37.322976 ip-10-0-138-55 kubenswrapper[2566]: W0603 01:04:37.321011 2566 feature_gate.go:328] unrecognized feature gate: DualReplica Jun 03 01:04:37.322976 ip-10-0-138-55 kubenswrapper[2566]: W0603 01:04:37.321014 2566 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jun 03 01:04:37.323497 ip-10-0-138-55 kubenswrapper[2566]: W0603 01:04:37.321017 2566 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jun 03 01:04:37.323497 ip-10-0-138-55 kubenswrapper[2566]: W0603 01:04:37.321020 2566 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jun 03 01:04:37.323497 ip-10-0-138-55 kubenswrapper[2566]: W0603 01:04:37.321022 2566 feature_gate.go:328] unrecognized feature gate: Example2 Jun 03 01:04:37.323497 ip-10-0-138-55 kubenswrapper[2566]: W0603 01:04:37.321025 2566 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jun 03 01:04:37.323497 ip-10-0-138-55 kubenswrapper[2566]: W0603 01:04:37.321028 2566 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jun 03 01:04:37.323497 ip-10-0-138-55 kubenswrapper[2566]: W0603 01:04:37.321030 2566 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jun 03 01:04:37.323497 ip-10-0-138-55 kubenswrapper[2566]: W0603 01:04:37.321091 2566 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jun 03 01:04:37.323497 ip-10-0-138-55 kubenswrapper[2566]: W0603 01:04:37.321096 2566 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jun 03 01:04:37.323497 ip-10-0-138-55 kubenswrapper[2566]: W0603 01:04:37.321101 2566 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jun 03 01:04:37.323497 ip-10-0-138-55 kubenswrapper[2566]: W0603 01:04:37.321105 2566 feature_gate.go:328] unrecognized feature gate: OVNObservability Jun 03 01:04:37.323497 ip-10-0-138-55 kubenswrapper[2566]: W0603 01:04:37.321109 2566 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jun 03 01:04:37.323497 ip-10-0-138-55 kubenswrapper[2566]: W0603 01:04:37.321114 2566 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jun 03 01:04:37.323497 ip-10-0-138-55 kubenswrapper[2566]: W0603 01:04:37.321118 2566 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jun 03 01:04:37.323497 ip-10-0-138-55 kubenswrapper[2566]: W0603 01:04:37.321124 2566 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jun 03 01:04:37.323497 ip-10-0-138-55 kubenswrapper[2566]: W0603 01:04:37.321131 2566 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jun 03 01:04:37.323497 ip-10-0-138-55 kubenswrapper[2566]: W0603 01:04:37.321137 2566 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jun 03 01:04:37.323497 ip-10-0-138-55 kubenswrapper[2566]: W0603 01:04:37.321144 2566 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jun 03 01:04:37.323497 ip-10-0-138-55 kubenswrapper[2566]: W0603 01:04:37.321149 2566 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jun 03 01:04:37.323497 ip-10-0-138-55 kubenswrapper[2566]: W0603 01:04:37.321159 2566 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jun 03 01:04:37.323497 ip-10-0-138-55 kubenswrapper[2566]: W0603 01:04:37.321163 2566 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jun 03 01:04:37.323983 ip-10-0-138-55 kubenswrapper[2566]: W0603 01:04:37.321168 2566 feature_gate.go:328] unrecognized feature gate: InsightsConfigAPI Jun 03 01:04:37.323983 ip-10-0-138-55 kubenswrapper[2566]: W0603 01:04:37.321173 2566 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jun 03 01:04:37.323983 ip-10-0-138-55 kubenswrapper[2566]: W0603 01:04:37.321177 2566 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jun 03 01:04:37.323983 ip-10-0-138-55 kubenswrapper[2566]: W0603 01:04:37.321182 2566 feature_gate.go:328] unrecognized feature gate: PinnedImages Jun 03 01:04:37.323983 ip-10-0-138-55 kubenswrapper[2566]: W0603 01:04:37.321186 2566 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jun 03 01:04:37.323983 ip-10-0-138-55 kubenswrapper[2566]: W0603 01:04:37.321190 2566 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jun 03 01:04:37.323983 ip-10-0-138-55 kubenswrapper[2566]: W0603 01:04:37.321194 2566 feature_gate.go:328] unrecognized feature gate: SetEIPForNLBIngressController Jun 03 01:04:37.323983 ip-10-0-138-55 kubenswrapper[2566]: W0603 01:04:37.321198 2566 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jun 03 01:04:37.323983 ip-10-0-138-55 kubenswrapper[2566]: W0603 01:04:37.321202 2566 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jun 03 01:04:37.323983 ip-10-0-138-55 kubenswrapper[2566]: W0603 01:04:37.321207 2566 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jun 03 01:04:37.323983 ip-10-0-138-55 kubenswrapper[2566]: W0603 01:04:37.321213 2566 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jun 03 01:04:37.323983 ip-10-0-138-55 kubenswrapper[2566]: W0603 01:04:37.321221 2566 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jun 03 01:04:37.323983 ip-10-0-138-55 kubenswrapper[2566]: W0603 01:04:37.321239 2566 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jun 03 01:04:37.323983 ip-10-0-138-55 kubenswrapper[2566]: W0603 01:04:37.321244 2566 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jun 03 01:04:37.323983 ip-10-0-138-55 kubenswrapper[2566]: W0603 01:04:37.321248 2566 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jun 03 01:04:37.323983 ip-10-0-138-55 kubenswrapper[2566]: W0603 01:04:37.321252 2566 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jun 03 01:04:37.323983 ip-10-0-138-55 kubenswrapper[2566]: W0603 01:04:37.321256 2566 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jun 03 01:04:37.323983 ip-10-0-138-55 kubenswrapper[2566]: W0603 01:04:37.321260 2566 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jun 03 01:04:37.323983 ip-10-0-138-55 kubenswrapper[2566]: W0603 01:04:37.321267 2566 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jun 03 01:04:37.324466 ip-10-0-138-55 kubenswrapper[2566]: W0603 01:04:37.321272 2566 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jun 03 01:04:37.324466 ip-10-0-138-55 kubenswrapper[2566]: W0603 01:04:37.321277 2566 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterOperations Jun 03 01:04:37.324466 ip-10-0-138-55 kubenswrapper[2566]: W0603 01:04:37.321281 2566 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jun 03 01:04:37.324466 ip-10-0-138-55 kubenswrapper[2566]: W0603 01:04:37.321285 2566 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jun 03 01:04:37.324466 ip-10-0-138-55 kubenswrapper[2566]: W0603 01:04:37.321295 2566 feature_gate.go:328] unrecognized feature gate: SignatureStores Jun 03 01:04:37.324466 ip-10-0-138-55 kubenswrapper[2566]: W0603 01:04:37.321299 2566 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jun 03 01:04:37.324466 ip-10-0-138-55 kubenswrapper[2566]: W0603 01:04:37.321303 2566 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jun 03 01:04:37.324466 ip-10-0-138-55 kubenswrapper[2566]: W0603 01:04:37.321308 2566 feature_gate.go:328] unrecognized feature gate: NewOLM Jun 03 01:04:37.324466 ip-10-0-138-55 kubenswrapper[2566]: W0603 01:04:37.321312 2566 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jun 03 01:04:37.324466 ip-10-0-138-55 kubenswrapper[2566]: W0603 01:04:37.321316 2566 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jun 03 01:04:37.324466 ip-10-0-138-55 kubenswrapper[2566]: W0603 01:04:37.321321 2566 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jun 03 01:04:37.324466 ip-10-0-138-55 kubenswrapper[2566]: W0603 01:04:37.321325 2566 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jun 03 01:04:37.324466 ip-10-0-138-55 kubenswrapper[2566]: W0603 01:04:37.321331 2566 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jun 03 01:04:37.324466 ip-10-0-138-55 kubenswrapper[2566]: W0603 01:04:37.321335 2566 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jun 03 01:04:37.324466 ip-10-0-138-55 kubenswrapper[2566]: W0603 01:04:37.321339 2566 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jun 03 01:04:37.324466 ip-10-0-138-55 kubenswrapper[2566]: W0603 01:04:37.321346 2566 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jun 03 01:04:37.324466 ip-10-0-138-55 kubenswrapper[2566]: W0603 01:04:37.321356 2566 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jun 03 01:04:37.324466 ip-10-0-138-55 kubenswrapper[2566]: W0603 01:04:37.321360 2566 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jun 03 01:04:37.324466 ip-10-0-138-55 kubenswrapper[2566]: I0603 01:04:37.322307 2566 flags.go:64] FLAG: --address="0.0.0.0" Jun 03 01:04:37.324466 ip-10-0-138-55 kubenswrapper[2566]: I0603 01:04:37.322456 2566 flags.go:64] FLAG: --allowed-unsafe-sysctls="[]" Jun 03 01:04:37.324466 ip-10-0-138-55 kubenswrapper[2566]: I0603 01:04:37.322466 2566 flags.go:64] FLAG: --anonymous-auth="true" Jun 03 01:04:37.324980 ip-10-0-138-55 kubenswrapper[2566]: I0603 01:04:37.322471 2566 flags.go:64] FLAG: --application-metrics-count-limit="100" Jun 03 01:04:37.324980 ip-10-0-138-55 kubenswrapper[2566]: I0603 01:04:37.322477 2566 flags.go:64] FLAG: --authentication-token-webhook="false" Jun 03 01:04:37.324980 ip-10-0-138-55 kubenswrapper[2566]: I0603 01:04:37.322480 2566 flags.go:64] FLAG: --authentication-token-webhook-cache-ttl="2m0s" Jun 03 01:04:37.324980 ip-10-0-138-55 kubenswrapper[2566]: I0603 01:04:37.322484 2566 flags.go:64] FLAG: --authorization-mode="AlwaysAllow" Jun 03 01:04:37.324980 ip-10-0-138-55 kubenswrapper[2566]: I0603 01:04:37.322489 2566 flags.go:64] FLAG: --authorization-webhook-cache-authorized-ttl="5m0s" Jun 03 01:04:37.324980 ip-10-0-138-55 kubenswrapper[2566]: I0603 01:04:37.322493 2566 flags.go:64] FLAG: --authorization-webhook-cache-unauthorized-ttl="30s" Jun 03 01:04:37.324980 ip-10-0-138-55 kubenswrapper[2566]: I0603 01:04:37.322496 2566 flags.go:64] FLAG: --boot-id-file="/proc/sys/kernel/random/boot_id" Jun 03 01:04:37.324980 ip-10-0-138-55 kubenswrapper[2566]: I0603 01:04:37.322500 2566 flags.go:64] FLAG: --bootstrap-kubeconfig="/etc/kubernetes/kubeconfig" Jun 03 01:04:37.324980 ip-10-0-138-55 kubenswrapper[2566]: I0603 01:04:37.322503 2566 flags.go:64] FLAG: --cert-dir="/var/lib/kubelet/pki" Jun 03 01:04:37.324980 ip-10-0-138-55 kubenswrapper[2566]: I0603 01:04:37.322506 2566 flags.go:64] FLAG: --cgroup-driver="cgroupfs" Jun 03 01:04:37.324980 ip-10-0-138-55 kubenswrapper[2566]: I0603 01:04:37.322510 2566 flags.go:64] FLAG: --cgroup-root="" Jun 03 01:04:37.324980 ip-10-0-138-55 kubenswrapper[2566]: I0603 01:04:37.322513 2566 flags.go:64] FLAG: --cgroups-per-qos="true" Jun 03 01:04:37.324980 ip-10-0-138-55 kubenswrapper[2566]: I0603 01:04:37.322516 2566 flags.go:64] FLAG: --client-ca-file="" Jun 03 01:04:37.324980 ip-10-0-138-55 kubenswrapper[2566]: I0603 01:04:37.322519 2566 flags.go:64] FLAG: --cloud-config="" Jun 03 01:04:37.324980 ip-10-0-138-55 kubenswrapper[2566]: I0603 01:04:37.322522 2566 flags.go:64] FLAG: --cloud-provider="external" Jun 03 01:04:37.324980 ip-10-0-138-55 kubenswrapper[2566]: I0603 01:04:37.322525 2566 flags.go:64] FLAG: --cluster-dns="[]" Jun 03 01:04:37.324980 ip-10-0-138-55 kubenswrapper[2566]: I0603 01:04:37.322529 2566 flags.go:64] FLAG: --cluster-domain="" Jun 03 01:04:37.324980 ip-10-0-138-55 kubenswrapper[2566]: I0603 01:04:37.322532 2566 flags.go:64] FLAG: --config="/etc/kubernetes/kubelet.conf" Jun 03 01:04:37.324980 ip-10-0-138-55 kubenswrapper[2566]: I0603 01:04:37.322535 2566 flags.go:64] FLAG: --config-dir="" Jun 03 01:04:37.324980 ip-10-0-138-55 kubenswrapper[2566]: I0603 01:04:37.322538 2566 flags.go:64] FLAG: --container-hints="/etc/cadvisor/container_hints.json" Jun 03 01:04:37.324980 ip-10-0-138-55 kubenswrapper[2566]: I0603 01:04:37.322541 2566 flags.go:64] FLAG: --container-log-max-files="5" Jun 03 01:04:37.324980 ip-10-0-138-55 kubenswrapper[2566]: I0603 01:04:37.322545 2566 flags.go:64] FLAG: --container-log-max-size="10Mi" Jun 03 01:04:37.324980 ip-10-0-138-55 kubenswrapper[2566]: I0603 01:04:37.322548 2566 flags.go:64] FLAG: --container-runtime-endpoint="/var/run/crio/crio.sock" Jun 03 01:04:37.324980 ip-10-0-138-55 kubenswrapper[2566]: I0603 01:04:37.322551 2566 flags.go:64] FLAG: --containerd="/run/containerd/containerd.sock" Jun 03 01:04:37.325602 ip-10-0-138-55 kubenswrapper[2566]: I0603 01:04:37.322555 2566 flags.go:64] FLAG: --containerd-namespace="k8s.io" Jun 03 01:04:37.325602 ip-10-0-138-55 kubenswrapper[2566]: I0603 01:04:37.322558 2566 flags.go:64] FLAG: --contention-profiling="false" Jun 03 01:04:37.325602 ip-10-0-138-55 kubenswrapper[2566]: I0603 01:04:37.322561 2566 flags.go:64] FLAG: --cpu-cfs-quota="true" Jun 03 01:04:37.325602 ip-10-0-138-55 kubenswrapper[2566]: I0603 01:04:37.322564 2566 flags.go:64] FLAG: --cpu-cfs-quota-period="100ms" Jun 03 01:04:37.325602 ip-10-0-138-55 kubenswrapper[2566]: I0603 01:04:37.322567 2566 flags.go:64] FLAG: --cpu-manager-policy="none" Jun 03 01:04:37.325602 ip-10-0-138-55 kubenswrapper[2566]: I0603 01:04:37.322570 2566 flags.go:64] FLAG: --cpu-manager-policy-options="" Jun 03 01:04:37.325602 ip-10-0-138-55 kubenswrapper[2566]: I0603 01:04:37.322576 2566 flags.go:64] FLAG: --cpu-manager-reconcile-period="10s" Jun 03 01:04:37.325602 ip-10-0-138-55 kubenswrapper[2566]: I0603 01:04:37.322580 2566 flags.go:64] FLAG: --enable-controller-attach-detach="true" Jun 03 01:04:37.325602 ip-10-0-138-55 kubenswrapper[2566]: I0603 01:04:37.322583 2566 flags.go:64] FLAG: --enable-debugging-handlers="true" Jun 03 01:04:37.325602 ip-10-0-138-55 kubenswrapper[2566]: I0603 01:04:37.322586 2566 flags.go:64] FLAG: --enable-load-reader="false" Jun 03 01:04:37.325602 ip-10-0-138-55 kubenswrapper[2566]: I0603 01:04:37.322589 2566 flags.go:64] FLAG: --enable-server="true" Jun 03 01:04:37.325602 ip-10-0-138-55 kubenswrapper[2566]: I0603 01:04:37.322592 2566 flags.go:64] FLAG: --enforce-node-allocatable="[pods]" Jun 03 01:04:37.325602 ip-10-0-138-55 kubenswrapper[2566]: I0603 01:04:37.322597 2566 flags.go:64] FLAG: --event-burst="100" Jun 03 01:04:37.325602 ip-10-0-138-55 kubenswrapper[2566]: I0603 01:04:37.322600 2566 flags.go:64] FLAG: --event-qps="50" Jun 03 01:04:37.325602 ip-10-0-138-55 kubenswrapper[2566]: I0603 01:04:37.322603 2566 flags.go:64] FLAG: --event-storage-age-limit="default=0" Jun 03 01:04:37.325602 ip-10-0-138-55 kubenswrapper[2566]: I0603 01:04:37.322606 2566 flags.go:64] FLAG: --event-storage-event-limit="default=0" Jun 03 01:04:37.325602 ip-10-0-138-55 kubenswrapper[2566]: I0603 01:04:37.322609 2566 flags.go:64] FLAG: --eviction-hard="" Jun 03 01:04:37.325602 ip-10-0-138-55 kubenswrapper[2566]: I0603 01:04:37.322613 2566 flags.go:64] FLAG: --eviction-max-pod-grace-period="0" Jun 03 01:04:37.325602 ip-10-0-138-55 kubenswrapper[2566]: I0603 01:04:37.322615 2566 flags.go:64] FLAG: --eviction-minimum-reclaim="" Jun 03 01:04:37.325602 ip-10-0-138-55 kubenswrapper[2566]: I0603 01:04:37.322618 2566 flags.go:64] FLAG: --eviction-pressure-transition-period="5m0s" Jun 03 01:04:37.325602 ip-10-0-138-55 kubenswrapper[2566]: I0603 01:04:37.322621 2566 flags.go:64] FLAG: --eviction-soft="" Jun 03 01:04:37.325602 ip-10-0-138-55 kubenswrapper[2566]: I0603 01:04:37.322624 2566 flags.go:64] FLAG: --eviction-soft-grace-period="" Jun 03 01:04:37.325602 ip-10-0-138-55 kubenswrapper[2566]: I0603 01:04:37.322627 2566 flags.go:64] FLAG: --exit-on-lock-contention="false" Jun 03 01:04:37.325602 ip-10-0-138-55 kubenswrapper[2566]: I0603 01:04:37.322630 2566 flags.go:64] FLAG: --experimental-allocatable-ignore-eviction="false" Jun 03 01:04:37.325602 ip-10-0-138-55 kubenswrapper[2566]: I0603 01:04:37.322633 2566 flags.go:64] FLAG: --experimental-mounter-path="" Jun 03 01:04:37.326200 ip-10-0-138-55 kubenswrapper[2566]: I0603 01:04:37.322636 2566 flags.go:64] FLAG: --fail-cgroupv1="false" Jun 03 01:04:37.326200 ip-10-0-138-55 kubenswrapper[2566]: I0603 01:04:37.322639 2566 flags.go:64] FLAG: --fail-swap-on="true" Jun 03 01:04:37.326200 ip-10-0-138-55 kubenswrapper[2566]: I0603 01:04:37.322642 2566 flags.go:64] FLAG: --feature-gates="" Jun 03 01:04:37.326200 ip-10-0-138-55 kubenswrapper[2566]: I0603 01:04:37.322646 2566 flags.go:64] FLAG: --file-check-frequency="20s" Jun 03 01:04:37.326200 ip-10-0-138-55 kubenswrapper[2566]: I0603 01:04:37.322649 2566 flags.go:64] FLAG: --global-housekeeping-interval="1m0s" Jun 03 01:04:37.326200 ip-10-0-138-55 kubenswrapper[2566]: I0603 01:04:37.322652 2566 flags.go:64] FLAG: --hairpin-mode="promiscuous-bridge" Jun 03 01:04:37.326200 ip-10-0-138-55 kubenswrapper[2566]: I0603 01:04:37.322655 2566 flags.go:64] FLAG: --healthz-bind-address="127.0.0.1" Jun 03 01:04:37.326200 ip-10-0-138-55 kubenswrapper[2566]: I0603 01:04:37.322658 2566 flags.go:64] FLAG: --healthz-port="10248" Jun 03 01:04:37.326200 ip-10-0-138-55 kubenswrapper[2566]: I0603 01:04:37.322661 2566 flags.go:64] FLAG: --help="false" Jun 03 01:04:37.326200 ip-10-0-138-55 kubenswrapper[2566]: I0603 01:04:37.322664 2566 flags.go:64] FLAG: --hostname-override="ip-10-0-138-55.ec2.internal" Jun 03 01:04:37.326200 ip-10-0-138-55 kubenswrapper[2566]: I0603 01:04:37.322667 2566 flags.go:64] FLAG: --housekeeping-interval="10s" Jun 03 01:04:37.326200 ip-10-0-138-55 kubenswrapper[2566]: I0603 01:04:37.322670 2566 flags.go:64] FLAG: --http-check-frequency="20s" Jun 03 01:04:37.326200 ip-10-0-138-55 kubenswrapper[2566]: I0603 01:04:37.322673 2566 flags.go:64] FLAG: --image-credential-provider-bin-dir="/usr/libexec/kubelet-image-credential-provider-plugins" Jun 03 01:04:37.326200 ip-10-0-138-55 kubenswrapper[2566]: I0603 01:04:37.322678 2566 flags.go:64] FLAG: --image-credential-provider-config="/etc/kubernetes/credential-providers/ecr-credential-provider.yaml" Jun 03 01:04:37.326200 ip-10-0-138-55 kubenswrapper[2566]: I0603 01:04:37.322683 2566 flags.go:64] FLAG: --image-gc-high-threshold="85" Jun 03 01:04:37.326200 ip-10-0-138-55 kubenswrapper[2566]: I0603 01:04:37.322685 2566 flags.go:64] FLAG: --image-gc-low-threshold="80" Jun 03 01:04:37.326200 ip-10-0-138-55 kubenswrapper[2566]: I0603 01:04:37.322688 2566 flags.go:64] FLAG: --image-service-endpoint="" Jun 03 01:04:37.326200 ip-10-0-138-55 kubenswrapper[2566]: I0603 01:04:37.322691 2566 flags.go:64] FLAG: --kernel-memcg-notification="false" Jun 03 01:04:37.326200 ip-10-0-138-55 kubenswrapper[2566]: I0603 01:04:37.322694 2566 flags.go:64] FLAG: --kube-api-burst="100" Jun 03 01:04:37.326200 ip-10-0-138-55 kubenswrapper[2566]: I0603 01:04:37.322697 2566 flags.go:64] FLAG: --kube-api-content-type="application/vnd.kubernetes.protobuf" Jun 03 01:04:37.326200 ip-10-0-138-55 kubenswrapper[2566]: I0603 01:04:37.322700 2566 flags.go:64] FLAG: --kube-api-qps="50" Jun 03 01:04:37.326200 ip-10-0-138-55 kubenswrapper[2566]: I0603 01:04:37.322703 2566 flags.go:64] FLAG: --kube-reserved="" Jun 03 01:04:37.326200 ip-10-0-138-55 kubenswrapper[2566]: I0603 01:04:37.322706 2566 flags.go:64] FLAG: --kube-reserved-cgroup="" Jun 03 01:04:37.326200 ip-10-0-138-55 kubenswrapper[2566]: I0603 01:04:37.322709 2566 flags.go:64] FLAG: --kubeconfig="/var/lib/kubelet/kubeconfig" Jun 03 01:04:37.326806 ip-10-0-138-55 kubenswrapper[2566]: I0603 01:04:37.322712 2566 flags.go:64] FLAG: --kubelet-cgroups="" Jun 03 01:04:37.326806 ip-10-0-138-55 kubenswrapper[2566]: I0603 01:04:37.322714 2566 flags.go:64] FLAG: --local-storage-capacity-isolation="true" Jun 03 01:04:37.326806 ip-10-0-138-55 kubenswrapper[2566]: I0603 01:04:37.322717 2566 flags.go:64] FLAG: --lock-file="" Jun 03 01:04:37.326806 ip-10-0-138-55 kubenswrapper[2566]: I0603 01:04:37.322720 2566 flags.go:64] FLAG: --log-cadvisor-usage="false" Jun 03 01:04:37.326806 ip-10-0-138-55 kubenswrapper[2566]: I0603 01:04:37.322723 2566 flags.go:64] FLAG: --log-flush-frequency="5s" Jun 03 01:04:37.326806 ip-10-0-138-55 kubenswrapper[2566]: I0603 01:04:37.322726 2566 flags.go:64] FLAG: --log-json-info-buffer-size="0" Jun 03 01:04:37.326806 ip-10-0-138-55 kubenswrapper[2566]: I0603 01:04:37.322731 2566 flags.go:64] FLAG: --log-json-split-stream="false" Jun 03 01:04:37.326806 ip-10-0-138-55 kubenswrapper[2566]: I0603 01:04:37.322734 2566 flags.go:64] FLAG: --log-text-info-buffer-size="0" Jun 03 01:04:37.326806 ip-10-0-138-55 kubenswrapper[2566]: I0603 01:04:37.322737 2566 flags.go:64] FLAG: --log-text-split-stream="false" Jun 03 01:04:37.326806 ip-10-0-138-55 kubenswrapper[2566]: I0603 01:04:37.322740 2566 flags.go:64] FLAG: --logging-format="text" Jun 03 01:04:37.326806 ip-10-0-138-55 kubenswrapper[2566]: I0603 01:04:37.322743 2566 flags.go:64] FLAG: --machine-id-file="/etc/machine-id,/var/lib/dbus/machine-id" Jun 03 01:04:37.326806 ip-10-0-138-55 kubenswrapper[2566]: I0603 01:04:37.322747 2566 flags.go:64] FLAG: --make-iptables-util-chains="true" Jun 03 01:04:37.326806 ip-10-0-138-55 kubenswrapper[2566]: I0603 01:04:37.322750 2566 flags.go:64] FLAG: --manifest-url="" Jun 03 01:04:37.326806 ip-10-0-138-55 kubenswrapper[2566]: I0603 01:04:37.322753 2566 flags.go:64] FLAG: --manifest-url-header="" Jun 03 01:04:37.326806 ip-10-0-138-55 kubenswrapper[2566]: I0603 01:04:37.322758 2566 flags.go:64] FLAG: --max-housekeeping-interval="15s" Jun 03 01:04:37.326806 ip-10-0-138-55 kubenswrapper[2566]: I0603 01:04:37.322762 2566 flags.go:64] FLAG: --max-open-files="1000000" Jun 03 01:04:37.326806 ip-10-0-138-55 kubenswrapper[2566]: I0603 01:04:37.322766 2566 flags.go:64] FLAG: --max-pods="110" Jun 03 01:04:37.326806 ip-10-0-138-55 kubenswrapper[2566]: I0603 01:04:37.322769 2566 flags.go:64] FLAG: --maximum-dead-containers="-1" Jun 03 01:04:37.326806 ip-10-0-138-55 kubenswrapper[2566]: I0603 01:04:37.322772 2566 flags.go:64] FLAG: --maximum-dead-containers-per-container="1" Jun 03 01:04:37.326806 ip-10-0-138-55 kubenswrapper[2566]: I0603 01:04:37.322775 2566 flags.go:64] FLAG: --memory-manager-policy="None" Jun 03 01:04:37.326806 ip-10-0-138-55 kubenswrapper[2566]: I0603 01:04:37.322777 2566 flags.go:64] FLAG: --minimum-container-ttl-duration="6m0s" Jun 03 01:04:37.326806 ip-10-0-138-55 kubenswrapper[2566]: I0603 01:04:37.322784 2566 flags.go:64] FLAG: --minimum-image-ttl-duration="2m0s" Jun 03 01:04:37.326806 ip-10-0-138-55 kubenswrapper[2566]: I0603 01:04:37.322787 2566 flags.go:64] FLAG: --node-ip="0.0.0.0" Jun 03 01:04:37.326806 ip-10-0-138-55 kubenswrapper[2566]: I0603 01:04:37.322790 2566 flags.go:64] FLAG: --node-labels="node-role.kubernetes.io/worker=,node.openshift.io/os_id=rhel" Jun 03 01:04:37.326806 ip-10-0-138-55 kubenswrapper[2566]: I0603 01:04:37.322798 2566 flags.go:64] FLAG: --node-status-max-images="50" Jun 03 01:04:37.327461 ip-10-0-138-55 kubenswrapper[2566]: I0603 01:04:37.322802 2566 flags.go:64] FLAG: --node-status-update-frequency="10s" Jun 03 01:04:37.327461 ip-10-0-138-55 kubenswrapper[2566]: I0603 01:04:37.322805 2566 flags.go:64] FLAG: --oom-score-adj="-999" Jun 03 01:04:37.327461 ip-10-0-138-55 kubenswrapper[2566]: I0603 01:04:37.322808 2566 flags.go:64] FLAG: --pod-cidr="" Jun 03 01:04:37.327461 ip-10-0-138-55 kubenswrapper[2566]: I0603 01:04:37.322810 2566 flags.go:64] FLAG: --pod-infra-container-image="quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:f1083dc6abd9805f79797fa11c9accacc4a38caa073c94cb99097faffce05983" Jun 03 01:04:37.327461 ip-10-0-138-55 kubenswrapper[2566]: I0603 01:04:37.322815 2566 flags.go:64] FLAG: --pod-manifest-path="" Jun 03 01:04:37.327461 ip-10-0-138-55 kubenswrapper[2566]: I0603 01:04:37.322818 2566 flags.go:64] FLAG: --pod-max-pids="-1" Jun 03 01:04:37.327461 ip-10-0-138-55 kubenswrapper[2566]: I0603 01:04:37.322821 2566 flags.go:64] FLAG: --pods-per-core="0" Jun 03 01:04:37.327461 ip-10-0-138-55 kubenswrapper[2566]: I0603 01:04:37.322824 2566 flags.go:64] FLAG: --port="10250" Jun 03 01:04:37.327461 ip-10-0-138-55 kubenswrapper[2566]: I0603 01:04:37.322827 2566 flags.go:64] FLAG: --protect-kernel-defaults="false" Jun 03 01:04:37.327461 ip-10-0-138-55 kubenswrapper[2566]: I0603 01:04:37.322830 2566 flags.go:64] FLAG: --provider-id="aws:///us-east-1a/i-02910ec3f1fe0b6f4" Jun 03 01:04:37.327461 ip-10-0-138-55 kubenswrapper[2566]: I0603 01:04:37.322833 2566 flags.go:64] FLAG: --qos-reserved="" Jun 03 01:04:37.327461 ip-10-0-138-55 kubenswrapper[2566]: I0603 01:04:37.322836 2566 flags.go:64] FLAG: --read-only-port="10255" Jun 03 01:04:37.327461 ip-10-0-138-55 kubenswrapper[2566]: I0603 01:04:37.322839 2566 flags.go:64] FLAG: --register-node="true" Jun 03 01:04:37.327461 ip-10-0-138-55 kubenswrapper[2566]: I0603 01:04:37.322844 2566 flags.go:64] FLAG: --register-schedulable="true" Jun 03 01:04:37.327461 ip-10-0-138-55 kubenswrapper[2566]: I0603 01:04:37.322847 2566 flags.go:64] FLAG: --register-with-taints="" Jun 03 01:04:37.327461 ip-10-0-138-55 kubenswrapper[2566]: I0603 01:04:37.322850 2566 flags.go:64] FLAG: --registry-burst="10" Jun 03 01:04:37.327461 ip-10-0-138-55 kubenswrapper[2566]: I0603 01:04:37.322853 2566 flags.go:64] FLAG: --registry-qps="5" Jun 03 01:04:37.327461 ip-10-0-138-55 kubenswrapper[2566]: I0603 01:04:37.322856 2566 flags.go:64] FLAG: --reserved-cpus="" Jun 03 01:04:37.327461 ip-10-0-138-55 kubenswrapper[2566]: I0603 01:04:37.322859 2566 flags.go:64] FLAG: --reserved-memory="" Jun 03 01:04:37.327461 ip-10-0-138-55 kubenswrapper[2566]: I0603 01:04:37.322863 2566 flags.go:64] FLAG: --resolv-conf="/etc/resolv.conf" Jun 03 01:04:37.327461 ip-10-0-138-55 kubenswrapper[2566]: I0603 01:04:37.322866 2566 flags.go:64] FLAG: --root-dir="/var/lib/kubelet" Jun 03 01:04:37.327461 ip-10-0-138-55 kubenswrapper[2566]: I0603 01:04:37.322869 2566 flags.go:64] FLAG: --rotate-certificates="false" Jun 03 01:04:37.327461 ip-10-0-138-55 kubenswrapper[2566]: I0603 01:04:37.322872 2566 flags.go:64] FLAG: --rotate-server-certificates="false" Jun 03 01:04:37.327461 ip-10-0-138-55 kubenswrapper[2566]: I0603 01:04:37.322875 2566 flags.go:64] FLAG: --runonce="false" Jun 03 01:04:37.327461 ip-10-0-138-55 kubenswrapper[2566]: I0603 01:04:37.322878 2566 flags.go:64] FLAG: --runtime-cgroups="/system.slice/crio.service" Jun 03 01:04:37.328054 ip-10-0-138-55 kubenswrapper[2566]: I0603 01:04:37.322881 2566 flags.go:64] FLAG: --runtime-request-timeout="2m0s" Jun 03 01:04:37.328054 ip-10-0-138-55 kubenswrapper[2566]: I0603 01:04:37.322884 2566 flags.go:64] FLAG: --seccomp-default="false" Jun 03 01:04:37.328054 ip-10-0-138-55 kubenswrapper[2566]: I0603 01:04:37.322887 2566 flags.go:64] FLAG: --serialize-image-pulls="true" Jun 03 01:04:37.328054 ip-10-0-138-55 kubenswrapper[2566]: I0603 01:04:37.322890 2566 flags.go:64] FLAG: --storage-driver-buffer-duration="1m0s" Jun 03 01:04:37.328054 ip-10-0-138-55 kubenswrapper[2566]: I0603 01:04:37.322894 2566 flags.go:64] FLAG: --storage-driver-db="cadvisor" Jun 03 01:04:37.328054 ip-10-0-138-55 kubenswrapper[2566]: I0603 01:04:37.322897 2566 flags.go:64] FLAG: --storage-driver-host="localhost:8086" Jun 03 01:04:37.328054 ip-10-0-138-55 kubenswrapper[2566]: I0603 01:04:37.322900 2566 flags.go:64] FLAG: --storage-driver-password="root" Jun 03 01:04:37.328054 ip-10-0-138-55 kubenswrapper[2566]: I0603 01:04:37.322903 2566 flags.go:64] FLAG: --storage-driver-secure="false" Jun 03 01:04:37.328054 ip-10-0-138-55 kubenswrapper[2566]: I0603 01:04:37.322906 2566 flags.go:64] FLAG: --storage-driver-table="stats" Jun 03 01:04:37.328054 ip-10-0-138-55 kubenswrapper[2566]: I0603 01:04:37.322909 2566 flags.go:64] FLAG: --storage-driver-user="root" Jun 03 01:04:37.328054 ip-10-0-138-55 kubenswrapper[2566]: I0603 01:04:37.322911 2566 flags.go:64] FLAG: --streaming-connection-idle-timeout="4h0m0s" Jun 03 01:04:37.328054 ip-10-0-138-55 kubenswrapper[2566]: I0603 01:04:37.322914 2566 flags.go:64] FLAG: --sync-frequency="1m0s" Jun 03 01:04:37.328054 ip-10-0-138-55 kubenswrapper[2566]: I0603 01:04:37.322917 2566 flags.go:64] FLAG: --system-cgroups="" Jun 03 01:04:37.328054 ip-10-0-138-55 kubenswrapper[2566]: I0603 01:04:37.322920 2566 flags.go:64] FLAG: --system-reserved="cpu=500m,ephemeral-storage=1Gi,memory=1Gi" Jun 03 01:04:37.328054 ip-10-0-138-55 kubenswrapper[2566]: I0603 01:04:37.322926 2566 flags.go:64] FLAG: --system-reserved-cgroup="" Jun 03 01:04:37.328054 ip-10-0-138-55 kubenswrapper[2566]: I0603 01:04:37.322929 2566 flags.go:64] FLAG: --tls-cert-file="" Jun 03 01:04:37.328054 ip-10-0-138-55 kubenswrapper[2566]: I0603 01:04:37.322932 2566 flags.go:64] FLAG: --tls-cipher-suites="[]" Jun 03 01:04:37.328054 ip-10-0-138-55 kubenswrapper[2566]: I0603 01:04:37.322938 2566 flags.go:64] FLAG: --tls-min-version="" Jun 03 01:04:37.328054 ip-10-0-138-55 kubenswrapper[2566]: I0603 01:04:37.322941 2566 flags.go:64] FLAG: --tls-private-key-file="" Jun 03 01:04:37.328054 ip-10-0-138-55 kubenswrapper[2566]: I0603 01:04:37.322944 2566 flags.go:64] FLAG: --topology-manager-policy="none" Jun 03 01:04:37.328054 ip-10-0-138-55 kubenswrapper[2566]: I0603 01:04:37.322951 2566 flags.go:64] FLAG: --topology-manager-policy-options="" Jun 03 01:04:37.328054 ip-10-0-138-55 kubenswrapper[2566]: I0603 01:04:37.322954 2566 flags.go:64] FLAG: --topology-manager-scope="container" Jun 03 01:04:37.328054 ip-10-0-138-55 kubenswrapper[2566]: I0603 01:04:37.322957 2566 flags.go:64] FLAG: --v="2" Jun 03 01:04:37.328054 ip-10-0-138-55 kubenswrapper[2566]: I0603 01:04:37.322961 2566 flags.go:64] FLAG: --version="false" Jun 03 01:04:37.328054 ip-10-0-138-55 kubenswrapper[2566]: I0603 01:04:37.322966 2566 flags.go:64] FLAG: --vmodule="" Jun 03 01:04:37.328700 ip-10-0-138-55 kubenswrapper[2566]: I0603 01:04:37.322970 2566 flags.go:64] FLAG: --volume-plugin-dir="/etc/kubernetes/kubelet-plugins/volume/exec" Jun 03 01:04:37.328700 ip-10-0-138-55 kubenswrapper[2566]: I0603 01:04:37.322973 2566 flags.go:64] FLAG: --volume-stats-agg-period="1m0s" Jun 03 01:04:37.328700 ip-10-0-138-55 kubenswrapper[2566]: W0603 01:04:37.323069 2566 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jun 03 01:04:37.328700 ip-10-0-138-55 kubenswrapper[2566]: W0603 01:04:37.323073 2566 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jun 03 01:04:37.328700 ip-10-0-138-55 kubenswrapper[2566]: W0603 01:04:37.323077 2566 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jun 03 01:04:37.328700 ip-10-0-138-55 kubenswrapper[2566]: W0603 01:04:37.323080 2566 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jun 03 01:04:37.328700 ip-10-0-138-55 kubenswrapper[2566]: W0603 01:04:37.323083 2566 feature_gate.go:328] unrecognized feature gate: Example Jun 03 01:04:37.328700 ip-10-0-138-55 kubenswrapper[2566]: W0603 01:04:37.323086 2566 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jun 03 01:04:37.328700 ip-10-0-138-55 kubenswrapper[2566]: W0603 01:04:37.323089 2566 feature_gate.go:328] unrecognized feature gate: DualReplica Jun 03 01:04:37.328700 ip-10-0-138-55 kubenswrapper[2566]: W0603 01:04:37.323091 2566 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jun 03 01:04:37.328700 ip-10-0-138-55 kubenswrapper[2566]: W0603 01:04:37.323094 2566 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jun 03 01:04:37.328700 ip-10-0-138-55 kubenswrapper[2566]: W0603 01:04:37.323099 2566 feature_gate.go:328] unrecognized feature gate: InsightsConfigAPI Jun 03 01:04:37.328700 ip-10-0-138-55 kubenswrapper[2566]: W0603 01:04:37.323101 2566 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jun 03 01:04:37.328700 ip-10-0-138-55 kubenswrapper[2566]: W0603 01:04:37.323104 2566 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jun 03 01:04:37.328700 ip-10-0-138-55 kubenswrapper[2566]: W0603 01:04:37.323107 2566 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jun 03 01:04:37.328700 ip-10-0-138-55 kubenswrapper[2566]: W0603 01:04:37.323111 2566 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jun 03 01:04:37.328700 ip-10-0-138-55 kubenswrapper[2566]: W0603 01:04:37.323113 2566 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jun 03 01:04:37.328700 ip-10-0-138-55 kubenswrapper[2566]: W0603 01:04:37.323116 2566 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jun 03 01:04:37.328700 ip-10-0-138-55 kubenswrapper[2566]: W0603 01:04:37.323119 2566 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jun 03 01:04:37.328700 ip-10-0-138-55 kubenswrapper[2566]: W0603 01:04:37.323121 2566 feature_gate.go:328] unrecognized feature gate: SignatureStores Jun 03 01:04:37.329215 ip-10-0-138-55 kubenswrapper[2566]: W0603 01:04:37.323124 2566 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jun 03 01:04:37.329215 ip-10-0-138-55 kubenswrapper[2566]: W0603 01:04:37.323127 2566 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jun 03 01:04:37.329215 ip-10-0-138-55 kubenswrapper[2566]: W0603 01:04:37.323129 2566 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jun 03 01:04:37.329215 ip-10-0-138-55 kubenswrapper[2566]: W0603 01:04:37.323132 2566 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jun 03 01:04:37.329215 ip-10-0-138-55 kubenswrapper[2566]: W0603 01:04:37.323135 2566 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jun 03 01:04:37.329215 ip-10-0-138-55 kubenswrapper[2566]: W0603 01:04:37.323137 2566 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jun 03 01:04:37.329215 ip-10-0-138-55 kubenswrapper[2566]: W0603 01:04:37.323140 2566 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jun 03 01:04:37.329215 ip-10-0-138-55 kubenswrapper[2566]: W0603 01:04:37.323143 2566 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jun 03 01:04:37.329215 ip-10-0-138-55 kubenswrapper[2566]: W0603 01:04:37.323146 2566 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jun 03 01:04:37.329215 ip-10-0-138-55 kubenswrapper[2566]: W0603 01:04:37.323148 2566 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jun 03 01:04:37.329215 ip-10-0-138-55 kubenswrapper[2566]: W0603 01:04:37.323153 2566 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jun 03 01:04:37.329215 ip-10-0-138-55 kubenswrapper[2566]: W0603 01:04:37.323156 2566 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jun 03 01:04:37.329215 ip-10-0-138-55 kubenswrapper[2566]: W0603 01:04:37.323159 2566 feature_gate.go:328] unrecognized feature gate: IngressControllerLBSubnetsAWS Jun 03 01:04:37.329215 ip-10-0-138-55 kubenswrapper[2566]: W0603 01:04:37.323162 2566 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jun 03 01:04:37.329215 ip-10-0-138-55 kubenswrapper[2566]: W0603 01:04:37.323164 2566 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jun 03 01:04:37.329215 ip-10-0-138-55 kubenswrapper[2566]: W0603 01:04:37.323168 2566 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jun 03 01:04:37.329215 ip-10-0-138-55 kubenswrapper[2566]: W0603 01:04:37.323172 2566 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jun 03 01:04:37.329215 ip-10-0-138-55 kubenswrapper[2566]: W0603 01:04:37.323175 2566 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jun 03 01:04:37.329215 ip-10-0-138-55 kubenswrapper[2566]: W0603 01:04:37.323178 2566 feature_gate.go:328] unrecognized feature gate: PinnedImages Jun 03 01:04:37.329805 ip-10-0-138-55 kubenswrapper[2566]: W0603 01:04:37.323180 2566 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jun 03 01:04:37.329805 ip-10-0-138-55 kubenswrapper[2566]: W0603 01:04:37.323183 2566 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jun 03 01:04:37.329805 ip-10-0-138-55 kubenswrapper[2566]: W0603 01:04:37.323186 2566 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jun 03 01:04:37.329805 ip-10-0-138-55 kubenswrapper[2566]: W0603 01:04:37.323188 2566 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jun 03 01:04:37.329805 ip-10-0-138-55 kubenswrapper[2566]: W0603 01:04:37.323192 2566 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterOperations Jun 03 01:04:37.329805 ip-10-0-138-55 kubenswrapper[2566]: W0603 01:04:37.323195 2566 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jun 03 01:04:37.329805 ip-10-0-138-55 kubenswrapper[2566]: W0603 01:04:37.323198 2566 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jun 03 01:04:37.329805 ip-10-0-138-55 kubenswrapper[2566]: W0603 01:04:37.323200 2566 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jun 03 01:04:37.329805 ip-10-0-138-55 kubenswrapper[2566]: W0603 01:04:37.323203 2566 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jun 03 01:04:37.329805 ip-10-0-138-55 kubenswrapper[2566]: W0603 01:04:37.323206 2566 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jun 03 01:04:37.329805 ip-10-0-138-55 kubenswrapper[2566]: W0603 01:04:37.323208 2566 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jun 03 01:04:37.329805 ip-10-0-138-55 kubenswrapper[2566]: W0603 01:04:37.323211 2566 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jun 03 01:04:37.329805 ip-10-0-138-55 kubenswrapper[2566]: W0603 01:04:37.323214 2566 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jun 03 01:04:37.329805 ip-10-0-138-55 kubenswrapper[2566]: W0603 01:04:37.323216 2566 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jun 03 01:04:37.329805 ip-10-0-138-55 kubenswrapper[2566]: W0603 01:04:37.323218 2566 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jun 03 01:04:37.329805 ip-10-0-138-55 kubenswrapper[2566]: W0603 01:04:37.323221 2566 feature_gate.go:328] unrecognized feature gate: OVNObservability Jun 03 01:04:37.329805 ip-10-0-138-55 kubenswrapper[2566]: W0603 01:04:37.323236 2566 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jun 03 01:04:37.329805 ip-10-0-138-55 kubenswrapper[2566]: W0603 01:04:37.323239 2566 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jun 03 01:04:37.329805 ip-10-0-138-55 kubenswrapper[2566]: W0603 01:04:37.323241 2566 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jun 03 01:04:37.329805 ip-10-0-138-55 kubenswrapper[2566]: W0603 01:04:37.323244 2566 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jun 03 01:04:37.330317 ip-10-0-138-55 kubenswrapper[2566]: W0603 01:04:37.323248 2566 feature_gate.go:328] unrecognized feature gate: Example2 Jun 03 01:04:37.330317 ip-10-0-138-55 kubenswrapper[2566]: W0603 01:04:37.323250 2566 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jun 03 01:04:37.330317 ip-10-0-138-55 kubenswrapper[2566]: W0603 01:04:37.323253 2566 feature_gate.go:328] unrecognized feature gate: SetEIPForNLBIngressController Jun 03 01:04:37.330317 ip-10-0-138-55 kubenswrapper[2566]: W0603 01:04:37.323255 2566 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jun 03 01:04:37.330317 ip-10-0-138-55 kubenswrapper[2566]: W0603 01:04:37.323258 2566 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jun 03 01:04:37.330317 ip-10-0-138-55 kubenswrapper[2566]: W0603 01:04:37.323261 2566 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jun 03 01:04:37.330317 ip-10-0-138-55 kubenswrapper[2566]: W0603 01:04:37.323263 2566 feature_gate.go:328] unrecognized feature gate: NewOLM Jun 03 01:04:37.330317 ip-10-0-138-55 kubenswrapper[2566]: W0603 01:04:37.323266 2566 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jun 03 01:04:37.330317 ip-10-0-138-55 kubenswrapper[2566]: W0603 01:04:37.323269 2566 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jun 03 01:04:37.330317 ip-10-0-138-55 kubenswrapper[2566]: W0603 01:04:37.323271 2566 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jun 03 01:04:37.330317 ip-10-0-138-55 kubenswrapper[2566]: W0603 01:04:37.323274 2566 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jun 03 01:04:37.330317 ip-10-0-138-55 kubenswrapper[2566]: W0603 01:04:37.323276 2566 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jun 03 01:04:37.330317 ip-10-0-138-55 kubenswrapper[2566]: W0603 01:04:37.323279 2566 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jun 03 01:04:37.330317 ip-10-0-138-55 kubenswrapper[2566]: W0603 01:04:37.323281 2566 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jun 03 01:04:37.330317 ip-10-0-138-55 kubenswrapper[2566]: W0603 01:04:37.323284 2566 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jun 03 01:04:37.330317 ip-10-0-138-55 kubenswrapper[2566]: W0603 01:04:37.323286 2566 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jun 03 01:04:37.330317 ip-10-0-138-55 kubenswrapper[2566]: W0603 01:04:37.323290 2566 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jun 03 01:04:37.330317 ip-10-0-138-55 kubenswrapper[2566]: W0603 01:04:37.323293 2566 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jun 03 01:04:37.330317 ip-10-0-138-55 kubenswrapper[2566]: W0603 01:04:37.323296 2566 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jun 03 01:04:37.330317 ip-10-0-138-55 kubenswrapper[2566]: W0603 01:04:37.323298 2566 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jun 03 01:04:37.330317 ip-10-0-138-55 kubenswrapper[2566]: W0603 01:04:37.323301 2566 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jun 03 01:04:37.330842 ip-10-0-138-55 kubenswrapper[2566]: W0603 01:04:37.323303 2566 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jun 03 01:04:37.330842 ip-10-0-138-55 kubenswrapper[2566]: W0603 01:04:37.323307 2566 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jun 03 01:04:37.330842 ip-10-0-138-55 kubenswrapper[2566]: W0603 01:04:37.323310 2566 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jun 03 01:04:37.330842 ip-10-0-138-55 kubenswrapper[2566]: W0603 01:04:37.323313 2566 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jun 03 01:04:37.330842 ip-10-0-138-55 kubenswrapper[2566]: W0603 01:04:37.323315 2566 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jun 03 01:04:37.330842 ip-10-0-138-55 kubenswrapper[2566]: W0603 01:04:37.323318 2566 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jun 03 01:04:37.330842 ip-10-0-138-55 kubenswrapper[2566]: W0603 01:04:37.323321 2566 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jun 03 01:04:37.330842 ip-10-0-138-55 kubenswrapper[2566]: W0603 01:04:37.323323 2566 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jun 03 01:04:37.330842 ip-10-0-138-55 kubenswrapper[2566]: I0603 01:04:37.324060 2566 feature_gate.go:384] feature gates: {map[DynamicResourceAllocation:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutatingAdmissionPolicy:false NodeSwap:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:false]} Jun 03 01:04:37.330842 ip-10-0-138-55 kubenswrapper[2566]: I0603 01:04:37.330120 2566 server.go:530] "Kubelet version" kubeletVersion="v1.33.12" Jun 03 01:04:37.330842 ip-10-0-138-55 kubenswrapper[2566]: I0603 01:04:37.330136 2566 server.go:532] "Golang settings" GOGC="" GOMAXPROCS="" GOTRACEBACK="" Jun 03 01:04:37.330842 ip-10-0-138-55 kubenswrapper[2566]: W0603 01:04:37.330182 2566 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jun 03 01:04:37.330842 ip-10-0-138-55 kubenswrapper[2566]: W0603 01:04:37.330187 2566 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jun 03 01:04:37.330842 ip-10-0-138-55 kubenswrapper[2566]: W0603 01:04:37.330190 2566 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jun 03 01:04:37.330842 ip-10-0-138-55 kubenswrapper[2566]: W0603 01:04:37.330193 2566 feature_gate.go:328] unrecognized feature gate: Example2 Jun 03 01:04:37.331234 ip-10-0-138-55 kubenswrapper[2566]: W0603 01:04:37.330197 2566 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jun 03 01:04:37.331234 ip-10-0-138-55 kubenswrapper[2566]: W0603 01:04:37.330199 2566 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jun 03 01:04:37.331234 ip-10-0-138-55 kubenswrapper[2566]: W0603 01:04:37.330202 2566 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jun 03 01:04:37.331234 ip-10-0-138-55 kubenswrapper[2566]: W0603 01:04:37.330206 2566 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jun 03 01:04:37.331234 ip-10-0-138-55 kubenswrapper[2566]: W0603 01:04:37.330210 2566 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterOperations Jun 03 01:04:37.331234 ip-10-0-138-55 kubenswrapper[2566]: W0603 01:04:37.330214 2566 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jun 03 01:04:37.331234 ip-10-0-138-55 kubenswrapper[2566]: W0603 01:04:37.330216 2566 feature_gate.go:328] unrecognized feature gate: DualReplica Jun 03 01:04:37.331234 ip-10-0-138-55 kubenswrapper[2566]: W0603 01:04:37.330219 2566 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jun 03 01:04:37.331234 ip-10-0-138-55 kubenswrapper[2566]: W0603 01:04:37.330237 2566 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jun 03 01:04:37.331234 ip-10-0-138-55 kubenswrapper[2566]: W0603 01:04:37.330240 2566 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jun 03 01:04:37.331234 ip-10-0-138-55 kubenswrapper[2566]: W0603 01:04:37.330242 2566 feature_gate.go:328] unrecognized feature gate: Example Jun 03 01:04:37.331234 ip-10-0-138-55 kubenswrapper[2566]: W0603 01:04:37.330245 2566 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jun 03 01:04:37.331234 ip-10-0-138-55 kubenswrapper[2566]: W0603 01:04:37.330248 2566 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jun 03 01:04:37.331234 ip-10-0-138-55 kubenswrapper[2566]: W0603 01:04:37.330251 2566 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jun 03 01:04:37.331234 ip-10-0-138-55 kubenswrapper[2566]: W0603 01:04:37.330254 2566 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jun 03 01:04:37.331234 ip-10-0-138-55 kubenswrapper[2566]: W0603 01:04:37.330256 2566 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jun 03 01:04:37.331234 ip-10-0-138-55 kubenswrapper[2566]: W0603 01:04:37.330259 2566 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jun 03 01:04:37.331234 ip-10-0-138-55 kubenswrapper[2566]: W0603 01:04:37.330262 2566 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jun 03 01:04:37.331234 ip-10-0-138-55 kubenswrapper[2566]: W0603 01:04:37.330265 2566 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jun 03 01:04:37.331234 ip-10-0-138-55 kubenswrapper[2566]: W0603 01:04:37.330268 2566 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jun 03 01:04:37.331731 ip-10-0-138-55 kubenswrapper[2566]: W0603 01:04:37.330271 2566 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jun 03 01:04:37.331731 ip-10-0-138-55 kubenswrapper[2566]: W0603 01:04:37.330273 2566 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jun 03 01:04:37.331731 ip-10-0-138-55 kubenswrapper[2566]: W0603 01:04:37.330276 2566 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jun 03 01:04:37.331731 ip-10-0-138-55 kubenswrapper[2566]: W0603 01:04:37.330278 2566 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jun 03 01:04:37.331731 ip-10-0-138-55 kubenswrapper[2566]: W0603 01:04:37.330281 2566 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jun 03 01:04:37.331731 ip-10-0-138-55 kubenswrapper[2566]: W0603 01:04:37.330284 2566 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jun 03 01:04:37.331731 ip-10-0-138-55 kubenswrapper[2566]: W0603 01:04:37.330286 2566 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jun 03 01:04:37.331731 ip-10-0-138-55 kubenswrapper[2566]: W0603 01:04:37.330289 2566 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jun 03 01:04:37.331731 ip-10-0-138-55 kubenswrapper[2566]: W0603 01:04:37.330292 2566 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jun 03 01:04:37.331731 ip-10-0-138-55 kubenswrapper[2566]: W0603 01:04:37.330294 2566 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jun 03 01:04:37.331731 ip-10-0-138-55 kubenswrapper[2566]: W0603 01:04:37.330298 2566 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jun 03 01:04:37.331731 ip-10-0-138-55 kubenswrapper[2566]: W0603 01:04:37.330300 2566 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jun 03 01:04:37.331731 ip-10-0-138-55 kubenswrapper[2566]: W0603 01:04:37.330303 2566 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jun 03 01:04:37.331731 ip-10-0-138-55 kubenswrapper[2566]: W0603 01:04:37.330306 2566 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jun 03 01:04:37.331731 ip-10-0-138-55 kubenswrapper[2566]: W0603 01:04:37.330308 2566 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jun 03 01:04:37.331731 ip-10-0-138-55 kubenswrapper[2566]: W0603 01:04:37.330311 2566 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jun 03 01:04:37.331731 ip-10-0-138-55 kubenswrapper[2566]: W0603 01:04:37.330313 2566 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jun 03 01:04:37.331731 ip-10-0-138-55 kubenswrapper[2566]: W0603 01:04:37.330316 2566 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jun 03 01:04:37.331731 ip-10-0-138-55 kubenswrapper[2566]: W0603 01:04:37.330319 2566 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jun 03 01:04:37.331731 ip-10-0-138-55 kubenswrapper[2566]: W0603 01:04:37.330321 2566 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jun 03 01:04:37.332217 ip-10-0-138-55 kubenswrapper[2566]: W0603 01:04:37.330324 2566 feature_gate.go:328] unrecognized feature gate: SetEIPForNLBIngressController Jun 03 01:04:37.332217 ip-10-0-138-55 kubenswrapper[2566]: W0603 01:04:37.330327 2566 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jun 03 01:04:37.332217 ip-10-0-138-55 kubenswrapper[2566]: W0603 01:04:37.330329 2566 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jun 03 01:04:37.332217 ip-10-0-138-55 kubenswrapper[2566]: W0603 01:04:37.330332 2566 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jun 03 01:04:37.332217 ip-10-0-138-55 kubenswrapper[2566]: W0603 01:04:37.330335 2566 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jun 03 01:04:37.332217 ip-10-0-138-55 kubenswrapper[2566]: W0603 01:04:37.330339 2566 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jun 03 01:04:37.332217 ip-10-0-138-55 kubenswrapper[2566]: W0603 01:04:37.330343 2566 feature_gate.go:328] unrecognized feature gate: PinnedImages Jun 03 01:04:37.332217 ip-10-0-138-55 kubenswrapper[2566]: W0603 01:04:37.330346 2566 feature_gate.go:328] unrecognized feature gate: SignatureStores Jun 03 01:04:37.332217 ip-10-0-138-55 kubenswrapper[2566]: W0603 01:04:37.330349 2566 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jun 03 01:04:37.332217 ip-10-0-138-55 kubenswrapper[2566]: W0603 01:04:37.330351 2566 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jun 03 01:04:37.332217 ip-10-0-138-55 kubenswrapper[2566]: W0603 01:04:37.330354 2566 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jun 03 01:04:37.332217 ip-10-0-138-55 kubenswrapper[2566]: W0603 01:04:37.330357 2566 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jun 03 01:04:37.332217 ip-10-0-138-55 kubenswrapper[2566]: W0603 01:04:37.330360 2566 feature_gate.go:328] unrecognized feature gate: InsightsConfigAPI Jun 03 01:04:37.332217 ip-10-0-138-55 kubenswrapper[2566]: W0603 01:04:37.330362 2566 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jun 03 01:04:37.332217 ip-10-0-138-55 kubenswrapper[2566]: W0603 01:04:37.330365 2566 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jun 03 01:04:37.332217 ip-10-0-138-55 kubenswrapper[2566]: W0603 01:04:37.330368 2566 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jun 03 01:04:37.332217 ip-10-0-138-55 kubenswrapper[2566]: W0603 01:04:37.330371 2566 feature_gate.go:328] unrecognized feature gate: IngressControllerLBSubnetsAWS Jun 03 01:04:37.332217 ip-10-0-138-55 kubenswrapper[2566]: W0603 01:04:37.330373 2566 feature_gate.go:328] unrecognized feature gate: OVNObservability Jun 03 01:04:37.332217 ip-10-0-138-55 kubenswrapper[2566]: W0603 01:04:37.330376 2566 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jun 03 01:04:37.332701 ip-10-0-138-55 kubenswrapper[2566]: W0603 01:04:37.330379 2566 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jun 03 01:04:37.332701 ip-10-0-138-55 kubenswrapper[2566]: W0603 01:04:37.330381 2566 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jun 03 01:04:37.332701 ip-10-0-138-55 kubenswrapper[2566]: W0603 01:04:37.330384 2566 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jun 03 01:04:37.332701 ip-10-0-138-55 kubenswrapper[2566]: W0603 01:04:37.330387 2566 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jun 03 01:04:37.332701 ip-10-0-138-55 kubenswrapper[2566]: W0603 01:04:37.330389 2566 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jun 03 01:04:37.332701 ip-10-0-138-55 kubenswrapper[2566]: W0603 01:04:37.330392 2566 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jun 03 01:04:37.332701 ip-10-0-138-55 kubenswrapper[2566]: W0603 01:04:37.330394 2566 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jun 03 01:04:37.332701 ip-10-0-138-55 kubenswrapper[2566]: W0603 01:04:37.330397 2566 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jun 03 01:04:37.332701 ip-10-0-138-55 kubenswrapper[2566]: W0603 01:04:37.330399 2566 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jun 03 01:04:37.332701 ip-10-0-138-55 kubenswrapper[2566]: W0603 01:04:37.330402 2566 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jun 03 01:04:37.332701 ip-10-0-138-55 kubenswrapper[2566]: W0603 01:04:37.330405 2566 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jun 03 01:04:37.332701 ip-10-0-138-55 kubenswrapper[2566]: W0603 01:04:37.330407 2566 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jun 03 01:04:37.332701 ip-10-0-138-55 kubenswrapper[2566]: W0603 01:04:37.330410 2566 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jun 03 01:04:37.332701 ip-10-0-138-55 kubenswrapper[2566]: W0603 01:04:37.330412 2566 feature_gate.go:328] unrecognized feature gate: NewOLM Jun 03 01:04:37.332701 ip-10-0-138-55 kubenswrapper[2566]: W0603 01:04:37.330415 2566 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jun 03 01:04:37.332701 ip-10-0-138-55 kubenswrapper[2566]: W0603 01:04:37.330417 2566 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jun 03 01:04:37.332701 ip-10-0-138-55 kubenswrapper[2566]: W0603 01:04:37.330420 2566 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jun 03 01:04:37.332701 ip-10-0-138-55 kubenswrapper[2566]: W0603 01:04:37.330423 2566 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jun 03 01:04:37.332701 ip-10-0-138-55 kubenswrapper[2566]: W0603 01:04:37.330426 2566 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jun 03 01:04:37.332701 ip-10-0-138-55 kubenswrapper[2566]: W0603 01:04:37.330428 2566 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jun 03 01:04:37.333213 ip-10-0-138-55 kubenswrapper[2566]: W0603 01:04:37.330431 2566 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jun 03 01:04:37.333213 ip-10-0-138-55 kubenswrapper[2566]: W0603 01:04:37.330434 2566 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jun 03 01:04:37.333213 ip-10-0-138-55 kubenswrapper[2566]: W0603 01:04:37.330436 2566 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jun 03 01:04:37.333213 ip-10-0-138-55 kubenswrapper[2566]: I0603 01:04:37.330441 2566 feature_gate.go:384] feature gates: {map[DynamicResourceAllocation:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutatingAdmissionPolicy:false NodeSwap:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:false]} Jun 03 01:04:37.333213 ip-10-0-138-55 kubenswrapper[2566]: W0603 01:04:37.330532 2566 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jun 03 01:04:37.333213 ip-10-0-138-55 kubenswrapper[2566]: W0603 01:04:37.330536 2566 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jun 03 01:04:37.333213 ip-10-0-138-55 kubenswrapper[2566]: W0603 01:04:37.330540 2566 feature_gate.go:328] unrecognized feature gate: PinnedImages Jun 03 01:04:37.333213 ip-10-0-138-55 kubenswrapper[2566]: W0603 01:04:37.330542 2566 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jun 03 01:04:37.333213 ip-10-0-138-55 kubenswrapper[2566]: W0603 01:04:37.330546 2566 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jun 03 01:04:37.333213 ip-10-0-138-55 kubenswrapper[2566]: W0603 01:04:37.330549 2566 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jun 03 01:04:37.333213 ip-10-0-138-55 kubenswrapper[2566]: W0603 01:04:37.330551 2566 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jun 03 01:04:37.333213 ip-10-0-138-55 kubenswrapper[2566]: W0603 01:04:37.330554 2566 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jun 03 01:04:37.333213 ip-10-0-138-55 kubenswrapper[2566]: W0603 01:04:37.330556 2566 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jun 03 01:04:37.333213 ip-10-0-138-55 kubenswrapper[2566]: W0603 01:04:37.330559 2566 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jun 03 01:04:37.333213 ip-10-0-138-55 kubenswrapper[2566]: W0603 01:04:37.330561 2566 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jun 03 01:04:37.333596 ip-10-0-138-55 kubenswrapper[2566]: W0603 01:04:37.330564 2566 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jun 03 01:04:37.333596 ip-10-0-138-55 kubenswrapper[2566]: W0603 01:04:37.330566 2566 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jun 03 01:04:37.333596 ip-10-0-138-55 kubenswrapper[2566]: W0603 01:04:37.330568 2566 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jun 03 01:04:37.333596 ip-10-0-138-55 kubenswrapper[2566]: W0603 01:04:37.330571 2566 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jun 03 01:04:37.333596 ip-10-0-138-55 kubenswrapper[2566]: W0603 01:04:37.330574 2566 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jun 03 01:04:37.333596 ip-10-0-138-55 kubenswrapper[2566]: W0603 01:04:37.330576 2566 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jun 03 01:04:37.333596 ip-10-0-138-55 kubenswrapper[2566]: W0603 01:04:37.330579 2566 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jun 03 01:04:37.333596 ip-10-0-138-55 kubenswrapper[2566]: W0603 01:04:37.330582 2566 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jun 03 01:04:37.333596 ip-10-0-138-55 kubenswrapper[2566]: W0603 01:04:37.330584 2566 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jun 03 01:04:37.333596 ip-10-0-138-55 kubenswrapper[2566]: W0603 01:04:37.330587 2566 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jun 03 01:04:37.333596 ip-10-0-138-55 kubenswrapper[2566]: W0603 01:04:37.330589 2566 feature_gate.go:328] unrecognized feature gate: Example2 Jun 03 01:04:37.333596 ip-10-0-138-55 kubenswrapper[2566]: W0603 01:04:37.330592 2566 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jun 03 01:04:37.333596 ip-10-0-138-55 kubenswrapper[2566]: W0603 01:04:37.330594 2566 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jun 03 01:04:37.333596 ip-10-0-138-55 kubenswrapper[2566]: W0603 01:04:37.330596 2566 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jun 03 01:04:37.333596 ip-10-0-138-55 kubenswrapper[2566]: W0603 01:04:37.330599 2566 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jun 03 01:04:37.333596 ip-10-0-138-55 kubenswrapper[2566]: W0603 01:04:37.330602 2566 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jun 03 01:04:37.333596 ip-10-0-138-55 kubenswrapper[2566]: W0603 01:04:37.330605 2566 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jun 03 01:04:37.333596 ip-10-0-138-55 kubenswrapper[2566]: W0603 01:04:37.330607 2566 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jun 03 01:04:37.333596 ip-10-0-138-55 kubenswrapper[2566]: W0603 01:04:37.330609 2566 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jun 03 01:04:37.333596 ip-10-0-138-55 kubenswrapper[2566]: W0603 01:04:37.330612 2566 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jun 03 01:04:37.334080 ip-10-0-138-55 kubenswrapper[2566]: W0603 01:04:37.330614 2566 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jun 03 01:04:37.334080 ip-10-0-138-55 kubenswrapper[2566]: W0603 01:04:37.330617 2566 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jun 03 01:04:37.334080 ip-10-0-138-55 kubenswrapper[2566]: W0603 01:04:37.330620 2566 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jun 03 01:04:37.334080 ip-10-0-138-55 kubenswrapper[2566]: W0603 01:04:37.330623 2566 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jun 03 01:04:37.334080 ip-10-0-138-55 kubenswrapper[2566]: W0603 01:04:37.330625 2566 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jun 03 01:04:37.334080 ip-10-0-138-55 kubenswrapper[2566]: W0603 01:04:37.330628 2566 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jun 03 01:04:37.334080 ip-10-0-138-55 kubenswrapper[2566]: W0603 01:04:37.330631 2566 feature_gate.go:328] unrecognized feature gate: SetEIPForNLBIngressController Jun 03 01:04:37.334080 ip-10-0-138-55 kubenswrapper[2566]: W0603 01:04:37.330634 2566 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jun 03 01:04:37.334080 ip-10-0-138-55 kubenswrapper[2566]: W0603 01:04:37.330636 2566 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jun 03 01:04:37.334080 ip-10-0-138-55 kubenswrapper[2566]: W0603 01:04:37.330638 2566 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jun 03 01:04:37.334080 ip-10-0-138-55 kubenswrapper[2566]: W0603 01:04:37.330642 2566 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jun 03 01:04:37.334080 ip-10-0-138-55 kubenswrapper[2566]: W0603 01:04:37.330646 2566 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jun 03 01:04:37.334080 ip-10-0-138-55 kubenswrapper[2566]: W0603 01:04:37.330648 2566 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jun 03 01:04:37.334080 ip-10-0-138-55 kubenswrapper[2566]: W0603 01:04:37.330651 2566 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jun 03 01:04:37.334080 ip-10-0-138-55 kubenswrapper[2566]: W0603 01:04:37.330654 2566 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jun 03 01:04:37.334080 ip-10-0-138-55 kubenswrapper[2566]: W0603 01:04:37.330657 2566 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jun 03 01:04:37.334080 ip-10-0-138-55 kubenswrapper[2566]: W0603 01:04:37.330660 2566 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jun 03 01:04:37.334080 ip-10-0-138-55 kubenswrapper[2566]: W0603 01:04:37.330662 2566 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jun 03 01:04:37.334080 ip-10-0-138-55 kubenswrapper[2566]: W0603 01:04:37.330665 2566 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jun 03 01:04:37.334620 ip-10-0-138-55 kubenswrapper[2566]: W0603 01:04:37.330667 2566 feature_gate.go:328] unrecognized feature gate: OVNObservability Jun 03 01:04:37.334620 ip-10-0-138-55 kubenswrapper[2566]: W0603 01:04:37.330670 2566 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jun 03 01:04:37.334620 ip-10-0-138-55 kubenswrapper[2566]: W0603 01:04:37.330673 2566 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jun 03 01:04:37.334620 ip-10-0-138-55 kubenswrapper[2566]: W0603 01:04:37.330675 2566 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jun 03 01:04:37.334620 ip-10-0-138-55 kubenswrapper[2566]: W0603 01:04:37.330678 2566 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jun 03 01:04:37.334620 ip-10-0-138-55 kubenswrapper[2566]: W0603 01:04:37.330680 2566 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jun 03 01:04:37.334620 ip-10-0-138-55 kubenswrapper[2566]: W0603 01:04:37.330683 2566 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jun 03 01:04:37.334620 ip-10-0-138-55 kubenswrapper[2566]: W0603 01:04:37.330686 2566 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jun 03 01:04:37.334620 ip-10-0-138-55 kubenswrapper[2566]: W0603 01:04:37.330689 2566 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterOperations Jun 03 01:04:37.334620 ip-10-0-138-55 kubenswrapper[2566]: W0603 01:04:37.330691 2566 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jun 03 01:04:37.334620 ip-10-0-138-55 kubenswrapper[2566]: W0603 01:04:37.330693 2566 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jun 03 01:04:37.334620 ip-10-0-138-55 kubenswrapper[2566]: W0603 01:04:37.330696 2566 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jun 03 01:04:37.334620 ip-10-0-138-55 kubenswrapper[2566]: W0603 01:04:37.330698 2566 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jun 03 01:04:37.334620 ip-10-0-138-55 kubenswrapper[2566]: W0603 01:04:37.330701 2566 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jun 03 01:04:37.334620 ip-10-0-138-55 kubenswrapper[2566]: W0603 01:04:37.330704 2566 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jun 03 01:04:37.334620 ip-10-0-138-55 kubenswrapper[2566]: W0603 01:04:37.330707 2566 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jun 03 01:04:37.334620 ip-10-0-138-55 kubenswrapper[2566]: W0603 01:04:37.330709 2566 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jun 03 01:04:37.334620 ip-10-0-138-55 kubenswrapper[2566]: W0603 01:04:37.330719 2566 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jun 03 01:04:37.334620 ip-10-0-138-55 kubenswrapper[2566]: W0603 01:04:37.330722 2566 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jun 03 01:04:37.334620 ip-10-0-138-55 kubenswrapper[2566]: W0603 01:04:37.330725 2566 feature_gate.go:328] unrecognized feature gate: IngressControllerLBSubnetsAWS Jun 03 01:04:37.335110 ip-10-0-138-55 kubenswrapper[2566]: W0603 01:04:37.330728 2566 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jun 03 01:04:37.335110 ip-10-0-138-55 kubenswrapper[2566]: W0603 01:04:37.330730 2566 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jun 03 01:04:37.335110 ip-10-0-138-55 kubenswrapper[2566]: W0603 01:04:37.330733 2566 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jun 03 01:04:37.335110 ip-10-0-138-55 kubenswrapper[2566]: W0603 01:04:37.330735 2566 feature_gate.go:328] unrecognized feature gate: InsightsConfigAPI Jun 03 01:04:37.335110 ip-10-0-138-55 kubenswrapper[2566]: W0603 01:04:37.330738 2566 feature_gate.go:328] unrecognized feature gate: SignatureStores Jun 03 01:04:37.335110 ip-10-0-138-55 kubenswrapper[2566]: W0603 01:04:37.330740 2566 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jun 03 01:04:37.335110 ip-10-0-138-55 kubenswrapper[2566]: W0603 01:04:37.330743 2566 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jun 03 01:04:37.335110 ip-10-0-138-55 kubenswrapper[2566]: W0603 01:04:37.330745 2566 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jun 03 01:04:37.335110 ip-10-0-138-55 kubenswrapper[2566]: W0603 01:04:37.330748 2566 feature_gate.go:328] unrecognized feature gate: NewOLM Jun 03 01:04:37.335110 ip-10-0-138-55 kubenswrapper[2566]: W0603 01:04:37.330750 2566 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jun 03 01:04:37.335110 ip-10-0-138-55 kubenswrapper[2566]: W0603 01:04:37.330753 2566 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jun 03 01:04:37.335110 ip-10-0-138-55 kubenswrapper[2566]: W0603 01:04:37.330756 2566 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jun 03 01:04:37.335110 ip-10-0-138-55 kubenswrapper[2566]: W0603 01:04:37.330759 2566 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jun 03 01:04:37.335110 ip-10-0-138-55 kubenswrapper[2566]: W0603 01:04:37.330762 2566 feature_gate.go:328] unrecognized feature gate: Example Jun 03 01:04:37.335110 ip-10-0-138-55 kubenswrapper[2566]: W0603 01:04:37.330765 2566 feature_gate.go:328] unrecognized feature gate: DualReplica Jun 03 01:04:37.335110 ip-10-0-138-55 kubenswrapper[2566]: W0603 01:04:37.330767 2566 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jun 03 01:04:37.335629 ip-10-0-138-55 kubenswrapper[2566]: I0603 01:04:37.330772 2566 feature_gate.go:384] feature gates: {map[DynamicResourceAllocation:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutatingAdmissionPolicy:false NodeSwap:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:false]} Jun 03 01:04:37.335629 ip-10-0-138-55 kubenswrapper[2566]: I0603 01:04:37.331502 2566 server.go:962] "Client rotation is on, will bootstrap in background" Jun 03 01:04:37.335629 ip-10-0-138-55 kubenswrapper[2566]: I0603 01:04:37.334299 2566 bootstrap.go:101] "Use the bootstrap credentials to request a cert, and set kubeconfig to point to the certificate dir" Jun 03 01:04:37.335629 ip-10-0-138-55 kubenswrapper[2566]: I0603 01:04:37.335251 2566 server.go:1019] "Starting client certificate rotation" Jun 03 01:04:37.335629 ip-10-0-138-55 kubenswrapper[2566]: I0603 01:04:37.335356 2566 certificate_manager.go:422] "Certificate rotation is enabled" logger="kubernetes.io/kube-apiserver-client-kubelet" Jun 03 01:04:37.335629 ip-10-0-138-55 kubenswrapper[2566]: I0603 01:04:37.335393 2566 certificate_manager.go:566] "Rotating certificates" logger="kubernetes.io/kube-apiserver-client-kubelet" Jun 03 01:04:37.364973 ip-10-0-138-55 kubenswrapper[2566]: I0603 01:04:37.364952 2566 dynamic_cafile_content.go:123] "Loaded a new CA Bundle and Verifier" name="client-ca-bundle::/etc/kubernetes/kubelet-ca.crt" Jun 03 01:04:37.370007 ip-10-0-138-55 kubenswrapper[2566]: I0603 01:04:37.369990 2566 dynamic_cafile_content.go:161] "Starting controller" name="client-ca-bundle::/etc/kubernetes/kubelet-ca.crt" Jun 03 01:04:37.401150 ip-10-0-138-55 kubenswrapper[2566]: I0603 01:04:37.401126 2566 reflector.go:430] "Caches populated" logger="kubernetes.io/kube-apiserver-client-kubelet" type="*v1.CertificateSigningRequest" reflector="k8s.io/client-go/tools/watch/informerwatcher.go:162" Jun 03 01:04:37.405060 ip-10-0-138-55 kubenswrapper[2566]: I0603 01:04:37.405044 2566 log.go:25] "Validated CRI v1 runtime API" Jun 03 01:04:37.413116 ip-10-0-138-55 kubenswrapper[2566]: I0603 01:04:37.413096 2566 csr.go:274] "Certificate signing request is approved, waiting to be issued" logger="kubernetes.io/kube-apiserver-client-kubelet" csr="csr-wv8lc" Jun 03 01:04:37.414415 ip-10-0-138-55 kubenswrapper[2566]: I0603 01:04:37.414404 2566 log.go:25] "Validated CRI v1 image API" Jun 03 01:04:37.415978 ip-10-0-138-55 kubenswrapper[2566]: I0603 01:04:37.415964 2566 server.go:1452] "Using cgroup driver setting received from the CRI runtime" cgroupDriver="systemd" Jun 03 01:04:37.420263 ip-10-0-138-55 kubenswrapper[2566]: I0603 01:04:37.420245 2566 fs.go:135] Filesystem UUIDs: map[1221ab1e-f4f5-4299-ac5a-33d295094ba6:/dev/nvme0n1p3 7B77-95E7:/dev/nvme0n1p2 9a599156-63c1-4a4d-972a-e26063cf4834:/dev/nvme0n1p4] Jun 03 01:04:37.420309 ip-10-0-138-55 kubenswrapper[2566]: I0603 01:04:37.420263 2566 fs.go:136] Filesystem partitions: map[/dev/nvme0n1p3:{mountpoint:/boot major:259 minor:3 fsType:ext4 blockSize:0} /dev/nvme0n1p4:{mountpoint:/var major:259 minor:4 fsType:xfs blockSize:0} /dev/shm:{mountpoint:/dev/shm major:0 minor:22 fsType:tmpfs blockSize:0} /run:{mountpoint:/run major:0 minor:24 fsType:tmpfs blockSize:0} /tmp:{mountpoint:/tmp major:0 minor:31 fsType:tmpfs blockSize:0} composefs_0-33:{mountpoint:/ major:0 minor:33 fsType:overlay blockSize:0}] Jun 03 01:04:37.420942 ip-10-0-138-55 kubenswrapper[2566]: I0603 01:04:37.420929 2566 csr.go:270] "Certificate signing request is issued" logger="kubernetes.io/kube-apiserver-client-kubelet" csr="csr-wv8lc" Jun 03 01:04:37.424690 ip-10-0-138-55 kubenswrapper[2566]: I0603 01:04:37.424583 2566 manager.go:217] Machine: {Timestamp:2026-06-03 01:04:37.424052896 +0000 UTC m=+0.570894833 CPUVendorID:GenuineIntel NumCores:8 NumPhysicalCores:4 NumSockets:1 CpuFrequency:3098826 MemoryCapacity:33164492800 SwapCapacity:0 MemoryByType:map[] NVMInfo:{MemoryModeCapacity:0 AppDirectModeCapacity:0 AvgPowerBudget:0} HugePages:[{PageSize:1048576 NumPages:0} {PageSize:2048 NumPages:0}] MachineID:ec210a49cec23ed1843766c5f5858d3e SystemUUID:ec210a49-cec2-3ed1-8437-66c5f5858d3e BootID:e6df8328-b08d-4c18-9c4f-ed578556cb14 Filesystems:[{Device:/dev/nvme0n1p4 DeviceMajor:259 DeviceMinor:4 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:composefs_0-33 DeviceMajor:0 DeviceMinor:33 Capacity:6103040 Type:vfs Inodes:18446744073709551615 HasInodes:true} {Device:/tmp DeviceMajor:0 DeviceMinor:31 Capacity:16582246400 Type:vfs Inodes:1048576 HasInodes:true} {Device:/dev/nvme0n1p3 DeviceMajor:259 DeviceMinor:3 Capacity:366869504 Type:vfs Inodes:98304 HasInodes:true} {Device:/dev/shm DeviceMajor:0 DeviceMinor:22 Capacity:16582246400 Type:vfs Inodes:4048400 HasInodes:true} {Device:/run DeviceMajor:0 DeviceMinor:24 Capacity:6632898560 Type:vfs Inodes:819200 HasInodes:true}] DiskMap:map[259:0:{Name:nvme0n1 Major:259 Minor:0 Size:128849018880 Scheduler:none}] NetworkDevices:[{Name:br-ex MacAddress:02:ba:8c:7f:48:03 Speed:0 Mtu:9001} {Name:ens5 MacAddress:02:ba:8c:7f:48:03 Speed:0 Mtu:9001} {Name:ovs-system MacAddress:82:ab:4f:51:8b:ba Speed:0 Mtu:1500}] Topology:[{Id:0 Memory:33164492800 HugePages:[{PageSize:1048576 NumPages:0} {PageSize:2048 NumPages:0}] Cores:[{Id:0 Threads:[0 4] Caches:[{Id:0 Size:32768 Type:Data Level:1} {Id:0 Size:32768 Type:Instruction Level:1} {Id:0 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:1 Threads:[1 5] Caches:[{Id:1 Size:32768 Type:Data Level:1} {Id:1 Size:32768 Type:Instruction Level:1} {Id:1 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:2 Threads:[2 6] Caches:[{Id:2 Size:32768 Type:Data Level:1} {Id:2 Size:32768 Type:Instruction Level:1} {Id:2 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:3 Threads:[3 7] Caches:[{Id:3 Size:32768 Type:Data Level:1} {Id:3 Size:32768 Type:Instruction Level:1} {Id:3 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:}] Caches:[{Id:0 Size:37486592 Type:Unified Level:3}] Distances:[10]}] CloudProvider:Unknown InstanceType:Unknown InstanceID:None} Jun 03 01:04:37.425478 ip-10-0-138-55 kubenswrapper[2566]: I0603 01:04:37.425467 2566 manager_no_libpfm.go:29] cAdvisor is build without cgo and/or libpfm support. Perf event counters are not available. Jun 03 01:04:37.425576 ip-10-0-138-55 kubenswrapper[2566]: I0603 01:04:37.425557 2566 manager.go:233] Version: {KernelVersion:5.14.0-570.117.1.el9_6.x86_64 ContainerOsVersion:Red Hat Enterprise Linux CoreOS 9.6.20260521-1 (Plow) DockerVersion: DockerAPIVersion: CadvisorVersion: CadvisorRevision:} Jun 03 01:04:37.428417 ip-10-0-138-55 kubenswrapper[2566]: I0603 01:04:37.428393 2566 container_manager_linux.go:270] "Container manager verified user specified cgroup-root exists" cgroupRoot=[] Jun 03 01:04:37.428553 ip-10-0-138-55 kubenswrapper[2566]: I0603 01:04:37.428420 2566 container_manager_linux.go:275] "Creating Container Manager object based on Node Config" nodeConfig={"NodeName":"ip-10-0-138-55.ec2.internal","RuntimeCgroupsName":"/system.slice/crio.service","SystemCgroupsName":"/system.slice","KubeletCgroupsName":"","KubeletOOMScoreAdj":-999,"ContainerRuntime":"","CgroupsPerQOS":true,"CgroupRoot":"/","CgroupDriver":"systemd","KubeletRootDir":"/var/lib/kubelet","ProtectKernelDefaults":true,"KubeReservedCgroupName":"","SystemReservedCgroupName":"","ReservedSystemCPUs":{},"EnforceNodeAllocatable":{"pods":{}},"KubeReserved":null,"SystemReserved":{"cpu":"500m","ephemeral-storage":"1Gi","memory":"1Gi"},"HardEvictionThresholds":[{"Signal":"nodefs.available","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.1},"GracePeriod":0,"MinReclaim":null},{"Signal":"nodefs.inodesFree","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.05},"GracePeriod":0,"MinReclaim":null},{"Signal":"imagefs.available","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.15},"GracePeriod":0,"MinReclaim":null},{"Signal":"imagefs.inodesFree","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.05},"GracePeriod":0,"MinReclaim":null},{"Signal":"memory.available","Operator":"LessThan","Value":{"Quantity":"100Mi","Percentage":0},"GracePeriod":0,"MinReclaim":null}],"QOSReserved":{},"CPUManagerPolicy":"none","CPUManagerPolicyOptions":null,"TopologyManagerScope":"container","CPUManagerReconcilePeriod":10000000000,"MemoryManagerPolicy":"None","MemoryManagerReservedMemory":null,"PodPidsLimit":4096,"EnforceCPULimits":true,"CPUCFSQuotaPeriod":100000000,"TopologyManagerPolicy":"none","TopologyManagerPolicyOptions":null,"CgroupVersion":2} Jun 03 01:04:37.428596 ip-10-0-138-55 kubenswrapper[2566]: I0603 01:04:37.428559 2566 topology_manager.go:138] "Creating topology manager with none policy" Jun 03 01:04:37.428596 ip-10-0-138-55 kubenswrapper[2566]: I0603 01:04:37.428568 2566 container_manager_linux.go:306] "Creating device plugin manager" Jun 03 01:04:37.429507 ip-10-0-138-55 kubenswrapper[2566]: I0603 01:04:37.429496 2566 manager.go:141] "Creating Device Plugin manager" path="/var/lib/kubelet/device-plugins/kubelet.sock" Jun 03 01:04:37.430780 ip-10-0-138-55 kubenswrapper[2566]: I0603 01:04:37.430770 2566 server.go:72] "Creating device plugin registration server" version="v1beta1" socket="/var/lib/kubelet/device-plugins/kubelet.sock" Jun 03 01:04:37.433091 ip-10-0-138-55 kubenswrapper[2566]: I0603 01:04:37.433079 2566 state_mem.go:36] "Initialized new in-memory state store" Jun 03 01:04:37.433196 ip-10-0-138-55 kubenswrapper[2566]: I0603 01:04:37.433187 2566 server.go:1267] "Using root directory" path="/var/lib/kubelet" Jun 03 01:04:37.437421 ip-10-0-138-55 kubenswrapper[2566]: I0603 01:04:37.437410 2566 kubelet.go:491] "Attempting to sync node with API server" Jun 03 01:04:37.437460 ip-10-0-138-55 kubenswrapper[2566]: I0603 01:04:37.437425 2566 kubelet.go:386] "Adding static pod path" path="/etc/kubernetes/manifests" Jun 03 01:04:37.437460 ip-10-0-138-55 kubenswrapper[2566]: I0603 01:04:37.437438 2566 file.go:69] "Watching path" path="/etc/kubernetes/manifests" Jun 03 01:04:37.437460 ip-10-0-138-55 kubenswrapper[2566]: I0603 01:04:37.437447 2566 kubelet.go:397] "Adding apiserver pod source" Jun 03 01:04:37.437460 ip-10-0-138-55 kubenswrapper[2566]: I0603 01:04:37.437457 2566 apiserver.go:42] "Waiting for node sync before watching apiserver pods" Jun 03 01:04:37.439074 ip-10-0-138-55 kubenswrapper[2566]: I0603 01:04:37.439052 2566 state_mem.go:40] "Initialized new in-memory state store for pod resource information tracking" Jun 03 01:04:37.439074 ip-10-0-138-55 kubenswrapper[2566]: I0603 01:04:37.439072 2566 state_mem.go:40] "Initialized new in-memory state store for pod resource information tracking" Jun 03 01:04:37.443969 ip-10-0-138-55 kubenswrapper[2566]: I0603 01:04:37.443950 2566 kuberuntime_manager.go:279] "Container runtime initialized" containerRuntime="cri-o" version="1.33.12-3.rhaos4.20.git64c6a00.el9" apiVersion="v1" Jun 03 01:04:37.446858 ip-10-0-138-55 kubenswrapper[2566]: I0603 01:04:37.446843 2566 kubelet.go:953] "Not starting ClusterTrustBundle informer because we are in static kubelet mode or the ClusterTrustBundleProjection featuregate is disabled" Jun 03 01:04:37.449938 ip-10-0-138-55 kubenswrapper[2566]: I0603 01:04:37.449923 2566 plugins.go:616] "Loaded volume plugin" pluginName="kubernetes.io/portworx-volume" Jun 03 01:04:37.450015 ip-10-0-138-55 kubenswrapper[2566]: I0603 01:04:37.449943 2566 plugins.go:616] "Loaded volume plugin" pluginName="kubernetes.io/empty-dir" Jun 03 01:04:37.450015 ip-10-0-138-55 kubenswrapper[2566]: I0603 01:04:37.449949 2566 plugins.go:616] "Loaded volume plugin" pluginName="kubernetes.io/git-repo" Jun 03 01:04:37.450015 ip-10-0-138-55 kubenswrapper[2566]: I0603 01:04:37.449955 2566 plugins.go:616] "Loaded volume plugin" pluginName="kubernetes.io/host-path" Jun 03 01:04:37.450015 ip-10-0-138-55 kubenswrapper[2566]: I0603 01:04:37.449965 2566 plugins.go:616] "Loaded volume plugin" pluginName="kubernetes.io/nfs" Jun 03 01:04:37.450015 ip-10-0-138-55 kubenswrapper[2566]: I0603 01:04:37.449973 2566 plugins.go:616] "Loaded volume plugin" pluginName="kubernetes.io/secret" Jun 03 01:04:37.450015 ip-10-0-138-55 kubenswrapper[2566]: I0603 01:04:37.449983 2566 plugins.go:616] "Loaded volume plugin" pluginName="kubernetes.io/iscsi" Jun 03 01:04:37.450015 ip-10-0-138-55 kubenswrapper[2566]: I0603 01:04:37.449989 2566 plugins.go:616] "Loaded volume plugin" pluginName="kubernetes.io/downward-api" Jun 03 01:04:37.450015 ip-10-0-138-55 kubenswrapper[2566]: I0603 01:04:37.449997 2566 plugins.go:616] "Loaded volume plugin" pluginName="kubernetes.io/fc" Jun 03 01:04:37.450015 ip-10-0-138-55 kubenswrapper[2566]: I0603 01:04:37.450003 2566 plugins.go:616] "Loaded volume plugin" pluginName="kubernetes.io/configmap" Jun 03 01:04:37.450015 ip-10-0-138-55 kubenswrapper[2566]: I0603 01:04:37.450016 2566 plugins.go:616] "Loaded volume plugin" pluginName="kubernetes.io/projected" Jun 03 01:04:37.450352 ip-10-0-138-55 kubenswrapper[2566]: I0603 01:04:37.450023 2566 plugins.go:616] "Loaded volume plugin" pluginName="kubernetes.io/local-volume" Jun 03 01:04:37.450729 ip-10-0-138-55 kubenswrapper[2566]: I0603 01:04:37.450716 2566 reflector.go:430] "Caches populated" type="*v1.Node" reflector="k8s.io/client-go/informers/factory.go:160" Jun 03 01:04:37.452742 ip-10-0-138-55 kubenswrapper[2566]: I0603 01:04:37.452729 2566 plugins.go:616] "Loaded volume plugin" pluginName="kubernetes.io/csi" Jun 03 01:04:37.452791 ip-10-0-138-55 kubenswrapper[2566]: I0603 01:04:37.452748 2566 plugins.go:616] "Loaded volume plugin" pluginName="kubernetes.io/image" Jun 03 01:04:37.453907 ip-10-0-138-55 kubenswrapper[2566]: I0603 01:04:37.453893 2566 reflector.go:430] "Caches populated" type="*v1.Service" reflector="k8s.io/client-go/informers/factory.go:160" Jun 03 01:04:37.455898 ip-10-0-138-55 kubenswrapper[2566]: I0603 01:04:37.455885 2566 watchdog_linux.go:99] "Systemd watchdog is not enabled" Jun 03 01:04:37.455943 ip-10-0-138-55 kubenswrapper[2566]: I0603 01:04:37.455923 2566 server.go:1295] "Started kubelet" Jun 03 01:04:37.456868 ip-10-0-138-55 systemd[1]: Started Kubernetes Kubelet. Jun 03 01:04:37.457488 ip-10-0-138-55 kubenswrapper[2566]: I0603 01:04:37.457467 2566 server.go:180] "Starting to listen" address="0.0.0.0" port=10250 Jun 03 01:04:37.457558 ip-10-0-138-55 kubenswrapper[2566]: I0603 01:04:37.457472 2566 ratelimit.go:55] "Setting rate limiting for endpoint" service="podresources" qps=100 burstTokens=10 Jun 03 01:04:37.457558 ip-10-0-138-55 kubenswrapper[2566]: I0603 01:04:37.457526 2566 server_v1.go:47] "podresources" method="list" useActivePods=true Jun 03 01:04:37.465121 ip-10-0-138-55 kubenswrapper[2566]: I0603 01:04:37.465100 2566 nodeinfomanager.go:417] Failed to publish CSINode: nodes "ip-10-0-138-55.ec2.internal" not found Jun 03 01:04:37.465708 ip-10-0-138-55 kubenswrapper[2566]: I0603 01:04:37.465693 2566 server.go:255] "Starting to serve the podresources API" endpoint="unix:/var/lib/kubelet/pod-resources/kubelet.sock" Jun 03 01:04:37.466147 ip-10-0-138-55 kubenswrapper[2566]: I0603 01:04:37.466126 2566 server.go:317] "Adding debug handlers to kubelet server" Jun 03 01:04:37.480499 ip-10-0-138-55 kubenswrapper[2566]: I0603 01:04:37.480482 2566 nodeinfomanager.go:417] Failed to publish CSINode: nodes "ip-10-0-138-55.ec2.internal" not found Jun 03 01:04:37.480626 ip-10-0-138-55 kubenswrapper[2566]: E0603 01:04:37.480607 2566 kubelet.go:1618] "Image garbage collection failed once. Stats initialization may not have completed yet" err="failed to get imageFs info: unable to find data in memory cache" Jun 03 01:04:37.480789 ip-10-0-138-55 kubenswrapper[2566]: I0603 01:04:37.480775 2566 certificate_manager.go:422] "Certificate rotation is enabled" logger="kubernetes.io/kubelet-serving" Jun 03 01:04:37.481908 ip-10-0-138-55 kubenswrapper[2566]: I0603 01:04:37.481892 2566 fs_resource_analyzer.go:67] "Starting FS ResourceAnalyzer" Jun 03 01:04:37.482036 ip-10-0-138-55 kubenswrapper[2566]: I0603 01:04:37.482021 2566 volume_manager.go:295] "The desired_state_of_world populator starts" Jun 03 01:04:37.482096 ip-10-0-138-55 kubenswrapper[2566]: I0603 01:04:37.482038 2566 volume_manager.go:297] "Starting Kubelet Volume Manager" Jun 03 01:04:37.482153 ip-10-0-138-55 kubenswrapper[2566]: I0603 01:04:37.482116 2566 desired_state_of_world_populator.go:150] "Desired state populator starts to run" Jun 03 01:04:37.482209 ip-10-0-138-55 kubenswrapper[2566]: I0603 01:04:37.482184 2566 reconstruct.go:97] "Volume reconstruction finished" Jun 03 01:04:37.482209 ip-10-0-138-55 kubenswrapper[2566]: I0603 01:04:37.482193 2566 reconciler.go:26] "Reconciler: start to sync state" Jun 03 01:04:37.482576 ip-10-0-138-55 kubenswrapper[2566]: I0603 01:04:37.482558 2566 factory.go:55] Registering systemd factory Jun 03 01:04:37.482576 ip-10-0-138-55 kubenswrapper[2566]: I0603 01:04:37.482578 2566 factory.go:223] Registration of the systemd container factory successfully Jun 03 01:04:37.482786 ip-10-0-138-55 kubenswrapper[2566]: I0603 01:04:37.482775 2566 factory.go:153] Registering CRI-O factory Jun 03 01:04:37.482786 ip-10-0-138-55 kubenswrapper[2566]: I0603 01:04:37.482788 2566 factory.go:223] Registration of the crio container factory successfully Jun 03 01:04:37.482876 ip-10-0-138-55 kubenswrapper[2566]: I0603 01:04:37.482832 2566 factory.go:221] Registration of the containerd container factory failed: unable to create containerd client: containerd: cannot unix dial containerd api service: dial unix /run/containerd/containerd.sock: connect: no such file or directory Jun 03 01:04:37.482876 ip-10-0-138-55 kubenswrapper[2566]: I0603 01:04:37.482850 2566 factory.go:103] Registering Raw factory Jun 03 01:04:37.482876 ip-10-0-138-55 kubenswrapper[2566]: I0603 01:04:37.482864 2566 manager.go:1196] Started watching for new ooms in manager Jun 03 01:04:37.483078 ip-10-0-138-55 kubenswrapper[2566]: E0603 01:04:37.483055 2566 kubelet_node_status.go:515] "Error getting the current node from lister" err="node \"ip-10-0-138-55.ec2.internal\" not found" Jun 03 01:04:37.483198 ip-10-0-138-55 kubenswrapper[2566]: I0603 01:04:37.483187 2566 manager.go:319] Starting recovery of all containers Jun 03 01:04:37.485084 ip-10-0-138-55 kubenswrapper[2566]: I0603 01:04:37.485062 2566 reflector.go:430] "Caches populated" type="*v1.CSIDriver" reflector="k8s.io/client-go/informers/factory.go:160" Jun 03 01:04:37.489351 ip-10-0-138-55 kubenswrapper[2566]: E0603 01:04:37.489165 2566 nodelease.go:49] "Failed to get node when trying to set owner ref to the node lease" err="nodes \"ip-10-0-138-55.ec2.internal\" not found" node="ip-10-0-138-55.ec2.internal" Jun 03 01:04:37.490027 ip-10-0-138-55 kubenswrapper[2566]: I0603 01:04:37.489987 2566 kubelet_network_linux.go:49] "Initialized iptables rules." protocol="IPv6" Jun 03 01:04:37.492680 ip-10-0-138-55 kubenswrapper[2566]: I0603 01:04:37.492661 2566 manager.go:324] Recovery completed Jun 03 01:04:37.497516 ip-10-0-138-55 kubenswrapper[2566]: I0603 01:04:37.497501 2566 kubelet_node_status.go:413] "Setting node annotation to enable volume controller attach/detach" Jun 03 01:04:37.499466 ip-10-0-138-55 kubenswrapper[2566]: I0603 01:04:37.499452 2566 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-138-55.ec2.internal" event="NodeHasSufficientMemory" Jun 03 01:04:37.499580 ip-10-0-138-55 kubenswrapper[2566]: I0603 01:04:37.499478 2566 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-138-55.ec2.internal" event="NodeHasNoDiskPressure" Jun 03 01:04:37.499580 ip-10-0-138-55 kubenswrapper[2566]: I0603 01:04:37.499490 2566 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-138-55.ec2.internal" event="NodeHasSufficientPID" Jun 03 01:04:37.499974 ip-10-0-138-55 kubenswrapper[2566]: I0603 01:04:37.499961 2566 cpu_manager.go:222] "Starting CPU manager" policy="none" Jun 03 01:04:37.499974 ip-10-0-138-55 kubenswrapper[2566]: I0603 01:04:37.499972 2566 cpu_manager.go:223] "Reconciling" reconcilePeriod="10s" Jun 03 01:04:37.500046 ip-10-0-138-55 kubenswrapper[2566]: I0603 01:04:37.499990 2566 state_mem.go:36] "Initialized new in-memory state store" Jun 03 01:04:37.502332 ip-10-0-138-55 kubenswrapper[2566]: I0603 01:04:37.502321 2566 policy_none.go:49] "None policy: Start" Jun 03 01:04:37.502369 ip-10-0-138-55 kubenswrapper[2566]: I0603 01:04:37.502337 2566 memory_manager.go:186] "Starting memorymanager" policy="None" Jun 03 01:04:37.502369 ip-10-0-138-55 kubenswrapper[2566]: I0603 01:04:37.502347 2566 state_mem.go:35] "Initializing new in-memory state store" Jun 03 01:04:37.538866 ip-10-0-138-55 kubenswrapper[2566]: I0603 01:04:37.538844 2566 manager.go:341] "Starting Device Plugin manager" Jun 03 01:04:37.551782 ip-10-0-138-55 kubenswrapper[2566]: E0603 01:04:37.538874 2566 manager.go:517] "Failed to read data from checkpoint" err="checkpoint is not found" checkpoint="kubelet_internal_checkpoint" Jun 03 01:04:37.551782 ip-10-0-138-55 kubenswrapper[2566]: I0603 01:04:37.538883 2566 server.go:85] "Starting device plugin registration server" Jun 03 01:04:37.551782 ip-10-0-138-55 kubenswrapper[2566]: I0603 01:04:37.539131 2566 eviction_manager.go:189] "Eviction manager: starting control loop" Jun 03 01:04:37.551782 ip-10-0-138-55 kubenswrapper[2566]: I0603 01:04:37.539143 2566 container_log_manager.go:189] "Initializing container log rotate workers" workers=1 monitorPeriod="10s" Jun 03 01:04:37.551782 ip-10-0-138-55 kubenswrapper[2566]: I0603 01:04:37.539251 2566 plugin_watcher.go:51] "Plugin Watcher Start" path="/var/lib/kubelet/plugins_registry" Jun 03 01:04:37.551782 ip-10-0-138-55 kubenswrapper[2566]: I0603 01:04:37.539316 2566 plugin_manager.go:116] "The desired_state_of_world populator (plugin watcher) starts" Jun 03 01:04:37.551782 ip-10-0-138-55 kubenswrapper[2566]: I0603 01:04:37.539324 2566 plugin_manager.go:118] "Starting Kubelet Plugin Manager" Jun 03 01:04:37.551782 ip-10-0-138-55 kubenswrapper[2566]: E0603 01:04:37.539854 2566 eviction_manager.go:267] "eviction manager: failed to check if we have separate container filesystem. Ignoring." err="non-existent label \"crio-containers\"" Jun 03 01:04:37.551782 ip-10-0-138-55 kubenswrapper[2566]: E0603 01:04:37.539894 2566 eviction_manager.go:292] "Eviction manager: failed to get summary stats" err="failed to get node info: node \"ip-10-0-138-55.ec2.internal\" not found" Jun 03 01:04:37.551782 ip-10-0-138-55 kubenswrapper[2566]: I0603 01:04:37.540919 2566 nodeinfomanager.go:417] Failed to publish CSINode: nodes "ip-10-0-138-55.ec2.internal" not found Jun 03 01:04:37.585024 ip-10-0-138-55 kubenswrapper[2566]: I0603 01:04:37.584980 2566 kubelet_network_linux.go:49] "Initialized iptables rules." protocol="IPv4" Jun 03 01:04:37.585024 ip-10-0-138-55 kubenswrapper[2566]: I0603 01:04:37.585003 2566 status_manager.go:230] "Starting to sync pod status with apiserver" Jun 03 01:04:37.585024 ip-10-0-138-55 kubenswrapper[2566]: I0603 01:04:37.585017 2566 watchdog_linux.go:127] "Systemd watchdog is not enabled or the interval is invalid, so health checking will not be started." Jun 03 01:04:37.585024 ip-10-0-138-55 kubenswrapper[2566]: I0603 01:04:37.585024 2566 kubelet.go:2451] "Starting kubelet main sync loop" Jun 03 01:04:37.585185 ip-10-0-138-55 kubenswrapper[2566]: E0603 01:04:37.585066 2566 kubelet.go:2475] "Skipping pod synchronization" err="PLEG is not healthy: pleg has yet to be successful" Jun 03 01:04:37.587936 ip-10-0-138-55 kubenswrapper[2566]: I0603 01:04:37.587920 2566 reflector.go:430] "Caches populated" type="*v1.RuntimeClass" reflector="k8s.io/client-go/informers/factory.go:160" Jun 03 01:04:37.640153 ip-10-0-138-55 kubenswrapper[2566]: I0603 01:04:37.640127 2566 kubelet_node_status.go:413] "Setting node annotation to enable volume controller attach/detach" Jun 03 01:04:37.640888 ip-10-0-138-55 kubenswrapper[2566]: I0603 01:04:37.640871 2566 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-138-55.ec2.internal" event="NodeHasSufficientMemory" Jun 03 01:04:37.640951 ip-10-0-138-55 kubenswrapper[2566]: I0603 01:04:37.640904 2566 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-138-55.ec2.internal" event="NodeHasNoDiskPressure" Jun 03 01:04:37.640951 ip-10-0-138-55 kubenswrapper[2566]: I0603 01:04:37.640914 2566 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-138-55.ec2.internal" event="NodeHasSufficientPID" Jun 03 01:04:37.640951 ip-10-0-138-55 kubenswrapper[2566]: I0603 01:04:37.640936 2566 kubelet_node_status.go:78] "Attempting to register node" node="ip-10-0-138-55.ec2.internal" Jun 03 01:04:37.649783 ip-10-0-138-55 kubenswrapper[2566]: I0603 01:04:37.649767 2566 kubelet_node_status.go:81] "Successfully registered node" node="ip-10-0-138-55.ec2.internal" Jun 03 01:04:37.649828 ip-10-0-138-55 kubenswrapper[2566]: E0603 01:04:37.649789 2566 kubelet_node_status.go:597] "Error updating node status, will retry" err="error getting node \"ip-10-0-138-55.ec2.internal\": node \"ip-10-0-138-55.ec2.internal\" not found" Jun 03 01:04:37.685881 ip-10-0-138-55 kubenswrapper[2566]: I0603 01:04:37.685844 2566 kubelet.go:2537] "SyncLoop ADD" source="file" pods=["openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-138-55.ec2.internal","kube-system/kube-apiserver-proxy-ip-10-0-138-55.ec2.internal"] Jun 03 01:04:37.688593 ip-10-0-138-55 kubenswrapper[2566]: I0603 01:04:37.688573 2566 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/kube-apiserver-proxy-ip-10-0-138-55.ec2.internal" Jun 03 01:04:37.688593 ip-10-0-138-55 kubenswrapper[2566]: I0603 01:04:37.688589 2566 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-138-55.ec2.internal" Jun 03 01:04:37.715756 ip-10-0-138-55 kubenswrapper[2566]: I0603 01:04:37.715739 2566 kubelet.go:3340] "Creating a mirror pod for static pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-138-55.ec2.internal" Jun 03 01:04:37.719625 ip-10-0-138-55 kubenswrapper[2566]: I0603 01:04:37.719612 2566 kubelet.go:3340] "Creating a mirror pod for static pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-138-55.ec2.internal" Jun 03 01:04:37.729904 ip-10-0-138-55 kubenswrapper[2566]: I0603 01:04:37.729887 2566 warnings.go:110] "Warning: metadata.name: this is used in the Pod's hostname, which can result in surprising behavior; a DNS label is recommended: [must not contain dots]" Jun 03 01:04:37.729988 ip-10-0-138-55 kubenswrapper[2566]: I0603 01:04:37.729961 2566 warnings.go:110] "Warning: metadata.name: this is used in the Pod's hostname, which can result in surprising behavior; a DNS label is recommended: [must not contain dots]" Jun 03 01:04:37.883522 ip-10-0-138-55 kubenswrapper[2566]: I0603 01:04:37.883496 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/09ebc096af5f7e7ecd11668f36b3a990-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-138-55.ec2.internal\" (UID: \"09ebc096af5f7e7ecd11668f36b3a990\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-138-55.ec2.internal" Jun 03 01:04:37.883662 ip-10-0-138-55 kubenswrapper[2566]: I0603 01:04:37.883529 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/09ebc096af5f7e7ecd11668f36b3a990-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-138-55.ec2.internal\" (UID: \"09ebc096af5f7e7ecd11668f36b3a990\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-138-55.ec2.internal" Jun 03 01:04:37.883662 ip-10-0-138-55 kubenswrapper[2566]: I0603 01:04:37.883557 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/host-path/441c506c4adc726a5846cc275e644767-config\") pod \"kube-apiserver-proxy-ip-10-0-138-55.ec2.internal\" (UID: \"441c506c4adc726a5846cc275e644767\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-138-55.ec2.internal" Jun 03 01:04:37.983849 ip-10-0-138-55 kubenswrapper[2566]: I0603 01:04:37.983824 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/host-path/441c506c4adc726a5846cc275e644767-config\") pod \"kube-apiserver-proxy-ip-10-0-138-55.ec2.internal\" (UID: \"441c506c4adc726a5846cc275e644767\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-138-55.ec2.internal" Jun 03 01:04:37.983968 ip-10-0-138-55 kubenswrapper[2566]: I0603 01:04:37.983770 2566 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/host-path/441c506c4adc726a5846cc275e644767-config\") pod \"kube-apiserver-proxy-ip-10-0-138-55.ec2.internal\" (UID: \"441c506c4adc726a5846cc275e644767\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-138-55.ec2.internal" Jun 03 01:04:37.983968 ip-10-0-138-55 kubenswrapper[2566]: I0603 01:04:37.983882 2566 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/09ebc096af5f7e7ecd11668f36b3a990-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-138-55.ec2.internal\" (UID: \"09ebc096af5f7e7ecd11668f36b3a990\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-138-55.ec2.internal" Jun 03 01:04:37.983968 ip-10-0-138-55 kubenswrapper[2566]: I0603 01:04:37.983899 2566 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/09ebc096af5f7e7ecd11668f36b3a990-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-138-55.ec2.internal\" (UID: \"09ebc096af5f7e7ecd11668f36b3a990\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-138-55.ec2.internal" Jun 03 01:04:37.983968 ip-10-0-138-55 kubenswrapper[2566]: I0603 01:04:37.983927 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/09ebc096af5f7e7ecd11668f36b3a990-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-138-55.ec2.internal\" (UID: \"09ebc096af5f7e7ecd11668f36b3a990\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-138-55.ec2.internal" Jun 03 01:04:37.983968 ip-10-0-138-55 kubenswrapper[2566]: I0603 01:04:37.983945 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/09ebc096af5f7e7ecd11668f36b3a990-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-138-55.ec2.internal\" (UID: \"09ebc096af5f7e7ecd11668f36b3a990\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-138-55.ec2.internal" Jun 03 01:04:38.033971 ip-10-0-138-55 kubenswrapper[2566]: I0603 01:04:38.033941 2566 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/kube-apiserver-proxy-ip-10-0-138-55.ec2.internal" Jun 03 01:04:38.034073 ip-10-0-138-55 kubenswrapper[2566]: I0603 01:04:38.034058 2566 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-138-55.ec2.internal" Jun 03 01:04:38.335165 ip-10-0-138-55 kubenswrapper[2566]: I0603 01:04:38.335078 2566 transport.go:147] "Certificate rotation detected, shutting down client connections to start using new credentials" Jun 03 01:04:38.335811 ip-10-0-138-55 kubenswrapper[2566]: I0603 01:04:38.335288 2566 reflector.go:556] "Warning: watch ended with error" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Service" err="very short watch: k8s.io/client-go/informers/factory.go:160: Unexpected watch close - watch lasted less than a second and no items received" Jun 03 01:04:38.335811 ip-10-0-138-55 kubenswrapper[2566]: I0603 01:04:38.335296 2566 reflector.go:556] "Warning: watch ended with error" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.CSIDriver" err="very short watch: k8s.io/client-go/informers/factory.go:160: Unexpected watch close - watch lasted less than a second and no items received" Jun 03 01:04:38.335811 ip-10-0-138-55 kubenswrapper[2566]: I0603 01:04:38.335288 2566 reflector.go:556] "Warning: watch ended with error" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.RuntimeClass" err="very short watch: k8s.io/client-go/informers/factory.go:160: Unexpected watch close - watch lasted less than a second and no items received" Jun 03 01:04:38.423980 ip-10-0-138-55 kubenswrapper[2566]: I0603 01:04:38.423932 2566 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kube-apiserver-client-kubelet" expiration="2028-06-02 00:59:37 +0000 UTC" deadline="2027-12-04 21:22:41.950168134 +0000 UTC" Jun 03 01:04:38.423980 ip-10-0-138-55 kubenswrapper[2566]: I0603 01:04:38.423976 2566 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kube-apiserver-client-kubelet" sleep="13196h18m3.526195559s" Jun 03 01:04:38.438081 ip-10-0-138-55 kubenswrapper[2566]: I0603 01:04:38.438057 2566 apiserver.go:52] "Watching apiserver" Jun 03 01:04:38.442862 ip-10-0-138-55 kubenswrapper[2566]: I0603 01:04:38.442844 2566 reflector.go:430] "Caches populated" type="*v1.Pod" reflector="pkg/kubelet/config/apiserver.go:66" Jun 03 01:04:38.443196 ip-10-0-138-55 kubenswrapper[2566]: I0603 01:04:38.443174 2566 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["kube-system/kube-apiserver-proxy-ip-10-0-138-55.ec2.internal","openshift-dns/node-resolver-ztzkx","openshift-image-registry/node-ca-wl5n2","openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-138-55.ec2.internal","openshift-network-diagnostics/network-check-target-k9zdx","openshift-network-operator/iptables-alerter-46tk7","openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-gvsbt","openshift-cluster-node-tuning-operator/tuned-jj7f8","openshift-multus/multus-additional-cni-plugins-lsx7q","openshift-multus/multus-frg76","openshift-multus/network-metrics-daemon-vzflm","openshift-ovn-kubernetes/ovnkube-node-c2smc","kube-system/konnectivity-agent-fg4j4"] Jun 03 01:04:38.445942 ip-10-0-138-55 kubenswrapper[2566]: I0603 01:04:38.445922 2566 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/node-resolver-ztzkx" Jun 03 01:04:38.447175 ip-10-0-138-55 kubenswrapper[2566]: I0603 01:04:38.447148 2566 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/node-ca-wl5n2" Jun 03 01:04:38.447775 ip-10-0-138-55 kubenswrapper[2566]: I0603 01:04:38.447759 2566 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"openshift-service-ca.crt\"" Jun 03 01:04:38.447856 ip-10-0-138-55 kubenswrapper[2566]: I0603 01:04:38.447812 2566 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"kube-root-ca.crt\"" Jun 03 01:04:38.447892 ip-10-0-138-55 kubenswrapper[2566]: I0603 01:04:38.447855 2566 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"node-resolver-dockercfg-vmh69\"" Jun 03 01:04:38.448219 ip-10-0-138-55 kubenswrapper[2566]: I0603 01:04:38.448206 2566 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-k9zdx" Jun 03 01:04:38.448307 ip-10-0-138-55 kubenswrapper[2566]: I0603 01:04:38.448294 2566 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-operator/iptables-alerter-46tk7" Jun 03 01:04:38.448358 ip-10-0-138-55 kubenswrapper[2566]: E0603 01:04:38.448289 2566 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-k9zdx" podUID="8bb0d88a-f4ad-42ec-b814-3d13ba6e8a3f" Jun 03 01:04:38.449076 ip-10-0-138-55 kubenswrapper[2566]: I0603 01:04:38.449060 2566 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"kube-root-ca.crt\"" Jun 03 01:04:38.449152 ip-10-0-138-55 kubenswrapper[2566]: I0603 01:04:38.449063 2566 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"node-ca-dockercfg-wp548\"" Jun 03 01:04:38.449152 ip-10-0-138-55 kubenswrapper[2566]: I0603 01:04:38.449104 2566 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"image-registry-certificates\"" Jun 03 01:04:38.449152 ip-10-0-138-55 kubenswrapper[2566]: I0603 01:04:38.449064 2566 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"openshift-service-ca.crt\"" Jun 03 01:04:38.449550 ip-10-0-138-55 kubenswrapper[2566]: I0603 01:04:38.449534 2566 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-gvsbt" Jun 03 01:04:38.449992 ip-10-0-138-55 kubenswrapper[2566]: I0603 01:04:38.449973 2566 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"kube-root-ca.crt\"" Jun 03 01:04:38.450075 ip-10-0-138-55 kubenswrapper[2566]: I0603 01:04:38.450037 2566 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-operator\"/\"iptables-alerter-dockercfg-w4rvm\"" Jun 03 01:04:38.450075 ip-10-0-138-55 kubenswrapper[2566]: I0603 01:04:38.450064 2566 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"openshift-service-ca.crt\"" Jun 03 01:04:38.450075 ip-10-0-138-55 kubenswrapper[2566]: I0603 01:04:38.450068 2566 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"iptables-alerter-script\"" Jun 03 01:04:38.450891 ip-10-0-138-55 kubenswrapper[2566]: I0603 01:04:38.450832 2566 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-node-tuning-operator/tuned-jj7f8" Jun 03 01:04:38.451283 ip-10-0-138-55 kubenswrapper[2566]: I0603 01:04:38.451264 2566 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-csi-drivers\"/\"aws-ebs-csi-driver-node-sa-dockercfg-ffp97\"" Jun 03 01:04:38.451388 ip-10-0-138-55 kubenswrapper[2566]: I0603 01:04:38.451293 2566 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-csi-drivers\"/\"aws-ebs-csi-driver-node-metrics-serving-cert\"" Jun 03 01:04:38.451388 ip-10-0-138-55 kubenswrapper[2566]: I0603 01:04:38.451323 2566 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-csi-drivers\"/\"kube-root-ca.crt\"" Jun 03 01:04:38.451388 ip-10-0-138-55 kubenswrapper[2566]: I0603 01:04:38.451270 2566 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-csi-drivers\"/\"openshift-service-ca.crt\"" Jun 03 01:04:38.452832 ip-10-0-138-55 kubenswrapper[2566]: I0603 01:04:38.452409 2566 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-additional-cni-plugins-lsx7q" Jun 03 01:04:38.453419 ip-10-0-138-55 kubenswrapper[2566]: I0603 01:04:38.453399 2566 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"openshift-service-ca.crt\"" Jun 03 01:04:38.453550 ip-10-0-138-55 kubenswrapper[2566]: I0603 01:04:38.453533 2566 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"tuned-dockercfg-vqww4\"" Jun 03 01:04:38.453691 ip-10-0-138-55 kubenswrapper[2566]: I0603 01:04:38.453673 2566 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"kube-root-ca.crt\"" Jun 03 01:04:38.454473 ip-10-0-138-55 kubenswrapper[2566]: I0603 01:04:38.454118 2566 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-frg76" Jun 03 01:04:38.454473 ip-10-0-138-55 kubenswrapper[2566]: I0603 01:04:38.454295 2566 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"default-cni-sysctl-allowlist\"" Jun 03 01:04:38.454710 ip-10-0-138-55 kubenswrapper[2566]: I0603 01:04:38.454693 2566 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"multus-ancillary-tools-dockercfg-22xnx\"" Jun 03 01:04:38.455097 ip-10-0-138-55 kubenswrapper[2566]: I0603 01:04:38.455081 2566 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"openshift-service-ca.crt\"" Jun 03 01:04:38.455278 ip-10-0-138-55 kubenswrapper[2566]: I0603 01:04:38.455188 2566 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"cni-copy-resources\"" Jun 03 01:04:38.455528 ip-10-0-138-55 kubenswrapper[2566]: I0603 01:04:38.455510 2566 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-vzflm" Jun 03 01:04:38.455822 ip-10-0-138-55 kubenswrapper[2566]: I0603 01:04:38.455806 2566 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"whereabouts-flatfile-config\"" Jun 03 01:04:38.455892 ip-10-0-138-55 kubenswrapper[2566]: E0603 01:04:38.455870 2566 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-vzflm" podUID="9b00548d-2314-42e7-ab92-ed1462bba025" Jun 03 01:04:38.455984 ip-10-0-138-55 kubenswrapper[2566]: I0603 01:04:38.455970 2566 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"kube-root-ca.crt\"" Jun 03 01:04:38.456041 ip-10-0-138-55 kubenswrapper[2566]: I0603 01:04:38.456032 2566 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"multus-daemon-config\"" Jun 03 01:04:38.456154 ip-10-0-138-55 kubenswrapper[2566]: I0603 01:04:38.456128 2566 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"default-dockercfg-rvwl4\"" Jun 03 01:04:38.457201 ip-10-0-138-55 kubenswrapper[2566]: I0603 01:04:38.457184 2566 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ovn-kubernetes/ovnkube-node-c2smc" Jun 03 01:04:38.458406 ip-10-0-138-55 kubenswrapper[2566]: I0603 01:04:38.458390 2566 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/konnectivity-agent-fg4j4" Jun 03 01:04:38.459404 ip-10-0-138-55 kubenswrapper[2566]: I0603 01:04:38.459391 2566 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"env-overrides\"" Jun 03 01:04:38.459823 ip-10-0-138-55 kubenswrapper[2566]: I0603 01:04:38.459808 2566 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ovn-kubernetes\"/\"ovn-node-metrics-cert\"" Jun 03 01:04:38.459902 ip-10-0-138-55 kubenswrapper[2566]: I0603 01:04:38.459861 2566 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"ovnkube-config\"" Jun 03 01:04:38.459961 ip-10-0-138-55 kubenswrapper[2566]: I0603 01:04:38.459914 2566 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"kube-root-ca.crt\"" Jun 03 01:04:38.460016 ip-10-0-138-55 kubenswrapper[2566]: I0603 01:04:38.460004 2566 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"openshift-service-ca.crt\"" Jun 03 01:04:38.460066 ip-10-0-138-55 kubenswrapper[2566]: I0603 01:04:38.460009 2566 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"ovnkube-script-lib\"" Jun 03 01:04:38.460066 ip-10-0-138-55 kubenswrapper[2566]: I0603 01:04:38.460028 2566 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"default-dockercfg-2rhwr\"" Jun 03 01:04:38.460066 ip-10-0-138-55 kubenswrapper[2566]: I0603 01:04:38.460009 2566 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ovn-kubernetes\"/\"ovn-kubernetes-node-dockercfg-q9r74\"" Jun 03 01:04:38.460191 ip-10-0-138-55 kubenswrapper[2566]: I0603 01:04:38.460179 2566 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kube-system\"/\"konnectivity-ca-bundle\"" Jun 03 01:04:38.460286 ip-10-0-138-55 kubenswrapper[2566]: I0603 01:04:38.460269 2566 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"konnectivity-agent\"" Jun 03 01:04:38.481772 ip-10-0-138-55 kubenswrapper[2566]: I0603 01:04:38.481755 2566 certificate_manager.go:566] "Rotating certificates" logger="kubernetes.io/kubelet-serving" Jun 03 01:04:38.482904 ip-10-0-138-55 kubenswrapper[2566]: I0603 01:04:38.482888 2566 desired_state_of_world_populator.go:158] "Finished populating initial desired state of world" Jun 03 01:04:38.485873 ip-10-0-138-55 kubenswrapper[2566]: I0603 01:04:38.485856 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/684e9f6d-abe0-4f60-af14-564c495677cc-agent-certs\") pod \"konnectivity-agent-fg4j4\" (UID: \"684e9f6d-abe0-4f60-af14-564c495677cc\") " pod="kube-system/konnectivity-agent-fg4j4" Jun 03 01:04:38.485950 ip-10-0-138-55 kubenswrapper[2566]: I0603 01:04:38.485887 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/684e9f6d-abe0-4f60-af14-564c495677cc-konnectivity-ca\") pod \"konnectivity-agent-fg4j4\" (UID: \"684e9f6d-abe0-4f60-af14-564c495677cc\") " pod="kube-system/konnectivity-agent-fg4j4" Jun 03 01:04:38.485950 ip-10-0-138-55 kubenswrapper[2566]: I0603 01:04:38.485914 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/a7e6e57f-fea2-40e8-a12b-c39140993cc5-etc-modprobe-d\") pod \"tuned-jj7f8\" (UID: \"a7e6e57f-fea2-40e8-a12b-c39140993cc5\") " pod="openshift-cluster-node-tuning-operator/tuned-jj7f8" Jun 03 01:04:38.486027 ip-10-0-138-55 kubenswrapper[2566]: I0603 01:04:38.485969 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/a7e6e57f-fea2-40e8-a12b-c39140993cc5-etc-tuned\") pod \"tuned-jj7f8\" (UID: \"a7e6e57f-fea2-40e8-a12b-c39140993cc5\") " pod="openshift-cluster-node-tuning-operator/tuned-jj7f8" Jun 03 01:04:38.486027 ip-10-0-138-55 kubenswrapper[2566]: I0603 01:04:38.485994 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/3b24c36b-015d-4776-8999-95b23959ff67-host-run-netns\") pod \"multus-frg76\" (UID: \"3b24c36b-015d-4776-8999-95b23959ff67\") " pod="openshift-multus/multus-frg76" Jun 03 01:04:38.486027 ip-10-0-138-55 kubenswrapper[2566]: I0603 01:04:38.486008 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/38c378b4-8f35-4e5f-8b38-83e4c61f9d9d-log-socket\") pod \"ovnkube-node-c2smc\" (UID: \"38c378b4-8f35-4e5f-8b38-83e4c61f9d9d\") " pod="openshift-ovn-kubernetes/ovnkube-node-c2smc" Jun 03 01:04:38.486144 ip-10-0-138-55 kubenswrapper[2566]: I0603 01:04:38.486057 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/38c378b4-8f35-4e5f-8b38-83e4c61f9d9d-host-cni-bin\") pod \"ovnkube-node-c2smc\" (UID: \"38c378b4-8f35-4e5f-8b38-83e4c61f9d9d\") " pod="openshift-ovn-kubernetes/ovnkube-node-c2smc" Jun 03 01:04:38.486144 ip-10-0-138-55 kubenswrapper[2566]: I0603 01:04:38.486074 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/38c378b4-8f35-4e5f-8b38-83e4c61f9d9d-env-overrides\") pod \"ovnkube-node-c2smc\" (UID: \"38c378b4-8f35-4e5f-8b38-83e4c61f9d9d\") " pod="openshift-ovn-kubernetes/ovnkube-node-c2smc" Jun 03 01:04:38.486144 ip-10-0-138-55 kubenswrapper[2566]: I0603 01:04:38.486089 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-27rgg\" (UniqueName: \"kubernetes.io/projected/38c378b4-8f35-4e5f-8b38-83e4c61f9d9d-kube-api-access-27rgg\") pod \"ovnkube-node-c2smc\" (UID: \"38c378b4-8f35-4e5f-8b38-83e4c61f9d9d\") " pod="openshift-ovn-kubernetes/ovnkube-node-c2smc" Jun 03 01:04:38.486144 ip-10-0-138-55 kubenswrapper[2566]: I0603 01:04:38.486106 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-kjztn\" (UniqueName: \"kubernetes.io/projected/9b00548d-2314-42e7-ab92-ed1462bba025-kube-api-access-kjztn\") pod \"network-metrics-daemon-vzflm\" (UID: \"9b00548d-2314-42e7-ab92-ed1462bba025\") " pod="openshift-multus/network-metrics-daemon-vzflm" Jun 03 01:04:38.486302 ip-10-0-138-55 kubenswrapper[2566]: I0603 01:04:38.486152 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/7a085832-7923-4e02-b929-f85fe37838f3-socket-dir\") pod \"aws-ebs-csi-driver-node-gvsbt\" (UID: \"7a085832-7923-4e02-b929-f85fe37838f3\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-gvsbt" Jun 03 01:04:38.486302 ip-10-0-138-55 kubenswrapper[2566]: I0603 01:04:38.486191 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/20148712-f92b-4521-92b1-e00d0c2571c9-system-cni-dir\") pod \"multus-additional-cni-plugins-lsx7q\" (UID: \"20148712-f92b-4521-92b1-e00d0c2571c9\") " pod="openshift-multus/multus-additional-cni-plugins-lsx7q" Jun 03 01:04:38.486302 ip-10-0-138-55 kubenswrapper[2566]: I0603 01:04:38.486243 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/38c378b4-8f35-4e5f-8b38-83e4c61f9d9d-run-systemd\") pod \"ovnkube-node-c2smc\" (UID: \"38c378b4-8f35-4e5f-8b38-83e4c61f9d9d\") " pod="openshift-ovn-kubernetes/ovnkube-node-c2smc" Jun 03 01:04:38.486302 ip-10-0-138-55 kubenswrapper[2566]: I0603 01:04:38.486274 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/4ddf5288-34de-4f9b-a70d-6024cc36f81a-host-slash\") pod \"iptables-alerter-46tk7\" (UID: \"4ddf5288-34de-4f9b-a70d-6024cc36f81a\") " pod="openshift-network-operator/iptables-alerter-46tk7" Jun 03 01:04:38.486302 ip-10-0-138-55 kubenswrapper[2566]: I0603 01:04:38.486299 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/20148712-f92b-4521-92b1-e00d0c2571c9-tuning-conf-dir\") pod \"multus-additional-cni-plugins-lsx7q\" (UID: \"20148712-f92b-4521-92b1-e00d0c2571c9\") " pod="openshift-multus/multus-additional-cni-plugins-lsx7q" Jun 03 01:04:38.486466 ip-10-0-138-55 kubenswrapper[2566]: I0603 01:04:38.486331 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/20148712-f92b-4521-92b1-e00d0c2571c9-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-lsx7q\" (UID: \"20148712-f92b-4521-92b1-e00d0c2571c9\") " pod="openshift-multus/multus-additional-cni-plugins-lsx7q" Jun 03 01:04:38.486466 ip-10-0-138-55 kubenswrapper[2566]: I0603 01:04:38.486348 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/3b24c36b-015d-4776-8999-95b23959ff67-multus-conf-dir\") pod \"multus-frg76\" (UID: \"3b24c36b-015d-4776-8999-95b23959ff67\") " pod="openshift-multus/multus-frg76" Jun 03 01:04:38.486466 ip-10-0-138-55 kubenswrapper[2566]: I0603 01:04:38.486371 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/38c378b4-8f35-4e5f-8b38-83e4c61f9d9d-host-run-netns\") pod \"ovnkube-node-c2smc\" (UID: \"38c378b4-8f35-4e5f-8b38-83e4c61f9d9d\") " pod="openshift-ovn-kubernetes/ovnkube-node-c2smc" Jun 03 01:04:38.486466 ip-10-0-138-55 kubenswrapper[2566]: I0603 01:04:38.486399 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/38c378b4-8f35-4e5f-8b38-83e4c61f9d9d-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-c2smc\" (UID: \"38c378b4-8f35-4e5f-8b38-83e4c61f9d9d\") " pod="openshift-ovn-kubernetes/ovnkube-node-c2smc" Jun 03 01:04:38.486466 ip-10-0-138-55 kubenswrapper[2566]: I0603 01:04:38.486418 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/a7e6e57f-fea2-40e8-a12b-c39140993cc5-etc-kubernetes\") pod \"tuned-jj7f8\" (UID: \"a7e6e57f-fea2-40e8-a12b-c39140993cc5\") " pod="openshift-cluster-node-tuning-operator/tuned-jj7f8" Jun 03 01:04:38.486466 ip-10-0-138-55 kubenswrapper[2566]: I0603 01:04:38.486431 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/a7e6e57f-fea2-40e8-a12b-c39140993cc5-host\") pod \"tuned-jj7f8\" (UID: \"a7e6e57f-fea2-40e8-a12b-c39140993cc5\") " pod="openshift-cluster-node-tuning-operator/tuned-jj7f8" Jun 03 01:04:38.486466 ip-10-0-138-55 kubenswrapper[2566]: I0603 01:04:38.486454 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/20148712-f92b-4521-92b1-e00d0c2571c9-cni-binary-copy\") pod \"multus-additional-cni-plugins-lsx7q\" (UID: \"20148712-f92b-4521-92b1-e00d0c2571c9\") " pod="openshift-multus/multus-additional-cni-plugins-lsx7q" Jun 03 01:04:38.486662 ip-10-0-138-55 kubenswrapper[2566]: I0603 01:04:38.486484 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/3b24c36b-015d-4776-8999-95b23959ff67-multus-cni-dir\") pod \"multus-frg76\" (UID: \"3b24c36b-015d-4776-8999-95b23959ff67\") " pod="openshift-multus/multus-frg76" Jun 03 01:04:38.486662 ip-10-0-138-55 kubenswrapper[2566]: I0603 01:04:38.486510 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/a7e6e57f-fea2-40e8-a12b-c39140993cc5-sys\") pod \"tuned-jj7f8\" (UID: \"a7e6e57f-fea2-40e8-a12b-c39140993cc5\") " pod="openshift-cluster-node-tuning-operator/tuned-jj7f8" Jun 03 01:04:38.486662 ip-10-0-138-55 kubenswrapper[2566]: I0603 01:04:38.486526 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/a7e6e57f-fea2-40e8-a12b-c39140993cc5-etc-sysctl-conf\") pod \"tuned-jj7f8\" (UID: \"a7e6e57f-fea2-40e8-a12b-c39140993cc5\") " pod="openshift-cluster-node-tuning-operator/tuned-jj7f8" Jun 03 01:04:38.486662 ip-10-0-138-55 kubenswrapper[2566]: I0603 01:04:38.486561 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/3b24c36b-015d-4776-8999-95b23959ff67-system-cni-dir\") pod \"multus-frg76\" (UID: \"3b24c36b-015d-4776-8999-95b23959ff67\") " pod="openshift-multus/multus-frg76" Jun 03 01:04:38.486662 ip-10-0-138-55 kubenswrapper[2566]: I0603 01:04:38.486590 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/38c378b4-8f35-4e5f-8b38-83e4c61f9d9d-host-slash\") pod \"ovnkube-node-c2smc\" (UID: \"38c378b4-8f35-4e5f-8b38-83e4c61f9d9d\") " pod="openshift-ovn-kubernetes/ovnkube-node-c2smc" Jun 03 01:04:38.486662 ip-10-0-138-55 kubenswrapper[2566]: I0603 01:04:38.486610 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run\" (UniqueName: \"kubernetes.io/host-path/a7e6e57f-fea2-40e8-a12b-c39140993cc5-run\") pod \"tuned-jj7f8\" (UID: \"a7e6e57f-fea2-40e8-a12b-c39140993cc5\") " pod="openshift-cluster-node-tuning-operator/tuned-jj7f8" Jun 03 01:04:38.486662 ip-10-0-138-55 kubenswrapper[2566]: I0603 01:04:38.486642 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/a7e6e57f-fea2-40e8-a12b-c39140993cc5-lib-modules\") pod \"tuned-jj7f8\" (UID: \"a7e6e57f-fea2-40e8-a12b-c39140993cc5\") " pod="openshift-cluster-node-tuning-operator/tuned-jj7f8" Jun 03 01:04:38.486865 ip-10-0-138-55 kubenswrapper[2566]: I0603 01:04:38.486666 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-xzvd5\" (UniqueName: \"kubernetes.io/projected/4ddf5288-34de-4f9b-a70d-6024cc36f81a-kube-api-access-xzvd5\") pod \"iptables-alerter-46tk7\" (UID: \"4ddf5288-34de-4f9b-a70d-6024cc36f81a\") " pod="openshift-network-operator/iptables-alerter-46tk7" Jun 03 01:04:38.486865 ip-10-0-138-55 kubenswrapper[2566]: I0603 01:04:38.486690 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-v9pfn\" (UniqueName: \"kubernetes.io/projected/7a085832-7923-4e02-b929-f85fe37838f3-kube-api-access-v9pfn\") pod \"aws-ebs-csi-driver-node-gvsbt\" (UID: \"7a085832-7923-4e02-b929-f85fe37838f3\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-gvsbt" Jun 03 01:04:38.486865 ip-10-0-138-55 kubenswrapper[2566]: I0603 01:04:38.486716 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/38c378b4-8f35-4e5f-8b38-83e4c61f9d9d-systemd-units\") pod \"ovnkube-node-c2smc\" (UID: \"38c378b4-8f35-4e5f-8b38-83e4c61f9d9d\") " pod="openshift-ovn-kubernetes/ovnkube-node-c2smc" Jun 03 01:04:38.486865 ip-10-0-138-55 kubenswrapper[2566]: I0603 01:04:38.486740 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/38c378b4-8f35-4e5f-8b38-83e4c61f9d9d-ovnkube-config\") pod \"ovnkube-node-c2smc\" (UID: \"38c378b4-8f35-4e5f-8b38-83e4c61f9d9d\") " pod="openshift-ovn-kubernetes/ovnkube-node-c2smc" Jun 03 01:04:38.486865 ip-10-0-138-55 kubenswrapper[2566]: I0603 01:04:38.486763 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/3e693b71-7178-4400-bdfa-91a820886ab1-serviceca\") pod \"node-ca-wl5n2\" (UID: \"3e693b71-7178-4400-bdfa-91a820886ab1\") " pod="openshift-image-registry/node-ca-wl5n2" Jun 03 01:04:38.486865 ip-10-0-138-55 kubenswrapper[2566]: I0603 01:04:38.486795 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/a7e6e57f-fea2-40e8-a12b-c39140993cc5-etc-systemd\") pod \"tuned-jj7f8\" (UID: \"a7e6e57f-fea2-40e8-a12b-c39140993cc5\") " pod="openshift-cluster-node-tuning-operator/tuned-jj7f8" Jun 03 01:04:38.486865 ip-10-0-138-55 kubenswrapper[2566]: I0603 01:04:38.486820 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/7a085832-7923-4e02-b929-f85fe37838f3-registration-dir\") pod \"aws-ebs-csi-driver-node-gvsbt\" (UID: \"7a085832-7923-4e02-b929-f85fe37838f3\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-gvsbt" Jun 03 01:04:38.486865 ip-10-0-138-55 kubenswrapper[2566]: I0603 01:04:38.486844 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/3b24c36b-015d-4776-8999-95b23959ff67-cni-binary-copy\") pod \"multus-frg76\" (UID: \"3b24c36b-015d-4776-8999-95b23959ff67\") " pod="openshift-multus/multus-frg76" Jun 03 01:04:38.487204 ip-10-0-138-55 kubenswrapper[2566]: I0603 01:04:38.486866 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/3b24c36b-015d-4776-8999-95b23959ff67-host-var-lib-kubelet\") pod \"multus-frg76\" (UID: \"3b24c36b-015d-4776-8999-95b23959ff67\") " pod="openshift-multus/multus-frg76" Jun 03 01:04:38.487204 ip-10-0-138-55 kubenswrapper[2566]: I0603 01:04:38.486899 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/a7e6e57f-fea2-40e8-a12b-c39140993cc5-etc-sysctl-d\") pod \"tuned-jj7f8\" (UID: \"a7e6e57f-fea2-40e8-a12b-c39140993cc5\") " pod="openshift-cluster-node-tuning-operator/tuned-jj7f8" Jun 03 01:04:38.487204 ip-10-0-138-55 kubenswrapper[2566]: I0603 01:04:38.486919 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/a7e6e57f-fea2-40e8-a12b-c39140993cc5-tmp\") pod \"tuned-jj7f8\" (UID: \"a7e6e57f-fea2-40e8-a12b-c39140993cc5\") " pod="openshift-cluster-node-tuning-operator/tuned-jj7f8" Jun 03 01:04:38.487204 ip-10-0-138-55 kubenswrapper[2566]: I0603 01:04:38.486935 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/3b24c36b-015d-4776-8999-95b23959ff67-os-release\") pod \"multus-frg76\" (UID: \"3b24c36b-015d-4776-8999-95b23959ff67\") " pod="openshift-multus/multus-frg76" Jun 03 01:04:38.487204 ip-10-0-138-55 kubenswrapper[2566]: I0603 01:04:38.486957 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/3b24c36b-015d-4776-8999-95b23959ff67-host-var-lib-cni-bin\") pod \"multus-frg76\" (UID: \"3b24c36b-015d-4776-8999-95b23959ff67\") " pod="openshift-multus/multus-frg76" Jun 03 01:04:38.487204 ip-10-0-138-55 kubenswrapper[2566]: I0603 01:04:38.486988 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/38c378b4-8f35-4e5f-8b38-83e4c61f9d9d-etc-openvswitch\") pod \"ovnkube-node-c2smc\" (UID: \"38c378b4-8f35-4e5f-8b38-83e4c61f9d9d\") " pod="openshift-ovn-kubernetes/ovnkube-node-c2smc" Jun 03 01:04:38.487204 ip-10-0-138-55 kubenswrapper[2566]: I0603 01:04:38.487017 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/38c378b4-8f35-4e5f-8b38-83e4c61f9d9d-run-openvswitch\") pod \"ovnkube-node-c2smc\" (UID: \"38c378b4-8f35-4e5f-8b38-83e4c61f9d9d\") " pod="openshift-ovn-kubernetes/ovnkube-node-c2smc" Jun 03 01:04:38.487204 ip-10-0-138-55 kubenswrapper[2566]: I0603 01:04:38.487044 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/7a085832-7923-4e02-b929-f85fe37838f3-sys-fs\") pod \"aws-ebs-csi-driver-node-gvsbt\" (UID: \"7a085832-7923-4e02-b929-f85fe37838f3\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-gvsbt" Jun 03 01:04:38.487204 ip-10-0-138-55 kubenswrapper[2566]: I0603 01:04:38.487068 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/3b24c36b-015d-4776-8999-95b23959ff67-multus-socket-dir-parent\") pod \"multus-frg76\" (UID: \"3b24c36b-015d-4776-8999-95b23959ff67\") " pod="openshift-multus/multus-frg76" Jun 03 01:04:38.487204 ip-10-0-138-55 kubenswrapper[2566]: I0603 01:04:38.487089 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/38c378b4-8f35-4e5f-8b38-83e4c61f9d9d-run-ovn\") pod \"ovnkube-node-c2smc\" (UID: \"38c378b4-8f35-4e5f-8b38-83e4c61f9d9d\") " pod="openshift-ovn-kubernetes/ovnkube-node-c2smc" Jun 03 01:04:38.487204 ip-10-0-138-55 kubenswrapper[2566]: I0603 01:04:38.487112 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/38c378b4-8f35-4e5f-8b38-83e4c61f9d9d-ovn-node-metrics-cert\") pod \"ovnkube-node-c2smc\" (UID: \"38c378b4-8f35-4e5f-8b38-83e4c61f9d9d\") " pod="openshift-ovn-kubernetes/ovnkube-node-c2smc" Jun 03 01:04:38.487204 ip-10-0-138-55 kubenswrapper[2566]: I0603 01:04:38.487128 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-whmvg\" (UniqueName: \"kubernetes.io/projected/8bb0d88a-f4ad-42ec-b814-3d13ba6e8a3f-kube-api-access-whmvg\") pod \"network-check-target-k9zdx\" (UID: \"8bb0d88a-f4ad-42ec-b814-3d13ba6e8a3f\") " pod="openshift-network-diagnostics/network-check-target-k9zdx" Jun 03 01:04:38.487204 ip-10-0-138-55 kubenswrapper[2566]: I0603 01:04:38.487143 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/7a085832-7923-4e02-b929-f85fe37838f3-device-dir\") pod \"aws-ebs-csi-driver-node-gvsbt\" (UID: \"7a085832-7923-4e02-b929-f85fe37838f3\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-gvsbt" Jun 03 01:04:38.487204 ip-10-0-138-55 kubenswrapper[2566]: I0603 01:04:38.487156 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/20148712-f92b-4521-92b1-e00d0c2571c9-cnibin\") pod \"multus-additional-cni-plugins-lsx7q\" (UID: \"20148712-f92b-4521-92b1-e00d0c2571c9\") " pod="openshift-multus/multus-additional-cni-plugins-lsx7q" Jun 03 01:04:38.487204 ip-10-0-138-55 kubenswrapper[2566]: I0603 01:04:38.487184 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/20148712-f92b-4521-92b1-e00d0c2571c9-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-lsx7q\" (UID: \"20148712-f92b-4521-92b1-e00d0c2571c9\") " pod="openshift-multus/multus-additional-cni-plugins-lsx7q" Jun 03 01:04:38.487204 ip-10-0-138-55 kubenswrapper[2566]: I0603 01:04:38.487210 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/3b24c36b-015d-4776-8999-95b23959ff67-host-var-lib-cni-multus\") pod \"multus-frg76\" (UID: \"3b24c36b-015d-4776-8999-95b23959ff67\") " pod="openshift-multus/multus-frg76" Jun 03 01:04:38.487723 ip-10-0-138-55 kubenswrapper[2566]: I0603 01:04:38.487256 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/3b24c36b-015d-4776-8999-95b23959ff67-hostroot\") pod \"multus-frg76\" (UID: \"3b24c36b-015d-4776-8999-95b23959ff67\") " pod="openshift-multus/multus-frg76" Jun 03 01:04:38.487723 ip-10-0-138-55 kubenswrapper[2566]: I0603 01:04:38.487282 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/3b24c36b-015d-4776-8999-95b23959ff67-multus-daemon-config\") pod \"multus-frg76\" (UID: \"3b24c36b-015d-4776-8999-95b23959ff67\") " pod="openshift-multus/multus-frg76" Jun 03 01:04:38.487723 ip-10-0-138-55 kubenswrapper[2566]: I0603 01:04:38.487302 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-cz7pk\" (UniqueName: \"kubernetes.io/projected/3b24c36b-015d-4776-8999-95b23959ff67-kube-api-access-cz7pk\") pod \"multus-frg76\" (UID: \"3b24c36b-015d-4776-8999-95b23959ff67\") " pod="openshift-multus/multus-frg76" Jun 03 01:04:38.487723 ip-10-0-138-55 kubenswrapper[2566]: I0603 01:04:38.487315 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/d3ec3632-b471-46e0-899f-54befd75838a-hosts-file\") pod \"node-resolver-ztzkx\" (UID: \"d3ec3632-b471-46e0-899f-54befd75838a\") " pod="openshift-dns/node-resolver-ztzkx" Jun 03 01:04:38.487723 ip-10-0-138-55 kubenswrapper[2566]: I0603 01:04:38.487330 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-dxfqt\" (UniqueName: \"kubernetes.io/projected/3e693b71-7178-4400-bdfa-91a820886ab1-kube-api-access-dxfqt\") pod \"node-ca-wl5n2\" (UID: \"3e693b71-7178-4400-bdfa-91a820886ab1\") " pod="openshift-image-registry/node-ca-wl5n2" Jun 03 01:04:38.487723 ip-10-0-138-55 kubenswrapper[2566]: I0603 01:04:38.487348 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/a7e6e57f-fea2-40e8-a12b-c39140993cc5-var-lib-kubelet\") pod \"tuned-jj7f8\" (UID: \"a7e6e57f-fea2-40e8-a12b-c39140993cc5\") " pod="openshift-cluster-node-tuning-operator/tuned-jj7f8" Jun 03 01:04:38.487723 ip-10-0-138-55 kubenswrapper[2566]: I0603 01:04:38.487365 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/9b00548d-2314-42e7-ab92-ed1462bba025-metrics-certs\") pod \"network-metrics-daemon-vzflm\" (UID: \"9b00548d-2314-42e7-ab92-ed1462bba025\") " pod="openshift-multus/network-metrics-daemon-vzflm" Jun 03 01:04:38.487723 ip-10-0-138-55 kubenswrapper[2566]: I0603 01:04:38.487382 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/3b24c36b-015d-4776-8999-95b23959ff67-host-run-k8s-cni-cncf-io\") pod \"multus-frg76\" (UID: \"3b24c36b-015d-4776-8999-95b23959ff67\") " pod="openshift-multus/multus-frg76" Jun 03 01:04:38.487723 ip-10-0-138-55 kubenswrapper[2566]: I0603 01:04:38.487402 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/3b24c36b-015d-4776-8999-95b23959ff67-host-run-multus-certs\") pod \"multus-frg76\" (UID: \"3b24c36b-015d-4776-8999-95b23959ff67\") " pod="openshift-multus/multus-frg76" Jun 03 01:04:38.487723 ip-10-0-138-55 kubenswrapper[2566]: I0603 01:04:38.487418 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/3b24c36b-015d-4776-8999-95b23959ff67-etc-kubernetes\") pod \"multus-frg76\" (UID: \"3b24c36b-015d-4776-8999-95b23959ff67\") " pod="openshift-multus/multus-frg76" Jun 03 01:04:38.487723 ip-10-0-138-55 kubenswrapper[2566]: I0603 01:04:38.487440 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/38c378b4-8f35-4e5f-8b38-83e4c61f9d9d-host-kubelet\") pod \"ovnkube-node-c2smc\" (UID: \"38c378b4-8f35-4e5f-8b38-83e4c61f9d9d\") " pod="openshift-ovn-kubernetes/ovnkube-node-c2smc" Jun 03 01:04:38.487723 ip-10-0-138-55 kubenswrapper[2566]: I0603 01:04:38.487454 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/d3ec3632-b471-46e0-899f-54befd75838a-tmp-dir\") pod \"node-resolver-ztzkx\" (UID: \"d3ec3632-b471-46e0-899f-54befd75838a\") " pod="openshift-dns/node-resolver-ztzkx" Jun 03 01:04:38.487723 ip-10-0-138-55 kubenswrapper[2566]: I0603 01:04:38.487471 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/3e693b71-7178-4400-bdfa-91a820886ab1-host\") pod \"node-ca-wl5n2\" (UID: \"3e693b71-7178-4400-bdfa-91a820886ab1\") " pod="openshift-image-registry/node-ca-wl5n2" Jun 03 01:04:38.487723 ip-10-0-138-55 kubenswrapper[2566]: I0603 01:04:38.487488 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/7a085832-7923-4e02-b929-f85fe37838f3-etc-selinux\") pod \"aws-ebs-csi-driver-node-gvsbt\" (UID: \"7a085832-7923-4e02-b929-f85fe37838f3\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-gvsbt" Jun 03 01:04:38.487723 ip-10-0-138-55 kubenswrapper[2566]: I0603 01:04:38.487503 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/20148712-f92b-4521-92b1-e00d0c2571c9-os-release\") pod \"multus-additional-cni-plugins-lsx7q\" (UID: \"20148712-f92b-4521-92b1-e00d0c2571c9\") " pod="openshift-multus/multus-additional-cni-plugins-lsx7q" Jun 03 01:04:38.487723 ip-10-0-138-55 kubenswrapper[2566]: I0603 01:04:38.487535 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/38c378b4-8f35-4e5f-8b38-83e4c61f9d9d-host-run-ovn-kubernetes\") pod \"ovnkube-node-c2smc\" (UID: \"38c378b4-8f35-4e5f-8b38-83e4c61f9d9d\") " pod="openshift-ovn-kubernetes/ovnkube-node-c2smc" Jun 03 01:04:38.487723 ip-10-0-138-55 kubenswrapper[2566]: I0603 01:04:38.487570 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-59gv2\" (UniqueName: \"kubernetes.io/projected/d3ec3632-b471-46e0-899f-54befd75838a-kube-api-access-59gv2\") pod \"node-resolver-ztzkx\" (UID: \"d3ec3632-b471-46e0-899f-54befd75838a\") " pod="openshift-dns/node-resolver-ztzkx" Jun 03 01:04:38.488251 ip-10-0-138-55 kubenswrapper[2566]: I0603 01:04:38.487595 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-qxpd8\" (UniqueName: \"kubernetes.io/projected/a7e6e57f-fea2-40e8-a12b-c39140993cc5-kube-api-access-qxpd8\") pod \"tuned-jj7f8\" (UID: \"a7e6e57f-fea2-40e8-a12b-c39140993cc5\") " pod="openshift-cluster-node-tuning-operator/tuned-jj7f8" Jun 03 01:04:38.488251 ip-10-0-138-55 kubenswrapper[2566]: I0603 01:04:38.487619 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/3b24c36b-015d-4776-8999-95b23959ff67-cnibin\") pod \"multus-frg76\" (UID: \"3b24c36b-015d-4776-8999-95b23959ff67\") " pod="openshift-multus/multus-frg76" Jun 03 01:04:38.488251 ip-10-0-138-55 kubenswrapper[2566]: I0603 01:04:38.487659 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/38c378b4-8f35-4e5f-8b38-83e4c61f9d9d-node-log\") pod \"ovnkube-node-c2smc\" (UID: \"38c378b4-8f35-4e5f-8b38-83e4c61f9d9d\") " pod="openshift-ovn-kubernetes/ovnkube-node-c2smc" Jun 03 01:04:38.488251 ip-10-0-138-55 kubenswrapper[2566]: I0603 01:04:38.487683 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/4ddf5288-34de-4f9b-a70d-6024cc36f81a-iptables-alerter-script\") pod \"iptables-alerter-46tk7\" (UID: \"4ddf5288-34de-4f9b-a70d-6024cc36f81a\") " pod="openshift-network-operator/iptables-alerter-46tk7" Jun 03 01:04:38.488251 ip-10-0-138-55 kubenswrapper[2566]: I0603 01:04:38.487716 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/7a085832-7923-4e02-b929-f85fe37838f3-kubelet-dir\") pod \"aws-ebs-csi-driver-node-gvsbt\" (UID: \"7a085832-7923-4e02-b929-f85fe37838f3\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-gvsbt" Jun 03 01:04:38.488251 ip-10-0-138-55 kubenswrapper[2566]: I0603 01:04:38.487742 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-7zfll\" (UniqueName: \"kubernetes.io/projected/20148712-f92b-4521-92b1-e00d0c2571c9-kube-api-access-7zfll\") pod \"multus-additional-cni-plugins-lsx7q\" (UID: \"20148712-f92b-4521-92b1-e00d0c2571c9\") " pod="openshift-multus/multus-additional-cni-plugins-lsx7q" Jun 03 01:04:38.488251 ip-10-0-138-55 kubenswrapper[2566]: I0603 01:04:38.487766 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/38c378b4-8f35-4e5f-8b38-83e4c61f9d9d-var-lib-openvswitch\") pod \"ovnkube-node-c2smc\" (UID: \"38c378b4-8f35-4e5f-8b38-83e4c61f9d9d\") " pod="openshift-ovn-kubernetes/ovnkube-node-c2smc" Jun 03 01:04:38.488251 ip-10-0-138-55 kubenswrapper[2566]: I0603 01:04:38.487796 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/38c378b4-8f35-4e5f-8b38-83e4c61f9d9d-host-cni-netd\") pod \"ovnkube-node-c2smc\" (UID: \"38c378b4-8f35-4e5f-8b38-83e4c61f9d9d\") " pod="openshift-ovn-kubernetes/ovnkube-node-c2smc" Jun 03 01:04:38.488251 ip-10-0-138-55 kubenswrapper[2566]: I0603 01:04:38.487833 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/38c378b4-8f35-4e5f-8b38-83e4c61f9d9d-ovnkube-script-lib\") pod \"ovnkube-node-c2smc\" (UID: \"38c378b4-8f35-4e5f-8b38-83e4c61f9d9d\") " pod="openshift-ovn-kubernetes/ovnkube-node-c2smc" Jun 03 01:04:38.488251 ip-10-0-138-55 kubenswrapper[2566]: I0603 01:04:38.487855 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/a7e6e57f-fea2-40e8-a12b-c39140993cc5-etc-sysconfig\") pod \"tuned-jj7f8\" (UID: \"a7e6e57f-fea2-40e8-a12b-c39140993cc5\") " pod="openshift-cluster-node-tuning-operator/tuned-jj7f8" Jun 03 01:04:38.494896 ip-10-0-138-55 kubenswrapper[2566]: I0603 01:04:38.494876 2566 reflector.go:430] "Caches populated" logger="kubernetes.io/kubelet-serving" type="*v1.CertificateSigningRequest" reflector="k8s.io/client-go/tools/watch/informerwatcher.go:162" Jun 03 01:04:38.517368 ip-10-0-138-55 kubenswrapper[2566]: I0603 01:04:38.517346 2566 csr.go:274] "Certificate signing request is approved, waiting to be issued" logger="kubernetes.io/kubelet-serving" csr="csr-4kzb6" Jun 03 01:04:38.524670 ip-10-0-138-55 kubenswrapper[2566]: I0603 01:04:38.524638 2566 csr.go:270] "Certificate signing request is issued" logger="kubernetes.io/kubelet-serving" csr="csr-4kzb6" Jun 03 01:04:38.588619 ip-10-0-138-55 kubenswrapper[2566]: I0603 01:04:38.588594 2566 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/3b24c36b-015d-4776-8999-95b23959ff67-multus-socket-dir-parent\") pod \"multus-frg76\" (UID: \"3b24c36b-015d-4776-8999-95b23959ff67\") " pod="openshift-multus/multus-frg76" Jun 03 01:04:38.588768 ip-10-0-138-55 kubenswrapper[2566]: I0603 01:04:38.588634 2566 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/38c378b4-8f35-4e5f-8b38-83e4c61f9d9d-run-ovn\") pod \"ovnkube-node-c2smc\" (UID: \"38c378b4-8f35-4e5f-8b38-83e4c61f9d9d\") " pod="openshift-ovn-kubernetes/ovnkube-node-c2smc" Jun 03 01:04:38.588768 ip-10-0-138-55 kubenswrapper[2566]: I0603 01:04:38.588659 2566 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/38c378b4-8f35-4e5f-8b38-83e4c61f9d9d-ovn-node-metrics-cert\") pod \"ovnkube-node-c2smc\" (UID: \"38c378b4-8f35-4e5f-8b38-83e4c61f9d9d\") " pod="openshift-ovn-kubernetes/ovnkube-node-c2smc" Jun 03 01:04:38.588768 ip-10-0-138-55 kubenswrapper[2566]: I0603 01:04:38.588681 2566 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-whmvg\" (UniqueName: \"kubernetes.io/projected/8bb0d88a-f4ad-42ec-b814-3d13ba6e8a3f-kube-api-access-whmvg\") pod \"network-check-target-k9zdx\" (UID: \"8bb0d88a-f4ad-42ec-b814-3d13ba6e8a3f\") " pod="openshift-network-diagnostics/network-check-target-k9zdx" Jun 03 01:04:38.588768 ip-10-0-138-55 kubenswrapper[2566]: I0603 01:04:38.588682 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/3b24c36b-015d-4776-8999-95b23959ff67-multus-socket-dir-parent\") pod \"multus-frg76\" (UID: \"3b24c36b-015d-4776-8999-95b23959ff67\") " pod="openshift-multus/multus-frg76" Jun 03 01:04:38.588768 ip-10-0-138-55 kubenswrapper[2566]: I0603 01:04:38.588741 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/38c378b4-8f35-4e5f-8b38-83e4c61f9d9d-run-ovn\") pod \"ovnkube-node-c2smc\" (UID: \"38c378b4-8f35-4e5f-8b38-83e4c61f9d9d\") " pod="openshift-ovn-kubernetes/ovnkube-node-c2smc" Jun 03 01:04:38.588768 ip-10-0-138-55 kubenswrapper[2566]: I0603 01:04:38.588769 2566 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/7a085832-7923-4e02-b929-f85fe37838f3-device-dir\") pod \"aws-ebs-csi-driver-node-gvsbt\" (UID: \"7a085832-7923-4e02-b929-f85fe37838f3\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-gvsbt" Jun 03 01:04:38.588978 ip-10-0-138-55 kubenswrapper[2566]: I0603 01:04:38.588793 2566 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/20148712-f92b-4521-92b1-e00d0c2571c9-cnibin\") pod \"multus-additional-cni-plugins-lsx7q\" (UID: \"20148712-f92b-4521-92b1-e00d0c2571c9\") " pod="openshift-multus/multus-additional-cni-plugins-lsx7q" Jun 03 01:04:38.588978 ip-10-0-138-55 kubenswrapper[2566]: I0603 01:04:38.588816 2566 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/20148712-f92b-4521-92b1-e00d0c2571c9-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-lsx7q\" (UID: \"20148712-f92b-4521-92b1-e00d0c2571c9\") " pod="openshift-multus/multus-additional-cni-plugins-lsx7q" Jun 03 01:04:38.588978 ip-10-0-138-55 kubenswrapper[2566]: I0603 01:04:38.588845 2566 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/3b24c36b-015d-4776-8999-95b23959ff67-host-var-lib-cni-multus\") pod \"multus-frg76\" (UID: \"3b24c36b-015d-4776-8999-95b23959ff67\") " pod="openshift-multus/multus-frg76" Jun 03 01:04:38.588978 ip-10-0-138-55 kubenswrapper[2566]: I0603 01:04:38.588869 2566 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/3b24c36b-015d-4776-8999-95b23959ff67-hostroot\") pod \"multus-frg76\" (UID: \"3b24c36b-015d-4776-8999-95b23959ff67\") " pod="openshift-multus/multus-frg76" Jun 03 01:04:38.588978 ip-10-0-138-55 kubenswrapper[2566]: I0603 01:04:38.588877 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/20148712-f92b-4521-92b1-e00d0c2571c9-cnibin\") pod \"multus-additional-cni-plugins-lsx7q\" (UID: \"20148712-f92b-4521-92b1-e00d0c2571c9\") " pod="openshift-multus/multus-additional-cni-plugins-lsx7q" Jun 03 01:04:38.588978 ip-10-0-138-55 kubenswrapper[2566]: I0603 01:04:38.588893 2566 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/3b24c36b-015d-4776-8999-95b23959ff67-multus-daemon-config\") pod \"multus-frg76\" (UID: \"3b24c36b-015d-4776-8999-95b23959ff67\") " pod="openshift-multus/multus-frg76" Jun 03 01:04:38.588978 ip-10-0-138-55 kubenswrapper[2566]: I0603 01:04:38.588922 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/3b24c36b-015d-4776-8999-95b23959ff67-host-var-lib-cni-multus\") pod \"multus-frg76\" (UID: \"3b24c36b-015d-4776-8999-95b23959ff67\") " pod="openshift-multus/multus-frg76" Jun 03 01:04:38.588978 ip-10-0-138-55 kubenswrapper[2566]: I0603 01:04:38.588931 2566 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-cz7pk\" (UniqueName: \"kubernetes.io/projected/3b24c36b-015d-4776-8999-95b23959ff67-kube-api-access-cz7pk\") pod \"multus-frg76\" (UID: \"3b24c36b-015d-4776-8999-95b23959ff67\") " pod="openshift-multus/multus-frg76" Jun 03 01:04:38.589368 ip-10-0-138-55 kubenswrapper[2566]: I0603 01:04:38.588978 2566 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/d3ec3632-b471-46e0-899f-54befd75838a-hosts-file\") pod \"node-resolver-ztzkx\" (UID: \"d3ec3632-b471-46e0-899f-54befd75838a\") " pod="openshift-dns/node-resolver-ztzkx" Jun 03 01:04:38.589368 ip-10-0-138-55 kubenswrapper[2566]: I0603 01:04:38.589009 2566 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-dxfqt\" (UniqueName: \"kubernetes.io/projected/3e693b71-7178-4400-bdfa-91a820886ab1-kube-api-access-dxfqt\") pod \"node-ca-wl5n2\" (UID: \"3e693b71-7178-4400-bdfa-91a820886ab1\") " pod="openshift-image-registry/node-ca-wl5n2" Jun 03 01:04:38.589368 ip-10-0-138-55 kubenswrapper[2566]: I0603 01:04:38.589050 2566 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/a7e6e57f-fea2-40e8-a12b-c39140993cc5-var-lib-kubelet\") pod \"tuned-jj7f8\" (UID: \"a7e6e57f-fea2-40e8-a12b-c39140993cc5\") " pod="openshift-cluster-node-tuning-operator/tuned-jj7f8" Jun 03 01:04:38.589368 ip-10-0-138-55 kubenswrapper[2566]: I0603 01:04:38.589077 2566 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/9b00548d-2314-42e7-ab92-ed1462bba025-metrics-certs\") pod \"network-metrics-daemon-vzflm\" (UID: \"9b00548d-2314-42e7-ab92-ed1462bba025\") " pod="openshift-multus/network-metrics-daemon-vzflm" Jun 03 01:04:38.589368 ip-10-0-138-55 kubenswrapper[2566]: I0603 01:04:38.589098 2566 swap_util.go:74] "error creating dir to test if tmpfs noswap is enabled. Assuming not supported" mount path="" error="stat /var/lib/kubelet/plugins/kubernetes.io/empty-dir: no such file or directory" Jun 03 01:04:38.589368 ip-10-0-138-55 kubenswrapper[2566]: I0603 01:04:38.589137 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/3b24c36b-015d-4776-8999-95b23959ff67-host-run-k8s-cni-cncf-io\") pod \"multus-frg76\" (UID: \"3b24c36b-015d-4776-8999-95b23959ff67\") " pod="openshift-multus/multus-frg76" Jun 03 01:04:38.589368 ip-10-0-138-55 kubenswrapper[2566]: I0603 01:04:38.588880 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/7a085832-7923-4e02-b929-f85fe37838f3-device-dir\") pod \"aws-ebs-csi-driver-node-gvsbt\" (UID: \"7a085832-7923-4e02-b929-f85fe37838f3\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-gvsbt" Jun 03 01:04:38.589368 ip-10-0-138-55 kubenswrapper[2566]: I0603 01:04:38.589104 2566 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/3b24c36b-015d-4776-8999-95b23959ff67-host-run-k8s-cni-cncf-io\") pod \"multus-frg76\" (UID: \"3b24c36b-015d-4776-8999-95b23959ff67\") " pod="openshift-multus/multus-frg76" Jun 03 01:04:38.589368 ip-10-0-138-55 kubenswrapper[2566]: I0603 01:04:38.589204 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/3b24c36b-015d-4776-8999-95b23959ff67-hostroot\") pod \"multus-frg76\" (UID: \"3b24c36b-015d-4776-8999-95b23959ff67\") " pod="openshift-multus/multus-frg76" Jun 03 01:04:38.589368 ip-10-0-138-55 kubenswrapper[2566]: I0603 01:04:38.589203 2566 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/3b24c36b-015d-4776-8999-95b23959ff67-host-run-multus-certs\") pod \"multus-frg76\" (UID: \"3b24c36b-015d-4776-8999-95b23959ff67\") " pod="openshift-multus/multus-frg76" Jun 03 01:04:38.589368 ip-10-0-138-55 kubenswrapper[2566]: I0603 01:04:38.589259 2566 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/3b24c36b-015d-4776-8999-95b23959ff67-etc-kubernetes\") pod \"multus-frg76\" (UID: \"3b24c36b-015d-4776-8999-95b23959ff67\") " pod="openshift-multus/multus-frg76" Jun 03 01:04:38.589368 ip-10-0-138-55 kubenswrapper[2566]: I0603 01:04:38.589287 2566 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/38c378b4-8f35-4e5f-8b38-83e4c61f9d9d-host-kubelet\") pod \"ovnkube-node-c2smc\" (UID: \"38c378b4-8f35-4e5f-8b38-83e4c61f9d9d\") " pod="openshift-ovn-kubernetes/ovnkube-node-c2smc" Jun 03 01:04:38.589368 ip-10-0-138-55 kubenswrapper[2566]: I0603 01:04:38.589296 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/3b24c36b-015d-4776-8999-95b23959ff67-etc-kubernetes\") pod \"multus-frg76\" (UID: \"3b24c36b-015d-4776-8999-95b23959ff67\") " pod="openshift-multus/multus-frg76" Jun 03 01:04:38.589368 ip-10-0-138-55 kubenswrapper[2566]: I0603 01:04:38.589312 2566 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/d3ec3632-b471-46e0-899f-54befd75838a-tmp-dir\") pod \"node-resolver-ztzkx\" (UID: \"d3ec3632-b471-46e0-899f-54befd75838a\") " pod="openshift-dns/node-resolver-ztzkx" Jun 03 01:04:38.589368 ip-10-0-138-55 kubenswrapper[2566]: I0603 01:04:38.589335 2566 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/3e693b71-7178-4400-bdfa-91a820886ab1-host\") pod \"node-ca-wl5n2\" (UID: \"3e693b71-7178-4400-bdfa-91a820886ab1\") " pod="openshift-image-registry/node-ca-wl5n2" Jun 03 01:04:38.589368 ip-10-0-138-55 kubenswrapper[2566]: I0603 01:04:38.589352 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/d3ec3632-b471-46e0-899f-54befd75838a-hosts-file\") pod \"node-resolver-ztzkx\" (UID: \"d3ec3632-b471-46e0-899f-54befd75838a\") " pod="openshift-dns/node-resolver-ztzkx" Jun 03 01:04:38.589368 ip-10-0-138-55 kubenswrapper[2566]: I0603 01:04:38.589366 2566 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/7a085832-7923-4e02-b929-f85fe37838f3-etc-selinux\") pod \"aws-ebs-csi-driver-node-gvsbt\" (UID: \"7a085832-7923-4e02-b929-f85fe37838f3\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-gvsbt" Jun 03 01:04:38.590258 ip-10-0-138-55 kubenswrapper[2566]: I0603 01:04:38.589391 2566 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/20148712-f92b-4521-92b1-e00d0c2571c9-os-release\") pod \"multus-additional-cni-plugins-lsx7q\" (UID: \"20148712-f92b-4521-92b1-e00d0c2571c9\") " pod="openshift-multus/multus-additional-cni-plugins-lsx7q" Jun 03 01:04:38.590258 ip-10-0-138-55 kubenswrapper[2566]: I0603 01:04:38.589394 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/a7e6e57f-fea2-40e8-a12b-c39140993cc5-var-lib-kubelet\") pod \"tuned-jj7f8\" (UID: \"a7e6e57f-fea2-40e8-a12b-c39140993cc5\") " pod="openshift-cluster-node-tuning-operator/tuned-jj7f8" Jun 03 01:04:38.590258 ip-10-0-138-55 kubenswrapper[2566]: I0603 01:04:38.589262 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/3b24c36b-015d-4776-8999-95b23959ff67-host-run-multus-certs\") pod \"multus-frg76\" (UID: \"3b24c36b-015d-4776-8999-95b23959ff67\") " pod="openshift-multus/multus-frg76" Jun 03 01:04:38.590258 ip-10-0-138-55 kubenswrapper[2566]: I0603 01:04:38.589417 2566 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/38c378b4-8f35-4e5f-8b38-83e4c61f9d9d-host-run-ovn-kubernetes\") pod \"ovnkube-node-c2smc\" (UID: \"38c378b4-8f35-4e5f-8b38-83e4c61f9d9d\") " pod="openshift-ovn-kubernetes/ovnkube-node-c2smc" Jun 03 01:04:38.590258 ip-10-0-138-55 kubenswrapper[2566]: I0603 01:04:38.589442 2566 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-59gv2\" (UniqueName: \"kubernetes.io/projected/d3ec3632-b471-46e0-899f-54befd75838a-kube-api-access-59gv2\") pod \"node-resolver-ztzkx\" (UID: \"d3ec3632-b471-46e0-899f-54befd75838a\") " pod="openshift-dns/node-resolver-ztzkx" Jun 03 01:04:38.590258 ip-10-0-138-55 kubenswrapper[2566]: I0603 01:04:38.589466 2566 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-qxpd8\" (UniqueName: \"kubernetes.io/projected/a7e6e57f-fea2-40e8-a12b-c39140993cc5-kube-api-access-qxpd8\") pod \"tuned-jj7f8\" (UID: \"a7e6e57f-fea2-40e8-a12b-c39140993cc5\") " pod="openshift-cluster-node-tuning-operator/tuned-jj7f8" Jun 03 01:04:38.590258 ip-10-0-138-55 kubenswrapper[2566]: I0603 01:04:38.589487 2566 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/3b24c36b-015d-4776-8999-95b23959ff67-cnibin\") pod \"multus-frg76\" (UID: \"3b24c36b-015d-4776-8999-95b23959ff67\") " pod="openshift-multus/multus-frg76" Jun 03 01:04:38.590258 ip-10-0-138-55 kubenswrapper[2566]: E0603 01:04:38.589498 2566 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jun 03 01:04:38.590258 ip-10-0-138-55 kubenswrapper[2566]: I0603 01:04:38.589510 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/7a085832-7923-4e02-b929-f85fe37838f3-etc-selinux\") pod \"aws-ebs-csi-driver-node-gvsbt\" (UID: \"7a085832-7923-4e02-b929-f85fe37838f3\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-gvsbt" Jun 03 01:04:38.590258 ip-10-0-138-55 kubenswrapper[2566]: I0603 01:04:38.589539 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/38c378b4-8f35-4e5f-8b38-83e4c61f9d9d-node-log\") pod \"ovnkube-node-c2smc\" (UID: \"38c378b4-8f35-4e5f-8b38-83e4c61f9d9d\") " pod="openshift-ovn-kubernetes/ovnkube-node-c2smc" Jun 03 01:04:38.590258 ip-10-0-138-55 kubenswrapper[2566]: I0603 01:04:38.589507 2566 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/38c378b4-8f35-4e5f-8b38-83e4c61f9d9d-node-log\") pod \"ovnkube-node-c2smc\" (UID: \"38c378b4-8f35-4e5f-8b38-83e4c61f9d9d\") " pod="openshift-ovn-kubernetes/ovnkube-node-c2smc" Jun 03 01:04:38.590258 ip-10-0-138-55 kubenswrapper[2566]: I0603 01:04:38.589563 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host\" (UniqueName: \"kubernetes.io/host-path/3e693b71-7178-4400-bdfa-91a820886ab1-host\") pod \"node-ca-wl5n2\" (UID: \"3e693b71-7178-4400-bdfa-91a820886ab1\") " pod="openshift-image-registry/node-ca-wl5n2" Jun 03 01:04:38.590258 ip-10-0-138-55 kubenswrapper[2566]: E0603 01:04:38.589611 2566 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/9b00548d-2314-42e7-ab92-ed1462bba025-metrics-certs podName:9b00548d-2314-42e7-ab92-ed1462bba025 nodeName:}" failed. No retries permitted until 2026-06-03 01:04:39.0895701 +0000 UTC m=+2.236412038 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/9b00548d-2314-42e7-ab92-ed1462bba025-metrics-certs") pod "network-metrics-daemon-vzflm" (UID: "9b00548d-2314-42e7-ab92-ed1462bba025") : object "openshift-multus"/"metrics-daemon-secret" not registered Jun 03 01:04:38.590258 ip-10-0-138-55 kubenswrapper[2566]: I0603 01:04:38.589614 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/20148712-f92b-4521-92b1-e00d0c2571c9-os-release\") pod \"multus-additional-cni-plugins-lsx7q\" (UID: \"20148712-f92b-4521-92b1-e00d0c2571c9\") " pod="openshift-multus/multus-additional-cni-plugins-lsx7q" Jun 03 01:04:38.590258 ip-10-0-138-55 kubenswrapper[2566]: I0603 01:04:38.589638 2566 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/4ddf5288-34de-4f9b-a70d-6024cc36f81a-iptables-alerter-script\") pod \"iptables-alerter-46tk7\" (UID: \"4ddf5288-34de-4f9b-a70d-6024cc36f81a\") " pod="openshift-network-operator/iptables-alerter-46tk7" Jun 03 01:04:38.590258 ip-10-0-138-55 kubenswrapper[2566]: I0603 01:04:38.589661 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/3b24c36b-015d-4776-8999-95b23959ff67-cnibin\") pod \"multus-frg76\" (UID: \"3b24c36b-015d-4776-8999-95b23959ff67\") " pod="openshift-multus/multus-frg76" Jun 03 01:04:38.590258 ip-10-0-138-55 kubenswrapper[2566]: I0603 01:04:38.589672 2566 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/7a085832-7923-4e02-b929-f85fe37838f3-kubelet-dir\") pod \"aws-ebs-csi-driver-node-gvsbt\" (UID: \"7a085832-7923-4e02-b929-f85fe37838f3\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-gvsbt" Jun 03 01:04:38.591137 ip-10-0-138-55 kubenswrapper[2566]: I0603 01:04:38.589686 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/d3ec3632-b471-46e0-899f-54befd75838a-tmp-dir\") pod \"node-resolver-ztzkx\" (UID: \"d3ec3632-b471-46e0-899f-54befd75838a\") " pod="openshift-dns/node-resolver-ztzkx" Jun 03 01:04:38.591137 ip-10-0-138-55 kubenswrapper[2566]: I0603 01:04:38.589703 2566 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-7zfll\" (UniqueName: \"kubernetes.io/projected/20148712-f92b-4521-92b1-e00d0c2571c9-kube-api-access-7zfll\") pod \"multus-additional-cni-plugins-lsx7q\" (UID: \"20148712-f92b-4521-92b1-e00d0c2571c9\") " pod="openshift-multus/multus-additional-cni-plugins-lsx7q" Jun 03 01:04:38.591137 ip-10-0-138-55 kubenswrapper[2566]: I0603 01:04:38.589720 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/20148712-f92b-4521-92b1-e00d0c2571c9-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-lsx7q\" (UID: \"20148712-f92b-4521-92b1-e00d0c2571c9\") " pod="openshift-multus/multus-additional-cni-plugins-lsx7q" Jun 03 01:04:38.591137 ip-10-0-138-55 kubenswrapper[2566]: I0603 01:04:38.589731 2566 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/38c378b4-8f35-4e5f-8b38-83e4c61f9d9d-var-lib-openvswitch\") pod \"ovnkube-node-c2smc\" (UID: \"38c378b4-8f35-4e5f-8b38-83e4c61f9d9d\") " pod="openshift-ovn-kubernetes/ovnkube-node-c2smc" Jun 03 01:04:38.591137 ip-10-0-138-55 kubenswrapper[2566]: I0603 01:04:38.589744 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/38c378b4-8f35-4e5f-8b38-83e4c61f9d9d-host-kubelet\") pod \"ovnkube-node-c2smc\" (UID: \"38c378b4-8f35-4e5f-8b38-83e4c61f9d9d\") " pod="openshift-ovn-kubernetes/ovnkube-node-c2smc" Jun 03 01:04:38.591137 ip-10-0-138-55 kubenswrapper[2566]: I0603 01:04:38.589755 2566 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/38c378b4-8f35-4e5f-8b38-83e4c61f9d9d-host-cni-netd\") pod \"ovnkube-node-c2smc\" (UID: \"38c378b4-8f35-4e5f-8b38-83e4c61f9d9d\") " pod="openshift-ovn-kubernetes/ovnkube-node-c2smc" Jun 03 01:04:38.591137 ip-10-0-138-55 kubenswrapper[2566]: I0603 01:04:38.589766 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/38c378b4-8f35-4e5f-8b38-83e4c61f9d9d-host-run-ovn-kubernetes\") pod \"ovnkube-node-c2smc\" (UID: \"38c378b4-8f35-4e5f-8b38-83e4c61f9d9d\") " pod="openshift-ovn-kubernetes/ovnkube-node-c2smc" Jun 03 01:04:38.591137 ip-10-0-138-55 kubenswrapper[2566]: I0603 01:04:38.589780 2566 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/38c378b4-8f35-4e5f-8b38-83e4c61f9d9d-ovnkube-script-lib\") pod \"ovnkube-node-c2smc\" (UID: \"38c378b4-8f35-4e5f-8b38-83e4c61f9d9d\") " pod="openshift-ovn-kubernetes/ovnkube-node-c2smc" Jun 03 01:04:38.591137 ip-10-0-138-55 kubenswrapper[2566]: I0603 01:04:38.589795 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/7a085832-7923-4e02-b929-f85fe37838f3-kubelet-dir\") pod \"aws-ebs-csi-driver-node-gvsbt\" (UID: \"7a085832-7923-4e02-b929-f85fe37838f3\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-gvsbt" Jun 03 01:04:38.591137 ip-10-0-138-55 kubenswrapper[2566]: I0603 01:04:38.589808 2566 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/a7e6e57f-fea2-40e8-a12b-c39140993cc5-etc-sysconfig\") pod \"tuned-jj7f8\" (UID: \"a7e6e57f-fea2-40e8-a12b-c39140993cc5\") " pod="openshift-cluster-node-tuning-operator/tuned-jj7f8" Jun 03 01:04:38.591137 ip-10-0-138-55 kubenswrapper[2566]: I0603 01:04:38.589812 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/38c378b4-8f35-4e5f-8b38-83e4c61f9d9d-var-lib-openvswitch\") pod \"ovnkube-node-c2smc\" (UID: \"38c378b4-8f35-4e5f-8b38-83e4c61f9d9d\") " pod="openshift-ovn-kubernetes/ovnkube-node-c2smc" Jun 03 01:04:38.591137 ip-10-0-138-55 kubenswrapper[2566]: I0603 01:04:38.589832 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/38c378b4-8f35-4e5f-8b38-83e4c61f9d9d-host-cni-netd\") pod \"ovnkube-node-c2smc\" (UID: \"38c378b4-8f35-4e5f-8b38-83e4c61f9d9d\") " pod="openshift-ovn-kubernetes/ovnkube-node-c2smc" Jun 03 01:04:38.591137 ip-10-0-138-55 kubenswrapper[2566]: I0603 01:04:38.589832 2566 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/684e9f6d-abe0-4f60-af14-564c495677cc-agent-certs\") pod \"konnectivity-agent-fg4j4\" (UID: \"684e9f6d-abe0-4f60-af14-564c495677cc\") " pod="kube-system/konnectivity-agent-fg4j4" Jun 03 01:04:38.591137 ip-10-0-138-55 kubenswrapper[2566]: I0603 01:04:38.589867 2566 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/684e9f6d-abe0-4f60-af14-564c495677cc-konnectivity-ca\") pod \"konnectivity-agent-fg4j4\" (UID: \"684e9f6d-abe0-4f60-af14-564c495677cc\") " pod="kube-system/konnectivity-agent-fg4j4" Jun 03 01:04:38.591137 ip-10-0-138-55 kubenswrapper[2566]: I0603 01:04:38.589891 2566 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/a7e6e57f-fea2-40e8-a12b-c39140993cc5-etc-modprobe-d\") pod \"tuned-jj7f8\" (UID: \"a7e6e57f-fea2-40e8-a12b-c39140993cc5\") " pod="openshift-cluster-node-tuning-operator/tuned-jj7f8" Jun 03 01:04:38.591137 ip-10-0-138-55 kubenswrapper[2566]: I0603 01:04:38.589916 2566 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/a7e6e57f-fea2-40e8-a12b-c39140993cc5-etc-tuned\") pod \"tuned-jj7f8\" (UID: \"a7e6e57f-fea2-40e8-a12b-c39140993cc5\") " pod="openshift-cluster-node-tuning-operator/tuned-jj7f8" Jun 03 01:04:38.591137 ip-10-0-138-55 kubenswrapper[2566]: I0603 01:04:38.589939 2566 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/3b24c36b-015d-4776-8999-95b23959ff67-host-run-netns\") pod \"multus-frg76\" (UID: \"3b24c36b-015d-4776-8999-95b23959ff67\") " pod="openshift-multus/multus-frg76" Jun 03 01:04:38.592042 ip-10-0-138-55 kubenswrapper[2566]: I0603 01:04:38.589971 2566 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/38c378b4-8f35-4e5f-8b38-83e4c61f9d9d-log-socket\") pod \"ovnkube-node-c2smc\" (UID: \"38c378b4-8f35-4e5f-8b38-83e4c61f9d9d\") " pod="openshift-ovn-kubernetes/ovnkube-node-c2smc" Jun 03 01:04:38.592042 ip-10-0-138-55 kubenswrapper[2566]: I0603 01:04:38.589988 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/a7e6e57f-fea2-40e8-a12b-c39140993cc5-etc-modprobe-d\") pod \"tuned-jj7f8\" (UID: \"a7e6e57f-fea2-40e8-a12b-c39140993cc5\") " pod="openshift-cluster-node-tuning-operator/tuned-jj7f8" Jun 03 01:04:38.592042 ip-10-0-138-55 kubenswrapper[2566]: I0603 01:04:38.589994 2566 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/38c378b4-8f35-4e5f-8b38-83e4c61f9d9d-host-cni-bin\") pod \"ovnkube-node-c2smc\" (UID: \"38c378b4-8f35-4e5f-8b38-83e4c61f9d9d\") " pod="openshift-ovn-kubernetes/ovnkube-node-c2smc" Jun 03 01:04:38.592042 ip-10-0-138-55 kubenswrapper[2566]: I0603 01:04:38.590018 2566 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/38c378b4-8f35-4e5f-8b38-83e4c61f9d9d-env-overrides\") pod \"ovnkube-node-c2smc\" (UID: \"38c378b4-8f35-4e5f-8b38-83e4c61f9d9d\") " pod="openshift-ovn-kubernetes/ovnkube-node-c2smc" Jun 03 01:04:38.592042 ip-10-0-138-55 kubenswrapper[2566]: I0603 01:04:38.590043 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/3b24c36b-015d-4776-8999-95b23959ff67-host-run-netns\") pod \"multus-frg76\" (UID: \"3b24c36b-015d-4776-8999-95b23959ff67\") " pod="openshift-multus/multus-frg76" Jun 03 01:04:38.592042 ip-10-0-138-55 kubenswrapper[2566]: I0603 01:04:38.590044 2566 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-27rgg\" (UniqueName: \"kubernetes.io/projected/38c378b4-8f35-4e5f-8b38-83e4c61f9d9d-kube-api-access-27rgg\") pod \"ovnkube-node-c2smc\" (UID: \"38c378b4-8f35-4e5f-8b38-83e4c61f9d9d\") " pod="openshift-ovn-kubernetes/ovnkube-node-c2smc" Jun 03 01:04:38.592042 ip-10-0-138-55 kubenswrapper[2566]: I0603 01:04:38.590087 2566 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-kjztn\" (UniqueName: \"kubernetes.io/projected/9b00548d-2314-42e7-ab92-ed1462bba025-kube-api-access-kjztn\") pod \"network-metrics-daemon-vzflm\" (UID: \"9b00548d-2314-42e7-ab92-ed1462bba025\") " pod="openshift-multus/network-metrics-daemon-vzflm" Jun 03 01:04:38.592042 ip-10-0-138-55 kubenswrapper[2566]: I0603 01:04:38.590114 2566 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/7a085832-7923-4e02-b929-f85fe37838f3-socket-dir\") pod \"aws-ebs-csi-driver-node-gvsbt\" (UID: \"7a085832-7923-4e02-b929-f85fe37838f3\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-gvsbt" Jun 03 01:04:38.592042 ip-10-0-138-55 kubenswrapper[2566]: I0603 01:04:38.590140 2566 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/20148712-f92b-4521-92b1-e00d0c2571c9-system-cni-dir\") pod \"multus-additional-cni-plugins-lsx7q\" (UID: \"20148712-f92b-4521-92b1-e00d0c2571c9\") " pod="openshift-multus/multus-additional-cni-plugins-lsx7q" Jun 03 01:04:38.592042 ip-10-0-138-55 kubenswrapper[2566]: I0603 01:04:38.590174 2566 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/38c378b4-8f35-4e5f-8b38-83e4c61f9d9d-run-systemd\") pod \"ovnkube-node-c2smc\" (UID: \"38c378b4-8f35-4e5f-8b38-83e4c61f9d9d\") " pod="openshift-ovn-kubernetes/ovnkube-node-c2smc" Jun 03 01:04:38.592042 ip-10-0-138-55 kubenswrapper[2566]: I0603 01:04:38.590202 2566 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/4ddf5288-34de-4f9b-a70d-6024cc36f81a-host-slash\") pod \"iptables-alerter-46tk7\" (UID: \"4ddf5288-34de-4f9b-a70d-6024cc36f81a\") " pod="openshift-network-operator/iptables-alerter-46tk7" Jun 03 01:04:38.592042 ip-10-0-138-55 kubenswrapper[2566]: I0603 01:04:38.590244 2566 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/20148712-f92b-4521-92b1-e00d0c2571c9-tuning-conf-dir\") pod \"multus-additional-cni-plugins-lsx7q\" (UID: \"20148712-f92b-4521-92b1-e00d0c2571c9\") " pod="openshift-multus/multus-additional-cni-plugins-lsx7q" Jun 03 01:04:38.592042 ip-10-0-138-55 kubenswrapper[2566]: I0603 01:04:38.590270 2566 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/20148712-f92b-4521-92b1-e00d0c2571c9-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-lsx7q\" (UID: \"20148712-f92b-4521-92b1-e00d0c2571c9\") " pod="openshift-multus/multus-additional-cni-plugins-lsx7q" Jun 03 01:04:38.592042 ip-10-0-138-55 kubenswrapper[2566]: I0603 01:04:38.590312 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/38c378b4-8f35-4e5f-8b38-83e4c61f9d9d-log-socket\") pod \"ovnkube-node-c2smc\" (UID: \"38c378b4-8f35-4e5f-8b38-83e4c61f9d9d\") " pod="openshift-ovn-kubernetes/ovnkube-node-c2smc" Jun 03 01:04:38.592042 ip-10-0-138-55 kubenswrapper[2566]: I0603 01:04:38.590297 2566 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/3b24c36b-015d-4776-8999-95b23959ff67-multus-conf-dir\") pod \"multus-frg76\" (UID: \"3b24c36b-015d-4776-8999-95b23959ff67\") " pod="openshift-multus/multus-frg76" Jun 03 01:04:38.592042 ip-10-0-138-55 kubenswrapper[2566]: I0603 01:04:38.590351 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/3b24c36b-015d-4776-8999-95b23959ff67-multus-conf-dir\") pod \"multus-frg76\" (UID: \"3b24c36b-015d-4776-8999-95b23959ff67\") " pod="openshift-multus/multus-frg76" Jun 03 01:04:38.592042 ip-10-0-138-55 kubenswrapper[2566]: I0603 01:04:38.589890 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/a7e6e57f-fea2-40e8-a12b-c39140993cc5-etc-sysconfig\") pod \"tuned-jj7f8\" (UID: \"a7e6e57f-fea2-40e8-a12b-c39140993cc5\") " pod="openshift-cluster-node-tuning-operator/tuned-jj7f8" Jun 03 01:04:38.592885 ip-10-0-138-55 kubenswrapper[2566]: I0603 01:04:38.590369 2566 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/38c378b4-8f35-4e5f-8b38-83e4c61f9d9d-host-run-netns\") pod \"ovnkube-node-c2smc\" (UID: \"38c378b4-8f35-4e5f-8b38-83e4c61f9d9d\") " pod="openshift-ovn-kubernetes/ovnkube-node-c2smc" Jun 03 01:04:38.592885 ip-10-0-138-55 kubenswrapper[2566]: I0603 01:04:38.590402 2566 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/38c378b4-8f35-4e5f-8b38-83e4c61f9d9d-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-c2smc\" (UID: \"38c378b4-8f35-4e5f-8b38-83e4c61f9d9d\") " pod="openshift-ovn-kubernetes/ovnkube-node-c2smc" Jun 03 01:04:38.592885 ip-10-0-138-55 kubenswrapper[2566]: I0603 01:04:38.590430 2566 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/a7e6e57f-fea2-40e8-a12b-c39140993cc5-etc-kubernetes\") pod \"tuned-jj7f8\" (UID: \"a7e6e57f-fea2-40e8-a12b-c39140993cc5\") " pod="openshift-cluster-node-tuning-operator/tuned-jj7f8" Jun 03 01:04:38.592885 ip-10-0-138-55 kubenswrapper[2566]: I0603 01:04:38.590458 2566 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/a7e6e57f-fea2-40e8-a12b-c39140993cc5-host\") pod \"tuned-jj7f8\" (UID: \"a7e6e57f-fea2-40e8-a12b-c39140993cc5\") " pod="openshift-cluster-node-tuning-operator/tuned-jj7f8" Jun 03 01:04:38.592885 ip-10-0-138-55 kubenswrapper[2566]: I0603 01:04:38.590485 2566 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/20148712-f92b-4521-92b1-e00d0c2571c9-cni-binary-copy\") pod \"multus-additional-cni-plugins-lsx7q\" (UID: \"20148712-f92b-4521-92b1-e00d0c2571c9\") " pod="openshift-multus/multus-additional-cni-plugins-lsx7q" Jun 03 01:04:38.592885 ip-10-0-138-55 kubenswrapper[2566]: I0603 01:04:38.590500 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/684e9f6d-abe0-4f60-af14-564c495677cc-konnectivity-ca\") pod \"konnectivity-agent-fg4j4\" (UID: \"684e9f6d-abe0-4f60-af14-564c495677cc\") " pod="kube-system/konnectivity-agent-fg4j4" Jun 03 01:04:38.592885 ip-10-0-138-55 kubenswrapper[2566]: I0603 01:04:38.590511 2566 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/3b24c36b-015d-4776-8999-95b23959ff67-multus-cni-dir\") pod \"multus-frg76\" (UID: \"3b24c36b-015d-4776-8999-95b23959ff67\") " pod="openshift-multus/multus-frg76" Jun 03 01:04:38.592885 ip-10-0-138-55 kubenswrapper[2566]: I0603 01:04:38.590546 2566 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/a7e6e57f-fea2-40e8-a12b-c39140993cc5-sys\") pod \"tuned-jj7f8\" (UID: \"a7e6e57f-fea2-40e8-a12b-c39140993cc5\") " pod="openshift-cluster-node-tuning-operator/tuned-jj7f8" Jun 03 01:04:38.592885 ip-10-0-138-55 kubenswrapper[2566]: I0603 01:04:38.590577 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/a7e6e57f-fea2-40e8-a12b-c39140993cc5-etc-kubernetes\") pod \"tuned-jj7f8\" (UID: \"a7e6e57f-fea2-40e8-a12b-c39140993cc5\") " pod="openshift-cluster-node-tuning-operator/tuned-jj7f8" Jun 03 01:04:38.592885 ip-10-0-138-55 kubenswrapper[2566]: I0603 01:04:38.590623 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/3b24c36b-015d-4776-8999-95b23959ff67-multus-daemon-config\") pod \"multus-frg76\" (UID: \"3b24c36b-015d-4776-8999-95b23959ff67\") " pod="openshift-multus/multus-frg76" Jun 03 01:04:38.592885 ip-10-0-138-55 kubenswrapper[2566]: I0603 01:04:38.590626 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/a7e6e57f-fea2-40e8-a12b-c39140993cc5-sys\") pod \"tuned-jj7f8\" (UID: \"a7e6e57f-fea2-40e8-a12b-c39140993cc5\") " pod="openshift-cluster-node-tuning-operator/tuned-jj7f8" Jun 03 01:04:38.592885 ip-10-0-138-55 kubenswrapper[2566]: I0603 01:04:38.590659 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/38c378b4-8f35-4e5f-8b38-83e4c61f9d9d-run-systemd\") pod \"ovnkube-node-c2smc\" (UID: \"38c378b4-8f35-4e5f-8b38-83e4c61f9d9d\") " pod="openshift-ovn-kubernetes/ovnkube-node-c2smc" Jun 03 01:04:38.592885 ip-10-0-138-55 kubenswrapper[2566]: I0603 01:04:38.590696 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/a7e6e57f-fea2-40e8-a12b-c39140993cc5-etc-sysctl-conf\") pod \"tuned-jj7f8\" (UID: \"a7e6e57f-fea2-40e8-a12b-c39140993cc5\") " pod="openshift-cluster-node-tuning-operator/tuned-jj7f8" Jun 03 01:04:38.592885 ip-10-0-138-55 kubenswrapper[2566]: I0603 01:04:38.590707 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/38c378b4-8f35-4e5f-8b38-83e4c61f9d9d-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-c2smc\" (UID: \"38c378b4-8f35-4e5f-8b38-83e4c61f9d9d\") " pod="openshift-ovn-kubernetes/ovnkube-node-c2smc" Jun 03 01:04:38.592885 ip-10-0-138-55 kubenswrapper[2566]: I0603 01:04:38.590769 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host\" (UniqueName: \"kubernetes.io/host-path/a7e6e57f-fea2-40e8-a12b-c39140993cc5-host\") pod \"tuned-jj7f8\" (UID: \"a7e6e57f-fea2-40e8-a12b-c39140993cc5\") " pod="openshift-cluster-node-tuning-operator/tuned-jj7f8" Jun 03 01:04:38.592885 ip-10-0-138-55 kubenswrapper[2566]: I0603 01:04:38.590773 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/38c378b4-8f35-4e5f-8b38-83e4c61f9d9d-host-run-netns\") pod \"ovnkube-node-c2smc\" (UID: \"38c378b4-8f35-4e5f-8b38-83e4c61f9d9d\") " pod="openshift-ovn-kubernetes/ovnkube-node-c2smc" Jun 03 01:04:38.592885 ip-10-0-138-55 kubenswrapper[2566]: I0603 01:04:38.590801 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/7a085832-7923-4e02-b929-f85fe37838f3-socket-dir\") pod \"aws-ebs-csi-driver-node-gvsbt\" (UID: \"7a085832-7923-4e02-b929-f85fe37838f3\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-gvsbt" Jun 03 01:04:38.593706 ip-10-0-138-55 kubenswrapper[2566]: I0603 01:04:38.590577 2566 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/a7e6e57f-fea2-40e8-a12b-c39140993cc5-etc-sysctl-conf\") pod \"tuned-jj7f8\" (UID: \"a7e6e57f-fea2-40e8-a12b-c39140993cc5\") " pod="openshift-cluster-node-tuning-operator/tuned-jj7f8" Jun 03 01:04:38.593706 ip-10-0-138-55 kubenswrapper[2566]: I0603 01:04:38.590842 2566 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/3b24c36b-015d-4776-8999-95b23959ff67-system-cni-dir\") pod \"multus-frg76\" (UID: \"3b24c36b-015d-4776-8999-95b23959ff67\") " pod="openshift-multus/multus-frg76" Jun 03 01:04:38.593706 ip-10-0-138-55 kubenswrapper[2566]: I0603 01:04:38.590847 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/3b24c36b-015d-4776-8999-95b23959ff67-multus-cni-dir\") pod \"multus-frg76\" (UID: \"3b24c36b-015d-4776-8999-95b23959ff67\") " pod="openshift-multus/multus-frg76" Jun 03 01:04:38.593706 ip-10-0-138-55 kubenswrapper[2566]: I0603 01:04:38.590813 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/38c378b4-8f35-4e5f-8b38-83e4c61f9d9d-host-cni-bin\") pod \"ovnkube-node-c2smc\" (UID: \"38c378b4-8f35-4e5f-8b38-83e4c61f9d9d\") " pod="openshift-ovn-kubernetes/ovnkube-node-c2smc" Jun 03 01:04:38.593706 ip-10-0-138-55 kubenswrapper[2566]: I0603 01:04:38.590884 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/38c378b4-8f35-4e5f-8b38-83e4c61f9d9d-ovnkube-script-lib\") pod \"ovnkube-node-c2smc\" (UID: \"38c378b4-8f35-4e5f-8b38-83e4c61f9d9d\") " pod="openshift-ovn-kubernetes/ovnkube-node-c2smc" Jun 03 01:04:38.593706 ip-10-0-138-55 kubenswrapper[2566]: I0603 01:04:38.590888 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/20148712-f92b-4521-92b1-e00d0c2571c9-system-cni-dir\") pod \"multus-additional-cni-plugins-lsx7q\" (UID: \"20148712-f92b-4521-92b1-e00d0c2571c9\") " pod="openshift-multus/multus-additional-cni-plugins-lsx7q" Jun 03 01:04:38.593706 ip-10-0-138-55 kubenswrapper[2566]: I0603 01:04:38.590935 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/3b24c36b-015d-4776-8999-95b23959ff67-system-cni-dir\") pod \"multus-frg76\" (UID: \"3b24c36b-015d-4776-8999-95b23959ff67\") " pod="openshift-multus/multus-frg76" Jun 03 01:04:38.593706 ip-10-0-138-55 kubenswrapper[2566]: I0603 01:04:38.590936 2566 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/38c378b4-8f35-4e5f-8b38-83e4c61f9d9d-host-slash\") pod \"ovnkube-node-c2smc\" (UID: \"38c378b4-8f35-4e5f-8b38-83e4c61f9d9d\") " pod="openshift-ovn-kubernetes/ovnkube-node-c2smc" Jun 03 01:04:38.593706 ip-10-0-138-55 kubenswrapper[2566]: I0603 01:04:38.590966 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/38c378b4-8f35-4e5f-8b38-83e4c61f9d9d-host-slash\") pod \"ovnkube-node-c2smc\" (UID: \"38c378b4-8f35-4e5f-8b38-83e4c61f9d9d\") " pod="openshift-ovn-kubernetes/ovnkube-node-c2smc" Jun 03 01:04:38.593706 ip-10-0-138-55 kubenswrapper[2566]: I0603 01:04:38.590984 2566 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"run\" (UniqueName: \"kubernetes.io/host-path/a7e6e57f-fea2-40e8-a12b-c39140993cc5-run\") pod \"tuned-jj7f8\" (UID: \"a7e6e57f-fea2-40e8-a12b-c39140993cc5\") " pod="openshift-cluster-node-tuning-operator/tuned-jj7f8" Jun 03 01:04:38.593706 ip-10-0-138-55 kubenswrapper[2566]: I0603 01:04:38.591010 2566 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/a7e6e57f-fea2-40e8-a12b-c39140993cc5-lib-modules\") pod \"tuned-jj7f8\" (UID: \"a7e6e57f-fea2-40e8-a12b-c39140993cc5\") " pod="openshift-cluster-node-tuning-operator/tuned-jj7f8" Jun 03 01:04:38.593706 ip-10-0-138-55 kubenswrapper[2566]: I0603 01:04:38.591016 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/20148712-f92b-4521-92b1-e00d0c2571c9-tuning-conf-dir\") pod \"multus-additional-cni-plugins-lsx7q\" (UID: \"20148712-f92b-4521-92b1-e00d0c2571c9\") " pod="openshift-multus/multus-additional-cni-plugins-lsx7q" Jun 03 01:04:38.593706 ip-10-0-138-55 kubenswrapper[2566]: I0603 01:04:38.590875 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/4ddf5288-34de-4f9b-a70d-6024cc36f81a-iptables-alerter-script\") pod \"iptables-alerter-46tk7\" (UID: \"4ddf5288-34de-4f9b-a70d-6024cc36f81a\") " pod="openshift-network-operator/iptables-alerter-46tk7" Jun 03 01:04:38.593706 ip-10-0-138-55 kubenswrapper[2566]: I0603 01:04:38.591035 2566 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-xzvd5\" (UniqueName: \"kubernetes.io/projected/4ddf5288-34de-4f9b-a70d-6024cc36f81a-kube-api-access-xzvd5\") pod \"iptables-alerter-46tk7\" (UID: \"4ddf5288-34de-4f9b-a70d-6024cc36f81a\") " pod="openshift-network-operator/iptables-alerter-46tk7" Jun 03 01:04:38.593706 ip-10-0-138-55 kubenswrapper[2566]: I0603 01:04:38.591078 2566 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-v9pfn\" (UniqueName: \"kubernetes.io/projected/7a085832-7923-4e02-b929-f85fe37838f3-kube-api-access-v9pfn\") pod \"aws-ebs-csi-driver-node-gvsbt\" (UID: \"7a085832-7923-4e02-b929-f85fe37838f3\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-gvsbt" Jun 03 01:04:38.593706 ip-10-0-138-55 kubenswrapper[2566]: I0603 01:04:38.591082 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"run\" (UniqueName: \"kubernetes.io/host-path/a7e6e57f-fea2-40e8-a12b-c39140993cc5-run\") pod \"tuned-jj7f8\" (UID: \"a7e6e57f-fea2-40e8-a12b-c39140993cc5\") " pod="openshift-cluster-node-tuning-operator/tuned-jj7f8" Jun 03 01:04:38.593706 ip-10-0-138-55 kubenswrapper[2566]: I0603 01:04:38.591112 2566 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/38c378b4-8f35-4e5f-8b38-83e4c61f9d9d-systemd-units\") pod \"ovnkube-node-c2smc\" (UID: \"38c378b4-8f35-4e5f-8b38-83e4c61f9d9d\") " pod="openshift-ovn-kubernetes/ovnkube-node-c2smc" Jun 03 01:04:38.594485 ip-10-0-138-55 kubenswrapper[2566]: I0603 01:04:38.591153 2566 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/38c378b4-8f35-4e5f-8b38-83e4c61f9d9d-ovnkube-config\") pod \"ovnkube-node-c2smc\" (UID: \"38c378b4-8f35-4e5f-8b38-83e4c61f9d9d\") " pod="openshift-ovn-kubernetes/ovnkube-node-c2smc" Jun 03 01:04:38.594485 ip-10-0-138-55 kubenswrapper[2566]: I0603 01:04:38.591176 2566 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/3e693b71-7178-4400-bdfa-91a820886ab1-serviceca\") pod \"node-ca-wl5n2\" (UID: \"3e693b71-7178-4400-bdfa-91a820886ab1\") " pod="openshift-image-registry/node-ca-wl5n2" Jun 03 01:04:38.594485 ip-10-0-138-55 kubenswrapper[2566]: I0603 01:04:38.591189 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/38c378b4-8f35-4e5f-8b38-83e4c61f9d9d-env-overrides\") pod \"ovnkube-node-c2smc\" (UID: \"38c378b4-8f35-4e5f-8b38-83e4c61f9d9d\") " pod="openshift-ovn-kubernetes/ovnkube-node-c2smc" Jun 03 01:04:38.594485 ip-10-0-138-55 kubenswrapper[2566]: I0603 01:04:38.591196 2566 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/a7e6e57f-fea2-40e8-a12b-c39140993cc5-etc-systemd\") pod \"tuned-jj7f8\" (UID: \"a7e6e57f-fea2-40e8-a12b-c39140993cc5\") " pod="openshift-cluster-node-tuning-operator/tuned-jj7f8" Jun 03 01:04:38.594485 ip-10-0-138-55 kubenswrapper[2566]: I0603 01:04:38.591260 2566 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/7a085832-7923-4e02-b929-f85fe37838f3-registration-dir\") pod \"aws-ebs-csi-driver-node-gvsbt\" (UID: \"7a085832-7923-4e02-b929-f85fe37838f3\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-gvsbt" Jun 03 01:04:38.594485 ip-10-0-138-55 kubenswrapper[2566]: I0603 01:04:38.591247 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/a7e6e57f-fea2-40e8-a12b-c39140993cc5-etc-systemd\") pod \"tuned-jj7f8\" (UID: \"a7e6e57f-fea2-40e8-a12b-c39140993cc5\") " pod="openshift-cluster-node-tuning-operator/tuned-jj7f8" Jun 03 01:04:38.594485 ip-10-0-138-55 kubenswrapper[2566]: I0603 01:04:38.591305 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/20148712-f92b-4521-92b1-e00d0c2571c9-cni-binary-copy\") pod \"multus-additional-cni-plugins-lsx7q\" (UID: \"20148712-f92b-4521-92b1-e00d0c2571c9\") " pod="openshift-multus/multus-additional-cni-plugins-lsx7q" Jun 03 01:04:38.594485 ip-10-0-138-55 kubenswrapper[2566]: I0603 01:04:38.591321 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/7a085832-7923-4e02-b929-f85fe37838f3-registration-dir\") pod \"aws-ebs-csi-driver-node-gvsbt\" (UID: \"7a085832-7923-4e02-b929-f85fe37838f3\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-gvsbt" Jun 03 01:04:38.594485 ip-10-0-138-55 kubenswrapper[2566]: I0603 01:04:38.591363 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/4ddf5288-34de-4f9b-a70d-6024cc36f81a-host-slash\") pod \"iptables-alerter-46tk7\" (UID: \"4ddf5288-34de-4f9b-a70d-6024cc36f81a\") " pod="openshift-network-operator/iptables-alerter-46tk7" Jun 03 01:04:38.594485 ip-10-0-138-55 kubenswrapper[2566]: I0603 01:04:38.591425 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/a7e6e57f-fea2-40e8-a12b-c39140993cc5-lib-modules\") pod \"tuned-jj7f8\" (UID: \"a7e6e57f-fea2-40e8-a12b-c39140993cc5\") " pod="openshift-cluster-node-tuning-operator/tuned-jj7f8" Jun 03 01:04:38.594485 ip-10-0-138-55 kubenswrapper[2566]: I0603 01:04:38.591464 2566 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/3b24c36b-015d-4776-8999-95b23959ff67-cni-binary-copy\") pod \"multus-frg76\" (UID: \"3b24c36b-015d-4776-8999-95b23959ff67\") " pod="openshift-multus/multus-frg76" Jun 03 01:04:38.594485 ip-10-0-138-55 kubenswrapper[2566]: I0603 01:04:38.591494 2566 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/3b24c36b-015d-4776-8999-95b23959ff67-host-var-lib-kubelet\") pod \"multus-frg76\" (UID: \"3b24c36b-015d-4776-8999-95b23959ff67\") " pod="openshift-multus/multus-frg76" Jun 03 01:04:38.594485 ip-10-0-138-55 kubenswrapper[2566]: I0603 01:04:38.591523 2566 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/a7e6e57f-fea2-40e8-a12b-c39140993cc5-etc-sysctl-d\") pod \"tuned-jj7f8\" (UID: \"a7e6e57f-fea2-40e8-a12b-c39140993cc5\") " pod="openshift-cluster-node-tuning-operator/tuned-jj7f8" Jun 03 01:04:38.594485 ip-10-0-138-55 kubenswrapper[2566]: I0603 01:04:38.591545 2566 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/a7e6e57f-fea2-40e8-a12b-c39140993cc5-tmp\") pod \"tuned-jj7f8\" (UID: \"a7e6e57f-fea2-40e8-a12b-c39140993cc5\") " pod="openshift-cluster-node-tuning-operator/tuned-jj7f8" Jun 03 01:04:38.594485 ip-10-0-138-55 kubenswrapper[2566]: I0603 01:04:38.591463 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/20148712-f92b-4521-92b1-e00d0c2571c9-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-lsx7q\" (UID: \"20148712-f92b-4521-92b1-e00d0c2571c9\") " pod="openshift-multus/multus-additional-cni-plugins-lsx7q" Jun 03 01:04:38.594485 ip-10-0-138-55 kubenswrapper[2566]: I0603 01:04:38.591598 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/3b24c36b-015d-4776-8999-95b23959ff67-host-var-lib-kubelet\") pod \"multus-frg76\" (UID: \"3b24c36b-015d-4776-8999-95b23959ff67\") " pod="openshift-multus/multus-frg76" Jun 03 01:04:38.594485 ip-10-0-138-55 kubenswrapper[2566]: I0603 01:04:38.591652 2566 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/3b24c36b-015d-4776-8999-95b23959ff67-os-release\") pod \"multus-frg76\" (UID: \"3b24c36b-015d-4776-8999-95b23959ff67\") " pod="openshift-multus/multus-frg76" Jun 03 01:04:38.594485 ip-10-0-138-55 kubenswrapper[2566]: I0603 01:04:38.591701 2566 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/3b24c36b-015d-4776-8999-95b23959ff67-host-var-lib-cni-bin\") pod \"multus-frg76\" (UID: \"3b24c36b-015d-4776-8999-95b23959ff67\") " pod="openshift-multus/multus-frg76" Jun 03 01:04:38.595447 ip-10-0-138-55 kubenswrapper[2566]: I0603 01:04:38.591742 2566 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/38c378b4-8f35-4e5f-8b38-83e4c61f9d9d-etc-openvswitch\") pod \"ovnkube-node-c2smc\" (UID: \"38c378b4-8f35-4e5f-8b38-83e4c61f9d9d\") " pod="openshift-ovn-kubernetes/ovnkube-node-c2smc" Jun 03 01:04:38.595447 ip-10-0-138-55 kubenswrapper[2566]: I0603 01:04:38.591767 2566 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/38c378b4-8f35-4e5f-8b38-83e4c61f9d9d-run-openvswitch\") pod \"ovnkube-node-c2smc\" (UID: \"38c378b4-8f35-4e5f-8b38-83e4c61f9d9d\") " pod="openshift-ovn-kubernetes/ovnkube-node-c2smc" Jun 03 01:04:38.595447 ip-10-0-138-55 kubenswrapper[2566]: I0603 01:04:38.591774 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/38c378b4-8f35-4e5f-8b38-83e4c61f9d9d-ovnkube-config\") pod \"ovnkube-node-c2smc\" (UID: \"38c378b4-8f35-4e5f-8b38-83e4c61f9d9d\") " pod="openshift-ovn-kubernetes/ovnkube-node-c2smc" Jun 03 01:04:38.595447 ip-10-0-138-55 kubenswrapper[2566]: I0603 01:04:38.591783 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/3e693b71-7178-4400-bdfa-91a820886ab1-serviceca\") pod \"node-ca-wl5n2\" (UID: \"3e693b71-7178-4400-bdfa-91a820886ab1\") " pod="openshift-image-registry/node-ca-wl5n2" Jun 03 01:04:38.595447 ip-10-0-138-55 kubenswrapper[2566]: I0603 01:04:38.591808 2566 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/7a085832-7923-4e02-b929-f85fe37838f3-sys-fs\") pod \"aws-ebs-csi-driver-node-gvsbt\" (UID: \"7a085832-7923-4e02-b929-f85fe37838f3\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-gvsbt" Jun 03 01:04:38.595447 ip-10-0-138-55 kubenswrapper[2566]: I0603 01:04:38.591825 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/38c378b4-8f35-4e5f-8b38-83e4c61f9d9d-systemd-units\") pod \"ovnkube-node-c2smc\" (UID: \"38c378b4-8f35-4e5f-8b38-83e4c61f9d9d\") " pod="openshift-ovn-kubernetes/ovnkube-node-c2smc" Jun 03 01:04:38.595447 ip-10-0-138-55 kubenswrapper[2566]: I0603 01:04:38.591840 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/3b24c36b-015d-4776-8999-95b23959ff67-host-var-lib-cni-bin\") pod \"multus-frg76\" (UID: \"3b24c36b-015d-4776-8999-95b23959ff67\") " pod="openshift-multus/multus-frg76" Jun 03 01:04:38.595447 ip-10-0-138-55 kubenswrapper[2566]: I0603 01:04:38.591872 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/38c378b4-8f35-4e5f-8b38-83e4c61f9d9d-etc-openvswitch\") pod \"ovnkube-node-c2smc\" (UID: \"38c378b4-8f35-4e5f-8b38-83e4c61f9d9d\") " pod="openshift-ovn-kubernetes/ovnkube-node-c2smc" Jun 03 01:04:38.595447 ip-10-0-138-55 kubenswrapper[2566]: I0603 01:04:38.591897 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/3b24c36b-015d-4776-8999-95b23959ff67-os-release\") pod \"multus-frg76\" (UID: \"3b24c36b-015d-4776-8999-95b23959ff67\") " pod="openshift-multus/multus-frg76" Jun 03 01:04:38.595447 ip-10-0-138-55 kubenswrapper[2566]: I0603 01:04:38.591901 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/7a085832-7923-4e02-b929-f85fe37838f3-sys-fs\") pod \"aws-ebs-csi-driver-node-gvsbt\" (UID: \"7a085832-7923-4e02-b929-f85fe37838f3\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-gvsbt" Jun 03 01:04:38.595447 ip-10-0-138-55 kubenswrapper[2566]: I0603 01:04:38.591914 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/38c378b4-8f35-4e5f-8b38-83e4c61f9d9d-run-openvswitch\") pod \"ovnkube-node-c2smc\" (UID: \"38c378b4-8f35-4e5f-8b38-83e4c61f9d9d\") " pod="openshift-ovn-kubernetes/ovnkube-node-c2smc" Jun 03 01:04:38.595447 ip-10-0-138-55 kubenswrapper[2566]: I0603 01:04:38.591931 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/3b24c36b-015d-4776-8999-95b23959ff67-cni-binary-copy\") pod \"multus-frg76\" (UID: \"3b24c36b-015d-4776-8999-95b23959ff67\") " pod="openshift-multus/multus-frg76" Jun 03 01:04:38.595447 ip-10-0-138-55 kubenswrapper[2566]: I0603 01:04:38.592049 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/a7e6e57f-fea2-40e8-a12b-c39140993cc5-etc-sysctl-d\") pod \"tuned-jj7f8\" (UID: \"a7e6e57f-fea2-40e8-a12b-c39140993cc5\") " pod="openshift-cluster-node-tuning-operator/tuned-jj7f8" Jun 03 01:04:38.595447 ip-10-0-138-55 kubenswrapper[2566]: I0603 01:04:38.592571 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/38c378b4-8f35-4e5f-8b38-83e4c61f9d9d-ovn-node-metrics-cert\") pod \"ovnkube-node-c2smc\" (UID: \"38c378b4-8f35-4e5f-8b38-83e4c61f9d9d\") " pod="openshift-ovn-kubernetes/ovnkube-node-c2smc" Jun 03 01:04:38.595447 ip-10-0-138-55 kubenswrapper[2566]: I0603 01:04:38.592884 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/684e9f6d-abe0-4f60-af14-564c495677cc-agent-certs\") pod \"konnectivity-agent-fg4j4\" (UID: \"684e9f6d-abe0-4f60-af14-564c495677cc\") " pod="kube-system/konnectivity-agent-fg4j4" Jun 03 01:04:38.595447 ip-10-0-138-55 kubenswrapper[2566]: I0603 01:04:38.593855 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/a7e6e57f-fea2-40e8-a12b-c39140993cc5-etc-tuned\") pod \"tuned-jj7f8\" (UID: \"a7e6e57f-fea2-40e8-a12b-c39140993cc5\") " pod="openshift-cluster-node-tuning-operator/tuned-jj7f8" Jun 03 01:04:38.595447 ip-10-0-138-55 kubenswrapper[2566]: I0603 01:04:38.595200 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/a7e6e57f-fea2-40e8-a12b-c39140993cc5-tmp\") pod \"tuned-jj7f8\" (UID: \"a7e6e57f-fea2-40e8-a12b-c39140993cc5\") " pod="openshift-cluster-node-tuning-operator/tuned-jj7f8" Jun 03 01:04:38.599123 ip-10-0-138-55 kubenswrapper[2566]: E0603 01:04:38.599105 2566 projected.go:289] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jun 03 01:04:38.599123 ip-10-0-138-55 kubenswrapper[2566]: E0603 01:04:38.599123 2566 projected.go:289] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jun 03 01:04:38.599256 ip-10-0-138-55 kubenswrapper[2566]: E0603 01:04:38.599133 2566 projected.go:194] Error preparing data for projected volume kube-api-access-whmvg for pod openshift-network-diagnostics/network-check-target-k9zdx: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 03 01:04:38.599256 ip-10-0-138-55 kubenswrapper[2566]: E0603 01:04:38.599180 2566 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/8bb0d88a-f4ad-42ec-b814-3d13ba6e8a3f-kube-api-access-whmvg podName:8bb0d88a-f4ad-42ec-b814-3d13ba6e8a3f nodeName:}" failed. No retries permitted until 2026-06-03 01:04:39.099167605 +0000 UTC m=+2.246009531 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "kube-api-access-whmvg" (UniqueName: "kubernetes.io/projected/8bb0d88a-f4ad-42ec-b814-3d13ba6e8a3f-kube-api-access-whmvg") pod "network-check-target-k9zdx" (UID: "8bb0d88a-f4ad-42ec-b814-3d13ba6e8a3f") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 03 01:04:38.601758 ip-10-0-138-55 kubenswrapper[2566]: I0603 01:04:38.601739 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-cz7pk\" (UniqueName: \"kubernetes.io/projected/3b24c36b-015d-4776-8999-95b23959ff67-kube-api-access-cz7pk\") pod \"multus-frg76\" (UID: \"3b24c36b-015d-4776-8999-95b23959ff67\") " pod="openshift-multus/multus-frg76" Jun 03 01:04:38.603475 ip-10-0-138-55 kubenswrapper[2566]: I0603 01:04:38.603453 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-kjztn\" (UniqueName: \"kubernetes.io/projected/9b00548d-2314-42e7-ab92-ed1462bba025-kube-api-access-kjztn\") pod \"network-metrics-daemon-vzflm\" (UID: \"9b00548d-2314-42e7-ab92-ed1462bba025\") " pod="openshift-multus/network-metrics-daemon-vzflm" Jun 03 01:04:38.605903 ip-10-0-138-55 kubenswrapper[2566]: I0603 01:04:38.605879 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-27rgg\" (UniqueName: \"kubernetes.io/projected/38c378b4-8f35-4e5f-8b38-83e4c61f9d9d-kube-api-access-27rgg\") pod \"ovnkube-node-c2smc\" (UID: \"38c378b4-8f35-4e5f-8b38-83e4c61f9d9d\") " pod="openshift-ovn-kubernetes/ovnkube-node-c2smc" Jun 03 01:04:38.606059 ip-10-0-138-55 kubenswrapper[2566]: I0603 01:04:38.606032 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-xzvd5\" (UniqueName: \"kubernetes.io/projected/4ddf5288-34de-4f9b-a70d-6024cc36f81a-kube-api-access-xzvd5\") pod \"iptables-alerter-46tk7\" (UID: \"4ddf5288-34de-4f9b-a70d-6024cc36f81a\") " pod="openshift-network-operator/iptables-alerter-46tk7" Jun 03 01:04:38.606156 ip-10-0-138-55 kubenswrapper[2566]: I0603 01:04:38.606062 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-v9pfn\" (UniqueName: \"kubernetes.io/projected/7a085832-7923-4e02-b929-f85fe37838f3-kube-api-access-v9pfn\") pod \"aws-ebs-csi-driver-node-gvsbt\" (UID: \"7a085832-7923-4e02-b929-f85fe37838f3\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-gvsbt" Jun 03 01:04:38.606156 ip-10-0-138-55 kubenswrapper[2566]: I0603 01:04:38.606113 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-dxfqt\" (UniqueName: \"kubernetes.io/projected/3e693b71-7178-4400-bdfa-91a820886ab1-kube-api-access-dxfqt\") pod \"node-ca-wl5n2\" (UID: \"3e693b71-7178-4400-bdfa-91a820886ab1\") " pod="openshift-image-registry/node-ca-wl5n2" Jun 03 01:04:38.606472 ip-10-0-138-55 kubenswrapper[2566]: I0603 01:04:38.606454 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-7zfll\" (UniqueName: \"kubernetes.io/projected/20148712-f92b-4521-92b1-e00d0c2571c9-kube-api-access-7zfll\") pod \"multus-additional-cni-plugins-lsx7q\" (UID: \"20148712-f92b-4521-92b1-e00d0c2571c9\") " pod="openshift-multus/multus-additional-cni-plugins-lsx7q" Jun 03 01:04:38.606641 ip-10-0-138-55 kubenswrapper[2566]: I0603 01:04:38.606627 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-qxpd8\" (UniqueName: \"kubernetes.io/projected/a7e6e57f-fea2-40e8-a12b-c39140993cc5-kube-api-access-qxpd8\") pod \"tuned-jj7f8\" (UID: \"a7e6e57f-fea2-40e8-a12b-c39140993cc5\") " pod="openshift-cluster-node-tuning-operator/tuned-jj7f8" Jun 03 01:04:38.608131 ip-10-0-138-55 kubenswrapper[2566]: I0603 01:04:38.608108 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-59gv2\" (UniqueName: \"kubernetes.io/projected/d3ec3632-b471-46e0-899f-54befd75838a-kube-api-access-59gv2\") pod \"node-resolver-ztzkx\" (UID: \"d3ec3632-b471-46e0-899f-54befd75838a\") " pod="openshift-dns/node-resolver-ztzkx" Jun 03 01:04:38.620586 ip-10-0-138-55 kubenswrapper[2566]: I0603 01:04:38.620567 2566 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/konnectivity-agent-fg4j4" Jun 03 01:04:38.678076 ip-10-0-138-55 kubenswrapper[2566]: W0603 01:04:38.678030 2566 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod09ebc096af5f7e7ecd11668f36b3a990.slice/crio-9d53db4a201504297c881918123ff980b9cf6f0cb7b2c6a665124877913d9a93 WatchSource:0}: Error finding container 9d53db4a201504297c881918123ff980b9cf6f0cb7b2c6a665124877913d9a93: Status 404 returned error can't find the container with id 9d53db4a201504297c881918123ff980b9cf6f0cb7b2c6a665124877913d9a93 Jun 03 01:04:38.678373 ip-10-0-138-55 kubenswrapper[2566]: W0603 01:04:38.678353 2566 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod441c506c4adc726a5846cc275e644767.slice/crio-32bd4b15be25307cd3c554b738e9c5d2bc816244396d4ed78c4e53fcf91f1dee WatchSource:0}: Error finding container 32bd4b15be25307cd3c554b738e9c5d2bc816244396d4ed78c4e53fcf91f1dee: Status 404 returned error can't find the container with id 32bd4b15be25307cd3c554b738e9c5d2bc816244396d4ed78c4e53fcf91f1dee Jun 03 01:04:38.682684 ip-10-0-138-55 kubenswrapper[2566]: I0603 01:04:38.682669 2566 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider Jun 03 01:04:38.776399 ip-10-0-138-55 kubenswrapper[2566]: I0603 01:04:38.776366 2566 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/node-resolver-ztzkx" Jun 03 01:04:38.783053 ip-10-0-138-55 kubenswrapper[2566]: W0603 01:04:38.783023 2566 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podd3ec3632_b471_46e0_899f_54befd75838a.slice/crio-7f3322bda4c7a2c6c6e57d906cc30d2e27235f0bdfe45e1468d8bee60fec9aec WatchSource:0}: Error finding container 7f3322bda4c7a2c6c6e57d906cc30d2e27235f0bdfe45e1468d8bee60fec9aec: Status 404 returned error can't find the container with id 7f3322bda4c7a2c6c6e57d906cc30d2e27235f0bdfe45e1468d8bee60fec9aec Jun 03 01:04:38.790255 ip-10-0-138-55 kubenswrapper[2566]: I0603 01:04:38.790220 2566 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/node-ca-wl5n2" Jun 03 01:04:38.796351 ip-10-0-138-55 kubenswrapper[2566]: W0603 01:04:38.796331 2566 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod3e693b71_7178_4400_bdfa_91a820886ab1.slice/crio-b39cac53cf6bbd8d138084dfa4bc1e80cc35c5a014187f17da90d336f0f56101 WatchSource:0}: Error finding container b39cac53cf6bbd8d138084dfa4bc1e80cc35c5a014187f17da90d336f0f56101: Status 404 returned error can't find the container with id b39cac53cf6bbd8d138084dfa4bc1e80cc35c5a014187f17da90d336f0f56101 Jun 03 01:04:38.805268 ip-10-0-138-55 kubenswrapper[2566]: I0603 01:04:38.805251 2566 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-operator/iptables-alerter-46tk7" Jun 03 01:04:38.811694 ip-10-0-138-55 kubenswrapper[2566]: W0603 01:04:38.811668 2566 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod4ddf5288_34de_4f9b_a70d_6024cc36f81a.slice/crio-3a20ab51716d641c4a3d5d0b3f35140f836103ecc0abe417c0c4eda421bbbc54 WatchSource:0}: Error finding container 3a20ab51716d641c4a3d5d0b3f35140f836103ecc0abe417c0c4eda421bbbc54: Status 404 returned error can't find the container with id 3a20ab51716d641c4a3d5d0b3f35140f836103ecc0abe417c0c4eda421bbbc54 Jun 03 01:04:38.822746 ip-10-0-138-55 kubenswrapper[2566]: I0603 01:04:38.822724 2566 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-gvsbt" Jun 03 01:04:38.828386 ip-10-0-138-55 kubenswrapper[2566]: W0603 01:04:38.828364 2566 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod7a085832_7923_4e02_b929_f85fe37838f3.slice/crio-2759ed510e1067eb5a77053b50236584437513c25db28cc503f712cf8a95b7fa WatchSource:0}: Error finding container 2759ed510e1067eb5a77053b50236584437513c25db28cc503f712cf8a95b7fa: Status 404 returned error can't find the container with id 2759ed510e1067eb5a77053b50236584437513c25db28cc503f712cf8a95b7fa Jun 03 01:04:38.849794 ip-10-0-138-55 kubenswrapper[2566]: I0603 01:04:38.849771 2566 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-node-tuning-operator/tuned-jj7f8" Jun 03 01:04:38.855215 ip-10-0-138-55 kubenswrapper[2566]: W0603 01:04:38.855186 2566 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poda7e6e57f_fea2_40e8_a12b_c39140993cc5.slice/crio-7ea7d472a3e07f2ba0379e8ac07c2dfeff38646cbc53473640a1e70369c63857 WatchSource:0}: Error finding container 7ea7d472a3e07f2ba0379e8ac07c2dfeff38646cbc53473640a1e70369c63857: Status 404 returned error can't find the container with id 7ea7d472a3e07f2ba0379e8ac07c2dfeff38646cbc53473640a1e70369c63857 Jun 03 01:04:38.868929 ip-10-0-138-55 kubenswrapper[2566]: I0603 01:04:38.868906 2566 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-additional-cni-plugins-lsx7q" Jun 03 01:04:38.874961 ip-10-0-138-55 kubenswrapper[2566]: W0603 01:04:38.874939 2566 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod20148712_f92b_4521_92b1_e00d0c2571c9.slice/crio-dd0d54f219407bf46952c0dd28e50d97297d2d7b3f23e6b6f92f59963da28c43 WatchSource:0}: Error finding container dd0d54f219407bf46952c0dd28e50d97297d2d7b3f23e6b6f92f59963da28c43: Status 404 returned error can't find the container with id dd0d54f219407bf46952c0dd28e50d97297d2d7b3f23e6b6f92f59963da28c43 Jun 03 01:04:38.883006 ip-10-0-138-55 kubenswrapper[2566]: I0603 01:04:38.882989 2566 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-frg76" Jun 03 01:04:38.888758 ip-10-0-138-55 kubenswrapper[2566]: W0603 01:04:38.888737 2566 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod3b24c36b_015d_4776_8999_95b23959ff67.slice/crio-bdc15f47828657d2a259939e1402a3ace08724faa62e4c8dffe139e4c9fb8204 WatchSource:0}: Error finding container bdc15f47828657d2a259939e1402a3ace08724faa62e4c8dffe139e4c9fb8204: Status 404 returned error can't find the container with id bdc15f47828657d2a259939e1402a3ace08724faa62e4c8dffe139e4c9fb8204 Jun 03 01:04:38.888866 ip-10-0-138-55 kubenswrapper[2566]: I0603 01:04:38.888855 2566 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ovn-kubernetes/ovnkube-node-c2smc" Jun 03 01:04:38.895957 ip-10-0-138-55 kubenswrapper[2566]: W0603 01:04:38.895934 2566 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod38c378b4_8f35_4e5f_8b38_83e4c61f9d9d.slice/crio-07688823d0de6517267ded4fae30e05cb7d07c9aa2835e580bef9eee012370bd WatchSource:0}: Error finding container 07688823d0de6517267ded4fae30e05cb7d07c9aa2835e580bef9eee012370bd: Status 404 returned error can't find the container with id 07688823d0de6517267ded4fae30e05cb7d07c9aa2835e580bef9eee012370bd Jun 03 01:04:38.919914 ip-10-0-138-55 kubenswrapper[2566]: W0603 01:04:38.919891 2566 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod684e9f6d_abe0_4f60_af14_564c495677cc.slice/crio-fac85eb676bdff808e368780cd0528586df5682d7ececffbf7ae9e4896c391a0 WatchSource:0}: Error finding container fac85eb676bdff808e368780cd0528586df5682d7ececffbf7ae9e4896c391a0: Status 404 returned error can't find the container with id fac85eb676bdff808e368780cd0528586df5682d7ececffbf7ae9e4896c391a0 Jun 03 01:04:39.096105 ip-10-0-138-55 kubenswrapper[2566]: I0603 01:04:39.096073 2566 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/9b00548d-2314-42e7-ab92-ed1462bba025-metrics-certs\") pod \"network-metrics-daemon-vzflm\" (UID: \"9b00548d-2314-42e7-ab92-ed1462bba025\") " pod="openshift-multus/network-metrics-daemon-vzflm" Jun 03 01:04:39.096293 ip-10-0-138-55 kubenswrapper[2566]: E0603 01:04:39.096245 2566 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jun 03 01:04:39.096353 ip-10-0-138-55 kubenswrapper[2566]: E0603 01:04:39.096312 2566 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/9b00548d-2314-42e7-ab92-ed1462bba025-metrics-certs podName:9b00548d-2314-42e7-ab92-ed1462bba025 nodeName:}" failed. No retries permitted until 2026-06-03 01:04:40.096294259 +0000 UTC m=+3.243136183 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/9b00548d-2314-42e7-ab92-ed1462bba025-metrics-certs") pod "network-metrics-daemon-vzflm" (UID: "9b00548d-2314-42e7-ab92-ed1462bba025") : object "openshift-multus"/"metrics-daemon-secret" not registered Jun 03 01:04:39.196794 ip-10-0-138-55 kubenswrapper[2566]: I0603 01:04:39.196713 2566 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-whmvg\" (UniqueName: \"kubernetes.io/projected/8bb0d88a-f4ad-42ec-b814-3d13ba6e8a3f-kube-api-access-whmvg\") pod \"network-check-target-k9zdx\" (UID: \"8bb0d88a-f4ad-42ec-b814-3d13ba6e8a3f\") " pod="openshift-network-diagnostics/network-check-target-k9zdx" Jun 03 01:04:39.196953 ip-10-0-138-55 kubenswrapper[2566]: E0603 01:04:39.196890 2566 projected.go:289] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jun 03 01:04:39.196953 ip-10-0-138-55 kubenswrapper[2566]: E0603 01:04:39.196909 2566 projected.go:289] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jun 03 01:04:39.196953 ip-10-0-138-55 kubenswrapper[2566]: E0603 01:04:39.196921 2566 projected.go:194] Error preparing data for projected volume kube-api-access-whmvg for pod openshift-network-diagnostics/network-check-target-k9zdx: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 03 01:04:39.197127 ip-10-0-138-55 kubenswrapper[2566]: E0603 01:04:39.196981 2566 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/8bb0d88a-f4ad-42ec-b814-3d13ba6e8a3f-kube-api-access-whmvg podName:8bb0d88a-f4ad-42ec-b814-3d13ba6e8a3f nodeName:}" failed. No retries permitted until 2026-06-03 01:04:40.196962662 +0000 UTC m=+3.343804589 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "kube-api-access-whmvg" (UniqueName: "kubernetes.io/projected/8bb0d88a-f4ad-42ec-b814-3d13ba6e8a3f-kube-api-access-whmvg") pod "network-check-target-k9zdx" (UID: "8bb0d88a-f4ad-42ec-b814-3d13ba6e8a3f") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 03 01:04:39.310967 ip-10-0-138-55 kubenswrapper[2566]: I0603 01:04:39.310747 2566 reflector.go:430] "Caches populated" type="*v1.RuntimeClass" reflector="k8s.io/client-go/informers/factory.go:160" Jun 03 01:04:39.470618 ip-10-0-138-55 kubenswrapper[2566]: I0603 01:04:39.470366 2566 reflector.go:430] "Caches populated" type="*v1.CSIDriver" reflector="k8s.io/client-go/informers/factory.go:160" Jun 03 01:04:39.527018 ip-10-0-138-55 kubenswrapper[2566]: I0603 01:04:39.526974 2566 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kubelet-serving" expiration="2028-06-02 00:59:38 +0000 UTC" deadline="2028-01-21 11:48:22.466266682 +0000 UTC" Jun 03 01:04:39.527018 ip-10-0-138-55 kubenswrapper[2566]: I0603 01:04:39.527014 2566 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kubelet-serving" sleep="14338h43m42.93925541s" Jun 03 01:04:39.633791 ip-10-0-138-55 kubenswrapper[2566]: I0603 01:04:39.633664 2566 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-network-operator/iptables-alerter-46tk7" event={"ID":"4ddf5288-34de-4f9b-a70d-6024cc36f81a","Type":"ContainerStarted","Data":"3a20ab51716d641c4a3d5d0b3f35140f836103ecc0abe417c0c4eda421bbbc54"} Jun 03 01:04:39.645212 ip-10-0-138-55 kubenswrapper[2566]: I0603 01:04:39.645141 2566 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-138-55.ec2.internal" event={"ID":"441c506c4adc726a5846cc275e644767","Type":"ContainerStarted","Data":"32bd4b15be25307cd3c554b738e9c5d2bc816244396d4ed78c4e53fcf91f1dee"} Jun 03 01:04:39.662309 ip-10-0-138-55 kubenswrapper[2566]: I0603 01:04:39.662256 2566 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-c2smc" event={"ID":"38c378b4-8f35-4e5f-8b38-83e4c61f9d9d","Type":"ContainerStarted","Data":"07688823d0de6517267ded4fae30e05cb7d07c9aa2835e580bef9eee012370bd"} Jun 03 01:04:39.671644 ip-10-0-138-55 kubenswrapper[2566]: I0603 01:04:39.671615 2566 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-node-tuning-operator/tuned-jj7f8" event={"ID":"a7e6e57f-fea2-40e8-a12b-c39140993cc5","Type":"ContainerStarted","Data":"7ea7d472a3e07f2ba0379e8ac07c2dfeff38646cbc53473640a1e70369c63857"} Jun 03 01:04:39.685307 ip-10-0-138-55 kubenswrapper[2566]: I0603 01:04:39.685103 2566 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/node-ca-wl5n2" event={"ID":"3e693b71-7178-4400-bdfa-91a820886ab1","Type":"ContainerStarted","Data":"b39cac53cf6bbd8d138084dfa4bc1e80cc35c5a014187f17da90d336f0f56101"} Jun 03 01:04:39.706295 ip-10-0-138-55 kubenswrapper[2566]: I0603 01:04:39.703646 2566 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-dns/node-resolver-ztzkx" event={"ID":"d3ec3632-b471-46e0-899f-54befd75838a","Type":"ContainerStarted","Data":"7f3322bda4c7a2c6c6e57d906cc30d2e27235f0bdfe45e1468d8bee60fec9aec"} Jun 03 01:04:39.726629 ip-10-0-138-55 kubenswrapper[2566]: I0603 01:04:39.726557 2566 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-138-55.ec2.internal" event={"ID":"09ebc096af5f7e7ecd11668f36b3a990","Type":"ContainerStarted","Data":"9d53db4a201504297c881918123ff980b9cf6f0cb7b2c6a665124877913d9a93"} Jun 03 01:04:39.742576 ip-10-0-138-55 kubenswrapper[2566]: I0603 01:04:39.742524 2566 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kube-system/konnectivity-agent-fg4j4" event={"ID":"684e9f6d-abe0-4f60-af14-564c495677cc","Type":"ContainerStarted","Data":"fac85eb676bdff808e368780cd0528586df5682d7ececffbf7ae9e4896c391a0"} Jun 03 01:04:39.752549 ip-10-0-138-55 kubenswrapper[2566]: I0603 01:04:39.752478 2566 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-frg76" event={"ID":"3b24c36b-015d-4776-8999-95b23959ff67","Type":"ContainerStarted","Data":"bdc15f47828657d2a259939e1402a3ace08724faa62e4c8dffe139e4c9fb8204"} Jun 03 01:04:39.762989 ip-10-0-138-55 kubenswrapper[2566]: I0603 01:04:39.762951 2566 reflector.go:430] "Caches populated" type="*v1.Service" reflector="k8s.io/client-go/informers/factory.go:160" Jun 03 01:04:39.771046 ip-10-0-138-55 kubenswrapper[2566]: I0603 01:04:39.770990 2566 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-lsx7q" event={"ID":"20148712-f92b-4521-92b1-e00d0c2571c9","Type":"ContainerStarted","Data":"dd0d54f219407bf46952c0dd28e50d97297d2d7b3f23e6b6f92f59963da28c43"} Jun 03 01:04:39.777862 ip-10-0-138-55 kubenswrapper[2566]: I0603 01:04:39.775793 2566 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-gvsbt" event={"ID":"7a085832-7923-4e02-b929-f85fe37838f3","Type":"ContainerStarted","Data":"2759ed510e1067eb5a77053b50236584437513c25db28cc503f712cf8a95b7fa"} Jun 03 01:04:40.103574 ip-10-0-138-55 kubenswrapper[2566]: I0603 01:04:40.103537 2566 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/9b00548d-2314-42e7-ab92-ed1462bba025-metrics-certs\") pod \"network-metrics-daemon-vzflm\" (UID: \"9b00548d-2314-42e7-ab92-ed1462bba025\") " pod="openshift-multus/network-metrics-daemon-vzflm" Jun 03 01:04:40.103752 ip-10-0-138-55 kubenswrapper[2566]: E0603 01:04:40.103703 2566 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jun 03 01:04:40.103817 ip-10-0-138-55 kubenswrapper[2566]: E0603 01:04:40.103766 2566 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/9b00548d-2314-42e7-ab92-ed1462bba025-metrics-certs podName:9b00548d-2314-42e7-ab92-ed1462bba025 nodeName:}" failed. No retries permitted until 2026-06-03 01:04:42.103748494 +0000 UTC m=+5.250590421 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/9b00548d-2314-42e7-ab92-ed1462bba025-metrics-certs") pod "network-metrics-daemon-vzflm" (UID: "9b00548d-2314-42e7-ab92-ed1462bba025") : object "openshift-multus"/"metrics-daemon-secret" not registered Jun 03 01:04:40.204145 ip-10-0-138-55 kubenswrapper[2566]: I0603 01:04:40.204040 2566 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-whmvg\" (UniqueName: \"kubernetes.io/projected/8bb0d88a-f4ad-42ec-b814-3d13ba6e8a3f-kube-api-access-whmvg\") pod \"network-check-target-k9zdx\" (UID: \"8bb0d88a-f4ad-42ec-b814-3d13ba6e8a3f\") " pod="openshift-network-diagnostics/network-check-target-k9zdx" Jun 03 01:04:40.204327 ip-10-0-138-55 kubenswrapper[2566]: E0603 01:04:40.204216 2566 projected.go:289] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jun 03 01:04:40.204327 ip-10-0-138-55 kubenswrapper[2566]: E0603 01:04:40.204257 2566 projected.go:289] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jun 03 01:04:40.204327 ip-10-0-138-55 kubenswrapper[2566]: E0603 01:04:40.204271 2566 projected.go:194] Error preparing data for projected volume kube-api-access-whmvg for pod openshift-network-diagnostics/network-check-target-k9zdx: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 03 01:04:40.204500 ip-10-0-138-55 kubenswrapper[2566]: E0603 01:04:40.204332 2566 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/8bb0d88a-f4ad-42ec-b814-3d13ba6e8a3f-kube-api-access-whmvg podName:8bb0d88a-f4ad-42ec-b814-3d13ba6e8a3f nodeName:}" failed. No retries permitted until 2026-06-03 01:04:42.204312328 +0000 UTC m=+5.351154264 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "kube-api-access-whmvg" (UniqueName: "kubernetes.io/projected/8bb0d88a-f4ad-42ec-b814-3d13ba6e8a3f-kube-api-access-whmvg") pod "network-check-target-k9zdx" (UID: "8bb0d88a-f4ad-42ec-b814-3d13ba6e8a3f") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 03 01:04:40.527650 ip-10-0-138-55 kubenswrapper[2566]: I0603 01:04:40.527523 2566 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kubelet-serving" expiration="2028-06-02 00:59:38 +0000 UTC" deadline="2027-11-11 06:52:40.42844261 +0000 UTC" Jun 03 01:04:40.527650 ip-10-0-138-55 kubenswrapper[2566]: I0603 01:04:40.527562 2566 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kubelet-serving" sleep="12629h47m59.900884372s" Jun 03 01:04:40.585683 ip-10-0-138-55 kubenswrapper[2566]: I0603 01:04:40.585646 2566 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-k9zdx" Jun 03 01:04:40.585865 ip-10-0-138-55 kubenswrapper[2566]: E0603 01:04:40.585776 2566 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-k9zdx" podUID="8bb0d88a-f4ad-42ec-b814-3d13ba6e8a3f" Jun 03 01:04:40.586204 ip-10-0-138-55 kubenswrapper[2566]: I0603 01:04:40.586183 2566 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-vzflm" Jun 03 01:04:40.586326 ip-10-0-138-55 kubenswrapper[2566]: E0603 01:04:40.586307 2566 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-vzflm" podUID="9b00548d-2314-42e7-ab92-ed1462bba025" Jun 03 01:04:42.122042 ip-10-0-138-55 kubenswrapper[2566]: I0603 01:04:42.121999 2566 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/9b00548d-2314-42e7-ab92-ed1462bba025-metrics-certs\") pod \"network-metrics-daemon-vzflm\" (UID: \"9b00548d-2314-42e7-ab92-ed1462bba025\") " pod="openshift-multus/network-metrics-daemon-vzflm" Jun 03 01:04:42.122501 ip-10-0-138-55 kubenswrapper[2566]: E0603 01:04:42.122167 2566 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jun 03 01:04:42.122501 ip-10-0-138-55 kubenswrapper[2566]: E0603 01:04:42.122254 2566 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/9b00548d-2314-42e7-ab92-ed1462bba025-metrics-certs podName:9b00548d-2314-42e7-ab92-ed1462bba025 nodeName:}" failed. No retries permitted until 2026-06-03 01:04:46.122215805 +0000 UTC m=+9.269057735 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/9b00548d-2314-42e7-ab92-ed1462bba025-metrics-certs") pod "network-metrics-daemon-vzflm" (UID: "9b00548d-2314-42e7-ab92-ed1462bba025") : object "openshift-multus"/"metrics-daemon-secret" not registered Jun 03 01:04:42.222760 ip-10-0-138-55 kubenswrapper[2566]: I0603 01:04:42.222631 2566 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-whmvg\" (UniqueName: \"kubernetes.io/projected/8bb0d88a-f4ad-42ec-b814-3d13ba6e8a3f-kube-api-access-whmvg\") pod \"network-check-target-k9zdx\" (UID: \"8bb0d88a-f4ad-42ec-b814-3d13ba6e8a3f\") " pod="openshift-network-diagnostics/network-check-target-k9zdx" Jun 03 01:04:42.222951 ip-10-0-138-55 kubenswrapper[2566]: E0603 01:04:42.222813 2566 projected.go:289] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jun 03 01:04:42.222951 ip-10-0-138-55 kubenswrapper[2566]: E0603 01:04:42.222841 2566 projected.go:289] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jun 03 01:04:42.222951 ip-10-0-138-55 kubenswrapper[2566]: E0603 01:04:42.222854 2566 projected.go:194] Error preparing data for projected volume kube-api-access-whmvg for pod openshift-network-diagnostics/network-check-target-k9zdx: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 03 01:04:42.222951 ip-10-0-138-55 kubenswrapper[2566]: E0603 01:04:42.222918 2566 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/8bb0d88a-f4ad-42ec-b814-3d13ba6e8a3f-kube-api-access-whmvg podName:8bb0d88a-f4ad-42ec-b814-3d13ba6e8a3f nodeName:}" failed. No retries permitted until 2026-06-03 01:04:46.22289797 +0000 UTC m=+9.369739895 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "kube-api-access-whmvg" (UniqueName: "kubernetes.io/projected/8bb0d88a-f4ad-42ec-b814-3d13ba6e8a3f-kube-api-access-whmvg") pod "network-check-target-k9zdx" (UID: "8bb0d88a-f4ad-42ec-b814-3d13ba6e8a3f") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 03 01:04:42.586004 ip-10-0-138-55 kubenswrapper[2566]: I0603 01:04:42.585834 2566 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-vzflm" Jun 03 01:04:42.586004 ip-10-0-138-55 kubenswrapper[2566]: I0603 01:04:42.585873 2566 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-k9zdx" Jun 03 01:04:42.586004 ip-10-0-138-55 kubenswrapper[2566]: E0603 01:04:42.585982 2566 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-vzflm" podUID="9b00548d-2314-42e7-ab92-ed1462bba025" Jun 03 01:04:42.586339 ip-10-0-138-55 kubenswrapper[2566]: E0603 01:04:42.586107 2566 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-k9zdx" podUID="8bb0d88a-f4ad-42ec-b814-3d13ba6e8a3f" Jun 03 01:04:44.585713 ip-10-0-138-55 kubenswrapper[2566]: I0603 01:04:44.585681 2566 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-k9zdx" Jun 03 01:04:44.586174 ip-10-0-138-55 kubenswrapper[2566]: I0603 01:04:44.585691 2566 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-vzflm" Jun 03 01:04:44.586174 ip-10-0-138-55 kubenswrapper[2566]: E0603 01:04:44.585818 2566 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-k9zdx" podUID="8bb0d88a-f4ad-42ec-b814-3d13ba6e8a3f" Jun 03 01:04:44.586174 ip-10-0-138-55 kubenswrapper[2566]: E0603 01:04:44.585928 2566 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-vzflm" podUID="9b00548d-2314-42e7-ab92-ed1462bba025" Jun 03 01:04:46.157704 ip-10-0-138-55 kubenswrapper[2566]: I0603 01:04:46.157125 2566 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/9b00548d-2314-42e7-ab92-ed1462bba025-metrics-certs\") pod \"network-metrics-daemon-vzflm\" (UID: \"9b00548d-2314-42e7-ab92-ed1462bba025\") " pod="openshift-multus/network-metrics-daemon-vzflm" Jun 03 01:04:46.157704 ip-10-0-138-55 kubenswrapper[2566]: E0603 01:04:46.157288 2566 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jun 03 01:04:46.157704 ip-10-0-138-55 kubenswrapper[2566]: E0603 01:04:46.157359 2566 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/9b00548d-2314-42e7-ab92-ed1462bba025-metrics-certs podName:9b00548d-2314-42e7-ab92-ed1462bba025 nodeName:}" failed. No retries permitted until 2026-06-03 01:04:54.157338814 +0000 UTC m=+17.304180741 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/9b00548d-2314-42e7-ab92-ed1462bba025-metrics-certs") pod "network-metrics-daemon-vzflm" (UID: "9b00548d-2314-42e7-ab92-ed1462bba025") : object "openshift-multus"/"metrics-daemon-secret" not registered Jun 03 01:04:46.258380 ip-10-0-138-55 kubenswrapper[2566]: I0603 01:04:46.258341 2566 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-whmvg\" (UniqueName: \"kubernetes.io/projected/8bb0d88a-f4ad-42ec-b814-3d13ba6e8a3f-kube-api-access-whmvg\") pod \"network-check-target-k9zdx\" (UID: \"8bb0d88a-f4ad-42ec-b814-3d13ba6e8a3f\") " pod="openshift-network-diagnostics/network-check-target-k9zdx" Jun 03 01:04:46.258535 ip-10-0-138-55 kubenswrapper[2566]: E0603 01:04:46.258494 2566 projected.go:289] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jun 03 01:04:46.258535 ip-10-0-138-55 kubenswrapper[2566]: E0603 01:04:46.258514 2566 projected.go:289] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jun 03 01:04:46.258535 ip-10-0-138-55 kubenswrapper[2566]: E0603 01:04:46.258527 2566 projected.go:194] Error preparing data for projected volume kube-api-access-whmvg for pod openshift-network-diagnostics/network-check-target-k9zdx: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 03 01:04:46.258682 ip-10-0-138-55 kubenswrapper[2566]: E0603 01:04:46.258593 2566 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/8bb0d88a-f4ad-42ec-b814-3d13ba6e8a3f-kube-api-access-whmvg podName:8bb0d88a-f4ad-42ec-b814-3d13ba6e8a3f nodeName:}" failed. No retries permitted until 2026-06-03 01:04:54.258573956 +0000 UTC m=+17.405415894 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "kube-api-access-whmvg" (UniqueName: "kubernetes.io/projected/8bb0d88a-f4ad-42ec-b814-3d13ba6e8a3f-kube-api-access-whmvg") pod "network-check-target-k9zdx" (UID: "8bb0d88a-f4ad-42ec-b814-3d13ba6e8a3f") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 03 01:04:46.586037 ip-10-0-138-55 kubenswrapper[2566]: I0603 01:04:46.585750 2566 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-vzflm" Jun 03 01:04:46.586037 ip-10-0-138-55 kubenswrapper[2566]: I0603 01:04:46.585750 2566 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-k9zdx" Jun 03 01:04:46.586037 ip-10-0-138-55 kubenswrapper[2566]: E0603 01:04:46.585886 2566 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-vzflm" podUID="9b00548d-2314-42e7-ab92-ed1462bba025" Jun 03 01:04:46.586037 ip-10-0-138-55 kubenswrapper[2566]: E0603 01:04:46.585914 2566 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-k9zdx" podUID="8bb0d88a-f4ad-42ec-b814-3d13ba6e8a3f" Jun 03 01:04:48.585957 ip-10-0-138-55 kubenswrapper[2566]: I0603 01:04:48.585709 2566 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-vzflm" Jun 03 01:04:48.586426 ip-10-0-138-55 kubenswrapper[2566]: I0603 01:04:48.585704 2566 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-k9zdx" Jun 03 01:04:48.586426 ip-10-0-138-55 kubenswrapper[2566]: E0603 01:04:48.586060 2566 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-vzflm" podUID="9b00548d-2314-42e7-ab92-ed1462bba025" Jun 03 01:04:48.586426 ip-10-0-138-55 kubenswrapper[2566]: E0603 01:04:48.586131 2566 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-k9zdx" podUID="8bb0d88a-f4ad-42ec-b814-3d13ba6e8a3f" Jun 03 01:04:50.585289 ip-10-0-138-55 kubenswrapper[2566]: I0603 01:04:50.585251 2566 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-k9zdx" Jun 03 01:04:50.585767 ip-10-0-138-55 kubenswrapper[2566]: I0603 01:04:50.585250 2566 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-vzflm" Jun 03 01:04:50.585767 ip-10-0-138-55 kubenswrapper[2566]: E0603 01:04:50.585395 2566 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-k9zdx" podUID="8bb0d88a-f4ad-42ec-b814-3d13ba6e8a3f" Jun 03 01:04:50.585767 ip-10-0-138-55 kubenswrapper[2566]: E0603 01:04:50.585485 2566 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-vzflm" podUID="9b00548d-2314-42e7-ab92-ed1462bba025" Jun 03 01:04:52.585242 ip-10-0-138-55 kubenswrapper[2566]: I0603 01:04:52.585204 2566 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-k9zdx" Jun 03 01:04:52.585666 ip-10-0-138-55 kubenswrapper[2566]: I0603 01:04:52.585204 2566 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-vzflm" Jun 03 01:04:52.585666 ip-10-0-138-55 kubenswrapper[2566]: E0603 01:04:52.585388 2566 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-k9zdx" podUID="8bb0d88a-f4ad-42ec-b814-3d13ba6e8a3f" Jun 03 01:04:52.585666 ip-10-0-138-55 kubenswrapper[2566]: E0603 01:04:52.585511 2566 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-vzflm" podUID="9b00548d-2314-42e7-ab92-ed1462bba025" Jun 03 01:04:54.214259 ip-10-0-138-55 kubenswrapper[2566]: I0603 01:04:54.214210 2566 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/9b00548d-2314-42e7-ab92-ed1462bba025-metrics-certs\") pod \"network-metrics-daemon-vzflm\" (UID: \"9b00548d-2314-42e7-ab92-ed1462bba025\") " pod="openshift-multus/network-metrics-daemon-vzflm" Jun 03 01:04:54.214697 ip-10-0-138-55 kubenswrapper[2566]: E0603 01:04:54.214357 2566 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jun 03 01:04:54.214697 ip-10-0-138-55 kubenswrapper[2566]: E0603 01:04:54.214433 2566 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/9b00548d-2314-42e7-ab92-ed1462bba025-metrics-certs podName:9b00548d-2314-42e7-ab92-ed1462bba025 nodeName:}" failed. No retries permitted until 2026-06-03 01:05:10.214411329 +0000 UTC m=+33.361253257 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/9b00548d-2314-42e7-ab92-ed1462bba025-metrics-certs") pod "network-metrics-daemon-vzflm" (UID: "9b00548d-2314-42e7-ab92-ed1462bba025") : object "openshift-multus"/"metrics-daemon-secret" not registered Jun 03 01:04:54.315308 ip-10-0-138-55 kubenswrapper[2566]: I0603 01:04:54.315271 2566 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-whmvg\" (UniqueName: \"kubernetes.io/projected/8bb0d88a-f4ad-42ec-b814-3d13ba6e8a3f-kube-api-access-whmvg\") pod \"network-check-target-k9zdx\" (UID: \"8bb0d88a-f4ad-42ec-b814-3d13ba6e8a3f\") " pod="openshift-network-diagnostics/network-check-target-k9zdx" Jun 03 01:04:54.315484 ip-10-0-138-55 kubenswrapper[2566]: E0603 01:04:54.315436 2566 projected.go:289] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jun 03 01:04:54.315484 ip-10-0-138-55 kubenswrapper[2566]: E0603 01:04:54.315462 2566 projected.go:289] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jun 03 01:04:54.315484 ip-10-0-138-55 kubenswrapper[2566]: E0603 01:04:54.315473 2566 projected.go:194] Error preparing data for projected volume kube-api-access-whmvg for pod openshift-network-diagnostics/network-check-target-k9zdx: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 03 01:04:54.315629 ip-10-0-138-55 kubenswrapper[2566]: E0603 01:04:54.315527 2566 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/8bb0d88a-f4ad-42ec-b814-3d13ba6e8a3f-kube-api-access-whmvg podName:8bb0d88a-f4ad-42ec-b814-3d13ba6e8a3f nodeName:}" failed. No retries permitted until 2026-06-03 01:05:10.315508979 +0000 UTC m=+33.462350920 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "kube-api-access-whmvg" (UniqueName: "kubernetes.io/projected/8bb0d88a-f4ad-42ec-b814-3d13ba6e8a3f-kube-api-access-whmvg") pod "network-check-target-k9zdx" (UID: "8bb0d88a-f4ad-42ec-b814-3d13ba6e8a3f") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 03 01:04:54.585468 ip-10-0-138-55 kubenswrapper[2566]: I0603 01:04:54.585385 2566 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-vzflm" Jun 03 01:04:54.585635 ip-10-0-138-55 kubenswrapper[2566]: I0603 01:04:54.585388 2566 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-k9zdx" Jun 03 01:04:54.585635 ip-10-0-138-55 kubenswrapper[2566]: E0603 01:04:54.585515 2566 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-vzflm" podUID="9b00548d-2314-42e7-ab92-ed1462bba025" Jun 03 01:04:54.585635 ip-10-0-138-55 kubenswrapper[2566]: E0603 01:04:54.585625 2566 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-k9zdx" podUID="8bb0d88a-f4ad-42ec-b814-3d13ba6e8a3f" Jun 03 01:04:56.586218 ip-10-0-138-55 kubenswrapper[2566]: I0603 01:04:56.586183 2566 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-vzflm" Jun 03 01:04:56.586218 ip-10-0-138-55 kubenswrapper[2566]: I0603 01:04:56.586209 2566 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-k9zdx" Jun 03 01:04:56.586672 ip-10-0-138-55 kubenswrapper[2566]: E0603 01:04:56.586316 2566 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-vzflm" podUID="9b00548d-2314-42e7-ab92-ed1462bba025" Jun 03 01:04:56.586672 ip-10-0-138-55 kubenswrapper[2566]: E0603 01:04:56.586474 2566 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-k9zdx" podUID="8bb0d88a-f4ad-42ec-b814-3d13ba6e8a3f" Jun 03 01:04:58.585468 ip-10-0-138-55 kubenswrapper[2566]: I0603 01:04:58.585439 2566 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-vzflm" Jun 03 01:04:58.585996 ip-10-0-138-55 kubenswrapper[2566]: E0603 01:04:58.585580 2566 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-vzflm" podUID="9b00548d-2314-42e7-ab92-ed1462bba025" Jun 03 01:04:58.585996 ip-10-0-138-55 kubenswrapper[2566]: I0603 01:04:58.585673 2566 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-k9zdx" Jun 03 01:04:58.585996 ip-10-0-138-55 kubenswrapper[2566]: E0603 01:04:58.585746 2566 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-k9zdx" podUID="8bb0d88a-f4ad-42ec-b814-3d13ba6e8a3f" Jun 03 01:04:58.821697 ip-10-0-138-55 kubenswrapper[2566]: I0603 01:04:58.821472 2566 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-lsx7q" event={"ID":"20148712-f92b-4521-92b1-e00d0c2571c9","Type":"ContainerStarted","Data":"b4228270aeb0e4e3b121c4abc2ecfa0f867fc0caf8864beeb1febb7691d49b50"} Jun 03 01:04:58.822798 ip-10-0-138-55 kubenswrapper[2566]: I0603 01:04:58.822773 2566 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-gvsbt" event={"ID":"7a085832-7923-4e02-b929-f85fe37838f3","Type":"ContainerStarted","Data":"4743d28600c5d809c27e61b1c9b06a2f56c576ee0a979f45758f07ffb592d46e"} Jun 03 01:04:58.823854 ip-10-0-138-55 kubenswrapper[2566]: I0603 01:04:58.823834 2566 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-138-55.ec2.internal" event={"ID":"441c506c4adc726a5846cc275e644767","Type":"ContainerStarted","Data":"4553761144ff783f7e0e1b8bde49d5b02e79f150a201cb1708140b5b66f8db26"} Jun 03 01:04:58.825918 ip-10-0-138-55 kubenswrapper[2566]: I0603 01:04:58.825897 2566 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-c2smc" event={"ID":"38c378b4-8f35-4e5f-8b38-83e4c61f9d9d","Type":"ContainerStarted","Data":"10cf3f2c77a53852c1ba4937b72c639d8b0a51dc88485e79f7c0b1ba00275ffd"} Jun 03 01:04:58.825997 ip-10-0-138-55 kubenswrapper[2566]: I0603 01:04:58.825924 2566 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-c2smc" event={"ID":"38c378b4-8f35-4e5f-8b38-83e4c61f9d9d","Type":"ContainerStarted","Data":"869edeb24e3711b43a124445df98a03a2a439a47b990c1773748210abf3dc33a"} Jun 03 01:04:58.825997 ip-10-0-138-55 kubenswrapper[2566]: I0603 01:04:58.825936 2566 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-c2smc" event={"ID":"38c378b4-8f35-4e5f-8b38-83e4c61f9d9d","Type":"ContainerStarted","Data":"cffa2ae646d09877af529783ad17602adabd874c72f48eab8ed1557408443813"} Jun 03 01:04:58.825997 ip-10-0-138-55 kubenswrapper[2566]: I0603 01:04:58.825948 2566 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-c2smc" event={"ID":"38c378b4-8f35-4e5f-8b38-83e4c61f9d9d","Type":"ContainerStarted","Data":"f13185d0c3730c139e80434b5aaf6fc4bd1189c2e8e104c8738ca6b5daa4f700"} Jun 03 01:04:58.827024 ip-10-0-138-55 kubenswrapper[2566]: I0603 01:04:58.827006 2566 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-node-tuning-operator/tuned-jj7f8" event={"ID":"a7e6e57f-fea2-40e8-a12b-c39140993cc5","Type":"ContainerStarted","Data":"3e26ae776e0e3e8bdb6a4b358de6193fbdc5ad515905b9fa30c05eb41921c845"} Jun 03 01:04:58.828142 ip-10-0-138-55 kubenswrapper[2566]: I0603 01:04:58.828124 2566 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/node-ca-wl5n2" event={"ID":"3e693b71-7178-4400-bdfa-91a820886ab1","Type":"ContainerStarted","Data":"305087be2a6bc4454e5fd63f75fbf558547ee46fa43e951a89fbf79c76f3b4ef"} Jun 03 01:04:58.829249 ip-10-0-138-55 kubenswrapper[2566]: I0603 01:04:58.829168 2566 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-dns/node-resolver-ztzkx" event={"ID":"d3ec3632-b471-46e0-899f-54befd75838a","Type":"ContainerStarted","Data":"806ef9c04b36a5160011db73bf8c1bb483c3a0d20d3534bcef31f61dddb8eb12"} Jun 03 01:04:58.830467 ip-10-0-138-55 kubenswrapper[2566]: I0603 01:04:58.830449 2566 generic.go:358] "Generic (PLEG): container finished" podID="09ebc096af5f7e7ecd11668f36b3a990" containerID="b2776876813421ce3ad5f07f9fef6050a7636788d9fa70f141fd2fc0cc6e8c2a" exitCode=0 Jun 03 01:04:58.830546 ip-10-0-138-55 kubenswrapper[2566]: I0603 01:04:58.830532 2566 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-138-55.ec2.internal" event={"ID":"09ebc096af5f7e7ecd11668f36b3a990","Type":"ContainerDied","Data":"b2776876813421ce3ad5f07f9fef6050a7636788d9fa70f141fd2fc0cc6e8c2a"} Jun 03 01:04:58.831783 ip-10-0-138-55 kubenswrapper[2566]: I0603 01:04:58.831759 2566 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kube-system/konnectivity-agent-fg4j4" event={"ID":"684e9f6d-abe0-4f60-af14-564c495677cc","Type":"ContainerStarted","Data":"b6cba7b2d523e0673042ca848680ed383aa313d0a2ebc8d324d69e75e4a22631"} Jun 03 01:04:58.832922 ip-10-0-138-55 kubenswrapper[2566]: I0603 01:04:58.832902 2566 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-frg76" event={"ID":"3b24c36b-015d-4776-8999-95b23959ff67","Type":"ContainerStarted","Data":"1a9fd1068b01bee443dfb7f1d7164ff0c6fe9e08b12f2a92d49a08abdc08cfad"} Jun 03 01:04:58.855151 ip-10-0-138-55 kubenswrapper[2566]: I0603 01:04:58.855115 2566 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-multus/multus-frg76" podStartSLOduration=2.607944362 podStartE2EDuration="21.855104504s" podCreationTimestamp="2026-06-03 01:04:37 +0000 UTC" firstStartedPulling="2026-06-03 01:04:38.890525157 +0000 UTC m=+2.037367081" lastFinishedPulling="2026-06-03 01:04:58.137685296 +0000 UTC m=+21.284527223" observedRunningTime="2026-06-03 01:04:58.854977791 +0000 UTC m=+22.001819734" watchObservedRunningTime="2026-06-03 01:04:58.855104504 +0000 UTC m=+22.001946484" Jun 03 01:04:58.883234 ip-10-0-138-55 kubenswrapper[2566]: I0603 01:04:58.883180 2566 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-cluster-node-tuning-operator/tuned-jj7f8" podStartSLOduration=2.610079923 podStartE2EDuration="21.883165683s" podCreationTimestamp="2026-06-03 01:04:37 +0000 UTC" firstStartedPulling="2026-06-03 01:04:38.856681553 +0000 UTC m=+2.003523477" lastFinishedPulling="2026-06-03 01:04:58.129767306 +0000 UTC m=+21.276609237" observedRunningTime="2026-06-03 01:04:58.883033087 +0000 UTC m=+22.029875036" watchObservedRunningTime="2026-06-03 01:04:58.883165683 +0000 UTC m=+22.030007629" Jun 03 01:04:58.883745 ip-10-0-138-55 kubenswrapper[2566]: I0603 01:04:58.883712 2566 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-image-registry/node-ca-wl5n2" podStartSLOduration=2.607360139 podStartE2EDuration="21.88370194s" podCreationTimestamp="2026-06-03 01:04:37 +0000 UTC" firstStartedPulling="2026-06-03 01:04:38.797987549 +0000 UTC m=+1.944829473" lastFinishedPulling="2026-06-03 01:04:58.074329348 +0000 UTC m=+21.221171274" observedRunningTime="2026-06-03 01:04:58.868412611 +0000 UTC m=+22.015254557" watchObservedRunningTime="2026-06-03 01:04:58.88370194 +0000 UTC m=+22.030543886" Jun 03 01:04:58.899559 ip-10-0-138-55 kubenswrapper[2566]: I0603 01:04:58.899519 2566 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="kube-system/konnectivity-agent-fg4j4" podStartSLOduration=2.7460787939999998 podStartE2EDuration="21.899507569s" podCreationTimestamp="2026-06-03 01:04:37 +0000 UTC" firstStartedPulling="2026-06-03 01:04:38.921332745 +0000 UTC m=+2.068174673" lastFinishedPulling="2026-06-03 01:04:58.074761523 +0000 UTC m=+21.221603448" observedRunningTime="2026-06-03 01:04:58.898738594 +0000 UTC m=+22.045580540" watchObservedRunningTime="2026-06-03 01:04:58.899507569 +0000 UTC m=+22.046349516" Jun 03 01:04:58.911757 ip-10-0-138-55 kubenswrapper[2566]: I0603 01:04:58.911716 2566 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="kube-system/kube-apiserver-proxy-ip-10-0-138-55.ec2.internal" podStartSLOduration=21.91170236 podStartE2EDuration="21.91170236s" podCreationTimestamp="2026-06-03 01:04:37 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2026-06-03 01:04:58.911156961 +0000 UTC m=+22.057998904" watchObservedRunningTime="2026-06-03 01:04:58.91170236 +0000 UTC m=+22.058544308" Jun 03 01:04:58.939183 ip-10-0-138-55 kubenswrapper[2566]: I0603 01:04:58.939149 2566 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-dns/node-resolver-ztzkx" podStartSLOduration=2.650352441 podStartE2EDuration="21.939137523s" podCreationTimestamp="2026-06-03 01:04:37 +0000 UTC" firstStartedPulling="2026-06-03 01:04:38.785818976 +0000 UTC m=+1.932660899" lastFinishedPulling="2026-06-03 01:04:58.074604042 +0000 UTC m=+21.221445981" observedRunningTime="2026-06-03 01:04:58.938708773 +0000 UTC m=+22.085550719" watchObservedRunningTime="2026-06-03 01:04:58.939137523 +0000 UTC m=+22.085979468" Jun 03 01:04:59.837081 ip-10-0-138-55 kubenswrapper[2566]: I0603 01:04:59.836997 2566 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-network-operator/iptables-alerter-46tk7" event={"ID":"4ddf5288-34de-4f9b-a70d-6024cc36f81a","Type":"ContainerStarted","Data":"a39ab728c0d8f24ccbc06e66664d00b091db2647c937b63f2c9118e5b91490ff"} Jun 03 01:04:59.840795 ip-10-0-138-55 kubenswrapper[2566]: I0603 01:04:59.839979 2566 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-c2smc" event={"ID":"38c378b4-8f35-4e5f-8b38-83e4c61f9d9d","Type":"ContainerStarted","Data":"3d4e530bba5eeebddd7c936ac68184f22619340b3c91c053f81f775648f3619b"} Jun 03 01:04:59.840795 ip-10-0-138-55 kubenswrapper[2566]: I0603 01:04:59.840014 2566 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-c2smc" event={"ID":"38c378b4-8f35-4e5f-8b38-83e4c61f9d9d","Type":"ContainerStarted","Data":"cc96484699035873c1ccf5a974186ab054e70a77ccef5c1f062061b87e524bf3"} Jun 03 01:04:59.842595 ip-10-0-138-55 kubenswrapper[2566]: I0603 01:04:59.842570 2566 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-138-55.ec2.internal" event={"ID":"09ebc096af5f7e7ecd11668f36b3a990","Type":"ContainerStarted","Data":"e5e1682ba9f25b236dbae29c6b8bab328e7a540e444c6b09b23f535f6ac360b8"} Jun 03 01:04:59.843826 ip-10-0-138-55 kubenswrapper[2566]: I0603 01:04:59.843799 2566 generic.go:358] "Generic (PLEG): container finished" podID="20148712-f92b-4521-92b1-e00d0c2571c9" containerID="b4228270aeb0e4e3b121c4abc2ecfa0f867fc0caf8864beeb1febb7691d49b50" exitCode=0 Jun 03 01:04:59.843935 ip-10-0-138-55 kubenswrapper[2566]: I0603 01:04:59.843899 2566 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-lsx7q" event={"ID":"20148712-f92b-4521-92b1-e00d0c2571c9","Type":"ContainerDied","Data":"b4228270aeb0e4e3b121c4abc2ecfa0f867fc0caf8864beeb1febb7691d49b50"} Jun 03 01:04:59.851163 ip-10-0-138-55 kubenswrapper[2566]: I0603 01:04:59.851131 2566 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-network-operator/iptables-alerter-46tk7" podStartSLOduration=3.589862379 podStartE2EDuration="22.851120722s" podCreationTimestamp="2026-06-03 01:04:37 +0000 UTC" firstStartedPulling="2026-06-03 01:04:38.813066598 +0000 UTC m=+1.959908522" lastFinishedPulling="2026-06-03 01:04:58.074324937 +0000 UTC m=+21.221166865" observedRunningTime="2026-06-03 01:04:59.851046745 +0000 UTC m=+22.997888691" watchObservedRunningTime="2026-06-03 01:04:59.851120722 +0000 UTC m=+22.997962667" Jun 03 01:04:59.863933 ip-10-0-138-55 kubenswrapper[2566]: I0603 01:04:59.863897 2566 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-138-55.ec2.internal" podStartSLOduration=22.863887555 podStartE2EDuration="22.863887555s" podCreationTimestamp="2026-06-03 01:04:37 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2026-06-03 01:04:59.863606638 +0000 UTC m=+23.010448585" watchObservedRunningTime="2026-06-03 01:04:59.863887555 +0000 UTC m=+23.010729500" Jun 03 01:04:59.886101 ip-10-0-138-55 kubenswrapper[2566]: I0603 01:04:59.886076 2566 plugin_watcher.go:194] "Adding socket path or updating timestamp to desired state cache" path="/var/lib/kubelet/plugins_registry/ebs.csi.aws.com-reg.sock" Jun 03 01:05:00.550823 ip-10-0-138-55 kubenswrapper[2566]: I0603 01:05:00.550627 2566 reconciler.go:161] "OperationExecutor.RegisterPlugin started" plugin={"SocketPath":"/var/lib/kubelet/plugins_registry/ebs.csi.aws.com-reg.sock","Timestamp":"2026-06-03T01:04:59.886096851Z","UUID":"b8bfeb61-3327-4889-9867-a8c2119e1fc4","Handler":null,"Name":"","Endpoint":""} Jun 03 01:05:00.553840 ip-10-0-138-55 kubenswrapper[2566]: I0603 01:05:00.553815 2566 csi_plugin.go:106] kubernetes.io/csi: Trying to validate a new CSI Driver with name: ebs.csi.aws.com endpoint: /var/lib/kubelet/plugins/ebs.csi.aws.com/csi.sock versions: 1.0.0 Jun 03 01:05:00.553840 ip-10-0-138-55 kubenswrapper[2566]: I0603 01:05:00.553846 2566 csi_plugin.go:119] kubernetes.io/csi: Register new plugin with name: ebs.csi.aws.com at endpoint: /var/lib/kubelet/plugins/ebs.csi.aws.com/csi.sock Jun 03 01:05:00.585237 ip-10-0-138-55 kubenswrapper[2566]: I0603 01:05:00.585208 2566 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-k9zdx" Jun 03 01:05:00.585383 ip-10-0-138-55 kubenswrapper[2566]: I0603 01:05:00.585211 2566 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-vzflm" Jun 03 01:05:00.585383 ip-10-0-138-55 kubenswrapper[2566]: E0603 01:05:00.585343 2566 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-k9zdx" podUID="8bb0d88a-f4ad-42ec-b814-3d13ba6e8a3f" Jun 03 01:05:00.585498 ip-10-0-138-55 kubenswrapper[2566]: E0603 01:05:00.585446 2566 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-vzflm" podUID="9b00548d-2314-42e7-ab92-ed1462bba025" Jun 03 01:05:00.848059 ip-10-0-138-55 kubenswrapper[2566]: I0603 01:05:00.848022 2566 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-gvsbt" event={"ID":"7a085832-7923-4e02-b929-f85fe37838f3","Type":"ContainerStarted","Data":"4c8ebd1d212234021ff5c15835b2dbf907961269f02bbae6d72cc2fb71b43fc8"} Jun 03 01:05:00.848555 ip-10-0-138-55 kubenswrapper[2566]: I0603 01:05:00.848071 2566 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-gvsbt" event={"ID":"7a085832-7923-4e02-b929-f85fe37838f3","Type":"ContainerStarted","Data":"e15eea979a31e15519bd9676542a6850834f8eb8e1ea3dbadca89958c172b5fd"} Jun 03 01:05:00.853996 ip-10-0-138-55 kubenswrapper[2566]: I0603 01:05:00.853972 2566 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="kube-system/konnectivity-agent-fg4j4" Jun 03 01:05:00.854600 ip-10-0-138-55 kubenswrapper[2566]: I0603 01:05:00.854578 2566 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="started" pod="kube-system/konnectivity-agent-fg4j4" Jun 03 01:05:00.864022 ip-10-0-138-55 kubenswrapper[2566]: I0603 01:05:00.863976 2566 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-gvsbt" podStartSLOduration=2.044203102 podStartE2EDuration="23.863942872s" podCreationTimestamp="2026-06-03 01:04:37 +0000 UTC" firstStartedPulling="2026-06-03 01:04:38.829790946 +0000 UTC m=+1.976632870" lastFinishedPulling="2026-06-03 01:05:00.649530704 +0000 UTC m=+23.796372640" observedRunningTime="2026-06-03 01:05:00.863615655 +0000 UTC m=+24.010457612" watchObservedRunningTime="2026-06-03 01:05:00.863942872 +0000 UTC m=+24.010784822" Jun 03 01:05:01.854580 ip-10-0-138-55 kubenswrapper[2566]: I0603 01:05:01.854542 2566 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-c2smc" event={"ID":"38c378b4-8f35-4e5f-8b38-83e4c61f9d9d","Type":"ContainerStarted","Data":"5e1edab03807c1af3e04ed2361ffea0ec0c71b341887f37410878c5644aafe04"} Jun 03 01:05:01.854954 ip-10-0-138-55 kubenswrapper[2566]: I0603 01:05:01.854895 2566 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kube-system/konnectivity-agent-fg4j4" Jun 03 01:05:01.855306 ip-10-0-138-55 kubenswrapper[2566]: I0603 01:05:01.855288 2566 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="kube-system/konnectivity-agent-fg4j4" Jun 03 01:05:02.586492 ip-10-0-138-55 kubenswrapper[2566]: I0603 01:05:02.586108 2566 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-k9zdx" Jun 03 01:05:02.586492 ip-10-0-138-55 kubenswrapper[2566]: I0603 01:05:02.586119 2566 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-vzflm" Jun 03 01:05:02.586719 ip-10-0-138-55 kubenswrapper[2566]: E0603 01:05:02.586581 2566 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-k9zdx" podUID="8bb0d88a-f4ad-42ec-b814-3d13ba6e8a3f" Jun 03 01:05:02.586719 ip-10-0-138-55 kubenswrapper[2566]: E0603 01:05:02.586691 2566 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-vzflm" podUID="9b00548d-2314-42e7-ab92-ed1462bba025" Jun 03 01:05:03.862787 ip-10-0-138-55 kubenswrapper[2566]: I0603 01:05:03.862744 2566 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-c2smc" event={"ID":"38c378b4-8f35-4e5f-8b38-83e4c61f9d9d","Type":"ContainerStarted","Data":"d9846bdbb80983bc6be3acb7d6ae163acbeb685774f9116fccbc7e56d0f9ca7d"} Jun 03 01:05:03.863613 ip-10-0-138-55 kubenswrapper[2566]: I0603 01:05:03.863129 2566 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-c2smc" Jun 03 01:05:03.863613 ip-10-0-138-55 kubenswrapper[2566]: I0603 01:05:03.863156 2566 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-c2smc" Jun 03 01:05:03.863613 ip-10-0-138-55 kubenswrapper[2566]: I0603 01:05:03.863171 2566 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-c2smc" Jun 03 01:05:03.880089 ip-10-0-138-55 kubenswrapper[2566]: I0603 01:05:03.880059 2566 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-c2smc" Jun 03 01:05:03.880259 ip-10-0-138-55 kubenswrapper[2566]: I0603 01:05:03.880188 2566 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-c2smc" Jun 03 01:05:03.891766 ip-10-0-138-55 kubenswrapper[2566]: I0603 01:05:03.891707 2566 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-ovn-kubernetes/ovnkube-node-c2smc" podStartSLOduration=7.384677112 podStartE2EDuration="26.891693167s" podCreationTimestamp="2026-06-03 01:04:37 +0000 UTC" firstStartedPulling="2026-06-03 01:04:38.897264644 +0000 UTC m=+2.044106568" lastFinishedPulling="2026-06-03 01:04:58.404280699 +0000 UTC m=+21.551122623" observedRunningTime="2026-06-03 01:05:03.891037121 +0000 UTC m=+27.037879070" watchObservedRunningTime="2026-06-03 01:05:03.891693167 +0000 UTC m=+27.038535112" Jun 03 01:05:04.585491 ip-10-0-138-55 kubenswrapper[2566]: I0603 01:05:04.585444 2566 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-k9zdx" Jun 03 01:05:04.585655 ip-10-0-138-55 kubenswrapper[2566]: E0603 01:05:04.585614 2566 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-k9zdx" podUID="8bb0d88a-f4ad-42ec-b814-3d13ba6e8a3f" Jun 03 01:05:04.585655 ip-10-0-138-55 kubenswrapper[2566]: I0603 01:05:04.585445 2566 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-vzflm" Jun 03 01:05:04.585809 ip-10-0-138-55 kubenswrapper[2566]: E0603 01:05:04.585771 2566 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-vzflm" podUID="9b00548d-2314-42e7-ab92-ed1462bba025" Jun 03 01:05:05.378456 ip-10-0-138-55 kubenswrapper[2566]: I0603 01:05:05.378245 2566 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-multus/network-metrics-daemon-vzflm"] Jun 03 01:05:05.379008 ip-10-0-138-55 kubenswrapper[2566]: I0603 01:05:05.378558 2566 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-vzflm" Jun 03 01:05:05.379008 ip-10-0-138-55 kubenswrapper[2566]: E0603 01:05:05.378691 2566 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-vzflm" podUID="9b00548d-2314-42e7-ab92-ed1462bba025" Jun 03 01:05:05.379107 ip-10-0-138-55 kubenswrapper[2566]: I0603 01:05:05.379011 2566 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-target-k9zdx"] Jun 03 01:05:05.379107 ip-10-0-138-55 kubenswrapper[2566]: I0603 01:05:05.379080 2566 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-k9zdx" Jun 03 01:05:05.379183 ip-10-0-138-55 kubenswrapper[2566]: E0603 01:05:05.379152 2566 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-k9zdx" podUID="8bb0d88a-f4ad-42ec-b814-3d13ba6e8a3f" Jun 03 01:05:05.867362 ip-10-0-138-55 kubenswrapper[2566]: I0603 01:05:05.867330 2566 generic.go:358] "Generic (PLEG): container finished" podID="20148712-f92b-4521-92b1-e00d0c2571c9" containerID="ecab24672799a1a572359196fa1486f6944b3dcb390c3631facfd70874410b7b" exitCode=0 Jun 03 01:05:05.867550 ip-10-0-138-55 kubenswrapper[2566]: I0603 01:05:05.867421 2566 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-lsx7q" event={"ID":"20148712-f92b-4521-92b1-e00d0c2571c9","Type":"ContainerDied","Data":"ecab24672799a1a572359196fa1486f6944b3dcb390c3631facfd70874410b7b"} Jun 03 01:05:06.585965 ip-10-0-138-55 kubenswrapper[2566]: I0603 01:05:06.585937 2566 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-vzflm" Jun 03 01:05:06.585965 ip-10-0-138-55 kubenswrapper[2566]: I0603 01:05:06.585974 2566 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-k9zdx" Jun 03 01:05:06.586442 ip-10-0-138-55 kubenswrapper[2566]: E0603 01:05:06.586059 2566 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-vzflm" podUID="9b00548d-2314-42e7-ab92-ed1462bba025" Jun 03 01:05:06.586442 ip-10-0-138-55 kubenswrapper[2566]: E0603 01:05:06.586160 2566 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-k9zdx" podUID="8bb0d88a-f4ad-42ec-b814-3d13ba6e8a3f" Jun 03 01:05:07.872933 ip-10-0-138-55 kubenswrapper[2566]: I0603 01:05:07.872898 2566 generic.go:358] "Generic (PLEG): container finished" podID="20148712-f92b-4521-92b1-e00d0c2571c9" containerID="142eac2c98bbba2ff6f6eb10c69ae3e367f085c589d77cac1abebf346b8ac55d" exitCode=0 Jun 03 01:05:07.873293 ip-10-0-138-55 kubenswrapper[2566]: I0603 01:05:07.872964 2566 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-lsx7q" event={"ID":"20148712-f92b-4521-92b1-e00d0c2571c9","Type":"ContainerDied","Data":"142eac2c98bbba2ff6f6eb10c69ae3e367f085c589d77cac1abebf346b8ac55d"} Jun 03 01:05:08.585438 ip-10-0-138-55 kubenswrapper[2566]: I0603 01:05:08.585252 2566 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-k9zdx" Jun 03 01:05:08.585628 ip-10-0-138-55 kubenswrapper[2566]: I0603 01:05:08.585252 2566 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-vzflm" Jun 03 01:05:08.585628 ip-10-0-138-55 kubenswrapper[2566]: E0603 01:05:08.585538 2566 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-k9zdx" podUID="8bb0d88a-f4ad-42ec-b814-3d13ba6e8a3f" Jun 03 01:05:08.585628 ip-10-0-138-55 kubenswrapper[2566]: E0603 01:05:08.585618 2566 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-vzflm" podUID="9b00548d-2314-42e7-ab92-ed1462bba025" Jun 03 01:05:09.878543 ip-10-0-138-55 kubenswrapper[2566]: I0603 01:05:09.878503 2566 generic.go:358] "Generic (PLEG): container finished" podID="20148712-f92b-4521-92b1-e00d0c2571c9" containerID="f684ee78b23a914edde4cf37fc1eb919431cad0f4096dfd1741029904d0d9525" exitCode=0 Jun 03 01:05:09.878904 ip-10-0-138-55 kubenswrapper[2566]: I0603 01:05:09.878577 2566 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-lsx7q" event={"ID":"20148712-f92b-4521-92b1-e00d0c2571c9","Type":"ContainerDied","Data":"f684ee78b23a914edde4cf37fc1eb919431cad0f4096dfd1741029904d0d9525"} Jun 03 01:05:10.231405 ip-10-0-138-55 kubenswrapper[2566]: I0603 01:05:10.231307 2566 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/9b00548d-2314-42e7-ab92-ed1462bba025-metrics-certs\") pod \"network-metrics-daemon-vzflm\" (UID: \"9b00548d-2314-42e7-ab92-ed1462bba025\") " pod="openshift-multus/network-metrics-daemon-vzflm" Jun 03 01:05:10.231557 ip-10-0-138-55 kubenswrapper[2566]: E0603 01:05:10.231435 2566 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jun 03 01:05:10.231557 ip-10-0-138-55 kubenswrapper[2566]: E0603 01:05:10.231504 2566 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/9b00548d-2314-42e7-ab92-ed1462bba025-metrics-certs podName:9b00548d-2314-42e7-ab92-ed1462bba025 nodeName:}" failed. No retries permitted until 2026-06-03 01:05:42.231484614 +0000 UTC m=+65.378326551 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/9b00548d-2314-42e7-ab92-ed1462bba025-metrics-certs") pod "network-metrics-daemon-vzflm" (UID: "9b00548d-2314-42e7-ab92-ed1462bba025") : object "openshift-multus"/"metrics-daemon-secret" not registered Jun 03 01:05:10.332284 ip-10-0-138-55 kubenswrapper[2566]: I0603 01:05:10.332218 2566 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-whmvg\" (UniqueName: \"kubernetes.io/projected/8bb0d88a-f4ad-42ec-b814-3d13ba6e8a3f-kube-api-access-whmvg\") pod \"network-check-target-k9zdx\" (UID: \"8bb0d88a-f4ad-42ec-b814-3d13ba6e8a3f\") " pod="openshift-network-diagnostics/network-check-target-k9zdx" Jun 03 01:05:10.332444 ip-10-0-138-55 kubenswrapper[2566]: E0603 01:05:10.332371 2566 projected.go:289] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jun 03 01:05:10.332444 ip-10-0-138-55 kubenswrapper[2566]: E0603 01:05:10.332391 2566 projected.go:289] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jun 03 01:05:10.332444 ip-10-0-138-55 kubenswrapper[2566]: E0603 01:05:10.332400 2566 projected.go:194] Error preparing data for projected volume kube-api-access-whmvg for pod openshift-network-diagnostics/network-check-target-k9zdx: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 03 01:05:10.332538 ip-10-0-138-55 kubenswrapper[2566]: E0603 01:05:10.332451 2566 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/8bb0d88a-f4ad-42ec-b814-3d13ba6e8a3f-kube-api-access-whmvg podName:8bb0d88a-f4ad-42ec-b814-3d13ba6e8a3f nodeName:}" failed. No retries permitted until 2026-06-03 01:05:42.332437605 +0000 UTC m=+65.479279529 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "kube-api-access-whmvg" (UniqueName: "kubernetes.io/projected/8bb0d88a-f4ad-42ec-b814-3d13ba6e8a3f-kube-api-access-whmvg") pod "network-check-target-k9zdx" (UID: "8bb0d88a-f4ad-42ec-b814-3d13ba6e8a3f") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 03 01:05:10.585672 ip-10-0-138-55 kubenswrapper[2566]: I0603 01:05:10.585594 2566 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-k9zdx" Jun 03 01:05:10.585846 ip-10-0-138-55 kubenswrapper[2566]: I0603 01:05:10.585599 2566 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-vzflm" Jun 03 01:05:10.585846 ip-10-0-138-55 kubenswrapper[2566]: E0603 01:05:10.585706 2566 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-k9zdx" podUID="8bb0d88a-f4ad-42ec-b814-3d13ba6e8a3f" Jun 03 01:05:10.585846 ip-10-0-138-55 kubenswrapper[2566]: E0603 01:05:10.585793 2566 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-vzflm" podUID="9b00548d-2314-42e7-ab92-ed1462bba025" Jun 03 01:05:11.150932 ip-10-0-138-55 kubenswrapper[2566]: I0603 01:05:11.150904 2566 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-138-55.ec2.internal" event="NodeReady" Jun 03 01:05:11.151613 ip-10-0-138-55 kubenswrapper[2566]: I0603 01:05:11.151056 2566 kubelet_node_status.go:550] "Fast updating node status as it just became ready" Jun 03 01:05:11.193178 ip-10-0-138-55 kubenswrapper[2566]: I0603 01:05:11.193149 2566 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-dns/dns-default-nvrs2"] Jun 03 01:05:11.216910 ip-10-0-138-55 kubenswrapper[2566]: I0603 01:05:11.216870 2566 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-ingress-canary/ingress-canary-vm9nr"] Jun 03 01:05:11.217071 ip-10-0-138-55 kubenswrapper[2566]: I0603 01:05:11.216923 2566 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-nvrs2" Jun 03 01:05:11.218940 ip-10-0-138-55 kubenswrapper[2566]: I0603 01:05:11.218916 2566 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"dns-default\"" Jun 03 01:05:11.219078 ip-10-0-138-55 kubenswrapper[2566]: I0603 01:05:11.219013 2566 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-dockercfg-tw28v\"" Jun 03 01:05:11.219078 ip-10-0-138-55 kubenswrapper[2566]: I0603 01:05:11.219069 2566 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-default-metrics-tls\"" Jun 03 01:05:11.240979 ip-10-0-138-55 kubenswrapper[2566]: I0603 01:05:11.240956 2566 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-dns/dns-default-nvrs2"] Jun 03 01:05:11.240979 ip-10-0-138-55 kubenswrapper[2566]: I0603 01:05:11.240981 2566 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-ingress-canary/ingress-canary-vm9nr"] Jun 03 01:05:11.241126 ip-10-0-138-55 kubenswrapper[2566]: I0603 01:05:11.241082 2566 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress-canary/ingress-canary-vm9nr" Jun 03 01:05:11.242885 ip-10-0-138-55 kubenswrapper[2566]: I0603 01:05:11.242864 2566 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress-canary\"/\"kube-root-ca.crt\"" Jun 03 01:05:11.242991 ip-10-0-138-55 kubenswrapper[2566]: I0603 01:05:11.242871 2566 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-canary\"/\"canary-serving-cert\"" Jun 03 01:05:11.242991 ip-10-0-138-55 kubenswrapper[2566]: I0603 01:05:11.242952 2566 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress-canary\"/\"openshift-service-ca.crt\"" Jun 03 01:05:11.242991 ip-10-0-138-55 kubenswrapper[2566]: I0603 01:05:11.242971 2566 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-canary\"/\"default-dockercfg-kzjqn\"" Jun 03 01:05:11.339770 ip-10-0-138-55 kubenswrapper[2566]: I0603 01:05:11.339733 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-gqwsr\" (UniqueName: \"kubernetes.io/projected/24c6861e-9230-4de3-b1b7-7edf01864353-kube-api-access-gqwsr\") pod \"dns-default-nvrs2\" (UID: \"24c6861e-9230-4de3-b1b7-7edf01864353\") " pod="openshift-dns/dns-default-nvrs2" Jun 03 01:05:11.339952 ip-10-0-138-55 kubenswrapper[2566]: I0603 01:05:11.339777 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/24c6861e-9230-4de3-b1b7-7edf01864353-config-volume\") pod \"dns-default-nvrs2\" (UID: \"24c6861e-9230-4de3-b1b7-7edf01864353\") " pod="openshift-dns/dns-default-nvrs2" Jun 03 01:05:11.339952 ip-10-0-138-55 kubenswrapper[2566]: I0603 01:05:11.339824 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/252447b2-d8a3-4d99-8302-361f32e759df-cert\") pod \"ingress-canary-vm9nr\" (UID: \"252447b2-d8a3-4d99-8302-361f32e759df\") " pod="openshift-ingress-canary/ingress-canary-vm9nr" Jun 03 01:05:11.339952 ip-10-0-138-55 kubenswrapper[2566]: I0603 01:05:11.339888 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-bgtb2\" (UniqueName: \"kubernetes.io/projected/252447b2-d8a3-4d99-8302-361f32e759df-kube-api-access-bgtb2\") pod \"ingress-canary-vm9nr\" (UID: \"252447b2-d8a3-4d99-8302-361f32e759df\") " pod="openshift-ingress-canary/ingress-canary-vm9nr" Jun 03 01:05:11.339952 ip-10-0-138-55 kubenswrapper[2566]: I0603 01:05:11.339923 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/24c6861e-9230-4de3-b1b7-7edf01864353-metrics-tls\") pod \"dns-default-nvrs2\" (UID: \"24c6861e-9230-4de3-b1b7-7edf01864353\") " pod="openshift-dns/dns-default-nvrs2" Jun 03 01:05:11.339952 ip-10-0-138-55 kubenswrapper[2566]: I0603 01:05:11.339952 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/24c6861e-9230-4de3-b1b7-7edf01864353-tmp-dir\") pod \"dns-default-nvrs2\" (UID: \"24c6861e-9230-4de3-b1b7-7edf01864353\") " pod="openshift-dns/dns-default-nvrs2" Jun 03 01:05:11.441248 ip-10-0-138-55 kubenswrapper[2566]: I0603 01:05:11.441140 2566 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/24c6861e-9230-4de3-b1b7-7edf01864353-metrics-tls\") pod \"dns-default-nvrs2\" (UID: \"24c6861e-9230-4de3-b1b7-7edf01864353\") " pod="openshift-dns/dns-default-nvrs2" Jun 03 01:05:11.441248 ip-10-0-138-55 kubenswrapper[2566]: I0603 01:05:11.441184 2566 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/24c6861e-9230-4de3-b1b7-7edf01864353-tmp-dir\") pod \"dns-default-nvrs2\" (UID: \"24c6861e-9230-4de3-b1b7-7edf01864353\") " pod="openshift-dns/dns-default-nvrs2" Jun 03 01:05:11.441471 ip-10-0-138-55 kubenswrapper[2566]: E0603 01:05:11.441318 2566 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jun 03 01:05:11.441471 ip-10-0-138-55 kubenswrapper[2566]: I0603 01:05:11.441368 2566 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-gqwsr\" (UniqueName: \"kubernetes.io/projected/24c6861e-9230-4de3-b1b7-7edf01864353-kube-api-access-gqwsr\") pod \"dns-default-nvrs2\" (UID: \"24c6861e-9230-4de3-b1b7-7edf01864353\") " pod="openshift-dns/dns-default-nvrs2" Jun 03 01:05:11.441471 ip-10-0-138-55 kubenswrapper[2566]: E0603 01:05:11.441395 2566 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/24c6861e-9230-4de3-b1b7-7edf01864353-metrics-tls podName:24c6861e-9230-4de3-b1b7-7edf01864353 nodeName:}" failed. No retries permitted until 2026-06-03 01:05:11.941378779 +0000 UTC m=+35.088220703 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/24c6861e-9230-4de3-b1b7-7edf01864353-metrics-tls") pod "dns-default-nvrs2" (UID: "24c6861e-9230-4de3-b1b7-7edf01864353") : secret "dns-default-metrics-tls" not found Jun 03 01:05:11.441471 ip-10-0-138-55 kubenswrapper[2566]: I0603 01:05:11.441425 2566 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/24c6861e-9230-4de3-b1b7-7edf01864353-config-volume\") pod \"dns-default-nvrs2\" (UID: \"24c6861e-9230-4de3-b1b7-7edf01864353\") " pod="openshift-dns/dns-default-nvrs2" Jun 03 01:05:11.441680 ip-10-0-138-55 kubenswrapper[2566]: I0603 01:05:11.441476 2566 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/252447b2-d8a3-4d99-8302-361f32e759df-cert\") pod \"ingress-canary-vm9nr\" (UID: \"252447b2-d8a3-4d99-8302-361f32e759df\") " pod="openshift-ingress-canary/ingress-canary-vm9nr" Jun 03 01:05:11.441680 ip-10-0-138-55 kubenswrapper[2566]: I0603 01:05:11.441504 2566 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-bgtb2\" (UniqueName: \"kubernetes.io/projected/252447b2-d8a3-4d99-8302-361f32e759df-kube-api-access-bgtb2\") pod \"ingress-canary-vm9nr\" (UID: \"252447b2-d8a3-4d99-8302-361f32e759df\") " pod="openshift-ingress-canary/ingress-canary-vm9nr" Jun 03 01:05:11.441680 ip-10-0-138-55 kubenswrapper[2566]: I0603 01:05:11.441530 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/24c6861e-9230-4de3-b1b7-7edf01864353-tmp-dir\") pod \"dns-default-nvrs2\" (UID: \"24c6861e-9230-4de3-b1b7-7edf01864353\") " pod="openshift-dns/dns-default-nvrs2" Jun 03 01:05:11.441680 ip-10-0-138-55 kubenswrapper[2566]: E0603 01:05:11.441652 2566 secret.go:189] Couldn't get secret openshift-ingress-canary/canary-serving-cert: secret "canary-serving-cert" not found Jun 03 01:05:11.441858 ip-10-0-138-55 kubenswrapper[2566]: E0603 01:05:11.441702 2566 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/252447b2-d8a3-4d99-8302-361f32e759df-cert podName:252447b2-d8a3-4d99-8302-361f32e759df nodeName:}" failed. No retries permitted until 2026-06-03 01:05:11.941681335 +0000 UTC m=+35.088523263 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "cert" (UniqueName: "kubernetes.io/secret/252447b2-d8a3-4d99-8302-361f32e759df-cert") pod "ingress-canary-vm9nr" (UID: "252447b2-d8a3-4d99-8302-361f32e759df") : secret "canary-serving-cert" not found Jun 03 01:05:11.442005 ip-10-0-138-55 kubenswrapper[2566]: I0603 01:05:11.441986 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/24c6861e-9230-4de3-b1b7-7edf01864353-config-volume\") pod \"dns-default-nvrs2\" (UID: \"24c6861e-9230-4de3-b1b7-7edf01864353\") " pod="openshift-dns/dns-default-nvrs2" Jun 03 01:05:11.453093 ip-10-0-138-55 kubenswrapper[2566]: I0603 01:05:11.453065 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-gqwsr\" (UniqueName: \"kubernetes.io/projected/24c6861e-9230-4de3-b1b7-7edf01864353-kube-api-access-gqwsr\") pod \"dns-default-nvrs2\" (UID: \"24c6861e-9230-4de3-b1b7-7edf01864353\") " pod="openshift-dns/dns-default-nvrs2" Jun 03 01:05:11.453272 ip-10-0-138-55 kubenswrapper[2566]: I0603 01:05:11.453189 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-bgtb2\" (UniqueName: \"kubernetes.io/projected/252447b2-d8a3-4d99-8302-361f32e759df-kube-api-access-bgtb2\") pod \"ingress-canary-vm9nr\" (UID: \"252447b2-d8a3-4d99-8302-361f32e759df\") " pod="openshift-ingress-canary/ingress-canary-vm9nr" Jun 03 01:05:11.946193 ip-10-0-138-55 kubenswrapper[2566]: I0603 01:05:11.946153 2566 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/252447b2-d8a3-4d99-8302-361f32e759df-cert\") pod \"ingress-canary-vm9nr\" (UID: \"252447b2-d8a3-4d99-8302-361f32e759df\") " pod="openshift-ingress-canary/ingress-canary-vm9nr" Jun 03 01:05:11.946386 ip-10-0-138-55 kubenswrapper[2566]: I0603 01:05:11.946213 2566 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/24c6861e-9230-4de3-b1b7-7edf01864353-metrics-tls\") pod \"dns-default-nvrs2\" (UID: \"24c6861e-9230-4de3-b1b7-7edf01864353\") " pod="openshift-dns/dns-default-nvrs2" Jun 03 01:05:11.946386 ip-10-0-138-55 kubenswrapper[2566]: E0603 01:05:11.946362 2566 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jun 03 01:05:11.946475 ip-10-0-138-55 kubenswrapper[2566]: E0603 01:05:11.946397 2566 secret.go:189] Couldn't get secret openshift-ingress-canary/canary-serving-cert: secret "canary-serving-cert" not found Jun 03 01:05:11.946475 ip-10-0-138-55 kubenswrapper[2566]: E0603 01:05:11.946427 2566 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/24c6861e-9230-4de3-b1b7-7edf01864353-metrics-tls podName:24c6861e-9230-4de3-b1b7-7edf01864353 nodeName:}" failed. No retries permitted until 2026-06-03 01:05:12.946409535 +0000 UTC m=+36.093251463 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/24c6861e-9230-4de3-b1b7-7edf01864353-metrics-tls") pod "dns-default-nvrs2" (UID: "24c6861e-9230-4de3-b1b7-7edf01864353") : secret "dns-default-metrics-tls" not found Jun 03 01:05:11.946555 ip-10-0-138-55 kubenswrapper[2566]: E0603 01:05:11.946514 2566 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/252447b2-d8a3-4d99-8302-361f32e759df-cert podName:252447b2-d8a3-4d99-8302-361f32e759df nodeName:}" failed. No retries permitted until 2026-06-03 01:05:12.946468033 +0000 UTC m=+36.093309958 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "cert" (UniqueName: "kubernetes.io/secret/252447b2-d8a3-4d99-8302-361f32e759df-cert") pod "ingress-canary-vm9nr" (UID: "252447b2-d8a3-4d99-8302-361f32e759df") : secret "canary-serving-cert" not found Jun 03 01:05:12.586039 ip-10-0-138-55 kubenswrapper[2566]: I0603 01:05:12.586002 2566 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-vzflm" Jun 03 01:05:12.586614 ip-10-0-138-55 kubenswrapper[2566]: I0603 01:05:12.586002 2566 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-k9zdx" Jun 03 01:05:12.595508 ip-10-0-138-55 kubenswrapper[2566]: I0603 01:05:12.595482 2566 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"openshift-service-ca.crt\"" Jun 03 01:05:12.596073 ip-10-0-138-55 kubenswrapper[2566]: I0603 01:05:12.596051 2566 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"kube-root-ca.crt\"" Jun 03 01:05:12.596185 ip-10-0-138-55 kubenswrapper[2566]: I0603 01:05:12.596097 2566 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-secret\"" Jun 03 01:05:12.596253 ip-10-0-138-55 kubenswrapper[2566]: I0603 01:05:12.596061 2566 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"default-dockercfg-55dgg\"" Jun 03 01:05:12.596577 ip-10-0-138-55 kubenswrapper[2566]: I0603 01:05:12.596559 2566 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-sa-dockercfg-jgszk\"" Jun 03 01:05:12.953529 ip-10-0-138-55 kubenswrapper[2566]: I0603 01:05:12.953490 2566 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/252447b2-d8a3-4d99-8302-361f32e759df-cert\") pod \"ingress-canary-vm9nr\" (UID: \"252447b2-d8a3-4d99-8302-361f32e759df\") " pod="openshift-ingress-canary/ingress-canary-vm9nr" Jun 03 01:05:12.953725 ip-10-0-138-55 kubenswrapper[2566]: I0603 01:05:12.953553 2566 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/24c6861e-9230-4de3-b1b7-7edf01864353-metrics-tls\") pod \"dns-default-nvrs2\" (UID: \"24c6861e-9230-4de3-b1b7-7edf01864353\") " pod="openshift-dns/dns-default-nvrs2" Jun 03 01:05:12.953725 ip-10-0-138-55 kubenswrapper[2566]: E0603 01:05:12.953648 2566 secret.go:189] Couldn't get secret openshift-ingress-canary/canary-serving-cert: secret "canary-serving-cert" not found Jun 03 01:05:12.953725 ip-10-0-138-55 kubenswrapper[2566]: E0603 01:05:12.953677 2566 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jun 03 01:05:12.953725 ip-10-0-138-55 kubenswrapper[2566]: E0603 01:05:12.953719 2566 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/252447b2-d8a3-4d99-8302-361f32e759df-cert podName:252447b2-d8a3-4d99-8302-361f32e759df nodeName:}" failed. No retries permitted until 2026-06-03 01:05:14.953702471 +0000 UTC m=+38.100544394 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "cert" (UniqueName: "kubernetes.io/secret/252447b2-d8a3-4d99-8302-361f32e759df-cert") pod "ingress-canary-vm9nr" (UID: "252447b2-d8a3-4d99-8302-361f32e759df") : secret "canary-serving-cert" not found Jun 03 01:05:12.953880 ip-10-0-138-55 kubenswrapper[2566]: E0603 01:05:12.953746 2566 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/24c6861e-9230-4de3-b1b7-7edf01864353-metrics-tls podName:24c6861e-9230-4de3-b1b7-7edf01864353 nodeName:}" failed. No retries permitted until 2026-06-03 01:05:14.953728136 +0000 UTC m=+38.100570076 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/24c6861e-9230-4de3-b1b7-7edf01864353-metrics-tls") pod "dns-default-nvrs2" (UID: "24c6861e-9230-4de3-b1b7-7edf01864353") : secret "dns-default-metrics-tls" not found Jun 03 01:05:14.965655 ip-10-0-138-55 kubenswrapper[2566]: I0603 01:05:14.965571 2566 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/252447b2-d8a3-4d99-8302-361f32e759df-cert\") pod \"ingress-canary-vm9nr\" (UID: \"252447b2-d8a3-4d99-8302-361f32e759df\") " pod="openshift-ingress-canary/ingress-canary-vm9nr" Jun 03 01:05:14.965655 ip-10-0-138-55 kubenswrapper[2566]: I0603 01:05:14.965630 2566 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/24c6861e-9230-4de3-b1b7-7edf01864353-metrics-tls\") pod \"dns-default-nvrs2\" (UID: \"24c6861e-9230-4de3-b1b7-7edf01864353\") " pod="openshift-dns/dns-default-nvrs2" Jun 03 01:05:14.966072 ip-10-0-138-55 kubenswrapper[2566]: E0603 01:05:14.965754 2566 secret.go:189] Couldn't get secret openshift-ingress-canary/canary-serving-cert: secret "canary-serving-cert" not found Jun 03 01:05:14.966072 ip-10-0-138-55 kubenswrapper[2566]: E0603 01:05:14.965836 2566 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/252447b2-d8a3-4d99-8302-361f32e759df-cert podName:252447b2-d8a3-4d99-8302-361f32e759df nodeName:}" failed. No retries permitted until 2026-06-03 01:05:18.96581553 +0000 UTC m=+42.112657456 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "cert" (UniqueName: "kubernetes.io/secret/252447b2-d8a3-4d99-8302-361f32e759df-cert") pod "ingress-canary-vm9nr" (UID: "252447b2-d8a3-4d99-8302-361f32e759df") : secret "canary-serving-cert" not found Jun 03 01:05:14.966072 ip-10-0-138-55 kubenswrapper[2566]: E0603 01:05:14.965749 2566 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jun 03 01:05:14.966072 ip-10-0-138-55 kubenswrapper[2566]: E0603 01:05:14.965925 2566 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/24c6861e-9230-4de3-b1b7-7edf01864353-metrics-tls podName:24c6861e-9230-4de3-b1b7-7edf01864353 nodeName:}" failed. No retries permitted until 2026-06-03 01:05:18.965909261 +0000 UTC m=+42.112751186 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/24c6861e-9230-4de3-b1b7-7edf01864353-metrics-tls") pod "dns-default-nvrs2" (UID: "24c6861e-9230-4de3-b1b7-7edf01864353") : secret "dns-default-metrics-tls" not found Jun 03 01:05:16.894291 ip-10-0-138-55 kubenswrapper[2566]: I0603 01:05:16.894258 2566 generic.go:358] "Generic (PLEG): container finished" podID="20148712-f92b-4521-92b1-e00d0c2571c9" containerID="1393b7a0e7b2506f8dae428c3d29b1d0284d7c061d2e4db5dbd83fe7358de73e" exitCode=0 Jun 03 01:05:16.894701 ip-10-0-138-55 kubenswrapper[2566]: I0603 01:05:16.894321 2566 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-lsx7q" event={"ID":"20148712-f92b-4521-92b1-e00d0c2571c9","Type":"ContainerDied","Data":"1393b7a0e7b2506f8dae428c3d29b1d0284d7c061d2e4db5dbd83fe7358de73e"} Jun 03 01:05:17.898866 ip-10-0-138-55 kubenswrapper[2566]: I0603 01:05:17.898824 2566 generic.go:358] "Generic (PLEG): container finished" podID="20148712-f92b-4521-92b1-e00d0c2571c9" containerID="f5276c256e8d357c37c160177f930fdd890b51dac7c9dcaf36ea8d6d6c5aad62" exitCode=0 Jun 03 01:05:17.899349 ip-10-0-138-55 kubenswrapper[2566]: I0603 01:05:17.898904 2566 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-lsx7q" event={"ID":"20148712-f92b-4521-92b1-e00d0c2571c9","Type":"ContainerDied","Data":"f5276c256e8d357c37c160177f930fdd890b51dac7c9dcaf36ea8d6d6c5aad62"} Jun 03 01:05:18.903706 ip-10-0-138-55 kubenswrapper[2566]: I0603 01:05:18.903673 2566 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-lsx7q" event={"ID":"20148712-f92b-4521-92b1-e00d0c2571c9","Type":"ContainerStarted","Data":"f65b1748f4ecd8b031cd00dfd16186a29db5e9e314d7bc15854fe1e296e2d110"} Jun 03 01:05:18.924413 ip-10-0-138-55 kubenswrapper[2566]: I0603 01:05:18.924364 2566 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-multus/multus-additional-cni-plugins-lsx7q" podStartSLOduration=4.619291712 podStartE2EDuration="41.924350668s" podCreationTimestamp="2026-06-03 01:04:37 +0000 UTC" firstStartedPulling="2026-06-03 01:04:38.876538182 +0000 UTC m=+2.023380106" lastFinishedPulling="2026-06-03 01:05:16.181597139 +0000 UTC m=+39.328439062" observedRunningTime="2026-06-03 01:05:18.923365282 +0000 UTC m=+42.070207228" watchObservedRunningTime="2026-06-03 01:05:18.924350668 +0000 UTC m=+42.071192613" Jun 03 01:05:18.995398 ip-10-0-138-55 kubenswrapper[2566]: I0603 01:05:18.995355 2566 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/252447b2-d8a3-4d99-8302-361f32e759df-cert\") pod \"ingress-canary-vm9nr\" (UID: \"252447b2-d8a3-4d99-8302-361f32e759df\") " pod="openshift-ingress-canary/ingress-canary-vm9nr" Jun 03 01:05:18.995596 ip-10-0-138-55 kubenswrapper[2566]: E0603 01:05:18.995488 2566 secret.go:189] Couldn't get secret openshift-ingress-canary/canary-serving-cert: secret "canary-serving-cert" not found Jun 03 01:05:18.995596 ip-10-0-138-55 kubenswrapper[2566]: I0603 01:05:18.995523 2566 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/24c6861e-9230-4de3-b1b7-7edf01864353-metrics-tls\") pod \"dns-default-nvrs2\" (UID: \"24c6861e-9230-4de3-b1b7-7edf01864353\") " pod="openshift-dns/dns-default-nvrs2" Jun 03 01:05:18.995596 ip-10-0-138-55 kubenswrapper[2566]: E0603 01:05:18.995571 2566 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/252447b2-d8a3-4d99-8302-361f32e759df-cert podName:252447b2-d8a3-4d99-8302-361f32e759df nodeName:}" failed. No retries permitted until 2026-06-03 01:05:26.995551652 +0000 UTC m=+50.142393581 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "cert" (UniqueName: "kubernetes.io/secret/252447b2-d8a3-4d99-8302-361f32e759df-cert") pod "ingress-canary-vm9nr" (UID: "252447b2-d8a3-4d99-8302-361f32e759df") : secret "canary-serving-cert" not found Jun 03 01:05:18.995731 ip-10-0-138-55 kubenswrapper[2566]: E0603 01:05:18.995604 2566 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jun 03 01:05:18.995731 ip-10-0-138-55 kubenswrapper[2566]: E0603 01:05:18.995639 2566 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/24c6861e-9230-4de3-b1b7-7edf01864353-metrics-tls podName:24c6861e-9230-4de3-b1b7-7edf01864353 nodeName:}" failed. No retries permitted until 2026-06-03 01:05:26.995627641 +0000 UTC m=+50.142469565 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/24c6861e-9230-4de3-b1b7-7edf01864353-metrics-tls") pod "dns-default-nvrs2" (UID: "24c6861e-9230-4de3-b1b7-7edf01864353") : secret "dns-default-metrics-tls" not found Jun 03 01:05:27.054588 ip-10-0-138-55 kubenswrapper[2566]: I0603 01:05:27.054548 2566 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/24c6861e-9230-4de3-b1b7-7edf01864353-metrics-tls\") pod \"dns-default-nvrs2\" (UID: \"24c6861e-9230-4de3-b1b7-7edf01864353\") " pod="openshift-dns/dns-default-nvrs2" Jun 03 01:05:27.055070 ip-10-0-138-55 kubenswrapper[2566]: I0603 01:05:27.054644 2566 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/252447b2-d8a3-4d99-8302-361f32e759df-cert\") pod \"ingress-canary-vm9nr\" (UID: \"252447b2-d8a3-4d99-8302-361f32e759df\") " pod="openshift-ingress-canary/ingress-canary-vm9nr" Jun 03 01:05:27.055070 ip-10-0-138-55 kubenswrapper[2566]: E0603 01:05:27.054705 2566 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jun 03 01:05:27.055070 ip-10-0-138-55 kubenswrapper[2566]: E0603 01:05:27.054725 2566 secret.go:189] Couldn't get secret openshift-ingress-canary/canary-serving-cert: secret "canary-serving-cert" not found Jun 03 01:05:27.055070 ip-10-0-138-55 kubenswrapper[2566]: E0603 01:05:27.054768 2566 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/24c6861e-9230-4de3-b1b7-7edf01864353-metrics-tls podName:24c6861e-9230-4de3-b1b7-7edf01864353 nodeName:}" failed. No retries permitted until 2026-06-03 01:05:43.054752918 +0000 UTC m=+66.201594847 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/24c6861e-9230-4de3-b1b7-7edf01864353-metrics-tls") pod "dns-default-nvrs2" (UID: "24c6861e-9230-4de3-b1b7-7edf01864353") : secret "dns-default-metrics-tls" not found Jun 03 01:05:27.055070 ip-10-0-138-55 kubenswrapper[2566]: E0603 01:05:27.054783 2566 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/252447b2-d8a3-4d99-8302-361f32e759df-cert podName:252447b2-d8a3-4d99-8302-361f32e759df nodeName:}" failed. No retries permitted until 2026-06-03 01:05:43.054777098 +0000 UTC m=+66.201619021 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "cert" (UniqueName: "kubernetes.io/secret/252447b2-d8a3-4d99-8302-361f32e759df-cert") pod "ingress-canary-vm9nr" (UID: "252447b2-d8a3-4d99-8302-361f32e759df") : secret "canary-serving-cert" not found Jun 03 01:05:35.878159 ip-10-0-138-55 kubenswrapper[2566]: I0603 01:05:35.878129 2566 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-c2smc" Jun 03 01:05:42.255068 ip-10-0-138-55 kubenswrapper[2566]: I0603 01:05:42.255020 2566 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/9b00548d-2314-42e7-ab92-ed1462bba025-metrics-certs\") pod \"network-metrics-daemon-vzflm\" (UID: \"9b00548d-2314-42e7-ab92-ed1462bba025\") " pod="openshift-multus/network-metrics-daemon-vzflm" Jun 03 01:05:42.257273 ip-10-0-138-55 kubenswrapper[2566]: I0603 01:05:42.257245 2566 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-secret\"" Jun 03 01:05:42.265714 ip-10-0-138-55 kubenswrapper[2566]: E0603 01:05:42.265685 2566 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: secret "metrics-daemon-secret" not found Jun 03 01:05:42.265800 ip-10-0-138-55 kubenswrapper[2566]: E0603 01:05:42.265757 2566 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/9b00548d-2314-42e7-ab92-ed1462bba025-metrics-certs podName:9b00548d-2314-42e7-ab92-ed1462bba025 nodeName:}" failed. No retries permitted until 2026-06-03 01:06:46.265740919 +0000 UTC m=+129.412582842 (durationBeforeRetry 1m4s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/9b00548d-2314-42e7-ab92-ed1462bba025-metrics-certs") pod "network-metrics-daemon-vzflm" (UID: "9b00548d-2314-42e7-ab92-ed1462bba025") : secret "metrics-daemon-secret" not found Jun 03 01:05:42.355663 ip-10-0-138-55 kubenswrapper[2566]: I0603 01:05:42.355623 2566 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-whmvg\" (UniqueName: \"kubernetes.io/projected/8bb0d88a-f4ad-42ec-b814-3d13ba6e8a3f-kube-api-access-whmvg\") pod \"network-check-target-k9zdx\" (UID: \"8bb0d88a-f4ad-42ec-b814-3d13ba6e8a3f\") " pod="openshift-network-diagnostics/network-check-target-k9zdx" Jun 03 01:05:42.357730 ip-10-0-138-55 kubenswrapper[2566]: I0603 01:05:42.357706 2566 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"kube-root-ca.crt\"" Jun 03 01:05:42.367946 ip-10-0-138-55 kubenswrapper[2566]: I0603 01:05:42.367924 2566 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"openshift-service-ca.crt\"" Jun 03 01:05:42.379289 ip-10-0-138-55 kubenswrapper[2566]: I0603 01:05:42.379268 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-whmvg\" (UniqueName: \"kubernetes.io/projected/8bb0d88a-f4ad-42ec-b814-3d13ba6e8a3f-kube-api-access-whmvg\") pod \"network-check-target-k9zdx\" (UID: \"8bb0d88a-f4ad-42ec-b814-3d13ba6e8a3f\") " pod="openshift-network-diagnostics/network-check-target-k9zdx" Jun 03 01:05:42.608431 ip-10-0-138-55 kubenswrapper[2566]: I0603 01:05:42.608407 2566 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"default-dockercfg-55dgg\"" Jun 03 01:05:42.616906 ip-10-0-138-55 kubenswrapper[2566]: I0603 01:05:42.616890 2566 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-k9zdx" Jun 03 01:05:42.744697 ip-10-0-138-55 kubenswrapper[2566]: I0603 01:05:42.744663 2566 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-target-k9zdx"] Jun 03 01:05:42.748026 ip-10-0-138-55 kubenswrapper[2566]: W0603 01:05:42.747993 2566 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod8bb0d88a_f4ad_42ec_b814_3d13ba6e8a3f.slice/crio-78e39a18d087a215a4c3b0ff7d70d72fade63fe314db61039805061b31d97a9c WatchSource:0}: Error finding container 78e39a18d087a215a4c3b0ff7d70d72fade63fe314db61039805061b31d97a9c: Status 404 returned error can't find the container with id 78e39a18d087a215a4c3b0ff7d70d72fade63fe314db61039805061b31d97a9c Jun 03 01:05:42.950385 ip-10-0-138-55 kubenswrapper[2566]: I0603 01:05:42.950291 2566 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-target-k9zdx" event={"ID":"8bb0d88a-f4ad-42ec-b814-3d13ba6e8a3f","Type":"ContainerStarted","Data":"78e39a18d087a215a4c3b0ff7d70d72fade63fe314db61039805061b31d97a9c"} Jun 03 01:05:43.060906 ip-10-0-138-55 kubenswrapper[2566]: I0603 01:05:43.060868 2566 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/252447b2-d8a3-4d99-8302-361f32e759df-cert\") pod \"ingress-canary-vm9nr\" (UID: \"252447b2-d8a3-4d99-8302-361f32e759df\") " pod="openshift-ingress-canary/ingress-canary-vm9nr" Jun 03 01:05:43.061039 ip-10-0-138-55 kubenswrapper[2566]: I0603 01:05:43.060909 2566 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/24c6861e-9230-4de3-b1b7-7edf01864353-metrics-tls\") pod \"dns-default-nvrs2\" (UID: \"24c6861e-9230-4de3-b1b7-7edf01864353\") " pod="openshift-dns/dns-default-nvrs2" Jun 03 01:05:43.061039 ip-10-0-138-55 kubenswrapper[2566]: E0603 01:05:43.061007 2566 secret.go:189] Couldn't get secret openshift-ingress-canary/canary-serving-cert: secret "canary-serving-cert" not found Jun 03 01:05:43.061121 ip-10-0-138-55 kubenswrapper[2566]: E0603 01:05:43.061058 2566 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jun 03 01:05:43.061121 ip-10-0-138-55 kubenswrapper[2566]: E0603 01:05:43.061063 2566 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/252447b2-d8a3-4d99-8302-361f32e759df-cert podName:252447b2-d8a3-4d99-8302-361f32e759df nodeName:}" failed. No retries permitted until 2026-06-03 01:06:15.061049085 +0000 UTC m=+98.207891009 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "cert" (UniqueName: "kubernetes.io/secret/252447b2-d8a3-4d99-8302-361f32e759df-cert") pod "ingress-canary-vm9nr" (UID: "252447b2-d8a3-4d99-8302-361f32e759df") : secret "canary-serving-cert" not found Jun 03 01:05:43.061121 ip-10-0-138-55 kubenswrapper[2566]: E0603 01:05:43.061096 2566 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/24c6861e-9230-4de3-b1b7-7edf01864353-metrics-tls podName:24c6861e-9230-4de3-b1b7-7edf01864353 nodeName:}" failed. No retries permitted until 2026-06-03 01:06:15.061084818 +0000 UTC m=+98.207926742 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/24c6861e-9230-4de3-b1b7-7edf01864353-metrics-tls") pod "dns-default-nvrs2" (UID: "24c6861e-9230-4de3-b1b7-7edf01864353") : secret "dns-default-metrics-tls" not found Jun 03 01:05:45.957767 ip-10-0-138-55 kubenswrapper[2566]: I0603 01:05:45.957735 2566 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-target-k9zdx" event={"ID":"8bb0d88a-f4ad-42ec-b814-3d13ba6e8a3f","Type":"ContainerStarted","Data":"d284607817486c73c66a51241009236dbc71765e9b5f5bc7f7e201c4b7d0e428"} Jun 03 01:05:45.958135 ip-10-0-138-55 kubenswrapper[2566]: I0603 01:05:45.957871 2566 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-network-diagnostics/network-check-target-k9zdx" Jun 03 01:05:45.972189 ip-10-0-138-55 kubenswrapper[2566]: I0603 01:05:45.972142 2566 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-network-diagnostics/network-check-target-k9zdx" podStartSLOduration=66.38624815 podStartE2EDuration="1m8.972127362s" podCreationTimestamp="2026-06-03 01:04:37 +0000 UTC" firstStartedPulling="2026-06-03 01:05:42.749902313 +0000 UTC m=+65.896744243" lastFinishedPulling="2026-06-03 01:05:45.335781531 +0000 UTC m=+68.482623455" observedRunningTime="2026-06-03 01:05:45.97114499 +0000 UTC m=+69.117986932" watchObservedRunningTime="2026-06-03 01:05:45.972127362 +0000 UTC m=+69.118969308" Jun 03 01:06:15.081149 ip-10-0-138-55 kubenswrapper[2566]: I0603 01:06:15.081034 2566 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/252447b2-d8a3-4d99-8302-361f32e759df-cert\") pod \"ingress-canary-vm9nr\" (UID: \"252447b2-d8a3-4d99-8302-361f32e759df\") " pod="openshift-ingress-canary/ingress-canary-vm9nr" Jun 03 01:06:15.081149 ip-10-0-138-55 kubenswrapper[2566]: I0603 01:06:15.081095 2566 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/24c6861e-9230-4de3-b1b7-7edf01864353-metrics-tls\") pod \"dns-default-nvrs2\" (UID: \"24c6861e-9230-4de3-b1b7-7edf01864353\") " pod="openshift-dns/dns-default-nvrs2" Jun 03 01:06:15.081748 ip-10-0-138-55 kubenswrapper[2566]: E0603 01:06:15.081202 2566 secret.go:189] Couldn't get secret openshift-ingress-canary/canary-serving-cert: secret "canary-serving-cert" not found Jun 03 01:06:15.081748 ip-10-0-138-55 kubenswrapper[2566]: E0603 01:06:15.081210 2566 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jun 03 01:06:15.081748 ip-10-0-138-55 kubenswrapper[2566]: E0603 01:06:15.081316 2566 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/252447b2-d8a3-4d99-8302-361f32e759df-cert podName:252447b2-d8a3-4d99-8302-361f32e759df nodeName:}" failed. No retries permitted until 2026-06-03 01:07:19.081291375 +0000 UTC m=+162.228133301 (durationBeforeRetry 1m4s). Error: MountVolume.SetUp failed for volume "cert" (UniqueName: "kubernetes.io/secret/252447b2-d8a3-4d99-8302-361f32e759df-cert") pod "ingress-canary-vm9nr" (UID: "252447b2-d8a3-4d99-8302-361f32e759df") : secret "canary-serving-cert" not found Jun 03 01:06:15.081748 ip-10-0-138-55 kubenswrapper[2566]: E0603 01:06:15.081349 2566 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/24c6861e-9230-4de3-b1b7-7edf01864353-metrics-tls podName:24c6861e-9230-4de3-b1b7-7edf01864353 nodeName:}" failed. No retries permitted until 2026-06-03 01:07:19.081336849 +0000 UTC m=+162.228178772 (durationBeforeRetry 1m4s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/24c6861e-9230-4de3-b1b7-7edf01864353-metrics-tls") pod "dns-default-nvrs2" (UID: "24c6861e-9230-4de3-b1b7-7edf01864353") : secret "dns-default-metrics-tls" not found Jun 03 01:06:16.380540 ip-10-0-138-55 kubenswrapper[2566]: I0603 01:06:16.380510 2566 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-cluster-storage-operator/volume-data-source-validator-7598fd5bd-zf7p6"] Jun 03 01:06:16.383090 ip-10-0-138-55 kubenswrapper[2566]: I0603 01:06:16.383074 2566 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-storage-operator/volume-data-source-validator-7598fd5bd-zf7p6" Jun 03 01:06:16.385069 ip-10-0-138-55 kubenswrapper[2566]: I0603 01:06:16.385050 2566 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-storage-operator\"/\"kube-root-ca.crt\"" Jun 03 01:06:16.385069 ip-10-0-138-55 kubenswrapper[2566]: I0603 01:06:16.385057 2566 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-storage-operator\"/\"volume-data-source-validator-dockercfg-4mz9b\"" Jun 03 01:06:16.385252 ip-10-0-138-55 kubenswrapper[2566]: I0603 01:06:16.385091 2566 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-storage-operator\"/\"openshift-service-ca.crt\"" Jun 03 01:06:16.391371 ip-10-0-138-55 kubenswrapper[2566]: I0603 01:06:16.391345 2566 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-console-operator/console-operator-86d7c6cc77-8nd2x"] Jun 03 01:06:16.393165 ip-10-0-138-55 kubenswrapper[2566]: I0603 01:06:16.393146 2566 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-insights/insights-operator-788bf58df5-nhrtq"] Jun 03 01:06:16.393311 ip-10-0-138-55 kubenswrapper[2566]: I0603 01:06:16.393296 2566 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console-operator/console-operator-86d7c6cc77-8nd2x" Jun 03 01:06:16.394838 ip-10-0-138-55 kubenswrapper[2566]: I0603 01:06:16.394820 2566 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-cluster-storage-operator/volume-data-source-validator-7598fd5bd-zf7p6"] Jun 03 01:06:16.394931 ip-10-0-138-55 kubenswrapper[2566]: I0603 01:06:16.394918 2566 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-operator-788bf58df5-nhrtq" Jun 03 01:06:16.395507 ip-10-0-138-55 kubenswrapper[2566]: I0603 01:06:16.395489 2566 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console-operator\"/\"kube-root-ca.crt\"" Jun 03 01:06:16.395599 ip-10-0-138-55 kubenswrapper[2566]: I0603 01:06:16.395587 2566 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console-operator\"/\"serving-cert\"" Jun 03 01:06:16.395654 ip-10-0-138-55 kubenswrapper[2566]: I0603 01:06:16.395596 2566 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console-operator\"/\"console-operator-dockercfg-ckg2c\"" Jun 03 01:06:16.395703 ip-10-0-138-55 kubenswrapper[2566]: I0603 01:06:16.395683 2566 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console-operator\"/\"console-operator-config\"" Jun 03 01:06:16.395810 ip-10-0-138-55 kubenswrapper[2566]: I0603 01:06:16.395795 2566 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console-operator\"/\"openshift-service-ca.crt\"" Jun 03 01:06:16.400943 ip-10-0-138-55 kubenswrapper[2566]: I0603 01:06:16.400922 2566 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"openshift-service-ca.crt\"" Jun 03 01:06:16.401322 ip-10-0-138-55 kubenswrapper[2566]: I0603 01:06:16.401302 2566 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"kube-root-ca.crt\"" Jun 03 01:06:16.401861 ip-10-0-138-55 kubenswrapper[2566]: I0603 01:06:16.401844 2566 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"operator-dockercfg-zwkdh\"" Jun 03 01:06:16.402406 ip-10-0-138-55 kubenswrapper[2566]: I0603 01:06:16.402264 2566 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"openshift-insights-serving-cert\"" Jun 03 01:06:16.402406 ip-10-0-138-55 kubenswrapper[2566]: I0603 01:06:16.402271 2566 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"service-ca-bundle\"" Jun 03 01:06:16.405860 ip-10-0-138-55 kubenswrapper[2566]: I0603 01:06:16.405840 2566 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console-operator\"/\"trusted-ca\"" Jun 03 01:06:16.407869 ip-10-0-138-55 kubenswrapper[2566]: I0603 01:06:16.407822 2566 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-operator-788bf58df5-nhrtq"] Jun 03 01:06:16.408014 ip-10-0-138-55 kubenswrapper[2566]: I0603 01:06:16.407907 2566 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"trusted-ca-bundle\"" Jun 03 01:06:16.411964 ip-10-0-138-55 kubenswrapper[2566]: I0603 01:06:16.410153 2566 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-console-operator/console-operator-86d7c6cc77-8nd2x"] Jun 03 01:06:16.484290 ip-10-0-138-55 kubenswrapper[2566]: I0603 01:06:16.484256 2566 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-monitoring/cluster-monitoring-operator-69b6cbdb88-8mdcx"] Jun 03 01:06:16.486335 ip-10-0-138-55 kubenswrapper[2566]: I0603 01:06:16.486319 2566 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-image-registry/image-registry-8ddf5bfd5-jc9m2"] Jun 03 01:06:16.486506 ip-10-0-138-55 kubenswrapper[2566]: I0603 01:06:16.486487 2566 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/cluster-monitoring-operator-69b6cbdb88-8mdcx" Jun 03 01:06:16.488000 ip-10-0-138-55 kubenswrapper[2566]: I0603 01:06:16.487980 2566 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-8ddf5bfd5-jc9m2" Jun 03 01:06:16.488590 ip-10-0-138-55 kubenswrapper[2566]: I0603 01:06:16.488564 2566 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"kube-root-ca.crt\"" Jun 03 01:06:16.488706 ip-10-0-138-55 kubenswrapper[2566]: I0603 01:06:16.488650 2566 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"cluster-monitoring-operator-tls\"" Jun 03 01:06:16.488772 ip-10-0-138-55 kubenswrapper[2566]: I0603 01:06:16.488713 2566 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"openshift-service-ca.crt\"" Jun 03 01:06:16.488971 ip-10-0-138-55 kubenswrapper[2566]: I0603 01:06:16.488956 2566 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"telemetry-config\"" Jun 03 01:06:16.489050 ip-10-0-138-55 kubenswrapper[2566]: I0603 01:06:16.488994 2566 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"cluster-monitoring-operator-dockercfg-nqm2z\"" Jun 03 01:06:16.489466 ip-10-0-138-55 kubenswrapper[2566]: I0603 01:06:16.489452 2566 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"image-registry-tls\"" Jun 03 01:06:16.489713 ip-10-0-138-55 kubenswrapper[2566]: I0603 01:06:16.489699 2566 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"image-registry-private-configuration\"" Jun 03 01:06:16.489925 ip-10-0-138-55 kubenswrapper[2566]: I0603 01:06:16.489907 2566 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"installation-pull-secrets\"" Jun 03 01:06:16.489998 ip-10-0-138-55 kubenswrapper[2566]: I0603 01:06:16.489942 2566 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"registry-dockercfg-lxj66\"" Jun 03 01:06:16.490821 ip-10-0-138-55 kubenswrapper[2566]: I0603 01:06:16.490800 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/9167dbe1-4d4e-4e57-9396-7b000dc36698-tmp\") pod \"insights-operator-788bf58df5-nhrtq\" (UID: \"9167dbe1-4d4e-4e57-9396-7b000dc36698\") " pod="openshift-insights/insights-operator-788bf58df5-nhrtq" Jun 03 01:06:16.490900 ip-10-0-138-55 kubenswrapper[2566]: I0603 01:06:16.490829 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/5776439a-7cdc-49da-a5f6-325eb0c8ab99-trusted-ca\") pod \"console-operator-86d7c6cc77-8nd2x\" (UID: \"5776439a-7cdc-49da-a5f6-325eb0c8ab99\") " pod="openshift-console-operator/console-operator-86d7c6cc77-8nd2x" Jun 03 01:06:16.490900 ip-10-0-138-55 kubenswrapper[2566]: I0603 01:06:16.490847 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"snapshots\" (UniqueName: \"kubernetes.io/empty-dir/9167dbe1-4d4e-4e57-9396-7b000dc36698-snapshots\") pod \"insights-operator-788bf58df5-nhrtq\" (UID: \"9167dbe1-4d4e-4e57-9396-7b000dc36698\") " pod="openshift-insights/insights-operator-788bf58df5-nhrtq" Jun 03 01:06:16.491002 ip-10-0-138-55 kubenswrapper[2566]: I0603 01:06:16.490908 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/9167dbe1-4d4e-4e57-9396-7b000dc36698-serving-cert\") pod \"insights-operator-788bf58df5-nhrtq\" (UID: \"9167dbe1-4d4e-4e57-9396-7b000dc36698\") " pod="openshift-insights/insights-operator-788bf58df5-nhrtq" Jun 03 01:06:16.491002 ip-10-0-138-55 kubenswrapper[2566]: I0603 01:06:16.490927 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-sgxvb\" (UniqueName: \"kubernetes.io/projected/6d6223c5-1390-4e92-afe6-042d4098c255-kube-api-access-sgxvb\") pod \"volume-data-source-validator-7598fd5bd-zf7p6\" (UID: \"6d6223c5-1390-4e92-afe6-042d4098c255\") " pod="openshift-cluster-storage-operator/volume-data-source-validator-7598fd5bd-zf7p6" Jun 03 01:06:16.491002 ip-10-0-138-55 kubenswrapper[2566]: I0603 01:06:16.490956 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/9167dbe1-4d4e-4e57-9396-7b000dc36698-trusted-ca-bundle\") pod \"insights-operator-788bf58df5-nhrtq\" (UID: \"9167dbe1-4d4e-4e57-9396-7b000dc36698\") " pod="openshift-insights/insights-operator-788bf58df5-nhrtq" Jun 03 01:06:16.491002 ip-10-0-138-55 kubenswrapper[2566]: I0603 01:06:16.490972 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-ttr5h\" (UniqueName: \"kubernetes.io/projected/9167dbe1-4d4e-4e57-9396-7b000dc36698-kube-api-access-ttr5h\") pod \"insights-operator-788bf58df5-nhrtq\" (UID: \"9167dbe1-4d4e-4e57-9396-7b000dc36698\") " pod="openshift-insights/insights-operator-788bf58df5-nhrtq" Jun 03 01:06:16.491252 ip-10-0-138-55 kubenswrapper[2566]: I0603 01:06:16.491033 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-7nslm\" (UniqueName: \"kubernetes.io/projected/5776439a-7cdc-49da-a5f6-325eb0c8ab99-kube-api-access-7nslm\") pod \"console-operator-86d7c6cc77-8nd2x\" (UID: \"5776439a-7cdc-49da-a5f6-325eb0c8ab99\") " pod="openshift-console-operator/console-operator-86d7c6cc77-8nd2x" Jun 03 01:06:16.491252 ip-10-0-138-55 kubenswrapper[2566]: I0603 01:06:16.491095 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/9167dbe1-4d4e-4e57-9396-7b000dc36698-service-ca-bundle\") pod \"insights-operator-788bf58df5-nhrtq\" (UID: \"9167dbe1-4d4e-4e57-9396-7b000dc36698\") " pod="openshift-insights/insights-operator-788bf58df5-nhrtq" Jun 03 01:06:16.491252 ip-10-0-138-55 kubenswrapper[2566]: I0603 01:06:16.491118 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/5776439a-7cdc-49da-a5f6-325eb0c8ab99-config\") pod \"console-operator-86d7c6cc77-8nd2x\" (UID: \"5776439a-7cdc-49da-a5f6-325eb0c8ab99\") " pod="openshift-console-operator/console-operator-86d7c6cc77-8nd2x" Jun 03 01:06:16.491252 ip-10-0-138-55 kubenswrapper[2566]: I0603 01:06:16.491135 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/5776439a-7cdc-49da-a5f6-325eb0c8ab99-serving-cert\") pod \"console-operator-86d7c6cc77-8nd2x\" (UID: \"5776439a-7cdc-49da-a5f6-325eb0c8ab99\") " pod="openshift-console-operator/console-operator-86d7c6cc77-8nd2x" Jun 03 01:06:16.494515 ip-10-0-138-55 kubenswrapper[2566]: I0603 01:06:16.494495 2566 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"trusted-ca\"" Jun 03 01:06:16.499101 ip-10-0-138-55 kubenswrapper[2566]: I0603 01:06:16.499076 2566 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/cluster-monitoring-operator-69b6cbdb88-8mdcx"] Jun 03 01:06:16.499957 ip-10-0-138-55 kubenswrapper[2566]: I0603 01:06:16.499938 2566 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-image-registry/image-registry-8ddf5bfd5-jc9m2"] Jun 03 01:06:16.591929 ip-10-0-138-55 kubenswrapper[2566]: I0603 01:06:16.591900 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/0bbb6c21-574c-40af-95cd-2e6d2a4b96ba-image-registry-private-configuration\") pod \"image-registry-8ddf5bfd5-jc9m2\" (UID: \"0bbb6c21-574c-40af-95cd-2e6d2a4b96ba\") " pod="openshift-image-registry/image-registry-8ddf5bfd5-jc9m2" Jun 03 01:06:16.592052 ip-10-0-138-55 kubenswrapper[2566]: I0603 01:06:16.591933 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/5d1ab162-5c9a-42b9-91d3-e069fe09b4b8-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-69b6cbdb88-8mdcx\" (UID: \"5d1ab162-5c9a-42b9-91d3-e069fe09b4b8\") " pod="openshift-monitoring/cluster-monitoring-operator-69b6cbdb88-8mdcx" Jun 03 01:06:16.592052 ip-10-0-138-55 kubenswrapper[2566]: I0603 01:06:16.591996 2566 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/9167dbe1-4d4e-4e57-9396-7b000dc36698-serving-cert\") pod \"insights-operator-788bf58df5-nhrtq\" (UID: \"9167dbe1-4d4e-4e57-9396-7b000dc36698\") " pod="openshift-insights/insights-operator-788bf58df5-nhrtq" Jun 03 01:06:16.592052 ip-10-0-138-55 kubenswrapper[2566]: I0603 01:06:16.592019 2566 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-sgxvb\" (UniqueName: \"kubernetes.io/projected/6d6223c5-1390-4e92-afe6-042d4098c255-kube-api-access-sgxvb\") pod \"volume-data-source-validator-7598fd5bd-zf7p6\" (UID: \"6d6223c5-1390-4e92-afe6-042d4098c255\") " pod="openshift-cluster-storage-operator/volume-data-source-validator-7598fd5bd-zf7p6" Jun 03 01:06:16.592052 ip-10-0-138-55 kubenswrapper[2566]: I0603 01:06:16.592044 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/0bbb6c21-574c-40af-95cd-2e6d2a4b96ba-registry-tls\") pod \"image-registry-8ddf5bfd5-jc9m2\" (UID: \"0bbb6c21-574c-40af-95cd-2e6d2a4b96ba\") " pod="openshift-image-registry/image-registry-8ddf5bfd5-jc9m2" Jun 03 01:06:16.592201 ip-10-0-138-55 kubenswrapper[2566]: I0603 01:06:16.592077 2566 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/9167dbe1-4d4e-4e57-9396-7b000dc36698-trusted-ca-bundle\") pod \"insights-operator-788bf58df5-nhrtq\" (UID: \"9167dbe1-4d4e-4e57-9396-7b000dc36698\") " pod="openshift-insights/insights-operator-788bf58df5-nhrtq" Jun 03 01:06:16.592201 ip-10-0-138-55 kubenswrapper[2566]: I0603 01:06:16.592095 2566 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-ttr5h\" (UniqueName: \"kubernetes.io/projected/9167dbe1-4d4e-4e57-9396-7b000dc36698-kube-api-access-ttr5h\") pod \"insights-operator-788bf58df5-nhrtq\" (UID: \"9167dbe1-4d4e-4e57-9396-7b000dc36698\") " pod="openshift-insights/insights-operator-788bf58df5-nhrtq" Jun 03 01:06:16.592201 ip-10-0-138-55 kubenswrapper[2566]: I0603 01:06:16.592141 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/0bbb6c21-574c-40af-95cd-2e6d2a4b96ba-trusted-ca\") pod \"image-registry-8ddf5bfd5-jc9m2\" (UID: \"0bbb6c21-574c-40af-95cd-2e6d2a4b96ba\") " pod="openshift-image-registry/image-registry-8ddf5bfd5-jc9m2" Jun 03 01:06:16.592201 ip-10-0-138-55 kubenswrapper[2566]: I0603 01:06:16.592163 2566 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-7nslm\" (UniqueName: \"kubernetes.io/projected/5776439a-7cdc-49da-a5f6-325eb0c8ab99-kube-api-access-7nslm\") pod \"console-operator-86d7c6cc77-8nd2x\" (UID: \"5776439a-7cdc-49da-a5f6-325eb0c8ab99\") " pod="openshift-console-operator/console-operator-86d7c6cc77-8nd2x" Jun 03 01:06:16.592201 ip-10-0-138-55 kubenswrapper[2566]: I0603 01:06:16.592181 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/0bbb6c21-574c-40af-95cd-2e6d2a4b96ba-installation-pull-secrets\") pod \"image-registry-8ddf5bfd5-jc9m2\" (UID: \"0bbb6c21-574c-40af-95cd-2e6d2a4b96ba\") " pod="openshift-image-registry/image-registry-8ddf5bfd5-jc9m2" Jun 03 01:06:16.592440 ip-10-0-138-55 kubenswrapper[2566]: I0603 01:06:16.592210 2566 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/9167dbe1-4d4e-4e57-9396-7b000dc36698-service-ca-bundle\") pod \"insights-operator-788bf58df5-nhrtq\" (UID: \"9167dbe1-4d4e-4e57-9396-7b000dc36698\") " pod="openshift-insights/insights-operator-788bf58df5-nhrtq" Jun 03 01:06:16.592440 ip-10-0-138-55 kubenswrapper[2566]: I0603 01:06:16.592365 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/0bbb6c21-574c-40af-95cd-2e6d2a4b96ba-registry-certificates\") pod \"image-registry-8ddf5bfd5-jc9m2\" (UID: \"0bbb6c21-574c-40af-95cd-2e6d2a4b96ba\") " pod="openshift-image-registry/image-registry-8ddf5bfd5-jc9m2" Jun 03 01:06:16.592440 ip-10-0-138-55 kubenswrapper[2566]: I0603 01:06:16.592430 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/0bbb6c21-574c-40af-95cd-2e6d2a4b96ba-bound-sa-token\") pod \"image-registry-8ddf5bfd5-jc9m2\" (UID: \"0bbb6c21-574c-40af-95cd-2e6d2a4b96ba\") " pod="openshift-image-registry/image-registry-8ddf5bfd5-jc9m2" Jun 03 01:06:16.592580 ip-10-0-138-55 kubenswrapper[2566]: I0603 01:06:16.592480 2566 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/5776439a-7cdc-49da-a5f6-325eb0c8ab99-config\") pod \"console-operator-86d7c6cc77-8nd2x\" (UID: \"5776439a-7cdc-49da-a5f6-325eb0c8ab99\") " pod="openshift-console-operator/console-operator-86d7c6cc77-8nd2x" Jun 03 01:06:16.592580 ip-10-0-138-55 kubenswrapper[2566]: I0603 01:06:16.592518 2566 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/5776439a-7cdc-49da-a5f6-325eb0c8ab99-serving-cert\") pod \"console-operator-86d7c6cc77-8nd2x\" (UID: \"5776439a-7cdc-49da-a5f6-325eb0c8ab99\") " pod="openshift-console-operator/console-operator-86d7c6cc77-8nd2x" Jun 03 01:06:16.592580 ip-10-0-138-55 kubenswrapper[2566]: I0603 01:06:16.592549 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"telemetry-config\" (UniqueName: \"kubernetes.io/configmap/5d1ab162-5c9a-42b9-91d3-e069fe09b4b8-telemetry-config\") pod \"cluster-monitoring-operator-69b6cbdb88-8mdcx\" (UID: \"5d1ab162-5c9a-42b9-91d3-e069fe09b4b8\") " pod="openshift-monitoring/cluster-monitoring-operator-69b6cbdb88-8mdcx" Jun 03 01:06:16.592702 ip-10-0-138-55 kubenswrapper[2566]: I0603 01:06:16.592614 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-tr6wj\" (UniqueName: \"kubernetes.io/projected/5d1ab162-5c9a-42b9-91d3-e069fe09b4b8-kube-api-access-tr6wj\") pod \"cluster-monitoring-operator-69b6cbdb88-8mdcx\" (UID: \"5d1ab162-5c9a-42b9-91d3-e069fe09b4b8\") " pod="openshift-monitoring/cluster-monitoring-operator-69b6cbdb88-8mdcx" Jun 03 01:06:16.592702 ip-10-0-138-55 kubenswrapper[2566]: I0603 01:06:16.592682 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-k6cs9\" (UniqueName: \"kubernetes.io/projected/0bbb6c21-574c-40af-95cd-2e6d2a4b96ba-kube-api-access-k6cs9\") pod \"image-registry-8ddf5bfd5-jc9m2\" (UID: \"0bbb6c21-574c-40af-95cd-2e6d2a4b96ba\") " pod="openshift-image-registry/image-registry-8ddf5bfd5-jc9m2" Jun 03 01:06:16.592802 ip-10-0-138-55 kubenswrapper[2566]: I0603 01:06:16.592760 2566 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/9167dbe1-4d4e-4e57-9396-7b000dc36698-tmp\") pod \"insights-operator-788bf58df5-nhrtq\" (UID: \"9167dbe1-4d4e-4e57-9396-7b000dc36698\") " pod="openshift-insights/insights-operator-788bf58df5-nhrtq" Jun 03 01:06:16.592802 ip-10-0-138-55 kubenswrapper[2566]: I0603 01:06:16.592791 2566 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/5776439a-7cdc-49da-a5f6-325eb0c8ab99-trusted-ca\") pod \"console-operator-86d7c6cc77-8nd2x\" (UID: \"5776439a-7cdc-49da-a5f6-325eb0c8ab99\") " pod="openshift-console-operator/console-operator-86d7c6cc77-8nd2x" Jun 03 01:06:16.592903 ip-10-0-138-55 kubenswrapper[2566]: I0603 01:06:16.592819 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/0bbb6c21-574c-40af-95cd-2e6d2a4b96ba-ca-trust-extracted\") pod \"image-registry-8ddf5bfd5-jc9m2\" (UID: \"0bbb6c21-574c-40af-95cd-2e6d2a4b96ba\") " pod="openshift-image-registry/image-registry-8ddf5bfd5-jc9m2" Jun 03 01:06:16.592903 ip-10-0-138-55 kubenswrapper[2566]: I0603 01:06:16.592850 2566 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"snapshots\" (UniqueName: \"kubernetes.io/empty-dir/9167dbe1-4d4e-4e57-9396-7b000dc36698-snapshots\") pod \"insights-operator-788bf58df5-nhrtq\" (UID: \"9167dbe1-4d4e-4e57-9396-7b000dc36698\") " pod="openshift-insights/insights-operator-788bf58df5-nhrtq" Jun 03 01:06:16.592903 ip-10-0-138-55 kubenswrapper[2566]: I0603 01:06:16.592851 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/9167dbe1-4d4e-4e57-9396-7b000dc36698-service-ca-bundle\") pod \"insights-operator-788bf58df5-nhrtq\" (UID: \"9167dbe1-4d4e-4e57-9396-7b000dc36698\") " pod="openshift-insights/insights-operator-788bf58df5-nhrtq" Jun 03 01:06:16.593116 ip-10-0-138-55 kubenswrapper[2566]: I0603 01:06:16.593089 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/9167dbe1-4d4e-4e57-9396-7b000dc36698-trusted-ca-bundle\") pod \"insights-operator-788bf58df5-nhrtq\" (UID: \"9167dbe1-4d4e-4e57-9396-7b000dc36698\") " pod="openshift-insights/insights-operator-788bf58df5-nhrtq" Jun 03 01:06:16.593198 ip-10-0-138-55 kubenswrapper[2566]: I0603 01:06:16.593103 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/9167dbe1-4d4e-4e57-9396-7b000dc36698-tmp\") pod \"insights-operator-788bf58df5-nhrtq\" (UID: \"9167dbe1-4d4e-4e57-9396-7b000dc36698\") " pod="openshift-insights/insights-operator-788bf58df5-nhrtq" Jun 03 01:06:16.593342 ip-10-0-138-55 kubenswrapper[2566]: I0603 01:06:16.593318 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/configmap/5776439a-7cdc-49da-a5f6-325eb0c8ab99-config\") pod \"console-operator-86d7c6cc77-8nd2x\" (UID: \"5776439a-7cdc-49da-a5f6-325eb0c8ab99\") " pod="openshift-console-operator/console-operator-86d7c6cc77-8nd2x" Jun 03 01:06:16.593471 ip-10-0-138-55 kubenswrapper[2566]: I0603 01:06:16.593454 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"snapshots\" (UniqueName: \"kubernetes.io/empty-dir/9167dbe1-4d4e-4e57-9396-7b000dc36698-snapshots\") pod \"insights-operator-788bf58df5-nhrtq\" (UID: \"9167dbe1-4d4e-4e57-9396-7b000dc36698\") " pod="openshift-insights/insights-operator-788bf58df5-nhrtq" Jun 03 01:06:16.593871 ip-10-0-138-55 kubenswrapper[2566]: I0603 01:06:16.593849 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/5776439a-7cdc-49da-a5f6-325eb0c8ab99-trusted-ca\") pod \"console-operator-86d7c6cc77-8nd2x\" (UID: \"5776439a-7cdc-49da-a5f6-325eb0c8ab99\") " pod="openshift-console-operator/console-operator-86d7c6cc77-8nd2x" Jun 03 01:06:16.594623 ip-10-0-138-55 kubenswrapper[2566]: I0603 01:06:16.594606 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/9167dbe1-4d4e-4e57-9396-7b000dc36698-serving-cert\") pod \"insights-operator-788bf58df5-nhrtq\" (UID: \"9167dbe1-4d4e-4e57-9396-7b000dc36698\") " pod="openshift-insights/insights-operator-788bf58df5-nhrtq" Jun 03 01:06:16.594890 ip-10-0-138-55 kubenswrapper[2566]: I0603 01:06:16.594871 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/5776439a-7cdc-49da-a5f6-325eb0c8ab99-serving-cert\") pod \"console-operator-86d7c6cc77-8nd2x\" (UID: \"5776439a-7cdc-49da-a5f6-325eb0c8ab99\") " pod="openshift-console-operator/console-operator-86d7c6cc77-8nd2x" Jun 03 01:06:16.599343 ip-10-0-138-55 kubenswrapper[2566]: I0603 01:06:16.599319 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-ttr5h\" (UniqueName: \"kubernetes.io/projected/9167dbe1-4d4e-4e57-9396-7b000dc36698-kube-api-access-ttr5h\") pod \"insights-operator-788bf58df5-nhrtq\" (UID: \"9167dbe1-4d4e-4e57-9396-7b000dc36698\") " pod="openshift-insights/insights-operator-788bf58df5-nhrtq" Jun 03 01:06:16.599564 ip-10-0-138-55 kubenswrapper[2566]: I0603 01:06:16.599539 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-sgxvb\" (UniqueName: \"kubernetes.io/projected/6d6223c5-1390-4e92-afe6-042d4098c255-kube-api-access-sgxvb\") pod \"volume-data-source-validator-7598fd5bd-zf7p6\" (UID: \"6d6223c5-1390-4e92-afe6-042d4098c255\") " pod="openshift-cluster-storage-operator/volume-data-source-validator-7598fd5bd-zf7p6" Jun 03 01:06:16.599656 ip-10-0-138-55 kubenswrapper[2566]: I0603 01:06:16.599625 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-7nslm\" (UniqueName: \"kubernetes.io/projected/5776439a-7cdc-49da-a5f6-325eb0c8ab99-kube-api-access-7nslm\") pod \"console-operator-86d7c6cc77-8nd2x\" (UID: \"5776439a-7cdc-49da-a5f6-325eb0c8ab99\") " pod="openshift-console-operator/console-operator-86d7c6cc77-8nd2x" Jun 03 01:06:16.692125 ip-10-0-138-55 kubenswrapper[2566]: I0603 01:06:16.692043 2566 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-storage-operator/volume-data-source-validator-7598fd5bd-zf7p6" Jun 03 01:06:16.693837 ip-10-0-138-55 kubenswrapper[2566]: I0603 01:06:16.693816 2566 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"telemetry-config\" (UniqueName: \"kubernetes.io/configmap/5d1ab162-5c9a-42b9-91d3-e069fe09b4b8-telemetry-config\") pod \"cluster-monitoring-operator-69b6cbdb88-8mdcx\" (UID: \"5d1ab162-5c9a-42b9-91d3-e069fe09b4b8\") " pod="openshift-monitoring/cluster-monitoring-operator-69b6cbdb88-8mdcx" Jun 03 01:06:16.693934 ip-10-0-138-55 kubenswrapper[2566]: I0603 01:06:16.693850 2566 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-tr6wj\" (UniqueName: \"kubernetes.io/projected/5d1ab162-5c9a-42b9-91d3-e069fe09b4b8-kube-api-access-tr6wj\") pod \"cluster-monitoring-operator-69b6cbdb88-8mdcx\" (UID: \"5d1ab162-5c9a-42b9-91d3-e069fe09b4b8\") " pod="openshift-monitoring/cluster-monitoring-operator-69b6cbdb88-8mdcx" Jun 03 01:06:16.693934 ip-10-0-138-55 kubenswrapper[2566]: I0603 01:06:16.693879 2566 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-k6cs9\" (UniqueName: \"kubernetes.io/projected/0bbb6c21-574c-40af-95cd-2e6d2a4b96ba-kube-api-access-k6cs9\") pod \"image-registry-8ddf5bfd5-jc9m2\" (UID: \"0bbb6c21-574c-40af-95cd-2e6d2a4b96ba\") " pod="openshift-image-registry/image-registry-8ddf5bfd5-jc9m2" Jun 03 01:06:16.694036 ip-10-0-138-55 kubenswrapper[2566]: I0603 01:06:16.693932 2566 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/0bbb6c21-574c-40af-95cd-2e6d2a4b96ba-ca-trust-extracted\") pod \"image-registry-8ddf5bfd5-jc9m2\" (UID: \"0bbb6c21-574c-40af-95cd-2e6d2a4b96ba\") " pod="openshift-image-registry/image-registry-8ddf5bfd5-jc9m2" Jun 03 01:06:16.694036 ip-10-0-138-55 kubenswrapper[2566]: I0603 01:06:16.693962 2566 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/0bbb6c21-574c-40af-95cd-2e6d2a4b96ba-image-registry-private-configuration\") pod \"image-registry-8ddf5bfd5-jc9m2\" (UID: \"0bbb6c21-574c-40af-95cd-2e6d2a4b96ba\") " pod="openshift-image-registry/image-registry-8ddf5bfd5-jc9m2" Jun 03 01:06:16.694036 ip-10-0-138-55 kubenswrapper[2566]: I0603 01:06:16.694005 2566 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/5d1ab162-5c9a-42b9-91d3-e069fe09b4b8-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-69b6cbdb88-8mdcx\" (UID: \"5d1ab162-5c9a-42b9-91d3-e069fe09b4b8\") " pod="openshift-monitoring/cluster-monitoring-operator-69b6cbdb88-8mdcx" Jun 03 01:06:16.694174 ip-10-0-138-55 kubenswrapper[2566]: I0603 01:06:16.694061 2566 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/0bbb6c21-574c-40af-95cd-2e6d2a4b96ba-registry-tls\") pod \"image-registry-8ddf5bfd5-jc9m2\" (UID: \"0bbb6c21-574c-40af-95cd-2e6d2a4b96ba\") " pod="openshift-image-registry/image-registry-8ddf5bfd5-jc9m2" Jun 03 01:06:16.694174 ip-10-0-138-55 kubenswrapper[2566]: E0603 01:06:16.694125 2566 secret.go:189] Couldn't get secret openshift-monitoring/cluster-monitoring-operator-tls: secret "cluster-monitoring-operator-tls" not found Jun 03 01:06:16.694174 ip-10-0-138-55 kubenswrapper[2566]: I0603 01:06:16.694135 2566 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/0bbb6c21-574c-40af-95cd-2e6d2a4b96ba-trusted-ca\") pod \"image-registry-8ddf5bfd5-jc9m2\" (UID: \"0bbb6c21-574c-40af-95cd-2e6d2a4b96ba\") " pod="openshift-image-registry/image-registry-8ddf5bfd5-jc9m2" Jun 03 01:06:16.694174 ip-10-0-138-55 kubenswrapper[2566]: I0603 01:06:16.694170 2566 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/0bbb6c21-574c-40af-95cd-2e6d2a4b96ba-installation-pull-secrets\") pod \"image-registry-8ddf5bfd5-jc9m2\" (UID: \"0bbb6c21-574c-40af-95cd-2e6d2a4b96ba\") " pod="openshift-image-registry/image-registry-8ddf5bfd5-jc9m2" Jun 03 01:06:16.694381 ip-10-0-138-55 kubenswrapper[2566]: E0603 01:06:16.694186 2566 projected.go:264] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found Jun 03 01:06:16.694381 ip-10-0-138-55 kubenswrapper[2566]: E0603 01:06:16.694201 2566 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/5d1ab162-5c9a-42b9-91d3-e069fe09b4b8-cluster-monitoring-operator-tls podName:5d1ab162-5c9a-42b9-91d3-e069fe09b4b8 nodeName:}" failed. No retries permitted until 2026-06-03 01:06:17.194180914 +0000 UTC m=+100.341022856 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "cluster-monitoring-operator-tls" (UniqueName: "kubernetes.io/secret/5d1ab162-5c9a-42b9-91d3-e069fe09b4b8-cluster-monitoring-operator-tls") pod "cluster-monitoring-operator-69b6cbdb88-8mdcx" (UID: "5d1ab162-5c9a-42b9-91d3-e069fe09b4b8") : secret "cluster-monitoring-operator-tls" not found Jun 03 01:06:16.694381 ip-10-0-138-55 kubenswrapper[2566]: E0603 01:06:16.694210 2566 projected.go:194] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-8ddf5bfd5-jc9m2: secret "image-registry-tls" not found Jun 03 01:06:16.694381 ip-10-0-138-55 kubenswrapper[2566]: I0603 01:06:16.694266 2566 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/0bbb6c21-574c-40af-95cd-2e6d2a4b96ba-registry-certificates\") pod \"image-registry-8ddf5bfd5-jc9m2\" (UID: \"0bbb6c21-574c-40af-95cd-2e6d2a4b96ba\") " pod="openshift-image-registry/image-registry-8ddf5bfd5-jc9m2" Jun 03 01:06:16.694381 ip-10-0-138-55 kubenswrapper[2566]: E0603 01:06:16.694288 2566 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/0bbb6c21-574c-40af-95cd-2e6d2a4b96ba-registry-tls podName:0bbb6c21-574c-40af-95cd-2e6d2a4b96ba nodeName:}" failed. No retries permitted until 2026-06-03 01:06:17.194270348 +0000 UTC m=+100.341112273 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/0bbb6c21-574c-40af-95cd-2e6d2a4b96ba-registry-tls") pod "image-registry-8ddf5bfd5-jc9m2" (UID: "0bbb6c21-574c-40af-95cd-2e6d2a4b96ba") : secret "image-registry-tls" not found Jun 03 01:06:16.694381 ip-10-0-138-55 kubenswrapper[2566]: I0603 01:06:16.694321 2566 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/0bbb6c21-574c-40af-95cd-2e6d2a4b96ba-bound-sa-token\") pod \"image-registry-8ddf5bfd5-jc9m2\" (UID: \"0bbb6c21-574c-40af-95cd-2e6d2a4b96ba\") " pod="openshift-image-registry/image-registry-8ddf5bfd5-jc9m2" Jun 03 01:06:16.694697 ip-10-0-138-55 kubenswrapper[2566]: I0603 01:06:16.694675 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/0bbb6c21-574c-40af-95cd-2e6d2a4b96ba-ca-trust-extracted\") pod \"image-registry-8ddf5bfd5-jc9m2\" (UID: \"0bbb6c21-574c-40af-95cd-2e6d2a4b96ba\") " pod="openshift-image-registry/image-registry-8ddf5bfd5-jc9m2" Jun 03 01:06:16.694697 ip-10-0-138-55 kubenswrapper[2566]: I0603 01:06:16.694681 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"telemetry-config\" (UniqueName: \"kubernetes.io/configmap/5d1ab162-5c9a-42b9-91d3-e069fe09b4b8-telemetry-config\") pod \"cluster-monitoring-operator-69b6cbdb88-8mdcx\" (UID: \"5d1ab162-5c9a-42b9-91d3-e069fe09b4b8\") " pod="openshift-monitoring/cluster-monitoring-operator-69b6cbdb88-8mdcx" Jun 03 01:06:16.695029 ip-10-0-138-55 kubenswrapper[2566]: I0603 01:06:16.695007 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/0bbb6c21-574c-40af-95cd-2e6d2a4b96ba-registry-certificates\") pod \"image-registry-8ddf5bfd5-jc9m2\" (UID: \"0bbb6c21-574c-40af-95cd-2e6d2a4b96ba\") " pod="openshift-image-registry/image-registry-8ddf5bfd5-jc9m2" Jun 03 01:06:16.695119 ip-10-0-138-55 kubenswrapper[2566]: I0603 01:06:16.695065 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/0bbb6c21-574c-40af-95cd-2e6d2a4b96ba-trusted-ca\") pod \"image-registry-8ddf5bfd5-jc9m2\" (UID: \"0bbb6c21-574c-40af-95cd-2e6d2a4b96ba\") " pod="openshift-image-registry/image-registry-8ddf5bfd5-jc9m2" Jun 03 01:06:16.696556 ip-10-0-138-55 kubenswrapper[2566]: I0603 01:06:16.696537 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/0bbb6c21-574c-40af-95cd-2e6d2a4b96ba-image-registry-private-configuration\") pod \"image-registry-8ddf5bfd5-jc9m2\" (UID: \"0bbb6c21-574c-40af-95cd-2e6d2a4b96ba\") " pod="openshift-image-registry/image-registry-8ddf5bfd5-jc9m2" Jun 03 01:06:16.696645 ip-10-0-138-55 kubenswrapper[2566]: I0603 01:06:16.696578 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/0bbb6c21-574c-40af-95cd-2e6d2a4b96ba-installation-pull-secrets\") pod \"image-registry-8ddf5bfd5-jc9m2\" (UID: \"0bbb6c21-574c-40af-95cd-2e6d2a4b96ba\") " pod="openshift-image-registry/image-registry-8ddf5bfd5-jc9m2" Jun 03 01:06:16.702187 ip-10-0-138-55 kubenswrapper[2566]: I0603 01:06:16.702166 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-k6cs9\" (UniqueName: \"kubernetes.io/projected/0bbb6c21-574c-40af-95cd-2e6d2a4b96ba-kube-api-access-k6cs9\") pod \"image-registry-8ddf5bfd5-jc9m2\" (UID: \"0bbb6c21-574c-40af-95cd-2e6d2a4b96ba\") " pod="openshift-image-registry/image-registry-8ddf5bfd5-jc9m2" Jun 03 01:06:16.702538 ip-10-0-138-55 kubenswrapper[2566]: I0603 01:06:16.702513 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-tr6wj\" (UniqueName: \"kubernetes.io/projected/5d1ab162-5c9a-42b9-91d3-e069fe09b4b8-kube-api-access-tr6wj\") pod \"cluster-monitoring-operator-69b6cbdb88-8mdcx\" (UID: \"5d1ab162-5c9a-42b9-91d3-e069fe09b4b8\") " pod="openshift-monitoring/cluster-monitoring-operator-69b6cbdb88-8mdcx" Jun 03 01:06:16.702636 ip-10-0-138-55 kubenswrapper[2566]: I0603 01:06:16.702618 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/0bbb6c21-574c-40af-95cd-2e6d2a4b96ba-bound-sa-token\") pod \"image-registry-8ddf5bfd5-jc9m2\" (UID: \"0bbb6c21-574c-40af-95cd-2e6d2a4b96ba\") " pod="openshift-image-registry/image-registry-8ddf5bfd5-jc9m2" Jun 03 01:06:16.703112 ip-10-0-138-55 kubenswrapper[2566]: I0603 01:06:16.703077 2566 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console-operator/console-operator-86d7c6cc77-8nd2x" Jun 03 01:06:16.709919 ip-10-0-138-55 kubenswrapper[2566]: I0603 01:06:16.709899 2566 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-operator-788bf58df5-nhrtq" Jun 03 01:06:16.826976 ip-10-0-138-55 kubenswrapper[2566]: I0603 01:06:16.826946 2566 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-cluster-storage-operator/volume-data-source-validator-7598fd5bd-zf7p6"] Jun 03 01:06:16.830387 ip-10-0-138-55 kubenswrapper[2566]: W0603 01:06:16.830347 2566 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod6d6223c5_1390_4e92_afe6_042d4098c255.slice/crio-56fc12b488009e5a8c841c7987cb1f0866dd146f3daed9fcf4dc60124695aedd WatchSource:0}: Error finding container 56fc12b488009e5a8c841c7987cb1f0866dd146f3daed9fcf4dc60124695aedd: Status 404 returned error can't find the container with id 56fc12b488009e5a8c841c7987cb1f0866dd146f3daed9fcf4dc60124695aedd Jun 03 01:06:16.843821 ip-10-0-138-55 kubenswrapper[2566]: I0603 01:06:16.843792 2566 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-console-operator/console-operator-86d7c6cc77-8nd2x"] Jun 03 01:06:16.847055 ip-10-0-138-55 kubenswrapper[2566]: W0603 01:06:16.847004 2566 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod5776439a_7cdc_49da_a5f6_325eb0c8ab99.slice/crio-620878b7adebdb577aac80bb8082cf638f8c052f0286fb75bced2f59b6b5bf40 WatchSource:0}: Error finding container 620878b7adebdb577aac80bb8082cf638f8c052f0286fb75bced2f59b6b5bf40: Status 404 returned error can't find the container with id 620878b7adebdb577aac80bb8082cf638f8c052f0286fb75bced2f59b6b5bf40 Jun 03 01:06:16.861179 ip-10-0-138-55 kubenswrapper[2566]: I0603 01:06:16.861152 2566 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-operator-788bf58df5-nhrtq"] Jun 03 01:06:16.864841 ip-10-0-138-55 kubenswrapper[2566]: W0603 01:06:16.864817 2566 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod9167dbe1_4d4e_4e57_9396_7b000dc36698.slice/crio-888ba0152f30646c38e39c28cc3c1b82d17f1a26842a489fcece82a8466e32ce WatchSource:0}: Error finding container 888ba0152f30646c38e39c28cc3c1b82d17f1a26842a489fcece82a8466e32ce: Status 404 returned error can't find the container with id 888ba0152f30646c38e39c28cc3c1b82d17f1a26842a489fcece82a8466e32ce Jun 03 01:06:16.961652 ip-10-0-138-55 kubenswrapper[2566]: I0603 01:06:16.961578 2566 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-network-diagnostics/network-check-target-k9zdx" Jun 03 01:06:17.016983 ip-10-0-138-55 kubenswrapper[2566]: I0603 01:06:17.016951 2566 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-console-operator/console-operator-86d7c6cc77-8nd2x" event={"ID":"5776439a-7cdc-49da-a5f6-325eb0c8ab99","Type":"ContainerStarted","Data":"620878b7adebdb577aac80bb8082cf638f8c052f0286fb75bced2f59b6b5bf40"} Jun 03 01:06:17.018097 ip-10-0-138-55 kubenswrapper[2566]: I0603 01:06:17.018067 2566 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-storage-operator/volume-data-source-validator-7598fd5bd-zf7p6" event={"ID":"6d6223c5-1390-4e92-afe6-042d4098c255","Type":"ContainerStarted","Data":"56fc12b488009e5a8c841c7987cb1f0866dd146f3daed9fcf4dc60124695aedd"} Jun 03 01:06:17.019001 ip-10-0-138-55 kubenswrapper[2566]: I0603 01:06:17.018984 2566 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-operator-788bf58df5-nhrtq" event={"ID":"9167dbe1-4d4e-4e57-9396-7b000dc36698","Type":"ContainerStarted","Data":"888ba0152f30646c38e39c28cc3c1b82d17f1a26842a489fcece82a8466e32ce"} Jun 03 01:06:17.198139 ip-10-0-138-55 kubenswrapper[2566]: I0603 01:06:17.198107 2566 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/0bbb6c21-574c-40af-95cd-2e6d2a4b96ba-registry-tls\") pod \"image-registry-8ddf5bfd5-jc9m2\" (UID: \"0bbb6c21-574c-40af-95cd-2e6d2a4b96ba\") " pod="openshift-image-registry/image-registry-8ddf5bfd5-jc9m2" Jun 03 01:06:17.198340 ip-10-0-138-55 kubenswrapper[2566]: I0603 01:06:17.198178 2566 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/5d1ab162-5c9a-42b9-91d3-e069fe09b4b8-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-69b6cbdb88-8mdcx\" (UID: \"5d1ab162-5c9a-42b9-91d3-e069fe09b4b8\") " pod="openshift-monitoring/cluster-monitoring-operator-69b6cbdb88-8mdcx" Jun 03 01:06:17.198340 ip-10-0-138-55 kubenswrapper[2566]: E0603 01:06:17.198273 2566 projected.go:264] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found Jun 03 01:06:17.198340 ip-10-0-138-55 kubenswrapper[2566]: E0603 01:06:17.198285 2566 secret.go:189] Couldn't get secret openshift-monitoring/cluster-monitoring-operator-tls: secret "cluster-monitoring-operator-tls" not found Jun 03 01:06:17.198340 ip-10-0-138-55 kubenswrapper[2566]: E0603 01:06:17.198292 2566 projected.go:194] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-8ddf5bfd5-jc9m2: secret "image-registry-tls" not found Jun 03 01:06:17.198493 ip-10-0-138-55 kubenswrapper[2566]: E0603 01:06:17.198345 2566 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/5d1ab162-5c9a-42b9-91d3-e069fe09b4b8-cluster-monitoring-operator-tls podName:5d1ab162-5c9a-42b9-91d3-e069fe09b4b8 nodeName:}" failed. No retries permitted until 2026-06-03 01:06:18.198331885 +0000 UTC m=+101.345173809 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "cluster-monitoring-operator-tls" (UniqueName: "kubernetes.io/secret/5d1ab162-5c9a-42b9-91d3-e069fe09b4b8-cluster-monitoring-operator-tls") pod "cluster-monitoring-operator-69b6cbdb88-8mdcx" (UID: "5d1ab162-5c9a-42b9-91d3-e069fe09b4b8") : secret "cluster-monitoring-operator-tls" not found Jun 03 01:06:17.198493 ip-10-0-138-55 kubenswrapper[2566]: E0603 01:06:17.198360 2566 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/0bbb6c21-574c-40af-95cd-2e6d2a4b96ba-registry-tls podName:0bbb6c21-574c-40af-95cd-2e6d2a4b96ba nodeName:}" failed. No retries permitted until 2026-06-03 01:06:18.198353611 +0000 UTC m=+101.345195535 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/0bbb6c21-574c-40af-95cd-2e6d2a4b96ba-registry-tls") pod "image-registry-8ddf5bfd5-jc9m2" (UID: "0bbb6c21-574c-40af-95cd-2e6d2a4b96ba") : secret "image-registry-tls" not found Jun 03 01:06:18.206101 ip-10-0-138-55 kubenswrapper[2566]: I0603 01:06:18.206060 2566 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/5d1ab162-5c9a-42b9-91d3-e069fe09b4b8-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-69b6cbdb88-8mdcx\" (UID: \"5d1ab162-5c9a-42b9-91d3-e069fe09b4b8\") " pod="openshift-monitoring/cluster-monitoring-operator-69b6cbdb88-8mdcx" Jun 03 01:06:18.206593 ip-10-0-138-55 kubenswrapper[2566]: I0603 01:06:18.206137 2566 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/0bbb6c21-574c-40af-95cd-2e6d2a4b96ba-registry-tls\") pod \"image-registry-8ddf5bfd5-jc9m2\" (UID: \"0bbb6c21-574c-40af-95cd-2e6d2a4b96ba\") " pod="openshift-image-registry/image-registry-8ddf5bfd5-jc9m2" Jun 03 01:06:18.206593 ip-10-0-138-55 kubenswrapper[2566]: E0603 01:06:18.206247 2566 secret.go:189] Couldn't get secret openshift-monitoring/cluster-monitoring-operator-tls: secret "cluster-monitoring-operator-tls" not found Jun 03 01:06:18.206593 ip-10-0-138-55 kubenswrapper[2566]: E0603 01:06:18.206296 2566 projected.go:264] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found Jun 03 01:06:18.206593 ip-10-0-138-55 kubenswrapper[2566]: E0603 01:06:18.206313 2566 projected.go:194] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-8ddf5bfd5-jc9m2: secret "image-registry-tls" not found Jun 03 01:06:18.206593 ip-10-0-138-55 kubenswrapper[2566]: E0603 01:06:18.206333 2566 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/5d1ab162-5c9a-42b9-91d3-e069fe09b4b8-cluster-monitoring-operator-tls podName:5d1ab162-5c9a-42b9-91d3-e069fe09b4b8 nodeName:}" failed. No retries permitted until 2026-06-03 01:06:20.206313071 +0000 UTC m=+103.353155012 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "cluster-monitoring-operator-tls" (UniqueName: "kubernetes.io/secret/5d1ab162-5c9a-42b9-91d3-e069fe09b4b8-cluster-monitoring-operator-tls") pod "cluster-monitoring-operator-69b6cbdb88-8mdcx" (UID: "5d1ab162-5c9a-42b9-91d3-e069fe09b4b8") : secret "cluster-monitoring-operator-tls" not found Jun 03 01:06:18.206593 ip-10-0-138-55 kubenswrapper[2566]: E0603 01:06:18.206353 2566 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/0bbb6c21-574c-40af-95cd-2e6d2a4b96ba-registry-tls podName:0bbb6c21-574c-40af-95cd-2e6d2a4b96ba nodeName:}" failed. No retries permitted until 2026-06-03 01:06:20.206341564 +0000 UTC m=+103.353183492 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/0bbb6c21-574c-40af-95cd-2e6d2a4b96ba-registry-tls") pod "image-registry-8ddf5bfd5-jc9m2" (UID: "0bbb6c21-574c-40af-95cd-2e6d2a4b96ba") : secret "image-registry-tls" not found Jun 03 01:06:18.337011 ip-10-0-138-55 kubenswrapper[2566]: I0603 01:06:18.336975 2566 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-96ddc787c-9dcb9"] Jun 03 01:06:18.338859 ip-10-0-138-55 kubenswrapper[2566]: I0603 01:06:18.338837 2566 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-96ddc787c-9dcb9" Jun 03 01:06:18.340754 ip-10-0-138-55 kubenswrapper[2566]: I0603 01:06:18.340733 2566 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-kube-storage-version-migrator-operator\"/\"serving-cert\"" Jun 03 01:06:18.340980 ip-10-0-138-55 kubenswrapper[2566]: I0603 01:06:18.340956 2566 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-kube-storage-version-migrator-operator\"/\"kube-storage-version-migrator-operator-dockercfg-l2scf\"" Jun 03 01:06:18.341107 ip-10-0-138-55 kubenswrapper[2566]: I0603 01:06:18.341093 2566 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-kube-storage-version-migrator-operator\"/\"kube-root-ca.crt\"" Jun 03 01:06:18.341471 ip-10-0-138-55 kubenswrapper[2566]: I0603 01:06:18.341279 2566 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-kube-storage-version-migrator-operator\"/\"openshift-service-ca.crt\"" Jun 03 01:06:18.341471 ip-10-0-138-55 kubenswrapper[2566]: I0603 01:06:18.341366 2566 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-kube-storage-version-migrator-operator\"/\"config\"" Jun 03 01:06:18.349298 ip-10-0-138-55 kubenswrapper[2566]: I0603 01:06:18.349263 2566 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-96ddc787c-9dcb9"] Jun 03 01:06:18.408285 ip-10-0-138-55 kubenswrapper[2566]: I0603 01:06:18.408244 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-pj8df\" (UniqueName: \"kubernetes.io/projected/b47d8095-6d81-4a7a-b17f-357d8b59c8d4-kube-api-access-pj8df\") pod \"kube-storage-version-migrator-operator-96ddc787c-9dcb9\" (UID: \"b47d8095-6d81-4a7a-b17f-357d8b59c8d4\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-96ddc787c-9dcb9" Jun 03 01:06:18.408447 ip-10-0-138-55 kubenswrapper[2566]: I0603 01:06:18.408344 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/b47d8095-6d81-4a7a-b17f-357d8b59c8d4-config\") pod \"kube-storage-version-migrator-operator-96ddc787c-9dcb9\" (UID: \"b47d8095-6d81-4a7a-b17f-357d8b59c8d4\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-96ddc787c-9dcb9" Jun 03 01:06:18.408447 ip-10-0-138-55 kubenswrapper[2566]: I0603 01:06:18.408374 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/b47d8095-6d81-4a7a-b17f-357d8b59c8d4-serving-cert\") pod \"kube-storage-version-migrator-operator-96ddc787c-9dcb9\" (UID: \"b47d8095-6d81-4a7a-b17f-357d8b59c8d4\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-96ddc787c-9dcb9" Jun 03 01:06:18.509782 ip-10-0-138-55 kubenswrapper[2566]: I0603 01:06:18.509698 2566 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-pj8df\" (UniqueName: \"kubernetes.io/projected/b47d8095-6d81-4a7a-b17f-357d8b59c8d4-kube-api-access-pj8df\") pod \"kube-storage-version-migrator-operator-96ddc787c-9dcb9\" (UID: \"b47d8095-6d81-4a7a-b17f-357d8b59c8d4\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-96ddc787c-9dcb9" Jun 03 01:06:18.509782 ip-10-0-138-55 kubenswrapper[2566]: I0603 01:06:18.509777 2566 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/b47d8095-6d81-4a7a-b17f-357d8b59c8d4-config\") pod \"kube-storage-version-migrator-operator-96ddc787c-9dcb9\" (UID: \"b47d8095-6d81-4a7a-b17f-357d8b59c8d4\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-96ddc787c-9dcb9" Jun 03 01:06:18.510027 ip-10-0-138-55 kubenswrapper[2566]: I0603 01:06:18.509804 2566 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/b47d8095-6d81-4a7a-b17f-357d8b59c8d4-serving-cert\") pod \"kube-storage-version-migrator-operator-96ddc787c-9dcb9\" (UID: \"b47d8095-6d81-4a7a-b17f-357d8b59c8d4\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-96ddc787c-9dcb9" Jun 03 01:06:18.510591 ip-10-0-138-55 kubenswrapper[2566]: I0603 01:06:18.510559 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/configmap/b47d8095-6d81-4a7a-b17f-357d8b59c8d4-config\") pod \"kube-storage-version-migrator-operator-96ddc787c-9dcb9\" (UID: \"b47d8095-6d81-4a7a-b17f-357d8b59c8d4\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-96ddc787c-9dcb9" Jun 03 01:06:18.512544 ip-10-0-138-55 kubenswrapper[2566]: I0603 01:06:18.512521 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/b47d8095-6d81-4a7a-b17f-357d8b59c8d4-serving-cert\") pod \"kube-storage-version-migrator-operator-96ddc787c-9dcb9\" (UID: \"b47d8095-6d81-4a7a-b17f-357d8b59c8d4\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-96ddc787c-9dcb9" Jun 03 01:06:18.517997 ip-10-0-138-55 kubenswrapper[2566]: I0603 01:06:18.517970 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-pj8df\" (UniqueName: \"kubernetes.io/projected/b47d8095-6d81-4a7a-b17f-357d8b59c8d4-kube-api-access-pj8df\") pod \"kube-storage-version-migrator-operator-96ddc787c-9dcb9\" (UID: \"b47d8095-6d81-4a7a-b17f-357d8b59c8d4\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-96ddc787c-9dcb9" Jun 03 01:06:18.650653 ip-10-0-138-55 kubenswrapper[2566]: I0603 01:06:18.650618 2566 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-96ddc787c-9dcb9" Jun 03 01:06:19.757909 ip-10-0-138-55 kubenswrapper[2566]: I0603 01:06:19.757852 2566 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-96ddc787c-9dcb9"] Jun 03 01:06:20.026028 ip-10-0-138-55 kubenswrapper[2566]: I0603 01:06:20.025941 2566 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-96ddc787c-9dcb9" event={"ID":"b47d8095-6d81-4a7a-b17f-357d8b59c8d4","Type":"ContainerStarted","Data":"df6a4ead9ec0e26fefc02621ff2125a05f41c48e6893da92df0b12c2e91a112a"} Jun 03 01:06:20.027398 ip-10-0-138-55 kubenswrapper[2566]: I0603 01:06:20.027373 2566 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-86d7c6cc77-8nd2x_5776439a-7cdc-49da-a5f6-325eb0c8ab99/console-operator/0.log" Jun 03 01:06:20.027524 ip-10-0-138-55 kubenswrapper[2566]: I0603 01:06:20.027419 2566 generic.go:358] "Generic (PLEG): container finished" podID="5776439a-7cdc-49da-a5f6-325eb0c8ab99" containerID="82c9fd810886e8f339352fcdf2e533c9f46d24382b4a225546f5188f8466b0fd" exitCode=255 Jun 03 01:06:20.027524 ip-10-0-138-55 kubenswrapper[2566]: I0603 01:06:20.027494 2566 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-console-operator/console-operator-86d7c6cc77-8nd2x" event={"ID":"5776439a-7cdc-49da-a5f6-325eb0c8ab99","Type":"ContainerDied","Data":"82c9fd810886e8f339352fcdf2e533c9f46d24382b4a225546f5188f8466b0fd"} Jun 03 01:06:20.027729 ip-10-0-138-55 kubenswrapper[2566]: I0603 01:06:20.027707 2566 scope.go:117] "RemoveContainer" containerID="82c9fd810886e8f339352fcdf2e533c9f46d24382b4a225546f5188f8466b0fd" Jun 03 01:06:20.028911 ip-10-0-138-55 kubenswrapper[2566]: I0603 01:06:20.028882 2566 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-storage-operator/volume-data-source-validator-7598fd5bd-zf7p6" event={"ID":"6d6223c5-1390-4e92-afe6-042d4098c255","Type":"ContainerStarted","Data":"340937d06d3728710b465564035a2b453a140224561015ebc008ceee75da2e11"} Jun 03 01:06:20.030236 ip-10-0-138-55 kubenswrapper[2566]: I0603 01:06:20.030200 2566 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-operator-788bf58df5-nhrtq" event={"ID":"9167dbe1-4d4e-4e57-9396-7b000dc36698","Type":"ContainerStarted","Data":"eb1b35c5049ccc0b216ce8d31507779336fcd6a204a419a9a79998adeb0a2984"} Jun 03 01:06:20.052327 ip-10-0-138-55 kubenswrapper[2566]: I0603 01:06:20.052277 2566 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-cluster-storage-operator/volume-data-source-validator-7598fd5bd-zf7p6" podStartSLOduration=1.25320648 podStartE2EDuration="4.052260385s" podCreationTimestamp="2026-06-03 01:06:16 +0000 UTC" firstStartedPulling="2026-06-03 01:06:16.832713874 +0000 UTC m=+99.979555806" lastFinishedPulling="2026-06-03 01:06:19.631767773 +0000 UTC m=+102.778609711" observedRunningTime="2026-06-03 01:06:20.051510954 +0000 UTC m=+103.198352900" watchObservedRunningTime="2026-06-03 01:06:20.052260385 +0000 UTC m=+103.199102332" Jun 03 01:06:20.067646 ip-10-0-138-55 kubenswrapper[2566]: I0603 01:06:20.067601 2566 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-insights/insights-operator-788bf58df5-nhrtq" podStartSLOduration=1.296941278 podStartE2EDuration="4.067587609s" podCreationTimestamp="2026-06-03 01:06:16 +0000 UTC" firstStartedPulling="2026-06-03 01:06:16.866499518 +0000 UTC m=+100.013341441" lastFinishedPulling="2026-06-03 01:06:19.637145841 +0000 UTC m=+102.783987772" observedRunningTime="2026-06-03 01:06:20.066567041 +0000 UTC m=+103.213408987" watchObservedRunningTime="2026-06-03 01:06:20.067587609 +0000 UTC m=+103.214429558" Jun 03 01:06:20.226115 ip-10-0-138-55 kubenswrapper[2566]: I0603 01:06:20.226078 2566 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/0bbb6c21-574c-40af-95cd-2e6d2a4b96ba-registry-tls\") pod \"image-registry-8ddf5bfd5-jc9m2\" (UID: \"0bbb6c21-574c-40af-95cd-2e6d2a4b96ba\") " pod="openshift-image-registry/image-registry-8ddf5bfd5-jc9m2" Jun 03 01:06:20.226310 ip-10-0-138-55 kubenswrapper[2566]: I0603 01:06:20.226170 2566 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/5d1ab162-5c9a-42b9-91d3-e069fe09b4b8-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-69b6cbdb88-8mdcx\" (UID: \"5d1ab162-5c9a-42b9-91d3-e069fe09b4b8\") " pod="openshift-monitoring/cluster-monitoring-operator-69b6cbdb88-8mdcx" Jun 03 01:06:20.226310 ip-10-0-138-55 kubenswrapper[2566]: E0603 01:06:20.226249 2566 projected.go:264] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found Jun 03 01:06:20.226310 ip-10-0-138-55 kubenswrapper[2566]: E0603 01:06:20.226269 2566 projected.go:194] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-8ddf5bfd5-jc9m2: secret "image-registry-tls" not found Jun 03 01:06:20.226310 ip-10-0-138-55 kubenswrapper[2566]: E0603 01:06:20.226300 2566 secret.go:189] Couldn't get secret openshift-monitoring/cluster-monitoring-operator-tls: secret "cluster-monitoring-operator-tls" not found Jun 03 01:06:20.226503 ip-10-0-138-55 kubenswrapper[2566]: E0603 01:06:20.226341 2566 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/0bbb6c21-574c-40af-95cd-2e6d2a4b96ba-registry-tls podName:0bbb6c21-574c-40af-95cd-2e6d2a4b96ba nodeName:}" failed. No retries permitted until 2026-06-03 01:06:24.226320577 +0000 UTC m=+107.373162501 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/0bbb6c21-574c-40af-95cd-2e6d2a4b96ba-registry-tls") pod "image-registry-8ddf5bfd5-jc9m2" (UID: "0bbb6c21-574c-40af-95cd-2e6d2a4b96ba") : secret "image-registry-tls" not found Jun 03 01:06:20.226503 ip-10-0-138-55 kubenswrapper[2566]: E0603 01:06:20.226361 2566 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/5d1ab162-5c9a-42b9-91d3-e069fe09b4b8-cluster-monitoring-operator-tls podName:5d1ab162-5c9a-42b9-91d3-e069fe09b4b8 nodeName:}" failed. No retries permitted until 2026-06-03 01:06:24.226351839 +0000 UTC m=+107.373193768 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "cluster-monitoring-operator-tls" (UniqueName: "kubernetes.io/secret/5d1ab162-5c9a-42b9-91d3-e069fe09b4b8-cluster-monitoring-operator-tls") pod "cluster-monitoring-operator-69b6cbdb88-8mdcx" (UID: "5d1ab162-5c9a-42b9-91d3-e069fe09b4b8") : secret "cluster-monitoring-operator-tls" not found Jun 03 01:06:21.033757 ip-10-0-138-55 kubenswrapper[2566]: I0603 01:06:21.033688 2566 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-86d7c6cc77-8nd2x_5776439a-7cdc-49da-a5f6-325eb0c8ab99/console-operator/1.log" Jun 03 01:06:21.034123 ip-10-0-138-55 kubenswrapper[2566]: I0603 01:06:21.034001 2566 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-86d7c6cc77-8nd2x_5776439a-7cdc-49da-a5f6-325eb0c8ab99/console-operator/0.log" Jun 03 01:06:21.034123 ip-10-0-138-55 kubenswrapper[2566]: I0603 01:06:21.034034 2566 generic.go:358] "Generic (PLEG): container finished" podID="5776439a-7cdc-49da-a5f6-325eb0c8ab99" containerID="5be8cd904b80be8ec0a08f5348e2b5a286234ba04caf5961aceacfb6b4b34b0e" exitCode=255 Jun 03 01:06:21.034188 ip-10-0-138-55 kubenswrapper[2566]: I0603 01:06:21.034129 2566 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-console-operator/console-operator-86d7c6cc77-8nd2x" event={"ID":"5776439a-7cdc-49da-a5f6-325eb0c8ab99","Type":"ContainerDied","Data":"5be8cd904b80be8ec0a08f5348e2b5a286234ba04caf5961aceacfb6b4b34b0e"} Jun 03 01:06:21.034188 ip-10-0-138-55 kubenswrapper[2566]: I0603 01:06:21.034179 2566 scope.go:117] "RemoveContainer" containerID="82c9fd810886e8f339352fcdf2e533c9f46d24382b4a225546f5188f8466b0fd" Jun 03 01:06:21.034418 ip-10-0-138-55 kubenswrapper[2566]: I0603 01:06:21.034400 2566 scope.go:117] "RemoveContainer" containerID="5be8cd904b80be8ec0a08f5348e2b5a286234ba04caf5961aceacfb6b4b34b0e" Jun 03 01:06:21.034672 ip-10-0-138-55 kubenswrapper[2566]: E0603 01:06:21.034639 2566 pod_workers.go:1301] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"console-operator\" with CrashLoopBackOff: \"back-off 10s restarting failed container=console-operator pod=console-operator-86d7c6cc77-8nd2x_openshift-console-operator(5776439a-7cdc-49da-a5f6-325eb0c8ab99)\"" pod="openshift-console-operator/console-operator-86d7c6cc77-8nd2x" podUID="5776439a-7cdc-49da-a5f6-325eb0c8ab99" Jun 03 01:06:22.037830 ip-10-0-138-55 kubenswrapper[2566]: I0603 01:06:22.037805 2566 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-86d7c6cc77-8nd2x_5776439a-7cdc-49da-a5f6-325eb0c8ab99/console-operator/1.log" Jun 03 01:06:22.038293 ip-10-0-138-55 kubenswrapper[2566]: I0603 01:06:22.038139 2566 scope.go:117] "RemoveContainer" containerID="5be8cd904b80be8ec0a08f5348e2b5a286234ba04caf5961aceacfb6b4b34b0e" Jun 03 01:06:22.038368 ip-10-0-138-55 kubenswrapper[2566]: E0603 01:06:22.038322 2566 pod_workers.go:1301] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"console-operator\" with CrashLoopBackOff: \"back-off 10s restarting failed container=console-operator pod=console-operator-86d7c6cc77-8nd2x_openshift-console-operator(5776439a-7cdc-49da-a5f6-325eb0c8ab99)\"" pod="openshift-console-operator/console-operator-86d7c6cc77-8nd2x" podUID="5776439a-7cdc-49da-a5f6-325eb0c8ab99" Jun 03 01:06:22.998150 ip-10-0-138-55 kubenswrapper[2566]: I0603 01:06:22.998118 2566 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-kube-storage-version-migrator/migrator-96c6f749-6mlq8"] Jun 03 01:06:23.000099 ip-10-0-138-55 kubenswrapper[2566]: I0603 01:06:23.000081 2566 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-kube-storage-version-migrator/migrator-96c6f749-6mlq8" Jun 03 01:06:23.002156 ip-10-0-138-55 kubenswrapper[2566]: I0603 01:06:23.002140 2566 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-kube-storage-version-migrator\"/\"kube-root-ca.crt\"" Jun 03 01:06:23.002727 ip-10-0-138-55 kubenswrapper[2566]: I0603 01:06:23.002711 2566 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-kube-storage-version-migrator\"/\"openshift-service-ca.crt\"" Jun 03 01:06:23.002809 ip-10-0-138-55 kubenswrapper[2566]: I0603 01:06:23.002728 2566 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-kube-storage-version-migrator\"/\"kube-storage-version-migrator-sa-dockercfg-shvck\"" Jun 03 01:06:23.007521 ip-10-0-138-55 kubenswrapper[2566]: I0603 01:06:23.007498 2566 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-kube-storage-version-migrator/migrator-96c6f749-6mlq8"] Jun 03 01:06:23.040722 ip-10-0-138-55 kubenswrapper[2566]: I0603 01:06:23.040689 2566 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-96ddc787c-9dcb9" event={"ID":"b47d8095-6d81-4a7a-b17f-357d8b59c8d4","Type":"ContainerStarted","Data":"e8ba3f28e18c6bb10dfb2f1eb035dcaa9cede7a363864648d5653717954f2539"} Jun 03 01:06:23.048058 ip-10-0-138-55 kubenswrapper[2566]: I0603 01:06:23.048036 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-hh4rj\" (UniqueName: \"kubernetes.io/projected/21cc8419-7eaa-4033-ba62-a2400cba3b9d-kube-api-access-hh4rj\") pod \"migrator-96c6f749-6mlq8\" (UID: \"21cc8419-7eaa-4033-ba62-a2400cba3b9d\") " pod="openshift-kube-storage-version-migrator/migrator-96c6f749-6mlq8" Jun 03 01:06:23.054663 ip-10-0-138-55 kubenswrapper[2566]: I0603 01:06:23.054623 2566 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-96ddc787c-9dcb9" podStartSLOduration=2.748552644 podStartE2EDuration="5.054611505s" podCreationTimestamp="2026-06-03 01:06:18 +0000 UTC" firstStartedPulling="2026-06-03 01:06:19.764453772 +0000 UTC m=+102.911295708" lastFinishedPulling="2026-06-03 01:06:22.070512644 +0000 UTC m=+105.217354569" observedRunningTime="2026-06-03 01:06:23.053838737 +0000 UTC m=+106.200680686" watchObservedRunningTime="2026-06-03 01:06:23.054611505 +0000 UTC m=+106.201453451" Jun 03 01:06:23.148631 ip-10-0-138-55 kubenswrapper[2566]: I0603 01:06:23.148596 2566 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-hh4rj\" (UniqueName: \"kubernetes.io/projected/21cc8419-7eaa-4033-ba62-a2400cba3b9d-kube-api-access-hh4rj\") pod \"migrator-96c6f749-6mlq8\" (UID: \"21cc8419-7eaa-4033-ba62-a2400cba3b9d\") " pod="openshift-kube-storage-version-migrator/migrator-96c6f749-6mlq8" Jun 03 01:06:23.155672 ip-10-0-138-55 kubenswrapper[2566]: I0603 01:06:23.155647 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-hh4rj\" (UniqueName: \"kubernetes.io/projected/21cc8419-7eaa-4033-ba62-a2400cba3b9d-kube-api-access-hh4rj\") pod \"migrator-96c6f749-6mlq8\" (UID: \"21cc8419-7eaa-4033-ba62-a2400cba3b9d\") " pod="openshift-kube-storage-version-migrator/migrator-96c6f749-6mlq8" Jun 03 01:06:23.309768 ip-10-0-138-55 kubenswrapper[2566]: I0603 01:06:23.309685 2566 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-kube-storage-version-migrator/migrator-96c6f749-6mlq8" Jun 03 01:06:23.355389 ip-10-0-138-55 kubenswrapper[2566]: I0603 01:06:23.355279 2566 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_node-resolver-ztzkx_d3ec3632-b471-46e0-899f-54befd75838a/dns-node-resolver/0.log" Jun 03 01:06:23.429073 ip-10-0-138-55 kubenswrapper[2566]: I0603 01:06:23.429043 2566 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-kube-storage-version-migrator/migrator-96c6f749-6mlq8"] Jun 03 01:06:23.431671 ip-10-0-138-55 kubenswrapper[2566]: W0603 01:06:23.431642 2566 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod21cc8419_7eaa_4033_ba62_a2400cba3b9d.slice/crio-6baf91391bf88ef5ce4ed3e8588d3cc741831759934e03fefd82a846a035295b WatchSource:0}: Error finding container 6baf91391bf88ef5ce4ed3e8588d3cc741831759934e03fefd82a846a035295b: Status 404 returned error can't find the container with id 6baf91391bf88ef5ce4ed3e8588d3cc741831759934e03fefd82a846a035295b Jun 03 01:06:24.043734 ip-10-0-138-55 kubenswrapper[2566]: I0603 01:06:24.043701 2566 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator/migrator-96c6f749-6mlq8" event={"ID":"21cc8419-7eaa-4033-ba62-a2400cba3b9d","Type":"ContainerStarted","Data":"6baf91391bf88ef5ce4ed3e8588d3cc741831759934e03fefd82a846a035295b"} Jun 03 01:06:24.258906 ip-10-0-138-55 kubenswrapper[2566]: I0603 01:06:24.258861 2566 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/0bbb6c21-574c-40af-95cd-2e6d2a4b96ba-registry-tls\") pod \"image-registry-8ddf5bfd5-jc9m2\" (UID: \"0bbb6c21-574c-40af-95cd-2e6d2a4b96ba\") " pod="openshift-image-registry/image-registry-8ddf5bfd5-jc9m2" Jun 03 01:06:24.259090 ip-10-0-138-55 kubenswrapper[2566]: I0603 01:06:24.258939 2566 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/5d1ab162-5c9a-42b9-91d3-e069fe09b4b8-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-69b6cbdb88-8mdcx\" (UID: \"5d1ab162-5c9a-42b9-91d3-e069fe09b4b8\") " pod="openshift-monitoring/cluster-monitoring-operator-69b6cbdb88-8mdcx" Jun 03 01:06:24.259090 ip-10-0-138-55 kubenswrapper[2566]: E0603 01:06:24.259027 2566 projected.go:264] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found Jun 03 01:06:24.259090 ip-10-0-138-55 kubenswrapper[2566]: E0603 01:06:24.259052 2566 projected.go:194] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-8ddf5bfd5-jc9m2: secret "image-registry-tls" not found Jun 03 01:06:24.259090 ip-10-0-138-55 kubenswrapper[2566]: E0603 01:06:24.259074 2566 secret.go:189] Couldn't get secret openshift-monitoring/cluster-monitoring-operator-tls: secret "cluster-monitoring-operator-tls" not found Jun 03 01:06:24.259281 ip-10-0-138-55 kubenswrapper[2566]: E0603 01:06:24.259127 2566 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/0bbb6c21-574c-40af-95cd-2e6d2a4b96ba-registry-tls podName:0bbb6c21-574c-40af-95cd-2e6d2a4b96ba nodeName:}" failed. No retries permitted until 2026-06-03 01:06:32.25910906 +0000 UTC m=+115.405950999 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/0bbb6c21-574c-40af-95cd-2e6d2a4b96ba-registry-tls") pod "image-registry-8ddf5bfd5-jc9m2" (UID: "0bbb6c21-574c-40af-95cd-2e6d2a4b96ba") : secret "image-registry-tls" not found Jun 03 01:06:24.259281 ip-10-0-138-55 kubenswrapper[2566]: E0603 01:06:24.259144 2566 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/5d1ab162-5c9a-42b9-91d3-e069fe09b4b8-cluster-monitoring-operator-tls podName:5d1ab162-5c9a-42b9-91d3-e069fe09b4b8 nodeName:}" failed. No retries permitted until 2026-06-03 01:06:32.259135732 +0000 UTC m=+115.405977656 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "cluster-monitoring-operator-tls" (UniqueName: "kubernetes.io/secret/5d1ab162-5c9a-42b9-91d3-e069fe09b4b8-cluster-monitoring-operator-tls") pod "cluster-monitoring-operator-69b6cbdb88-8mdcx" (UID: "5d1ab162-5c9a-42b9-91d3-e069fe09b4b8") : secret "cluster-monitoring-operator-tls" not found Jun 03 01:06:24.355098 ip-10-0-138-55 kubenswrapper[2566]: I0603 01:06:24.355072 2566 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_node-ca-wl5n2_3e693b71-7178-4400-bdfa-91a820886ab1/node-ca/0.log" Jun 03 01:06:26.048928 ip-10-0-138-55 kubenswrapper[2566]: I0603 01:06:26.048894 2566 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator/migrator-96c6f749-6mlq8" event={"ID":"21cc8419-7eaa-4033-ba62-a2400cba3b9d","Type":"ContainerStarted","Data":"9ee2e9a404a34373bf3e643e11787805a46717e6f05f9f5231f39239a39ebbd4"} Jun 03 01:06:26.048928 ip-10-0-138-55 kubenswrapper[2566]: I0603 01:06:26.048929 2566 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator/migrator-96c6f749-6mlq8" event={"ID":"21cc8419-7eaa-4033-ba62-a2400cba3b9d","Type":"ContainerStarted","Data":"034e06d7b0f976893ec4262cfbd63dfac42d13481068102cc33b683c283ad47c"} Jun 03 01:06:26.067213 ip-10-0-138-55 kubenswrapper[2566]: I0603 01:06:26.067164 2566 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-kube-storage-version-migrator/migrator-96c6f749-6mlq8" podStartSLOduration=2.456885837 podStartE2EDuration="4.067151109s" podCreationTimestamp="2026-06-03 01:06:22 +0000 UTC" firstStartedPulling="2026-06-03 01:06:23.433434498 +0000 UTC m=+106.580276422" lastFinishedPulling="2026-06-03 01:06:25.043699755 +0000 UTC m=+108.190541694" observedRunningTime="2026-06-03 01:06:26.066402849 +0000 UTC m=+109.213244798" watchObservedRunningTime="2026-06-03 01:06:26.067151109 +0000 UTC m=+109.213993100" Jun 03 01:06:26.703383 ip-10-0-138-55 kubenswrapper[2566]: I0603 01:06:26.703350 2566 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console-operator/console-operator-86d7c6cc77-8nd2x" Jun 03 01:06:26.703383 ip-10-0-138-55 kubenswrapper[2566]: I0603 01:06:26.703388 2566 kubelet.go:2658] "SyncLoop (probe)" probe="liveness" status="unhealthy" pod="openshift-console-operator/console-operator-86d7c6cc77-8nd2x" Jun 03 01:06:26.703697 ip-10-0-138-55 kubenswrapper[2566]: I0603 01:06:26.703686 2566 scope.go:117] "RemoveContainer" containerID="5be8cd904b80be8ec0a08f5348e2b5a286234ba04caf5961aceacfb6b4b34b0e" Jun 03 01:06:26.703874 ip-10-0-138-55 kubenswrapper[2566]: E0603 01:06:26.703859 2566 pod_workers.go:1301] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"console-operator\" with CrashLoopBackOff: \"back-off 10s restarting failed container=console-operator pod=console-operator-86d7c6cc77-8nd2x_openshift-console-operator(5776439a-7cdc-49da-a5f6-325eb0c8ab99)\"" pod="openshift-console-operator/console-operator-86d7c6cc77-8nd2x" podUID="5776439a-7cdc-49da-a5f6-325eb0c8ab99" Jun 03 01:06:32.326370 ip-10-0-138-55 kubenswrapper[2566]: I0603 01:06:32.326327 2566 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/5d1ab162-5c9a-42b9-91d3-e069fe09b4b8-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-69b6cbdb88-8mdcx\" (UID: \"5d1ab162-5c9a-42b9-91d3-e069fe09b4b8\") " pod="openshift-monitoring/cluster-monitoring-operator-69b6cbdb88-8mdcx" Jun 03 01:06:32.326725 ip-10-0-138-55 kubenswrapper[2566]: I0603 01:06:32.326415 2566 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/0bbb6c21-574c-40af-95cd-2e6d2a4b96ba-registry-tls\") pod \"image-registry-8ddf5bfd5-jc9m2\" (UID: \"0bbb6c21-574c-40af-95cd-2e6d2a4b96ba\") " pod="openshift-image-registry/image-registry-8ddf5bfd5-jc9m2" Jun 03 01:06:32.326725 ip-10-0-138-55 kubenswrapper[2566]: E0603 01:06:32.326502 2566 secret.go:189] Couldn't get secret openshift-monitoring/cluster-monitoring-operator-tls: secret "cluster-monitoring-operator-tls" not found Jun 03 01:06:32.326725 ip-10-0-138-55 kubenswrapper[2566]: E0603 01:06:32.326522 2566 projected.go:264] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found Jun 03 01:06:32.326725 ip-10-0-138-55 kubenswrapper[2566]: E0603 01:06:32.326532 2566 projected.go:194] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-8ddf5bfd5-jc9m2: secret "image-registry-tls" not found Jun 03 01:06:32.326725 ip-10-0-138-55 kubenswrapper[2566]: E0603 01:06:32.326590 2566 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/5d1ab162-5c9a-42b9-91d3-e069fe09b4b8-cluster-monitoring-operator-tls podName:5d1ab162-5c9a-42b9-91d3-e069fe09b4b8 nodeName:}" failed. No retries permitted until 2026-06-03 01:06:48.326572723 +0000 UTC m=+131.473414646 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "cluster-monitoring-operator-tls" (UniqueName: "kubernetes.io/secret/5d1ab162-5c9a-42b9-91d3-e069fe09b4b8-cluster-monitoring-operator-tls") pod "cluster-monitoring-operator-69b6cbdb88-8mdcx" (UID: "5d1ab162-5c9a-42b9-91d3-e069fe09b4b8") : secret "cluster-monitoring-operator-tls" not found Jun 03 01:06:32.326725 ip-10-0-138-55 kubenswrapper[2566]: E0603 01:06:32.326606 2566 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/0bbb6c21-574c-40af-95cd-2e6d2a4b96ba-registry-tls podName:0bbb6c21-574c-40af-95cd-2e6d2a4b96ba nodeName:}" failed. No retries permitted until 2026-06-03 01:06:48.326599576 +0000 UTC m=+131.473441499 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/0bbb6c21-574c-40af-95cd-2e6d2a4b96ba-registry-tls") pod "image-registry-8ddf5bfd5-jc9m2" (UID: "0bbb6c21-574c-40af-95cd-2e6d2a4b96ba") : secret "image-registry-tls" not found Jun 03 01:06:38.586179 ip-10-0-138-55 kubenswrapper[2566]: I0603 01:06:38.586151 2566 scope.go:117] "RemoveContainer" containerID="5be8cd904b80be8ec0a08f5348e2b5a286234ba04caf5961aceacfb6b4b34b0e" Jun 03 01:06:39.084704 ip-10-0-138-55 kubenswrapper[2566]: I0603 01:06:39.084677 2566 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-86d7c6cc77-8nd2x_5776439a-7cdc-49da-a5f6-325eb0c8ab99/console-operator/1.log" Jun 03 01:06:39.084878 ip-10-0-138-55 kubenswrapper[2566]: I0603 01:06:39.084748 2566 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-console-operator/console-operator-86d7c6cc77-8nd2x" event={"ID":"5776439a-7cdc-49da-a5f6-325eb0c8ab99","Type":"ContainerStarted","Data":"4efcf8f9f3113c5f7620327e30a646d96c9f9d766cce3c314b9a9f100393c5b9"} Jun 03 01:06:39.085034 ip-10-0-138-55 kubenswrapper[2566]: I0603 01:06:39.085016 2566 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console-operator/console-operator-86d7c6cc77-8nd2x" Jun 03 01:06:39.103579 ip-10-0-138-55 kubenswrapper[2566]: I0603 01:06:39.103534 2566 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-console-operator/console-operator-86d7c6cc77-8nd2x" podStartSLOduration=20.311452553 podStartE2EDuration="23.103521744s" podCreationTimestamp="2026-06-03 01:06:16 +0000 UTC" firstStartedPulling="2026-06-03 01:06:16.849356826 +0000 UTC m=+99.996198752" lastFinishedPulling="2026-06-03 01:06:19.641426006 +0000 UTC m=+102.788267943" observedRunningTime="2026-06-03 01:06:39.102948382 +0000 UTC m=+122.249790339" watchObservedRunningTime="2026-06-03 01:06:39.103521744 +0000 UTC m=+122.250363719" Jun 03 01:06:39.250968 ip-10-0-138-55 kubenswrapper[2566]: I0603 01:06:39.250938 2566 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console-operator/console-operator-86d7c6cc77-8nd2x" Jun 03 01:06:46.213576 ip-10-0-138-55 kubenswrapper[2566]: I0603 01:06:46.213532 2566 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-insights/insights-runtime-extractor-v4ppd"] Jun 03 01:06:46.216935 ip-10-0-138-55 kubenswrapper[2566]: I0603 01:06:46.216911 2566 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-runtime-extractor-v4ppd" Jun 03 01:06:46.220689 ip-10-0-138-55 kubenswrapper[2566]: I0603 01:06:46.220665 2566 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-tls\"" Jun 03 01:06:46.220818 ip-10-0-138-55 kubenswrapper[2566]: I0603 01:06:46.220726 2566 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-sa-dockercfg-l2788\"" Jun 03 01:06:46.221215 ip-10-0-138-55 kubenswrapper[2566]: I0603 01:06:46.221200 2566 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"kube-rbac-proxy\"" Jun 03 01:06:46.231913 ip-10-0-138-55 kubenswrapper[2566]: I0603 01:06:46.231891 2566 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-runtime-extractor-v4ppd"] Jun 03 01:06:46.256220 ip-10-0-138-55 kubenswrapper[2566]: I0603 01:06:46.256190 2566 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openshift-image-registry/image-registry-8ddf5bfd5-jc9m2"] Jun 03 01:06:46.256406 ip-10-0-138-55 kubenswrapper[2566]: E0603 01:06:46.256385 2566 pod_workers.go:1301] "Error syncing pod, skipping" err="unmounted volumes=[registry-tls], unattached volumes=[], failed to process volumes=[]: context canceled" pod="openshift-image-registry/image-registry-8ddf5bfd5-jc9m2" podUID="0bbb6c21-574c-40af-95cd-2e6d2a4b96ba" Jun 03 01:06:46.335755 ip-10-0-138-55 kubenswrapper[2566]: I0603 01:06:46.335717 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/78dd0994-42e2-48fc-bd26-3d35afde3e04-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-v4ppd\" (UID: \"78dd0994-42e2-48fc-bd26-3d35afde3e04\") " pod="openshift-insights/insights-runtime-extractor-v4ppd" Jun 03 01:06:46.335925 ip-10-0-138-55 kubenswrapper[2566]: I0603 01:06:46.335779 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-2gvtc\" (UniqueName: \"kubernetes.io/projected/78dd0994-42e2-48fc-bd26-3d35afde3e04-kube-api-access-2gvtc\") pod \"insights-runtime-extractor-v4ppd\" (UID: \"78dd0994-42e2-48fc-bd26-3d35afde3e04\") " pod="openshift-insights/insights-runtime-extractor-v4ppd" Jun 03 01:06:46.335925 ip-10-0-138-55 kubenswrapper[2566]: I0603 01:06:46.335814 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/78dd0994-42e2-48fc-bd26-3d35afde3e04-data-volume\") pod \"insights-runtime-extractor-v4ppd\" (UID: \"78dd0994-42e2-48fc-bd26-3d35afde3e04\") " pod="openshift-insights/insights-runtime-extractor-v4ppd" Jun 03 01:06:46.335925 ip-10-0-138-55 kubenswrapper[2566]: I0603 01:06:46.335887 2566 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/9b00548d-2314-42e7-ab92-ed1462bba025-metrics-certs\") pod \"network-metrics-daemon-vzflm\" (UID: \"9b00548d-2314-42e7-ab92-ed1462bba025\") " pod="openshift-multus/network-metrics-daemon-vzflm" Jun 03 01:06:46.335925 ip-10-0-138-55 kubenswrapper[2566]: I0603 01:06:46.335918 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/78dd0994-42e2-48fc-bd26-3d35afde3e04-crio-socket\") pod \"insights-runtime-extractor-v4ppd\" (UID: \"78dd0994-42e2-48fc-bd26-3d35afde3e04\") " pod="openshift-insights/insights-runtime-extractor-v4ppd" Jun 03 01:06:46.336092 ip-10-0-138-55 kubenswrapper[2566]: I0603 01:06:46.335979 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/78dd0994-42e2-48fc-bd26-3d35afde3e04-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-v4ppd\" (UID: \"78dd0994-42e2-48fc-bd26-3d35afde3e04\") " pod="openshift-insights/insights-runtime-extractor-v4ppd" Jun 03 01:06:46.338234 ip-10-0-138-55 kubenswrapper[2566]: I0603 01:06:46.338205 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/9b00548d-2314-42e7-ab92-ed1462bba025-metrics-certs\") pod \"network-metrics-daemon-vzflm\" (UID: \"9b00548d-2314-42e7-ab92-ed1462bba025\") " pod="openshift-multus/network-metrics-daemon-vzflm" Jun 03 01:06:46.437124 ip-10-0-138-55 kubenswrapper[2566]: I0603 01:06:46.437088 2566 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/78dd0994-42e2-48fc-bd26-3d35afde3e04-crio-socket\") pod \"insights-runtime-extractor-v4ppd\" (UID: \"78dd0994-42e2-48fc-bd26-3d35afde3e04\") " pod="openshift-insights/insights-runtime-extractor-v4ppd" Jun 03 01:06:46.437124 ip-10-0-138-55 kubenswrapper[2566]: I0603 01:06:46.437130 2566 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/78dd0994-42e2-48fc-bd26-3d35afde3e04-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-v4ppd\" (UID: \"78dd0994-42e2-48fc-bd26-3d35afde3e04\") " pod="openshift-insights/insights-runtime-extractor-v4ppd" Jun 03 01:06:46.437373 ip-10-0-138-55 kubenswrapper[2566]: I0603 01:06:46.437173 2566 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/78dd0994-42e2-48fc-bd26-3d35afde3e04-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-v4ppd\" (UID: \"78dd0994-42e2-48fc-bd26-3d35afde3e04\") " pod="openshift-insights/insights-runtime-extractor-v4ppd" Jun 03 01:06:46.437373 ip-10-0-138-55 kubenswrapper[2566]: I0603 01:06:46.437199 2566 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-2gvtc\" (UniqueName: \"kubernetes.io/projected/78dd0994-42e2-48fc-bd26-3d35afde3e04-kube-api-access-2gvtc\") pod \"insights-runtime-extractor-v4ppd\" (UID: \"78dd0994-42e2-48fc-bd26-3d35afde3e04\") " pod="openshift-insights/insights-runtime-extractor-v4ppd" Jun 03 01:06:46.437373 ip-10-0-138-55 kubenswrapper[2566]: I0603 01:06:46.437220 2566 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/78dd0994-42e2-48fc-bd26-3d35afde3e04-data-volume\") pod \"insights-runtime-extractor-v4ppd\" (UID: \"78dd0994-42e2-48fc-bd26-3d35afde3e04\") " pod="openshift-insights/insights-runtime-extractor-v4ppd" Jun 03 01:06:46.437373 ip-10-0-138-55 kubenswrapper[2566]: I0603 01:06:46.437219 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/78dd0994-42e2-48fc-bd26-3d35afde3e04-crio-socket\") pod \"insights-runtime-extractor-v4ppd\" (UID: \"78dd0994-42e2-48fc-bd26-3d35afde3e04\") " pod="openshift-insights/insights-runtime-extractor-v4ppd" Jun 03 01:06:46.437557 ip-10-0-138-55 kubenswrapper[2566]: I0603 01:06:46.437546 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/78dd0994-42e2-48fc-bd26-3d35afde3e04-data-volume\") pod \"insights-runtime-extractor-v4ppd\" (UID: \"78dd0994-42e2-48fc-bd26-3d35afde3e04\") " pod="openshift-insights/insights-runtime-extractor-v4ppd" Jun 03 01:06:46.437855 ip-10-0-138-55 kubenswrapper[2566]: I0603 01:06:46.437832 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/78dd0994-42e2-48fc-bd26-3d35afde3e04-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-v4ppd\" (UID: \"78dd0994-42e2-48fc-bd26-3d35afde3e04\") " pod="openshift-insights/insights-runtime-extractor-v4ppd" Jun 03 01:06:46.439446 ip-10-0-138-55 kubenswrapper[2566]: I0603 01:06:46.439427 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/78dd0994-42e2-48fc-bd26-3d35afde3e04-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-v4ppd\" (UID: \"78dd0994-42e2-48fc-bd26-3d35afde3e04\") " pod="openshift-insights/insights-runtime-extractor-v4ppd" Jun 03 01:06:46.446471 ip-10-0-138-55 kubenswrapper[2566]: I0603 01:06:46.446451 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-2gvtc\" (UniqueName: \"kubernetes.io/projected/78dd0994-42e2-48fc-bd26-3d35afde3e04-kube-api-access-2gvtc\") pod \"insights-runtime-extractor-v4ppd\" (UID: \"78dd0994-42e2-48fc-bd26-3d35afde3e04\") " pod="openshift-insights/insights-runtime-extractor-v4ppd" Jun 03 01:06:46.500878 ip-10-0-138-55 kubenswrapper[2566]: I0603 01:06:46.500816 2566 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-sa-dockercfg-jgszk\"" Jun 03 01:06:46.509848 ip-10-0-138-55 kubenswrapper[2566]: I0603 01:06:46.509828 2566 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-vzflm" Jun 03 01:06:46.525696 ip-10-0-138-55 kubenswrapper[2566]: I0603 01:06:46.525663 2566 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-runtime-extractor-v4ppd" Jun 03 01:06:46.640502 ip-10-0-138-55 kubenswrapper[2566]: I0603 01:06:46.640472 2566 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-multus/network-metrics-daemon-vzflm"] Jun 03 01:06:46.643209 ip-10-0-138-55 kubenswrapper[2566]: W0603 01:06:46.643180 2566 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod9b00548d_2314_42e7_ab92_ed1462bba025.slice/crio-699e40f7e40692c78d1f4cb3cc3c3c8ce7a54809d9284186991a9a6cf84e5af9 WatchSource:0}: Error finding container 699e40f7e40692c78d1f4cb3cc3c3c8ce7a54809d9284186991a9a6cf84e5af9: Status 404 returned error can't find the container with id 699e40f7e40692c78d1f4cb3cc3c3c8ce7a54809d9284186991a9a6cf84e5af9 Jun 03 01:06:46.659088 ip-10-0-138-55 kubenswrapper[2566]: I0603 01:06:46.659065 2566 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-runtime-extractor-v4ppd"] Jun 03 01:06:46.662697 ip-10-0-138-55 kubenswrapper[2566]: W0603 01:06:46.662672 2566 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod78dd0994_42e2_48fc_bd26_3d35afde3e04.slice/crio-85e23023d3576313e7a8fdc04365e8525c01a528732ab0faccecc6a890575a81 WatchSource:0}: Error finding container 85e23023d3576313e7a8fdc04365e8525c01a528732ab0faccecc6a890575a81: Status 404 returned error can't find the container with id 85e23023d3576313e7a8fdc04365e8525c01a528732ab0faccecc6a890575a81 Jun 03 01:06:47.104870 ip-10-0-138-55 kubenswrapper[2566]: I0603 01:06:47.104813 2566 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-v4ppd" event={"ID":"78dd0994-42e2-48fc-bd26-3d35afde3e04","Type":"ContainerStarted","Data":"a2b809a7185e15ea49041a3c31fa4c32ffe8a37b9803c6efea391f600b3774ba"} Jun 03 01:06:47.104870 ip-10-0-138-55 kubenswrapper[2566]: I0603 01:06:47.104856 2566 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-v4ppd" event={"ID":"78dd0994-42e2-48fc-bd26-3d35afde3e04","Type":"ContainerStarted","Data":"85e23023d3576313e7a8fdc04365e8525c01a528732ab0faccecc6a890575a81"} Jun 03 01:06:47.105935 ip-10-0-138-55 kubenswrapper[2566]: I0603 01:06:47.105905 2566 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-vzflm" event={"ID":"9b00548d-2314-42e7-ab92-ed1462bba025","Type":"ContainerStarted","Data":"699e40f7e40692c78d1f4cb3cc3c3c8ce7a54809d9284186991a9a6cf84e5af9"} Jun 03 01:06:47.106055 ip-10-0-138-55 kubenswrapper[2566]: I0603 01:06:47.105936 2566 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-8ddf5bfd5-jc9m2" Jun 03 01:06:47.110741 ip-10-0-138-55 kubenswrapper[2566]: I0603 01:06:47.110720 2566 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-8ddf5bfd5-jc9m2" Jun 03 01:06:47.244788 ip-10-0-138-55 kubenswrapper[2566]: I0603 01:06:47.244753 2566 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-k6cs9\" (UniqueName: \"kubernetes.io/projected/0bbb6c21-574c-40af-95cd-2e6d2a4b96ba-kube-api-access-k6cs9\") pod \"0bbb6c21-574c-40af-95cd-2e6d2a4b96ba\" (UID: \"0bbb6c21-574c-40af-95cd-2e6d2a4b96ba\") " Jun 03 01:06:47.245269 ip-10-0-138-55 kubenswrapper[2566]: I0603 01:06:47.244824 2566 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/0bbb6c21-574c-40af-95cd-2e6d2a4b96ba-trusted-ca\") pod \"0bbb6c21-574c-40af-95cd-2e6d2a4b96ba\" (UID: \"0bbb6c21-574c-40af-95cd-2e6d2a4b96ba\") " Jun 03 01:06:47.245269 ip-10-0-138-55 kubenswrapper[2566]: I0603 01:06:47.244859 2566 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/0bbb6c21-574c-40af-95cd-2e6d2a4b96ba-ca-trust-extracted\") pod \"0bbb6c21-574c-40af-95cd-2e6d2a4b96ba\" (UID: \"0bbb6c21-574c-40af-95cd-2e6d2a4b96ba\") " Jun 03 01:06:47.245269 ip-10-0-138-55 kubenswrapper[2566]: I0603 01:06:47.244893 2566 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/0bbb6c21-574c-40af-95cd-2e6d2a4b96ba-registry-certificates\") pod \"0bbb6c21-574c-40af-95cd-2e6d2a4b96ba\" (UID: \"0bbb6c21-574c-40af-95cd-2e6d2a4b96ba\") " Jun 03 01:06:47.245269 ip-10-0-138-55 kubenswrapper[2566]: I0603 01:06:47.244935 2566 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/0bbb6c21-574c-40af-95cd-2e6d2a4b96ba-bound-sa-token\") pod \"0bbb6c21-574c-40af-95cd-2e6d2a4b96ba\" (UID: \"0bbb6c21-574c-40af-95cd-2e6d2a4b96ba\") " Jun 03 01:06:47.245269 ip-10-0-138-55 kubenswrapper[2566]: I0603 01:06:47.244978 2566 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/0bbb6c21-574c-40af-95cd-2e6d2a4b96ba-image-registry-private-configuration\") pod \"0bbb6c21-574c-40af-95cd-2e6d2a4b96ba\" (UID: \"0bbb6c21-574c-40af-95cd-2e6d2a4b96ba\") " Jun 03 01:06:47.245269 ip-10-0-138-55 kubenswrapper[2566]: I0603 01:06:47.245024 2566 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/0bbb6c21-574c-40af-95cd-2e6d2a4b96ba-installation-pull-secrets\") pod \"0bbb6c21-574c-40af-95cd-2e6d2a4b96ba\" (UID: \"0bbb6c21-574c-40af-95cd-2e6d2a4b96ba\") " Jun 03 01:06:47.245548 ip-10-0-138-55 kubenswrapper[2566]: I0603 01:06:47.245409 2566 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/0bbb6c21-574c-40af-95cd-2e6d2a4b96ba-registry-certificates" (OuterVolumeSpecName: "registry-certificates") pod "0bbb6c21-574c-40af-95cd-2e6d2a4b96ba" (UID: "0bbb6c21-574c-40af-95cd-2e6d2a4b96ba"). InnerVolumeSpecName "registry-certificates". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jun 03 01:06:47.245548 ip-10-0-138-55 kubenswrapper[2566]: I0603 01:06:47.245408 2566 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/0bbb6c21-574c-40af-95cd-2e6d2a4b96ba-trusted-ca" (OuterVolumeSpecName: "trusted-ca") pod "0bbb6c21-574c-40af-95cd-2e6d2a4b96ba" (UID: "0bbb6c21-574c-40af-95cd-2e6d2a4b96ba"). InnerVolumeSpecName "trusted-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jun 03 01:06:47.245548 ip-10-0-138-55 kubenswrapper[2566]: I0603 01:06:47.245462 2566 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/0bbb6c21-574c-40af-95cd-2e6d2a4b96ba-ca-trust-extracted" (OuterVolumeSpecName: "ca-trust-extracted") pod "0bbb6c21-574c-40af-95cd-2e6d2a4b96ba" (UID: "0bbb6c21-574c-40af-95cd-2e6d2a4b96ba"). InnerVolumeSpecName "ca-trust-extracted". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jun 03 01:06:47.247851 ip-10-0-138-55 kubenswrapper[2566]: I0603 01:06:47.247823 2566 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/0bbb6c21-574c-40af-95cd-2e6d2a4b96ba-kube-api-access-k6cs9" (OuterVolumeSpecName: "kube-api-access-k6cs9") pod "0bbb6c21-574c-40af-95cd-2e6d2a4b96ba" (UID: "0bbb6c21-574c-40af-95cd-2e6d2a4b96ba"). InnerVolumeSpecName "kube-api-access-k6cs9". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 03 01:06:47.248305 ip-10-0-138-55 kubenswrapper[2566]: I0603 01:06:47.248255 2566 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/0bbb6c21-574c-40af-95cd-2e6d2a4b96ba-image-registry-private-configuration" (OuterVolumeSpecName: "image-registry-private-configuration") pod "0bbb6c21-574c-40af-95cd-2e6d2a4b96ba" (UID: "0bbb6c21-574c-40af-95cd-2e6d2a4b96ba"). InnerVolumeSpecName "image-registry-private-configuration". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jun 03 01:06:47.248305 ip-10-0-138-55 kubenswrapper[2566]: I0603 01:06:47.248278 2566 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/0bbb6c21-574c-40af-95cd-2e6d2a4b96ba-installation-pull-secrets" (OuterVolumeSpecName: "installation-pull-secrets") pod "0bbb6c21-574c-40af-95cd-2e6d2a4b96ba" (UID: "0bbb6c21-574c-40af-95cd-2e6d2a4b96ba"). InnerVolumeSpecName "installation-pull-secrets". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jun 03 01:06:47.248443 ip-10-0-138-55 kubenswrapper[2566]: I0603 01:06:47.248348 2566 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/0bbb6c21-574c-40af-95cd-2e6d2a4b96ba-bound-sa-token" (OuterVolumeSpecName: "bound-sa-token") pod "0bbb6c21-574c-40af-95cd-2e6d2a4b96ba" (UID: "0bbb6c21-574c-40af-95cd-2e6d2a4b96ba"). InnerVolumeSpecName "bound-sa-token". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 03 01:06:47.346193 ip-10-0-138-55 kubenswrapper[2566]: I0603 01:06:47.346156 2566 reconciler_common.go:299] "Volume detached for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/0bbb6c21-574c-40af-95cd-2e6d2a4b96ba-bound-sa-token\") on node \"ip-10-0-138-55.ec2.internal\" DevicePath \"\"" Jun 03 01:06:47.346339 ip-10-0-138-55 kubenswrapper[2566]: I0603 01:06:47.346195 2566 reconciler_common.go:299] "Volume detached for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/0bbb6c21-574c-40af-95cd-2e6d2a4b96ba-image-registry-private-configuration\") on node \"ip-10-0-138-55.ec2.internal\" DevicePath \"\"" Jun 03 01:06:47.346339 ip-10-0-138-55 kubenswrapper[2566]: I0603 01:06:47.346212 2566 reconciler_common.go:299] "Volume detached for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/0bbb6c21-574c-40af-95cd-2e6d2a4b96ba-installation-pull-secrets\") on node \"ip-10-0-138-55.ec2.internal\" DevicePath \"\"" Jun 03 01:06:47.346339 ip-10-0-138-55 kubenswrapper[2566]: I0603 01:06:47.346244 2566 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-k6cs9\" (UniqueName: \"kubernetes.io/projected/0bbb6c21-574c-40af-95cd-2e6d2a4b96ba-kube-api-access-k6cs9\") on node \"ip-10-0-138-55.ec2.internal\" DevicePath \"\"" Jun 03 01:06:47.346339 ip-10-0-138-55 kubenswrapper[2566]: I0603 01:06:47.346262 2566 reconciler_common.go:299] "Volume detached for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/0bbb6c21-574c-40af-95cd-2e6d2a4b96ba-trusted-ca\") on node \"ip-10-0-138-55.ec2.internal\" DevicePath \"\"" Jun 03 01:06:47.346339 ip-10-0-138-55 kubenswrapper[2566]: I0603 01:06:47.346276 2566 reconciler_common.go:299] "Volume detached for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/0bbb6c21-574c-40af-95cd-2e6d2a4b96ba-ca-trust-extracted\") on node \"ip-10-0-138-55.ec2.internal\" DevicePath \"\"" Jun 03 01:06:47.346339 ip-10-0-138-55 kubenswrapper[2566]: I0603 01:06:47.346288 2566 reconciler_common.go:299] "Volume detached for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/0bbb6c21-574c-40af-95cd-2e6d2a4b96ba-registry-certificates\") on node \"ip-10-0-138-55.ec2.internal\" DevicePath \"\"" Jun 03 01:06:48.109974 ip-10-0-138-55 kubenswrapper[2566]: I0603 01:06:48.109886 2566 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-v4ppd" event={"ID":"78dd0994-42e2-48fc-bd26-3d35afde3e04","Type":"ContainerStarted","Data":"129da1764492ffb109ef8d99e99e4030195257dbd28e35fef01ec36123017ff5"} Jun 03 01:06:48.111341 ip-10-0-138-55 kubenswrapper[2566]: I0603 01:06:48.111315 2566 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-vzflm" event={"ID":"9b00548d-2314-42e7-ab92-ed1462bba025","Type":"ContainerStarted","Data":"c1788d21155f58cf23887a28a6de8efea7b19767ce2b5b49d088bd0dc088daa2"} Jun 03 01:06:48.111396 ip-10-0-138-55 kubenswrapper[2566]: I0603 01:06:48.111350 2566 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-vzflm" event={"ID":"9b00548d-2314-42e7-ab92-ed1462bba025","Type":"ContainerStarted","Data":"e8568c42c04acb7ccbdd1da3e73eddc927421172629775236f80706b93f05718"} Jun 03 01:06:48.111396 ip-10-0-138-55 kubenswrapper[2566]: I0603 01:06:48.111360 2566 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-8ddf5bfd5-jc9m2" Jun 03 01:06:48.140810 ip-10-0-138-55 kubenswrapper[2566]: I0603 01:06:48.140768 2566 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openshift-image-registry/image-registry-8ddf5bfd5-jc9m2"] Jun 03 01:06:48.145629 ip-10-0-138-55 kubenswrapper[2566]: I0603 01:06:48.145596 2566 kubelet.go:2547] "SyncLoop REMOVE" source="api" pods=["openshift-image-registry/image-registry-8ddf5bfd5-jc9m2"] Jun 03 01:06:48.161988 ip-10-0-138-55 kubenswrapper[2566]: I0603 01:06:48.161946 2566 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-multus/network-metrics-daemon-vzflm" podStartSLOduration=130.087080456 podStartE2EDuration="2m11.161930874s" podCreationTimestamp="2026-06-03 01:04:37 +0000 UTC" firstStartedPulling="2026-06-03 01:06:46.645288854 +0000 UTC m=+129.792130779" lastFinishedPulling="2026-06-03 01:06:47.720139271 +0000 UTC m=+130.866981197" observedRunningTime="2026-06-03 01:06:48.161510457 +0000 UTC m=+131.308352405" watchObservedRunningTime="2026-06-03 01:06:48.161930874 +0000 UTC m=+131.308772819" Jun 03 01:06:48.252069 ip-10-0-138-55 kubenswrapper[2566]: I0603 01:06:48.252027 2566 reconciler_common.go:299] "Volume detached for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/0bbb6c21-574c-40af-95cd-2e6d2a4b96ba-registry-tls\") on node \"ip-10-0-138-55.ec2.internal\" DevicePath \"\"" Jun 03 01:06:48.352815 ip-10-0-138-55 kubenswrapper[2566]: I0603 01:06:48.352772 2566 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/5d1ab162-5c9a-42b9-91d3-e069fe09b4b8-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-69b6cbdb88-8mdcx\" (UID: \"5d1ab162-5c9a-42b9-91d3-e069fe09b4b8\") " pod="openshift-monitoring/cluster-monitoring-operator-69b6cbdb88-8mdcx" Jun 03 01:06:48.355563 ip-10-0-138-55 kubenswrapper[2566]: I0603 01:06:48.355532 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/5d1ab162-5c9a-42b9-91d3-e069fe09b4b8-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-69b6cbdb88-8mdcx\" (UID: \"5d1ab162-5c9a-42b9-91d3-e069fe09b4b8\") " pod="openshift-monitoring/cluster-monitoring-operator-69b6cbdb88-8mdcx" Jun 03 01:06:48.597600 ip-10-0-138-55 kubenswrapper[2566]: I0603 01:06:48.597574 2566 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"cluster-monitoring-operator-dockercfg-nqm2z\"" Jun 03 01:06:48.606320 ip-10-0-138-55 kubenswrapper[2566]: I0603 01:06:48.606289 2566 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/cluster-monitoring-operator-69b6cbdb88-8mdcx" Jun 03 01:06:48.765380 ip-10-0-138-55 kubenswrapper[2566]: I0603 01:06:48.765343 2566 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/cluster-monitoring-operator-69b6cbdb88-8mdcx"] Jun 03 01:06:48.768589 ip-10-0-138-55 kubenswrapper[2566]: W0603 01:06:48.768557 2566 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod5d1ab162_5c9a_42b9_91d3_e069fe09b4b8.slice/crio-82895782714d54651d8c91e06b51879a5cbbb56cc486ab0f6fb7ac61a70cfc6c WatchSource:0}: Error finding container 82895782714d54651d8c91e06b51879a5cbbb56cc486ab0f6fb7ac61a70cfc6c: Status 404 returned error can't find the container with id 82895782714d54651d8c91e06b51879a5cbbb56cc486ab0f6fb7ac61a70cfc6c Jun 03 01:06:49.115513 ip-10-0-138-55 kubenswrapper[2566]: I0603 01:06:49.115482 2566 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/cluster-monitoring-operator-69b6cbdb88-8mdcx" event={"ID":"5d1ab162-5c9a-42b9-91d3-e069fe09b4b8","Type":"ContainerStarted","Data":"82895782714d54651d8c91e06b51879a5cbbb56cc486ab0f6fb7ac61a70cfc6c"} Jun 03 01:06:49.588528 ip-10-0-138-55 kubenswrapper[2566]: I0603 01:06:49.588446 2566 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="0bbb6c21-574c-40af-95cd-2e6d2a4b96ba" path="/var/lib/kubelet/pods/0bbb6c21-574c-40af-95cd-2e6d2a4b96ba/volumes" Jun 03 01:06:50.121440 ip-10-0-138-55 kubenswrapper[2566]: I0603 01:06:50.121405 2566 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-v4ppd" event={"ID":"78dd0994-42e2-48fc-bd26-3d35afde3e04","Type":"ContainerStarted","Data":"8b109234793dcc398f394d0c284f763a10f22632a78b987a8e2e70b523994763"} Jun 03 01:06:50.139870 ip-10-0-138-55 kubenswrapper[2566]: I0603 01:06:50.139821 2566 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-insights/insights-runtime-extractor-v4ppd" podStartSLOduration=1.042543947 podStartE2EDuration="4.139807259s" podCreationTimestamp="2026-06-03 01:06:46 +0000 UTC" firstStartedPulling="2026-06-03 01:06:46.725089511 +0000 UTC m=+129.871931435" lastFinishedPulling="2026-06-03 01:06:49.822352806 +0000 UTC m=+132.969194747" observedRunningTime="2026-06-03 01:06:50.139347626 +0000 UTC m=+133.286189576" watchObservedRunningTime="2026-06-03 01:06:50.139807259 +0000 UTC m=+133.286649204" Jun 03 01:06:50.143925 ip-10-0-138-55 kubenswrapper[2566]: I0603 01:06:50.143904 2566 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-console/console-cfbb9ffb-pq8vs"] Jun 03 01:06:50.156151 ip-10-0-138-55 kubenswrapper[2566]: I0603 01:06:50.156124 2566 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-cfbb9ffb-pq8vs"] Jun 03 01:06:50.156294 ip-10-0-138-55 kubenswrapper[2566]: I0603 01:06:50.156273 2566 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-cfbb9ffb-pq8vs" Jun 03 01:06:50.158452 ip-10-0-138-55 kubenswrapper[2566]: I0603 01:06:50.158426 2566 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"console-config\"" Jun 03 01:06:50.161826 ip-10-0-138-55 kubenswrapper[2566]: I0603 01:06:50.160438 2566 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"kube-root-ca.crt\"" Jun 03 01:06:50.161826 ip-10-0-138-55 kubenswrapper[2566]: I0603 01:06:50.160730 2566 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-dockercfg-ftz9d\"" Jun 03 01:06:50.161826 ip-10-0-138-55 kubenswrapper[2566]: I0603 01:06:50.160961 2566 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"service-ca\"" Jun 03 01:06:50.161826 ip-10-0-138-55 kubenswrapper[2566]: I0603 01:06:50.161172 2566 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-oauth-config\"" Jun 03 01:06:50.161826 ip-10-0-138-55 kubenswrapper[2566]: I0603 01:06:50.161441 2566 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"openshift-service-ca.crt\"" Jun 03 01:06:50.161826 ip-10-0-138-55 kubenswrapper[2566]: I0603 01:06:50.161669 2566 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"oauth-serving-cert\"" Jun 03 01:06:50.162395 ip-10-0-138-55 kubenswrapper[2566]: I0603 01:06:50.161945 2566 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-serving-cert\"" Jun 03 01:06:50.268547 ip-10-0-138-55 kubenswrapper[2566]: I0603 01:06:50.268503 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/37f0bd95-7af5-44e6-bb2e-41260f75dfb1-console-serving-cert\") pod \"console-cfbb9ffb-pq8vs\" (UID: \"37f0bd95-7af5-44e6-bb2e-41260f75dfb1\") " pod="openshift-console/console-cfbb9ffb-pq8vs" Jun 03 01:06:50.268694 ip-10-0-138-55 kubenswrapper[2566]: I0603 01:06:50.268599 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-8ppfg\" (UniqueName: \"kubernetes.io/projected/37f0bd95-7af5-44e6-bb2e-41260f75dfb1-kube-api-access-8ppfg\") pod \"console-cfbb9ffb-pq8vs\" (UID: \"37f0bd95-7af5-44e6-bb2e-41260f75dfb1\") " pod="openshift-console/console-cfbb9ffb-pq8vs" Jun 03 01:06:50.268694 ip-10-0-138-55 kubenswrapper[2566]: I0603 01:06:50.268630 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/37f0bd95-7af5-44e6-bb2e-41260f75dfb1-service-ca\") pod \"console-cfbb9ffb-pq8vs\" (UID: \"37f0bd95-7af5-44e6-bb2e-41260f75dfb1\") " pod="openshift-console/console-cfbb9ffb-pq8vs" Jun 03 01:06:50.268694 ip-10-0-138-55 kubenswrapper[2566]: I0603 01:06:50.268656 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/37f0bd95-7af5-44e6-bb2e-41260f75dfb1-console-config\") pod \"console-cfbb9ffb-pq8vs\" (UID: \"37f0bd95-7af5-44e6-bb2e-41260f75dfb1\") " pod="openshift-console/console-cfbb9ffb-pq8vs" Jun 03 01:06:50.268694 ip-10-0-138-55 kubenswrapper[2566]: I0603 01:06:50.268672 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/37f0bd95-7af5-44e6-bb2e-41260f75dfb1-oauth-serving-cert\") pod \"console-cfbb9ffb-pq8vs\" (UID: \"37f0bd95-7af5-44e6-bb2e-41260f75dfb1\") " pod="openshift-console/console-cfbb9ffb-pq8vs" Jun 03 01:06:50.268694 ip-10-0-138-55 kubenswrapper[2566]: I0603 01:06:50.268691 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/37f0bd95-7af5-44e6-bb2e-41260f75dfb1-console-oauth-config\") pod \"console-cfbb9ffb-pq8vs\" (UID: \"37f0bd95-7af5-44e6-bb2e-41260f75dfb1\") " pod="openshift-console/console-cfbb9ffb-pq8vs" Jun 03 01:06:50.369518 ip-10-0-138-55 kubenswrapper[2566]: I0603 01:06:50.369480 2566 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/37f0bd95-7af5-44e6-bb2e-41260f75dfb1-console-oauth-config\") pod \"console-cfbb9ffb-pq8vs\" (UID: \"37f0bd95-7af5-44e6-bb2e-41260f75dfb1\") " pod="openshift-console/console-cfbb9ffb-pq8vs" Jun 03 01:06:50.369713 ip-10-0-138-55 kubenswrapper[2566]: I0603 01:06:50.369555 2566 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/37f0bd95-7af5-44e6-bb2e-41260f75dfb1-console-serving-cert\") pod \"console-cfbb9ffb-pq8vs\" (UID: \"37f0bd95-7af5-44e6-bb2e-41260f75dfb1\") " pod="openshift-console/console-cfbb9ffb-pq8vs" Jun 03 01:06:50.369713 ip-10-0-138-55 kubenswrapper[2566]: I0603 01:06:50.369598 2566 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-8ppfg\" (UniqueName: \"kubernetes.io/projected/37f0bd95-7af5-44e6-bb2e-41260f75dfb1-kube-api-access-8ppfg\") pod \"console-cfbb9ffb-pq8vs\" (UID: \"37f0bd95-7af5-44e6-bb2e-41260f75dfb1\") " pod="openshift-console/console-cfbb9ffb-pq8vs" Jun 03 01:06:50.369898 ip-10-0-138-55 kubenswrapper[2566]: I0603 01:06:50.369746 2566 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/37f0bd95-7af5-44e6-bb2e-41260f75dfb1-service-ca\") pod \"console-cfbb9ffb-pq8vs\" (UID: \"37f0bd95-7af5-44e6-bb2e-41260f75dfb1\") " pod="openshift-console/console-cfbb9ffb-pq8vs" Jun 03 01:06:50.369898 ip-10-0-138-55 kubenswrapper[2566]: I0603 01:06:50.369803 2566 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/37f0bd95-7af5-44e6-bb2e-41260f75dfb1-console-config\") pod \"console-cfbb9ffb-pq8vs\" (UID: \"37f0bd95-7af5-44e6-bb2e-41260f75dfb1\") " pod="openshift-console/console-cfbb9ffb-pq8vs" Jun 03 01:06:50.369898 ip-10-0-138-55 kubenswrapper[2566]: I0603 01:06:50.369835 2566 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/37f0bd95-7af5-44e6-bb2e-41260f75dfb1-oauth-serving-cert\") pod \"console-cfbb9ffb-pq8vs\" (UID: \"37f0bd95-7af5-44e6-bb2e-41260f75dfb1\") " pod="openshift-console/console-cfbb9ffb-pq8vs" Jun 03 01:06:50.370657 ip-10-0-138-55 kubenswrapper[2566]: I0603 01:06:50.370571 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/37f0bd95-7af5-44e6-bb2e-41260f75dfb1-oauth-serving-cert\") pod \"console-cfbb9ffb-pq8vs\" (UID: \"37f0bd95-7af5-44e6-bb2e-41260f75dfb1\") " pod="openshift-console/console-cfbb9ffb-pq8vs" Jun 03 01:06:50.370770 ip-10-0-138-55 kubenswrapper[2566]: I0603 01:06:50.370711 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/37f0bd95-7af5-44e6-bb2e-41260f75dfb1-service-ca\") pod \"console-cfbb9ffb-pq8vs\" (UID: \"37f0bd95-7af5-44e6-bb2e-41260f75dfb1\") " pod="openshift-console/console-cfbb9ffb-pq8vs" Jun 03 01:06:50.370770 ip-10-0-138-55 kubenswrapper[2566]: I0603 01:06:50.370735 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/37f0bd95-7af5-44e6-bb2e-41260f75dfb1-console-config\") pod \"console-cfbb9ffb-pq8vs\" (UID: \"37f0bd95-7af5-44e6-bb2e-41260f75dfb1\") " pod="openshift-console/console-cfbb9ffb-pq8vs" Jun 03 01:06:50.372386 ip-10-0-138-55 kubenswrapper[2566]: I0603 01:06:50.372331 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/37f0bd95-7af5-44e6-bb2e-41260f75dfb1-console-oauth-config\") pod \"console-cfbb9ffb-pq8vs\" (UID: \"37f0bd95-7af5-44e6-bb2e-41260f75dfb1\") " pod="openshift-console/console-cfbb9ffb-pq8vs" Jun 03 01:06:50.372500 ip-10-0-138-55 kubenswrapper[2566]: I0603 01:06:50.372465 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/37f0bd95-7af5-44e6-bb2e-41260f75dfb1-console-serving-cert\") pod \"console-cfbb9ffb-pq8vs\" (UID: \"37f0bd95-7af5-44e6-bb2e-41260f75dfb1\") " pod="openshift-console/console-cfbb9ffb-pq8vs" Jun 03 01:06:50.376849 ip-10-0-138-55 kubenswrapper[2566]: I0603 01:06:50.376824 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-8ppfg\" (UniqueName: \"kubernetes.io/projected/37f0bd95-7af5-44e6-bb2e-41260f75dfb1-kube-api-access-8ppfg\") pod \"console-cfbb9ffb-pq8vs\" (UID: \"37f0bd95-7af5-44e6-bb2e-41260f75dfb1\") " pod="openshift-console/console-cfbb9ffb-pq8vs" Jun 03 01:06:50.471057 ip-10-0-138-55 kubenswrapper[2566]: I0603 01:06:50.471018 2566 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-cfbb9ffb-pq8vs" Jun 03 01:06:50.601941 ip-10-0-138-55 kubenswrapper[2566]: I0603 01:06:50.601905 2566 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-cfbb9ffb-pq8vs"] Jun 03 01:06:50.605348 ip-10-0-138-55 kubenswrapper[2566]: W0603 01:06:50.605320 2566 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod37f0bd95_7af5_44e6_bb2e_41260f75dfb1.slice/crio-fb55292ac93acfd02d5e417d178dc48a399bbc01f2fde8b4bae0ed652e6fa871 WatchSource:0}: Error finding container fb55292ac93acfd02d5e417d178dc48a399bbc01f2fde8b4bae0ed652e6fa871: Status 404 returned error can't find the container with id fb55292ac93acfd02d5e417d178dc48a399bbc01f2fde8b4bae0ed652e6fa871 Jun 03 01:06:51.125360 ip-10-0-138-55 kubenswrapper[2566]: I0603 01:06:51.125321 2566 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-cfbb9ffb-pq8vs" event={"ID":"37f0bd95-7af5-44e6-bb2e-41260f75dfb1","Type":"ContainerStarted","Data":"fb55292ac93acfd02d5e417d178dc48a399bbc01f2fde8b4bae0ed652e6fa871"} Jun 03 01:06:51.814810 ip-10-0-138-55 kubenswrapper[2566]: I0603 01:06:51.814738 2566 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-monitoring/prometheus-operator-admission-webhook-59b7f8756b-vsgcr"] Jun 03 01:06:51.816532 ip-10-0-138-55 kubenswrapper[2566]: I0603 01:06:51.816502 2566 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-operator-admission-webhook-59b7f8756b-vsgcr" Jun 03 01:06:51.818345 ip-10-0-138-55 kubenswrapper[2566]: I0603 01:06:51.818321 2566 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-operator-admission-webhook-tls\"" Jun 03 01:06:51.818478 ip-10-0-138-55 kubenswrapper[2566]: I0603 01:06:51.818355 2566 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-operator-admission-webhook-dockercfg-gdfm6\"" Jun 03 01:06:51.824070 ip-10-0-138-55 kubenswrapper[2566]: I0603 01:06:51.824047 2566 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-operator-admission-webhook-59b7f8756b-vsgcr"] Jun 03 01:06:51.983782 ip-10-0-138-55 kubenswrapper[2566]: I0603 01:06:51.983746 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certificates\" (UniqueName: \"kubernetes.io/secret/04b7774a-b55d-4777-95c1-d18aa479fc2a-tls-certificates\") pod \"prometheus-operator-admission-webhook-59b7f8756b-vsgcr\" (UID: \"04b7774a-b55d-4777-95c1-d18aa479fc2a\") " pod="openshift-monitoring/prometheus-operator-admission-webhook-59b7f8756b-vsgcr" Jun 03 01:06:52.085027 ip-10-0-138-55 kubenswrapper[2566]: I0603 01:06:52.084947 2566 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"tls-certificates\" (UniqueName: \"kubernetes.io/secret/04b7774a-b55d-4777-95c1-d18aa479fc2a-tls-certificates\") pod \"prometheus-operator-admission-webhook-59b7f8756b-vsgcr\" (UID: \"04b7774a-b55d-4777-95c1-d18aa479fc2a\") " pod="openshift-monitoring/prometheus-operator-admission-webhook-59b7f8756b-vsgcr" Jun 03 01:06:52.087914 ip-10-0-138-55 kubenswrapper[2566]: I0603 01:06:52.087884 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-certificates\" (UniqueName: \"kubernetes.io/secret/04b7774a-b55d-4777-95c1-d18aa479fc2a-tls-certificates\") pod \"prometheus-operator-admission-webhook-59b7f8756b-vsgcr\" (UID: \"04b7774a-b55d-4777-95c1-d18aa479fc2a\") " pod="openshift-monitoring/prometheus-operator-admission-webhook-59b7f8756b-vsgcr" Jun 03 01:06:52.125773 ip-10-0-138-55 kubenswrapper[2566]: I0603 01:06:52.125743 2566 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-operator-admission-webhook-59b7f8756b-vsgcr" Jun 03 01:06:52.129097 ip-10-0-138-55 kubenswrapper[2566]: I0603 01:06:52.129068 2566 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/cluster-monitoring-operator-69b6cbdb88-8mdcx" event={"ID":"5d1ab162-5c9a-42b9-91d3-e069fe09b4b8","Type":"ContainerStarted","Data":"bca90bdffe9d5b3b0ceb398f6d027921336a664e9d5259d655057cf083f9d66b"} Jun 03 01:06:52.145328 ip-10-0-138-55 kubenswrapper[2566]: I0603 01:06:52.144954 2566 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-monitoring/cluster-monitoring-operator-69b6cbdb88-8mdcx" podStartSLOduration=33.584618062 podStartE2EDuration="36.144934472s" podCreationTimestamp="2026-06-03 01:06:16 +0000 UTC" firstStartedPulling="2026-06-03 01:06:48.770696011 +0000 UTC m=+131.917537941" lastFinishedPulling="2026-06-03 01:06:51.331012428 +0000 UTC m=+134.477854351" observedRunningTime="2026-06-03 01:06:52.142680485 +0000 UTC m=+135.289522434" watchObservedRunningTime="2026-06-03 01:06:52.144934472 +0000 UTC m=+135.291776422" Jun 03 01:06:52.249059 ip-10-0-138-55 kubenswrapper[2566]: I0603 01:06:52.249029 2566 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-operator-admission-webhook-59b7f8756b-vsgcr"] Jun 03 01:06:52.251880 ip-10-0-138-55 kubenswrapper[2566]: W0603 01:06:52.251856 2566 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod04b7774a_b55d_4777_95c1_d18aa479fc2a.slice/crio-5bd72b37c8239a056fe89ad4cb35eed153b9faec2ad51b6496cf58d02152225e WatchSource:0}: Error finding container 5bd72b37c8239a056fe89ad4cb35eed153b9faec2ad51b6496cf58d02152225e: Status 404 returned error can't find the container with id 5bd72b37c8239a056fe89ad4cb35eed153b9faec2ad51b6496cf58d02152225e Jun 03 01:06:52.332921 ip-10-0-138-55 kubenswrapper[2566]: I0603 01:06:52.332894 2566 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-console/console-746b478965-gtg74"] Jun 03 01:06:52.335355 ip-10-0-138-55 kubenswrapper[2566]: I0603 01:06:52.335312 2566 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-746b478965-gtg74" Jun 03 01:06:52.343444 ip-10-0-138-55 kubenswrapper[2566]: I0603 01:06:52.343423 2566 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"trusted-ca-bundle\"" Jun 03 01:06:52.346955 ip-10-0-138-55 kubenswrapper[2566]: I0603 01:06:52.346934 2566 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-746b478965-gtg74"] Jun 03 01:06:52.489123 ip-10-0-138-55 kubenswrapper[2566]: I0603 01:06:52.489090 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/27030eaa-f2e3-4cc1-8a0a-61c99a27db41-oauth-serving-cert\") pod \"console-746b478965-gtg74\" (UID: \"27030eaa-f2e3-4cc1-8a0a-61c99a27db41\") " pod="openshift-console/console-746b478965-gtg74" Jun 03 01:06:52.489327 ip-10-0-138-55 kubenswrapper[2566]: I0603 01:06:52.489153 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-kbcsz\" (UniqueName: \"kubernetes.io/projected/27030eaa-f2e3-4cc1-8a0a-61c99a27db41-kube-api-access-kbcsz\") pod \"console-746b478965-gtg74\" (UID: \"27030eaa-f2e3-4cc1-8a0a-61c99a27db41\") " pod="openshift-console/console-746b478965-gtg74" Jun 03 01:06:52.489327 ip-10-0-138-55 kubenswrapper[2566]: I0603 01:06:52.489289 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/27030eaa-f2e3-4cc1-8a0a-61c99a27db41-service-ca\") pod \"console-746b478965-gtg74\" (UID: \"27030eaa-f2e3-4cc1-8a0a-61c99a27db41\") " pod="openshift-console/console-746b478965-gtg74" Jun 03 01:06:52.489431 ip-10-0-138-55 kubenswrapper[2566]: I0603 01:06:52.489339 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/27030eaa-f2e3-4cc1-8a0a-61c99a27db41-console-config\") pod \"console-746b478965-gtg74\" (UID: \"27030eaa-f2e3-4cc1-8a0a-61c99a27db41\") " pod="openshift-console/console-746b478965-gtg74" Jun 03 01:06:52.489431 ip-10-0-138-55 kubenswrapper[2566]: I0603 01:06:52.489378 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/27030eaa-f2e3-4cc1-8a0a-61c99a27db41-console-oauth-config\") pod \"console-746b478965-gtg74\" (UID: \"27030eaa-f2e3-4cc1-8a0a-61c99a27db41\") " pod="openshift-console/console-746b478965-gtg74" Jun 03 01:06:52.489431 ip-10-0-138-55 kubenswrapper[2566]: I0603 01:06:52.489408 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/27030eaa-f2e3-4cc1-8a0a-61c99a27db41-trusted-ca-bundle\") pod \"console-746b478965-gtg74\" (UID: \"27030eaa-f2e3-4cc1-8a0a-61c99a27db41\") " pod="openshift-console/console-746b478965-gtg74" Jun 03 01:06:52.489567 ip-10-0-138-55 kubenswrapper[2566]: I0603 01:06:52.489436 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/27030eaa-f2e3-4cc1-8a0a-61c99a27db41-console-serving-cert\") pod \"console-746b478965-gtg74\" (UID: \"27030eaa-f2e3-4cc1-8a0a-61c99a27db41\") " pod="openshift-console/console-746b478965-gtg74" Jun 03 01:06:52.590094 ip-10-0-138-55 kubenswrapper[2566]: I0603 01:06:52.590018 2566 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/27030eaa-f2e3-4cc1-8a0a-61c99a27db41-service-ca\") pod \"console-746b478965-gtg74\" (UID: \"27030eaa-f2e3-4cc1-8a0a-61c99a27db41\") " pod="openshift-console/console-746b478965-gtg74" Jun 03 01:06:52.590094 ip-10-0-138-55 kubenswrapper[2566]: I0603 01:06:52.590061 2566 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/27030eaa-f2e3-4cc1-8a0a-61c99a27db41-console-config\") pod \"console-746b478965-gtg74\" (UID: \"27030eaa-f2e3-4cc1-8a0a-61c99a27db41\") " pod="openshift-console/console-746b478965-gtg74" Jun 03 01:06:52.590094 ip-10-0-138-55 kubenswrapper[2566]: I0603 01:06:52.590093 2566 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/27030eaa-f2e3-4cc1-8a0a-61c99a27db41-console-oauth-config\") pod \"console-746b478965-gtg74\" (UID: \"27030eaa-f2e3-4cc1-8a0a-61c99a27db41\") " pod="openshift-console/console-746b478965-gtg74" Jun 03 01:06:52.590378 ip-10-0-138-55 kubenswrapper[2566]: I0603 01:06:52.590121 2566 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/27030eaa-f2e3-4cc1-8a0a-61c99a27db41-trusted-ca-bundle\") pod \"console-746b478965-gtg74\" (UID: \"27030eaa-f2e3-4cc1-8a0a-61c99a27db41\") " pod="openshift-console/console-746b478965-gtg74" Jun 03 01:06:52.590378 ip-10-0-138-55 kubenswrapper[2566]: I0603 01:06:52.590144 2566 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/27030eaa-f2e3-4cc1-8a0a-61c99a27db41-console-serving-cert\") pod \"console-746b478965-gtg74\" (UID: \"27030eaa-f2e3-4cc1-8a0a-61c99a27db41\") " pod="openshift-console/console-746b478965-gtg74" Jun 03 01:06:52.590378 ip-10-0-138-55 kubenswrapper[2566]: I0603 01:06:52.590176 2566 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/27030eaa-f2e3-4cc1-8a0a-61c99a27db41-oauth-serving-cert\") pod \"console-746b478965-gtg74\" (UID: \"27030eaa-f2e3-4cc1-8a0a-61c99a27db41\") " pod="openshift-console/console-746b478965-gtg74" Jun 03 01:06:52.590378 ip-10-0-138-55 kubenswrapper[2566]: I0603 01:06:52.590238 2566 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-kbcsz\" (UniqueName: \"kubernetes.io/projected/27030eaa-f2e3-4cc1-8a0a-61c99a27db41-kube-api-access-kbcsz\") pod \"console-746b478965-gtg74\" (UID: \"27030eaa-f2e3-4cc1-8a0a-61c99a27db41\") " pod="openshift-console/console-746b478965-gtg74" Jun 03 01:06:52.590825 ip-10-0-138-55 kubenswrapper[2566]: I0603 01:06:52.590786 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/27030eaa-f2e3-4cc1-8a0a-61c99a27db41-service-ca\") pod \"console-746b478965-gtg74\" (UID: \"27030eaa-f2e3-4cc1-8a0a-61c99a27db41\") " pod="openshift-console/console-746b478965-gtg74" Jun 03 01:06:52.590929 ip-10-0-138-55 kubenswrapper[2566]: I0603 01:06:52.590892 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/27030eaa-f2e3-4cc1-8a0a-61c99a27db41-oauth-serving-cert\") pod \"console-746b478965-gtg74\" (UID: \"27030eaa-f2e3-4cc1-8a0a-61c99a27db41\") " pod="openshift-console/console-746b478965-gtg74" Jun 03 01:06:52.591029 ip-10-0-138-55 kubenswrapper[2566]: I0603 01:06:52.591010 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/27030eaa-f2e3-4cc1-8a0a-61c99a27db41-console-config\") pod \"console-746b478965-gtg74\" (UID: \"27030eaa-f2e3-4cc1-8a0a-61c99a27db41\") " pod="openshift-console/console-746b478965-gtg74" Jun 03 01:06:52.591547 ip-10-0-138-55 kubenswrapper[2566]: I0603 01:06:52.591515 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/27030eaa-f2e3-4cc1-8a0a-61c99a27db41-trusted-ca-bundle\") pod \"console-746b478965-gtg74\" (UID: \"27030eaa-f2e3-4cc1-8a0a-61c99a27db41\") " pod="openshift-console/console-746b478965-gtg74" Jun 03 01:06:52.593194 ip-10-0-138-55 kubenswrapper[2566]: I0603 01:06:52.593174 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/27030eaa-f2e3-4cc1-8a0a-61c99a27db41-console-serving-cert\") pod \"console-746b478965-gtg74\" (UID: \"27030eaa-f2e3-4cc1-8a0a-61c99a27db41\") " pod="openshift-console/console-746b478965-gtg74" Jun 03 01:06:52.593313 ip-10-0-138-55 kubenswrapper[2566]: I0603 01:06:52.593285 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/27030eaa-f2e3-4cc1-8a0a-61c99a27db41-console-oauth-config\") pod \"console-746b478965-gtg74\" (UID: \"27030eaa-f2e3-4cc1-8a0a-61c99a27db41\") " pod="openshift-console/console-746b478965-gtg74" Jun 03 01:06:52.598861 ip-10-0-138-55 kubenswrapper[2566]: I0603 01:06:52.598837 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-kbcsz\" (UniqueName: \"kubernetes.io/projected/27030eaa-f2e3-4cc1-8a0a-61c99a27db41-kube-api-access-kbcsz\") pod \"console-746b478965-gtg74\" (UID: \"27030eaa-f2e3-4cc1-8a0a-61c99a27db41\") " pod="openshift-console/console-746b478965-gtg74" Jun 03 01:06:52.645076 ip-10-0-138-55 kubenswrapper[2566]: I0603 01:06:52.645043 2566 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-746b478965-gtg74" Jun 03 01:06:52.761631 ip-10-0-138-55 kubenswrapper[2566]: I0603 01:06:52.761503 2566 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-746b478965-gtg74"] Jun 03 01:06:52.764101 ip-10-0-138-55 kubenswrapper[2566]: W0603 01:06:52.764072 2566 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod27030eaa_f2e3_4cc1_8a0a_61c99a27db41.slice/crio-5bbd9ad4511fde142fb097f097d2c33f3b794821c766715a8a521aca191848b4 WatchSource:0}: Error finding container 5bbd9ad4511fde142fb097f097d2c33f3b794821c766715a8a521aca191848b4: Status 404 returned error can't find the container with id 5bbd9ad4511fde142fb097f097d2c33f3b794821c766715a8a521aca191848b4 Jun 03 01:06:53.133396 ip-10-0-138-55 kubenswrapper[2566]: I0603 01:06:53.133343 2566 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-746b478965-gtg74" event={"ID":"27030eaa-f2e3-4cc1-8a0a-61c99a27db41","Type":"ContainerStarted","Data":"5bbd9ad4511fde142fb097f097d2c33f3b794821c766715a8a521aca191848b4"} Jun 03 01:06:53.134800 ip-10-0-138-55 kubenswrapper[2566]: I0603 01:06:53.134769 2566 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-operator-admission-webhook-59b7f8756b-vsgcr" event={"ID":"04b7774a-b55d-4777-95c1-d18aa479fc2a","Type":"ContainerStarted","Data":"5bd72b37c8239a056fe89ad4cb35eed153b9faec2ad51b6496cf58d02152225e"} Jun 03 01:06:54.139622 ip-10-0-138-55 kubenswrapper[2566]: I0603 01:06:54.139578 2566 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-operator-admission-webhook-59b7f8756b-vsgcr" event={"ID":"04b7774a-b55d-4777-95c1-d18aa479fc2a","Type":"ContainerStarted","Data":"48abc45543cb00bdbec18fcc83e86e8bf2c91f48d48282bbc577f17cdc314058"} Jun 03 01:06:54.140147 ip-10-0-138-55 kubenswrapper[2566]: I0603 01:06:54.140107 2566 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-monitoring/prometheus-operator-admission-webhook-59b7f8756b-vsgcr" Jun 03 01:06:54.146418 ip-10-0-138-55 kubenswrapper[2566]: I0603 01:06:54.146391 2566 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-monitoring/prometheus-operator-admission-webhook-59b7f8756b-vsgcr" Jun 03 01:06:54.154027 ip-10-0-138-55 kubenswrapper[2566]: I0603 01:06:54.153976 2566 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-monitoring/prometheus-operator-admission-webhook-59b7f8756b-vsgcr" podStartSLOduration=2.005121896 podStartE2EDuration="3.153959578s" podCreationTimestamp="2026-06-03 01:06:51 +0000 UTC" firstStartedPulling="2026-06-03 01:06:52.253716299 +0000 UTC m=+135.400558223" lastFinishedPulling="2026-06-03 01:06:53.402553968 +0000 UTC m=+136.549395905" observedRunningTime="2026-06-03 01:06:54.152972562 +0000 UTC m=+137.299814508" watchObservedRunningTime="2026-06-03 01:06:54.153959578 +0000 UTC m=+137.300801526" Jun 03 01:06:54.880619 ip-10-0-138-55 kubenswrapper[2566]: I0603 01:06:54.880585 2566 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-monitoring/prometheus-operator-658bcd8bdf-979l6"] Jun 03 01:06:54.883670 ip-10-0-138-55 kubenswrapper[2566]: I0603 01:06:54.883646 2566 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-operator-658bcd8bdf-979l6" Jun 03 01:06:54.885538 ip-10-0-138-55 kubenswrapper[2566]: I0603 01:06:54.885509 2566 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-operator-tls\"" Jun 03 01:06:54.885671 ip-10-0-138-55 kubenswrapper[2566]: I0603 01:06:54.885545 2566 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-operator-dockercfg-g57zc\"" Jun 03 01:06:54.885671 ip-10-0-138-55 kubenswrapper[2566]: I0603 01:06:54.885548 2566 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-operator-kube-rbac-proxy-config\"" Jun 03 01:06:54.886169 ip-10-0-138-55 kubenswrapper[2566]: I0603 01:06:54.886151 2566 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"metrics-client-ca\"" Jun 03 01:06:54.892637 ip-10-0-138-55 kubenswrapper[2566]: I0603 01:06:54.892475 2566 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-operator-658bcd8bdf-979l6"] Jun 03 01:06:55.011921 ip-10-0-138-55 kubenswrapper[2566]: I0603 01:06:55.011886 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-operator-tls\" (UniqueName: \"kubernetes.io/secret/b9cf3091-8f78-491a-afbd-df28d0a8d7a7-prometheus-operator-tls\") pod \"prometheus-operator-658bcd8bdf-979l6\" (UID: \"b9cf3091-8f78-491a-afbd-df28d0a8d7a7\") " pod="openshift-monitoring/prometheus-operator-658bcd8bdf-979l6" Jun 03 01:06:55.012105 ip-10-0-138-55 kubenswrapper[2566]: I0603 01:06:55.011937 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/b9cf3091-8f78-491a-afbd-df28d0a8d7a7-metrics-client-ca\") pod \"prometheus-operator-658bcd8bdf-979l6\" (UID: \"b9cf3091-8f78-491a-afbd-df28d0a8d7a7\") " pod="openshift-monitoring/prometheus-operator-658bcd8bdf-979l6" Jun 03 01:06:55.012168 ip-10-0-138-55 kubenswrapper[2566]: I0603 01:06:55.012103 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-operator-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/b9cf3091-8f78-491a-afbd-df28d0a8d7a7-prometheus-operator-kube-rbac-proxy-config\") pod \"prometheus-operator-658bcd8bdf-979l6\" (UID: \"b9cf3091-8f78-491a-afbd-df28d0a8d7a7\") " pod="openshift-monitoring/prometheus-operator-658bcd8bdf-979l6" Jun 03 01:06:55.012168 ip-10-0-138-55 kubenswrapper[2566]: I0603 01:06:55.012149 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-hdrln\" (UniqueName: \"kubernetes.io/projected/b9cf3091-8f78-491a-afbd-df28d0a8d7a7-kube-api-access-hdrln\") pod \"prometheus-operator-658bcd8bdf-979l6\" (UID: \"b9cf3091-8f78-491a-afbd-df28d0a8d7a7\") " pod="openshift-monitoring/prometheus-operator-658bcd8bdf-979l6" Jun 03 01:06:55.113485 ip-10-0-138-55 kubenswrapper[2566]: I0603 01:06:55.113444 2566 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/b9cf3091-8f78-491a-afbd-df28d0a8d7a7-metrics-client-ca\") pod \"prometheus-operator-658bcd8bdf-979l6\" (UID: \"b9cf3091-8f78-491a-afbd-df28d0a8d7a7\") " pod="openshift-monitoring/prometheus-operator-658bcd8bdf-979l6" Jun 03 01:06:55.113670 ip-10-0-138-55 kubenswrapper[2566]: I0603 01:06:55.113541 2566 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"prometheus-operator-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/b9cf3091-8f78-491a-afbd-df28d0a8d7a7-prometheus-operator-kube-rbac-proxy-config\") pod \"prometheus-operator-658bcd8bdf-979l6\" (UID: \"b9cf3091-8f78-491a-afbd-df28d0a8d7a7\") " pod="openshift-monitoring/prometheus-operator-658bcd8bdf-979l6" Jun 03 01:06:55.113670 ip-10-0-138-55 kubenswrapper[2566]: I0603 01:06:55.113592 2566 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-hdrln\" (UniqueName: \"kubernetes.io/projected/b9cf3091-8f78-491a-afbd-df28d0a8d7a7-kube-api-access-hdrln\") pod \"prometheus-operator-658bcd8bdf-979l6\" (UID: \"b9cf3091-8f78-491a-afbd-df28d0a8d7a7\") " pod="openshift-monitoring/prometheus-operator-658bcd8bdf-979l6" Jun 03 01:06:55.113670 ip-10-0-138-55 kubenswrapper[2566]: I0603 01:06:55.113637 2566 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"prometheus-operator-tls\" (UniqueName: \"kubernetes.io/secret/b9cf3091-8f78-491a-afbd-df28d0a8d7a7-prometheus-operator-tls\") pod \"prometheus-operator-658bcd8bdf-979l6\" (UID: \"b9cf3091-8f78-491a-afbd-df28d0a8d7a7\") " pod="openshift-monitoring/prometheus-operator-658bcd8bdf-979l6" Jun 03 01:06:55.113809 ip-10-0-138-55 kubenswrapper[2566]: E0603 01:06:55.113749 2566 secret.go:189] Couldn't get secret openshift-monitoring/prometheus-operator-tls: secret "prometheus-operator-tls" not found Jun 03 01:06:55.113848 ip-10-0-138-55 kubenswrapper[2566]: E0603 01:06:55.113828 2566 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/b9cf3091-8f78-491a-afbd-df28d0a8d7a7-prometheus-operator-tls podName:b9cf3091-8f78-491a-afbd-df28d0a8d7a7 nodeName:}" failed. No retries permitted until 2026-06-03 01:06:55.613806744 +0000 UTC m=+138.760648669 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "prometheus-operator-tls" (UniqueName: "kubernetes.io/secret/b9cf3091-8f78-491a-afbd-df28d0a8d7a7-prometheus-operator-tls") pod "prometheus-operator-658bcd8bdf-979l6" (UID: "b9cf3091-8f78-491a-afbd-df28d0a8d7a7") : secret "prometheus-operator-tls" not found Jun 03 01:06:55.114212 ip-10-0-138-55 kubenswrapper[2566]: I0603 01:06:55.114185 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/b9cf3091-8f78-491a-afbd-df28d0a8d7a7-metrics-client-ca\") pod \"prometheus-operator-658bcd8bdf-979l6\" (UID: \"b9cf3091-8f78-491a-afbd-df28d0a8d7a7\") " pod="openshift-monitoring/prometheus-operator-658bcd8bdf-979l6" Jun 03 01:06:55.116282 ip-10-0-138-55 kubenswrapper[2566]: I0603 01:06:55.116257 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"prometheus-operator-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/b9cf3091-8f78-491a-afbd-df28d0a8d7a7-prometheus-operator-kube-rbac-proxy-config\") pod \"prometheus-operator-658bcd8bdf-979l6\" (UID: \"b9cf3091-8f78-491a-afbd-df28d0a8d7a7\") " pod="openshift-monitoring/prometheus-operator-658bcd8bdf-979l6" Jun 03 01:06:55.128885 ip-10-0-138-55 kubenswrapper[2566]: I0603 01:06:55.128864 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-hdrln\" (UniqueName: \"kubernetes.io/projected/b9cf3091-8f78-491a-afbd-df28d0a8d7a7-kube-api-access-hdrln\") pod \"prometheus-operator-658bcd8bdf-979l6\" (UID: \"b9cf3091-8f78-491a-afbd-df28d0a8d7a7\") " pod="openshift-monitoring/prometheus-operator-658bcd8bdf-979l6" Jun 03 01:06:55.617973 ip-10-0-138-55 kubenswrapper[2566]: I0603 01:06:55.617940 2566 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"prometheus-operator-tls\" (UniqueName: \"kubernetes.io/secret/b9cf3091-8f78-491a-afbd-df28d0a8d7a7-prometheus-operator-tls\") pod \"prometheus-operator-658bcd8bdf-979l6\" (UID: \"b9cf3091-8f78-491a-afbd-df28d0a8d7a7\") " pod="openshift-monitoring/prometheus-operator-658bcd8bdf-979l6" Jun 03 01:06:55.620300 ip-10-0-138-55 kubenswrapper[2566]: I0603 01:06:55.620279 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"prometheus-operator-tls\" (UniqueName: \"kubernetes.io/secret/b9cf3091-8f78-491a-afbd-df28d0a8d7a7-prometheus-operator-tls\") pod \"prometheus-operator-658bcd8bdf-979l6\" (UID: \"b9cf3091-8f78-491a-afbd-df28d0a8d7a7\") " pod="openshift-monitoring/prometheus-operator-658bcd8bdf-979l6" Jun 03 01:06:55.795964 ip-10-0-138-55 kubenswrapper[2566]: I0603 01:06:55.795929 2566 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-operator-658bcd8bdf-979l6" Jun 03 01:06:55.916669 ip-10-0-138-55 kubenswrapper[2566]: I0603 01:06:55.916640 2566 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-operator-658bcd8bdf-979l6"] Jun 03 01:06:55.918867 ip-10-0-138-55 kubenswrapper[2566]: W0603 01:06:55.918837 2566 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podb9cf3091_8f78_491a_afbd_df28d0a8d7a7.slice/crio-426b90598751c634d8f048f6c5cfda76b0573f143feb828f29daea62defda0fa WatchSource:0}: Error finding container 426b90598751c634d8f048f6c5cfda76b0573f143feb828f29daea62defda0fa: Status 404 returned error can't find the container with id 426b90598751c634d8f048f6c5cfda76b0573f143feb828f29daea62defda0fa Jun 03 01:06:56.145575 ip-10-0-138-55 kubenswrapper[2566]: I0603 01:06:56.145491 2566 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-cfbb9ffb-pq8vs" event={"ID":"37f0bd95-7af5-44e6-bb2e-41260f75dfb1","Type":"ContainerStarted","Data":"c5323bcd178e158750eba332cc0240b69801a00304c0a2dd3d2a16092cc7c435"} Jun 03 01:06:56.146484 ip-10-0-138-55 kubenswrapper[2566]: I0603 01:06:56.146462 2566 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-operator-658bcd8bdf-979l6" event={"ID":"b9cf3091-8f78-491a-afbd-df28d0a8d7a7","Type":"ContainerStarted","Data":"426b90598751c634d8f048f6c5cfda76b0573f143feb828f29daea62defda0fa"} Jun 03 01:06:56.147587 ip-10-0-138-55 kubenswrapper[2566]: I0603 01:06:56.147565 2566 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-746b478965-gtg74" event={"ID":"27030eaa-f2e3-4cc1-8a0a-61c99a27db41","Type":"ContainerStarted","Data":"b906c3406b8d0b3a5dfd05905bf75cba3dbc8adbc8d9ee3450a319ac37c79d69"} Jun 03 01:06:56.160666 ip-10-0-138-55 kubenswrapper[2566]: I0603 01:06:56.160626 2566 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-console/console-cfbb9ffb-pq8vs" podStartSLOduration=1.42723169 podStartE2EDuration="6.160614405s" podCreationTimestamp="2026-06-03 01:06:50 +0000 UTC" firstStartedPulling="2026-06-03 01:06:50.607416474 +0000 UTC m=+133.754258397" lastFinishedPulling="2026-06-03 01:06:55.340799185 +0000 UTC m=+138.487641112" observedRunningTime="2026-06-03 01:06:56.159442162 +0000 UTC m=+139.306284108" watchObservedRunningTime="2026-06-03 01:06:56.160614405 +0000 UTC m=+139.307456351" Jun 03 01:06:56.173694 ip-10-0-138-55 kubenswrapper[2566]: I0603 01:06:56.173655 2566 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-console/console-746b478965-gtg74" podStartSLOduration=1.6038944339999999 podStartE2EDuration="4.17364435s" podCreationTimestamp="2026-06-03 01:06:52 +0000 UTC" firstStartedPulling="2026-06-03 01:06:52.766261605 +0000 UTC m=+135.913103534" lastFinishedPulling="2026-06-03 01:06:55.336011513 +0000 UTC m=+138.482853450" observedRunningTime="2026-06-03 01:06:56.172752396 +0000 UTC m=+139.319594342" watchObservedRunningTime="2026-06-03 01:06:56.17364435 +0000 UTC m=+139.320486295" Jun 03 01:06:58.154235 ip-10-0-138-55 kubenswrapper[2566]: I0603 01:06:58.154198 2566 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-operator-658bcd8bdf-979l6" event={"ID":"b9cf3091-8f78-491a-afbd-df28d0a8d7a7","Type":"ContainerStarted","Data":"03d2db759eda4b1094b2a23ad5c99f460b68ec49cf1759ae21cf923a475783b6"} Jun 03 01:06:58.154621 ip-10-0-138-55 kubenswrapper[2566]: I0603 01:06:58.154251 2566 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-operator-658bcd8bdf-979l6" event={"ID":"b9cf3091-8f78-491a-afbd-df28d0a8d7a7","Type":"ContainerStarted","Data":"a76a7ce0cc105cb766a875f85b5dbcb63afc73c9a47b6dbfac6ba096cb48c47d"} Jun 03 01:06:58.167820 ip-10-0-138-55 kubenswrapper[2566]: I0603 01:06:58.167762 2566 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-monitoring/prometheus-operator-658bcd8bdf-979l6" podStartSLOduration=2.883065457 podStartE2EDuration="4.167747021s" podCreationTimestamp="2026-06-03 01:06:54 +0000 UTC" firstStartedPulling="2026-06-03 01:06:55.920682598 +0000 UTC m=+139.067524522" lastFinishedPulling="2026-06-03 01:06:57.20536416 +0000 UTC m=+140.352206086" observedRunningTime="2026-06-03 01:06:58.16708684 +0000 UTC m=+141.313928785" watchObservedRunningTime="2026-06-03 01:06:58.167747021 +0000 UTC m=+141.314588968" Jun 03 01:07:00.266748 ip-10-0-138-55 kubenswrapper[2566]: I0603 01:07:00.266714 2566 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-monitoring/openshift-state-metrics-85658796db-q6dzj"] Jun 03 01:07:00.269013 ip-10-0-138-55 kubenswrapper[2566]: I0603 01:07:00.268988 2566 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/openshift-state-metrics-85658796db-q6dzj" Jun 03 01:07:00.270978 ip-10-0-138-55 kubenswrapper[2566]: I0603 01:07:00.270957 2566 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"openshift-state-metrics-tls\"" Jun 03 01:07:00.271094 ip-10-0-138-55 kubenswrapper[2566]: I0603 01:07:00.271076 2566 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"openshift-state-metrics-dockercfg-5h9gm\"" Jun 03 01:07:00.271208 ip-10-0-138-55 kubenswrapper[2566]: I0603 01:07:00.271188 2566 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"openshift-state-metrics-kube-rbac-proxy-config\"" Jun 03 01:07:00.280881 ip-10-0-138-55 kubenswrapper[2566]: I0603 01:07:00.280857 2566 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/openshift-state-metrics-85658796db-q6dzj"] Jun 03 01:07:00.290043 ip-10-0-138-55 kubenswrapper[2566]: I0603 01:07:00.290020 2566 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-monitoring/kube-state-metrics-8469c486bb-p4vjj"] Jun 03 01:07:00.292166 ip-10-0-138-55 kubenswrapper[2566]: I0603 01:07:00.292146 2566 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/kube-state-metrics-8469c486bb-p4vjj" Jun 03 01:07:00.293606 ip-10-0-138-55 kubenswrapper[2566]: I0603 01:07:00.293586 2566 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-monitoring/node-exporter-wpr4v"] Jun 03 01:07:00.294787 ip-10-0-138-55 kubenswrapper[2566]: I0603 01:07:00.294743 2566 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"kube-state-metrics-tls\"" Jun 03 01:07:00.294787 ip-10-0-138-55 kubenswrapper[2566]: I0603 01:07:00.294743 2566 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"kube-state-metrics-kube-rbac-proxy-config\"" Jun 03 01:07:00.294787 ip-10-0-138-55 kubenswrapper[2566]: I0603 01:07:00.294772 2566 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"kube-state-metrics-dockercfg-lzj44\"" Jun 03 01:07:00.295004 ip-10-0-138-55 kubenswrapper[2566]: I0603 01:07:00.294851 2566 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"kube-state-metrics-custom-resource-state-configmap\"" Jun 03 01:07:00.295809 ip-10-0-138-55 kubenswrapper[2566]: I0603 01:07:00.295794 2566 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/node-exporter-wpr4v" Jun 03 01:07:00.297580 ip-10-0-138-55 kubenswrapper[2566]: I0603 01:07:00.297515 2566 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-tls\"" Jun 03 01:07:00.297580 ip-10-0-138-55 kubenswrapper[2566]: I0603 01:07:00.297520 2566 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-dockercfg-sjcbr\"" Jun 03 01:07:00.297806 ip-10-0-138-55 kubenswrapper[2566]: I0603 01:07:00.297769 2566 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-kube-rbac-proxy-config\"" Jun 03 01:07:00.297906 ip-10-0-138-55 kubenswrapper[2566]: I0603 01:07:00.297883 2566 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"node-exporter-accelerators-collector-config\"" Jun 03 01:07:00.305829 ip-10-0-138-55 kubenswrapper[2566]: I0603 01:07:00.305807 2566 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/kube-state-metrics-8469c486bb-p4vjj"] Jun 03 01:07:00.460580 ip-10-0-138-55 kubenswrapper[2566]: I0603 01:07:00.460544 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/e79c5637-7a9b-4530-b492-44cc41e28902-sys\") pod \"node-exporter-wpr4v\" (UID: \"e79c5637-7a9b-4530-b492-44cc41e28902\") " pod="openshift-monitoring/node-exporter-wpr4v" Jun 03 01:07:00.460580 ip-10-0-138-55 kubenswrapper[2566]: I0603 01:07:00.460583 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/e79c5637-7a9b-4530-b492-44cc41e28902-node-exporter-accelerators-collector-config\") pod \"node-exporter-wpr4v\" (UID: \"e79c5637-7a9b-4530-b492-44cc41e28902\") " pod="openshift-monitoring/node-exporter-wpr4v" Jun 03 01:07:00.460825 ip-10-0-138-55 kubenswrapper[2566]: I0603 01:07:00.460608 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-phn9v\" (UniqueName: \"kubernetes.io/projected/e79c5637-7a9b-4530-b492-44cc41e28902-kube-api-access-phn9v\") pod \"node-exporter-wpr4v\" (UID: \"e79c5637-7a9b-4530-b492-44cc41e28902\") " pod="openshift-monitoring/node-exporter-wpr4v" Jun 03 01:07:00.460825 ip-10-0-138-55 kubenswrapper[2566]: I0603 01:07:00.460652 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/e79c5637-7a9b-4530-b492-44cc41e28902-node-exporter-textfile\") pod \"node-exporter-wpr4v\" (UID: \"e79c5637-7a9b-4530-b492-44cc41e28902\") " pod="openshift-monitoring/node-exporter-wpr4v" Jun 03 01:07:00.460825 ip-10-0-138-55 kubenswrapper[2566]: I0603 01:07:00.460675 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-tvm57\" (UniqueName: \"kubernetes.io/projected/2e65f17c-898a-49be-a2a6-7a04d6e36060-kube-api-access-tvm57\") pod \"kube-state-metrics-8469c486bb-p4vjj\" (UID: \"2e65f17c-898a-49be-a2a6-7a04d6e36060\") " pod="openshift-monitoring/kube-state-metrics-8469c486bb-p4vjj" Jun 03 01:07:00.460825 ip-10-0-138-55 kubenswrapper[2566]: I0603 01:07:00.460722 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"volume-directive-shadow\" (UniqueName: \"kubernetes.io/empty-dir/2e65f17c-898a-49be-a2a6-7a04d6e36060-volume-directive-shadow\") pod \"kube-state-metrics-8469c486bb-p4vjj\" (UID: \"2e65f17c-898a-49be-a2a6-7a04d6e36060\") " pod="openshift-monitoring/kube-state-metrics-8469c486bb-p4vjj" Jun 03 01:07:00.460825 ip-10-0-138-55 kubenswrapper[2566]: I0603 01:07:00.460746 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/2e65f17c-898a-49be-a2a6-7a04d6e36060-kube-state-metrics-tls\") pod \"kube-state-metrics-8469c486bb-p4vjj\" (UID: \"2e65f17c-898a-49be-a2a6-7a04d6e36060\") " pod="openshift-monitoring/kube-state-metrics-8469c486bb-p4vjj" Jun 03 01:07:00.460825 ip-10-0-138-55 kubenswrapper[2566]: I0603 01:07:00.460774 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/e79c5637-7a9b-4530-b492-44cc41e28902-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-wpr4v\" (UID: \"e79c5637-7a9b-4530-b492-44cc41e28902\") " pod="openshift-monitoring/node-exporter-wpr4v" Jun 03 01:07:00.460825 ip-10-0-138-55 kubenswrapper[2566]: I0603 01:07:00.460805 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-state-metrics-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/2e65f17c-898a-49be-a2a6-7a04d6e36060-kube-state-metrics-kube-rbac-proxy-config\") pod \"kube-state-metrics-8469c486bb-p4vjj\" (UID: \"2e65f17c-898a-49be-a2a6-7a04d6e36060\") " pod="openshift-monitoring/kube-state-metrics-8469c486bb-p4vjj" Jun 03 01:07:00.461165 ip-10-0-138-55 kubenswrapper[2566]: I0603 01:07:00.460848 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-5k5bx\" (UniqueName: \"kubernetes.io/projected/0a1da2cf-2553-4954-8e0d-4532ccca0977-kube-api-access-5k5bx\") pod \"openshift-state-metrics-85658796db-q6dzj\" (UID: \"0a1da2cf-2553-4954-8e0d-4532ccca0977\") " pod="openshift-monitoring/openshift-state-metrics-85658796db-q6dzj" Jun 03 01:07:00.461165 ip-10-0-138-55 kubenswrapper[2566]: I0603 01:07:00.460875 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/e79c5637-7a9b-4530-b492-44cc41e28902-metrics-client-ca\") pod \"node-exporter-wpr4v\" (UID: \"e79c5637-7a9b-4530-b492-44cc41e28902\") " pod="openshift-monitoring/node-exporter-wpr4v" Jun 03 01:07:00.461165 ip-10-0-138-55 kubenswrapper[2566]: I0603 01:07:00.460911 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"root\" (UniqueName: \"kubernetes.io/host-path/e79c5637-7a9b-4530-b492-44cc41e28902-root\") pod \"node-exporter-wpr4v\" (UID: \"e79c5637-7a9b-4530-b492-44cc41e28902\") " pod="openshift-monitoring/node-exporter-wpr4v" Jun 03 01:07:00.461165 ip-10-0-138-55 kubenswrapper[2566]: I0603 01:07:00.460982 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/0a1da2cf-2553-4954-8e0d-4532ccca0977-openshift-state-metrics-tls\") pod \"openshift-state-metrics-85658796db-q6dzj\" (UID: \"0a1da2cf-2553-4954-8e0d-4532ccca0977\") " pod="openshift-monitoring/openshift-state-metrics-85658796db-q6dzj" Jun 03 01:07:00.461165 ip-10-0-138-55 kubenswrapper[2566]: I0603 01:07:00.461015 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/2e65f17c-898a-49be-a2a6-7a04d6e36060-metrics-client-ca\") pod \"kube-state-metrics-8469c486bb-p4vjj\" (UID: \"2e65f17c-898a-49be-a2a6-7a04d6e36060\") " pod="openshift-monitoring/kube-state-metrics-8469c486bb-p4vjj" Jun 03 01:07:00.461165 ip-10-0-138-55 kubenswrapper[2566]: I0603 01:07:00.461043 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-state-metrics-custom-resource-state-configmap\" (UniqueName: \"kubernetes.io/configmap/2e65f17c-898a-49be-a2a6-7a04d6e36060-kube-state-metrics-custom-resource-state-configmap\") pod \"kube-state-metrics-8469c486bb-p4vjj\" (UID: \"2e65f17c-898a-49be-a2a6-7a04d6e36060\") " pod="openshift-monitoring/kube-state-metrics-8469c486bb-p4vjj" Jun 03 01:07:00.461165 ip-10-0-138-55 kubenswrapper[2566]: I0603 01:07:00.461087 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/0a1da2cf-2553-4954-8e0d-4532ccca0977-metrics-client-ca\") pod \"openshift-state-metrics-85658796db-q6dzj\" (UID: \"0a1da2cf-2553-4954-8e0d-4532ccca0977\") " pod="openshift-monitoring/openshift-state-metrics-85658796db-q6dzj" Jun 03 01:07:00.461165 ip-10-0-138-55 kubenswrapper[2566]: I0603 01:07:00.461113 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/e79c5637-7a9b-4530-b492-44cc41e28902-node-exporter-tls\") pod \"node-exporter-wpr4v\" (UID: \"e79c5637-7a9b-4530-b492-44cc41e28902\") " pod="openshift-monitoring/node-exporter-wpr4v" Jun 03 01:07:00.461165 ip-10-0-138-55 kubenswrapper[2566]: I0603 01:07:00.461144 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/e79c5637-7a9b-4530-b492-44cc41e28902-node-exporter-wtmp\") pod \"node-exporter-wpr4v\" (UID: \"e79c5637-7a9b-4530-b492-44cc41e28902\") " pod="openshift-monitoring/node-exporter-wpr4v" Jun 03 01:07:00.461457 ip-10-0-138-55 kubenswrapper[2566]: I0603 01:07:00.461192 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-state-metrics-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/0a1da2cf-2553-4954-8e0d-4532ccca0977-openshift-state-metrics-kube-rbac-proxy-config\") pod \"openshift-state-metrics-85658796db-q6dzj\" (UID: \"0a1da2cf-2553-4954-8e0d-4532ccca0977\") " pod="openshift-monitoring/openshift-state-metrics-85658796db-q6dzj" Jun 03 01:07:00.471656 ip-10-0-138-55 kubenswrapper[2566]: I0603 01:07:00.471629 2566 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/console-cfbb9ffb-pq8vs" Jun 03 01:07:00.471761 ip-10-0-138-55 kubenswrapper[2566]: I0603 01:07:00.471667 2566 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-console/console-cfbb9ffb-pq8vs" Jun 03 01:07:00.473018 ip-10-0-138-55 kubenswrapper[2566]: I0603 01:07:00.472995 2566 patch_prober.go:28] interesting pod/console-cfbb9ffb-pq8vs container/console namespace/openshift-console: Startup probe status=failure output="Get \"https://10.134.0.15:8443/health\": dial tcp 10.134.0.15:8443: connect: connection refused" start-of-body= Jun 03 01:07:00.473110 ip-10-0-138-55 kubenswrapper[2566]: I0603 01:07:00.473055 2566 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-console/console-cfbb9ffb-pq8vs" podUID="37f0bd95-7af5-44e6-bb2e-41260f75dfb1" containerName="console" probeResult="failure" output="Get \"https://10.134.0.15:8443/health\": dial tcp 10.134.0.15:8443: connect: connection refused" Jun 03 01:07:00.561671 ip-10-0-138-55 kubenswrapper[2566]: I0603 01:07:00.561580 2566 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"openshift-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/0a1da2cf-2553-4954-8e0d-4532ccca0977-openshift-state-metrics-tls\") pod \"openshift-state-metrics-85658796db-q6dzj\" (UID: \"0a1da2cf-2553-4954-8e0d-4532ccca0977\") " pod="openshift-monitoring/openshift-state-metrics-85658796db-q6dzj" Jun 03 01:07:00.561671 ip-10-0-138-55 kubenswrapper[2566]: I0603 01:07:00.561622 2566 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/2e65f17c-898a-49be-a2a6-7a04d6e36060-metrics-client-ca\") pod \"kube-state-metrics-8469c486bb-p4vjj\" (UID: \"2e65f17c-898a-49be-a2a6-7a04d6e36060\") " pod="openshift-monitoring/kube-state-metrics-8469c486bb-p4vjj" Jun 03 01:07:00.561872 ip-10-0-138-55 kubenswrapper[2566]: E0603 01:07:00.561725 2566 secret.go:189] Couldn't get secret openshift-monitoring/openshift-state-metrics-tls: secret "openshift-state-metrics-tls" not found Jun 03 01:07:00.561872 ip-10-0-138-55 kubenswrapper[2566]: E0603 01:07:00.561788 2566 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/0a1da2cf-2553-4954-8e0d-4532ccca0977-openshift-state-metrics-tls podName:0a1da2cf-2553-4954-8e0d-4532ccca0977 nodeName:}" failed. No retries permitted until 2026-06-03 01:07:01.061772676 +0000 UTC m=+144.208614600 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "openshift-state-metrics-tls" (UniqueName: "kubernetes.io/secret/0a1da2cf-2553-4954-8e0d-4532ccca0977-openshift-state-metrics-tls") pod "openshift-state-metrics-85658796db-q6dzj" (UID: "0a1da2cf-2553-4954-8e0d-4532ccca0977") : secret "openshift-state-metrics-tls" not found Jun 03 01:07:00.561991 ip-10-0-138-55 kubenswrapper[2566]: I0603 01:07:00.561872 2566 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-state-metrics-custom-resource-state-configmap\" (UniqueName: \"kubernetes.io/configmap/2e65f17c-898a-49be-a2a6-7a04d6e36060-kube-state-metrics-custom-resource-state-configmap\") pod \"kube-state-metrics-8469c486bb-p4vjj\" (UID: \"2e65f17c-898a-49be-a2a6-7a04d6e36060\") " pod="openshift-monitoring/kube-state-metrics-8469c486bb-p4vjj" Jun 03 01:07:00.561991 ip-10-0-138-55 kubenswrapper[2566]: I0603 01:07:00.561918 2566 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/0a1da2cf-2553-4954-8e0d-4532ccca0977-metrics-client-ca\") pod \"openshift-state-metrics-85658796db-q6dzj\" (UID: \"0a1da2cf-2553-4954-8e0d-4532ccca0977\") " pod="openshift-monitoring/openshift-state-metrics-85658796db-q6dzj" Jun 03 01:07:00.561991 ip-10-0-138-55 kubenswrapper[2566]: I0603 01:07:00.561945 2566 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/e79c5637-7a9b-4530-b492-44cc41e28902-node-exporter-tls\") pod \"node-exporter-wpr4v\" (UID: \"e79c5637-7a9b-4530-b492-44cc41e28902\") " pod="openshift-monitoring/node-exporter-wpr4v" Jun 03 01:07:00.561991 ip-10-0-138-55 kubenswrapper[2566]: I0603 01:07:00.561969 2566 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/e79c5637-7a9b-4530-b492-44cc41e28902-node-exporter-wtmp\") pod \"node-exporter-wpr4v\" (UID: \"e79c5637-7a9b-4530-b492-44cc41e28902\") " pod="openshift-monitoring/node-exporter-wpr4v" Jun 03 01:07:00.562184 ip-10-0-138-55 kubenswrapper[2566]: I0603 01:07:00.562000 2566 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"openshift-state-metrics-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/0a1da2cf-2553-4954-8e0d-4532ccca0977-openshift-state-metrics-kube-rbac-proxy-config\") pod \"openshift-state-metrics-85658796db-q6dzj\" (UID: \"0a1da2cf-2553-4954-8e0d-4532ccca0977\") " pod="openshift-monitoring/openshift-state-metrics-85658796db-q6dzj" Jun 03 01:07:00.562184 ip-10-0-138-55 kubenswrapper[2566]: I0603 01:07:00.562033 2566 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/e79c5637-7a9b-4530-b492-44cc41e28902-sys\") pod \"node-exporter-wpr4v\" (UID: \"e79c5637-7a9b-4530-b492-44cc41e28902\") " pod="openshift-monitoring/node-exporter-wpr4v" Jun 03 01:07:00.562184 ip-10-0-138-55 kubenswrapper[2566]: E0603 01:07:00.562041 2566 secret.go:189] Couldn't get secret openshift-monitoring/node-exporter-tls: secret "node-exporter-tls" not found Jun 03 01:07:00.562184 ip-10-0-138-55 kubenswrapper[2566]: I0603 01:07:00.562075 2566 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/e79c5637-7a9b-4530-b492-44cc41e28902-node-exporter-accelerators-collector-config\") pod \"node-exporter-wpr4v\" (UID: \"e79c5637-7a9b-4530-b492-44cc41e28902\") " pod="openshift-monitoring/node-exporter-wpr4v" Jun 03 01:07:00.562184 ip-10-0-138-55 kubenswrapper[2566]: E0603 01:07:00.562084 2566 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/e79c5637-7a9b-4530-b492-44cc41e28902-node-exporter-tls podName:e79c5637-7a9b-4530-b492-44cc41e28902 nodeName:}" failed. No retries permitted until 2026-06-03 01:07:01.062069655 +0000 UTC m=+144.208911582 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "node-exporter-tls" (UniqueName: "kubernetes.io/secret/e79c5637-7a9b-4530-b492-44cc41e28902-node-exporter-tls") pod "node-exporter-wpr4v" (UID: "e79c5637-7a9b-4530-b492-44cc41e28902") : secret "node-exporter-tls" not found Jun 03 01:07:00.562184 ip-10-0-138-55 kubenswrapper[2566]: I0603 01:07:00.562117 2566 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-phn9v\" (UniqueName: \"kubernetes.io/projected/e79c5637-7a9b-4530-b492-44cc41e28902-kube-api-access-phn9v\") pod \"node-exporter-wpr4v\" (UID: \"e79c5637-7a9b-4530-b492-44cc41e28902\") " pod="openshift-monitoring/node-exporter-wpr4v" Jun 03 01:07:00.562184 ip-10-0-138-55 kubenswrapper[2566]: I0603 01:07:00.562155 2566 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/e79c5637-7a9b-4530-b492-44cc41e28902-node-exporter-textfile\") pod \"node-exporter-wpr4v\" (UID: \"e79c5637-7a9b-4530-b492-44cc41e28902\") " pod="openshift-monitoring/node-exporter-wpr4v" Jun 03 01:07:00.562184 ip-10-0-138-55 kubenswrapper[2566]: I0603 01:07:00.562157 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/e79c5637-7a9b-4530-b492-44cc41e28902-sys\") pod \"node-exporter-wpr4v\" (UID: \"e79c5637-7a9b-4530-b492-44cc41e28902\") " pod="openshift-monitoring/node-exporter-wpr4v" Jun 03 01:07:00.562184 ip-10-0-138-55 kubenswrapper[2566]: I0603 01:07:00.562184 2566 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-tvm57\" (UniqueName: \"kubernetes.io/projected/2e65f17c-898a-49be-a2a6-7a04d6e36060-kube-api-access-tvm57\") pod \"kube-state-metrics-8469c486bb-p4vjj\" (UID: \"2e65f17c-898a-49be-a2a6-7a04d6e36060\") " pod="openshift-monitoring/kube-state-metrics-8469c486bb-p4vjj" Jun 03 01:07:00.562710 ip-10-0-138-55 kubenswrapper[2566]: I0603 01:07:00.562258 2566 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"volume-directive-shadow\" (UniqueName: \"kubernetes.io/empty-dir/2e65f17c-898a-49be-a2a6-7a04d6e36060-volume-directive-shadow\") pod \"kube-state-metrics-8469c486bb-p4vjj\" (UID: \"2e65f17c-898a-49be-a2a6-7a04d6e36060\") " pod="openshift-monitoring/kube-state-metrics-8469c486bb-p4vjj" Jun 03 01:07:00.562710 ip-10-0-138-55 kubenswrapper[2566]: I0603 01:07:00.562285 2566 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/2e65f17c-898a-49be-a2a6-7a04d6e36060-kube-state-metrics-tls\") pod \"kube-state-metrics-8469c486bb-p4vjj\" (UID: \"2e65f17c-898a-49be-a2a6-7a04d6e36060\") " pod="openshift-monitoring/kube-state-metrics-8469c486bb-p4vjj" Jun 03 01:07:00.562710 ip-10-0-138-55 kubenswrapper[2566]: I0603 01:07:00.562312 2566 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/e79c5637-7a9b-4530-b492-44cc41e28902-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-wpr4v\" (UID: \"e79c5637-7a9b-4530-b492-44cc41e28902\") " pod="openshift-monitoring/node-exporter-wpr4v" Jun 03 01:07:00.562710 ip-10-0-138-55 kubenswrapper[2566]: I0603 01:07:00.562348 2566 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-state-metrics-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/2e65f17c-898a-49be-a2a6-7a04d6e36060-kube-state-metrics-kube-rbac-proxy-config\") pod \"kube-state-metrics-8469c486bb-p4vjj\" (UID: \"2e65f17c-898a-49be-a2a6-7a04d6e36060\") " pod="openshift-monitoring/kube-state-metrics-8469c486bb-p4vjj" Jun 03 01:07:00.562710 ip-10-0-138-55 kubenswrapper[2566]: I0603 01:07:00.562406 2566 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-5k5bx\" (UniqueName: \"kubernetes.io/projected/0a1da2cf-2553-4954-8e0d-4532ccca0977-kube-api-access-5k5bx\") pod \"openshift-state-metrics-85658796db-q6dzj\" (UID: \"0a1da2cf-2553-4954-8e0d-4532ccca0977\") " pod="openshift-monitoring/openshift-state-metrics-85658796db-q6dzj" Jun 03 01:07:00.562710 ip-10-0-138-55 kubenswrapper[2566]: I0603 01:07:00.562430 2566 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/e79c5637-7a9b-4530-b492-44cc41e28902-metrics-client-ca\") pod \"node-exporter-wpr4v\" (UID: \"e79c5637-7a9b-4530-b492-44cc41e28902\") " pod="openshift-monitoring/node-exporter-wpr4v" Jun 03 01:07:00.562710 ip-10-0-138-55 kubenswrapper[2566]: I0603 01:07:00.562474 2566 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"root\" (UniqueName: \"kubernetes.io/host-path/e79c5637-7a9b-4530-b492-44cc41e28902-root\") pod \"node-exporter-wpr4v\" (UID: \"e79c5637-7a9b-4530-b492-44cc41e28902\") " pod="openshift-monitoring/node-exporter-wpr4v" Jun 03 01:07:00.562710 ip-10-0-138-55 kubenswrapper[2566]: I0603 01:07:00.562510 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/2e65f17c-898a-49be-a2a6-7a04d6e36060-metrics-client-ca\") pod \"kube-state-metrics-8469c486bb-p4vjj\" (UID: \"2e65f17c-898a-49be-a2a6-7a04d6e36060\") " pod="openshift-monitoring/kube-state-metrics-8469c486bb-p4vjj" Jun 03 01:07:00.562710 ip-10-0-138-55 kubenswrapper[2566]: I0603 01:07:00.562185 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/e79c5637-7a9b-4530-b492-44cc41e28902-node-exporter-wtmp\") pod \"node-exporter-wpr4v\" (UID: \"e79c5637-7a9b-4530-b492-44cc41e28902\") " pod="openshift-monitoring/node-exporter-wpr4v" Jun 03 01:07:00.562710 ip-10-0-138-55 kubenswrapper[2566]: I0603 01:07:00.562587 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/e79c5637-7a9b-4530-b492-44cc41e28902-node-exporter-textfile\") pod \"node-exporter-wpr4v\" (UID: \"e79c5637-7a9b-4530-b492-44cc41e28902\") " pod="openshift-monitoring/node-exporter-wpr4v" Jun 03 01:07:00.563175 ip-10-0-138-55 kubenswrapper[2566]: I0603 01:07:00.562717 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-state-metrics-custom-resource-state-configmap\" (UniqueName: \"kubernetes.io/configmap/2e65f17c-898a-49be-a2a6-7a04d6e36060-kube-state-metrics-custom-resource-state-configmap\") pod \"kube-state-metrics-8469c486bb-p4vjj\" (UID: \"2e65f17c-898a-49be-a2a6-7a04d6e36060\") " pod="openshift-monitoring/kube-state-metrics-8469c486bb-p4vjj" Jun 03 01:07:00.563175 ip-10-0-138-55 kubenswrapper[2566]: I0603 01:07:00.562743 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/0a1da2cf-2553-4954-8e0d-4532ccca0977-metrics-client-ca\") pod \"openshift-state-metrics-85658796db-q6dzj\" (UID: \"0a1da2cf-2553-4954-8e0d-4532ccca0977\") " pod="openshift-monitoring/openshift-state-metrics-85658796db-q6dzj" Jun 03 01:07:00.563175 ip-10-0-138-55 kubenswrapper[2566]: I0603 01:07:00.562797 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"root\" (UniqueName: \"kubernetes.io/host-path/e79c5637-7a9b-4530-b492-44cc41e28902-root\") pod \"node-exporter-wpr4v\" (UID: \"e79c5637-7a9b-4530-b492-44cc41e28902\") " pod="openshift-monitoring/node-exporter-wpr4v" Jun 03 01:07:00.563175 ip-10-0-138-55 kubenswrapper[2566]: I0603 01:07:00.562839 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"volume-directive-shadow\" (UniqueName: \"kubernetes.io/empty-dir/2e65f17c-898a-49be-a2a6-7a04d6e36060-volume-directive-shadow\") pod \"kube-state-metrics-8469c486bb-p4vjj\" (UID: \"2e65f17c-898a-49be-a2a6-7a04d6e36060\") " pod="openshift-monitoring/kube-state-metrics-8469c486bb-p4vjj" Jun 03 01:07:00.563404 ip-10-0-138-55 kubenswrapper[2566]: I0603 01:07:00.563271 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/e79c5637-7a9b-4530-b492-44cc41e28902-node-exporter-accelerators-collector-config\") pod \"node-exporter-wpr4v\" (UID: \"e79c5637-7a9b-4530-b492-44cc41e28902\") " pod="openshift-monitoring/node-exporter-wpr4v" Jun 03 01:07:00.563404 ip-10-0-138-55 kubenswrapper[2566]: I0603 01:07:00.563351 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/e79c5637-7a9b-4530-b492-44cc41e28902-metrics-client-ca\") pod \"node-exporter-wpr4v\" (UID: \"e79c5637-7a9b-4530-b492-44cc41e28902\") " pod="openshift-monitoring/node-exporter-wpr4v" Jun 03 01:07:00.565062 ip-10-0-138-55 kubenswrapper[2566]: I0603 01:07:00.565038 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/2e65f17c-898a-49be-a2a6-7a04d6e36060-kube-state-metrics-tls\") pod \"kube-state-metrics-8469c486bb-p4vjj\" (UID: \"2e65f17c-898a-49be-a2a6-7a04d6e36060\") " pod="openshift-monitoring/kube-state-metrics-8469c486bb-p4vjj" Jun 03 01:07:00.565177 ip-10-0-138-55 kubenswrapper[2566]: I0603 01:07:00.565102 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-state-metrics-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/2e65f17c-898a-49be-a2a6-7a04d6e36060-kube-state-metrics-kube-rbac-proxy-config\") pod \"kube-state-metrics-8469c486bb-p4vjj\" (UID: \"2e65f17c-898a-49be-a2a6-7a04d6e36060\") " pod="openshift-monitoring/kube-state-metrics-8469c486bb-p4vjj" Jun 03 01:07:00.565500 ip-10-0-138-55 kubenswrapper[2566]: I0603 01:07:00.565470 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/e79c5637-7a9b-4530-b492-44cc41e28902-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-wpr4v\" (UID: \"e79c5637-7a9b-4530-b492-44cc41e28902\") " pod="openshift-monitoring/node-exporter-wpr4v" Jun 03 01:07:00.565556 ip-10-0-138-55 kubenswrapper[2566]: I0603 01:07:00.565523 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"openshift-state-metrics-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/0a1da2cf-2553-4954-8e0d-4532ccca0977-openshift-state-metrics-kube-rbac-proxy-config\") pod \"openshift-state-metrics-85658796db-q6dzj\" (UID: \"0a1da2cf-2553-4954-8e0d-4532ccca0977\") " pod="openshift-monitoring/openshift-state-metrics-85658796db-q6dzj" Jun 03 01:07:00.569781 ip-10-0-138-55 kubenswrapper[2566]: I0603 01:07:00.569754 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-phn9v\" (UniqueName: \"kubernetes.io/projected/e79c5637-7a9b-4530-b492-44cc41e28902-kube-api-access-phn9v\") pod \"node-exporter-wpr4v\" (UID: \"e79c5637-7a9b-4530-b492-44cc41e28902\") " pod="openshift-monitoring/node-exporter-wpr4v" Jun 03 01:07:00.570556 ip-10-0-138-55 kubenswrapper[2566]: I0603 01:07:00.570534 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-5k5bx\" (UniqueName: \"kubernetes.io/projected/0a1da2cf-2553-4954-8e0d-4532ccca0977-kube-api-access-5k5bx\") pod \"openshift-state-metrics-85658796db-q6dzj\" (UID: \"0a1da2cf-2553-4954-8e0d-4532ccca0977\") " pod="openshift-monitoring/openshift-state-metrics-85658796db-q6dzj" Jun 03 01:07:00.570635 ip-10-0-138-55 kubenswrapper[2566]: I0603 01:07:00.570556 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-tvm57\" (UniqueName: \"kubernetes.io/projected/2e65f17c-898a-49be-a2a6-7a04d6e36060-kube-api-access-tvm57\") pod \"kube-state-metrics-8469c486bb-p4vjj\" (UID: \"2e65f17c-898a-49be-a2a6-7a04d6e36060\") " pod="openshift-monitoring/kube-state-metrics-8469c486bb-p4vjj" Jun 03 01:07:00.602489 ip-10-0-138-55 kubenswrapper[2566]: I0603 01:07:00.602465 2566 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/kube-state-metrics-8469c486bb-p4vjj" Jun 03 01:07:00.725049 ip-10-0-138-55 kubenswrapper[2566]: I0603 01:07:00.724981 2566 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/kube-state-metrics-8469c486bb-p4vjj"] Jun 03 01:07:00.726956 ip-10-0-138-55 kubenswrapper[2566]: W0603 01:07:00.726928 2566 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod2e65f17c_898a_49be_a2a6_7a04d6e36060.slice/crio-009e72360403ff4d470cb4a6ba5bf4a1e53d6169f7fac170796b8f4cfb54446b WatchSource:0}: Error finding container 009e72360403ff4d470cb4a6ba5bf4a1e53d6169f7fac170796b8f4cfb54446b: Status 404 returned error can't find the container with id 009e72360403ff4d470cb4a6ba5bf4a1e53d6169f7fac170796b8f4cfb54446b Jun 03 01:07:01.068426 ip-10-0-138-55 kubenswrapper[2566]: I0603 01:07:01.068392 2566 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"openshift-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/0a1da2cf-2553-4954-8e0d-4532ccca0977-openshift-state-metrics-tls\") pod \"openshift-state-metrics-85658796db-q6dzj\" (UID: \"0a1da2cf-2553-4954-8e0d-4532ccca0977\") " pod="openshift-monitoring/openshift-state-metrics-85658796db-q6dzj" Jun 03 01:07:01.068597 ip-10-0-138-55 kubenswrapper[2566]: I0603 01:07:01.068456 2566 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/e79c5637-7a9b-4530-b492-44cc41e28902-node-exporter-tls\") pod \"node-exporter-wpr4v\" (UID: \"e79c5637-7a9b-4530-b492-44cc41e28902\") " pod="openshift-monitoring/node-exporter-wpr4v" Jun 03 01:07:01.070821 ip-10-0-138-55 kubenswrapper[2566]: I0603 01:07:01.070782 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/e79c5637-7a9b-4530-b492-44cc41e28902-node-exporter-tls\") pod \"node-exporter-wpr4v\" (UID: \"e79c5637-7a9b-4530-b492-44cc41e28902\") " pod="openshift-monitoring/node-exporter-wpr4v" Jun 03 01:07:01.070947 ip-10-0-138-55 kubenswrapper[2566]: I0603 01:07:01.070839 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"openshift-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/0a1da2cf-2553-4954-8e0d-4532ccca0977-openshift-state-metrics-tls\") pod \"openshift-state-metrics-85658796db-q6dzj\" (UID: \"0a1da2cf-2553-4954-8e0d-4532ccca0977\") " pod="openshift-monitoring/openshift-state-metrics-85658796db-q6dzj" Jun 03 01:07:01.164006 ip-10-0-138-55 kubenswrapper[2566]: I0603 01:07:01.163964 2566 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/kube-state-metrics-8469c486bb-p4vjj" event={"ID":"2e65f17c-898a-49be-a2a6-7a04d6e36060","Type":"ContainerStarted","Data":"009e72360403ff4d470cb4a6ba5bf4a1e53d6169f7fac170796b8f4cfb54446b"} Jun 03 01:07:01.178426 ip-10-0-138-55 kubenswrapper[2566]: I0603 01:07:01.178395 2566 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/openshift-state-metrics-85658796db-q6dzj" Jun 03 01:07:01.208523 ip-10-0-138-55 kubenswrapper[2566]: I0603 01:07:01.208484 2566 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/node-exporter-wpr4v" Jun 03 01:07:01.218997 ip-10-0-138-55 kubenswrapper[2566]: W0603 01:07:01.218961 2566 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pode79c5637_7a9b_4530_b492_44cc41e28902.slice/crio-3fa666d14d0854909b04c6f134a7204c0e9ea7af09f7b6a3beb5ff7258517722 WatchSource:0}: Error finding container 3fa666d14d0854909b04c6f134a7204c0e9ea7af09f7b6a3beb5ff7258517722: Status 404 returned error can't find the container with id 3fa666d14d0854909b04c6f134a7204c0e9ea7af09f7b6a3beb5ff7258517722 Jun 03 01:07:01.316507 ip-10-0-138-55 kubenswrapper[2566]: I0603 01:07:01.316470 2566 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/openshift-state-metrics-85658796db-q6dzj"] Jun 03 01:07:01.319218 ip-10-0-138-55 kubenswrapper[2566]: W0603 01:07:01.319113 2566 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod0a1da2cf_2553_4954_8e0d_4532ccca0977.slice/crio-7f071554b6fdb01e3bc79ead59b7155dec69bcd974c2d1e7f16643420ba89462 WatchSource:0}: Error finding container 7f071554b6fdb01e3bc79ead59b7155dec69bcd974c2d1e7f16643420ba89462: Status 404 returned error can't find the container with id 7f071554b6fdb01e3bc79ead59b7155dec69bcd974c2d1e7f16643420ba89462 Jun 03 01:07:01.320974 ip-10-0-138-55 kubenswrapper[2566]: I0603 01:07:01.320945 2566 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-monitoring/alertmanager-main-0"] Jun 03 01:07:01.324925 ip-10-0-138-55 kubenswrapper[2566]: I0603 01:07:01.324904 2566 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/alertmanager-main-0" Jun 03 01:07:01.327302 ip-10-0-138-55 kubenswrapper[2566]: I0603 01:07:01.327078 2566 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-generated\"" Jun 03 01:07:01.327302 ip-10-0-138-55 kubenswrapper[2566]: I0603 01:07:01.327092 2566 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-dockercfg-889ww\"" Jun 03 01:07:01.327302 ip-10-0-138-55 kubenswrapper[2566]: I0603 01:07:01.327112 2566 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-tls\"" Jun 03 01:07:01.327302 ip-10-0-138-55 kubenswrapper[2566]: I0603 01:07:01.327253 2566 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-kube-rbac-proxy\"" Jun 03 01:07:01.327552 ip-10-0-138-55 kubenswrapper[2566]: I0603 01:07:01.327428 2566 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-web-config\"" Jun 03 01:07:01.327552 ip-10-0-138-55 kubenswrapper[2566]: I0603 01:07:01.327471 2566 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-cluster-tls-config\"" Jun 03 01:07:01.327552 ip-10-0-138-55 kubenswrapper[2566]: I0603 01:07:01.327485 2566 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-kube-rbac-proxy-web\"" Jun 03 01:07:01.327552 ip-10-0-138-55 kubenswrapper[2566]: I0603 01:07:01.327427 2566 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"alertmanager-trusted-ca-bundle\"" Jun 03 01:07:01.327740 ip-10-0-138-55 kubenswrapper[2566]: I0603 01:07:01.327598 2566 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-tls-assets-0\"" Jun 03 01:07:01.327981 ip-10-0-138-55 kubenswrapper[2566]: I0603 01:07:01.327962 2566 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-kube-rbac-proxy-metric\"" Jun 03 01:07:01.335387 ip-10-0-138-55 kubenswrapper[2566]: I0603 01:07:01.335361 2566 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/alertmanager-main-0"] Jun 03 01:07:01.370638 ip-10-0-138-55 kubenswrapper[2566]: I0603 01:07:01.370604 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/d2415250-c38e-4199-a530-040c21e2336b-secret-alertmanager-kube-rbac-proxy\") pod \"alertmanager-main-0\" (UID: \"d2415250-c38e-4199-a530-040c21e2336b\") " pod="openshift-monitoring/alertmanager-main-0" Jun 03 01:07:01.370804 ip-10-0-138-55 kubenswrapper[2566]: I0603 01:07:01.370650 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/d2415250-c38e-4199-a530-040c21e2336b-config-volume\") pod \"alertmanager-main-0\" (UID: \"d2415250-c38e-4199-a530-040c21e2336b\") " pod="openshift-monitoring/alertmanager-main-0" Jun 03 01:07:01.370804 ip-10-0-138-55 kubenswrapper[2566]: I0603 01:07:01.370669 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/d2415250-c38e-4199-a530-040c21e2336b-cluster-tls-config\") pod \"alertmanager-main-0\" (UID: \"d2415250-c38e-4199-a530-040c21e2336b\") " pod="openshift-monitoring/alertmanager-main-0" Jun 03 01:07:01.370804 ip-10-0-138-55 kubenswrapper[2566]: I0603 01:07:01.370714 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/d2415250-c38e-4199-a530-040c21e2336b-web-config\") pod \"alertmanager-main-0\" (UID: \"d2415250-c38e-4199-a530-040c21e2336b\") " pod="openshift-monitoring/alertmanager-main-0" Jun 03 01:07:01.370940 ip-10-0-138-55 kubenswrapper[2566]: I0603 01:07:01.370820 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/d2415250-c38e-4199-a530-040c21e2336b-secret-alertmanager-kube-rbac-proxy-metric\") pod \"alertmanager-main-0\" (UID: \"d2415250-c38e-4199-a530-040c21e2336b\") " pod="openshift-monitoring/alertmanager-main-0" Jun 03 01:07:01.370940 ip-10-0-138-55 kubenswrapper[2566]: I0603 01:07:01.370850 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/d2415250-c38e-4199-a530-040c21e2336b-config-out\") pod \"alertmanager-main-0\" (UID: \"d2415250-c38e-4199-a530-040c21e2336b\") " pod="openshift-monitoring/alertmanager-main-0" Jun 03 01:07:01.370940 ip-10-0-138-55 kubenswrapper[2566]: I0603 01:07:01.370888 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/d2415250-c38e-4199-a530-040c21e2336b-alertmanager-main-db\") pod \"alertmanager-main-0\" (UID: \"d2415250-c38e-4199-a530-040c21e2336b\") " pod="openshift-monitoring/alertmanager-main-0" Jun 03 01:07:01.371056 ip-10-0-138-55 kubenswrapper[2566]: I0603 01:07:01.370977 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/d2415250-c38e-4199-a530-040c21e2336b-secret-alertmanager-main-tls\") pod \"alertmanager-main-0\" (UID: \"d2415250-c38e-4199-a530-040c21e2336b\") " pod="openshift-monitoring/alertmanager-main-0" Jun 03 01:07:01.371088 ip-10-0-138-55 kubenswrapper[2566]: I0603 01:07:01.371075 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/d2415250-c38e-4199-a530-040c21e2336b-metrics-client-ca\") pod \"alertmanager-main-0\" (UID: \"d2415250-c38e-4199-a530-040c21e2336b\") " pod="openshift-monitoring/alertmanager-main-0" Jun 03 01:07:01.371123 ip-10-0-138-55 kubenswrapper[2566]: I0603 01:07:01.371098 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/d2415250-c38e-4199-a530-040c21e2336b-alertmanager-trusted-ca-bundle\") pod \"alertmanager-main-0\" (UID: \"d2415250-c38e-4199-a530-040c21e2336b\") " pod="openshift-monitoring/alertmanager-main-0" Jun 03 01:07:01.371160 ip-10-0-138-55 kubenswrapper[2566]: I0603 01:07:01.371125 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/d2415250-c38e-4199-a530-040c21e2336b-secret-alertmanager-kube-rbac-proxy-web\") pod \"alertmanager-main-0\" (UID: \"d2415250-c38e-4199-a530-040c21e2336b\") " pod="openshift-monitoring/alertmanager-main-0" Jun 03 01:07:01.371160 ip-10-0-138-55 kubenswrapper[2566]: I0603 01:07:01.371150 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-b867q\" (UniqueName: \"kubernetes.io/projected/d2415250-c38e-4199-a530-040c21e2336b-kube-api-access-b867q\") pod \"alertmanager-main-0\" (UID: \"d2415250-c38e-4199-a530-040c21e2336b\") " pod="openshift-monitoring/alertmanager-main-0" Jun 03 01:07:01.371258 ip-10-0-138-55 kubenswrapper[2566]: I0603 01:07:01.371176 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/d2415250-c38e-4199-a530-040c21e2336b-tls-assets\") pod \"alertmanager-main-0\" (UID: \"d2415250-c38e-4199-a530-040c21e2336b\") " pod="openshift-monitoring/alertmanager-main-0" Jun 03 01:07:01.471746 ip-10-0-138-55 kubenswrapper[2566]: I0603 01:07:01.471714 2566 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/d2415250-c38e-4199-a530-040c21e2336b-metrics-client-ca\") pod \"alertmanager-main-0\" (UID: \"d2415250-c38e-4199-a530-040c21e2336b\") " pod="openshift-monitoring/alertmanager-main-0" Jun 03 01:07:01.471866 ip-10-0-138-55 kubenswrapper[2566]: I0603 01:07:01.471761 2566 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/d2415250-c38e-4199-a530-040c21e2336b-alertmanager-trusted-ca-bundle\") pod \"alertmanager-main-0\" (UID: \"d2415250-c38e-4199-a530-040c21e2336b\") " pod="openshift-monitoring/alertmanager-main-0" Jun 03 01:07:01.471866 ip-10-0-138-55 kubenswrapper[2566]: I0603 01:07:01.471792 2566 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/d2415250-c38e-4199-a530-040c21e2336b-secret-alertmanager-kube-rbac-proxy-web\") pod \"alertmanager-main-0\" (UID: \"d2415250-c38e-4199-a530-040c21e2336b\") " pod="openshift-monitoring/alertmanager-main-0" Jun 03 01:07:01.471866 ip-10-0-138-55 kubenswrapper[2566]: I0603 01:07:01.471817 2566 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-b867q\" (UniqueName: \"kubernetes.io/projected/d2415250-c38e-4199-a530-040c21e2336b-kube-api-access-b867q\") pod \"alertmanager-main-0\" (UID: \"d2415250-c38e-4199-a530-040c21e2336b\") " pod="openshift-monitoring/alertmanager-main-0" Jun 03 01:07:01.471866 ip-10-0-138-55 kubenswrapper[2566]: I0603 01:07:01.471845 2566 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/d2415250-c38e-4199-a530-040c21e2336b-tls-assets\") pod \"alertmanager-main-0\" (UID: \"d2415250-c38e-4199-a530-040c21e2336b\") " pod="openshift-monitoring/alertmanager-main-0" Jun 03 01:07:01.471866 ip-10-0-138-55 kubenswrapper[2566]: I0603 01:07:01.471872 2566 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/d2415250-c38e-4199-a530-040c21e2336b-secret-alertmanager-kube-rbac-proxy\") pod \"alertmanager-main-0\" (UID: \"d2415250-c38e-4199-a530-040c21e2336b\") " pod="openshift-monitoring/alertmanager-main-0" Jun 03 01:07:01.472149 ip-10-0-138-55 kubenswrapper[2566]: I0603 01:07:01.471915 2566 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/d2415250-c38e-4199-a530-040c21e2336b-config-volume\") pod \"alertmanager-main-0\" (UID: \"d2415250-c38e-4199-a530-040c21e2336b\") " pod="openshift-monitoring/alertmanager-main-0" Jun 03 01:07:01.472149 ip-10-0-138-55 kubenswrapper[2566]: I0603 01:07:01.471938 2566 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/d2415250-c38e-4199-a530-040c21e2336b-cluster-tls-config\") pod \"alertmanager-main-0\" (UID: \"d2415250-c38e-4199-a530-040c21e2336b\") " pod="openshift-monitoring/alertmanager-main-0" Jun 03 01:07:01.472149 ip-10-0-138-55 kubenswrapper[2566]: I0603 01:07:01.471969 2566 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/d2415250-c38e-4199-a530-040c21e2336b-web-config\") pod \"alertmanager-main-0\" (UID: \"d2415250-c38e-4199-a530-040c21e2336b\") " pod="openshift-monitoring/alertmanager-main-0" Jun 03 01:07:01.472149 ip-10-0-138-55 kubenswrapper[2566]: I0603 01:07:01.472011 2566 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/d2415250-c38e-4199-a530-040c21e2336b-secret-alertmanager-kube-rbac-proxy-metric\") pod \"alertmanager-main-0\" (UID: \"d2415250-c38e-4199-a530-040c21e2336b\") " pod="openshift-monitoring/alertmanager-main-0" Jun 03 01:07:01.472149 ip-10-0-138-55 kubenswrapper[2566]: I0603 01:07:01.472038 2566 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/d2415250-c38e-4199-a530-040c21e2336b-config-out\") pod \"alertmanager-main-0\" (UID: \"d2415250-c38e-4199-a530-040c21e2336b\") " pod="openshift-monitoring/alertmanager-main-0" Jun 03 01:07:01.472149 ip-10-0-138-55 kubenswrapper[2566]: I0603 01:07:01.472061 2566 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/d2415250-c38e-4199-a530-040c21e2336b-alertmanager-main-db\") pod \"alertmanager-main-0\" (UID: \"d2415250-c38e-4199-a530-040c21e2336b\") " pod="openshift-monitoring/alertmanager-main-0" Jun 03 01:07:01.472149 ip-10-0-138-55 kubenswrapper[2566]: I0603 01:07:01.472116 2566 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/d2415250-c38e-4199-a530-040c21e2336b-secret-alertmanager-main-tls\") pod \"alertmanager-main-0\" (UID: \"d2415250-c38e-4199-a530-040c21e2336b\") " pod="openshift-monitoring/alertmanager-main-0" Jun 03 01:07:01.472590 ip-10-0-138-55 kubenswrapper[2566]: E0603 01:07:01.472338 2566 secret.go:189] Couldn't get secret openshift-monitoring/alertmanager-main-tls: secret "alertmanager-main-tls" not found Jun 03 01:07:01.472590 ip-10-0-138-55 kubenswrapper[2566]: E0603 01:07:01.472390 2566 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/d2415250-c38e-4199-a530-040c21e2336b-secret-alertmanager-main-tls podName:d2415250-c38e-4199-a530-040c21e2336b nodeName:}" failed. No retries permitted until 2026-06-03 01:07:01.972371005 +0000 UTC m=+145.119212932 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "secret-alertmanager-main-tls" (UniqueName: "kubernetes.io/secret/d2415250-c38e-4199-a530-040c21e2336b-secret-alertmanager-main-tls") pod "alertmanager-main-0" (UID: "d2415250-c38e-4199-a530-040c21e2336b") : secret "alertmanager-main-tls" not found Jun 03 01:07:01.472590 ip-10-0-138-55 kubenswrapper[2566]: E0603 01:07:01.472564 2566 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/d2415250-c38e-4199-a530-040c21e2336b-alertmanager-trusted-ca-bundle podName:d2415250-c38e-4199-a530-040c21e2336b nodeName:}" failed. No retries permitted until 2026-06-03 01:07:01.972543706 +0000 UTC m=+145.119385634 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "alertmanager-trusted-ca-bundle" (UniqueName: "kubernetes.io/configmap/d2415250-c38e-4199-a530-040c21e2336b-alertmanager-trusted-ca-bundle") pod "alertmanager-main-0" (UID: "d2415250-c38e-4199-a530-040c21e2336b") : configmap references non-existent config key: ca-bundle.crt Jun 03 01:07:01.473355 ip-10-0-138-55 kubenswrapper[2566]: I0603 01:07:01.473268 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/d2415250-c38e-4199-a530-040c21e2336b-alertmanager-main-db\") pod \"alertmanager-main-0\" (UID: \"d2415250-c38e-4199-a530-040c21e2336b\") " pod="openshift-monitoring/alertmanager-main-0" Jun 03 01:07:01.473823 ip-10-0-138-55 kubenswrapper[2566]: I0603 01:07:01.473777 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/d2415250-c38e-4199-a530-040c21e2336b-metrics-client-ca\") pod \"alertmanager-main-0\" (UID: \"d2415250-c38e-4199-a530-040c21e2336b\") " pod="openshift-monitoring/alertmanager-main-0" Jun 03 01:07:01.476282 ip-10-0-138-55 kubenswrapper[2566]: I0603 01:07:01.476214 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/d2415250-c38e-4199-a530-040c21e2336b-cluster-tls-config\") pod \"alertmanager-main-0\" (UID: \"d2415250-c38e-4199-a530-040c21e2336b\") " pod="openshift-monitoring/alertmanager-main-0" Jun 03 01:07:01.477392 ip-10-0-138-55 kubenswrapper[2566]: I0603 01:07:01.476566 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/d2415250-c38e-4199-a530-040c21e2336b-secret-alertmanager-kube-rbac-proxy-metric\") pod \"alertmanager-main-0\" (UID: \"d2415250-c38e-4199-a530-040c21e2336b\") " pod="openshift-monitoring/alertmanager-main-0" Jun 03 01:07:01.477392 ip-10-0-138-55 kubenswrapper[2566]: I0603 01:07:01.476652 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/d2415250-c38e-4199-a530-040c21e2336b-secret-alertmanager-kube-rbac-proxy-web\") pod \"alertmanager-main-0\" (UID: \"d2415250-c38e-4199-a530-040c21e2336b\") " pod="openshift-monitoring/alertmanager-main-0" Jun 03 01:07:01.477392 ip-10-0-138-55 kubenswrapper[2566]: I0603 01:07:01.477083 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/d2415250-c38e-4199-a530-040c21e2336b-config-volume\") pod \"alertmanager-main-0\" (UID: \"d2415250-c38e-4199-a530-040c21e2336b\") " pod="openshift-monitoring/alertmanager-main-0" Jun 03 01:07:01.477392 ip-10-0-138-55 kubenswrapper[2566]: I0603 01:07:01.477088 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/d2415250-c38e-4199-a530-040c21e2336b-web-config\") pod \"alertmanager-main-0\" (UID: \"d2415250-c38e-4199-a530-040c21e2336b\") " pod="openshift-monitoring/alertmanager-main-0" Jun 03 01:07:01.477392 ip-10-0-138-55 kubenswrapper[2566]: I0603 01:07:01.477105 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/d2415250-c38e-4199-a530-040c21e2336b-tls-assets\") pod \"alertmanager-main-0\" (UID: \"d2415250-c38e-4199-a530-040c21e2336b\") " pod="openshift-monitoring/alertmanager-main-0" Jun 03 01:07:01.477392 ip-10-0-138-55 kubenswrapper[2566]: I0603 01:07:01.477375 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/d2415250-c38e-4199-a530-040c21e2336b-config-out\") pod \"alertmanager-main-0\" (UID: \"d2415250-c38e-4199-a530-040c21e2336b\") " pod="openshift-monitoring/alertmanager-main-0" Jun 03 01:07:01.478406 ip-10-0-138-55 kubenswrapper[2566]: I0603 01:07:01.478362 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/d2415250-c38e-4199-a530-040c21e2336b-secret-alertmanager-kube-rbac-proxy\") pod \"alertmanager-main-0\" (UID: \"d2415250-c38e-4199-a530-040c21e2336b\") " pod="openshift-monitoring/alertmanager-main-0" Jun 03 01:07:01.480137 ip-10-0-138-55 kubenswrapper[2566]: I0603 01:07:01.480114 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-b867q\" (UniqueName: \"kubernetes.io/projected/d2415250-c38e-4199-a530-040c21e2336b-kube-api-access-b867q\") pod \"alertmanager-main-0\" (UID: \"d2415250-c38e-4199-a530-040c21e2336b\") " pod="openshift-monitoring/alertmanager-main-0" Jun 03 01:07:01.977793 ip-10-0-138-55 kubenswrapper[2566]: I0603 01:07:01.976624 2566 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/d2415250-c38e-4199-a530-040c21e2336b-secret-alertmanager-main-tls\") pod \"alertmanager-main-0\" (UID: \"d2415250-c38e-4199-a530-040c21e2336b\") " pod="openshift-monitoring/alertmanager-main-0" Jun 03 01:07:01.977793 ip-10-0-138-55 kubenswrapper[2566]: I0603 01:07:01.976721 2566 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/d2415250-c38e-4199-a530-040c21e2336b-alertmanager-trusted-ca-bundle\") pod \"alertmanager-main-0\" (UID: \"d2415250-c38e-4199-a530-040c21e2336b\") " pod="openshift-monitoring/alertmanager-main-0" Jun 03 01:07:01.977793 ip-10-0-138-55 kubenswrapper[2566]: I0603 01:07:01.977769 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/d2415250-c38e-4199-a530-040c21e2336b-alertmanager-trusted-ca-bundle\") pod \"alertmanager-main-0\" (UID: \"d2415250-c38e-4199-a530-040c21e2336b\") " pod="openshift-monitoring/alertmanager-main-0" Jun 03 01:07:01.980709 ip-10-0-138-55 kubenswrapper[2566]: I0603 01:07:01.980662 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/d2415250-c38e-4199-a530-040c21e2336b-secret-alertmanager-main-tls\") pod \"alertmanager-main-0\" (UID: \"d2415250-c38e-4199-a530-040c21e2336b\") " pod="openshift-monitoring/alertmanager-main-0" Jun 03 01:07:02.170073 ip-10-0-138-55 kubenswrapper[2566]: I0603 01:07:02.169997 2566 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-wpr4v" event={"ID":"e79c5637-7a9b-4530-b492-44cc41e28902","Type":"ContainerStarted","Data":"3fa666d14d0854909b04c6f134a7204c0e9ea7af09f7b6a3beb5ff7258517722"} Jun 03 01:07:02.172475 ip-10-0-138-55 kubenswrapper[2566]: I0603 01:07:02.172441 2566 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/openshift-state-metrics-85658796db-q6dzj" event={"ID":"0a1da2cf-2553-4954-8e0d-4532ccca0977","Type":"ContainerStarted","Data":"0ff82734580d1a6612cf3e888aba956a3b0159f8f3b2e44c22c152a0bc86acd4"} Jun 03 01:07:02.172616 ip-10-0-138-55 kubenswrapper[2566]: I0603 01:07:02.172481 2566 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/openshift-state-metrics-85658796db-q6dzj" event={"ID":"0a1da2cf-2553-4954-8e0d-4532ccca0977","Type":"ContainerStarted","Data":"853b77957c9f748429103c47c08e4398ed7db5ce3356a0cb7c1b753a84c01506"} Jun 03 01:07:02.172616 ip-10-0-138-55 kubenswrapper[2566]: I0603 01:07:02.172494 2566 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/openshift-state-metrics-85658796db-q6dzj" event={"ID":"0a1da2cf-2553-4954-8e0d-4532ccca0977","Type":"ContainerStarted","Data":"7f071554b6fdb01e3bc79ead59b7155dec69bcd974c2d1e7f16643420ba89462"} Jun 03 01:07:02.238124 ip-10-0-138-55 kubenswrapper[2566]: I0603 01:07:02.238041 2566 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/alertmanager-main-0" Jun 03 01:07:02.645322 ip-10-0-138-55 kubenswrapper[2566]: I0603 01:07:02.645269 2566 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-console/console-746b478965-gtg74" Jun 03 01:07:02.645322 ip-10-0-138-55 kubenswrapper[2566]: I0603 01:07:02.645316 2566 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/console-746b478965-gtg74" Jun 03 01:07:02.646739 ip-10-0-138-55 kubenswrapper[2566]: I0603 01:07:02.646659 2566 patch_prober.go:28] interesting pod/console-746b478965-gtg74 container/console namespace/openshift-console: Startup probe status=failure output="Get \"https://10.134.0.17:8443/health\": dial tcp 10.134.0.17:8443: connect: connection refused" start-of-body= Jun 03 01:07:02.646739 ip-10-0-138-55 kubenswrapper[2566]: I0603 01:07:02.646701 2566 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-console/console-746b478965-gtg74" podUID="27030eaa-f2e3-4cc1-8a0a-61c99a27db41" containerName="console" probeResult="failure" output="Get \"https://10.134.0.17:8443/health\": dial tcp 10.134.0.17:8443: connect: connection refused" Jun 03 01:07:02.727613 ip-10-0-138-55 kubenswrapper[2566]: I0603 01:07:02.727560 2566 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/alertmanager-main-0"] Jun 03 01:07:02.852452 ip-10-0-138-55 kubenswrapper[2566]: W0603 01:07:02.852422 2566 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podd2415250_c38e_4199_a530_040c21e2336b.slice/crio-a861e20789324290198ef0e56349094192510f8723161d6357ed20d67b47e5e8 WatchSource:0}: Error finding container a861e20789324290198ef0e56349094192510f8723161d6357ed20d67b47e5e8: Status 404 returned error can't find the container with id a861e20789324290198ef0e56349094192510f8723161d6357ed20d67b47e5e8 Jun 03 01:07:03.176955 ip-10-0-138-55 kubenswrapper[2566]: I0603 01:07:03.176869 2566 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/kube-state-metrics-8469c486bb-p4vjj" event={"ID":"2e65f17c-898a-49be-a2a6-7a04d6e36060","Type":"ContainerStarted","Data":"e5c92fd4b3c031cbda96f566aaf691bbefd828a28cf117340f4638a597f91b91"} Jun 03 01:07:03.176955 ip-10-0-138-55 kubenswrapper[2566]: I0603 01:07:03.176908 2566 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/kube-state-metrics-8469c486bb-p4vjj" event={"ID":"2e65f17c-898a-49be-a2a6-7a04d6e36060","Type":"ContainerStarted","Data":"67eb426700b9a07410768bb3e4d96956d40ee970a0d1f011380729d19aba4ecc"} Jun 03 01:07:03.176955 ip-10-0-138-55 kubenswrapper[2566]: I0603 01:07:03.176920 2566 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/kube-state-metrics-8469c486bb-p4vjj" event={"ID":"2e65f17c-898a-49be-a2a6-7a04d6e36060","Type":"ContainerStarted","Data":"88d61e72fd94e2eb7085a0016be2afbdc96f14482556e4cea3fb74e03e8050ed"} Jun 03 01:07:03.178352 ip-10-0-138-55 kubenswrapper[2566]: I0603 01:07:03.178321 2566 generic.go:358] "Generic (PLEG): container finished" podID="e79c5637-7a9b-4530-b492-44cc41e28902" containerID="712ce4b212e63ffa9c893798a92ada86e2ed8ae4e169888834a6559ae649f706" exitCode=0 Jun 03 01:07:03.178489 ip-10-0-138-55 kubenswrapper[2566]: I0603 01:07:03.178416 2566 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-wpr4v" event={"ID":"e79c5637-7a9b-4530-b492-44cc41e28902","Type":"ContainerDied","Data":"712ce4b212e63ffa9c893798a92ada86e2ed8ae4e169888834a6559ae649f706"} Jun 03 01:07:03.180264 ip-10-0-138-55 kubenswrapper[2566]: I0603 01:07:03.180240 2566 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/openshift-state-metrics-85658796db-q6dzj" event={"ID":"0a1da2cf-2553-4954-8e0d-4532ccca0977","Type":"ContainerStarted","Data":"4d916e4683468c6d78013300e94800f89d910ea251c72852640840cc2f893a53"} Jun 03 01:07:03.181272 ip-10-0-138-55 kubenswrapper[2566]: I0603 01:07:03.181252 2566 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"d2415250-c38e-4199-a530-040c21e2336b","Type":"ContainerStarted","Data":"a861e20789324290198ef0e56349094192510f8723161d6357ed20d67b47e5e8"} Jun 03 01:07:03.193719 ip-10-0-138-55 kubenswrapper[2566]: I0603 01:07:03.193678 2566 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-monitoring/kube-state-metrics-8469c486bb-p4vjj" podStartSLOduration=1.347154315 podStartE2EDuration="3.193664668s" podCreationTimestamp="2026-06-03 01:07:00 +0000 UTC" firstStartedPulling="2026-06-03 01:07:00.728828988 +0000 UTC m=+143.875670913" lastFinishedPulling="2026-06-03 01:07:02.575339335 +0000 UTC m=+145.722181266" observedRunningTime="2026-06-03 01:07:03.191893167 +0000 UTC m=+146.338735112" watchObservedRunningTime="2026-06-03 01:07:03.193664668 +0000 UTC m=+146.340506613" Jun 03 01:07:03.208306 ip-10-0-138-55 kubenswrapper[2566]: I0603 01:07:03.208262 2566 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-monitoring/openshift-state-metrics-85658796db-q6dzj" podStartSLOduration=1.796588047 podStartE2EDuration="3.208246921s" podCreationTimestamp="2026-06-03 01:07:00 +0000 UTC" firstStartedPulling="2026-06-03 01:07:01.471211074 +0000 UTC m=+144.618053012" lastFinishedPulling="2026-06-03 01:07:02.882869947 +0000 UTC m=+146.029711886" observedRunningTime="2026-06-03 01:07:03.207381522 +0000 UTC m=+146.354223468" watchObservedRunningTime="2026-06-03 01:07:03.208246921 +0000 UTC m=+146.355088866" Jun 03 01:07:04.188966 ip-10-0-138-55 kubenswrapper[2566]: I0603 01:07:04.188935 2566 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-wpr4v" event={"ID":"e79c5637-7a9b-4530-b492-44cc41e28902","Type":"ContainerStarted","Data":"9ce7ba1188f3bd30a3975a1620afd51cace26ba54e0aca0aeb2b07cfc4206376"} Jun 03 01:07:04.189346 ip-10-0-138-55 kubenswrapper[2566]: I0603 01:07:04.188976 2566 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-wpr4v" event={"ID":"e79c5637-7a9b-4530-b492-44cc41e28902","Type":"ContainerStarted","Data":"1124a493eebae9d174d4b310695f7b8c2a9f390df336f2f4f94725be6833cc59"} Jun 03 01:07:04.207879 ip-10-0-138-55 kubenswrapper[2566]: I0603 01:07:04.207837 2566 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-monitoring/node-exporter-wpr4v" podStartSLOduration=2.849943917 podStartE2EDuration="4.207823695s" podCreationTimestamp="2026-06-03 01:07:00 +0000 UTC" firstStartedPulling="2026-06-03 01:07:01.220680447 +0000 UTC m=+144.367522372" lastFinishedPulling="2026-06-03 01:07:02.578560214 +0000 UTC m=+145.725402150" observedRunningTime="2026-06-03 01:07:04.20637672 +0000 UTC m=+147.353218667" watchObservedRunningTime="2026-06-03 01:07:04.207823695 +0000 UTC m=+147.354665674" Jun 03 01:07:05.025132 ip-10-0-138-55 kubenswrapper[2566]: I0603 01:07:05.025082 2566 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openshift-console/console-cfbb9ffb-pq8vs"] Jun 03 01:07:05.055880 ip-10-0-138-55 kubenswrapper[2566]: I0603 01:07:05.055849 2566 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-console/console-75dcf85d9d-fvd4k"] Jun 03 01:07:05.058044 ip-10-0-138-55 kubenswrapper[2566]: I0603 01:07:05.058024 2566 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-75dcf85d9d-fvd4k" Jun 03 01:07:05.067425 ip-10-0-138-55 kubenswrapper[2566]: I0603 01:07:05.067403 2566 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-75dcf85d9d-fvd4k"] Jun 03 01:07:05.099847 ip-10-0-138-55 kubenswrapper[2566]: I0603 01:07:05.099818 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/48e0d444-7707-4a91-b9ae-e12ae15c6f86-console-config\") pod \"console-75dcf85d9d-fvd4k\" (UID: \"48e0d444-7707-4a91-b9ae-e12ae15c6f86\") " pod="openshift-console/console-75dcf85d9d-fvd4k" Jun 03 01:07:05.100001 ip-10-0-138-55 kubenswrapper[2566]: I0603 01:07:05.099916 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/48e0d444-7707-4a91-b9ae-e12ae15c6f86-oauth-serving-cert\") pod \"console-75dcf85d9d-fvd4k\" (UID: \"48e0d444-7707-4a91-b9ae-e12ae15c6f86\") " pod="openshift-console/console-75dcf85d9d-fvd4k" Jun 03 01:07:05.100001 ip-10-0-138-55 kubenswrapper[2566]: I0603 01:07:05.099939 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/48e0d444-7707-4a91-b9ae-e12ae15c6f86-service-ca\") pod \"console-75dcf85d9d-fvd4k\" (UID: \"48e0d444-7707-4a91-b9ae-e12ae15c6f86\") " pod="openshift-console/console-75dcf85d9d-fvd4k" Jun 03 01:07:05.100001 ip-10-0-138-55 kubenswrapper[2566]: I0603 01:07:05.099955 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/48e0d444-7707-4a91-b9ae-e12ae15c6f86-trusted-ca-bundle\") pod \"console-75dcf85d9d-fvd4k\" (UID: \"48e0d444-7707-4a91-b9ae-e12ae15c6f86\") " pod="openshift-console/console-75dcf85d9d-fvd4k" Jun 03 01:07:05.100001 ip-10-0-138-55 kubenswrapper[2566]: I0603 01:07:05.099979 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-pjt8r\" (UniqueName: \"kubernetes.io/projected/48e0d444-7707-4a91-b9ae-e12ae15c6f86-kube-api-access-pjt8r\") pod \"console-75dcf85d9d-fvd4k\" (UID: \"48e0d444-7707-4a91-b9ae-e12ae15c6f86\") " pod="openshift-console/console-75dcf85d9d-fvd4k" Jun 03 01:07:05.100149 ip-10-0-138-55 kubenswrapper[2566]: I0603 01:07:05.100004 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/48e0d444-7707-4a91-b9ae-e12ae15c6f86-console-oauth-config\") pod \"console-75dcf85d9d-fvd4k\" (UID: \"48e0d444-7707-4a91-b9ae-e12ae15c6f86\") " pod="openshift-console/console-75dcf85d9d-fvd4k" Jun 03 01:07:05.100149 ip-10-0-138-55 kubenswrapper[2566]: I0603 01:07:05.100028 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/48e0d444-7707-4a91-b9ae-e12ae15c6f86-console-serving-cert\") pod \"console-75dcf85d9d-fvd4k\" (UID: \"48e0d444-7707-4a91-b9ae-e12ae15c6f86\") " pod="openshift-console/console-75dcf85d9d-fvd4k" Jun 03 01:07:05.194016 ip-10-0-138-55 kubenswrapper[2566]: I0603 01:07:05.193977 2566 generic.go:358] "Generic (PLEG): container finished" podID="d2415250-c38e-4199-a530-040c21e2336b" containerID="89a043092f860540d03ca9bd3e472e2f40c66754228f7d960fe742f34d75b855" exitCode=0 Jun 03 01:07:05.194373 ip-10-0-138-55 kubenswrapper[2566]: I0603 01:07:05.194065 2566 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"d2415250-c38e-4199-a530-040c21e2336b","Type":"ContainerDied","Data":"89a043092f860540d03ca9bd3e472e2f40c66754228f7d960fe742f34d75b855"} Jun 03 01:07:05.201299 ip-10-0-138-55 kubenswrapper[2566]: I0603 01:07:05.201257 2566 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/48e0d444-7707-4a91-b9ae-e12ae15c6f86-oauth-serving-cert\") pod \"console-75dcf85d9d-fvd4k\" (UID: \"48e0d444-7707-4a91-b9ae-e12ae15c6f86\") " pod="openshift-console/console-75dcf85d9d-fvd4k" Jun 03 01:07:05.201423 ip-10-0-138-55 kubenswrapper[2566]: I0603 01:07:05.201307 2566 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/48e0d444-7707-4a91-b9ae-e12ae15c6f86-service-ca\") pod \"console-75dcf85d9d-fvd4k\" (UID: \"48e0d444-7707-4a91-b9ae-e12ae15c6f86\") " pod="openshift-console/console-75dcf85d9d-fvd4k" Jun 03 01:07:05.201423 ip-10-0-138-55 kubenswrapper[2566]: I0603 01:07:05.201352 2566 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/48e0d444-7707-4a91-b9ae-e12ae15c6f86-trusted-ca-bundle\") pod \"console-75dcf85d9d-fvd4k\" (UID: \"48e0d444-7707-4a91-b9ae-e12ae15c6f86\") " pod="openshift-console/console-75dcf85d9d-fvd4k" Jun 03 01:07:05.201423 ip-10-0-138-55 kubenswrapper[2566]: I0603 01:07:05.201383 2566 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-pjt8r\" (UniqueName: \"kubernetes.io/projected/48e0d444-7707-4a91-b9ae-e12ae15c6f86-kube-api-access-pjt8r\") pod \"console-75dcf85d9d-fvd4k\" (UID: \"48e0d444-7707-4a91-b9ae-e12ae15c6f86\") " pod="openshift-console/console-75dcf85d9d-fvd4k" Jun 03 01:07:05.201596 ip-10-0-138-55 kubenswrapper[2566]: I0603 01:07:05.201452 2566 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/48e0d444-7707-4a91-b9ae-e12ae15c6f86-console-oauth-config\") pod \"console-75dcf85d9d-fvd4k\" (UID: \"48e0d444-7707-4a91-b9ae-e12ae15c6f86\") " pod="openshift-console/console-75dcf85d9d-fvd4k" Jun 03 01:07:05.201596 ip-10-0-138-55 kubenswrapper[2566]: I0603 01:07:05.201507 2566 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/48e0d444-7707-4a91-b9ae-e12ae15c6f86-console-serving-cert\") pod \"console-75dcf85d9d-fvd4k\" (UID: \"48e0d444-7707-4a91-b9ae-e12ae15c6f86\") " pod="openshift-console/console-75dcf85d9d-fvd4k" Jun 03 01:07:05.201771 ip-10-0-138-55 kubenswrapper[2566]: I0603 01:07:05.201623 2566 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/48e0d444-7707-4a91-b9ae-e12ae15c6f86-console-config\") pod \"console-75dcf85d9d-fvd4k\" (UID: \"48e0d444-7707-4a91-b9ae-e12ae15c6f86\") " pod="openshift-console/console-75dcf85d9d-fvd4k" Jun 03 01:07:05.202379 ip-10-0-138-55 kubenswrapper[2566]: I0603 01:07:05.202097 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/48e0d444-7707-4a91-b9ae-e12ae15c6f86-service-ca\") pod \"console-75dcf85d9d-fvd4k\" (UID: \"48e0d444-7707-4a91-b9ae-e12ae15c6f86\") " pod="openshift-console/console-75dcf85d9d-fvd4k" Jun 03 01:07:05.202379 ip-10-0-138-55 kubenswrapper[2566]: I0603 01:07:05.202338 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/48e0d444-7707-4a91-b9ae-e12ae15c6f86-console-config\") pod \"console-75dcf85d9d-fvd4k\" (UID: \"48e0d444-7707-4a91-b9ae-e12ae15c6f86\") " pod="openshift-console/console-75dcf85d9d-fvd4k" Jun 03 01:07:05.202379 ip-10-0-138-55 kubenswrapper[2566]: I0603 01:07:05.202362 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/48e0d444-7707-4a91-b9ae-e12ae15c6f86-trusted-ca-bundle\") pod \"console-75dcf85d9d-fvd4k\" (UID: \"48e0d444-7707-4a91-b9ae-e12ae15c6f86\") " pod="openshift-console/console-75dcf85d9d-fvd4k" Jun 03 01:07:05.202608 ip-10-0-138-55 kubenswrapper[2566]: I0603 01:07:05.202590 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/48e0d444-7707-4a91-b9ae-e12ae15c6f86-oauth-serving-cert\") pod \"console-75dcf85d9d-fvd4k\" (UID: \"48e0d444-7707-4a91-b9ae-e12ae15c6f86\") " pod="openshift-console/console-75dcf85d9d-fvd4k" Jun 03 01:07:05.203979 ip-10-0-138-55 kubenswrapper[2566]: I0603 01:07:05.203959 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/48e0d444-7707-4a91-b9ae-e12ae15c6f86-console-serving-cert\") pod \"console-75dcf85d9d-fvd4k\" (UID: \"48e0d444-7707-4a91-b9ae-e12ae15c6f86\") " pod="openshift-console/console-75dcf85d9d-fvd4k" Jun 03 01:07:05.203979 ip-10-0-138-55 kubenswrapper[2566]: I0603 01:07:05.203974 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/48e0d444-7707-4a91-b9ae-e12ae15c6f86-console-oauth-config\") pod \"console-75dcf85d9d-fvd4k\" (UID: \"48e0d444-7707-4a91-b9ae-e12ae15c6f86\") " pod="openshift-console/console-75dcf85d9d-fvd4k" Jun 03 01:07:05.208409 ip-10-0-138-55 kubenswrapper[2566]: I0603 01:07:05.208385 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-pjt8r\" (UniqueName: \"kubernetes.io/projected/48e0d444-7707-4a91-b9ae-e12ae15c6f86-kube-api-access-pjt8r\") pod \"console-75dcf85d9d-fvd4k\" (UID: \"48e0d444-7707-4a91-b9ae-e12ae15c6f86\") " pod="openshift-console/console-75dcf85d9d-fvd4k" Jun 03 01:07:05.368317 ip-10-0-138-55 kubenswrapper[2566]: I0603 01:07:05.368288 2566 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-75dcf85d9d-fvd4k" Jun 03 01:07:05.500709 ip-10-0-138-55 kubenswrapper[2566]: I0603 01:07:05.500681 2566 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-75dcf85d9d-fvd4k"] Jun 03 01:07:05.503285 ip-10-0-138-55 kubenswrapper[2566]: W0603 01:07:05.503258 2566 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod48e0d444_7707_4a91_b9ae_e12ae15c6f86.slice/crio-33d9e493c9cfad77602bcdd624d5a4511205a63bb2da55da535b7f9781cabb35 WatchSource:0}: Error finding container 33d9e493c9cfad77602bcdd624d5a4511205a63bb2da55da535b7f9781cabb35: Status 404 returned error can't find the container with id 33d9e493c9cfad77602bcdd624d5a4511205a63bb2da55da535b7f9781cabb35 Jun 03 01:07:06.200404 ip-10-0-138-55 kubenswrapper[2566]: I0603 01:07:06.200340 2566 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-75dcf85d9d-fvd4k" event={"ID":"48e0d444-7707-4a91-b9ae-e12ae15c6f86","Type":"ContainerStarted","Data":"a21feaa5f018c879844980dc90fde7034ead8c115077ecd41fa399f49c56c87b"} Jun 03 01:07:06.200873 ip-10-0-138-55 kubenswrapper[2566]: I0603 01:07:06.200413 2566 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-75dcf85d9d-fvd4k" event={"ID":"48e0d444-7707-4a91-b9ae-e12ae15c6f86","Type":"ContainerStarted","Data":"33d9e493c9cfad77602bcdd624d5a4511205a63bb2da55da535b7f9781cabb35"} Jun 03 01:07:06.219293 ip-10-0-138-55 kubenswrapper[2566]: I0603 01:07:06.219010 2566 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-console/console-75dcf85d9d-fvd4k" podStartSLOduration=1.2189950139999999 podStartE2EDuration="1.218995014s" podCreationTimestamp="2026-06-03 01:07:05 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2026-06-03 01:07:06.21727196 +0000 UTC m=+149.364113903" watchObservedRunningTime="2026-06-03 01:07:06.218995014 +0000 UTC m=+149.365836961" Jun 03 01:07:07.206362 ip-10-0-138-55 kubenswrapper[2566]: I0603 01:07:07.206328 2566 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"d2415250-c38e-4199-a530-040c21e2336b","Type":"ContainerStarted","Data":"3a4a5f3a32acd0dac79a937757889c47d483333753ae387f08a959e197aa8468"} Jun 03 01:07:08.212713 ip-10-0-138-55 kubenswrapper[2566]: I0603 01:07:08.212689 2566 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"d2415250-c38e-4199-a530-040c21e2336b","Type":"ContainerStarted","Data":"26bf37dcc236cda78d367f804557382153b7c11c9f9d69e22cbddb25f66270b7"} Jun 03 01:07:08.212982 ip-10-0-138-55 kubenswrapper[2566]: I0603 01:07:08.212721 2566 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"d2415250-c38e-4199-a530-040c21e2336b","Type":"ContainerStarted","Data":"62f1628215b8789cf900218c99959363ef99f45c136af635aac82cde10a36b51"} Jun 03 01:07:08.212982 ip-10-0-138-55 kubenswrapper[2566]: I0603 01:07:08.212731 2566 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"d2415250-c38e-4199-a530-040c21e2336b","Type":"ContainerStarted","Data":"e98f0ba472e4635a18c9fe28afaf8b5d52c9d21566b3ab2ca72ff83a26df2d15"} Jun 03 01:07:08.212982 ip-10-0-138-55 kubenswrapper[2566]: I0603 01:07:08.212740 2566 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"d2415250-c38e-4199-a530-040c21e2336b","Type":"ContainerStarted","Data":"96e8e4b7ef955c563d7eccec3fc647b2a990eb236fb53012cf69425a22d935ce"} Jun 03 01:07:09.222490 ip-10-0-138-55 kubenswrapper[2566]: I0603 01:07:09.222455 2566 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"d2415250-c38e-4199-a530-040c21e2336b","Type":"ContainerStarted","Data":"fe0839c54af2afea5e3f06cc84be518585f2643aacb0473ba80b1a8d0f5d6e22"} Jun 03 01:07:09.245464 ip-10-0-138-55 kubenswrapper[2566]: I0603 01:07:09.245416 2566 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-monitoring/alertmanager-main-0" podStartSLOduration=2.934867379 podStartE2EDuration="8.245404855s" podCreationTimestamp="2026-06-03 01:07:01 +0000 UTC" firstStartedPulling="2026-06-03 01:07:02.85515962 +0000 UTC m=+146.002001544" lastFinishedPulling="2026-06-03 01:07:08.165697092 +0000 UTC m=+151.312539020" observedRunningTime="2026-06-03 01:07:09.245156573 +0000 UTC m=+152.391998520" watchObservedRunningTime="2026-06-03 01:07:09.245404855 +0000 UTC m=+152.392246800" Jun 03 01:07:12.645738 ip-10-0-138-55 kubenswrapper[2566]: I0603 01:07:12.645699 2566 patch_prober.go:28] interesting pod/console-746b478965-gtg74 container/console namespace/openshift-console: Startup probe status=failure output="Get \"https://10.134.0.17:8443/health\": dial tcp 10.134.0.17:8443: connect: connection refused" start-of-body= Jun 03 01:07:12.646097 ip-10-0-138-55 kubenswrapper[2566]: I0603 01:07:12.645757 2566 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-console/console-746b478965-gtg74" podUID="27030eaa-f2e3-4cc1-8a0a-61c99a27db41" containerName="console" probeResult="failure" output="Get \"https://10.134.0.17:8443/health\": dial tcp 10.134.0.17:8443: connect: connection refused" Jun 03 01:07:14.227641 ip-10-0-138-55 kubenswrapper[2566]: E0603 01:07:14.227588 2566 pod_workers.go:1301] "Error syncing pod, skipping" err="unmounted volumes=[metrics-tls], unattached volumes=[], failed to process volumes=[]: context deadline exceeded" pod="openshift-dns/dns-default-nvrs2" podUID="24c6861e-9230-4de3-b1b7-7edf01864353" Jun 03 01:07:14.238735 ip-10-0-138-55 kubenswrapper[2566]: I0603 01:07:14.238707 2566 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-nvrs2" Jun 03 01:07:14.250271 ip-10-0-138-55 kubenswrapper[2566]: E0603 01:07:14.250219 2566 pod_workers.go:1301] "Error syncing pod, skipping" err="unmounted volumes=[cert], unattached volumes=[], failed to process volumes=[]: context deadline exceeded" pod="openshift-ingress-canary/ingress-canary-vm9nr" podUID="252447b2-d8a3-4d99-8302-361f32e759df" Jun 03 01:07:15.369262 ip-10-0-138-55 kubenswrapper[2566]: I0603 01:07:15.369196 2566 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/console-75dcf85d9d-fvd4k" Jun 03 01:07:15.369262 ip-10-0-138-55 kubenswrapper[2566]: I0603 01:07:15.369268 2566 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-console/console-75dcf85d9d-fvd4k" Jun 03 01:07:15.370733 ip-10-0-138-55 kubenswrapper[2566]: I0603 01:07:15.370710 2566 patch_prober.go:28] interesting pod/console-75dcf85d9d-fvd4k container/console namespace/openshift-console: Startup probe status=failure output="Get \"https://10.134.0.22:8443/health\": dial tcp 10.134.0.22:8443: connect: connection refused" start-of-body= Jun 03 01:07:15.370867 ip-10-0-138-55 kubenswrapper[2566]: I0603 01:07:15.370758 2566 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-console/console-75dcf85d9d-fvd4k" podUID="48e0d444-7707-4a91-b9ae-e12ae15c6f86" containerName="console" probeResult="failure" output="Get \"https://10.134.0.22:8443/health\": dial tcp 10.134.0.22:8443: connect: connection refused" Jun 03 01:07:19.131625 ip-10-0-138-55 kubenswrapper[2566]: I0603 01:07:19.131591 2566 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/252447b2-d8a3-4d99-8302-361f32e759df-cert\") pod \"ingress-canary-vm9nr\" (UID: \"252447b2-d8a3-4d99-8302-361f32e759df\") " pod="openshift-ingress-canary/ingress-canary-vm9nr" Jun 03 01:07:19.132100 ip-10-0-138-55 kubenswrapper[2566]: I0603 01:07:19.131650 2566 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/24c6861e-9230-4de3-b1b7-7edf01864353-metrics-tls\") pod \"dns-default-nvrs2\" (UID: \"24c6861e-9230-4de3-b1b7-7edf01864353\") " pod="openshift-dns/dns-default-nvrs2" Jun 03 01:07:19.134077 ip-10-0-138-55 kubenswrapper[2566]: I0603 01:07:19.134050 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/252447b2-d8a3-4d99-8302-361f32e759df-cert\") pod \"ingress-canary-vm9nr\" (UID: \"252447b2-d8a3-4d99-8302-361f32e759df\") " pod="openshift-ingress-canary/ingress-canary-vm9nr" Jun 03 01:07:19.134077 ip-10-0-138-55 kubenswrapper[2566]: I0603 01:07:19.134070 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/24c6861e-9230-4de3-b1b7-7edf01864353-metrics-tls\") pod \"dns-default-nvrs2\" (UID: \"24c6861e-9230-4de3-b1b7-7edf01864353\") " pod="openshift-dns/dns-default-nvrs2" Jun 03 01:07:19.341645 ip-10-0-138-55 kubenswrapper[2566]: I0603 01:07:19.341615 2566 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-dockercfg-tw28v\"" Jun 03 01:07:19.350121 ip-10-0-138-55 kubenswrapper[2566]: I0603 01:07:19.350101 2566 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-nvrs2" Jun 03 01:07:19.471901 ip-10-0-138-55 kubenswrapper[2566]: I0603 01:07:19.471877 2566 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-dns/dns-default-nvrs2"] Jun 03 01:07:19.474082 ip-10-0-138-55 kubenswrapper[2566]: W0603 01:07:19.474052 2566 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod24c6861e_9230_4de3_b1b7_7edf01864353.slice/crio-e8a4c6c0a5fac01b026694c211aebc36a117ce15653782cc5f61b51f16942101 WatchSource:0}: Error finding container e8a4c6c0a5fac01b026694c211aebc36a117ce15653782cc5f61b51f16942101: Status 404 returned error can't find the container with id e8a4c6c0a5fac01b026694c211aebc36a117ce15653782cc5f61b51f16942101 Jun 03 01:07:20.255729 ip-10-0-138-55 kubenswrapper[2566]: I0603 01:07:20.255684 2566 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-nvrs2" event={"ID":"24c6861e-9230-4de3-b1b7-7edf01864353","Type":"ContainerStarted","Data":"e8a4c6c0a5fac01b026694c211aebc36a117ce15653782cc5f61b51f16942101"} Jun 03 01:07:21.260104 ip-10-0-138-55 kubenswrapper[2566]: I0603 01:07:21.260021 2566 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-nvrs2" event={"ID":"24c6861e-9230-4de3-b1b7-7edf01864353","Type":"ContainerStarted","Data":"bf94ff69e0fce9b8d71d82c85d757378bb4f8caf722cb1336999cc4ba0863911"} Jun 03 01:07:21.260104 ip-10-0-138-55 kubenswrapper[2566]: I0603 01:07:21.260061 2566 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-nvrs2" event={"ID":"24c6861e-9230-4de3-b1b7-7edf01864353","Type":"ContainerStarted","Data":"c881efcd96e2ca4d7d8593938689d22554da85302b8fcf82e0e19ed68794dfaf"} Jun 03 01:07:21.260509 ip-10-0-138-55 kubenswrapper[2566]: I0603 01:07:21.260151 2566 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-dns/dns-default-nvrs2" Jun 03 01:07:21.276240 ip-10-0-138-55 kubenswrapper[2566]: I0603 01:07:21.276192 2566 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-dns/dns-default-nvrs2" podStartSLOduration=128.750178248 podStartE2EDuration="2m10.276180014s" podCreationTimestamp="2026-06-03 01:05:11 +0000 UTC" firstStartedPulling="2026-06-03 01:07:19.47599787 +0000 UTC m=+162.622839796" lastFinishedPulling="2026-06-03 01:07:21.001999631 +0000 UTC m=+164.148841562" observedRunningTime="2026-06-03 01:07:21.274294189 +0000 UTC m=+164.421136129" watchObservedRunningTime="2026-06-03 01:07:21.276180014 +0000 UTC m=+164.423021994" Jun 03 01:07:22.645650 ip-10-0-138-55 kubenswrapper[2566]: I0603 01:07:22.645617 2566 patch_prober.go:28] interesting pod/console-746b478965-gtg74 container/console namespace/openshift-console: Startup probe status=failure output="Get \"https://10.134.0.17:8443/health\": dial tcp 10.134.0.17:8443: connect: connection refused" start-of-body= Jun 03 01:07:22.646119 ip-10-0-138-55 kubenswrapper[2566]: I0603 01:07:22.645677 2566 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-console/console-746b478965-gtg74" podUID="27030eaa-f2e3-4cc1-8a0a-61c99a27db41" containerName="console" probeResult="failure" output="Get \"https://10.134.0.17:8443/health\": dial tcp 10.134.0.17:8443: connect: connection refused" Jun 03 01:07:25.369349 ip-10-0-138-55 kubenswrapper[2566]: I0603 01:07:25.369305 2566 patch_prober.go:28] interesting pod/console-75dcf85d9d-fvd4k container/console namespace/openshift-console: Startup probe status=failure output="Get \"https://10.134.0.22:8443/health\": dial tcp 10.134.0.22:8443: connect: connection refused" start-of-body= Jun 03 01:07:25.369796 ip-10-0-138-55 kubenswrapper[2566]: I0603 01:07:25.369380 2566 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-console/console-75dcf85d9d-fvd4k" podUID="48e0d444-7707-4a91-b9ae-e12ae15c6f86" containerName="console" probeResult="failure" output="Get \"https://10.134.0.22:8443/health\": dial tcp 10.134.0.22:8443: connect: connection refused" Jun 03 01:07:25.585425 ip-10-0-138-55 kubenswrapper[2566]: I0603 01:07:25.585391 2566 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress-canary/ingress-canary-vm9nr" Jun 03 01:07:25.587721 ip-10-0-138-55 kubenswrapper[2566]: I0603 01:07:25.587697 2566 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-canary\"/\"default-dockercfg-kzjqn\"" Jun 03 01:07:25.596220 ip-10-0-138-55 kubenswrapper[2566]: I0603 01:07:25.596197 2566 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress-canary/ingress-canary-vm9nr" Jun 03 01:07:25.721308 ip-10-0-138-55 kubenswrapper[2566]: I0603 01:07:25.721286 2566 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-ingress-canary/ingress-canary-vm9nr"] Jun 03 01:07:25.723755 ip-10-0-138-55 kubenswrapper[2566]: W0603 01:07:25.723731 2566 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod252447b2_d8a3_4d99_8302_361f32e759df.slice/crio-db1b4fc11a1efed24bec166a3ade495659c80f65cd633df022ae0b3afe69f46e WatchSource:0}: Error finding container db1b4fc11a1efed24bec166a3ade495659c80f65cd633df022ae0b3afe69f46e: Status 404 returned error can't find the container with id db1b4fc11a1efed24bec166a3ade495659c80f65cd633df022ae0b3afe69f46e Jun 03 01:07:26.274679 ip-10-0-138-55 kubenswrapper[2566]: I0603 01:07:26.274639 2566 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-ingress-canary/ingress-canary-vm9nr" event={"ID":"252447b2-d8a3-4d99-8302-361f32e759df","Type":"ContainerStarted","Data":"db1b4fc11a1efed24bec166a3ade495659c80f65cd633df022ae0b3afe69f46e"} Jun 03 01:07:28.282021 ip-10-0-138-55 kubenswrapper[2566]: I0603 01:07:28.281977 2566 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-ingress-canary/ingress-canary-vm9nr" event={"ID":"252447b2-d8a3-4d99-8302-361f32e759df","Type":"ContainerStarted","Data":"42b000728be89acc1a651ad7f687ae5adc8eae514cc481002c0f5749e7d04032"} Jun 03 01:07:28.296654 ip-10-0-138-55 kubenswrapper[2566]: I0603 01:07:28.296605 2566 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-ingress-canary/ingress-canary-vm9nr" podStartSLOduration=135.352046586 podStartE2EDuration="2m17.296590662s" podCreationTimestamp="2026-06-03 01:05:11 +0000 UTC" firstStartedPulling="2026-06-03 01:07:25.725539703 +0000 UTC m=+168.872381627" lastFinishedPulling="2026-06-03 01:07:27.670083775 +0000 UTC m=+170.816925703" observedRunningTime="2026-06-03 01:07:28.294413097 +0000 UTC m=+171.441255043" watchObservedRunningTime="2026-06-03 01:07:28.296590662 +0000 UTC m=+171.443432628" Jun 03 01:07:30.045429 ip-10-0-138-55 kubenswrapper[2566]: I0603 01:07:30.045371 2566 kuberuntime_container.go:864] "Killing container with a grace period" pod="openshift-console/console-cfbb9ffb-pq8vs" podUID="37f0bd95-7af5-44e6-bb2e-41260f75dfb1" containerName="console" containerID="cri-o://c5323bcd178e158750eba332cc0240b69801a00304c0a2dd3d2a16092cc7c435" gracePeriod=15 Jun 03 01:07:30.293576 ip-10-0-138-55 kubenswrapper[2566]: I0603 01:07:30.293548 2566 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console_console-cfbb9ffb-pq8vs_37f0bd95-7af5-44e6-bb2e-41260f75dfb1/console/0.log" Jun 03 01:07:30.293725 ip-10-0-138-55 kubenswrapper[2566]: I0603 01:07:30.293595 2566 generic.go:358] "Generic (PLEG): container finished" podID="37f0bd95-7af5-44e6-bb2e-41260f75dfb1" containerID="c5323bcd178e158750eba332cc0240b69801a00304c0a2dd3d2a16092cc7c435" exitCode=2 Jun 03 01:07:30.293725 ip-10-0-138-55 kubenswrapper[2566]: I0603 01:07:30.293636 2566 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-cfbb9ffb-pq8vs" event={"ID":"37f0bd95-7af5-44e6-bb2e-41260f75dfb1","Type":"ContainerDied","Data":"c5323bcd178e158750eba332cc0240b69801a00304c0a2dd3d2a16092cc7c435"} Jun 03 01:07:30.337840 ip-10-0-138-55 kubenswrapper[2566]: I0603 01:07:30.337820 2566 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console_console-cfbb9ffb-pq8vs_37f0bd95-7af5-44e6-bb2e-41260f75dfb1/console/0.log" Jun 03 01:07:30.337949 ip-10-0-138-55 kubenswrapper[2566]: I0603 01:07:30.337882 2566 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-cfbb9ffb-pq8vs" Jun 03 01:07:30.431494 ip-10-0-138-55 kubenswrapper[2566]: I0603 01:07:30.431459 2566 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/37f0bd95-7af5-44e6-bb2e-41260f75dfb1-console-serving-cert\") pod \"37f0bd95-7af5-44e6-bb2e-41260f75dfb1\" (UID: \"37f0bd95-7af5-44e6-bb2e-41260f75dfb1\") " Jun 03 01:07:30.431494 ip-10-0-138-55 kubenswrapper[2566]: I0603 01:07:30.431501 2566 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/37f0bd95-7af5-44e6-bb2e-41260f75dfb1-service-ca\") pod \"37f0bd95-7af5-44e6-bb2e-41260f75dfb1\" (UID: \"37f0bd95-7af5-44e6-bb2e-41260f75dfb1\") " Jun 03 01:07:30.431742 ip-10-0-138-55 kubenswrapper[2566]: I0603 01:07:30.431541 2566 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/37f0bd95-7af5-44e6-bb2e-41260f75dfb1-oauth-serving-cert\") pod \"37f0bd95-7af5-44e6-bb2e-41260f75dfb1\" (UID: \"37f0bd95-7af5-44e6-bb2e-41260f75dfb1\") " Jun 03 01:07:30.431742 ip-10-0-138-55 kubenswrapper[2566]: I0603 01:07:30.431575 2566 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/37f0bd95-7af5-44e6-bb2e-41260f75dfb1-console-oauth-config\") pod \"37f0bd95-7af5-44e6-bb2e-41260f75dfb1\" (UID: \"37f0bd95-7af5-44e6-bb2e-41260f75dfb1\") " Jun 03 01:07:30.431742 ip-10-0-138-55 kubenswrapper[2566]: I0603 01:07:30.431597 2566 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-8ppfg\" (UniqueName: \"kubernetes.io/projected/37f0bd95-7af5-44e6-bb2e-41260f75dfb1-kube-api-access-8ppfg\") pod \"37f0bd95-7af5-44e6-bb2e-41260f75dfb1\" (UID: \"37f0bd95-7af5-44e6-bb2e-41260f75dfb1\") " Jun 03 01:07:30.431742 ip-10-0-138-55 kubenswrapper[2566]: I0603 01:07:30.431612 2566 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/37f0bd95-7af5-44e6-bb2e-41260f75dfb1-console-config\") pod \"37f0bd95-7af5-44e6-bb2e-41260f75dfb1\" (UID: \"37f0bd95-7af5-44e6-bb2e-41260f75dfb1\") " Jun 03 01:07:30.432093 ip-10-0-138-55 kubenswrapper[2566]: I0603 01:07:30.432061 2566 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/37f0bd95-7af5-44e6-bb2e-41260f75dfb1-service-ca" (OuterVolumeSpecName: "service-ca") pod "37f0bd95-7af5-44e6-bb2e-41260f75dfb1" (UID: "37f0bd95-7af5-44e6-bb2e-41260f75dfb1"). InnerVolumeSpecName "service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jun 03 01:07:30.432093 ip-10-0-138-55 kubenswrapper[2566]: I0603 01:07:30.432065 2566 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/37f0bd95-7af5-44e6-bb2e-41260f75dfb1-oauth-serving-cert" (OuterVolumeSpecName: "oauth-serving-cert") pod "37f0bd95-7af5-44e6-bb2e-41260f75dfb1" (UID: "37f0bd95-7af5-44e6-bb2e-41260f75dfb1"). InnerVolumeSpecName "oauth-serving-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jun 03 01:07:30.432282 ip-10-0-138-55 kubenswrapper[2566]: I0603 01:07:30.432101 2566 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/37f0bd95-7af5-44e6-bb2e-41260f75dfb1-console-config" (OuterVolumeSpecName: "console-config") pod "37f0bd95-7af5-44e6-bb2e-41260f75dfb1" (UID: "37f0bd95-7af5-44e6-bb2e-41260f75dfb1"). InnerVolumeSpecName "console-config". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jun 03 01:07:30.433943 ip-10-0-138-55 kubenswrapper[2566]: I0603 01:07:30.433912 2566 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/37f0bd95-7af5-44e6-bb2e-41260f75dfb1-kube-api-access-8ppfg" (OuterVolumeSpecName: "kube-api-access-8ppfg") pod "37f0bd95-7af5-44e6-bb2e-41260f75dfb1" (UID: "37f0bd95-7af5-44e6-bb2e-41260f75dfb1"). InnerVolumeSpecName "kube-api-access-8ppfg". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 03 01:07:30.434157 ip-10-0-138-55 kubenswrapper[2566]: I0603 01:07:30.434135 2566 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/37f0bd95-7af5-44e6-bb2e-41260f75dfb1-console-serving-cert" (OuterVolumeSpecName: "console-serving-cert") pod "37f0bd95-7af5-44e6-bb2e-41260f75dfb1" (UID: "37f0bd95-7af5-44e6-bb2e-41260f75dfb1"). InnerVolumeSpecName "console-serving-cert". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jun 03 01:07:30.434203 ip-10-0-138-55 kubenswrapper[2566]: I0603 01:07:30.434155 2566 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/37f0bd95-7af5-44e6-bb2e-41260f75dfb1-console-oauth-config" (OuterVolumeSpecName: "console-oauth-config") pod "37f0bd95-7af5-44e6-bb2e-41260f75dfb1" (UID: "37f0bd95-7af5-44e6-bb2e-41260f75dfb1"). InnerVolumeSpecName "console-oauth-config". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jun 03 01:07:30.532838 ip-10-0-138-55 kubenswrapper[2566]: I0603 01:07:30.532794 2566 reconciler_common.go:299] "Volume detached for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/37f0bd95-7af5-44e6-bb2e-41260f75dfb1-console-serving-cert\") on node \"ip-10-0-138-55.ec2.internal\" DevicePath \"\"" Jun 03 01:07:30.532838 ip-10-0-138-55 kubenswrapper[2566]: I0603 01:07:30.532833 2566 reconciler_common.go:299] "Volume detached for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/37f0bd95-7af5-44e6-bb2e-41260f75dfb1-service-ca\") on node \"ip-10-0-138-55.ec2.internal\" DevicePath \"\"" Jun 03 01:07:30.532838 ip-10-0-138-55 kubenswrapper[2566]: I0603 01:07:30.532843 2566 reconciler_common.go:299] "Volume detached for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/37f0bd95-7af5-44e6-bb2e-41260f75dfb1-oauth-serving-cert\") on node \"ip-10-0-138-55.ec2.internal\" DevicePath \"\"" Jun 03 01:07:30.532838 ip-10-0-138-55 kubenswrapper[2566]: I0603 01:07:30.532852 2566 reconciler_common.go:299] "Volume detached for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/37f0bd95-7af5-44e6-bb2e-41260f75dfb1-console-oauth-config\") on node \"ip-10-0-138-55.ec2.internal\" DevicePath \"\"" Jun 03 01:07:30.533081 ip-10-0-138-55 kubenswrapper[2566]: I0603 01:07:30.532861 2566 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-8ppfg\" (UniqueName: \"kubernetes.io/projected/37f0bd95-7af5-44e6-bb2e-41260f75dfb1-kube-api-access-8ppfg\") on node \"ip-10-0-138-55.ec2.internal\" DevicePath \"\"" Jun 03 01:07:30.533081 ip-10-0-138-55 kubenswrapper[2566]: I0603 01:07:30.532871 2566 reconciler_common.go:299] "Volume detached for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/37f0bd95-7af5-44e6-bb2e-41260f75dfb1-console-config\") on node \"ip-10-0-138-55.ec2.internal\" DevicePath \"\"" Jun 03 01:07:31.264373 ip-10-0-138-55 kubenswrapper[2566]: I0603 01:07:31.264341 2566 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-dns/dns-default-nvrs2" Jun 03 01:07:31.298068 ip-10-0-138-55 kubenswrapper[2566]: I0603 01:07:31.298044 2566 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console_console-cfbb9ffb-pq8vs_37f0bd95-7af5-44e6-bb2e-41260f75dfb1/console/0.log" Jun 03 01:07:31.298254 ip-10-0-138-55 kubenswrapper[2566]: I0603 01:07:31.298140 2566 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-cfbb9ffb-pq8vs" Jun 03 01:07:31.298254 ip-10-0-138-55 kubenswrapper[2566]: I0603 01:07:31.298168 2566 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-cfbb9ffb-pq8vs" event={"ID":"37f0bd95-7af5-44e6-bb2e-41260f75dfb1","Type":"ContainerDied","Data":"fb55292ac93acfd02d5e417d178dc48a399bbc01f2fde8b4bae0ed652e6fa871"} Jun 03 01:07:31.298254 ip-10-0-138-55 kubenswrapper[2566]: I0603 01:07:31.298205 2566 scope.go:117] "RemoveContainer" containerID="c5323bcd178e158750eba332cc0240b69801a00304c0a2dd3d2a16092cc7c435" Jun 03 01:07:31.317810 ip-10-0-138-55 kubenswrapper[2566]: I0603 01:07:31.317784 2566 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openshift-console/console-cfbb9ffb-pq8vs"] Jun 03 01:07:31.323715 ip-10-0-138-55 kubenswrapper[2566]: I0603 01:07:31.323685 2566 kubelet.go:2547] "SyncLoop REMOVE" source="api" pods=["openshift-console/console-cfbb9ffb-pq8vs"] Jun 03 01:07:31.589331 ip-10-0-138-55 kubenswrapper[2566]: I0603 01:07:31.589256 2566 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="37f0bd95-7af5-44e6-bb2e-41260f75dfb1" path="/var/lib/kubelet/pods/37f0bd95-7af5-44e6-bb2e-41260f75dfb1/volumes" Jun 03 01:07:32.645646 ip-10-0-138-55 kubenswrapper[2566]: I0603 01:07:32.645612 2566 patch_prober.go:28] interesting pod/console-746b478965-gtg74 container/console namespace/openshift-console: Startup probe status=failure output="Get \"https://10.134.0.17:8443/health\": dial tcp 10.134.0.17:8443: connect: connection refused" start-of-body= Jun 03 01:07:32.646021 ip-10-0-138-55 kubenswrapper[2566]: I0603 01:07:32.645666 2566 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-console/console-746b478965-gtg74" podUID="27030eaa-f2e3-4cc1-8a0a-61c99a27db41" containerName="console" probeResult="failure" output="Get \"https://10.134.0.17:8443/health\": dial tcp 10.134.0.17:8443: connect: connection refused" Jun 03 01:07:35.369493 ip-10-0-138-55 kubenswrapper[2566]: I0603 01:07:35.369456 2566 patch_prober.go:28] interesting pod/console-75dcf85d9d-fvd4k container/console namespace/openshift-console: Startup probe status=failure output="Get \"https://10.134.0.22:8443/health\": dial tcp 10.134.0.22:8443: connect: connection refused" start-of-body= Jun 03 01:07:35.369943 ip-10-0-138-55 kubenswrapper[2566]: I0603 01:07:35.369510 2566 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-console/console-75dcf85d9d-fvd4k" podUID="48e0d444-7707-4a91-b9ae-e12ae15c6f86" containerName="console" probeResult="failure" output="Get \"https://10.134.0.22:8443/health\": dial tcp 10.134.0.22:8443: connect: connection refused" Jun 03 01:07:42.649490 ip-10-0-138-55 kubenswrapper[2566]: I0603 01:07:42.649454 2566 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-console/console-746b478965-gtg74" Jun 03 01:07:42.653269 ip-10-0-138-55 kubenswrapper[2566]: I0603 01:07:42.653242 2566 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console/console-746b478965-gtg74" Jun 03 01:07:45.373121 ip-10-0-138-55 kubenswrapper[2566]: I0603 01:07:45.373091 2566 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-console/console-75dcf85d9d-fvd4k" Jun 03 01:07:45.377214 ip-10-0-138-55 kubenswrapper[2566]: I0603 01:07:45.377193 2566 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console/console-75dcf85d9d-fvd4k" Jun 03 01:07:45.433316 ip-10-0-138-55 kubenswrapper[2566]: I0603 01:07:45.433286 2566 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openshift-console/console-746b478965-gtg74"] Jun 03 01:07:51.359698 ip-10-0-138-55 kubenswrapper[2566]: I0603 01:07:51.359664 2566 generic.go:358] "Generic (PLEG): container finished" podID="9167dbe1-4d4e-4e57-9396-7b000dc36698" containerID="eb1b35c5049ccc0b216ce8d31507779336fcd6a204a419a9a79998adeb0a2984" exitCode=0 Jun 03 01:07:51.360097 ip-10-0-138-55 kubenswrapper[2566]: I0603 01:07:51.359713 2566 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-operator-788bf58df5-nhrtq" event={"ID":"9167dbe1-4d4e-4e57-9396-7b000dc36698","Type":"ContainerDied","Data":"eb1b35c5049ccc0b216ce8d31507779336fcd6a204a419a9a79998adeb0a2984"} Jun 03 01:07:51.360097 ip-10-0-138-55 kubenswrapper[2566]: I0603 01:07:51.359998 2566 scope.go:117] "RemoveContainer" containerID="eb1b35c5049ccc0b216ce8d31507779336fcd6a204a419a9a79998adeb0a2984" Jun 03 01:07:52.364299 ip-10-0-138-55 kubenswrapper[2566]: I0603 01:07:52.364254 2566 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-operator-788bf58df5-nhrtq" event={"ID":"9167dbe1-4d4e-4e57-9396-7b000dc36698","Type":"ContainerStarted","Data":"4acbc8e708d9cd36d35d56259ffd6aa848c4640edcf16c469565239ee8985fff"} Jun 03 01:07:53.368364 ip-10-0-138-55 kubenswrapper[2566]: I0603 01:07:53.368329 2566 generic.go:358] "Generic (PLEG): container finished" podID="b47d8095-6d81-4a7a-b17f-357d8b59c8d4" containerID="e8ba3f28e18c6bb10dfb2f1eb035dcaa9cede7a363864648d5653717954f2539" exitCode=0 Jun 03 01:07:53.368737 ip-10-0-138-55 kubenswrapper[2566]: I0603 01:07:53.368406 2566 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-96ddc787c-9dcb9" event={"ID":"b47d8095-6d81-4a7a-b17f-357d8b59c8d4","Type":"ContainerDied","Data":"e8ba3f28e18c6bb10dfb2f1eb035dcaa9cede7a363864648d5653717954f2539"} Jun 03 01:07:53.368778 ip-10-0-138-55 kubenswrapper[2566]: I0603 01:07:53.368737 2566 scope.go:117] "RemoveContainer" containerID="e8ba3f28e18c6bb10dfb2f1eb035dcaa9cede7a363864648d5653717954f2539" Jun 03 01:07:54.372703 ip-10-0-138-55 kubenswrapper[2566]: I0603 01:07:54.372672 2566 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-96ddc787c-9dcb9" event={"ID":"b47d8095-6d81-4a7a-b17f-357d8b59c8d4","Type":"ContainerStarted","Data":"ede1ec6971d6991a64eae813666199609f908e5af774dedb4d3182b4b8da32d6"} Jun 03 01:08:10.457696 ip-10-0-138-55 kubenswrapper[2566]: I0603 01:08:10.457632 2566 kuberuntime_container.go:864] "Killing container with a grace period" pod="openshift-console/console-746b478965-gtg74" podUID="27030eaa-f2e3-4cc1-8a0a-61c99a27db41" containerName="console" containerID="cri-o://b906c3406b8d0b3a5dfd05905bf75cba3dbc8adbc8d9ee3450a319ac37c79d69" gracePeriod=15 Jun 03 01:08:10.711434 ip-10-0-138-55 kubenswrapper[2566]: I0603 01:08:10.711379 2566 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console_console-746b478965-gtg74_27030eaa-f2e3-4cc1-8a0a-61c99a27db41/console/0.log" Jun 03 01:08:10.711543 ip-10-0-138-55 kubenswrapper[2566]: I0603 01:08:10.711439 2566 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-746b478965-gtg74" Jun 03 01:08:10.774242 ip-10-0-138-55 kubenswrapper[2566]: I0603 01:08:10.774203 2566 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-kbcsz\" (UniqueName: \"kubernetes.io/projected/27030eaa-f2e3-4cc1-8a0a-61c99a27db41-kube-api-access-kbcsz\") pod \"27030eaa-f2e3-4cc1-8a0a-61c99a27db41\" (UID: \"27030eaa-f2e3-4cc1-8a0a-61c99a27db41\") " Jun 03 01:08:10.774429 ip-10-0-138-55 kubenswrapper[2566]: I0603 01:08:10.774254 2566 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/27030eaa-f2e3-4cc1-8a0a-61c99a27db41-console-oauth-config\") pod \"27030eaa-f2e3-4cc1-8a0a-61c99a27db41\" (UID: \"27030eaa-f2e3-4cc1-8a0a-61c99a27db41\") " Jun 03 01:08:10.774429 ip-10-0-138-55 kubenswrapper[2566]: I0603 01:08:10.774295 2566 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/27030eaa-f2e3-4cc1-8a0a-61c99a27db41-trusted-ca-bundle\") pod \"27030eaa-f2e3-4cc1-8a0a-61c99a27db41\" (UID: \"27030eaa-f2e3-4cc1-8a0a-61c99a27db41\") " Jun 03 01:08:10.774429 ip-10-0-138-55 kubenswrapper[2566]: I0603 01:08:10.774393 2566 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/27030eaa-f2e3-4cc1-8a0a-61c99a27db41-oauth-serving-cert\") pod \"27030eaa-f2e3-4cc1-8a0a-61c99a27db41\" (UID: \"27030eaa-f2e3-4cc1-8a0a-61c99a27db41\") " Jun 03 01:08:10.774599 ip-10-0-138-55 kubenswrapper[2566]: I0603 01:08:10.774442 2566 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/27030eaa-f2e3-4cc1-8a0a-61c99a27db41-service-ca\") pod \"27030eaa-f2e3-4cc1-8a0a-61c99a27db41\" (UID: \"27030eaa-f2e3-4cc1-8a0a-61c99a27db41\") " Jun 03 01:08:10.774599 ip-10-0-138-55 kubenswrapper[2566]: I0603 01:08:10.774476 2566 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/27030eaa-f2e3-4cc1-8a0a-61c99a27db41-console-config\") pod \"27030eaa-f2e3-4cc1-8a0a-61c99a27db41\" (UID: \"27030eaa-f2e3-4cc1-8a0a-61c99a27db41\") " Jun 03 01:08:10.774599 ip-10-0-138-55 kubenswrapper[2566]: I0603 01:08:10.774499 2566 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/27030eaa-f2e3-4cc1-8a0a-61c99a27db41-console-serving-cert\") pod \"27030eaa-f2e3-4cc1-8a0a-61c99a27db41\" (UID: \"27030eaa-f2e3-4cc1-8a0a-61c99a27db41\") " Jun 03 01:08:10.774789 ip-10-0-138-55 kubenswrapper[2566]: I0603 01:08:10.774763 2566 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/27030eaa-f2e3-4cc1-8a0a-61c99a27db41-trusted-ca-bundle" (OuterVolumeSpecName: "trusted-ca-bundle") pod "27030eaa-f2e3-4cc1-8a0a-61c99a27db41" (UID: "27030eaa-f2e3-4cc1-8a0a-61c99a27db41"). InnerVolumeSpecName "trusted-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jun 03 01:08:10.774849 ip-10-0-138-55 kubenswrapper[2566]: I0603 01:08:10.774807 2566 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/27030eaa-f2e3-4cc1-8a0a-61c99a27db41-oauth-serving-cert" (OuterVolumeSpecName: "oauth-serving-cert") pod "27030eaa-f2e3-4cc1-8a0a-61c99a27db41" (UID: "27030eaa-f2e3-4cc1-8a0a-61c99a27db41"). InnerVolumeSpecName "oauth-serving-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jun 03 01:08:10.774849 ip-10-0-138-55 kubenswrapper[2566]: I0603 01:08:10.774830 2566 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/27030eaa-f2e3-4cc1-8a0a-61c99a27db41-console-config" (OuterVolumeSpecName: "console-config") pod "27030eaa-f2e3-4cc1-8a0a-61c99a27db41" (UID: "27030eaa-f2e3-4cc1-8a0a-61c99a27db41"). InnerVolumeSpecName "console-config". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jun 03 01:08:10.774947 ip-10-0-138-55 kubenswrapper[2566]: I0603 01:08:10.774858 2566 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/27030eaa-f2e3-4cc1-8a0a-61c99a27db41-service-ca" (OuterVolumeSpecName: "service-ca") pod "27030eaa-f2e3-4cc1-8a0a-61c99a27db41" (UID: "27030eaa-f2e3-4cc1-8a0a-61c99a27db41"). InnerVolumeSpecName "service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jun 03 01:08:10.776515 ip-10-0-138-55 kubenswrapper[2566]: I0603 01:08:10.776483 2566 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/27030eaa-f2e3-4cc1-8a0a-61c99a27db41-kube-api-access-kbcsz" (OuterVolumeSpecName: "kube-api-access-kbcsz") pod "27030eaa-f2e3-4cc1-8a0a-61c99a27db41" (UID: "27030eaa-f2e3-4cc1-8a0a-61c99a27db41"). InnerVolumeSpecName "kube-api-access-kbcsz". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 03 01:08:10.776515 ip-10-0-138-55 kubenswrapper[2566]: I0603 01:08:10.776502 2566 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/27030eaa-f2e3-4cc1-8a0a-61c99a27db41-console-oauth-config" (OuterVolumeSpecName: "console-oauth-config") pod "27030eaa-f2e3-4cc1-8a0a-61c99a27db41" (UID: "27030eaa-f2e3-4cc1-8a0a-61c99a27db41"). InnerVolumeSpecName "console-oauth-config". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jun 03 01:08:10.776674 ip-10-0-138-55 kubenswrapper[2566]: I0603 01:08:10.776566 2566 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/27030eaa-f2e3-4cc1-8a0a-61c99a27db41-console-serving-cert" (OuterVolumeSpecName: "console-serving-cert") pod "27030eaa-f2e3-4cc1-8a0a-61c99a27db41" (UID: "27030eaa-f2e3-4cc1-8a0a-61c99a27db41"). InnerVolumeSpecName "console-serving-cert". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jun 03 01:08:10.875424 ip-10-0-138-55 kubenswrapper[2566]: I0603 01:08:10.875386 2566 reconciler_common.go:299] "Volume detached for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/27030eaa-f2e3-4cc1-8a0a-61c99a27db41-service-ca\") on node \"ip-10-0-138-55.ec2.internal\" DevicePath \"\"" Jun 03 01:08:10.875424 ip-10-0-138-55 kubenswrapper[2566]: I0603 01:08:10.875418 2566 reconciler_common.go:299] "Volume detached for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/27030eaa-f2e3-4cc1-8a0a-61c99a27db41-console-config\") on node \"ip-10-0-138-55.ec2.internal\" DevicePath \"\"" Jun 03 01:08:10.875424 ip-10-0-138-55 kubenswrapper[2566]: I0603 01:08:10.875426 2566 reconciler_common.go:299] "Volume detached for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/27030eaa-f2e3-4cc1-8a0a-61c99a27db41-console-serving-cert\") on node \"ip-10-0-138-55.ec2.internal\" DevicePath \"\"" Jun 03 01:08:10.875652 ip-10-0-138-55 kubenswrapper[2566]: I0603 01:08:10.875437 2566 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-kbcsz\" (UniqueName: \"kubernetes.io/projected/27030eaa-f2e3-4cc1-8a0a-61c99a27db41-kube-api-access-kbcsz\") on node \"ip-10-0-138-55.ec2.internal\" DevicePath \"\"" Jun 03 01:08:10.875652 ip-10-0-138-55 kubenswrapper[2566]: I0603 01:08:10.875448 2566 reconciler_common.go:299] "Volume detached for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/27030eaa-f2e3-4cc1-8a0a-61c99a27db41-console-oauth-config\") on node \"ip-10-0-138-55.ec2.internal\" DevicePath \"\"" Jun 03 01:08:10.875652 ip-10-0-138-55 kubenswrapper[2566]: I0603 01:08:10.875456 2566 reconciler_common.go:299] "Volume detached for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/27030eaa-f2e3-4cc1-8a0a-61c99a27db41-trusted-ca-bundle\") on node \"ip-10-0-138-55.ec2.internal\" DevicePath \"\"" Jun 03 01:08:10.875652 ip-10-0-138-55 kubenswrapper[2566]: I0603 01:08:10.875467 2566 reconciler_common.go:299] "Volume detached for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/27030eaa-f2e3-4cc1-8a0a-61c99a27db41-oauth-serving-cert\") on node \"ip-10-0-138-55.ec2.internal\" DevicePath \"\"" Jun 03 01:08:11.430703 ip-10-0-138-55 kubenswrapper[2566]: I0603 01:08:11.430676 2566 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console_console-746b478965-gtg74_27030eaa-f2e3-4cc1-8a0a-61c99a27db41/console/0.log" Jun 03 01:08:11.430867 ip-10-0-138-55 kubenswrapper[2566]: I0603 01:08:11.430722 2566 generic.go:358] "Generic (PLEG): container finished" podID="27030eaa-f2e3-4cc1-8a0a-61c99a27db41" containerID="b906c3406b8d0b3a5dfd05905bf75cba3dbc8adbc8d9ee3450a319ac37c79d69" exitCode=2 Jun 03 01:08:11.430867 ip-10-0-138-55 kubenswrapper[2566]: I0603 01:08:11.430795 2566 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-746b478965-gtg74" Jun 03 01:08:11.430867 ip-10-0-138-55 kubenswrapper[2566]: I0603 01:08:11.430810 2566 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-746b478965-gtg74" event={"ID":"27030eaa-f2e3-4cc1-8a0a-61c99a27db41","Type":"ContainerDied","Data":"b906c3406b8d0b3a5dfd05905bf75cba3dbc8adbc8d9ee3450a319ac37c79d69"} Jun 03 01:08:11.430867 ip-10-0-138-55 kubenswrapper[2566]: I0603 01:08:11.430849 2566 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-746b478965-gtg74" event={"ID":"27030eaa-f2e3-4cc1-8a0a-61c99a27db41","Type":"ContainerDied","Data":"5bbd9ad4511fde142fb097f097d2c33f3b794821c766715a8a521aca191848b4"} Jun 03 01:08:11.430867 ip-10-0-138-55 kubenswrapper[2566]: I0603 01:08:11.430866 2566 scope.go:117] "RemoveContainer" containerID="b906c3406b8d0b3a5dfd05905bf75cba3dbc8adbc8d9ee3450a319ac37c79d69" Jun 03 01:08:11.440018 ip-10-0-138-55 kubenswrapper[2566]: I0603 01:08:11.439999 2566 scope.go:117] "RemoveContainer" containerID="b906c3406b8d0b3a5dfd05905bf75cba3dbc8adbc8d9ee3450a319ac37c79d69" Jun 03 01:08:11.440293 ip-10-0-138-55 kubenswrapper[2566]: E0603 01:08:11.440267 2566 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"b906c3406b8d0b3a5dfd05905bf75cba3dbc8adbc8d9ee3450a319ac37c79d69\": container with ID starting with b906c3406b8d0b3a5dfd05905bf75cba3dbc8adbc8d9ee3450a319ac37c79d69 not found: ID does not exist" containerID="b906c3406b8d0b3a5dfd05905bf75cba3dbc8adbc8d9ee3450a319ac37c79d69" Jun 03 01:08:11.440391 ip-10-0-138-55 kubenswrapper[2566]: I0603 01:08:11.440298 2566 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"b906c3406b8d0b3a5dfd05905bf75cba3dbc8adbc8d9ee3450a319ac37c79d69"} err="failed to get container status \"b906c3406b8d0b3a5dfd05905bf75cba3dbc8adbc8d9ee3450a319ac37c79d69\": rpc error: code = NotFound desc = could not find container \"b906c3406b8d0b3a5dfd05905bf75cba3dbc8adbc8d9ee3450a319ac37c79d69\": container with ID starting with b906c3406b8d0b3a5dfd05905bf75cba3dbc8adbc8d9ee3450a319ac37c79d69 not found: ID does not exist" Jun 03 01:08:11.451183 ip-10-0-138-55 kubenswrapper[2566]: I0603 01:08:11.451162 2566 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openshift-console/console-746b478965-gtg74"] Jun 03 01:08:11.454283 ip-10-0-138-55 kubenswrapper[2566]: I0603 01:08:11.454261 2566 kubelet.go:2547] "SyncLoop REMOVE" source="api" pods=["openshift-console/console-746b478965-gtg74"] Jun 03 01:08:11.590275 ip-10-0-138-55 kubenswrapper[2566]: I0603 01:08:11.590216 2566 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="27030eaa-f2e3-4cc1-8a0a-61c99a27db41" path="/var/lib/kubelet/pods/27030eaa-f2e3-4cc1-8a0a-61c99a27db41/volumes" Jun 03 01:08:24.551273 ip-10-0-138-55 kubenswrapper[2566]: I0603 01:08:24.551220 2566 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-monitoring/telemeter-client-687fdbd4f-qlspg"] Jun 03 01:08:24.552239 ip-10-0-138-55 kubenswrapper[2566]: I0603 01:08:24.552198 2566 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="37f0bd95-7af5-44e6-bb2e-41260f75dfb1" containerName="console" Jun 03 01:08:24.552379 ip-10-0-138-55 kubenswrapper[2566]: I0603 01:08:24.552251 2566 state_mem.go:107] "Deleted CPUSet assignment" podUID="37f0bd95-7af5-44e6-bb2e-41260f75dfb1" containerName="console" Jun 03 01:08:24.552379 ip-10-0-138-55 kubenswrapper[2566]: I0603 01:08:24.552295 2566 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="27030eaa-f2e3-4cc1-8a0a-61c99a27db41" containerName="console" Jun 03 01:08:24.552379 ip-10-0-138-55 kubenswrapper[2566]: I0603 01:08:24.552307 2566 state_mem.go:107] "Deleted CPUSet assignment" podUID="27030eaa-f2e3-4cc1-8a0a-61c99a27db41" containerName="console" Jun 03 01:08:24.552547 ip-10-0-138-55 kubenswrapper[2566]: I0603 01:08:24.552421 2566 memory_manager.go:356] "RemoveStaleState removing state" podUID="37f0bd95-7af5-44e6-bb2e-41260f75dfb1" containerName="console" Jun 03 01:08:24.552547 ip-10-0-138-55 kubenswrapper[2566]: I0603 01:08:24.552437 2566 memory_manager.go:356] "RemoveStaleState removing state" podUID="27030eaa-f2e3-4cc1-8a0a-61c99a27db41" containerName="console" Jun 03 01:08:24.555929 ip-10-0-138-55 kubenswrapper[2566]: I0603 01:08:24.555906 2566 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/telemeter-client-687fdbd4f-qlspg" Jun 03 01:08:24.557785 ip-10-0-138-55 kubenswrapper[2566]: I0603 01:08:24.557756 2566 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"telemeter-client-tls\"" Jun 03 01:08:24.557977 ip-10-0-138-55 kubenswrapper[2566]: I0603 01:08:24.557762 2566 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"telemeter-client-serving-certs-ca-bundle\"" Jun 03 01:08:24.557977 ip-10-0-138-55 kubenswrapper[2566]: I0603 01:08:24.557802 2566 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"telemeter-client-kube-rbac-proxy-config\"" Jun 03 01:08:24.558183 ip-10-0-138-55 kubenswrapper[2566]: I0603 01:08:24.558089 2566 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"telemeter-client\"" Jun 03 01:08:24.558183 ip-10-0-138-55 kubenswrapper[2566]: I0603 01:08:24.558091 2566 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"federate-client-certs\"" Jun 03 01:08:24.558353 ip-10-0-138-55 kubenswrapper[2566]: I0603 01:08:24.558183 2566 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"telemeter-client-dockercfg-lx4tx\"" Jun 03 01:08:24.563708 ip-10-0-138-55 kubenswrapper[2566]: I0603 01:08:24.563675 2566 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"telemeter-trusted-ca-bundle-8i12ta5c71j38\"" Jun 03 01:08:24.567449 ip-10-0-138-55 kubenswrapper[2566]: I0603 01:08:24.567062 2566 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/telemeter-client-687fdbd4f-qlspg"] Jun 03 01:08:24.690247 ip-10-0-138-55 kubenswrapper[2566]: I0603 01:08:24.690180 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-telemeter-client-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/7dc20f7a-9ee1-484e-bdb1-ff81b28e891c-secret-telemeter-client-kube-rbac-proxy-config\") pod \"telemeter-client-687fdbd4f-qlspg\" (UID: \"7dc20f7a-9ee1-484e-bdb1-ff81b28e891c\") " pod="openshift-monitoring/telemeter-client-687fdbd4f-qlspg" Jun 03 01:08:24.690442 ip-10-0-138-55 kubenswrapper[2566]: I0603 01:08:24.690253 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-telemeter-client\" (UniqueName: \"kubernetes.io/secret/7dc20f7a-9ee1-484e-bdb1-ff81b28e891c-secret-telemeter-client\") pod \"telemeter-client-687fdbd4f-qlspg\" (UID: \"7dc20f7a-9ee1-484e-bdb1-ff81b28e891c\") " pod="openshift-monitoring/telemeter-client-687fdbd4f-qlspg" Jun 03 01:08:24.690442 ip-10-0-138-55 kubenswrapper[2566]: I0603 01:08:24.690302 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"telemeter-client-tls\" (UniqueName: \"kubernetes.io/secret/7dc20f7a-9ee1-484e-bdb1-ff81b28e891c-telemeter-client-tls\") pod \"telemeter-client-687fdbd4f-qlspg\" (UID: \"7dc20f7a-9ee1-484e-bdb1-ff81b28e891c\") " pod="openshift-monitoring/telemeter-client-687fdbd4f-qlspg" Jun 03 01:08:24.690442 ip-10-0-138-55 kubenswrapper[2566]: I0603 01:08:24.690327 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/7dc20f7a-9ee1-484e-bdb1-ff81b28e891c-metrics-client-ca\") pod \"telemeter-client-687fdbd4f-qlspg\" (UID: \"7dc20f7a-9ee1-484e-bdb1-ff81b28e891c\") " pod="openshift-monitoring/telemeter-client-687fdbd4f-qlspg" Jun 03 01:08:24.690442 ip-10-0-138-55 kubenswrapper[2566]: I0603 01:08:24.690353 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"federate-client-tls\" (UniqueName: \"kubernetes.io/secret/7dc20f7a-9ee1-484e-bdb1-ff81b28e891c-federate-client-tls\") pod \"telemeter-client-687fdbd4f-qlspg\" (UID: \"7dc20f7a-9ee1-484e-bdb1-ff81b28e891c\") " pod="openshift-monitoring/telemeter-client-687fdbd4f-qlspg" Jun 03 01:08:24.690442 ip-10-0-138-55 kubenswrapper[2566]: I0603 01:08:24.690376 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-ft4vh\" (UniqueName: \"kubernetes.io/projected/7dc20f7a-9ee1-484e-bdb1-ff81b28e891c-kube-api-access-ft4vh\") pod \"telemeter-client-687fdbd4f-qlspg\" (UID: \"7dc20f7a-9ee1-484e-bdb1-ff81b28e891c\") " pod="openshift-monitoring/telemeter-client-687fdbd4f-qlspg" Jun 03 01:08:24.690631 ip-10-0-138-55 kubenswrapper[2566]: I0603 01:08:24.690484 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/7dc20f7a-9ee1-484e-bdb1-ff81b28e891c-serving-certs-ca-bundle\") pod \"telemeter-client-687fdbd4f-qlspg\" (UID: \"7dc20f7a-9ee1-484e-bdb1-ff81b28e891c\") " pod="openshift-monitoring/telemeter-client-687fdbd4f-qlspg" Jun 03 01:08:24.690631 ip-10-0-138-55 kubenswrapper[2566]: I0603 01:08:24.690525 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"telemeter-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/7dc20f7a-9ee1-484e-bdb1-ff81b28e891c-telemeter-trusted-ca-bundle\") pod \"telemeter-client-687fdbd4f-qlspg\" (UID: \"7dc20f7a-9ee1-484e-bdb1-ff81b28e891c\") " pod="openshift-monitoring/telemeter-client-687fdbd4f-qlspg" Jun 03 01:08:24.791485 ip-10-0-138-55 kubenswrapper[2566]: I0603 01:08:24.791444 2566 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"federate-client-tls\" (UniqueName: \"kubernetes.io/secret/7dc20f7a-9ee1-484e-bdb1-ff81b28e891c-federate-client-tls\") pod \"telemeter-client-687fdbd4f-qlspg\" (UID: \"7dc20f7a-9ee1-484e-bdb1-ff81b28e891c\") " pod="openshift-monitoring/telemeter-client-687fdbd4f-qlspg" Jun 03 01:08:24.791485 ip-10-0-138-55 kubenswrapper[2566]: I0603 01:08:24.791489 2566 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-ft4vh\" (UniqueName: \"kubernetes.io/projected/7dc20f7a-9ee1-484e-bdb1-ff81b28e891c-kube-api-access-ft4vh\") pod \"telemeter-client-687fdbd4f-qlspg\" (UID: \"7dc20f7a-9ee1-484e-bdb1-ff81b28e891c\") " pod="openshift-monitoring/telemeter-client-687fdbd4f-qlspg" Jun 03 01:08:24.791710 ip-10-0-138-55 kubenswrapper[2566]: I0603 01:08:24.791523 2566 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/7dc20f7a-9ee1-484e-bdb1-ff81b28e891c-serving-certs-ca-bundle\") pod \"telemeter-client-687fdbd4f-qlspg\" (UID: \"7dc20f7a-9ee1-484e-bdb1-ff81b28e891c\") " pod="openshift-monitoring/telemeter-client-687fdbd4f-qlspg" Jun 03 01:08:24.791710 ip-10-0-138-55 kubenswrapper[2566]: I0603 01:08:24.791559 2566 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"telemeter-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/7dc20f7a-9ee1-484e-bdb1-ff81b28e891c-telemeter-trusted-ca-bundle\") pod \"telemeter-client-687fdbd4f-qlspg\" (UID: \"7dc20f7a-9ee1-484e-bdb1-ff81b28e891c\") " pod="openshift-monitoring/telemeter-client-687fdbd4f-qlspg" Jun 03 01:08:24.791710 ip-10-0-138-55 kubenswrapper[2566]: I0603 01:08:24.791626 2566 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"secret-telemeter-client-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/7dc20f7a-9ee1-484e-bdb1-ff81b28e891c-secret-telemeter-client-kube-rbac-proxy-config\") pod \"telemeter-client-687fdbd4f-qlspg\" (UID: \"7dc20f7a-9ee1-484e-bdb1-ff81b28e891c\") " pod="openshift-monitoring/telemeter-client-687fdbd4f-qlspg" Jun 03 01:08:24.791710 ip-10-0-138-55 kubenswrapper[2566]: I0603 01:08:24.791661 2566 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"secret-telemeter-client\" (UniqueName: \"kubernetes.io/secret/7dc20f7a-9ee1-484e-bdb1-ff81b28e891c-secret-telemeter-client\") pod \"telemeter-client-687fdbd4f-qlspg\" (UID: \"7dc20f7a-9ee1-484e-bdb1-ff81b28e891c\") " pod="openshift-monitoring/telemeter-client-687fdbd4f-qlspg" Jun 03 01:08:24.791710 ip-10-0-138-55 kubenswrapper[2566]: I0603 01:08:24.791704 2566 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"telemeter-client-tls\" (UniqueName: \"kubernetes.io/secret/7dc20f7a-9ee1-484e-bdb1-ff81b28e891c-telemeter-client-tls\") pod \"telemeter-client-687fdbd4f-qlspg\" (UID: \"7dc20f7a-9ee1-484e-bdb1-ff81b28e891c\") " pod="openshift-monitoring/telemeter-client-687fdbd4f-qlspg" Jun 03 01:08:24.791962 ip-10-0-138-55 kubenswrapper[2566]: I0603 01:08:24.791737 2566 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/7dc20f7a-9ee1-484e-bdb1-ff81b28e891c-metrics-client-ca\") pod \"telemeter-client-687fdbd4f-qlspg\" (UID: \"7dc20f7a-9ee1-484e-bdb1-ff81b28e891c\") " pod="openshift-monitoring/telemeter-client-687fdbd4f-qlspg" Jun 03 01:08:24.792422 ip-10-0-138-55 kubenswrapper[2566]: I0603 01:08:24.792391 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/7dc20f7a-9ee1-484e-bdb1-ff81b28e891c-serving-certs-ca-bundle\") pod \"telemeter-client-687fdbd4f-qlspg\" (UID: \"7dc20f7a-9ee1-484e-bdb1-ff81b28e891c\") " pod="openshift-monitoring/telemeter-client-687fdbd4f-qlspg" Jun 03 01:08:24.792617 ip-10-0-138-55 kubenswrapper[2566]: I0603 01:08:24.792452 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/7dc20f7a-9ee1-484e-bdb1-ff81b28e891c-metrics-client-ca\") pod \"telemeter-client-687fdbd4f-qlspg\" (UID: \"7dc20f7a-9ee1-484e-bdb1-ff81b28e891c\") " pod="openshift-monitoring/telemeter-client-687fdbd4f-qlspg" Jun 03 01:08:24.792758 ip-10-0-138-55 kubenswrapper[2566]: I0603 01:08:24.792737 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"telemeter-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/7dc20f7a-9ee1-484e-bdb1-ff81b28e891c-telemeter-trusted-ca-bundle\") pod \"telemeter-client-687fdbd4f-qlspg\" (UID: \"7dc20f7a-9ee1-484e-bdb1-ff81b28e891c\") " pod="openshift-monitoring/telemeter-client-687fdbd4f-qlspg" Jun 03 01:08:24.794269 ip-10-0-138-55 kubenswrapper[2566]: I0603 01:08:24.794246 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"telemeter-client-tls\" (UniqueName: \"kubernetes.io/secret/7dc20f7a-9ee1-484e-bdb1-ff81b28e891c-telemeter-client-tls\") pod \"telemeter-client-687fdbd4f-qlspg\" (UID: \"7dc20f7a-9ee1-484e-bdb1-ff81b28e891c\") " pod="openshift-monitoring/telemeter-client-687fdbd4f-qlspg" Jun 03 01:08:24.794361 ip-10-0-138-55 kubenswrapper[2566]: I0603 01:08:24.794294 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-telemeter-client\" (UniqueName: \"kubernetes.io/secret/7dc20f7a-9ee1-484e-bdb1-ff81b28e891c-secret-telemeter-client\") pod \"telemeter-client-687fdbd4f-qlspg\" (UID: \"7dc20f7a-9ee1-484e-bdb1-ff81b28e891c\") " pod="openshift-monitoring/telemeter-client-687fdbd4f-qlspg" Jun 03 01:08:24.794405 ip-10-0-138-55 kubenswrapper[2566]: I0603 01:08:24.794383 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-telemeter-client-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/7dc20f7a-9ee1-484e-bdb1-ff81b28e891c-secret-telemeter-client-kube-rbac-proxy-config\") pod \"telemeter-client-687fdbd4f-qlspg\" (UID: \"7dc20f7a-9ee1-484e-bdb1-ff81b28e891c\") " pod="openshift-monitoring/telemeter-client-687fdbd4f-qlspg" Jun 03 01:08:24.794462 ip-10-0-138-55 kubenswrapper[2566]: I0603 01:08:24.794444 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"federate-client-tls\" (UniqueName: \"kubernetes.io/secret/7dc20f7a-9ee1-484e-bdb1-ff81b28e891c-federate-client-tls\") pod \"telemeter-client-687fdbd4f-qlspg\" (UID: \"7dc20f7a-9ee1-484e-bdb1-ff81b28e891c\") " pod="openshift-monitoring/telemeter-client-687fdbd4f-qlspg" Jun 03 01:08:24.798523 ip-10-0-138-55 kubenswrapper[2566]: I0603 01:08:24.798500 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-ft4vh\" (UniqueName: \"kubernetes.io/projected/7dc20f7a-9ee1-484e-bdb1-ff81b28e891c-kube-api-access-ft4vh\") pod \"telemeter-client-687fdbd4f-qlspg\" (UID: \"7dc20f7a-9ee1-484e-bdb1-ff81b28e891c\") " pod="openshift-monitoring/telemeter-client-687fdbd4f-qlspg" Jun 03 01:08:24.870993 ip-10-0-138-55 kubenswrapper[2566]: I0603 01:08:24.870962 2566 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/telemeter-client-687fdbd4f-qlspg" Jun 03 01:08:24.995206 ip-10-0-138-55 kubenswrapper[2566]: I0603 01:08:24.995170 2566 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/telemeter-client-687fdbd4f-qlspg"] Jun 03 01:08:24.999280 ip-10-0-138-55 kubenswrapper[2566]: W0603 01:08:24.999254 2566 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod7dc20f7a_9ee1_484e_bdb1_ff81b28e891c.slice/crio-ded54a8d0d290cecb4079ea42295b293a5750012cb7b34d570a5c9a6735dca15 WatchSource:0}: Error finding container ded54a8d0d290cecb4079ea42295b293a5750012cb7b34d570a5c9a6735dca15: Status 404 returned error can't find the container with id ded54a8d0d290cecb4079ea42295b293a5750012cb7b34d570a5c9a6735dca15 Jun 03 01:08:25.476944 ip-10-0-138-55 kubenswrapper[2566]: I0603 01:08:25.476907 2566 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/telemeter-client-687fdbd4f-qlspg" event={"ID":"7dc20f7a-9ee1-484e-bdb1-ff81b28e891c","Type":"ContainerStarted","Data":"ded54a8d0d290cecb4079ea42295b293a5750012cb7b34d570a5c9a6735dca15"} Jun 03 01:08:27.484346 ip-10-0-138-55 kubenswrapper[2566]: I0603 01:08:27.484263 2566 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/telemeter-client-687fdbd4f-qlspg" event={"ID":"7dc20f7a-9ee1-484e-bdb1-ff81b28e891c","Type":"ContainerStarted","Data":"180a2203b7526f12d310ab429becb0b7c528746b78103383ea2c2d57aedad21d"} Jun 03 01:08:27.484346 ip-10-0-138-55 kubenswrapper[2566]: I0603 01:08:27.484308 2566 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/telemeter-client-687fdbd4f-qlspg" event={"ID":"7dc20f7a-9ee1-484e-bdb1-ff81b28e891c","Type":"ContainerStarted","Data":"c7174e1a7a19726e03b9464d34d9d3c11a2c7bfaca2feca2063fca1fdd1fc70d"} Jun 03 01:08:27.484346 ip-10-0-138-55 kubenswrapper[2566]: I0603 01:08:27.484322 2566 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/telemeter-client-687fdbd4f-qlspg" event={"ID":"7dc20f7a-9ee1-484e-bdb1-ff81b28e891c","Type":"ContainerStarted","Data":"e29de935cc2ea2a88ffc0176128140d35ab9e3b437502cbfa605ef788610cf8f"} Jun 03 01:08:27.504205 ip-10-0-138-55 kubenswrapper[2566]: I0603 01:08:27.504152 2566 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-monitoring/telemeter-client-687fdbd4f-qlspg" podStartSLOduration=1.293601963 podStartE2EDuration="3.504135807s" podCreationTimestamp="2026-06-03 01:08:24 +0000 UTC" firstStartedPulling="2026-06-03 01:08:25.001219284 +0000 UTC m=+228.148061218" lastFinishedPulling="2026-06-03 01:08:27.211753138 +0000 UTC m=+230.358595062" observedRunningTime="2026-06-03 01:08:27.502424831 +0000 UTC m=+230.649266777" watchObservedRunningTime="2026-06-03 01:08:27.504135807 +0000 UTC m=+230.650978051" Jun 03 01:08:28.157335 ip-10-0-138-55 kubenswrapper[2566]: I0603 01:08:28.157304 2566 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-console/console-8675875d6d-k5ff2"] Jun 03 01:08:28.160969 ip-10-0-138-55 kubenswrapper[2566]: I0603 01:08:28.160939 2566 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-8675875d6d-k5ff2" Jun 03 01:08:28.171019 ip-10-0-138-55 kubenswrapper[2566]: I0603 01:08:28.170992 2566 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-8675875d6d-k5ff2"] Jun 03 01:08:28.221912 ip-10-0-138-55 kubenswrapper[2566]: I0603 01:08:28.221860 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/319e7e9c-d51a-478e-b59f-f0fc4346db1f-console-oauth-config\") pod \"console-8675875d6d-k5ff2\" (UID: \"319e7e9c-d51a-478e-b59f-f0fc4346db1f\") " pod="openshift-console/console-8675875d6d-k5ff2" Jun 03 01:08:28.222106 ip-10-0-138-55 kubenswrapper[2566]: I0603 01:08:28.221922 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/319e7e9c-d51a-478e-b59f-f0fc4346db1f-trusted-ca-bundle\") pod \"console-8675875d6d-k5ff2\" (UID: \"319e7e9c-d51a-478e-b59f-f0fc4346db1f\") " pod="openshift-console/console-8675875d6d-k5ff2" Jun 03 01:08:28.222106 ip-10-0-138-55 kubenswrapper[2566]: I0603 01:08:28.222039 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/319e7e9c-d51a-478e-b59f-f0fc4346db1f-console-serving-cert\") pod \"console-8675875d6d-k5ff2\" (UID: \"319e7e9c-d51a-478e-b59f-f0fc4346db1f\") " pod="openshift-console/console-8675875d6d-k5ff2" Jun 03 01:08:28.222106 ip-10-0-138-55 kubenswrapper[2566]: I0603 01:08:28.222078 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/319e7e9c-d51a-478e-b59f-f0fc4346db1f-oauth-serving-cert\") pod \"console-8675875d6d-k5ff2\" (UID: \"319e7e9c-d51a-478e-b59f-f0fc4346db1f\") " pod="openshift-console/console-8675875d6d-k5ff2" Jun 03 01:08:28.222299 ip-10-0-138-55 kubenswrapper[2566]: I0603 01:08:28.222106 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/319e7e9c-d51a-478e-b59f-f0fc4346db1f-service-ca\") pod \"console-8675875d6d-k5ff2\" (UID: \"319e7e9c-d51a-478e-b59f-f0fc4346db1f\") " pod="openshift-console/console-8675875d6d-k5ff2" Jun 03 01:08:28.222299 ip-10-0-138-55 kubenswrapper[2566]: I0603 01:08:28.222145 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/319e7e9c-d51a-478e-b59f-f0fc4346db1f-console-config\") pod \"console-8675875d6d-k5ff2\" (UID: \"319e7e9c-d51a-478e-b59f-f0fc4346db1f\") " pod="openshift-console/console-8675875d6d-k5ff2" Jun 03 01:08:28.222299 ip-10-0-138-55 kubenswrapper[2566]: I0603 01:08:28.222187 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-dtl6m\" (UniqueName: \"kubernetes.io/projected/319e7e9c-d51a-478e-b59f-f0fc4346db1f-kube-api-access-dtl6m\") pod \"console-8675875d6d-k5ff2\" (UID: \"319e7e9c-d51a-478e-b59f-f0fc4346db1f\") " pod="openshift-console/console-8675875d6d-k5ff2" Jun 03 01:08:28.323157 ip-10-0-138-55 kubenswrapper[2566]: I0603 01:08:28.323121 2566 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/319e7e9c-d51a-478e-b59f-f0fc4346db1f-console-serving-cert\") pod \"console-8675875d6d-k5ff2\" (UID: \"319e7e9c-d51a-478e-b59f-f0fc4346db1f\") " pod="openshift-console/console-8675875d6d-k5ff2" Jun 03 01:08:28.323157 ip-10-0-138-55 kubenswrapper[2566]: I0603 01:08:28.323164 2566 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/319e7e9c-d51a-478e-b59f-f0fc4346db1f-oauth-serving-cert\") pod \"console-8675875d6d-k5ff2\" (UID: \"319e7e9c-d51a-478e-b59f-f0fc4346db1f\") " pod="openshift-console/console-8675875d6d-k5ff2" Jun 03 01:08:28.323421 ip-10-0-138-55 kubenswrapper[2566]: I0603 01:08:28.323182 2566 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/319e7e9c-d51a-478e-b59f-f0fc4346db1f-service-ca\") pod \"console-8675875d6d-k5ff2\" (UID: \"319e7e9c-d51a-478e-b59f-f0fc4346db1f\") " pod="openshift-console/console-8675875d6d-k5ff2" Jun 03 01:08:28.323421 ip-10-0-138-55 kubenswrapper[2566]: I0603 01:08:28.323205 2566 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/319e7e9c-d51a-478e-b59f-f0fc4346db1f-console-config\") pod \"console-8675875d6d-k5ff2\" (UID: \"319e7e9c-d51a-478e-b59f-f0fc4346db1f\") " pod="openshift-console/console-8675875d6d-k5ff2" Jun 03 01:08:28.323421 ip-10-0-138-55 kubenswrapper[2566]: I0603 01:08:28.323258 2566 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-dtl6m\" (UniqueName: \"kubernetes.io/projected/319e7e9c-d51a-478e-b59f-f0fc4346db1f-kube-api-access-dtl6m\") pod \"console-8675875d6d-k5ff2\" (UID: \"319e7e9c-d51a-478e-b59f-f0fc4346db1f\") " pod="openshift-console/console-8675875d6d-k5ff2" Jun 03 01:08:28.323421 ip-10-0-138-55 kubenswrapper[2566]: I0603 01:08:28.323293 2566 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/319e7e9c-d51a-478e-b59f-f0fc4346db1f-console-oauth-config\") pod \"console-8675875d6d-k5ff2\" (UID: \"319e7e9c-d51a-478e-b59f-f0fc4346db1f\") " pod="openshift-console/console-8675875d6d-k5ff2" Jun 03 01:08:28.323421 ip-10-0-138-55 kubenswrapper[2566]: I0603 01:08:28.323317 2566 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/319e7e9c-d51a-478e-b59f-f0fc4346db1f-trusted-ca-bundle\") pod \"console-8675875d6d-k5ff2\" (UID: \"319e7e9c-d51a-478e-b59f-f0fc4346db1f\") " pod="openshift-console/console-8675875d6d-k5ff2" Jun 03 01:08:28.324116 ip-10-0-138-55 kubenswrapper[2566]: I0603 01:08:28.324088 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/319e7e9c-d51a-478e-b59f-f0fc4346db1f-oauth-serving-cert\") pod \"console-8675875d6d-k5ff2\" (UID: \"319e7e9c-d51a-478e-b59f-f0fc4346db1f\") " pod="openshift-console/console-8675875d6d-k5ff2" Jun 03 01:08:28.324261 ip-10-0-138-55 kubenswrapper[2566]: I0603 01:08:28.324125 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/319e7e9c-d51a-478e-b59f-f0fc4346db1f-console-config\") pod \"console-8675875d6d-k5ff2\" (UID: \"319e7e9c-d51a-478e-b59f-f0fc4346db1f\") " pod="openshift-console/console-8675875d6d-k5ff2" Jun 03 01:08:28.324261 ip-10-0-138-55 kubenswrapper[2566]: I0603 01:08:28.324140 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/319e7e9c-d51a-478e-b59f-f0fc4346db1f-service-ca\") pod \"console-8675875d6d-k5ff2\" (UID: \"319e7e9c-d51a-478e-b59f-f0fc4346db1f\") " pod="openshift-console/console-8675875d6d-k5ff2" Jun 03 01:08:28.324394 ip-10-0-138-55 kubenswrapper[2566]: I0603 01:08:28.324301 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/319e7e9c-d51a-478e-b59f-f0fc4346db1f-trusted-ca-bundle\") pod \"console-8675875d6d-k5ff2\" (UID: \"319e7e9c-d51a-478e-b59f-f0fc4346db1f\") " pod="openshift-console/console-8675875d6d-k5ff2" Jun 03 01:08:28.325846 ip-10-0-138-55 kubenswrapper[2566]: I0603 01:08:28.325819 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/319e7e9c-d51a-478e-b59f-f0fc4346db1f-console-oauth-config\") pod \"console-8675875d6d-k5ff2\" (UID: \"319e7e9c-d51a-478e-b59f-f0fc4346db1f\") " pod="openshift-console/console-8675875d6d-k5ff2" Jun 03 01:08:28.325944 ip-10-0-138-55 kubenswrapper[2566]: I0603 01:08:28.325879 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/319e7e9c-d51a-478e-b59f-f0fc4346db1f-console-serving-cert\") pod \"console-8675875d6d-k5ff2\" (UID: \"319e7e9c-d51a-478e-b59f-f0fc4346db1f\") " pod="openshift-console/console-8675875d6d-k5ff2" Jun 03 01:08:28.330486 ip-10-0-138-55 kubenswrapper[2566]: I0603 01:08:28.330462 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-dtl6m\" (UniqueName: \"kubernetes.io/projected/319e7e9c-d51a-478e-b59f-f0fc4346db1f-kube-api-access-dtl6m\") pod \"console-8675875d6d-k5ff2\" (UID: \"319e7e9c-d51a-478e-b59f-f0fc4346db1f\") " pod="openshift-console/console-8675875d6d-k5ff2" Jun 03 01:08:28.471046 ip-10-0-138-55 kubenswrapper[2566]: I0603 01:08:28.470964 2566 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-8675875d6d-k5ff2" Jun 03 01:08:28.596557 ip-10-0-138-55 kubenswrapper[2566]: I0603 01:08:28.596536 2566 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-8675875d6d-k5ff2"] Jun 03 01:08:28.598915 ip-10-0-138-55 kubenswrapper[2566]: W0603 01:08:28.598885 2566 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod319e7e9c_d51a_478e_b59f_f0fc4346db1f.slice/crio-b240763b0dfb077085888d84c99e0ee977500dfa9e33c525c887ea7315cf8c23 WatchSource:0}: Error finding container b240763b0dfb077085888d84c99e0ee977500dfa9e33c525c887ea7315cf8c23: Status 404 returned error can't find the container with id b240763b0dfb077085888d84c99e0ee977500dfa9e33c525c887ea7315cf8c23 Jun 03 01:08:29.492318 ip-10-0-138-55 kubenswrapper[2566]: I0603 01:08:29.492269 2566 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-8675875d6d-k5ff2" event={"ID":"319e7e9c-d51a-478e-b59f-f0fc4346db1f","Type":"ContainerStarted","Data":"87421fec65690d94769bb28da4d05e689e3cf8ef47af205f55e6eda5d66dbbd4"} Jun 03 01:08:29.492318 ip-10-0-138-55 kubenswrapper[2566]: I0603 01:08:29.492320 2566 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-8675875d6d-k5ff2" event={"ID":"319e7e9c-d51a-478e-b59f-f0fc4346db1f","Type":"ContainerStarted","Data":"b240763b0dfb077085888d84c99e0ee977500dfa9e33c525c887ea7315cf8c23"} Jun 03 01:08:29.509325 ip-10-0-138-55 kubenswrapper[2566]: I0603 01:08:29.509282 2566 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-console/console-8675875d6d-k5ff2" podStartSLOduration=1.509269789 podStartE2EDuration="1.509269789s" podCreationTimestamp="2026-06-03 01:08:28 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2026-06-03 01:08:29.507038887 +0000 UTC m=+232.653880832" watchObservedRunningTime="2026-06-03 01:08:29.509269789 +0000 UTC m=+232.656111734" Jun 03 01:08:38.471882 ip-10-0-138-55 kubenswrapper[2566]: I0603 01:08:38.471841 2566 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-console/console-8675875d6d-k5ff2" Jun 03 01:08:38.471882 ip-10-0-138-55 kubenswrapper[2566]: I0603 01:08:38.471888 2566 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/console-8675875d6d-k5ff2" Jun 03 01:08:38.477742 ip-10-0-138-55 kubenswrapper[2566]: I0603 01:08:38.477717 2566 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-console/console-8675875d6d-k5ff2" Jun 03 01:08:38.526268 ip-10-0-138-55 kubenswrapper[2566]: I0603 01:08:38.526221 2566 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console/console-8675875d6d-k5ff2" Jun 03 01:08:38.572589 ip-10-0-138-55 kubenswrapper[2566]: I0603 01:08:38.572553 2566 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openshift-console/console-75dcf85d9d-fvd4k"] Jun 03 01:08:38.637876 ip-10-0-138-55 kubenswrapper[2566]: I0603 01:08:38.637837 2566 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-console/console-79448cc8b6-94mc5"] Jun 03 01:08:38.643358 ip-10-0-138-55 kubenswrapper[2566]: I0603 01:08:38.643324 2566 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-79448cc8b6-94mc5" Jun 03 01:08:38.650960 ip-10-0-138-55 kubenswrapper[2566]: I0603 01:08:38.650933 2566 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-79448cc8b6-94mc5"] Jun 03 01:08:38.817438 ip-10-0-138-55 kubenswrapper[2566]: I0603 01:08:38.817353 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/f472186e-7a5c-492f-a8de-8a890653b3db-console-serving-cert\") pod \"console-79448cc8b6-94mc5\" (UID: \"f472186e-7a5c-492f-a8de-8a890653b3db\") " pod="openshift-console/console-79448cc8b6-94mc5" Jun 03 01:08:38.817438 ip-10-0-138-55 kubenswrapper[2566]: I0603 01:08:38.817401 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/f472186e-7a5c-492f-a8de-8a890653b3db-oauth-serving-cert\") pod \"console-79448cc8b6-94mc5\" (UID: \"f472186e-7a5c-492f-a8de-8a890653b3db\") " pod="openshift-console/console-79448cc8b6-94mc5" Jun 03 01:08:38.817618 ip-10-0-138-55 kubenswrapper[2566]: I0603 01:08:38.817521 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/f472186e-7a5c-492f-a8de-8a890653b3db-console-oauth-config\") pod \"console-79448cc8b6-94mc5\" (UID: \"f472186e-7a5c-492f-a8de-8a890653b3db\") " pod="openshift-console/console-79448cc8b6-94mc5" Jun 03 01:08:38.817618 ip-10-0-138-55 kubenswrapper[2566]: I0603 01:08:38.817555 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/f472186e-7a5c-492f-a8de-8a890653b3db-trusted-ca-bundle\") pod \"console-79448cc8b6-94mc5\" (UID: \"f472186e-7a5c-492f-a8de-8a890653b3db\") " pod="openshift-console/console-79448cc8b6-94mc5" Jun 03 01:08:38.817683 ip-10-0-138-55 kubenswrapper[2566]: I0603 01:08:38.817621 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/f472186e-7a5c-492f-a8de-8a890653b3db-service-ca\") pod \"console-79448cc8b6-94mc5\" (UID: \"f472186e-7a5c-492f-a8de-8a890653b3db\") " pod="openshift-console/console-79448cc8b6-94mc5" Jun 03 01:08:38.817683 ip-10-0-138-55 kubenswrapper[2566]: I0603 01:08:38.817656 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-hvmcq\" (UniqueName: \"kubernetes.io/projected/f472186e-7a5c-492f-a8de-8a890653b3db-kube-api-access-hvmcq\") pod \"console-79448cc8b6-94mc5\" (UID: \"f472186e-7a5c-492f-a8de-8a890653b3db\") " pod="openshift-console/console-79448cc8b6-94mc5" Jun 03 01:08:38.817683 ip-10-0-138-55 kubenswrapper[2566]: I0603 01:08:38.817675 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/f472186e-7a5c-492f-a8de-8a890653b3db-console-config\") pod \"console-79448cc8b6-94mc5\" (UID: \"f472186e-7a5c-492f-a8de-8a890653b3db\") " pod="openshift-console/console-79448cc8b6-94mc5" Jun 03 01:08:38.918531 ip-10-0-138-55 kubenswrapper[2566]: I0603 01:08:38.918491 2566 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/f472186e-7a5c-492f-a8de-8a890653b3db-console-serving-cert\") pod \"console-79448cc8b6-94mc5\" (UID: \"f472186e-7a5c-492f-a8de-8a890653b3db\") " pod="openshift-console/console-79448cc8b6-94mc5" Jun 03 01:08:38.918701 ip-10-0-138-55 kubenswrapper[2566]: I0603 01:08:38.918544 2566 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/f472186e-7a5c-492f-a8de-8a890653b3db-oauth-serving-cert\") pod \"console-79448cc8b6-94mc5\" (UID: \"f472186e-7a5c-492f-a8de-8a890653b3db\") " pod="openshift-console/console-79448cc8b6-94mc5" Jun 03 01:08:38.918701 ip-10-0-138-55 kubenswrapper[2566]: I0603 01:08:38.918578 2566 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/f472186e-7a5c-492f-a8de-8a890653b3db-console-oauth-config\") pod \"console-79448cc8b6-94mc5\" (UID: \"f472186e-7a5c-492f-a8de-8a890653b3db\") " pod="openshift-console/console-79448cc8b6-94mc5" Jun 03 01:08:38.918701 ip-10-0-138-55 kubenswrapper[2566]: I0603 01:08:38.918598 2566 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/f472186e-7a5c-492f-a8de-8a890653b3db-trusted-ca-bundle\") pod \"console-79448cc8b6-94mc5\" (UID: \"f472186e-7a5c-492f-a8de-8a890653b3db\") " pod="openshift-console/console-79448cc8b6-94mc5" Jun 03 01:08:38.918701 ip-10-0-138-55 kubenswrapper[2566]: I0603 01:08:38.918632 2566 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/f472186e-7a5c-492f-a8de-8a890653b3db-service-ca\") pod \"console-79448cc8b6-94mc5\" (UID: \"f472186e-7a5c-492f-a8de-8a890653b3db\") " pod="openshift-console/console-79448cc8b6-94mc5" Jun 03 01:08:38.918701 ip-10-0-138-55 kubenswrapper[2566]: I0603 01:08:38.918666 2566 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-hvmcq\" (UniqueName: \"kubernetes.io/projected/f472186e-7a5c-492f-a8de-8a890653b3db-kube-api-access-hvmcq\") pod \"console-79448cc8b6-94mc5\" (UID: \"f472186e-7a5c-492f-a8de-8a890653b3db\") " pod="openshift-console/console-79448cc8b6-94mc5" Jun 03 01:08:38.918701 ip-10-0-138-55 kubenswrapper[2566]: I0603 01:08:38.918693 2566 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/f472186e-7a5c-492f-a8de-8a890653b3db-console-config\") pod \"console-79448cc8b6-94mc5\" (UID: \"f472186e-7a5c-492f-a8de-8a890653b3db\") " pod="openshift-console/console-79448cc8b6-94mc5" Jun 03 01:08:38.919428 ip-10-0-138-55 kubenswrapper[2566]: I0603 01:08:38.919402 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/f472186e-7a5c-492f-a8de-8a890653b3db-console-config\") pod \"console-79448cc8b6-94mc5\" (UID: \"f472186e-7a5c-492f-a8de-8a890653b3db\") " pod="openshift-console/console-79448cc8b6-94mc5" Jun 03 01:08:38.919555 ip-10-0-138-55 kubenswrapper[2566]: I0603 01:08:38.919448 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/f472186e-7a5c-492f-a8de-8a890653b3db-oauth-serving-cert\") pod \"console-79448cc8b6-94mc5\" (UID: \"f472186e-7a5c-492f-a8de-8a890653b3db\") " pod="openshift-console/console-79448cc8b6-94mc5" Jun 03 01:08:38.919601 ip-10-0-138-55 kubenswrapper[2566]: I0603 01:08:38.919553 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/f472186e-7a5c-492f-a8de-8a890653b3db-service-ca\") pod \"console-79448cc8b6-94mc5\" (UID: \"f472186e-7a5c-492f-a8de-8a890653b3db\") " pod="openshift-console/console-79448cc8b6-94mc5" Jun 03 01:08:38.919636 ip-10-0-138-55 kubenswrapper[2566]: I0603 01:08:38.919595 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/f472186e-7a5c-492f-a8de-8a890653b3db-trusted-ca-bundle\") pod \"console-79448cc8b6-94mc5\" (UID: \"f472186e-7a5c-492f-a8de-8a890653b3db\") " pod="openshift-console/console-79448cc8b6-94mc5" Jun 03 01:08:38.921103 ip-10-0-138-55 kubenswrapper[2566]: I0603 01:08:38.921072 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/f472186e-7a5c-492f-a8de-8a890653b3db-console-serving-cert\") pod \"console-79448cc8b6-94mc5\" (UID: \"f472186e-7a5c-492f-a8de-8a890653b3db\") " pod="openshift-console/console-79448cc8b6-94mc5" Jun 03 01:08:38.921196 ip-10-0-138-55 kubenswrapper[2566]: I0603 01:08:38.921135 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/f472186e-7a5c-492f-a8de-8a890653b3db-console-oauth-config\") pod \"console-79448cc8b6-94mc5\" (UID: \"f472186e-7a5c-492f-a8de-8a890653b3db\") " pod="openshift-console/console-79448cc8b6-94mc5" Jun 03 01:08:38.925876 ip-10-0-138-55 kubenswrapper[2566]: I0603 01:08:38.925853 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-hvmcq\" (UniqueName: \"kubernetes.io/projected/f472186e-7a5c-492f-a8de-8a890653b3db-kube-api-access-hvmcq\") pod \"console-79448cc8b6-94mc5\" (UID: \"f472186e-7a5c-492f-a8de-8a890653b3db\") " pod="openshift-console/console-79448cc8b6-94mc5" Jun 03 01:08:38.954850 ip-10-0-138-55 kubenswrapper[2566]: I0603 01:08:38.954830 2566 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-79448cc8b6-94mc5" Jun 03 01:08:39.076693 ip-10-0-138-55 kubenswrapper[2566]: I0603 01:08:39.076559 2566 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-79448cc8b6-94mc5"] Jun 03 01:08:39.079403 ip-10-0-138-55 kubenswrapper[2566]: W0603 01:08:39.079368 2566 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podf472186e_7a5c_492f_a8de_8a890653b3db.slice/crio-9046125ea71202a874043ebd39a6f539eb1f6d9c7fb1be26fd1ca65a8ef1ec88 WatchSource:0}: Error finding container 9046125ea71202a874043ebd39a6f539eb1f6d9c7fb1be26fd1ca65a8ef1ec88: Status 404 returned error can't find the container with id 9046125ea71202a874043ebd39a6f539eb1f6d9c7fb1be26fd1ca65a8ef1ec88 Jun 03 01:08:39.526035 ip-10-0-138-55 kubenswrapper[2566]: I0603 01:08:39.525985 2566 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-79448cc8b6-94mc5" event={"ID":"f472186e-7a5c-492f-a8de-8a890653b3db","Type":"ContainerStarted","Data":"eb54fd9b6c6947581b8936b79efdcc39f8c7f601a6986713ff8099078277d7d6"} Jun 03 01:08:39.526035 ip-10-0-138-55 kubenswrapper[2566]: I0603 01:08:39.526037 2566 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-79448cc8b6-94mc5" event={"ID":"f472186e-7a5c-492f-a8de-8a890653b3db","Type":"ContainerStarted","Data":"9046125ea71202a874043ebd39a6f539eb1f6d9c7fb1be26fd1ca65a8ef1ec88"} Jun 03 01:08:39.542411 ip-10-0-138-55 kubenswrapper[2566]: I0603 01:08:39.542368 2566 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-console/console-79448cc8b6-94mc5" podStartSLOduration=1.5423540180000002 podStartE2EDuration="1.542354018s" podCreationTimestamp="2026-06-03 01:08:38 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2026-06-03 01:08:39.540751126 +0000 UTC m=+242.687593071" watchObservedRunningTime="2026-06-03 01:08:39.542354018 +0000 UTC m=+242.689195964" Jun 03 01:08:48.955245 ip-10-0-138-55 kubenswrapper[2566]: I0603 01:08:48.955183 2566 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/console-79448cc8b6-94mc5" Jun 03 01:08:48.955628 ip-10-0-138-55 kubenswrapper[2566]: I0603 01:08:48.955273 2566 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-console/console-79448cc8b6-94mc5" Jun 03 01:08:48.959858 ip-10-0-138-55 kubenswrapper[2566]: I0603 01:08:48.959835 2566 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-console/console-79448cc8b6-94mc5" Jun 03 01:08:49.559654 ip-10-0-138-55 kubenswrapper[2566]: I0603 01:08:49.559628 2566 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console/console-79448cc8b6-94mc5" Jun 03 01:08:49.601886 ip-10-0-138-55 kubenswrapper[2566]: I0603 01:08:49.601852 2566 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openshift-console/console-8675875d6d-k5ff2"] Jun 03 01:09:03.598487 ip-10-0-138-55 kubenswrapper[2566]: I0603 01:09:03.598408 2566 kuberuntime_container.go:864] "Killing container with a grace period" pod="openshift-console/console-75dcf85d9d-fvd4k" podUID="48e0d444-7707-4a91-b9ae-e12ae15c6f86" containerName="console" containerID="cri-o://a21feaa5f018c879844980dc90fde7034ead8c115077ecd41fa399f49c56c87b" gracePeriod=15 Jun 03 01:09:03.839688 ip-10-0-138-55 kubenswrapper[2566]: I0603 01:09:03.839667 2566 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console_console-75dcf85d9d-fvd4k_48e0d444-7707-4a91-b9ae-e12ae15c6f86/console/0.log" Jun 03 01:09:03.839789 ip-10-0-138-55 kubenswrapper[2566]: I0603 01:09:03.839729 2566 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-75dcf85d9d-fvd4k" Jun 03 01:09:03.933409 ip-10-0-138-55 kubenswrapper[2566]: I0603 01:09:03.933329 2566 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/48e0d444-7707-4a91-b9ae-e12ae15c6f86-service-ca\") pod \"48e0d444-7707-4a91-b9ae-e12ae15c6f86\" (UID: \"48e0d444-7707-4a91-b9ae-e12ae15c6f86\") " Jun 03 01:09:03.933409 ip-10-0-138-55 kubenswrapper[2566]: I0603 01:09:03.933366 2566 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/48e0d444-7707-4a91-b9ae-e12ae15c6f86-oauth-serving-cert\") pod \"48e0d444-7707-4a91-b9ae-e12ae15c6f86\" (UID: \"48e0d444-7707-4a91-b9ae-e12ae15c6f86\") " Jun 03 01:09:03.933622 ip-10-0-138-55 kubenswrapper[2566]: I0603 01:09:03.933507 2566 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-pjt8r\" (UniqueName: \"kubernetes.io/projected/48e0d444-7707-4a91-b9ae-e12ae15c6f86-kube-api-access-pjt8r\") pod \"48e0d444-7707-4a91-b9ae-e12ae15c6f86\" (UID: \"48e0d444-7707-4a91-b9ae-e12ae15c6f86\") " Jun 03 01:09:03.933622 ip-10-0-138-55 kubenswrapper[2566]: I0603 01:09:03.933558 2566 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/48e0d444-7707-4a91-b9ae-e12ae15c6f86-console-serving-cert\") pod \"48e0d444-7707-4a91-b9ae-e12ae15c6f86\" (UID: \"48e0d444-7707-4a91-b9ae-e12ae15c6f86\") " Jun 03 01:09:03.933622 ip-10-0-138-55 kubenswrapper[2566]: I0603 01:09:03.933608 2566 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/48e0d444-7707-4a91-b9ae-e12ae15c6f86-console-oauth-config\") pod \"48e0d444-7707-4a91-b9ae-e12ae15c6f86\" (UID: \"48e0d444-7707-4a91-b9ae-e12ae15c6f86\") " Jun 03 01:09:03.933768 ip-10-0-138-55 kubenswrapper[2566]: I0603 01:09:03.933641 2566 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/48e0d444-7707-4a91-b9ae-e12ae15c6f86-trusted-ca-bundle\") pod \"48e0d444-7707-4a91-b9ae-e12ae15c6f86\" (UID: \"48e0d444-7707-4a91-b9ae-e12ae15c6f86\") " Jun 03 01:09:03.933768 ip-10-0-138-55 kubenswrapper[2566]: I0603 01:09:03.933677 2566 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/48e0d444-7707-4a91-b9ae-e12ae15c6f86-console-config\") pod \"48e0d444-7707-4a91-b9ae-e12ae15c6f86\" (UID: \"48e0d444-7707-4a91-b9ae-e12ae15c6f86\") " Jun 03 01:09:03.933768 ip-10-0-138-55 kubenswrapper[2566]: I0603 01:09:03.933734 2566 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/48e0d444-7707-4a91-b9ae-e12ae15c6f86-service-ca" (OuterVolumeSpecName: "service-ca") pod "48e0d444-7707-4a91-b9ae-e12ae15c6f86" (UID: "48e0d444-7707-4a91-b9ae-e12ae15c6f86"). InnerVolumeSpecName "service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jun 03 01:09:03.933768 ip-10-0-138-55 kubenswrapper[2566]: I0603 01:09:03.933742 2566 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/48e0d444-7707-4a91-b9ae-e12ae15c6f86-oauth-serving-cert" (OuterVolumeSpecName: "oauth-serving-cert") pod "48e0d444-7707-4a91-b9ae-e12ae15c6f86" (UID: "48e0d444-7707-4a91-b9ae-e12ae15c6f86"). InnerVolumeSpecName "oauth-serving-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jun 03 01:09:03.934080 ip-10-0-138-55 kubenswrapper[2566]: I0603 01:09:03.934059 2566 reconciler_common.go:299] "Volume detached for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/48e0d444-7707-4a91-b9ae-e12ae15c6f86-service-ca\") on node \"ip-10-0-138-55.ec2.internal\" DevicePath \"\"" Jun 03 01:09:03.934148 ip-10-0-138-55 kubenswrapper[2566]: I0603 01:09:03.934087 2566 reconciler_common.go:299] "Volume detached for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/48e0d444-7707-4a91-b9ae-e12ae15c6f86-oauth-serving-cert\") on node \"ip-10-0-138-55.ec2.internal\" DevicePath \"\"" Jun 03 01:09:03.934148 ip-10-0-138-55 kubenswrapper[2566]: I0603 01:09:03.934113 2566 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/48e0d444-7707-4a91-b9ae-e12ae15c6f86-console-config" (OuterVolumeSpecName: "console-config") pod "48e0d444-7707-4a91-b9ae-e12ae15c6f86" (UID: "48e0d444-7707-4a91-b9ae-e12ae15c6f86"). InnerVolumeSpecName "console-config". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jun 03 01:09:03.934221 ip-10-0-138-55 kubenswrapper[2566]: I0603 01:09:03.934139 2566 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/48e0d444-7707-4a91-b9ae-e12ae15c6f86-trusted-ca-bundle" (OuterVolumeSpecName: "trusted-ca-bundle") pod "48e0d444-7707-4a91-b9ae-e12ae15c6f86" (UID: "48e0d444-7707-4a91-b9ae-e12ae15c6f86"). InnerVolumeSpecName "trusted-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jun 03 01:09:03.935822 ip-10-0-138-55 kubenswrapper[2566]: I0603 01:09:03.935798 2566 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/48e0d444-7707-4a91-b9ae-e12ae15c6f86-console-oauth-config" (OuterVolumeSpecName: "console-oauth-config") pod "48e0d444-7707-4a91-b9ae-e12ae15c6f86" (UID: "48e0d444-7707-4a91-b9ae-e12ae15c6f86"). InnerVolumeSpecName "console-oauth-config". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jun 03 01:09:03.936106 ip-10-0-138-55 kubenswrapper[2566]: I0603 01:09:03.936084 2566 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/48e0d444-7707-4a91-b9ae-e12ae15c6f86-console-serving-cert" (OuterVolumeSpecName: "console-serving-cert") pod "48e0d444-7707-4a91-b9ae-e12ae15c6f86" (UID: "48e0d444-7707-4a91-b9ae-e12ae15c6f86"). InnerVolumeSpecName "console-serving-cert". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jun 03 01:09:03.936164 ip-10-0-138-55 kubenswrapper[2566]: I0603 01:09:03.936089 2566 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/48e0d444-7707-4a91-b9ae-e12ae15c6f86-kube-api-access-pjt8r" (OuterVolumeSpecName: "kube-api-access-pjt8r") pod "48e0d444-7707-4a91-b9ae-e12ae15c6f86" (UID: "48e0d444-7707-4a91-b9ae-e12ae15c6f86"). InnerVolumeSpecName "kube-api-access-pjt8r". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 03 01:09:04.035476 ip-10-0-138-55 kubenswrapper[2566]: I0603 01:09:04.035434 2566 reconciler_common.go:299] "Volume detached for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/48e0d444-7707-4a91-b9ae-e12ae15c6f86-console-config\") on node \"ip-10-0-138-55.ec2.internal\" DevicePath \"\"" Jun 03 01:09:04.035476 ip-10-0-138-55 kubenswrapper[2566]: I0603 01:09:04.035472 2566 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-pjt8r\" (UniqueName: \"kubernetes.io/projected/48e0d444-7707-4a91-b9ae-e12ae15c6f86-kube-api-access-pjt8r\") on node \"ip-10-0-138-55.ec2.internal\" DevicePath \"\"" Jun 03 01:09:04.035476 ip-10-0-138-55 kubenswrapper[2566]: I0603 01:09:04.035483 2566 reconciler_common.go:299] "Volume detached for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/48e0d444-7707-4a91-b9ae-e12ae15c6f86-console-serving-cert\") on node \"ip-10-0-138-55.ec2.internal\" DevicePath \"\"" Jun 03 01:09:04.035476 ip-10-0-138-55 kubenswrapper[2566]: I0603 01:09:04.035493 2566 reconciler_common.go:299] "Volume detached for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/48e0d444-7707-4a91-b9ae-e12ae15c6f86-console-oauth-config\") on node \"ip-10-0-138-55.ec2.internal\" DevicePath \"\"" Jun 03 01:09:04.035716 ip-10-0-138-55 kubenswrapper[2566]: I0603 01:09:04.035502 2566 reconciler_common.go:299] "Volume detached for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/48e0d444-7707-4a91-b9ae-e12ae15c6f86-trusted-ca-bundle\") on node \"ip-10-0-138-55.ec2.internal\" DevicePath \"\"" Jun 03 01:09:04.208137 ip-10-0-138-55 kubenswrapper[2566]: I0603 01:09:04.208061 2566 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["kube-system/global-pull-secret-syncer-vrzz5"] Jun 03 01:09:04.208424 ip-10-0-138-55 kubenswrapper[2566]: I0603 01:09:04.208410 2566 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="48e0d444-7707-4a91-b9ae-e12ae15c6f86" containerName="console" Jun 03 01:09:04.208471 ip-10-0-138-55 kubenswrapper[2566]: I0603 01:09:04.208427 2566 state_mem.go:107] "Deleted CPUSet assignment" podUID="48e0d444-7707-4a91-b9ae-e12ae15c6f86" containerName="console" Jun 03 01:09:04.208505 ip-10-0-138-55 kubenswrapper[2566]: I0603 01:09:04.208496 2566 memory_manager.go:356] "RemoveStaleState removing state" podUID="48e0d444-7707-4a91-b9ae-e12ae15c6f86" containerName="console" Jun 03 01:09:04.213126 ip-10-0-138-55 kubenswrapper[2566]: I0603 01:09:04.213105 2566 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-vrzz5" Jun 03 01:09:04.214881 ip-10-0-138-55 kubenswrapper[2566]: I0603 01:09:04.214865 2566 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"original-pull-secret\"" Jun 03 01:09:04.219160 ip-10-0-138-55 kubenswrapper[2566]: I0603 01:09:04.219135 2566 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kube-system/global-pull-secret-syncer-vrzz5"] Jun 03 01:09:04.237988 ip-10-0-138-55 kubenswrapper[2566]: I0603 01:09:04.237964 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/c3a41da4-011b-42dd-ab88-3f4b5d601840-original-pull-secret\") pod \"global-pull-secret-syncer-vrzz5\" (UID: \"c3a41da4-011b-42dd-ab88-3f4b5d601840\") " pod="kube-system/global-pull-secret-syncer-vrzz5" Jun 03 01:09:04.238080 ip-10-0-138-55 kubenswrapper[2566]: I0603 01:09:04.237994 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/c3a41da4-011b-42dd-ab88-3f4b5d601840-dbus\") pod \"global-pull-secret-syncer-vrzz5\" (UID: \"c3a41da4-011b-42dd-ab88-3f4b5d601840\") " pod="kube-system/global-pull-secret-syncer-vrzz5" Jun 03 01:09:04.238080 ip-10-0-138-55 kubenswrapper[2566]: I0603 01:09:04.238024 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/c3a41da4-011b-42dd-ab88-3f4b5d601840-kubelet-config\") pod \"global-pull-secret-syncer-vrzz5\" (UID: \"c3a41da4-011b-42dd-ab88-3f4b5d601840\") " pod="kube-system/global-pull-secret-syncer-vrzz5" Jun 03 01:09:04.338798 ip-10-0-138-55 kubenswrapper[2566]: I0603 01:09:04.338769 2566 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/c3a41da4-011b-42dd-ab88-3f4b5d601840-original-pull-secret\") pod \"global-pull-secret-syncer-vrzz5\" (UID: \"c3a41da4-011b-42dd-ab88-3f4b5d601840\") " pod="kube-system/global-pull-secret-syncer-vrzz5" Jun 03 01:09:04.338798 ip-10-0-138-55 kubenswrapper[2566]: I0603 01:09:04.338804 2566 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/c3a41da4-011b-42dd-ab88-3f4b5d601840-dbus\") pod \"global-pull-secret-syncer-vrzz5\" (UID: \"c3a41da4-011b-42dd-ab88-3f4b5d601840\") " pod="kube-system/global-pull-secret-syncer-vrzz5" Jun 03 01:09:04.339003 ip-10-0-138-55 kubenswrapper[2566]: I0603 01:09:04.338835 2566 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/c3a41da4-011b-42dd-ab88-3f4b5d601840-kubelet-config\") pod \"global-pull-secret-syncer-vrzz5\" (UID: \"c3a41da4-011b-42dd-ab88-3f4b5d601840\") " pod="kube-system/global-pull-secret-syncer-vrzz5" Jun 03 01:09:04.339003 ip-10-0-138-55 kubenswrapper[2566]: I0603 01:09:04.338910 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/c3a41da4-011b-42dd-ab88-3f4b5d601840-kubelet-config\") pod \"global-pull-secret-syncer-vrzz5\" (UID: \"c3a41da4-011b-42dd-ab88-3f4b5d601840\") " pod="kube-system/global-pull-secret-syncer-vrzz5" Jun 03 01:09:04.339003 ip-10-0-138-55 kubenswrapper[2566]: I0603 01:09:04.338974 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/c3a41da4-011b-42dd-ab88-3f4b5d601840-dbus\") pod \"global-pull-secret-syncer-vrzz5\" (UID: \"c3a41da4-011b-42dd-ab88-3f4b5d601840\") " pod="kube-system/global-pull-secret-syncer-vrzz5" Jun 03 01:09:04.341082 ip-10-0-138-55 kubenswrapper[2566]: I0603 01:09:04.341058 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/c3a41da4-011b-42dd-ab88-3f4b5d601840-original-pull-secret\") pod \"global-pull-secret-syncer-vrzz5\" (UID: \"c3a41da4-011b-42dd-ab88-3f4b5d601840\") " pod="kube-system/global-pull-secret-syncer-vrzz5" Jun 03 01:09:04.523081 ip-10-0-138-55 kubenswrapper[2566]: I0603 01:09:04.522997 2566 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-vrzz5" Jun 03 01:09:04.598183 ip-10-0-138-55 kubenswrapper[2566]: I0603 01:09:04.598157 2566 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console_console-75dcf85d9d-fvd4k_48e0d444-7707-4a91-b9ae-e12ae15c6f86/console/0.log" Jun 03 01:09:04.598354 ip-10-0-138-55 kubenswrapper[2566]: I0603 01:09:04.598202 2566 generic.go:358] "Generic (PLEG): container finished" podID="48e0d444-7707-4a91-b9ae-e12ae15c6f86" containerID="a21feaa5f018c879844980dc90fde7034ead8c115077ecd41fa399f49c56c87b" exitCode=2 Jun 03 01:09:04.598354 ip-10-0-138-55 kubenswrapper[2566]: I0603 01:09:04.598285 2566 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-75dcf85d9d-fvd4k" Jun 03 01:09:04.598443 ip-10-0-138-55 kubenswrapper[2566]: I0603 01:09:04.598284 2566 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-75dcf85d9d-fvd4k" event={"ID":"48e0d444-7707-4a91-b9ae-e12ae15c6f86","Type":"ContainerDied","Data":"a21feaa5f018c879844980dc90fde7034ead8c115077ecd41fa399f49c56c87b"} Jun 03 01:09:04.598443 ip-10-0-138-55 kubenswrapper[2566]: I0603 01:09:04.598386 2566 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-75dcf85d9d-fvd4k" event={"ID":"48e0d444-7707-4a91-b9ae-e12ae15c6f86","Type":"ContainerDied","Data":"33d9e493c9cfad77602bcdd624d5a4511205a63bb2da55da535b7f9781cabb35"} Jun 03 01:09:04.598443 ip-10-0-138-55 kubenswrapper[2566]: I0603 01:09:04.598401 2566 scope.go:117] "RemoveContainer" containerID="a21feaa5f018c879844980dc90fde7034ead8c115077ecd41fa399f49c56c87b" Jun 03 01:09:04.608795 ip-10-0-138-55 kubenswrapper[2566]: I0603 01:09:04.608776 2566 scope.go:117] "RemoveContainer" containerID="a21feaa5f018c879844980dc90fde7034ead8c115077ecd41fa399f49c56c87b" Jun 03 01:09:04.609101 ip-10-0-138-55 kubenswrapper[2566]: E0603 01:09:04.609082 2566 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"a21feaa5f018c879844980dc90fde7034ead8c115077ecd41fa399f49c56c87b\": container with ID starting with a21feaa5f018c879844980dc90fde7034ead8c115077ecd41fa399f49c56c87b not found: ID does not exist" containerID="a21feaa5f018c879844980dc90fde7034ead8c115077ecd41fa399f49c56c87b" Jun 03 01:09:04.609171 ip-10-0-138-55 kubenswrapper[2566]: I0603 01:09:04.609111 2566 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"a21feaa5f018c879844980dc90fde7034ead8c115077ecd41fa399f49c56c87b"} err="failed to get container status \"a21feaa5f018c879844980dc90fde7034ead8c115077ecd41fa399f49c56c87b\": rpc error: code = NotFound desc = could not find container \"a21feaa5f018c879844980dc90fde7034ead8c115077ecd41fa399f49c56c87b\": container with ID starting with a21feaa5f018c879844980dc90fde7034ead8c115077ecd41fa399f49c56c87b not found: ID does not exist" Jun 03 01:09:04.630434 ip-10-0-138-55 kubenswrapper[2566]: I0603 01:09:04.630408 2566 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openshift-console/console-75dcf85d9d-fvd4k"] Jun 03 01:09:04.633493 ip-10-0-138-55 kubenswrapper[2566]: I0603 01:09:04.633470 2566 kubelet.go:2547] "SyncLoop REMOVE" source="api" pods=["openshift-console/console-75dcf85d9d-fvd4k"] Jun 03 01:09:04.647643 ip-10-0-138-55 kubenswrapper[2566]: I0603 01:09:04.647616 2566 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kube-system/global-pull-secret-syncer-vrzz5"] Jun 03 01:09:04.650892 ip-10-0-138-55 kubenswrapper[2566]: W0603 01:09:04.650863 2566 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podc3a41da4_011b_42dd_ab88_3f4b5d601840.slice/crio-4f4d1f870d14819c15675d3789d27f2ef13866bb1e35b9f05046ffa9efcca870 WatchSource:0}: Error finding container 4f4d1f870d14819c15675d3789d27f2ef13866bb1e35b9f05046ffa9efcca870: Status 404 returned error can't find the container with id 4f4d1f870d14819c15675d3789d27f2ef13866bb1e35b9f05046ffa9efcca870 Jun 03 01:09:05.591148 ip-10-0-138-55 kubenswrapper[2566]: I0603 01:09:05.591109 2566 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="48e0d444-7707-4a91-b9ae-e12ae15c6f86" path="/var/lib/kubelet/pods/48e0d444-7707-4a91-b9ae-e12ae15c6f86/volumes" Jun 03 01:09:05.606565 ip-10-0-138-55 kubenswrapper[2566]: I0603 01:09:05.606533 2566 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kube-system/global-pull-secret-syncer-vrzz5" event={"ID":"c3a41da4-011b-42dd-ab88-3f4b5d601840","Type":"ContainerStarted","Data":"4f4d1f870d14819c15675d3789d27f2ef13866bb1e35b9f05046ffa9efcca870"} Jun 03 01:09:09.619940 ip-10-0-138-55 kubenswrapper[2566]: I0603 01:09:09.619888 2566 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kube-system/global-pull-secret-syncer-vrzz5" event={"ID":"c3a41da4-011b-42dd-ab88-3f4b5d601840","Type":"ContainerStarted","Data":"cd5bacf2ddc625965f365545a10ee5345525f07134e991dd9ec1d87ac12733c2"} Jun 03 01:09:09.633407 ip-10-0-138-55 kubenswrapper[2566]: I0603 01:09:09.633359 2566 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="kube-system/global-pull-secret-syncer-vrzz5" podStartSLOduration=1.602359195 podStartE2EDuration="5.633345199s" podCreationTimestamp="2026-06-03 01:09:04 +0000 UTC" firstStartedPulling="2026-06-03 01:09:04.652598743 +0000 UTC m=+267.799440673" lastFinishedPulling="2026-06-03 01:09:08.68358475 +0000 UTC m=+271.830426677" observedRunningTime="2026-06-03 01:09:09.632378219 +0000 UTC m=+272.779220180" watchObservedRunningTime="2026-06-03 01:09:09.633345199 +0000 UTC m=+272.780187145" Jun 03 01:09:14.626375 ip-10-0-138-55 kubenswrapper[2566]: I0603 01:09:14.626311 2566 kuberuntime_container.go:864] "Killing container with a grace period" pod="openshift-console/console-8675875d6d-k5ff2" podUID="319e7e9c-d51a-478e-b59f-f0fc4346db1f" containerName="console" containerID="cri-o://87421fec65690d94769bb28da4d05e689e3cf8ef47af205f55e6eda5d66dbbd4" gracePeriod=15 Jun 03 01:09:14.875707 ip-10-0-138-55 kubenswrapper[2566]: I0603 01:09:14.875686 2566 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console_console-8675875d6d-k5ff2_319e7e9c-d51a-478e-b59f-f0fc4346db1f/console/0.log" Jun 03 01:09:14.875824 ip-10-0-138-55 kubenswrapper[2566]: I0603 01:09:14.875744 2566 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-8675875d6d-k5ff2" Jun 03 01:09:14.931171 ip-10-0-138-55 kubenswrapper[2566]: I0603 01:09:14.931078 2566 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/319e7e9c-d51a-478e-b59f-f0fc4346db1f-trusted-ca-bundle\") pod \"319e7e9c-d51a-478e-b59f-f0fc4346db1f\" (UID: \"319e7e9c-d51a-478e-b59f-f0fc4346db1f\") " Jun 03 01:09:14.931171 ip-10-0-138-55 kubenswrapper[2566]: I0603 01:09:14.931128 2566 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/319e7e9c-d51a-478e-b59f-f0fc4346db1f-service-ca\") pod \"319e7e9c-d51a-478e-b59f-f0fc4346db1f\" (UID: \"319e7e9c-d51a-478e-b59f-f0fc4346db1f\") " Jun 03 01:09:14.931421 ip-10-0-138-55 kubenswrapper[2566]: I0603 01:09:14.931291 2566 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/319e7e9c-d51a-478e-b59f-f0fc4346db1f-console-serving-cert\") pod \"319e7e9c-d51a-478e-b59f-f0fc4346db1f\" (UID: \"319e7e9c-d51a-478e-b59f-f0fc4346db1f\") " Jun 03 01:09:14.931421 ip-10-0-138-55 kubenswrapper[2566]: I0603 01:09:14.931343 2566 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/319e7e9c-d51a-478e-b59f-f0fc4346db1f-console-oauth-config\") pod \"319e7e9c-d51a-478e-b59f-f0fc4346db1f\" (UID: \"319e7e9c-d51a-478e-b59f-f0fc4346db1f\") " Jun 03 01:09:14.931421 ip-10-0-138-55 kubenswrapper[2566]: I0603 01:09:14.931393 2566 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/319e7e9c-d51a-478e-b59f-f0fc4346db1f-console-config\") pod \"319e7e9c-d51a-478e-b59f-f0fc4346db1f\" (UID: \"319e7e9c-d51a-478e-b59f-f0fc4346db1f\") " Jun 03 01:09:14.931583 ip-10-0-138-55 kubenswrapper[2566]: I0603 01:09:14.931504 2566 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-dtl6m\" (UniqueName: \"kubernetes.io/projected/319e7e9c-d51a-478e-b59f-f0fc4346db1f-kube-api-access-dtl6m\") pod \"319e7e9c-d51a-478e-b59f-f0fc4346db1f\" (UID: \"319e7e9c-d51a-478e-b59f-f0fc4346db1f\") " Jun 03 01:09:14.931583 ip-10-0-138-55 kubenswrapper[2566]: I0603 01:09:14.931545 2566 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/319e7e9c-d51a-478e-b59f-f0fc4346db1f-oauth-serving-cert\") pod \"319e7e9c-d51a-478e-b59f-f0fc4346db1f\" (UID: \"319e7e9c-d51a-478e-b59f-f0fc4346db1f\") " Jun 03 01:09:14.931583 ip-10-0-138-55 kubenswrapper[2566]: I0603 01:09:14.931541 2566 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/319e7e9c-d51a-478e-b59f-f0fc4346db1f-service-ca" (OuterVolumeSpecName: "service-ca") pod "319e7e9c-d51a-478e-b59f-f0fc4346db1f" (UID: "319e7e9c-d51a-478e-b59f-f0fc4346db1f"). InnerVolumeSpecName "service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jun 03 01:09:14.931728 ip-10-0-138-55 kubenswrapper[2566]: I0603 01:09:14.931573 2566 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/319e7e9c-d51a-478e-b59f-f0fc4346db1f-trusted-ca-bundle" (OuterVolumeSpecName: "trusted-ca-bundle") pod "319e7e9c-d51a-478e-b59f-f0fc4346db1f" (UID: "319e7e9c-d51a-478e-b59f-f0fc4346db1f"). InnerVolumeSpecName "trusted-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jun 03 01:09:14.931827 ip-10-0-138-55 kubenswrapper[2566]: I0603 01:09:14.931803 2566 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/319e7e9c-d51a-478e-b59f-f0fc4346db1f-console-config" (OuterVolumeSpecName: "console-config") pod "319e7e9c-d51a-478e-b59f-f0fc4346db1f" (UID: "319e7e9c-d51a-478e-b59f-f0fc4346db1f"). InnerVolumeSpecName "console-config". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jun 03 01:09:14.931925 ip-10-0-138-55 kubenswrapper[2566]: I0603 01:09:14.931849 2566 reconciler_common.go:299] "Volume detached for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/319e7e9c-d51a-478e-b59f-f0fc4346db1f-trusted-ca-bundle\") on node \"ip-10-0-138-55.ec2.internal\" DevicePath \"\"" Jun 03 01:09:14.931976 ip-10-0-138-55 kubenswrapper[2566]: I0603 01:09:14.931940 2566 reconciler_common.go:299] "Volume detached for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/319e7e9c-d51a-478e-b59f-f0fc4346db1f-service-ca\") on node \"ip-10-0-138-55.ec2.internal\" DevicePath \"\"" Jun 03 01:09:14.932010 ip-10-0-138-55 kubenswrapper[2566]: I0603 01:09:14.931972 2566 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/319e7e9c-d51a-478e-b59f-f0fc4346db1f-oauth-serving-cert" (OuterVolumeSpecName: "oauth-serving-cert") pod "319e7e9c-d51a-478e-b59f-f0fc4346db1f" (UID: "319e7e9c-d51a-478e-b59f-f0fc4346db1f"). InnerVolumeSpecName "oauth-serving-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jun 03 01:09:14.933656 ip-10-0-138-55 kubenswrapper[2566]: I0603 01:09:14.933624 2566 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/319e7e9c-d51a-478e-b59f-f0fc4346db1f-kube-api-access-dtl6m" (OuterVolumeSpecName: "kube-api-access-dtl6m") pod "319e7e9c-d51a-478e-b59f-f0fc4346db1f" (UID: "319e7e9c-d51a-478e-b59f-f0fc4346db1f"). InnerVolumeSpecName "kube-api-access-dtl6m". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 03 01:09:14.933656 ip-10-0-138-55 kubenswrapper[2566]: I0603 01:09:14.933627 2566 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/319e7e9c-d51a-478e-b59f-f0fc4346db1f-console-serving-cert" (OuterVolumeSpecName: "console-serving-cert") pod "319e7e9c-d51a-478e-b59f-f0fc4346db1f" (UID: "319e7e9c-d51a-478e-b59f-f0fc4346db1f"). InnerVolumeSpecName "console-serving-cert". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jun 03 01:09:14.933802 ip-10-0-138-55 kubenswrapper[2566]: I0603 01:09:14.933701 2566 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/319e7e9c-d51a-478e-b59f-f0fc4346db1f-console-oauth-config" (OuterVolumeSpecName: "console-oauth-config") pod "319e7e9c-d51a-478e-b59f-f0fc4346db1f" (UID: "319e7e9c-d51a-478e-b59f-f0fc4346db1f"). InnerVolumeSpecName "console-oauth-config". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jun 03 01:09:15.032617 ip-10-0-138-55 kubenswrapper[2566]: I0603 01:09:15.032582 2566 reconciler_common.go:299] "Volume detached for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/319e7e9c-d51a-478e-b59f-f0fc4346db1f-console-serving-cert\") on node \"ip-10-0-138-55.ec2.internal\" DevicePath \"\"" Jun 03 01:09:15.032617 ip-10-0-138-55 kubenswrapper[2566]: I0603 01:09:15.032612 2566 reconciler_common.go:299] "Volume detached for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/319e7e9c-d51a-478e-b59f-f0fc4346db1f-console-oauth-config\") on node \"ip-10-0-138-55.ec2.internal\" DevicePath \"\"" Jun 03 01:09:15.032617 ip-10-0-138-55 kubenswrapper[2566]: I0603 01:09:15.032622 2566 reconciler_common.go:299] "Volume detached for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/319e7e9c-d51a-478e-b59f-f0fc4346db1f-console-config\") on node \"ip-10-0-138-55.ec2.internal\" DevicePath \"\"" Jun 03 01:09:15.032839 ip-10-0-138-55 kubenswrapper[2566]: I0603 01:09:15.032632 2566 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-dtl6m\" (UniqueName: \"kubernetes.io/projected/319e7e9c-d51a-478e-b59f-f0fc4346db1f-kube-api-access-dtl6m\") on node \"ip-10-0-138-55.ec2.internal\" DevicePath \"\"" Jun 03 01:09:15.032839 ip-10-0-138-55 kubenswrapper[2566]: I0603 01:09:15.032642 2566 reconciler_common.go:299] "Volume detached for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/319e7e9c-d51a-478e-b59f-f0fc4346db1f-oauth-serving-cert\") on node \"ip-10-0-138-55.ec2.internal\" DevicePath \"\"" Jun 03 01:09:15.638260 ip-10-0-138-55 kubenswrapper[2566]: I0603 01:09:15.638215 2566 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console_console-8675875d6d-k5ff2_319e7e9c-d51a-478e-b59f-f0fc4346db1f/console/0.log" Jun 03 01:09:15.638621 ip-10-0-138-55 kubenswrapper[2566]: I0603 01:09:15.638273 2566 generic.go:358] "Generic (PLEG): container finished" podID="319e7e9c-d51a-478e-b59f-f0fc4346db1f" containerID="87421fec65690d94769bb28da4d05e689e3cf8ef47af205f55e6eda5d66dbbd4" exitCode=2 Jun 03 01:09:15.638621 ip-10-0-138-55 kubenswrapper[2566]: I0603 01:09:15.638306 2566 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-8675875d6d-k5ff2" event={"ID":"319e7e9c-d51a-478e-b59f-f0fc4346db1f","Type":"ContainerDied","Data":"87421fec65690d94769bb28da4d05e689e3cf8ef47af205f55e6eda5d66dbbd4"} Jun 03 01:09:15.638621 ip-10-0-138-55 kubenswrapper[2566]: I0603 01:09:15.638335 2566 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-8675875d6d-k5ff2" event={"ID":"319e7e9c-d51a-478e-b59f-f0fc4346db1f","Type":"ContainerDied","Data":"b240763b0dfb077085888d84c99e0ee977500dfa9e33c525c887ea7315cf8c23"} Jun 03 01:09:15.638621 ip-10-0-138-55 kubenswrapper[2566]: I0603 01:09:15.638341 2566 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-8675875d6d-k5ff2" Jun 03 01:09:15.638621 ip-10-0-138-55 kubenswrapper[2566]: I0603 01:09:15.638354 2566 scope.go:117] "RemoveContainer" containerID="87421fec65690d94769bb28da4d05e689e3cf8ef47af205f55e6eda5d66dbbd4" Jun 03 01:09:15.646090 ip-10-0-138-55 kubenswrapper[2566]: I0603 01:09:15.646060 2566 scope.go:117] "RemoveContainer" containerID="87421fec65690d94769bb28da4d05e689e3cf8ef47af205f55e6eda5d66dbbd4" Jun 03 01:09:15.646343 ip-10-0-138-55 kubenswrapper[2566]: E0603 01:09:15.646318 2566 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"87421fec65690d94769bb28da4d05e689e3cf8ef47af205f55e6eda5d66dbbd4\": container with ID starting with 87421fec65690d94769bb28da4d05e689e3cf8ef47af205f55e6eda5d66dbbd4 not found: ID does not exist" containerID="87421fec65690d94769bb28da4d05e689e3cf8ef47af205f55e6eda5d66dbbd4" Jun 03 01:09:15.646418 ip-10-0-138-55 kubenswrapper[2566]: I0603 01:09:15.646354 2566 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"87421fec65690d94769bb28da4d05e689e3cf8ef47af205f55e6eda5d66dbbd4"} err="failed to get container status \"87421fec65690d94769bb28da4d05e689e3cf8ef47af205f55e6eda5d66dbbd4\": rpc error: code = NotFound desc = could not find container \"87421fec65690d94769bb28da4d05e689e3cf8ef47af205f55e6eda5d66dbbd4\": container with ID starting with 87421fec65690d94769bb28da4d05e689e3cf8ef47af205f55e6eda5d66dbbd4 not found: ID does not exist" Jun 03 01:09:15.658000 ip-10-0-138-55 kubenswrapper[2566]: I0603 01:09:15.657977 2566 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openshift-console/console-8675875d6d-k5ff2"] Jun 03 01:09:15.664392 ip-10-0-138-55 kubenswrapper[2566]: I0603 01:09:15.664371 2566 kubelet.go:2547] "SyncLoop REMOVE" source="api" pods=["openshift-console/console-8675875d6d-k5ff2"] Jun 03 01:09:16.096656 ip-10-0-138-55 kubenswrapper[2566]: I0603 01:09:16.096622 2566 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-marketplace/2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19d64b9q"] Jun 03 01:09:16.097020 ip-10-0-138-55 kubenswrapper[2566]: I0603 01:09:16.097002 2566 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="319e7e9c-d51a-478e-b59f-f0fc4346db1f" containerName="console" Jun 03 01:09:16.097128 ip-10-0-138-55 kubenswrapper[2566]: I0603 01:09:16.097023 2566 state_mem.go:107] "Deleted CPUSet assignment" podUID="319e7e9c-d51a-478e-b59f-f0fc4346db1f" containerName="console" Jun 03 01:09:16.097198 ip-10-0-138-55 kubenswrapper[2566]: I0603 01:09:16.097145 2566 memory_manager.go:356] "RemoveStaleState removing state" podUID="319e7e9c-d51a-478e-b59f-f0fc4346db1f" containerName="console" Jun 03 01:09:16.101601 ip-10-0-138-55 kubenswrapper[2566]: I0603 01:09:16.101580 2566 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19d64b9q" Jun 03 01:09:16.103561 ip-10-0-138-55 kubenswrapper[2566]: I0603 01:09:16.103540 2566 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"kube-root-ca.crt\"" Jun 03 01:09:16.103662 ip-10-0-138-55 kubenswrapper[2566]: I0603 01:09:16.103569 2566 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"openshift-service-ca.crt\"" Jun 03 01:09:16.103662 ip-10-0-138-55 kubenswrapper[2566]: I0603 01:09:16.103600 2566 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-marketplace\"/\"default-dockercfg-xfvxj\"" Jun 03 01:09:16.106846 ip-10-0-138-55 kubenswrapper[2566]: I0603 01:09:16.106814 2566 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19d64b9q"] Jun 03 01:09:16.242455 ip-10-0-138-55 kubenswrapper[2566]: I0603 01:09:16.242418 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/7977c207-38b3-4da2-b6a0-669be440b563-bundle\") pod \"2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19d64b9q\" (UID: \"7977c207-38b3-4da2-b6a0-669be440b563\") " pod="openshift-marketplace/2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19d64b9q" Jun 03 01:09:16.242626 ip-10-0-138-55 kubenswrapper[2566]: I0603 01:09:16.242476 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/7977c207-38b3-4da2-b6a0-669be440b563-util\") pod \"2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19d64b9q\" (UID: \"7977c207-38b3-4da2-b6a0-669be440b563\") " pod="openshift-marketplace/2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19d64b9q" Jun 03 01:09:16.242626 ip-10-0-138-55 kubenswrapper[2566]: I0603 01:09:16.242523 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-b7gnv\" (UniqueName: \"kubernetes.io/projected/7977c207-38b3-4da2-b6a0-669be440b563-kube-api-access-b7gnv\") pod \"2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19d64b9q\" (UID: \"7977c207-38b3-4da2-b6a0-669be440b563\") " pod="openshift-marketplace/2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19d64b9q" Jun 03 01:09:16.343000 ip-10-0-138-55 kubenswrapper[2566]: I0603 01:09:16.342953 2566 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/7977c207-38b3-4da2-b6a0-669be440b563-util\") pod \"2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19d64b9q\" (UID: \"7977c207-38b3-4da2-b6a0-669be440b563\") " pod="openshift-marketplace/2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19d64b9q" Jun 03 01:09:16.343000 ip-10-0-138-55 kubenswrapper[2566]: I0603 01:09:16.343005 2566 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-b7gnv\" (UniqueName: \"kubernetes.io/projected/7977c207-38b3-4da2-b6a0-669be440b563-kube-api-access-b7gnv\") pod \"2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19d64b9q\" (UID: \"7977c207-38b3-4da2-b6a0-669be440b563\") " pod="openshift-marketplace/2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19d64b9q" Jun 03 01:09:16.343199 ip-10-0-138-55 kubenswrapper[2566]: I0603 01:09:16.343083 2566 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/7977c207-38b3-4da2-b6a0-669be440b563-bundle\") pod \"2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19d64b9q\" (UID: \"7977c207-38b3-4da2-b6a0-669be440b563\") " pod="openshift-marketplace/2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19d64b9q" Jun 03 01:09:16.343385 ip-10-0-138-55 kubenswrapper[2566]: I0603 01:09:16.343365 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/7977c207-38b3-4da2-b6a0-669be440b563-util\") pod \"2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19d64b9q\" (UID: \"7977c207-38b3-4da2-b6a0-669be440b563\") " pod="openshift-marketplace/2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19d64b9q" Jun 03 01:09:16.343434 ip-10-0-138-55 kubenswrapper[2566]: I0603 01:09:16.343407 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/7977c207-38b3-4da2-b6a0-669be440b563-bundle\") pod \"2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19d64b9q\" (UID: \"7977c207-38b3-4da2-b6a0-669be440b563\") " pod="openshift-marketplace/2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19d64b9q" Jun 03 01:09:16.350766 ip-10-0-138-55 kubenswrapper[2566]: I0603 01:09:16.350706 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-b7gnv\" (UniqueName: \"kubernetes.io/projected/7977c207-38b3-4da2-b6a0-669be440b563-kube-api-access-b7gnv\") pod \"2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19d64b9q\" (UID: \"7977c207-38b3-4da2-b6a0-669be440b563\") " pod="openshift-marketplace/2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19d64b9q" Jun 03 01:09:16.411743 ip-10-0-138-55 kubenswrapper[2566]: I0603 01:09:16.411721 2566 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19d64b9q" Jun 03 01:09:16.529643 ip-10-0-138-55 kubenswrapper[2566]: I0603 01:09:16.529533 2566 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19d64b9q"] Jun 03 01:09:16.532752 ip-10-0-138-55 kubenswrapper[2566]: W0603 01:09:16.532726 2566 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod7977c207_38b3_4da2_b6a0_669be440b563.slice/crio-a20831187a3da1a9d40fbad215415014178bace974223613b8405b9db9f8d85e WatchSource:0}: Error finding container a20831187a3da1a9d40fbad215415014178bace974223613b8405b9db9f8d85e: Status 404 returned error can't find the container with id a20831187a3da1a9d40fbad215415014178bace974223613b8405b9db9f8d85e Jun 03 01:09:16.644349 ip-10-0-138-55 kubenswrapper[2566]: I0603 01:09:16.644265 2566 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19d64b9q" event={"ID":"7977c207-38b3-4da2-b6a0-669be440b563","Type":"ContainerStarted","Data":"a20831187a3da1a9d40fbad215415014178bace974223613b8405b9db9f8d85e"} Jun 03 01:09:17.596702 ip-10-0-138-55 kubenswrapper[2566]: I0603 01:09:17.596658 2566 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="319e7e9c-d51a-478e-b59f-f0fc4346db1f" path="/var/lib/kubelet/pods/319e7e9c-d51a-478e-b59f-f0fc4346db1f/volumes" Jun 03 01:09:25.674272 ip-10-0-138-55 kubenswrapper[2566]: I0603 01:09:25.674218 2566 generic.go:358] "Generic (PLEG): container finished" podID="7977c207-38b3-4da2-b6a0-669be440b563" containerID="dfc8cb755cd7e101a3738afdb0541dc131716396baa67b8102bd1e6edcd33205" exitCode=0 Jun 03 01:09:25.674623 ip-10-0-138-55 kubenswrapper[2566]: I0603 01:09:25.674314 2566 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19d64b9q" event={"ID":"7977c207-38b3-4da2-b6a0-669be440b563","Type":"ContainerDied","Data":"dfc8cb755cd7e101a3738afdb0541dc131716396baa67b8102bd1e6edcd33205"} Jun 03 01:09:28.685068 ip-10-0-138-55 kubenswrapper[2566]: I0603 01:09:28.685028 2566 generic.go:358] "Generic (PLEG): container finished" podID="7977c207-38b3-4da2-b6a0-669be440b563" containerID="6010051339a7ebb9a354fd23961578d443cd109c62cac45fcba04ebf7f257ad8" exitCode=0 Jun 03 01:09:28.685434 ip-10-0-138-55 kubenswrapper[2566]: I0603 01:09:28.685114 2566 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19d64b9q" event={"ID":"7977c207-38b3-4da2-b6a0-669be440b563","Type":"ContainerDied","Data":"6010051339a7ebb9a354fd23961578d443cd109c62cac45fcba04ebf7f257ad8"} Jun 03 01:09:37.634762 ip-10-0-138-55 kubenswrapper[2566]: I0603 01:09:37.601601 2566 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-86d7c6cc77-8nd2x_5776439a-7cdc-49da-a5f6-325eb0c8ab99/console-operator/1.log" Jun 03 01:09:37.634762 ip-10-0-138-55 kubenswrapper[2566]: I0603 01:09:37.601776 2566 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-86d7c6cc77-8nd2x_5776439a-7cdc-49da-a5f6-325eb0c8ab99/console-operator/1.log" Jun 03 01:09:37.634762 ip-10-0-138-55 kubenswrapper[2566]: I0603 01:09:37.610816 2566 kubelet.go:1628] "Image garbage collection succeeded" Jun 03 01:09:38.719733 ip-10-0-138-55 kubenswrapper[2566]: I0603 01:09:38.719691 2566 generic.go:358] "Generic (PLEG): container finished" podID="7977c207-38b3-4da2-b6a0-669be440b563" containerID="f16fe21bd5859f4b53b458f6542d58365a13dc905ddb0b5276f8aa980406a01c" exitCode=0 Jun 03 01:09:38.720188 ip-10-0-138-55 kubenswrapper[2566]: I0603 01:09:38.719775 2566 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19d64b9q" event={"ID":"7977c207-38b3-4da2-b6a0-669be440b563","Type":"ContainerDied","Data":"f16fe21bd5859f4b53b458f6542d58365a13dc905ddb0b5276f8aa980406a01c"} Jun 03 01:09:39.846358 ip-10-0-138-55 kubenswrapper[2566]: I0603 01:09:39.846331 2566 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19d64b9q" Jun 03 01:09:39.857144 ip-10-0-138-55 kubenswrapper[2566]: I0603 01:09:39.857120 2566 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/7977c207-38b3-4da2-b6a0-669be440b563-util\") pod \"7977c207-38b3-4da2-b6a0-669be440b563\" (UID: \"7977c207-38b3-4da2-b6a0-669be440b563\") " Jun 03 01:09:39.857283 ip-10-0-138-55 kubenswrapper[2566]: I0603 01:09:39.857165 2566 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-b7gnv\" (UniqueName: \"kubernetes.io/projected/7977c207-38b3-4da2-b6a0-669be440b563-kube-api-access-b7gnv\") pod \"7977c207-38b3-4da2-b6a0-669be440b563\" (UID: \"7977c207-38b3-4da2-b6a0-669be440b563\") " Jun 03 01:09:39.857283 ip-10-0-138-55 kubenswrapper[2566]: I0603 01:09:39.857211 2566 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/7977c207-38b3-4da2-b6a0-669be440b563-bundle\") pod \"7977c207-38b3-4da2-b6a0-669be440b563\" (UID: \"7977c207-38b3-4da2-b6a0-669be440b563\") " Jun 03 01:09:39.857917 ip-10-0-138-55 kubenswrapper[2566]: I0603 01:09:39.857892 2566 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/7977c207-38b3-4da2-b6a0-669be440b563-bundle" (OuterVolumeSpecName: "bundle") pod "7977c207-38b3-4da2-b6a0-669be440b563" (UID: "7977c207-38b3-4da2-b6a0-669be440b563"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jun 03 01:09:39.859357 ip-10-0-138-55 kubenswrapper[2566]: I0603 01:09:39.859329 2566 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/7977c207-38b3-4da2-b6a0-669be440b563-kube-api-access-b7gnv" (OuterVolumeSpecName: "kube-api-access-b7gnv") pod "7977c207-38b3-4da2-b6a0-669be440b563" (UID: "7977c207-38b3-4da2-b6a0-669be440b563"). InnerVolumeSpecName "kube-api-access-b7gnv". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 03 01:09:39.862325 ip-10-0-138-55 kubenswrapper[2566]: I0603 01:09:39.862299 2566 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/7977c207-38b3-4da2-b6a0-669be440b563-util" (OuterVolumeSpecName: "util") pod "7977c207-38b3-4da2-b6a0-669be440b563" (UID: "7977c207-38b3-4da2-b6a0-669be440b563"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jun 03 01:09:39.958464 ip-10-0-138-55 kubenswrapper[2566]: I0603 01:09:39.958426 2566 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/7977c207-38b3-4da2-b6a0-669be440b563-util\") on node \"ip-10-0-138-55.ec2.internal\" DevicePath \"\"" Jun 03 01:09:39.958464 ip-10-0-138-55 kubenswrapper[2566]: I0603 01:09:39.958458 2566 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-b7gnv\" (UniqueName: \"kubernetes.io/projected/7977c207-38b3-4da2-b6a0-669be440b563-kube-api-access-b7gnv\") on node \"ip-10-0-138-55.ec2.internal\" DevicePath \"\"" Jun 03 01:09:39.958464 ip-10-0-138-55 kubenswrapper[2566]: I0603 01:09:39.958469 2566 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/7977c207-38b3-4da2-b6a0-669be440b563-bundle\") on node \"ip-10-0-138-55.ec2.internal\" DevicePath \"\"" Jun 03 01:09:40.729244 ip-10-0-138-55 kubenswrapper[2566]: I0603 01:09:40.729198 2566 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19d64b9q" Jun 03 01:09:40.729244 ip-10-0-138-55 kubenswrapper[2566]: I0603 01:09:40.729206 2566 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19d64b9q" event={"ID":"7977c207-38b3-4da2-b6a0-669be440b563","Type":"ContainerDied","Data":"a20831187a3da1a9d40fbad215415014178bace974223613b8405b9db9f8d85e"} Jun 03 01:09:40.729447 ip-10-0-138-55 kubenswrapper[2566]: I0603 01:09:40.729260 2566 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="a20831187a3da1a9d40fbad215415014178bace974223613b8405b9db9f8d85e" Jun 03 01:09:44.033587 ip-10-0-138-55 kubenswrapper[2566]: I0603 01:09:44.033553 2566 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["cert-manager-operator/cert-manager-operator-controller-manager-54b9655956-jlk46"] Jun 03 01:09:44.033968 ip-10-0-138-55 kubenswrapper[2566]: I0603 01:09:44.033862 2566 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="7977c207-38b3-4da2-b6a0-669be440b563" containerName="util" Jun 03 01:09:44.033968 ip-10-0-138-55 kubenswrapper[2566]: I0603 01:09:44.033872 2566 state_mem.go:107] "Deleted CPUSet assignment" podUID="7977c207-38b3-4da2-b6a0-669be440b563" containerName="util" Jun 03 01:09:44.033968 ip-10-0-138-55 kubenswrapper[2566]: I0603 01:09:44.033885 2566 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="7977c207-38b3-4da2-b6a0-669be440b563" containerName="pull" Jun 03 01:09:44.033968 ip-10-0-138-55 kubenswrapper[2566]: I0603 01:09:44.033891 2566 state_mem.go:107] "Deleted CPUSet assignment" podUID="7977c207-38b3-4da2-b6a0-669be440b563" containerName="pull" Jun 03 01:09:44.033968 ip-10-0-138-55 kubenswrapper[2566]: I0603 01:09:44.033918 2566 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="7977c207-38b3-4da2-b6a0-669be440b563" containerName="extract" Jun 03 01:09:44.033968 ip-10-0-138-55 kubenswrapper[2566]: I0603 01:09:44.033928 2566 state_mem.go:107] "Deleted CPUSet assignment" podUID="7977c207-38b3-4da2-b6a0-669be440b563" containerName="extract" Jun 03 01:09:44.034153 ip-10-0-138-55 kubenswrapper[2566]: I0603 01:09:44.033986 2566 memory_manager.go:356] "RemoveStaleState removing state" podUID="7977c207-38b3-4da2-b6a0-669be440b563" containerName="extract" Jun 03 01:09:44.036524 ip-10-0-138-55 kubenswrapper[2566]: I0603 01:09:44.036507 2566 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager-operator/cert-manager-operator-controller-manager-54b9655956-jlk46" Jun 03 01:09:44.038323 ip-10-0-138-55 kubenswrapper[2566]: I0603 01:09:44.038299 2566 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"cert-manager-operator\"/\"openshift-service-ca.crt\"" Jun 03 01:09:44.038323 ip-10-0-138-55 kubenswrapper[2566]: I0603 01:09:44.038315 2566 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"cert-manager-operator\"/\"cert-manager-operator-controller-manager-dockercfg-bp78k\"" Jun 03 01:09:44.038507 ip-10-0-138-55 kubenswrapper[2566]: I0603 01:09:44.038367 2566 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"cert-manager-operator\"/\"kube-root-ca.crt\"" Jun 03 01:09:44.045544 ip-10-0-138-55 kubenswrapper[2566]: I0603 01:09:44.045519 2566 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["cert-manager-operator/cert-manager-operator-controller-manager-54b9655956-jlk46"] Jun 03 01:09:44.097888 ip-10-0-138-55 kubenswrapper[2566]: I0603 01:09:44.097854 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/7c3f9a0b-9c69-4f90-add0-1517a360eb86-tmp\") pod \"cert-manager-operator-controller-manager-54b9655956-jlk46\" (UID: \"7c3f9a0b-9c69-4f90-add0-1517a360eb86\") " pod="cert-manager-operator/cert-manager-operator-controller-manager-54b9655956-jlk46" Jun 03 01:09:44.098039 ip-10-0-138-55 kubenswrapper[2566]: I0603 01:09:44.097908 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-6pkwx\" (UniqueName: \"kubernetes.io/projected/7c3f9a0b-9c69-4f90-add0-1517a360eb86-kube-api-access-6pkwx\") pod \"cert-manager-operator-controller-manager-54b9655956-jlk46\" (UID: \"7c3f9a0b-9c69-4f90-add0-1517a360eb86\") " pod="cert-manager-operator/cert-manager-operator-controller-manager-54b9655956-jlk46" Jun 03 01:09:44.198962 ip-10-0-138-55 kubenswrapper[2566]: I0603 01:09:44.198929 2566 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/7c3f9a0b-9c69-4f90-add0-1517a360eb86-tmp\") pod \"cert-manager-operator-controller-manager-54b9655956-jlk46\" (UID: \"7c3f9a0b-9c69-4f90-add0-1517a360eb86\") " pod="cert-manager-operator/cert-manager-operator-controller-manager-54b9655956-jlk46" Jun 03 01:09:44.199147 ip-10-0-138-55 kubenswrapper[2566]: I0603 01:09:44.198988 2566 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-6pkwx\" (UniqueName: \"kubernetes.io/projected/7c3f9a0b-9c69-4f90-add0-1517a360eb86-kube-api-access-6pkwx\") pod \"cert-manager-operator-controller-manager-54b9655956-jlk46\" (UID: \"7c3f9a0b-9c69-4f90-add0-1517a360eb86\") " pod="cert-manager-operator/cert-manager-operator-controller-manager-54b9655956-jlk46" Jun 03 01:09:44.199409 ip-10-0-138-55 kubenswrapper[2566]: I0603 01:09:44.199385 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/7c3f9a0b-9c69-4f90-add0-1517a360eb86-tmp\") pod \"cert-manager-operator-controller-manager-54b9655956-jlk46\" (UID: \"7c3f9a0b-9c69-4f90-add0-1517a360eb86\") " pod="cert-manager-operator/cert-manager-operator-controller-manager-54b9655956-jlk46" Jun 03 01:09:44.206266 ip-10-0-138-55 kubenswrapper[2566]: I0603 01:09:44.206242 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-6pkwx\" (UniqueName: \"kubernetes.io/projected/7c3f9a0b-9c69-4f90-add0-1517a360eb86-kube-api-access-6pkwx\") pod \"cert-manager-operator-controller-manager-54b9655956-jlk46\" (UID: \"7c3f9a0b-9c69-4f90-add0-1517a360eb86\") " pod="cert-manager-operator/cert-manager-operator-controller-manager-54b9655956-jlk46" Jun 03 01:09:44.347303 ip-10-0-138-55 kubenswrapper[2566]: I0603 01:09:44.347267 2566 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager-operator/cert-manager-operator-controller-manager-54b9655956-jlk46" Jun 03 01:09:44.475443 ip-10-0-138-55 kubenswrapper[2566]: I0603 01:09:44.475408 2566 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["cert-manager-operator/cert-manager-operator-controller-manager-54b9655956-jlk46"] Jun 03 01:09:44.478093 ip-10-0-138-55 kubenswrapper[2566]: W0603 01:09:44.478064 2566 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod7c3f9a0b_9c69_4f90_add0_1517a360eb86.slice/crio-194c7c1512e9578e5ff2b2b35d5cad055a8da14d63a7ab9e3c4e1be79848ba2f WatchSource:0}: Error finding container 194c7c1512e9578e5ff2b2b35d5cad055a8da14d63a7ab9e3c4e1be79848ba2f: Status 404 returned error can't find the container with id 194c7c1512e9578e5ff2b2b35d5cad055a8da14d63a7ab9e3c4e1be79848ba2f Jun 03 01:09:44.480716 ip-10-0-138-55 kubenswrapper[2566]: I0603 01:09:44.480698 2566 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider Jun 03 01:09:44.745827 ip-10-0-138-55 kubenswrapper[2566]: I0603 01:09:44.745737 2566 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="cert-manager-operator/cert-manager-operator-controller-manager-54b9655956-jlk46" event={"ID":"7c3f9a0b-9c69-4f90-add0-1517a360eb86","Type":"ContainerStarted","Data":"194c7c1512e9578e5ff2b2b35d5cad055a8da14d63a7ab9e3c4e1be79848ba2f"} Jun 03 01:09:47.757508 ip-10-0-138-55 kubenswrapper[2566]: I0603 01:09:47.757473 2566 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="cert-manager-operator/cert-manager-operator-controller-manager-54b9655956-jlk46" event={"ID":"7c3f9a0b-9c69-4f90-add0-1517a360eb86","Type":"ContainerStarted","Data":"4c2e401b75e442fd6d9410d071adc5690e3e63947f737af536844855342c96cc"} Jun 03 01:09:47.779607 ip-10-0-138-55 kubenswrapper[2566]: I0603 01:09:47.779559 2566 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="cert-manager-operator/cert-manager-operator-controller-manager-54b9655956-jlk46" podStartSLOduration=1.369238397 podStartE2EDuration="3.779544964s" podCreationTimestamp="2026-06-03 01:09:44 +0000 UTC" firstStartedPulling="2026-06-03 01:09:44.480823573 +0000 UTC m=+307.627665497" lastFinishedPulling="2026-06-03 01:09:46.891130138 +0000 UTC m=+310.037972064" observedRunningTime="2026-06-03 01:09:47.778043991 +0000 UTC m=+310.924885942" watchObservedRunningTime="2026-06-03 01:09:47.779544964 +0000 UTC m=+310.926386909" Jun 03 01:09:48.447169 ip-10-0-138-55 kubenswrapper[2566]: I0603 01:09:48.447137 2566 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fpwx28"] Jun 03 01:09:48.449637 ip-10-0-138-55 kubenswrapper[2566]: I0603 01:09:48.449622 2566 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fpwx28" Jun 03 01:09:48.451851 ip-10-0-138-55 kubenswrapper[2566]: I0603 01:09:48.451825 2566 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-marketplace\"/\"default-dockercfg-xfvxj\"" Jun 03 01:09:48.451851 ip-10-0-138-55 kubenswrapper[2566]: I0603 01:09:48.451842 2566 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"openshift-service-ca.crt\"" Jun 03 01:09:48.452040 ip-10-0-138-55 kubenswrapper[2566]: I0603 01:09:48.451830 2566 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"kube-root-ca.crt\"" Jun 03 01:09:48.457731 ip-10-0-138-55 kubenswrapper[2566]: I0603 01:09:48.457710 2566 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fpwx28"] Jun 03 01:09:48.534900 ip-10-0-138-55 kubenswrapper[2566]: I0603 01:09:48.534862 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/5a217381-f81c-4c0a-bbcc-bab020c4bb4e-bundle\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fpwx28\" (UID: \"5a217381-f81c-4c0a-bbcc-bab020c4bb4e\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fpwx28" Jun 03 01:09:48.535074 ip-10-0-138-55 kubenswrapper[2566]: I0603 01:09:48.534911 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-d5zxx\" (UniqueName: \"kubernetes.io/projected/5a217381-f81c-4c0a-bbcc-bab020c4bb4e-kube-api-access-d5zxx\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fpwx28\" (UID: \"5a217381-f81c-4c0a-bbcc-bab020c4bb4e\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fpwx28" Jun 03 01:09:48.535074 ip-10-0-138-55 kubenswrapper[2566]: I0603 01:09:48.534963 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/5a217381-f81c-4c0a-bbcc-bab020c4bb4e-util\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fpwx28\" (UID: \"5a217381-f81c-4c0a-bbcc-bab020c4bb4e\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fpwx28" Jun 03 01:09:48.636364 ip-10-0-138-55 kubenswrapper[2566]: I0603 01:09:48.636327 2566 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/5a217381-f81c-4c0a-bbcc-bab020c4bb4e-util\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fpwx28\" (UID: \"5a217381-f81c-4c0a-bbcc-bab020c4bb4e\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fpwx28" Jun 03 01:09:48.636520 ip-10-0-138-55 kubenswrapper[2566]: I0603 01:09:48.636395 2566 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/5a217381-f81c-4c0a-bbcc-bab020c4bb4e-bundle\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fpwx28\" (UID: \"5a217381-f81c-4c0a-bbcc-bab020c4bb4e\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fpwx28" Jun 03 01:09:48.636520 ip-10-0-138-55 kubenswrapper[2566]: I0603 01:09:48.636425 2566 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-d5zxx\" (UniqueName: \"kubernetes.io/projected/5a217381-f81c-4c0a-bbcc-bab020c4bb4e-kube-api-access-d5zxx\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fpwx28\" (UID: \"5a217381-f81c-4c0a-bbcc-bab020c4bb4e\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fpwx28" Jun 03 01:09:48.636825 ip-10-0-138-55 kubenswrapper[2566]: I0603 01:09:48.636796 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/5a217381-f81c-4c0a-bbcc-bab020c4bb4e-util\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fpwx28\" (UID: \"5a217381-f81c-4c0a-bbcc-bab020c4bb4e\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fpwx28" Jun 03 01:09:48.636872 ip-10-0-138-55 kubenswrapper[2566]: I0603 01:09:48.636807 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/5a217381-f81c-4c0a-bbcc-bab020c4bb4e-bundle\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fpwx28\" (UID: \"5a217381-f81c-4c0a-bbcc-bab020c4bb4e\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fpwx28" Jun 03 01:09:48.643275 ip-10-0-138-55 kubenswrapper[2566]: I0603 01:09:48.643252 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-d5zxx\" (UniqueName: \"kubernetes.io/projected/5a217381-f81c-4c0a-bbcc-bab020c4bb4e-kube-api-access-d5zxx\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fpwx28\" (UID: \"5a217381-f81c-4c0a-bbcc-bab020c4bb4e\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fpwx28" Jun 03 01:09:48.759002 ip-10-0-138-55 kubenswrapper[2566]: I0603 01:09:48.758924 2566 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fpwx28" Jun 03 01:09:48.884373 ip-10-0-138-55 kubenswrapper[2566]: I0603 01:09:48.884337 2566 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fpwx28"] Jun 03 01:09:48.888281 ip-10-0-138-55 kubenswrapper[2566]: W0603 01:09:48.888248 2566 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod5a217381_f81c_4c0a_bbcc_bab020c4bb4e.slice/crio-bf9b7549ac6ae71a592b9a201610430bc4ab856a37c6a0738f833b0199271184 WatchSource:0}: Error finding container bf9b7549ac6ae71a592b9a201610430bc4ab856a37c6a0738f833b0199271184: Status 404 returned error can't find the container with id bf9b7549ac6ae71a592b9a201610430bc4ab856a37c6a0738f833b0199271184 Jun 03 01:09:49.766032 ip-10-0-138-55 kubenswrapper[2566]: I0603 01:09:49.765998 2566 generic.go:358] "Generic (PLEG): container finished" podID="5a217381-f81c-4c0a-bbcc-bab020c4bb4e" containerID="4b32b5d5e6d2ebbaee8fe2e84b64724483976006b0aa638ddd66c3fdc52d26fc" exitCode=0 Jun 03 01:09:49.766430 ip-10-0-138-55 kubenswrapper[2566]: I0603 01:09:49.766050 2566 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fpwx28" event={"ID":"5a217381-f81c-4c0a-bbcc-bab020c4bb4e","Type":"ContainerDied","Data":"4b32b5d5e6d2ebbaee8fe2e84b64724483976006b0aa638ddd66c3fdc52d26fc"} Jun 03 01:09:49.766430 ip-10-0-138-55 kubenswrapper[2566]: I0603 01:09:49.766078 2566 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fpwx28" event={"ID":"5a217381-f81c-4c0a-bbcc-bab020c4bb4e","Type":"ContainerStarted","Data":"bf9b7549ac6ae71a592b9a201610430bc4ab856a37c6a0738f833b0199271184"} Jun 03 01:09:50.228179 ip-10-0-138-55 kubenswrapper[2566]: I0603 01:09:50.225776 2566 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["cert-manager/cert-manager-webhook-587ccfb98-t5sn6"] Jun 03 01:09:50.229563 ip-10-0-138-55 kubenswrapper[2566]: I0603 01:09:50.229353 2566 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager/cert-manager-webhook-587ccfb98-t5sn6" Jun 03 01:09:50.231972 ip-10-0-138-55 kubenswrapper[2566]: I0603 01:09:50.231946 2566 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"cert-manager\"/\"kube-root-ca.crt\"" Jun 03 01:09:50.232112 ip-10-0-138-55 kubenswrapper[2566]: I0603 01:09:50.232023 2566 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"cert-manager\"/\"cert-manager-webhook-dockercfg-2fv25\"" Jun 03 01:09:50.232362 ip-10-0-138-55 kubenswrapper[2566]: I0603 01:09:50.232338 2566 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"cert-manager\"/\"openshift-service-ca.crt\"" Jun 03 01:09:50.237963 ip-10-0-138-55 kubenswrapper[2566]: I0603 01:09:50.237944 2566 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["cert-manager/cert-manager-webhook-587ccfb98-t5sn6"] Jun 03 01:09:50.350073 ip-10-0-138-55 kubenswrapper[2566]: I0603 01:09:50.350036 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-sjcxz\" (UniqueName: \"kubernetes.io/projected/c9838306-71fd-48cf-ac83-94048bf0a8f4-kube-api-access-sjcxz\") pod \"cert-manager-webhook-587ccfb98-t5sn6\" (UID: \"c9838306-71fd-48cf-ac83-94048bf0a8f4\") " pod="cert-manager/cert-manager-webhook-587ccfb98-t5sn6" Jun 03 01:09:50.350073 ip-10-0-138-55 kubenswrapper[2566]: I0603 01:09:50.350074 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/c9838306-71fd-48cf-ac83-94048bf0a8f4-bound-sa-token\") pod \"cert-manager-webhook-587ccfb98-t5sn6\" (UID: \"c9838306-71fd-48cf-ac83-94048bf0a8f4\") " pod="cert-manager/cert-manager-webhook-587ccfb98-t5sn6" Jun 03 01:09:50.450649 ip-10-0-138-55 kubenswrapper[2566]: I0603 01:09:50.450613 2566 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-sjcxz\" (UniqueName: \"kubernetes.io/projected/c9838306-71fd-48cf-ac83-94048bf0a8f4-kube-api-access-sjcxz\") pod \"cert-manager-webhook-587ccfb98-t5sn6\" (UID: \"c9838306-71fd-48cf-ac83-94048bf0a8f4\") " pod="cert-manager/cert-manager-webhook-587ccfb98-t5sn6" Jun 03 01:09:50.450836 ip-10-0-138-55 kubenswrapper[2566]: I0603 01:09:50.450654 2566 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/c9838306-71fd-48cf-ac83-94048bf0a8f4-bound-sa-token\") pod \"cert-manager-webhook-587ccfb98-t5sn6\" (UID: \"c9838306-71fd-48cf-ac83-94048bf0a8f4\") " pod="cert-manager/cert-manager-webhook-587ccfb98-t5sn6" Jun 03 01:09:50.458277 ip-10-0-138-55 kubenswrapper[2566]: I0603 01:09:50.458241 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-sjcxz\" (UniqueName: \"kubernetes.io/projected/c9838306-71fd-48cf-ac83-94048bf0a8f4-kube-api-access-sjcxz\") pod \"cert-manager-webhook-587ccfb98-t5sn6\" (UID: \"c9838306-71fd-48cf-ac83-94048bf0a8f4\") " pod="cert-manager/cert-manager-webhook-587ccfb98-t5sn6" Jun 03 01:09:50.458382 ip-10-0-138-55 kubenswrapper[2566]: I0603 01:09:50.458347 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/c9838306-71fd-48cf-ac83-94048bf0a8f4-bound-sa-token\") pod \"cert-manager-webhook-587ccfb98-t5sn6\" (UID: \"c9838306-71fd-48cf-ac83-94048bf0a8f4\") " pod="cert-manager/cert-manager-webhook-587ccfb98-t5sn6" Jun 03 01:09:50.551499 ip-10-0-138-55 kubenswrapper[2566]: I0603 01:09:50.551424 2566 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager/cert-manager-webhook-587ccfb98-t5sn6" Jun 03 01:09:50.679506 ip-10-0-138-55 kubenswrapper[2566]: I0603 01:09:50.679479 2566 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["cert-manager/cert-manager-webhook-587ccfb98-t5sn6"] Jun 03 01:09:50.681750 ip-10-0-138-55 kubenswrapper[2566]: W0603 01:09:50.681716 2566 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-podc9838306_71fd_48cf_ac83_94048bf0a8f4.slice/crio-7db1c8a76c38fd03b0b133be20ed395b063e7e2909bbed0f07cc1f5db086421b WatchSource:0}: Error finding container 7db1c8a76c38fd03b0b133be20ed395b063e7e2909bbed0f07cc1f5db086421b: Status 404 returned error can't find the container with id 7db1c8a76c38fd03b0b133be20ed395b063e7e2909bbed0f07cc1f5db086421b Jun 03 01:09:50.770200 ip-10-0-138-55 kubenswrapper[2566]: I0603 01:09:50.770162 2566 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="cert-manager/cert-manager-webhook-587ccfb98-t5sn6" event={"ID":"c9838306-71fd-48cf-ac83-94048bf0a8f4","Type":"ContainerStarted","Data":"7db1c8a76c38fd03b0b133be20ed395b063e7e2909bbed0f07cc1f5db086421b"} Jun 03 01:09:51.320683 ip-10-0-138-55 kubenswrapper[2566]: I0603 01:09:51.320644 2566 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["cert-manager/cert-manager-cainjector-68b757865b-kb29d"] Jun 03 01:09:51.323319 ip-10-0-138-55 kubenswrapper[2566]: I0603 01:09:51.323295 2566 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager/cert-manager-cainjector-68b757865b-kb29d" Jun 03 01:09:51.325173 ip-10-0-138-55 kubenswrapper[2566]: I0603 01:09:51.325150 2566 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"cert-manager\"/\"cert-manager-cainjector-dockercfg-bntl9\"" Jun 03 01:09:51.330027 ip-10-0-138-55 kubenswrapper[2566]: I0603 01:09:51.329983 2566 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["cert-manager/cert-manager-cainjector-68b757865b-kb29d"] Jun 03 01:09:51.359935 ip-10-0-138-55 kubenswrapper[2566]: I0603 01:09:51.359877 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-2vgnp\" (UniqueName: \"kubernetes.io/projected/7c491892-9b0d-4312-80f8-3858cdb742be-kube-api-access-2vgnp\") pod \"cert-manager-cainjector-68b757865b-kb29d\" (UID: \"7c491892-9b0d-4312-80f8-3858cdb742be\") " pod="cert-manager/cert-manager-cainjector-68b757865b-kb29d" Jun 03 01:09:51.359935 ip-10-0-138-55 kubenswrapper[2566]: I0603 01:09:51.359926 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/7c491892-9b0d-4312-80f8-3858cdb742be-bound-sa-token\") pod \"cert-manager-cainjector-68b757865b-kb29d\" (UID: \"7c491892-9b0d-4312-80f8-3858cdb742be\") " pod="cert-manager/cert-manager-cainjector-68b757865b-kb29d" Jun 03 01:09:51.460923 ip-10-0-138-55 kubenswrapper[2566]: I0603 01:09:51.460883 2566 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-2vgnp\" (UniqueName: \"kubernetes.io/projected/7c491892-9b0d-4312-80f8-3858cdb742be-kube-api-access-2vgnp\") pod \"cert-manager-cainjector-68b757865b-kb29d\" (UID: \"7c491892-9b0d-4312-80f8-3858cdb742be\") " pod="cert-manager/cert-manager-cainjector-68b757865b-kb29d" Jun 03 01:09:51.461109 ip-10-0-138-55 kubenswrapper[2566]: I0603 01:09:51.460937 2566 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/7c491892-9b0d-4312-80f8-3858cdb742be-bound-sa-token\") pod \"cert-manager-cainjector-68b757865b-kb29d\" (UID: \"7c491892-9b0d-4312-80f8-3858cdb742be\") " pod="cert-manager/cert-manager-cainjector-68b757865b-kb29d" Jun 03 01:09:51.468842 ip-10-0-138-55 kubenswrapper[2566]: I0603 01:09:51.468784 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-2vgnp\" (UniqueName: \"kubernetes.io/projected/7c491892-9b0d-4312-80f8-3858cdb742be-kube-api-access-2vgnp\") pod \"cert-manager-cainjector-68b757865b-kb29d\" (UID: \"7c491892-9b0d-4312-80f8-3858cdb742be\") " pod="cert-manager/cert-manager-cainjector-68b757865b-kb29d" Jun 03 01:09:51.469588 ip-10-0-138-55 kubenswrapper[2566]: I0603 01:09:51.469566 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/7c491892-9b0d-4312-80f8-3858cdb742be-bound-sa-token\") pod \"cert-manager-cainjector-68b757865b-kb29d\" (UID: \"7c491892-9b0d-4312-80f8-3858cdb742be\") " pod="cert-manager/cert-manager-cainjector-68b757865b-kb29d" Jun 03 01:09:51.637538 ip-10-0-138-55 kubenswrapper[2566]: I0603 01:09:51.637501 2566 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager/cert-manager-cainjector-68b757865b-kb29d" Jun 03 01:09:51.802409 ip-10-0-138-55 kubenswrapper[2566]: I0603 01:09:51.802375 2566 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["cert-manager/cert-manager-cainjector-68b757865b-kb29d"] Jun 03 01:09:51.805256 ip-10-0-138-55 kubenswrapper[2566]: W0603 01:09:51.805203 2566 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod7c491892_9b0d_4312_80f8_3858cdb742be.slice/crio-519e84f610162704bdac8e4935adff525294260cb43c451415e73f47c99fc640 WatchSource:0}: Error finding container 519e84f610162704bdac8e4935adff525294260cb43c451415e73f47c99fc640: Status 404 returned error can't find the container with id 519e84f610162704bdac8e4935adff525294260cb43c451415e73f47c99fc640 Jun 03 01:09:52.778997 ip-10-0-138-55 kubenswrapper[2566]: I0603 01:09:52.778955 2566 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="cert-manager/cert-manager-cainjector-68b757865b-kb29d" event={"ID":"7c491892-9b0d-4312-80f8-3858cdb742be","Type":"ContainerStarted","Data":"519e84f610162704bdac8e4935adff525294260cb43c451415e73f47c99fc640"} Jun 03 01:09:53.784001 ip-10-0-138-55 kubenswrapper[2566]: I0603 01:09:53.783915 2566 generic.go:358] "Generic (PLEG): container finished" podID="5a217381-f81c-4c0a-bbcc-bab020c4bb4e" containerID="b2f0a94e6658573611df77b47dddd36daf039f78fd3da944b1202e37aab09e57" exitCode=0 Jun 03 01:09:53.784001 ip-10-0-138-55 kubenswrapper[2566]: I0603 01:09:53.783990 2566 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fpwx28" event={"ID":"5a217381-f81c-4c0a-bbcc-bab020c4bb4e","Type":"ContainerDied","Data":"b2f0a94e6658573611df77b47dddd36daf039f78fd3da944b1202e37aab09e57"} Jun 03 01:09:53.785517 ip-10-0-138-55 kubenswrapper[2566]: I0603 01:09:53.785492 2566 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="cert-manager/cert-manager-webhook-587ccfb98-t5sn6" event={"ID":"c9838306-71fd-48cf-ac83-94048bf0a8f4","Type":"ContainerStarted","Data":"206800c89ac8337dfb6e565dc20f91e34169679e7edc483a2b290de515f6b84a"} Jun 03 01:09:53.785643 ip-10-0-138-55 kubenswrapper[2566]: I0603 01:09:53.785530 2566 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="cert-manager/cert-manager-webhook-587ccfb98-t5sn6" Jun 03 01:09:53.786924 ip-10-0-138-55 kubenswrapper[2566]: I0603 01:09:53.786905 2566 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="cert-manager/cert-manager-cainjector-68b757865b-kb29d" event={"ID":"7c491892-9b0d-4312-80f8-3858cdb742be","Type":"ContainerStarted","Data":"de761cb10ee3874dce5c329bde79c5ed0cb737b480e1749b22dc56da7dc816f7"} Jun 03 01:09:53.815183 ip-10-0-138-55 kubenswrapper[2566]: I0603 01:09:53.815129 2566 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="cert-manager/cert-manager-webhook-587ccfb98-t5sn6" podStartSLOduration=1.042112674 podStartE2EDuration="3.815112982s" podCreationTimestamp="2026-06-03 01:09:50 +0000 UTC" firstStartedPulling="2026-06-03 01:09:50.683982206 +0000 UTC m=+313.830824129" lastFinishedPulling="2026-06-03 01:09:53.456982509 +0000 UTC m=+316.603824437" observedRunningTime="2026-06-03 01:09:53.814003477 +0000 UTC m=+316.960845424" watchObservedRunningTime="2026-06-03 01:09:53.815112982 +0000 UTC m=+316.961954929" Jun 03 01:09:53.828420 ip-10-0-138-55 kubenswrapper[2566]: I0603 01:09:53.828371 2566 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="cert-manager/cert-manager-cainjector-68b757865b-kb29d" podStartSLOduration=1.178320633 podStartE2EDuration="2.828353127s" podCreationTimestamp="2026-06-03 01:09:51 +0000 UTC" firstStartedPulling="2026-06-03 01:09:51.807650731 +0000 UTC m=+314.954492668" lastFinishedPulling="2026-06-03 01:09:53.457683227 +0000 UTC m=+316.604525162" observedRunningTime="2026-06-03 01:09:53.826894126 +0000 UTC m=+316.973736082" watchObservedRunningTime="2026-06-03 01:09:53.828353127 +0000 UTC m=+316.975195076" Jun 03 01:09:54.791888 ip-10-0-138-55 kubenswrapper[2566]: I0603 01:09:54.791798 2566 generic.go:358] "Generic (PLEG): container finished" podID="5a217381-f81c-4c0a-bbcc-bab020c4bb4e" containerID="19cc50af7e9627ac90cc4cd167766810e85196dafbfe09d8e9aedf50036c20f5" exitCode=0 Jun 03 01:09:54.792311 ip-10-0-138-55 kubenswrapper[2566]: I0603 01:09:54.791874 2566 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fpwx28" event={"ID":"5a217381-f81c-4c0a-bbcc-bab020c4bb4e","Type":"ContainerDied","Data":"19cc50af7e9627ac90cc4cd167766810e85196dafbfe09d8e9aedf50036c20f5"} Jun 03 01:09:55.914955 ip-10-0-138-55 kubenswrapper[2566]: I0603 01:09:55.914929 2566 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fpwx28" Jun 03 01:09:55.999792 ip-10-0-138-55 kubenswrapper[2566]: I0603 01:09:55.999757 2566 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-d5zxx\" (UniqueName: \"kubernetes.io/projected/5a217381-f81c-4c0a-bbcc-bab020c4bb4e-kube-api-access-d5zxx\") pod \"5a217381-f81c-4c0a-bbcc-bab020c4bb4e\" (UID: \"5a217381-f81c-4c0a-bbcc-bab020c4bb4e\") " Jun 03 01:09:55.999985 ip-10-0-138-55 kubenswrapper[2566]: I0603 01:09:55.999813 2566 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/5a217381-f81c-4c0a-bbcc-bab020c4bb4e-bundle\") pod \"5a217381-f81c-4c0a-bbcc-bab020c4bb4e\" (UID: \"5a217381-f81c-4c0a-bbcc-bab020c4bb4e\") " Jun 03 01:09:55.999985 ip-10-0-138-55 kubenswrapper[2566]: I0603 01:09:55.999875 2566 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/5a217381-f81c-4c0a-bbcc-bab020c4bb4e-util\") pod \"5a217381-f81c-4c0a-bbcc-bab020c4bb4e\" (UID: \"5a217381-f81c-4c0a-bbcc-bab020c4bb4e\") " Jun 03 01:09:56.000303 ip-10-0-138-55 kubenswrapper[2566]: I0603 01:09:56.000271 2566 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/5a217381-f81c-4c0a-bbcc-bab020c4bb4e-bundle" (OuterVolumeSpecName: "bundle") pod "5a217381-f81c-4c0a-bbcc-bab020c4bb4e" (UID: "5a217381-f81c-4c0a-bbcc-bab020c4bb4e"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jun 03 01:09:56.001975 ip-10-0-138-55 kubenswrapper[2566]: I0603 01:09:56.001951 2566 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/5a217381-f81c-4c0a-bbcc-bab020c4bb4e-kube-api-access-d5zxx" (OuterVolumeSpecName: "kube-api-access-d5zxx") pod "5a217381-f81c-4c0a-bbcc-bab020c4bb4e" (UID: "5a217381-f81c-4c0a-bbcc-bab020c4bb4e"). InnerVolumeSpecName "kube-api-access-d5zxx". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 03 01:09:56.004689 ip-10-0-138-55 kubenswrapper[2566]: I0603 01:09:56.004666 2566 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/5a217381-f81c-4c0a-bbcc-bab020c4bb4e-util" (OuterVolumeSpecName: "util") pod "5a217381-f81c-4c0a-bbcc-bab020c4bb4e" (UID: "5a217381-f81c-4c0a-bbcc-bab020c4bb4e"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jun 03 01:09:56.101529 ip-10-0-138-55 kubenswrapper[2566]: I0603 01:09:56.101501 2566 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/5a217381-f81c-4c0a-bbcc-bab020c4bb4e-bundle\") on node \"ip-10-0-138-55.ec2.internal\" DevicePath \"\"" Jun 03 01:09:56.101529 ip-10-0-138-55 kubenswrapper[2566]: I0603 01:09:56.101528 2566 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/5a217381-f81c-4c0a-bbcc-bab020c4bb4e-util\") on node \"ip-10-0-138-55.ec2.internal\" DevicePath \"\"" Jun 03 01:09:56.101724 ip-10-0-138-55 kubenswrapper[2566]: I0603 01:09:56.101537 2566 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-d5zxx\" (UniqueName: \"kubernetes.io/projected/5a217381-f81c-4c0a-bbcc-bab020c4bb4e-kube-api-access-d5zxx\") on node \"ip-10-0-138-55.ec2.internal\" DevicePath \"\"" Jun 03 01:09:56.799190 ip-10-0-138-55 kubenswrapper[2566]: I0603 01:09:56.799147 2566 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fpwx28" event={"ID":"5a217381-f81c-4c0a-bbcc-bab020c4bb4e","Type":"ContainerDied","Data":"bf9b7549ac6ae71a592b9a201610430bc4ab856a37c6a0738f833b0199271184"} Jun 03 01:09:56.799190 ip-10-0-138-55 kubenswrapper[2566]: I0603 01:09:56.799182 2566 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fpwx28" Jun 03 01:09:56.799190 ip-10-0-138-55 kubenswrapper[2566]: I0603 01:09:56.799192 2566 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="bf9b7549ac6ae71a592b9a201610430bc4ab856a37c6a0738f833b0199271184" Jun 03 01:09:59.794606 ip-10-0-138-55 kubenswrapper[2566]: I0603 01:09:59.794579 2566 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="cert-manager/cert-manager-webhook-587ccfb98-t5sn6" Jun 03 01:10:08.397947 ip-10-0-138-55 kubenswrapper[2566]: I0603 01:10:08.397911 2566 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-marketplace/410e69f41462d9d02a48f76ad929b5f41ed146182df7ab38cf9ce4e1cdf79l7"] Jun 03 01:10:08.398375 ip-10-0-138-55 kubenswrapper[2566]: I0603 01:10:08.398319 2566 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="5a217381-f81c-4c0a-bbcc-bab020c4bb4e" containerName="util" Jun 03 01:10:08.398375 ip-10-0-138-55 kubenswrapper[2566]: I0603 01:10:08.398333 2566 state_mem.go:107] "Deleted CPUSet assignment" podUID="5a217381-f81c-4c0a-bbcc-bab020c4bb4e" containerName="util" Jun 03 01:10:08.398375 ip-10-0-138-55 kubenswrapper[2566]: I0603 01:10:08.398350 2566 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="5a217381-f81c-4c0a-bbcc-bab020c4bb4e" containerName="extract" Jun 03 01:10:08.398375 ip-10-0-138-55 kubenswrapper[2566]: I0603 01:10:08.398355 2566 state_mem.go:107] "Deleted CPUSet assignment" podUID="5a217381-f81c-4c0a-bbcc-bab020c4bb4e" containerName="extract" Jun 03 01:10:08.398375 ip-10-0-138-55 kubenswrapper[2566]: I0603 01:10:08.398364 2566 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="5a217381-f81c-4c0a-bbcc-bab020c4bb4e" containerName="pull" Jun 03 01:10:08.398375 ip-10-0-138-55 kubenswrapper[2566]: I0603 01:10:08.398369 2566 state_mem.go:107] "Deleted CPUSet assignment" podUID="5a217381-f81c-4c0a-bbcc-bab020c4bb4e" containerName="pull" Jun 03 01:10:08.398559 ip-10-0-138-55 kubenswrapper[2566]: I0603 01:10:08.398429 2566 memory_manager.go:356] "RemoveStaleState removing state" podUID="5a217381-f81c-4c0a-bbcc-bab020c4bb4e" containerName="extract" Jun 03 01:10:08.402099 ip-10-0-138-55 kubenswrapper[2566]: I0603 01:10:08.402079 2566 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/410e69f41462d9d02a48f76ad929b5f41ed146182df7ab38cf9ce4e1cdf79l7" Jun 03 01:10:08.403987 ip-10-0-138-55 kubenswrapper[2566]: I0603 01:10:08.403964 2566 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"kube-root-ca.crt\"" Jun 03 01:10:08.404509 ip-10-0-138-55 kubenswrapper[2566]: I0603 01:10:08.404489 2566 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"openshift-service-ca.crt\"" Jun 03 01:10:08.404509 ip-10-0-138-55 kubenswrapper[2566]: I0603 01:10:08.404506 2566 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-marketplace\"/\"default-dockercfg-xfvxj\"" Jun 03 01:10:08.408404 ip-10-0-138-55 kubenswrapper[2566]: I0603 01:10:08.408362 2566 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/410e69f41462d9d02a48f76ad929b5f41ed146182df7ab38cf9ce4e1cdf79l7"] Jun 03 01:10:08.504583 ip-10-0-138-55 kubenswrapper[2566]: I0603 01:10:08.504546 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/ea38a8f8-f28f-476d-bc14-72f5192de14b-bundle\") pod \"410e69f41462d9d02a48f76ad929b5f41ed146182df7ab38cf9ce4e1cdf79l7\" (UID: \"ea38a8f8-f28f-476d-bc14-72f5192de14b\") " pod="openshift-marketplace/410e69f41462d9d02a48f76ad929b5f41ed146182df7ab38cf9ce4e1cdf79l7" Jun 03 01:10:08.504842 ip-10-0-138-55 kubenswrapper[2566]: I0603 01:10:08.504593 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-5hfkr\" (UniqueName: \"kubernetes.io/projected/ea38a8f8-f28f-476d-bc14-72f5192de14b-kube-api-access-5hfkr\") pod \"410e69f41462d9d02a48f76ad929b5f41ed146182df7ab38cf9ce4e1cdf79l7\" (UID: \"ea38a8f8-f28f-476d-bc14-72f5192de14b\") " pod="openshift-marketplace/410e69f41462d9d02a48f76ad929b5f41ed146182df7ab38cf9ce4e1cdf79l7" Jun 03 01:10:08.504842 ip-10-0-138-55 kubenswrapper[2566]: I0603 01:10:08.504662 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/ea38a8f8-f28f-476d-bc14-72f5192de14b-util\") pod \"410e69f41462d9d02a48f76ad929b5f41ed146182df7ab38cf9ce4e1cdf79l7\" (UID: \"ea38a8f8-f28f-476d-bc14-72f5192de14b\") " pod="openshift-marketplace/410e69f41462d9d02a48f76ad929b5f41ed146182df7ab38cf9ce4e1cdf79l7" Jun 03 01:10:08.605503 ip-10-0-138-55 kubenswrapper[2566]: I0603 01:10:08.605467 2566 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/ea38a8f8-f28f-476d-bc14-72f5192de14b-bundle\") pod \"410e69f41462d9d02a48f76ad929b5f41ed146182df7ab38cf9ce4e1cdf79l7\" (UID: \"ea38a8f8-f28f-476d-bc14-72f5192de14b\") " pod="openshift-marketplace/410e69f41462d9d02a48f76ad929b5f41ed146182df7ab38cf9ce4e1cdf79l7" Jun 03 01:10:08.605739 ip-10-0-138-55 kubenswrapper[2566]: I0603 01:10:08.605514 2566 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-5hfkr\" (UniqueName: \"kubernetes.io/projected/ea38a8f8-f28f-476d-bc14-72f5192de14b-kube-api-access-5hfkr\") pod \"410e69f41462d9d02a48f76ad929b5f41ed146182df7ab38cf9ce4e1cdf79l7\" (UID: \"ea38a8f8-f28f-476d-bc14-72f5192de14b\") " pod="openshift-marketplace/410e69f41462d9d02a48f76ad929b5f41ed146182df7ab38cf9ce4e1cdf79l7" Jun 03 01:10:08.605739 ip-10-0-138-55 kubenswrapper[2566]: I0603 01:10:08.605553 2566 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/ea38a8f8-f28f-476d-bc14-72f5192de14b-util\") pod \"410e69f41462d9d02a48f76ad929b5f41ed146182df7ab38cf9ce4e1cdf79l7\" (UID: \"ea38a8f8-f28f-476d-bc14-72f5192de14b\") " pod="openshift-marketplace/410e69f41462d9d02a48f76ad929b5f41ed146182df7ab38cf9ce4e1cdf79l7" Jun 03 01:10:08.605861 ip-10-0-138-55 kubenswrapper[2566]: I0603 01:10:08.605841 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/ea38a8f8-f28f-476d-bc14-72f5192de14b-bundle\") pod \"410e69f41462d9d02a48f76ad929b5f41ed146182df7ab38cf9ce4e1cdf79l7\" (UID: \"ea38a8f8-f28f-476d-bc14-72f5192de14b\") " pod="openshift-marketplace/410e69f41462d9d02a48f76ad929b5f41ed146182df7ab38cf9ce4e1cdf79l7" Jun 03 01:10:08.605925 ip-10-0-138-55 kubenswrapper[2566]: I0603 01:10:08.605902 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/ea38a8f8-f28f-476d-bc14-72f5192de14b-util\") pod \"410e69f41462d9d02a48f76ad929b5f41ed146182df7ab38cf9ce4e1cdf79l7\" (UID: \"ea38a8f8-f28f-476d-bc14-72f5192de14b\") " pod="openshift-marketplace/410e69f41462d9d02a48f76ad929b5f41ed146182df7ab38cf9ce4e1cdf79l7" Jun 03 01:10:08.612828 ip-10-0-138-55 kubenswrapper[2566]: I0603 01:10:08.612800 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-5hfkr\" (UniqueName: \"kubernetes.io/projected/ea38a8f8-f28f-476d-bc14-72f5192de14b-kube-api-access-5hfkr\") pod \"410e69f41462d9d02a48f76ad929b5f41ed146182df7ab38cf9ce4e1cdf79l7\" (UID: \"ea38a8f8-f28f-476d-bc14-72f5192de14b\") " pod="openshift-marketplace/410e69f41462d9d02a48f76ad929b5f41ed146182df7ab38cf9ce4e1cdf79l7" Jun 03 01:10:08.712669 ip-10-0-138-55 kubenswrapper[2566]: I0603 01:10:08.712601 2566 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/410e69f41462d9d02a48f76ad929b5f41ed146182df7ab38cf9ce4e1cdf79l7" Jun 03 01:10:08.836735 ip-10-0-138-55 kubenswrapper[2566]: I0603 01:10:08.836696 2566 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/410e69f41462d9d02a48f76ad929b5f41ed146182df7ab38cf9ce4e1cdf79l7"] Jun 03 01:10:08.840472 ip-10-0-138-55 kubenswrapper[2566]: W0603 01:10:08.840446 2566 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podea38a8f8_f28f_476d_bc14_72f5192de14b.slice/crio-22ed68e6327270a908b86cac368fe37394c3e1a3a06aba578410a48265a65e7d WatchSource:0}: Error finding container 22ed68e6327270a908b86cac368fe37394c3e1a3a06aba578410a48265a65e7d: Status 404 returned error can't find the container with id 22ed68e6327270a908b86cac368fe37394c3e1a3a06aba578410a48265a65e7d Jun 03 01:10:09.140762 ip-10-0-138-55 kubenswrapper[2566]: I0603 01:10:09.140721 2566 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["cert-manager/cert-manager-79c8d999ff-nwr26"] Jun 03 01:10:09.154161 ip-10-0-138-55 kubenswrapper[2566]: I0603 01:10:09.154126 2566 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["cert-manager/cert-manager-79c8d999ff-nwr26"] Jun 03 01:10:09.154161 ip-10-0-138-55 kubenswrapper[2566]: I0603 01:10:09.154130 2566 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager/cert-manager-79c8d999ff-nwr26" Jun 03 01:10:09.156292 ip-10-0-138-55 kubenswrapper[2566]: I0603 01:10:09.156270 2566 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"cert-manager\"/\"cert-manager-dockercfg-6xldj\"" Jun 03 01:10:09.210216 ip-10-0-138-55 kubenswrapper[2566]: I0603 01:10:09.210184 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-9j4xk\" (UniqueName: \"kubernetes.io/projected/647415ef-48df-4938-b232-609c838ff888-kube-api-access-9j4xk\") pod \"cert-manager-79c8d999ff-nwr26\" (UID: \"647415ef-48df-4938-b232-609c838ff888\") " pod="cert-manager/cert-manager-79c8d999ff-nwr26" Jun 03 01:10:09.210374 ip-10-0-138-55 kubenswrapper[2566]: I0603 01:10:09.210317 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/647415ef-48df-4938-b232-609c838ff888-bound-sa-token\") pod \"cert-manager-79c8d999ff-nwr26\" (UID: \"647415ef-48df-4938-b232-609c838ff888\") " pod="cert-manager/cert-manager-79c8d999ff-nwr26" Jun 03 01:10:09.311524 ip-10-0-138-55 kubenswrapper[2566]: I0603 01:10:09.311437 2566 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-9j4xk\" (UniqueName: \"kubernetes.io/projected/647415ef-48df-4938-b232-609c838ff888-kube-api-access-9j4xk\") pod \"cert-manager-79c8d999ff-nwr26\" (UID: \"647415ef-48df-4938-b232-609c838ff888\") " pod="cert-manager/cert-manager-79c8d999ff-nwr26" Jun 03 01:10:09.311670 ip-10-0-138-55 kubenswrapper[2566]: I0603 01:10:09.311566 2566 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/647415ef-48df-4938-b232-609c838ff888-bound-sa-token\") pod \"cert-manager-79c8d999ff-nwr26\" (UID: \"647415ef-48df-4938-b232-609c838ff888\") " pod="cert-manager/cert-manager-79c8d999ff-nwr26" Jun 03 01:10:09.318736 ip-10-0-138-55 kubenswrapper[2566]: I0603 01:10:09.318710 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/647415ef-48df-4938-b232-609c838ff888-bound-sa-token\") pod \"cert-manager-79c8d999ff-nwr26\" (UID: \"647415ef-48df-4938-b232-609c838ff888\") " pod="cert-manager/cert-manager-79c8d999ff-nwr26" Jun 03 01:10:09.318862 ip-10-0-138-55 kubenswrapper[2566]: I0603 01:10:09.318818 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-9j4xk\" (UniqueName: \"kubernetes.io/projected/647415ef-48df-4938-b232-609c838ff888-kube-api-access-9j4xk\") pod \"cert-manager-79c8d999ff-nwr26\" (UID: \"647415ef-48df-4938-b232-609c838ff888\") " pod="cert-manager/cert-manager-79c8d999ff-nwr26" Jun 03 01:10:09.464196 ip-10-0-138-55 kubenswrapper[2566]: I0603 01:10:09.464165 2566 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager/cert-manager-79c8d999ff-nwr26" Jun 03 01:10:09.589679 ip-10-0-138-55 kubenswrapper[2566]: W0603 01:10:09.589648 2566 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod647415ef_48df_4938_b232_609c838ff888.slice/crio-2ac6c5281e49ef744913b43a19aaa2f97e6019bcc40d0a11cc7e15c3720313b1 WatchSource:0}: Error finding container 2ac6c5281e49ef744913b43a19aaa2f97e6019bcc40d0a11cc7e15c3720313b1: Status 404 returned error can't find the container with id 2ac6c5281e49ef744913b43a19aaa2f97e6019bcc40d0a11cc7e15c3720313b1 Jun 03 01:10:09.592205 ip-10-0-138-55 kubenswrapper[2566]: I0603 01:10:09.592114 2566 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["cert-manager/cert-manager-79c8d999ff-nwr26"] Jun 03 01:10:09.843961 ip-10-0-138-55 kubenswrapper[2566]: I0603 01:10:09.843865 2566 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="cert-manager/cert-manager-79c8d999ff-nwr26" event={"ID":"647415ef-48df-4938-b232-609c838ff888","Type":"ContainerStarted","Data":"0ab7339fa006d459897d899768e4236c653ec5f8b19ae35c178a7557e692c4cf"} Jun 03 01:10:09.843961 ip-10-0-138-55 kubenswrapper[2566]: I0603 01:10:09.843902 2566 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="cert-manager/cert-manager-79c8d999ff-nwr26" event={"ID":"647415ef-48df-4938-b232-609c838ff888","Type":"ContainerStarted","Data":"2ac6c5281e49ef744913b43a19aaa2f97e6019bcc40d0a11cc7e15c3720313b1"} Jun 03 01:10:09.845164 ip-10-0-138-55 kubenswrapper[2566]: I0603 01:10:09.845131 2566 generic.go:358] "Generic (PLEG): container finished" podID="ea38a8f8-f28f-476d-bc14-72f5192de14b" containerID="01e6ea40ae879e421765a269b6fa7cc251e46b3cbeff4a9ffec805df6beeab21" exitCode=0 Jun 03 01:10:09.845296 ip-10-0-138-55 kubenswrapper[2566]: I0603 01:10:09.845171 2566 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/410e69f41462d9d02a48f76ad929b5f41ed146182df7ab38cf9ce4e1cdf79l7" event={"ID":"ea38a8f8-f28f-476d-bc14-72f5192de14b","Type":"ContainerDied","Data":"01e6ea40ae879e421765a269b6fa7cc251e46b3cbeff4a9ffec805df6beeab21"} Jun 03 01:10:09.845296 ip-10-0-138-55 kubenswrapper[2566]: I0603 01:10:09.845202 2566 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/410e69f41462d9d02a48f76ad929b5f41ed146182df7ab38cf9ce4e1cdf79l7" event={"ID":"ea38a8f8-f28f-476d-bc14-72f5192de14b","Type":"ContainerStarted","Data":"22ed68e6327270a908b86cac368fe37394c3e1a3a06aba578410a48265a65e7d"} Jun 03 01:10:09.858142 ip-10-0-138-55 kubenswrapper[2566]: I0603 01:10:09.858097 2566 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="cert-manager/cert-manager-79c8d999ff-nwr26" podStartSLOduration=0.858085704 podStartE2EDuration="858.085704ms" podCreationTimestamp="2026-06-03 01:10:09 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2026-06-03 01:10:09.857131011 +0000 UTC m=+333.003972959" watchObservedRunningTime="2026-06-03 01:10:09.858085704 +0000 UTC m=+333.004927649" Jun 03 01:10:11.856717 ip-10-0-138-55 kubenswrapper[2566]: I0603 01:10:11.856681 2566 generic.go:358] "Generic (PLEG): container finished" podID="ea38a8f8-f28f-476d-bc14-72f5192de14b" containerID="f720cb4bfce617d6d1c787474536416551d7fdbb92361dfd9ff85fdbfe778f91" exitCode=0 Jun 03 01:10:11.857090 ip-10-0-138-55 kubenswrapper[2566]: I0603 01:10:11.856730 2566 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/410e69f41462d9d02a48f76ad929b5f41ed146182df7ab38cf9ce4e1cdf79l7" event={"ID":"ea38a8f8-f28f-476d-bc14-72f5192de14b","Type":"ContainerDied","Data":"f720cb4bfce617d6d1c787474536416551d7fdbb92361dfd9ff85fdbfe778f91"} Jun 03 01:10:12.862369 ip-10-0-138-55 kubenswrapper[2566]: I0603 01:10:12.862333 2566 generic.go:358] "Generic (PLEG): container finished" podID="ea38a8f8-f28f-476d-bc14-72f5192de14b" containerID="553892b3199c9e30d591be8215069cab7effee3b77ab69ea3b2568191ea071b1" exitCode=0 Jun 03 01:10:12.862729 ip-10-0-138-55 kubenswrapper[2566]: I0603 01:10:12.862418 2566 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/410e69f41462d9d02a48f76ad929b5f41ed146182df7ab38cf9ce4e1cdf79l7" event={"ID":"ea38a8f8-f28f-476d-bc14-72f5192de14b","Type":"ContainerDied","Data":"553892b3199c9e30d591be8215069cab7effee3b77ab69ea3b2568191ea071b1"} Jun 03 01:10:13.992845 ip-10-0-138-55 kubenswrapper[2566]: I0603 01:10:13.992823 2566 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/410e69f41462d9d02a48f76ad929b5f41ed146182df7ab38cf9ce4e1cdf79l7" Jun 03 01:10:14.156853 ip-10-0-138-55 kubenswrapper[2566]: I0603 01:10:14.156769 2566 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/ea38a8f8-f28f-476d-bc14-72f5192de14b-util\") pod \"ea38a8f8-f28f-476d-bc14-72f5192de14b\" (UID: \"ea38a8f8-f28f-476d-bc14-72f5192de14b\") " Jun 03 01:10:14.156853 ip-10-0-138-55 kubenswrapper[2566]: I0603 01:10:14.156824 2566 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-5hfkr\" (UniqueName: \"kubernetes.io/projected/ea38a8f8-f28f-476d-bc14-72f5192de14b-kube-api-access-5hfkr\") pod \"ea38a8f8-f28f-476d-bc14-72f5192de14b\" (UID: \"ea38a8f8-f28f-476d-bc14-72f5192de14b\") " Jun 03 01:10:14.157043 ip-10-0-138-55 kubenswrapper[2566]: I0603 01:10:14.156881 2566 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/ea38a8f8-f28f-476d-bc14-72f5192de14b-bundle\") pod \"ea38a8f8-f28f-476d-bc14-72f5192de14b\" (UID: \"ea38a8f8-f28f-476d-bc14-72f5192de14b\") " Jun 03 01:10:14.157604 ip-10-0-138-55 kubenswrapper[2566]: I0603 01:10:14.157577 2566 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/ea38a8f8-f28f-476d-bc14-72f5192de14b-bundle" (OuterVolumeSpecName: "bundle") pod "ea38a8f8-f28f-476d-bc14-72f5192de14b" (UID: "ea38a8f8-f28f-476d-bc14-72f5192de14b"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jun 03 01:10:14.158945 ip-10-0-138-55 kubenswrapper[2566]: I0603 01:10:14.158917 2566 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/ea38a8f8-f28f-476d-bc14-72f5192de14b-kube-api-access-5hfkr" (OuterVolumeSpecName: "kube-api-access-5hfkr") pod "ea38a8f8-f28f-476d-bc14-72f5192de14b" (UID: "ea38a8f8-f28f-476d-bc14-72f5192de14b"). InnerVolumeSpecName "kube-api-access-5hfkr". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 03 01:10:14.162249 ip-10-0-138-55 kubenswrapper[2566]: I0603 01:10:14.162207 2566 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/ea38a8f8-f28f-476d-bc14-72f5192de14b-util" (OuterVolumeSpecName: "util") pod "ea38a8f8-f28f-476d-bc14-72f5192de14b" (UID: "ea38a8f8-f28f-476d-bc14-72f5192de14b"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jun 03 01:10:14.258023 ip-10-0-138-55 kubenswrapper[2566]: I0603 01:10:14.257974 2566 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/ea38a8f8-f28f-476d-bc14-72f5192de14b-util\") on node \"ip-10-0-138-55.ec2.internal\" DevicePath \"\"" Jun 03 01:10:14.258023 ip-10-0-138-55 kubenswrapper[2566]: I0603 01:10:14.258020 2566 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-5hfkr\" (UniqueName: \"kubernetes.io/projected/ea38a8f8-f28f-476d-bc14-72f5192de14b-kube-api-access-5hfkr\") on node \"ip-10-0-138-55.ec2.internal\" DevicePath \"\"" Jun 03 01:10:14.258023 ip-10-0-138-55 kubenswrapper[2566]: I0603 01:10:14.258032 2566 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/ea38a8f8-f28f-476d-bc14-72f5192de14b-bundle\") on node \"ip-10-0-138-55.ec2.internal\" DevicePath \"\"" Jun 03 01:10:14.872009 ip-10-0-138-55 kubenswrapper[2566]: I0603 01:10:14.871968 2566 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/410e69f41462d9d02a48f76ad929b5f41ed146182df7ab38cf9ce4e1cdf79l7" event={"ID":"ea38a8f8-f28f-476d-bc14-72f5192de14b","Type":"ContainerDied","Data":"22ed68e6327270a908b86cac368fe37394c3e1a3a06aba578410a48265a65e7d"} Jun 03 01:10:14.872009 ip-10-0-138-55 kubenswrapper[2566]: I0603 01:10:14.872006 2566 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="22ed68e6327270a908b86cac368fe37394c3e1a3a06aba578410a48265a65e7d" Jun 03 01:10:14.872199 ip-10-0-138-55 kubenswrapper[2566]: I0603 01:10:14.872019 2566 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/410e69f41462d9d02a48f76ad929b5f41ed146182df7ab38cf9ce4e1cdf79l7" Jun 03 01:10:25.459756 ip-10-0-138-55 kubenswrapper[2566]: I0603 01:10:25.459722 2566 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-85b884ccf6-6j2kc"] Jun 03 01:10:25.460202 ip-10-0-138-55 kubenswrapper[2566]: I0603 01:10:25.460056 2566 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="ea38a8f8-f28f-476d-bc14-72f5192de14b" containerName="util" Jun 03 01:10:25.460202 ip-10-0-138-55 kubenswrapper[2566]: I0603 01:10:25.460066 2566 state_mem.go:107] "Deleted CPUSet assignment" podUID="ea38a8f8-f28f-476d-bc14-72f5192de14b" containerName="util" Jun 03 01:10:25.460202 ip-10-0-138-55 kubenswrapper[2566]: I0603 01:10:25.460077 2566 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="ea38a8f8-f28f-476d-bc14-72f5192de14b" containerName="extract" Jun 03 01:10:25.460202 ip-10-0-138-55 kubenswrapper[2566]: I0603 01:10:25.460083 2566 state_mem.go:107] "Deleted CPUSet assignment" podUID="ea38a8f8-f28f-476d-bc14-72f5192de14b" containerName="extract" Jun 03 01:10:25.460202 ip-10-0-138-55 kubenswrapper[2566]: I0603 01:10:25.460092 2566 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="ea38a8f8-f28f-476d-bc14-72f5192de14b" containerName="pull" Jun 03 01:10:25.460202 ip-10-0-138-55 kubenswrapper[2566]: I0603 01:10:25.460097 2566 state_mem.go:107] "Deleted CPUSet assignment" podUID="ea38a8f8-f28f-476d-bc14-72f5192de14b" containerName="pull" Jun 03 01:10:25.460202 ip-10-0-138-55 kubenswrapper[2566]: I0603 01:10:25.460158 2566 memory_manager.go:356] "RemoveStaleState removing state" podUID="ea38a8f8-f28f-476d-bc14-72f5192de14b" containerName="extract" Jun 03 01:10:25.463139 ip-10-0-138-55 kubenswrapper[2566]: I0603 01:10:25.463123 2566 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/opendatahub-operator-controller-manager-85b884ccf6-6j2kc" Jun 03 01:10:25.465096 ip-10-0-138-55 kubenswrapper[2566]: I0603 01:10:25.465070 2566 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"kube-root-ca.crt\"" Jun 03 01:10:25.465240 ip-10-0-138-55 kubenswrapper[2566]: I0603 01:10:25.465075 2566 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-webhook-cert\"" Jun 03 01:10:25.465488 ip-10-0-138-55 kubenswrapper[2566]: I0603 01:10:25.465468 2566 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"openshift-service-ca.crt\"" Jun 03 01:10:25.465565 ip-10-0-138-55 kubenswrapper[2566]: I0603 01:10:25.465473 2566 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-manager-service-cert\"" Jun 03 01:10:25.465565 ip-10-0-138-55 kubenswrapper[2566]: I0603 01:10:25.465505 2566 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-manager-dockercfg-l57z2\"" Jun 03 01:10:25.473748 ip-10-0-138-55 kubenswrapper[2566]: I0603 01:10:25.473723 2566 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-85b884ccf6-6j2kc"] Jun 03 01:10:25.556014 ip-10-0-138-55 kubenswrapper[2566]: I0603 01:10:25.555974 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/991aaba9-8623-4501-9e50-c19d4d89c7d1-manifests\") pod \"opendatahub-operator-controller-manager-85b884ccf6-6j2kc\" (UID: \"991aaba9-8623-4501-9e50-c19d4d89c7d1\") " pod="opendatahub/opendatahub-operator-controller-manager-85b884ccf6-6j2kc" Jun 03 01:10:25.556157 ip-10-0-138-55 kubenswrapper[2566]: I0603 01:10:25.556034 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/991aaba9-8623-4501-9e50-c19d4d89c7d1-webhook-cert\") pod \"opendatahub-operator-controller-manager-85b884ccf6-6j2kc\" (UID: \"991aaba9-8623-4501-9e50-c19d4d89c7d1\") " pod="opendatahub/opendatahub-operator-controller-manager-85b884ccf6-6j2kc" Jun 03 01:10:25.556157 ip-10-0-138-55 kubenswrapper[2566]: I0603 01:10:25.556083 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/991aaba9-8623-4501-9e50-c19d4d89c7d1-tmp\") pod \"opendatahub-operator-controller-manager-85b884ccf6-6j2kc\" (UID: \"991aaba9-8623-4501-9e50-c19d4d89c7d1\") " pod="opendatahub/opendatahub-operator-controller-manager-85b884ccf6-6j2kc" Jun 03 01:10:25.556157 ip-10-0-138-55 kubenswrapper[2566]: I0603 01:10:25.556114 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/991aaba9-8623-4501-9e50-c19d4d89c7d1-apiservice-cert\") pod \"opendatahub-operator-controller-manager-85b884ccf6-6j2kc\" (UID: \"991aaba9-8623-4501-9e50-c19d4d89c7d1\") " pod="opendatahub/opendatahub-operator-controller-manager-85b884ccf6-6j2kc" Jun 03 01:10:25.556157 ip-10-0-138-55 kubenswrapper[2566]: I0603 01:10:25.556141 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-lhbwd\" (UniqueName: \"kubernetes.io/projected/991aaba9-8623-4501-9e50-c19d4d89c7d1-kube-api-access-lhbwd\") pod \"opendatahub-operator-controller-manager-85b884ccf6-6j2kc\" (UID: \"991aaba9-8623-4501-9e50-c19d4d89c7d1\") " pod="opendatahub/opendatahub-operator-controller-manager-85b884ccf6-6j2kc" Jun 03 01:10:25.657043 ip-10-0-138-55 kubenswrapper[2566]: I0603 01:10:25.657007 2566 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/991aaba9-8623-4501-9e50-c19d4d89c7d1-tmp\") pod \"opendatahub-operator-controller-manager-85b884ccf6-6j2kc\" (UID: \"991aaba9-8623-4501-9e50-c19d4d89c7d1\") " pod="opendatahub/opendatahub-operator-controller-manager-85b884ccf6-6j2kc" Jun 03 01:10:25.657215 ip-10-0-138-55 kubenswrapper[2566]: I0603 01:10:25.657053 2566 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/991aaba9-8623-4501-9e50-c19d4d89c7d1-apiservice-cert\") pod \"opendatahub-operator-controller-manager-85b884ccf6-6j2kc\" (UID: \"991aaba9-8623-4501-9e50-c19d4d89c7d1\") " pod="opendatahub/opendatahub-operator-controller-manager-85b884ccf6-6j2kc" Jun 03 01:10:25.657215 ip-10-0-138-55 kubenswrapper[2566]: I0603 01:10:25.657081 2566 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-lhbwd\" (UniqueName: \"kubernetes.io/projected/991aaba9-8623-4501-9e50-c19d4d89c7d1-kube-api-access-lhbwd\") pod \"opendatahub-operator-controller-manager-85b884ccf6-6j2kc\" (UID: \"991aaba9-8623-4501-9e50-c19d4d89c7d1\") " pod="opendatahub/opendatahub-operator-controller-manager-85b884ccf6-6j2kc" Jun 03 01:10:25.657215 ip-10-0-138-55 kubenswrapper[2566]: I0603 01:10:25.657123 2566 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/991aaba9-8623-4501-9e50-c19d4d89c7d1-manifests\") pod \"opendatahub-operator-controller-manager-85b884ccf6-6j2kc\" (UID: \"991aaba9-8623-4501-9e50-c19d4d89c7d1\") " pod="opendatahub/opendatahub-operator-controller-manager-85b884ccf6-6j2kc" Jun 03 01:10:25.657215 ip-10-0-138-55 kubenswrapper[2566]: I0603 01:10:25.657152 2566 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/991aaba9-8623-4501-9e50-c19d4d89c7d1-webhook-cert\") pod \"opendatahub-operator-controller-manager-85b884ccf6-6j2kc\" (UID: \"991aaba9-8623-4501-9e50-c19d4d89c7d1\") " pod="opendatahub/opendatahub-operator-controller-manager-85b884ccf6-6j2kc" Jun 03 01:10:25.657576 ip-10-0-138-55 kubenswrapper[2566]: I0603 01:10:25.657545 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/991aaba9-8623-4501-9e50-c19d4d89c7d1-manifests\") pod \"opendatahub-operator-controller-manager-85b884ccf6-6j2kc\" (UID: \"991aaba9-8623-4501-9e50-c19d4d89c7d1\") " pod="opendatahub/opendatahub-operator-controller-manager-85b884ccf6-6j2kc" Jun 03 01:10:25.659534 ip-10-0-138-55 kubenswrapper[2566]: I0603 01:10:25.659512 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/991aaba9-8623-4501-9e50-c19d4d89c7d1-tmp\") pod \"opendatahub-operator-controller-manager-85b884ccf6-6j2kc\" (UID: \"991aaba9-8623-4501-9e50-c19d4d89c7d1\") " pod="opendatahub/opendatahub-operator-controller-manager-85b884ccf6-6j2kc" Jun 03 01:10:25.659654 ip-10-0-138-55 kubenswrapper[2566]: I0603 01:10:25.659589 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/991aaba9-8623-4501-9e50-c19d4d89c7d1-webhook-cert\") pod \"opendatahub-operator-controller-manager-85b884ccf6-6j2kc\" (UID: \"991aaba9-8623-4501-9e50-c19d4d89c7d1\") " pod="opendatahub/opendatahub-operator-controller-manager-85b884ccf6-6j2kc" Jun 03 01:10:25.659654 ip-10-0-138-55 kubenswrapper[2566]: I0603 01:10:25.659626 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/991aaba9-8623-4501-9e50-c19d4d89c7d1-apiservice-cert\") pod \"opendatahub-operator-controller-manager-85b884ccf6-6j2kc\" (UID: \"991aaba9-8623-4501-9e50-c19d4d89c7d1\") " pod="opendatahub/opendatahub-operator-controller-manager-85b884ccf6-6j2kc" Jun 03 01:10:25.664986 ip-10-0-138-55 kubenswrapper[2566]: I0603 01:10:25.664956 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-lhbwd\" (UniqueName: \"kubernetes.io/projected/991aaba9-8623-4501-9e50-c19d4d89c7d1-kube-api-access-lhbwd\") pod \"opendatahub-operator-controller-manager-85b884ccf6-6j2kc\" (UID: \"991aaba9-8623-4501-9e50-c19d4d89c7d1\") " pod="opendatahub/opendatahub-operator-controller-manager-85b884ccf6-6j2kc" Jun 03 01:10:25.774722 ip-10-0-138-55 kubenswrapper[2566]: I0603 01:10:25.774635 2566 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/opendatahub-operator-controller-manager-85b884ccf6-6j2kc" Jun 03 01:10:25.909327 ip-10-0-138-55 kubenswrapper[2566]: I0603 01:10:25.909296 2566 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-85b884ccf6-6j2kc"] Jun 03 01:10:25.911459 ip-10-0-138-55 kubenswrapper[2566]: W0603 01:10:25.911420 2566 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod991aaba9_8623_4501_9e50_c19d4d89c7d1.slice/crio-92c27ad5bd8259a816eba3b0475f814da11f9ce6cd79c8e8d6312187edce9994 WatchSource:0}: Error finding container 92c27ad5bd8259a816eba3b0475f814da11f9ce6cd79c8e8d6312187edce9994: Status 404 returned error can't find the container with id 92c27ad5bd8259a816eba3b0475f814da11f9ce6cd79c8e8d6312187edce9994 Jun 03 01:10:26.919636 ip-10-0-138-55 kubenswrapper[2566]: I0603 01:10:26.919594 2566 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-85b884ccf6-6j2kc" event={"ID":"991aaba9-8623-4501-9e50-c19d4d89c7d1","Type":"ContainerStarted","Data":"92c27ad5bd8259a816eba3b0475f814da11f9ce6cd79c8e8d6312187edce9994"} Jun 03 01:10:28.929450 ip-10-0-138-55 kubenswrapper[2566]: I0603 01:10:28.929407 2566 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-85b884ccf6-6j2kc" event={"ID":"991aaba9-8623-4501-9e50-c19d4d89c7d1","Type":"ContainerStarted","Data":"d4ae9d94d2d46fc9d184d9794f483a4d69ff65850deb4ea124c32a5cf4808307"} Jun 03 01:10:29.934351 ip-10-0-138-55 kubenswrapper[2566]: I0603 01:10:29.934315 2566 generic.go:358] "Generic (PLEG): container finished" podID="991aaba9-8623-4501-9e50-c19d4d89c7d1" containerID="d4ae9d94d2d46fc9d184d9794f483a4d69ff65850deb4ea124c32a5cf4808307" exitCode=0 Jun 03 01:10:29.934699 ip-10-0-138-55 kubenswrapper[2566]: I0603 01:10:29.934388 2566 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-85b884ccf6-6j2kc" event={"ID":"991aaba9-8623-4501-9e50-c19d4d89c7d1","Type":"ContainerDied","Data":"d4ae9d94d2d46fc9d184d9794f483a4d69ff65850deb4ea124c32a5cf4808307"} Jun 03 01:10:30.939365 ip-10-0-138-55 kubenswrapper[2566]: I0603 01:10:30.939330 2566 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-85b884ccf6-6j2kc" event={"ID":"991aaba9-8623-4501-9e50-c19d4d89c7d1","Type":"ContainerStarted","Data":"05ecbf3db5beb264e757fdb8ce60cd311266b11bad987505c84be65613f87369"} Jun 03 01:10:30.939770 ip-10-0-138-55 kubenswrapper[2566]: I0603 01:10:30.939470 2566 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/opendatahub-operator-controller-manager-85b884ccf6-6j2kc" Jun 03 01:10:30.960158 ip-10-0-138-55 kubenswrapper[2566]: I0603 01:10:30.960090 2566 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="opendatahub/opendatahub-operator-controller-manager-85b884ccf6-6j2kc" podStartSLOduration=1.597325117 podStartE2EDuration="5.960074191s" podCreationTimestamp="2026-06-03 01:10:25 +0000 UTC" firstStartedPulling="2026-06-03 01:10:25.913294867 +0000 UTC m=+349.060136794" lastFinishedPulling="2026-06-03 01:10:30.276043937 +0000 UTC m=+353.422885868" observedRunningTime="2026-06-03 01:10:30.957382361 +0000 UTC m=+354.104224306" watchObservedRunningTime="2026-06-03 01:10:30.960074191 +0000 UTC m=+354.106916138" Jun 03 01:10:41.944801 ip-10-0-138-55 kubenswrapper[2566]: I0603 01:10:41.944764 2566 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/opendatahub-operator-controller-manager-85b884ccf6-6j2kc" Jun 03 01:10:44.681807 ip-10-0-138-55 kubenswrapper[2566]: I0603 01:10:44.681770 2566 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["opendatahub/odh-model-controller-76588b95-dhfrn"] Jun 03 01:10:44.690602 ip-10-0-138-55 kubenswrapper[2566]: I0603 01:10:44.690580 2566 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/odh-model-controller-76588b95-dhfrn" Jun 03 01:10:44.692869 ip-10-0-138-55 kubenswrapper[2566]: I0603 01:10:44.692681 2566 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"odh-model-controller-dockercfg-jffdc\"" Jun 03 01:10:44.693102 ip-10-0-138-55 kubenswrapper[2566]: I0603 01:10:44.693075 2566 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"odh-model-controller-webhook-cert\"" Jun 03 01:10:44.695774 ip-10-0-138-55 kubenswrapper[2566]: I0603 01:10:44.695742 2566 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["opendatahub/odh-model-controller-76588b95-dhfrn"] Jun 03 01:10:44.719060 ip-10-0-138-55 kubenswrapper[2566]: I0603 01:10:44.719034 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/994f0858-424c-4dff-b6b6-974c5d51c82e-cert\") pod \"odh-model-controller-76588b95-dhfrn\" (UID: \"994f0858-424c-4dff-b6b6-974c5d51c82e\") " pod="opendatahub/odh-model-controller-76588b95-dhfrn" Jun 03 01:10:44.719187 ip-10-0-138-55 kubenswrapper[2566]: I0603 01:10:44.719099 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-jkhgj\" (UniqueName: \"kubernetes.io/projected/994f0858-424c-4dff-b6b6-974c5d51c82e-kube-api-access-jkhgj\") pod \"odh-model-controller-76588b95-dhfrn\" (UID: \"994f0858-424c-4dff-b6b6-974c5d51c82e\") " pod="opendatahub/odh-model-controller-76588b95-dhfrn" Jun 03 01:10:44.819887 ip-10-0-138-55 kubenswrapper[2566]: I0603 01:10:44.819846 2566 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-jkhgj\" (UniqueName: \"kubernetes.io/projected/994f0858-424c-4dff-b6b6-974c5d51c82e-kube-api-access-jkhgj\") pod \"odh-model-controller-76588b95-dhfrn\" (UID: \"994f0858-424c-4dff-b6b6-974c5d51c82e\") " pod="opendatahub/odh-model-controller-76588b95-dhfrn" Jun 03 01:10:44.820065 ip-10-0-138-55 kubenswrapper[2566]: I0603 01:10:44.819955 2566 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/994f0858-424c-4dff-b6b6-974c5d51c82e-cert\") pod \"odh-model-controller-76588b95-dhfrn\" (UID: \"994f0858-424c-4dff-b6b6-974c5d51c82e\") " pod="opendatahub/odh-model-controller-76588b95-dhfrn" Jun 03 01:10:44.820065 ip-10-0-138-55 kubenswrapper[2566]: E0603 01:10:44.820058 2566 secret.go:189] Couldn't get secret opendatahub/odh-model-controller-webhook-cert: secret "odh-model-controller-webhook-cert" not found Jun 03 01:10:44.820148 ip-10-0-138-55 kubenswrapper[2566]: E0603 01:10:44.820123 2566 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/994f0858-424c-4dff-b6b6-974c5d51c82e-cert podName:994f0858-424c-4dff-b6b6-974c5d51c82e nodeName:}" failed. No retries permitted until 2026-06-03 01:10:45.32010399 +0000 UTC m=+368.466945917 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "cert" (UniqueName: "kubernetes.io/secret/994f0858-424c-4dff-b6b6-974c5d51c82e-cert") pod "odh-model-controller-76588b95-dhfrn" (UID: "994f0858-424c-4dff-b6b6-974c5d51c82e") : secret "odh-model-controller-webhook-cert" not found Jun 03 01:10:44.839504 ip-10-0-138-55 kubenswrapper[2566]: I0603 01:10:44.839474 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-jkhgj\" (UniqueName: \"kubernetes.io/projected/994f0858-424c-4dff-b6b6-974c5d51c82e-kube-api-access-jkhgj\") pod \"odh-model-controller-76588b95-dhfrn\" (UID: \"994f0858-424c-4dff-b6b6-974c5d51c82e\") " pod="opendatahub/odh-model-controller-76588b95-dhfrn" Jun 03 01:10:45.173163 ip-10-0-138-55 kubenswrapper[2566]: I0603 01:10:45.173126 2566 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-lws-operator/lws-controller-manager-65c8c8d4bb-kksb4"] Jun 03 01:10:45.176831 ip-10-0-138-55 kubenswrapper[2566]: I0603 01:10:45.176810 2566 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-lws-operator/lws-controller-manager-65c8c8d4bb-kksb4" Jun 03 01:10:45.179089 ip-10-0-138-55 kubenswrapper[2566]: I0603 01:10:45.179062 2566 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-lws-operator\"/\"lws-manager-config\"" Jun 03 01:10:45.179640 ip-10-0-138-55 kubenswrapper[2566]: I0603 01:10:45.179619 2566 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-lws-operator\"/\"lws-controller-manager-dockercfg-kxfl9\"" Jun 03 01:10:45.179739 ip-10-0-138-55 kubenswrapper[2566]: I0603 01:10:45.179689 2566 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-lws-operator\"/\"webhook-server-cert\"" Jun 03 01:10:45.179979 ip-10-0-138-55 kubenswrapper[2566]: I0603 01:10:45.179954 2566 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-lws-operator\"/\"metrics-server-cert\"" Jun 03 01:10:45.180192 ip-10-0-138-55 kubenswrapper[2566]: I0603 01:10:45.180176 2566 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-lws-operator\"/\"openshift-service-ca.crt\"" Jun 03 01:10:45.180308 ip-10-0-138-55 kubenswrapper[2566]: I0603 01:10:45.180260 2566 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-lws-operator\"/\"kube-root-ca.crt\"" Jun 03 01:10:45.186774 ip-10-0-138-55 kubenswrapper[2566]: I0603 01:10:45.186748 2566 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-lws-operator/lws-controller-manager-65c8c8d4bb-kksb4"] Jun 03 01:10:45.224247 ip-10-0-138-55 kubenswrapper[2566]: I0603 01:10:45.224188 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-cert\" (UniqueName: \"kubernetes.io/secret/1c8fd408-3f6d-4d94-ada5-29cefbdab2dc-metrics-cert\") pod \"lws-controller-manager-65c8c8d4bb-kksb4\" (UID: \"1c8fd408-3f6d-4d94-ada5-29cefbdab2dc\") " pod="openshift-lws-operator/lws-controller-manager-65c8c8d4bb-kksb4" Jun 03 01:10:45.224436 ip-10-0-138-55 kubenswrapper[2566]: I0603 01:10:45.224252 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"manager-config\" (UniqueName: \"kubernetes.io/configmap/1c8fd408-3f6d-4d94-ada5-29cefbdab2dc-manager-config\") pod \"lws-controller-manager-65c8c8d4bb-kksb4\" (UID: \"1c8fd408-3f6d-4d94-ada5-29cefbdab2dc\") " pod="openshift-lws-operator/lws-controller-manager-65c8c8d4bb-kksb4" Jun 03 01:10:45.224436 ip-10-0-138-55 kubenswrapper[2566]: I0603 01:10:45.224393 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/1c8fd408-3f6d-4d94-ada5-29cefbdab2dc-cert\") pod \"lws-controller-manager-65c8c8d4bb-kksb4\" (UID: \"1c8fd408-3f6d-4d94-ada5-29cefbdab2dc\") " pod="openshift-lws-operator/lws-controller-manager-65c8c8d4bb-kksb4" Jun 03 01:10:45.224551 ip-10-0-138-55 kubenswrapper[2566]: I0603 01:10:45.224474 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-cl6cp\" (UniqueName: \"kubernetes.io/projected/1c8fd408-3f6d-4d94-ada5-29cefbdab2dc-kube-api-access-cl6cp\") pod \"lws-controller-manager-65c8c8d4bb-kksb4\" (UID: \"1c8fd408-3f6d-4d94-ada5-29cefbdab2dc\") " pod="openshift-lws-operator/lws-controller-manager-65c8c8d4bb-kksb4" Jun 03 01:10:45.325281 ip-10-0-138-55 kubenswrapper[2566]: I0603 01:10:45.325237 2566 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/994f0858-424c-4dff-b6b6-974c5d51c82e-cert\") pod \"odh-model-controller-76588b95-dhfrn\" (UID: \"994f0858-424c-4dff-b6b6-974c5d51c82e\") " pod="opendatahub/odh-model-controller-76588b95-dhfrn" Jun 03 01:10:45.325281 ip-10-0-138-55 kubenswrapper[2566]: I0603 01:10:45.325290 2566 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/1c8fd408-3f6d-4d94-ada5-29cefbdab2dc-cert\") pod \"lws-controller-manager-65c8c8d4bb-kksb4\" (UID: \"1c8fd408-3f6d-4d94-ada5-29cefbdab2dc\") " pod="openshift-lws-operator/lws-controller-manager-65c8c8d4bb-kksb4" Jun 03 01:10:45.325544 ip-10-0-138-55 kubenswrapper[2566]: I0603 01:10:45.325345 2566 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-cl6cp\" (UniqueName: \"kubernetes.io/projected/1c8fd408-3f6d-4d94-ada5-29cefbdab2dc-kube-api-access-cl6cp\") pod \"lws-controller-manager-65c8c8d4bb-kksb4\" (UID: \"1c8fd408-3f6d-4d94-ada5-29cefbdab2dc\") " pod="openshift-lws-operator/lws-controller-manager-65c8c8d4bb-kksb4" Jun 03 01:10:45.325544 ip-10-0-138-55 kubenswrapper[2566]: E0603 01:10:45.325368 2566 secret.go:189] Couldn't get secret opendatahub/odh-model-controller-webhook-cert: secret "odh-model-controller-webhook-cert" not found Jun 03 01:10:45.325544 ip-10-0-138-55 kubenswrapper[2566]: I0603 01:10:45.325398 2566 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-cert\" (UniqueName: \"kubernetes.io/secret/1c8fd408-3f6d-4d94-ada5-29cefbdab2dc-metrics-cert\") pod \"lws-controller-manager-65c8c8d4bb-kksb4\" (UID: \"1c8fd408-3f6d-4d94-ada5-29cefbdab2dc\") " pod="openshift-lws-operator/lws-controller-manager-65c8c8d4bb-kksb4" Jun 03 01:10:45.325544 ip-10-0-138-55 kubenswrapper[2566]: E0603 01:10:45.325443 2566 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/994f0858-424c-4dff-b6b6-974c5d51c82e-cert podName:994f0858-424c-4dff-b6b6-974c5d51c82e nodeName:}" failed. No retries permitted until 2026-06-03 01:10:46.325423937 +0000 UTC m=+369.472265861 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "cert" (UniqueName: "kubernetes.io/secret/994f0858-424c-4dff-b6b6-974c5d51c82e-cert") pod "odh-model-controller-76588b95-dhfrn" (UID: "994f0858-424c-4dff-b6b6-974c5d51c82e") : secret "odh-model-controller-webhook-cert" not found Jun 03 01:10:45.325544 ip-10-0-138-55 kubenswrapper[2566]: I0603 01:10:45.325464 2566 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"manager-config\" (UniqueName: \"kubernetes.io/configmap/1c8fd408-3f6d-4d94-ada5-29cefbdab2dc-manager-config\") pod \"lws-controller-manager-65c8c8d4bb-kksb4\" (UID: \"1c8fd408-3f6d-4d94-ada5-29cefbdab2dc\") " pod="openshift-lws-operator/lws-controller-manager-65c8c8d4bb-kksb4" Jun 03 01:10:45.326120 ip-10-0-138-55 kubenswrapper[2566]: I0603 01:10:45.326100 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"manager-config\" (UniqueName: \"kubernetes.io/configmap/1c8fd408-3f6d-4d94-ada5-29cefbdab2dc-manager-config\") pod \"lws-controller-manager-65c8c8d4bb-kksb4\" (UID: \"1c8fd408-3f6d-4d94-ada5-29cefbdab2dc\") " pod="openshift-lws-operator/lws-controller-manager-65c8c8d4bb-kksb4" Jun 03 01:10:45.327729 ip-10-0-138-55 kubenswrapper[2566]: I0603 01:10:45.327702 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-cert\" (UniqueName: \"kubernetes.io/secret/1c8fd408-3f6d-4d94-ada5-29cefbdab2dc-metrics-cert\") pod \"lws-controller-manager-65c8c8d4bb-kksb4\" (UID: \"1c8fd408-3f6d-4d94-ada5-29cefbdab2dc\") " pod="openshift-lws-operator/lws-controller-manager-65c8c8d4bb-kksb4" Jun 03 01:10:45.327861 ip-10-0-138-55 kubenswrapper[2566]: I0603 01:10:45.327793 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/1c8fd408-3f6d-4d94-ada5-29cefbdab2dc-cert\") pod \"lws-controller-manager-65c8c8d4bb-kksb4\" (UID: \"1c8fd408-3f6d-4d94-ada5-29cefbdab2dc\") " pod="openshift-lws-operator/lws-controller-manager-65c8c8d4bb-kksb4" Jun 03 01:10:45.332690 ip-10-0-138-55 kubenswrapper[2566]: I0603 01:10:45.332664 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-cl6cp\" (UniqueName: \"kubernetes.io/projected/1c8fd408-3f6d-4d94-ada5-29cefbdab2dc-kube-api-access-cl6cp\") pod \"lws-controller-manager-65c8c8d4bb-kksb4\" (UID: \"1c8fd408-3f6d-4d94-ada5-29cefbdab2dc\") " pod="openshift-lws-operator/lws-controller-manager-65c8c8d4bb-kksb4" Jun 03 01:10:45.489096 ip-10-0-138-55 kubenswrapper[2566]: I0603 01:10:45.489002 2566 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-lws-operator/lws-controller-manager-65c8c8d4bb-kksb4" Jun 03 01:10:45.645573 ip-10-0-138-55 kubenswrapper[2566]: I0603 01:10:45.645548 2566 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-lws-operator/lws-controller-manager-65c8c8d4bb-kksb4"] Jun 03 01:10:45.647701 ip-10-0-138-55 kubenswrapper[2566]: W0603 01:10:45.647677 2566 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod1c8fd408_3f6d_4d94_ada5_29cefbdab2dc.slice/crio-4006ade81e975c5a7ac8829079728b3eda53b16fb3f8a9a163f9e59bc2f411f7 WatchSource:0}: Error finding container 4006ade81e975c5a7ac8829079728b3eda53b16fb3f8a9a163f9e59bc2f411f7: Status 404 returned error can't find the container with id 4006ade81e975c5a7ac8829079728b3eda53b16fb3f8a9a163f9e59bc2f411f7 Jun 03 01:10:45.992294 ip-10-0-138-55 kubenswrapper[2566]: I0603 01:10:45.992258 2566 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-lws-operator/lws-controller-manager-65c8c8d4bb-kksb4" event={"ID":"1c8fd408-3f6d-4d94-ada5-29cefbdab2dc","Type":"ContainerStarted","Data":"4006ade81e975c5a7ac8829079728b3eda53b16fb3f8a9a163f9e59bc2f411f7"} Jun 03 01:10:46.335383 ip-10-0-138-55 kubenswrapper[2566]: I0603 01:10:46.335212 2566 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/994f0858-424c-4dff-b6b6-974c5d51c82e-cert\") pod \"odh-model-controller-76588b95-dhfrn\" (UID: \"994f0858-424c-4dff-b6b6-974c5d51c82e\") " pod="opendatahub/odh-model-controller-76588b95-dhfrn" Jun 03 01:10:46.338110 ip-10-0-138-55 kubenswrapper[2566]: I0603 01:10:46.338082 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/994f0858-424c-4dff-b6b6-974c5d51c82e-cert\") pod \"odh-model-controller-76588b95-dhfrn\" (UID: \"994f0858-424c-4dff-b6b6-974c5d51c82e\") " pod="opendatahub/odh-model-controller-76588b95-dhfrn" Jun 03 01:10:46.352557 ip-10-0-138-55 kubenswrapper[2566]: I0603 01:10:46.352528 2566 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-marketplace/4c892a6d2d8a57acbc49427d3a7d24e253bab25be2c607ef405d2c4835mbkl6"] Jun 03 01:10:46.356279 ip-10-0-138-55 kubenswrapper[2566]: I0603 01:10:46.356248 2566 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/4c892a6d2d8a57acbc49427d3a7d24e253bab25be2c607ef405d2c4835mbkl6" Jun 03 01:10:46.358414 ip-10-0-138-55 kubenswrapper[2566]: I0603 01:10:46.358290 2566 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-marketplace\"/\"default-dockercfg-xfvxj\"" Jun 03 01:10:46.358414 ip-10-0-138-55 kubenswrapper[2566]: I0603 01:10:46.358308 2566 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"openshift-service-ca.crt\"" Jun 03 01:10:46.358414 ip-10-0-138-55 kubenswrapper[2566]: I0603 01:10:46.358296 2566 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"kube-root-ca.crt\"" Jun 03 01:10:46.363305 ip-10-0-138-55 kubenswrapper[2566]: I0603 01:10:46.363278 2566 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/4c892a6d2d8a57acbc49427d3a7d24e253bab25be2c607ef405d2c4835mbkl6"] Jun 03 01:10:46.435945 ip-10-0-138-55 kubenswrapper[2566]: I0603 01:10:46.435910 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-xmzct\" (UniqueName: \"kubernetes.io/projected/5f24b89e-f32a-4f4b-b51e-226db4a3684b-kube-api-access-xmzct\") pod \"4c892a6d2d8a57acbc49427d3a7d24e253bab25be2c607ef405d2c4835mbkl6\" (UID: \"5f24b89e-f32a-4f4b-b51e-226db4a3684b\") " pod="openshift-marketplace/4c892a6d2d8a57acbc49427d3a7d24e253bab25be2c607ef405d2c4835mbkl6" Jun 03 01:10:46.436122 ip-10-0-138-55 kubenswrapper[2566]: I0603 01:10:46.435951 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/5f24b89e-f32a-4f4b-b51e-226db4a3684b-util\") pod \"4c892a6d2d8a57acbc49427d3a7d24e253bab25be2c607ef405d2c4835mbkl6\" (UID: \"5f24b89e-f32a-4f4b-b51e-226db4a3684b\") " pod="openshift-marketplace/4c892a6d2d8a57acbc49427d3a7d24e253bab25be2c607ef405d2c4835mbkl6" Jun 03 01:10:46.436122 ip-10-0-138-55 kubenswrapper[2566]: I0603 01:10:46.435984 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/5f24b89e-f32a-4f4b-b51e-226db4a3684b-bundle\") pod \"4c892a6d2d8a57acbc49427d3a7d24e253bab25be2c607ef405d2c4835mbkl6\" (UID: \"5f24b89e-f32a-4f4b-b51e-226db4a3684b\") " pod="openshift-marketplace/4c892a6d2d8a57acbc49427d3a7d24e253bab25be2c607ef405d2c4835mbkl6" Jun 03 01:10:46.503886 ip-10-0-138-55 kubenswrapper[2566]: I0603 01:10:46.503852 2566 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/odh-model-controller-76588b95-dhfrn" Jun 03 01:10:46.537333 ip-10-0-138-55 kubenswrapper[2566]: I0603 01:10:46.536824 2566 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-xmzct\" (UniqueName: \"kubernetes.io/projected/5f24b89e-f32a-4f4b-b51e-226db4a3684b-kube-api-access-xmzct\") pod \"4c892a6d2d8a57acbc49427d3a7d24e253bab25be2c607ef405d2c4835mbkl6\" (UID: \"5f24b89e-f32a-4f4b-b51e-226db4a3684b\") " pod="openshift-marketplace/4c892a6d2d8a57acbc49427d3a7d24e253bab25be2c607ef405d2c4835mbkl6" Jun 03 01:10:46.537333 ip-10-0-138-55 kubenswrapper[2566]: I0603 01:10:46.536881 2566 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/5f24b89e-f32a-4f4b-b51e-226db4a3684b-util\") pod \"4c892a6d2d8a57acbc49427d3a7d24e253bab25be2c607ef405d2c4835mbkl6\" (UID: \"5f24b89e-f32a-4f4b-b51e-226db4a3684b\") " pod="openshift-marketplace/4c892a6d2d8a57acbc49427d3a7d24e253bab25be2c607ef405d2c4835mbkl6" Jun 03 01:10:46.537333 ip-10-0-138-55 kubenswrapper[2566]: I0603 01:10:46.536925 2566 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/5f24b89e-f32a-4f4b-b51e-226db4a3684b-bundle\") pod \"4c892a6d2d8a57acbc49427d3a7d24e253bab25be2c607ef405d2c4835mbkl6\" (UID: \"5f24b89e-f32a-4f4b-b51e-226db4a3684b\") " pod="openshift-marketplace/4c892a6d2d8a57acbc49427d3a7d24e253bab25be2c607ef405d2c4835mbkl6" Jun 03 01:10:46.537606 ip-10-0-138-55 kubenswrapper[2566]: I0603 01:10:46.537396 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/5f24b89e-f32a-4f4b-b51e-226db4a3684b-util\") pod \"4c892a6d2d8a57acbc49427d3a7d24e253bab25be2c607ef405d2c4835mbkl6\" (UID: \"5f24b89e-f32a-4f4b-b51e-226db4a3684b\") " pod="openshift-marketplace/4c892a6d2d8a57acbc49427d3a7d24e253bab25be2c607ef405d2c4835mbkl6" Jun 03 01:10:46.537606 ip-10-0-138-55 kubenswrapper[2566]: I0603 01:10:46.537523 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/5f24b89e-f32a-4f4b-b51e-226db4a3684b-bundle\") pod \"4c892a6d2d8a57acbc49427d3a7d24e253bab25be2c607ef405d2c4835mbkl6\" (UID: \"5f24b89e-f32a-4f4b-b51e-226db4a3684b\") " pod="openshift-marketplace/4c892a6d2d8a57acbc49427d3a7d24e253bab25be2c607ef405d2c4835mbkl6" Jun 03 01:10:46.544881 ip-10-0-138-55 kubenswrapper[2566]: I0603 01:10:46.544825 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-xmzct\" (UniqueName: \"kubernetes.io/projected/5f24b89e-f32a-4f4b-b51e-226db4a3684b-kube-api-access-xmzct\") pod \"4c892a6d2d8a57acbc49427d3a7d24e253bab25be2c607ef405d2c4835mbkl6\" (UID: \"5f24b89e-f32a-4f4b-b51e-226db4a3684b\") " pod="openshift-marketplace/4c892a6d2d8a57acbc49427d3a7d24e253bab25be2c607ef405d2c4835mbkl6" Jun 03 01:10:46.669717 ip-10-0-138-55 kubenswrapper[2566]: I0603 01:10:46.669685 2566 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/4c892a6d2d8a57acbc49427d3a7d24e253bab25be2c607ef405d2c4835mbkl6" Jun 03 01:10:46.683533 ip-10-0-138-55 kubenswrapper[2566]: I0603 01:10:46.683482 2566 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["opendatahub/odh-model-controller-76588b95-dhfrn"] Jun 03 01:10:46.687085 ip-10-0-138-55 kubenswrapper[2566]: W0603 01:10:46.687047 2566 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod994f0858_424c_4dff_b6b6_974c5d51c82e.slice/crio-17dc0c7fe7877c0be3153213c3ebc286006d4b4f6f7b22f7167615cd58604e4a WatchSource:0}: Error finding container 17dc0c7fe7877c0be3153213c3ebc286006d4b4f6f7b22f7167615cd58604e4a: Status 404 returned error can't find the container with id 17dc0c7fe7877c0be3153213c3ebc286006d4b4f6f7b22f7167615cd58604e4a Jun 03 01:10:46.830208 ip-10-0-138-55 kubenswrapper[2566]: I0603 01:10:46.830180 2566 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/4c892a6d2d8a57acbc49427d3a7d24e253bab25be2c607ef405d2c4835mbkl6"] Jun 03 01:10:46.998125 ip-10-0-138-55 kubenswrapper[2566]: I0603 01:10:46.998027 2566 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="opendatahub/odh-model-controller-76588b95-dhfrn" event={"ID":"994f0858-424c-4dff-b6b6-974c5d51c82e","Type":"ContainerStarted","Data":"17dc0c7fe7877c0be3153213c3ebc286006d4b4f6f7b22f7167615cd58604e4a"} Jun 03 01:10:47.139381 ip-10-0-138-55 kubenswrapper[2566]: W0603 01:10:47.139340 2566 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod5f24b89e_f32a_4f4b_b51e_226db4a3684b.slice/crio-b2b641a66eb7b462944b28f07731ac086d121084d0dc11ac6b2f21623aa3d737 WatchSource:0}: Error finding container b2b641a66eb7b462944b28f07731ac086d121084d0dc11ac6b2f21623aa3d737: Status 404 returned error can't find the container with id b2b641a66eb7b462944b28f07731ac086d121084d0dc11ac6b2f21623aa3d737 Jun 03 01:10:48.004001 ip-10-0-138-55 kubenswrapper[2566]: I0603 01:10:48.003962 2566 generic.go:358] "Generic (PLEG): container finished" podID="5f24b89e-f32a-4f4b-b51e-226db4a3684b" containerID="7b3886c2ad3aa778477bfca41a97a7c1644d251caf52da12cf9cca3ce78a40c4" exitCode=0 Jun 03 01:10:48.004493 ip-10-0-138-55 kubenswrapper[2566]: I0603 01:10:48.004052 2566 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/4c892a6d2d8a57acbc49427d3a7d24e253bab25be2c607ef405d2c4835mbkl6" event={"ID":"5f24b89e-f32a-4f4b-b51e-226db4a3684b","Type":"ContainerDied","Data":"7b3886c2ad3aa778477bfca41a97a7c1644d251caf52da12cf9cca3ce78a40c4"} Jun 03 01:10:48.004493 ip-10-0-138-55 kubenswrapper[2566]: I0603 01:10:48.004098 2566 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/4c892a6d2d8a57acbc49427d3a7d24e253bab25be2c607ef405d2c4835mbkl6" event={"ID":"5f24b89e-f32a-4f4b-b51e-226db4a3684b","Type":"ContainerStarted","Data":"b2b641a66eb7b462944b28f07731ac086d121084d0dc11ac6b2f21623aa3d737"} Jun 03 01:10:48.005673 ip-10-0-138-55 kubenswrapper[2566]: I0603 01:10:48.005648 2566 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-lws-operator/lws-controller-manager-65c8c8d4bb-kksb4" event={"ID":"1c8fd408-3f6d-4d94-ada5-29cefbdab2dc","Type":"ContainerStarted","Data":"ac44fe9331000a421c5d93e446d2c710643fe3a90e1c692ee2c152f75ae295e9"} Jun 03 01:10:48.005869 ip-10-0-138-55 kubenswrapper[2566]: I0603 01:10:48.005810 2566 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-lws-operator/lws-controller-manager-65c8c8d4bb-kksb4" Jun 03 01:10:48.035073 ip-10-0-138-55 kubenswrapper[2566]: I0603 01:10:48.034981 2566 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-lws-operator/lws-controller-manager-65c8c8d4bb-kksb4" podStartSLOduration=1.4766783669999999 podStartE2EDuration="3.034952928s" podCreationTimestamp="2026-06-03 01:10:45 +0000 UTC" firstStartedPulling="2026-06-03 01:10:45.649580496 +0000 UTC m=+368.796422421" lastFinishedPulling="2026-06-03 01:10:47.207855057 +0000 UTC m=+370.354696982" observedRunningTime="2026-06-03 01:10:48.031627343 +0000 UTC m=+371.178469288" watchObservedRunningTime="2026-06-03 01:10:48.034952928 +0000 UTC m=+371.181794866" Jun 03 01:10:50.014609 ip-10-0-138-55 kubenswrapper[2566]: I0603 01:10:50.014571 2566 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="opendatahub/odh-model-controller-76588b95-dhfrn" event={"ID":"994f0858-424c-4dff-b6b6-974c5d51c82e","Type":"ContainerStarted","Data":"780e4c7aeefa43db57f28c879beee14295c12801997fa689f994085e3579361c"} Jun 03 01:10:50.015077 ip-10-0-138-55 kubenswrapper[2566]: I0603 01:10:50.014647 2566 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/odh-model-controller-76588b95-dhfrn" Jun 03 01:10:50.016257 ip-10-0-138-55 kubenswrapper[2566]: I0603 01:10:50.016214 2566 generic.go:358] "Generic (PLEG): container finished" podID="5f24b89e-f32a-4f4b-b51e-226db4a3684b" containerID="f859fed7ade22e774742a2a1ed6ae23ba996b989589780a4bd5566f2b072b975" exitCode=0 Jun 03 01:10:50.016374 ip-10-0-138-55 kubenswrapper[2566]: I0603 01:10:50.016254 2566 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/4c892a6d2d8a57acbc49427d3a7d24e253bab25be2c607ef405d2c4835mbkl6" event={"ID":"5f24b89e-f32a-4f4b-b51e-226db4a3684b","Type":"ContainerDied","Data":"f859fed7ade22e774742a2a1ed6ae23ba996b989589780a4bd5566f2b072b975"} Jun 03 01:10:50.030272 ip-10-0-138-55 kubenswrapper[2566]: I0603 01:10:50.030204 2566 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="opendatahub/odh-model-controller-76588b95-dhfrn" podStartSLOduration=2.897981836 podStartE2EDuration="6.030191523s" podCreationTimestamp="2026-06-03 01:10:44 +0000 UTC" firstStartedPulling="2026-06-03 01:10:46.68855182 +0000 UTC m=+369.835393756" lastFinishedPulling="2026-06-03 01:10:49.82076151 +0000 UTC m=+372.967603443" observedRunningTime="2026-06-03 01:10:50.027320057 +0000 UTC m=+373.174161996" watchObservedRunningTime="2026-06-03 01:10:50.030191523 +0000 UTC m=+373.177033469" Jun 03 01:10:51.022400 ip-10-0-138-55 kubenswrapper[2566]: I0603 01:10:51.022361 2566 generic.go:358] "Generic (PLEG): container finished" podID="5f24b89e-f32a-4f4b-b51e-226db4a3684b" containerID="0a7d578e2fc6a5672ae99606152d8eae2cf5cb7c67f5669a31853243786921ea" exitCode=0 Jun 03 01:10:51.022841 ip-10-0-138-55 kubenswrapper[2566]: I0603 01:10:51.022448 2566 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/4c892a6d2d8a57acbc49427d3a7d24e253bab25be2c607ef405d2c4835mbkl6" event={"ID":"5f24b89e-f32a-4f4b-b51e-226db4a3684b","Type":"ContainerDied","Data":"0a7d578e2fc6a5672ae99606152d8eae2cf5cb7c67f5669a31853243786921ea"} Jun 03 01:10:52.153698 ip-10-0-138-55 kubenswrapper[2566]: I0603 01:10:52.153674 2566 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/4c892a6d2d8a57acbc49427d3a7d24e253bab25be2c607ef405d2c4835mbkl6" Jun 03 01:10:52.297074 ip-10-0-138-55 kubenswrapper[2566]: I0603 01:10:52.296990 2566 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-xmzct\" (UniqueName: \"kubernetes.io/projected/5f24b89e-f32a-4f4b-b51e-226db4a3684b-kube-api-access-xmzct\") pod \"5f24b89e-f32a-4f4b-b51e-226db4a3684b\" (UID: \"5f24b89e-f32a-4f4b-b51e-226db4a3684b\") " Jun 03 01:10:52.297074 ip-10-0-138-55 kubenswrapper[2566]: I0603 01:10:52.297028 2566 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/5f24b89e-f32a-4f4b-b51e-226db4a3684b-util\") pod \"5f24b89e-f32a-4f4b-b51e-226db4a3684b\" (UID: \"5f24b89e-f32a-4f4b-b51e-226db4a3684b\") " Jun 03 01:10:52.297343 ip-10-0-138-55 kubenswrapper[2566]: I0603 01:10:52.297087 2566 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/5f24b89e-f32a-4f4b-b51e-226db4a3684b-bundle\") pod \"5f24b89e-f32a-4f4b-b51e-226db4a3684b\" (UID: \"5f24b89e-f32a-4f4b-b51e-226db4a3684b\") " Jun 03 01:10:52.297924 ip-10-0-138-55 kubenswrapper[2566]: I0603 01:10:52.297895 2566 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/5f24b89e-f32a-4f4b-b51e-226db4a3684b-bundle" (OuterVolumeSpecName: "bundle") pod "5f24b89e-f32a-4f4b-b51e-226db4a3684b" (UID: "5f24b89e-f32a-4f4b-b51e-226db4a3684b"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jun 03 01:10:52.299079 ip-10-0-138-55 kubenswrapper[2566]: I0603 01:10:52.299051 2566 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/5f24b89e-f32a-4f4b-b51e-226db4a3684b-kube-api-access-xmzct" (OuterVolumeSpecName: "kube-api-access-xmzct") pod "5f24b89e-f32a-4f4b-b51e-226db4a3684b" (UID: "5f24b89e-f32a-4f4b-b51e-226db4a3684b"). InnerVolumeSpecName "kube-api-access-xmzct". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 03 01:10:52.305213 ip-10-0-138-55 kubenswrapper[2566]: I0603 01:10:52.305163 2566 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/5f24b89e-f32a-4f4b-b51e-226db4a3684b-util" (OuterVolumeSpecName: "util") pod "5f24b89e-f32a-4f4b-b51e-226db4a3684b" (UID: "5f24b89e-f32a-4f4b-b51e-226db4a3684b"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jun 03 01:10:52.398025 ip-10-0-138-55 kubenswrapper[2566]: I0603 01:10:52.397977 2566 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-xmzct\" (UniqueName: \"kubernetes.io/projected/5f24b89e-f32a-4f4b-b51e-226db4a3684b-kube-api-access-xmzct\") on node \"ip-10-0-138-55.ec2.internal\" DevicePath \"\"" Jun 03 01:10:52.398025 ip-10-0-138-55 kubenswrapper[2566]: I0603 01:10:52.398021 2566 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/5f24b89e-f32a-4f4b-b51e-226db4a3684b-util\") on node \"ip-10-0-138-55.ec2.internal\" DevicePath \"\"" Jun 03 01:10:52.398025 ip-10-0-138-55 kubenswrapper[2566]: I0603 01:10:52.398030 2566 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/5f24b89e-f32a-4f4b-b51e-226db4a3684b-bundle\") on node \"ip-10-0-138-55.ec2.internal\" DevicePath \"\"" Jun 03 01:10:53.031993 ip-10-0-138-55 kubenswrapper[2566]: I0603 01:10:53.031960 2566 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/4c892a6d2d8a57acbc49427d3a7d24e253bab25be2c607ef405d2c4835mbkl6" Jun 03 01:10:53.031993 ip-10-0-138-55 kubenswrapper[2566]: I0603 01:10:53.031965 2566 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/4c892a6d2d8a57acbc49427d3a7d24e253bab25be2c607ef405d2c4835mbkl6" event={"ID":"5f24b89e-f32a-4f4b-b51e-226db4a3684b","Type":"ContainerDied","Data":"b2b641a66eb7b462944b28f07731ac086d121084d0dc11ac6b2f21623aa3d737"} Jun 03 01:10:53.031993 ip-10-0-138-55 kubenswrapper[2566]: I0603 01:10:53.031998 2566 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="b2b641a66eb7b462944b28f07731ac086d121084d0dc11ac6b2f21623aa3d737" Jun 03 01:10:59.012048 ip-10-0-138-55 kubenswrapper[2566]: I0603 01:10:59.012016 2566 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-lws-operator/lws-controller-manager-65c8c8d4bb-kksb4" Jun 03 01:11:01.025404 ip-10-0-138-55 kubenswrapper[2566]: I0603 01:11:01.025371 2566 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/odh-model-controller-76588b95-dhfrn" Jun 03 01:11:01.381939 ip-10-0-138-55 kubenswrapper[2566]: I0603 01:11:01.381903 2566 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-marketplace/c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762a9b4z7"] Jun 03 01:11:01.382418 ip-10-0-138-55 kubenswrapper[2566]: I0603 01:11:01.382403 2566 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="5f24b89e-f32a-4f4b-b51e-226db4a3684b" containerName="extract" Jun 03 01:11:01.382463 ip-10-0-138-55 kubenswrapper[2566]: I0603 01:11:01.382422 2566 state_mem.go:107] "Deleted CPUSet assignment" podUID="5f24b89e-f32a-4f4b-b51e-226db4a3684b" containerName="extract" Jun 03 01:11:01.382463 ip-10-0-138-55 kubenswrapper[2566]: I0603 01:11:01.382453 2566 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="5f24b89e-f32a-4f4b-b51e-226db4a3684b" containerName="pull" Jun 03 01:11:01.382538 ip-10-0-138-55 kubenswrapper[2566]: I0603 01:11:01.382463 2566 state_mem.go:107] "Deleted CPUSet assignment" podUID="5f24b89e-f32a-4f4b-b51e-226db4a3684b" containerName="pull" Jun 03 01:11:01.382538 ip-10-0-138-55 kubenswrapper[2566]: I0603 01:11:01.382484 2566 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="5f24b89e-f32a-4f4b-b51e-226db4a3684b" containerName="util" Jun 03 01:11:01.382538 ip-10-0-138-55 kubenswrapper[2566]: I0603 01:11:01.382491 2566 state_mem.go:107] "Deleted CPUSet assignment" podUID="5f24b89e-f32a-4f4b-b51e-226db4a3684b" containerName="util" Jun 03 01:11:01.382633 ip-10-0-138-55 kubenswrapper[2566]: I0603 01:11:01.382587 2566 memory_manager.go:356] "RemoveStaleState removing state" podUID="5f24b89e-f32a-4f4b-b51e-226db4a3684b" containerName="extract" Jun 03 01:11:01.389331 ip-10-0-138-55 kubenswrapper[2566]: I0603 01:11:01.389305 2566 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762a9b4z7" Jun 03 01:11:01.393824 ip-10-0-138-55 kubenswrapper[2566]: I0603 01:11:01.393210 2566 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-marketplace\"/\"default-dockercfg-xfvxj\"" Jun 03 01:11:01.393824 ip-10-0-138-55 kubenswrapper[2566]: I0603 01:11:01.393386 2566 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762a9b4z7"] Jun 03 01:11:01.393824 ip-10-0-138-55 kubenswrapper[2566]: I0603 01:11:01.393489 2566 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"openshift-service-ca.crt\"" Jun 03 01:11:01.393824 ip-10-0-138-55 kubenswrapper[2566]: I0603 01:11:01.393683 2566 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"kube-root-ca.crt\"" Jun 03 01:11:01.481282 ip-10-0-138-55 kubenswrapper[2566]: I0603 01:11:01.481241 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/358a6881-af4e-4cc6-86e3-16fbbcf3037f-bundle\") pod \"c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762a9b4z7\" (UID: \"358a6881-af4e-4cc6-86e3-16fbbcf3037f\") " pod="openshift-marketplace/c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762a9b4z7" Jun 03 01:11:01.481461 ip-10-0-138-55 kubenswrapper[2566]: I0603 01:11:01.481304 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/358a6881-af4e-4cc6-86e3-16fbbcf3037f-util\") pod \"c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762a9b4z7\" (UID: \"358a6881-af4e-4cc6-86e3-16fbbcf3037f\") " pod="openshift-marketplace/c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762a9b4z7" Jun 03 01:11:01.481461 ip-10-0-138-55 kubenswrapper[2566]: I0603 01:11:01.481446 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-k68gw\" (UniqueName: \"kubernetes.io/projected/358a6881-af4e-4cc6-86e3-16fbbcf3037f-kube-api-access-k68gw\") pod \"c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762a9b4z7\" (UID: \"358a6881-af4e-4cc6-86e3-16fbbcf3037f\") " pod="openshift-marketplace/c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762a9b4z7" Jun 03 01:11:01.582684 ip-10-0-138-55 kubenswrapper[2566]: I0603 01:11:01.582646 2566 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-k68gw\" (UniqueName: \"kubernetes.io/projected/358a6881-af4e-4cc6-86e3-16fbbcf3037f-kube-api-access-k68gw\") pod \"c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762a9b4z7\" (UID: \"358a6881-af4e-4cc6-86e3-16fbbcf3037f\") " pod="openshift-marketplace/c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762a9b4z7" Jun 03 01:11:01.582874 ip-10-0-138-55 kubenswrapper[2566]: I0603 01:11:01.582701 2566 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/358a6881-af4e-4cc6-86e3-16fbbcf3037f-bundle\") pod \"c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762a9b4z7\" (UID: \"358a6881-af4e-4cc6-86e3-16fbbcf3037f\") " pod="openshift-marketplace/c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762a9b4z7" Jun 03 01:11:01.582874 ip-10-0-138-55 kubenswrapper[2566]: I0603 01:11:01.582737 2566 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/358a6881-af4e-4cc6-86e3-16fbbcf3037f-util\") pod \"c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762a9b4z7\" (UID: \"358a6881-af4e-4cc6-86e3-16fbbcf3037f\") " pod="openshift-marketplace/c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762a9b4z7" Jun 03 01:11:01.583169 ip-10-0-138-55 kubenswrapper[2566]: I0603 01:11:01.583147 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/358a6881-af4e-4cc6-86e3-16fbbcf3037f-util\") pod \"c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762a9b4z7\" (UID: \"358a6881-af4e-4cc6-86e3-16fbbcf3037f\") " pod="openshift-marketplace/c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762a9b4z7" Jun 03 01:11:01.583208 ip-10-0-138-55 kubenswrapper[2566]: I0603 01:11:01.583171 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/358a6881-af4e-4cc6-86e3-16fbbcf3037f-bundle\") pod \"c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762a9b4z7\" (UID: \"358a6881-af4e-4cc6-86e3-16fbbcf3037f\") " pod="openshift-marketplace/c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762a9b4z7" Jun 03 01:11:01.596503 ip-10-0-138-55 kubenswrapper[2566]: I0603 01:11:01.596472 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-k68gw\" (UniqueName: \"kubernetes.io/projected/358a6881-af4e-4cc6-86e3-16fbbcf3037f-kube-api-access-k68gw\") pod \"c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762a9b4z7\" (UID: \"358a6881-af4e-4cc6-86e3-16fbbcf3037f\") " pod="openshift-marketplace/c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762a9b4z7" Jun 03 01:11:01.703413 ip-10-0-138-55 kubenswrapper[2566]: I0603 01:11:01.703327 2566 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762a9b4z7" Jun 03 01:11:01.866609 ip-10-0-138-55 kubenswrapper[2566]: I0603 01:11:01.866580 2566 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762a9b4z7"] Jun 03 01:11:01.869159 ip-10-0-138-55 kubenswrapper[2566]: W0603 01:11:01.869130 2566 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod358a6881_af4e_4cc6_86e3_16fbbcf3037f.slice/crio-029b85efe93f7dafac6060f056535232fedb8245623a7502f16fa0becabf7080 WatchSource:0}: Error finding container 029b85efe93f7dafac6060f056535232fedb8245623a7502f16fa0becabf7080: Status 404 returned error can't find the container with id 029b85efe93f7dafac6060f056535232fedb8245623a7502f16fa0becabf7080 Jun 03 01:11:02.066118 ip-10-0-138-55 kubenswrapper[2566]: I0603 01:11:02.066082 2566 generic.go:358] "Generic (PLEG): container finished" podID="358a6881-af4e-4cc6-86e3-16fbbcf3037f" containerID="c98e083c2637e56346368ef617f170dd04f26c6b41a56d20b0fbea32e926cb42" exitCode=0 Jun 03 01:11:02.066510 ip-10-0-138-55 kubenswrapper[2566]: I0603 01:11:02.066146 2566 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762a9b4z7" event={"ID":"358a6881-af4e-4cc6-86e3-16fbbcf3037f","Type":"ContainerDied","Data":"c98e083c2637e56346368ef617f170dd04f26c6b41a56d20b0fbea32e926cb42"} Jun 03 01:11:02.066510 ip-10-0-138-55 kubenswrapper[2566]: I0603 01:11:02.066181 2566 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762a9b4z7" event={"ID":"358a6881-af4e-4cc6-86e3-16fbbcf3037f","Type":"ContainerStarted","Data":"029b85efe93f7dafac6060f056535232fedb8245623a7502f16fa0becabf7080"} Jun 03 01:11:04.075670 ip-10-0-138-55 kubenswrapper[2566]: I0603 01:11:04.075630 2566 generic.go:358] "Generic (PLEG): container finished" podID="358a6881-af4e-4cc6-86e3-16fbbcf3037f" containerID="2b9590df45f8c85d58a00f407df6fb242d0ec68927514386d529f85bd6aaac96" exitCode=0 Jun 03 01:11:04.076065 ip-10-0-138-55 kubenswrapper[2566]: I0603 01:11:04.075715 2566 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762a9b4z7" event={"ID":"358a6881-af4e-4cc6-86e3-16fbbcf3037f","Type":"ContainerDied","Data":"2b9590df45f8c85d58a00f407df6fb242d0ec68927514386d529f85bd6aaac96"} Jun 03 01:11:05.081843 ip-10-0-138-55 kubenswrapper[2566]: I0603 01:11:05.081808 2566 generic.go:358] "Generic (PLEG): container finished" podID="358a6881-af4e-4cc6-86e3-16fbbcf3037f" containerID="778d6549b6b1b4ca1560538f0a9c684b38a9b2851fb430c761ba5dce2c3ecbf8" exitCode=0 Jun 03 01:11:05.082247 ip-10-0-138-55 kubenswrapper[2566]: I0603 01:11:05.081901 2566 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762a9b4z7" event={"ID":"358a6881-af4e-4cc6-86e3-16fbbcf3037f","Type":"ContainerDied","Data":"778d6549b6b1b4ca1560538f0a9c684b38a9b2851fb430c761ba5dce2c3ecbf8"} Jun 03 01:11:06.222963 ip-10-0-138-55 kubenswrapper[2566]: I0603 01:11:06.222939 2566 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762a9b4z7" Jun 03 01:11:06.324601 ip-10-0-138-55 kubenswrapper[2566]: I0603 01:11:06.324550 2566 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/358a6881-af4e-4cc6-86e3-16fbbcf3037f-bundle\") pod \"358a6881-af4e-4cc6-86e3-16fbbcf3037f\" (UID: \"358a6881-af4e-4cc6-86e3-16fbbcf3037f\") " Jun 03 01:11:06.324770 ip-10-0-138-55 kubenswrapper[2566]: I0603 01:11:06.324617 2566 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-k68gw\" (UniqueName: \"kubernetes.io/projected/358a6881-af4e-4cc6-86e3-16fbbcf3037f-kube-api-access-k68gw\") pod \"358a6881-af4e-4cc6-86e3-16fbbcf3037f\" (UID: \"358a6881-af4e-4cc6-86e3-16fbbcf3037f\") " Jun 03 01:11:06.324770 ip-10-0-138-55 kubenswrapper[2566]: I0603 01:11:06.324727 2566 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/358a6881-af4e-4cc6-86e3-16fbbcf3037f-util\") pod \"358a6881-af4e-4cc6-86e3-16fbbcf3037f\" (UID: \"358a6881-af4e-4cc6-86e3-16fbbcf3037f\") " Jun 03 01:11:06.325498 ip-10-0-138-55 kubenswrapper[2566]: I0603 01:11:06.325471 2566 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/358a6881-af4e-4cc6-86e3-16fbbcf3037f-bundle" (OuterVolumeSpecName: "bundle") pod "358a6881-af4e-4cc6-86e3-16fbbcf3037f" (UID: "358a6881-af4e-4cc6-86e3-16fbbcf3037f"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jun 03 01:11:06.326687 ip-10-0-138-55 kubenswrapper[2566]: I0603 01:11:06.326661 2566 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/358a6881-af4e-4cc6-86e3-16fbbcf3037f-kube-api-access-k68gw" (OuterVolumeSpecName: "kube-api-access-k68gw") pod "358a6881-af4e-4cc6-86e3-16fbbcf3037f" (UID: "358a6881-af4e-4cc6-86e3-16fbbcf3037f"). InnerVolumeSpecName "kube-api-access-k68gw". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 03 01:11:06.330043 ip-10-0-138-55 kubenswrapper[2566]: I0603 01:11:06.330009 2566 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/358a6881-af4e-4cc6-86e3-16fbbcf3037f-util" (OuterVolumeSpecName: "util") pod "358a6881-af4e-4cc6-86e3-16fbbcf3037f" (UID: "358a6881-af4e-4cc6-86e3-16fbbcf3037f"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jun 03 01:11:06.425945 ip-10-0-138-55 kubenswrapper[2566]: I0603 01:11:06.425912 2566 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/358a6881-af4e-4cc6-86e3-16fbbcf3037f-util\") on node \"ip-10-0-138-55.ec2.internal\" DevicePath \"\"" Jun 03 01:11:06.425945 ip-10-0-138-55 kubenswrapper[2566]: I0603 01:11:06.425944 2566 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/358a6881-af4e-4cc6-86e3-16fbbcf3037f-bundle\") on node \"ip-10-0-138-55.ec2.internal\" DevicePath \"\"" Jun 03 01:11:06.426136 ip-10-0-138-55 kubenswrapper[2566]: I0603 01:11:06.425953 2566 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-k68gw\" (UniqueName: \"kubernetes.io/projected/358a6881-af4e-4cc6-86e3-16fbbcf3037f-kube-api-access-k68gw\") on node \"ip-10-0-138-55.ec2.internal\" DevicePath \"\"" Jun 03 01:11:07.090663 ip-10-0-138-55 kubenswrapper[2566]: I0603 01:11:07.090635 2566 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762a9b4z7" Jun 03 01:11:07.090834 ip-10-0-138-55 kubenswrapper[2566]: I0603 01:11:07.090633 2566 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762a9b4z7" event={"ID":"358a6881-af4e-4cc6-86e3-16fbbcf3037f","Type":"ContainerDied","Data":"029b85efe93f7dafac6060f056535232fedb8245623a7502f16fa0becabf7080"} Jun 03 01:11:07.090834 ip-10-0-138-55 kubenswrapper[2566]: I0603 01:11:07.090762 2566 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="029b85efe93f7dafac6060f056535232fedb8245623a7502f16fa0becabf7080" Jun 03 01:11:18.854085 ip-10-0-138-55 kubenswrapper[2566]: I0603 01:11:18.854051 2566 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-ingress/data-science-gateway-data-science-gateway-class-686dffbf4b65ht8"] Jun 03 01:11:18.854587 ip-10-0-138-55 kubenswrapper[2566]: I0603 01:11:18.854419 2566 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="358a6881-af4e-4cc6-86e3-16fbbcf3037f" containerName="util" Jun 03 01:11:18.854587 ip-10-0-138-55 kubenswrapper[2566]: I0603 01:11:18.854431 2566 state_mem.go:107] "Deleted CPUSet assignment" podUID="358a6881-af4e-4cc6-86e3-16fbbcf3037f" containerName="util" Jun 03 01:11:18.854587 ip-10-0-138-55 kubenswrapper[2566]: I0603 01:11:18.854453 2566 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="358a6881-af4e-4cc6-86e3-16fbbcf3037f" containerName="pull" Jun 03 01:11:18.854587 ip-10-0-138-55 kubenswrapper[2566]: I0603 01:11:18.854460 2566 state_mem.go:107] "Deleted CPUSet assignment" podUID="358a6881-af4e-4cc6-86e3-16fbbcf3037f" containerName="pull" Jun 03 01:11:18.854587 ip-10-0-138-55 kubenswrapper[2566]: I0603 01:11:18.854469 2566 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="358a6881-af4e-4cc6-86e3-16fbbcf3037f" containerName="extract" Jun 03 01:11:18.854587 ip-10-0-138-55 kubenswrapper[2566]: I0603 01:11:18.854475 2566 state_mem.go:107] "Deleted CPUSet assignment" podUID="358a6881-af4e-4cc6-86e3-16fbbcf3037f" containerName="extract" Jun 03 01:11:18.854587 ip-10-0-138-55 kubenswrapper[2566]: I0603 01:11:18.854532 2566 memory_manager.go:356] "RemoveStaleState removing state" podUID="358a6881-af4e-4cc6-86e3-16fbbcf3037f" containerName="extract" Jun 03 01:11:18.857337 ip-10-0-138-55 kubenswrapper[2566]: I0603 01:11:18.857318 2566 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-686dffbf4b65ht8" Jun 03 01:11:18.860601 ip-10-0-138-55 kubenswrapper[2566]: I0603 01:11:18.860580 2566 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"data-science-gateway-data-science-gateway-class-dockercfg-wd8zs\"" Jun 03 01:11:18.860915 ip-10-0-138-55 kubenswrapper[2566]: I0603 01:11:18.860899 2566 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"openshift-gw-ca-root-cert\"" Jun 03 01:11:18.861219 ip-10-0-138-55 kubenswrapper[2566]: I0603 01:11:18.861196 2566 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"openshift-service-ca.crt\"" Jun 03 01:11:18.861401 ip-10-0-138-55 kubenswrapper[2566]: I0603 01:11:18.861383 2566 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"kube-root-ca.crt\"" Jun 03 01:11:18.870729 ip-10-0-138-55 kubenswrapper[2566]: I0603 01:11:18.870707 2566 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/data-science-gateway-data-science-gateway-class-686dffbf4b65ht8"] Jun 03 01:11:18.939163 ip-10-0-138-55 kubenswrapper[2566]: I0603 01:11:18.939131 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/8c6cb31a-08f6-48f5-a12b-651f0391e2ce-istio-envoy\") pod \"data-science-gateway-data-science-gateway-class-686dffbf4b65ht8\" (UID: \"8c6cb31a-08f6-48f5-a12b-651f0391e2ce\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-686dffbf4b65ht8" Jun 03 01:11:18.939163 ip-10-0-138-55 kubenswrapper[2566]: I0603 01:11:18.939172 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/8c6cb31a-08f6-48f5-a12b-651f0391e2ce-istio-token\") pod \"data-science-gateway-data-science-gateway-class-686dffbf4b65ht8\" (UID: \"8c6cb31a-08f6-48f5-a12b-651f0391e2ce\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-686dffbf4b65ht8" Jun 03 01:11:18.939385 ip-10-0-138-55 kubenswrapper[2566]: I0603 01:11:18.939196 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-gd2jr\" (UniqueName: \"kubernetes.io/projected/8c6cb31a-08f6-48f5-a12b-651f0391e2ce-kube-api-access-gd2jr\") pod \"data-science-gateway-data-science-gateway-class-686dffbf4b65ht8\" (UID: \"8c6cb31a-08f6-48f5-a12b-651f0391e2ce\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-686dffbf4b65ht8" Jun 03 01:11:18.939385 ip-10-0-138-55 kubenswrapper[2566]: I0603 01:11:18.939275 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/8c6cb31a-08f6-48f5-a12b-651f0391e2ce-credential-socket\") pod \"data-science-gateway-data-science-gateway-class-686dffbf4b65ht8\" (UID: \"8c6cb31a-08f6-48f5-a12b-651f0391e2ce\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-686dffbf4b65ht8" Jun 03 01:11:18.939385 ip-10-0-138-55 kubenswrapper[2566]: I0603 01:11:18.939299 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/8c6cb31a-08f6-48f5-a12b-651f0391e2ce-istiod-ca-cert\") pod \"data-science-gateway-data-science-gateway-class-686dffbf4b65ht8\" (UID: \"8c6cb31a-08f6-48f5-a12b-651f0391e2ce\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-686dffbf4b65ht8" Jun 03 01:11:18.939385 ip-10-0-138-55 kubenswrapper[2566]: I0603 01:11:18.939325 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/8c6cb31a-08f6-48f5-a12b-651f0391e2ce-istio-data\") pod \"data-science-gateway-data-science-gateway-class-686dffbf4b65ht8\" (UID: \"8c6cb31a-08f6-48f5-a12b-651f0391e2ce\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-686dffbf4b65ht8" Jun 03 01:11:18.939512 ip-10-0-138-55 kubenswrapper[2566]: I0603 01:11:18.939398 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/8c6cb31a-08f6-48f5-a12b-651f0391e2ce-workload-socket\") pod \"data-science-gateway-data-science-gateway-class-686dffbf4b65ht8\" (UID: \"8c6cb31a-08f6-48f5-a12b-651f0391e2ce\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-686dffbf4b65ht8" Jun 03 01:11:18.939512 ip-10-0-138-55 kubenswrapper[2566]: I0603 01:11:18.939485 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/8c6cb31a-08f6-48f5-a12b-651f0391e2ce-workload-certs\") pod \"data-science-gateway-data-science-gateway-class-686dffbf4b65ht8\" (UID: \"8c6cb31a-08f6-48f5-a12b-651f0391e2ce\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-686dffbf4b65ht8" Jun 03 01:11:18.939574 ip-10-0-138-55 kubenswrapper[2566]: I0603 01:11:18.939519 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/8c6cb31a-08f6-48f5-a12b-651f0391e2ce-istio-podinfo\") pod \"data-science-gateway-data-science-gateway-class-686dffbf4b65ht8\" (UID: \"8c6cb31a-08f6-48f5-a12b-651f0391e2ce\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-686dffbf4b65ht8" Jun 03 01:11:19.040314 ip-10-0-138-55 kubenswrapper[2566]: I0603 01:11:19.040282 2566 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/8c6cb31a-08f6-48f5-a12b-651f0391e2ce-workload-certs\") pod \"data-science-gateway-data-science-gateway-class-686dffbf4b65ht8\" (UID: \"8c6cb31a-08f6-48f5-a12b-651f0391e2ce\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-686dffbf4b65ht8" Jun 03 01:11:19.040539 ip-10-0-138-55 kubenswrapper[2566]: I0603 01:11:19.040325 2566 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/8c6cb31a-08f6-48f5-a12b-651f0391e2ce-istio-podinfo\") pod \"data-science-gateway-data-science-gateway-class-686dffbf4b65ht8\" (UID: \"8c6cb31a-08f6-48f5-a12b-651f0391e2ce\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-686dffbf4b65ht8" Jun 03 01:11:19.040539 ip-10-0-138-55 kubenswrapper[2566]: I0603 01:11:19.040354 2566 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/8c6cb31a-08f6-48f5-a12b-651f0391e2ce-istio-envoy\") pod \"data-science-gateway-data-science-gateway-class-686dffbf4b65ht8\" (UID: \"8c6cb31a-08f6-48f5-a12b-651f0391e2ce\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-686dffbf4b65ht8" Jun 03 01:11:19.040539 ip-10-0-138-55 kubenswrapper[2566]: I0603 01:11:19.040449 2566 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/8c6cb31a-08f6-48f5-a12b-651f0391e2ce-istio-token\") pod \"data-science-gateway-data-science-gateway-class-686dffbf4b65ht8\" (UID: \"8c6cb31a-08f6-48f5-a12b-651f0391e2ce\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-686dffbf4b65ht8" Jun 03 01:11:19.040539 ip-10-0-138-55 kubenswrapper[2566]: I0603 01:11:19.040480 2566 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-gd2jr\" (UniqueName: \"kubernetes.io/projected/8c6cb31a-08f6-48f5-a12b-651f0391e2ce-kube-api-access-gd2jr\") pod \"data-science-gateway-data-science-gateway-class-686dffbf4b65ht8\" (UID: \"8c6cb31a-08f6-48f5-a12b-651f0391e2ce\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-686dffbf4b65ht8" Jun 03 01:11:19.040539 ip-10-0-138-55 kubenswrapper[2566]: I0603 01:11:19.040504 2566 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/8c6cb31a-08f6-48f5-a12b-651f0391e2ce-credential-socket\") pod \"data-science-gateway-data-science-gateway-class-686dffbf4b65ht8\" (UID: \"8c6cb31a-08f6-48f5-a12b-651f0391e2ce\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-686dffbf4b65ht8" Jun 03 01:11:19.040539 ip-10-0-138-55 kubenswrapper[2566]: I0603 01:11:19.040525 2566 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/8c6cb31a-08f6-48f5-a12b-651f0391e2ce-istiod-ca-cert\") pod \"data-science-gateway-data-science-gateway-class-686dffbf4b65ht8\" (UID: \"8c6cb31a-08f6-48f5-a12b-651f0391e2ce\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-686dffbf4b65ht8" Jun 03 01:11:19.040906 ip-10-0-138-55 kubenswrapper[2566]: I0603 01:11:19.040557 2566 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/8c6cb31a-08f6-48f5-a12b-651f0391e2ce-istio-data\") pod \"data-science-gateway-data-science-gateway-class-686dffbf4b65ht8\" (UID: \"8c6cb31a-08f6-48f5-a12b-651f0391e2ce\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-686dffbf4b65ht8" Jun 03 01:11:19.040906 ip-10-0-138-55 kubenswrapper[2566]: I0603 01:11:19.040607 2566 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/8c6cb31a-08f6-48f5-a12b-651f0391e2ce-workload-socket\") pod \"data-science-gateway-data-science-gateway-class-686dffbf4b65ht8\" (UID: \"8c6cb31a-08f6-48f5-a12b-651f0391e2ce\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-686dffbf4b65ht8" Jun 03 01:11:19.040906 ip-10-0-138-55 kubenswrapper[2566]: I0603 01:11:19.040714 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/8c6cb31a-08f6-48f5-a12b-651f0391e2ce-workload-certs\") pod \"data-science-gateway-data-science-gateway-class-686dffbf4b65ht8\" (UID: \"8c6cb31a-08f6-48f5-a12b-651f0391e2ce\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-686dffbf4b65ht8" Jun 03 01:11:19.040906 ip-10-0-138-55 kubenswrapper[2566]: I0603 01:11:19.040816 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/8c6cb31a-08f6-48f5-a12b-651f0391e2ce-credential-socket\") pod \"data-science-gateway-data-science-gateway-class-686dffbf4b65ht8\" (UID: \"8c6cb31a-08f6-48f5-a12b-651f0391e2ce\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-686dffbf4b65ht8" Jun 03 01:11:19.041108 ip-10-0-138-55 kubenswrapper[2566]: I0603 01:11:19.040945 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/8c6cb31a-08f6-48f5-a12b-651f0391e2ce-workload-socket\") pod \"data-science-gateway-data-science-gateway-class-686dffbf4b65ht8\" (UID: \"8c6cb31a-08f6-48f5-a12b-651f0391e2ce\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-686dffbf4b65ht8" Jun 03 01:11:19.041108 ip-10-0-138-55 kubenswrapper[2566]: I0603 01:11:19.040955 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/8c6cb31a-08f6-48f5-a12b-651f0391e2ce-istio-data\") pod \"data-science-gateway-data-science-gateway-class-686dffbf4b65ht8\" (UID: \"8c6cb31a-08f6-48f5-a12b-651f0391e2ce\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-686dffbf4b65ht8" Jun 03 01:11:19.041332 ip-10-0-138-55 kubenswrapper[2566]: I0603 01:11:19.041311 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/8c6cb31a-08f6-48f5-a12b-651f0391e2ce-istiod-ca-cert\") pod \"data-science-gateway-data-science-gateway-class-686dffbf4b65ht8\" (UID: \"8c6cb31a-08f6-48f5-a12b-651f0391e2ce\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-686dffbf4b65ht8" Jun 03 01:11:19.042721 ip-10-0-138-55 kubenswrapper[2566]: I0603 01:11:19.042699 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/8c6cb31a-08f6-48f5-a12b-651f0391e2ce-istio-envoy\") pod \"data-science-gateway-data-science-gateway-class-686dffbf4b65ht8\" (UID: \"8c6cb31a-08f6-48f5-a12b-651f0391e2ce\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-686dffbf4b65ht8" Jun 03 01:11:19.042908 ip-10-0-138-55 kubenswrapper[2566]: I0603 01:11:19.042891 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/8c6cb31a-08f6-48f5-a12b-651f0391e2ce-istio-podinfo\") pod \"data-science-gateway-data-science-gateway-class-686dffbf4b65ht8\" (UID: \"8c6cb31a-08f6-48f5-a12b-651f0391e2ce\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-686dffbf4b65ht8" Jun 03 01:11:19.062307 ip-10-0-138-55 kubenswrapper[2566]: I0603 01:11:19.062283 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-gd2jr\" (UniqueName: \"kubernetes.io/projected/8c6cb31a-08f6-48f5-a12b-651f0391e2ce-kube-api-access-gd2jr\") pod \"data-science-gateway-data-science-gateway-class-686dffbf4b65ht8\" (UID: \"8c6cb31a-08f6-48f5-a12b-651f0391e2ce\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-686dffbf4b65ht8" Jun 03 01:11:19.062452 ip-10-0-138-55 kubenswrapper[2566]: I0603 01:11:19.062433 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/8c6cb31a-08f6-48f5-a12b-651f0391e2ce-istio-token\") pod \"data-science-gateway-data-science-gateway-class-686dffbf4b65ht8\" (UID: \"8c6cb31a-08f6-48f5-a12b-651f0391e2ce\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-686dffbf4b65ht8" Jun 03 01:11:19.168816 ip-10-0-138-55 kubenswrapper[2566]: I0603 01:11:19.168733 2566 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-686dffbf4b65ht8" Jun 03 01:11:19.297408 ip-10-0-138-55 kubenswrapper[2566]: I0603 01:11:19.297381 2566 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/data-science-gateway-data-science-gateway-class-686dffbf4b65ht8"] Jun 03 01:11:19.299426 ip-10-0-138-55 kubenswrapper[2566]: W0603 01:11:19.299397 2566 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod8c6cb31a_08f6_48f5_a12b_651f0391e2ce.slice/crio-700ad9c35db43db3517a241151319d8864d0462eca66da8beb1d3f03ff0fdfb7 WatchSource:0}: Error finding container 700ad9c35db43db3517a241151319d8864d0462eca66da8beb1d3f03ff0fdfb7: Status 404 returned error can't find the container with id 700ad9c35db43db3517a241151319d8864d0462eca66da8beb1d3f03ff0fdfb7 Jun 03 01:11:20.140637 ip-10-0-138-55 kubenswrapper[2566]: I0603 01:11:20.140598 2566 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-686dffbf4b65ht8" event={"ID":"8c6cb31a-08f6-48f5-a12b-651f0391e2ce","Type":"ContainerStarted","Data":"700ad9c35db43db3517a241151319d8864d0462eca66da8beb1d3f03ff0fdfb7"} Jun 03 01:11:24.681986 ip-10-0-138-55 kubenswrapper[2566]: I0603 01:11:24.681948 2566 kubelet_resources.go:45] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236224Ki","pods":"250"} Jun 03 01:11:24.682238 ip-10-0-138-55 kubenswrapper[2566]: I0603 01:11:24.682025 2566 kubelet_resources.go:45] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236224Ki","pods":"250"} Jun 03 01:11:24.682238 ip-10-0-138-55 kubenswrapper[2566]: I0603 01:11:24.682053 2566 kubelet_resources.go:45] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236224Ki","pods":"250"} Jun 03 01:11:25.163570 ip-10-0-138-55 kubenswrapper[2566]: I0603 01:11:25.163538 2566 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-686dffbf4b65ht8" event={"ID":"8c6cb31a-08f6-48f5-a12b-651f0391e2ce","Type":"ContainerStarted","Data":"c467b91cade9c891bfb1f6a1d2f0461fe871b975cdb217418ea4ccb4d47798bb"} Jun 03 01:11:25.169330 ip-10-0-138-55 kubenswrapper[2566]: I0603 01:11:25.169312 2566 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-686dffbf4b65ht8" Jun 03 01:11:25.173946 ip-10-0-138-55 kubenswrapper[2566]: I0603 01:11:25.173920 2566 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-686dffbf4b65ht8" Jun 03 01:11:25.184187 ip-10-0-138-55 kubenswrapper[2566]: I0603 01:11:25.184143 2566 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-686dffbf4b65ht8" podStartSLOduration=1.803744385 podStartE2EDuration="7.184129304s" podCreationTimestamp="2026-06-03 01:11:18 +0000 UTC" firstStartedPulling="2026-06-03 01:11:19.301314977 +0000 UTC m=+402.448156901" lastFinishedPulling="2026-06-03 01:11:24.681699893 +0000 UTC m=+407.828541820" observedRunningTime="2026-06-03 01:11:25.182044427 +0000 UTC m=+408.328886373" watchObservedRunningTime="2026-06-03 01:11:25.184129304 +0000 UTC m=+408.330971250" Jun 03 01:11:25.556552 ip-10-0-138-55 kubenswrapper[2566]: I0603 01:11:25.556466 2566 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["opendatahub/dashboard-redirect-86cc4fb5f5-fkwsp"] Jun 03 01:11:25.559211 ip-10-0-138-55 kubenswrapper[2566]: I0603 01:11:25.559185 2566 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/dashboard-redirect-86cc4fb5f5-fkwsp" Jun 03 01:11:25.561500 ip-10-0-138-55 kubenswrapper[2566]: I0603 01:11:25.561478 2566 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"default-dockercfg-4ptqm\"" Jun 03 01:11:25.561633 ip-10-0-138-55 kubenswrapper[2566]: I0603 01:11:25.561522 2566 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"dashboard-redirect-config\"" Jun 03 01:11:25.566374 ip-10-0-138-55 kubenswrapper[2566]: I0603 01:11:25.566337 2566 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["opendatahub/dashboard-redirect-86cc4fb5f5-fkwsp"] Jun 03 01:11:25.602337 ip-10-0-138-55 kubenswrapper[2566]: I0603 01:11:25.602303 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"redirect-config\" (UniqueName: \"kubernetes.io/configmap/6cc062c0-40a4-4d87-b1b0-c534e382d518-redirect-config\") pod \"dashboard-redirect-86cc4fb5f5-fkwsp\" (UID: \"6cc062c0-40a4-4d87-b1b0-c534e382d518\") " pod="opendatahub/dashboard-redirect-86cc4fb5f5-fkwsp" Jun 03 01:11:25.602496 ip-10-0-138-55 kubenswrapper[2566]: I0603 01:11:25.602343 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-p5rtl\" (UniqueName: \"kubernetes.io/projected/6cc062c0-40a4-4d87-b1b0-c534e382d518-kube-api-access-p5rtl\") pod \"dashboard-redirect-86cc4fb5f5-fkwsp\" (UID: \"6cc062c0-40a4-4d87-b1b0-c534e382d518\") " pod="opendatahub/dashboard-redirect-86cc4fb5f5-fkwsp" Jun 03 01:11:25.703499 ip-10-0-138-55 kubenswrapper[2566]: I0603 01:11:25.703463 2566 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"redirect-config\" (UniqueName: \"kubernetes.io/configmap/6cc062c0-40a4-4d87-b1b0-c534e382d518-redirect-config\") pod \"dashboard-redirect-86cc4fb5f5-fkwsp\" (UID: \"6cc062c0-40a4-4d87-b1b0-c534e382d518\") " pod="opendatahub/dashboard-redirect-86cc4fb5f5-fkwsp" Jun 03 01:11:25.703875 ip-10-0-138-55 kubenswrapper[2566]: I0603 01:11:25.703511 2566 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-p5rtl\" (UniqueName: \"kubernetes.io/projected/6cc062c0-40a4-4d87-b1b0-c534e382d518-kube-api-access-p5rtl\") pod \"dashboard-redirect-86cc4fb5f5-fkwsp\" (UID: \"6cc062c0-40a4-4d87-b1b0-c534e382d518\") " pod="opendatahub/dashboard-redirect-86cc4fb5f5-fkwsp" Jun 03 01:11:25.704282 ip-10-0-138-55 kubenswrapper[2566]: I0603 01:11:25.704261 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"redirect-config\" (UniqueName: \"kubernetes.io/configmap/6cc062c0-40a4-4d87-b1b0-c534e382d518-redirect-config\") pod \"dashboard-redirect-86cc4fb5f5-fkwsp\" (UID: \"6cc062c0-40a4-4d87-b1b0-c534e382d518\") " pod="opendatahub/dashboard-redirect-86cc4fb5f5-fkwsp" Jun 03 01:11:25.710299 ip-10-0-138-55 kubenswrapper[2566]: I0603 01:11:25.710267 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-p5rtl\" (UniqueName: \"kubernetes.io/projected/6cc062c0-40a4-4d87-b1b0-c534e382d518-kube-api-access-p5rtl\") pod \"dashboard-redirect-86cc4fb5f5-fkwsp\" (UID: \"6cc062c0-40a4-4d87-b1b0-c534e382d518\") " pod="opendatahub/dashboard-redirect-86cc4fb5f5-fkwsp" Jun 03 01:11:25.874336 ip-10-0-138-55 kubenswrapper[2566]: I0603 01:11:25.874296 2566 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/dashboard-redirect-86cc4fb5f5-fkwsp" Jun 03 01:11:26.002210 ip-10-0-138-55 kubenswrapper[2566]: I0603 01:11:26.002183 2566 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["opendatahub/dashboard-redirect-86cc4fb5f5-fkwsp"] Jun 03 01:11:26.003868 ip-10-0-138-55 kubenswrapper[2566]: W0603 01:11:26.003837 2566 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod6cc062c0_40a4_4d87_b1b0_c534e382d518.slice/crio-04e577cab9a39df9f168d99c485ecd0c82734cc7695784623ed123db8b53f043 WatchSource:0}: Error finding container 04e577cab9a39df9f168d99c485ecd0c82734cc7695784623ed123db8b53f043: Status 404 returned error can't find the container with id 04e577cab9a39df9f168d99c485ecd0c82734cc7695784623ed123db8b53f043 Jun 03 01:11:26.172154 ip-10-0-138-55 kubenswrapper[2566]: I0603 01:11:26.172068 2566 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="opendatahub/dashboard-redirect-86cc4fb5f5-fkwsp" event={"ID":"6cc062c0-40a4-4d87-b1b0-c534e382d518","Type":"ContainerStarted","Data":"04e577cab9a39df9f168d99c485ecd0c82734cc7695784623ed123db8b53f043"} Jun 03 01:11:26.172469 ip-10-0-138-55 kubenswrapper[2566]: I0603 01:11:26.172447 2566 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-686dffbf4b65ht8" Jun 03 01:11:26.173564 ip-10-0-138-55 kubenswrapper[2566]: I0603 01:11:26.173544 2566 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-686dffbf4b65ht8" Jun 03 01:11:30.187139 ip-10-0-138-55 kubenswrapper[2566]: I0603 01:11:30.187100 2566 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="opendatahub/dashboard-redirect-86cc4fb5f5-fkwsp" event={"ID":"6cc062c0-40a4-4d87-b1b0-c534e382d518","Type":"ContainerStarted","Data":"b66a3287f7c7d56060594bb914ca9a704fa4559350e817ad7b8a9bf7a2288c04"} Jun 03 01:11:30.204222 ip-10-0-138-55 kubenswrapper[2566]: I0603 01:11:30.204175 2566 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="opendatahub/dashboard-redirect-86cc4fb5f5-fkwsp" podStartSLOduration=1.4226456029999999 podStartE2EDuration="5.204160582s" podCreationTimestamp="2026-06-03 01:11:25 +0000 UTC" firstStartedPulling="2026-06-03 01:11:26.005476296 +0000 UTC m=+409.152318220" lastFinishedPulling="2026-06-03 01:11:29.786991272 +0000 UTC m=+412.933833199" observedRunningTime="2026-06-03 01:11:30.201760361 +0000 UTC m=+413.348602301" watchObservedRunningTime="2026-06-03 01:11:30.204160582 +0000 UTC m=+413.351002527" Jun 03 01:11:45.573763 ip-10-0-138-55 kubenswrapper[2566]: I0603 01:11:45.573725 2566 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["kuadrant-system/kuadrant-operator-catalog-h976h"] Jun 03 01:11:45.579105 ip-10-0-138-55 kubenswrapper[2566]: I0603 01:11:45.579081 2566 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-catalog-h976h" Jun 03 01:11:45.581216 ip-10-0-138-55 kubenswrapper[2566]: I0603 01:11:45.581189 2566 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"kuadrant-operator-catalog-dockercfg-67wnx\"" Jun 03 01:11:45.581216 ip-10-0-138-55 kubenswrapper[2566]: I0603 01:11:45.581203 2566 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"openshift-service-ca.crt\"" Jun 03 01:11:45.581710 ip-10-0-138-55 kubenswrapper[2566]: I0603 01:11:45.581694 2566 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"kube-root-ca.crt\"" Jun 03 01:11:45.585399 ip-10-0-138-55 kubenswrapper[2566]: I0603 01:11:45.585374 2566 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-catalog-h976h"] Jun 03 01:11:45.677383 ip-10-0-138-55 kubenswrapper[2566]: I0603 01:11:45.677351 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-dvtf8\" (UniqueName: \"kubernetes.io/projected/830ea846-a510-4d5e-bd63-7bd084fb0d86-kube-api-access-dvtf8\") pod \"kuadrant-operator-catalog-h976h\" (UID: \"830ea846-a510-4d5e-bd63-7bd084fb0d86\") " pod="kuadrant-system/kuadrant-operator-catalog-h976h" Jun 03 01:11:45.778569 ip-10-0-138-55 kubenswrapper[2566]: I0603 01:11:45.778534 2566 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-dvtf8\" (UniqueName: \"kubernetes.io/projected/830ea846-a510-4d5e-bd63-7bd084fb0d86-kube-api-access-dvtf8\") pod \"kuadrant-operator-catalog-h976h\" (UID: \"830ea846-a510-4d5e-bd63-7bd084fb0d86\") " pod="kuadrant-system/kuadrant-operator-catalog-h976h" Jun 03 01:11:45.785856 ip-10-0-138-55 kubenswrapper[2566]: I0603 01:11:45.785831 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-dvtf8\" (UniqueName: \"kubernetes.io/projected/830ea846-a510-4d5e-bd63-7bd084fb0d86-kube-api-access-dvtf8\") pod \"kuadrant-operator-catalog-h976h\" (UID: \"830ea846-a510-4d5e-bd63-7bd084fb0d86\") " pod="kuadrant-system/kuadrant-operator-catalog-h976h" Jun 03 01:11:45.890910 ip-10-0-138-55 kubenswrapper[2566]: I0603 01:11:45.890881 2566 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-catalog-h976h" Jun 03 01:11:45.942630 ip-10-0-138-55 kubenswrapper[2566]: I0603 01:11:45.942600 2566 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-catalog-h976h"] Jun 03 01:11:46.023270 ip-10-0-138-55 kubenswrapper[2566]: I0603 01:11:46.022278 2566 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-catalog-h976h"] Jun 03 01:11:46.150330 ip-10-0-138-55 kubenswrapper[2566]: I0603 01:11:46.150218 2566 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["kuadrant-system/kuadrant-operator-catalog-9qkhp"] Jun 03 01:11:46.155653 ip-10-0-138-55 kubenswrapper[2566]: I0603 01:11:46.155630 2566 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-catalog-9qkhp" Jun 03 01:11:46.159305 ip-10-0-138-55 kubenswrapper[2566]: I0603 01:11:46.159276 2566 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-catalog-9qkhp"] Jun 03 01:11:46.250290 ip-10-0-138-55 kubenswrapper[2566]: I0603 01:11:46.250254 2566 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-catalog-h976h" event={"ID":"830ea846-a510-4d5e-bd63-7bd084fb0d86","Type":"ContainerStarted","Data":"9181dc77b9b7f5da033a735f08b3ad58e4eb287fb35b0abaa133ceddfc046b43"} Jun 03 01:11:46.283487 ip-10-0-138-55 kubenswrapper[2566]: I0603 01:11:46.283451 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-ggc7s\" (UniqueName: \"kubernetes.io/projected/55e7c773-1677-4ea7-8d4c-cc50c7304932-kube-api-access-ggc7s\") pod \"kuadrant-operator-catalog-9qkhp\" (UID: \"55e7c773-1677-4ea7-8d4c-cc50c7304932\") " pod="kuadrant-system/kuadrant-operator-catalog-9qkhp" Jun 03 01:11:46.384387 ip-10-0-138-55 kubenswrapper[2566]: I0603 01:11:46.384348 2566 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-ggc7s\" (UniqueName: \"kubernetes.io/projected/55e7c773-1677-4ea7-8d4c-cc50c7304932-kube-api-access-ggc7s\") pod \"kuadrant-operator-catalog-9qkhp\" (UID: \"55e7c773-1677-4ea7-8d4c-cc50c7304932\") " pod="kuadrant-system/kuadrant-operator-catalog-9qkhp" Jun 03 01:11:46.392432 ip-10-0-138-55 kubenswrapper[2566]: I0603 01:11:46.392407 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-ggc7s\" (UniqueName: \"kubernetes.io/projected/55e7c773-1677-4ea7-8d4c-cc50c7304932-kube-api-access-ggc7s\") pod \"kuadrant-operator-catalog-9qkhp\" (UID: \"55e7c773-1677-4ea7-8d4c-cc50c7304932\") " pod="kuadrant-system/kuadrant-operator-catalog-9qkhp" Jun 03 01:11:46.466260 ip-10-0-138-55 kubenswrapper[2566]: I0603 01:11:46.466151 2566 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-catalog-9qkhp" Jun 03 01:11:46.599622 ip-10-0-138-55 kubenswrapper[2566]: I0603 01:11:46.599597 2566 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-catalog-9qkhp"] Jun 03 01:11:46.601437 ip-10-0-138-55 kubenswrapper[2566]: W0603 01:11:46.601407 2566 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod55e7c773_1677_4ea7_8d4c_cc50c7304932.slice/crio-bd5b8b07dc0a23fa53a0e41863098c4e098ab1f5da6425c0d19b7d560e4cfb5e WatchSource:0}: Error finding container bd5b8b07dc0a23fa53a0e41863098c4e098ab1f5da6425c0d19b7d560e4cfb5e: Status 404 returned error can't find the container with id bd5b8b07dc0a23fa53a0e41863098c4e098ab1f5da6425c0d19b7d560e4cfb5e Jun 03 01:11:47.256679 ip-10-0-138-55 kubenswrapper[2566]: I0603 01:11:47.256643 2566 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-catalog-9qkhp" event={"ID":"55e7c773-1677-4ea7-8d4c-cc50c7304932","Type":"ContainerStarted","Data":"bd5b8b07dc0a23fa53a0e41863098c4e098ab1f5da6425c0d19b7d560e4cfb5e"} Jun 03 01:11:49.266396 ip-10-0-138-55 kubenswrapper[2566]: I0603 01:11:49.266354 2566 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-catalog-9qkhp" event={"ID":"55e7c773-1677-4ea7-8d4c-cc50c7304932","Type":"ContainerStarted","Data":"b03dc08acd4e7758c89c17e701003f6d7d9c77889eee812755fd4675b9af5b4d"} Jun 03 01:11:49.267784 ip-10-0-138-55 kubenswrapper[2566]: I0603 01:11:49.267754 2566 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-catalog-h976h" event={"ID":"830ea846-a510-4d5e-bd63-7bd084fb0d86","Type":"ContainerStarted","Data":"c6d357bb50b0d43712d35abbab25bf8d774a438fddab03cd3d35694eaf3b4e0b"} Jun 03 01:11:49.267926 ip-10-0-138-55 kubenswrapper[2566]: I0603 01:11:49.267810 2566 kuberuntime_container.go:864] "Killing container with a grace period" pod="kuadrant-system/kuadrant-operator-catalog-h976h" podUID="830ea846-a510-4d5e-bd63-7bd084fb0d86" containerName="registry-server" containerID="cri-o://c6d357bb50b0d43712d35abbab25bf8d774a438fddab03cd3d35694eaf3b4e0b" gracePeriod=2 Jun 03 01:11:49.282322 ip-10-0-138-55 kubenswrapper[2566]: I0603 01:11:49.282277 2566 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="kuadrant-system/kuadrant-operator-catalog-9qkhp" podStartSLOduration=1.3652157169999999 podStartE2EDuration="3.282263684s" podCreationTimestamp="2026-06-03 01:11:46 +0000 UTC" firstStartedPulling="2026-06-03 01:11:46.602849685 +0000 UTC m=+429.749691609" lastFinishedPulling="2026-06-03 01:11:48.519897653 +0000 UTC m=+431.666739576" observedRunningTime="2026-06-03 01:11:49.279328556 +0000 UTC m=+432.426170502" watchObservedRunningTime="2026-06-03 01:11:49.282263684 +0000 UTC m=+432.429105629" Jun 03 01:11:49.292363 ip-10-0-138-55 kubenswrapper[2566]: I0603 01:11:49.292325 2566 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="kuadrant-system/kuadrant-operator-catalog-h976h" podStartSLOduration=1.800394628 podStartE2EDuration="4.292311207s" podCreationTimestamp="2026-06-03 01:11:45 +0000 UTC" firstStartedPulling="2026-06-03 01:11:46.025471681 +0000 UTC m=+429.172313615" lastFinishedPulling="2026-06-03 01:11:48.517388249 +0000 UTC m=+431.664230194" observedRunningTime="2026-06-03 01:11:49.291662114 +0000 UTC m=+432.438504062" watchObservedRunningTime="2026-06-03 01:11:49.292311207 +0000 UTC m=+432.439153152" Jun 03 01:11:49.520988 ip-10-0-138-55 kubenswrapper[2566]: I0603 01:11:49.520936 2566 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-catalog-h976h" Jun 03 01:11:49.615122 ip-10-0-138-55 kubenswrapper[2566]: I0603 01:11:49.615096 2566 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-dvtf8\" (UniqueName: \"kubernetes.io/projected/830ea846-a510-4d5e-bd63-7bd084fb0d86-kube-api-access-dvtf8\") pod \"830ea846-a510-4d5e-bd63-7bd084fb0d86\" (UID: \"830ea846-a510-4d5e-bd63-7bd084fb0d86\") " Jun 03 01:11:49.617270 ip-10-0-138-55 kubenswrapper[2566]: I0603 01:11:49.617246 2566 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/830ea846-a510-4d5e-bd63-7bd084fb0d86-kube-api-access-dvtf8" (OuterVolumeSpecName: "kube-api-access-dvtf8") pod "830ea846-a510-4d5e-bd63-7bd084fb0d86" (UID: "830ea846-a510-4d5e-bd63-7bd084fb0d86"). InnerVolumeSpecName "kube-api-access-dvtf8". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 03 01:11:49.716068 ip-10-0-138-55 kubenswrapper[2566]: I0603 01:11:49.716027 2566 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-dvtf8\" (UniqueName: \"kubernetes.io/projected/830ea846-a510-4d5e-bd63-7bd084fb0d86-kube-api-access-dvtf8\") on node \"ip-10-0-138-55.ec2.internal\" DevicePath \"\"" Jun 03 01:11:50.272809 ip-10-0-138-55 kubenswrapper[2566]: I0603 01:11:50.272773 2566 generic.go:358] "Generic (PLEG): container finished" podID="830ea846-a510-4d5e-bd63-7bd084fb0d86" containerID="c6d357bb50b0d43712d35abbab25bf8d774a438fddab03cd3d35694eaf3b4e0b" exitCode=0 Jun 03 01:11:50.273285 ip-10-0-138-55 kubenswrapper[2566]: I0603 01:11:50.272854 2566 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-catalog-h976h" Jun 03 01:11:50.273285 ip-10-0-138-55 kubenswrapper[2566]: I0603 01:11:50.272859 2566 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-catalog-h976h" event={"ID":"830ea846-a510-4d5e-bd63-7bd084fb0d86","Type":"ContainerDied","Data":"c6d357bb50b0d43712d35abbab25bf8d774a438fddab03cd3d35694eaf3b4e0b"} Jun 03 01:11:50.273285 ip-10-0-138-55 kubenswrapper[2566]: I0603 01:11:50.272901 2566 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-catalog-h976h" event={"ID":"830ea846-a510-4d5e-bd63-7bd084fb0d86","Type":"ContainerDied","Data":"9181dc77b9b7f5da033a735f08b3ad58e4eb287fb35b0abaa133ceddfc046b43"} Jun 03 01:11:50.273285 ip-10-0-138-55 kubenswrapper[2566]: I0603 01:11:50.272919 2566 scope.go:117] "RemoveContainer" containerID="c6d357bb50b0d43712d35abbab25bf8d774a438fddab03cd3d35694eaf3b4e0b" Jun 03 01:11:50.282710 ip-10-0-138-55 kubenswrapper[2566]: I0603 01:11:50.282692 2566 scope.go:117] "RemoveContainer" containerID="c6d357bb50b0d43712d35abbab25bf8d774a438fddab03cd3d35694eaf3b4e0b" Jun 03 01:11:50.282950 ip-10-0-138-55 kubenswrapper[2566]: E0603 01:11:50.282933 2566 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"c6d357bb50b0d43712d35abbab25bf8d774a438fddab03cd3d35694eaf3b4e0b\": container with ID starting with c6d357bb50b0d43712d35abbab25bf8d774a438fddab03cd3d35694eaf3b4e0b not found: ID does not exist" containerID="c6d357bb50b0d43712d35abbab25bf8d774a438fddab03cd3d35694eaf3b4e0b" Jun 03 01:11:50.282990 ip-10-0-138-55 kubenswrapper[2566]: I0603 01:11:50.282957 2566 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"c6d357bb50b0d43712d35abbab25bf8d774a438fddab03cd3d35694eaf3b4e0b"} err="failed to get container status \"c6d357bb50b0d43712d35abbab25bf8d774a438fddab03cd3d35694eaf3b4e0b\": rpc error: code = NotFound desc = could not find container \"c6d357bb50b0d43712d35abbab25bf8d774a438fddab03cd3d35694eaf3b4e0b\": container with ID starting with c6d357bb50b0d43712d35abbab25bf8d774a438fddab03cd3d35694eaf3b4e0b not found: ID does not exist" Jun 03 01:11:50.292968 ip-10-0-138-55 kubenswrapper[2566]: I0603 01:11:50.292947 2566 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-catalog-h976h"] Jun 03 01:11:50.296980 ip-10-0-138-55 kubenswrapper[2566]: I0603 01:11:50.296960 2566 kubelet.go:2547] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/kuadrant-operator-catalog-h976h"] Jun 03 01:11:51.591167 ip-10-0-138-55 kubenswrapper[2566]: I0603 01:11:51.591130 2566 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="830ea846-a510-4d5e-bd63-7bd084fb0d86" path="/var/lib/kubelet/pods/830ea846-a510-4d5e-bd63-7bd084fb0d86/volumes" Jun 03 01:11:56.467067 ip-10-0-138-55 kubenswrapper[2566]: I0603 01:11:56.466971 2566 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="kuadrant-system/kuadrant-operator-catalog-9qkhp" Jun 03 01:11:56.467067 ip-10-0-138-55 kubenswrapper[2566]: I0603 01:11:56.467011 2566 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/kuadrant-operator-catalog-9qkhp" Jun 03 01:11:56.490312 ip-10-0-138-55 kubenswrapper[2566]: I0603 01:11:56.490281 2566 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="started" pod="kuadrant-system/kuadrant-operator-catalog-9qkhp" Jun 03 01:11:57.323854 ip-10-0-138-55 kubenswrapper[2566]: I0603 01:11:57.323828 2566 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/kuadrant-operator-catalog-9qkhp" Jun 03 01:12:01.184353 ip-10-0-138-55 kubenswrapper[2566]: I0603 01:12:01.184318 2566 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73xr8xr"] Jun 03 01:12:01.184775 ip-10-0-138-55 kubenswrapper[2566]: I0603 01:12:01.184681 2566 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="830ea846-a510-4d5e-bd63-7bd084fb0d86" containerName="registry-server" Jun 03 01:12:01.184775 ip-10-0-138-55 kubenswrapper[2566]: I0603 01:12:01.184692 2566 state_mem.go:107] "Deleted CPUSet assignment" podUID="830ea846-a510-4d5e-bd63-7bd084fb0d86" containerName="registry-server" Jun 03 01:12:01.184775 ip-10-0-138-55 kubenswrapper[2566]: I0603 01:12:01.184768 2566 memory_manager.go:356] "RemoveStaleState removing state" podUID="830ea846-a510-4d5e-bd63-7bd084fb0d86" containerName="registry-server" Jun 03 01:12:01.195978 ip-10-0-138-55 kubenswrapper[2566]: I0603 01:12:01.195950 2566 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73xr8xr"] Jun 03 01:12:01.196133 ip-10-0-138-55 kubenswrapper[2566]: I0603 01:12:01.196090 2566 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73xr8xr" Jun 03 01:12:01.198264 ip-10-0-138-55 kubenswrapper[2566]: I0603 01:12:01.198245 2566 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"default-dockercfg-xl8l2\"" Jun 03 01:12:01.319650 ip-10-0-138-55 kubenswrapper[2566]: I0603 01:12:01.319615 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/eedc5d49-5a31-4c4f-9b41-08d311ea09de-util\") pod \"5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73xr8xr\" (UID: \"eedc5d49-5a31-4c4f-9b41-08d311ea09de\") " pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73xr8xr" Jun 03 01:12:01.319650 ip-10-0-138-55 kubenswrapper[2566]: I0603 01:12:01.319652 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-wshmh\" (UniqueName: \"kubernetes.io/projected/eedc5d49-5a31-4c4f-9b41-08d311ea09de-kube-api-access-wshmh\") pod \"5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73xr8xr\" (UID: \"eedc5d49-5a31-4c4f-9b41-08d311ea09de\") " pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73xr8xr" Jun 03 01:12:01.319856 ip-10-0-138-55 kubenswrapper[2566]: I0603 01:12:01.319734 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/eedc5d49-5a31-4c4f-9b41-08d311ea09de-bundle\") pod \"5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73xr8xr\" (UID: \"eedc5d49-5a31-4c4f-9b41-08d311ea09de\") " pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73xr8xr" Jun 03 01:12:01.421237 ip-10-0-138-55 kubenswrapper[2566]: I0603 01:12:01.421183 2566 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/eedc5d49-5a31-4c4f-9b41-08d311ea09de-bundle\") pod \"5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73xr8xr\" (UID: \"eedc5d49-5a31-4c4f-9b41-08d311ea09de\") " pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73xr8xr" Jun 03 01:12:01.421427 ip-10-0-138-55 kubenswrapper[2566]: I0603 01:12:01.421292 2566 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/eedc5d49-5a31-4c4f-9b41-08d311ea09de-util\") pod \"5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73xr8xr\" (UID: \"eedc5d49-5a31-4c4f-9b41-08d311ea09de\") " pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73xr8xr" Jun 03 01:12:01.421427 ip-10-0-138-55 kubenswrapper[2566]: I0603 01:12:01.421312 2566 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-wshmh\" (UniqueName: \"kubernetes.io/projected/eedc5d49-5a31-4c4f-9b41-08d311ea09de-kube-api-access-wshmh\") pod \"5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73xr8xr\" (UID: \"eedc5d49-5a31-4c4f-9b41-08d311ea09de\") " pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73xr8xr" Jun 03 01:12:01.421595 ip-10-0-138-55 kubenswrapper[2566]: I0603 01:12:01.421570 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/eedc5d49-5a31-4c4f-9b41-08d311ea09de-bundle\") pod \"5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73xr8xr\" (UID: \"eedc5d49-5a31-4c4f-9b41-08d311ea09de\") " pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73xr8xr" Jun 03 01:12:01.421683 ip-10-0-138-55 kubenswrapper[2566]: I0603 01:12:01.421662 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/eedc5d49-5a31-4c4f-9b41-08d311ea09de-util\") pod \"5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73xr8xr\" (UID: \"eedc5d49-5a31-4c4f-9b41-08d311ea09de\") " pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73xr8xr" Jun 03 01:12:01.430612 ip-10-0-138-55 kubenswrapper[2566]: I0603 01:12:01.430583 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-wshmh\" (UniqueName: \"kubernetes.io/projected/eedc5d49-5a31-4c4f-9b41-08d311ea09de-kube-api-access-wshmh\") pod \"5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73xr8xr\" (UID: \"eedc5d49-5a31-4c4f-9b41-08d311ea09de\") " pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73xr8xr" Jun 03 01:12:01.507788 ip-10-0-138-55 kubenswrapper[2566]: I0603 01:12:01.507701 2566 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73xr8xr" Jun 03 01:12:01.640496 ip-10-0-138-55 kubenswrapper[2566]: I0603 01:12:01.640454 2566 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73xr8xr"] Jun 03 01:12:01.641951 ip-10-0-138-55 kubenswrapper[2566]: W0603 01:12:01.641924 2566 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podeedc5d49_5a31_4c4f_9b41_08d311ea09de.slice/crio-1466f39c90dcf34869284bc4d2337a617e84092aea0ef58c10b6faaa60740137 WatchSource:0}: Error finding container 1466f39c90dcf34869284bc4d2337a617e84092aea0ef58c10b6faaa60740137: Status 404 returned error can't find the container with id 1466f39c90dcf34869284bc4d2337a617e84092aea0ef58c10b6faaa60740137 Jun 03 01:12:01.787236 ip-10-0-138-55 kubenswrapper[2566]: I0603 01:12:01.787146 2566 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1ffkt4"] Jun 03 01:12:01.790875 ip-10-0-138-55 kubenswrapper[2566]: I0603 01:12:01.790859 2566 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1ffkt4" Jun 03 01:12:01.796299 ip-10-0-138-55 kubenswrapper[2566]: I0603 01:12:01.796274 2566 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1ffkt4"] Jun 03 01:12:01.926009 ip-10-0-138-55 kubenswrapper[2566]: I0603 01:12:01.925960 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/51b4334f-89ac-4ec8-9e08-44748b1c05d0-bundle\") pod \"9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1ffkt4\" (UID: \"51b4334f-89ac-4ec8-9e08-44748b1c05d0\") " pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1ffkt4" Jun 03 01:12:01.926193 ip-10-0-138-55 kubenswrapper[2566]: I0603 01:12:01.926040 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-rfmw7\" (UniqueName: \"kubernetes.io/projected/51b4334f-89ac-4ec8-9e08-44748b1c05d0-kube-api-access-rfmw7\") pod \"9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1ffkt4\" (UID: \"51b4334f-89ac-4ec8-9e08-44748b1c05d0\") " pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1ffkt4" Jun 03 01:12:01.926193 ip-10-0-138-55 kubenswrapper[2566]: I0603 01:12:01.926065 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/51b4334f-89ac-4ec8-9e08-44748b1c05d0-util\") pod \"9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1ffkt4\" (UID: \"51b4334f-89ac-4ec8-9e08-44748b1c05d0\") " pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1ffkt4" Jun 03 01:12:02.027029 ip-10-0-138-55 kubenswrapper[2566]: I0603 01:12:02.026988 2566 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-rfmw7\" (UniqueName: \"kubernetes.io/projected/51b4334f-89ac-4ec8-9e08-44748b1c05d0-kube-api-access-rfmw7\") pod \"9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1ffkt4\" (UID: \"51b4334f-89ac-4ec8-9e08-44748b1c05d0\") " pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1ffkt4" Jun 03 01:12:02.027029 ip-10-0-138-55 kubenswrapper[2566]: I0603 01:12:02.027029 2566 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/51b4334f-89ac-4ec8-9e08-44748b1c05d0-util\") pod \"9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1ffkt4\" (UID: \"51b4334f-89ac-4ec8-9e08-44748b1c05d0\") " pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1ffkt4" Jun 03 01:12:02.027334 ip-10-0-138-55 kubenswrapper[2566]: I0603 01:12:02.027096 2566 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/51b4334f-89ac-4ec8-9e08-44748b1c05d0-bundle\") pod \"9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1ffkt4\" (UID: \"51b4334f-89ac-4ec8-9e08-44748b1c05d0\") " pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1ffkt4" Jun 03 01:12:02.027484 ip-10-0-138-55 kubenswrapper[2566]: I0603 01:12:02.027461 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/51b4334f-89ac-4ec8-9e08-44748b1c05d0-util\") pod \"9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1ffkt4\" (UID: \"51b4334f-89ac-4ec8-9e08-44748b1c05d0\") " pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1ffkt4" Jun 03 01:12:02.027532 ip-10-0-138-55 kubenswrapper[2566]: I0603 01:12:02.027487 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/51b4334f-89ac-4ec8-9e08-44748b1c05d0-bundle\") pod \"9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1ffkt4\" (UID: \"51b4334f-89ac-4ec8-9e08-44748b1c05d0\") " pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1ffkt4" Jun 03 01:12:02.034364 ip-10-0-138-55 kubenswrapper[2566]: I0603 01:12:02.034328 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-rfmw7\" (UniqueName: \"kubernetes.io/projected/51b4334f-89ac-4ec8-9e08-44748b1c05d0-kube-api-access-rfmw7\") pod \"9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1ffkt4\" (UID: \"51b4334f-89ac-4ec8-9e08-44748b1c05d0\") " pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1ffkt4" Jun 03 01:12:02.105979 ip-10-0-138-55 kubenswrapper[2566]: I0603 01:12:02.105949 2566 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1ffkt4" Jun 03 01:12:02.239277 ip-10-0-138-55 kubenswrapper[2566]: I0603 01:12:02.239252 2566 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1ffkt4"] Jun 03 01:12:02.241739 ip-10-0-138-55 kubenswrapper[2566]: W0603 01:12:02.241710 2566 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod51b4334f_89ac_4ec8_9e08_44748b1c05d0.slice/crio-5dd401cb904ebb7ea3627f5e211485c8ac09a8fb333e3cd4ca17b0da1d304ca3 WatchSource:0}: Error finding container 5dd401cb904ebb7ea3627f5e211485c8ac09a8fb333e3cd4ca17b0da1d304ca3: Status 404 returned error can't find the container with id 5dd401cb904ebb7ea3627f5e211485c8ac09a8fb333e3cd4ca17b0da1d304ca3 Jun 03 01:12:02.322772 ip-10-0-138-55 kubenswrapper[2566]: I0603 01:12:02.322735 2566 generic.go:358] "Generic (PLEG): container finished" podID="eedc5d49-5a31-4c4f-9b41-08d311ea09de" containerID="8a80b9bdfc7d38de5e2260db782074f8362a329a62f32436d56d2e667efa5fb8" exitCode=0 Jun 03 01:12:02.322958 ip-10-0-138-55 kubenswrapper[2566]: I0603 01:12:02.322811 2566 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73xr8xr" event={"ID":"eedc5d49-5a31-4c4f-9b41-08d311ea09de","Type":"ContainerDied","Data":"8a80b9bdfc7d38de5e2260db782074f8362a329a62f32436d56d2e667efa5fb8"} Jun 03 01:12:02.322958 ip-10-0-138-55 kubenswrapper[2566]: I0603 01:12:02.322851 2566 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73xr8xr" event={"ID":"eedc5d49-5a31-4c4f-9b41-08d311ea09de","Type":"ContainerStarted","Data":"1466f39c90dcf34869284bc4d2337a617e84092aea0ef58c10b6faaa60740137"} Jun 03 01:12:02.324405 ip-10-0-138-55 kubenswrapper[2566]: I0603 01:12:02.324375 2566 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1ffkt4" event={"ID":"51b4334f-89ac-4ec8-9e08-44748b1c05d0","Type":"ContainerStarted","Data":"3124d472d03f7537dd03d36e4d6ee9eb1b1a187571330d71643d8e9f0a6dedb7"} Jun 03 01:12:02.324509 ip-10-0-138-55 kubenswrapper[2566]: I0603 01:12:02.324413 2566 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1ffkt4" event={"ID":"51b4334f-89ac-4ec8-9e08-44748b1c05d0","Type":"ContainerStarted","Data":"5dd401cb904ebb7ea3627f5e211485c8ac09a8fb333e3cd4ca17b0da1d304ca3"} Jun 03 01:12:02.389423 ip-10-0-138-55 kubenswrapper[2566]: I0603 01:12:02.389342 2566 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759vg6nh"] Jun 03 01:12:02.393385 ip-10-0-138-55 kubenswrapper[2566]: I0603 01:12:02.393362 2566 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759vg6nh" Jun 03 01:12:02.401829 ip-10-0-138-55 kubenswrapper[2566]: I0603 01:12:02.401805 2566 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759vg6nh"] Jun 03 01:12:02.531471 ip-10-0-138-55 kubenswrapper[2566]: I0603 01:12:02.531426 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/d04b4880-a9b8-4143-bbe6-68dd52416e9c-bundle\") pod \"0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759vg6nh\" (UID: \"d04b4880-a9b8-4143-bbe6-68dd52416e9c\") " pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759vg6nh" Jun 03 01:12:02.531471 ip-10-0-138-55 kubenswrapper[2566]: I0603 01:12:02.531472 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/d04b4880-a9b8-4143-bbe6-68dd52416e9c-util\") pod \"0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759vg6nh\" (UID: \"d04b4880-a9b8-4143-bbe6-68dd52416e9c\") " pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759vg6nh" Jun 03 01:12:02.531694 ip-10-0-138-55 kubenswrapper[2566]: I0603 01:12:02.531501 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-j5b5j\" (UniqueName: \"kubernetes.io/projected/d04b4880-a9b8-4143-bbe6-68dd52416e9c-kube-api-access-j5b5j\") pod \"0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759vg6nh\" (UID: \"d04b4880-a9b8-4143-bbe6-68dd52416e9c\") " pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759vg6nh" Jun 03 01:12:02.632597 ip-10-0-138-55 kubenswrapper[2566]: I0603 01:12:02.632556 2566 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/d04b4880-a9b8-4143-bbe6-68dd52416e9c-bundle\") pod \"0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759vg6nh\" (UID: \"d04b4880-a9b8-4143-bbe6-68dd52416e9c\") " pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759vg6nh" Jun 03 01:12:02.632597 ip-10-0-138-55 kubenswrapper[2566]: I0603 01:12:02.632596 2566 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/d04b4880-a9b8-4143-bbe6-68dd52416e9c-util\") pod \"0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759vg6nh\" (UID: \"d04b4880-a9b8-4143-bbe6-68dd52416e9c\") " pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759vg6nh" Jun 03 01:12:02.632799 ip-10-0-138-55 kubenswrapper[2566]: I0603 01:12:02.632615 2566 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-j5b5j\" (UniqueName: \"kubernetes.io/projected/d04b4880-a9b8-4143-bbe6-68dd52416e9c-kube-api-access-j5b5j\") pod \"0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759vg6nh\" (UID: \"d04b4880-a9b8-4143-bbe6-68dd52416e9c\") " pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759vg6nh" Jun 03 01:12:02.633059 ip-10-0-138-55 kubenswrapper[2566]: I0603 01:12:02.633036 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/d04b4880-a9b8-4143-bbe6-68dd52416e9c-util\") pod \"0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759vg6nh\" (UID: \"d04b4880-a9b8-4143-bbe6-68dd52416e9c\") " pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759vg6nh" Jun 03 01:12:02.633059 ip-10-0-138-55 kubenswrapper[2566]: I0603 01:12:02.633047 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/d04b4880-a9b8-4143-bbe6-68dd52416e9c-bundle\") pod \"0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759vg6nh\" (UID: \"d04b4880-a9b8-4143-bbe6-68dd52416e9c\") " pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759vg6nh" Jun 03 01:12:02.641622 ip-10-0-138-55 kubenswrapper[2566]: I0603 01:12:02.641557 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-j5b5j\" (UniqueName: \"kubernetes.io/projected/d04b4880-a9b8-4143-bbe6-68dd52416e9c-kube-api-access-j5b5j\") pod \"0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759vg6nh\" (UID: \"d04b4880-a9b8-4143-bbe6-68dd52416e9c\") " pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759vg6nh" Jun 03 01:12:02.704135 ip-10-0-138-55 kubenswrapper[2566]: I0603 01:12:02.704087 2566 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759vg6nh" Jun 03 01:12:02.789047 ip-10-0-138-55 kubenswrapper[2566]: I0603 01:12:02.789010 2566 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0rjwj4"] Jun 03 01:12:02.795009 ip-10-0-138-55 kubenswrapper[2566]: I0603 01:12:02.794980 2566 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0rjwj4" Jun 03 01:12:02.801999 ip-10-0-138-55 kubenswrapper[2566]: I0603 01:12:02.801964 2566 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0rjwj4"] Jun 03 01:12:02.841799 ip-10-0-138-55 kubenswrapper[2566]: I0603 01:12:02.841750 2566 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759vg6nh"] Jun 03 01:12:02.843817 ip-10-0-138-55 kubenswrapper[2566]: W0603 01:12:02.843779 2566 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podd04b4880_a9b8_4143_bbe6_68dd52416e9c.slice/crio-c1d63bd88453e4e88b49fffa0e7ac99797eb6f56567ab89d8ed2e2c570eaa058 WatchSource:0}: Error finding container c1d63bd88453e4e88b49fffa0e7ac99797eb6f56567ab89d8ed2e2c570eaa058: Status 404 returned error can't find the container with id c1d63bd88453e4e88b49fffa0e7ac99797eb6f56567ab89d8ed2e2c570eaa058 Jun 03 01:12:02.935043 ip-10-0-138-55 kubenswrapper[2566]: I0603 01:12:02.935011 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/05cdd465-123d-4ae4-8a24-fe0679cd2dcf-util\") pod \"19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0rjwj4\" (UID: \"05cdd465-123d-4ae4-8a24-fe0679cd2dcf\") " pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0rjwj4" Jun 03 01:12:02.935219 ip-10-0-138-55 kubenswrapper[2566]: I0603 01:12:02.935098 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/05cdd465-123d-4ae4-8a24-fe0679cd2dcf-bundle\") pod \"19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0rjwj4\" (UID: \"05cdd465-123d-4ae4-8a24-fe0679cd2dcf\") " pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0rjwj4" Jun 03 01:12:02.935219 ip-10-0-138-55 kubenswrapper[2566]: I0603 01:12:02.935128 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-fnr7f\" (UniqueName: \"kubernetes.io/projected/05cdd465-123d-4ae4-8a24-fe0679cd2dcf-kube-api-access-fnr7f\") pod \"19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0rjwj4\" (UID: \"05cdd465-123d-4ae4-8a24-fe0679cd2dcf\") " pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0rjwj4" Jun 03 01:12:03.036647 ip-10-0-138-55 kubenswrapper[2566]: I0603 01:12:03.036608 2566 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/05cdd465-123d-4ae4-8a24-fe0679cd2dcf-bundle\") pod \"19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0rjwj4\" (UID: \"05cdd465-123d-4ae4-8a24-fe0679cd2dcf\") " pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0rjwj4" Jun 03 01:12:03.036825 ip-10-0-138-55 kubenswrapper[2566]: I0603 01:12:03.036670 2566 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-fnr7f\" (UniqueName: \"kubernetes.io/projected/05cdd465-123d-4ae4-8a24-fe0679cd2dcf-kube-api-access-fnr7f\") pod \"19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0rjwj4\" (UID: \"05cdd465-123d-4ae4-8a24-fe0679cd2dcf\") " pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0rjwj4" Jun 03 01:12:03.036825 ip-10-0-138-55 kubenswrapper[2566]: I0603 01:12:03.036726 2566 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/05cdd465-123d-4ae4-8a24-fe0679cd2dcf-util\") pod \"19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0rjwj4\" (UID: \"05cdd465-123d-4ae4-8a24-fe0679cd2dcf\") " pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0rjwj4" Jun 03 01:12:03.037078 ip-10-0-138-55 kubenswrapper[2566]: I0603 01:12:03.037054 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/05cdd465-123d-4ae4-8a24-fe0679cd2dcf-bundle\") pod \"19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0rjwj4\" (UID: \"05cdd465-123d-4ae4-8a24-fe0679cd2dcf\") " pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0rjwj4" Jun 03 01:12:03.037117 ip-10-0-138-55 kubenswrapper[2566]: I0603 01:12:03.037085 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/05cdd465-123d-4ae4-8a24-fe0679cd2dcf-util\") pod \"19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0rjwj4\" (UID: \"05cdd465-123d-4ae4-8a24-fe0679cd2dcf\") " pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0rjwj4" Jun 03 01:12:03.044762 ip-10-0-138-55 kubenswrapper[2566]: I0603 01:12:03.044735 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-fnr7f\" (UniqueName: \"kubernetes.io/projected/05cdd465-123d-4ae4-8a24-fe0679cd2dcf-kube-api-access-fnr7f\") pod \"19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0rjwj4\" (UID: \"05cdd465-123d-4ae4-8a24-fe0679cd2dcf\") " pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0rjwj4" Jun 03 01:12:03.108632 ip-10-0-138-55 kubenswrapper[2566]: I0603 01:12:03.108599 2566 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0rjwj4" Jun 03 01:12:03.289543 ip-10-0-138-55 kubenswrapper[2566]: I0603 01:12:03.289516 2566 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0rjwj4"] Jun 03 01:12:03.302362 ip-10-0-138-55 kubenswrapper[2566]: W0603 01:12:03.302327 2566 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod05cdd465_123d_4ae4_8a24_fe0679cd2dcf.slice/crio-652959631c6b5a3ae6955c5ef847ff27fdc92f09dd341d966f350b63c1017a95 WatchSource:0}: Error finding container 652959631c6b5a3ae6955c5ef847ff27fdc92f09dd341d966f350b63c1017a95: Status 404 returned error can't find the container with id 652959631c6b5a3ae6955c5ef847ff27fdc92f09dd341d966f350b63c1017a95 Jun 03 01:12:03.329310 ip-10-0-138-55 kubenswrapper[2566]: I0603 01:12:03.329278 2566 generic.go:358] "Generic (PLEG): container finished" podID="51b4334f-89ac-4ec8-9e08-44748b1c05d0" containerID="3124d472d03f7537dd03d36e4d6ee9eb1b1a187571330d71643d8e9f0a6dedb7" exitCode=0 Jun 03 01:12:03.329429 ip-10-0-138-55 kubenswrapper[2566]: I0603 01:12:03.329368 2566 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1ffkt4" event={"ID":"51b4334f-89ac-4ec8-9e08-44748b1c05d0","Type":"ContainerDied","Data":"3124d472d03f7537dd03d36e4d6ee9eb1b1a187571330d71643d8e9f0a6dedb7"} Jun 03 01:12:03.330950 ip-10-0-138-55 kubenswrapper[2566]: I0603 01:12:03.330924 2566 generic.go:358] "Generic (PLEG): container finished" podID="eedc5d49-5a31-4c4f-9b41-08d311ea09de" containerID="c6d94e17aff8e790e4ce5e903068ba7292f652818b5563467d85517817fba10b" exitCode=0 Jun 03 01:12:03.331054 ip-10-0-138-55 kubenswrapper[2566]: I0603 01:12:03.331003 2566 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73xr8xr" event={"ID":"eedc5d49-5a31-4c4f-9b41-08d311ea09de","Type":"ContainerDied","Data":"c6d94e17aff8e790e4ce5e903068ba7292f652818b5563467d85517817fba10b"} Jun 03 01:12:03.332575 ip-10-0-138-55 kubenswrapper[2566]: I0603 01:12:03.332549 2566 generic.go:358] "Generic (PLEG): container finished" podID="d04b4880-a9b8-4143-bbe6-68dd52416e9c" containerID="88429af1d9a580b47cfdda5c8ed823fe94232cecc17365616e015a3e9f605825" exitCode=0 Jun 03 01:12:03.332775 ip-10-0-138-55 kubenswrapper[2566]: I0603 01:12:03.332600 2566 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759vg6nh" event={"ID":"d04b4880-a9b8-4143-bbe6-68dd52416e9c","Type":"ContainerDied","Data":"88429af1d9a580b47cfdda5c8ed823fe94232cecc17365616e015a3e9f605825"} Jun 03 01:12:03.332775 ip-10-0-138-55 kubenswrapper[2566]: I0603 01:12:03.332627 2566 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759vg6nh" event={"ID":"d04b4880-a9b8-4143-bbe6-68dd52416e9c","Type":"ContainerStarted","Data":"c1d63bd88453e4e88b49fffa0e7ac99797eb6f56567ab89d8ed2e2c570eaa058"} Jun 03 01:12:03.333885 ip-10-0-138-55 kubenswrapper[2566]: I0603 01:12:03.333865 2566 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0rjwj4" event={"ID":"05cdd465-123d-4ae4-8a24-fe0679cd2dcf","Type":"ContainerStarted","Data":"652959631c6b5a3ae6955c5ef847ff27fdc92f09dd341d966f350b63c1017a95"} Jun 03 01:12:04.339904 ip-10-0-138-55 kubenswrapper[2566]: I0603 01:12:04.339864 2566 generic.go:358] "Generic (PLEG): container finished" podID="eedc5d49-5a31-4c4f-9b41-08d311ea09de" containerID="fbeb702d499ff0273a6c63186630ce087176e308a9775473fc3b22ab95b473d6" exitCode=0 Jun 03 01:12:04.340305 ip-10-0-138-55 kubenswrapper[2566]: I0603 01:12:04.339896 2566 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73xr8xr" event={"ID":"eedc5d49-5a31-4c4f-9b41-08d311ea09de","Type":"ContainerDied","Data":"fbeb702d499ff0273a6c63186630ce087176e308a9775473fc3b22ab95b473d6"} Jun 03 01:12:04.341631 ip-10-0-138-55 kubenswrapper[2566]: I0603 01:12:04.341610 2566 generic.go:358] "Generic (PLEG): container finished" podID="d04b4880-a9b8-4143-bbe6-68dd52416e9c" containerID="cfe900e36612923f126b5c80810468f884c79850559de6b2675ecdb5b42a4930" exitCode=0 Jun 03 01:12:04.341745 ip-10-0-138-55 kubenswrapper[2566]: I0603 01:12:04.341682 2566 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759vg6nh" event={"ID":"d04b4880-a9b8-4143-bbe6-68dd52416e9c","Type":"ContainerDied","Data":"cfe900e36612923f126b5c80810468f884c79850559de6b2675ecdb5b42a4930"} Jun 03 01:12:04.343203 ip-10-0-138-55 kubenswrapper[2566]: I0603 01:12:04.343177 2566 generic.go:358] "Generic (PLEG): container finished" podID="05cdd465-123d-4ae4-8a24-fe0679cd2dcf" containerID="ed3fa95a7ca75d7f5fb1936f098b6260a275622c77c614063b4afb67d3a5fd3c" exitCode=0 Jun 03 01:12:04.343383 ip-10-0-138-55 kubenswrapper[2566]: I0603 01:12:04.343343 2566 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0rjwj4" event={"ID":"05cdd465-123d-4ae4-8a24-fe0679cd2dcf","Type":"ContainerDied","Data":"ed3fa95a7ca75d7f5fb1936f098b6260a275622c77c614063b4afb67d3a5fd3c"} Jun 03 01:12:04.345479 ip-10-0-138-55 kubenswrapper[2566]: I0603 01:12:04.345436 2566 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1ffkt4" event={"ID":"51b4334f-89ac-4ec8-9e08-44748b1c05d0","Type":"ContainerStarted","Data":"40a25a61b570c4352fe0c7b775a1198bdf39c3a7b9ee54681c8c007fc60d7825"} Jun 03 01:12:05.352187 ip-10-0-138-55 kubenswrapper[2566]: I0603 01:12:05.352156 2566 generic.go:358] "Generic (PLEG): container finished" podID="d04b4880-a9b8-4143-bbe6-68dd52416e9c" containerID="20c011eba368b558ce3b43f22de27ec3f386e046b867011b2c655cd338cb18cf" exitCode=0 Jun 03 01:12:05.352624 ip-10-0-138-55 kubenswrapper[2566]: I0603 01:12:05.352255 2566 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759vg6nh" event={"ID":"d04b4880-a9b8-4143-bbe6-68dd52416e9c","Type":"ContainerDied","Data":"20c011eba368b558ce3b43f22de27ec3f386e046b867011b2c655cd338cb18cf"} Jun 03 01:12:05.353868 ip-10-0-138-55 kubenswrapper[2566]: I0603 01:12:05.353841 2566 generic.go:358] "Generic (PLEG): container finished" podID="05cdd465-123d-4ae4-8a24-fe0679cd2dcf" containerID="19f15c6e4648d67b422a7ea029491ea5971c526e45f328f34863542999c2c31c" exitCode=0 Jun 03 01:12:05.353959 ip-10-0-138-55 kubenswrapper[2566]: I0603 01:12:05.353932 2566 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0rjwj4" event={"ID":"05cdd465-123d-4ae4-8a24-fe0679cd2dcf","Type":"ContainerDied","Data":"19f15c6e4648d67b422a7ea029491ea5971c526e45f328f34863542999c2c31c"} Jun 03 01:12:05.355827 ip-10-0-138-55 kubenswrapper[2566]: I0603 01:12:05.355808 2566 generic.go:358] "Generic (PLEG): container finished" podID="51b4334f-89ac-4ec8-9e08-44748b1c05d0" containerID="40a25a61b570c4352fe0c7b775a1198bdf39c3a7b9ee54681c8c007fc60d7825" exitCode=0 Jun 03 01:12:05.355920 ip-10-0-138-55 kubenswrapper[2566]: I0603 01:12:05.355899 2566 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1ffkt4" event={"ID":"51b4334f-89ac-4ec8-9e08-44748b1c05d0","Type":"ContainerDied","Data":"40a25a61b570c4352fe0c7b775a1198bdf39c3a7b9ee54681c8c007fc60d7825"} Jun 03 01:12:05.501327 ip-10-0-138-55 kubenswrapper[2566]: I0603 01:12:05.501301 2566 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73xr8xr" Jun 03 01:12:05.557048 ip-10-0-138-55 kubenswrapper[2566]: I0603 01:12:05.557014 2566 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-wshmh\" (UniqueName: \"kubernetes.io/projected/eedc5d49-5a31-4c4f-9b41-08d311ea09de-kube-api-access-wshmh\") pod \"eedc5d49-5a31-4c4f-9b41-08d311ea09de\" (UID: \"eedc5d49-5a31-4c4f-9b41-08d311ea09de\") " Jun 03 01:12:05.557171 ip-10-0-138-55 kubenswrapper[2566]: I0603 01:12:05.557064 2566 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/eedc5d49-5a31-4c4f-9b41-08d311ea09de-util\") pod \"eedc5d49-5a31-4c4f-9b41-08d311ea09de\" (UID: \"eedc5d49-5a31-4c4f-9b41-08d311ea09de\") " Jun 03 01:12:05.557171 ip-10-0-138-55 kubenswrapper[2566]: I0603 01:12:05.557094 2566 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/eedc5d49-5a31-4c4f-9b41-08d311ea09de-bundle\") pod \"eedc5d49-5a31-4c4f-9b41-08d311ea09de\" (UID: \"eedc5d49-5a31-4c4f-9b41-08d311ea09de\") " Jun 03 01:12:05.557752 ip-10-0-138-55 kubenswrapper[2566]: I0603 01:12:05.557719 2566 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/eedc5d49-5a31-4c4f-9b41-08d311ea09de-bundle" (OuterVolumeSpecName: "bundle") pod "eedc5d49-5a31-4c4f-9b41-08d311ea09de" (UID: "eedc5d49-5a31-4c4f-9b41-08d311ea09de"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jun 03 01:12:05.559084 ip-10-0-138-55 kubenswrapper[2566]: I0603 01:12:05.559062 2566 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/eedc5d49-5a31-4c4f-9b41-08d311ea09de-kube-api-access-wshmh" (OuterVolumeSpecName: "kube-api-access-wshmh") pod "eedc5d49-5a31-4c4f-9b41-08d311ea09de" (UID: "eedc5d49-5a31-4c4f-9b41-08d311ea09de"). InnerVolumeSpecName "kube-api-access-wshmh". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 03 01:12:05.562412 ip-10-0-138-55 kubenswrapper[2566]: I0603 01:12:05.562392 2566 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/eedc5d49-5a31-4c4f-9b41-08d311ea09de-util" (OuterVolumeSpecName: "util") pod "eedc5d49-5a31-4c4f-9b41-08d311ea09de" (UID: "eedc5d49-5a31-4c4f-9b41-08d311ea09de"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jun 03 01:12:05.658077 ip-10-0-138-55 kubenswrapper[2566]: I0603 01:12:05.658037 2566 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/eedc5d49-5a31-4c4f-9b41-08d311ea09de-util\") on node \"ip-10-0-138-55.ec2.internal\" DevicePath \"\"" Jun 03 01:12:05.658077 ip-10-0-138-55 kubenswrapper[2566]: I0603 01:12:05.658075 2566 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/eedc5d49-5a31-4c4f-9b41-08d311ea09de-bundle\") on node \"ip-10-0-138-55.ec2.internal\" DevicePath \"\"" Jun 03 01:12:05.658297 ip-10-0-138-55 kubenswrapper[2566]: I0603 01:12:05.658091 2566 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-wshmh\" (UniqueName: \"kubernetes.io/projected/eedc5d49-5a31-4c4f-9b41-08d311ea09de-kube-api-access-wshmh\") on node \"ip-10-0-138-55.ec2.internal\" DevicePath \"\"" Jun 03 01:12:06.361566 ip-10-0-138-55 kubenswrapper[2566]: I0603 01:12:06.361529 2566 generic.go:358] "Generic (PLEG): container finished" podID="51b4334f-89ac-4ec8-9e08-44748b1c05d0" containerID="539dbc0ba8341328082fdc9b020e988c8c1d7a19754cbce722aa51c3cbf7face" exitCode=0 Jun 03 01:12:06.361971 ip-10-0-138-55 kubenswrapper[2566]: I0603 01:12:06.361623 2566 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1ffkt4" event={"ID":"51b4334f-89ac-4ec8-9e08-44748b1c05d0","Type":"ContainerDied","Data":"539dbc0ba8341328082fdc9b020e988c8c1d7a19754cbce722aa51c3cbf7face"} Jun 03 01:12:06.363359 ip-10-0-138-55 kubenswrapper[2566]: I0603 01:12:06.363337 2566 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73xr8xr" Jun 03 01:12:06.363484 ip-10-0-138-55 kubenswrapper[2566]: I0603 01:12:06.363334 2566 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73xr8xr" event={"ID":"eedc5d49-5a31-4c4f-9b41-08d311ea09de","Type":"ContainerDied","Data":"1466f39c90dcf34869284bc4d2337a617e84092aea0ef58c10b6faaa60740137"} Jun 03 01:12:06.363484 ip-10-0-138-55 kubenswrapper[2566]: I0603 01:12:06.363437 2566 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="1466f39c90dcf34869284bc4d2337a617e84092aea0ef58c10b6faaa60740137" Jun 03 01:12:06.365207 ip-10-0-138-55 kubenswrapper[2566]: I0603 01:12:06.365177 2566 generic.go:358] "Generic (PLEG): container finished" podID="05cdd465-123d-4ae4-8a24-fe0679cd2dcf" containerID="19d4b1836d2f650cbddc348819721e9f557edac35cd61eb73516e2b9633e3aa6" exitCode=0 Jun 03 01:12:06.365337 ip-10-0-138-55 kubenswrapper[2566]: I0603 01:12:06.365281 2566 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0rjwj4" event={"ID":"05cdd465-123d-4ae4-8a24-fe0679cd2dcf","Type":"ContainerDied","Data":"19d4b1836d2f650cbddc348819721e9f557edac35cd61eb73516e2b9633e3aa6"} Jun 03 01:12:06.493048 ip-10-0-138-55 kubenswrapper[2566]: I0603 01:12:06.493027 2566 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759vg6nh" Jun 03 01:12:06.564061 ip-10-0-138-55 kubenswrapper[2566]: I0603 01:12:06.564032 2566 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/d04b4880-a9b8-4143-bbe6-68dd52416e9c-util\") pod \"d04b4880-a9b8-4143-bbe6-68dd52416e9c\" (UID: \"d04b4880-a9b8-4143-bbe6-68dd52416e9c\") " Jun 03 01:12:06.564242 ip-10-0-138-55 kubenswrapper[2566]: I0603 01:12:06.564066 2566 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-j5b5j\" (UniqueName: \"kubernetes.io/projected/d04b4880-a9b8-4143-bbe6-68dd52416e9c-kube-api-access-j5b5j\") pod \"d04b4880-a9b8-4143-bbe6-68dd52416e9c\" (UID: \"d04b4880-a9b8-4143-bbe6-68dd52416e9c\") " Jun 03 01:12:06.564242 ip-10-0-138-55 kubenswrapper[2566]: I0603 01:12:06.564118 2566 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/d04b4880-a9b8-4143-bbe6-68dd52416e9c-bundle\") pod \"d04b4880-a9b8-4143-bbe6-68dd52416e9c\" (UID: \"d04b4880-a9b8-4143-bbe6-68dd52416e9c\") " Jun 03 01:12:06.564809 ip-10-0-138-55 kubenswrapper[2566]: I0603 01:12:06.564786 2566 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/d04b4880-a9b8-4143-bbe6-68dd52416e9c-bundle" (OuterVolumeSpecName: "bundle") pod "d04b4880-a9b8-4143-bbe6-68dd52416e9c" (UID: "d04b4880-a9b8-4143-bbe6-68dd52416e9c"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jun 03 01:12:06.566210 ip-10-0-138-55 kubenswrapper[2566]: I0603 01:12:06.566185 2566 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/d04b4880-a9b8-4143-bbe6-68dd52416e9c-kube-api-access-j5b5j" (OuterVolumeSpecName: "kube-api-access-j5b5j") pod "d04b4880-a9b8-4143-bbe6-68dd52416e9c" (UID: "d04b4880-a9b8-4143-bbe6-68dd52416e9c"). InnerVolumeSpecName "kube-api-access-j5b5j". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 03 01:12:06.571776 ip-10-0-138-55 kubenswrapper[2566]: I0603 01:12:06.571748 2566 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/d04b4880-a9b8-4143-bbe6-68dd52416e9c-util" (OuterVolumeSpecName: "util") pod "d04b4880-a9b8-4143-bbe6-68dd52416e9c" (UID: "d04b4880-a9b8-4143-bbe6-68dd52416e9c"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jun 03 01:12:06.665555 ip-10-0-138-55 kubenswrapper[2566]: I0603 01:12:06.665436 2566 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/d04b4880-a9b8-4143-bbe6-68dd52416e9c-bundle\") on node \"ip-10-0-138-55.ec2.internal\" DevicePath \"\"" Jun 03 01:12:06.665555 ip-10-0-138-55 kubenswrapper[2566]: I0603 01:12:06.665492 2566 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/d04b4880-a9b8-4143-bbe6-68dd52416e9c-util\") on node \"ip-10-0-138-55.ec2.internal\" DevicePath \"\"" Jun 03 01:12:06.665555 ip-10-0-138-55 kubenswrapper[2566]: I0603 01:12:06.665507 2566 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-j5b5j\" (UniqueName: \"kubernetes.io/projected/d04b4880-a9b8-4143-bbe6-68dd52416e9c-kube-api-access-j5b5j\") on node \"ip-10-0-138-55.ec2.internal\" DevicePath \"\"" Jun 03 01:12:07.370609 ip-10-0-138-55 kubenswrapper[2566]: I0603 01:12:07.370578 2566 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759vg6nh" Jun 03 01:12:07.370609 ip-10-0-138-55 kubenswrapper[2566]: I0603 01:12:07.370601 2566 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759vg6nh" event={"ID":"d04b4880-a9b8-4143-bbe6-68dd52416e9c","Type":"ContainerDied","Data":"c1d63bd88453e4e88b49fffa0e7ac99797eb6f56567ab89d8ed2e2c570eaa058"} Jun 03 01:12:07.371137 ip-10-0-138-55 kubenswrapper[2566]: I0603 01:12:07.370630 2566 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="c1d63bd88453e4e88b49fffa0e7ac99797eb6f56567ab89d8ed2e2c570eaa058" Jun 03 01:12:07.527492 ip-10-0-138-55 kubenswrapper[2566]: I0603 01:12:07.527471 2566 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1ffkt4" Jun 03 01:12:07.547982 ip-10-0-138-55 kubenswrapper[2566]: I0603 01:12:07.547959 2566 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0rjwj4" Jun 03 01:12:07.571064 ip-10-0-138-55 kubenswrapper[2566]: I0603 01:12:07.571027 2566 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/51b4334f-89ac-4ec8-9e08-44748b1c05d0-bundle\") pod \"51b4334f-89ac-4ec8-9e08-44748b1c05d0\" (UID: \"51b4334f-89ac-4ec8-9e08-44748b1c05d0\") " Jun 03 01:12:07.571193 ip-10-0-138-55 kubenswrapper[2566]: I0603 01:12:07.571067 2566 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-fnr7f\" (UniqueName: \"kubernetes.io/projected/05cdd465-123d-4ae4-8a24-fe0679cd2dcf-kube-api-access-fnr7f\") pod \"05cdd465-123d-4ae4-8a24-fe0679cd2dcf\" (UID: \"05cdd465-123d-4ae4-8a24-fe0679cd2dcf\") " Jun 03 01:12:07.571193 ip-10-0-138-55 kubenswrapper[2566]: I0603 01:12:07.571107 2566 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/51b4334f-89ac-4ec8-9e08-44748b1c05d0-util\") pod \"51b4334f-89ac-4ec8-9e08-44748b1c05d0\" (UID: \"51b4334f-89ac-4ec8-9e08-44748b1c05d0\") " Jun 03 01:12:07.571193 ip-10-0-138-55 kubenswrapper[2566]: I0603 01:12:07.571131 2566 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/05cdd465-123d-4ae4-8a24-fe0679cd2dcf-bundle\") pod \"05cdd465-123d-4ae4-8a24-fe0679cd2dcf\" (UID: \"05cdd465-123d-4ae4-8a24-fe0679cd2dcf\") " Jun 03 01:12:07.571193 ip-10-0-138-55 kubenswrapper[2566]: I0603 01:12:07.571167 2566 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-rfmw7\" (UniqueName: \"kubernetes.io/projected/51b4334f-89ac-4ec8-9e08-44748b1c05d0-kube-api-access-rfmw7\") pod \"51b4334f-89ac-4ec8-9e08-44748b1c05d0\" (UID: \"51b4334f-89ac-4ec8-9e08-44748b1c05d0\") " Jun 03 01:12:07.571423 ip-10-0-138-55 kubenswrapper[2566]: I0603 01:12:07.571217 2566 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/05cdd465-123d-4ae4-8a24-fe0679cd2dcf-util\") pod \"05cdd465-123d-4ae4-8a24-fe0679cd2dcf\" (UID: \"05cdd465-123d-4ae4-8a24-fe0679cd2dcf\") " Jun 03 01:12:07.571986 ip-10-0-138-55 kubenswrapper[2566]: I0603 01:12:07.571957 2566 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/51b4334f-89ac-4ec8-9e08-44748b1c05d0-bundle" (OuterVolumeSpecName: "bundle") pod "51b4334f-89ac-4ec8-9e08-44748b1c05d0" (UID: "51b4334f-89ac-4ec8-9e08-44748b1c05d0"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jun 03 01:12:07.572150 ip-10-0-138-55 kubenswrapper[2566]: I0603 01:12:07.572036 2566 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/05cdd465-123d-4ae4-8a24-fe0679cd2dcf-bundle" (OuterVolumeSpecName: "bundle") pod "05cdd465-123d-4ae4-8a24-fe0679cd2dcf" (UID: "05cdd465-123d-4ae4-8a24-fe0679cd2dcf"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jun 03 01:12:07.573816 ip-10-0-138-55 kubenswrapper[2566]: I0603 01:12:07.573788 2566 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/05cdd465-123d-4ae4-8a24-fe0679cd2dcf-kube-api-access-fnr7f" (OuterVolumeSpecName: "kube-api-access-fnr7f") pod "05cdd465-123d-4ae4-8a24-fe0679cd2dcf" (UID: "05cdd465-123d-4ae4-8a24-fe0679cd2dcf"). InnerVolumeSpecName "kube-api-access-fnr7f". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 03 01:12:07.577799 ip-10-0-138-55 kubenswrapper[2566]: I0603 01:12:07.577775 2566 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/51b4334f-89ac-4ec8-9e08-44748b1c05d0-util" (OuterVolumeSpecName: "util") pod "51b4334f-89ac-4ec8-9e08-44748b1c05d0" (UID: "51b4334f-89ac-4ec8-9e08-44748b1c05d0"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jun 03 01:12:07.578152 ip-10-0-138-55 kubenswrapper[2566]: I0603 01:12:07.578126 2566 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/51b4334f-89ac-4ec8-9e08-44748b1c05d0-kube-api-access-rfmw7" (OuterVolumeSpecName: "kube-api-access-rfmw7") pod "51b4334f-89ac-4ec8-9e08-44748b1c05d0" (UID: "51b4334f-89ac-4ec8-9e08-44748b1c05d0"). InnerVolumeSpecName "kube-api-access-rfmw7". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 03 01:12:07.578579 ip-10-0-138-55 kubenswrapper[2566]: I0603 01:12:07.578547 2566 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/05cdd465-123d-4ae4-8a24-fe0679cd2dcf-util" (OuterVolumeSpecName: "util") pod "05cdd465-123d-4ae4-8a24-fe0679cd2dcf" (UID: "05cdd465-123d-4ae4-8a24-fe0679cd2dcf"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jun 03 01:12:07.672555 ip-10-0-138-55 kubenswrapper[2566]: I0603 01:12:07.672476 2566 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-rfmw7\" (UniqueName: \"kubernetes.io/projected/51b4334f-89ac-4ec8-9e08-44748b1c05d0-kube-api-access-rfmw7\") on node \"ip-10-0-138-55.ec2.internal\" DevicePath \"\"" Jun 03 01:12:07.672555 ip-10-0-138-55 kubenswrapper[2566]: I0603 01:12:07.672501 2566 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/05cdd465-123d-4ae4-8a24-fe0679cd2dcf-util\") on node \"ip-10-0-138-55.ec2.internal\" DevicePath \"\"" Jun 03 01:12:07.672555 ip-10-0-138-55 kubenswrapper[2566]: I0603 01:12:07.672511 2566 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/51b4334f-89ac-4ec8-9e08-44748b1c05d0-bundle\") on node \"ip-10-0-138-55.ec2.internal\" DevicePath \"\"" Jun 03 01:12:07.672555 ip-10-0-138-55 kubenswrapper[2566]: I0603 01:12:07.672520 2566 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-fnr7f\" (UniqueName: \"kubernetes.io/projected/05cdd465-123d-4ae4-8a24-fe0679cd2dcf-kube-api-access-fnr7f\") on node \"ip-10-0-138-55.ec2.internal\" DevicePath \"\"" Jun 03 01:12:07.672555 ip-10-0-138-55 kubenswrapper[2566]: I0603 01:12:07.672528 2566 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/51b4334f-89ac-4ec8-9e08-44748b1c05d0-util\") on node \"ip-10-0-138-55.ec2.internal\" DevicePath \"\"" Jun 03 01:12:07.672555 ip-10-0-138-55 kubenswrapper[2566]: I0603 01:12:07.672536 2566 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/05cdd465-123d-4ae4-8a24-fe0679cd2dcf-bundle\") on node \"ip-10-0-138-55.ec2.internal\" DevicePath \"\"" Jun 03 01:12:08.376883 ip-10-0-138-55 kubenswrapper[2566]: I0603 01:12:08.376855 2566 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0rjwj4" Jun 03 01:12:08.376883 ip-10-0-138-55 kubenswrapper[2566]: I0603 01:12:08.376872 2566 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0rjwj4" event={"ID":"05cdd465-123d-4ae4-8a24-fe0679cd2dcf","Type":"ContainerDied","Data":"652959631c6b5a3ae6955c5ef847ff27fdc92f09dd341d966f350b63c1017a95"} Jun 03 01:12:08.377390 ip-10-0-138-55 kubenswrapper[2566]: I0603 01:12:08.376906 2566 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="652959631c6b5a3ae6955c5ef847ff27fdc92f09dd341d966f350b63c1017a95" Jun 03 01:12:08.378571 ip-10-0-138-55 kubenswrapper[2566]: I0603 01:12:08.378550 2566 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1ffkt4" event={"ID":"51b4334f-89ac-4ec8-9e08-44748b1c05d0","Type":"ContainerDied","Data":"5dd401cb904ebb7ea3627f5e211485c8ac09a8fb333e3cd4ca17b0da1d304ca3"} Jun 03 01:12:08.378571 ip-10-0-138-55 kubenswrapper[2566]: I0603 01:12:08.378575 2566 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="5dd401cb904ebb7ea3627f5e211485c8ac09a8fb333e3cd4ca17b0da1d304ca3" Jun 03 01:12:08.378735 ip-10-0-138-55 kubenswrapper[2566]: I0603 01:12:08.378585 2566 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1ffkt4" Jun 03 01:12:19.126186 ip-10-0-138-55 kubenswrapper[2566]: I0603 01:12:19.126151 2566 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-5f895dd7d5-vb8xw"] Jun 03 01:12:19.126637 ip-10-0-138-55 kubenswrapper[2566]: I0603 01:12:19.126546 2566 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="51b4334f-89ac-4ec8-9e08-44748b1c05d0" containerName="pull" Jun 03 01:12:19.126637 ip-10-0-138-55 kubenswrapper[2566]: I0603 01:12:19.126558 2566 state_mem.go:107] "Deleted CPUSet assignment" podUID="51b4334f-89ac-4ec8-9e08-44748b1c05d0" containerName="pull" Jun 03 01:12:19.126637 ip-10-0-138-55 kubenswrapper[2566]: I0603 01:12:19.126568 2566 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="d04b4880-a9b8-4143-bbe6-68dd52416e9c" containerName="extract" Jun 03 01:12:19.126637 ip-10-0-138-55 kubenswrapper[2566]: I0603 01:12:19.126573 2566 state_mem.go:107] "Deleted CPUSet assignment" podUID="d04b4880-a9b8-4143-bbe6-68dd52416e9c" containerName="extract" Jun 03 01:12:19.126637 ip-10-0-138-55 kubenswrapper[2566]: I0603 01:12:19.126582 2566 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="eedc5d49-5a31-4c4f-9b41-08d311ea09de" containerName="extract" Jun 03 01:12:19.126637 ip-10-0-138-55 kubenswrapper[2566]: I0603 01:12:19.126588 2566 state_mem.go:107] "Deleted CPUSet assignment" podUID="eedc5d49-5a31-4c4f-9b41-08d311ea09de" containerName="extract" Jun 03 01:12:19.126637 ip-10-0-138-55 kubenswrapper[2566]: I0603 01:12:19.126598 2566 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="eedc5d49-5a31-4c4f-9b41-08d311ea09de" containerName="pull" Jun 03 01:12:19.126637 ip-10-0-138-55 kubenswrapper[2566]: I0603 01:12:19.126603 2566 state_mem.go:107] "Deleted CPUSet assignment" podUID="eedc5d49-5a31-4c4f-9b41-08d311ea09de" containerName="pull" Jun 03 01:12:19.126637 ip-10-0-138-55 kubenswrapper[2566]: I0603 01:12:19.126609 2566 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="51b4334f-89ac-4ec8-9e08-44748b1c05d0" containerName="extract" Jun 03 01:12:19.126637 ip-10-0-138-55 kubenswrapper[2566]: I0603 01:12:19.126614 2566 state_mem.go:107] "Deleted CPUSet assignment" podUID="51b4334f-89ac-4ec8-9e08-44748b1c05d0" containerName="extract" Jun 03 01:12:19.126637 ip-10-0-138-55 kubenswrapper[2566]: I0603 01:12:19.126621 2566 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="05cdd465-123d-4ae4-8a24-fe0679cd2dcf" containerName="extract" Jun 03 01:12:19.126637 ip-10-0-138-55 kubenswrapper[2566]: I0603 01:12:19.126625 2566 state_mem.go:107] "Deleted CPUSet assignment" podUID="05cdd465-123d-4ae4-8a24-fe0679cd2dcf" containerName="extract" Jun 03 01:12:19.126637 ip-10-0-138-55 kubenswrapper[2566]: I0603 01:12:19.126635 2566 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="d04b4880-a9b8-4143-bbe6-68dd52416e9c" containerName="pull" Jun 03 01:12:19.126637 ip-10-0-138-55 kubenswrapper[2566]: I0603 01:12:19.126640 2566 state_mem.go:107] "Deleted CPUSet assignment" podUID="d04b4880-a9b8-4143-bbe6-68dd52416e9c" containerName="pull" Jun 03 01:12:19.127075 ip-10-0-138-55 kubenswrapper[2566]: I0603 01:12:19.126648 2566 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="eedc5d49-5a31-4c4f-9b41-08d311ea09de" containerName="util" Jun 03 01:12:19.127075 ip-10-0-138-55 kubenswrapper[2566]: I0603 01:12:19.126653 2566 state_mem.go:107] "Deleted CPUSet assignment" podUID="eedc5d49-5a31-4c4f-9b41-08d311ea09de" containerName="util" Jun 03 01:12:19.127075 ip-10-0-138-55 kubenswrapper[2566]: I0603 01:12:19.126659 2566 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="05cdd465-123d-4ae4-8a24-fe0679cd2dcf" containerName="util" Jun 03 01:12:19.127075 ip-10-0-138-55 kubenswrapper[2566]: I0603 01:12:19.126663 2566 state_mem.go:107] "Deleted CPUSet assignment" podUID="05cdd465-123d-4ae4-8a24-fe0679cd2dcf" containerName="util" Jun 03 01:12:19.127075 ip-10-0-138-55 kubenswrapper[2566]: I0603 01:12:19.126669 2566 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="d04b4880-a9b8-4143-bbe6-68dd52416e9c" containerName="util" Jun 03 01:12:19.127075 ip-10-0-138-55 kubenswrapper[2566]: I0603 01:12:19.126674 2566 state_mem.go:107] "Deleted CPUSet assignment" podUID="d04b4880-a9b8-4143-bbe6-68dd52416e9c" containerName="util" Jun 03 01:12:19.127075 ip-10-0-138-55 kubenswrapper[2566]: I0603 01:12:19.126681 2566 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="05cdd465-123d-4ae4-8a24-fe0679cd2dcf" containerName="pull" Jun 03 01:12:19.127075 ip-10-0-138-55 kubenswrapper[2566]: I0603 01:12:19.126688 2566 state_mem.go:107] "Deleted CPUSet assignment" podUID="05cdd465-123d-4ae4-8a24-fe0679cd2dcf" containerName="pull" Jun 03 01:12:19.127075 ip-10-0-138-55 kubenswrapper[2566]: I0603 01:12:19.126696 2566 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="51b4334f-89ac-4ec8-9e08-44748b1c05d0" containerName="util" Jun 03 01:12:19.127075 ip-10-0-138-55 kubenswrapper[2566]: I0603 01:12:19.126701 2566 state_mem.go:107] "Deleted CPUSet assignment" podUID="51b4334f-89ac-4ec8-9e08-44748b1c05d0" containerName="util" Jun 03 01:12:19.127075 ip-10-0-138-55 kubenswrapper[2566]: I0603 01:12:19.126749 2566 memory_manager.go:356] "RemoveStaleState removing state" podUID="51b4334f-89ac-4ec8-9e08-44748b1c05d0" containerName="extract" Jun 03 01:12:19.127075 ip-10-0-138-55 kubenswrapper[2566]: I0603 01:12:19.126757 2566 memory_manager.go:356] "RemoveStaleState removing state" podUID="d04b4880-a9b8-4143-bbe6-68dd52416e9c" containerName="extract" Jun 03 01:12:19.127075 ip-10-0-138-55 kubenswrapper[2566]: I0603 01:12:19.126765 2566 memory_manager.go:356] "RemoveStaleState removing state" podUID="05cdd465-123d-4ae4-8a24-fe0679cd2dcf" containerName="extract" Jun 03 01:12:19.127075 ip-10-0-138-55 kubenswrapper[2566]: I0603 01:12:19.126773 2566 memory_manager.go:356] "RemoveStaleState removing state" podUID="eedc5d49-5a31-4c4f-9b41-08d311ea09de" containerName="extract" Jun 03 01:12:19.131348 ip-10-0-138-55 kubenswrapper[2566]: I0603 01:12:19.131326 2566 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-5f895dd7d5-vb8xw" Jun 03 01:12:19.135395 ip-10-0-138-55 kubenswrapper[2566]: I0603 01:12:19.135374 2566 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"kuadrant-operator-controller-manager-dockercfg-kcvqf\"" Jun 03 01:12:19.151819 ip-10-0-138-55 kubenswrapper[2566]: I0603 01:12:19.151795 2566 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-5f895dd7d5-vb8xw"] Jun 03 01:12:19.176481 ip-10-0-138-55 kubenswrapper[2566]: I0603 01:12:19.176452 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/4a32aff0-e3cf-457d-9085-6433e12ccf39-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-5f895dd7d5-vb8xw\" (UID: \"4a32aff0-e3cf-457d-9085-6433e12ccf39\") " pod="kuadrant-system/kuadrant-operator-controller-manager-5f895dd7d5-vb8xw" Jun 03 01:12:19.176597 ip-10-0-138-55 kubenswrapper[2566]: I0603 01:12:19.176502 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-jl8s2\" (UniqueName: \"kubernetes.io/projected/4a32aff0-e3cf-457d-9085-6433e12ccf39-kube-api-access-jl8s2\") pod \"kuadrant-operator-controller-manager-5f895dd7d5-vb8xw\" (UID: \"4a32aff0-e3cf-457d-9085-6433e12ccf39\") " pod="kuadrant-system/kuadrant-operator-controller-manager-5f895dd7d5-vb8xw" Jun 03 01:12:19.277098 ip-10-0-138-55 kubenswrapper[2566]: I0603 01:12:19.277063 2566 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/4a32aff0-e3cf-457d-9085-6433e12ccf39-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-5f895dd7d5-vb8xw\" (UID: \"4a32aff0-e3cf-457d-9085-6433e12ccf39\") " pod="kuadrant-system/kuadrant-operator-controller-manager-5f895dd7d5-vb8xw" Jun 03 01:12:19.277286 ip-10-0-138-55 kubenswrapper[2566]: I0603 01:12:19.277124 2566 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-jl8s2\" (UniqueName: \"kubernetes.io/projected/4a32aff0-e3cf-457d-9085-6433e12ccf39-kube-api-access-jl8s2\") pod \"kuadrant-operator-controller-manager-5f895dd7d5-vb8xw\" (UID: \"4a32aff0-e3cf-457d-9085-6433e12ccf39\") " pod="kuadrant-system/kuadrant-operator-controller-manager-5f895dd7d5-vb8xw" Jun 03 01:12:19.277456 ip-10-0-138-55 kubenswrapper[2566]: I0603 01:12:19.277435 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/4a32aff0-e3cf-457d-9085-6433e12ccf39-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-5f895dd7d5-vb8xw\" (UID: \"4a32aff0-e3cf-457d-9085-6433e12ccf39\") " pod="kuadrant-system/kuadrant-operator-controller-manager-5f895dd7d5-vb8xw" Jun 03 01:12:19.285478 ip-10-0-138-55 kubenswrapper[2566]: I0603 01:12:19.285455 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-jl8s2\" (UniqueName: \"kubernetes.io/projected/4a32aff0-e3cf-457d-9085-6433e12ccf39-kube-api-access-jl8s2\") pod \"kuadrant-operator-controller-manager-5f895dd7d5-vb8xw\" (UID: \"4a32aff0-e3cf-457d-9085-6433e12ccf39\") " pod="kuadrant-system/kuadrant-operator-controller-manager-5f895dd7d5-vb8xw" Jun 03 01:12:19.442572 ip-10-0-138-55 kubenswrapper[2566]: I0603 01:12:19.442480 2566 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-5f895dd7d5-vb8xw" Jun 03 01:12:19.579795 ip-10-0-138-55 kubenswrapper[2566]: I0603 01:12:19.579772 2566 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-5f895dd7d5-vb8xw"] Jun 03 01:12:19.581840 ip-10-0-138-55 kubenswrapper[2566]: W0603 01:12:19.581810 2566 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod4a32aff0_e3cf_457d_9085_6433e12ccf39.slice/crio-ec449d7f85a9436e3a92fbdf7ef94207a0cd5c50093c7b3939d207b085510814 WatchSource:0}: Error finding container ec449d7f85a9436e3a92fbdf7ef94207a0cd5c50093c7b3939d207b085510814: Status 404 returned error can't find the container with id ec449d7f85a9436e3a92fbdf7ef94207a0cd5c50093c7b3939d207b085510814 Jun 03 01:12:20.430613 ip-10-0-138-55 kubenswrapper[2566]: I0603 01:12:20.430573 2566 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-5f895dd7d5-vb8xw" event={"ID":"4a32aff0-e3cf-457d-9085-6433e12ccf39","Type":"ContainerStarted","Data":"ec449d7f85a9436e3a92fbdf7ef94207a0cd5c50093c7b3939d207b085510814"} Jun 03 01:12:21.118309 ip-10-0-138-55 kubenswrapper[2566]: I0603 01:12:21.118277 2566 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["kuadrant-system/dns-operator-controller-manager-648d5c98bc-mv844"] Jun 03 01:12:21.126775 ip-10-0-138-55 kubenswrapper[2566]: I0603 01:12:21.126751 2566 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/dns-operator-controller-manager-648d5c98bc-mv844" Jun 03 01:12:21.129302 ip-10-0-138-55 kubenswrapper[2566]: I0603 01:12:21.129279 2566 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"dns-operator-controller-manager-dockercfg-8824p\"" Jun 03 01:12:21.130180 ip-10-0-138-55 kubenswrapper[2566]: I0603 01:12:21.130146 2566 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/dns-operator-controller-manager-648d5c98bc-mv844"] Jun 03 01:12:21.131014 ip-10-0-138-55 kubenswrapper[2566]: I0603 01:12:21.130996 2566 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"dns-operator-controller-env\"" Jun 03 01:12:21.196796 ip-10-0-138-55 kubenswrapper[2566]: I0603 01:12:21.196759 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-mg8s6\" (UniqueName: \"kubernetes.io/projected/4a9013f7-d6e0-4d22-95d5-988b49a15e37-kube-api-access-mg8s6\") pod \"dns-operator-controller-manager-648d5c98bc-mv844\" (UID: \"4a9013f7-d6e0-4d22-95d5-988b49a15e37\") " pod="kuadrant-system/dns-operator-controller-manager-648d5c98bc-mv844" Jun 03 01:12:21.297553 ip-10-0-138-55 kubenswrapper[2566]: I0603 01:12:21.297519 2566 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-mg8s6\" (UniqueName: \"kubernetes.io/projected/4a9013f7-d6e0-4d22-95d5-988b49a15e37-kube-api-access-mg8s6\") pod \"dns-operator-controller-manager-648d5c98bc-mv844\" (UID: \"4a9013f7-d6e0-4d22-95d5-988b49a15e37\") " pod="kuadrant-system/dns-operator-controller-manager-648d5c98bc-mv844" Jun 03 01:12:21.309465 ip-10-0-138-55 kubenswrapper[2566]: I0603 01:12:21.309428 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-mg8s6\" (UniqueName: \"kubernetes.io/projected/4a9013f7-d6e0-4d22-95d5-988b49a15e37-kube-api-access-mg8s6\") pod \"dns-operator-controller-manager-648d5c98bc-mv844\" (UID: \"4a9013f7-d6e0-4d22-95d5-988b49a15e37\") " pod="kuadrant-system/dns-operator-controller-manager-648d5c98bc-mv844" Jun 03 01:12:21.440642 ip-10-0-138-55 kubenswrapper[2566]: I0603 01:12:21.440564 2566 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/dns-operator-controller-manager-648d5c98bc-mv844" Jun 03 01:12:21.573758 ip-10-0-138-55 kubenswrapper[2566]: I0603 01:12:21.573731 2566 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/dns-operator-controller-manager-648d5c98bc-mv844"] Jun 03 01:12:21.575948 ip-10-0-138-55 kubenswrapper[2566]: W0603 01:12:21.575919 2566 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod4a9013f7_d6e0_4d22_95d5_988b49a15e37.slice/crio-1c09122cf3d81f0e9ba63832c9ee1a6c88b24a0c84776aee43c9faf9be8d4f95 WatchSource:0}: Error finding container 1c09122cf3d81f0e9ba63832c9ee1a6c88b24a0c84776aee43c9faf9be8d4f95: Status 404 returned error can't find the container with id 1c09122cf3d81f0e9ba63832c9ee1a6c88b24a0c84776aee43c9faf9be8d4f95 Jun 03 01:12:22.439839 ip-10-0-138-55 kubenswrapper[2566]: I0603 01:12:22.439802 2566 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/dns-operator-controller-manager-648d5c98bc-mv844" event={"ID":"4a9013f7-d6e0-4d22-95d5-988b49a15e37","Type":"ContainerStarted","Data":"1c09122cf3d81f0e9ba63832c9ee1a6c88b24a0c84776aee43c9faf9be8d4f95"} Jun 03 01:12:25.455154 ip-10-0-138-55 kubenswrapper[2566]: I0603 01:12:25.455100 2566 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/dns-operator-controller-manager-648d5c98bc-mv844" event={"ID":"4a9013f7-d6e0-4d22-95d5-988b49a15e37","Type":"ContainerStarted","Data":"e8f3ae5758541e76d9721fa5a3713f896de4679517ca874e22e556642f1af7f6"} Jun 03 01:12:25.455154 ip-10-0-138-55 kubenswrapper[2566]: I0603 01:12:25.455162 2566 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/dns-operator-controller-manager-648d5c98bc-mv844" Jun 03 01:12:25.456613 ip-10-0-138-55 kubenswrapper[2566]: I0603 01:12:25.456591 2566 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-5f895dd7d5-vb8xw" event={"ID":"4a32aff0-e3cf-457d-9085-6433e12ccf39","Type":"ContainerStarted","Data":"ca93c84eec5c7237eec8f8d1f27a363b8c1a1ef87fd5f3f8f94a53113bcdd382"} Jun 03 01:12:25.456724 ip-10-0-138-55 kubenswrapper[2566]: I0603 01:12:25.456706 2566 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/kuadrant-operator-controller-manager-5f895dd7d5-vb8xw" Jun 03 01:12:25.472219 ip-10-0-138-55 kubenswrapper[2566]: I0603 01:12:25.472165 2566 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="kuadrant-system/dns-operator-controller-manager-648d5c98bc-mv844" podStartSLOduration=0.744433079 podStartE2EDuration="4.472151756s" podCreationTimestamp="2026-06-03 01:12:21 +0000 UTC" firstStartedPulling="2026-06-03 01:12:21.577907921 +0000 UTC m=+464.724749844" lastFinishedPulling="2026-06-03 01:12:25.305626596 +0000 UTC m=+468.452468521" observedRunningTime="2026-06-03 01:12:25.469434942 +0000 UTC m=+468.616276900" watchObservedRunningTime="2026-06-03 01:12:25.472151756 +0000 UTC m=+468.618993703" Jun 03 01:12:25.489014 ip-10-0-138-55 kubenswrapper[2566]: I0603 01:12:25.488965 2566 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="kuadrant-system/kuadrant-operator-controller-manager-5f895dd7d5-vb8xw" podStartSLOduration=0.761276291 podStartE2EDuration="6.488949656s" podCreationTimestamp="2026-06-03 01:12:19 +0000 UTC" firstStartedPulling="2026-06-03 01:12:19.584168061 +0000 UTC m=+462.731009984" lastFinishedPulling="2026-06-03 01:12:25.311841425 +0000 UTC m=+468.458683349" observedRunningTime="2026-06-03 01:12:25.486732228 +0000 UTC m=+468.633574173" watchObservedRunningTime="2026-06-03 01:12:25.488949656 +0000 UTC m=+468.635791661" Jun 03 01:12:27.243959 ip-10-0-138-55 kubenswrapper[2566]: I0603 01:12:27.243926 2566 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["kuadrant-system/authorino-operator-657f44b778-8ghpk"] Jun 03 01:12:27.247522 ip-10-0-138-55 kubenswrapper[2566]: I0603 01:12:27.247502 2566 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-operator-657f44b778-8ghpk" Jun 03 01:12:27.249741 ip-10-0-138-55 kubenswrapper[2566]: I0603 01:12:27.249717 2566 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"authorino-operator-dockercfg-vmrz2\"" Jun 03 01:12:27.258168 ip-10-0-138-55 kubenswrapper[2566]: I0603 01:12:27.258144 2566 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-operator-657f44b778-8ghpk"] Jun 03 01:12:27.354777 ip-10-0-138-55 kubenswrapper[2566]: I0603 01:12:27.354725 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-5vd9j\" (UniqueName: \"kubernetes.io/projected/f9cede5a-bff1-40d6-8cdb-1d058196cb2f-kube-api-access-5vd9j\") pod \"authorino-operator-657f44b778-8ghpk\" (UID: \"f9cede5a-bff1-40d6-8cdb-1d058196cb2f\") " pod="kuadrant-system/authorino-operator-657f44b778-8ghpk" Jun 03 01:12:27.455469 ip-10-0-138-55 kubenswrapper[2566]: I0603 01:12:27.455435 2566 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-5vd9j\" (UniqueName: \"kubernetes.io/projected/f9cede5a-bff1-40d6-8cdb-1d058196cb2f-kube-api-access-5vd9j\") pod \"authorino-operator-657f44b778-8ghpk\" (UID: \"f9cede5a-bff1-40d6-8cdb-1d058196cb2f\") " pod="kuadrant-system/authorino-operator-657f44b778-8ghpk" Jun 03 01:12:27.463640 ip-10-0-138-55 kubenswrapper[2566]: I0603 01:12:27.463606 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-5vd9j\" (UniqueName: \"kubernetes.io/projected/f9cede5a-bff1-40d6-8cdb-1d058196cb2f-kube-api-access-5vd9j\") pod \"authorino-operator-657f44b778-8ghpk\" (UID: \"f9cede5a-bff1-40d6-8cdb-1d058196cb2f\") " pod="kuadrant-system/authorino-operator-657f44b778-8ghpk" Jun 03 01:12:27.559220 ip-10-0-138-55 kubenswrapper[2566]: I0603 01:12:27.559135 2566 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-operator-657f44b778-8ghpk" Jun 03 01:12:27.697107 ip-10-0-138-55 kubenswrapper[2566]: I0603 01:12:27.697071 2566 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-operator-657f44b778-8ghpk"] Jun 03 01:12:27.699967 ip-10-0-138-55 kubenswrapper[2566]: W0603 01:12:27.699940 2566 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podf9cede5a_bff1_40d6_8cdb_1d058196cb2f.slice/crio-e6c20ee4e39a1c6734ea254e1092bf71e0514142ba9a39ea9a656fdf38e059ad WatchSource:0}: Error finding container e6c20ee4e39a1c6734ea254e1092bf71e0514142ba9a39ea9a656fdf38e059ad: Status 404 returned error can't find the container with id e6c20ee4e39a1c6734ea254e1092bf71e0514142ba9a39ea9a656fdf38e059ad Jun 03 01:12:28.470013 ip-10-0-138-55 kubenswrapper[2566]: I0603 01:12:28.469973 2566 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-operator-657f44b778-8ghpk" event={"ID":"f9cede5a-bff1-40d6-8cdb-1d058196cb2f","Type":"ContainerStarted","Data":"e6c20ee4e39a1c6734ea254e1092bf71e0514142ba9a39ea9a656fdf38e059ad"} Jun 03 01:12:30.479825 ip-10-0-138-55 kubenswrapper[2566]: I0603 01:12:30.479782 2566 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-operator-657f44b778-8ghpk" event={"ID":"f9cede5a-bff1-40d6-8cdb-1d058196cb2f","Type":"ContainerStarted","Data":"7b3fb50d51b6f4c16baa847529d2df8dd5df3ced41f2e5a40e93ed8239edbcc3"} Jun 03 01:12:30.480212 ip-10-0-138-55 kubenswrapper[2566]: I0603 01:12:30.479920 2566 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/authorino-operator-657f44b778-8ghpk" Jun 03 01:12:30.494457 ip-10-0-138-55 kubenswrapper[2566]: I0603 01:12:30.494417 2566 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="kuadrant-system/authorino-operator-657f44b778-8ghpk" podStartSLOduration=1.294472346 podStartE2EDuration="3.494399686s" podCreationTimestamp="2026-06-03 01:12:27 +0000 UTC" firstStartedPulling="2026-06-03 01:12:27.702273927 +0000 UTC m=+470.849115850" lastFinishedPulling="2026-06-03 01:12:29.902201263 +0000 UTC m=+473.049043190" observedRunningTime="2026-06-03 01:12:30.49355675 +0000 UTC m=+473.640398696" watchObservedRunningTime="2026-06-03 01:12:30.494399686 +0000 UTC m=+473.641241635" Jun 03 01:12:36.462818 ip-10-0-138-55 kubenswrapper[2566]: I0603 01:12:36.462780 2566 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/dns-operator-controller-manager-648d5c98bc-mv844" Jun 03 01:12:36.463325 ip-10-0-138-55 kubenswrapper[2566]: I0603 01:12:36.462846 2566 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/kuadrant-operator-controller-manager-5f895dd7d5-vb8xw" Jun 03 01:12:38.253472 ip-10-0-138-55 kubenswrapper[2566]: I0603 01:12:38.253429 2566 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-5f895dd7d5-vb8xw"] Jun 03 01:12:38.253887 ip-10-0-138-55 kubenswrapper[2566]: I0603 01:12:38.253670 2566 kuberuntime_container.go:864] "Killing container with a grace period" pod="kuadrant-system/kuadrant-operator-controller-manager-5f895dd7d5-vb8xw" podUID="4a32aff0-e3cf-457d-9085-6433e12ccf39" containerName="manager" containerID="cri-o://ca93c84eec5c7237eec8f8d1f27a363b8c1a1ef87fd5f3f8f94a53113bcdd382" gracePeriod=2 Jun 03 01:12:38.263536 ip-10-0-138-55 kubenswrapper[2566]: I0603 01:12:38.263509 2566 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-55c7f4c975-cvqzd"] Jun 03 01:12:38.267202 ip-10-0-138-55 kubenswrapper[2566]: I0603 01:12:38.267177 2566 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-55c7f4c975-cvqzd" Jun 03 01:12:38.271943 ip-10-0-138-55 kubenswrapper[2566]: I0603 01:12:38.271911 2566 kubelet.go:2547] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-5f895dd7d5-vb8xw"] Jun 03 01:12:38.283624 ip-10-0-138-55 kubenswrapper[2566]: I0603 01:12:38.283592 2566 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-55c7f4c975-cvqzd"] Jun 03 01:12:38.292190 ip-10-0-138-55 kubenswrapper[2566]: I0603 01:12:38.292163 2566 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-5f895dd7d5-vhw82"] Jun 03 01:12:38.292584 ip-10-0-138-55 kubenswrapper[2566]: I0603 01:12:38.292568 2566 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="4a32aff0-e3cf-457d-9085-6433e12ccf39" containerName="manager" Jun 03 01:12:38.292584 ip-10-0-138-55 kubenswrapper[2566]: I0603 01:12:38.292583 2566 state_mem.go:107] "Deleted CPUSet assignment" podUID="4a32aff0-e3cf-457d-9085-6433e12ccf39" containerName="manager" Jun 03 01:12:38.292720 ip-10-0-138-55 kubenswrapper[2566]: I0603 01:12:38.292639 2566 memory_manager.go:356] "RemoveStaleState removing state" podUID="4a32aff0-e3cf-457d-9085-6433e12ccf39" containerName="manager" Jun 03 01:12:38.295860 ip-10-0-138-55 kubenswrapper[2566]: I0603 01:12:38.295839 2566 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-5f895dd7d5-vhw82" Jun 03 01:12:38.302084 ip-10-0-138-55 kubenswrapper[2566]: I0603 01:12:38.302046 2566 status_manager.go:895] "Failed to get status for pod" podUID="4a32aff0-e3cf-457d-9085-6433e12ccf39" pod="kuadrant-system/kuadrant-operator-controller-manager-5f895dd7d5-vb8xw" err="pods \"kuadrant-operator-controller-manager-5f895dd7d5-vb8xw\" is forbidden: User \"system:node:ip-10-0-138-55.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-138-55.ec2.internal' and this object" Jun 03 01:12:38.304014 ip-10-0-138-55 kubenswrapper[2566]: I0603 01:12:38.303980 2566 status_manager.go:895] "Failed to get status for pod" podUID="4a32aff0-e3cf-457d-9085-6433e12ccf39" pod="kuadrant-system/kuadrant-operator-controller-manager-5f895dd7d5-vb8xw" err="pods \"kuadrant-operator-controller-manager-5f895dd7d5-vb8xw\" is forbidden: User \"system:node:ip-10-0-138-55.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-138-55.ec2.internal' and this object" Jun 03 01:12:38.309698 ip-10-0-138-55 kubenswrapper[2566]: I0603 01:12:38.309672 2566 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-5f895dd7d5-vhw82"] Jun 03 01:12:38.354464 ip-10-0-138-55 kubenswrapper[2566]: I0603 01:12:38.354434 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/7d38331e-2c20-4482-9194-194d1bfddc67-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-55c7f4c975-cvqzd\" (UID: \"7d38331e-2c20-4482-9194-194d1bfddc67\") " pod="kuadrant-system/kuadrant-operator-controller-manager-55c7f4c975-cvqzd" Jun 03 01:12:38.354629 ip-10-0-138-55 kubenswrapper[2566]: I0603 01:12:38.354530 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-hswfz\" (UniqueName: \"kubernetes.io/projected/7d38331e-2c20-4482-9194-194d1bfddc67-kube-api-access-hswfz\") pod \"kuadrant-operator-controller-manager-55c7f4c975-cvqzd\" (UID: \"7d38331e-2c20-4482-9194-194d1bfddc67\") " pod="kuadrant-system/kuadrant-operator-controller-manager-55c7f4c975-cvqzd" Jun 03 01:12:38.455990 ip-10-0-138-55 kubenswrapper[2566]: I0603 01:12:38.455936 2566 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/7d38331e-2c20-4482-9194-194d1bfddc67-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-55c7f4c975-cvqzd\" (UID: \"7d38331e-2c20-4482-9194-194d1bfddc67\") " pod="kuadrant-system/kuadrant-operator-controller-manager-55c7f4c975-cvqzd" Jun 03 01:12:38.456175 ip-10-0-138-55 kubenswrapper[2566]: I0603 01:12:38.456052 2566 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-hswfz\" (UniqueName: \"kubernetes.io/projected/7d38331e-2c20-4482-9194-194d1bfddc67-kube-api-access-hswfz\") pod \"kuadrant-operator-controller-manager-55c7f4c975-cvqzd\" (UID: \"7d38331e-2c20-4482-9194-194d1bfddc67\") " pod="kuadrant-system/kuadrant-operator-controller-manager-55c7f4c975-cvqzd" Jun 03 01:12:38.456175 ip-10-0-138-55 kubenswrapper[2566]: I0603 01:12:38.456089 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/41d2259e-1f9e-4aa7-9587-341704e1bf57-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-5f895dd7d5-vhw82\" (UID: \"41d2259e-1f9e-4aa7-9587-341704e1bf57\") " pod="kuadrant-system/kuadrant-operator-controller-manager-5f895dd7d5-vhw82" Jun 03 01:12:38.456175 ip-10-0-138-55 kubenswrapper[2566]: I0603 01:12:38.456117 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-9d489\" (UniqueName: \"kubernetes.io/projected/41d2259e-1f9e-4aa7-9587-341704e1bf57-kube-api-access-9d489\") pod \"kuadrant-operator-controller-manager-5f895dd7d5-vhw82\" (UID: \"41d2259e-1f9e-4aa7-9587-341704e1bf57\") " pod="kuadrant-system/kuadrant-operator-controller-manager-5f895dd7d5-vhw82" Jun 03 01:12:38.456367 ip-10-0-138-55 kubenswrapper[2566]: I0603 01:12:38.456351 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/7d38331e-2c20-4482-9194-194d1bfddc67-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-55c7f4c975-cvqzd\" (UID: \"7d38331e-2c20-4482-9194-194d1bfddc67\") " pod="kuadrant-system/kuadrant-operator-controller-manager-55c7f4c975-cvqzd" Jun 03 01:12:38.471010 ip-10-0-138-55 kubenswrapper[2566]: I0603 01:12:38.468641 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-hswfz\" (UniqueName: \"kubernetes.io/projected/7d38331e-2c20-4482-9194-194d1bfddc67-kube-api-access-hswfz\") pod \"kuadrant-operator-controller-manager-55c7f4c975-cvqzd\" (UID: \"7d38331e-2c20-4482-9194-194d1bfddc67\") " pod="kuadrant-system/kuadrant-operator-controller-manager-55c7f4c975-cvqzd" Jun 03 01:12:38.491098 ip-10-0-138-55 kubenswrapper[2566]: I0603 01:12:38.491076 2566 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-5f895dd7d5-vb8xw" Jun 03 01:12:38.492921 ip-10-0-138-55 kubenswrapper[2566]: I0603 01:12:38.492895 2566 status_manager.go:895] "Failed to get status for pod" podUID="4a32aff0-e3cf-457d-9085-6433e12ccf39" pod="kuadrant-system/kuadrant-operator-controller-manager-5f895dd7d5-vb8xw" err="pods \"kuadrant-operator-controller-manager-5f895dd7d5-vb8xw\" is forbidden: User \"system:node:ip-10-0-138-55.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-138-55.ec2.internal' and this object" Jun 03 01:12:38.513766 ip-10-0-138-55 kubenswrapper[2566]: I0603 01:12:38.513691 2566 generic.go:358] "Generic (PLEG): container finished" podID="4a32aff0-e3cf-457d-9085-6433e12ccf39" containerID="ca93c84eec5c7237eec8f8d1f27a363b8c1a1ef87fd5f3f8f94a53113bcdd382" exitCode=0 Jun 03 01:12:38.513766 ip-10-0-138-55 kubenswrapper[2566]: I0603 01:12:38.513739 2566 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-5f895dd7d5-vb8xw" Jun 03 01:12:38.513934 ip-10-0-138-55 kubenswrapper[2566]: I0603 01:12:38.513786 2566 scope.go:117] "RemoveContainer" containerID="ca93c84eec5c7237eec8f8d1f27a363b8c1a1ef87fd5f3f8f94a53113bcdd382" Jun 03 01:12:38.515852 ip-10-0-138-55 kubenswrapper[2566]: I0603 01:12:38.515828 2566 status_manager.go:895] "Failed to get status for pod" podUID="4a32aff0-e3cf-457d-9085-6433e12ccf39" pod="kuadrant-system/kuadrant-operator-controller-manager-5f895dd7d5-vb8xw" err="pods \"kuadrant-operator-controller-manager-5f895dd7d5-vb8xw\" is forbidden: User \"system:node:ip-10-0-138-55.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-138-55.ec2.internal' and this object" Jun 03 01:12:38.522422 ip-10-0-138-55 kubenswrapper[2566]: I0603 01:12:38.522402 2566 scope.go:117] "RemoveContainer" containerID="ca93c84eec5c7237eec8f8d1f27a363b8c1a1ef87fd5f3f8f94a53113bcdd382" Jun 03 01:12:38.522694 ip-10-0-138-55 kubenswrapper[2566]: E0603 01:12:38.522677 2566 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"ca93c84eec5c7237eec8f8d1f27a363b8c1a1ef87fd5f3f8f94a53113bcdd382\": container with ID starting with ca93c84eec5c7237eec8f8d1f27a363b8c1a1ef87fd5f3f8f94a53113bcdd382 not found: ID does not exist" containerID="ca93c84eec5c7237eec8f8d1f27a363b8c1a1ef87fd5f3f8f94a53113bcdd382" Jun 03 01:12:38.522743 ip-10-0-138-55 kubenswrapper[2566]: I0603 01:12:38.522702 2566 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"ca93c84eec5c7237eec8f8d1f27a363b8c1a1ef87fd5f3f8f94a53113bcdd382"} err="failed to get container status \"ca93c84eec5c7237eec8f8d1f27a363b8c1a1ef87fd5f3f8f94a53113bcdd382\": rpc error: code = NotFound desc = could not find container \"ca93c84eec5c7237eec8f8d1f27a363b8c1a1ef87fd5f3f8f94a53113bcdd382\": container with ID starting with ca93c84eec5c7237eec8f8d1f27a363b8c1a1ef87fd5f3f8f94a53113bcdd382 not found: ID does not exist" Jun 03 01:12:38.557657 ip-10-0-138-55 kubenswrapper[2566]: I0603 01:12:38.557624 2566 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/41d2259e-1f9e-4aa7-9587-341704e1bf57-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-5f895dd7d5-vhw82\" (UID: \"41d2259e-1f9e-4aa7-9587-341704e1bf57\") " pod="kuadrant-system/kuadrant-operator-controller-manager-5f895dd7d5-vhw82" Jun 03 01:12:38.557657 ip-10-0-138-55 kubenswrapper[2566]: I0603 01:12:38.557658 2566 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-9d489\" (UniqueName: \"kubernetes.io/projected/41d2259e-1f9e-4aa7-9587-341704e1bf57-kube-api-access-9d489\") pod \"kuadrant-operator-controller-manager-5f895dd7d5-vhw82\" (UID: \"41d2259e-1f9e-4aa7-9587-341704e1bf57\") " pod="kuadrant-system/kuadrant-operator-controller-manager-5f895dd7d5-vhw82" Jun 03 01:12:38.557987 ip-10-0-138-55 kubenswrapper[2566]: I0603 01:12:38.557967 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/41d2259e-1f9e-4aa7-9587-341704e1bf57-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-5f895dd7d5-vhw82\" (UID: \"41d2259e-1f9e-4aa7-9587-341704e1bf57\") " pod="kuadrant-system/kuadrant-operator-controller-manager-5f895dd7d5-vhw82" Jun 03 01:12:38.573171 ip-10-0-138-55 kubenswrapper[2566]: I0603 01:12:38.573141 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-9d489\" (UniqueName: \"kubernetes.io/projected/41d2259e-1f9e-4aa7-9587-341704e1bf57-kube-api-access-9d489\") pod \"kuadrant-operator-controller-manager-5f895dd7d5-vhw82\" (UID: \"41d2259e-1f9e-4aa7-9587-341704e1bf57\") " pod="kuadrant-system/kuadrant-operator-controller-manager-5f895dd7d5-vhw82" Jun 03 01:12:38.631631 ip-10-0-138-55 kubenswrapper[2566]: I0603 01:12:38.631597 2566 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-55c7f4c975-cvqzd" Jun 03 01:12:38.638954 ip-10-0-138-55 kubenswrapper[2566]: I0603 01:12:38.638930 2566 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-5f895dd7d5-vhw82" Jun 03 01:12:38.658846 ip-10-0-138-55 kubenswrapper[2566]: I0603 01:12:38.658818 2566 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/4a32aff0-e3cf-457d-9085-6433e12ccf39-extensions-socket-volume\") pod \"4a32aff0-e3cf-457d-9085-6433e12ccf39\" (UID: \"4a32aff0-e3cf-457d-9085-6433e12ccf39\") " Jun 03 01:12:38.658990 ip-10-0-138-55 kubenswrapper[2566]: I0603 01:12:38.658952 2566 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-jl8s2\" (UniqueName: \"kubernetes.io/projected/4a32aff0-e3cf-457d-9085-6433e12ccf39-kube-api-access-jl8s2\") pod \"4a32aff0-e3cf-457d-9085-6433e12ccf39\" (UID: \"4a32aff0-e3cf-457d-9085-6433e12ccf39\") " Jun 03 01:12:38.659563 ip-10-0-138-55 kubenswrapper[2566]: I0603 01:12:38.659316 2566 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/4a32aff0-e3cf-457d-9085-6433e12ccf39-extensions-socket-volume" (OuterVolumeSpecName: "extensions-socket-volume") pod "4a32aff0-e3cf-457d-9085-6433e12ccf39" (UID: "4a32aff0-e3cf-457d-9085-6433e12ccf39"). InnerVolumeSpecName "extensions-socket-volume". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jun 03 01:12:38.661430 ip-10-0-138-55 kubenswrapper[2566]: I0603 01:12:38.661402 2566 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/4a32aff0-e3cf-457d-9085-6433e12ccf39-kube-api-access-jl8s2" (OuterVolumeSpecName: "kube-api-access-jl8s2") pod "4a32aff0-e3cf-457d-9085-6433e12ccf39" (UID: "4a32aff0-e3cf-457d-9085-6433e12ccf39"). InnerVolumeSpecName "kube-api-access-jl8s2". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 03 01:12:38.761220 ip-10-0-138-55 kubenswrapper[2566]: I0603 01:12:38.760885 2566 reconciler_common.go:299] "Volume detached for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/4a32aff0-e3cf-457d-9085-6433e12ccf39-extensions-socket-volume\") on node \"ip-10-0-138-55.ec2.internal\" DevicePath \"\"" Jun 03 01:12:38.761220 ip-10-0-138-55 kubenswrapper[2566]: I0603 01:12:38.760918 2566 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-jl8s2\" (UniqueName: \"kubernetes.io/projected/4a32aff0-e3cf-457d-9085-6433e12ccf39-kube-api-access-jl8s2\") on node \"ip-10-0-138-55.ec2.internal\" DevicePath \"\"" Jun 03 01:12:38.788185 ip-10-0-138-55 kubenswrapper[2566]: I0603 01:12:38.788153 2566 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-55c7f4c975-cvqzd"] Jun 03 01:12:38.790049 ip-10-0-138-55 kubenswrapper[2566]: W0603 01:12:38.790022 2566 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod7d38331e_2c20_4482_9194_194d1bfddc67.slice/crio-174a9f5de7f768958f4be6e00562ee6bd628a7dd551c213a0423d0496aec6846 WatchSource:0}: Error finding container 174a9f5de7f768958f4be6e00562ee6bd628a7dd551c213a0423d0496aec6846: Status 404 returned error can't find the container with id 174a9f5de7f768958f4be6e00562ee6bd628a7dd551c213a0423d0496aec6846 Jun 03 01:12:38.805454 ip-10-0-138-55 kubenswrapper[2566]: I0603 01:12:38.805424 2566 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-5f895dd7d5-vhw82"] Jun 03 01:12:38.807119 ip-10-0-138-55 kubenswrapper[2566]: W0603 01:12:38.807095 2566 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod41d2259e_1f9e_4aa7_9587_341704e1bf57.slice/crio-be0f880de957eca7d0ec1c069069b8ac980818659830f0ecda5549019fe58cbc WatchSource:0}: Error finding container be0f880de957eca7d0ec1c069069b8ac980818659830f0ecda5549019fe58cbc: Status 404 returned error can't find the container with id be0f880de957eca7d0ec1c069069b8ac980818659830f0ecda5549019fe58cbc Jun 03 01:12:38.827471 ip-10-0-138-55 kubenswrapper[2566]: W0603 01:12:38.827448 2566 helpers.go:245] readString: Failed to read "/sys/fs/cgroup/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod4a32aff0_e3cf_457d_9085_6433e12ccf39.slice/cpu.max": read /sys/fs/cgroup/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod4a32aff0_e3cf_457d_9085_6433e12ccf39.slice/cpu.max: no such device Jun 03 01:12:38.830601 ip-10-0-138-55 kubenswrapper[2566]: I0603 01:12:38.830561 2566 status_manager.go:895] "Failed to get status for pod" podUID="4a32aff0-e3cf-457d-9085-6433e12ccf39" pod="kuadrant-system/kuadrant-operator-controller-manager-5f895dd7d5-vb8xw" err="pods \"kuadrant-operator-controller-manager-5f895dd7d5-vb8xw\" is forbidden: User \"system:node:ip-10-0-138-55.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-138-55.ec2.internal' and this object" Jun 03 01:12:39.519803 ip-10-0-138-55 kubenswrapper[2566]: I0603 01:12:39.519763 2566 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-5f895dd7d5-vhw82" event={"ID":"41d2259e-1f9e-4aa7-9587-341704e1bf57","Type":"ContainerStarted","Data":"00a39863ed2d69af2a15bf83c3474dfb44b9c8cd408ccac09bac0806829f86aa"} Jun 03 01:12:39.519803 ip-10-0-138-55 kubenswrapper[2566]: I0603 01:12:39.519806 2566 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-5f895dd7d5-vhw82" event={"ID":"41d2259e-1f9e-4aa7-9587-341704e1bf57","Type":"ContainerStarted","Data":"be0f880de957eca7d0ec1c069069b8ac980818659830f0ecda5549019fe58cbc"} Jun 03 01:12:39.520319 ip-10-0-138-55 kubenswrapper[2566]: I0603 01:12:39.519873 2566 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/kuadrant-operator-controller-manager-5f895dd7d5-vhw82" Jun 03 01:12:39.521248 ip-10-0-138-55 kubenswrapper[2566]: I0603 01:12:39.521208 2566 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-55c7f4c975-cvqzd" event={"ID":"7d38331e-2c20-4482-9194-194d1bfddc67","Type":"ContainerStarted","Data":"724b332442188db0b672faff0e66ddcbb572624c5d309fa58d945506fa79a0c5"} Jun 03 01:12:39.521336 ip-10-0-138-55 kubenswrapper[2566]: I0603 01:12:39.521257 2566 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-55c7f4c975-cvqzd" event={"ID":"7d38331e-2c20-4482-9194-194d1bfddc67","Type":"ContainerStarted","Data":"174a9f5de7f768958f4be6e00562ee6bd628a7dd551c213a0423d0496aec6846"} Jun 03 01:12:39.521336 ip-10-0-138-55 kubenswrapper[2566]: I0603 01:12:39.521283 2566 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/kuadrant-operator-controller-manager-55c7f4c975-cvqzd" Jun 03 01:12:39.544090 ip-10-0-138-55 kubenswrapper[2566]: I0603 01:12:39.544004 2566 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="kuadrant-system/kuadrant-operator-controller-manager-5f895dd7d5-vhw82" podStartSLOduration=1.543992011 podStartE2EDuration="1.543992011s" podCreationTimestamp="2026-06-03 01:12:38 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2026-06-03 01:12:39.542061627 +0000 UTC m=+482.688903574" watchObservedRunningTime="2026-06-03 01:12:39.543992011 +0000 UTC m=+482.690833956" Jun 03 01:12:39.544370 ip-10-0-138-55 kubenswrapper[2566]: I0603 01:12:39.544344 2566 status_manager.go:895] "Failed to get status for pod" podUID="4a32aff0-e3cf-457d-9085-6433e12ccf39" pod="kuadrant-system/kuadrant-operator-controller-manager-5f895dd7d5-vb8xw" err="pods \"kuadrant-operator-controller-manager-5f895dd7d5-vb8xw\" is forbidden: User \"system:node:ip-10-0-138-55.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-138-55.ec2.internal' and this object" Jun 03 01:12:39.566682 ip-10-0-138-55 kubenswrapper[2566]: I0603 01:12:39.566645 2566 status_manager.go:895] "Failed to get status for pod" podUID="4a32aff0-e3cf-457d-9085-6433e12ccf39" pod="kuadrant-system/kuadrant-operator-controller-manager-5f895dd7d5-vb8xw" err="pods \"kuadrant-operator-controller-manager-5f895dd7d5-vb8xw\" is forbidden: User \"system:node:ip-10-0-138-55.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-138-55.ec2.internal' and this object" Jun 03 01:12:39.567034 ip-10-0-138-55 kubenswrapper[2566]: I0603 01:12:39.567002 2566 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="kuadrant-system/kuadrant-operator-controller-manager-55c7f4c975-cvqzd" podStartSLOduration=1.566991689 podStartE2EDuration="1.566991689s" podCreationTimestamp="2026-06-03 01:12:38 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2026-06-03 01:12:39.564868826 +0000 UTC m=+482.711710772" watchObservedRunningTime="2026-06-03 01:12:39.566991689 +0000 UTC m=+482.713833699" Jun 03 01:12:39.591982 ip-10-0-138-55 kubenswrapper[2566]: I0603 01:12:39.591941 2566 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="4a32aff0-e3cf-457d-9085-6433e12ccf39" path="/var/lib/kubelet/pods/4a32aff0-e3cf-457d-9085-6433e12ccf39/volumes" Jun 03 01:12:41.486684 ip-10-0-138-55 kubenswrapper[2566]: I0603 01:12:41.486649 2566 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/authorino-operator-657f44b778-8ghpk" Jun 03 01:12:50.527384 ip-10-0-138-55 kubenswrapper[2566]: I0603 01:12:50.527352 2566 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/kuadrant-operator-controller-manager-55c7f4c975-cvqzd" Jun 03 01:12:50.527768 ip-10-0-138-55 kubenswrapper[2566]: I0603 01:12:50.527412 2566 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/kuadrant-operator-controller-manager-5f895dd7d5-vhw82" Jun 03 01:12:50.599964 ip-10-0-138-55 kubenswrapper[2566]: I0603 01:12:50.599931 2566 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-5f895dd7d5-vhw82"] Jun 03 01:12:50.600161 ip-10-0-138-55 kubenswrapper[2566]: I0603 01:12:50.600121 2566 kuberuntime_container.go:864] "Killing container with a grace period" pod="kuadrant-system/kuadrant-operator-controller-manager-5f895dd7d5-vhw82" podUID="41d2259e-1f9e-4aa7-9587-341704e1bf57" containerName="manager" containerID="cri-o://00a39863ed2d69af2a15bf83c3474dfb44b9c8cd408ccac09bac0806829f86aa" gracePeriod=10 Jun 03 01:12:50.856546 ip-10-0-138-55 kubenswrapper[2566]: I0603 01:12:50.856524 2566 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-5f895dd7d5-vhw82" Jun 03 01:12:50.872145 ip-10-0-138-55 kubenswrapper[2566]: I0603 01:12:50.872109 2566 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-9d489\" (UniqueName: \"kubernetes.io/projected/41d2259e-1f9e-4aa7-9587-341704e1bf57-kube-api-access-9d489\") pod \"41d2259e-1f9e-4aa7-9587-341704e1bf57\" (UID: \"41d2259e-1f9e-4aa7-9587-341704e1bf57\") " Jun 03 01:12:50.872299 ip-10-0-138-55 kubenswrapper[2566]: I0603 01:12:50.872199 2566 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/41d2259e-1f9e-4aa7-9587-341704e1bf57-extensions-socket-volume\") pod \"41d2259e-1f9e-4aa7-9587-341704e1bf57\" (UID: \"41d2259e-1f9e-4aa7-9587-341704e1bf57\") " Jun 03 01:12:50.872583 ip-10-0-138-55 kubenswrapper[2566]: I0603 01:12:50.872558 2566 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/41d2259e-1f9e-4aa7-9587-341704e1bf57-extensions-socket-volume" (OuterVolumeSpecName: "extensions-socket-volume") pod "41d2259e-1f9e-4aa7-9587-341704e1bf57" (UID: "41d2259e-1f9e-4aa7-9587-341704e1bf57"). InnerVolumeSpecName "extensions-socket-volume". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jun 03 01:12:50.874114 ip-10-0-138-55 kubenswrapper[2566]: I0603 01:12:50.874094 2566 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/41d2259e-1f9e-4aa7-9587-341704e1bf57-kube-api-access-9d489" (OuterVolumeSpecName: "kube-api-access-9d489") pod "41d2259e-1f9e-4aa7-9587-341704e1bf57" (UID: "41d2259e-1f9e-4aa7-9587-341704e1bf57"). InnerVolumeSpecName "kube-api-access-9d489". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 03 01:12:50.973743 ip-10-0-138-55 kubenswrapper[2566]: I0603 01:12:50.973708 2566 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-9d489\" (UniqueName: \"kubernetes.io/projected/41d2259e-1f9e-4aa7-9587-341704e1bf57-kube-api-access-9d489\") on node \"ip-10-0-138-55.ec2.internal\" DevicePath \"\"" Jun 03 01:12:50.973743 ip-10-0-138-55 kubenswrapper[2566]: I0603 01:12:50.973736 2566 reconciler_common.go:299] "Volume detached for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/41d2259e-1f9e-4aa7-9587-341704e1bf57-extensions-socket-volume\") on node \"ip-10-0-138-55.ec2.internal\" DevicePath \"\"" Jun 03 01:12:51.569536 ip-10-0-138-55 kubenswrapper[2566]: I0603 01:12:51.569501 2566 generic.go:358] "Generic (PLEG): container finished" podID="41d2259e-1f9e-4aa7-9587-341704e1bf57" containerID="00a39863ed2d69af2a15bf83c3474dfb44b9c8cd408ccac09bac0806829f86aa" exitCode=0 Jun 03 01:12:51.569955 ip-10-0-138-55 kubenswrapper[2566]: I0603 01:12:51.569562 2566 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-5f895dd7d5-vhw82" Jun 03 01:12:51.569955 ip-10-0-138-55 kubenswrapper[2566]: I0603 01:12:51.569580 2566 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-5f895dd7d5-vhw82" event={"ID":"41d2259e-1f9e-4aa7-9587-341704e1bf57","Type":"ContainerDied","Data":"00a39863ed2d69af2a15bf83c3474dfb44b9c8cd408ccac09bac0806829f86aa"} Jun 03 01:12:51.569955 ip-10-0-138-55 kubenswrapper[2566]: I0603 01:12:51.569620 2566 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-5f895dd7d5-vhw82" event={"ID":"41d2259e-1f9e-4aa7-9587-341704e1bf57","Type":"ContainerDied","Data":"be0f880de957eca7d0ec1c069069b8ac980818659830f0ecda5549019fe58cbc"} Jun 03 01:12:51.569955 ip-10-0-138-55 kubenswrapper[2566]: I0603 01:12:51.569641 2566 scope.go:117] "RemoveContainer" containerID="00a39863ed2d69af2a15bf83c3474dfb44b9c8cd408ccac09bac0806829f86aa" Jun 03 01:12:51.578805 ip-10-0-138-55 kubenswrapper[2566]: I0603 01:12:51.578784 2566 scope.go:117] "RemoveContainer" containerID="00a39863ed2d69af2a15bf83c3474dfb44b9c8cd408ccac09bac0806829f86aa" Jun 03 01:12:51.579049 ip-10-0-138-55 kubenswrapper[2566]: E0603 01:12:51.579030 2566 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"00a39863ed2d69af2a15bf83c3474dfb44b9c8cd408ccac09bac0806829f86aa\": container with ID starting with 00a39863ed2d69af2a15bf83c3474dfb44b9c8cd408ccac09bac0806829f86aa not found: ID does not exist" containerID="00a39863ed2d69af2a15bf83c3474dfb44b9c8cd408ccac09bac0806829f86aa" Jun 03 01:12:51.579096 ip-10-0-138-55 kubenswrapper[2566]: I0603 01:12:51.579058 2566 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"00a39863ed2d69af2a15bf83c3474dfb44b9c8cd408ccac09bac0806829f86aa"} err="failed to get container status \"00a39863ed2d69af2a15bf83c3474dfb44b9c8cd408ccac09bac0806829f86aa\": rpc error: code = NotFound desc = could not find container \"00a39863ed2d69af2a15bf83c3474dfb44b9c8cd408ccac09bac0806829f86aa\": container with ID starting with 00a39863ed2d69af2a15bf83c3474dfb44b9c8cd408ccac09bac0806829f86aa not found: ID does not exist" Jun 03 01:12:51.591473 ip-10-0-138-55 kubenswrapper[2566]: I0603 01:12:51.591451 2566 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-5f895dd7d5-vhw82"] Jun 03 01:12:51.599757 ip-10-0-138-55 kubenswrapper[2566]: I0603 01:12:51.599727 2566 kubelet.go:2547] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-5f895dd7d5-vhw82"] Jun 03 01:12:53.590681 ip-10-0-138-55 kubenswrapper[2566]: I0603 01:12:53.590645 2566 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="41d2259e-1f9e-4aa7-9587-341704e1bf57" path="/var/lib/kubelet/pods/41d2259e-1f9e-4aa7-9587-341704e1bf57/volumes" Jun 03 01:13:06.849622 ip-10-0-138-55 kubenswrapper[2566]: I0603 01:13:06.849587 2566 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-ingress/maas-default-gateway-openshift-default-7d6f447cf5-6vd8b"] Jun 03 01:13:06.850083 ip-10-0-138-55 kubenswrapper[2566]: I0603 01:13:06.850004 2566 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="41d2259e-1f9e-4aa7-9587-341704e1bf57" containerName="manager" Jun 03 01:13:06.850083 ip-10-0-138-55 kubenswrapper[2566]: I0603 01:13:06.850017 2566 state_mem.go:107] "Deleted CPUSet assignment" podUID="41d2259e-1f9e-4aa7-9587-341704e1bf57" containerName="manager" Jun 03 01:13:06.850083 ip-10-0-138-55 kubenswrapper[2566]: I0603 01:13:06.850082 2566 memory_manager.go:356] "RemoveStaleState removing state" podUID="41d2259e-1f9e-4aa7-9587-341704e1bf57" containerName="manager" Jun 03 01:13:06.855022 ip-10-0-138-55 kubenswrapper[2566]: I0603 01:13:06.854999 2566 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/maas-default-gateway-openshift-default-7d6f447cf5-6vd8b" Jun 03 01:13:06.857249 ip-10-0-138-55 kubenswrapper[2566]: I0603 01:13:06.857197 2566 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"maas-default-gateway-openshift-default-dockercfg-hftlr\"" Jun 03 01:13:06.863307 ip-10-0-138-55 kubenswrapper[2566]: I0603 01:13:06.863277 2566 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/maas-default-gateway-openshift-default-7d6f447cf5-6vd8b"] Jun 03 01:13:06.911401 ip-10-0-138-55 kubenswrapper[2566]: I0603 01:13:06.911369 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/7d7ddddb-62c0-4920-a201-726c8b885fc0-workload-socket\") pod \"maas-default-gateway-openshift-default-7d6f447cf5-6vd8b\" (UID: \"7d7ddddb-62c0-4920-a201-726c8b885fc0\") " pod="openshift-ingress/maas-default-gateway-openshift-default-7d6f447cf5-6vd8b" Jun 03 01:13:06.911559 ip-10-0-138-55 kubenswrapper[2566]: I0603 01:13:06.911410 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/7d7ddddb-62c0-4920-a201-726c8b885fc0-istio-envoy\") pod \"maas-default-gateway-openshift-default-7d6f447cf5-6vd8b\" (UID: \"7d7ddddb-62c0-4920-a201-726c8b885fc0\") " pod="openshift-ingress/maas-default-gateway-openshift-default-7d6f447cf5-6vd8b" Jun 03 01:13:06.911559 ip-10-0-138-55 kubenswrapper[2566]: I0603 01:13:06.911431 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/7d7ddddb-62c0-4920-a201-726c8b885fc0-istiod-ca-cert\") pod \"maas-default-gateway-openshift-default-7d6f447cf5-6vd8b\" (UID: \"7d7ddddb-62c0-4920-a201-726c8b885fc0\") " pod="openshift-ingress/maas-default-gateway-openshift-default-7d6f447cf5-6vd8b" Jun 03 01:13:06.911559 ip-10-0-138-55 kubenswrapper[2566]: I0603 01:13:06.911509 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/7d7ddddb-62c0-4920-a201-726c8b885fc0-workload-certs\") pod \"maas-default-gateway-openshift-default-7d6f447cf5-6vd8b\" (UID: \"7d7ddddb-62c0-4920-a201-726c8b885fc0\") " pod="openshift-ingress/maas-default-gateway-openshift-default-7d6f447cf5-6vd8b" Jun 03 01:13:06.911559 ip-10-0-138-55 kubenswrapper[2566]: I0603 01:13:06.911543 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/7d7ddddb-62c0-4920-a201-726c8b885fc0-istio-token\") pod \"maas-default-gateway-openshift-default-7d6f447cf5-6vd8b\" (UID: \"7d7ddddb-62c0-4920-a201-726c8b885fc0\") " pod="openshift-ingress/maas-default-gateway-openshift-default-7d6f447cf5-6vd8b" Jun 03 01:13:06.911724 ip-10-0-138-55 kubenswrapper[2566]: I0603 01:13:06.911579 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/7d7ddddb-62c0-4920-a201-726c8b885fc0-credential-socket\") pod \"maas-default-gateway-openshift-default-7d6f447cf5-6vd8b\" (UID: \"7d7ddddb-62c0-4920-a201-726c8b885fc0\") " pod="openshift-ingress/maas-default-gateway-openshift-default-7d6f447cf5-6vd8b" Jun 03 01:13:06.911724 ip-10-0-138-55 kubenswrapper[2566]: I0603 01:13:06.911612 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/7d7ddddb-62c0-4920-a201-726c8b885fc0-istio-podinfo\") pod \"maas-default-gateway-openshift-default-7d6f447cf5-6vd8b\" (UID: \"7d7ddddb-62c0-4920-a201-726c8b885fc0\") " pod="openshift-ingress/maas-default-gateway-openshift-default-7d6f447cf5-6vd8b" Jun 03 01:13:06.911724 ip-10-0-138-55 kubenswrapper[2566]: I0603 01:13:06.911641 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/7d7ddddb-62c0-4920-a201-726c8b885fc0-istio-data\") pod \"maas-default-gateway-openshift-default-7d6f447cf5-6vd8b\" (UID: \"7d7ddddb-62c0-4920-a201-726c8b885fc0\") " pod="openshift-ingress/maas-default-gateway-openshift-default-7d6f447cf5-6vd8b" Jun 03 01:13:06.911838 ip-10-0-138-55 kubenswrapper[2566]: I0603 01:13:06.911740 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-mcp92\" (UniqueName: \"kubernetes.io/projected/7d7ddddb-62c0-4920-a201-726c8b885fc0-kube-api-access-mcp92\") pod \"maas-default-gateway-openshift-default-7d6f447cf5-6vd8b\" (UID: \"7d7ddddb-62c0-4920-a201-726c8b885fc0\") " pod="openshift-ingress/maas-default-gateway-openshift-default-7d6f447cf5-6vd8b" Jun 03 01:13:07.012989 ip-10-0-138-55 kubenswrapper[2566]: I0603 01:13:07.012951 2566 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/7d7ddddb-62c0-4920-a201-726c8b885fc0-istio-podinfo\") pod \"maas-default-gateway-openshift-default-7d6f447cf5-6vd8b\" (UID: \"7d7ddddb-62c0-4920-a201-726c8b885fc0\") " pod="openshift-ingress/maas-default-gateway-openshift-default-7d6f447cf5-6vd8b" Jun 03 01:13:07.012989 ip-10-0-138-55 kubenswrapper[2566]: I0603 01:13:07.012998 2566 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/7d7ddddb-62c0-4920-a201-726c8b885fc0-istio-data\") pod \"maas-default-gateway-openshift-default-7d6f447cf5-6vd8b\" (UID: \"7d7ddddb-62c0-4920-a201-726c8b885fc0\") " pod="openshift-ingress/maas-default-gateway-openshift-default-7d6f447cf5-6vd8b" Jun 03 01:13:07.013280 ip-10-0-138-55 kubenswrapper[2566]: I0603 01:13:07.013051 2566 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-mcp92\" (UniqueName: \"kubernetes.io/projected/7d7ddddb-62c0-4920-a201-726c8b885fc0-kube-api-access-mcp92\") pod \"maas-default-gateway-openshift-default-7d6f447cf5-6vd8b\" (UID: \"7d7ddddb-62c0-4920-a201-726c8b885fc0\") " pod="openshift-ingress/maas-default-gateway-openshift-default-7d6f447cf5-6vd8b" Jun 03 01:13:07.013280 ip-10-0-138-55 kubenswrapper[2566]: I0603 01:13:07.013098 2566 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/7d7ddddb-62c0-4920-a201-726c8b885fc0-workload-socket\") pod \"maas-default-gateway-openshift-default-7d6f447cf5-6vd8b\" (UID: \"7d7ddddb-62c0-4920-a201-726c8b885fc0\") " pod="openshift-ingress/maas-default-gateway-openshift-default-7d6f447cf5-6vd8b" Jun 03 01:13:07.013280 ip-10-0-138-55 kubenswrapper[2566]: I0603 01:13:07.013116 2566 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/7d7ddddb-62c0-4920-a201-726c8b885fc0-istio-envoy\") pod \"maas-default-gateway-openshift-default-7d6f447cf5-6vd8b\" (UID: \"7d7ddddb-62c0-4920-a201-726c8b885fc0\") " pod="openshift-ingress/maas-default-gateway-openshift-default-7d6f447cf5-6vd8b" Jun 03 01:13:07.013280 ip-10-0-138-55 kubenswrapper[2566]: I0603 01:13:07.013135 2566 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/7d7ddddb-62c0-4920-a201-726c8b885fc0-istiod-ca-cert\") pod \"maas-default-gateway-openshift-default-7d6f447cf5-6vd8b\" (UID: \"7d7ddddb-62c0-4920-a201-726c8b885fc0\") " pod="openshift-ingress/maas-default-gateway-openshift-default-7d6f447cf5-6vd8b" Jun 03 01:13:07.013280 ip-10-0-138-55 kubenswrapper[2566]: I0603 01:13:07.013165 2566 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/7d7ddddb-62c0-4920-a201-726c8b885fc0-workload-certs\") pod \"maas-default-gateway-openshift-default-7d6f447cf5-6vd8b\" (UID: \"7d7ddddb-62c0-4920-a201-726c8b885fc0\") " pod="openshift-ingress/maas-default-gateway-openshift-default-7d6f447cf5-6vd8b" Jun 03 01:13:07.013280 ip-10-0-138-55 kubenswrapper[2566]: I0603 01:13:07.013190 2566 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/7d7ddddb-62c0-4920-a201-726c8b885fc0-istio-token\") pod \"maas-default-gateway-openshift-default-7d6f447cf5-6vd8b\" (UID: \"7d7ddddb-62c0-4920-a201-726c8b885fc0\") " pod="openshift-ingress/maas-default-gateway-openshift-default-7d6f447cf5-6vd8b" Jun 03 01:13:07.013594 ip-10-0-138-55 kubenswrapper[2566]: I0603 01:13:07.013413 2566 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/7d7ddddb-62c0-4920-a201-726c8b885fc0-credential-socket\") pod \"maas-default-gateway-openshift-default-7d6f447cf5-6vd8b\" (UID: \"7d7ddddb-62c0-4920-a201-726c8b885fc0\") " pod="openshift-ingress/maas-default-gateway-openshift-default-7d6f447cf5-6vd8b" Jun 03 01:13:07.013594 ip-10-0-138-55 kubenswrapper[2566]: I0603 01:13:07.013575 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/7d7ddddb-62c0-4920-a201-726c8b885fc0-istio-data\") pod \"maas-default-gateway-openshift-default-7d6f447cf5-6vd8b\" (UID: \"7d7ddddb-62c0-4920-a201-726c8b885fc0\") " pod="openshift-ingress/maas-default-gateway-openshift-default-7d6f447cf5-6vd8b" Jun 03 01:13:07.013698 ip-10-0-138-55 kubenswrapper[2566]: I0603 01:13:07.013597 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/7d7ddddb-62c0-4920-a201-726c8b885fc0-workload-socket\") pod \"maas-default-gateway-openshift-default-7d6f447cf5-6vd8b\" (UID: \"7d7ddddb-62c0-4920-a201-726c8b885fc0\") " pod="openshift-ingress/maas-default-gateway-openshift-default-7d6f447cf5-6vd8b" Jun 03 01:13:07.013698 ip-10-0-138-55 kubenswrapper[2566]: I0603 01:13:07.013672 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/7d7ddddb-62c0-4920-a201-726c8b885fc0-workload-certs\") pod \"maas-default-gateway-openshift-default-7d6f447cf5-6vd8b\" (UID: \"7d7ddddb-62c0-4920-a201-726c8b885fc0\") " pod="openshift-ingress/maas-default-gateway-openshift-default-7d6f447cf5-6vd8b" Jun 03 01:13:07.013831 ip-10-0-138-55 kubenswrapper[2566]: I0603 01:13:07.013805 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/7d7ddddb-62c0-4920-a201-726c8b885fc0-credential-socket\") pod \"maas-default-gateway-openshift-default-7d6f447cf5-6vd8b\" (UID: \"7d7ddddb-62c0-4920-a201-726c8b885fc0\") " pod="openshift-ingress/maas-default-gateway-openshift-default-7d6f447cf5-6vd8b" Jun 03 01:13:07.014097 ip-10-0-138-55 kubenswrapper[2566]: I0603 01:13:07.014079 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/7d7ddddb-62c0-4920-a201-726c8b885fc0-istiod-ca-cert\") pod \"maas-default-gateway-openshift-default-7d6f447cf5-6vd8b\" (UID: \"7d7ddddb-62c0-4920-a201-726c8b885fc0\") " pod="openshift-ingress/maas-default-gateway-openshift-default-7d6f447cf5-6vd8b" Jun 03 01:13:07.015626 ip-10-0-138-55 kubenswrapper[2566]: I0603 01:13:07.015599 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/7d7ddddb-62c0-4920-a201-726c8b885fc0-istio-envoy\") pod \"maas-default-gateway-openshift-default-7d6f447cf5-6vd8b\" (UID: \"7d7ddddb-62c0-4920-a201-726c8b885fc0\") " pod="openshift-ingress/maas-default-gateway-openshift-default-7d6f447cf5-6vd8b" Jun 03 01:13:07.015756 ip-10-0-138-55 kubenswrapper[2566]: I0603 01:13:07.015672 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/7d7ddddb-62c0-4920-a201-726c8b885fc0-istio-podinfo\") pod \"maas-default-gateway-openshift-default-7d6f447cf5-6vd8b\" (UID: \"7d7ddddb-62c0-4920-a201-726c8b885fc0\") " pod="openshift-ingress/maas-default-gateway-openshift-default-7d6f447cf5-6vd8b" Jun 03 01:13:07.020348 ip-10-0-138-55 kubenswrapper[2566]: I0603 01:13:07.020325 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/7d7ddddb-62c0-4920-a201-726c8b885fc0-istio-token\") pod \"maas-default-gateway-openshift-default-7d6f447cf5-6vd8b\" (UID: \"7d7ddddb-62c0-4920-a201-726c8b885fc0\") " pod="openshift-ingress/maas-default-gateway-openshift-default-7d6f447cf5-6vd8b" Jun 03 01:13:07.020445 ip-10-0-138-55 kubenswrapper[2566]: I0603 01:13:07.020417 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-mcp92\" (UniqueName: \"kubernetes.io/projected/7d7ddddb-62c0-4920-a201-726c8b885fc0-kube-api-access-mcp92\") pod \"maas-default-gateway-openshift-default-7d6f447cf5-6vd8b\" (UID: \"7d7ddddb-62c0-4920-a201-726c8b885fc0\") " pod="openshift-ingress/maas-default-gateway-openshift-default-7d6f447cf5-6vd8b" Jun 03 01:13:07.170616 ip-10-0-138-55 kubenswrapper[2566]: I0603 01:13:07.170518 2566 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/maas-default-gateway-openshift-default-7d6f447cf5-6vd8b" Jun 03 01:13:07.311653 ip-10-0-138-55 kubenswrapper[2566]: I0603 01:13:07.311619 2566 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/maas-default-gateway-openshift-default-7d6f447cf5-6vd8b"] Jun 03 01:13:07.313022 ip-10-0-138-55 kubenswrapper[2566]: W0603 01:13:07.312996 2566 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod7d7ddddb_62c0_4920_a201_726c8b885fc0.slice/crio-174719a7ab0d22588f993c1586c07786b537d5b1d51b0daabca891b11eb51b34 WatchSource:0}: Error finding container 174719a7ab0d22588f993c1586c07786b537d5b1d51b0daabca891b11eb51b34: Status 404 returned error can't find the container with id 174719a7ab0d22588f993c1586c07786b537d5b1d51b0daabca891b11eb51b34 Jun 03 01:13:07.315218 ip-10-0-138-55 kubenswrapper[2566]: I0603 01:13:07.315180 2566 kubelet_resources.go:45] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236224Ki","pods":"250"} Jun 03 01:13:07.315341 ip-10-0-138-55 kubenswrapper[2566]: I0603 01:13:07.315293 2566 kubelet_resources.go:45] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236224Ki","pods":"250"} Jun 03 01:13:07.315404 ip-10-0-138-55 kubenswrapper[2566]: I0603 01:13:07.315339 2566 kubelet_resources.go:45] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236224Ki","pods":"250"} Jun 03 01:13:07.630461 ip-10-0-138-55 kubenswrapper[2566]: I0603 01:13:07.630425 2566 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/maas-default-gateway-openshift-default-7d6f447cf5-6vd8b" event={"ID":"7d7ddddb-62c0-4920-a201-726c8b885fc0","Type":"ContainerStarted","Data":"706896c75cfbad219779824ea75681de900849535dd32db58b6b8cdd0e5b3879"} Jun 03 01:13:07.630461 ip-10-0-138-55 kubenswrapper[2566]: I0603 01:13:07.630464 2566 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/maas-default-gateway-openshift-default-7d6f447cf5-6vd8b" event={"ID":"7d7ddddb-62c0-4920-a201-726c8b885fc0","Type":"ContainerStarted","Data":"174719a7ab0d22588f993c1586c07786b537d5b1d51b0daabca891b11eb51b34"} Jun 03 01:13:07.650561 ip-10-0-138-55 kubenswrapper[2566]: I0603 01:13:07.650351 2566 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-ingress/maas-default-gateway-openshift-default-7d6f447cf5-6vd8b" podStartSLOduration=1.650333298 podStartE2EDuration="1.650333298s" podCreationTimestamp="2026-06-03 01:13:06 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2026-06-03 01:13:07.647636286 +0000 UTC m=+510.794478257" watchObservedRunningTime="2026-06-03 01:13:07.650333298 +0000 UTC m=+510.797175246" Jun 03 01:13:08.170717 ip-10-0-138-55 kubenswrapper[2566]: I0603 01:13:08.170676 2566 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/maas-default-gateway-openshift-default-7d6f447cf5-6vd8b" Jun 03 01:13:08.175519 ip-10-0-138-55 kubenswrapper[2566]: I0603 01:13:08.175494 2566 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/maas-default-gateway-openshift-default-7d6f447cf5-6vd8b" Jun 03 01:13:08.634306 ip-10-0-138-55 kubenswrapper[2566]: I0603 01:13:08.634269 2566 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/maas-default-gateway-openshift-default-7d6f447cf5-6vd8b" Jun 03 01:13:08.635189 ip-10-0-138-55 kubenswrapper[2566]: I0603 01:13:08.635164 2566 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/maas-default-gateway-openshift-default-7d6f447cf5-6vd8b" Jun 03 01:13:11.784962 ip-10-0-138-55 kubenswrapper[2566]: I0603 01:13:11.784925 2566 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["kuadrant-system/authorino-f99f4b5cd-j69v8"] Jun 03 01:13:11.788493 ip-10-0-138-55 kubenswrapper[2566]: I0603 01:13:11.788477 2566 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-f99f4b5cd-j69v8" Jun 03 01:13:11.791428 ip-10-0-138-55 kubenswrapper[2566]: I0603 01:13:11.791407 2566 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"authorino-authorino-dockercfg-hr228\"" Jun 03 01:13:11.802188 ip-10-0-138-55 kubenswrapper[2566]: I0603 01:13:11.802161 2566 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-f99f4b5cd-j69v8"] Jun 03 01:13:11.864825 ip-10-0-138-55 kubenswrapper[2566]: I0603 01:13:11.864787 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-5q9gh\" (UniqueName: \"kubernetes.io/projected/bb1d0204-2038-429c-8201-4d56629f29e4-kube-api-access-5q9gh\") pod \"authorino-f99f4b5cd-j69v8\" (UID: \"bb1d0204-2038-429c-8201-4d56629f29e4\") " pod="kuadrant-system/authorino-f99f4b5cd-j69v8" Jun 03 01:13:11.965606 ip-10-0-138-55 kubenswrapper[2566]: I0603 01:13:11.965559 2566 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-5q9gh\" (UniqueName: \"kubernetes.io/projected/bb1d0204-2038-429c-8201-4d56629f29e4-kube-api-access-5q9gh\") pod \"authorino-f99f4b5cd-j69v8\" (UID: \"bb1d0204-2038-429c-8201-4d56629f29e4\") " pod="kuadrant-system/authorino-f99f4b5cd-j69v8" Jun 03 01:13:11.980302 ip-10-0-138-55 kubenswrapper[2566]: I0603 01:13:11.980271 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-5q9gh\" (UniqueName: \"kubernetes.io/projected/bb1d0204-2038-429c-8201-4d56629f29e4-kube-api-access-5q9gh\") pod \"authorino-f99f4b5cd-j69v8\" (UID: \"bb1d0204-2038-429c-8201-4d56629f29e4\") " pod="kuadrant-system/authorino-f99f4b5cd-j69v8" Jun 03 01:13:12.098525 ip-10-0-138-55 kubenswrapper[2566]: I0603 01:13:12.098493 2566 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-f99f4b5cd-j69v8" Jun 03 01:13:12.229565 ip-10-0-138-55 kubenswrapper[2566]: I0603 01:13:12.229531 2566 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-f99f4b5cd-j69v8"] Jun 03 01:13:12.231335 ip-10-0-138-55 kubenswrapper[2566]: W0603 01:13:12.231298 2566 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-podbb1d0204_2038_429c_8201_4d56629f29e4.slice/crio-46d73b10fe51b8f60815f5d7f46604e7d0d9821f30d8bdc8d50fb7d593f8fc05 WatchSource:0}: Error finding container 46d73b10fe51b8f60815f5d7f46604e7d0d9821f30d8bdc8d50fb7d593f8fc05: Status 404 returned error can't find the container with id 46d73b10fe51b8f60815f5d7f46604e7d0d9821f30d8bdc8d50fb7d593f8fc05 Jun 03 01:13:12.651492 ip-10-0-138-55 kubenswrapper[2566]: I0603 01:13:12.651458 2566 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-f99f4b5cd-j69v8" event={"ID":"bb1d0204-2038-429c-8201-4d56629f29e4","Type":"ContainerStarted","Data":"46d73b10fe51b8f60815f5d7f46604e7d0d9821f30d8bdc8d50fb7d593f8fc05"} Jun 03 01:13:15.668098 ip-10-0-138-55 kubenswrapper[2566]: I0603 01:13:15.668054 2566 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-f99f4b5cd-j69v8" event={"ID":"bb1d0204-2038-429c-8201-4d56629f29e4","Type":"ContainerStarted","Data":"325dc444ac208ac3f068c700d4c818772b1845786c8391c2d28a6714596f37d8"} Jun 03 01:13:15.682810 ip-10-0-138-55 kubenswrapper[2566]: I0603 01:13:15.682748 2566 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="kuadrant-system/authorino-f99f4b5cd-j69v8" podStartSLOduration=1.374635071 podStartE2EDuration="4.682731939s" podCreationTimestamp="2026-06-03 01:13:11 +0000 UTC" firstStartedPulling="2026-06-03 01:13:12.232642174 +0000 UTC m=+515.379484101" lastFinishedPulling="2026-06-03 01:13:15.540739045 +0000 UTC m=+518.687580969" observedRunningTime="2026-06-03 01:13:15.681652979 +0000 UTC m=+518.828494926" watchObservedRunningTime="2026-06-03 01:13:15.682731939 +0000 UTC m=+518.829573886" Jun 03 01:13:17.113670 ip-10-0-138-55 kubenswrapper[2566]: I0603 01:13:17.113637 2566 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-f99f4b5cd-j69v8"] Jun 03 01:13:17.676432 ip-10-0-138-55 kubenswrapper[2566]: I0603 01:13:17.676390 2566 kuberuntime_container.go:864] "Killing container with a grace period" pod="kuadrant-system/authorino-f99f4b5cd-j69v8" podUID="bb1d0204-2038-429c-8201-4d56629f29e4" containerName="authorino" containerID="cri-o://325dc444ac208ac3f068c700d4c818772b1845786c8391c2d28a6714596f37d8" gracePeriod=30 Jun 03 01:13:17.921420 ip-10-0-138-55 kubenswrapper[2566]: I0603 01:13:17.921395 2566 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-f99f4b5cd-j69v8" Jun 03 01:13:18.030179 ip-10-0-138-55 kubenswrapper[2566]: I0603 01:13:18.030093 2566 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-5q9gh\" (UniqueName: \"kubernetes.io/projected/bb1d0204-2038-429c-8201-4d56629f29e4-kube-api-access-5q9gh\") pod \"bb1d0204-2038-429c-8201-4d56629f29e4\" (UID: \"bb1d0204-2038-429c-8201-4d56629f29e4\") " Jun 03 01:13:18.032116 ip-10-0-138-55 kubenswrapper[2566]: I0603 01:13:18.032081 2566 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/bb1d0204-2038-429c-8201-4d56629f29e4-kube-api-access-5q9gh" (OuterVolumeSpecName: "kube-api-access-5q9gh") pod "bb1d0204-2038-429c-8201-4d56629f29e4" (UID: "bb1d0204-2038-429c-8201-4d56629f29e4"). InnerVolumeSpecName "kube-api-access-5q9gh". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 03 01:13:18.131677 ip-10-0-138-55 kubenswrapper[2566]: I0603 01:13:18.131633 2566 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-5q9gh\" (UniqueName: \"kubernetes.io/projected/bb1d0204-2038-429c-8201-4d56629f29e4-kube-api-access-5q9gh\") on node \"ip-10-0-138-55.ec2.internal\" DevicePath \"\"" Jun 03 01:13:18.681030 ip-10-0-138-55 kubenswrapper[2566]: I0603 01:13:18.680991 2566 generic.go:358] "Generic (PLEG): container finished" podID="bb1d0204-2038-429c-8201-4d56629f29e4" containerID="325dc444ac208ac3f068c700d4c818772b1845786c8391c2d28a6714596f37d8" exitCode=0 Jun 03 01:13:18.681213 ip-10-0-138-55 kubenswrapper[2566]: I0603 01:13:18.681042 2566 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-f99f4b5cd-j69v8" Jun 03 01:13:18.681213 ip-10-0-138-55 kubenswrapper[2566]: I0603 01:13:18.681079 2566 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-f99f4b5cd-j69v8" event={"ID":"bb1d0204-2038-429c-8201-4d56629f29e4","Type":"ContainerDied","Data":"325dc444ac208ac3f068c700d4c818772b1845786c8391c2d28a6714596f37d8"} Jun 03 01:13:18.681213 ip-10-0-138-55 kubenswrapper[2566]: I0603 01:13:18.681123 2566 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-f99f4b5cd-j69v8" event={"ID":"bb1d0204-2038-429c-8201-4d56629f29e4","Type":"ContainerDied","Data":"46d73b10fe51b8f60815f5d7f46604e7d0d9821f30d8bdc8d50fb7d593f8fc05"} Jun 03 01:13:18.681213 ip-10-0-138-55 kubenswrapper[2566]: I0603 01:13:18.681146 2566 scope.go:117] "RemoveContainer" containerID="325dc444ac208ac3f068c700d4c818772b1845786c8391c2d28a6714596f37d8" Jun 03 01:13:18.690835 ip-10-0-138-55 kubenswrapper[2566]: I0603 01:13:18.690811 2566 scope.go:117] "RemoveContainer" containerID="325dc444ac208ac3f068c700d4c818772b1845786c8391c2d28a6714596f37d8" Jun 03 01:13:18.691129 ip-10-0-138-55 kubenswrapper[2566]: E0603 01:13:18.691111 2566 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"325dc444ac208ac3f068c700d4c818772b1845786c8391c2d28a6714596f37d8\": container with ID starting with 325dc444ac208ac3f068c700d4c818772b1845786c8391c2d28a6714596f37d8 not found: ID does not exist" containerID="325dc444ac208ac3f068c700d4c818772b1845786c8391c2d28a6714596f37d8" Jun 03 01:13:18.691183 ip-10-0-138-55 kubenswrapper[2566]: I0603 01:13:18.691138 2566 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"325dc444ac208ac3f068c700d4c818772b1845786c8391c2d28a6714596f37d8"} err="failed to get container status \"325dc444ac208ac3f068c700d4c818772b1845786c8391c2d28a6714596f37d8\": rpc error: code = NotFound desc = could not find container \"325dc444ac208ac3f068c700d4c818772b1845786c8391c2d28a6714596f37d8\": container with ID starting with 325dc444ac208ac3f068c700d4c818772b1845786c8391c2d28a6714596f37d8 not found: ID does not exist" Jun 03 01:13:18.705163 ip-10-0-138-55 kubenswrapper[2566]: I0603 01:13:18.705123 2566 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-f99f4b5cd-j69v8"] Jun 03 01:13:18.716460 ip-10-0-138-55 kubenswrapper[2566]: I0603 01:13:18.709387 2566 kubelet.go:2547] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/authorino-f99f4b5cd-j69v8"] Jun 03 01:13:19.594807 ip-10-0-138-55 kubenswrapper[2566]: I0603 01:13:19.594770 2566 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="bb1d0204-2038-429c-8201-4d56629f29e4" path="/var/lib/kubelet/pods/bb1d0204-2038-429c-8201-4d56629f29e4/volumes" Jun 03 01:13:26.942042 ip-10-0-138-55 kubenswrapper[2566]: I0603 01:13:26.941963 2566 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["opendatahub/postgres-68c4fbbd6f-7dcqx"] Jun 03 01:13:26.942578 ip-10-0-138-55 kubenswrapper[2566]: I0603 01:13:26.942557 2566 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="bb1d0204-2038-429c-8201-4d56629f29e4" containerName="authorino" Jun 03 01:13:26.942578 ip-10-0-138-55 kubenswrapper[2566]: I0603 01:13:26.942577 2566 state_mem.go:107] "Deleted CPUSet assignment" podUID="bb1d0204-2038-429c-8201-4d56629f29e4" containerName="authorino" Jun 03 01:13:26.942704 ip-10-0-138-55 kubenswrapper[2566]: I0603 01:13:26.942672 2566 memory_manager.go:356] "RemoveStaleState removing state" podUID="bb1d0204-2038-429c-8201-4d56629f29e4" containerName="authorino" Jun 03 01:13:26.945975 ip-10-0-138-55 kubenswrapper[2566]: I0603 01:13:26.945954 2566 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/postgres-68c4fbbd6f-7dcqx" Jun 03 01:13:26.947830 ip-10-0-138-55 kubenswrapper[2566]: I0603 01:13:26.947809 2566 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"postgres-creds\"" Jun 03 01:13:26.952635 ip-10-0-138-55 kubenswrapper[2566]: I0603 01:13:26.952608 2566 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["opendatahub/postgres-68c4fbbd6f-7dcqx"] Jun 03 01:13:27.119333 ip-10-0-138-55 kubenswrapper[2566]: I0603 01:13:27.119295 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-km4tj\" (UniqueName: \"kubernetes.io/projected/4f761a76-7bad-4c17-bfd8-45dd143de9c1-kube-api-access-km4tj\") pod \"postgres-68c4fbbd6f-7dcqx\" (UID: \"4f761a76-7bad-4c17-bfd8-45dd143de9c1\") " pod="opendatahub/postgres-68c4fbbd6f-7dcqx" Jun 03 01:13:27.119487 ip-10-0-138-55 kubenswrapper[2566]: I0603 01:13:27.119366 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"data\" (UniqueName: \"kubernetes.io/empty-dir/4f761a76-7bad-4c17-bfd8-45dd143de9c1-data\") pod \"postgres-68c4fbbd6f-7dcqx\" (UID: \"4f761a76-7bad-4c17-bfd8-45dd143de9c1\") " pod="opendatahub/postgres-68c4fbbd6f-7dcqx" Jun 03 01:13:27.220886 ip-10-0-138-55 kubenswrapper[2566]: I0603 01:13:27.220781 2566 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"data\" (UniqueName: \"kubernetes.io/empty-dir/4f761a76-7bad-4c17-bfd8-45dd143de9c1-data\") pod \"postgres-68c4fbbd6f-7dcqx\" (UID: \"4f761a76-7bad-4c17-bfd8-45dd143de9c1\") " pod="opendatahub/postgres-68c4fbbd6f-7dcqx" Jun 03 01:13:27.221055 ip-10-0-138-55 kubenswrapper[2566]: I0603 01:13:27.220917 2566 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-km4tj\" (UniqueName: \"kubernetes.io/projected/4f761a76-7bad-4c17-bfd8-45dd143de9c1-kube-api-access-km4tj\") pod \"postgres-68c4fbbd6f-7dcqx\" (UID: \"4f761a76-7bad-4c17-bfd8-45dd143de9c1\") " pod="opendatahub/postgres-68c4fbbd6f-7dcqx" Jun 03 01:13:27.221336 ip-10-0-138-55 kubenswrapper[2566]: I0603 01:13:27.221311 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"data\" (UniqueName: \"kubernetes.io/empty-dir/4f761a76-7bad-4c17-bfd8-45dd143de9c1-data\") pod \"postgres-68c4fbbd6f-7dcqx\" (UID: \"4f761a76-7bad-4c17-bfd8-45dd143de9c1\") " pod="opendatahub/postgres-68c4fbbd6f-7dcqx" Jun 03 01:13:27.233124 ip-10-0-138-55 kubenswrapper[2566]: I0603 01:13:27.233098 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-km4tj\" (UniqueName: \"kubernetes.io/projected/4f761a76-7bad-4c17-bfd8-45dd143de9c1-kube-api-access-km4tj\") pod \"postgres-68c4fbbd6f-7dcqx\" (UID: \"4f761a76-7bad-4c17-bfd8-45dd143de9c1\") " pod="opendatahub/postgres-68c4fbbd6f-7dcqx" Jun 03 01:13:27.259218 ip-10-0-138-55 kubenswrapper[2566]: I0603 01:13:27.259189 2566 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/postgres-68c4fbbd6f-7dcqx" Jun 03 01:13:27.415695 ip-10-0-138-55 kubenswrapper[2566]: I0603 01:13:27.415662 2566 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["opendatahub/postgres-68c4fbbd6f-7dcqx"] Jun 03 01:13:27.416942 ip-10-0-138-55 kubenswrapper[2566]: W0603 01:13:27.416911 2566 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod4f761a76_7bad_4c17_bfd8_45dd143de9c1.slice/crio-60f731e203b383d146de810d311975875f859ef700a3b4bed0e1270ffc22fc5d WatchSource:0}: Error finding container 60f731e203b383d146de810d311975875f859ef700a3b4bed0e1270ffc22fc5d: Status 404 returned error can't find the container with id 60f731e203b383d146de810d311975875f859ef700a3b4bed0e1270ffc22fc5d Jun 03 01:13:27.723694 ip-10-0-138-55 kubenswrapper[2566]: I0603 01:13:27.723660 2566 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="opendatahub/postgres-68c4fbbd6f-7dcqx" event={"ID":"4f761a76-7bad-4c17-bfd8-45dd143de9c1","Type":"ContainerStarted","Data":"60f731e203b383d146de810d311975875f859ef700a3b4bed0e1270ffc22fc5d"} Jun 03 01:13:30.739656 ip-10-0-138-55 kubenswrapper[2566]: I0603 01:13:30.739614 2566 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="opendatahub/postgres-68c4fbbd6f-7dcqx" event={"ID":"4f761a76-7bad-4c17-bfd8-45dd143de9c1","Type":"ContainerStarted","Data":"8420ca2b0eac4cc1cd6b38d4d7b3073324934c88f1038e910a43868571170f17"} Jun 03 01:13:30.740102 ip-10-0-138-55 kubenswrapper[2566]: I0603 01:13:30.739667 2566 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/postgres-68c4fbbd6f-7dcqx" Jun 03 01:13:30.770830 ip-10-0-138-55 kubenswrapper[2566]: I0603 01:13:30.770772 2566 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="opendatahub/postgres-68c4fbbd6f-7dcqx" podStartSLOduration=2.3511061619999998 podStartE2EDuration="4.770753633s" podCreationTimestamp="2026-06-03 01:13:26 +0000 UTC" firstStartedPulling="2026-06-03 01:13:27.418333477 +0000 UTC m=+530.565175401" lastFinishedPulling="2026-06-03 01:13:29.837980944 +0000 UTC m=+532.984822872" observedRunningTime="2026-06-03 01:13:30.770480428 +0000 UTC m=+533.917322364" watchObservedRunningTime="2026-06-03 01:13:30.770753633 +0000 UTC m=+533.917595578" Jun 03 01:13:36.775021 ip-10-0-138-55 kubenswrapper[2566]: I0603 01:13:36.774990 2566 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/postgres-68c4fbbd6f-7dcqx" Jun 03 01:13:36.890698 ip-10-0-138-55 kubenswrapper[2566]: I0603 01:13:36.890664 2566 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-console/console-79d474476d-fmkmf"] Jun 03 01:13:36.898243 ip-10-0-138-55 kubenswrapper[2566]: I0603 01:13:36.898202 2566 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-79d474476d-fmkmf" Jun 03 01:13:36.903196 ip-10-0-138-55 kubenswrapper[2566]: I0603 01:13:36.903132 2566 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-79d474476d-fmkmf"] Jun 03 01:13:36.913554 ip-10-0-138-55 kubenswrapper[2566]: I0603 01:13:36.913525 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/ce981c2d-76b9-40a5-9fcc-03f8da01c4d7-oauth-serving-cert\") pod \"console-79d474476d-fmkmf\" (UID: \"ce981c2d-76b9-40a5-9fcc-03f8da01c4d7\") " pod="openshift-console/console-79d474476d-fmkmf" Jun 03 01:13:36.913687 ip-10-0-138-55 kubenswrapper[2566]: I0603 01:13:36.913575 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/ce981c2d-76b9-40a5-9fcc-03f8da01c4d7-trusted-ca-bundle\") pod \"console-79d474476d-fmkmf\" (UID: \"ce981c2d-76b9-40a5-9fcc-03f8da01c4d7\") " pod="openshift-console/console-79d474476d-fmkmf" Jun 03 01:13:36.913687 ip-10-0-138-55 kubenswrapper[2566]: I0603 01:13:36.913615 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/ce981c2d-76b9-40a5-9fcc-03f8da01c4d7-service-ca\") pod \"console-79d474476d-fmkmf\" (UID: \"ce981c2d-76b9-40a5-9fcc-03f8da01c4d7\") " pod="openshift-console/console-79d474476d-fmkmf" Jun 03 01:13:36.913687 ip-10-0-138-55 kubenswrapper[2566]: I0603 01:13:36.913663 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/ce981c2d-76b9-40a5-9fcc-03f8da01c4d7-console-config\") pod \"console-79d474476d-fmkmf\" (UID: \"ce981c2d-76b9-40a5-9fcc-03f8da01c4d7\") " pod="openshift-console/console-79d474476d-fmkmf" Jun 03 01:13:36.913795 ip-10-0-138-55 kubenswrapper[2566]: I0603 01:13:36.913776 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/ce981c2d-76b9-40a5-9fcc-03f8da01c4d7-console-oauth-config\") pod \"console-79d474476d-fmkmf\" (UID: \"ce981c2d-76b9-40a5-9fcc-03f8da01c4d7\") " pod="openshift-console/console-79d474476d-fmkmf" Jun 03 01:13:36.913846 ip-10-0-138-55 kubenswrapper[2566]: I0603 01:13:36.913827 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-xdsdx\" (UniqueName: \"kubernetes.io/projected/ce981c2d-76b9-40a5-9fcc-03f8da01c4d7-kube-api-access-xdsdx\") pod \"console-79d474476d-fmkmf\" (UID: \"ce981c2d-76b9-40a5-9fcc-03f8da01c4d7\") " pod="openshift-console/console-79d474476d-fmkmf" Jun 03 01:13:36.913892 ip-10-0-138-55 kubenswrapper[2566]: I0603 01:13:36.913873 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/ce981c2d-76b9-40a5-9fcc-03f8da01c4d7-console-serving-cert\") pod \"console-79d474476d-fmkmf\" (UID: \"ce981c2d-76b9-40a5-9fcc-03f8da01c4d7\") " pod="openshift-console/console-79d474476d-fmkmf" Jun 03 01:13:37.014824 ip-10-0-138-55 kubenswrapper[2566]: I0603 01:13:37.014785 2566 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/ce981c2d-76b9-40a5-9fcc-03f8da01c4d7-console-oauth-config\") pod \"console-79d474476d-fmkmf\" (UID: \"ce981c2d-76b9-40a5-9fcc-03f8da01c4d7\") " pod="openshift-console/console-79d474476d-fmkmf" Jun 03 01:13:37.014824 ip-10-0-138-55 kubenswrapper[2566]: I0603 01:13:37.014823 2566 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-xdsdx\" (UniqueName: \"kubernetes.io/projected/ce981c2d-76b9-40a5-9fcc-03f8da01c4d7-kube-api-access-xdsdx\") pod \"console-79d474476d-fmkmf\" (UID: \"ce981c2d-76b9-40a5-9fcc-03f8da01c4d7\") " pod="openshift-console/console-79d474476d-fmkmf" Jun 03 01:13:37.015087 ip-10-0-138-55 kubenswrapper[2566]: I0603 01:13:37.014844 2566 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/ce981c2d-76b9-40a5-9fcc-03f8da01c4d7-console-serving-cert\") pod \"console-79d474476d-fmkmf\" (UID: \"ce981c2d-76b9-40a5-9fcc-03f8da01c4d7\") " pod="openshift-console/console-79d474476d-fmkmf" Jun 03 01:13:37.015087 ip-10-0-138-55 kubenswrapper[2566]: I0603 01:13:37.014888 2566 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/ce981c2d-76b9-40a5-9fcc-03f8da01c4d7-oauth-serving-cert\") pod \"console-79d474476d-fmkmf\" (UID: \"ce981c2d-76b9-40a5-9fcc-03f8da01c4d7\") " pod="openshift-console/console-79d474476d-fmkmf" Jun 03 01:13:37.015087 ip-10-0-138-55 kubenswrapper[2566]: I0603 01:13:37.014907 2566 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/ce981c2d-76b9-40a5-9fcc-03f8da01c4d7-trusted-ca-bundle\") pod \"console-79d474476d-fmkmf\" (UID: \"ce981c2d-76b9-40a5-9fcc-03f8da01c4d7\") " pod="openshift-console/console-79d474476d-fmkmf" Jun 03 01:13:37.015087 ip-10-0-138-55 kubenswrapper[2566]: I0603 01:13:37.014924 2566 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/ce981c2d-76b9-40a5-9fcc-03f8da01c4d7-service-ca\") pod \"console-79d474476d-fmkmf\" (UID: \"ce981c2d-76b9-40a5-9fcc-03f8da01c4d7\") " pod="openshift-console/console-79d474476d-fmkmf" Jun 03 01:13:37.015087 ip-10-0-138-55 kubenswrapper[2566]: I0603 01:13:37.014953 2566 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/ce981c2d-76b9-40a5-9fcc-03f8da01c4d7-console-config\") pod \"console-79d474476d-fmkmf\" (UID: \"ce981c2d-76b9-40a5-9fcc-03f8da01c4d7\") " pod="openshift-console/console-79d474476d-fmkmf" Jun 03 01:13:37.015661 ip-10-0-138-55 kubenswrapper[2566]: I0603 01:13:37.015639 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/ce981c2d-76b9-40a5-9fcc-03f8da01c4d7-service-ca\") pod \"console-79d474476d-fmkmf\" (UID: \"ce981c2d-76b9-40a5-9fcc-03f8da01c4d7\") " pod="openshift-console/console-79d474476d-fmkmf" Jun 03 01:13:37.015791 ip-10-0-138-55 kubenswrapper[2566]: I0603 01:13:37.015768 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/ce981c2d-76b9-40a5-9fcc-03f8da01c4d7-oauth-serving-cert\") pod \"console-79d474476d-fmkmf\" (UID: \"ce981c2d-76b9-40a5-9fcc-03f8da01c4d7\") " pod="openshift-console/console-79d474476d-fmkmf" Jun 03 01:13:37.015853 ip-10-0-138-55 kubenswrapper[2566]: I0603 01:13:37.015768 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/ce981c2d-76b9-40a5-9fcc-03f8da01c4d7-console-config\") pod \"console-79d474476d-fmkmf\" (UID: \"ce981c2d-76b9-40a5-9fcc-03f8da01c4d7\") " pod="openshift-console/console-79d474476d-fmkmf" Jun 03 01:13:37.016210 ip-10-0-138-55 kubenswrapper[2566]: I0603 01:13:37.016188 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/ce981c2d-76b9-40a5-9fcc-03f8da01c4d7-trusted-ca-bundle\") pod \"console-79d474476d-fmkmf\" (UID: \"ce981c2d-76b9-40a5-9fcc-03f8da01c4d7\") " pod="openshift-console/console-79d474476d-fmkmf" Jun 03 01:13:37.017324 ip-10-0-138-55 kubenswrapper[2566]: I0603 01:13:37.017310 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/ce981c2d-76b9-40a5-9fcc-03f8da01c4d7-console-oauth-config\") pod \"console-79d474476d-fmkmf\" (UID: \"ce981c2d-76b9-40a5-9fcc-03f8da01c4d7\") " pod="openshift-console/console-79d474476d-fmkmf" Jun 03 01:13:37.017937 ip-10-0-138-55 kubenswrapper[2566]: I0603 01:13:37.017908 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/ce981c2d-76b9-40a5-9fcc-03f8da01c4d7-console-serving-cert\") pod \"console-79d474476d-fmkmf\" (UID: \"ce981c2d-76b9-40a5-9fcc-03f8da01c4d7\") " pod="openshift-console/console-79d474476d-fmkmf" Jun 03 01:13:37.023311 ip-10-0-138-55 kubenswrapper[2566]: I0603 01:13:37.023286 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-xdsdx\" (UniqueName: \"kubernetes.io/projected/ce981c2d-76b9-40a5-9fcc-03f8da01c4d7-kube-api-access-xdsdx\") pod \"console-79d474476d-fmkmf\" (UID: \"ce981c2d-76b9-40a5-9fcc-03f8da01c4d7\") " pod="openshift-console/console-79d474476d-fmkmf" Jun 03 01:13:37.210178 ip-10-0-138-55 kubenswrapper[2566]: I0603 01:13:37.210137 2566 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-79d474476d-fmkmf" Jun 03 01:13:37.349615 ip-10-0-138-55 kubenswrapper[2566]: I0603 01:13:37.349589 2566 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-79d474476d-fmkmf"] Jun 03 01:13:37.351313 ip-10-0-138-55 kubenswrapper[2566]: W0603 01:13:37.351286 2566 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podce981c2d_76b9_40a5_9fcc_03f8da01c4d7.slice/crio-115691ab68c765a13941ef74dcc0cee87af3db420863edaffd26c72ab0b8f3b4 WatchSource:0}: Error finding container 115691ab68c765a13941ef74dcc0cee87af3db420863edaffd26c72ab0b8f3b4: Status 404 returned error can't find the container with id 115691ab68c765a13941ef74dcc0cee87af3db420863edaffd26c72ab0b8f3b4 Jun 03 01:13:37.769890 ip-10-0-138-55 kubenswrapper[2566]: I0603 01:13:37.769844 2566 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-79d474476d-fmkmf" event={"ID":"ce981c2d-76b9-40a5-9fcc-03f8da01c4d7","Type":"ContainerStarted","Data":"ba6b5809c417fbc306054ff1c9967a0de704fd2479f1d79e1f3bb5c036536bca"} Jun 03 01:13:37.769890 ip-10-0-138-55 kubenswrapper[2566]: I0603 01:13:37.769893 2566 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-79d474476d-fmkmf" event={"ID":"ce981c2d-76b9-40a5-9fcc-03f8da01c4d7","Type":"ContainerStarted","Data":"115691ab68c765a13941ef74dcc0cee87af3db420863edaffd26c72ab0b8f3b4"} Jun 03 01:13:37.786103 ip-10-0-138-55 kubenswrapper[2566]: I0603 01:13:37.786033 2566 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-console/console-79d474476d-fmkmf" podStartSLOduration=1.78601687 podStartE2EDuration="1.78601687s" podCreationTimestamp="2026-06-03 01:13:36 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2026-06-03 01:13:37.785205608 +0000 UTC m=+540.932047536" watchObservedRunningTime="2026-06-03 01:13:37.78601687 +0000 UTC m=+540.932858820" Jun 03 01:13:38.100268 ip-10-0-138-55 kubenswrapper[2566]: I0603 01:13:38.100233 2566 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-marketplace/32684d7096c88e320aaae000f43b8c5ea50d1c3368188ae50aa1502a708s9qz"] Jun 03 01:13:38.105210 ip-10-0-138-55 kubenswrapper[2566]: I0603 01:13:38.105188 2566 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/32684d7096c88e320aaae000f43b8c5ea50d1c3368188ae50aa1502a708s9qz" Jun 03 01:13:38.107537 ip-10-0-138-55 kubenswrapper[2566]: I0603 01:13:38.107480 2566 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"kube-root-ca.crt\"" Jun 03 01:13:38.107537 ip-10-0-138-55 kubenswrapper[2566]: I0603 01:13:38.107527 2566 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"openshift-service-ca.crt\"" Jun 03 01:13:38.107743 ip-10-0-138-55 kubenswrapper[2566]: I0603 01:13:38.107723 2566 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-marketplace\"/\"default-dockercfg-xfvxj\"" Jun 03 01:13:38.111481 ip-10-0-138-55 kubenswrapper[2566]: I0603 01:13:38.111460 2566 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/32684d7096c88e320aaae000f43b8c5ea50d1c3368188ae50aa1502a708s9qz"] Jun 03 01:13:38.126699 ip-10-0-138-55 kubenswrapper[2566]: I0603 01:13:38.126669 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/7954d3b1-a37b-4dbe-9f7d-4324ad243c3c-bundle\") pod \"32684d7096c88e320aaae000f43b8c5ea50d1c3368188ae50aa1502a708s9qz\" (UID: \"7954d3b1-a37b-4dbe-9f7d-4324ad243c3c\") " pod="openshift-marketplace/32684d7096c88e320aaae000f43b8c5ea50d1c3368188ae50aa1502a708s9qz" Jun 03 01:13:38.126827 ip-10-0-138-55 kubenswrapper[2566]: I0603 01:13:38.126728 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-cgrnc\" (UniqueName: \"kubernetes.io/projected/7954d3b1-a37b-4dbe-9f7d-4324ad243c3c-kube-api-access-cgrnc\") pod \"32684d7096c88e320aaae000f43b8c5ea50d1c3368188ae50aa1502a708s9qz\" (UID: \"7954d3b1-a37b-4dbe-9f7d-4324ad243c3c\") " pod="openshift-marketplace/32684d7096c88e320aaae000f43b8c5ea50d1c3368188ae50aa1502a708s9qz" Jun 03 01:13:38.126895 ip-10-0-138-55 kubenswrapper[2566]: I0603 01:13:38.126875 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/7954d3b1-a37b-4dbe-9f7d-4324ad243c3c-util\") pod \"32684d7096c88e320aaae000f43b8c5ea50d1c3368188ae50aa1502a708s9qz\" (UID: \"7954d3b1-a37b-4dbe-9f7d-4324ad243c3c\") " pod="openshift-marketplace/32684d7096c88e320aaae000f43b8c5ea50d1c3368188ae50aa1502a708s9qz" Jun 03 01:13:38.227924 ip-10-0-138-55 kubenswrapper[2566]: I0603 01:13:38.227888 2566 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/7954d3b1-a37b-4dbe-9f7d-4324ad243c3c-bundle\") pod \"32684d7096c88e320aaae000f43b8c5ea50d1c3368188ae50aa1502a708s9qz\" (UID: \"7954d3b1-a37b-4dbe-9f7d-4324ad243c3c\") " pod="openshift-marketplace/32684d7096c88e320aaae000f43b8c5ea50d1c3368188ae50aa1502a708s9qz" Jun 03 01:13:38.228099 ip-10-0-138-55 kubenswrapper[2566]: I0603 01:13:38.227931 2566 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-cgrnc\" (UniqueName: \"kubernetes.io/projected/7954d3b1-a37b-4dbe-9f7d-4324ad243c3c-kube-api-access-cgrnc\") pod \"32684d7096c88e320aaae000f43b8c5ea50d1c3368188ae50aa1502a708s9qz\" (UID: \"7954d3b1-a37b-4dbe-9f7d-4324ad243c3c\") " pod="openshift-marketplace/32684d7096c88e320aaae000f43b8c5ea50d1c3368188ae50aa1502a708s9qz" Jun 03 01:13:38.228099 ip-10-0-138-55 kubenswrapper[2566]: I0603 01:13:38.228012 2566 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/7954d3b1-a37b-4dbe-9f7d-4324ad243c3c-util\") pod \"32684d7096c88e320aaae000f43b8c5ea50d1c3368188ae50aa1502a708s9qz\" (UID: \"7954d3b1-a37b-4dbe-9f7d-4324ad243c3c\") " pod="openshift-marketplace/32684d7096c88e320aaae000f43b8c5ea50d1c3368188ae50aa1502a708s9qz" Jun 03 01:13:38.228331 ip-10-0-138-55 kubenswrapper[2566]: I0603 01:13:38.228310 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/7954d3b1-a37b-4dbe-9f7d-4324ad243c3c-bundle\") pod \"32684d7096c88e320aaae000f43b8c5ea50d1c3368188ae50aa1502a708s9qz\" (UID: \"7954d3b1-a37b-4dbe-9f7d-4324ad243c3c\") " pod="openshift-marketplace/32684d7096c88e320aaae000f43b8c5ea50d1c3368188ae50aa1502a708s9qz" Jun 03 01:13:38.228386 ip-10-0-138-55 kubenswrapper[2566]: I0603 01:13:38.228372 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/7954d3b1-a37b-4dbe-9f7d-4324ad243c3c-util\") pod \"32684d7096c88e320aaae000f43b8c5ea50d1c3368188ae50aa1502a708s9qz\" (UID: \"7954d3b1-a37b-4dbe-9f7d-4324ad243c3c\") " pod="openshift-marketplace/32684d7096c88e320aaae000f43b8c5ea50d1c3368188ae50aa1502a708s9qz" Jun 03 01:13:38.236778 ip-10-0-138-55 kubenswrapper[2566]: I0603 01:13:38.236748 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-cgrnc\" (UniqueName: \"kubernetes.io/projected/7954d3b1-a37b-4dbe-9f7d-4324ad243c3c-kube-api-access-cgrnc\") pod \"32684d7096c88e320aaae000f43b8c5ea50d1c3368188ae50aa1502a708s9qz\" (UID: \"7954d3b1-a37b-4dbe-9f7d-4324ad243c3c\") " pod="openshift-marketplace/32684d7096c88e320aaae000f43b8c5ea50d1c3368188ae50aa1502a708s9qz" Jun 03 01:13:38.416666 ip-10-0-138-55 kubenswrapper[2566]: I0603 01:13:38.416563 2566 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/32684d7096c88e320aaae000f43b8c5ea50d1c3368188ae50aa1502a708s9qz" Jun 03 01:13:38.556162 ip-10-0-138-55 kubenswrapper[2566]: I0603 01:13:38.556133 2566 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/32684d7096c88e320aaae000f43b8c5ea50d1c3368188ae50aa1502a708s9qz"] Jun 03 01:13:38.558357 ip-10-0-138-55 kubenswrapper[2566]: W0603 01:13:38.558326 2566 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod7954d3b1_a37b_4dbe_9f7d_4324ad243c3c.slice/crio-161e1272bd361ef73336c8bec3edf5e153e9cb2beeef5ad95ee2261d1ff0bccb WatchSource:0}: Error finding container 161e1272bd361ef73336c8bec3edf5e153e9cb2beeef5ad95ee2261d1ff0bccb: Status 404 returned error can't find the container with id 161e1272bd361ef73336c8bec3edf5e153e9cb2beeef5ad95ee2261d1ff0bccb Jun 03 01:13:38.774780 ip-10-0-138-55 kubenswrapper[2566]: I0603 01:13:38.774692 2566 generic.go:358] "Generic (PLEG): container finished" podID="7954d3b1-a37b-4dbe-9f7d-4324ad243c3c" containerID="9c55e1d8bccbdd39f73e6832edc3f1d5df74c0ee04a8187307606f7f6443f4b2" exitCode=0 Jun 03 01:13:38.774929 ip-10-0-138-55 kubenswrapper[2566]: I0603 01:13:38.774773 2566 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/32684d7096c88e320aaae000f43b8c5ea50d1c3368188ae50aa1502a708s9qz" event={"ID":"7954d3b1-a37b-4dbe-9f7d-4324ad243c3c","Type":"ContainerDied","Data":"9c55e1d8bccbdd39f73e6832edc3f1d5df74c0ee04a8187307606f7f6443f4b2"} Jun 03 01:13:38.774929 ip-10-0-138-55 kubenswrapper[2566]: I0603 01:13:38.774810 2566 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/32684d7096c88e320aaae000f43b8c5ea50d1c3368188ae50aa1502a708s9qz" event={"ID":"7954d3b1-a37b-4dbe-9f7d-4324ad243c3c","Type":"ContainerStarted","Data":"161e1272bd361ef73336c8bec3edf5e153e9cb2beeef5ad95ee2261d1ff0bccb"} Jun 03 01:13:39.780825 ip-10-0-138-55 kubenswrapper[2566]: I0603 01:13:39.780789 2566 generic.go:358] "Generic (PLEG): container finished" podID="7954d3b1-a37b-4dbe-9f7d-4324ad243c3c" containerID="84db02dd20dfba3eaaedde376de999c09d833c417306d8374fbd8b84c1bd4be3" exitCode=0 Jun 03 01:13:39.781250 ip-10-0-138-55 kubenswrapper[2566]: I0603 01:13:39.780864 2566 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/32684d7096c88e320aaae000f43b8c5ea50d1c3368188ae50aa1502a708s9qz" event={"ID":"7954d3b1-a37b-4dbe-9f7d-4324ad243c3c","Type":"ContainerDied","Data":"84db02dd20dfba3eaaedde376de999c09d833c417306d8374fbd8b84c1bd4be3"} Jun 03 01:13:40.786082 ip-10-0-138-55 kubenswrapper[2566]: I0603 01:13:40.786049 2566 generic.go:358] "Generic (PLEG): container finished" podID="7954d3b1-a37b-4dbe-9f7d-4324ad243c3c" containerID="f92c874e7da6274ad1a28a944ee637c1c746e078ab247618e1fa08e7956c432b" exitCode=0 Jun 03 01:13:40.786459 ip-10-0-138-55 kubenswrapper[2566]: I0603 01:13:40.786108 2566 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/32684d7096c88e320aaae000f43b8c5ea50d1c3368188ae50aa1502a708s9qz" event={"ID":"7954d3b1-a37b-4dbe-9f7d-4324ad243c3c","Type":"ContainerDied","Data":"f92c874e7da6274ad1a28a944ee637c1c746e078ab247618e1fa08e7956c432b"} Jun 03 01:13:41.923743 ip-10-0-138-55 kubenswrapper[2566]: I0603 01:13:41.923715 2566 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/32684d7096c88e320aaae000f43b8c5ea50d1c3368188ae50aa1502a708s9qz" Jun 03 01:13:41.972461 ip-10-0-138-55 kubenswrapper[2566]: I0603 01:13:41.972429 2566 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/7954d3b1-a37b-4dbe-9f7d-4324ad243c3c-bundle\") pod \"7954d3b1-a37b-4dbe-9f7d-4324ad243c3c\" (UID: \"7954d3b1-a37b-4dbe-9f7d-4324ad243c3c\") " Jun 03 01:13:41.972461 ip-10-0-138-55 kubenswrapper[2566]: I0603 01:13:41.972464 2566 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/7954d3b1-a37b-4dbe-9f7d-4324ad243c3c-util\") pod \"7954d3b1-a37b-4dbe-9f7d-4324ad243c3c\" (UID: \"7954d3b1-a37b-4dbe-9f7d-4324ad243c3c\") " Jun 03 01:13:41.972648 ip-10-0-138-55 kubenswrapper[2566]: I0603 01:13:41.972550 2566 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-cgrnc\" (UniqueName: \"kubernetes.io/projected/7954d3b1-a37b-4dbe-9f7d-4324ad243c3c-kube-api-access-cgrnc\") pod \"7954d3b1-a37b-4dbe-9f7d-4324ad243c3c\" (UID: \"7954d3b1-a37b-4dbe-9f7d-4324ad243c3c\") " Jun 03 01:13:41.973029 ip-10-0-138-55 kubenswrapper[2566]: I0603 01:13:41.973002 2566 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/7954d3b1-a37b-4dbe-9f7d-4324ad243c3c-bundle" (OuterVolumeSpecName: "bundle") pod "7954d3b1-a37b-4dbe-9f7d-4324ad243c3c" (UID: "7954d3b1-a37b-4dbe-9f7d-4324ad243c3c"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jun 03 01:13:41.974768 ip-10-0-138-55 kubenswrapper[2566]: I0603 01:13:41.974737 2566 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/7954d3b1-a37b-4dbe-9f7d-4324ad243c3c-kube-api-access-cgrnc" (OuterVolumeSpecName: "kube-api-access-cgrnc") pod "7954d3b1-a37b-4dbe-9f7d-4324ad243c3c" (UID: "7954d3b1-a37b-4dbe-9f7d-4324ad243c3c"). InnerVolumeSpecName "kube-api-access-cgrnc". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 03 01:13:41.978258 ip-10-0-138-55 kubenswrapper[2566]: I0603 01:13:41.978210 2566 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/7954d3b1-a37b-4dbe-9f7d-4324ad243c3c-util" (OuterVolumeSpecName: "util") pod "7954d3b1-a37b-4dbe-9f7d-4324ad243c3c" (UID: "7954d3b1-a37b-4dbe-9f7d-4324ad243c3c"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jun 03 01:13:42.073675 ip-10-0-138-55 kubenswrapper[2566]: I0603 01:13:42.073606 2566 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/7954d3b1-a37b-4dbe-9f7d-4324ad243c3c-bundle\") on node \"ip-10-0-138-55.ec2.internal\" DevicePath \"\"" Jun 03 01:13:42.073675 ip-10-0-138-55 kubenswrapper[2566]: I0603 01:13:42.073632 2566 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/7954d3b1-a37b-4dbe-9f7d-4324ad243c3c-util\") on node \"ip-10-0-138-55.ec2.internal\" DevicePath \"\"" Jun 03 01:13:42.073675 ip-10-0-138-55 kubenswrapper[2566]: I0603 01:13:42.073643 2566 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-cgrnc\" (UniqueName: \"kubernetes.io/projected/7954d3b1-a37b-4dbe-9f7d-4324ad243c3c-kube-api-access-cgrnc\") on node \"ip-10-0-138-55.ec2.internal\" DevicePath \"\"" Jun 03 01:13:42.795873 ip-10-0-138-55 kubenswrapper[2566]: I0603 01:13:42.795843 2566 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/32684d7096c88e320aaae000f43b8c5ea50d1c3368188ae50aa1502a708s9qz" Jun 03 01:13:42.796036 ip-10-0-138-55 kubenswrapper[2566]: I0603 01:13:42.795852 2566 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/32684d7096c88e320aaae000f43b8c5ea50d1c3368188ae50aa1502a708s9qz" event={"ID":"7954d3b1-a37b-4dbe-9f7d-4324ad243c3c","Type":"ContainerDied","Data":"161e1272bd361ef73336c8bec3edf5e153e9cb2beeef5ad95ee2261d1ff0bccb"} Jun 03 01:13:42.796036 ip-10-0-138-55 kubenswrapper[2566]: I0603 01:13:42.795951 2566 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="161e1272bd361ef73336c8bec3edf5e153e9cb2beeef5ad95ee2261d1ff0bccb" Jun 03 01:13:47.210838 ip-10-0-138-55 kubenswrapper[2566]: I0603 01:13:47.210797 2566 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/console-79d474476d-fmkmf" Jun 03 01:13:47.211278 ip-10-0-138-55 kubenswrapper[2566]: I0603 01:13:47.210942 2566 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-console/console-79d474476d-fmkmf" Jun 03 01:13:47.216034 ip-10-0-138-55 kubenswrapper[2566]: I0603 01:13:47.216009 2566 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-console/console-79d474476d-fmkmf" Jun 03 01:13:47.823081 ip-10-0-138-55 kubenswrapper[2566]: I0603 01:13:47.823051 2566 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console/console-79d474476d-fmkmf" Jun 03 01:13:47.872368 ip-10-0-138-55 kubenswrapper[2566]: I0603 01:13:47.872336 2566 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openshift-console/console-79448cc8b6-94mc5"] Jun 03 01:14:01.279166 ip-10-0-138-55 kubenswrapper[2566]: I0603 01:14:01.279127 2566 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["keycloak-system/maas-keycloak-0"] Jun 03 01:14:01.279597 ip-10-0-138-55 kubenswrapper[2566]: I0603 01:14:01.279582 2566 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="7954d3b1-a37b-4dbe-9f7d-4324ad243c3c" containerName="pull" Jun 03 01:14:01.279650 ip-10-0-138-55 kubenswrapper[2566]: I0603 01:14:01.279599 2566 state_mem.go:107] "Deleted CPUSet assignment" podUID="7954d3b1-a37b-4dbe-9f7d-4324ad243c3c" containerName="pull" Jun 03 01:14:01.279650 ip-10-0-138-55 kubenswrapper[2566]: I0603 01:14:01.279617 2566 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="7954d3b1-a37b-4dbe-9f7d-4324ad243c3c" containerName="util" Jun 03 01:14:01.279650 ip-10-0-138-55 kubenswrapper[2566]: I0603 01:14:01.279623 2566 state_mem.go:107] "Deleted CPUSet assignment" podUID="7954d3b1-a37b-4dbe-9f7d-4324ad243c3c" containerName="util" Jun 03 01:14:01.279650 ip-10-0-138-55 kubenswrapper[2566]: I0603 01:14:01.279642 2566 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="7954d3b1-a37b-4dbe-9f7d-4324ad243c3c" containerName="extract" Jun 03 01:14:01.279650 ip-10-0-138-55 kubenswrapper[2566]: I0603 01:14:01.279648 2566 state_mem.go:107] "Deleted CPUSet assignment" podUID="7954d3b1-a37b-4dbe-9f7d-4324ad243c3c" containerName="extract" Jun 03 01:14:01.279796 ip-10-0-138-55 kubenswrapper[2566]: I0603 01:14:01.279709 2566 memory_manager.go:356] "RemoveStaleState removing state" podUID="7954d3b1-a37b-4dbe-9f7d-4324ad243c3c" containerName="extract" Jun 03 01:14:01.282853 ip-10-0-138-55 kubenswrapper[2566]: I0603 01:14:01.282833 2566 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="keycloak-system/maas-keycloak-0" Jun 03 01:14:01.285098 ip-10-0-138-55 kubenswrapper[2566]: I0603 01:14:01.285074 2566 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"keycloak-system\"/\"default-dockercfg-lcj8q\"" Jun 03 01:14:01.285183 ip-10-0-138-55 kubenswrapper[2566]: I0603 01:14:01.285135 2566 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"keycloak-system\"/\"maas-keycloak-initial-admin\"" Jun 03 01:14:01.285238 ip-10-0-138-55 kubenswrapper[2566]: I0603 01:14:01.285180 2566 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"keycloak-system\"/\"openshift-service-ca.crt\"" Jun 03 01:14:01.285296 ip-10-0-138-55 kubenswrapper[2566]: I0603 01:14:01.285180 2566 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"keycloak-system\"/\"kube-root-ca.crt\"" Jun 03 01:14:01.290780 ip-10-0-138-55 kubenswrapper[2566]: I0603 01:14:01.290710 2566 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["keycloak-system/maas-keycloak-0"] Jun 03 01:14:01.471375 ip-10-0-138-55 kubenswrapper[2566]: I0603 01:14:01.471327 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-vr9wl\" (UniqueName: \"kubernetes.io/projected/851cb6cf-116a-44de-af6f-8b275eb8f0af-kube-api-access-vr9wl\") pod \"maas-keycloak-0\" (UID: \"851cb6cf-116a-44de-af6f-8b275eb8f0af\") " pod="keycloak-system/maas-keycloak-0" Jun 03 01:14:01.572577 ip-10-0-138-55 kubenswrapper[2566]: I0603 01:14:01.572458 2566 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-vr9wl\" (UniqueName: \"kubernetes.io/projected/851cb6cf-116a-44de-af6f-8b275eb8f0af-kube-api-access-vr9wl\") pod \"maas-keycloak-0\" (UID: \"851cb6cf-116a-44de-af6f-8b275eb8f0af\") " pod="keycloak-system/maas-keycloak-0" Jun 03 01:14:01.580712 ip-10-0-138-55 kubenswrapper[2566]: I0603 01:14:01.580687 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-vr9wl\" (UniqueName: \"kubernetes.io/projected/851cb6cf-116a-44de-af6f-8b275eb8f0af-kube-api-access-vr9wl\") pod \"maas-keycloak-0\" (UID: \"851cb6cf-116a-44de-af6f-8b275eb8f0af\") " pod="keycloak-system/maas-keycloak-0" Jun 03 01:14:01.594142 ip-10-0-138-55 kubenswrapper[2566]: I0603 01:14:01.594113 2566 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="keycloak-system/maas-keycloak-0" Jun 03 01:14:01.732720 ip-10-0-138-55 kubenswrapper[2566]: I0603 01:14:01.732690 2566 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["keycloak-system/maas-keycloak-0"] Jun 03 01:14:01.734111 ip-10-0-138-55 kubenswrapper[2566]: W0603 01:14:01.734079 2566 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod851cb6cf_116a_44de_af6f_8b275eb8f0af.slice/crio-a7c83ea85d21fa21c9a96dd618433c4a0d7cd941ff139870319c0cb921d5d7ed WatchSource:0}: Error finding container a7c83ea85d21fa21c9a96dd618433c4a0d7cd941ff139870319c0cb921d5d7ed: Status 404 returned error can't find the container with id a7c83ea85d21fa21c9a96dd618433c4a0d7cd941ff139870319c0cb921d5d7ed Jun 03 01:14:01.876734 ip-10-0-138-55 kubenswrapper[2566]: I0603 01:14:01.876699 2566 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="keycloak-system/maas-keycloak-0" event={"ID":"851cb6cf-116a-44de-af6f-8b275eb8f0af","Type":"ContainerStarted","Data":"a7c83ea85d21fa21c9a96dd618433c4a0d7cd941ff139870319c0cb921d5d7ed"} Jun 03 01:14:08.911995 ip-10-0-138-55 kubenswrapper[2566]: I0603 01:14:08.911955 2566 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="keycloak-system/maas-keycloak-0" event={"ID":"851cb6cf-116a-44de-af6f-8b275eb8f0af","Type":"ContainerStarted","Data":"51e6eb4b0fc59b987129e10b503019672431454b7ca4c3b1caba4dfe34eeba0f"} Jun 03 01:14:08.933422 ip-10-0-138-55 kubenswrapper[2566]: I0603 01:14:08.933364 2566 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="keycloak-system/maas-keycloak-0" podStartSLOduration=1.789953363 podStartE2EDuration="7.933343584s" podCreationTimestamp="2026-06-03 01:14:01 +0000 UTC" firstStartedPulling="2026-06-03 01:14:01.73543652 +0000 UTC m=+564.882278444" lastFinishedPulling="2026-06-03 01:14:07.878826741 +0000 UTC m=+571.025668665" observedRunningTime="2026-06-03 01:14:08.927828843 +0000 UTC m=+572.074670801" watchObservedRunningTime="2026-06-03 01:14:08.933343584 +0000 UTC m=+572.080185553" Jun 03 01:14:09.595045 ip-10-0-138-55 kubenswrapper[2566]: I0603 01:14:09.595012 2566 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="keycloak-system/maas-keycloak-0" Jun 03 01:14:09.596812 ip-10-0-138-55 kubenswrapper[2566]: I0603 01:14:09.596779 2566 prober.go:120] "Probe failed" probeType="Startup" pod="keycloak-system/maas-keycloak-0" podUID="851cb6cf-116a-44de-af6f-8b275eb8f0af" containerName="keycloak" probeResult="failure" output="Get \"http://10.134.0.57:9000/health/started\": dial tcp 10.134.0.57:9000: connect: connection refused" Jun 03 01:14:10.594959 ip-10-0-138-55 kubenswrapper[2566]: I0603 01:14:10.594906 2566 prober.go:120] "Probe failed" probeType="Startup" pod="keycloak-system/maas-keycloak-0" podUID="851cb6cf-116a-44de-af6f-8b275eb8f0af" containerName="keycloak" probeResult="failure" output="Get \"http://10.134.0.57:9000/health/started\": dial tcp 10.134.0.57:9000: connect: connection refused" Jun 03 01:14:11.594760 ip-10-0-138-55 kubenswrapper[2566]: I0603 01:14:11.594707 2566 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="keycloak-system/maas-keycloak-0" Jun 03 01:14:11.595127 ip-10-0-138-55 kubenswrapper[2566]: I0603 01:14:11.595093 2566 prober.go:120] "Probe failed" probeType="Startup" pod="keycloak-system/maas-keycloak-0" podUID="851cb6cf-116a-44de-af6f-8b275eb8f0af" containerName="keycloak" probeResult="failure" output="Get \"http://10.134.0.57:9000/health/started\": dial tcp 10.134.0.57:9000: connect: connection refused" Jun 03 01:14:12.594584 ip-10-0-138-55 kubenswrapper[2566]: I0603 01:14:12.594530 2566 prober.go:120] "Probe failed" probeType="Startup" pod="keycloak-system/maas-keycloak-0" podUID="851cb6cf-116a-44de-af6f-8b275eb8f0af" containerName="keycloak" probeResult="failure" output="Get \"http://10.134.0.57:9000/health/started\": dial tcp 10.134.0.57:9000: connect: connection refused" Jun 03 01:14:12.894802 ip-10-0-138-55 kubenswrapper[2566]: I0603 01:14:12.894702 2566 kuberuntime_container.go:864] "Killing container with a grace period" pod="openshift-console/console-79448cc8b6-94mc5" podUID="f472186e-7a5c-492f-a8de-8a890653b3db" containerName="console" containerID="cri-o://eb54fd9b6c6947581b8936b79efdcc39f8c7f601a6986713ff8099078277d7d6" gracePeriod=15 Jun 03 01:14:13.216275 ip-10-0-138-55 kubenswrapper[2566]: I0603 01:14:13.216218 2566 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console_console-79448cc8b6-94mc5_f472186e-7a5c-492f-a8de-8a890653b3db/console/0.log" Jun 03 01:14:13.216557 ip-10-0-138-55 kubenswrapper[2566]: I0603 01:14:13.216333 2566 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-79448cc8b6-94mc5" Jun 03 01:14:13.301974 ip-10-0-138-55 kubenswrapper[2566]: I0603 01:14:13.301181 2566 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/f472186e-7a5c-492f-a8de-8a890653b3db-console-oauth-config\") pod \"f472186e-7a5c-492f-a8de-8a890653b3db\" (UID: \"f472186e-7a5c-492f-a8de-8a890653b3db\") " Jun 03 01:14:13.301974 ip-10-0-138-55 kubenswrapper[2566]: I0603 01:14:13.301290 2566 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/f472186e-7a5c-492f-a8de-8a890653b3db-service-ca\") pod \"f472186e-7a5c-492f-a8de-8a890653b3db\" (UID: \"f472186e-7a5c-492f-a8de-8a890653b3db\") " Jun 03 01:14:13.301974 ip-10-0-138-55 kubenswrapper[2566]: I0603 01:14:13.301319 2566 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/f472186e-7a5c-492f-a8de-8a890653b3db-console-config\") pod \"f472186e-7a5c-492f-a8de-8a890653b3db\" (UID: \"f472186e-7a5c-492f-a8de-8a890653b3db\") " Jun 03 01:14:13.301974 ip-10-0-138-55 kubenswrapper[2566]: I0603 01:14:13.301357 2566 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/f472186e-7a5c-492f-a8de-8a890653b3db-trusted-ca-bundle\") pod \"f472186e-7a5c-492f-a8de-8a890653b3db\" (UID: \"f472186e-7a5c-492f-a8de-8a890653b3db\") " Jun 03 01:14:13.301974 ip-10-0-138-55 kubenswrapper[2566]: I0603 01:14:13.301433 2566 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-hvmcq\" (UniqueName: \"kubernetes.io/projected/f472186e-7a5c-492f-a8de-8a890653b3db-kube-api-access-hvmcq\") pod \"f472186e-7a5c-492f-a8de-8a890653b3db\" (UID: \"f472186e-7a5c-492f-a8de-8a890653b3db\") " Jun 03 01:14:13.301974 ip-10-0-138-55 kubenswrapper[2566]: I0603 01:14:13.301519 2566 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/f472186e-7a5c-492f-a8de-8a890653b3db-console-serving-cert\") pod \"f472186e-7a5c-492f-a8de-8a890653b3db\" (UID: \"f472186e-7a5c-492f-a8de-8a890653b3db\") " Jun 03 01:14:13.301974 ip-10-0-138-55 kubenswrapper[2566]: I0603 01:14:13.301541 2566 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/f472186e-7a5c-492f-a8de-8a890653b3db-oauth-serving-cert\") pod \"f472186e-7a5c-492f-a8de-8a890653b3db\" (UID: \"f472186e-7a5c-492f-a8de-8a890653b3db\") " Jun 03 01:14:13.303662 ip-10-0-138-55 kubenswrapper[2566]: I0603 01:14:13.303302 2566 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/f472186e-7a5c-492f-a8de-8a890653b3db-trusted-ca-bundle" (OuterVolumeSpecName: "trusted-ca-bundle") pod "f472186e-7a5c-492f-a8de-8a890653b3db" (UID: "f472186e-7a5c-492f-a8de-8a890653b3db"). InnerVolumeSpecName "trusted-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jun 03 01:14:13.303662 ip-10-0-138-55 kubenswrapper[2566]: I0603 01:14:13.303455 2566 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/f472186e-7a5c-492f-a8de-8a890653b3db-console-config" (OuterVolumeSpecName: "console-config") pod "f472186e-7a5c-492f-a8de-8a890653b3db" (UID: "f472186e-7a5c-492f-a8de-8a890653b3db"). InnerVolumeSpecName "console-config". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jun 03 01:14:13.303662 ip-10-0-138-55 kubenswrapper[2566]: I0603 01:14:13.303589 2566 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/f472186e-7a5c-492f-a8de-8a890653b3db-service-ca" (OuterVolumeSpecName: "service-ca") pod "f472186e-7a5c-492f-a8de-8a890653b3db" (UID: "f472186e-7a5c-492f-a8de-8a890653b3db"). InnerVolumeSpecName "service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jun 03 01:14:13.304357 ip-10-0-138-55 kubenswrapper[2566]: I0603 01:14:13.304324 2566 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/f472186e-7a5c-492f-a8de-8a890653b3db-oauth-serving-cert" (OuterVolumeSpecName: "oauth-serving-cert") pod "f472186e-7a5c-492f-a8de-8a890653b3db" (UID: "f472186e-7a5c-492f-a8de-8a890653b3db"). InnerVolumeSpecName "oauth-serving-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jun 03 01:14:13.308076 ip-10-0-138-55 kubenswrapper[2566]: I0603 01:14:13.308034 2566 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/f472186e-7a5c-492f-a8de-8a890653b3db-kube-api-access-hvmcq" (OuterVolumeSpecName: "kube-api-access-hvmcq") pod "f472186e-7a5c-492f-a8de-8a890653b3db" (UID: "f472186e-7a5c-492f-a8de-8a890653b3db"). InnerVolumeSpecName "kube-api-access-hvmcq". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 03 01:14:13.308323 ip-10-0-138-55 kubenswrapper[2566]: I0603 01:14:13.308286 2566 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/f472186e-7a5c-492f-a8de-8a890653b3db-console-oauth-config" (OuterVolumeSpecName: "console-oauth-config") pod "f472186e-7a5c-492f-a8de-8a890653b3db" (UID: "f472186e-7a5c-492f-a8de-8a890653b3db"). InnerVolumeSpecName "console-oauth-config". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jun 03 01:14:13.308663 ip-10-0-138-55 kubenswrapper[2566]: I0603 01:14:13.308617 2566 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/f472186e-7a5c-492f-a8de-8a890653b3db-console-serving-cert" (OuterVolumeSpecName: "console-serving-cert") pod "f472186e-7a5c-492f-a8de-8a890653b3db" (UID: "f472186e-7a5c-492f-a8de-8a890653b3db"). InnerVolumeSpecName "console-serving-cert". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jun 03 01:14:13.402935 ip-10-0-138-55 kubenswrapper[2566]: I0603 01:14:13.402758 2566 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-hvmcq\" (UniqueName: \"kubernetes.io/projected/f472186e-7a5c-492f-a8de-8a890653b3db-kube-api-access-hvmcq\") on node \"ip-10-0-138-55.ec2.internal\" DevicePath \"\"" Jun 03 01:14:13.402935 ip-10-0-138-55 kubenswrapper[2566]: I0603 01:14:13.402805 2566 reconciler_common.go:299] "Volume detached for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/f472186e-7a5c-492f-a8de-8a890653b3db-console-serving-cert\") on node \"ip-10-0-138-55.ec2.internal\" DevicePath \"\"" Jun 03 01:14:13.402935 ip-10-0-138-55 kubenswrapper[2566]: I0603 01:14:13.402822 2566 reconciler_common.go:299] "Volume detached for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/f472186e-7a5c-492f-a8de-8a890653b3db-oauth-serving-cert\") on node \"ip-10-0-138-55.ec2.internal\" DevicePath \"\"" Jun 03 01:14:13.402935 ip-10-0-138-55 kubenswrapper[2566]: I0603 01:14:13.402836 2566 reconciler_common.go:299] "Volume detached for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/f472186e-7a5c-492f-a8de-8a890653b3db-console-oauth-config\") on node \"ip-10-0-138-55.ec2.internal\" DevicePath \"\"" Jun 03 01:14:13.402935 ip-10-0-138-55 kubenswrapper[2566]: I0603 01:14:13.402853 2566 reconciler_common.go:299] "Volume detached for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/f472186e-7a5c-492f-a8de-8a890653b3db-service-ca\") on node \"ip-10-0-138-55.ec2.internal\" DevicePath \"\"" Jun 03 01:14:13.402935 ip-10-0-138-55 kubenswrapper[2566]: I0603 01:14:13.402867 2566 reconciler_common.go:299] "Volume detached for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/f472186e-7a5c-492f-a8de-8a890653b3db-console-config\") on node \"ip-10-0-138-55.ec2.internal\" DevicePath \"\"" Jun 03 01:14:13.402935 ip-10-0-138-55 kubenswrapper[2566]: I0603 01:14:13.402878 2566 reconciler_common.go:299] "Volume detached for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/f472186e-7a5c-492f-a8de-8a890653b3db-trusted-ca-bundle\") on node \"ip-10-0-138-55.ec2.internal\" DevicePath \"\"" Jun 03 01:14:13.595539 ip-10-0-138-55 kubenswrapper[2566]: I0603 01:14:13.595487 2566 prober.go:120] "Probe failed" probeType="Startup" pod="keycloak-system/maas-keycloak-0" podUID="851cb6cf-116a-44de-af6f-8b275eb8f0af" containerName="keycloak" probeResult="failure" output="Get \"http://10.134.0.57:9000/health/started\": dial tcp 10.134.0.57:9000: connect: connection refused" Jun 03 01:14:13.942311 ip-10-0-138-55 kubenswrapper[2566]: I0603 01:14:13.942191 2566 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console_console-79448cc8b6-94mc5_f472186e-7a5c-492f-a8de-8a890653b3db/console/0.log" Jun 03 01:14:13.942311 ip-10-0-138-55 kubenswrapper[2566]: I0603 01:14:13.942283 2566 generic.go:358] "Generic (PLEG): container finished" podID="f472186e-7a5c-492f-a8de-8a890653b3db" containerID="eb54fd9b6c6947581b8936b79efdcc39f8c7f601a6986713ff8099078277d7d6" exitCode=2 Jun 03 01:14:13.942850 ip-10-0-138-55 kubenswrapper[2566]: I0603 01:14:13.942430 2566 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-79448cc8b6-94mc5" event={"ID":"f472186e-7a5c-492f-a8de-8a890653b3db","Type":"ContainerDied","Data":"eb54fd9b6c6947581b8936b79efdcc39f8c7f601a6986713ff8099078277d7d6"} Jun 03 01:14:13.942850 ip-10-0-138-55 kubenswrapper[2566]: I0603 01:14:13.942461 2566 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-79448cc8b6-94mc5" event={"ID":"f472186e-7a5c-492f-a8de-8a890653b3db","Type":"ContainerDied","Data":"9046125ea71202a874043ebd39a6f539eb1f6d9c7fb1be26fd1ca65a8ef1ec88"} Jun 03 01:14:13.942850 ip-10-0-138-55 kubenswrapper[2566]: I0603 01:14:13.942484 2566 scope.go:117] "RemoveContainer" containerID="eb54fd9b6c6947581b8936b79efdcc39f8c7f601a6986713ff8099078277d7d6" Jun 03 01:14:13.942850 ip-10-0-138-55 kubenswrapper[2566]: I0603 01:14:13.942548 2566 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-79448cc8b6-94mc5" Jun 03 01:14:13.956666 ip-10-0-138-55 kubenswrapper[2566]: I0603 01:14:13.956623 2566 scope.go:117] "RemoveContainer" containerID="eb54fd9b6c6947581b8936b79efdcc39f8c7f601a6986713ff8099078277d7d6" Jun 03 01:14:13.957405 ip-10-0-138-55 kubenswrapper[2566]: E0603 01:14:13.957051 2566 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"eb54fd9b6c6947581b8936b79efdcc39f8c7f601a6986713ff8099078277d7d6\": container with ID starting with eb54fd9b6c6947581b8936b79efdcc39f8c7f601a6986713ff8099078277d7d6 not found: ID does not exist" containerID="eb54fd9b6c6947581b8936b79efdcc39f8c7f601a6986713ff8099078277d7d6" Jun 03 01:14:13.957405 ip-10-0-138-55 kubenswrapper[2566]: I0603 01:14:13.957090 2566 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"eb54fd9b6c6947581b8936b79efdcc39f8c7f601a6986713ff8099078277d7d6"} err="failed to get container status \"eb54fd9b6c6947581b8936b79efdcc39f8c7f601a6986713ff8099078277d7d6\": rpc error: code = NotFound desc = could not find container \"eb54fd9b6c6947581b8936b79efdcc39f8c7f601a6986713ff8099078277d7d6\": container with ID starting with eb54fd9b6c6947581b8936b79efdcc39f8c7f601a6986713ff8099078277d7d6 not found: ID does not exist" Jun 03 01:14:13.962418 ip-10-0-138-55 kubenswrapper[2566]: I0603 01:14:13.962351 2566 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openshift-console/console-79448cc8b6-94mc5"] Jun 03 01:14:13.966881 ip-10-0-138-55 kubenswrapper[2566]: I0603 01:14:13.966853 2566 kubelet.go:2547] "SyncLoop REMOVE" source="api" pods=["openshift-console/console-79448cc8b6-94mc5"] Jun 03 01:14:14.595053 ip-10-0-138-55 kubenswrapper[2566]: I0603 01:14:14.594996 2566 prober.go:120] "Probe failed" probeType="Startup" pod="keycloak-system/maas-keycloak-0" podUID="851cb6cf-116a-44de-af6f-8b275eb8f0af" containerName="keycloak" probeResult="failure" output="Get \"http://10.134.0.57:9000/health/started\": dial tcp 10.134.0.57:9000: connect: connection refused" Jun 03 01:14:15.593818 ip-10-0-138-55 kubenswrapper[2566]: I0603 01:14:15.593774 2566 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="f472186e-7a5c-492f-a8de-8a890653b3db" path="/var/lib/kubelet/pods/f472186e-7a5c-492f-a8de-8a890653b3db/volumes" Jun 03 01:14:15.594627 ip-10-0-138-55 kubenswrapper[2566]: I0603 01:14:15.594591 2566 prober.go:120] "Probe failed" probeType="Startup" pod="keycloak-system/maas-keycloak-0" podUID="851cb6cf-116a-44de-af6f-8b275eb8f0af" containerName="keycloak" probeResult="failure" output="Get \"http://10.134.0.57:9000/health/started\": dial tcp 10.134.0.57:9000: connect: connection refused" Jun 03 01:14:16.595296 ip-10-0-138-55 kubenswrapper[2566]: I0603 01:14:16.595243 2566 prober.go:120] "Probe failed" probeType="Startup" pod="keycloak-system/maas-keycloak-0" podUID="851cb6cf-116a-44de-af6f-8b275eb8f0af" containerName="keycloak" probeResult="failure" output="Get \"http://10.134.0.57:9000/health/started\": dial tcp 10.134.0.57:9000: connect: connection refused" Jun 03 01:14:17.595313 ip-10-0-138-55 kubenswrapper[2566]: I0603 01:14:17.595268 2566 prober.go:120] "Probe failed" probeType="Startup" pod="keycloak-system/maas-keycloak-0" podUID="851cb6cf-116a-44de-af6f-8b275eb8f0af" containerName="keycloak" probeResult="failure" output="Get \"http://10.134.0.57:9000/health/started\": dial tcp 10.134.0.57:9000: connect: connection refused" Jun 03 01:14:18.594711 ip-10-0-138-55 kubenswrapper[2566]: I0603 01:14:18.594653 2566 prober.go:120] "Probe failed" probeType="Startup" pod="keycloak-system/maas-keycloak-0" podUID="851cb6cf-116a-44de-af6f-8b275eb8f0af" containerName="keycloak" probeResult="failure" output="Get \"http://10.134.0.57:9000/health/started\": dial tcp 10.134.0.57:9000: connect: connection refused" Jun 03 01:14:19.594918 ip-10-0-138-55 kubenswrapper[2566]: I0603 01:14:19.594871 2566 prober.go:120] "Probe failed" probeType="Startup" pod="keycloak-system/maas-keycloak-0" podUID="851cb6cf-116a-44de-af6f-8b275eb8f0af" containerName="keycloak" probeResult="failure" output="Get \"http://10.134.0.57:9000/health/started\": dial tcp 10.134.0.57:9000: connect: connection refused" Jun 03 01:14:20.594749 ip-10-0-138-55 kubenswrapper[2566]: I0603 01:14:20.594697 2566 prober.go:120] "Probe failed" probeType="Startup" pod="keycloak-system/maas-keycloak-0" podUID="851cb6cf-116a-44de-af6f-8b275eb8f0af" containerName="keycloak" probeResult="failure" output="Get \"http://10.134.0.57:9000/health/started\": dial tcp 10.134.0.57:9000: connect: connection refused" Jun 03 01:14:21.721032 ip-10-0-138-55 kubenswrapper[2566]: I0603 01:14:21.720986 2566 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="started" pod="keycloak-system/maas-keycloak-0" Jun 03 01:14:21.741350 ip-10-0-138-55 kubenswrapper[2566]: I0603 01:14:21.741309 2566 prober.go:120] "Probe failed" probeType="Readiness" pod="keycloak-system/maas-keycloak-0" podUID="851cb6cf-116a-44de-af6f-8b275eb8f0af" containerName="keycloak" probeResult="failure" output="HTTP probe failed with statuscode: 503" Jun 03 01:14:31.727156 ip-10-0-138-55 kubenswrapper[2566]: I0603 01:14:31.727109 2566 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="keycloak-system/maas-keycloak-0" Jun 03 01:14:37.641290 ip-10-0-138-55 kubenswrapper[2566]: I0603 01:14:37.641266 2566 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-86d7c6cc77-8nd2x_5776439a-7cdc-49da-a5f6-325eb0c8ab99/console-operator/1.log" Jun 03 01:14:37.642978 ip-10-0-138-55 kubenswrapper[2566]: I0603 01:14:37.642961 2566 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-86d7c6cc77-8nd2x_5776439a-7cdc-49da-a5f6-325eb0c8ab99/console-operator/1.log" Jun 03 01:14:37.947940 ip-10-0-138-55 kubenswrapper[2566]: I0603 01:14:37.947860 2566 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["opendatahub/maas-controller-7c98b97645-wkxf8"] Jun 03 01:14:37.948364 ip-10-0-138-55 kubenswrapper[2566]: I0603 01:14:37.948349 2566 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="f472186e-7a5c-492f-a8de-8a890653b3db" containerName="console" Jun 03 01:14:37.948421 ip-10-0-138-55 kubenswrapper[2566]: I0603 01:14:37.948365 2566 state_mem.go:107] "Deleted CPUSet assignment" podUID="f472186e-7a5c-492f-a8de-8a890653b3db" containerName="console" Jun 03 01:14:37.948458 ip-10-0-138-55 kubenswrapper[2566]: I0603 01:14:37.948446 2566 memory_manager.go:356] "RemoveStaleState removing state" podUID="f472186e-7a5c-492f-a8de-8a890653b3db" containerName="console" Jun 03 01:14:37.952625 ip-10-0-138-55 kubenswrapper[2566]: I0603 01:14:37.952608 2566 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-7c98b97645-wkxf8" Jun 03 01:14:37.954643 ip-10-0-138-55 kubenswrapper[2566]: I0603 01:14:37.954616 2566 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"maas-parameters\"" Jun 03 01:14:37.954760 ip-10-0-138-55 kubenswrapper[2566]: I0603 01:14:37.954669 2566 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"maas-controller-dockercfg-5c2k8\"" Jun 03 01:14:37.962187 ip-10-0-138-55 kubenswrapper[2566]: I0603 01:14:37.962161 2566 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-controller-7c98b97645-wkxf8"] Jun 03 01:14:38.055157 ip-10-0-138-55 kubenswrapper[2566]: I0603 01:14:38.055128 2566 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["opendatahub/maas-controller-76cbd784d6-rsjhd"] Jun 03 01:14:38.058809 ip-10-0-138-55 kubenswrapper[2566]: I0603 01:14:38.058787 2566 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-76cbd784d6-rsjhd" Jun 03 01:14:38.058952 ip-10-0-138-55 kubenswrapper[2566]: I0603 01:14:38.058915 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-cpc59\" (UniqueName: \"kubernetes.io/projected/2b85e55f-8d44-461d-9355-cece5d476628-kube-api-access-cpc59\") pod \"maas-controller-7c98b97645-wkxf8\" (UID: \"2b85e55f-8d44-461d-9355-cece5d476628\") " pod="opendatahub/maas-controller-7c98b97645-wkxf8" Jun 03 01:14:38.064953 ip-10-0-138-55 kubenswrapper[2566]: I0603 01:14:38.064927 2566 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-controller-76cbd784d6-rsjhd"] Jun 03 01:14:38.159537 ip-10-0-138-55 kubenswrapper[2566]: I0603 01:14:38.159504 2566 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-cpc59\" (UniqueName: \"kubernetes.io/projected/2b85e55f-8d44-461d-9355-cece5d476628-kube-api-access-cpc59\") pod \"maas-controller-7c98b97645-wkxf8\" (UID: \"2b85e55f-8d44-461d-9355-cece5d476628\") " pod="opendatahub/maas-controller-7c98b97645-wkxf8" Jun 03 01:14:38.159711 ip-10-0-138-55 kubenswrapper[2566]: I0603 01:14:38.159569 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-v8sn7\" (UniqueName: \"kubernetes.io/projected/f58fbdda-eabd-4aab-9e64-0e8bb850d2c3-kube-api-access-v8sn7\") pod \"maas-controller-76cbd784d6-rsjhd\" (UID: \"f58fbdda-eabd-4aab-9e64-0e8bb850d2c3\") " pod="opendatahub/maas-controller-76cbd784d6-rsjhd" Jun 03 01:14:38.167277 ip-10-0-138-55 kubenswrapper[2566]: I0603 01:14:38.167251 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-cpc59\" (UniqueName: \"kubernetes.io/projected/2b85e55f-8d44-461d-9355-cece5d476628-kube-api-access-cpc59\") pod \"maas-controller-7c98b97645-wkxf8\" (UID: \"2b85e55f-8d44-461d-9355-cece5d476628\") " pod="opendatahub/maas-controller-7c98b97645-wkxf8" Jun 03 01:14:38.260436 ip-10-0-138-55 kubenswrapper[2566]: I0603 01:14:38.260341 2566 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-v8sn7\" (UniqueName: \"kubernetes.io/projected/f58fbdda-eabd-4aab-9e64-0e8bb850d2c3-kube-api-access-v8sn7\") pod \"maas-controller-76cbd784d6-rsjhd\" (UID: \"f58fbdda-eabd-4aab-9e64-0e8bb850d2c3\") " pod="opendatahub/maas-controller-76cbd784d6-rsjhd" Jun 03 01:14:38.264174 ip-10-0-138-55 kubenswrapper[2566]: I0603 01:14:38.264153 2566 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-7c98b97645-wkxf8" Jun 03 01:14:38.268323 ip-10-0-138-55 kubenswrapper[2566]: I0603 01:14:38.268304 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-v8sn7\" (UniqueName: \"kubernetes.io/projected/f58fbdda-eabd-4aab-9e64-0e8bb850d2c3-kube-api-access-v8sn7\") pod \"maas-controller-76cbd784d6-rsjhd\" (UID: \"f58fbdda-eabd-4aab-9e64-0e8bb850d2c3\") " pod="opendatahub/maas-controller-76cbd784d6-rsjhd" Jun 03 01:14:38.370993 ip-10-0-138-55 kubenswrapper[2566]: I0603 01:14:38.370959 2566 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-76cbd784d6-rsjhd" Jun 03 01:14:38.396071 ip-10-0-138-55 kubenswrapper[2566]: I0603 01:14:38.396040 2566 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-controller-7c98b97645-wkxf8"] Jun 03 01:14:38.396777 ip-10-0-138-55 kubenswrapper[2566]: W0603 01:14:38.396649 2566 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod2b85e55f_8d44_461d_9355_cece5d476628.slice/crio-d6f2c384e2fa7cc884913eac3810e82268b4de2de1106880b538b33c503d5966 WatchSource:0}: Error finding container d6f2c384e2fa7cc884913eac3810e82268b4de2de1106880b538b33c503d5966: Status 404 returned error can't find the container with id d6f2c384e2fa7cc884913eac3810e82268b4de2de1106880b538b33c503d5966 Jun 03 01:14:38.507951 ip-10-0-138-55 kubenswrapper[2566]: I0603 01:14:38.507920 2566 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-controller-76cbd784d6-rsjhd"] Jun 03 01:14:38.509485 ip-10-0-138-55 kubenswrapper[2566]: W0603 01:14:38.509460 2566 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podf58fbdda_eabd_4aab_9e64_0e8bb850d2c3.slice/crio-092e18024b5e8be2f28b5342badfbeaa7bfeb3d2d936a40f3dae6cbab8e82e62 WatchSource:0}: Error finding container 092e18024b5e8be2f28b5342badfbeaa7bfeb3d2d936a40f3dae6cbab8e82e62: Status 404 returned error can't find the container with id 092e18024b5e8be2f28b5342badfbeaa7bfeb3d2d936a40f3dae6cbab8e82e62 Jun 03 01:14:39.061201 ip-10-0-138-55 kubenswrapper[2566]: I0603 01:14:39.061146 2566 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-7c98b97645-wkxf8" event={"ID":"2b85e55f-8d44-461d-9355-cece5d476628","Type":"ContainerStarted","Data":"d6f2c384e2fa7cc884913eac3810e82268b4de2de1106880b538b33c503d5966"} Jun 03 01:14:39.062577 ip-10-0-138-55 kubenswrapper[2566]: I0603 01:14:39.062547 2566 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-76cbd784d6-rsjhd" event={"ID":"f58fbdda-eabd-4aab-9e64-0e8bb850d2c3","Type":"ContainerStarted","Data":"092e18024b5e8be2f28b5342badfbeaa7bfeb3d2d936a40f3dae6cbab8e82e62"} Jun 03 01:14:42.078649 ip-10-0-138-55 kubenswrapper[2566]: I0603 01:14:42.078594 2566 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-76cbd784d6-rsjhd" event={"ID":"f58fbdda-eabd-4aab-9e64-0e8bb850d2c3","Type":"ContainerStarted","Data":"14ffcb70d89cf63017af9fea20c008448b6b502a1b7594edb6314b5858764671"} Jun 03 01:14:42.078649 ip-10-0-138-55 kubenswrapper[2566]: I0603 01:14:42.078650 2566 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/maas-controller-76cbd784d6-rsjhd" Jun 03 01:14:42.079991 ip-10-0-138-55 kubenswrapper[2566]: I0603 01:14:42.079965 2566 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-7c98b97645-wkxf8" event={"ID":"2b85e55f-8d44-461d-9355-cece5d476628","Type":"ContainerStarted","Data":"db3f6d887b0536cf6f27eace33beb08998264344157a2eb1c19b5be6b3040d01"} Jun 03 01:14:42.080143 ip-10-0-138-55 kubenswrapper[2566]: I0603 01:14:42.080119 2566 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/maas-controller-7c98b97645-wkxf8" Jun 03 01:14:42.094482 ip-10-0-138-55 kubenswrapper[2566]: I0603 01:14:42.094436 2566 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="opendatahub/maas-controller-76cbd784d6-rsjhd" podStartSLOduration=1.473528809 podStartE2EDuration="4.094420265s" podCreationTimestamp="2026-06-03 01:14:38 +0000 UTC" firstStartedPulling="2026-06-03 01:14:38.510759711 +0000 UTC m=+601.657601639" lastFinishedPulling="2026-06-03 01:14:41.131651168 +0000 UTC m=+604.278493095" observedRunningTime="2026-06-03 01:14:42.090404757 +0000 UTC m=+605.237246705" watchObservedRunningTime="2026-06-03 01:14:42.094420265 +0000 UTC m=+605.241262212" Jun 03 01:14:42.104300 ip-10-0-138-55 kubenswrapper[2566]: I0603 01:14:42.104252 2566 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="opendatahub/maas-controller-7c98b97645-wkxf8" podStartSLOduration=2.364045714 podStartE2EDuration="5.104220163s" podCreationTimestamp="2026-06-03 01:14:37 +0000 UTC" firstStartedPulling="2026-06-03 01:14:38.398359078 +0000 UTC m=+601.545201004" lastFinishedPulling="2026-06-03 01:14:41.138533515 +0000 UTC m=+604.285375453" observedRunningTime="2026-06-03 01:14:42.10301471 +0000 UTC m=+605.249856657" watchObservedRunningTime="2026-06-03 01:14:42.104220163 +0000 UTC m=+605.251062108" Jun 03 01:14:53.090550 ip-10-0-138-55 kubenswrapper[2566]: I0603 01:14:53.090516 2566 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/maas-controller-76cbd784d6-rsjhd" Jun 03 01:14:53.091043 ip-10-0-138-55 kubenswrapper[2566]: I0603 01:14:53.090788 2566 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/maas-controller-7c98b97645-wkxf8" Jun 03 01:14:53.146937 ip-10-0-138-55 kubenswrapper[2566]: I0603 01:14:53.146902 2566 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["opendatahub/maas-controller-7c98b97645-wkxf8"] Jun 03 01:14:53.147126 ip-10-0-138-55 kubenswrapper[2566]: I0603 01:14:53.147098 2566 kuberuntime_container.go:864] "Killing container with a grace period" pod="opendatahub/maas-controller-7c98b97645-wkxf8" podUID="2b85e55f-8d44-461d-9355-cece5d476628" containerName="manager" containerID="cri-o://db3f6d887b0536cf6f27eace33beb08998264344157a2eb1c19b5be6b3040d01" gracePeriod=30 Jun 03 01:14:53.390780 ip-10-0-138-55 kubenswrapper[2566]: I0603 01:14:53.390757 2566 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-7c98b97645-wkxf8" Jun 03 01:14:53.526435 ip-10-0-138-55 kubenswrapper[2566]: I0603 01:14:53.526400 2566 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-cpc59\" (UniqueName: \"kubernetes.io/projected/2b85e55f-8d44-461d-9355-cece5d476628-kube-api-access-cpc59\") pod \"2b85e55f-8d44-461d-9355-cece5d476628\" (UID: \"2b85e55f-8d44-461d-9355-cece5d476628\") " Jun 03 01:14:53.528626 ip-10-0-138-55 kubenswrapper[2566]: I0603 01:14:53.528595 2566 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/2b85e55f-8d44-461d-9355-cece5d476628-kube-api-access-cpc59" (OuterVolumeSpecName: "kube-api-access-cpc59") pod "2b85e55f-8d44-461d-9355-cece5d476628" (UID: "2b85e55f-8d44-461d-9355-cece5d476628"). InnerVolumeSpecName "kube-api-access-cpc59". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 03 01:14:53.627265 ip-10-0-138-55 kubenswrapper[2566]: I0603 01:14:53.627204 2566 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-cpc59\" (UniqueName: \"kubernetes.io/projected/2b85e55f-8d44-461d-9355-cece5d476628-kube-api-access-cpc59\") on node \"ip-10-0-138-55.ec2.internal\" DevicePath \"\"" Jun 03 01:14:54.131073 ip-10-0-138-55 kubenswrapper[2566]: I0603 01:14:54.131038 2566 generic.go:358] "Generic (PLEG): container finished" podID="2b85e55f-8d44-461d-9355-cece5d476628" containerID="db3f6d887b0536cf6f27eace33beb08998264344157a2eb1c19b5be6b3040d01" exitCode=0 Jun 03 01:14:54.131562 ip-10-0-138-55 kubenswrapper[2566]: I0603 01:14:54.131088 2566 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-7c98b97645-wkxf8" event={"ID":"2b85e55f-8d44-461d-9355-cece5d476628","Type":"ContainerDied","Data":"db3f6d887b0536cf6f27eace33beb08998264344157a2eb1c19b5be6b3040d01"} Jun 03 01:14:54.131562 ip-10-0-138-55 kubenswrapper[2566]: I0603 01:14:54.131122 2566 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-7c98b97645-wkxf8" Jun 03 01:14:54.131562 ip-10-0-138-55 kubenswrapper[2566]: I0603 01:14:54.131129 2566 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-7c98b97645-wkxf8" event={"ID":"2b85e55f-8d44-461d-9355-cece5d476628","Type":"ContainerDied","Data":"d6f2c384e2fa7cc884913eac3810e82268b4de2de1106880b538b33c503d5966"} Jun 03 01:14:54.131562 ip-10-0-138-55 kubenswrapper[2566]: I0603 01:14:54.131146 2566 scope.go:117] "RemoveContainer" containerID="db3f6d887b0536cf6f27eace33beb08998264344157a2eb1c19b5be6b3040d01" Jun 03 01:14:54.140388 ip-10-0-138-55 kubenswrapper[2566]: I0603 01:14:54.140327 2566 scope.go:117] "RemoveContainer" containerID="db3f6d887b0536cf6f27eace33beb08998264344157a2eb1c19b5be6b3040d01" Jun 03 01:14:54.140607 ip-10-0-138-55 kubenswrapper[2566]: E0603 01:14:54.140587 2566 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"db3f6d887b0536cf6f27eace33beb08998264344157a2eb1c19b5be6b3040d01\": container with ID starting with db3f6d887b0536cf6f27eace33beb08998264344157a2eb1c19b5be6b3040d01 not found: ID does not exist" containerID="db3f6d887b0536cf6f27eace33beb08998264344157a2eb1c19b5be6b3040d01" Jun 03 01:14:54.140657 ip-10-0-138-55 kubenswrapper[2566]: I0603 01:14:54.140618 2566 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"db3f6d887b0536cf6f27eace33beb08998264344157a2eb1c19b5be6b3040d01"} err="failed to get container status \"db3f6d887b0536cf6f27eace33beb08998264344157a2eb1c19b5be6b3040d01\": rpc error: code = NotFound desc = could not find container \"db3f6d887b0536cf6f27eace33beb08998264344157a2eb1c19b5be6b3040d01\": container with ID starting with db3f6d887b0536cf6f27eace33beb08998264344157a2eb1c19b5be6b3040d01 not found: ID does not exist" Jun 03 01:14:54.148060 ip-10-0-138-55 kubenswrapper[2566]: I0603 01:14:54.148037 2566 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["opendatahub/maas-controller-7c98b97645-wkxf8"] Jun 03 01:14:54.151536 ip-10-0-138-55 kubenswrapper[2566]: I0603 01:14:54.151512 2566 kubelet.go:2547] "SyncLoop REMOVE" source="api" pods=["opendatahub/maas-controller-7c98b97645-wkxf8"] Jun 03 01:14:55.590861 ip-10-0-138-55 kubenswrapper[2566]: I0603 01:14:55.590825 2566 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="2b85e55f-8d44-461d-9355-cece5d476628" path="/var/lib/kubelet/pods/2b85e55f-8d44-461d-9355-cece5d476628/volumes" Jun 03 01:15:13.721654 ip-10-0-138-55 kubenswrapper[2566]: I0603 01:15:13.721566 2566 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["opendatahub/maas-api-7986767586-jvsst"] Jun 03 01:15:13.722305 ip-10-0-138-55 kubenswrapper[2566]: I0603 01:15:13.722278 2566 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="2b85e55f-8d44-461d-9355-cece5d476628" containerName="manager" Jun 03 01:15:13.722393 ip-10-0-138-55 kubenswrapper[2566]: I0603 01:15:13.722311 2566 state_mem.go:107] "Deleted CPUSet assignment" podUID="2b85e55f-8d44-461d-9355-cece5d476628" containerName="manager" Jun 03 01:15:13.722469 ip-10-0-138-55 kubenswrapper[2566]: I0603 01:15:13.722453 2566 memory_manager.go:356] "RemoveStaleState removing state" podUID="2b85e55f-8d44-461d-9355-cece5d476628" containerName="manager" Jun 03 01:15:13.730563 ip-10-0-138-55 kubenswrapper[2566]: I0603 01:15:13.730541 2566 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-api-7986767586-jvsst" Jun 03 01:15:13.733685 ip-10-0-138-55 kubenswrapper[2566]: I0603 01:15:13.733664 2566 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"maas-api-serving-cert\"" Jun 03 01:15:13.733804 ip-10-0-138-55 kubenswrapper[2566]: I0603 01:15:13.733663 2566 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"maas-api-dockercfg-7sn94\"" Jun 03 01:15:13.735909 ip-10-0-138-55 kubenswrapper[2566]: I0603 01:15:13.735876 2566 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-api-7986767586-jvsst"] Jun 03 01:15:13.817982 ip-10-0-138-55 kubenswrapper[2566]: I0603 01:15:13.817948 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-m4hln\" (UniqueName: \"kubernetes.io/projected/8ddf70ce-359b-4d17-947f-f39153e7824f-kube-api-access-m4hln\") pod \"maas-api-7986767586-jvsst\" (UID: \"8ddf70ce-359b-4d17-947f-f39153e7824f\") " pod="opendatahub/maas-api-7986767586-jvsst" Jun 03 01:15:13.818180 ip-10-0-138-55 kubenswrapper[2566]: I0603 01:15:13.818140 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/8ddf70ce-359b-4d17-947f-f39153e7824f-maas-api-tls\") pod \"maas-api-7986767586-jvsst\" (UID: \"8ddf70ce-359b-4d17-947f-f39153e7824f\") " pod="opendatahub/maas-api-7986767586-jvsst" Jun 03 01:15:13.919396 ip-10-0-138-55 kubenswrapper[2566]: I0603 01:15:13.919364 2566 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/8ddf70ce-359b-4d17-947f-f39153e7824f-maas-api-tls\") pod \"maas-api-7986767586-jvsst\" (UID: \"8ddf70ce-359b-4d17-947f-f39153e7824f\") " pod="opendatahub/maas-api-7986767586-jvsst" Jun 03 01:15:13.919563 ip-10-0-138-55 kubenswrapper[2566]: I0603 01:15:13.919404 2566 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-m4hln\" (UniqueName: \"kubernetes.io/projected/8ddf70ce-359b-4d17-947f-f39153e7824f-kube-api-access-m4hln\") pod \"maas-api-7986767586-jvsst\" (UID: \"8ddf70ce-359b-4d17-947f-f39153e7824f\") " pod="opendatahub/maas-api-7986767586-jvsst" Jun 03 01:15:13.921860 ip-10-0-138-55 kubenswrapper[2566]: I0603 01:15:13.921837 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/8ddf70ce-359b-4d17-947f-f39153e7824f-maas-api-tls\") pod \"maas-api-7986767586-jvsst\" (UID: \"8ddf70ce-359b-4d17-947f-f39153e7824f\") " pod="opendatahub/maas-api-7986767586-jvsst" Jun 03 01:15:13.927609 ip-10-0-138-55 kubenswrapper[2566]: I0603 01:15:13.927586 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-m4hln\" (UniqueName: \"kubernetes.io/projected/8ddf70ce-359b-4d17-947f-f39153e7824f-kube-api-access-m4hln\") pod \"maas-api-7986767586-jvsst\" (UID: \"8ddf70ce-359b-4d17-947f-f39153e7824f\") " pod="opendatahub/maas-api-7986767586-jvsst" Jun 03 01:15:14.044842 ip-10-0-138-55 kubenswrapper[2566]: I0603 01:15:14.044749 2566 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-api-7986767586-jvsst" Jun 03 01:15:14.201093 ip-10-0-138-55 kubenswrapper[2566]: I0603 01:15:14.201046 2566 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-api-7986767586-jvsst"] Jun 03 01:15:14.203837 ip-10-0-138-55 kubenswrapper[2566]: W0603 01:15:14.203811 2566 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod8ddf70ce_359b_4d17_947f_f39153e7824f.slice/crio-caefd77a96867976fd8c5346a85c86012dd56b6d73e5c82c64c9e2de68359815 WatchSource:0}: Error finding container caefd77a96867976fd8c5346a85c86012dd56b6d73e5c82c64c9e2de68359815: Status 404 returned error can't find the container with id caefd77a96867976fd8c5346a85c86012dd56b6d73e5c82c64c9e2de68359815 Jun 03 01:15:14.205167 ip-10-0-138-55 kubenswrapper[2566]: I0603 01:15:14.205149 2566 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider Jun 03 01:15:14.213854 ip-10-0-138-55 kubenswrapper[2566]: I0603 01:15:14.213829 2566 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-api-7986767586-jvsst" event={"ID":"8ddf70ce-359b-4d17-947f-f39153e7824f","Type":"ContainerStarted","Data":"caefd77a96867976fd8c5346a85c86012dd56b6d73e5c82c64c9e2de68359815"} Jun 03 01:15:16.224161 ip-10-0-138-55 kubenswrapper[2566]: I0603 01:15:16.224128 2566 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-api-7986767586-jvsst" event={"ID":"8ddf70ce-359b-4d17-947f-f39153e7824f","Type":"ContainerStarted","Data":"3cc1ca50da89ec4ff7a36bfb085181984e5d8ef5b644f9034286b3467b8232e5"} Jun 03 01:15:16.224560 ip-10-0-138-55 kubenswrapper[2566]: I0603 01:15:16.224180 2566 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/maas-api-7986767586-jvsst" Jun 03 01:15:16.240182 ip-10-0-138-55 kubenswrapper[2566]: I0603 01:15:16.240129 2566 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="opendatahub/maas-api-7986767586-jvsst" podStartSLOduration=1.397670771 podStartE2EDuration="3.240113788s" podCreationTimestamp="2026-06-03 01:15:13 +0000 UTC" firstStartedPulling="2026-06-03 01:15:14.205337808 +0000 UTC m=+637.352179748" lastFinishedPulling="2026-06-03 01:15:16.047780841 +0000 UTC m=+639.194622765" observedRunningTime="2026-06-03 01:15:16.237825484 +0000 UTC m=+639.384667430" watchObservedRunningTime="2026-06-03 01:15:16.240113788 +0000 UTC m=+639.386955783" Jun 03 01:15:22.234557 ip-10-0-138-55 kubenswrapper[2566]: I0603 01:15:22.234519 2566 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/maas-api-7986767586-jvsst" Jun 03 01:15:25.463121 ip-10-0-138-55 kubenswrapper[2566]: I0603 01:15:25.463081 2566 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["keycloak-system/maas-keycloak-0"] Jun 03 01:15:25.463555 ip-10-0-138-55 kubenswrapper[2566]: I0603 01:15:25.463358 2566 kuberuntime_container.go:864] "Killing container with a grace period" pod="keycloak-system/maas-keycloak-0" podUID="851cb6cf-116a-44de-af6f-8b275eb8f0af" containerName="keycloak" containerID="cri-o://51e6eb4b0fc59b987129e10b503019672431454b7ca4c3b1caba4dfe34eeba0f" gracePeriod=30 Jun 03 01:15:27.279653 ip-10-0-138-55 kubenswrapper[2566]: I0603 01:15:27.279569 2566 generic.go:358] "Generic (PLEG): container finished" podID="851cb6cf-116a-44de-af6f-8b275eb8f0af" containerID="51e6eb4b0fc59b987129e10b503019672431454b7ca4c3b1caba4dfe34eeba0f" exitCode=143 Jun 03 01:15:27.279653 ip-10-0-138-55 kubenswrapper[2566]: I0603 01:15:27.279639 2566 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="keycloak-system/maas-keycloak-0" event={"ID":"851cb6cf-116a-44de-af6f-8b275eb8f0af","Type":"ContainerDied","Data":"51e6eb4b0fc59b987129e10b503019672431454b7ca4c3b1caba4dfe34eeba0f"} Jun 03 01:15:27.520159 ip-10-0-138-55 kubenswrapper[2566]: I0603 01:15:27.520136 2566 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="keycloak-system/maas-keycloak-0" Jun 03 01:15:27.649646 ip-10-0-138-55 kubenswrapper[2566]: I0603 01:15:27.649611 2566 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-vr9wl\" (UniqueName: \"kubernetes.io/projected/851cb6cf-116a-44de-af6f-8b275eb8f0af-kube-api-access-vr9wl\") pod \"851cb6cf-116a-44de-af6f-8b275eb8f0af\" (UID: \"851cb6cf-116a-44de-af6f-8b275eb8f0af\") " Jun 03 01:15:27.651855 ip-10-0-138-55 kubenswrapper[2566]: I0603 01:15:27.651828 2566 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/851cb6cf-116a-44de-af6f-8b275eb8f0af-kube-api-access-vr9wl" (OuterVolumeSpecName: "kube-api-access-vr9wl") pod "851cb6cf-116a-44de-af6f-8b275eb8f0af" (UID: "851cb6cf-116a-44de-af6f-8b275eb8f0af"). InnerVolumeSpecName "kube-api-access-vr9wl". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 03 01:15:27.750470 ip-10-0-138-55 kubenswrapper[2566]: I0603 01:15:27.750436 2566 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-vr9wl\" (UniqueName: \"kubernetes.io/projected/851cb6cf-116a-44de-af6f-8b275eb8f0af-kube-api-access-vr9wl\") on node \"ip-10-0-138-55.ec2.internal\" DevicePath \"\"" Jun 03 01:15:28.284551 ip-10-0-138-55 kubenswrapper[2566]: I0603 01:15:28.284523 2566 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="keycloak-system/maas-keycloak-0" Jun 03 01:15:28.284977 ip-10-0-138-55 kubenswrapper[2566]: I0603 01:15:28.284521 2566 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="keycloak-system/maas-keycloak-0" event={"ID":"851cb6cf-116a-44de-af6f-8b275eb8f0af","Type":"ContainerDied","Data":"a7c83ea85d21fa21c9a96dd618433c4a0d7cd941ff139870319c0cb921d5d7ed"} Jun 03 01:15:28.284977 ip-10-0-138-55 kubenswrapper[2566]: I0603 01:15:28.284640 2566 scope.go:117] "RemoveContainer" containerID="51e6eb4b0fc59b987129e10b503019672431454b7ca4c3b1caba4dfe34eeba0f" Jun 03 01:15:28.308391 ip-10-0-138-55 kubenswrapper[2566]: I0603 01:15:28.308358 2566 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["keycloak-system/maas-keycloak-0"] Jun 03 01:15:28.310914 ip-10-0-138-55 kubenswrapper[2566]: I0603 01:15:28.310882 2566 kubelet.go:2547] "SyncLoop REMOVE" source="api" pods=["keycloak-system/maas-keycloak-0"] Jun 03 01:15:28.328781 ip-10-0-138-55 kubenswrapper[2566]: I0603 01:15:28.328756 2566 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["keycloak-system/maas-keycloak-0"] Jun 03 01:15:28.329326 ip-10-0-138-55 kubenswrapper[2566]: I0603 01:15:28.329308 2566 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="851cb6cf-116a-44de-af6f-8b275eb8f0af" containerName="keycloak" Jun 03 01:15:28.329326 ip-10-0-138-55 kubenswrapper[2566]: I0603 01:15:28.329327 2566 state_mem.go:107] "Deleted CPUSet assignment" podUID="851cb6cf-116a-44de-af6f-8b275eb8f0af" containerName="keycloak" Jun 03 01:15:28.329433 ip-10-0-138-55 kubenswrapper[2566]: I0603 01:15:28.329404 2566 memory_manager.go:356] "RemoveStaleState removing state" podUID="851cb6cf-116a-44de-af6f-8b275eb8f0af" containerName="keycloak" Jun 03 01:15:28.333763 ip-10-0-138-55 kubenswrapper[2566]: I0603 01:15:28.333746 2566 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="keycloak-system/maas-keycloak-0" Jun 03 01:15:28.335550 ip-10-0-138-55 kubenswrapper[2566]: I0603 01:15:28.335528 2566 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"keycloak-system\"/\"kube-root-ca.crt\"" Jun 03 01:15:28.335743 ip-10-0-138-55 kubenswrapper[2566]: I0603 01:15:28.335699 2566 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"keycloak-system\"/\"keycloak-test-realms\"" Jun 03 01:15:28.335960 ip-10-0-138-55 kubenswrapper[2566]: I0603 01:15:28.335759 2566 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"keycloak-system\"/\"openshift-service-ca.crt\"" Jun 03 01:15:28.336218 ip-10-0-138-55 kubenswrapper[2566]: I0603 01:15:28.336196 2566 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"keycloak-system\"/\"maas-keycloak-initial-admin\"" Jun 03 01:15:28.336507 ip-10-0-138-55 kubenswrapper[2566]: I0603 01:15:28.336486 2566 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"keycloak-system\"/\"default-dockercfg-lcj8q\"" Jun 03 01:15:28.339819 ip-10-0-138-55 kubenswrapper[2566]: I0603 01:15:28.339792 2566 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["keycloak-system/maas-keycloak-0"] Jun 03 01:15:28.457358 ip-10-0-138-55 kubenswrapper[2566]: I0603 01:15:28.457318 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-jxhhj\" (UniqueName: \"kubernetes.io/projected/b0ca1223-8c0f-4e98-88aa-9ec4d6572405-kube-api-access-jxhhj\") pod \"maas-keycloak-0\" (UID: \"b0ca1223-8c0f-4e98-88aa-9ec4d6572405\") " pod="keycloak-system/maas-keycloak-0" Jun 03 01:15:28.457518 ip-10-0-138-55 kubenswrapper[2566]: I0603 01:15:28.457446 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"test-realms\" (UniqueName: \"kubernetes.io/configmap/b0ca1223-8c0f-4e98-88aa-9ec4d6572405-test-realms\") pod \"maas-keycloak-0\" (UID: \"b0ca1223-8c0f-4e98-88aa-9ec4d6572405\") " pod="keycloak-system/maas-keycloak-0" Jun 03 01:15:28.558396 ip-10-0-138-55 kubenswrapper[2566]: I0603 01:15:28.558303 2566 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"test-realms\" (UniqueName: \"kubernetes.io/configmap/b0ca1223-8c0f-4e98-88aa-9ec4d6572405-test-realms\") pod \"maas-keycloak-0\" (UID: \"b0ca1223-8c0f-4e98-88aa-9ec4d6572405\") " pod="keycloak-system/maas-keycloak-0" Jun 03 01:15:28.558396 ip-10-0-138-55 kubenswrapper[2566]: I0603 01:15:28.558393 2566 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-jxhhj\" (UniqueName: \"kubernetes.io/projected/b0ca1223-8c0f-4e98-88aa-9ec4d6572405-kube-api-access-jxhhj\") pod \"maas-keycloak-0\" (UID: \"b0ca1223-8c0f-4e98-88aa-9ec4d6572405\") " pod="keycloak-system/maas-keycloak-0" Jun 03 01:15:28.559060 ip-10-0-138-55 kubenswrapper[2566]: I0603 01:15:28.559040 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"test-realms\" (UniqueName: \"kubernetes.io/configmap/b0ca1223-8c0f-4e98-88aa-9ec4d6572405-test-realms\") pod \"maas-keycloak-0\" (UID: \"b0ca1223-8c0f-4e98-88aa-9ec4d6572405\") " pod="keycloak-system/maas-keycloak-0" Jun 03 01:15:28.565986 ip-10-0-138-55 kubenswrapper[2566]: I0603 01:15:28.565959 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-jxhhj\" (UniqueName: \"kubernetes.io/projected/b0ca1223-8c0f-4e98-88aa-9ec4d6572405-kube-api-access-jxhhj\") pod \"maas-keycloak-0\" (UID: \"b0ca1223-8c0f-4e98-88aa-9ec4d6572405\") " pod="keycloak-system/maas-keycloak-0" Jun 03 01:15:28.644896 ip-10-0-138-55 kubenswrapper[2566]: I0603 01:15:28.644854 2566 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="keycloak-system/maas-keycloak-0" Jun 03 01:15:28.779131 ip-10-0-138-55 kubenswrapper[2566]: I0603 01:15:28.779097 2566 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["keycloak-system/maas-keycloak-0"] Jun 03 01:15:28.780353 ip-10-0-138-55 kubenswrapper[2566]: W0603 01:15:28.780321 2566 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podb0ca1223_8c0f_4e98_88aa_9ec4d6572405.slice/crio-7358f6daf2b28a2a038fc57e2daca429625627f5e002874dfa44e1e380434390 WatchSource:0}: Error finding container 7358f6daf2b28a2a038fc57e2daca429625627f5e002874dfa44e1e380434390: Status 404 returned error can't find the container with id 7358f6daf2b28a2a038fc57e2daca429625627f5e002874dfa44e1e380434390 Jun 03 01:15:29.291366 ip-10-0-138-55 kubenswrapper[2566]: I0603 01:15:29.291327 2566 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="keycloak-system/maas-keycloak-0" event={"ID":"b0ca1223-8c0f-4e98-88aa-9ec4d6572405","Type":"ContainerStarted","Data":"3548338a48fed9e78e5361ba3dd3f7ba0119c28c6ceda343172b38ec0327c77e"} Jun 03 01:15:29.291366 ip-10-0-138-55 kubenswrapper[2566]: I0603 01:15:29.291369 2566 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="keycloak-system/maas-keycloak-0" event={"ID":"b0ca1223-8c0f-4e98-88aa-9ec4d6572405","Type":"ContainerStarted","Data":"7358f6daf2b28a2a038fc57e2daca429625627f5e002874dfa44e1e380434390"} Jun 03 01:15:29.309967 ip-10-0-138-55 kubenswrapper[2566]: I0603 01:15:29.309910 2566 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="keycloak-system/maas-keycloak-0" podStartSLOduration=1.012974976 podStartE2EDuration="1.309895758s" podCreationTimestamp="2026-06-03 01:15:28 +0000 UTC" firstStartedPulling="2026-06-03 01:15:28.781665473 +0000 UTC m=+651.928507396" lastFinishedPulling="2026-06-03 01:15:29.078586249 +0000 UTC m=+652.225428178" observedRunningTime="2026-06-03 01:15:29.305894199 +0000 UTC m=+652.452736146" watchObservedRunningTime="2026-06-03 01:15:29.309895758 +0000 UTC m=+652.456737703" Jun 03 01:15:29.593715 ip-10-0-138-55 kubenswrapper[2566]: I0603 01:15:29.593672 2566 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="851cb6cf-116a-44de-af6f-8b275eb8f0af" path="/var/lib/kubelet/pods/851cb6cf-116a-44de-af6f-8b275eb8f0af/volumes" Jun 03 01:15:29.645722 ip-10-0-138-55 kubenswrapper[2566]: I0603 01:15:29.645673 2566 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="keycloak-system/maas-keycloak-0" Jun 03 01:15:29.647265 ip-10-0-138-55 kubenswrapper[2566]: I0603 01:15:29.647200 2566 prober.go:120] "Probe failed" probeType="Startup" pod="keycloak-system/maas-keycloak-0" podUID="b0ca1223-8c0f-4e98-88aa-9ec4d6572405" containerName="keycloak" probeResult="failure" output="Get \"http://10.134.0.61:9000/health/started\": dial tcp 10.134.0.61:9000: connect: connection refused" Jun 03 01:15:30.646309 ip-10-0-138-55 kubenswrapper[2566]: I0603 01:15:30.646260 2566 prober.go:120] "Probe failed" probeType="Startup" pod="keycloak-system/maas-keycloak-0" podUID="b0ca1223-8c0f-4e98-88aa-9ec4d6572405" containerName="keycloak" probeResult="failure" output="Get \"http://10.134.0.61:9000/health/started\": dial tcp 10.134.0.61:9000: connect: connection refused" Jun 03 01:15:31.645357 ip-10-0-138-55 kubenswrapper[2566]: I0603 01:15:31.645307 2566 prober.go:120] "Probe failed" probeType="Startup" pod="keycloak-system/maas-keycloak-0" podUID="b0ca1223-8c0f-4e98-88aa-9ec4d6572405" containerName="keycloak" probeResult="failure" output="Get \"http://10.134.0.61:9000/health/started\": dial tcp 10.134.0.61:9000: connect: connection refused" Jun 03 01:15:32.645443 ip-10-0-138-55 kubenswrapper[2566]: I0603 01:15:32.645392 2566 prober.go:120] "Probe failed" probeType="Startup" pod="keycloak-system/maas-keycloak-0" podUID="b0ca1223-8c0f-4e98-88aa-9ec4d6572405" containerName="keycloak" probeResult="failure" output="Get \"http://10.134.0.61:9000/health/started\": dial tcp 10.134.0.61:9000: connect: connection refused" Jun 03 01:15:33.646419 ip-10-0-138-55 kubenswrapper[2566]: I0603 01:15:33.646362 2566 prober.go:120] "Probe failed" probeType="Startup" pod="keycloak-system/maas-keycloak-0" podUID="b0ca1223-8c0f-4e98-88aa-9ec4d6572405" containerName="keycloak" probeResult="failure" output="Get \"http://10.134.0.61:9000/health/started\": dial tcp 10.134.0.61:9000: connect: connection refused" Jun 03 01:15:34.645784 ip-10-0-138-55 kubenswrapper[2566]: I0603 01:15:34.645726 2566 prober.go:120] "Probe failed" probeType="Startup" pod="keycloak-system/maas-keycloak-0" podUID="b0ca1223-8c0f-4e98-88aa-9ec4d6572405" containerName="keycloak" probeResult="failure" output="Get \"http://10.134.0.61:9000/health/started\": dial tcp 10.134.0.61:9000: connect: connection refused" Jun 03 01:15:35.646331 ip-10-0-138-55 kubenswrapper[2566]: I0603 01:15:35.646275 2566 prober.go:120] "Probe failed" probeType="Startup" pod="keycloak-system/maas-keycloak-0" podUID="b0ca1223-8c0f-4e98-88aa-9ec4d6572405" containerName="keycloak" probeResult="failure" output="Get \"http://10.134.0.61:9000/health/started\": dial tcp 10.134.0.61:9000: connect: connection refused" Jun 03 01:15:36.645739 ip-10-0-138-55 kubenswrapper[2566]: I0603 01:15:36.645686 2566 prober.go:120] "Probe failed" probeType="Startup" pod="keycloak-system/maas-keycloak-0" podUID="b0ca1223-8c0f-4e98-88aa-9ec4d6572405" containerName="keycloak" probeResult="failure" output="Get \"http://10.134.0.61:9000/health/started\": dial tcp 10.134.0.61:9000: connect: connection refused" Jun 03 01:15:37.645813 ip-10-0-138-55 kubenswrapper[2566]: I0603 01:15:37.645594 2566 prober.go:120] "Probe failed" probeType="Startup" pod="keycloak-system/maas-keycloak-0" podUID="b0ca1223-8c0f-4e98-88aa-9ec4d6572405" containerName="keycloak" probeResult="failure" output="Get \"http://10.134.0.61:9000/health/started\": dial tcp 10.134.0.61:9000: connect: connection refused" Jun 03 01:15:38.645198 ip-10-0-138-55 kubenswrapper[2566]: I0603 01:15:38.645156 2566 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="keycloak-system/maas-keycloak-0" Jun 03 01:15:38.645516 ip-10-0-138-55 kubenswrapper[2566]: I0603 01:15:38.645479 2566 prober.go:120] "Probe failed" probeType="Startup" pod="keycloak-system/maas-keycloak-0" podUID="b0ca1223-8c0f-4e98-88aa-9ec4d6572405" containerName="keycloak" probeResult="failure" output="Get \"http://10.134.0.61:9000/health/started\": dial tcp 10.134.0.61:9000: connect: connection refused" Jun 03 01:15:39.645454 ip-10-0-138-55 kubenswrapper[2566]: I0603 01:15:39.645395 2566 prober.go:120] "Probe failed" probeType="Startup" pod="keycloak-system/maas-keycloak-0" podUID="b0ca1223-8c0f-4e98-88aa-9ec4d6572405" containerName="keycloak" probeResult="failure" output="Get \"http://10.134.0.61:9000/health/started\": dial tcp 10.134.0.61:9000: connect: connection refused" Jun 03 01:15:40.645633 ip-10-0-138-55 kubenswrapper[2566]: I0603 01:15:40.645584 2566 prober.go:120] "Probe failed" probeType="Startup" pod="keycloak-system/maas-keycloak-0" podUID="b0ca1223-8c0f-4e98-88aa-9ec4d6572405" containerName="keycloak" probeResult="failure" output="Get \"http://10.134.0.61:9000/health/started\": dial tcp 10.134.0.61:9000: connect: connection refused" Jun 03 01:15:41.646199 ip-10-0-138-55 kubenswrapper[2566]: I0603 01:15:41.646153 2566 prober.go:120] "Probe failed" probeType="Startup" pod="keycloak-system/maas-keycloak-0" podUID="b0ca1223-8c0f-4e98-88aa-9ec4d6572405" containerName="keycloak" probeResult="failure" output="Get \"http://10.134.0.61:9000/health/started\": dial tcp 10.134.0.61:9000: connect: connection refused" Jun 03 01:15:42.752016 ip-10-0-138-55 kubenswrapper[2566]: I0603 01:15:42.751977 2566 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="started" pod="keycloak-system/maas-keycloak-0" Jun 03 01:15:42.771486 ip-10-0-138-55 kubenswrapper[2566]: I0603 01:15:42.771427 2566 prober.go:120] "Probe failed" probeType="Readiness" pod="keycloak-system/maas-keycloak-0" podUID="b0ca1223-8c0f-4e98-88aa-9ec4d6572405" containerName="keycloak" probeResult="failure" output="HTTP probe failed with statuscode: 503" Jun 03 01:15:52.758790 ip-10-0-138-55 kubenswrapper[2566]: I0603 01:15:52.758749 2566 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="keycloak-system/maas-keycloak-0" Jun 03 01:16:17.944065 ip-10-0-138-55 kubenswrapper[2566]: I0603 01:16:17.944032 2566 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["llm/e2e-distinct-2-simulated-kserve-8595bdc8d4-z259h"] Jun 03 01:16:17.948003 ip-10-0-138-55 kubenswrapper[2566]: I0603 01:16:17.947986 2566 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-distinct-2-simulated-kserve-8595bdc8d4-z259h" Jun 03 01:16:17.950084 ip-10-0-138-55 kubenswrapper[2566]: I0603 01:16:17.950063 2566 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"llm\"/\"openshift-service-ca.crt\"" Jun 03 01:16:17.950572 ip-10-0-138-55 kubenswrapper[2566]: I0603 01:16:17.950552 2566 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"e2e-distinct-2-simulated-kserve-self-signed-certs\"" Jun 03 01:16:17.950667 ip-10-0-138-55 kubenswrapper[2566]: I0603 01:16:17.950577 2566 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"default-dockercfg-wwwg7\"" Jun 03 01:16:17.950667 ip-10-0-138-55 kubenswrapper[2566]: I0603 01:16:17.950577 2566 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"llm\"/\"kube-root-ca.crt\"" Jun 03 01:16:17.957622 ip-10-0-138-55 kubenswrapper[2566]: I0603 01:16:17.957601 2566 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["llm/e2e-distinct-2-simulated-kserve-8595bdc8d4-z259h"] Jun 03 01:16:18.064684 ip-10-0-138-55 kubenswrapper[2566]: I0603 01:16:18.064650 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/69a77c2e-b9fb-4226-8013-4ec97f8e3bd1-dshm\") pod \"e2e-distinct-2-simulated-kserve-8595bdc8d4-z259h\" (UID: \"69a77c2e-b9fb-4226-8013-4ec97f8e3bd1\") " pod="llm/e2e-distinct-2-simulated-kserve-8595bdc8d4-z259h" Jun 03 01:16:18.064839 ip-10-0-138-55 kubenswrapper[2566]: I0603 01:16:18.064701 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/69a77c2e-b9fb-4226-8013-4ec97f8e3bd1-tls-certs\") pod \"e2e-distinct-2-simulated-kserve-8595bdc8d4-z259h\" (UID: \"69a77c2e-b9fb-4226-8013-4ec97f8e3bd1\") " pod="llm/e2e-distinct-2-simulated-kserve-8595bdc8d4-z259h" Jun 03 01:16:18.064839 ip-10-0-138-55 kubenswrapper[2566]: I0603 01:16:18.064766 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/69a77c2e-b9fb-4226-8013-4ec97f8e3bd1-home\") pod \"e2e-distinct-2-simulated-kserve-8595bdc8d4-z259h\" (UID: \"69a77c2e-b9fb-4226-8013-4ec97f8e3bd1\") " pod="llm/e2e-distinct-2-simulated-kserve-8595bdc8d4-z259h" Jun 03 01:16:18.064919 ip-10-0-138-55 kubenswrapper[2566]: I0603 01:16:18.064841 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-g45jf\" (UniqueName: \"kubernetes.io/projected/69a77c2e-b9fb-4226-8013-4ec97f8e3bd1-kube-api-access-g45jf\") pod \"e2e-distinct-2-simulated-kserve-8595bdc8d4-z259h\" (UID: \"69a77c2e-b9fb-4226-8013-4ec97f8e3bd1\") " pod="llm/e2e-distinct-2-simulated-kserve-8595bdc8d4-z259h" Jun 03 01:16:18.064919 ip-10-0-138-55 kubenswrapper[2566]: I0603 01:16:18.064860 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/69a77c2e-b9fb-4226-8013-4ec97f8e3bd1-model-cache\") pod \"e2e-distinct-2-simulated-kserve-8595bdc8d4-z259h\" (UID: \"69a77c2e-b9fb-4226-8013-4ec97f8e3bd1\") " pod="llm/e2e-distinct-2-simulated-kserve-8595bdc8d4-z259h" Jun 03 01:16:18.064919 ip-10-0-138-55 kubenswrapper[2566]: I0603 01:16:18.064879 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kserve-provision-location\" (UniqueName: \"kubernetes.io/empty-dir/69a77c2e-b9fb-4226-8013-4ec97f8e3bd1-kserve-provision-location\") pod \"e2e-distinct-2-simulated-kserve-8595bdc8d4-z259h\" (UID: \"69a77c2e-b9fb-4226-8013-4ec97f8e3bd1\") " pod="llm/e2e-distinct-2-simulated-kserve-8595bdc8d4-z259h" Jun 03 01:16:18.165656 ip-10-0-138-55 kubenswrapper[2566]: I0603 01:16:18.165617 2566 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/69a77c2e-b9fb-4226-8013-4ec97f8e3bd1-tls-certs\") pod \"e2e-distinct-2-simulated-kserve-8595bdc8d4-z259h\" (UID: \"69a77c2e-b9fb-4226-8013-4ec97f8e3bd1\") " pod="llm/e2e-distinct-2-simulated-kserve-8595bdc8d4-z259h" Jun 03 01:16:18.165656 ip-10-0-138-55 kubenswrapper[2566]: I0603 01:16:18.165656 2566 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/69a77c2e-b9fb-4226-8013-4ec97f8e3bd1-home\") pod \"e2e-distinct-2-simulated-kserve-8595bdc8d4-z259h\" (UID: \"69a77c2e-b9fb-4226-8013-4ec97f8e3bd1\") " pod="llm/e2e-distinct-2-simulated-kserve-8595bdc8d4-z259h" Jun 03 01:16:18.165954 ip-10-0-138-55 kubenswrapper[2566]: I0603 01:16:18.165702 2566 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-g45jf\" (UniqueName: \"kubernetes.io/projected/69a77c2e-b9fb-4226-8013-4ec97f8e3bd1-kube-api-access-g45jf\") pod \"e2e-distinct-2-simulated-kserve-8595bdc8d4-z259h\" (UID: \"69a77c2e-b9fb-4226-8013-4ec97f8e3bd1\") " pod="llm/e2e-distinct-2-simulated-kserve-8595bdc8d4-z259h" Jun 03 01:16:18.165954 ip-10-0-138-55 kubenswrapper[2566]: I0603 01:16:18.165722 2566 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/69a77c2e-b9fb-4226-8013-4ec97f8e3bd1-model-cache\") pod \"e2e-distinct-2-simulated-kserve-8595bdc8d4-z259h\" (UID: \"69a77c2e-b9fb-4226-8013-4ec97f8e3bd1\") " pod="llm/e2e-distinct-2-simulated-kserve-8595bdc8d4-z259h" Jun 03 01:16:18.165954 ip-10-0-138-55 kubenswrapper[2566]: I0603 01:16:18.165740 2566 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kserve-provision-location\" (UniqueName: \"kubernetes.io/empty-dir/69a77c2e-b9fb-4226-8013-4ec97f8e3bd1-kserve-provision-location\") pod \"e2e-distinct-2-simulated-kserve-8595bdc8d4-z259h\" (UID: \"69a77c2e-b9fb-4226-8013-4ec97f8e3bd1\") " pod="llm/e2e-distinct-2-simulated-kserve-8595bdc8d4-z259h" Jun 03 01:16:18.165954 ip-10-0-138-55 kubenswrapper[2566]: I0603 01:16:18.165794 2566 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/69a77c2e-b9fb-4226-8013-4ec97f8e3bd1-dshm\") pod \"e2e-distinct-2-simulated-kserve-8595bdc8d4-z259h\" (UID: \"69a77c2e-b9fb-4226-8013-4ec97f8e3bd1\") " pod="llm/e2e-distinct-2-simulated-kserve-8595bdc8d4-z259h" Jun 03 01:16:18.166287 ip-10-0-138-55 kubenswrapper[2566]: I0603 01:16:18.166260 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/69a77c2e-b9fb-4226-8013-4ec97f8e3bd1-home\") pod \"e2e-distinct-2-simulated-kserve-8595bdc8d4-z259h\" (UID: \"69a77c2e-b9fb-4226-8013-4ec97f8e3bd1\") " pod="llm/e2e-distinct-2-simulated-kserve-8595bdc8d4-z259h" Jun 03 01:16:18.166385 ip-10-0-138-55 kubenswrapper[2566]: I0603 01:16:18.166293 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/69a77c2e-b9fb-4226-8013-4ec97f8e3bd1-model-cache\") pod \"e2e-distinct-2-simulated-kserve-8595bdc8d4-z259h\" (UID: \"69a77c2e-b9fb-4226-8013-4ec97f8e3bd1\") " pod="llm/e2e-distinct-2-simulated-kserve-8595bdc8d4-z259h" Jun 03 01:16:18.166469 ip-10-0-138-55 kubenswrapper[2566]: I0603 01:16:18.166447 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kserve-provision-location\" (UniqueName: \"kubernetes.io/empty-dir/69a77c2e-b9fb-4226-8013-4ec97f8e3bd1-kserve-provision-location\") pod \"e2e-distinct-2-simulated-kserve-8595bdc8d4-z259h\" (UID: \"69a77c2e-b9fb-4226-8013-4ec97f8e3bd1\") " pod="llm/e2e-distinct-2-simulated-kserve-8595bdc8d4-z259h" Jun 03 01:16:18.168016 ip-10-0-138-55 kubenswrapper[2566]: I0603 01:16:18.167975 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/69a77c2e-b9fb-4226-8013-4ec97f8e3bd1-dshm\") pod \"e2e-distinct-2-simulated-kserve-8595bdc8d4-z259h\" (UID: \"69a77c2e-b9fb-4226-8013-4ec97f8e3bd1\") " pod="llm/e2e-distinct-2-simulated-kserve-8595bdc8d4-z259h" Jun 03 01:16:18.168122 ip-10-0-138-55 kubenswrapper[2566]: I0603 01:16:18.168102 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/69a77c2e-b9fb-4226-8013-4ec97f8e3bd1-tls-certs\") pod \"e2e-distinct-2-simulated-kserve-8595bdc8d4-z259h\" (UID: \"69a77c2e-b9fb-4226-8013-4ec97f8e3bd1\") " pod="llm/e2e-distinct-2-simulated-kserve-8595bdc8d4-z259h" Jun 03 01:16:18.172663 ip-10-0-138-55 kubenswrapper[2566]: I0603 01:16:18.172641 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-g45jf\" (UniqueName: \"kubernetes.io/projected/69a77c2e-b9fb-4226-8013-4ec97f8e3bd1-kube-api-access-g45jf\") pod \"e2e-distinct-2-simulated-kserve-8595bdc8d4-z259h\" (UID: \"69a77c2e-b9fb-4226-8013-4ec97f8e3bd1\") " pod="llm/e2e-distinct-2-simulated-kserve-8595bdc8d4-z259h" Jun 03 01:16:18.258771 ip-10-0-138-55 kubenswrapper[2566]: I0603 01:16:18.258679 2566 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-distinct-2-simulated-kserve-8595bdc8d4-z259h" Jun 03 01:16:18.400044 ip-10-0-138-55 kubenswrapper[2566]: I0603 01:16:18.400018 2566 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["llm/e2e-distinct-2-simulated-kserve-8595bdc8d4-z259h"] Jun 03 01:16:18.401415 ip-10-0-138-55 kubenswrapper[2566]: W0603 01:16:18.401389 2566 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod69a77c2e_b9fb_4226_8013_4ec97f8e3bd1.slice/crio-a54f61cc955da48a5d170c2e10e5122d28575a45bbe61652b201ec4c2beba277 WatchSource:0}: Error finding container a54f61cc955da48a5d170c2e10e5122d28575a45bbe61652b201ec4c2beba277: Status 404 returned error can't find the container with id a54f61cc955da48a5d170c2e10e5122d28575a45bbe61652b201ec4c2beba277 Jun 03 01:16:18.528490 ip-10-0-138-55 kubenswrapper[2566]: I0603 01:16:18.528402 2566 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="llm/e2e-distinct-2-simulated-kserve-8595bdc8d4-z259h" event={"ID":"69a77c2e-b9fb-4226-8013-4ec97f8e3bd1","Type":"ContainerStarted","Data":"a54f61cc955da48a5d170c2e10e5122d28575a45bbe61652b201ec4c2beba277"} Jun 03 01:16:23.554923 ip-10-0-138-55 kubenswrapper[2566]: I0603 01:16:23.554886 2566 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="llm/e2e-distinct-2-simulated-kserve-8595bdc8d4-z259h" event={"ID":"69a77c2e-b9fb-4226-8013-4ec97f8e3bd1","Type":"ContainerStarted","Data":"7877938dfb23eb397e53c89f7dd58c0b7ad240b488fc919daf9e64ce7ff5a465"} Jun 03 01:16:24.561629 ip-10-0-138-55 kubenswrapper[2566]: I0603 01:16:24.561595 2566 generic.go:358] "Generic (PLEG): container finished" podID="69a77c2e-b9fb-4226-8013-4ec97f8e3bd1" containerID="7877938dfb23eb397e53c89f7dd58c0b7ad240b488fc919daf9e64ce7ff5a465" exitCode=0 Jun 03 01:16:24.562010 ip-10-0-138-55 kubenswrapper[2566]: I0603 01:16:24.561671 2566 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="llm/e2e-distinct-2-simulated-kserve-8595bdc8d4-z259h" event={"ID":"69a77c2e-b9fb-4226-8013-4ec97f8e3bd1","Type":"ContainerDied","Data":"7877938dfb23eb397e53c89f7dd58c0b7ad240b488fc919daf9e64ce7ff5a465"} Jun 03 01:16:26.573105 ip-10-0-138-55 kubenswrapper[2566]: I0603 01:16:26.573050 2566 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="llm/e2e-distinct-2-simulated-kserve-8595bdc8d4-z259h" event={"ID":"69a77c2e-b9fb-4226-8013-4ec97f8e3bd1","Type":"ContainerStarted","Data":"6b74f78d9f4344122544baf110817b3676a2be16a491d895b0b0de48726b37b6"} Jun 03 01:16:26.592502 ip-10-0-138-55 kubenswrapper[2566]: I0603 01:16:26.592457 2566 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="llm/e2e-distinct-2-simulated-kserve-8595bdc8d4-z259h" podStartSLOduration=2.322651893 podStartE2EDuration="9.592442876s" podCreationTimestamp="2026-06-03 01:16:17 +0000 UTC" firstStartedPulling="2026-06-03 01:16:18.403090078 +0000 UTC m=+701.549932002" lastFinishedPulling="2026-06-03 01:16:25.672881058 +0000 UTC m=+708.819722985" observedRunningTime="2026-06-03 01:16:26.588742308 +0000 UTC m=+709.735584253" watchObservedRunningTime="2026-06-03 01:16:26.592442876 +0000 UTC m=+709.739284821" Jun 03 01:16:28.258962 ip-10-0-138-55 kubenswrapper[2566]: I0603 01:16:28.258919 2566 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="llm/e2e-distinct-2-simulated-kserve-8595bdc8d4-z259h" Jun 03 01:16:28.258962 ip-10-0-138-55 kubenswrapper[2566]: I0603 01:16:28.258970 2566 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="llm/e2e-distinct-2-simulated-kserve-8595bdc8d4-z259h" Jun 03 01:16:28.271582 ip-10-0-138-55 kubenswrapper[2566]: I0603 01:16:28.271558 2566 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="started" pod="llm/e2e-distinct-2-simulated-kserve-8595bdc8d4-z259h" Jun 03 01:16:28.592403 ip-10-0-138-55 kubenswrapper[2566]: I0603 01:16:28.592321 2566 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="llm/e2e-distinct-2-simulated-kserve-8595bdc8d4-z259h" Jun 03 01:16:39.442413 ip-10-0-138-55 kubenswrapper[2566]: I0603 01:16:39.442378 2566 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-bdd7f97q9kg"] Jun 03 01:16:39.462100 ip-10-0-138-55 kubenswrapper[2566]: I0603 01:16:39.462068 2566 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-bdd7f97q9kg"] Jun 03 01:16:39.462268 ip-10-0-138-55 kubenswrapper[2566]: I0603 01:16:39.462205 2566 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-bdd7f97q9kg" Jun 03 01:16:39.464333 ip-10-0-138-55 kubenswrapper[2566]: I0603 01:16:39.464309 2566 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"e2e-unab60ef4d3a239b5143b412cab04acac3-kserve-self-signed-certs\"" Jun 03 01:16:39.580731 ip-10-0-138-55 kubenswrapper[2566]: I0603 01:16:39.580696 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/681dd519-3adb-438b-a3c7-825e916688f4-home\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-bdd7f97q9kg\" (UID: \"681dd519-3adb-438b-a3c7-825e916688f4\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-bdd7f97q9kg" Jun 03 01:16:39.580925 ip-10-0-138-55 kubenswrapper[2566]: I0603 01:16:39.580740 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/681dd519-3adb-438b-a3c7-825e916688f4-dshm\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-bdd7f97q9kg\" (UID: \"681dd519-3adb-438b-a3c7-825e916688f4\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-bdd7f97q9kg" Jun 03 01:16:39.580925 ip-10-0-138-55 kubenswrapper[2566]: I0603 01:16:39.580779 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/681dd519-3adb-438b-a3c7-825e916688f4-tls-certs\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-bdd7f97q9kg\" (UID: \"681dd519-3adb-438b-a3c7-825e916688f4\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-bdd7f97q9kg" Jun 03 01:16:39.580925 ip-10-0-138-55 kubenswrapper[2566]: I0603 01:16:39.580841 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/681dd519-3adb-438b-a3c7-825e916688f4-model-cache\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-bdd7f97q9kg\" (UID: \"681dd519-3adb-438b-a3c7-825e916688f4\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-bdd7f97q9kg" Jun 03 01:16:39.580925 ip-10-0-138-55 kubenswrapper[2566]: I0603 01:16:39.580884 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-t9gz2\" (UniqueName: \"kubernetes.io/projected/681dd519-3adb-438b-a3c7-825e916688f4-kube-api-access-t9gz2\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-bdd7f97q9kg\" (UID: \"681dd519-3adb-438b-a3c7-825e916688f4\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-bdd7f97q9kg" Jun 03 01:16:39.581161 ip-10-0-138-55 kubenswrapper[2566]: I0603 01:16:39.580974 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kserve-provision-location\" (UniqueName: \"kubernetes.io/empty-dir/681dd519-3adb-438b-a3c7-825e916688f4-kserve-provision-location\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-bdd7f97q9kg\" (UID: \"681dd519-3adb-438b-a3c7-825e916688f4\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-bdd7f97q9kg" Jun 03 01:16:39.681651 ip-10-0-138-55 kubenswrapper[2566]: I0603 01:16:39.681616 2566 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/681dd519-3adb-438b-a3c7-825e916688f4-home\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-bdd7f97q9kg\" (UID: \"681dd519-3adb-438b-a3c7-825e916688f4\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-bdd7f97q9kg" Jun 03 01:16:39.681858 ip-10-0-138-55 kubenswrapper[2566]: I0603 01:16:39.681663 2566 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/681dd519-3adb-438b-a3c7-825e916688f4-dshm\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-bdd7f97q9kg\" (UID: \"681dd519-3adb-438b-a3c7-825e916688f4\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-bdd7f97q9kg" Jun 03 01:16:39.681858 ip-10-0-138-55 kubenswrapper[2566]: I0603 01:16:39.681694 2566 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/681dd519-3adb-438b-a3c7-825e916688f4-tls-certs\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-bdd7f97q9kg\" (UID: \"681dd519-3adb-438b-a3c7-825e916688f4\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-bdd7f97q9kg" Jun 03 01:16:39.681858 ip-10-0-138-55 kubenswrapper[2566]: I0603 01:16:39.681717 2566 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/681dd519-3adb-438b-a3c7-825e916688f4-model-cache\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-bdd7f97q9kg\" (UID: \"681dd519-3adb-438b-a3c7-825e916688f4\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-bdd7f97q9kg" Jun 03 01:16:39.681858 ip-10-0-138-55 kubenswrapper[2566]: I0603 01:16:39.681743 2566 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-t9gz2\" (UniqueName: \"kubernetes.io/projected/681dd519-3adb-438b-a3c7-825e916688f4-kube-api-access-t9gz2\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-bdd7f97q9kg\" (UID: \"681dd519-3adb-438b-a3c7-825e916688f4\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-bdd7f97q9kg" Jun 03 01:16:39.681858 ip-10-0-138-55 kubenswrapper[2566]: I0603 01:16:39.681811 2566 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kserve-provision-location\" (UniqueName: \"kubernetes.io/empty-dir/681dd519-3adb-438b-a3c7-825e916688f4-kserve-provision-location\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-bdd7f97q9kg\" (UID: \"681dd519-3adb-438b-a3c7-825e916688f4\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-bdd7f97q9kg" Jun 03 01:16:39.682125 ip-10-0-138-55 kubenswrapper[2566]: I0603 01:16:39.682053 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/681dd519-3adb-438b-a3c7-825e916688f4-home\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-bdd7f97q9kg\" (UID: \"681dd519-3adb-438b-a3c7-825e916688f4\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-bdd7f97q9kg" Jun 03 01:16:39.682166 ip-10-0-138-55 kubenswrapper[2566]: I0603 01:16:39.682145 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/681dd519-3adb-438b-a3c7-825e916688f4-model-cache\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-bdd7f97q9kg\" (UID: \"681dd519-3adb-438b-a3c7-825e916688f4\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-bdd7f97q9kg" Jun 03 01:16:39.682283 ip-10-0-138-55 kubenswrapper[2566]: I0603 01:16:39.682263 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kserve-provision-location\" (UniqueName: \"kubernetes.io/empty-dir/681dd519-3adb-438b-a3c7-825e916688f4-kserve-provision-location\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-bdd7f97q9kg\" (UID: \"681dd519-3adb-438b-a3c7-825e916688f4\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-bdd7f97q9kg" Jun 03 01:16:39.683989 ip-10-0-138-55 kubenswrapper[2566]: I0603 01:16:39.683967 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/681dd519-3adb-438b-a3c7-825e916688f4-dshm\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-bdd7f97q9kg\" (UID: \"681dd519-3adb-438b-a3c7-825e916688f4\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-bdd7f97q9kg" Jun 03 01:16:39.684154 ip-10-0-138-55 kubenswrapper[2566]: I0603 01:16:39.684135 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/681dd519-3adb-438b-a3c7-825e916688f4-tls-certs\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-bdd7f97q9kg\" (UID: \"681dd519-3adb-438b-a3c7-825e916688f4\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-bdd7f97q9kg" Jun 03 01:16:39.689661 ip-10-0-138-55 kubenswrapper[2566]: I0603 01:16:39.689637 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-t9gz2\" (UniqueName: \"kubernetes.io/projected/681dd519-3adb-438b-a3c7-825e916688f4-kube-api-access-t9gz2\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-bdd7f97q9kg\" (UID: \"681dd519-3adb-438b-a3c7-825e916688f4\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-bdd7f97q9kg" Jun 03 01:16:39.774296 ip-10-0-138-55 kubenswrapper[2566]: I0603 01:16:39.774180 2566 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-bdd7f97q9kg" Jun 03 01:16:39.911010 ip-10-0-138-55 kubenswrapper[2566]: I0603 01:16:39.910982 2566 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-bdd7f97q9kg"] Jun 03 01:16:39.913168 ip-10-0-138-55 kubenswrapper[2566]: W0603 01:16:39.913142 2566 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod681dd519_3adb_438b_a3c7_825e916688f4.slice/crio-f80c58b92ba17a24b07e682c38b3fe6161275fd602ec6ef11e3e89f591ceed5f WatchSource:0}: Error finding container f80c58b92ba17a24b07e682c38b3fe6161275fd602ec6ef11e3e89f591ceed5f: Status 404 returned error can't find the container with id f80c58b92ba17a24b07e682c38b3fe6161275fd602ec6ef11e3e89f591ceed5f Jun 03 01:16:40.632417 ip-10-0-138-55 kubenswrapper[2566]: I0603 01:16:40.632381 2566 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-bdd7f97q9kg" event={"ID":"681dd519-3adb-438b-a3c7-825e916688f4","Type":"ContainerStarted","Data":"1430903bd77d39d5dbafdb01875bd59d7185f60fc8022819019741a7f199ddb2"} Jun 03 01:16:40.632417 ip-10-0-138-55 kubenswrapper[2566]: I0603 01:16:40.632420 2566 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-bdd7f97q9kg" event={"ID":"681dd519-3adb-438b-a3c7-825e916688f4","Type":"ContainerStarted","Data":"f80c58b92ba17a24b07e682c38b3fe6161275fd602ec6ef11e3e89f591ceed5f"} Jun 03 01:16:41.637560 ip-10-0-138-55 kubenswrapper[2566]: I0603 01:16:41.637524 2566 generic.go:358] "Generic (PLEG): container finished" podID="681dd519-3adb-438b-a3c7-825e916688f4" containerID="1430903bd77d39d5dbafdb01875bd59d7185f60fc8022819019741a7f199ddb2" exitCode=0 Jun 03 01:16:41.638015 ip-10-0-138-55 kubenswrapper[2566]: I0603 01:16:41.637568 2566 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-bdd7f97q9kg" event={"ID":"681dd519-3adb-438b-a3c7-825e916688f4","Type":"ContainerDied","Data":"1430903bd77d39d5dbafdb01875bd59d7185f60fc8022819019741a7f199ddb2"} Jun 03 01:16:42.645444 ip-10-0-138-55 kubenswrapper[2566]: I0603 01:16:42.645407 2566 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-bdd7f97q9kg" event={"ID":"681dd519-3adb-438b-a3c7-825e916688f4","Type":"ContainerStarted","Data":"287140e5f40c647c5dab4df891f0602932b1e26bbce5f2b1a9f0b36fde1130b0"} Jun 03 01:16:42.663991 ip-10-0-138-55 kubenswrapper[2566]: I0603 01:16:42.663929 2566 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-bdd7f97q9kg" podStartSLOduration=3.464024084 podStartE2EDuration="3.663909051s" podCreationTimestamp="2026-06-03 01:16:39 +0000 UTC" firstStartedPulling="2026-06-03 01:16:41.6381404 +0000 UTC m=+724.784982325" lastFinishedPulling="2026-06-03 01:16:41.838025368 +0000 UTC m=+724.984867292" observedRunningTime="2026-06-03 01:16:42.661550356 +0000 UTC m=+725.808392302" watchObservedRunningTime="2026-06-03 01:16:42.663909051 +0000 UTC m=+725.810750998" Jun 03 01:16:49.775073 ip-10-0-138-55 kubenswrapper[2566]: I0603 01:16:49.775031 2566 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-bdd7f97q9kg" Jun 03 01:16:49.775073 ip-10-0-138-55 kubenswrapper[2566]: I0603 01:16:49.775073 2566 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-bdd7f97q9kg" Jun 03 01:16:49.787819 ip-10-0-138-55 kubenswrapper[2566]: I0603 01:16:49.787791 2566 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="started" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-bdd7f97q9kg" Jun 03 01:16:50.693068 ip-10-0-138-55 kubenswrapper[2566]: I0603 01:16:50.693038 2566 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-bdd7f97q9kg" Jun 03 01:19:37.679312 ip-10-0-138-55 kubenswrapper[2566]: I0603 01:19:37.679185 2566 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-86d7c6cc77-8nd2x_5776439a-7cdc-49da-a5f6-325eb0c8ab99/console-operator/1.log" Jun 03 01:19:37.684391 ip-10-0-138-55 kubenswrapper[2566]: I0603 01:19:37.683307 2566 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-86d7c6cc77-8nd2x_5776439a-7cdc-49da-a5f6-325eb0c8ab99/console-operator/1.log" Jun 03 01:22:54.490901 ip-10-0-138-55 kubenswrapper[2566]: I0603 01:22:54.490870 2566 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_dashboard-redirect-86cc4fb5f5-fkwsp_6cc062c0-40a4-4d87-b1b0-c534e382d518/nginx/0.log" Jun 03 01:22:54.950103 ip-10-0-138-55 kubenswrapper[2566]: I0603 01:22:54.950067 2566 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_maas-api-7986767586-jvsst_8ddf70ce-359b-4d17-947f-f39153e7824f/maas-api/0.log" Jun 03 01:22:55.068522 ip-10-0-138-55 kubenswrapper[2566]: I0603 01:22:55.068493 2566 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_maas-controller-76cbd784d6-rsjhd_f58fbdda-eabd-4aab-9e64-0e8bb850d2c3/manager/0.log" Jun 03 01:22:55.300981 ip-10-0-138-55 kubenswrapper[2566]: I0603 01:22:55.300897 2566 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_odh-model-controller-76588b95-dhfrn_994f0858-424c-4dff-b6b6-974c5d51c82e/manager/0.log" Jun 03 01:22:55.416061 ip-10-0-138-55 kubenswrapper[2566]: I0603 01:22:55.416032 2566 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-85b884ccf6-6j2kc_991aaba9-8623-4501-9e50-c19d4d89c7d1/copy-manifests/0.log" Jun 03 01:22:55.437178 ip-10-0-138-55 kubenswrapper[2566]: I0603 01:22:55.437122 2566 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-85b884ccf6-6j2kc_991aaba9-8623-4501-9e50-c19d4d89c7d1/manager/0.log" Jun 03 01:22:55.778509 ip-10-0-138-55 kubenswrapper[2566]: I0603 01:22:55.778472 2566 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_postgres-68c4fbbd6f-7dcqx_4f761a76-7bad-4c17-bfd8-45dd143de9c1/postgres/0.log" Jun 03 01:22:56.577510 ip-10-0-138-55 kubenswrapper[2566]: I0603 01:22:56.577476 2566 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759vg6nh_d04b4880-a9b8-4143-bbe6-68dd52416e9c/util/0.log" Jun 03 01:22:56.583574 ip-10-0-138-55 kubenswrapper[2566]: I0603 01:22:56.583545 2566 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759vg6nh_d04b4880-a9b8-4143-bbe6-68dd52416e9c/pull/0.log" Jun 03 01:22:56.590351 ip-10-0-138-55 kubenswrapper[2566]: I0603 01:22:56.590321 2566 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759vg6nh_d04b4880-a9b8-4143-bbe6-68dd52416e9c/extract/0.log" Jun 03 01:22:56.705087 ip-10-0-138-55 kubenswrapper[2566]: I0603 01:22:56.705046 2566 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0rjwj4_05cdd465-123d-4ae4-8a24-fe0679cd2dcf/pull/0.log" Jun 03 01:22:56.713847 ip-10-0-138-55 kubenswrapper[2566]: I0603 01:22:56.713821 2566 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0rjwj4_05cdd465-123d-4ae4-8a24-fe0679cd2dcf/extract/0.log" Jun 03 01:22:56.720720 ip-10-0-138-55 kubenswrapper[2566]: I0603 01:22:56.720699 2566 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0rjwj4_05cdd465-123d-4ae4-8a24-fe0679cd2dcf/util/0.log" Jun 03 01:22:56.835481 ip-10-0-138-55 kubenswrapper[2566]: I0603 01:22:56.835393 2566 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73xr8xr_eedc5d49-5a31-4c4f-9b41-08d311ea09de/util/0.log" Jun 03 01:22:56.842100 ip-10-0-138-55 kubenswrapper[2566]: I0603 01:22:56.842074 2566 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73xr8xr_eedc5d49-5a31-4c4f-9b41-08d311ea09de/pull/0.log" Jun 03 01:22:56.849754 ip-10-0-138-55 kubenswrapper[2566]: I0603 01:22:56.849733 2566 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73xr8xr_eedc5d49-5a31-4c4f-9b41-08d311ea09de/extract/0.log" Jun 03 01:22:56.973914 ip-10-0-138-55 kubenswrapper[2566]: I0603 01:22:56.973877 2566 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1ffkt4_51b4334f-89ac-4ec8-9e08-44748b1c05d0/util/0.log" Jun 03 01:22:56.980429 ip-10-0-138-55 kubenswrapper[2566]: I0603 01:22:56.980398 2566 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1ffkt4_51b4334f-89ac-4ec8-9e08-44748b1c05d0/pull/0.log" Jun 03 01:22:56.986788 ip-10-0-138-55 kubenswrapper[2566]: I0603 01:22:56.986768 2566 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1ffkt4_51b4334f-89ac-4ec8-9e08-44748b1c05d0/extract/0.log" Jun 03 01:22:57.221764 ip-10-0-138-55 kubenswrapper[2566]: I0603 01:22:57.221737 2566 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_authorino-operator-657f44b778-8ghpk_f9cede5a-bff1-40d6-8cdb-1d058196cb2f/manager/0.log" Jun 03 01:22:57.337301 ip-10-0-138-55 kubenswrapper[2566]: I0603 01:22:57.337270 2566 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_dns-operator-controller-manager-648d5c98bc-mv844_4a9013f7-d6e0-4d22-95d5-988b49a15e37/manager/0.log" Jun 03 01:22:57.595671 ip-10-0-138-55 kubenswrapper[2566]: I0603 01:22:57.595641 2566 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_kuadrant-operator-catalog-9qkhp_55e7c773-1677-4ea7-8d4c-cc50c7304932/registry-server/0.log" Jun 03 01:22:57.714589 ip-10-0-138-55 kubenswrapper[2566]: I0603 01:22:57.714551 2566 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_kuadrant-operator-controller-manager-55c7f4c975-cvqzd_7d38331e-2c20-4482-9194-194d1bfddc67/manager/0.log" Jun 03 01:22:58.270963 ip-10-0-138-55 kubenswrapper[2566]: I0603 01:22:58.270929 2566 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_data-science-gateway-data-science-gateway-class-686dffbf4b65ht8_8c6cb31a-08f6-48f5-a12b-651f0391e2ce/istio-proxy/0.log" Jun 03 01:22:58.724384 ip-10-0-138-55 kubenswrapper[2566]: I0603 01:22:58.724352 2566 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_maas-default-gateway-openshift-default-7d6f447cf5-6vd8b_7d7ddddb-62c0-4920-a201-726c8b885fc0/istio-proxy/0.log" Jun 03 01:22:59.294248 ip-10-0-138-55 kubenswrapper[2566]: I0603 01:22:59.294189 2566 log.go:25] "Finished parsing log file" path="/var/log/pods/llm_e2e-distinct-2-simulated-kserve-8595bdc8d4-z259h_69a77c2e-b9fb-4226-8013-4ec97f8e3bd1/storage-initializer/0.log" Jun 03 01:22:59.302610 ip-10-0-138-55 kubenswrapper[2566]: I0603 01:22:59.302583 2566 log.go:25] "Finished parsing log file" path="/var/log/pods/llm_e2e-distinct-2-simulated-kserve-8595bdc8d4-z259h_69a77c2e-b9fb-4226-8013-4ec97f8e3bd1/main/0.log" Jun 03 01:22:59.664494 ip-10-0-138-55 kubenswrapper[2566]: I0603 01:22:59.664452 2566 log.go:25] "Finished parsing log file" path="/var/log/pods/llm_e2e-unconfigured-facebook-opt-125m-simulated-kserve-bdd7f97q9kg_681dd519-3adb-438b-a3c7-825e916688f4/storage-initializer/0.log" Jun 03 01:22:59.673041 ip-10-0-138-55 kubenswrapper[2566]: I0603 01:22:59.673006 2566 log.go:25] "Finished parsing log file" path="/var/log/pods/llm_e2e-unconfigured-facebook-opt-125m-simulated-kserve-bdd7f97q9kg_681dd519-3adb-438b-a3c7-825e916688f4/main/0.log" Jun 03 01:23:07.251730 ip-10-0-138-55 kubenswrapper[2566]: I0603 01:23:07.251694 2566 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_global-pull-secret-syncer-vrzz5_c3a41da4-011b-42dd-ab88-3f4b5d601840/global-pull-secret-syncer/0.log" Jun 03 01:23:07.371378 ip-10-0-138-55 kubenswrapper[2566]: I0603 01:23:07.371346 2566 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_konnectivity-agent-fg4j4_684e9f6d-abe0-4f60-af14-564c495677cc/konnectivity-agent/0.log" Jun 03 01:23:07.413902 ip-10-0-138-55 kubenswrapper[2566]: I0603 01:23:07.413866 2566 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_kube-apiserver-proxy-ip-10-0-138-55.ec2.internal_441c506c4adc726a5846cc275e644767/haproxy/0.log" Jun 03 01:23:11.261240 ip-10-0-138-55 kubenswrapper[2566]: I0603 01:23:11.261188 2566 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759vg6nh_d04b4880-a9b8-4143-bbe6-68dd52416e9c/extract/0.log" Jun 03 01:23:11.285122 ip-10-0-138-55 kubenswrapper[2566]: I0603 01:23:11.285054 2566 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759vg6nh_d04b4880-a9b8-4143-bbe6-68dd52416e9c/util/0.log" Jun 03 01:23:11.308792 ip-10-0-138-55 kubenswrapper[2566]: I0603 01:23:11.308759 2566 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759vg6nh_d04b4880-a9b8-4143-bbe6-68dd52416e9c/pull/0.log" Jun 03 01:23:11.336837 ip-10-0-138-55 kubenswrapper[2566]: I0603 01:23:11.336811 2566 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0rjwj4_05cdd465-123d-4ae4-8a24-fe0679cd2dcf/extract/0.log" Jun 03 01:23:11.360515 ip-10-0-138-55 kubenswrapper[2566]: I0603 01:23:11.360485 2566 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0rjwj4_05cdd465-123d-4ae4-8a24-fe0679cd2dcf/util/0.log" Jun 03 01:23:11.382884 ip-10-0-138-55 kubenswrapper[2566]: I0603 01:23:11.382856 2566 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0rjwj4_05cdd465-123d-4ae4-8a24-fe0679cd2dcf/pull/0.log" Jun 03 01:23:11.411014 ip-10-0-138-55 kubenswrapper[2566]: I0603 01:23:11.410983 2566 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73xr8xr_eedc5d49-5a31-4c4f-9b41-08d311ea09de/extract/0.log" Jun 03 01:23:11.434725 ip-10-0-138-55 kubenswrapper[2566]: I0603 01:23:11.434694 2566 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73xr8xr_eedc5d49-5a31-4c4f-9b41-08d311ea09de/util/0.log" Jun 03 01:23:11.456481 ip-10-0-138-55 kubenswrapper[2566]: I0603 01:23:11.456459 2566 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73xr8xr_eedc5d49-5a31-4c4f-9b41-08d311ea09de/pull/0.log" Jun 03 01:23:11.482975 ip-10-0-138-55 kubenswrapper[2566]: I0603 01:23:11.482947 2566 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1ffkt4_51b4334f-89ac-4ec8-9e08-44748b1c05d0/extract/0.log" Jun 03 01:23:11.503574 ip-10-0-138-55 kubenswrapper[2566]: I0603 01:23:11.503551 2566 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1ffkt4_51b4334f-89ac-4ec8-9e08-44748b1c05d0/util/0.log" Jun 03 01:23:11.527082 ip-10-0-138-55 kubenswrapper[2566]: I0603 01:23:11.527012 2566 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1ffkt4_51b4334f-89ac-4ec8-9e08-44748b1c05d0/pull/0.log" Jun 03 01:23:11.606244 ip-10-0-138-55 kubenswrapper[2566]: I0603 01:23:11.606209 2566 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_authorino-operator-657f44b778-8ghpk_f9cede5a-bff1-40d6-8cdb-1d058196cb2f/manager/0.log" Jun 03 01:23:11.630321 ip-10-0-138-55 kubenswrapper[2566]: I0603 01:23:11.630286 2566 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_dns-operator-controller-manager-648d5c98bc-mv844_4a9013f7-d6e0-4d22-95d5-988b49a15e37/manager/0.log" Jun 03 01:23:11.692815 ip-10-0-138-55 kubenswrapper[2566]: I0603 01:23:11.692786 2566 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_kuadrant-operator-catalog-9qkhp_55e7c773-1677-4ea7-8d4c-cc50c7304932/registry-server/0.log" Jun 03 01:23:11.746873 ip-10-0-138-55 kubenswrapper[2566]: I0603 01:23:11.746845 2566 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_kuadrant-operator-controller-manager-55c7f4c975-cvqzd_7d38331e-2c20-4482-9194-194d1bfddc67/manager/0.log" Jun 03 01:23:12.987063 ip-10-0-138-55 kubenswrapper[2566]: I0603 01:23:12.987032 2566 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_d2415250-c38e-4199-a530-040c21e2336b/alertmanager/0.log" Jun 03 01:23:13.009984 ip-10-0-138-55 kubenswrapper[2566]: I0603 01:23:13.009958 2566 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_d2415250-c38e-4199-a530-040c21e2336b/config-reloader/0.log" Jun 03 01:23:13.032713 ip-10-0-138-55 kubenswrapper[2566]: I0603 01:23:13.032689 2566 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_d2415250-c38e-4199-a530-040c21e2336b/kube-rbac-proxy-web/0.log" Jun 03 01:23:13.057618 ip-10-0-138-55 kubenswrapper[2566]: I0603 01:23:13.057593 2566 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_d2415250-c38e-4199-a530-040c21e2336b/kube-rbac-proxy/0.log" Jun 03 01:23:13.082902 ip-10-0-138-55 kubenswrapper[2566]: I0603 01:23:13.082860 2566 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_d2415250-c38e-4199-a530-040c21e2336b/kube-rbac-proxy-metric/0.log" Jun 03 01:23:13.110538 ip-10-0-138-55 kubenswrapper[2566]: I0603 01:23:13.110510 2566 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_d2415250-c38e-4199-a530-040c21e2336b/prom-label-proxy/0.log" Jun 03 01:23:13.135977 ip-10-0-138-55 kubenswrapper[2566]: I0603 01:23:13.135953 2566 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_d2415250-c38e-4199-a530-040c21e2336b/init-config-reloader/0.log" Jun 03 01:23:13.180366 ip-10-0-138-55 kubenswrapper[2566]: I0603 01:23:13.180335 2566 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_cluster-monitoring-operator-69b6cbdb88-8mdcx_5d1ab162-5c9a-42b9-91d3-e069fe09b4b8/cluster-monitoring-operator/0.log" Jun 03 01:23:13.208953 ip-10-0-138-55 kubenswrapper[2566]: I0603 01:23:13.208921 2566 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_kube-state-metrics-8469c486bb-p4vjj_2e65f17c-898a-49be-a2a6-7a04d6e36060/kube-state-metrics/0.log" Jun 03 01:23:13.225310 ip-10-0-138-55 kubenswrapper[2566]: I0603 01:23:13.225287 2566 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_kube-state-metrics-8469c486bb-p4vjj_2e65f17c-898a-49be-a2a6-7a04d6e36060/kube-rbac-proxy-main/0.log" Jun 03 01:23:13.246003 ip-10-0-138-55 kubenswrapper[2566]: I0603 01:23:13.245930 2566 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_kube-state-metrics-8469c486bb-p4vjj_2e65f17c-898a-49be-a2a6-7a04d6e36060/kube-rbac-proxy-self/0.log" Jun 03 01:23:13.491792 ip-10-0-138-55 kubenswrapper[2566]: I0603 01:23:13.491764 2566 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-wpr4v_e79c5637-7a9b-4530-b492-44cc41e28902/node-exporter/0.log" Jun 03 01:23:13.518632 ip-10-0-138-55 kubenswrapper[2566]: I0603 01:23:13.518552 2566 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-wpr4v_e79c5637-7a9b-4530-b492-44cc41e28902/kube-rbac-proxy/0.log" Jun 03 01:23:13.551171 ip-10-0-138-55 kubenswrapper[2566]: I0603 01:23:13.551145 2566 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-wpr4v_e79c5637-7a9b-4530-b492-44cc41e28902/init-textfile/0.log" Jun 03 01:23:13.585313 ip-10-0-138-55 kubenswrapper[2566]: I0603 01:23:13.585279 2566 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_openshift-state-metrics-85658796db-q6dzj_0a1da2cf-2553-4954-8e0d-4532ccca0977/kube-rbac-proxy-main/0.log" Jun 03 01:23:13.611318 ip-10-0-138-55 kubenswrapper[2566]: I0603 01:23:13.611286 2566 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_openshift-state-metrics-85658796db-q6dzj_0a1da2cf-2553-4954-8e0d-4532ccca0977/kube-rbac-proxy-self/0.log" Jun 03 01:23:13.632454 ip-10-0-138-55 kubenswrapper[2566]: I0603 01:23:13.632426 2566 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_openshift-state-metrics-85658796db-q6dzj_0a1da2cf-2553-4954-8e0d-4532ccca0977/openshift-state-metrics/0.log" Jun 03 01:23:13.838549 ip-10-0-138-55 kubenswrapper[2566]: I0603 01:23:13.838465 2566 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-operator-658bcd8bdf-979l6_b9cf3091-8f78-491a-afbd-df28d0a8d7a7/prometheus-operator/0.log" Jun 03 01:23:13.856450 ip-10-0-138-55 kubenswrapper[2566]: I0603 01:23:13.856424 2566 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-operator-658bcd8bdf-979l6_b9cf3091-8f78-491a-afbd-df28d0a8d7a7/kube-rbac-proxy/0.log" Jun 03 01:23:13.881424 ip-10-0-138-55 kubenswrapper[2566]: I0603 01:23:13.881401 2566 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-operator-admission-webhook-59b7f8756b-vsgcr_04b7774a-b55d-4777-95c1-d18aa479fc2a/prometheus-operator-admission-webhook/0.log" Jun 03 01:23:13.918768 ip-10-0-138-55 kubenswrapper[2566]: I0603 01:23:13.918737 2566 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_telemeter-client-687fdbd4f-qlspg_7dc20f7a-9ee1-484e-bdb1-ff81b28e891c/telemeter-client/0.log" Jun 03 01:23:13.961785 ip-10-0-138-55 kubenswrapper[2566]: I0603 01:23:13.961752 2566 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_telemeter-client-687fdbd4f-qlspg_7dc20f7a-9ee1-484e-bdb1-ff81b28e891c/reload/0.log" Jun 03 01:23:13.984449 ip-10-0-138-55 kubenswrapper[2566]: I0603 01:23:13.984419 2566 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_telemeter-client-687fdbd4f-qlspg_7dc20f7a-9ee1-484e-bdb1-ff81b28e891c/kube-rbac-proxy/0.log" Jun 03 01:23:15.799616 ip-10-0-138-55 kubenswrapper[2566]: I0603 01:23:15.799587 2566 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-86d7c6cc77-8nd2x_5776439a-7cdc-49da-a5f6-325eb0c8ab99/console-operator/1.log" Jun 03 01:23:15.813831 ip-10-0-138-55 kubenswrapper[2566]: I0603 01:23:15.813796 2566 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-86d7c6cc77-8nd2x_5776439a-7cdc-49da-a5f6-325eb0c8ab99/console-operator/2.log" Jun 03 01:23:16.302119 ip-10-0-138-55 kubenswrapper[2566]: I0603 01:23:16.302089 2566 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console_console-79d474476d-fmkmf_ce981c2d-76b9-40a5-9fcc-03f8da01c4d7/console/0.log" Jun 03 01:23:16.833836 ip-10-0-138-55 kubenswrapper[2566]: I0603 01:23:16.833806 2566 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-cluster-storage-operator_volume-data-source-validator-7598fd5bd-zf7p6_6d6223c5-1390-4e92-afe6-042d4098c255/volume-data-source-validator/0.log" Jun 03 01:23:17.007176 ip-10-0-138-55 kubenswrapper[2566]: I0603 01:23:17.007132 2566 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-must-gather-d79wk/perf-node-gather-daemonset-mv6zf"] Jun 03 01:23:17.011194 ip-10-0-138-55 kubenswrapper[2566]: I0603 01:23:17.011174 2566 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-d79wk/perf-node-gather-daemonset-mv6zf" Jun 03 01:23:17.013238 ip-10-0-138-55 kubenswrapper[2566]: I0603 01:23:17.013199 2566 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-must-gather-d79wk\"/\"default-dockercfg-9nwgs\"" Jun 03 01:23:17.013771 ip-10-0-138-55 kubenswrapper[2566]: I0603 01:23:17.013752 2566 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-must-gather-d79wk\"/\"kube-root-ca.crt\"" Jun 03 01:23:17.013977 ip-10-0-138-55 kubenswrapper[2566]: I0603 01:23:17.013777 2566 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-must-gather-d79wk\"/\"openshift-service-ca.crt\"" Jun 03 01:23:17.017966 ip-10-0-138-55 kubenswrapper[2566]: I0603 01:23:17.017944 2566 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-d79wk/perf-node-gather-daemonset-mv6zf"] Jun 03 01:23:17.094464 ip-10-0-138-55 kubenswrapper[2566]: I0603 01:23:17.094435 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/513f496a-0327-4756-92e5-252b3e5a7a7a-sys\") pod \"perf-node-gather-daemonset-mv6zf\" (UID: \"513f496a-0327-4756-92e5-252b3e5a7a7a\") " pod="openshift-must-gather-d79wk/perf-node-gather-daemonset-mv6zf" Jun 03 01:23:17.094605 ip-10-0-138-55 kubenswrapper[2566]: I0603 01:23:17.094468 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/513f496a-0327-4756-92e5-252b3e5a7a7a-podres\") pod \"perf-node-gather-daemonset-mv6zf\" (UID: \"513f496a-0327-4756-92e5-252b3e5a7a7a\") " pod="openshift-must-gather-d79wk/perf-node-gather-daemonset-mv6zf" Jun 03 01:23:17.094605 ip-10-0-138-55 kubenswrapper[2566]: I0603 01:23:17.094507 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/513f496a-0327-4756-92e5-252b3e5a7a7a-lib-modules\") pod \"perf-node-gather-daemonset-mv6zf\" (UID: \"513f496a-0327-4756-92e5-252b3e5a7a7a\") " pod="openshift-must-gather-d79wk/perf-node-gather-daemonset-mv6zf" Jun 03 01:23:17.094605 ip-10-0-138-55 kubenswrapper[2566]: I0603 01:23:17.094537 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/513f496a-0327-4756-92e5-252b3e5a7a7a-proc\") pod \"perf-node-gather-daemonset-mv6zf\" (UID: \"513f496a-0327-4756-92e5-252b3e5a7a7a\") " pod="openshift-must-gather-d79wk/perf-node-gather-daemonset-mv6zf" Jun 03 01:23:17.094605 ip-10-0-138-55 kubenswrapper[2566]: I0603 01:23:17.094581 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-nwxwj\" (UniqueName: \"kubernetes.io/projected/513f496a-0327-4756-92e5-252b3e5a7a7a-kube-api-access-nwxwj\") pod \"perf-node-gather-daemonset-mv6zf\" (UID: \"513f496a-0327-4756-92e5-252b3e5a7a7a\") " pod="openshift-must-gather-d79wk/perf-node-gather-daemonset-mv6zf" Jun 03 01:23:17.195278 ip-10-0-138-55 kubenswrapper[2566]: I0603 01:23:17.195219 2566 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-nwxwj\" (UniqueName: \"kubernetes.io/projected/513f496a-0327-4756-92e5-252b3e5a7a7a-kube-api-access-nwxwj\") pod \"perf-node-gather-daemonset-mv6zf\" (UID: \"513f496a-0327-4756-92e5-252b3e5a7a7a\") " pod="openshift-must-gather-d79wk/perf-node-gather-daemonset-mv6zf" Jun 03 01:23:17.195425 ip-10-0-138-55 kubenswrapper[2566]: I0603 01:23:17.195333 2566 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/513f496a-0327-4756-92e5-252b3e5a7a7a-sys\") pod \"perf-node-gather-daemonset-mv6zf\" (UID: \"513f496a-0327-4756-92e5-252b3e5a7a7a\") " pod="openshift-must-gather-d79wk/perf-node-gather-daemonset-mv6zf" Jun 03 01:23:17.195425 ip-10-0-138-55 kubenswrapper[2566]: I0603 01:23:17.195360 2566 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/513f496a-0327-4756-92e5-252b3e5a7a7a-podres\") pod \"perf-node-gather-daemonset-mv6zf\" (UID: \"513f496a-0327-4756-92e5-252b3e5a7a7a\") " pod="openshift-must-gather-d79wk/perf-node-gather-daemonset-mv6zf" Jun 03 01:23:17.195498 ip-10-0-138-55 kubenswrapper[2566]: I0603 01:23:17.195451 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/513f496a-0327-4756-92e5-252b3e5a7a7a-sys\") pod \"perf-node-gather-daemonset-mv6zf\" (UID: \"513f496a-0327-4756-92e5-252b3e5a7a7a\") " pod="openshift-must-gather-d79wk/perf-node-gather-daemonset-mv6zf" Jun 03 01:23:17.195498 ip-10-0-138-55 kubenswrapper[2566]: I0603 01:23:17.195490 2566 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/513f496a-0327-4756-92e5-252b3e5a7a7a-lib-modules\") pod \"perf-node-gather-daemonset-mv6zf\" (UID: \"513f496a-0327-4756-92e5-252b3e5a7a7a\") " pod="openshift-must-gather-d79wk/perf-node-gather-daemonset-mv6zf" Jun 03 01:23:17.195593 ip-10-0-138-55 kubenswrapper[2566]: I0603 01:23:17.195508 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/513f496a-0327-4756-92e5-252b3e5a7a7a-podres\") pod \"perf-node-gather-daemonset-mv6zf\" (UID: \"513f496a-0327-4756-92e5-252b3e5a7a7a\") " pod="openshift-must-gather-d79wk/perf-node-gather-daemonset-mv6zf" Jun 03 01:23:17.195593 ip-10-0-138-55 kubenswrapper[2566]: I0603 01:23:17.195512 2566 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/513f496a-0327-4756-92e5-252b3e5a7a7a-proc\") pod \"perf-node-gather-daemonset-mv6zf\" (UID: \"513f496a-0327-4756-92e5-252b3e5a7a7a\") " pod="openshift-must-gather-d79wk/perf-node-gather-daemonset-mv6zf" Jun 03 01:23:17.195593 ip-10-0-138-55 kubenswrapper[2566]: I0603 01:23:17.195539 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/513f496a-0327-4756-92e5-252b3e5a7a7a-proc\") pod \"perf-node-gather-daemonset-mv6zf\" (UID: \"513f496a-0327-4756-92e5-252b3e5a7a7a\") " pod="openshift-must-gather-d79wk/perf-node-gather-daemonset-mv6zf" Jun 03 01:23:17.195697 ip-10-0-138-55 kubenswrapper[2566]: I0603 01:23:17.195617 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/513f496a-0327-4756-92e5-252b3e5a7a7a-lib-modules\") pod \"perf-node-gather-daemonset-mv6zf\" (UID: \"513f496a-0327-4756-92e5-252b3e5a7a7a\") " pod="openshift-must-gather-d79wk/perf-node-gather-daemonset-mv6zf" Jun 03 01:23:17.203872 ip-10-0-138-55 kubenswrapper[2566]: I0603 01:23:17.203840 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-nwxwj\" (UniqueName: \"kubernetes.io/projected/513f496a-0327-4756-92e5-252b3e5a7a7a-kube-api-access-nwxwj\") pod \"perf-node-gather-daemonset-mv6zf\" (UID: \"513f496a-0327-4756-92e5-252b3e5a7a7a\") " pod="openshift-must-gather-d79wk/perf-node-gather-daemonset-mv6zf" Jun 03 01:23:17.322761 ip-10-0-138-55 kubenswrapper[2566]: I0603 01:23:17.322727 2566 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-d79wk/perf-node-gather-daemonset-mv6zf" Jun 03 01:23:17.454524 ip-10-0-138-55 kubenswrapper[2566]: I0603 01:23:17.454498 2566 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-d79wk/perf-node-gather-daemonset-mv6zf"] Jun 03 01:23:17.456329 ip-10-0-138-55 kubenswrapper[2566]: W0603 01:23:17.456291 2566 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-pod513f496a_0327_4756_92e5_252b3e5a7a7a.slice/crio-3ce665b8df2f18104812b81bfebbc1a7e65e905739f4a24cf6bc7e4b5b0f232e WatchSource:0}: Error finding container 3ce665b8df2f18104812b81bfebbc1a7e65e905739f4a24cf6bc7e4b5b0f232e: Status 404 returned error can't find the container with id 3ce665b8df2f18104812b81bfebbc1a7e65e905739f4a24cf6bc7e4b5b0f232e Jun 03 01:23:17.458272 ip-10-0-138-55 kubenswrapper[2566]: I0603 01:23:17.458251 2566 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider Jun 03 01:23:17.860605 ip-10-0-138-55 kubenswrapper[2566]: I0603 01:23:17.860579 2566 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_dns-default-nvrs2_24c6861e-9230-4de3-b1b7-7edf01864353/dns/0.log" Jun 03 01:23:17.884523 ip-10-0-138-55 kubenswrapper[2566]: I0603 01:23:17.884485 2566 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_dns-default-nvrs2_24c6861e-9230-4de3-b1b7-7edf01864353/kube-rbac-proxy/0.log" Jun 03 01:23:17.947475 ip-10-0-138-55 kubenswrapper[2566]: I0603 01:23:17.947453 2566 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_node-resolver-ztzkx_d3ec3632-b471-46e0-899f-54befd75838a/dns-node-resolver/0.log" Jun 03 01:23:18.308578 ip-10-0-138-55 kubenswrapper[2566]: I0603 01:23:18.308490 2566 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-d79wk/perf-node-gather-daemonset-mv6zf" event={"ID":"513f496a-0327-4756-92e5-252b3e5a7a7a","Type":"ContainerStarted","Data":"28883c726873ccadb434d738677b92416858b20ed63eacf3b9d557244a251160"} Jun 03 01:23:18.308578 ip-10-0-138-55 kubenswrapper[2566]: I0603 01:23:18.308533 2566 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-d79wk/perf-node-gather-daemonset-mv6zf" event={"ID":"513f496a-0327-4756-92e5-252b3e5a7a7a","Type":"ContainerStarted","Data":"3ce665b8df2f18104812b81bfebbc1a7e65e905739f4a24cf6bc7e4b5b0f232e"} Jun 03 01:23:18.308778 ip-10-0-138-55 kubenswrapper[2566]: I0603 01:23:18.308646 2566 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-must-gather-d79wk/perf-node-gather-daemonset-mv6zf" Jun 03 01:23:18.323669 ip-10-0-138-55 kubenswrapper[2566]: I0603 01:23:18.323623 2566 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-must-gather-d79wk/perf-node-gather-daemonset-mv6zf" podStartSLOduration=2.323610521 podStartE2EDuration="2.323610521s" podCreationTimestamp="2026-06-03 01:23:16 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2026-06-03 01:23:18.321220742 +0000 UTC m=+1121.468062687" watchObservedRunningTime="2026-06-03 01:23:18.323610521 +0000 UTC m=+1121.470452467" Jun 03 01:23:18.508282 ip-10-0-138-55 kubenswrapper[2566]: I0603 01:23:18.508250 2566 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_node-ca-wl5n2_3e693b71-7178-4400-bdfa-91a820886ab1/node-ca/0.log" Jun 03 01:23:19.298060 ip-10-0-138-55 kubenswrapper[2566]: I0603 01:23:19.298030 2566 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_data-science-gateway-data-science-gateway-class-686dffbf4b65ht8_8c6cb31a-08f6-48f5-a12b-651f0391e2ce/istio-proxy/0.log" Jun 03 01:23:19.451848 ip-10-0-138-55 kubenswrapper[2566]: I0603 01:23:19.451811 2566 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_maas-default-gateway-openshift-default-7d6f447cf5-6vd8b_7d7ddddb-62c0-4920-a201-726c8b885fc0/istio-proxy/0.log" Jun 03 01:23:20.031754 ip-10-0-138-55 kubenswrapper[2566]: I0603 01:23:20.031726 2566 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress-canary_ingress-canary-vm9nr_252447b2-d8a3-4d99-8302-361f32e759df/serve-healthcheck-canary/0.log" Jun 03 01:23:20.462742 ip-10-0-138-55 kubenswrapper[2566]: I0603 01:23:20.462713 2566 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-operator-788bf58df5-nhrtq_9167dbe1-4d4e-4e57-9396-7b000dc36698/insights-operator/1.log" Jun 03 01:23:20.463190 ip-10-0-138-55 kubenswrapper[2566]: I0603 01:23:20.462882 2566 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-operator-788bf58df5-nhrtq_9167dbe1-4d4e-4e57-9396-7b000dc36698/insights-operator/0.log" Jun 03 01:23:20.485119 ip-10-0-138-55 kubenswrapper[2566]: I0603 01:23:20.485088 2566 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-v4ppd_78dd0994-42e2-48fc-bd26-3d35afde3e04/kube-rbac-proxy/0.log" Jun 03 01:23:20.506935 ip-10-0-138-55 kubenswrapper[2566]: I0603 01:23:20.506910 2566 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-v4ppd_78dd0994-42e2-48fc-bd26-3d35afde3e04/exporter/0.log" Jun 03 01:23:20.527903 ip-10-0-138-55 kubenswrapper[2566]: I0603 01:23:20.527877 2566 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-v4ppd_78dd0994-42e2-48fc-bd26-3d35afde3e04/extractor/0.log" Jun 03 01:23:22.616645 ip-10-0-138-55 kubenswrapper[2566]: I0603 01:23:22.616615 2566 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_dashboard-redirect-86cc4fb5f5-fkwsp_6cc062c0-40a4-4d87-b1b0-c534e382d518/nginx/0.log" Jun 03 01:23:22.731272 ip-10-0-138-55 kubenswrapper[2566]: I0603 01:23:22.731219 2566 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_maas-api-7986767586-jvsst_8ddf70ce-359b-4d17-947f-f39153e7824f/maas-api/0.log" Jun 03 01:23:22.763045 ip-10-0-138-55 kubenswrapper[2566]: I0603 01:23:22.763020 2566 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_maas-controller-76cbd784d6-rsjhd_f58fbdda-eabd-4aab-9e64-0e8bb850d2c3/manager/0.log" Jun 03 01:23:22.851373 ip-10-0-138-55 kubenswrapper[2566]: I0603 01:23:22.851347 2566 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_odh-model-controller-76588b95-dhfrn_994f0858-424c-4dff-b6b6-974c5d51c82e/manager/0.log" Jun 03 01:23:22.959761 ip-10-0-138-55 kubenswrapper[2566]: I0603 01:23:22.959667 2566 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-85b884ccf6-6j2kc_991aaba9-8623-4501-9e50-c19d4d89c7d1/manager/0.log" Jun 03 01:23:22.980760 ip-10-0-138-55 kubenswrapper[2566]: I0603 01:23:22.980734 2566 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-85b884ccf6-6j2kc_991aaba9-8623-4501-9e50-c19d4d89c7d1/copy-manifests/0.log" Jun 03 01:23:23.087179 ip-10-0-138-55 kubenswrapper[2566]: I0603 01:23:23.087151 2566 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_postgres-68c4fbbd6f-7dcqx_4f761a76-7bad-4c17-bfd8-45dd143de9c1/postgres/0.log" Jun 03 01:23:24.322477 ip-10-0-138-55 kubenswrapper[2566]: I0603 01:23:24.322436 2566 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-must-gather-d79wk/perf-node-gather-daemonset-mv6zf" Jun 03 01:23:24.324486 ip-10-0-138-55 kubenswrapper[2566]: I0603 01:23:24.324459 2566 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-lws-operator_lws-controller-manager-65c8c8d4bb-kksb4_1c8fd408-3f6d-4d94-ada5-29cefbdab2dc/manager/0.log" Jun 03 01:23:29.120251 ip-10-0-138-55 kubenswrapper[2566]: I0603 01:23:29.120198 2566 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-kube-storage-version-migrator_migrator-96c6f749-6mlq8_21cc8419-7eaa-4033-ba62-a2400cba3b9d/migrator/0.log" Jun 03 01:23:29.140671 ip-10-0-138-55 kubenswrapper[2566]: I0603 01:23:29.140647 2566 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-kube-storage-version-migrator_migrator-96c6f749-6mlq8_21cc8419-7eaa-4033-ba62-a2400cba3b9d/graceful-termination/0.log" Jun 03 01:23:29.538055 ip-10-0-138-55 kubenswrapper[2566]: I0603 01:23:29.537953 2566 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-kube-storage-version-migrator-operator_kube-storage-version-migrator-operator-96ddc787c-9dcb9_b47d8095-6d81-4a7a-b17f-357d8b59c8d4/kube-storage-version-migrator-operator/1.log" Jun 03 01:23:29.539669 ip-10-0-138-55 kubenswrapper[2566]: I0603 01:23:29.539638 2566 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-kube-storage-version-migrator-operator_kube-storage-version-migrator-operator-96ddc787c-9dcb9_b47d8095-6d81-4a7a-b17f-357d8b59c8d4/kube-storage-version-migrator-operator/0.log" Jun 03 01:23:30.837210 ip-10-0-138-55 kubenswrapper[2566]: I0603 01:23:30.837181 2566 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-lsx7q_20148712-f92b-4521-92b1-e00d0c2571c9/kube-multus-additional-cni-plugins/0.log" Jun 03 01:23:30.864492 ip-10-0-138-55 kubenswrapper[2566]: I0603 01:23:30.864464 2566 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-lsx7q_20148712-f92b-4521-92b1-e00d0c2571c9/egress-router-binary-copy/0.log" Jun 03 01:23:30.887653 ip-10-0-138-55 kubenswrapper[2566]: I0603 01:23:30.887624 2566 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-lsx7q_20148712-f92b-4521-92b1-e00d0c2571c9/cni-plugins/0.log" Jun 03 01:23:30.911252 ip-10-0-138-55 kubenswrapper[2566]: I0603 01:23:30.911209 2566 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-lsx7q_20148712-f92b-4521-92b1-e00d0c2571c9/bond-cni-plugin/0.log" Jun 03 01:23:30.933969 ip-10-0-138-55 kubenswrapper[2566]: I0603 01:23:30.933943 2566 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-lsx7q_20148712-f92b-4521-92b1-e00d0c2571c9/routeoverride-cni/0.log" Jun 03 01:23:30.959281 ip-10-0-138-55 kubenswrapper[2566]: I0603 01:23:30.959257 2566 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-lsx7q_20148712-f92b-4521-92b1-e00d0c2571c9/whereabouts-cni-bincopy/0.log" Jun 03 01:23:30.983376 ip-10-0-138-55 kubenswrapper[2566]: I0603 01:23:30.983348 2566 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-lsx7q_20148712-f92b-4521-92b1-e00d0c2571c9/whereabouts-cni/0.log" Jun 03 01:23:31.024564 ip-10-0-138-55 kubenswrapper[2566]: I0603 01:23:31.024542 2566 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-frg76_3b24c36b-015d-4776-8999-95b23959ff67/kube-multus/0.log" Jun 03 01:23:31.142753 ip-10-0-138-55 kubenswrapper[2566]: I0603 01:23:31.142729 2566 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_network-metrics-daemon-vzflm_9b00548d-2314-42e7-ab92-ed1462bba025/network-metrics-daemon/0.log" Jun 03 01:23:31.159432 ip-10-0-138-55 kubenswrapper[2566]: I0603 01:23:31.159409 2566 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_network-metrics-daemon-vzflm_9b00548d-2314-42e7-ab92-ed1462bba025/kube-rbac-proxy/0.log" Jun 03 01:23:32.338292 ip-10-0-138-55 kubenswrapper[2566]: I0603 01:23:32.338263 2566 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-c2smc_38c378b4-8f35-4e5f-8b38-83e4c61f9d9d/ovn-controller/0.log" Jun 03 01:23:32.366018 ip-10-0-138-55 kubenswrapper[2566]: I0603 01:23:32.365985 2566 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-c2smc_38c378b4-8f35-4e5f-8b38-83e4c61f9d9d/ovn-acl-logging/0.log" Jun 03 01:23:32.387003 ip-10-0-138-55 kubenswrapper[2566]: I0603 01:23:32.386975 2566 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-c2smc_38c378b4-8f35-4e5f-8b38-83e4c61f9d9d/kube-rbac-proxy-node/0.log" Jun 03 01:23:32.408765 ip-10-0-138-55 kubenswrapper[2566]: I0603 01:23:32.408735 2566 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-c2smc_38c378b4-8f35-4e5f-8b38-83e4c61f9d9d/kube-rbac-proxy-ovn-metrics/0.log" Jun 03 01:23:32.427974 ip-10-0-138-55 kubenswrapper[2566]: I0603 01:23:32.427943 2566 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-c2smc_38c378b4-8f35-4e5f-8b38-83e4c61f9d9d/northd/0.log" Jun 03 01:23:32.449822 ip-10-0-138-55 kubenswrapper[2566]: I0603 01:23:32.449796 2566 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-c2smc_38c378b4-8f35-4e5f-8b38-83e4c61f9d9d/nbdb/0.log" Jun 03 01:23:32.472875 ip-10-0-138-55 kubenswrapper[2566]: I0603 01:23:32.472846 2566 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-c2smc_38c378b4-8f35-4e5f-8b38-83e4c61f9d9d/sbdb/0.log" Jun 03 01:23:32.669665 ip-10-0-138-55 kubenswrapper[2566]: I0603 01:23:32.669633 2566 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-c2smc_38c378b4-8f35-4e5f-8b38-83e4c61f9d9d/ovnkube-controller/0.log"