Jun 03 13:51:16.353360 ip-10-0-134-229 systemd[1]: kubelet.service: Failed to load environment files: No such file or directory Jun 03 13:51:16.353370 ip-10-0-134-229 systemd[1]: kubelet.service: Failed to run 'start-pre' task: No such file or directory Jun 03 13:51:16.353377 ip-10-0-134-229 systemd[1]: kubelet.service: Failed with result 'resources'. Jun 03 13:51:16.353581 ip-10-0-134-229 systemd[1]: Failed to start Kubernetes Kubelet. Jun 03 13:51:26.459025 ip-10-0-134-229 systemd[1]: kubelet.service: Failed to schedule restart job: Unit crio.service not found. Jun 03 13:51:26.459042 ip-10-0-134-229 systemd[1]: kubelet.service: Failed with result 'resources'. -- Boot a706629fe9ab4287a3091dde6dc946ae -- Jun 03 13:53:58.682654 ip-10-0-134-229 systemd[1]: Starting Kubernetes Kubelet... Jun 03 13:53:59.188076 ip-10-0-134-229 kubenswrapper[2574]: Flag --container-runtime-endpoint has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information. Jun 03 13:53:59.188076 ip-10-0-134-229 kubenswrapper[2574]: Flag --minimum-container-ttl-duration has been deprecated, Use --eviction-hard or --eviction-soft instead. Will be removed in a future version. Jun 03 13:53:59.188076 ip-10-0-134-229 kubenswrapper[2574]: Flag --volume-plugin-dir has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information. Jun 03 13:53:59.188076 ip-10-0-134-229 kubenswrapper[2574]: Flag --pod-infra-container-image has been deprecated, will be removed in 1.35. Image garbage collector will get sandbox image information from CRI. Jun 03 13:53:59.188076 ip-10-0-134-229 kubenswrapper[2574]: Flag --system-reserved has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information. Jun 03 13:53:59.189763 ip-10-0-134-229 kubenswrapper[2574]: I0603 13:53:59.189678 2574 server.go:212] "--pod-infra-container-image will not be pruned by the image garbage collector in kubelet and should also be set in the remote runtime" Jun 03 13:53:59.193208 ip-10-0-134-229 kubenswrapper[2574]: W0603 13:53:59.193191 2574 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jun 03 13:53:59.193208 ip-10-0-134-229 kubenswrapper[2574]: W0603 13:53:59.193209 2574 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jun 03 13:53:59.193280 ip-10-0-134-229 kubenswrapper[2574]: W0603 13:53:59.193213 2574 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jun 03 13:53:59.193280 ip-10-0-134-229 kubenswrapper[2574]: W0603 13:53:59.193216 2574 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jun 03 13:53:59.193280 ip-10-0-134-229 kubenswrapper[2574]: W0603 13:53:59.193219 2574 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jun 03 13:53:59.193280 ip-10-0-134-229 kubenswrapper[2574]: W0603 13:53:59.193222 2574 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jun 03 13:53:59.193280 ip-10-0-134-229 kubenswrapper[2574]: W0603 13:53:59.193225 2574 feature_gate.go:328] unrecognized feature gate: NewOLM Jun 03 13:53:59.193280 ip-10-0-134-229 kubenswrapper[2574]: W0603 13:53:59.193227 2574 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jun 03 13:53:59.193280 ip-10-0-134-229 kubenswrapper[2574]: W0603 13:53:59.193230 2574 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jun 03 13:53:59.193280 ip-10-0-134-229 kubenswrapper[2574]: W0603 13:53:59.193233 2574 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jun 03 13:53:59.193280 ip-10-0-134-229 kubenswrapper[2574]: W0603 13:53:59.193236 2574 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jun 03 13:53:59.193280 ip-10-0-134-229 kubenswrapper[2574]: W0603 13:53:59.193239 2574 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jun 03 13:53:59.193280 ip-10-0-134-229 kubenswrapper[2574]: W0603 13:53:59.193242 2574 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jun 03 13:53:59.193280 ip-10-0-134-229 kubenswrapper[2574]: W0603 13:53:59.193244 2574 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jun 03 13:53:59.193280 ip-10-0-134-229 kubenswrapper[2574]: W0603 13:53:59.193247 2574 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jun 03 13:53:59.193280 ip-10-0-134-229 kubenswrapper[2574]: W0603 13:53:59.193249 2574 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jun 03 13:53:59.193280 ip-10-0-134-229 kubenswrapper[2574]: W0603 13:53:59.193252 2574 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jun 03 13:53:59.193280 ip-10-0-134-229 kubenswrapper[2574]: W0603 13:53:59.193255 2574 feature_gate.go:328] unrecognized feature gate: PinnedImages Jun 03 13:53:59.193280 ip-10-0-134-229 kubenswrapper[2574]: W0603 13:53:59.193257 2574 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jun 03 13:53:59.193280 ip-10-0-134-229 kubenswrapper[2574]: W0603 13:53:59.193260 2574 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jun 03 13:53:59.193280 ip-10-0-134-229 kubenswrapper[2574]: W0603 13:53:59.193262 2574 feature_gate.go:328] unrecognized feature gate: InsightsConfigAPI Jun 03 13:53:59.193280 ip-10-0-134-229 kubenswrapper[2574]: W0603 13:53:59.193265 2574 feature_gate.go:328] unrecognized feature gate: OVNObservability Jun 03 13:53:59.193780 ip-10-0-134-229 kubenswrapper[2574]: W0603 13:53:59.193267 2574 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jun 03 13:53:59.193780 ip-10-0-134-229 kubenswrapper[2574]: W0603 13:53:59.193270 2574 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jun 03 13:53:59.193780 ip-10-0-134-229 kubenswrapper[2574]: W0603 13:53:59.193272 2574 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jun 03 13:53:59.193780 ip-10-0-134-229 kubenswrapper[2574]: W0603 13:53:59.193275 2574 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jun 03 13:53:59.193780 ip-10-0-134-229 kubenswrapper[2574]: W0603 13:53:59.193277 2574 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jun 03 13:53:59.193780 ip-10-0-134-229 kubenswrapper[2574]: W0603 13:53:59.193280 2574 feature_gate.go:328] unrecognized feature gate: SetEIPForNLBIngressController Jun 03 13:53:59.193780 ip-10-0-134-229 kubenswrapper[2574]: W0603 13:53:59.193282 2574 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jun 03 13:53:59.193780 ip-10-0-134-229 kubenswrapper[2574]: W0603 13:53:59.193285 2574 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jun 03 13:53:59.193780 ip-10-0-134-229 kubenswrapper[2574]: W0603 13:53:59.193288 2574 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jun 03 13:53:59.193780 ip-10-0-134-229 kubenswrapper[2574]: W0603 13:53:59.193291 2574 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jun 03 13:53:59.193780 ip-10-0-134-229 kubenswrapper[2574]: W0603 13:53:59.193293 2574 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jun 03 13:53:59.193780 ip-10-0-134-229 kubenswrapper[2574]: W0603 13:53:59.193296 2574 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jun 03 13:53:59.193780 ip-10-0-134-229 kubenswrapper[2574]: W0603 13:53:59.193299 2574 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jun 03 13:53:59.193780 ip-10-0-134-229 kubenswrapper[2574]: W0603 13:53:59.193302 2574 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jun 03 13:53:59.193780 ip-10-0-134-229 kubenswrapper[2574]: W0603 13:53:59.193304 2574 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jun 03 13:53:59.193780 ip-10-0-134-229 kubenswrapper[2574]: W0603 13:53:59.193310 2574 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jun 03 13:53:59.193780 ip-10-0-134-229 kubenswrapper[2574]: W0603 13:53:59.193312 2574 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jun 03 13:53:59.193780 ip-10-0-134-229 kubenswrapper[2574]: W0603 13:53:59.193315 2574 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jun 03 13:53:59.193780 ip-10-0-134-229 kubenswrapper[2574]: W0603 13:53:59.193317 2574 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jun 03 13:53:59.194236 ip-10-0-134-229 kubenswrapper[2574]: W0603 13:53:59.193320 2574 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jun 03 13:53:59.194236 ip-10-0-134-229 kubenswrapper[2574]: W0603 13:53:59.193322 2574 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jun 03 13:53:59.194236 ip-10-0-134-229 kubenswrapper[2574]: W0603 13:53:59.193324 2574 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jun 03 13:53:59.194236 ip-10-0-134-229 kubenswrapper[2574]: W0603 13:53:59.193329 2574 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jun 03 13:53:59.194236 ip-10-0-134-229 kubenswrapper[2574]: W0603 13:53:59.193333 2574 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jun 03 13:53:59.194236 ip-10-0-134-229 kubenswrapper[2574]: W0603 13:53:59.193336 2574 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jun 03 13:53:59.194236 ip-10-0-134-229 kubenswrapper[2574]: W0603 13:53:59.193338 2574 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jun 03 13:53:59.194236 ip-10-0-134-229 kubenswrapper[2574]: W0603 13:53:59.193341 2574 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jun 03 13:53:59.194236 ip-10-0-134-229 kubenswrapper[2574]: W0603 13:53:59.193344 2574 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jun 03 13:53:59.194236 ip-10-0-134-229 kubenswrapper[2574]: W0603 13:53:59.193346 2574 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jun 03 13:53:59.194236 ip-10-0-134-229 kubenswrapper[2574]: W0603 13:53:59.193349 2574 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jun 03 13:53:59.194236 ip-10-0-134-229 kubenswrapper[2574]: W0603 13:53:59.193351 2574 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jun 03 13:53:59.194236 ip-10-0-134-229 kubenswrapper[2574]: W0603 13:53:59.193354 2574 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jun 03 13:53:59.194236 ip-10-0-134-229 kubenswrapper[2574]: W0603 13:53:59.193357 2574 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jun 03 13:53:59.194236 ip-10-0-134-229 kubenswrapper[2574]: W0603 13:53:59.193360 2574 feature_gate.go:328] unrecognized feature gate: SignatureStores Jun 03 13:53:59.194236 ip-10-0-134-229 kubenswrapper[2574]: W0603 13:53:59.193363 2574 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jun 03 13:53:59.194236 ip-10-0-134-229 kubenswrapper[2574]: W0603 13:53:59.193365 2574 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jun 03 13:53:59.194236 ip-10-0-134-229 kubenswrapper[2574]: W0603 13:53:59.193368 2574 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jun 03 13:53:59.194236 ip-10-0-134-229 kubenswrapper[2574]: W0603 13:53:59.193388 2574 feature_gate.go:328] unrecognized feature gate: Example Jun 03 13:53:59.194236 ip-10-0-134-229 kubenswrapper[2574]: W0603 13:53:59.193392 2574 feature_gate.go:328] unrecognized feature gate: Example2 Jun 03 13:53:59.194735 ip-10-0-134-229 kubenswrapper[2574]: W0603 13:53:59.193396 2574 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jun 03 13:53:59.194735 ip-10-0-134-229 kubenswrapper[2574]: W0603 13:53:59.193399 2574 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jun 03 13:53:59.194735 ip-10-0-134-229 kubenswrapper[2574]: W0603 13:53:59.193402 2574 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jun 03 13:53:59.194735 ip-10-0-134-229 kubenswrapper[2574]: W0603 13:53:59.193404 2574 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jun 03 13:53:59.194735 ip-10-0-134-229 kubenswrapper[2574]: W0603 13:53:59.193407 2574 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jun 03 13:53:59.194735 ip-10-0-134-229 kubenswrapper[2574]: W0603 13:53:59.193410 2574 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jun 03 13:53:59.194735 ip-10-0-134-229 kubenswrapper[2574]: W0603 13:53:59.193412 2574 feature_gate.go:328] unrecognized feature gate: DualReplica Jun 03 13:53:59.194735 ip-10-0-134-229 kubenswrapper[2574]: W0603 13:53:59.193415 2574 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jun 03 13:53:59.194735 ip-10-0-134-229 kubenswrapper[2574]: W0603 13:53:59.193417 2574 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jun 03 13:53:59.194735 ip-10-0-134-229 kubenswrapper[2574]: W0603 13:53:59.193420 2574 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jun 03 13:53:59.194735 ip-10-0-134-229 kubenswrapper[2574]: W0603 13:53:59.193424 2574 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jun 03 13:53:59.194735 ip-10-0-134-229 kubenswrapper[2574]: W0603 13:53:59.193428 2574 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jun 03 13:53:59.194735 ip-10-0-134-229 kubenswrapper[2574]: W0603 13:53:59.193431 2574 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jun 03 13:53:59.194735 ip-10-0-134-229 kubenswrapper[2574]: W0603 13:53:59.193433 2574 feature_gate.go:328] unrecognized feature gate: IngressControllerLBSubnetsAWS Jun 03 13:53:59.194735 ip-10-0-134-229 kubenswrapper[2574]: W0603 13:53:59.193436 2574 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterOperations Jun 03 13:53:59.194735 ip-10-0-134-229 kubenswrapper[2574]: W0603 13:53:59.193438 2574 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jun 03 13:53:59.194735 ip-10-0-134-229 kubenswrapper[2574]: W0603 13:53:59.193441 2574 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jun 03 13:53:59.194735 ip-10-0-134-229 kubenswrapper[2574]: W0603 13:53:59.193443 2574 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jun 03 13:53:59.194735 ip-10-0-134-229 kubenswrapper[2574]: W0603 13:53:59.193445 2574 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jun 03 13:53:59.195285 ip-10-0-134-229 kubenswrapper[2574]: W0603 13:53:59.193448 2574 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jun 03 13:53:59.195285 ip-10-0-134-229 kubenswrapper[2574]: W0603 13:53:59.193450 2574 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jun 03 13:53:59.195285 ip-10-0-134-229 kubenswrapper[2574]: W0603 13:53:59.193453 2574 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jun 03 13:53:59.195285 ip-10-0-134-229 kubenswrapper[2574]: W0603 13:53:59.193455 2574 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jun 03 13:53:59.195285 ip-10-0-134-229 kubenswrapper[2574]: W0603 13:53:59.193457 2574 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jun 03 13:53:59.195285 ip-10-0-134-229 kubenswrapper[2574]: W0603 13:53:59.193460 2574 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jun 03 13:53:59.195285 ip-10-0-134-229 kubenswrapper[2574]: W0603 13:53:59.194642 2574 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jun 03 13:53:59.195285 ip-10-0-134-229 kubenswrapper[2574]: W0603 13:53:59.194649 2574 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jun 03 13:53:59.195285 ip-10-0-134-229 kubenswrapper[2574]: W0603 13:53:59.194653 2574 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jun 03 13:53:59.195285 ip-10-0-134-229 kubenswrapper[2574]: W0603 13:53:59.194656 2574 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jun 03 13:53:59.195285 ip-10-0-134-229 kubenswrapper[2574]: W0603 13:53:59.194659 2574 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jun 03 13:53:59.195285 ip-10-0-134-229 kubenswrapper[2574]: W0603 13:53:59.194662 2574 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jun 03 13:53:59.195285 ip-10-0-134-229 kubenswrapper[2574]: W0603 13:53:59.194664 2574 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jun 03 13:53:59.195285 ip-10-0-134-229 kubenswrapper[2574]: W0603 13:53:59.194667 2574 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jun 03 13:53:59.195285 ip-10-0-134-229 kubenswrapper[2574]: W0603 13:53:59.194671 2574 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jun 03 13:53:59.195285 ip-10-0-134-229 kubenswrapper[2574]: W0603 13:53:59.194673 2574 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jun 03 13:53:59.195285 ip-10-0-134-229 kubenswrapper[2574]: W0603 13:53:59.194676 2574 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jun 03 13:53:59.195285 ip-10-0-134-229 kubenswrapper[2574]: W0603 13:53:59.194679 2574 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jun 03 13:53:59.195285 ip-10-0-134-229 kubenswrapper[2574]: W0603 13:53:59.194681 2574 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jun 03 13:53:59.195285 ip-10-0-134-229 kubenswrapper[2574]: W0603 13:53:59.194684 2574 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jun 03 13:53:59.195813 ip-10-0-134-229 kubenswrapper[2574]: W0603 13:53:59.194687 2574 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jun 03 13:53:59.195813 ip-10-0-134-229 kubenswrapper[2574]: W0603 13:53:59.194689 2574 feature_gate.go:328] unrecognized feature gate: DualReplica Jun 03 13:53:59.195813 ip-10-0-134-229 kubenswrapper[2574]: W0603 13:53:59.194693 2574 feature_gate.go:328] unrecognized feature gate: SignatureStores Jun 03 13:53:59.195813 ip-10-0-134-229 kubenswrapper[2574]: W0603 13:53:59.194695 2574 feature_gate.go:328] unrecognized feature gate: Example Jun 03 13:53:59.195813 ip-10-0-134-229 kubenswrapper[2574]: W0603 13:53:59.194698 2574 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterOperations Jun 03 13:53:59.195813 ip-10-0-134-229 kubenswrapper[2574]: W0603 13:53:59.194701 2574 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jun 03 13:53:59.195813 ip-10-0-134-229 kubenswrapper[2574]: W0603 13:53:59.194703 2574 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jun 03 13:53:59.195813 ip-10-0-134-229 kubenswrapper[2574]: W0603 13:53:59.194706 2574 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jun 03 13:53:59.195813 ip-10-0-134-229 kubenswrapper[2574]: W0603 13:53:59.194708 2574 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jun 03 13:53:59.195813 ip-10-0-134-229 kubenswrapper[2574]: W0603 13:53:59.194711 2574 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jun 03 13:53:59.195813 ip-10-0-134-229 kubenswrapper[2574]: W0603 13:53:59.194714 2574 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jun 03 13:53:59.195813 ip-10-0-134-229 kubenswrapper[2574]: W0603 13:53:59.194716 2574 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jun 03 13:53:59.195813 ip-10-0-134-229 kubenswrapper[2574]: W0603 13:53:59.194719 2574 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jun 03 13:53:59.195813 ip-10-0-134-229 kubenswrapper[2574]: W0603 13:53:59.194721 2574 feature_gate.go:328] unrecognized feature gate: NewOLM Jun 03 13:53:59.195813 ip-10-0-134-229 kubenswrapper[2574]: W0603 13:53:59.194724 2574 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jun 03 13:53:59.195813 ip-10-0-134-229 kubenswrapper[2574]: W0603 13:53:59.194726 2574 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jun 03 13:53:59.195813 ip-10-0-134-229 kubenswrapper[2574]: W0603 13:53:59.194729 2574 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jun 03 13:53:59.195813 ip-10-0-134-229 kubenswrapper[2574]: W0603 13:53:59.194732 2574 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jun 03 13:53:59.195813 ip-10-0-134-229 kubenswrapper[2574]: W0603 13:53:59.194734 2574 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jun 03 13:53:59.195813 ip-10-0-134-229 kubenswrapper[2574]: W0603 13:53:59.194737 2574 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jun 03 13:53:59.196299 ip-10-0-134-229 kubenswrapper[2574]: W0603 13:53:59.194740 2574 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jun 03 13:53:59.196299 ip-10-0-134-229 kubenswrapper[2574]: W0603 13:53:59.194744 2574 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jun 03 13:53:59.196299 ip-10-0-134-229 kubenswrapper[2574]: W0603 13:53:59.194748 2574 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jun 03 13:53:59.196299 ip-10-0-134-229 kubenswrapper[2574]: W0603 13:53:59.194751 2574 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jun 03 13:53:59.196299 ip-10-0-134-229 kubenswrapper[2574]: W0603 13:53:59.194753 2574 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jun 03 13:53:59.196299 ip-10-0-134-229 kubenswrapper[2574]: W0603 13:53:59.194756 2574 feature_gate.go:328] unrecognized feature gate: SetEIPForNLBIngressController Jun 03 13:53:59.196299 ip-10-0-134-229 kubenswrapper[2574]: W0603 13:53:59.194760 2574 feature_gate.go:328] unrecognized feature gate: PinnedImages Jun 03 13:53:59.196299 ip-10-0-134-229 kubenswrapper[2574]: W0603 13:53:59.194763 2574 feature_gate.go:328] unrecognized feature gate: Example2 Jun 03 13:53:59.196299 ip-10-0-134-229 kubenswrapper[2574]: W0603 13:53:59.194765 2574 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jun 03 13:53:59.196299 ip-10-0-134-229 kubenswrapper[2574]: W0603 13:53:59.194768 2574 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jun 03 13:53:59.196299 ip-10-0-134-229 kubenswrapper[2574]: W0603 13:53:59.194770 2574 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jun 03 13:53:59.196299 ip-10-0-134-229 kubenswrapper[2574]: W0603 13:53:59.194773 2574 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jun 03 13:53:59.196299 ip-10-0-134-229 kubenswrapper[2574]: W0603 13:53:59.194776 2574 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jun 03 13:53:59.196299 ip-10-0-134-229 kubenswrapper[2574]: W0603 13:53:59.194778 2574 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jun 03 13:53:59.196299 ip-10-0-134-229 kubenswrapper[2574]: W0603 13:53:59.194781 2574 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jun 03 13:53:59.196299 ip-10-0-134-229 kubenswrapper[2574]: W0603 13:53:59.194784 2574 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jun 03 13:53:59.196299 ip-10-0-134-229 kubenswrapper[2574]: W0603 13:53:59.194787 2574 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jun 03 13:53:59.196299 ip-10-0-134-229 kubenswrapper[2574]: W0603 13:53:59.194789 2574 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jun 03 13:53:59.196299 ip-10-0-134-229 kubenswrapper[2574]: W0603 13:53:59.194791 2574 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jun 03 13:53:59.196299 ip-10-0-134-229 kubenswrapper[2574]: W0603 13:53:59.194794 2574 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jun 03 13:53:59.196800 ip-10-0-134-229 kubenswrapper[2574]: W0603 13:53:59.194796 2574 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jun 03 13:53:59.196800 ip-10-0-134-229 kubenswrapper[2574]: W0603 13:53:59.194799 2574 feature_gate.go:328] unrecognized feature gate: InsightsConfigAPI Jun 03 13:53:59.196800 ip-10-0-134-229 kubenswrapper[2574]: W0603 13:53:59.194801 2574 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jun 03 13:53:59.196800 ip-10-0-134-229 kubenswrapper[2574]: W0603 13:53:59.194804 2574 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jun 03 13:53:59.196800 ip-10-0-134-229 kubenswrapper[2574]: W0603 13:53:59.194806 2574 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jun 03 13:53:59.196800 ip-10-0-134-229 kubenswrapper[2574]: W0603 13:53:59.194809 2574 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jun 03 13:53:59.196800 ip-10-0-134-229 kubenswrapper[2574]: W0603 13:53:59.194811 2574 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jun 03 13:53:59.196800 ip-10-0-134-229 kubenswrapper[2574]: W0603 13:53:59.194814 2574 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jun 03 13:53:59.196800 ip-10-0-134-229 kubenswrapper[2574]: W0603 13:53:59.194816 2574 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jun 03 13:53:59.196800 ip-10-0-134-229 kubenswrapper[2574]: W0603 13:53:59.194821 2574 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jun 03 13:53:59.196800 ip-10-0-134-229 kubenswrapper[2574]: W0603 13:53:59.194825 2574 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jun 03 13:53:59.196800 ip-10-0-134-229 kubenswrapper[2574]: W0603 13:53:59.194827 2574 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jun 03 13:53:59.196800 ip-10-0-134-229 kubenswrapper[2574]: W0603 13:53:59.194830 2574 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jun 03 13:53:59.196800 ip-10-0-134-229 kubenswrapper[2574]: W0603 13:53:59.194833 2574 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jun 03 13:53:59.196800 ip-10-0-134-229 kubenswrapper[2574]: W0603 13:53:59.194835 2574 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jun 03 13:53:59.196800 ip-10-0-134-229 kubenswrapper[2574]: W0603 13:53:59.194838 2574 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jun 03 13:53:59.196800 ip-10-0-134-229 kubenswrapper[2574]: W0603 13:53:59.194840 2574 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jun 03 13:53:59.196800 ip-10-0-134-229 kubenswrapper[2574]: W0603 13:53:59.194843 2574 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jun 03 13:53:59.196800 ip-10-0-134-229 kubenswrapper[2574]: W0603 13:53:59.194845 2574 feature_gate.go:328] unrecognized feature gate: IngressControllerLBSubnetsAWS Jun 03 13:53:59.197284 ip-10-0-134-229 kubenswrapper[2574]: W0603 13:53:59.194848 2574 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jun 03 13:53:59.197284 ip-10-0-134-229 kubenswrapper[2574]: W0603 13:53:59.194850 2574 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jun 03 13:53:59.197284 ip-10-0-134-229 kubenswrapper[2574]: W0603 13:53:59.194855 2574 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jun 03 13:53:59.197284 ip-10-0-134-229 kubenswrapper[2574]: W0603 13:53:59.194857 2574 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jun 03 13:53:59.197284 ip-10-0-134-229 kubenswrapper[2574]: W0603 13:53:59.194860 2574 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jun 03 13:53:59.197284 ip-10-0-134-229 kubenswrapper[2574]: W0603 13:53:59.194862 2574 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jun 03 13:53:59.197284 ip-10-0-134-229 kubenswrapper[2574]: W0603 13:53:59.194865 2574 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jun 03 13:53:59.197284 ip-10-0-134-229 kubenswrapper[2574]: W0603 13:53:59.194867 2574 feature_gate.go:328] unrecognized feature gate: OVNObservability Jun 03 13:53:59.197284 ip-10-0-134-229 kubenswrapper[2574]: W0603 13:53:59.194869 2574 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jun 03 13:53:59.197284 ip-10-0-134-229 kubenswrapper[2574]: W0603 13:53:59.194872 2574 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jun 03 13:53:59.197284 ip-10-0-134-229 kubenswrapper[2574]: W0603 13:53:59.194875 2574 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jun 03 13:53:59.197284 ip-10-0-134-229 kubenswrapper[2574]: W0603 13:53:59.194877 2574 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jun 03 13:53:59.197284 ip-10-0-134-229 kubenswrapper[2574]: W0603 13:53:59.194879 2574 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jun 03 13:53:59.197284 ip-10-0-134-229 kubenswrapper[2574]: I0603 13:53:59.194942 2574 flags.go:64] FLAG: --address="0.0.0.0" Jun 03 13:53:59.197284 ip-10-0-134-229 kubenswrapper[2574]: I0603 13:53:59.194949 2574 flags.go:64] FLAG: --allowed-unsafe-sysctls="[]" Jun 03 13:53:59.197284 ip-10-0-134-229 kubenswrapper[2574]: I0603 13:53:59.194956 2574 flags.go:64] FLAG: --anonymous-auth="true" Jun 03 13:53:59.197284 ip-10-0-134-229 kubenswrapper[2574]: I0603 13:53:59.194960 2574 flags.go:64] FLAG: --application-metrics-count-limit="100" Jun 03 13:53:59.197284 ip-10-0-134-229 kubenswrapper[2574]: I0603 13:53:59.194964 2574 flags.go:64] FLAG: --authentication-token-webhook="false" Jun 03 13:53:59.197284 ip-10-0-134-229 kubenswrapper[2574]: I0603 13:53:59.194967 2574 flags.go:64] FLAG: --authentication-token-webhook-cache-ttl="2m0s" Jun 03 13:53:59.197284 ip-10-0-134-229 kubenswrapper[2574]: I0603 13:53:59.194972 2574 flags.go:64] FLAG: --authorization-mode="AlwaysAllow" Jun 03 13:53:59.197284 ip-10-0-134-229 kubenswrapper[2574]: I0603 13:53:59.194977 2574 flags.go:64] FLAG: --authorization-webhook-cache-authorized-ttl="5m0s" Jun 03 13:53:59.197811 ip-10-0-134-229 kubenswrapper[2574]: I0603 13:53:59.194981 2574 flags.go:64] FLAG: --authorization-webhook-cache-unauthorized-ttl="30s" Jun 03 13:53:59.197811 ip-10-0-134-229 kubenswrapper[2574]: I0603 13:53:59.194984 2574 flags.go:64] FLAG: --boot-id-file="/proc/sys/kernel/random/boot_id" Jun 03 13:53:59.197811 ip-10-0-134-229 kubenswrapper[2574]: I0603 13:53:59.194987 2574 flags.go:64] FLAG: --bootstrap-kubeconfig="/etc/kubernetes/kubeconfig" Jun 03 13:53:59.197811 ip-10-0-134-229 kubenswrapper[2574]: I0603 13:53:59.194990 2574 flags.go:64] FLAG: --cert-dir="/var/lib/kubelet/pki" Jun 03 13:53:59.197811 ip-10-0-134-229 kubenswrapper[2574]: I0603 13:53:59.194994 2574 flags.go:64] FLAG: --cgroup-driver="cgroupfs" Jun 03 13:53:59.197811 ip-10-0-134-229 kubenswrapper[2574]: I0603 13:53:59.194997 2574 flags.go:64] FLAG: --cgroup-root="" Jun 03 13:53:59.197811 ip-10-0-134-229 kubenswrapper[2574]: I0603 13:53:59.195000 2574 flags.go:64] FLAG: --cgroups-per-qos="true" Jun 03 13:53:59.197811 ip-10-0-134-229 kubenswrapper[2574]: I0603 13:53:59.195003 2574 flags.go:64] FLAG: --client-ca-file="" Jun 03 13:53:59.197811 ip-10-0-134-229 kubenswrapper[2574]: I0603 13:53:59.195006 2574 flags.go:64] FLAG: --cloud-config="" Jun 03 13:53:59.197811 ip-10-0-134-229 kubenswrapper[2574]: I0603 13:53:59.195008 2574 flags.go:64] FLAG: --cloud-provider="external" Jun 03 13:53:59.197811 ip-10-0-134-229 kubenswrapper[2574]: I0603 13:53:59.195012 2574 flags.go:64] FLAG: --cluster-dns="[]" Jun 03 13:53:59.197811 ip-10-0-134-229 kubenswrapper[2574]: I0603 13:53:59.195016 2574 flags.go:64] FLAG: --cluster-domain="" Jun 03 13:53:59.197811 ip-10-0-134-229 kubenswrapper[2574]: I0603 13:53:59.195019 2574 flags.go:64] FLAG: --config="/etc/kubernetes/kubelet.conf" Jun 03 13:53:59.197811 ip-10-0-134-229 kubenswrapper[2574]: I0603 13:53:59.195022 2574 flags.go:64] FLAG: --config-dir="" Jun 03 13:53:59.197811 ip-10-0-134-229 kubenswrapper[2574]: I0603 13:53:59.195025 2574 flags.go:64] FLAG: --container-hints="/etc/cadvisor/container_hints.json" Jun 03 13:53:59.197811 ip-10-0-134-229 kubenswrapper[2574]: I0603 13:53:59.195029 2574 flags.go:64] FLAG: --container-log-max-files="5" Jun 03 13:53:59.197811 ip-10-0-134-229 kubenswrapper[2574]: I0603 13:53:59.195033 2574 flags.go:64] FLAG: --container-log-max-size="10Mi" Jun 03 13:53:59.197811 ip-10-0-134-229 kubenswrapper[2574]: I0603 13:53:59.195036 2574 flags.go:64] FLAG: --container-runtime-endpoint="/var/run/crio/crio.sock" Jun 03 13:53:59.197811 ip-10-0-134-229 kubenswrapper[2574]: I0603 13:53:59.195039 2574 flags.go:64] FLAG: --containerd="/run/containerd/containerd.sock" Jun 03 13:53:59.197811 ip-10-0-134-229 kubenswrapper[2574]: I0603 13:53:59.195043 2574 flags.go:64] FLAG: --containerd-namespace="k8s.io" Jun 03 13:53:59.197811 ip-10-0-134-229 kubenswrapper[2574]: I0603 13:53:59.195046 2574 flags.go:64] FLAG: --contention-profiling="false" Jun 03 13:53:59.197811 ip-10-0-134-229 kubenswrapper[2574]: I0603 13:53:59.195050 2574 flags.go:64] FLAG: --cpu-cfs-quota="true" Jun 03 13:53:59.197811 ip-10-0-134-229 kubenswrapper[2574]: I0603 13:53:59.195053 2574 flags.go:64] FLAG: --cpu-cfs-quota-period="100ms" Jun 03 13:53:59.197811 ip-10-0-134-229 kubenswrapper[2574]: I0603 13:53:59.195057 2574 flags.go:64] FLAG: --cpu-manager-policy="none" Jun 03 13:53:59.197811 ip-10-0-134-229 kubenswrapper[2574]: I0603 13:53:59.195061 2574 flags.go:64] FLAG: --cpu-manager-policy-options="" Jun 03 13:53:59.198444 ip-10-0-134-229 kubenswrapper[2574]: I0603 13:53:59.195065 2574 flags.go:64] FLAG: --cpu-manager-reconcile-period="10s" Jun 03 13:53:59.198444 ip-10-0-134-229 kubenswrapper[2574]: I0603 13:53:59.195068 2574 flags.go:64] FLAG: --enable-controller-attach-detach="true" Jun 03 13:53:59.198444 ip-10-0-134-229 kubenswrapper[2574]: I0603 13:53:59.195071 2574 flags.go:64] FLAG: --enable-debugging-handlers="true" Jun 03 13:53:59.198444 ip-10-0-134-229 kubenswrapper[2574]: I0603 13:53:59.195073 2574 flags.go:64] FLAG: --enable-load-reader="false" Jun 03 13:53:59.198444 ip-10-0-134-229 kubenswrapper[2574]: I0603 13:53:59.195076 2574 flags.go:64] FLAG: --enable-server="true" Jun 03 13:53:59.198444 ip-10-0-134-229 kubenswrapper[2574]: I0603 13:53:59.195079 2574 flags.go:64] FLAG: --enforce-node-allocatable="[pods]" Jun 03 13:53:59.198444 ip-10-0-134-229 kubenswrapper[2574]: I0603 13:53:59.195084 2574 flags.go:64] FLAG: --event-burst="100" Jun 03 13:53:59.198444 ip-10-0-134-229 kubenswrapper[2574]: I0603 13:53:59.195087 2574 flags.go:64] FLAG: --event-qps="50" Jun 03 13:53:59.198444 ip-10-0-134-229 kubenswrapper[2574]: I0603 13:53:59.195090 2574 flags.go:64] FLAG: --event-storage-age-limit="default=0" Jun 03 13:53:59.198444 ip-10-0-134-229 kubenswrapper[2574]: I0603 13:53:59.195093 2574 flags.go:64] FLAG: --event-storage-event-limit="default=0" Jun 03 13:53:59.198444 ip-10-0-134-229 kubenswrapper[2574]: I0603 13:53:59.195096 2574 flags.go:64] FLAG: --eviction-hard="" Jun 03 13:53:59.198444 ip-10-0-134-229 kubenswrapper[2574]: I0603 13:53:59.195100 2574 flags.go:64] FLAG: --eviction-max-pod-grace-period="0" Jun 03 13:53:59.198444 ip-10-0-134-229 kubenswrapper[2574]: I0603 13:53:59.195103 2574 flags.go:64] FLAG: --eviction-minimum-reclaim="" Jun 03 13:53:59.198444 ip-10-0-134-229 kubenswrapper[2574]: I0603 13:53:59.195107 2574 flags.go:64] FLAG: --eviction-pressure-transition-period="5m0s" Jun 03 13:53:59.198444 ip-10-0-134-229 kubenswrapper[2574]: I0603 13:53:59.195110 2574 flags.go:64] FLAG: --eviction-soft="" Jun 03 13:53:59.198444 ip-10-0-134-229 kubenswrapper[2574]: I0603 13:53:59.195113 2574 flags.go:64] FLAG: --eviction-soft-grace-period="" Jun 03 13:53:59.198444 ip-10-0-134-229 kubenswrapper[2574]: I0603 13:53:59.195116 2574 flags.go:64] FLAG: --exit-on-lock-contention="false" Jun 03 13:53:59.198444 ip-10-0-134-229 kubenswrapper[2574]: I0603 13:53:59.195119 2574 flags.go:64] FLAG: --experimental-allocatable-ignore-eviction="false" Jun 03 13:53:59.198444 ip-10-0-134-229 kubenswrapper[2574]: I0603 13:53:59.195122 2574 flags.go:64] FLAG: --experimental-mounter-path="" Jun 03 13:53:59.198444 ip-10-0-134-229 kubenswrapper[2574]: I0603 13:53:59.195125 2574 flags.go:64] FLAG: --fail-cgroupv1="false" Jun 03 13:53:59.198444 ip-10-0-134-229 kubenswrapper[2574]: I0603 13:53:59.195128 2574 flags.go:64] FLAG: --fail-swap-on="true" Jun 03 13:53:59.198444 ip-10-0-134-229 kubenswrapper[2574]: I0603 13:53:59.195130 2574 flags.go:64] FLAG: --feature-gates="" Jun 03 13:53:59.198444 ip-10-0-134-229 kubenswrapper[2574]: I0603 13:53:59.195134 2574 flags.go:64] FLAG: --file-check-frequency="20s" Jun 03 13:53:59.198444 ip-10-0-134-229 kubenswrapper[2574]: I0603 13:53:59.195138 2574 flags.go:64] FLAG: --global-housekeeping-interval="1m0s" Jun 03 13:53:59.198444 ip-10-0-134-229 kubenswrapper[2574]: I0603 13:53:59.195141 2574 flags.go:64] FLAG: --hairpin-mode="promiscuous-bridge" Jun 03 13:53:59.199045 ip-10-0-134-229 kubenswrapper[2574]: I0603 13:53:59.195144 2574 flags.go:64] FLAG: --healthz-bind-address="127.0.0.1" Jun 03 13:53:59.199045 ip-10-0-134-229 kubenswrapper[2574]: I0603 13:53:59.195147 2574 flags.go:64] FLAG: --healthz-port="10248" Jun 03 13:53:59.199045 ip-10-0-134-229 kubenswrapper[2574]: I0603 13:53:59.195150 2574 flags.go:64] FLAG: --help="false" Jun 03 13:53:59.199045 ip-10-0-134-229 kubenswrapper[2574]: I0603 13:53:59.195153 2574 flags.go:64] FLAG: --hostname-override="ip-10-0-134-229.ec2.internal" Jun 03 13:53:59.199045 ip-10-0-134-229 kubenswrapper[2574]: I0603 13:53:59.195156 2574 flags.go:64] FLAG: --housekeeping-interval="10s" Jun 03 13:53:59.199045 ip-10-0-134-229 kubenswrapper[2574]: I0603 13:53:59.195159 2574 flags.go:64] FLAG: --http-check-frequency="20s" Jun 03 13:53:59.199045 ip-10-0-134-229 kubenswrapper[2574]: I0603 13:53:59.195162 2574 flags.go:64] FLAG: --image-credential-provider-bin-dir="/usr/libexec/kubelet-image-credential-provider-plugins" Jun 03 13:53:59.199045 ip-10-0-134-229 kubenswrapper[2574]: I0603 13:53:59.195165 2574 flags.go:64] FLAG: --image-credential-provider-config="/etc/kubernetes/credential-providers/ecr-credential-provider.yaml" Jun 03 13:53:59.199045 ip-10-0-134-229 kubenswrapper[2574]: I0603 13:53:59.195168 2574 flags.go:64] FLAG: --image-gc-high-threshold="85" Jun 03 13:53:59.199045 ip-10-0-134-229 kubenswrapper[2574]: I0603 13:53:59.195171 2574 flags.go:64] FLAG: --image-gc-low-threshold="80" Jun 03 13:53:59.199045 ip-10-0-134-229 kubenswrapper[2574]: I0603 13:53:59.195174 2574 flags.go:64] FLAG: --image-service-endpoint="" Jun 03 13:53:59.199045 ip-10-0-134-229 kubenswrapper[2574]: I0603 13:53:59.195177 2574 flags.go:64] FLAG: --kernel-memcg-notification="false" Jun 03 13:53:59.199045 ip-10-0-134-229 kubenswrapper[2574]: I0603 13:53:59.195180 2574 flags.go:64] FLAG: --kube-api-burst="100" Jun 03 13:53:59.199045 ip-10-0-134-229 kubenswrapper[2574]: I0603 13:53:59.195183 2574 flags.go:64] FLAG: --kube-api-content-type="application/vnd.kubernetes.protobuf" Jun 03 13:53:59.199045 ip-10-0-134-229 kubenswrapper[2574]: I0603 13:53:59.195186 2574 flags.go:64] FLAG: --kube-api-qps="50" Jun 03 13:53:59.199045 ip-10-0-134-229 kubenswrapper[2574]: I0603 13:53:59.195189 2574 flags.go:64] FLAG: --kube-reserved="" Jun 03 13:53:59.199045 ip-10-0-134-229 kubenswrapper[2574]: I0603 13:53:59.195193 2574 flags.go:64] FLAG: --kube-reserved-cgroup="" Jun 03 13:53:59.199045 ip-10-0-134-229 kubenswrapper[2574]: I0603 13:53:59.195196 2574 flags.go:64] FLAG: --kubeconfig="/var/lib/kubelet/kubeconfig" Jun 03 13:53:59.199045 ip-10-0-134-229 kubenswrapper[2574]: I0603 13:53:59.195199 2574 flags.go:64] FLAG: --kubelet-cgroups="" Jun 03 13:53:59.199045 ip-10-0-134-229 kubenswrapper[2574]: I0603 13:53:59.195202 2574 flags.go:64] FLAG: --local-storage-capacity-isolation="true" Jun 03 13:53:59.199045 ip-10-0-134-229 kubenswrapper[2574]: I0603 13:53:59.195205 2574 flags.go:64] FLAG: --lock-file="" Jun 03 13:53:59.199045 ip-10-0-134-229 kubenswrapper[2574]: I0603 13:53:59.195208 2574 flags.go:64] FLAG: --log-cadvisor-usage="false" Jun 03 13:53:59.199045 ip-10-0-134-229 kubenswrapper[2574]: I0603 13:53:59.195211 2574 flags.go:64] FLAG: --log-flush-frequency="5s" Jun 03 13:53:59.199045 ip-10-0-134-229 kubenswrapper[2574]: I0603 13:53:59.195214 2574 flags.go:64] FLAG: --log-json-info-buffer-size="0" Jun 03 13:53:59.199631 ip-10-0-134-229 kubenswrapper[2574]: I0603 13:53:59.195222 2574 flags.go:64] FLAG: --log-json-split-stream="false" Jun 03 13:53:59.199631 ip-10-0-134-229 kubenswrapper[2574]: I0603 13:53:59.195225 2574 flags.go:64] FLAG: --log-text-info-buffer-size="0" Jun 03 13:53:59.199631 ip-10-0-134-229 kubenswrapper[2574]: I0603 13:53:59.195228 2574 flags.go:64] FLAG: --log-text-split-stream="false" Jun 03 13:53:59.199631 ip-10-0-134-229 kubenswrapper[2574]: I0603 13:53:59.195231 2574 flags.go:64] FLAG: --logging-format="text" Jun 03 13:53:59.199631 ip-10-0-134-229 kubenswrapper[2574]: I0603 13:53:59.195234 2574 flags.go:64] FLAG: --machine-id-file="/etc/machine-id,/var/lib/dbus/machine-id" Jun 03 13:53:59.199631 ip-10-0-134-229 kubenswrapper[2574]: I0603 13:53:59.195238 2574 flags.go:64] FLAG: --make-iptables-util-chains="true" Jun 03 13:53:59.199631 ip-10-0-134-229 kubenswrapper[2574]: I0603 13:53:59.195241 2574 flags.go:64] FLAG: --manifest-url="" Jun 03 13:53:59.199631 ip-10-0-134-229 kubenswrapper[2574]: I0603 13:53:59.195243 2574 flags.go:64] FLAG: --manifest-url-header="" Jun 03 13:53:59.199631 ip-10-0-134-229 kubenswrapper[2574]: I0603 13:53:59.195248 2574 flags.go:64] FLAG: --max-housekeeping-interval="15s" Jun 03 13:53:59.199631 ip-10-0-134-229 kubenswrapper[2574]: I0603 13:53:59.195251 2574 flags.go:64] FLAG: --max-open-files="1000000" Jun 03 13:53:59.199631 ip-10-0-134-229 kubenswrapper[2574]: I0603 13:53:59.195255 2574 flags.go:64] FLAG: --max-pods="110" Jun 03 13:53:59.199631 ip-10-0-134-229 kubenswrapper[2574]: I0603 13:53:59.195258 2574 flags.go:64] FLAG: --maximum-dead-containers="-1" Jun 03 13:53:59.199631 ip-10-0-134-229 kubenswrapper[2574]: I0603 13:53:59.195261 2574 flags.go:64] FLAG: --maximum-dead-containers-per-container="1" Jun 03 13:53:59.199631 ip-10-0-134-229 kubenswrapper[2574]: I0603 13:53:59.195264 2574 flags.go:64] FLAG: --memory-manager-policy="None" Jun 03 13:53:59.199631 ip-10-0-134-229 kubenswrapper[2574]: I0603 13:53:59.195267 2574 flags.go:64] FLAG: --minimum-container-ttl-duration="6m0s" Jun 03 13:53:59.199631 ip-10-0-134-229 kubenswrapper[2574]: I0603 13:53:59.195270 2574 flags.go:64] FLAG: --minimum-image-ttl-duration="2m0s" Jun 03 13:53:59.199631 ip-10-0-134-229 kubenswrapper[2574]: I0603 13:53:59.195273 2574 flags.go:64] FLAG: --node-ip="0.0.0.0" Jun 03 13:53:59.199631 ip-10-0-134-229 kubenswrapper[2574]: I0603 13:53:59.195276 2574 flags.go:64] FLAG: --node-labels="node-role.kubernetes.io/worker=,node.openshift.io/os_id=rhel" Jun 03 13:53:59.199631 ip-10-0-134-229 kubenswrapper[2574]: I0603 13:53:59.195288 2574 flags.go:64] FLAG: --node-status-max-images="50" Jun 03 13:53:59.199631 ip-10-0-134-229 kubenswrapper[2574]: I0603 13:53:59.195291 2574 flags.go:64] FLAG: --node-status-update-frequency="10s" Jun 03 13:53:59.199631 ip-10-0-134-229 kubenswrapper[2574]: I0603 13:53:59.195294 2574 flags.go:64] FLAG: --oom-score-adj="-999" Jun 03 13:53:59.199631 ip-10-0-134-229 kubenswrapper[2574]: I0603 13:53:59.195297 2574 flags.go:64] FLAG: --pod-cidr="" Jun 03 13:53:59.199631 ip-10-0-134-229 kubenswrapper[2574]: I0603 13:53:59.195300 2574 flags.go:64] FLAG: --pod-infra-container-image="quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:f1083dc6abd9805f79797fa11c9accacc4a38caa073c94cb99097faffce05983" Jun 03 13:53:59.200203 ip-10-0-134-229 kubenswrapper[2574]: I0603 13:53:59.195306 2574 flags.go:64] FLAG: --pod-manifest-path="" Jun 03 13:53:59.200203 ip-10-0-134-229 kubenswrapper[2574]: I0603 13:53:59.195309 2574 flags.go:64] FLAG: --pod-max-pids="-1" Jun 03 13:53:59.200203 ip-10-0-134-229 kubenswrapper[2574]: I0603 13:53:59.195312 2574 flags.go:64] FLAG: --pods-per-core="0" Jun 03 13:53:59.200203 ip-10-0-134-229 kubenswrapper[2574]: I0603 13:53:59.195315 2574 flags.go:64] FLAG: --port="10250" Jun 03 13:53:59.200203 ip-10-0-134-229 kubenswrapper[2574]: I0603 13:53:59.195318 2574 flags.go:64] FLAG: --protect-kernel-defaults="false" Jun 03 13:53:59.200203 ip-10-0-134-229 kubenswrapper[2574]: I0603 13:53:59.195321 2574 flags.go:64] FLAG: --provider-id="aws:///us-east-1a/i-0b067ebfd8e5f237f" Jun 03 13:53:59.200203 ip-10-0-134-229 kubenswrapper[2574]: I0603 13:53:59.195324 2574 flags.go:64] FLAG: --qos-reserved="" Jun 03 13:53:59.200203 ip-10-0-134-229 kubenswrapper[2574]: I0603 13:53:59.195327 2574 flags.go:64] FLAG: --read-only-port="10255" Jun 03 13:53:59.200203 ip-10-0-134-229 kubenswrapper[2574]: I0603 13:53:59.195330 2574 flags.go:64] FLAG: --register-node="true" Jun 03 13:53:59.200203 ip-10-0-134-229 kubenswrapper[2574]: I0603 13:53:59.195337 2574 flags.go:64] FLAG: --register-schedulable="true" Jun 03 13:53:59.200203 ip-10-0-134-229 kubenswrapper[2574]: I0603 13:53:59.195341 2574 flags.go:64] FLAG: --register-with-taints="" Jun 03 13:53:59.200203 ip-10-0-134-229 kubenswrapper[2574]: I0603 13:53:59.195344 2574 flags.go:64] FLAG: --registry-burst="10" Jun 03 13:53:59.200203 ip-10-0-134-229 kubenswrapper[2574]: I0603 13:53:59.195347 2574 flags.go:64] FLAG: --registry-qps="5" Jun 03 13:53:59.200203 ip-10-0-134-229 kubenswrapper[2574]: I0603 13:53:59.195350 2574 flags.go:64] FLAG: --reserved-cpus="" Jun 03 13:53:59.200203 ip-10-0-134-229 kubenswrapper[2574]: I0603 13:53:59.195353 2574 flags.go:64] FLAG: --reserved-memory="" Jun 03 13:53:59.200203 ip-10-0-134-229 kubenswrapper[2574]: I0603 13:53:59.195357 2574 flags.go:64] FLAG: --resolv-conf="/etc/resolv.conf" Jun 03 13:53:59.200203 ip-10-0-134-229 kubenswrapper[2574]: I0603 13:53:59.195360 2574 flags.go:64] FLAG: --root-dir="/var/lib/kubelet" Jun 03 13:53:59.200203 ip-10-0-134-229 kubenswrapper[2574]: I0603 13:53:59.195363 2574 flags.go:64] FLAG: --rotate-certificates="false" Jun 03 13:53:59.200203 ip-10-0-134-229 kubenswrapper[2574]: I0603 13:53:59.195366 2574 flags.go:64] FLAG: --rotate-server-certificates="false" Jun 03 13:53:59.200203 ip-10-0-134-229 kubenswrapper[2574]: I0603 13:53:59.195369 2574 flags.go:64] FLAG: --runonce="false" Jun 03 13:53:59.200203 ip-10-0-134-229 kubenswrapper[2574]: I0603 13:53:59.195384 2574 flags.go:64] FLAG: --runtime-cgroups="/system.slice/crio.service" Jun 03 13:53:59.200203 ip-10-0-134-229 kubenswrapper[2574]: I0603 13:53:59.195388 2574 flags.go:64] FLAG: --runtime-request-timeout="2m0s" Jun 03 13:53:59.200203 ip-10-0-134-229 kubenswrapper[2574]: I0603 13:53:59.195390 2574 flags.go:64] FLAG: --seccomp-default="false" Jun 03 13:53:59.200203 ip-10-0-134-229 kubenswrapper[2574]: I0603 13:53:59.195394 2574 flags.go:64] FLAG: --serialize-image-pulls="true" Jun 03 13:53:59.200203 ip-10-0-134-229 kubenswrapper[2574]: I0603 13:53:59.195397 2574 flags.go:64] FLAG: --storage-driver-buffer-duration="1m0s" Jun 03 13:53:59.200203 ip-10-0-134-229 kubenswrapper[2574]: I0603 13:53:59.195400 2574 flags.go:64] FLAG: --storage-driver-db="cadvisor" Jun 03 13:53:59.200866 ip-10-0-134-229 kubenswrapper[2574]: I0603 13:53:59.195403 2574 flags.go:64] FLAG: --storage-driver-host="localhost:8086" Jun 03 13:53:59.200866 ip-10-0-134-229 kubenswrapper[2574]: I0603 13:53:59.195408 2574 flags.go:64] FLAG: --storage-driver-password="root" Jun 03 13:53:59.200866 ip-10-0-134-229 kubenswrapper[2574]: I0603 13:53:59.195411 2574 flags.go:64] FLAG: --storage-driver-secure="false" Jun 03 13:53:59.200866 ip-10-0-134-229 kubenswrapper[2574]: I0603 13:53:59.195414 2574 flags.go:64] FLAG: --storage-driver-table="stats" Jun 03 13:53:59.200866 ip-10-0-134-229 kubenswrapper[2574]: I0603 13:53:59.195417 2574 flags.go:64] FLAG: --storage-driver-user="root" Jun 03 13:53:59.200866 ip-10-0-134-229 kubenswrapper[2574]: I0603 13:53:59.195420 2574 flags.go:64] FLAG: --streaming-connection-idle-timeout="4h0m0s" Jun 03 13:53:59.200866 ip-10-0-134-229 kubenswrapper[2574]: I0603 13:53:59.195423 2574 flags.go:64] FLAG: --sync-frequency="1m0s" Jun 03 13:53:59.200866 ip-10-0-134-229 kubenswrapper[2574]: I0603 13:53:59.195425 2574 flags.go:64] FLAG: --system-cgroups="" Jun 03 13:53:59.200866 ip-10-0-134-229 kubenswrapper[2574]: I0603 13:53:59.195428 2574 flags.go:64] FLAG: --system-reserved="cpu=500m,ephemeral-storage=1Gi,memory=1Gi" Jun 03 13:53:59.200866 ip-10-0-134-229 kubenswrapper[2574]: I0603 13:53:59.195434 2574 flags.go:64] FLAG: --system-reserved-cgroup="" Jun 03 13:53:59.200866 ip-10-0-134-229 kubenswrapper[2574]: I0603 13:53:59.195437 2574 flags.go:64] FLAG: --tls-cert-file="" Jun 03 13:53:59.200866 ip-10-0-134-229 kubenswrapper[2574]: I0603 13:53:59.195440 2574 flags.go:64] FLAG: --tls-cipher-suites="[]" Jun 03 13:53:59.200866 ip-10-0-134-229 kubenswrapper[2574]: I0603 13:53:59.195444 2574 flags.go:64] FLAG: --tls-min-version="" Jun 03 13:53:59.200866 ip-10-0-134-229 kubenswrapper[2574]: I0603 13:53:59.195447 2574 flags.go:64] FLAG: --tls-private-key-file="" Jun 03 13:53:59.200866 ip-10-0-134-229 kubenswrapper[2574]: I0603 13:53:59.195450 2574 flags.go:64] FLAG: --topology-manager-policy="none" Jun 03 13:53:59.200866 ip-10-0-134-229 kubenswrapper[2574]: I0603 13:53:59.195454 2574 flags.go:64] FLAG: --topology-manager-policy-options="" Jun 03 13:53:59.200866 ip-10-0-134-229 kubenswrapper[2574]: I0603 13:53:59.195457 2574 flags.go:64] FLAG: --topology-manager-scope="container" Jun 03 13:53:59.200866 ip-10-0-134-229 kubenswrapper[2574]: I0603 13:53:59.195460 2574 flags.go:64] FLAG: --v="2" Jun 03 13:53:59.200866 ip-10-0-134-229 kubenswrapper[2574]: I0603 13:53:59.195464 2574 flags.go:64] FLAG: --version="false" Jun 03 13:53:59.200866 ip-10-0-134-229 kubenswrapper[2574]: I0603 13:53:59.195468 2574 flags.go:64] FLAG: --vmodule="" Jun 03 13:53:59.200866 ip-10-0-134-229 kubenswrapper[2574]: I0603 13:53:59.195472 2574 flags.go:64] FLAG: --volume-plugin-dir="/etc/kubernetes/kubelet-plugins/volume/exec" Jun 03 13:53:59.200866 ip-10-0-134-229 kubenswrapper[2574]: I0603 13:53:59.195476 2574 flags.go:64] FLAG: --volume-stats-agg-period="1m0s" Jun 03 13:53:59.200866 ip-10-0-134-229 kubenswrapper[2574]: W0603 13:53:59.195559 2574 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jun 03 13:53:59.200866 ip-10-0-134-229 kubenswrapper[2574]: W0603 13:53:59.195562 2574 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jun 03 13:53:59.201478 ip-10-0-134-229 kubenswrapper[2574]: W0603 13:53:59.195566 2574 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jun 03 13:53:59.201478 ip-10-0-134-229 kubenswrapper[2574]: W0603 13:53:59.195570 2574 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jun 03 13:53:59.201478 ip-10-0-134-229 kubenswrapper[2574]: W0603 13:53:59.195573 2574 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jun 03 13:53:59.201478 ip-10-0-134-229 kubenswrapper[2574]: W0603 13:53:59.195576 2574 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jun 03 13:53:59.201478 ip-10-0-134-229 kubenswrapper[2574]: W0603 13:53:59.195579 2574 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jun 03 13:53:59.201478 ip-10-0-134-229 kubenswrapper[2574]: W0603 13:53:59.195582 2574 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jun 03 13:53:59.201478 ip-10-0-134-229 kubenswrapper[2574]: W0603 13:53:59.195585 2574 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jun 03 13:53:59.201478 ip-10-0-134-229 kubenswrapper[2574]: W0603 13:53:59.195588 2574 feature_gate.go:328] unrecognized feature gate: Example Jun 03 13:53:59.201478 ip-10-0-134-229 kubenswrapper[2574]: W0603 13:53:59.195591 2574 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jun 03 13:53:59.201478 ip-10-0-134-229 kubenswrapper[2574]: W0603 13:53:59.195595 2574 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jun 03 13:53:59.201478 ip-10-0-134-229 kubenswrapper[2574]: W0603 13:53:59.195597 2574 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jun 03 13:53:59.201478 ip-10-0-134-229 kubenswrapper[2574]: W0603 13:53:59.195600 2574 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jun 03 13:53:59.201478 ip-10-0-134-229 kubenswrapper[2574]: W0603 13:53:59.195603 2574 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jun 03 13:53:59.201478 ip-10-0-134-229 kubenswrapper[2574]: W0603 13:53:59.195606 2574 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jun 03 13:53:59.201478 ip-10-0-134-229 kubenswrapper[2574]: W0603 13:53:59.195609 2574 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jun 03 13:53:59.201478 ip-10-0-134-229 kubenswrapper[2574]: W0603 13:53:59.195611 2574 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jun 03 13:53:59.201478 ip-10-0-134-229 kubenswrapper[2574]: W0603 13:53:59.195614 2574 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jun 03 13:53:59.201478 ip-10-0-134-229 kubenswrapper[2574]: W0603 13:53:59.195616 2574 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jun 03 13:53:59.201478 ip-10-0-134-229 kubenswrapper[2574]: W0603 13:53:59.195619 2574 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jun 03 13:53:59.201978 ip-10-0-134-229 kubenswrapper[2574]: W0603 13:53:59.195621 2574 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jun 03 13:53:59.201978 ip-10-0-134-229 kubenswrapper[2574]: W0603 13:53:59.195624 2574 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jun 03 13:53:59.201978 ip-10-0-134-229 kubenswrapper[2574]: W0603 13:53:59.195627 2574 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jun 03 13:53:59.201978 ip-10-0-134-229 kubenswrapper[2574]: W0603 13:53:59.195629 2574 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jun 03 13:53:59.201978 ip-10-0-134-229 kubenswrapper[2574]: W0603 13:53:59.195633 2574 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jun 03 13:53:59.201978 ip-10-0-134-229 kubenswrapper[2574]: W0603 13:53:59.195635 2574 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jun 03 13:53:59.201978 ip-10-0-134-229 kubenswrapper[2574]: W0603 13:53:59.195638 2574 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jun 03 13:53:59.201978 ip-10-0-134-229 kubenswrapper[2574]: W0603 13:53:59.195640 2574 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jun 03 13:53:59.201978 ip-10-0-134-229 kubenswrapper[2574]: W0603 13:53:59.195642 2574 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jun 03 13:53:59.201978 ip-10-0-134-229 kubenswrapper[2574]: W0603 13:53:59.195645 2574 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jun 03 13:53:59.201978 ip-10-0-134-229 kubenswrapper[2574]: W0603 13:53:59.195648 2574 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jun 03 13:53:59.201978 ip-10-0-134-229 kubenswrapper[2574]: W0603 13:53:59.195650 2574 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jun 03 13:53:59.201978 ip-10-0-134-229 kubenswrapper[2574]: W0603 13:53:59.195653 2574 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jun 03 13:53:59.201978 ip-10-0-134-229 kubenswrapper[2574]: W0603 13:53:59.195655 2574 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jun 03 13:53:59.201978 ip-10-0-134-229 kubenswrapper[2574]: W0603 13:53:59.195657 2574 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jun 03 13:53:59.201978 ip-10-0-134-229 kubenswrapper[2574]: W0603 13:53:59.195660 2574 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jun 03 13:53:59.201978 ip-10-0-134-229 kubenswrapper[2574]: W0603 13:53:59.195662 2574 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jun 03 13:53:59.201978 ip-10-0-134-229 kubenswrapper[2574]: W0603 13:53:59.195665 2574 feature_gate.go:328] unrecognized feature gate: InsightsConfigAPI Jun 03 13:53:59.201978 ip-10-0-134-229 kubenswrapper[2574]: W0603 13:53:59.195667 2574 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jun 03 13:53:59.201978 ip-10-0-134-229 kubenswrapper[2574]: W0603 13:53:59.195670 2574 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jun 03 13:53:59.202850 ip-10-0-134-229 kubenswrapper[2574]: W0603 13:53:59.195673 2574 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jun 03 13:53:59.202850 ip-10-0-134-229 kubenswrapper[2574]: W0603 13:53:59.195675 2574 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jun 03 13:53:59.202850 ip-10-0-134-229 kubenswrapper[2574]: W0603 13:53:59.195679 2574 feature_gate.go:328] unrecognized feature gate: SignatureStores Jun 03 13:53:59.202850 ip-10-0-134-229 kubenswrapper[2574]: W0603 13:53:59.195681 2574 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jun 03 13:53:59.202850 ip-10-0-134-229 kubenswrapper[2574]: W0603 13:53:59.195684 2574 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jun 03 13:53:59.202850 ip-10-0-134-229 kubenswrapper[2574]: W0603 13:53:59.195687 2574 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jun 03 13:53:59.202850 ip-10-0-134-229 kubenswrapper[2574]: W0603 13:53:59.195689 2574 feature_gate.go:328] unrecognized feature gate: IngressControllerLBSubnetsAWS Jun 03 13:53:59.202850 ip-10-0-134-229 kubenswrapper[2574]: W0603 13:53:59.195691 2574 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jun 03 13:53:59.202850 ip-10-0-134-229 kubenswrapper[2574]: W0603 13:53:59.195694 2574 feature_gate.go:328] unrecognized feature gate: OVNObservability Jun 03 13:53:59.202850 ip-10-0-134-229 kubenswrapper[2574]: W0603 13:53:59.195696 2574 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jun 03 13:53:59.202850 ip-10-0-134-229 kubenswrapper[2574]: W0603 13:53:59.195699 2574 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jun 03 13:53:59.202850 ip-10-0-134-229 kubenswrapper[2574]: W0603 13:53:59.195702 2574 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jun 03 13:53:59.202850 ip-10-0-134-229 kubenswrapper[2574]: W0603 13:53:59.195705 2574 feature_gate.go:328] unrecognized feature gate: SetEIPForNLBIngressController Jun 03 13:53:59.202850 ip-10-0-134-229 kubenswrapper[2574]: W0603 13:53:59.195707 2574 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jun 03 13:53:59.202850 ip-10-0-134-229 kubenswrapper[2574]: W0603 13:53:59.195709 2574 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jun 03 13:53:59.202850 ip-10-0-134-229 kubenswrapper[2574]: W0603 13:53:59.195712 2574 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jun 03 13:53:59.202850 ip-10-0-134-229 kubenswrapper[2574]: W0603 13:53:59.195716 2574 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jun 03 13:53:59.202850 ip-10-0-134-229 kubenswrapper[2574]: W0603 13:53:59.195718 2574 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jun 03 13:53:59.202850 ip-10-0-134-229 kubenswrapper[2574]: W0603 13:53:59.195721 2574 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jun 03 13:53:59.203539 ip-10-0-134-229 kubenswrapper[2574]: W0603 13:53:59.195724 2574 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jun 03 13:53:59.203539 ip-10-0-134-229 kubenswrapper[2574]: W0603 13:53:59.195728 2574 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jun 03 13:53:59.203539 ip-10-0-134-229 kubenswrapper[2574]: W0603 13:53:59.195731 2574 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jun 03 13:53:59.203539 ip-10-0-134-229 kubenswrapper[2574]: W0603 13:53:59.195734 2574 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jun 03 13:53:59.203539 ip-10-0-134-229 kubenswrapper[2574]: W0603 13:53:59.195736 2574 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterOperations Jun 03 13:53:59.203539 ip-10-0-134-229 kubenswrapper[2574]: W0603 13:53:59.195739 2574 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jun 03 13:53:59.203539 ip-10-0-134-229 kubenswrapper[2574]: W0603 13:53:59.195742 2574 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jun 03 13:53:59.203539 ip-10-0-134-229 kubenswrapper[2574]: W0603 13:53:59.195744 2574 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jun 03 13:53:59.203539 ip-10-0-134-229 kubenswrapper[2574]: W0603 13:53:59.195747 2574 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jun 03 13:53:59.203539 ip-10-0-134-229 kubenswrapper[2574]: W0603 13:53:59.195749 2574 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jun 03 13:53:59.203539 ip-10-0-134-229 kubenswrapper[2574]: W0603 13:53:59.195752 2574 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jun 03 13:53:59.203539 ip-10-0-134-229 kubenswrapper[2574]: W0603 13:53:59.195754 2574 feature_gate.go:328] unrecognized feature gate: NewOLM Jun 03 13:53:59.203539 ip-10-0-134-229 kubenswrapper[2574]: W0603 13:53:59.195757 2574 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jun 03 13:53:59.203539 ip-10-0-134-229 kubenswrapper[2574]: W0603 13:53:59.195759 2574 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jun 03 13:53:59.203539 ip-10-0-134-229 kubenswrapper[2574]: W0603 13:53:59.195766 2574 feature_gate.go:328] unrecognized feature gate: DualReplica Jun 03 13:53:59.203539 ip-10-0-134-229 kubenswrapper[2574]: W0603 13:53:59.195771 2574 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jun 03 13:53:59.203539 ip-10-0-134-229 kubenswrapper[2574]: W0603 13:53:59.195773 2574 feature_gate.go:328] unrecognized feature gate: PinnedImages Jun 03 13:53:59.203539 ip-10-0-134-229 kubenswrapper[2574]: W0603 13:53:59.195776 2574 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jun 03 13:53:59.203539 ip-10-0-134-229 kubenswrapper[2574]: W0603 13:53:59.195778 2574 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jun 03 13:53:59.203539 ip-10-0-134-229 kubenswrapper[2574]: W0603 13:53:59.195781 2574 feature_gate.go:328] unrecognized feature gate: Example2 Jun 03 13:53:59.204105 ip-10-0-134-229 kubenswrapper[2574]: W0603 13:53:59.195783 2574 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jun 03 13:53:59.204105 ip-10-0-134-229 kubenswrapper[2574]: W0603 13:53:59.195786 2574 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jun 03 13:53:59.204105 ip-10-0-134-229 kubenswrapper[2574]: W0603 13:53:59.195788 2574 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jun 03 13:53:59.204105 ip-10-0-134-229 kubenswrapper[2574]: W0603 13:53:59.195791 2574 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jun 03 13:53:59.204105 ip-10-0-134-229 kubenswrapper[2574]: W0603 13:53:59.195794 2574 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jun 03 13:53:59.204105 ip-10-0-134-229 kubenswrapper[2574]: W0603 13:53:59.195796 2574 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jun 03 13:53:59.204105 ip-10-0-134-229 kubenswrapper[2574]: I0603 13:53:59.196688 2574 feature_gate.go:384] feature gates: {map[DynamicResourceAllocation:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutatingAdmissionPolicy:false NodeSwap:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:false]} Jun 03 13:53:59.204486 ip-10-0-134-229 kubenswrapper[2574]: I0603 13:53:59.204468 2574 server.go:530] "Kubelet version" kubeletVersion="v1.33.12" Jun 03 13:53:59.204530 ip-10-0-134-229 kubenswrapper[2574]: I0603 13:53:59.204486 2574 server.go:532] "Golang settings" GOGC="" GOMAXPROCS="" GOTRACEBACK="" Jun 03 13:53:59.204566 ip-10-0-134-229 kubenswrapper[2574]: W0603 13:53:59.204537 2574 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jun 03 13:53:59.204566 ip-10-0-134-229 kubenswrapper[2574]: W0603 13:53:59.204543 2574 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jun 03 13:53:59.204566 ip-10-0-134-229 kubenswrapper[2574]: W0603 13:53:59.204548 2574 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jun 03 13:53:59.204566 ip-10-0-134-229 kubenswrapper[2574]: W0603 13:53:59.204553 2574 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jun 03 13:53:59.204566 ip-10-0-134-229 kubenswrapper[2574]: W0603 13:53:59.204556 2574 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jun 03 13:53:59.204566 ip-10-0-134-229 kubenswrapper[2574]: W0603 13:53:59.204559 2574 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jun 03 13:53:59.204566 ip-10-0-134-229 kubenswrapper[2574]: W0603 13:53:59.204562 2574 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jun 03 13:53:59.204566 ip-10-0-134-229 kubenswrapper[2574]: W0603 13:53:59.204565 2574 feature_gate.go:328] unrecognized feature gate: PinnedImages Jun 03 13:53:59.204566 ip-10-0-134-229 kubenswrapper[2574]: W0603 13:53:59.204568 2574 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jun 03 13:53:59.204566 ip-10-0-134-229 kubenswrapper[2574]: W0603 13:53:59.204570 2574 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jun 03 13:53:59.204832 ip-10-0-134-229 kubenswrapper[2574]: W0603 13:53:59.204573 2574 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jun 03 13:53:59.204832 ip-10-0-134-229 kubenswrapper[2574]: W0603 13:53:59.204576 2574 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jun 03 13:53:59.204832 ip-10-0-134-229 kubenswrapper[2574]: W0603 13:53:59.204579 2574 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jun 03 13:53:59.204832 ip-10-0-134-229 kubenswrapper[2574]: W0603 13:53:59.204581 2574 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jun 03 13:53:59.204832 ip-10-0-134-229 kubenswrapper[2574]: W0603 13:53:59.204584 2574 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jun 03 13:53:59.204832 ip-10-0-134-229 kubenswrapper[2574]: W0603 13:53:59.204587 2574 feature_gate.go:328] unrecognized feature gate: Example Jun 03 13:53:59.204832 ip-10-0-134-229 kubenswrapper[2574]: W0603 13:53:59.204590 2574 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jun 03 13:53:59.204832 ip-10-0-134-229 kubenswrapper[2574]: W0603 13:53:59.204592 2574 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jun 03 13:53:59.204832 ip-10-0-134-229 kubenswrapper[2574]: W0603 13:53:59.204595 2574 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jun 03 13:53:59.204832 ip-10-0-134-229 kubenswrapper[2574]: W0603 13:53:59.204598 2574 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jun 03 13:53:59.204832 ip-10-0-134-229 kubenswrapper[2574]: W0603 13:53:59.204601 2574 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jun 03 13:53:59.204832 ip-10-0-134-229 kubenswrapper[2574]: W0603 13:53:59.204603 2574 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jun 03 13:53:59.204832 ip-10-0-134-229 kubenswrapper[2574]: W0603 13:53:59.204606 2574 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jun 03 13:53:59.204832 ip-10-0-134-229 kubenswrapper[2574]: W0603 13:53:59.204609 2574 feature_gate.go:328] unrecognized feature gate: DualReplica Jun 03 13:53:59.204832 ip-10-0-134-229 kubenswrapper[2574]: W0603 13:53:59.204612 2574 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jun 03 13:53:59.204832 ip-10-0-134-229 kubenswrapper[2574]: W0603 13:53:59.204615 2574 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jun 03 13:53:59.204832 ip-10-0-134-229 kubenswrapper[2574]: W0603 13:53:59.204617 2574 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jun 03 13:53:59.204832 ip-10-0-134-229 kubenswrapper[2574]: W0603 13:53:59.204620 2574 feature_gate.go:328] unrecognized feature gate: InsightsConfigAPI Jun 03 13:53:59.204832 ip-10-0-134-229 kubenswrapper[2574]: W0603 13:53:59.204622 2574 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jun 03 13:53:59.204832 ip-10-0-134-229 kubenswrapper[2574]: W0603 13:53:59.204625 2574 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jun 03 13:53:59.205395 ip-10-0-134-229 kubenswrapper[2574]: W0603 13:53:59.204627 2574 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jun 03 13:53:59.205395 ip-10-0-134-229 kubenswrapper[2574]: W0603 13:53:59.204629 2574 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jun 03 13:53:59.205395 ip-10-0-134-229 kubenswrapper[2574]: W0603 13:53:59.204632 2574 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jun 03 13:53:59.205395 ip-10-0-134-229 kubenswrapper[2574]: W0603 13:53:59.204635 2574 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jun 03 13:53:59.205395 ip-10-0-134-229 kubenswrapper[2574]: W0603 13:53:59.204637 2574 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jun 03 13:53:59.205395 ip-10-0-134-229 kubenswrapper[2574]: W0603 13:53:59.204640 2574 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jun 03 13:53:59.205395 ip-10-0-134-229 kubenswrapper[2574]: W0603 13:53:59.204642 2574 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jun 03 13:53:59.205395 ip-10-0-134-229 kubenswrapper[2574]: W0603 13:53:59.204644 2574 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jun 03 13:53:59.205395 ip-10-0-134-229 kubenswrapper[2574]: W0603 13:53:59.204647 2574 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jun 03 13:53:59.205395 ip-10-0-134-229 kubenswrapper[2574]: W0603 13:53:59.204649 2574 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jun 03 13:53:59.205395 ip-10-0-134-229 kubenswrapper[2574]: W0603 13:53:59.204652 2574 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jun 03 13:53:59.205395 ip-10-0-134-229 kubenswrapper[2574]: W0603 13:53:59.204654 2574 feature_gate.go:328] unrecognized feature gate: SignatureStores Jun 03 13:53:59.205395 ip-10-0-134-229 kubenswrapper[2574]: W0603 13:53:59.204657 2574 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jun 03 13:53:59.205395 ip-10-0-134-229 kubenswrapper[2574]: W0603 13:53:59.204660 2574 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jun 03 13:53:59.205395 ip-10-0-134-229 kubenswrapper[2574]: W0603 13:53:59.204663 2574 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jun 03 13:53:59.205395 ip-10-0-134-229 kubenswrapper[2574]: W0603 13:53:59.204666 2574 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jun 03 13:53:59.205395 ip-10-0-134-229 kubenswrapper[2574]: W0603 13:53:59.204668 2574 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jun 03 13:53:59.205395 ip-10-0-134-229 kubenswrapper[2574]: W0603 13:53:59.204671 2574 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jun 03 13:53:59.205395 ip-10-0-134-229 kubenswrapper[2574]: W0603 13:53:59.204673 2574 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jun 03 13:53:59.205395 ip-10-0-134-229 kubenswrapper[2574]: W0603 13:53:59.204676 2574 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jun 03 13:53:59.205942 ip-10-0-134-229 kubenswrapper[2574]: W0603 13:53:59.204679 2574 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jun 03 13:53:59.205942 ip-10-0-134-229 kubenswrapper[2574]: W0603 13:53:59.204681 2574 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jun 03 13:53:59.205942 ip-10-0-134-229 kubenswrapper[2574]: W0603 13:53:59.204684 2574 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jun 03 13:53:59.205942 ip-10-0-134-229 kubenswrapper[2574]: W0603 13:53:59.204686 2574 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jun 03 13:53:59.205942 ip-10-0-134-229 kubenswrapper[2574]: W0603 13:53:59.204689 2574 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jun 03 13:53:59.205942 ip-10-0-134-229 kubenswrapper[2574]: W0603 13:53:59.204691 2574 feature_gate.go:328] unrecognized feature gate: SetEIPForNLBIngressController Jun 03 13:53:59.205942 ip-10-0-134-229 kubenswrapper[2574]: W0603 13:53:59.204694 2574 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jun 03 13:53:59.205942 ip-10-0-134-229 kubenswrapper[2574]: W0603 13:53:59.204696 2574 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jun 03 13:53:59.205942 ip-10-0-134-229 kubenswrapper[2574]: W0603 13:53:59.204698 2574 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jun 03 13:53:59.205942 ip-10-0-134-229 kubenswrapper[2574]: W0603 13:53:59.204701 2574 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jun 03 13:53:59.205942 ip-10-0-134-229 kubenswrapper[2574]: W0603 13:53:59.204703 2574 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jun 03 13:53:59.205942 ip-10-0-134-229 kubenswrapper[2574]: W0603 13:53:59.204706 2574 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jun 03 13:53:59.205942 ip-10-0-134-229 kubenswrapper[2574]: W0603 13:53:59.204708 2574 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jun 03 13:53:59.205942 ip-10-0-134-229 kubenswrapper[2574]: W0603 13:53:59.204711 2574 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jun 03 13:53:59.205942 ip-10-0-134-229 kubenswrapper[2574]: W0603 13:53:59.204715 2574 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jun 03 13:53:59.205942 ip-10-0-134-229 kubenswrapper[2574]: W0603 13:53:59.204719 2574 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jun 03 13:53:59.205942 ip-10-0-134-229 kubenswrapper[2574]: W0603 13:53:59.204722 2574 feature_gate.go:328] unrecognized feature gate: Example2 Jun 03 13:53:59.205942 ip-10-0-134-229 kubenswrapper[2574]: W0603 13:53:59.204725 2574 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jun 03 13:53:59.205942 ip-10-0-134-229 kubenswrapper[2574]: W0603 13:53:59.204728 2574 feature_gate.go:328] unrecognized feature gate: IngressControllerLBSubnetsAWS Jun 03 13:53:59.206555 ip-10-0-134-229 kubenswrapper[2574]: W0603 13:53:59.204731 2574 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jun 03 13:53:59.206555 ip-10-0-134-229 kubenswrapper[2574]: W0603 13:53:59.204733 2574 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jun 03 13:53:59.206555 ip-10-0-134-229 kubenswrapper[2574]: W0603 13:53:59.204736 2574 feature_gate.go:328] unrecognized feature gate: OVNObservability Jun 03 13:53:59.206555 ip-10-0-134-229 kubenswrapper[2574]: W0603 13:53:59.204739 2574 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jun 03 13:53:59.206555 ip-10-0-134-229 kubenswrapper[2574]: W0603 13:53:59.204741 2574 feature_gate.go:328] unrecognized feature gate: NewOLM Jun 03 13:53:59.206555 ip-10-0-134-229 kubenswrapper[2574]: W0603 13:53:59.204744 2574 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jun 03 13:53:59.206555 ip-10-0-134-229 kubenswrapper[2574]: W0603 13:53:59.204747 2574 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jun 03 13:53:59.206555 ip-10-0-134-229 kubenswrapper[2574]: W0603 13:53:59.204755 2574 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterOperations Jun 03 13:53:59.206555 ip-10-0-134-229 kubenswrapper[2574]: W0603 13:53:59.204758 2574 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jun 03 13:53:59.206555 ip-10-0-134-229 kubenswrapper[2574]: W0603 13:53:59.204761 2574 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jun 03 13:53:59.206555 ip-10-0-134-229 kubenswrapper[2574]: W0603 13:53:59.204763 2574 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jun 03 13:53:59.206555 ip-10-0-134-229 kubenswrapper[2574]: W0603 13:53:59.204766 2574 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jun 03 13:53:59.206555 ip-10-0-134-229 kubenswrapper[2574]: W0603 13:53:59.204769 2574 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jun 03 13:53:59.206555 ip-10-0-134-229 kubenswrapper[2574]: W0603 13:53:59.204771 2574 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jun 03 13:53:59.206555 ip-10-0-134-229 kubenswrapper[2574]: W0603 13:53:59.204774 2574 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jun 03 13:53:59.206555 ip-10-0-134-229 kubenswrapper[2574]: W0603 13:53:59.204776 2574 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jun 03 13:53:59.206555 ip-10-0-134-229 kubenswrapper[2574]: W0603 13:53:59.204779 2574 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jun 03 13:53:59.206985 ip-10-0-134-229 kubenswrapper[2574]: I0603 13:53:59.204784 2574 feature_gate.go:384] feature gates: {map[DynamicResourceAllocation:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutatingAdmissionPolicy:false NodeSwap:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:false]} Jun 03 13:53:59.206985 ip-10-0-134-229 kubenswrapper[2574]: W0603 13:53:59.204883 2574 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jun 03 13:53:59.206985 ip-10-0-134-229 kubenswrapper[2574]: W0603 13:53:59.204889 2574 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jun 03 13:53:59.206985 ip-10-0-134-229 kubenswrapper[2574]: W0603 13:53:59.204892 2574 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jun 03 13:53:59.206985 ip-10-0-134-229 kubenswrapper[2574]: W0603 13:53:59.204895 2574 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jun 03 13:53:59.206985 ip-10-0-134-229 kubenswrapper[2574]: W0603 13:53:59.204899 2574 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jun 03 13:53:59.206985 ip-10-0-134-229 kubenswrapper[2574]: W0603 13:53:59.204903 2574 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jun 03 13:53:59.206985 ip-10-0-134-229 kubenswrapper[2574]: W0603 13:53:59.204906 2574 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jun 03 13:53:59.206985 ip-10-0-134-229 kubenswrapper[2574]: W0603 13:53:59.204909 2574 feature_gate.go:328] unrecognized feature gate: SetEIPForNLBIngressController Jun 03 13:53:59.206985 ip-10-0-134-229 kubenswrapper[2574]: W0603 13:53:59.204912 2574 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jun 03 13:53:59.206985 ip-10-0-134-229 kubenswrapper[2574]: W0603 13:53:59.204914 2574 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jun 03 13:53:59.206985 ip-10-0-134-229 kubenswrapper[2574]: W0603 13:53:59.204917 2574 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jun 03 13:53:59.206985 ip-10-0-134-229 kubenswrapper[2574]: W0603 13:53:59.204920 2574 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jun 03 13:53:59.206985 ip-10-0-134-229 kubenswrapper[2574]: W0603 13:53:59.204922 2574 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jun 03 13:53:59.206985 ip-10-0-134-229 kubenswrapper[2574]: W0603 13:53:59.204925 2574 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jun 03 13:53:59.207351 ip-10-0-134-229 kubenswrapper[2574]: W0603 13:53:59.204927 2574 feature_gate.go:328] unrecognized feature gate: Example Jun 03 13:53:59.207351 ip-10-0-134-229 kubenswrapper[2574]: W0603 13:53:59.204930 2574 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jun 03 13:53:59.207351 ip-10-0-134-229 kubenswrapper[2574]: W0603 13:53:59.204933 2574 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jun 03 13:53:59.207351 ip-10-0-134-229 kubenswrapper[2574]: W0603 13:53:59.204935 2574 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jun 03 13:53:59.207351 ip-10-0-134-229 kubenswrapper[2574]: W0603 13:53:59.204938 2574 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jun 03 13:53:59.207351 ip-10-0-134-229 kubenswrapper[2574]: W0603 13:53:59.204940 2574 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jun 03 13:53:59.207351 ip-10-0-134-229 kubenswrapper[2574]: W0603 13:53:59.204943 2574 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jun 03 13:53:59.207351 ip-10-0-134-229 kubenswrapper[2574]: W0603 13:53:59.204946 2574 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jun 03 13:53:59.207351 ip-10-0-134-229 kubenswrapper[2574]: W0603 13:53:59.204956 2574 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jun 03 13:53:59.207351 ip-10-0-134-229 kubenswrapper[2574]: W0603 13:53:59.204959 2574 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jun 03 13:53:59.207351 ip-10-0-134-229 kubenswrapper[2574]: W0603 13:53:59.204961 2574 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jun 03 13:53:59.207351 ip-10-0-134-229 kubenswrapper[2574]: W0603 13:53:59.204964 2574 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jun 03 13:53:59.207351 ip-10-0-134-229 kubenswrapper[2574]: W0603 13:53:59.204966 2574 feature_gate.go:328] unrecognized feature gate: InsightsConfigAPI Jun 03 13:53:59.207351 ip-10-0-134-229 kubenswrapper[2574]: W0603 13:53:59.204968 2574 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jun 03 13:53:59.207351 ip-10-0-134-229 kubenswrapper[2574]: W0603 13:53:59.204971 2574 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jun 03 13:53:59.207351 ip-10-0-134-229 kubenswrapper[2574]: W0603 13:53:59.204973 2574 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jun 03 13:53:59.207351 ip-10-0-134-229 kubenswrapper[2574]: W0603 13:53:59.204984 2574 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jun 03 13:53:59.207351 ip-10-0-134-229 kubenswrapper[2574]: W0603 13:53:59.204987 2574 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jun 03 13:53:59.207351 ip-10-0-134-229 kubenswrapper[2574]: W0603 13:53:59.204990 2574 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jun 03 13:53:59.207351 ip-10-0-134-229 kubenswrapper[2574]: W0603 13:53:59.204992 2574 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jun 03 13:53:59.207857 ip-10-0-134-229 kubenswrapper[2574]: W0603 13:53:59.204995 2574 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jun 03 13:53:59.207857 ip-10-0-134-229 kubenswrapper[2574]: W0603 13:53:59.204997 2574 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jun 03 13:53:59.207857 ip-10-0-134-229 kubenswrapper[2574]: W0603 13:53:59.205000 2574 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jun 03 13:53:59.207857 ip-10-0-134-229 kubenswrapper[2574]: W0603 13:53:59.205002 2574 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jun 03 13:53:59.207857 ip-10-0-134-229 kubenswrapper[2574]: W0603 13:53:59.205005 2574 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jun 03 13:53:59.207857 ip-10-0-134-229 kubenswrapper[2574]: W0603 13:53:59.205007 2574 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jun 03 13:53:59.207857 ip-10-0-134-229 kubenswrapper[2574]: W0603 13:53:59.205010 2574 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jun 03 13:53:59.207857 ip-10-0-134-229 kubenswrapper[2574]: W0603 13:53:59.205013 2574 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jun 03 13:53:59.207857 ip-10-0-134-229 kubenswrapper[2574]: W0603 13:53:59.205015 2574 feature_gate.go:328] unrecognized feature gate: OVNObservability Jun 03 13:53:59.207857 ip-10-0-134-229 kubenswrapper[2574]: W0603 13:53:59.205018 2574 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jun 03 13:53:59.207857 ip-10-0-134-229 kubenswrapper[2574]: W0603 13:53:59.205020 2574 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jun 03 13:53:59.207857 ip-10-0-134-229 kubenswrapper[2574]: W0603 13:53:59.205023 2574 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jun 03 13:53:59.207857 ip-10-0-134-229 kubenswrapper[2574]: W0603 13:53:59.205025 2574 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jun 03 13:53:59.207857 ip-10-0-134-229 kubenswrapper[2574]: W0603 13:53:59.205028 2574 feature_gate.go:328] unrecognized feature gate: Example2 Jun 03 13:53:59.207857 ip-10-0-134-229 kubenswrapper[2574]: W0603 13:53:59.205030 2574 feature_gate.go:328] unrecognized feature gate: IngressControllerLBSubnetsAWS Jun 03 13:53:59.207857 ip-10-0-134-229 kubenswrapper[2574]: W0603 13:53:59.205033 2574 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jun 03 13:53:59.207857 ip-10-0-134-229 kubenswrapper[2574]: W0603 13:53:59.205035 2574 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jun 03 13:53:59.207857 ip-10-0-134-229 kubenswrapper[2574]: W0603 13:53:59.205038 2574 feature_gate.go:328] unrecognized feature gate: DualReplica Jun 03 13:53:59.207857 ip-10-0-134-229 kubenswrapper[2574]: W0603 13:53:59.205041 2574 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jun 03 13:53:59.207857 ip-10-0-134-229 kubenswrapper[2574]: W0603 13:53:59.205043 2574 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jun 03 13:53:59.208342 ip-10-0-134-229 kubenswrapper[2574]: W0603 13:53:59.205046 2574 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jun 03 13:53:59.208342 ip-10-0-134-229 kubenswrapper[2574]: W0603 13:53:59.205050 2574 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jun 03 13:53:59.208342 ip-10-0-134-229 kubenswrapper[2574]: W0603 13:53:59.205053 2574 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jun 03 13:53:59.208342 ip-10-0-134-229 kubenswrapper[2574]: W0603 13:53:59.205056 2574 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jun 03 13:53:59.208342 ip-10-0-134-229 kubenswrapper[2574]: W0603 13:53:59.205058 2574 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jun 03 13:53:59.208342 ip-10-0-134-229 kubenswrapper[2574]: W0603 13:53:59.205060 2574 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jun 03 13:53:59.208342 ip-10-0-134-229 kubenswrapper[2574]: W0603 13:53:59.205063 2574 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jun 03 13:53:59.208342 ip-10-0-134-229 kubenswrapper[2574]: W0603 13:53:59.205066 2574 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jun 03 13:53:59.208342 ip-10-0-134-229 kubenswrapper[2574]: W0603 13:53:59.205068 2574 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jun 03 13:53:59.208342 ip-10-0-134-229 kubenswrapper[2574]: W0603 13:53:59.205070 2574 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jun 03 13:53:59.208342 ip-10-0-134-229 kubenswrapper[2574]: W0603 13:53:59.205073 2574 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jun 03 13:53:59.208342 ip-10-0-134-229 kubenswrapper[2574]: W0603 13:53:59.205075 2574 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jun 03 13:53:59.208342 ip-10-0-134-229 kubenswrapper[2574]: W0603 13:53:59.205078 2574 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jun 03 13:53:59.208342 ip-10-0-134-229 kubenswrapper[2574]: W0603 13:53:59.205081 2574 feature_gate.go:328] unrecognized feature gate: NewOLM Jun 03 13:53:59.208342 ip-10-0-134-229 kubenswrapper[2574]: W0603 13:53:59.205083 2574 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jun 03 13:53:59.208342 ip-10-0-134-229 kubenswrapper[2574]: W0603 13:53:59.205085 2574 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jun 03 13:53:59.208342 ip-10-0-134-229 kubenswrapper[2574]: W0603 13:53:59.205088 2574 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jun 03 13:53:59.208342 ip-10-0-134-229 kubenswrapper[2574]: W0603 13:53:59.205090 2574 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jun 03 13:53:59.208342 ip-10-0-134-229 kubenswrapper[2574]: W0603 13:53:59.205093 2574 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jun 03 13:53:59.208861 ip-10-0-134-229 kubenswrapper[2574]: W0603 13:53:59.205097 2574 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jun 03 13:53:59.208861 ip-10-0-134-229 kubenswrapper[2574]: W0603 13:53:59.205100 2574 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jun 03 13:53:59.208861 ip-10-0-134-229 kubenswrapper[2574]: W0603 13:53:59.205103 2574 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterOperations Jun 03 13:53:59.208861 ip-10-0-134-229 kubenswrapper[2574]: W0603 13:53:59.205106 2574 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jun 03 13:53:59.208861 ip-10-0-134-229 kubenswrapper[2574]: W0603 13:53:59.205108 2574 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jun 03 13:53:59.208861 ip-10-0-134-229 kubenswrapper[2574]: W0603 13:53:59.205111 2574 feature_gate.go:328] unrecognized feature gate: SignatureStores Jun 03 13:53:59.208861 ip-10-0-134-229 kubenswrapper[2574]: W0603 13:53:59.205114 2574 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jun 03 13:53:59.208861 ip-10-0-134-229 kubenswrapper[2574]: W0603 13:53:59.205117 2574 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jun 03 13:53:59.208861 ip-10-0-134-229 kubenswrapper[2574]: W0603 13:53:59.205119 2574 feature_gate.go:328] unrecognized feature gate: PinnedImages Jun 03 13:53:59.208861 ip-10-0-134-229 kubenswrapper[2574]: W0603 13:53:59.205122 2574 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jun 03 13:53:59.208861 ip-10-0-134-229 kubenswrapper[2574]: W0603 13:53:59.205125 2574 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jun 03 13:53:59.208861 ip-10-0-134-229 kubenswrapper[2574]: W0603 13:53:59.205128 2574 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jun 03 13:53:59.208861 ip-10-0-134-229 kubenswrapper[2574]: W0603 13:53:59.205130 2574 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jun 03 13:53:59.208861 ip-10-0-134-229 kubenswrapper[2574]: I0603 13:53:59.205135 2574 feature_gate.go:384] feature gates: {map[DynamicResourceAllocation:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutatingAdmissionPolicy:false NodeSwap:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:false]} Jun 03 13:53:59.208861 ip-10-0-134-229 kubenswrapper[2574]: I0603 13:53:59.205722 2574 server.go:962] "Client rotation is on, will bootstrap in background" Jun 03 13:53:59.209242 ip-10-0-134-229 kubenswrapper[2574]: I0603 13:53:59.207899 2574 bootstrap.go:101] "Use the bootstrap credentials to request a cert, and set kubeconfig to point to the certificate dir" Jun 03 13:53:59.209242 ip-10-0-134-229 kubenswrapper[2574]: I0603 13:53:59.208874 2574 server.go:1019] "Starting client certificate rotation" Jun 03 13:53:59.209242 ip-10-0-134-229 kubenswrapper[2574]: I0603 13:53:59.208967 2574 certificate_manager.go:422] "Certificate rotation is enabled" logger="kubernetes.io/kube-apiserver-client-kubelet" Jun 03 13:53:59.209242 ip-10-0-134-229 kubenswrapper[2574]: I0603 13:53:59.209006 2574 certificate_manager.go:566] "Rotating certificates" logger="kubernetes.io/kube-apiserver-client-kubelet" Jun 03 13:53:59.234587 ip-10-0-134-229 kubenswrapper[2574]: I0603 13:53:59.234568 2574 dynamic_cafile_content.go:123] "Loaded a new CA Bundle and Verifier" name="client-ca-bundle::/etc/kubernetes/kubelet-ca.crt" Jun 03 13:53:59.236741 ip-10-0-134-229 kubenswrapper[2574]: I0603 13:53:59.236722 2574 dynamic_cafile_content.go:161] "Starting controller" name="client-ca-bundle::/etc/kubernetes/kubelet-ca.crt" Jun 03 13:53:59.252015 ip-10-0-134-229 kubenswrapper[2574]: I0603 13:53:59.251991 2574 log.go:25] "Validated CRI v1 runtime API" Jun 03 13:53:59.258990 ip-10-0-134-229 kubenswrapper[2574]: I0603 13:53:59.258972 2574 log.go:25] "Validated CRI v1 image API" Jun 03 13:53:59.260975 ip-10-0-134-229 kubenswrapper[2574]: I0603 13:53:59.260951 2574 server.go:1452] "Using cgroup driver setting received from the CRI runtime" cgroupDriver="systemd" Jun 03 13:53:59.263856 ip-10-0-134-229 kubenswrapper[2574]: I0603 13:53:59.263838 2574 fs.go:135] Filesystem UUIDs: map[07d882c7-027b-4d15-9859-5fa2e4370984:/dev/nvme0n1p4 357d18ab-efa1-4024-ae9f-56ac0cc4bd1f:/dev/nvme0n1p3 7B77-95E7:/dev/nvme0n1p2] Jun 03 13:53:59.263907 ip-10-0-134-229 kubenswrapper[2574]: I0603 13:53:59.263857 2574 fs.go:136] Filesystem partitions: map[/dev/nvme0n1p3:{mountpoint:/boot major:259 minor:3 fsType:ext4 blockSize:0} /dev/nvme0n1p4:{mountpoint:/var major:259 minor:4 fsType:xfs blockSize:0} /dev/shm:{mountpoint:/dev/shm major:0 minor:22 fsType:tmpfs blockSize:0} /run:{mountpoint:/run major:0 minor:24 fsType:tmpfs blockSize:0} /tmp:{mountpoint:/tmp major:0 minor:31 fsType:tmpfs blockSize:0} composefs_0-33:{mountpoint:/ major:0 minor:33 fsType:overlay blockSize:0}] Jun 03 13:53:59.265811 ip-10-0-134-229 kubenswrapper[2574]: I0603 13:53:59.265795 2574 reflector.go:430] "Caches populated" logger="kubernetes.io/kube-apiserver-client-kubelet" type="*v1.CertificateSigningRequest" reflector="k8s.io/client-go/tools/watch/informerwatcher.go:162" Jun 03 13:53:59.268169 ip-10-0-134-229 kubenswrapper[2574]: I0603 13:53:59.268071 2574 manager.go:217] Machine: {Timestamp:2026-06-03 13:53:59.267588362 +0000 UTC m=+0.451595682 CPUVendorID:GenuineIntel NumCores:8 NumPhysicalCores:4 NumSockets:1 CpuFrequency:3080381 MemoryCapacity:33164500992 SwapCapacity:0 MemoryByType:map[] NVMInfo:{MemoryModeCapacity:0 AppDirectModeCapacity:0 AvgPowerBudget:0} HugePages:[{PageSize:1048576 NumPages:0} {PageSize:2048 NumPages:0}] MachineID:ec203f8121fc0a8eae4a5734e45ab1d4 SystemUUID:ec203f81-21fc-0a8e-ae4a-5734e45ab1d4 BootID:a706629f-e9ab-4287-a309-1dde6dc946ae Filesystems:[{Device:/dev/shm DeviceMajor:0 DeviceMinor:22 Capacity:16582250496 Type:vfs Inodes:4048401 HasInodes:true} {Device:/run DeviceMajor:0 DeviceMinor:24 Capacity:6632902656 Type:vfs Inodes:819200 HasInodes:true} {Device:/dev/nvme0n1p4 DeviceMajor:259 DeviceMinor:4 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:composefs_0-33 DeviceMajor:0 DeviceMinor:33 Capacity:6103040 Type:vfs Inodes:18446744073709551615 HasInodes:true} {Device:/tmp DeviceMajor:0 DeviceMinor:31 Capacity:16582250496 Type:vfs Inodes:1048576 HasInodes:true} {Device:/dev/nvme0n1p3 DeviceMajor:259 DeviceMinor:3 Capacity:366869504 Type:vfs Inodes:98304 HasInodes:true}] DiskMap:map[259:0:{Name:nvme0n1 Major:259 Minor:0 Size:128849018880 Scheduler:none}] NetworkDevices:[{Name:br-ex MacAddress:02:04:35:66:08:67 Speed:0 Mtu:9001} {Name:ens5 MacAddress:02:04:35:66:08:67 Speed:0 Mtu:9001} {Name:ovs-system MacAddress:76:08:3a:fb:c4:47 Speed:0 Mtu:1500}] Topology:[{Id:0 Memory:33164500992 HugePages:[{PageSize:1048576 NumPages:0} {PageSize:2048 NumPages:0}] Cores:[{Id:0 Threads:[0 4] Caches:[{Id:0 Size:32768 Type:Data Level:1} {Id:0 Size:32768 Type:Instruction Level:1} {Id:0 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:1 Threads:[1 5] Caches:[{Id:1 Size:32768 Type:Data Level:1} {Id:1 Size:32768 Type:Instruction Level:1} {Id:1 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:2 Threads:[2 6] Caches:[{Id:2 Size:32768 Type:Data Level:1} {Id:2 Size:32768 Type:Instruction Level:1} {Id:2 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:3 Threads:[3 7] Caches:[{Id:3 Size:32768 Type:Data Level:1} {Id:3 Size:32768 Type:Instruction Level:1} {Id:3 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:}] Caches:[{Id:0 Size:37486592 Type:Unified Level:3}] Distances:[10]}] CloudProvider:Unknown InstanceType:Unknown InstanceID:None} Jun 03 13:53:59.269072 ip-10-0-134-229 kubenswrapper[2574]: I0603 13:53:59.269060 2574 manager_no_libpfm.go:29] cAdvisor is build without cgo and/or libpfm support. Perf event counters are not available. Jun 03 13:53:59.269186 ip-10-0-134-229 kubenswrapper[2574]: I0603 13:53:59.269174 2574 manager.go:233] Version: {KernelVersion:5.14.0-570.117.1.el9_6.x86_64 ContainerOsVersion:Red Hat Enterprise Linux CoreOS 9.6.20260521-1 (Plow) DockerVersion: DockerAPIVersion: CadvisorVersion: CadvisorRevision:} Jun 03 13:53:59.272475 ip-10-0-134-229 kubenswrapper[2574]: I0603 13:53:59.272327 2574 container_manager_linux.go:270] "Container manager verified user specified cgroup-root exists" cgroupRoot=[] Jun 03 13:53:59.272608 ip-10-0-134-229 kubenswrapper[2574]: I0603 13:53:59.272479 2574 container_manager_linux.go:275] "Creating Container Manager object based on Node Config" nodeConfig={"NodeName":"ip-10-0-134-229.ec2.internal","RuntimeCgroupsName":"/system.slice/crio.service","SystemCgroupsName":"/system.slice","KubeletCgroupsName":"","KubeletOOMScoreAdj":-999,"ContainerRuntime":"","CgroupsPerQOS":true,"CgroupRoot":"/","CgroupDriver":"systemd","KubeletRootDir":"/var/lib/kubelet","ProtectKernelDefaults":true,"KubeReservedCgroupName":"","SystemReservedCgroupName":"","ReservedSystemCPUs":{},"EnforceNodeAllocatable":{"pods":{}},"KubeReserved":null,"SystemReserved":{"cpu":"500m","ephemeral-storage":"1Gi","memory":"1Gi"},"HardEvictionThresholds":[{"Signal":"imagefs.inodesFree","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.05},"GracePeriod":0,"MinReclaim":null},{"Signal":"memory.available","Operator":"LessThan","Value":{"Quantity":"100Mi","Percentage":0},"GracePeriod":0,"MinReclaim":null},{"Signal":"nodefs.available","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.1},"GracePeriod":0,"MinReclaim":null},{"Signal":"nodefs.inodesFree","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.05},"GracePeriod":0,"MinReclaim":null},{"Signal":"imagefs.available","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.15},"GracePeriod":0,"MinReclaim":null}],"QOSReserved":{},"CPUManagerPolicy":"none","CPUManagerPolicyOptions":null,"TopologyManagerScope":"container","CPUManagerReconcilePeriod":10000000000,"MemoryManagerPolicy":"None","MemoryManagerReservedMemory":null,"PodPidsLimit":4096,"EnforceCPULimits":true,"CPUCFSQuotaPeriod":100000000,"TopologyManagerPolicy":"none","TopologyManagerPolicyOptions":null,"CgroupVersion":2} Jun 03 13:53:59.272655 ip-10-0-134-229 kubenswrapper[2574]: I0603 13:53:59.272617 2574 topology_manager.go:138] "Creating topology manager with none policy" Jun 03 13:53:59.272655 ip-10-0-134-229 kubenswrapper[2574]: I0603 13:53:59.272626 2574 container_manager_linux.go:306] "Creating device plugin manager" Jun 03 13:53:59.272655 ip-10-0-134-229 kubenswrapper[2574]: I0603 13:53:59.272634 2574 manager.go:141] "Creating Device Plugin manager" path="/var/lib/kubelet/device-plugins/kubelet.sock" Jun 03 13:53:59.273526 ip-10-0-134-229 kubenswrapper[2574]: I0603 13:53:59.273515 2574 server.go:72] "Creating device plugin registration server" version="v1beta1" socket="/var/lib/kubelet/device-plugins/kubelet.sock" Jun 03 13:53:59.274879 ip-10-0-134-229 kubenswrapper[2574]: I0603 13:53:59.274870 2574 state_mem.go:36] "Initialized new in-memory state store" Jun 03 13:53:59.274999 ip-10-0-134-229 kubenswrapper[2574]: I0603 13:53:59.274990 2574 server.go:1267] "Using root directory" path="/var/lib/kubelet" Jun 03 13:53:59.277448 ip-10-0-134-229 kubenswrapper[2574]: I0603 13:53:59.277438 2574 kubelet.go:491] "Attempting to sync node with API server" Jun 03 13:53:59.277490 ip-10-0-134-229 kubenswrapper[2574]: I0603 13:53:59.277451 2574 kubelet.go:386] "Adding static pod path" path="/etc/kubernetes/manifests" Jun 03 13:53:59.277490 ip-10-0-134-229 kubenswrapper[2574]: I0603 13:53:59.277463 2574 file.go:69] "Watching path" path="/etc/kubernetes/manifests" Jun 03 13:53:59.277490 ip-10-0-134-229 kubenswrapper[2574]: I0603 13:53:59.277471 2574 kubelet.go:397] "Adding apiserver pod source" Jun 03 13:53:59.277490 ip-10-0-134-229 kubenswrapper[2574]: I0603 13:53:59.277480 2574 apiserver.go:42] "Waiting for node sync before watching apiserver pods" Jun 03 13:53:59.278575 ip-10-0-134-229 kubenswrapper[2574]: I0603 13:53:59.278563 2574 state_mem.go:40] "Initialized new in-memory state store for pod resource information tracking" Jun 03 13:53:59.278627 ip-10-0-134-229 kubenswrapper[2574]: I0603 13:53:59.278581 2574 state_mem.go:40] "Initialized new in-memory state store for pod resource information tracking" Jun 03 13:53:59.281782 ip-10-0-134-229 kubenswrapper[2574]: I0603 13:53:59.281767 2574 kuberuntime_manager.go:279] "Container runtime initialized" containerRuntime="cri-o" version="1.33.12-3.rhaos4.20.git64c6a00.el9" apiVersion="v1" Jun 03 13:53:59.283561 ip-10-0-134-229 kubenswrapper[2574]: I0603 13:53:59.283548 2574 kubelet.go:953] "Not starting ClusterTrustBundle informer because we are in static kubelet mode or the ClusterTrustBundleProjection featuregate is disabled" Jun 03 13:53:59.285552 ip-10-0-134-229 kubenswrapper[2574]: I0603 13:53:59.285526 2574 plugins.go:616] "Loaded volume plugin" pluginName="kubernetes.io/portworx-volume" Jun 03 13:53:59.285552 ip-10-0-134-229 kubenswrapper[2574]: I0603 13:53:59.285550 2574 plugins.go:616] "Loaded volume plugin" pluginName="kubernetes.io/empty-dir" Jun 03 13:53:59.285691 ip-10-0-134-229 kubenswrapper[2574]: I0603 13:53:59.285558 2574 plugins.go:616] "Loaded volume plugin" pluginName="kubernetes.io/git-repo" Jun 03 13:53:59.285691 ip-10-0-134-229 kubenswrapper[2574]: I0603 13:53:59.285567 2574 plugins.go:616] "Loaded volume plugin" pluginName="kubernetes.io/host-path" Jun 03 13:53:59.285691 ip-10-0-134-229 kubenswrapper[2574]: I0603 13:53:59.285579 2574 plugins.go:616] "Loaded volume plugin" pluginName="kubernetes.io/nfs" Jun 03 13:53:59.285691 ip-10-0-134-229 kubenswrapper[2574]: I0603 13:53:59.285588 2574 plugins.go:616] "Loaded volume plugin" pluginName="kubernetes.io/secret" Jun 03 13:53:59.285691 ip-10-0-134-229 kubenswrapper[2574]: I0603 13:53:59.285596 2574 plugins.go:616] "Loaded volume plugin" pluginName="kubernetes.io/iscsi" Jun 03 13:53:59.285691 ip-10-0-134-229 kubenswrapper[2574]: I0603 13:53:59.285605 2574 plugins.go:616] "Loaded volume plugin" pluginName="kubernetes.io/downward-api" Jun 03 13:53:59.285691 ip-10-0-134-229 kubenswrapper[2574]: I0603 13:53:59.285615 2574 plugins.go:616] "Loaded volume plugin" pluginName="kubernetes.io/fc" Jun 03 13:53:59.285691 ip-10-0-134-229 kubenswrapper[2574]: I0603 13:53:59.285623 2574 plugins.go:616] "Loaded volume plugin" pluginName="kubernetes.io/configmap" Jun 03 13:53:59.285691 ip-10-0-134-229 kubenswrapper[2574]: I0603 13:53:59.285647 2574 plugins.go:616] "Loaded volume plugin" pluginName="kubernetes.io/projected" Jun 03 13:53:59.285691 ip-10-0-134-229 kubenswrapper[2574]: I0603 13:53:59.285657 2574 plugins.go:616] "Loaded volume plugin" pluginName="kubernetes.io/local-volume" Jun 03 13:53:59.286529 ip-10-0-134-229 kubenswrapper[2574]: I0603 13:53:59.286518 2574 plugins.go:616] "Loaded volume plugin" pluginName="kubernetes.io/csi" Jun 03 13:53:59.286586 ip-10-0-134-229 kubenswrapper[2574]: I0603 13:53:59.286532 2574 plugins.go:616] "Loaded volume plugin" pluginName="kubernetes.io/image" Jun 03 13:53:59.289696 ip-10-0-134-229 kubenswrapper[2574]: I0603 13:53:59.289680 2574 watchdog_linux.go:99] "Systemd watchdog is not enabled" Jun 03 13:53:59.289775 ip-10-0-134-229 kubenswrapper[2574]: I0603 13:53:59.289723 2574 server.go:1295] "Started kubelet" Jun 03 13:53:59.289943 ip-10-0-134-229 kubenswrapper[2574]: I0603 13:53:59.289884 2574 ratelimit.go:55] "Setting rate limiting for endpoint" service="podresources" qps=100 burstTokens=10 Jun 03 13:53:59.290023 ip-10-0-134-229 kubenswrapper[2574]: I0603 13:53:59.289968 2574 server_v1.go:47] "podresources" method="list" useActivePods=true Jun 03 13:53:59.290265 ip-10-0-134-229 kubenswrapper[2574]: I0603 13:53:59.289790 2574 server.go:180] "Starting to listen" address="0.0.0.0" port=10250 Jun 03 13:53:59.290638 ip-10-0-134-229 kubenswrapper[2574]: I0603 13:53:59.290622 2574 csi_plugin.go:988] Failed to contact API server when waiting for CSINode publishing: csinodes.storage.k8s.io "ip-10-0-134-229.ec2.internal" is forbidden: User "system:anonymous" cannot get resource "csinodes" in API group "storage.k8s.io" at the cluster scope Jun 03 13:53:59.290759 ip-10-0-134-229 systemd[1]: Started Kubernetes Kubelet. Jun 03 13:53:59.290873 ip-10-0-134-229 kubenswrapper[2574]: E0603 13:53:59.290795 2574 reflector.go:200] "Failed to watch" err="failed to list *v1.Node: nodes \"ip-10-0-134-229.ec2.internal\" is forbidden: User \"system:anonymous\" cannot list resource \"nodes\" in API group \"\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Node" Jun 03 13:53:59.290873 ip-10-0-134-229 kubenswrapper[2574]: E0603 13:53:59.290797 2574 reflector.go:200] "Failed to watch" err="failed to list *v1.Service: services is forbidden: User \"system:anonymous\" cannot list resource \"services\" in API group \"\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Service" Jun 03 13:53:59.291095 ip-10-0-134-229 kubenswrapper[2574]: I0603 13:53:59.291079 2574 server.go:255] "Starting to serve the podresources API" endpoint="unix:/var/lib/kubelet/pod-resources/kubelet.sock" Jun 03 13:53:59.292897 ip-10-0-134-229 kubenswrapper[2574]: I0603 13:53:59.292884 2574 server.go:317] "Adding debug handlers to kubelet server" Jun 03 13:53:59.296488 ip-10-0-134-229 kubenswrapper[2574]: I0603 13:53:59.296466 2574 fs_resource_analyzer.go:67] "Starting FS ResourceAnalyzer" Jun 03 13:53:59.296488 ip-10-0-134-229 kubenswrapper[2574]: I0603 13:53:59.296478 2574 certificate_manager.go:422] "Certificate rotation is enabled" logger="kubernetes.io/kubelet-serving" Jun 03 13:53:59.296626 ip-10-0-134-229 kubenswrapper[2574]: I0603 13:53:59.296571 2574 volume_manager.go:295] "The desired_state_of_world populator starts" Jun 03 13:53:59.296626 ip-10-0-134-229 kubenswrapper[2574]: I0603 13:53:59.296586 2574 volume_manager.go:297] "Starting Kubelet Volume Manager" Jun 03 13:53:59.296795 ip-10-0-134-229 kubenswrapper[2574]: I0603 13:53:59.296775 2574 desired_state_of_world_populator.go:150] "Desired state populator starts to run" Jun 03 13:53:59.296877 ip-10-0-134-229 kubenswrapper[2574]: I0603 13:53:59.296803 2574 reconstruct.go:97] "Volume reconstruction finished" Jun 03 13:53:59.296877 ip-10-0-134-229 kubenswrapper[2574]: I0603 13:53:59.296813 2574 reconciler.go:26] "Reconciler: start to sync state" Jun 03 13:53:59.298331 ip-10-0-134-229 kubenswrapper[2574]: E0603 13:53:59.298296 2574 kubelet_node_status.go:515] "Error getting the current node from lister" err="node \"ip-10-0-134-229.ec2.internal\" not found" Jun 03 13:53:59.302167 ip-10-0-134-229 kubenswrapper[2574]: E0603 13:53:59.298300 2574 event.go:359] "Server rejected event (will not retry!)" err="events is forbidden: User \"system:anonymous\" cannot create resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-134-229.ec2.internal.18b5969f74474499 default 0 0001-01-01 00:00:00 +0000 UTC map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-134-229.ec2.internal,UID:ip-10-0-134-229.ec2.internal,APIVersion:,ResourceVersion:,FieldPath:,},Reason:Starting,Message:Starting kubelet.,Source:EventSource{Component:kubelet,Host:ip-10-0-134-229.ec2.internal,},FirstTimestamp:2026-06-03 13:53:59.289693337 +0000 UTC m=+0.473700657,LastTimestamp:2026-06-03 13:53:59.289693337 +0000 UTC m=+0.473700657,Count:1,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-134-229.ec2.internal,}" Jun 03 13:53:59.302290 ip-10-0-134-229 kubenswrapper[2574]: I0603 13:53:59.302201 2574 factory.go:55] Registering systemd factory Jun 03 13:53:59.302290 ip-10-0-134-229 kubenswrapper[2574]: I0603 13:53:59.302218 2574 factory.go:223] Registration of the systemd container factory successfully Jun 03 13:53:59.302290 ip-10-0-134-229 kubenswrapper[2574]: I0603 13:53:59.302217 2574 csr.go:274] "Certificate signing request is approved, waiting to be issued" logger="kubernetes.io/kube-apiserver-client-kubelet" csr="csr-26qpk" Jun 03 13:53:59.302493 ip-10-0-134-229 kubenswrapper[2574]: I0603 13:53:59.302478 2574 factory.go:153] Registering CRI-O factory Jun 03 13:53:59.302611 ip-10-0-134-229 kubenswrapper[2574]: I0603 13:53:59.302571 2574 factory.go:223] Registration of the crio container factory successfully Jun 03 13:53:59.302773 ip-10-0-134-229 kubenswrapper[2574]: I0603 13:53:59.302634 2574 factory.go:221] Registration of the containerd container factory failed: unable to create containerd client: containerd: cannot unix dial containerd api service: dial unix /run/containerd/containerd.sock: connect: no such file or directory Jun 03 13:53:59.302773 ip-10-0-134-229 kubenswrapper[2574]: I0603 13:53:59.302656 2574 factory.go:103] Registering Raw factory Jun 03 13:53:59.302773 ip-10-0-134-229 kubenswrapper[2574]: I0603 13:53:59.302670 2574 manager.go:1196] Started watching for new ooms in manager Jun 03 13:53:59.303134 ip-10-0-134-229 kubenswrapper[2574]: I0603 13:53:59.303120 2574 manager.go:319] Starting recovery of all containers Jun 03 13:53:59.304334 ip-10-0-134-229 kubenswrapper[2574]: E0603 13:53:59.304306 2574 kubelet.go:1618] "Image garbage collection failed once. Stats initialization may not have completed yet" err="failed to get imageFs info: unable to find data in memory cache" Jun 03 13:53:59.306486 ip-10-0-134-229 kubenswrapper[2574]: I0603 13:53:59.306463 2574 csr.go:270] "Certificate signing request is issued" logger="kubernetes.io/kube-apiserver-client-kubelet" csr="csr-26qpk" Jun 03 13:53:59.308439 ip-10-0-134-229 kubenswrapper[2574]: E0603 13:53:59.308411 2574 reflector.go:200] "Failed to watch" err="failed to list *v1.CSIDriver: csidrivers.storage.k8s.io is forbidden: User \"system:anonymous\" cannot list resource \"csidrivers\" in API group \"storage.k8s.io\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.CSIDriver" Jun 03 13:53:59.308533 ip-10-0-134-229 kubenswrapper[2574]: E0603 13:53:59.308516 2574 controller.go:145] "Failed to ensure lease exists, will retry" err="leases.coordination.k8s.io \"ip-10-0-134-229.ec2.internal\" is forbidden: User \"system:anonymous\" cannot get resource \"leases\" in API group \"coordination.k8s.io\" in the namespace \"kube-node-lease\"" interval="200ms" Jun 03 13:53:59.312499 ip-10-0-134-229 kubenswrapper[2574]: I0603 13:53:59.312484 2574 manager.go:324] Recovery completed Jun 03 13:53:59.313707 ip-10-0-134-229 kubenswrapper[2574]: E0603 13:53:59.313661 2574 watcher.go:152] Failed to watch directory "/sys/fs/cgroup/system.slice/systemd-update-utmp-runlevel.service": inotify_add_watch /sys/fs/cgroup/system.slice/systemd-update-utmp-runlevel.service: no such file or directory Jun 03 13:53:59.316539 ip-10-0-134-229 kubenswrapper[2574]: I0603 13:53:59.316528 2574 kubelet_node_status.go:413] "Setting node annotation to enable volume controller attach/detach" Jun 03 13:53:59.318203 ip-10-0-134-229 kubenswrapper[2574]: I0603 13:53:59.318190 2574 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-134-229.ec2.internal" event="NodeHasSufficientMemory" Jun 03 13:53:59.318274 ip-10-0-134-229 kubenswrapper[2574]: I0603 13:53:59.318214 2574 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-134-229.ec2.internal" event="NodeHasNoDiskPressure" Jun 03 13:53:59.318274 ip-10-0-134-229 kubenswrapper[2574]: I0603 13:53:59.318227 2574 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-134-229.ec2.internal" event="NodeHasSufficientPID" Jun 03 13:53:59.318730 ip-10-0-134-229 kubenswrapper[2574]: I0603 13:53:59.318713 2574 cpu_manager.go:222] "Starting CPU manager" policy="none" Jun 03 13:53:59.318802 ip-10-0-134-229 kubenswrapper[2574]: I0603 13:53:59.318731 2574 cpu_manager.go:223] "Reconciling" reconcilePeriod="10s" Jun 03 13:53:59.318802 ip-10-0-134-229 kubenswrapper[2574]: I0603 13:53:59.318748 2574 state_mem.go:36] "Initialized new in-memory state store" Jun 03 13:53:59.322012 ip-10-0-134-229 kubenswrapper[2574]: I0603 13:53:59.321999 2574 policy_none.go:49] "None policy: Start" Jun 03 13:53:59.322050 ip-10-0-134-229 kubenswrapper[2574]: I0603 13:53:59.322016 2574 memory_manager.go:186] "Starting memorymanager" policy="None" Jun 03 13:53:59.322050 ip-10-0-134-229 kubenswrapper[2574]: I0603 13:53:59.322027 2574 state_mem.go:35] "Initializing new in-memory state store" Jun 03 13:53:59.363112 ip-10-0-134-229 kubenswrapper[2574]: I0603 13:53:59.360566 2574 manager.go:341] "Starting Device Plugin manager" Jun 03 13:53:59.363112 ip-10-0-134-229 kubenswrapper[2574]: E0603 13:53:59.360591 2574 manager.go:517] "Failed to read data from checkpoint" err="checkpoint is not found" checkpoint="kubelet_internal_checkpoint" Jun 03 13:53:59.363112 ip-10-0-134-229 kubenswrapper[2574]: I0603 13:53:59.360600 2574 server.go:85] "Starting device plugin registration server" Jun 03 13:53:59.363112 ip-10-0-134-229 kubenswrapper[2574]: I0603 13:53:59.360822 2574 eviction_manager.go:189] "Eviction manager: starting control loop" Jun 03 13:53:59.363112 ip-10-0-134-229 kubenswrapper[2574]: I0603 13:53:59.360832 2574 container_log_manager.go:189] "Initializing container log rotate workers" workers=1 monitorPeriod="10s" Jun 03 13:53:59.363112 ip-10-0-134-229 kubenswrapper[2574]: I0603 13:53:59.361003 2574 plugin_watcher.go:51] "Plugin Watcher Start" path="/var/lib/kubelet/plugins_registry" Jun 03 13:53:59.363112 ip-10-0-134-229 kubenswrapper[2574]: I0603 13:53:59.361087 2574 plugin_manager.go:116] "The desired_state_of_world populator (plugin watcher) starts" Jun 03 13:53:59.363112 ip-10-0-134-229 kubenswrapper[2574]: I0603 13:53:59.361095 2574 plugin_manager.go:118] "Starting Kubelet Plugin Manager" Jun 03 13:53:59.363112 ip-10-0-134-229 kubenswrapper[2574]: E0603 13:53:59.361481 2574 eviction_manager.go:267] "eviction manager: failed to check if we have separate container filesystem. Ignoring." err="non-existent label \"crio-containers\"" Jun 03 13:53:59.363112 ip-10-0-134-229 kubenswrapper[2574]: E0603 13:53:59.361518 2574 eviction_manager.go:292] "Eviction manager: failed to get summary stats" err="failed to get node info: node \"ip-10-0-134-229.ec2.internal\" not found" Jun 03 13:53:59.425113 ip-10-0-134-229 kubenswrapper[2574]: I0603 13:53:59.425089 2574 kubelet_network_linux.go:49] "Initialized iptables rules." protocol="IPv4" Jun 03 13:53:59.426245 ip-10-0-134-229 kubenswrapper[2574]: I0603 13:53:59.426218 2574 kubelet_network_linux.go:49] "Initialized iptables rules." protocol="IPv6" Jun 03 13:53:59.426245 ip-10-0-134-229 kubenswrapper[2574]: I0603 13:53:59.426246 2574 status_manager.go:230] "Starting to sync pod status with apiserver" Jun 03 13:53:59.426401 ip-10-0-134-229 kubenswrapper[2574]: I0603 13:53:59.426265 2574 watchdog_linux.go:127] "Systemd watchdog is not enabled or the interval is invalid, so health checking will not be started." Jun 03 13:53:59.426401 ip-10-0-134-229 kubenswrapper[2574]: I0603 13:53:59.426272 2574 kubelet.go:2451] "Starting kubelet main sync loop" Jun 03 13:53:59.426401 ip-10-0-134-229 kubenswrapper[2574]: E0603 13:53:59.426311 2574 kubelet.go:2475] "Skipping pod synchronization" err="PLEG is not healthy: pleg has yet to be successful" Jun 03 13:53:59.428294 ip-10-0-134-229 kubenswrapper[2574]: I0603 13:53:59.428271 2574 reflector.go:430] "Caches populated" type="*v1.RuntimeClass" reflector="k8s.io/client-go/informers/factory.go:160" Jun 03 13:53:59.461153 ip-10-0-134-229 kubenswrapper[2574]: I0603 13:53:59.461092 2574 kubelet_node_status.go:413] "Setting node annotation to enable volume controller attach/detach" Jun 03 13:53:59.462051 ip-10-0-134-229 kubenswrapper[2574]: I0603 13:53:59.462038 2574 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-134-229.ec2.internal" event="NodeHasSufficientMemory" Jun 03 13:53:59.462109 ip-10-0-134-229 kubenswrapper[2574]: I0603 13:53:59.462064 2574 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-134-229.ec2.internal" event="NodeHasNoDiskPressure" Jun 03 13:53:59.462109 ip-10-0-134-229 kubenswrapper[2574]: I0603 13:53:59.462079 2574 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-134-229.ec2.internal" event="NodeHasSufficientPID" Jun 03 13:53:59.462109 ip-10-0-134-229 kubenswrapper[2574]: I0603 13:53:59.462107 2574 kubelet_node_status.go:78] "Attempting to register node" node="ip-10-0-134-229.ec2.internal" Jun 03 13:53:59.470152 ip-10-0-134-229 kubenswrapper[2574]: I0603 13:53:59.470130 2574 kubelet_node_status.go:81] "Successfully registered node" node="ip-10-0-134-229.ec2.internal" Jun 03 13:53:59.470236 ip-10-0-134-229 kubenswrapper[2574]: E0603 13:53:59.470155 2574 kubelet_node_status.go:597] "Error updating node status, will retry" err="error getting node \"ip-10-0-134-229.ec2.internal\": node \"ip-10-0-134-229.ec2.internal\" not found" Jun 03 13:53:59.494378 ip-10-0-134-229 kubenswrapper[2574]: E0603 13:53:59.494356 2574 kubelet_node_status.go:515] "Error getting the current node from lister" err="node \"ip-10-0-134-229.ec2.internal\" not found" Jun 03 13:53:59.527354 ip-10-0-134-229 kubenswrapper[2574]: I0603 13:53:59.527316 2574 kubelet.go:2537] "SyncLoop ADD" source="file" pods=["openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-134-229.ec2.internal","kube-system/kube-apiserver-proxy-ip-10-0-134-229.ec2.internal"] Jun 03 13:53:59.527418 ip-10-0-134-229 kubenswrapper[2574]: I0603 13:53:59.527403 2574 kubelet_node_status.go:413] "Setting node annotation to enable volume controller attach/detach" Jun 03 13:53:59.528156 ip-10-0-134-229 kubenswrapper[2574]: I0603 13:53:59.528137 2574 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-134-229.ec2.internal" event="NodeHasSufficientMemory" Jun 03 13:53:59.528220 ip-10-0-134-229 kubenswrapper[2574]: I0603 13:53:59.528168 2574 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-134-229.ec2.internal" event="NodeHasNoDiskPressure" Jun 03 13:53:59.528220 ip-10-0-134-229 kubenswrapper[2574]: I0603 13:53:59.528179 2574 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-134-229.ec2.internal" event="NodeHasSufficientPID" Jun 03 13:53:59.529509 ip-10-0-134-229 kubenswrapper[2574]: I0603 13:53:59.529498 2574 kubelet_node_status.go:413] "Setting node annotation to enable volume controller attach/detach" Jun 03 13:53:59.529661 ip-10-0-134-229 kubenswrapper[2574]: I0603 13:53:59.529647 2574 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-134-229.ec2.internal" Jun 03 13:53:59.529713 ip-10-0-134-229 kubenswrapper[2574]: I0603 13:53:59.529674 2574 kubelet_node_status.go:413] "Setting node annotation to enable volume controller attach/detach" Jun 03 13:53:59.530161 ip-10-0-134-229 kubenswrapper[2574]: I0603 13:53:59.530144 2574 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-134-229.ec2.internal" event="NodeHasSufficientMemory" Jun 03 13:53:59.530222 ip-10-0-134-229 kubenswrapper[2574]: I0603 13:53:59.530144 2574 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-134-229.ec2.internal" event="NodeHasSufficientMemory" Jun 03 13:53:59.530222 ip-10-0-134-229 kubenswrapper[2574]: I0603 13:53:59.530200 2574 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-134-229.ec2.internal" event="NodeHasNoDiskPressure" Jun 03 13:53:59.530222 ip-10-0-134-229 kubenswrapper[2574]: I0603 13:53:59.530213 2574 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-134-229.ec2.internal" event="NodeHasSufficientPID" Jun 03 13:53:59.530303 ip-10-0-134-229 kubenswrapper[2574]: I0603 13:53:59.530174 2574 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-134-229.ec2.internal" event="NodeHasNoDiskPressure" Jun 03 13:53:59.530303 ip-10-0-134-229 kubenswrapper[2574]: I0603 13:53:59.530241 2574 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-134-229.ec2.internal" event="NodeHasSufficientPID" Jun 03 13:53:59.531451 ip-10-0-134-229 kubenswrapper[2574]: I0603 13:53:59.531438 2574 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/kube-apiserver-proxy-ip-10-0-134-229.ec2.internal" Jun 03 13:53:59.531494 ip-10-0-134-229 kubenswrapper[2574]: I0603 13:53:59.531462 2574 kubelet_node_status.go:413] "Setting node annotation to enable volume controller attach/detach" Jun 03 13:53:59.532145 ip-10-0-134-229 kubenswrapper[2574]: I0603 13:53:59.532129 2574 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-134-229.ec2.internal" event="NodeHasSufficientMemory" Jun 03 13:53:59.532235 ip-10-0-134-229 kubenswrapper[2574]: I0603 13:53:59.532157 2574 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-134-229.ec2.internal" event="NodeHasNoDiskPressure" Jun 03 13:53:59.532235 ip-10-0-134-229 kubenswrapper[2574]: I0603 13:53:59.532170 2574 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-134-229.ec2.internal" event="NodeHasSufficientPID" Jun 03 13:53:59.559102 ip-10-0-134-229 kubenswrapper[2574]: E0603 13:53:59.559080 2574 kubelet.go:3336] "No need to create a mirror pod, since failed to get node info from the cluster" err="node \"ip-10-0-134-229.ec2.internal\" not found" node="ip-10-0-134-229.ec2.internal" Jun 03 13:53:59.563286 ip-10-0-134-229 kubenswrapper[2574]: E0603 13:53:59.563271 2574 kubelet.go:3336] "No need to create a mirror pod, since failed to get node info from the cluster" err="node \"ip-10-0-134-229.ec2.internal\" not found" node="ip-10-0-134-229.ec2.internal" Jun 03 13:53:59.595166 ip-10-0-134-229 kubenswrapper[2574]: E0603 13:53:59.595146 2574 kubelet_node_status.go:515] "Error getting the current node from lister" err="node \"ip-10-0-134-229.ec2.internal\" not found" Jun 03 13:53:59.598453 ip-10-0-134-229 kubenswrapper[2574]: I0603 13:53:59.598437 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/host-path/fe2965869ce022bdc90ca9172d2df8d9-config\") pod \"kube-apiserver-proxy-ip-10-0-134-229.ec2.internal\" (UID: \"fe2965869ce022bdc90ca9172d2df8d9\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-134-229.ec2.internal" Jun 03 13:53:59.598506 ip-10-0-134-229 kubenswrapper[2574]: I0603 13:53:59.598462 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/4a797ddfb9d290ccab2f8888a0be8fd1-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-134-229.ec2.internal\" (UID: \"4a797ddfb9d290ccab2f8888a0be8fd1\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-134-229.ec2.internal" Jun 03 13:53:59.598506 ip-10-0-134-229 kubenswrapper[2574]: I0603 13:53:59.598479 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/4a797ddfb9d290ccab2f8888a0be8fd1-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-134-229.ec2.internal\" (UID: \"4a797ddfb9d290ccab2f8888a0be8fd1\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-134-229.ec2.internal" Jun 03 13:53:59.695451 ip-10-0-134-229 kubenswrapper[2574]: E0603 13:53:59.695431 2574 kubelet_node_status.go:515] "Error getting the current node from lister" err="node \"ip-10-0-134-229.ec2.internal\" not found" Jun 03 13:53:59.698725 ip-10-0-134-229 kubenswrapper[2574]: I0603 13:53:59.698710 2574 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/4a797ddfb9d290ccab2f8888a0be8fd1-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-134-229.ec2.internal\" (UID: \"4a797ddfb9d290ccab2f8888a0be8fd1\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-134-229.ec2.internal" Jun 03 13:53:59.698774 ip-10-0-134-229 kubenswrapper[2574]: I0603 13:53:59.698733 2574 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/4a797ddfb9d290ccab2f8888a0be8fd1-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-134-229.ec2.internal\" (UID: \"4a797ddfb9d290ccab2f8888a0be8fd1\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-134-229.ec2.internal" Jun 03 13:53:59.698774 ip-10-0-134-229 kubenswrapper[2574]: I0603 13:53:59.698749 2574 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/host-path/fe2965869ce022bdc90ca9172d2df8d9-config\") pod \"kube-apiserver-proxy-ip-10-0-134-229.ec2.internal\" (UID: \"fe2965869ce022bdc90ca9172d2df8d9\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-134-229.ec2.internal" Jun 03 13:53:59.698868 ip-10-0-134-229 kubenswrapper[2574]: I0603 13:53:59.698783 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/host-path/fe2965869ce022bdc90ca9172d2df8d9-config\") pod \"kube-apiserver-proxy-ip-10-0-134-229.ec2.internal\" (UID: \"fe2965869ce022bdc90ca9172d2df8d9\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-134-229.ec2.internal" Jun 03 13:53:59.698868 ip-10-0-134-229 kubenswrapper[2574]: I0603 13:53:59.698810 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/4a797ddfb9d290ccab2f8888a0be8fd1-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-134-229.ec2.internal\" (UID: \"4a797ddfb9d290ccab2f8888a0be8fd1\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-134-229.ec2.internal" Jun 03 13:53:59.698868 ip-10-0-134-229 kubenswrapper[2574]: I0603 13:53:59.698838 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/4a797ddfb9d290ccab2f8888a0be8fd1-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-134-229.ec2.internal\" (UID: \"4a797ddfb9d290ccab2f8888a0be8fd1\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-134-229.ec2.internal" Jun 03 13:53:59.796157 ip-10-0-134-229 kubenswrapper[2574]: E0603 13:53:59.796095 2574 kubelet_node_status.go:515] "Error getting the current node from lister" err="node \"ip-10-0-134-229.ec2.internal\" not found" Jun 03 13:53:59.861490 ip-10-0-134-229 kubenswrapper[2574]: I0603 13:53:59.861468 2574 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-134-229.ec2.internal" Jun 03 13:53:59.866028 ip-10-0-134-229 kubenswrapper[2574]: I0603 13:53:59.866013 2574 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/kube-apiserver-proxy-ip-10-0-134-229.ec2.internal" Jun 03 13:53:59.896980 ip-10-0-134-229 kubenswrapper[2574]: E0603 13:53:59.896948 2574 kubelet_node_status.go:515] "Error getting the current node from lister" err="node \"ip-10-0-134-229.ec2.internal\" not found" Jun 03 13:53:59.997324 ip-10-0-134-229 kubenswrapper[2574]: E0603 13:53:59.997273 2574 kubelet_node_status.go:515] "Error getting the current node from lister" err="node \"ip-10-0-134-229.ec2.internal\" not found" Jun 03 13:54:00.097742 ip-10-0-134-229 kubenswrapper[2574]: E0603 13:54:00.097677 2574 kubelet_node_status.go:515] "Error getting the current node from lister" err="node \"ip-10-0-134-229.ec2.internal\" not found" Jun 03 13:54:00.198069 ip-10-0-134-229 kubenswrapper[2574]: E0603 13:54:00.198046 2574 kubelet_node_status.go:515] "Error getting the current node from lister" err="node \"ip-10-0-134-229.ec2.internal\" not found" Jun 03 13:54:00.209350 ip-10-0-134-229 kubenswrapper[2574]: I0603 13:54:00.209331 2574 transport.go:147] "Certificate rotation detected, shutting down client connections to start using new credentials" Jun 03 13:54:00.209475 ip-10-0-134-229 kubenswrapper[2574]: I0603 13:54:00.209460 2574 reflector.go:556] "Warning: watch ended with error" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.RuntimeClass" err="very short watch: k8s.io/client-go/informers/factory.go:160: Unexpected watch close - watch lasted less than a second and no items received" Jun 03 13:54:00.296706 ip-10-0-134-229 kubenswrapper[2574]: I0603 13:54:00.296680 2574 certificate_manager.go:566] "Rotating certificates" logger="kubernetes.io/kubelet-serving" Jun 03 13:54:00.298554 ip-10-0-134-229 kubenswrapper[2574]: E0603 13:54:00.298539 2574 kubelet_node_status.go:515] "Error getting the current node from lister" err="node \"ip-10-0-134-229.ec2.internal\" not found" Jun 03 13:54:00.308434 ip-10-0-134-229 kubenswrapper[2574]: I0603 13:54:00.308406 2574 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kube-apiserver-client-kubelet" expiration="2028-06-02 13:48:59 +0000 UTC" deadline="2027-11-25 01:07:06.701211581 +0000 UTC" Jun 03 13:54:00.308434 ip-10-0-134-229 kubenswrapper[2574]: I0603 13:54:00.308433 2574 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kube-apiserver-client-kubelet" sleep="12947h13m6.392781594s" Jun 03 13:54:00.309122 ip-10-0-134-229 kubenswrapper[2574]: I0603 13:54:00.309104 2574 reflector.go:430] "Caches populated" logger="kubernetes.io/kubelet-serving" type="*v1.CertificateSigningRequest" reflector="k8s.io/client-go/tools/watch/informerwatcher.go:162" Jun 03 13:54:00.330136 ip-10-0-134-229 kubenswrapper[2574]: I0603 13:54:00.330112 2574 csr.go:274] "Certificate signing request is approved, waiting to be issued" logger="kubernetes.io/kubelet-serving" csr="csr-2487m" Jun 03 13:54:00.336523 ip-10-0-134-229 kubenswrapper[2574]: I0603 13:54:00.336507 2574 csr.go:270] "Certificate signing request is issued" logger="kubernetes.io/kubelet-serving" csr="csr-2487m" Jun 03 13:54:00.359321 ip-10-0-134-229 kubenswrapper[2574]: W0603 13:54:00.359293 2574 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod4a797ddfb9d290ccab2f8888a0be8fd1.slice/crio-2df792f5437444f4a9dcbfdb8e0dfe19cecc9616beb739312078573ac9eb82d7 WatchSource:0}: Error finding container 2df792f5437444f4a9dcbfdb8e0dfe19cecc9616beb739312078573ac9eb82d7: Status 404 returned error can't find the container with id 2df792f5437444f4a9dcbfdb8e0dfe19cecc9616beb739312078573ac9eb82d7 Jun 03 13:54:00.359528 ip-10-0-134-229 kubenswrapper[2574]: W0603 13:54:00.359508 2574 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podfe2965869ce022bdc90ca9172d2df8d9.slice/crio-e496a6d50e3b52662ab6dfb2d08b0579a58da18aed3da07d5df1dc799f397029 WatchSource:0}: Error finding container e496a6d50e3b52662ab6dfb2d08b0579a58da18aed3da07d5df1dc799f397029: Status 404 returned error can't find the container with id e496a6d50e3b52662ab6dfb2d08b0579a58da18aed3da07d5df1dc799f397029 Jun 03 13:54:00.362680 ip-10-0-134-229 kubenswrapper[2574]: I0603 13:54:00.362666 2574 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider Jun 03 13:54:00.399581 ip-10-0-134-229 kubenswrapper[2574]: E0603 13:54:00.399551 2574 kubelet_node_status.go:515] "Error getting the current node from lister" err="node \"ip-10-0-134-229.ec2.internal\" not found" Jun 03 13:54:00.429498 ip-10-0-134-229 kubenswrapper[2574]: I0603 13:54:00.429462 2574 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-134-229.ec2.internal" event={"ID":"fe2965869ce022bdc90ca9172d2df8d9","Type":"ContainerStarted","Data":"e496a6d50e3b52662ab6dfb2d08b0579a58da18aed3da07d5df1dc799f397029"} Jun 03 13:54:00.430473 ip-10-0-134-229 kubenswrapper[2574]: I0603 13:54:00.430450 2574 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-134-229.ec2.internal" event={"ID":"4a797ddfb9d290ccab2f8888a0be8fd1","Type":"ContainerStarted","Data":"2df792f5437444f4a9dcbfdb8e0dfe19cecc9616beb739312078573ac9eb82d7"} Jun 03 13:54:00.499792 ip-10-0-134-229 kubenswrapper[2574]: E0603 13:54:00.499765 2574 kubelet_node_status.go:515] "Error getting the current node from lister" err="node \"ip-10-0-134-229.ec2.internal\" not found" Jun 03 13:54:00.600306 ip-10-0-134-229 kubenswrapper[2574]: E0603 13:54:00.600241 2574 kubelet_node_status.go:515] "Error getting the current node from lister" err="node \"ip-10-0-134-229.ec2.internal\" not found" Jun 03 13:54:00.700734 ip-10-0-134-229 kubenswrapper[2574]: E0603 13:54:00.700708 2574 kubelet_node_status.go:515] "Error getting the current node from lister" err="node \"ip-10-0-134-229.ec2.internal\" not found" Jun 03 13:54:00.723254 ip-10-0-134-229 kubenswrapper[2574]: I0603 13:54:00.723237 2574 reflector.go:430] "Caches populated" type="*v1.Node" reflector="k8s.io/client-go/informers/factory.go:160" Jun 03 13:54:00.751238 ip-10-0-134-229 kubenswrapper[2574]: I0603 13:54:00.751221 2574 reflector.go:430] "Caches populated" type="*v1.CSIDriver" reflector="k8s.io/client-go/informers/factory.go:160" Jun 03 13:54:00.785431 ip-10-0-134-229 kubenswrapper[2574]: I0603 13:54:00.785406 2574 reflector.go:430] "Caches populated" type="*v1.Service" reflector="k8s.io/client-go/informers/factory.go:160" Jun 03 13:54:00.797160 ip-10-0-134-229 kubenswrapper[2574]: I0603 13:54:00.797132 2574 kubelet.go:3340] "Creating a mirror pod for static pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-134-229.ec2.internal" Jun 03 13:54:00.812122 ip-10-0-134-229 kubenswrapper[2574]: I0603 13:54:00.812014 2574 warnings.go:110] "Warning: metadata.name: this is used in the Pod's hostname, which can result in surprising behavior; a DNS label is recommended: [must not contain dots]" Jun 03 13:54:00.813077 ip-10-0-134-229 kubenswrapper[2574]: I0603 13:54:00.813060 2574 kubelet.go:3340] "Creating a mirror pod for static pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-134-229.ec2.internal" Jun 03 13:54:00.825348 ip-10-0-134-229 kubenswrapper[2574]: I0603 13:54:00.825257 2574 warnings.go:110] "Warning: metadata.name: this is used in the Pod's hostname, which can result in surprising behavior; a DNS label is recommended: [must not contain dots]" Jun 03 13:54:01.278221 ip-10-0-134-229 kubenswrapper[2574]: I0603 13:54:01.278189 2574 apiserver.go:52] "Watching apiserver" Jun 03 13:54:01.283797 ip-10-0-134-229 kubenswrapper[2574]: I0603 13:54:01.283766 2574 reflector.go:430] "Caches populated" type="*v1.Pod" reflector="pkg/kubelet/config/apiserver.go:66" Jun 03 13:54:01.284159 ip-10-0-134-229 kubenswrapper[2574]: I0603 13:54:01.284138 2574 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-multus/network-metrics-daemon-9f7k7","kube-system/konnectivity-agent-5mz8g","openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-134-229.ec2.internal","openshift-multus/multus-additional-cni-plugins-v264j","openshift-multus/multus-jkcw2","openshift-network-diagnostics/network-check-target-vpjf9","openshift-network-operator/iptables-alerter-ft4ch","openshift-ovn-kubernetes/ovnkube-node-kfq8c","kube-system/kube-apiserver-proxy-ip-10-0-134-229.ec2.internal","openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-zhqfp","openshift-cluster-node-tuning-operator/tuned-l2f2s","openshift-dns/node-resolver-pc2nh","openshift-image-registry/node-ca-7ql52"] Jun 03 13:54:01.286614 ip-10-0-134-229 kubenswrapper[2574]: I0603 13:54:01.286594 2574 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-operator/iptables-alerter-ft4ch" Jun 03 13:54:01.286699 ip-10-0-134-229 kubenswrapper[2574]: I0603 13:54:01.286626 2574 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/konnectivity-agent-5mz8g" Jun 03 13:54:01.289974 ip-10-0-134-229 kubenswrapper[2574]: I0603 13:54:01.289483 2574 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-additional-cni-plugins-v264j" Jun 03 13:54:01.289974 ip-10-0-134-229 kubenswrapper[2574]: I0603 13:54:01.289542 2574 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"kube-root-ca.crt\"" Jun 03 13:54:01.289974 ip-10-0-134-229 kubenswrapper[2574]: I0603 13:54:01.289549 2574 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kube-system\"/\"konnectivity-ca-bundle\"" Jun 03 13:54:01.289974 ip-10-0-134-229 kubenswrapper[2574]: I0603 13:54:01.289643 2574 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-operator\"/\"iptables-alerter-dockercfg-z86xz\"" Jun 03 13:54:01.289974 ip-10-0-134-229 kubenswrapper[2574]: I0603 13:54:01.289935 2574 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"konnectivity-agent\"" Jun 03 13:54:01.290292 ip-10-0-134-229 kubenswrapper[2574]: I0603 13:54:01.289949 2574 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"openshift-service-ca.crt\"" Jun 03 13:54:01.290694 ip-10-0-134-229 kubenswrapper[2574]: I0603 13:54:01.290087 2574 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"default-dockercfg-tqscp\"" Jun 03 13:54:01.290803 ip-10-0-134-229 kubenswrapper[2574]: I0603 13:54:01.290737 2574 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"iptables-alerter-script\"" Jun 03 13:54:01.291422 ip-10-0-134-229 kubenswrapper[2574]: I0603 13:54:01.291400 2574 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"default-cni-sysctl-allowlist\"" Jun 03 13:54:01.291538 ip-10-0-134-229 kubenswrapper[2574]: I0603 13:54:01.291448 2574 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"openshift-service-ca.crt\"" Jun 03 13:54:01.291962 ip-10-0-134-229 kubenswrapper[2574]: I0603 13:54:01.291943 2574 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"multus-ancillary-tools-dockercfg-tfptg\"" Jun 03 13:54:01.292043 ip-10-0-134-229 kubenswrapper[2574]: I0603 13:54:01.291948 2574 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"kube-root-ca.crt\"" Jun 03 13:54:01.292103 ip-10-0-134-229 kubenswrapper[2574]: I0603 13:54:01.292054 2574 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"whereabouts-flatfile-config\"" Jun 03 13:54:01.292244 ip-10-0-134-229 kubenswrapper[2574]: I0603 13:54:01.292232 2574 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-jkcw2" Jun 03 13:54:01.292303 ip-10-0-134-229 kubenswrapper[2574]: I0603 13:54:01.292264 2574 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"cni-copy-resources\"" Jun 03 13:54:01.293638 ip-10-0-134-229 kubenswrapper[2574]: I0603 13:54:01.293612 2574 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-vpjf9" Jun 03 13:54:01.293737 ip-10-0-134-229 kubenswrapper[2574]: I0603 13:54:01.293721 2574 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-9f7k7" Jun 03 13:54:01.293737 ip-10-0-134-229 kubenswrapper[2574]: E0603 13:54:01.293721 2574 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-vpjf9" podUID="1422bf53-dc3d-42c1-9a1f-8657ec8777f4" Jun 03 13:54:01.293849 ip-10-0-134-229 kubenswrapper[2574]: E0603 13:54:01.293779 2574 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-9f7k7" podUID="6f47d39b-6eb0-4d5f-921b-0d56c194113e" Jun 03 13:54:01.294052 ip-10-0-134-229 kubenswrapper[2574]: I0603 13:54:01.294033 2574 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"multus-daemon-config\"" Jun 03 13:54:01.294308 ip-10-0-134-229 kubenswrapper[2574]: I0603 13:54:01.294286 2574 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"default-dockercfg-p2wfx\"" Jun 03 13:54:01.295249 ip-10-0-134-229 kubenswrapper[2574]: I0603 13:54:01.295231 2574 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ovn-kubernetes/ovnkube-node-kfq8c" Jun 03 13:54:01.296590 ip-10-0-134-229 kubenswrapper[2574]: I0603 13:54:01.296559 2574 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-zhqfp" Jun 03 13:54:01.297791 ip-10-0-134-229 kubenswrapper[2574]: I0603 13:54:01.297417 2574 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"kube-root-ca.crt\"" Jun 03 13:54:01.297791 ip-10-0-134-229 kubenswrapper[2574]: I0603 13:54:01.297427 2574 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"ovnkube-config\"" Jun 03 13:54:01.297791 ip-10-0-134-229 kubenswrapper[2574]: I0603 13:54:01.297691 2574 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"env-overrides\"" Jun 03 13:54:01.297791 ip-10-0-134-229 kubenswrapper[2574]: I0603 13:54:01.297702 2574 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"ovnkube-script-lib\"" Jun 03 13:54:01.297791 ip-10-0-134-229 kubenswrapper[2574]: I0603 13:54:01.297769 2574 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"openshift-service-ca.crt\"" Jun 03 13:54:01.297791 ip-10-0-134-229 kubenswrapper[2574]: I0603 13:54:01.297772 2574 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ovn-kubernetes\"/\"ovn-kubernetes-node-dockercfg-wxjcz\"" Jun 03 13:54:01.298117 ip-10-0-134-229 kubenswrapper[2574]: I0603 13:54:01.297799 2574 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ovn-kubernetes\"/\"ovn-node-metrics-cert\"" Jun 03 13:54:01.298117 ip-10-0-134-229 kubenswrapper[2574]: I0603 13:54:01.298077 2574 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-node-tuning-operator/tuned-l2f2s" Jun 03 13:54:01.298198 ip-10-0-134-229 kubenswrapper[2574]: I0603 13:54:01.298174 2574 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-csi-drivers\"/\"openshift-service-ca.crt\"" Jun 03 13:54:01.298782 ip-10-0-134-229 kubenswrapper[2574]: I0603 13:54:01.298765 2574 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-csi-drivers\"/\"aws-ebs-csi-driver-node-metrics-serving-cert\"" Jun 03 13:54:01.298848 ip-10-0-134-229 kubenswrapper[2574]: I0603 13:54:01.298819 2574 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-csi-drivers\"/\"aws-ebs-csi-driver-node-sa-dockercfg-prpmb\"" Jun 03 13:54:01.298954 ip-10-0-134-229 kubenswrapper[2574]: I0603 13:54:01.298770 2574 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-csi-drivers\"/\"kube-root-ca.crt\"" Jun 03 13:54:01.299758 ip-10-0-134-229 kubenswrapper[2574]: I0603 13:54:01.299739 2574 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/node-resolver-pc2nh" Jun 03 13:54:01.299918 ip-10-0-134-229 kubenswrapper[2574]: I0603 13:54:01.299902 2574 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"kube-root-ca.crt\"" Jun 03 13:54:01.300391 ip-10-0-134-229 kubenswrapper[2574]: I0603 13:54:01.300350 2574 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"openshift-service-ca.crt\"" Jun 03 13:54:01.300491 ip-10-0-134-229 kubenswrapper[2574]: I0603 13:54:01.300412 2574 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"tuned-dockercfg-gkqg5\"" Jun 03 13:54:01.301584 ip-10-0-134-229 kubenswrapper[2574]: I0603 13:54:01.301568 2574 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/node-ca-7ql52" Jun 03 13:54:01.301772 ip-10-0-134-229 kubenswrapper[2574]: I0603 13:54:01.301756 2574 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"node-resolver-dockercfg-qgvgc\"" Jun 03 13:54:01.301961 ip-10-0-134-229 kubenswrapper[2574]: I0603 13:54:01.301943 2574 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"openshift-service-ca.crt\"" Jun 03 13:54:01.302035 ip-10-0-134-229 kubenswrapper[2574]: I0603 13:54:01.301975 2574 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"kube-root-ca.crt\"" Jun 03 13:54:01.303803 ip-10-0-134-229 kubenswrapper[2574]: I0603 13:54:01.303762 2574 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"openshift-service-ca.crt\"" Jun 03 13:54:01.304011 ip-10-0-134-229 kubenswrapper[2574]: I0603 13:54:01.303974 2574 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"node-ca-dockercfg-gcsrd\"" Jun 03 13:54:01.304011 ip-10-0-134-229 kubenswrapper[2574]: I0603 13:54:01.303974 2574 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"image-registry-certificates\"" Jun 03 13:54:01.304802 ip-10-0-134-229 kubenswrapper[2574]: I0603 13:54:01.304216 2574 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"kube-root-ca.crt\"" Jun 03 13:54:01.305292 ip-10-0-134-229 kubenswrapper[2574]: I0603 13:54:01.305209 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-zcc9k\" (UniqueName: \"kubernetes.io/projected/9ccfb5b8-aff0-4122-a190-c406b390bdae-kube-api-access-zcc9k\") pod \"multus-jkcw2\" (UID: \"9ccfb5b8-aff0-4122-a190-c406b390bdae\") " pod="openshift-multus/multus-jkcw2" Jun 03 13:54:01.305292 ip-10-0-134-229 kubenswrapper[2574]: I0603 13:54:01.305241 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/f88ee55a-f56d-41d1-9216-18124b7f55f3-var-lib-openvswitch\") pod \"ovnkube-node-kfq8c\" (UID: \"f88ee55a-f56d-41d1-9216-18124b7f55f3\") " pod="openshift-ovn-kubernetes/ovnkube-node-kfq8c" Jun 03 13:54:01.305292 ip-10-0-134-229 kubenswrapper[2574]: I0603 13:54:01.305266 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/f88ee55a-f56d-41d1-9216-18124b7f55f3-run-ovn\") pod \"ovnkube-node-kfq8c\" (UID: \"f88ee55a-f56d-41d1-9216-18124b7f55f3\") " pod="openshift-ovn-kubernetes/ovnkube-node-kfq8c" Jun 03 13:54:01.305485 ip-10-0-134-229 kubenswrapper[2574]: I0603 13:54:01.305327 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/f88ee55a-f56d-41d1-9216-18124b7f55f3-ovnkube-config\") pod \"ovnkube-node-kfq8c\" (UID: \"f88ee55a-f56d-41d1-9216-18124b7f55f3\") " pod="openshift-ovn-kubernetes/ovnkube-node-kfq8c" Jun 03 13:54:01.305485 ip-10-0-134-229 kubenswrapper[2574]: I0603 13:54:01.305364 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/92d4e3fb-b640-4739-bf3a-6bf0ee60d517-socket-dir\") pod \"aws-ebs-csi-driver-node-zhqfp\" (UID: \"92d4e3fb-b640-4739-bf3a-6bf0ee60d517\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-zhqfp" Jun 03 13:54:01.305485 ip-10-0-134-229 kubenswrapper[2574]: I0603 13:54:01.305406 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/9ccfb5b8-aff0-4122-a190-c406b390bdae-system-cni-dir\") pod \"multus-jkcw2\" (UID: \"9ccfb5b8-aff0-4122-a190-c406b390bdae\") " pod="openshift-multus/multus-jkcw2" Jun 03 13:54:01.305485 ip-10-0-134-229 kubenswrapper[2574]: I0603 13:54:01.305431 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/9ccfb5b8-aff0-4122-a190-c406b390bdae-cnibin\") pod \"multus-jkcw2\" (UID: \"9ccfb5b8-aff0-4122-a190-c406b390bdae\") " pod="openshift-multus/multus-jkcw2" Jun 03 13:54:01.305660 ip-10-0-134-229 kubenswrapper[2574]: I0603 13:54:01.305491 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/9ccfb5b8-aff0-4122-a190-c406b390bdae-cni-binary-copy\") pod \"multus-jkcw2\" (UID: \"9ccfb5b8-aff0-4122-a190-c406b390bdae\") " pod="openshift-multus/multus-jkcw2" Jun 03 13:54:01.305660 ip-10-0-134-229 kubenswrapper[2574]: I0603 13:54:01.305521 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/9ccfb5b8-aff0-4122-a190-c406b390bdae-host-run-netns\") pod \"multus-jkcw2\" (UID: \"9ccfb5b8-aff0-4122-a190-c406b390bdae\") " pod="openshift-multus/multus-jkcw2" Jun 03 13:54:01.305660 ip-10-0-134-229 kubenswrapper[2574]: I0603 13:54:01.305546 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-gm6cq\" (UniqueName: \"kubernetes.io/projected/6f47d39b-6eb0-4d5f-921b-0d56c194113e-kube-api-access-gm6cq\") pod \"network-metrics-daemon-9f7k7\" (UID: \"6f47d39b-6eb0-4d5f-921b-0d56c194113e\") " pod="openshift-multus/network-metrics-daemon-9f7k7" Jun 03 13:54:01.305660 ip-10-0-134-229 kubenswrapper[2574]: I0603 13:54:01.305585 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-hscr6\" (UniqueName: \"kubernetes.io/projected/92d4e3fb-b640-4739-bf3a-6bf0ee60d517-kube-api-access-hscr6\") pod \"aws-ebs-csi-driver-node-zhqfp\" (UID: \"92d4e3fb-b640-4739-bf3a-6bf0ee60d517\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-zhqfp" Jun 03 13:54:01.305660 ip-10-0-134-229 kubenswrapper[2574]: I0603 13:54:01.305642 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/963383f0-b900-46cb-81f8-4e92934bb58e-etc-modprobe-d\") pod \"tuned-l2f2s\" (UID: \"963383f0-b900-46cb-81f8-4e92934bb58e\") " pod="openshift-cluster-node-tuning-operator/tuned-l2f2s" Jun 03 13:54:01.305865 ip-10-0-134-229 kubenswrapper[2574]: I0603 13:54:01.305666 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run\" (UniqueName: \"kubernetes.io/host-path/963383f0-b900-46cb-81f8-4e92934bb58e-run\") pod \"tuned-l2f2s\" (UID: \"963383f0-b900-46cb-81f8-4e92934bb58e\") " pod="openshift-cluster-node-tuning-operator/tuned-l2f2s" Jun 03 13:54:01.305865 ip-10-0-134-229 kubenswrapper[2574]: I0603 13:54:01.305691 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-gwjt5\" (UniqueName: \"kubernetes.io/projected/963383f0-b900-46cb-81f8-4e92934bb58e-kube-api-access-gwjt5\") pod \"tuned-l2f2s\" (UID: \"963383f0-b900-46cb-81f8-4e92934bb58e\") " pod="openshift-cluster-node-tuning-operator/tuned-l2f2s" Jun 03 13:54:01.305865 ip-10-0-134-229 kubenswrapper[2574]: I0603 13:54:01.305716 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/9ccfb5b8-aff0-4122-a190-c406b390bdae-multus-socket-dir-parent\") pod \"multus-jkcw2\" (UID: \"9ccfb5b8-aff0-4122-a190-c406b390bdae\") " pod="openshift-multus/multus-jkcw2" Jun 03 13:54:01.305865 ip-10-0-134-229 kubenswrapper[2574]: I0603 13:54:01.305739 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/f88ee55a-f56d-41d1-9216-18124b7f55f3-ovn-node-metrics-cert\") pod \"ovnkube-node-kfq8c\" (UID: \"f88ee55a-f56d-41d1-9216-18124b7f55f3\") " pod="openshift-ovn-kubernetes/ovnkube-node-kfq8c" Jun 03 13:54:01.305865 ip-10-0-134-229 kubenswrapper[2574]: I0603 13:54:01.305763 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-b4pf4\" (UniqueName: \"kubernetes.io/projected/f88ee55a-f56d-41d1-9216-18124b7f55f3-kube-api-access-b4pf4\") pod \"ovnkube-node-kfq8c\" (UID: \"f88ee55a-f56d-41d1-9216-18124b7f55f3\") " pod="openshift-ovn-kubernetes/ovnkube-node-kfq8c" Jun 03 13:54:01.305865 ip-10-0-134-229 kubenswrapper[2574]: I0603 13:54:01.305787 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/e868100e-e4c6-48f1-b00c-ae9c32f7de33-iptables-alerter-script\") pod \"iptables-alerter-ft4ch\" (UID: \"e868100e-e4c6-48f1-b00c-ae9c32f7de33\") " pod="openshift-network-operator/iptables-alerter-ft4ch" Jun 03 13:54:01.305865 ip-10-0-134-229 kubenswrapper[2574]: I0603 13:54:01.305812 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/92d4e3fb-b640-4739-bf3a-6bf0ee60d517-device-dir\") pod \"aws-ebs-csi-driver-node-zhqfp\" (UID: \"92d4e3fb-b640-4739-bf3a-6bf0ee60d517\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-zhqfp" Jun 03 13:54:01.305865 ip-10-0-134-229 kubenswrapper[2574]: I0603 13:54:01.305836 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/92d4e3fb-b640-4739-bf3a-6bf0ee60d517-sys-fs\") pod \"aws-ebs-csi-driver-node-zhqfp\" (UID: \"92d4e3fb-b640-4739-bf3a-6bf0ee60d517\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-zhqfp" Jun 03 13:54:01.305865 ip-10-0-134-229 kubenswrapper[2574]: I0603 13:54:01.305862 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/963383f0-b900-46cb-81f8-4e92934bb58e-etc-sysconfig\") pod \"tuned-l2f2s\" (UID: \"963383f0-b900-46cb-81f8-4e92934bb58e\") " pod="openshift-cluster-node-tuning-operator/tuned-l2f2s" Jun 03 13:54:01.306247 ip-10-0-134-229 kubenswrapper[2574]: I0603 13:54:01.305882 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/9ccfb5b8-aff0-4122-a190-c406b390bdae-hostroot\") pod \"multus-jkcw2\" (UID: \"9ccfb5b8-aff0-4122-a190-c406b390bdae\") " pod="openshift-multus/multus-jkcw2" Jun 03 13:54:01.306247 ip-10-0-134-229 kubenswrapper[2574]: I0603 13:54:01.305901 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/f88ee55a-f56d-41d1-9216-18124b7f55f3-host-cni-bin\") pod \"ovnkube-node-kfq8c\" (UID: \"f88ee55a-f56d-41d1-9216-18124b7f55f3\") " pod="openshift-ovn-kubernetes/ovnkube-node-kfq8c" Jun 03 13:54:01.306247 ip-10-0-134-229 kubenswrapper[2574]: I0603 13:54:01.305924 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/6f47d39b-6eb0-4d5f-921b-0d56c194113e-metrics-certs\") pod \"network-metrics-daemon-9f7k7\" (UID: \"6f47d39b-6eb0-4d5f-921b-0d56c194113e\") " pod="openshift-multus/network-metrics-daemon-9f7k7" Jun 03 13:54:01.306247 ip-10-0-134-229 kubenswrapper[2574]: I0603 13:54:01.305948 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/963383f0-b900-46cb-81f8-4e92934bb58e-tmp\") pod \"tuned-l2f2s\" (UID: \"963383f0-b900-46cb-81f8-4e92934bb58e\") " pod="openshift-cluster-node-tuning-operator/tuned-l2f2s" Jun 03 13:54:01.306247 ip-10-0-134-229 kubenswrapper[2574]: I0603 13:54:01.305965 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/8c5a5cc8-abff-454b-8b7c-6e4064a2c8c0-agent-certs\") pod \"konnectivity-agent-5mz8g\" (UID: \"8c5a5cc8-abff-454b-8b7c-6e4064a2c8c0\") " pod="kube-system/konnectivity-agent-5mz8g" Jun 03 13:54:01.306247 ip-10-0-134-229 kubenswrapper[2574]: I0603 13:54:01.305979 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/9ccfb5b8-aff0-4122-a190-c406b390bdae-multus-cni-dir\") pod \"multus-jkcw2\" (UID: \"9ccfb5b8-aff0-4122-a190-c406b390bdae\") " pod="openshift-multus/multus-jkcw2" Jun 03 13:54:01.306247 ip-10-0-134-229 kubenswrapper[2574]: I0603 13:54:01.306000 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/9ccfb5b8-aff0-4122-a190-c406b390bdae-host-run-k8s-cni-cncf-io\") pod \"multus-jkcw2\" (UID: \"9ccfb5b8-aff0-4122-a190-c406b390bdae\") " pod="openshift-multus/multus-jkcw2" Jun 03 13:54:01.306247 ip-10-0-134-229 kubenswrapper[2574]: I0603 13:54:01.306046 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/9ccfb5b8-aff0-4122-a190-c406b390bdae-host-run-multus-certs\") pod \"multus-jkcw2\" (UID: \"9ccfb5b8-aff0-4122-a190-c406b390bdae\") " pod="openshift-multus/multus-jkcw2" Jun 03 13:54:01.306247 ip-10-0-134-229 kubenswrapper[2574]: I0603 13:54:01.306085 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/f88ee55a-f56d-41d1-9216-18124b7f55f3-host-kubelet\") pod \"ovnkube-node-kfq8c\" (UID: \"f88ee55a-f56d-41d1-9216-18124b7f55f3\") " pod="openshift-ovn-kubernetes/ovnkube-node-kfq8c" Jun 03 13:54:01.306247 ip-10-0-134-229 kubenswrapper[2574]: I0603 13:54:01.306112 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/9ccfb5b8-aff0-4122-a190-c406b390bdae-host-var-lib-kubelet\") pod \"multus-jkcw2\" (UID: \"9ccfb5b8-aff0-4122-a190-c406b390bdae\") " pod="openshift-multus/multus-jkcw2" Jun 03 13:54:01.306247 ip-10-0-134-229 kubenswrapper[2574]: I0603 13:54:01.306133 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/9ccfb5b8-aff0-4122-a190-c406b390bdae-multus-conf-dir\") pod \"multus-jkcw2\" (UID: \"9ccfb5b8-aff0-4122-a190-c406b390bdae\") " pod="openshift-multus/multus-jkcw2" Jun 03 13:54:01.306247 ip-10-0-134-229 kubenswrapper[2574]: I0603 13:54:01.306155 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/f88ee55a-f56d-41d1-9216-18124b7f55f3-ovnkube-script-lib\") pod \"ovnkube-node-kfq8c\" (UID: \"f88ee55a-f56d-41d1-9216-18124b7f55f3\") " pod="openshift-ovn-kubernetes/ovnkube-node-kfq8c" Jun 03 13:54:01.306247 ip-10-0-134-229 kubenswrapper[2574]: I0603 13:54:01.306183 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/963383f0-b900-46cb-81f8-4e92934bb58e-var-lib-kubelet\") pod \"tuned-l2f2s\" (UID: \"963383f0-b900-46cb-81f8-4e92934bb58e\") " pod="openshift-cluster-node-tuning-operator/tuned-l2f2s" Jun 03 13:54:01.306247 ip-10-0-134-229 kubenswrapper[2574]: I0603 13:54:01.306209 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/77b2aeec-d4be-45f6-b355-4030387080ad-os-release\") pod \"multus-additional-cni-plugins-v264j\" (UID: \"77b2aeec-d4be-45f6-b355-4030387080ad\") " pod="openshift-multus/multus-additional-cni-plugins-v264j" Jun 03 13:54:01.306247 ip-10-0-134-229 kubenswrapper[2574]: I0603 13:54:01.306233 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/9ccfb5b8-aff0-4122-a190-c406b390bdae-multus-daemon-config\") pod \"multus-jkcw2\" (UID: \"9ccfb5b8-aff0-4122-a190-c406b390bdae\") " pod="openshift-multus/multus-jkcw2" Jun 03 13:54:01.306887 ip-10-0-134-229 kubenswrapper[2574]: I0603 13:54:01.306279 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/92d4e3fb-b640-4739-bf3a-6bf0ee60d517-registration-dir\") pod \"aws-ebs-csi-driver-node-zhqfp\" (UID: \"92d4e3fb-b640-4739-bf3a-6bf0ee60d517\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-zhqfp" Jun 03 13:54:01.306887 ip-10-0-134-229 kubenswrapper[2574]: I0603 13:54:01.306310 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/963383f0-b900-46cb-81f8-4e92934bb58e-etc-kubernetes\") pod \"tuned-l2f2s\" (UID: \"963383f0-b900-46cb-81f8-4e92934bb58e\") " pod="openshift-cluster-node-tuning-operator/tuned-l2f2s" Jun 03 13:54:01.306887 ip-10-0-134-229 kubenswrapper[2574]: I0603 13:54:01.306369 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/f88ee55a-f56d-41d1-9216-18124b7f55f3-host-slash\") pod \"ovnkube-node-kfq8c\" (UID: \"f88ee55a-f56d-41d1-9216-18124b7f55f3\") " pod="openshift-ovn-kubernetes/ovnkube-node-kfq8c" Jun 03 13:54:01.306887 ip-10-0-134-229 kubenswrapper[2574]: I0603 13:54:01.306456 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/f88ee55a-f56d-41d1-9216-18124b7f55f3-env-overrides\") pod \"ovnkube-node-kfq8c\" (UID: \"f88ee55a-f56d-41d1-9216-18124b7f55f3\") " pod="openshift-ovn-kubernetes/ovnkube-node-kfq8c" Jun 03 13:54:01.306887 ip-10-0-134-229 kubenswrapper[2574]: I0603 13:54:01.306482 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/77b2aeec-d4be-45f6-b355-4030387080ad-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-v264j\" (UID: \"77b2aeec-d4be-45f6-b355-4030387080ad\") " pod="openshift-multus/multus-additional-cni-plugins-v264j" Jun 03 13:54:01.306887 ip-10-0-134-229 kubenswrapper[2574]: I0603 13:54:01.306507 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/f88ee55a-f56d-41d1-9216-18124b7f55f3-run-systemd\") pod \"ovnkube-node-kfq8c\" (UID: \"f88ee55a-f56d-41d1-9216-18124b7f55f3\") " pod="openshift-ovn-kubernetes/ovnkube-node-kfq8c" Jun 03 13:54:01.306887 ip-10-0-134-229 kubenswrapper[2574]: I0603 13:54:01.306530 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/92d4e3fb-b640-4739-bf3a-6bf0ee60d517-etc-selinux\") pod \"aws-ebs-csi-driver-node-zhqfp\" (UID: \"92d4e3fb-b640-4739-bf3a-6bf0ee60d517\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-zhqfp" Jun 03 13:54:01.306887 ip-10-0-134-229 kubenswrapper[2574]: I0603 13:54:01.306553 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/963383f0-b900-46cb-81f8-4e92934bb58e-etc-sysctl-conf\") pod \"tuned-l2f2s\" (UID: \"963383f0-b900-46cb-81f8-4e92934bb58e\") " pod="openshift-cluster-node-tuning-operator/tuned-l2f2s" Jun 03 13:54:01.306887 ip-10-0-134-229 kubenswrapper[2574]: I0603 13:54:01.306596 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/963383f0-b900-46cb-81f8-4e92934bb58e-sys\") pod \"tuned-l2f2s\" (UID: \"963383f0-b900-46cb-81f8-4e92934bb58e\") " pod="openshift-cluster-node-tuning-operator/tuned-l2f2s" Jun 03 13:54:01.306887 ip-10-0-134-229 kubenswrapper[2574]: I0603 13:54:01.306620 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-wjjfh\" (UniqueName: \"kubernetes.io/projected/e868100e-e4c6-48f1-b00c-ae9c32f7de33-kube-api-access-wjjfh\") pod \"iptables-alerter-ft4ch\" (UID: \"e868100e-e4c6-48f1-b00c-ae9c32f7de33\") " pod="openshift-network-operator/iptables-alerter-ft4ch" Jun 03 13:54:01.306887 ip-10-0-134-229 kubenswrapper[2574]: I0603 13:54:01.306662 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/9ccfb5b8-aff0-4122-a190-c406b390bdae-etc-kubernetes\") pod \"multus-jkcw2\" (UID: \"9ccfb5b8-aff0-4122-a190-c406b390bdae\") " pod="openshift-multus/multus-jkcw2" Jun 03 13:54:01.306887 ip-10-0-134-229 kubenswrapper[2574]: I0603 13:54:01.306715 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/e868100e-e4c6-48f1-b00c-ae9c32f7de33-host-slash\") pod \"iptables-alerter-ft4ch\" (UID: \"e868100e-e4c6-48f1-b00c-ae9c32f7de33\") " pod="openshift-network-operator/iptables-alerter-ft4ch" Jun 03 13:54:01.306887 ip-10-0-134-229 kubenswrapper[2574]: I0603 13:54:01.306740 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/963383f0-b900-46cb-81f8-4e92934bb58e-lib-modules\") pod \"tuned-l2f2s\" (UID: \"963383f0-b900-46cb-81f8-4e92934bb58e\") " pod="openshift-cluster-node-tuning-operator/tuned-l2f2s" Jun 03 13:54:01.306887 ip-10-0-134-229 kubenswrapper[2574]: I0603 13:54:01.306758 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/963383f0-b900-46cb-81f8-4e92934bb58e-etc-tuned\") pod \"tuned-l2f2s\" (UID: \"963383f0-b900-46cb-81f8-4e92934bb58e\") " pod="openshift-cluster-node-tuning-operator/tuned-l2f2s" Jun 03 13:54:01.306887 ip-10-0-134-229 kubenswrapper[2574]: I0603 13:54:01.306790 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/77b2aeec-d4be-45f6-b355-4030387080ad-system-cni-dir\") pod \"multus-additional-cni-plugins-v264j\" (UID: \"77b2aeec-d4be-45f6-b355-4030387080ad\") " pod="openshift-multus/multus-additional-cni-plugins-v264j" Jun 03 13:54:01.306887 ip-10-0-134-229 kubenswrapper[2574]: I0603 13:54:01.306808 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/9ccfb5b8-aff0-4122-a190-c406b390bdae-host-var-lib-cni-multus\") pod \"multus-jkcw2\" (UID: \"9ccfb5b8-aff0-4122-a190-c406b390bdae\") " pod="openshift-multus/multus-jkcw2" Jun 03 13:54:01.307639 ip-10-0-134-229 kubenswrapper[2574]: I0603 13:54:01.306830 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/963383f0-b900-46cb-81f8-4e92934bb58e-etc-sysctl-d\") pod \"tuned-l2f2s\" (UID: \"963383f0-b900-46cb-81f8-4e92934bb58e\") " pod="openshift-cluster-node-tuning-operator/tuned-l2f2s" Jun 03 13:54:01.307639 ip-10-0-134-229 kubenswrapper[2574]: I0603 13:54:01.306855 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/f88ee55a-f56d-41d1-9216-18124b7f55f3-systemd-units\") pod \"ovnkube-node-kfq8c\" (UID: \"f88ee55a-f56d-41d1-9216-18124b7f55f3\") " pod="openshift-ovn-kubernetes/ovnkube-node-kfq8c" Jun 03 13:54:01.307639 ip-10-0-134-229 kubenswrapper[2574]: I0603 13:54:01.306894 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/f88ee55a-f56d-41d1-9216-18124b7f55f3-etc-openvswitch\") pod \"ovnkube-node-kfq8c\" (UID: \"f88ee55a-f56d-41d1-9216-18124b7f55f3\") " pod="openshift-ovn-kubernetes/ovnkube-node-kfq8c" Jun 03 13:54:01.307639 ip-10-0-134-229 kubenswrapper[2574]: I0603 13:54:01.306928 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/f88ee55a-f56d-41d1-9216-18124b7f55f3-log-socket\") pod \"ovnkube-node-kfq8c\" (UID: \"f88ee55a-f56d-41d1-9216-18124b7f55f3\") " pod="openshift-ovn-kubernetes/ovnkube-node-kfq8c" Jun 03 13:54:01.307639 ip-10-0-134-229 kubenswrapper[2574]: I0603 13:54:01.306948 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/f88ee55a-f56d-41d1-9216-18124b7f55f3-host-run-ovn-kubernetes\") pod \"ovnkube-node-kfq8c\" (UID: \"f88ee55a-f56d-41d1-9216-18124b7f55f3\") " pod="openshift-ovn-kubernetes/ovnkube-node-kfq8c" Jun 03 13:54:01.307639 ip-10-0-134-229 kubenswrapper[2574]: I0603 13:54:01.306969 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/92d4e3fb-b640-4739-bf3a-6bf0ee60d517-kubelet-dir\") pod \"aws-ebs-csi-driver-node-zhqfp\" (UID: \"92d4e3fb-b640-4739-bf3a-6bf0ee60d517\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-zhqfp" Jun 03 13:54:01.307639 ip-10-0-134-229 kubenswrapper[2574]: I0603 13:54:01.306996 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/963383f0-b900-46cb-81f8-4e92934bb58e-etc-systemd\") pod \"tuned-l2f2s\" (UID: \"963383f0-b900-46cb-81f8-4e92934bb58e\") " pod="openshift-cluster-node-tuning-operator/tuned-l2f2s" Jun 03 13:54:01.307639 ip-10-0-134-229 kubenswrapper[2574]: I0603 13:54:01.307018 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/963383f0-b900-46cb-81f8-4e92934bb58e-host\") pod \"tuned-l2f2s\" (UID: \"963383f0-b900-46cb-81f8-4e92934bb58e\") " pod="openshift-cluster-node-tuning-operator/tuned-l2f2s" Jun 03 13:54:01.307639 ip-10-0-134-229 kubenswrapper[2574]: I0603 13:54:01.307060 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/9ccfb5b8-aff0-4122-a190-c406b390bdae-host-var-lib-cni-bin\") pod \"multus-jkcw2\" (UID: \"9ccfb5b8-aff0-4122-a190-c406b390bdae\") " pod="openshift-multus/multus-jkcw2" Jun 03 13:54:01.307639 ip-10-0-134-229 kubenswrapper[2574]: I0603 13:54:01.307109 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/f88ee55a-f56d-41d1-9216-18124b7f55f3-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-kfq8c\" (UID: \"f88ee55a-f56d-41d1-9216-18124b7f55f3\") " pod="openshift-ovn-kubernetes/ovnkube-node-kfq8c" Jun 03 13:54:01.307639 ip-10-0-134-229 kubenswrapper[2574]: I0603 13:54:01.307155 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/77b2aeec-d4be-45f6-b355-4030387080ad-tuning-conf-dir\") pod \"multus-additional-cni-plugins-v264j\" (UID: \"77b2aeec-d4be-45f6-b355-4030387080ad\") " pod="openshift-multus/multus-additional-cni-plugins-v264j" Jun 03 13:54:01.307639 ip-10-0-134-229 kubenswrapper[2574]: I0603 13:54:01.307175 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/f88ee55a-f56d-41d1-9216-18124b7f55f3-run-openvswitch\") pod \"ovnkube-node-kfq8c\" (UID: \"f88ee55a-f56d-41d1-9216-18124b7f55f3\") " pod="openshift-ovn-kubernetes/ovnkube-node-kfq8c" Jun 03 13:54:01.307639 ip-10-0-134-229 kubenswrapper[2574]: I0603 13:54:01.307189 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/f88ee55a-f56d-41d1-9216-18124b7f55f3-host-cni-netd\") pod \"ovnkube-node-kfq8c\" (UID: \"f88ee55a-f56d-41d1-9216-18124b7f55f3\") " pod="openshift-ovn-kubernetes/ovnkube-node-kfq8c" Jun 03 13:54:01.307639 ip-10-0-134-229 kubenswrapper[2574]: I0603 13:54:01.307204 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-qwqz4\" (UniqueName: \"kubernetes.io/projected/1422bf53-dc3d-42c1-9a1f-8657ec8777f4-kube-api-access-qwqz4\") pod \"network-check-target-vpjf9\" (UID: \"1422bf53-dc3d-42c1-9a1f-8657ec8777f4\") " pod="openshift-network-diagnostics/network-check-target-vpjf9" Jun 03 13:54:01.307639 ip-10-0-134-229 kubenswrapper[2574]: I0603 13:54:01.307219 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/77b2aeec-d4be-45f6-b355-4030387080ad-cni-binary-copy\") pod \"multus-additional-cni-plugins-v264j\" (UID: \"77b2aeec-d4be-45f6-b355-4030387080ad\") " pod="openshift-multus/multus-additional-cni-plugins-v264j" Jun 03 13:54:01.307639 ip-10-0-134-229 kubenswrapper[2574]: I0603 13:54:01.307252 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-2sc6g\" (UniqueName: \"kubernetes.io/projected/77b2aeec-d4be-45f6-b355-4030387080ad-kube-api-access-2sc6g\") pod \"multus-additional-cni-plugins-v264j\" (UID: \"77b2aeec-d4be-45f6-b355-4030387080ad\") " pod="openshift-multus/multus-additional-cni-plugins-v264j" Jun 03 13:54:01.308343 ip-10-0-134-229 kubenswrapper[2574]: I0603 13:54:01.307267 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/f88ee55a-f56d-41d1-9216-18124b7f55f3-node-log\") pod \"ovnkube-node-kfq8c\" (UID: \"f88ee55a-f56d-41d1-9216-18124b7f55f3\") " pod="openshift-ovn-kubernetes/ovnkube-node-kfq8c" Jun 03 13:54:01.308343 ip-10-0-134-229 kubenswrapper[2574]: I0603 13:54:01.307287 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/8c5a5cc8-abff-454b-8b7c-6e4064a2c8c0-konnectivity-ca\") pod \"konnectivity-agent-5mz8g\" (UID: \"8c5a5cc8-abff-454b-8b7c-6e4064a2c8c0\") " pod="kube-system/konnectivity-agent-5mz8g" Jun 03 13:54:01.308343 ip-10-0-134-229 kubenswrapper[2574]: I0603 13:54:01.307312 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/77b2aeec-d4be-45f6-b355-4030387080ad-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-v264j\" (UID: \"77b2aeec-d4be-45f6-b355-4030387080ad\") " pod="openshift-multus/multus-additional-cni-plugins-v264j" Jun 03 13:54:01.308343 ip-10-0-134-229 kubenswrapper[2574]: I0603 13:54:01.307389 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/9ccfb5b8-aff0-4122-a190-c406b390bdae-os-release\") pod \"multus-jkcw2\" (UID: \"9ccfb5b8-aff0-4122-a190-c406b390bdae\") " pod="openshift-multus/multus-jkcw2" Jun 03 13:54:01.308343 ip-10-0-134-229 kubenswrapper[2574]: I0603 13:54:01.307424 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/f88ee55a-f56d-41d1-9216-18124b7f55f3-host-run-netns\") pod \"ovnkube-node-kfq8c\" (UID: \"f88ee55a-f56d-41d1-9216-18124b7f55f3\") " pod="openshift-ovn-kubernetes/ovnkube-node-kfq8c" Jun 03 13:54:01.308343 ip-10-0-134-229 kubenswrapper[2574]: I0603 13:54:01.307468 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/77b2aeec-d4be-45f6-b355-4030387080ad-cnibin\") pod \"multus-additional-cni-plugins-v264j\" (UID: \"77b2aeec-d4be-45f6-b355-4030387080ad\") " pod="openshift-multus/multus-additional-cni-plugins-v264j" Jun 03 13:54:01.337214 ip-10-0-134-229 kubenswrapper[2574]: I0603 13:54:01.337191 2574 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kubelet-serving" expiration="2028-06-02 13:49:00 +0000 UTC" deadline="2027-11-22 08:29:24.457802631 +0000 UTC" Jun 03 13:54:01.337295 ip-10-0-134-229 kubenswrapper[2574]: I0603 13:54:01.337214 2574 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kubelet-serving" sleep="12882h35m23.120591589s" Jun 03 13:54:01.397625 ip-10-0-134-229 kubenswrapper[2574]: I0603 13:54:01.397606 2574 desired_state_of_world_populator.go:158] "Finished populating initial desired state of world" Jun 03 13:54:01.407958 ip-10-0-134-229 kubenswrapper[2574]: I0603 13:54:01.407937 2574 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/963383f0-b900-46cb-81f8-4e92934bb58e-lib-modules\") pod \"tuned-l2f2s\" (UID: \"963383f0-b900-46cb-81f8-4e92934bb58e\") " pod="openshift-cluster-node-tuning-operator/tuned-l2f2s" Jun 03 13:54:01.408067 ip-10-0-134-229 kubenswrapper[2574]: I0603 13:54:01.407971 2574 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/963383f0-b900-46cb-81f8-4e92934bb58e-etc-tuned\") pod \"tuned-l2f2s\" (UID: \"963383f0-b900-46cb-81f8-4e92934bb58e\") " pod="openshift-cluster-node-tuning-operator/tuned-l2f2s" Jun 03 13:54:01.408067 ip-10-0-134-229 kubenswrapper[2574]: I0603 13:54:01.407994 2574 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/77b2aeec-d4be-45f6-b355-4030387080ad-system-cni-dir\") pod \"multus-additional-cni-plugins-v264j\" (UID: \"77b2aeec-d4be-45f6-b355-4030387080ad\") " pod="openshift-multus/multus-additional-cni-plugins-v264j" Jun 03 13:54:01.408067 ip-10-0-134-229 kubenswrapper[2574]: I0603 13:54:01.408020 2574 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/9ccfb5b8-aff0-4122-a190-c406b390bdae-host-var-lib-cni-multus\") pod \"multus-jkcw2\" (UID: \"9ccfb5b8-aff0-4122-a190-c406b390bdae\") " pod="openshift-multus/multus-jkcw2" Jun 03 13:54:01.408067 ip-10-0-134-229 kubenswrapper[2574]: I0603 13:54:01.408050 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-4k5md\" (UniqueName: \"kubernetes.io/projected/aaa611e0-e507-419d-8a90-f692f2d26ee5-kube-api-access-4k5md\") pod \"node-resolver-pc2nh\" (UID: \"aaa611e0-e507-419d-8a90-f692f2d26ee5\") " pod="openshift-dns/node-resolver-pc2nh" Jun 03 13:54:01.408267 ip-10-0-134-229 kubenswrapper[2574]: I0603 13:54:01.408092 2574 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/963383f0-b900-46cb-81f8-4e92934bb58e-etc-sysctl-d\") pod \"tuned-l2f2s\" (UID: \"963383f0-b900-46cb-81f8-4e92934bb58e\") " pod="openshift-cluster-node-tuning-operator/tuned-l2f2s" Jun 03 13:54:01.408267 ip-10-0-134-229 kubenswrapper[2574]: I0603 13:54:01.408118 2574 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/f88ee55a-f56d-41d1-9216-18124b7f55f3-systemd-units\") pod \"ovnkube-node-kfq8c\" (UID: \"f88ee55a-f56d-41d1-9216-18124b7f55f3\") " pod="openshift-ovn-kubernetes/ovnkube-node-kfq8c" Jun 03 13:54:01.408267 ip-10-0-134-229 kubenswrapper[2574]: I0603 13:54:01.408142 2574 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/f88ee55a-f56d-41d1-9216-18124b7f55f3-etc-openvswitch\") pod \"ovnkube-node-kfq8c\" (UID: \"f88ee55a-f56d-41d1-9216-18124b7f55f3\") " pod="openshift-ovn-kubernetes/ovnkube-node-kfq8c" Jun 03 13:54:01.408267 ip-10-0-134-229 kubenswrapper[2574]: I0603 13:54:01.408156 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/963383f0-b900-46cb-81f8-4e92934bb58e-lib-modules\") pod \"tuned-l2f2s\" (UID: \"963383f0-b900-46cb-81f8-4e92934bb58e\") " pod="openshift-cluster-node-tuning-operator/tuned-l2f2s" Jun 03 13:54:01.408267 ip-10-0-134-229 kubenswrapper[2574]: I0603 13:54:01.408180 2574 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/f88ee55a-f56d-41d1-9216-18124b7f55f3-log-socket\") pod \"ovnkube-node-kfq8c\" (UID: \"f88ee55a-f56d-41d1-9216-18124b7f55f3\") " pod="openshift-ovn-kubernetes/ovnkube-node-kfq8c" Jun 03 13:54:01.408267 ip-10-0-134-229 kubenswrapper[2574]: I0603 13:54:01.408207 2574 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/f88ee55a-f56d-41d1-9216-18124b7f55f3-host-run-ovn-kubernetes\") pod \"ovnkube-node-kfq8c\" (UID: \"f88ee55a-f56d-41d1-9216-18124b7f55f3\") " pod="openshift-ovn-kubernetes/ovnkube-node-kfq8c" Jun 03 13:54:01.408267 ip-10-0-134-229 kubenswrapper[2574]: I0603 13:54:01.408260 2574 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/92d4e3fb-b640-4739-bf3a-6bf0ee60d517-kubelet-dir\") pod \"aws-ebs-csi-driver-node-zhqfp\" (UID: \"92d4e3fb-b640-4739-bf3a-6bf0ee60d517\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-zhqfp" Jun 03 13:54:01.408614 ip-10-0-134-229 kubenswrapper[2574]: I0603 13:54:01.408281 2574 swap_util.go:74] "error creating dir to test if tmpfs noswap is enabled. Assuming not supported" mount path="" error="stat /var/lib/kubelet/plugins/kubernetes.io/empty-dir: no such file or directory" Jun 03 13:54:01.408614 ip-10-0-134-229 kubenswrapper[2574]: I0603 13:54:01.408291 2574 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/963383f0-b900-46cb-81f8-4e92934bb58e-etc-systemd\") pod \"tuned-l2f2s\" (UID: \"963383f0-b900-46cb-81f8-4e92934bb58e\") " pod="openshift-cluster-node-tuning-operator/tuned-l2f2s" Jun 03 13:54:01.408614 ip-10-0-134-229 kubenswrapper[2574]: I0603 13:54:01.408302 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/77b2aeec-d4be-45f6-b355-4030387080ad-system-cni-dir\") pod \"multus-additional-cni-plugins-v264j\" (UID: \"77b2aeec-d4be-45f6-b355-4030387080ad\") " pod="openshift-multus/multus-additional-cni-plugins-v264j" Jun 03 13:54:01.408614 ip-10-0-134-229 kubenswrapper[2574]: I0603 13:54:01.408332 2574 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/963383f0-b900-46cb-81f8-4e92934bb58e-host\") pod \"tuned-l2f2s\" (UID: \"963383f0-b900-46cb-81f8-4e92934bb58e\") " pod="openshift-cluster-node-tuning-operator/tuned-l2f2s" Jun 03 13:54:01.408614 ip-10-0-134-229 kubenswrapper[2574]: I0603 13:54:01.408360 2574 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/9ccfb5b8-aff0-4122-a190-c406b390bdae-host-var-lib-cni-bin\") pod \"multus-jkcw2\" (UID: \"9ccfb5b8-aff0-4122-a190-c406b390bdae\") " pod="openshift-multus/multus-jkcw2" Jun 03 13:54:01.408614 ip-10-0-134-229 kubenswrapper[2574]: I0603 13:54:01.408390 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/963383f0-b900-46cb-81f8-4e92934bb58e-etc-systemd\") pod \"tuned-l2f2s\" (UID: \"963383f0-b900-46cb-81f8-4e92934bb58e\") " pod="openshift-cluster-node-tuning-operator/tuned-l2f2s" Jun 03 13:54:01.408614 ip-10-0-134-229 kubenswrapper[2574]: I0603 13:54:01.408405 2574 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/f88ee55a-f56d-41d1-9216-18124b7f55f3-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-kfq8c\" (UID: \"f88ee55a-f56d-41d1-9216-18124b7f55f3\") " pod="openshift-ovn-kubernetes/ovnkube-node-kfq8c" Jun 03 13:54:01.408614 ip-10-0-134-229 kubenswrapper[2574]: I0603 13:54:01.408442 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/f88ee55a-f56d-41d1-9216-18124b7f55f3-etc-openvswitch\") pod \"ovnkube-node-kfq8c\" (UID: \"f88ee55a-f56d-41d1-9216-18124b7f55f3\") " pod="openshift-ovn-kubernetes/ovnkube-node-kfq8c" Jun 03 13:54:01.408614 ip-10-0-134-229 kubenswrapper[2574]: I0603 13:54:01.408447 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/9ccfb5b8-aff0-4122-a190-c406b390bdae-host-var-lib-cni-bin\") pod \"multus-jkcw2\" (UID: \"9ccfb5b8-aff0-4122-a190-c406b390bdae\") " pod="openshift-multus/multus-jkcw2" Jun 03 13:54:01.408614 ip-10-0-134-229 kubenswrapper[2574]: I0603 13:54:01.408451 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host\" (UniqueName: \"kubernetes.io/host-path/963383f0-b900-46cb-81f8-4e92934bb58e-host\") pod \"tuned-l2f2s\" (UID: \"963383f0-b900-46cb-81f8-4e92934bb58e\") " pod="openshift-cluster-node-tuning-operator/tuned-l2f2s" Jun 03 13:54:01.408614 ip-10-0-134-229 kubenswrapper[2574]: I0603 13:54:01.408472 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/f88ee55a-f56d-41d1-9216-18124b7f55f3-host-run-ovn-kubernetes\") pod \"ovnkube-node-kfq8c\" (UID: \"f88ee55a-f56d-41d1-9216-18124b7f55f3\") " pod="openshift-ovn-kubernetes/ovnkube-node-kfq8c" Jun 03 13:54:01.408614 ip-10-0-134-229 kubenswrapper[2574]: I0603 13:54:01.408494 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/f88ee55a-f56d-41d1-9216-18124b7f55f3-systemd-units\") pod \"ovnkube-node-kfq8c\" (UID: \"f88ee55a-f56d-41d1-9216-18124b7f55f3\") " pod="openshift-ovn-kubernetes/ovnkube-node-kfq8c" Jun 03 13:54:01.408614 ip-10-0-134-229 kubenswrapper[2574]: I0603 13:54:01.408507 2574 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/77b2aeec-d4be-45f6-b355-4030387080ad-tuning-conf-dir\") pod \"multus-additional-cni-plugins-v264j\" (UID: \"77b2aeec-d4be-45f6-b355-4030387080ad\") " pod="openshift-multus/multus-additional-cni-plugins-v264j" Jun 03 13:54:01.408614 ip-10-0-134-229 kubenswrapper[2574]: I0603 13:54:01.408494 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/f88ee55a-f56d-41d1-9216-18124b7f55f3-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-kfq8c\" (UID: \"f88ee55a-f56d-41d1-9216-18124b7f55f3\") " pod="openshift-ovn-kubernetes/ovnkube-node-kfq8c" Jun 03 13:54:01.408614 ip-10-0-134-229 kubenswrapper[2574]: I0603 13:54:01.408524 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/9ccfb5b8-aff0-4122-a190-c406b390bdae-host-var-lib-cni-multus\") pod \"multus-jkcw2\" (UID: \"9ccfb5b8-aff0-4122-a190-c406b390bdae\") " pod="openshift-multus/multus-jkcw2" Jun 03 13:54:01.408614 ip-10-0-134-229 kubenswrapper[2574]: I0603 13:54:01.408569 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/92d4e3fb-b640-4739-bf3a-6bf0ee60d517-kubelet-dir\") pod \"aws-ebs-csi-driver-node-zhqfp\" (UID: \"92d4e3fb-b640-4739-bf3a-6bf0ee60d517\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-zhqfp" Jun 03 13:54:01.408614 ip-10-0-134-229 kubenswrapper[2574]: I0603 13:54:01.408574 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/f88ee55a-f56d-41d1-9216-18124b7f55f3-run-openvswitch\") pod \"ovnkube-node-kfq8c\" (UID: \"f88ee55a-f56d-41d1-9216-18124b7f55f3\") " pod="openshift-ovn-kubernetes/ovnkube-node-kfq8c" Jun 03 13:54:01.408614 ip-10-0-134-229 kubenswrapper[2574]: I0603 13:54:01.408592 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/f88ee55a-f56d-41d1-9216-18124b7f55f3-log-socket\") pod \"ovnkube-node-kfq8c\" (UID: \"f88ee55a-f56d-41d1-9216-18124b7f55f3\") " pod="openshift-ovn-kubernetes/ovnkube-node-kfq8c" Jun 03 13:54:01.409457 ip-10-0-134-229 kubenswrapper[2574]: I0603 13:54:01.408533 2574 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/f88ee55a-f56d-41d1-9216-18124b7f55f3-run-openvswitch\") pod \"ovnkube-node-kfq8c\" (UID: \"f88ee55a-f56d-41d1-9216-18124b7f55f3\") " pod="openshift-ovn-kubernetes/ovnkube-node-kfq8c" Jun 03 13:54:01.409457 ip-10-0-134-229 kubenswrapper[2574]: I0603 13:54:01.408629 2574 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/f88ee55a-f56d-41d1-9216-18124b7f55f3-host-cni-netd\") pod \"ovnkube-node-kfq8c\" (UID: \"f88ee55a-f56d-41d1-9216-18124b7f55f3\") " pod="openshift-ovn-kubernetes/ovnkube-node-kfq8c" Jun 03 13:54:01.409457 ip-10-0-134-229 kubenswrapper[2574]: I0603 13:54:01.408654 2574 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-qwqz4\" (UniqueName: \"kubernetes.io/projected/1422bf53-dc3d-42c1-9a1f-8657ec8777f4-kube-api-access-qwqz4\") pod \"network-check-target-vpjf9\" (UID: \"1422bf53-dc3d-42c1-9a1f-8657ec8777f4\") " pod="openshift-network-diagnostics/network-check-target-vpjf9" Jun 03 13:54:01.409457 ip-10-0-134-229 kubenswrapper[2574]: I0603 13:54:01.408678 2574 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/77b2aeec-d4be-45f6-b355-4030387080ad-cni-binary-copy\") pod \"multus-additional-cni-plugins-v264j\" (UID: \"77b2aeec-d4be-45f6-b355-4030387080ad\") " pod="openshift-multus/multus-additional-cni-plugins-v264j" Jun 03 13:54:01.409457 ip-10-0-134-229 kubenswrapper[2574]: I0603 13:54:01.408704 2574 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-2sc6g\" (UniqueName: \"kubernetes.io/projected/77b2aeec-d4be-45f6-b355-4030387080ad-kube-api-access-2sc6g\") pod \"multus-additional-cni-plugins-v264j\" (UID: \"77b2aeec-d4be-45f6-b355-4030387080ad\") " pod="openshift-multus/multus-additional-cni-plugins-v264j" Jun 03 13:54:01.409457 ip-10-0-134-229 kubenswrapper[2574]: I0603 13:54:01.408708 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/963383f0-b900-46cb-81f8-4e92934bb58e-etc-sysctl-d\") pod \"tuned-l2f2s\" (UID: \"963383f0-b900-46cb-81f8-4e92934bb58e\") " pod="openshift-cluster-node-tuning-operator/tuned-l2f2s" Jun 03 13:54:01.409457 ip-10-0-134-229 kubenswrapper[2574]: I0603 13:54:01.408710 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/77b2aeec-d4be-45f6-b355-4030387080ad-tuning-conf-dir\") pod \"multus-additional-cni-plugins-v264j\" (UID: \"77b2aeec-d4be-45f6-b355-4030387080ad\") " pod="openshift-multus/multus-additional-cni-plugins-v264j" Jun 03 13:54:01.409457 ip-10-0-134-229 kubenswrapper[2574]: I0603 13:54:01.408728 2574 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/f88ee55a-f56d-41d1-9216-18124b7f55f3-node-log\") pod \"ovnkube-node-kfq8c\" (UID: \"f88ee55a-f56d-41d1-9216-18124b7f55f3\") " pod="openshift-ovn-kubernetes/ovnkube-node-kfq8c" Jun 03 13:54:01.409457 ip-10-0-134-229 kubenswrapper[2574]: I0603 13:54:01.408759 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/aaa611e0-e507-419d-8a90-f692f2d26ee5-hosts-file\") pod \"node-resolver-pc2nh\" (UID: \"aaa611e0-e507-419d-8a90-f692f2d26ee5\") " pod="openshift-dns/node-resolver-pc2nh" Jun 03 13:54:01.409457 ip-10-0-134-229 kubenswrapper[2574]: I0603 13:54:01.408765 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/f88ee55a-f56d-41d1-9216-18124b7f55f3-host-cni-netd\") pod \"ovnkube-node-kfq8c\" (UID: \"f88ee55a-f56d-41d1-9216-18124b7f55f3\") " pod="openshift-ovn-kubernetes/ovnkube-node-kfq8c" Jun 03 13:54:01.409457 ip-10-0-134-229 kubenswrapper[2574]: I0603 13:54:01.408784 2574 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/8c5a5cc8-abff-454b-8b7c-6e4064a2c8c0-konnectivity-ca\") pod \"konnectivity-agent-5mz8g\" (UID: \"8c5a5cc8-abff-454b-8b7c-6e4064a2c8c0\") " pod="kube-system/konnectivity-agent-5mz8g" Jun 03 13:54:01.409457 ip-10-0-134-229 kubenswrapper[2574]: I0603 13:54:01.408812 2574 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/77b2aeec-d4be-45f6-b355-4030387080ad-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-v264j\" (UID: \"77b2aeec-d4be-45f6-b355-4030387080ad\") " pod="openshift-multus/multus-additional-cni-plugins-v264j" Jun 03 13:54:01.409457 ip-10-0-134-229 kubenswrapper[2574]: I0603 13:54:01.408836 2574 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/9ccfb5b8-aff0-4122-a190-c406b390bdae-os-release\") pod \"multus-jkcw2\" (UID: \"9ccfb5b8-aff0-4122-a190-c406b390bdae\") " pod="openshift-multus/multus-jkcw2" Jun 03 13:54:01.409457 ip-10-0-134-229 kubenswrapper[2574]: I0603 13:54:01.408877 2574 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/f88ee55a-f56d-41d1-9216-18124b7f55f3-host-run-netns\") pod \"ovnkube-node-kfq8c\" (UID: \"f88ee55a-f56d-41d1-9216-18124b7f55f3\") " pod="openshift-ovn-kubernetes/ovnkube-node-kfq8c" Jun 03 13:54:01.409457 ip-10-0-134-229 kubenswrapper[2574]: I0603 13:54:01.408915 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/5e68f084-d02c-4757-9842-1c01178fcfcb-serviceca\") pod \"node-ca-7ql52\" (UID: \"5e68f084-d02c-4757-9842-1c01178fcfcb\") " pod="openshift-image-registry/node-ca-7ql52" Jun 03 13:54:01.409457 ip-10-0-134-229 kubenswrapper[2574]: I0603 13:54:01.408973 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/f88ee55a-f56d-41d1-9216-18124b7f55f3-host-run-netns\") pod \"ovnkube-node-kfq8c\" (UID: \"f88ee55a-f56d-41d1-9216-18124b7f55f3\") " pod="openshift-ovn-kubernetes/ovnkube-node-kfq8c" Jun 03 13:54:01.409457 ip-10-0-134-229 kubenswrapper[2574]: I0603 13:54:01.408991 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/f88ee55a-f56d-41d1-9216-18124b7f55f3-node-log\") pod \"ovnkube-node-kfq8c\" (UID: \"f88ee55a-f56d-41d1-9216-18124b7f55f3\") " pod="openshift-ovn-kubernetes/ovnkube-node-kfq8c" Jun 03 13:54:01.410238 ip-10-0-134-229 kubenswrapper[2574]: I0603 13:54:01.409023 2574 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/77b2aeec-d4be-45f6-b355-4030387080ad-cnibin\") pod \"multus-additional-cni-plugins-v264j\" (UID: \"77b2aeec-d4be-45f6-b355-4030387080ad\") " pod="openshift-multus/multus-additional-cni-plugins-v264j" Jun 03 13:54:01.410238 ip-10-0-134-229 kubenswrapper[2574]: I0603 13:54:01.409066 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/9ccfb5b8-aff0-4122-a190-c406b390bdae-os-release\") pod \"multus-jkcw2\" (UID: \"9ccfb5b8-aff0-4122-a190-c406b390bdae\") " pod="openshift-multus/multus-jkcw2" Jun 03 13:54:01.410238 ip-10-0-134-229 kubenswrapper[2574]: I0603 13:54:01.409109 2574 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-zcc9k\" (UniqueName: \"kubernetes.io/projected/9ccfb5b8-aff0-4122-a190-c406b390bdae-kube-api-access-zcc9k\") pod \"multus-jkcw2\" (UID: \"9ccfb5b8-aff0-4122-a190-c406b390bdae\") " pod="openshift-multus/multus-jkcw2" Jun 03 13:54:01.410238 ip-10-0-134-229 kubenswrapper[2574]: I0603 13:54:01.409136 2574 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/f88ee55a-f56d-41d1-9216-18124b7f55f3-var-lib-openvswitch\") pod \"ovnkube-node-kfq8c\" (UID: \"f88ee55a-f56d-41d1-9216-18124b7f55f3\") " pod="openshift-ovn-kubernetes/ovnkube-node-kfq8c" Jun 03 13:54:01.410238 ip-10-0-134-229 kubenswrapper[2574]: I0603 13:54:01.409179 2574 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/f88ee55a-f56d-41d1-9216-18124b7f55f3-run-ovn\") pod \"ovnkube-node-kfq8c\" (UID: \"f88ee55a-f56d-41d1-9216-18124b7f55f3\") " pod="openshift-ovn-kubernetes/ovnkube-node-kfq8c" Jun 03 13:54:01.410238 ip-10-0-134-229 kubenswrapper[2574]: I0603 13:54:01.409204 2574 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/f88ee55a-f56d-41d1-9216-18124b7f55f3-ovnkube-config\") pod \"ovnkube-node-kfq8c\" (UID: \"f88ee55a-f56d-41d1-9216-18124b7f55f3\") " pod="openshift-ovn-kubernetes/ovnkube-node-kfq8c" Jun 03 13:54:01.410238 ip-10-0-134-229 kubenswrapper[2574]: I0603 13:54:01.409231 2574 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/92d4e3fb-b640-4739-bf3a-6bf0ee60d517-socket-dir\") pod \"aws-ebs-csi-driver-node-zhqfp\" (UID: \"92d4e3fb-b640-4739-bf3a-6bf0ee60d517\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-zhqfp" Jun 03 13:54:01.410238 ip-10-0-134-229 kubenswrapper[2574]: I0603 13:54:01.409235 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/77b2aeec-d4be-45f6-b355-4030387080ad-cnibin\") pod \"multus-additional-cni-plugins-v264j\" (UID: \"77b2aeec-d4be-45f6-b355-4030387080ad\") " pod="openshift-multus/multus-additional-cni-plugins-v264j" Jun 03 13:54:01.410238 ip-10-0-134-229 kubenswrapper[2574]: I0603 13:54:01.409289 2574 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/9ccfb5b8-aff0-4122-a190-c406b390bdae-system-cni-dir\") pod \"multus-jkcw2\" (UID: \"9ccfb5b8-aff0-4122-a190-c406b390bdae\") " pod="openshift-multus/multus-jkcw2" Jun 03 13:54:01.410238 ip-10-0-134-229 kubenswrapper[2574]: I0603 13:54:01.409314 2574 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/9ccfb5b8-aff0-4122-a190-c406b390bdae-cnibin\") pod \"multus-jkcw2\" (UID: \"9ccfb5b8-aff0-4122-a190-c406b390bdae\") " pod="openshift-multus/multus-jkcw2" Jun 03 13:54:01.410238 ip-10-0-134-229 kubenswrapper[2574]: I0603 13:54:01.409336 2574 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/9ccfb5b8-aff0-4122-a190-c406b390bdae-cni-binary-copy\") pod \"multus-jkcw2\" (UID: \"9ccfb5b8-aff0-4122-a190-c406b390bdae\") " pod="openshift-multus/multus-jkcw2" Jun 03 13:54:01.410238 ip-10-0-134-229 kubenswrapper[2574]: I0603 13:54:01.409359 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/77b2aeec-d4be-45f6-b355-4030387080ad-cni-binary-copy\") pod \"multus-additional-cni-plugins-v264j\" (UID: \"77b2aeec-d4be-45f6-b355-4030387080ad\") " pod="openshift-multus/multus-additional-cni-plugins-v264j" Jun 03 13:54:01.410238 ip-10-0-134-229 kubenswrapper[2574]: I0603 13:54:01.409363 2574 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/9ccfb5b8-aff0-4122-a190-c406b390bdae-host-run-netns\") pod \"multus-jkcw2\" (UID: \"9ccfb5b8-aff0-4122-a190-c406b390bdae\") " pod="openshift-multus/multus-jkcw2" Jun 03 13:54:01.410238 ip-10-0-134-229 kubenswrapper[2574]: I0603 13:54:01.409367 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/92d4e3fb-b640-4739-bf3a-6bf0ee60d517-socket-dir\") pod \"aws-ebs-csi-driver-node-zhqfp\" (UID: \"92d4e3fb-b640-4739-bf3a-6bf0ee60d517\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-zhqfp" Jun 03 13:54:01.410238 ip-10-0-134-229 kubenswrapper[2574]: I0603 13:54:01.409427 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/f88ee55a-f56d-41d1-9216-18124b7f55f3-run-ovn\") pod \"ovnkube-node-kfq8c\" (UID: \"f88ee55a-f56d-41d1-9216-18124b7f55f3\") " pod="openshift-ovn-kubernetes/ovnkube-node-kfq8c" Jun 03 13:54:01.410238 ip-10-0-134-229 kubenswrapper[2574]: I0603 13:54:01.409446 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/9ccfb5b8-aff0-4122-a190-c406b390bdae-system-cni-dir\") pod \"multus-jkcw2\" (UID: \"9ccfb5b8-aff0-4122-a190-c406b390bdae\") " pod="openshift-multus/multus-jkcw2" Jun 03 13:54:01.410238 ip-10-0-134-229 kubenswrapper[2574]: I0603 13:54:01.409494 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/9ccfb5b8-aff0-4122-a190-c406b390bdae-cnibin\") pod \"multus-jkcw2\" (UID: \"9ccfb5b8-aff0-4122-a190-c406b390bdae\") " pod="openshift-multus/multus-jkcw2" Jun 03 13:54:01.410238 ip-10-0-134-229 kubenswrapper[2574]: I0603 13:54:01.409513 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/8c5a5cc8-abff-454b-8b7c-6e4064a2c8c0-konnectivity-ca\") pod \"konnectivity-agent-5mz8g\" (UID: \"8c5a5cc8-abff-454b-8b7c-6e4064a2c8c0\") " pod="kube-system/konnectivity-agent-5mz8g" Jun 03 13:54:01.411062 ip-10-0-134-229 kubenswrapper[2574]: I0603 13:54:01.409528 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/77b2aeec-d4be-45f6-b355-4030387080ad-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-v264j\" (UID: \"77b2aeec-d4be-45f6-b355-4030387080ad\") " pod="openshift-multus/multus-additional-cni-plugins-v264j" Jun 03 13:54:01.411062 ip-10-0-134-229 kubenswrapper[2574]: I0603 13:54:01.409569 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/f88ee55a-f56d-41d1-9216-18124b7f55f3-var-lib-openvswitch\") pod \"ovnkube-node-kfq8c\" (UID: \"f88ee55a-f56d-41d1-9216-18124b7f55f3\") " pod="openshift-ovn-kubernetes/ovnkube-node-kfq8c" Jun 03 13:54:01.411062 ip-10-0-134-229 kubenswrapper[2574]: I0603 13:54:01.409572 2574 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-gm6cq\" (UniqueName: \"kubernetes.io/projected/6f47d39b-6eb0-4d5f-921b-0d56c194113e-kube-api-access-gm6cq\") pod \"network-metrics-daemon-9f7k7\" (UID: \"6f47d39b-6eb0-4d5f-921b-0d56c194113e\") " pod="openshift-multus/network-metrics-daemon-9f7k7" Jun 03 13:54:01.411062 ip-10-0-134-229 kubenswrapper[2574]: I0603 13:54:01.409602 2574 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-hscr6\" (UniqueName: \"kubernetes.io/projected/92d4e3fb-b640-4739-bf3a-6bf0ee60d517-kube-api-access-hscr6\") pod \"aws-ebs-csi-driver-node-zhqfp\" (UID: \"92d4e3fb-b640-4739-bf3a-6bf0ee60d517\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-zhqfp" Jun 03 13:54:01.411062 ip-10-0-134-229 kubenswrapper[2574]: I0603 13:54:01.409723 2574 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/963383f0-b900-46cb-81f8-4e92934bb58e-etc-modprobe-d\") pod \"tuned-l2f2s\" (UID: \"963383f0-b900-46cb-81f8-4e92934bb58e\") " pod="openshift-cluster-node-tuning-operator/tuned-l2f2s" Jun 03 13:54:01.411062 ip-10-0-134-229 kubenswrapper[2574]: I0603 13:54:01.409754 2574 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"run\" (UniqueName: \"kubernetes.io/host-path/963383f0-b900-46cb-81f8-4e92934bb58e-run\") pod \"tuned-l2f2s\" (UID: \"963383f0-b900-46cb-81f8-4e92934bb58e\") " pod="openshift-cluster-node-tuning-operator/tuned-l2f2s" Jun 03 13:54:01.411062 ip-10-0-134-229 kubenswrapper[2574]: I0603 13:54:01.409801 2574 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-gwjt5\" (UniqueName: \"kubernetes.io/projected/963383f0-b900-46cb-81f8-4e92934bb58e-kube-api-access-gwjt5\") pod \"tuned-l2f2s\" (UID: \"963383f0-b900-46cb-81f8-4e92934bb58e\") " pod="openshift-cluster-node-tuning-operator/tuned-l2f2s" Jun 03 13:54:01.411062 ip-10-0-134-229 kubenswrapper[2574]: I0603 13:54:01.409844 2574 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/9ccfb5b8-aff0-4122-a190-c406b390bdae-multus-socket-dir-parent\") pod \"multus-jkcw2\" (UID: \"9ccfb5b8-aff0-4122-a190-c406b390bdae\") " pod="openshift-multus/multus-jkcw2" Jun 03 13:54:01.411062 ip-10-0-134-229 kubenswrapper[2574]: I0603 13:54:01.409882 2574 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/f88ee55a-f56d-41d1-9216-18124b7f55f3-ovn-node-metrics-cert\") pod \"ovnkube-node-kfq8c\" (UID: \"f88ee55a-f56d-41d1-9216-18124b7f55f3\") " pod="openshift-ovn-kubernetes/ovnkube-node-kfq8c" Jun 03 13:54:01.411062 ip-10-0-134-229 kubenswrapper[2574]: I0603 13:54:01.409906 2574 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-b4pf4\" (UniqueName: \"kubernetes.io/projected/f88ee55a-f56d-41d1-9216-18124b7f55f3-kube-api-access-b4pf4\") pod \"ovnkube-node-kfq8c\" (UID: \"f88ee55a-f56d-41d1-9216-18124b7f55f3\") " pod="openshift-ovn-kubernetes/ovnkube-node-kfq8c" Jun 03 13:54:01.411062 ip-10-0-134-229 kubenswrapper[2574]: I0603 13:54:01.409937 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/f88ee55a-f56d-41d1-9216-18124b7f55f3-ovnkube-config\") pod \"ovnkube-node-kfq8c\" (UID: \"f88ee55a-f56d-41d1-9216-18124b7f55f3\") " pod="openshift-ovn-kubernetes/ovnkube-node-kfq8c" Jun 03 13:54:01.411062 ip-10-0-134-229 kubenswrapper[2574]: I0603 13:54:01.409985 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/963383f0-b900-46cb-81f8-4e92934bb58e-etc-modprobe-d\") pod \"tuned-l2f2s\" (UID: \"963383f0-b900-46cb-81f8-4e92934bb58e\") " pod="openshift-cluster-node-tuning-operator/tuned-l2f2s" Jun 03 13:54:01.411062 ip-10-0-134-229 kubenswrapper[2574]: I0603 13:54:01.409994 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/9ccfb5b8-aff0-4122-a190-c406b390bdae-cni-binary-copy\") pod \"multus-jkcw2\" (UID: \"9ccfb5b8-aff0-4122-a190-c406b390bdae\") " pod="openshift-multus/multus-jkcw2" Jun 03 13:54:01.411062 ip-10-0-134-229 kubenswrapper[2574]: I0603 13:54:01.409989 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/9ccfb5b8-aff0-4122-a190-c406b390bdae-host-run-netns\") pod \"multus-jkcw2\" (UID: \"9ccfb5b8-aff0-4122-a190-c406b390bdae\") " pod="openshift-multus/multus-jkcw2" Jun 03 13:54:01.411062 ip-10-0-134-229 kubenswrapper[2574]: I0603 13:54:01.410038 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"run\" (UniqueName: \"kubernetes.io/host-path/963383f0-b900-46cb-81f8-4e92934bb58e-run\") pod \"tuned-l2f2s\" (UID: \"963383f0-b900-46cb-81f8-4e92934bb58e\") " pod="openshift-cluster-node-tuning-operator/tuned-l2f2s" Jun 03 13:54:01.411062 ip-10-0-134-229 kubenswrapper[2574]: I0603 13:54:01.410053 2574 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/e868100e-e4c6-48f1-b00c-ae9c32f7de33-iptables-alerter-script\") pod \"iptables-alerter-ft4ch\" (UID: \"e868100e-e4c6-48f1-b00c-ae9c32f7de33\") " pod="openshift-network-operator/iptables-alerter-ft4ch" Jun 03 13:54:01.411062 ip-10-0-134-229 kubenswrapper[2574]: I0603 13:54:01.410083 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/9ccfb5b8-aff0-4122-a190-c406b390bdae-multus-socket-dir-parent\") pod \"multus-jkcw2\" (UID: \"9ccfb5b8-aff0-4122-a190-c406b390bdae\") " pod="openshift-multus/multus-jkcw2" Jun 03 13:54:01.411723 ip-10-0-134-229 kubenswrapper[2574]: I0603 13:54:01.410128 2574 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/92d4e3fb-b640-4739-bf3a-6bf0ee60d517-device-dir\") pod \"aws-ebs-csi-driver-node-zhqfp\" (UID: \"92d4e3fb-b640-4739-bf3a-6bf0ee60d517\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-zhqfp" Jun 03 13:54:01.411723 ip-10-0-134-229 kubenswrapper[2574]: I0603 13:54:01.410171 2574 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/92d4e3fb-b640-4739-bf3a-6bf0ee60d517-sys-fs\") pod \"aws-ebs-csi-driver-node-zhqfp\" (UID: \"92d4e3fb-b640-4739-bf3a-6bf0ee60d517\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-zhqfp" Jun 03 13:54:01.411723 ip-10-0-134-229 kubenswrapper[2574]: I0603 13:54:01.410176 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/92d4e3fb-b640-4739-bf3a-6bf0ee60d517-device-dir\") pod \"aws-ebs-csi-driver-node-zhqfp\" (UID: \"92d4e3fb-b640-4739-bf3a-6bf0ee60d517\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-zhqfp" Jun 03 13:54:01.411723 ip-10-0-134-229 kubenswrapper[2574]: I0603 13:54:01.410210 2574 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/963383f0-b900-46cb-81f8-4e92934bb58e-etc-sysconfig\") pod \"tuned-l2f2s\" (UID: \"963383f0-b900-46cb-81f8-4e92934bb58e\") " pod="openshift-cluster-node-tuning-operator/tuned-l2f2s" Jun 03 13:54:01.411723 ip-10-0-134-229 kubenswrapper[2574]: I0603 13:54:01.410227 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/92d4e3fb-b640-4739-bf3a-6bf0ee60d517-sys-fs\") pod \"aws-ebs-csi-driver-node-zhqfp\" (UID: \"92d4e3fb-b640-4739-bf3a-6bf0ee60d517\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-zhqfp" Jun 03 13:54:01.411723 ip-10-0-134-229 kubenswrapper[2574]: I0603 13:54:01.410259 2574 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/9ccfb5b8-aff0-4122-a190-c406b390bdae-hostroot\") pod \"multus-jkcw2\" (UID: \"9ccfb5b8-aff0-4122-a190-c406b390bdae\") " pod="openshift-multus/multus-jkcw2" Jun 03 13:54:01.411723 ip-10-0-134-229 kubenswrapper[2574]: I0603 13:54:01.410283 2574 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/f88ee55a-f56d-41d1-9216-18124b7f55f3-host-cni-bin\") pod \"ovnkube-node-kfq8c\" (UID: \"f88ee55a-f56d-41d1-9216-18124b7f55f3\") " pod="openshift-ovn-kubernetes/ovnkube-node-kfq8c" Jun 03 13:54:01.411723 ip-10-0-134-229 kubenswrapper[2574]: I0603 13:54:01.410319 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/9ccfb5b8-aff0-4122-a190-c406b390bdae-hostroot\") pod \"multus-jkcw2\" (UID: \"9ccfb5b8-aff0-4122-a190-c406b390bdae\") " pod="openshift-multus/multus-jkcw2" Jun 03 13:54:01.411723 ip-10-0-134-229 kubenswrapper[2574]: I0603 13:54:01.410336 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-dz8tb\" (UniqueName: \"kubernetes.io/projected/5e68f084-d02c-4757-9842-1c01178fcfcb-kube-api-access-dz8tb\") pod \"node-ca-7ql52\" (UID: \"5e68f084-d02c-4757-9842-1c01178fcfcb\") " pod="openshift-image-registry/node-ca-7ql52" Jun 03 13:54:01.411723 ip-10-0-134-229 kubenswrapper[2574]: I0603 13:54:01.410347 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/f88ee55a-f56d-41d1-9216-18124b7f55f3-host-cni-bin\") pod \"ovnkube-node-kfq8c\" (UID: \"f88ee55a-f56d-41d1-9216-18124b7f55f3\") " pod="openshift-ovn-kubernetes/ovnkube-node-kfq8c" Jun 03 13:54:01.411723 ip-10-0-134-229 kubenswrapper[2574]: I0603 13:54:01.410395 2574 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/6f47d39b-6eb0-4d5f-921b-0d56c194113e-metrics-certs\") pod \"network-metrics-daemon-9f7k7\" (UID: \"6f47d39b-6eb0-4d5f-921b-0d56c194113e\") " pod="openshift-multus/network-metrics-daemon-9f7k7" Jun 03 13:54:01.411723 ip-10-0-134-229 kubenswrapper[2574]: I0603 13:54:01.410400 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/963383f0-b900-46cb-81f8-4e92934bb58e-etc-sysconfig\") pod \"tuned-l2f2s\" (UID: \"963383f0-b900-46cb-81f8-4e92934bb58e\") " pod="openshift-cluster-node-tuning-operator/tuned-l2f2s" Jun 03 13:54:01.411723 ip-10-0-134-229 kubenswrapper[2574]: I0603 13:54:01.410423 2574 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/963383f0-b900-46cb-81f8-4e92934bb58e-tmp\") pod \"tuned-l2f2s\" (UID: \"963383f0-b900-46cb-81f8-4e92934bb58e\") " pod="openshift-cluster-node-tuning-operator/tuned-l2f2s" Jun 03 13:54:01.411723 ip-10-0-134-229 kubenswrapper[2574]: I0603 13:54:01.410447 2574 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/8c5a5cc8-abff-454b-8b7c-6e4064a2c8c0-agent-certs\") pod \"konnectivity-agent-5mz8g\" (UID: \"8c5a5cc8-abff-454b-8b7c-6e4064a2c8c0\") " pod="kube-system/konnectivity-agent-5mz8g" Jun 03 13:54:01.411723 ip-10-0-134-229 kubenswrapper[2574]: E0603 13:54:01.410469 2574 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jun 03 13:54:01.411723 ip-10-0-134-229 kubenswrapper[2574]: I0603 13:54:01.410474 2574 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/9ccfb5b8-aff0-4122-a190-c406b390bdae-multus-cni-dir\") pod \"multus-jkcw2\" (UID: \"9ccfb5b8-aff0-4122-a190-c406b390bdae\") " pod="openshift-multus/multus-jkcw2" Jun 03 13:54:01.411723 ip-10-0-134-229 kubenswrapper[2574]: I0603 13:54:01.410502 2574 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/9ccfb5b8-aff0-4122-a190-c406b390bdae-host-run-k8s-cni-cncf-io\") pod \"multus-jkcw2\" (UID: \"9ccfb5b8-aff0-4122-a190-c406b390bdae\") " pod="openshift-multus/multus-jkcw2" Jun 03 13:54:01.411723 ip-10-0-134-229 kubenswrapper[2574]: I0603 13:54:01.410556 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/9ccfb5b8-aff0-4122-a190-c406b390bdae-host-run-k8s-cni-cncf-io\") pod \"multus-jkcw2\" (UID: \"9ccfb5b8-aff0-4122-a190-c406b390bdae\") " pod="openshift-multus/multus-jkcw2" Jun 03 13:54:01.412467 ip-10-0-134-229 kubenswrapper[2574]: E0603 13:54:01.410563 2574 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/6f47d39b-6eb0-4d5f-921b-0d56c194113e-metrics-certs podName:6f47d39b-6eb0-4d5f-921b-0d56c194113e nodeName:}" failed. No retries permitted until 2026-06-03 13:54:01.910514533 +0000 UTC m=+3.094521857 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/6f47d39b-6eb0-4d5f-921b-0d56c194113e-metrics-certs") pod "network-metrics-daemon-9f7k7" (UID: "6f47d39b-6eb0-4d5f-921b-0d56c194113e") : object "openshift-multus"/"metrics-daemon-secret" not registered Jun 03 13:54:01.412467 ip-10-0-134-229 kubenswrapper[2574]: I0603 13:54:01.410576 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/e868100e-e4c6-48f1-b00c-ae9c32f7de33-iptables-alerter-script\") pod \"iptables-alerter-ft4ch\" (UID: \"e868100e-e4c6-48f1-b00c-ae9c32f7de33\") " pod="openshift-network-operator/iptables-alerter-ft4ch" Jun 03 13:54:01.412467 ip-10-0-134-229 kubenswrapper[2574]: I0603 13:54:01.410587 2574 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/9ccfb5b8-aff0-4122-a190-c406b390bdae-host-run-multus-certs\") pod \"multus-jkcw2\" (UID: \"9ccfb5b8-aff0-4122-a190-c406b390bdae\") " pod="openshift-multus/multus-jkcw2" Jun 03 13:54:01.412467 ip-10-0-134-229 kubenswrapper[2574]: I0603 13:54:01.410616 2574 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/f88ee55a-f56d-41d1-9216-18124b7f55f3-host-kubelet\") pod \"ovnkube-node-kfq8c\" (UID: \"f88ee55a-f56d-41d1-9216-18124b7f55f3\") " pod="openshift-ovn-kubernetes/ovnkube-node-kfq8c" Jun 03 13:54:01.412467 ip-10-0-134-229 kubenswrapper[2574]: I0603 13:54:01.410655 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/f88ee55a-f56d-41d1-9216-18124b7f55f3-host-kubelet\") pod \"ovnkube-node-kfq8c\" (UID: \"f88ee55a-f56d-41d1-9216-18124b7f55f3\") " pod="openshift-ovn-kubernetes/ovnkube-node-kfq8c" Jun 03 13:54:01.412467 ip-10-0-134-229 kubenswrapper[2574]: I0603 13:54:01.410661 2574 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/9ccfb5b8-aff0-4122-a190-c406b390bdae-host-var-lib-kubelet\") pod \"multus-jkcw2\" (UID: \"9ccfb5b8-aff0-4122-a190-c406b390bdae\") " pod="openshift-multus/multus-jkcw2" Jun 03 13:54:01.412467 ip-10-0-134-229 kubenswrapper[2574]: I0603 13:54:01.410689 2574 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/9ccfb5b8-aff0-4122-a190-c406b390bdae-multus-conf-dir\") pod \"multus-jkcw2\" (UID: \"9ccfb5b8-aff0-4122-a190-c406b390bdae\") " pod="openshift-multus/multus-jkcw2" Jun 03 13:54:01.412467 ip-10-0-134-229 kubenswrapper[2574]: I0603 13:54:01.410715 2574 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/f88ee55a-f56d-41d1-9216-18124b7f55f3-ovnkube-script-lib\") pod \"ovnkube-node-kfq8c\" (UID: \"f88ee55a-f56d-41d1-9216-18124b7f55f3\") " pod="openshift-ovn-kubernetes/ovnkube-node-kfq8c" Jun 03 13:54:01.412467 ip-10-0-134-229 kubenswrapper[2574]: I0603 13:54:01.410753 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/5e68f084-d02c-4757-9842-1c01178fcfcb-host\") pod \"node-ca-7ql52\" (UID: \"5e68f084-d02c-4757-9842-1c01178fcfcb\") " pod="openshift-image-registry/node-ca-7ql52" Jun 03 13:54:01.412467 ip-10-0-134-229 kubenswrapper[2574]: I0603 13:54:01.410787 2574 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/963383f0-b900-46cb-81f8-4e92934bb58e-var-lib-kubelet\") pod \"tuned-l2f2s\" (UID: \"963383f0-b900-46cb-81f8-4e92934bb58e\") " pod="openshift-cluster-node-tuning-operator/tuned-l2f2s" Jun 03 13:54:01.412467 ip-10-0-134-229 kubenswrapper[2574]: I0603 13:54:01.410813 2574 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/77b2aeec-d4be-45f6-b355-4030387080ad-os-release\") pod \"multus-additional-cni-plugins-v264j\" (UID: \"77b2aeec-d4be-45f6-b355-4030387080ad\") " pod="openshift-multus/multus-additional-cni-plugins-v264j" Jun 03 13:54:01.412467 ip-10-0-134-229 kubenswrapper[2574]: I0603 13:54:01.410857 2574 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/9ccfb5b8-aff0-4122-a190-c406b390bdae-multus-daemon-config\") pod \"multus-jkcw2\" (UID: \"9ccfb5b8-aff0-4122-a190-c406b390bdae\") " pod="openshift-multus/multus-jkcw2" Jun 03 13:54:01.412467 ip-10-0-134-229 kubenswrapper[2574]: I0603 13:54:01.410886 2574 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/92d4e3fb-b640-4739-bf3a-6bf0ee60d517-registration-dir\") pod \"aws-ebs-csi-driver-node-zhqfp\" (UID: \"92d4e3fb-b640-4739-bf3a-6bf0ee60d517\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-zhqfp" Jun 03 13:54:01.412467 ip-10-0-134-229 kubenswrapper[2574]: I0603 13:54:01.410912 2574 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/963383f0-b900-46cb-81f8-4e92934bb58e-etc-kubernetes\") pod \"tuned-l2f2s\" (UID: \"963383f0-b900-46cb-81f8-4e92934bb58e\") " pod="openshift-cluster-node-tuning-operator/tuned-l2f2s" Jun 03 13:54:01.412467 ip-10-0-134-229 kubenswrapper[2574]: I0603 13:54:01.410940 2574 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/f88ee55a-f56d-41d1-9216-18124b7f55f3-host-slash\") pod \"ovnkube-node-kfq8c\" (UID: \"f88ee55a-f56d-41d1-9216-18124b7f55f3\") " pod="openshift-ovn-kubernetes/ovnkube-node-kfq8c" Jun 03 13:54:01.412467 ip-10-0-134-229 kubenswrapper[2574]: I0603 13:54:01.410968 2574 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/f88ee55a-f56d-41d1-9216-18124b7f55f3-env-overrides\") pod \"ovnkube-node-kfq8c\" (UID: \"f88ee55a-f56d-41d1-9216-18124b7f55f3\") " pod="openshift-ovn-kubernetes/ovnkube-node-kfq8c" Jun 03 13:54:01.413212 ip-10-0-134-229 kubenswrapper[2574]: I0603 13:54:01.410997 2574 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/77b2aeec-d4be-45f6-b355-4030387080ad-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-v264j\" (UID: \"77b2aeec-d4be-45f6-b355-4030387080ad\") " pod="openshift-multus/multus-additional-cni-plugins-v264j" Jun 03 13:54:01.413212 ip-10-0-134-229 kubenswrapper[2574]: I0603 13:54:01.411023 2574 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/f88ee55a-f56d-41d1-9216-18124b7f55f3-run-systemd\") pod \"ovnkube-node-kfq8c\" (UID: \"f88ee55a-f56d-41d1-9216-18124b7f55f3\") " pod="openshift-ovn-kubernetes/ovnkube-node-kfq8c" Jun 03 13:54:01.413212 ip-10-0-134-229 kubenswrapper[2574]: I0603 13:54:01.411049 2574 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/92d4e3fb-b640-4739-bf3a-6bf0ee60d517-etc-selinux\") pod \"aws-ebs-csi-driver-node-zhqfp\" (UID: \"92d4e3fb-b640-4739-bf3a-6bf0ee60d517\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-zhqfp" Jun 03 13:54:01.413212 ip-10-0-134-229 kubenswrapper[2574]: I0603 13:54:01.411061 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/9ccfb5b8-aff0-4122-a190-c406b390bdae-multus-cni-dir\") pod \"multus-jkcw2\" (UID: \"9ccfb5b8-aff0-4122-a190-c406b390bdae\") " pod="openshift-multus/multus-jkcw2" Jun 03 13:54:01.413212 ip-10-0-134-229 kubenswrapper[2574]: I0603 13:54:01.411077 2574 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/963383f0-b900-46cb-81f8-4e92934bb58e-etc-sysctl-conf\") pod \"tuned-l2f2s\" (UID: \"963383f0-b900-46cb-81f8-4e92934bb58e\") " pod="openshift-cluster-node-tuning-operator/tuned-l2f2s" Jun 03 13:54:01.413212 ip-10-0-134-229 kubenswrapper[2574]: I0603 13:54:01.411103 2574 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/963383f0-b900-46cb-81f8-4e92934bb58e-sys\") pod \"tuned-l2f2s\" (UID: \"963383f0-b900-46cb-81f8-4e92934bb58e\") " pod="openshift-cluster-node-tuning-operator/tuned-l2f2s" Jun 03 13:54:01.413212 ip-10-0-134-229 kubenswrapper[2574]: I0603 13:54:01.411136 2574 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-wjjfh\" (UniqueName: \"kubernetes.io/projected/e868100e-e4c6-48f1-b00c-ae9c32f7de33-kube-api-access-wjjfh\") pod \"iptables-alerter-ft4ch\" (UID: \"e868100e-e4c6-48f1-b00c-ae9c32f7de33\") " pod="openshift-network-operator/iptables-alerter-ft4ch" Jun 03 13:54:01.413212 ip-10-0-134-229 kubenswrapper[2574]: I0603 13:54:01.411246 2574 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/9ccfb5b8-aff0-4122-a190-c406b390bdae-etc-kubernetes\") pod \"multus-jkcw2\" (UID: \"9ccfb5b8-aff0-4122-a190-c406b390bdae\") " pod="openshift-multus/multus-jkcw2" Jun 03 13:54:01.413212 ip-10-0-134-229 kubenswrapper[2574]: I0603 13:54:01.411517 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/aaa611e0-e507-419d-8a90-f692f2d26ee5-tmp-dir\") pod \"node-resolver-pc2nh\" (UID: \"aaa611e0-e507-419d-8a90-f692f2d26ee5\") " pod="openshift-dns/node-resolver-pc2nh" Jun 03 13:54:01.413212 ip-10-0-134-229 kubenswrapper[2574]: I0603 13:54:01.411522 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/77b2aeec-d4be-45f6-b355-4030387080ad-os-release\") pod \"multus-additional-cni-plugins-v264j\" (UID: \"77b2aeec-d4be-45f6-b355-4030387080ad\") " pod="openshift-multus/multus-additional-cni-plugins-v264j" Jun 03 13:54:01.413212 ip-10-0-134-229 kubenswrapper[2574]: I0603 13:54:01.411384 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/963383f0-b900-46cb-81f8-4e92934bb58e-etc-sysctl-conf\") pod \"tuned-l2f2s\" (UID: \"963383f0-b900-46cb-81f8-4e92934bb58e\") " pod="openshift-cluster-node-tuning-operator/tuned-l2f2s" Jun 03 13:54:01.413212 ip-10-0-134-229 kubenswrapper[2574]: I0603 13:54:01.411424 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/f88ee55a-f56d-41d1-9216-18124b7f55f3-run-systemd\") pod \"ovnkube-node-kfq8c\" (UID: \"f88ee55a-f56d-41d1-9216-18124b7f55f3\") " pod="openshift-ovn-kubernetes/ovnkube-node-kfq8c" Jun 03 13:54:01.413212 ip-10-0-134-229 kubenswrapper[2574]: I0603 13:54:01.411462 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/963383f0-b900-46cb-81f8-4e92934bb58e-sys\") pod \"tuned-l2f2s\" (UID: \"963383f0-b900-46cb-81f8-4e92934bb58e\") " pod="openshift-cluster-node-tuning-operator/tuned-l2f2s" Jun 03 13:54:01.413212 ip-10-0-134-229 kubenswrapper[2574]: I0603 13:54:01.411567 2574 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/e868100e-e4c6-48f1-b00c-ae9c32f7de33-host-slash\") pod \"iptables-alerter-ft4ch\" (UID: \"e868100e-e4c6-48f1-b00c-ae9c32f7de33\") " pod="openshift-network-operator/iptables-alerter-ft4ch" Jun 03 13:54:01.413212 ip-10-0-134-229 kubenswrapper[2574]: I0603 13:54:01.411252 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/f88ee55a-f56d-41d1-9216-18124b7f55f3-ovnkube-script-lib\") pod \"ovnkube-node-kfq8c\" (UID: \"f88ee55a-f56d-41d1-9216-18124b7f55f3\") " pod="openshift-ovn-kubernetes/ovnkube-node-kfq8c" Jun 03 13:54:01.413212 ip-10-0-134-229 kubenswrapper[2574]: I0603 13:54:01.412441 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/9ccfb5b8-aff0-4122-a190-c406b390bdae-etc-kubernetes\") pod \"multus-jkcw2\" (UID: \"9ccfb5b8-aff0-4122-a190-c406b390bdae\") " pod="openshift-multus/multus-jkcw2" Jun 03 13:54:01.413212 ip-10-0-134-229 kubenswrapper[2574]: I0603 13:54:01.412874 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/f88ee55a-f56d-41d1-9216-18124b7f55f3-host-slash\") pod \"ovnkube-node-kfq8c\" (UID: \"f88ee55a-f56d-41d1-9216-18124b7f55f3\") " pod="openshift-ovn-kubernetes/ovnkube-node-kfq8c" Jun 03 13:54:01.413212 ip-10-0-134-229 kubenswrapper[2574]: I0603 13:54:01.412888 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/f88ee55a-f56d-41d1-9216-18124b7f55f3-env-overrides\") pod \"ovnkube-node-kfq8c\" (UID: \"f88ee55a-f56d-41d1-9216-18124b7f55f3\") " pod="openshift-ovn-kubernetes/ovnkube-node-kfq8c" Jun 03 13:54:01.414047 ip-10-0-134-229 kubenswrapper[2574]: I0603 13:54:01.412971 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/9ccfb5b8-aff0-4122-a190-c406b390bdae-multus-conf-dir\") pod \"multus-jkcw2\" (UID: \"9ccfb5b8-aff0-4122-a190-c406b390bdae\") " pod="openshift-multus/multus-jkcw2" Jun 03 13:54:01.414047 ip-10-0-134-229 kubenswrapper[2574]: I0603 13:54:01.413019 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/9ccfb5b8-aff0-4122-a190-c406b390bdae-host-var-lib-kubelet\") pod \"multus-jkcw2\" (UID: \"9ccfb5b8-aff0-4122-a190-c406b390bdae\") " pod="openshift-multus/multus-jkcw2" Jun 03 13:54:01.414047 ip-10-0-134-229 kubenswrapper[2574]: I0603 13:54:01.413062 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/9ccfb5b8-aff0-4122-a190-c406b390bdae-host-run-multus-certs\") pod \"multus-jkcw2\" (UID: \"9ccfb5b8-aff0-4122-a190-c406b390bdae\") " pod="openshift-multus/multus-jkcw2" Jun 03 13:54:01.414047 ip-10-0-134-229 kubenswrapper[2574]: I0603 13:54:01.413103 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/9ccfb5b8-aff0-4122-a190-c406b390bdae-multus-daemon-config\") pod \"multus-jkcw2\" (UID: \"9ccfb5b8-aff0-4122-a190-c406b390bdae\") " pod="openshift-multus/multus-jkcw2" Jun 03 13:54:01.414047 ip-10-0-134-229 kubenswrapper[2574]: I0603 13:54:01.413516 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/77b2aeec-d4be-45f6-b355-4030387080ad-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-v264j\" (UID: \"77b2aeec-d4be-45f6-b355-4030387080ad\") " pod="openshift-multus/multus-additional-cni-plugins-v264j" Jun 03 13:54:01.414047 ip-10-0-134-229 kubenswrapper[2574]: I0603 13:54:01.413707 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/963383f0-b900-46cb-81f8-4e92934bb58e-tmp\") pod \"tuned-l2f2s\" (UID: \"963383f0-b900-46cb-81f8-4e92934bb58e\") " pod="openshift-cluster-node-tuning-operator/tuned-l2f2s" Jun 03 13:54:01.414047 ip-10-0-134-229 kubenswrapper[2574]: I0603 13:54:01.413756 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/8c5a5cc8-abff-454b-8b7c-6e4064a2c8c0-agent-certs\") pod \"konnectivity-agent-5mz8g\" (UID: \"8c5a5cc8-abff-454b-8b7c-6e4064a2c8c0\") " pod="kube-system/konnectivity-agent-5mz8g" Jun 03 13:54:01.414047 ip-10-0-134-229 kubenswrapper[2574]: I0603 13:54:01.413893 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/963383f0-b900-46cb-81f8-4e92934bb58e-etc-tuned\") pod \"tuned-l2f2s\" (UID: \"963383f0-b900-46cb-81f8-4e92934bb58e\") " pod="openshift-cluster-node-tuning-operator/tuned-l2f2s" Jun 03 13:54:01.414047 ip-10-0-134-229 kubenswrapper[2574]: I0603 13:54:01.413941 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/f88ee55a-f56d-41d1-9216-18124b7f55f3-ovn-node-metrics-cert\") pod \"ovnkube-node-kfq8c\" (UID: \"f88ee55a-f56d-41d1-9216-18124b7f55f3\") " pod="openshift-ovn-kubernetes/ovnkube-node-kfq8c" Jun 03 13:54:01.414471 ip-10-0-134-229 kubenswrapper[2574]: I0603 13:54:01.414144 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/92d4e3fb-b640-4739-bf3a-6bf0ee60d517-registration-dir\") pod \"aws-ebs-csi-driver-node-zhqfp\" (UID: \"92d4e3fb-b640-4739-bf3a-6bf0ee60d517\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-zhqfp" Jun 03 13:54:01.414471 ip-10-0-134-229 kubenswrapper[2574]: I0603 13:54:01.411361 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/963383f0-b900-46cb-81f8-4e92934bb58e-var-lib-kubelet\") pod \"tuned-l2f2s\" (UID: \"963383f0-b900-46cb-81f8-4e92934bb58e\") " pod="openshift-cluster-node-tuning-operator/tuned-l2f2s" Jun 03 13:54:01.414471 ip-10-0-134-229 kubenswrapper[2574]: I0603 13:54:01.411485 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/92d4e3fb-b640-4739-bf3a-6bf0ee60d517-etc-selinux\") pod \"aws-ebs-csi-driver-node-zhqfp\" (UID: \"92d4e3fb-b640-4739-bf3a-6bf0ee60d517\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-zhqfp" Jun 03 13:54:01.414471 ip-10-0-134-229 kubenswrapper[2574]: I0603 13:54:01.414284 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/e868100e-e4c6-48f1-b00c-ae9c32f7de33-host-slash\") pod \"iptables-alerter-ft4ch\" (UID: \"e868100e-e4c6-48f1-b00c-ae9c32f7de33\") " pod="openshift-network-operator/iptables-alerter-ft4ch" Jun 03 13:54:01.414471 ip-10-0-134-229 kubenswrapper[2574]: I0603 13:54:01.414326 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/963383f0-b900-46cb-81f8-4e92934bb58e-etc-kubernetes\") pod \"tuned-l2f2s\" (UID: \"963383f0-b900-46cb-81f8-4e92934bb58e\") " pod="openshift-cluster-node-tuning-operator/tuned-l2f2s" Jun 03 13:54:01.421582 ip-10-0-134-229 kubenswrapper[2574]: E0603 13:54:01.421560 2574 projected.go:289] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jun 03 13:54:01.421582 ip-10-0-134-229 kubenswrapper[2574]: E0603 13:54:01.421584 2574 projected.go:289] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jun 03 13:54:01.421764 ip-10-0-134-229 kubenswrapper[2574]: E0603 13:54:01.421598 2574 projected.go:194] Error preparing data for projected volume kube-api-access-qwqz4 for pod openshift-network-diagnostics/network-check-target-vpjf9: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 03 13:54:01.421764 ip-10-0-134-229 kubenswrapper[2574]: E0603 13:54:01.421652 2574 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/1422bf53-dc3d-42c1-9a1f-8657ec8777f4-kube-api-access-qwqz4 podName:1422bf53-dc3d-42c1-9a1f-8657ec8777f4 nodeName:}" failed. No retries permitted until 2026-06-03 13:54:01.921634668 +0000 UTC m=+3.105641991 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "kube-api-access-qwqz4" (UniqueName: "kubernetes.io/projected/1422bf53-dc3d-42c1-9a1f-8657ec8777f4-kube-api-access-qwqz4") pod "network-check-target-vpjf9" (UID: "1422bf53-dc3d-42c1-9a1f-8657ec8777f4") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 03 13:54:01.423296 ip-10-0-134-229 kubenswrapper[2574]: I0603 13:54:01.423273 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-2sc6g\" (UniqueName: \"kubernetes.io/projected/77b2aeec-d4be-45f6-b355-4030387080ad-kube-api-access-2sc6g\") pod \"multus-additional-cni-plugins-v264j\" (UID: \"77b2aeec-d4be-45f6-b355-4030387080ad\") " pod="openshift-multus/multus-additional-cni-plugins-v264j" Jun 03 13:54:01.423511 ip-10-0-134-229 kubenswrapper[2574]: I0603 13:54:01.423491 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-hscr6\" (UniqueName: \"kubernetes.io/projected/92d4e3fb-b640-4739-bf3a-6bf0ee60d517-kube-api-access-hscr6\") pod \"aws-ebs-csi-driver-node-zhqfp\" (UID: \"92d4e3fb-b640-4739-bf3a-6bf0ee60d517\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-zhqfp" Jun 03 13:54:01.423734 ip-10-0-134-229 kubenswrapper[2574]: I0603 13:54:01.423711 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-zcc9k\" (UniqueName: \"kubernetes.io/projected/9ccfb5b8-aff0-4122-a190-c406b390bdae-kube-api-access-zcc9k\") pod \"multus-jkcw2\" (UID: \"9ccfb5b8-aff0-4122-a190-c406b390bdae\") " pod="openshift-multus/multus-jkcw2" Jun 03 13:54:01.424493 ip-10-0-134-229 kubenswrapper[2574]: I0603 13:54:01.424466 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-gm6cq\" (UniqueName: \"kubernetes.io/projected/6f47d39b-6eb0-4d5f-921b-0d56c194113e-kube-api-access-gm6cq\") pod \"network-metrics-daemon-9f7k7\" (UID: \"6f47d39b-6eb0-4d5f-921b-0d56c194113e\") " pod="openshift-multus/network-metrics-daemon-9f7k7" Jun 03 13:54:01.424596 ip-10-0-134-229 kubenswrapper[2574]: I0603 13:54:01.424490 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-gwjt5\" (UniqueName: \"kubernetes.io/projected/963383f0-b900-46cb-81f8-4e92934bb58e-kube-api-access-gwjt5\") pod \"tuned-l2f2s\" (UID: \"963383f0-b900-46cb-81f8-4e92934bb58e\") " pod="openshift-cluster-node-tuning-operator/tuned-l2f2s" Jun 03 13:54:01.426428 ip-10-0-134-229 kubenswrapper[2574]: I0603 13:54:01.426405 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-b4pf4\" (UniqueName: \"kubernetes.io/projected/f88ee55a-f56d-41d1-9216-18124b7f55f3-kube-api-access-b4pf4\") pod \"ovnkube-node-kfq8c\" (UID: \"f88ee55a-f56d-41d1-9216-18124b7f55f3\") " pod="openshift-ovn-kubernetes/ovnkube-node-kfq8c" Jun 03 13:54:01.427229 ip-10-0-134-229 kubenswrapper[2574]: I0603 13:54:01.427209 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-wjjfh\" (UniqueName: \"kubernetes.io/projected/e868100e-e4c6-48f1-b00c-ae9c32f7de33-kube-api-access-wjjfh\") pod \"iptables-alerter-ft4ch\" (UID: \"e868100e-e4c6-48f1-b00c-ae9c32f7de33\") " pod="openshift-network-operator/iptables-alerter-ft4ch" Jun 03 13:54:01.512642 ip-10-0-134-229 kubenswrapper[2574]: I0603 13:54:01.512431 2574 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-dz8tb\" (UniqueName: \"kubernetes.io/projected/5e68f084-d02c-4757-9842-1c01178fcfcb-kube-api-access-dz8tb\") pod \"node-ca-7ql52\" (UID: \"5e68f084-d02c-4757-9842-1c01178fcfcb\") " pod="openshift-image-registry/node-ca-7ql52" Jun 03 13:54:01.512642 ip-10-0-134-229 kubenswrapper[2574]: I0603 13:54:01.512517 2574 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/5e68f084-d02c-4757-9842-1c01178fcfcb-host\") pod \"node-ca-7ql52\" (UID: \"5e68f084-d02c-4757-9842-1c01178fcfcb\") " pod="openshift-image-registry/node-ca-7ql52" Jun 03 13:54:01.512642 ip-10-0-134-229 kubenswrapper[2574]: I0603 13:54:01.512558 2574 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/aaa611e0-e507-419d-8a90-f692f2d26ee5-tmp-dir\") pod \"node-resolver-pc2nh\" (UID: \"aaa611e0-e507-419d-8a90-f692f2d26ee5\") " pod="openshift-dns/node-resolver-pc2nh" Jun 03 13:54:01.512642 ip-10-0-134-229 kubenswrapper[2574]: I0603 13:54:01.512587 2574 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-4k5md\" (UniqueName: \"kubernetes.io/projected/aaa611e0-e507-419d-8a90-f692f2d26ee5-kube-api-access-4k5md\") pod \"node-resolver-pc2nh\" (UID: \"aaa611e0-e507-419d-8a90-f692f2d26ee5\") " pod="openshift-dns/node-resolver-pc2nh" Jun 03 13:54:01.512642 ip-10-0-134-229 kubenswrapper[2574]: I0603 13:54:01.512632 2574 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/aaa611e0-e507-419d-8a90-f692f2d26ee5-hosts-file\") pod \"node-resolver-pc2nh\" (UID: \"aaa611e0-e507-419d-8a90-f692f2d26ee5\") " pod="openshift-dns/node-resolver-pc2nh" Jun 03 13:54:01.512642 ip-10-0-134-229 kubenswrapper[2574]: I0603 13:54:01.512659 2574 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/5e68f084-d02c-4757-9842-1c01178fcfcb-serviceca\") pod \"node-ca-7ql52\" (UID: \"5e68f084-d02c-4757-9842-1c01178fcfcb\") " pod="openshift-image-registry/node-ca-7ql52" Jun 03 13:54:01.513103 ip-10-0-134-229 kubenswrapper[2574]: I0603 13:54:01.512899 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host\" (UniqueName: \"kubernetes.io/host-path/5e68f084-d02c-4757-9842-1c01178fcfcb-host\") pod \"node-ca-7ql52\" (UID: \"5e68f084-d02c-4757-9842-1c01178fcfcb\") " pod="openshift-image-registry/node-ca-7ql52" Jun 03 13:54:01.513103 ip-10-0-134-229 kubenswrapper[2574]: I0603 13:54:01.512929 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/aaa611e0-e507-419d-8a90-f692f2d26ee5-hosts-file\") pod \"node-resolver-pc2nh\" (UID: \"aaa611e0-e507-419d-8a90-f692f2d26ee5\") " pod="openshift-dns/node-resolver-pc2nh" Jun 03 13:54:01.513103 ip-10-0-134-229 kubenswrapper[2574]: I0603 13:54:01.512977 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/aaa611e0-e507-419d-8a90-f692f2d26ee5-tmp-dir\") pod \"node-resolver-pc2nh\" (UID: \"aaa611e0-e507-419d-8a90-f692f2d26ee5\") " pod="openshift-dns/node-resolver-pc2nh" Jun 03 13:54:01.513633 ip-10-0-134-229 kubenswrapper[2574]: I0603 13:54:01.513612 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/5e68f084-d02c-4757-9842-1c01178fcfcb-serviceca\") pod \"node-ca-7ql52\" (UID: \"5e68f084-d02c-4757-9842-1c01178fcfcb\") " pod="openshift-image-registry/node-ca-7ql52" Jun 03 13:54:01.520825 ip-10-0-134-229 kubenswrapper[2574]: I0603 13:54:01.520803 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-dz8tb\" (UniqueName: \"kubernetes.io/projected/5e68f084-d02c-4757-9842-1c01178fcfcb-kube-api-access-dz8tb\") pod \"node-ca-7ql52\" (UID: \"5e68f084-d02c-4757-9842-1c01178fcfcb\") " pod="openshift-image-registry/node-ca-7ql52" Jun 03 13:54:01.520930 ip-10-0-134-229 kubenswrapper[2574]: I0603 13:54:01.520802 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-4k5md\" (UniqueName: \"kubernetes.io/projected/aaa611e0-e507-419d-8a90-f692f2d26ee5-kube-api-access-4k5md\") pod \"node-resolver-pc2nh\" (UID: \"aaa611e0-e507-419d-8a90-f692f2d26ee5\") " pod="openshift-dns/node-resolver-pc2nh" Jun 03 13:54:01.600911 ip-10-0-134-229 kubenswrapper[2574]: I0603 13:54:01.600832 2574 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-operator/iptables-alerter-ft4ch" Jun 03 13:54:01.608494 ip-10-0-134-229 kubenswrapper[2574]: I0603 13:54:01.608469 2574 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/konnectivity-agent-5mz8g" Jun 03 13:54:01.616431 ip-10-0-134-229 kubenswrapper[2574]: I0603 13:54:01.616411 2574 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-additional-cni-plugins-v264j" Jun 03 13:54:01.622952 ip-10-0-134-229 kubenswrapper[2574]: I0603 13:54:01.622933 2574 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-jkcw2" Jun 03 13:54:01.629506 ip-10-0-134-229 kubenswrapper[2574]: I0603 13:54:01.629487 2574 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ovn-kubernetes/ovnkube-node-kfq8c" Jun 03 13:54:01.637655 ip-10-0-134-229 kubenswrapper[2574]: I0603 13:54:01.637636 2574 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-zhqfp" Jun 03 13:54:01.641063 ip-10-0-134-229 kubenswrapper[2574]: I0603 13:54:01.641048 2574 reflector.go:430] "Caches populated" type="*v1.RuntimeClass" reflector="k8s.io/client-go/informers/factory.go:160" Jun 03 13:54:01.643860 ip-10-0-134-229 kubenswrapper[2574]: I0603 13:54:01.643842 2574 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-node-tuning-operator/tuned-l2f2s" Jun 03 13:54:01.650396 ip-10-0-134-229 kubenswrapper[2574]: I0603 13:54:01.650360 2574 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/node-resolver-pc2nh" Jun 03 13:54:01.655887 ip-10-0-134-229 kubenswrapper[2574]: I0603 13:54:01.655873 2574 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/node-ca-7ql52" Jun 03 13:54:01.914833 ip-10-0-134-229 kubenswrapper[2574]: I0603 13:54:01.914767 2574 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/6f47d39b-6eb0-4d5f-921b-0d56c194113e-metrics-certs\") pod \"network-metrics-daemon-9f7k7\" (UID: \"6f47d39b-6eb0-4d5f-921b-0d56c194113e\") " pod="openshift-multus/network-metrics-daemon-9f7k7" Jun 03 13:54:01.914961 ip-10-0-134-229 kubenswrapper[2574]: E0603 13:54:01.914876 2574 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jun 03 13:54:01.914961 ip-10-0-134-229 kubenswrapper[2574]: E0603 13:54:01.914933 2574 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/6f47d39b-6eb0-4d5f-921b-0d56c194113e-metrics-certs podName:6f47d39b-6eb0-4d5f-921b-0d56c194113e nodeName:}" failed. No retries permitted until 2026-06-03 13:54:02.914917203 +0000 UTC m=+4.098924515 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/6f47d39b-6eb0-4d5f-921b-0d56c194113e-metrics-certs") pod "network-metrics-daemon-9f7k7" (UID: "6f47d39b-6eb0-4d5f-921b-0d56c194113e") : object "openshift-multus"/"metrics-daemon-secret" not registered Jun 03 13:54:01.932948 ip-10-0-134-229 kubenswrapper[2574]: W0603 13:54:01.932924 2574 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod9ccfb5b8_aff0_4122_a190_c406b390bdae.slice/crio-f36b61d2d5372a3edc608dce351e82749c2bb8aa621be6e3224b541fd65a0892 WatchSource:0}: Error finding container f36b61d2d5372a3edc608dce351e82749c2bb8aa621be6e3224b541fd65a0892: Status 404 returned error can't find the container with id f36b61d2d5372a3edc608dce351e82749c2bb8aa621be6e3224b541fd65a0892 Jun 03 13:54:01.934256 ip-10-0-134-229 kubenswrapper[2574]: W0603 13:54:01.934237 2574 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podaaa611e0_e507_419d_8a90_f692f2d26ee5.slice/crio-39667041f02ec3e1b587089d1e5b731a71285be91ef2608bd439d42bb4090746 WatchSource:0}: Error finding container 39667041f02ec3e1b587089d1e5b731a71285be91ef2608bd439d42bb4090746: Status 404 returned error can't find the container with id 39667041f02ec3e1b587089d1e5b731a71285be91ef2608bd439d42bb4090746 Jun 03 13:54:01.937989 ip-10-0-134-229 kubenswrapper[2574]: W0603 13:54:01.937954 2574 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podf88ee55a_f56d_41d1_9216_18124b7f55f3.slice/crio-921b77f7e280ce8939eb36abd9854fc68367a0569d8e3691fd856fea93195fb1 WatchSource:0}: Error finding container 921b77f7e280ce8939eb36abd9854fc68367a0569d8e3691fd856fea93195fb1: Status 404 returned error can't find the container with id 921b77f7e280ce8939eb36abd9854fc68367a0569d8e3691fd856fea93195fb1 Jun 03 13:54:01.938786 ip-10-0-134-229 kubenswrapper[2574]: W0603 13:54:01.938764 2574 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod92d4e3fb_b640_4739_bf3a_6bf0ee60d517.slice/crio-d491202ae0e60cfde985d47763a78339c76085b9e73f6e7bf2bded45ade16790 WatchSource:0}: Error finding container d491202ae0e60cfde985d47763a78339c76085b9e73f6e7bf2bded45ade16790: Status 404 returned error can't find the container with id d491202ae0e60cfde985d47763a78339c76085b9e73f6e7bf2bded45ade16790 Jun 03 13:54:01.940415 ip-10-0-134-229 kubenswrapper[2574]: W0603 13:54:01.940174 2574 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod963383f0_b900_46cb_81f8_4e92934bb58e.slice/crio-a912ca6244a06637acae1e090eb51f06f951700bef3d3cf74b88d53971a4c0ad WatchSource:0}: Error finding container a912ca6244a06637acae1e090eb51f06f951700bef3d3cf74b88d53971a4c0ad: Status 404 returned error can't find the container with id a912ca6244a06637acae1e090eb51f06f951700bef3d3cf74b88d53971a4c0ad Jun 03 13:54:01.941148 ip-10-0-134-229 kubenswrapper[2574]: W0603 13:54:01.941112 2574 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pode868100e_e4c6_48f1_b00c_ae9c32f7de33.slice/crio-e307c354b1741d40b1b53964eabccb1f3b252fdbff7235db1bf986dd61d3400e WatchSource:0}: Error finding container e307c354b1741d40b1b53964eabccb1f3b252fdbff7235db1bf986dd61d3400e: Status 404 returned error can't find the container with id e307c354b1741d40b1b53964eabccb1f3b252fdbff7235db1bf986dd61d3400e Jun 03 13:54:01.945120 ip-10-0-134-229 kubenswrapper[2574]: W0603 13:54:01.945097 2574 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod8c5a5cc8_abff_454b_8b7c_6e4064a2c8c0.slice/crio-b40ea72b9905fbb2cfe6a7c0c39aa564b741ec4c6134702a1b64a01090b27ee0 WatchSource:0}: Error finding container b40ea72b9905fbb2cfe6a7c0c39aa564b741ec4c6134702a1b64a01090b27ee0: Status 404 returned error can't find the container with id b40ea72b9905fbb2cfe6a7c0c39aa564b741ec4c6134702a1b64a01090b27ee0 Jun 03 13:54:02.015656 ip-10-0-134-229 kubenswrapper[2574]: I0603 13:54:02.015628 2574 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-qwqz4\" (UniqueName: \"kubernetes.io/projected/1422bf53-dc3d-42c1-9a1f-8657ec8777f4-kube-api-access-qwqz4\") pod \"network-check-target-vpjf9\" (UID: \"1422bf53-dc3d-42c1-9a1f-8657ec8777f4\") " pod="openshift-network-diagnostics/network-check-target-vpjf9" Jun 03 13:54:02.015774 ip-10-0-134-229 kubenswrapper[2574]: E0603 13:54:02.015758 2574 projected.go:289] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jun 03 13:54:02.015838 ip-10-0-134-229 kubenswrapper[2574]: E0603 13:54:02.015779 2574 projected.go:289] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jun 03 13:54:02.015838 ip-10-0-134-229 kubenswrapper[2574]: E0603 13:54:02.015794 2574 projected.go:194] Error preparing data for projected volume kube-api-access-qwqz4 for pod openshift-network-diagnostics/network-check-target-vpjf9: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 03 13:54:02.015928 ip-10-0-134-229 kubenswrapper[2574]: E0603 13:54:02.015847 2574 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/1422bf53-dc3d-42c1-9a1f-8657ec8777f4-kube-api-access-qwqz4 podName:1422bf53-dc3d-42c1-9a1f-8657ec8777f4 nodeName:}" failed. No retries permitted until 2026-06-03 13:54:03.015829655 +0000 UTC m=+4.199836985 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "kube-api-access-qwqz4" (UniqueName: "kubernetes.io/projected/1422bf53-dc3d-42c1-9a1f-8657ec8777f4-kube-api-access-qwqz4") pod "network-check-target-vpjf9" (UID: "1422bf53-dc3d-42c1-9a1f-8657ec8777f4") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 03 13:54:02.337444 ip-10-0-134-229 kubenswrapper[2574]: I0603 13:54:02.337403 2574 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kubelet-serving" expiration="2028-06-02 13:49:00 +0000 UTC" deadline="2028-02-21 15:06:58.229595446 +0000 UTC" Jun 03 13:54:02.337444 ip-10-0-134-229 kubenswrapper[2574]: I0603 13:54:02.337441 2574 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kubelet-serving" sleep="15073h12m55.892158895s" Jun 03 13:54:02.444261 ip-10-0-134-229 kubenswrapper[2574]: I0603 13:54:02.442555 2574 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-134-229.ec2.internal" event={"ID":"fe2965869ce022bdc90ca9172d2df8d9","Type":"ContainerStarted","Data":"d6d21f90a2903ac576bbbc4e0b550d90c56a5ea597bf740cb8bfd92e7a04751a"} Jun 03 13:54:02.450813 ip-10-0-134-229 kubenswrapper[2574]: I0603 13:54:02.448299 2574 generic.go:358] "Generic (PLEG): container finished" podID="4a797ddfb9d290ccab2f8888a0be8fd1" containerID="b0b9040a8c4a533b1a42d01dbddc29b76338cc93d86a6cddd39ffa0e1ee5887a" exitCode=0 Jun 03 13:54:02.450813 ip-10-0-134-229 kubenswrapper[2574]: I0603 13:54:02.448391 2574 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-134-229.ec2.internal" event={"ID":"4a797ddfb9d290ccab2f8888a0be8fd1","Type":"ContainerDied","Data":"b0b9040a8c4a533b1a42d01dbddc29b76338cc93d86a6cddd39ffa0e1ee5887a"} Jun 03 13:54:02.459914 ip-10-0-134-229 kubenswrapper[2574]: I0603 13:54:02.459885 2574 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-zhqfp" event={"ID":"92d4e3fb-b640-4739-bf3a-6bf0ee60d517","Type":"ContainerStarted","Data":"d491202ae0e60cfde985d47763a78339c76085b9e73f6e7bf2bded45ade16790"} Jun 03 13:54:02.461856 ip-10-0-134-229 kubenswrapper[2574]: I0603 13:54:02.461806 2574 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-kfq8c" event={"ID":"f88ee55a-f56d-41d1-9216-18124b7f55f3","Type":"ContainerStarted","Data":"921b77f7e280ce8939eb36abd9854fc68367a0569d8e3691fd856fea93195fb1"} Jun 03 13:54:02.466941 ip-10-0-134-229 kubenswrapper[2574]: I0603 13:54:02.466872 2574 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-jkcw2" event={"ID":"9ccfb5b8-aff0-4122-a190-c406b390bdae","Type":"ContainerStarted","Data":"f36b61d2d5372a3edc608dce351e82749c2bb8aa621be6e3224b541fd65a0892"} Jun 03 13:54:02.468299 ip-10-0-134-229 kubenswrapper[2574]: I0603 13:54:02.468245 2574 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="kube-system/kube-apiserver-proxy-ip-10-0-134-229.ec2.internal" podStartSLOduration=2.468230382 podStartE2EDuration="2.468230382s" podCreationTimestamp="2026-06-03 13:54:00 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2026-06-03 13:54:02.455297491 +0000 UTC m=+3.639304820" watchObservedRunningTime="2026-06-03 13:54:02.468230382 +0000 UTC m=+3.652237713" Jun 03 13:54:02.473308 ip-10-0-134-229 kubenswrapper[2574]: I0603 13:54:02.473280 2574 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kube-system/konnectivity-agent-5mz8g" event={"ID":"8c5a5cc8-abff-454b-8b7c-6e4064a2c8c0","Type":"ContainerStarted","Data":"b40ea72b9905fbb2cfe6a7c0c39aa564b741ec4c6134702a1b64a01090b27ee0"} Jun 03 13:54:02.480918 ip-10-0-134-229 kubenswrapper[2574]: I0603 13:54:02.480850 2574 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-v264j" event={"ID":"77b2aeec-d4be-45f6-b355-4030387080ad","Type":"ContainerStarted","Data":"f9489053eedc1690cba95ddac3ec00615012fc0d1893c369309d53997d5ac959"} Jun 03 13:54:02.484670 ip-10-0-134-229 kubenswrapper[2574]: I0603 13:54:02.484603 2574 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/node-ca-7ql52" event={"ID":"5e68f084-d02c-4757-9842-1c01178fcfcb","Type":"ContainerStarted","Data":"73f2adca10b106c873bb0d2081d5d21a7d0b22b31a8c2a7791c715866c98440e"} Jun 03 13:54:02.496306 ip-10-0-134-229 kubenswrapper[2574]: I0603 13:54:02.496235 2574 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-network-operator/iptables-alerter-ft4ch" event={"ID":"e868100e-e4c6-48f1-b00c-ae9c32f7de33","Type":"ContainerStarted","Data":"e307c354b1741d40b1b53964eabccb1f3b252fdbff7235db1bf986dd61d3400e"} Jun 03 13:54:02.508860 ip-10-0-134-229 kubenswrapper[2574]: I0603 13:54:02.508834 2574 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-node-tuning-operator/tuned-l2f2s" event={"ID":"963383f0-b900-46cb-81f8-4e92934bb58e","Type":"ContainerStarted","Data":"a912ca6244a06637acae1e090eb51f06f951700bef3d3cf74b88d53971a4c0ad"} Jun 03 13:54:02.530992 ip-10-0-134-229 kubenswrapper[2574]: I0603 13:54:02.530951 2574 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-dns/node-resolver-pc2nh" event={"ID":"aaa611e0-e507-419d-8a90-f692f2d26ee5","Type":"ContainerStarted","Data":"39667041f02ec3e1b587089d1e5b731a71285be91ef2608bd439d42bb4090746"} Jun 03 13:54:02.924796 ip-10-0-134-229 kubenswrapper[2574]: I0603 13:54:02.924145 2574 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/6f47d39b-6eb0-4d5f-921b-0d56c194113e-metrics-certs\") pod \"network-metrics-daemon-9f7k7\" (UID: \"6f47d39b-6eb0-4d5f-921b-0d56c194113e\") " pod="openshift-multus/network-metrics-daemon-9f7k7" Jun 03 13:54:02.924796 ip-10-0-134-229 kubenswrapper[2574]: E0603 13:54:02.924282 2574 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jun 03 13:54:02.924796 ip-10-0-134-229 kubenswrapper[2574]: E0603 13:54:02.924346 2574 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/6f47d39b-6eb0-4d5f-921b-0d56c194113e-metrics-certs podName:6f47d39b-6eb0-4d5f-921b-0d56c194113e nodeName:}" failed. No retries permitted until 2026-06-03 13:54:04.924328265 +0000 UTC m=+6.108335578 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/6f47d39b-6eb0-4d5f-921b-0d56c194113e-metrics-certs") pod "network-metrics-daemon-9f7k7" (UID: "6f47d39b-6eb0-4d5f-921b-0d56c194113e") : object "openshift-multus"/"metrics-daemon-secret" not registered Jun 03 13:54:03.024761 ip-10-0-134-229 kubenswrapper[2574]: I0603 13:54:03.024681 2574 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-qwqz4\" (UniqueName: \"kubernetes.io/projected/1422bf53-dc3d-42c1-9a1f-8657ec8777f4-kube-api-access-qwqz4\") pod \"network-check-target-vpjf9\" (UID: \"1422bf53-dc3d-42c1-9a1f-8657ec8777f4\") " pod="openshift-network-diagnostics/network-check-target-vpjf9" Jun 03 13:54:03.024922 ip-10-0-134-229 kubenswrapper[2574]: E0603 13:54:03.024859 2574 projected.go:289] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jun 03 13:54:03.024922 ip-10-0-134-229 kubenswrapper[2574]: E0603 13:54:03.024877 2574 projected.go:289] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jun 03 13:54:03.024922 ip-10-0-134-229 kubenswrapper[2574]: E0603 13:54:03.024889 2574 projected.go:194] Error preparing data for projected volume kube-api-access-qwqz4 for pod openshift-network-diagnostics/network-check-target-vpjf9: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 03 13:54:03.025080 ip-10-0-134-229 kubenswrapper[2574]: E0603 13:54:03.024943 2574 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/1422bf53-dc3d-42c1-9a1f-8657ec8777f4-kube-api-access-qwqz4 podName:1422bf53-dc3d-42c1-9a1f-8657ec8777f4 nodeName:}" failed. No retries permitted until 2026-06-03 13:54:05.024925377 +0000 UTC m=+6.208932689 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "kube-api-access-qwqz4" (UniqueName: "kubernetes.io/projected/1422bf53-dc3d-42c1-9a1f-8657ec8777f4-kube-api-access-qwqz4") pod "network-check-target-vpjf9" (UID: "1422bf53-dc3d-42c1-9a1f-8657ec8777f4") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 03 13:54:03.430186 ip-10-0-134-229 kubenswrapper[2574]: I0603 13:54:03.429452 2574 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-vpjf9" Jun 03 13:54:03.430186 ip-10-0-134-229 kubenswrapper[2574]: E0603 13:54:03.429572 2574 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-vpjf9" podUID="1422bf53-dc3d-42c1-9a1f-8657ec8777f4" Jun 03 13:54:03.430186 ip-10-0-134-229 kubenswrapper[2574]: I0603 13:54:03.429980 2574 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-9f7k7" Jun 03 13:54:03.430186 ip-10-0-134-229 kubenswrapper[2574]: E0603 13:54:03.430080 2574 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-9f7k7" podUID="6f47d39b-6eb0-4d5f-921b-0d56c194113e" Jun 03 13:54:03.552666 ip-10-0-134-229 kubenswrapper[2574]: I0603 13:54:03.552598 2574 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-134-229.ec2.internal" event={"ID":"4a797ddfb9d290ccab2f8888a0be8fd1","Type":"ContainerStarted","Data":"16eeac3049f98466575a693888eb8509a7d7647668e9c66ca50a5ebb8905f69a"} Jun 03 13:54:04.945740 ip-10-0-134-229 kubenswrapper[2574]: I0603 13:54:04.945644 2574 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/6f47d39b-6eb0-4d5f-921b-0d56c194113e-metrics-certs\") pod \"network-metrics-daemon-9f7k7\" (UID: \"6f47d39b-6eb0-4d5f-921b-0d56c194113e\") " pod="openshift-multus/network-metrics-daemon-9f7k7" Jun 03 13:54:04.946238 ip-10-0-134-229 kubenswrapper[2574]: E0603 13:54:04.945837 2574 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jun 03 13:54:04.946238 ip-10-0-134-229 kubenswrapper[2574]: E0603 13:54:04.945919 2574 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/6f47d39b-6eb0-4d5f-921b-0d56c194113e-metrics-certs podName:6f47d39b-6eb0-4d5f-921b-0d56c194113e nodeName:}" failed. No retries permitted until 2026-06-03 13:54:08.945896339 +0000 UTC m=+10.129903667 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/6f47d39b-6eb0-4d5f-921b-0d56c194113e-metrics-certs") pod "network-metrics-daemon-9f7k7" (UID: "6f47d39b-6eb0-4d5f-921b-0d56c194113e") : object "openshift-multus"/"metrics-daemon-secret" not registered Jun 03 13:54:05.047365 ip-10-0-134-229 kubenswrapper[2574]: I0603 13:54:05.046757 2574 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-qwqz4\" (UniqueName: \"kubernetes.io/projected/1422bf53-dc3d-42c1-9a1f-8657ec8777f4-kube-api-access-qwqz4\") pod \"network-check-target-vpjf9\" (UID: \"1422bf53-dc3d-42c1-9a1f-8657ec8777f4\") " pod="openshift-network-diagnostics/network-check-target-vpjf9" Jun 03 13:54:05.047365 ip-10-0-134-229 kubenswrapper[2574]: E0603 13:54:05.046923 2574 projected.go:289] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jun 03 13:54:05.047365 ip-10-0-134-229 kubenswrapper[2574]: E0603 13:54:05.046942 2574 projected.go:289] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jun 03 13:54:05.047365 ip-10-0-134-229 kubenswrapper[2574]: E0603 13:54:05.046955 2574 projected.go:194] Error preparing data for projected volume kube-api-access-qwqz4 for pod openshift-network-diagnostics/network-check-target-vpjf9: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 03 13:54:05.047365 ip-10-0-134-229 kubenswrapper[2574]: E0603 13:54:05.047026 2574 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/1422bf53-dc3d-42c1-9a1f-8657ec8777f4-kube-api-access-qwqz4 podName:1422bf53-dc3d-42c1-9a1f-8657ec8777f4 nodeName:}" failed. No retries permitted until 2026-06-03 13:54:09.047008025 +0000 UTC m=+10.231015340 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "kube-api-access-qwqz4" (UniqueName: "kubernetes.io/projected/1422bf53-dc3d-42c1-9a1f-8657ec8777f4-kube-api-access-qwqz4") pod "network-check-target-vpjf9" (UID: "1422bf53-dc3d-42c1-9a1f-8657ec8777f4") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 03 13:54:05.428217 ip-10-0-134-229 kubenswrapper[2574]: I0603 13:54:05.427474 2574 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-vpjf9" Jun 03 13:54:05.428217 ip-10-0-134-229 kubenswrapper[2574]: E0603 13:54:05.427597 2574 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-vpjf9" podUID="1422bf53-dc3d-42c1-9a1f-8657ec8777f4" Jun 03 13:54:05.428217 ip-10-0-134-229 kubenswrapper[2574]: I0603 13:54:05.428013 2574 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-9f7k7" Jun 03 13:54:05.428217 ip-10-0-134-229 kubenswrapper[2574]: E0603 13:54:05.428127 2574 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-9f7k7" podUID="6f47d39b-6eb0-4d5f-921b-0d56c194113e" Jun 03 13:54:06.844450 ip-10-0-134-229 kubenswrapper[2574]: I0603 13:54:06.844388 2574 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-134-229.ec2.internal" podStartSLOduration=6.844355131 podStartE2EDuration="6.844355131s" podCreationTimestamp="2026-06-03 13:54:00 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2026-06-03 13:54:03.569488429 +0000 UTC m=+4.753495759" watchObservedRunningTime="2026-06-03 13:54:06.844355131 +0000 UTC m=+8.028362462" Jun 03 13:54:06.845894 ip-10-0-134-229 kubenswrapper[2574]: I0603 13:54:06.845339 2574 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["kube-system/global-pull-secret-syncer-g8xw8"] Jun 03 13:54:06.847514 ip-10-0-134-229 kubenswrapper[2574]: I0603 13:54:06.847116 2574 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-g8xw8" Jun 03 13:54:06.847514 ip-10-0-134-229 kubenswrapper[2574]: E0603 13:54:06.847193 2574 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-g8xw8" podUID="14b4e9c6-79e5-4c10-96b7-cc3cd27b89aa" Jun 03 13:54:06.963527 ip-10-0-134-229 kubenswrapper[2574]: I0603 13:54:06.963475 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/14b4e9c6-79e5-4c10-96b7-cc3cd27b89aa-original-pull-secret\") pod \"global-pull-secret-syncer-g8xw8\" (UID: \"14b4e9c6-79e5-4c10-96b7-cc3cd27b89aa\") " pod="kube-system/global-pull-secret-syncer-g8xw8" Jun 03 13:54:06.963696 ip-10-0-134-229 kubenswrapper[2574]: I0603 13:54:06.963587 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/14b4e9c6-79e5-4c10-96b7-cc3cd27b89aa-dbus\") pod \"global-pull-secret-syncer-g8xw8\" (UID: \"14b4e9c6-79e5-4c10-96b7-cc3cd27b89aa\") " pod="kube-system/global-pull-secret-syncer-g8xw8" Jun 03 13:54:06.963696 ip-10-0-134-229 kubenswrapper[2574]: I0603 13:54:06.963620 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/14b4e9c6-79e5-4c10-96b7-cc3cd27b89aa-kubelet-config\") pod \"global-pull-secret-syncer-g8xw8\" (UID: \"14b4e9c6-79e5-4c10-96b7-cc3cd27b89aa\") " pod="kube-system/global-pull-secret-syncer-g8xw8" Jun 03 13:54:07.064962 ip-10-0-134-229 kubenswrapper[2574]: I0603 13:54:07.064917 2574 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/14b4e9c6-79e5-4c10-96b7-cc3cd27b89aa-original-pull-secret\") pod \"global-pull-secret-syncer-g8xw8\" (UID: \"14b4e9c6-79e5-4c10-96b7-cc3cd27b89aa\") " pod="kube-system/global-pull-secret-syncer-g8xw8" Jun 03 13:54:07.065125 ip-10-0-134-229 kubenswrapper[2574]: I0603 13:54:07.065021 2574 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/14b4e9c6-79e5-4c10-96b7-cc3cd27b89aa-dbus\") pod \"global-pull-secret-syncer-g8xw8\" (UID: \"14b4e9c6-79e5-4c10-96b7-cc3cd27b89aa\") " pod="kube-system/global-pull-secret-syncer-g8xw8" Jun 03 13:54:07.065125 ip-10-0-134-229 kubenswrapper[2574]: I0603 13:54:07.065050 2574 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/14b4e9c6-79e5-4c10-96b7-cc3cd27b89aa-kubelet-config\") pod \"global-pull-secret-syncer-g8xw8\" (UID: \"14b4e9c6-79e5-4c10-96b7-cc3cd27b89aa\") " pod="kube-system/global-pull-secret-syncer-g8xw8" Jun 03 13:54:07.065125 ip-10-0-134-229 kubenswrapper[2574]: E0603 13:54:07.065116 2574 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jun 03 13:54:07.065285 ip-10-0-134-229 kubenswrapper[2574]: I0603 13:54:07.065128 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/14b4e9c6-79e5-4c10-96b7-cc3cd27b89aa-kubelet-config\") pod \"global-pull-secret-syncer-g8xw8\" (UID: \"14b4e9c6-79e5-4c10-96b7-cc3cd27b89aa\") " pod="kube-system/global-pull-secret-syncer-g8xw8" Jun 03 13:54:07.065285 ip-10-0-134-229 kubenswrapper[2574]: E0603 13:54:07.065178 2574 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/14b4e9c6-79e5-4c10-96b7-cc3cd27b89aa-original-pull-secret podName:14b4e9c6-79e5-4c10-96b7-cc3cd27b89aa nodeName:}" failed. No retries permitted until 2026-06-03 13:54:07.565157733 +0000 UTC m=+8.749165054 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/14b4e9c6-79e5-4c10-96b7-cc3cd27b89aa-original-pull-secret") pod "global-pull-secret-syncer-g8xw8" (UID: "14b4e9c6-79e5-4c10-96b7-cc3cd27b89aa") : object "kube-system"/"original-pull-secret" not registered Jun 03 13:54:07.065285 ip-10-0-134-229 kubenswrapper[2574]: I0603 13:54:07.065268 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/14b4e9c6-79e5-4c10-96b7-cc3cd27b89aa-dbus\") pod \"global-pull-secret-syncer-g8xw8\" (UID: \"14b4e9c6-79e5-4c10-96b7-cc3cd27b89aa\") " pod="kube-system/global-pull-secret-syncer-g8xw8" Jun 03 13:54:07.427962 ip-10-0-134-229 kubenswrapper[2574]: I0603 13:54:07.427439 2574 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-vpjf9" Jun 03 13:54:07.427962 ip-10-0-134-229 kubenswrapper[2574]: E0603 13:54:07.427560 2574 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-vpjf9" podUID="1422bf53-dc3d-42c1-9a1f-8657ec8777f4" Jun 03 13:54:07.427962 ip-10-0-134-229 kubenswrapper[2574]: I0603 13:54:07.427449 2574 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-9f7k7" Jun 03 13:54:07.427962 ip-10-0-134-229 kubenswrapper[2574]: E0603 13:54:07.427675 2574 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-9f7k7" podUID="6f47d39b-6eb0-4d5f-921b-0d56c194113e" Jun 03 13:54:07.570177 ip-10-0-134-229 kubenswrapper[2574]: I0603 13:54:07.570142 2574 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/14b4e9c6-79e5-4c10-96b7-cc3cd27b89aa-original-pull-secret\") pod \"global-pull-secret-syncer-g8xw8\" (UID: \"14b4e9c6-79e5-4c10-96b7-cc3cd27b89aa\") " pod="kube-system/global-pull-secret-syncer-g8xw8" Jun 03 13:54:07.570364 ip-10-0-134-229 kubenswrapper[2574]: E0603 13:54:07.570293 2574 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jun 03 13:54:07.570364 ip-10-0-134-229 kubenswrapper[2574]: E0603 13:54:07.570360 2574 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/14b4e9c6-79e5-4c10-96b7-cc3cd27b89aa-original-pull-secret podName:14b4e9c6-79e5-4c10-96b7-cc3cd27b89aa nodeName:}" failed. No retries permitted until 2026-06-03 13:54:08.570342344 +0000 UTC m=+9.754349668 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/14b4e9c6-79e5-4c10-96b7-cc3cd27b89aa-original-pull-secret") pod "global-pull-secret-syncer-g8xw8" (UID: "14b4e9c6-79e5-4c10-96b7-cc3cd27b89aa") : object "kube-system"/"original-pull-secret" not registered Jun 03 13:54:08.426475 ip-10-0-134-229 kubenswrapper[2574]: I0603 13:54:08.426443 2574 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-g8xw8" Jun 03 13:54:08.426922 ip-10-0-134-229 kubenswrapper[2574]: E0603 13:54:08.426569 2574 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-g8xw8" podUID="14b4e9c6-79e5-4c10-96b7-cc3cd27b89aa" Jun 03 13:54:08.578533 ip-10-0-134-229 kubenswrapper[2574]: I0603 13:54:08.578459 2574 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/14b4e9c6-79e5-4c10-96b7-cc3cd27b89aa-original-pull-secret\") pod \"global-pull-secret-syncer-g8xw8\" (UID: \"14b4e9c6-79e5-4c10-96b7-cc3cd27b89aa\") " pod="kube-system/global-pull-secret-syncer-g8xw8" Jun 03 13:54:08.578686 ip-10-0-134-229 kubenswrapper[2574]: E0603 13:54:08.578634 2574 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jun 03 13:54:08.578735 ip-10-0-134-229 kubenswrapper[2574]: E0603 13:54:08.578709 2574 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/14b4e9c6-79e5-4c10-96b7-cc3cd27b89aa-original-pull-secret podName:14b4e9c6-79e5-4c10-96b7-cc3cd27b89aa nodeName:}" failed. No retries permitted until 2026-06-03 13:54:10.578689802 +0000 UTC m=+11.762697121 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/14b4e9c6-79e5-4c10-96b7-cc3cd27b89aa-original-pull-secret") pod "global-pull-secret-syncer-g8xw8" (UID: "14b4e9c6-79e5-4c10-96b7-cc3cd27b89aa") : object "kube-system"/"original-pull-secret" not registered Jun 03 13:54:08.982013 ip-10-0-134-229 kubenswrapper[2574]: I0603 13:54:08.981974 2574 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/6f47d39b-6eb0-4d5f-921b-0d56c194113e-metrics-certs\") pod \"network-metrics-daemon-9f7k7\" (UID: \"6f47d39b-6eb0-4d5f-921b-0d56c194113e\") " pod="openshift-multus/network-metrics-daemon-9f7k7" Jun 03 13:54:08.982185 ip-10-0-134-229 kubenswrapper[2574]: E0603 13:54:08.982115 2574 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jun 03 13:54:08.982247 ip-10-0-134-229 kubenswrapper[2574]: E0603 13:54:08.982197 2574 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/6f47d39b-6eb0-4d5f-921b-0d56c194113e-metrics-certs podName:6f47d39b-6eb0-4d5f-921b-0d56c194113e nodeName:}" failed. No retries permitted until 2026-06-03 13:54:16.982176409 +0000 UTC m=+18.166183732 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/6f47d39b-6eb0-4d5f-921b-0d56c194113e-metrics-certs") pod "network-metrics-daemon-9f7k7" (UID: "6f47d39b-6eb0-4d5f-921b-0d56c194113e") : object "openshift-multus"/"metrics-daemon-secret" not registered Jun 03 13:54:09.082333 ip-10-0-134-229 kubenswrapper[2574]: I0603 13:54:09.082296 2574 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-qwqz4\" (UniqueName: \"kubernetes.io/projected/1422bf53-dc3d-42c1-9a1f-8657ec8777f4-kube-api-access-qwqz4\") pod \"network-check-target-vpjf9\" (UID: \"1422bf53-dc3d-42c1-9a1f-8657ec8777f4\") " pod="openshift-network-diagnostics/network-check-target-vpjf9" Jun 03 13:54:09.082524 ip-10-0-134-229 kubenswrapper[2574]: E0603 13:54:09.082472 2574 projected.go:289] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jun 03 13:54:09.082524 ip-10-0-134-229 kubenswrapper[2574]: E0603 13:54:09.082497 2574 projected.go:289] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jun 03 13:54:09.082524 ip-10-0-134-229 kubenswrapper[2574]: E0603 13:54:09.082510 2574 projected.go:194] Error preparing data for projected volume kube-api-access-qwqz4 for pod openshift-network-diagnostics/network-check-target-vpjf9: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 03 13:54:09.082680 ip-10-0-134-229 kubenswrapper[2574]: E0603 13:54:09.082568 2574 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/1422bf53-dc3d-42c1-9a1f-8657ec8777f4-kube-api-access-qwqz4 podName:1422bf53-dc3d-42c1-9a1f-8657ec8777f4 nodeName:}" failed. No retries permitted until 2026-06-03 13:54:17.082551346 +0000 UTC m=+18.266558674 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "kube-api-access-qwqz4" (UniqueName: "kubernetes.io/projected/1422bf53-dc3d-42c1-9a1f-8657ec8777f4-kube-api-access-qwqz4") pod "network-check-target-vpjf9" (UID: "1422bf53-dc3d-42c1-9a1f-8657ec8777f4") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 03 13:54:09.430145 ip-10-0-134-229 kubenswrapper[2574]: I0603 13:54:09.430070 2574 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-9f7k7" Jun 03 13:54:09.430590 ip-10-0-134-229 kubenswrapper[2574]: E0603 13:54:09.430198 2574 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-9f7k7" podUID="6f47d39b-6eb0-4d5f-921b-0d56c194113e" Jun 03 13:54:09.430590 ip-10-0-134-229 kubenswrapper[2574]: I0603 13:54:09.430242 2574 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-vpjf9" Jun 03 13:54:09.430590 ip-10-0-134-229 kubenswrapper[2574]: E0603 13:54:09.430312 2574 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-vpjf9" podUID="1422bf53-dc3d-42c1-9a1f-8657ec8777f4" Jun 03 13:54:10.427330 ip-10-0-134-229 kubenswrapper[2574]: I0603 13:54:10.427299 2574 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-g8xw8" Jun 03 13:54:10.427614 ip-10-0-134-229 kubenswrapper[2574]: E0603 13:54:10.427441 2574 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-g8xw8" podUID="14b4e9c6-79e5-4c10-96b7-cc3cd27b89aa" Jun 03 13:54:10.594342 ip-10-0-134-229 kubenswrapper[2574]: I0603 13:54:10.594305 2574 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/14b4e9c6-79e5-4c10-96b7-cc3cd27b89aa-original-pull-secret\") pod \"global-pull-secret-syncer-g8xw8\" (UID: \"14b4e9c6-79e5-4c10-96b7-cc3cd27b89aa\") " pod="kube-system/global-pull-secret-syncer-g8xw8" Jun 03 13:54:10.594755 ip-10-0-134-229 kubenswrapper[2574]: E0603 13:54:10.594431 2574 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jun 03 13:54:10.594755 ip-10-0-134-229 kubenswrapper[2574]: E0603 13:54:10.594505 2574 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/14b4e9c6-79e5-4c10-96b7-cc3cd27b89aa-original-pull-secret podName:14b4e9c6-79e5-4c10-96b7-cc3cd27b89aa nodeName:}" failed. No retries permitted until 2026-06-03 13:54:14.594487234 +0000 UTC m=+15.778494556 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/14b4e9c6-79e5-4c10-96b7-cc3cd27b89aa-original-pull-secret") pod "global-pull-secret-syncer-g8xw8" (UID: "14b4e9c6-79e5-4c10-96b7-cc3cd27b89aa") : object "kube-system"/"original-pull-secret" not registered Jun 03 13:54:11.430181 ip-10-0-134-229 kubenswrapper[2574]: I0603 13:54:11.430151 2574 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-9f7k7" Jun 03 13:54:11.430359 ip-10-0-134-229 kubenswrapper[2574]: I0603 13:54:11.430151 2574 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-vpjf9" Jun 03 13:54:11.430359 ip-10-0-134-229 kubenswrapper[2574]: E0603 13:54:11.430271 2574 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-9f7k7" podUID="6f47d39b-6eb0-4d5f-921b-0d56c194113e" Jun 03 13:54:11.430359 ip-10-0-134-229 kubenswrapper[2574]: E0603 13:54:11.430333 2574 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-vpjf9" podUID="1422bf53-dc3d-42c1-9a1f-8657ec8777f4" Jun 03 13:54:12.426971 ip-10-0-134-229 kubenswrapper[2574]: I0603 13:54:12.426938 2574 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-g8xw8" Jun 03 13:54:12.427404 ip-10-0-134-229 kubenswrapper[2574]: E0603 13:54:12.427039 2574 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-g8xw8" podUID="14b4e9c6-79e5-4c10-96b7-cc3cd27b89aa" Jun 03 13:54:13.430024 ip-10-0-134-229 kubenswrapper[2574]: I0603 13:54:13.429994 2574 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-9f7k7" Jun 03 13:54:13.430569 ip-10-0-134-229 kubenswrapper[2574]: I0603 13:54:13.429993 2574 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-vpjf9" Jun 03 13:54:13.430569 ip-10-0-134-229 kubenswrapper[2574]: E0603 13:54:13.430099 2574 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-9f7k7" podUID="6f47d39b-6eb0-4d5f-921b-0d56c194113e" Jun 03 13:54:13.430569 ip-10-0-134-229 kubenswrapper[2574]: E0603 13:54:13.430170 2574 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-vpjf9" podUID="1422bf53-dc3d-42c1-9a1f-8657ec8777f4" Jun 03 13:54:14.426820 ip-10-0-134-229 kubenswrapper[2574]: I0603 13:54:14.426786 2574 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-g8xw8" Jun 03 13:54:14.427008 ip-10-0-134-229 kubenswrapper[2574]: E0603 13:54:14.426908 2574 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-g8xw8" podUID="14b4e9c6-79e5-4c10-96b7-cc3cd27b89aa" Jun 03 13:54:14.626144 ip-10-0-134-229 kubenswrapper[2574]: I0603 13:54:14.626106 2574 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/14b4e9c6-79e5-4c10-96b7-cc3cd27b89aa-original-pull-secret\") pod \"global-pull-secret-syncer-g8xw8\" (UID: \"14b4e9c6-79e5-4c10-96b7-cc3cd27b89aa\") " pod="kube-system/global-pull-secret-syncer-g8xw8" Jun 03 13:54:14.626583 ip-10-0-134-229 kubenswrapper[2574]: E0603 13:54:14.626266 2574 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jun 03 13:54:14.626583 ip-10-0-134-229 kubenswrapper[2574]: E0603 13:54:14.626330 2574 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/14b4e9c6-79e5-4c10-96b7-cc3cd27b89aa-original-pull-secret podName:14b4e9c6-79e5-4c10-96b7-cc3cd27b89aa nodeName:}" failed. No retries permitted until 2026-06-03 13:54:22.626316349 +0000 UTC m=+23.810323656 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/14b4e9c6-79e5-4c10-96b7-cc3cd27b89aa-original-pull-secret") pod "global-pull-secret-syncer-g8xw8" (UID: "14b4e9c6-79e5-4c10-96b7-cc3cd27b89aa") : object "kube-system"/"original-pull-secret" not registered Jun 03 13:54:15.426684 ip-10-0-134-229 kubenswrapper[2574]: I0603 13:54:15.426589 2574 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-vpjf9" Jun 03 13:54:15.426845 ip-10-0-134-229 kubenswrapper[2574]: E0603 13:54:15.426723 2574 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-vpjf9" podUID="1422bf53-dc3d-42c1-9a1f-8657ec8777f4" Jun 03 13:54:15.427099 ip-10-0-134-229 kubenswrapper[2574]: I0603 13:54:15.426979 2574 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-9f7k7" Jun 03 13:54:15.427193 ip-10-0-134-229 kubenswrapper[2574]: E0603 13:54:15.427131 2574 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-9f7k7" podUID="6f47d39b-6eb0-4d5f-921b-0d56c194113e" Jun 03 13:54:16.426529 ip-10-0-134-229 kubenswrapper[2574]: I0603 13:54:16.426500 2574 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-g8xw8" Jun 03 13:54:16.426947 ip-10-0-134-229 kubenswrapper[2574]: E0603 13:54:16.426645 2574 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-g8xw8" podUID="14b4e9c6-79e5-4c10-96b7-cc3cd27b89aa" Jun 03 13:54:17.046385 ip-10-0-134-229 kubenswrapper[2574]: I0603 13:54:17.046334 2574 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/6f47d39b-6eb0-4d5f-921b-0d56c194113e-metrics-certs\") pod \"network-metrics-daemon-9f7k7\" (UID: \"6f47d39b-6eb0-4d5f-921b-0d56c194113e\") " pod="openshift-multus/network-metrics-daemon-9f7k7" Jun 03 13:54:17.046619 ip-10-0-134-229 kubenswrapper[2574]: E0603 13:54:17.046508 2574 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jun 03 13:54:17.046619 ip-10-0-134-229 kubenswrapper[2574]: E0603 13:54:17.046583 2574 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/6f47d39b-6eb0-4d5f-921b-0d56c194113e-metrics-certs podName:6f47d39b-6eb0-4d5f-921b-0d56c194113e nodeName:}" failed. No retries permitted until 2026-06-03 13:54:33.046563476 +0000 UTC m=+34.230570802 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/6f47d39b-6eb0-4d5f-921b-0d56c194113e-metrics-certs") pod "network-metrics-daemon-9f7k7" (UID: "6f47d39b-6eb0-4d5f-921b-0d56c194113e") : object "openshift-multus"/"metrics-daemon-secret" not registered Jun 03 13:54:17.147706 ip-10-0-134-229 kubenswrapper[2574]: I0603 13:54:17.147676 2574 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-qwqz4\" (UniqueName: \"kubernetes.io/projected/1422bf53-dc3d-42c1-9a1f-8657ec8777f4-kube-api-access-qwqz4\") pod \"network-check-target-vpjf9\" (UID: \"1422bf53-dc3d-42c1-9a1f-8657ec8777f4\") " pod="openshift-network-diagnostics/network-check-target-vpjf9" Jun 03 13:54:17.147896 ip-10-0-134-229 kubenswrapper[2574]: E0603 13:54:17.147844 2574 projected.go:289] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jun 03 13:54:17.147896 ip-10-0-134-229 kubenswrapper[2574]: E0603 13:54:17.147868 2574 projected.go:289] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jun 03 13:54:17.147896 ip-10-0-134-229 kubenswrapper[2574]: E0603 13:54:17.147879 2574 projected.go:194] Error preparing data for projected volume kube-api-access-qwqz4 for pod openshift-network-diagnostics/network-check-target-vpjf9: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 03 13:54:17.148029 ip-10-0-134-229 kubenswrapper[2574]: E0603 13:54:17.147934 2574 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/1422bf53-dc3d-42c1-9a1f-8657ec8777f4-kube-api-access-qwqz4 podName:1422bf53-dc3d-42c1-9a1f-8657ec8777f4 nodeName:}" failed. No retries permitted until 2026-06-03 13:54:33.147914893 +0000 UTC m=+34.331922199 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "kube-api-access-qwqz4" (UniqueName: "kubernetes.io/projected/1422bf53-dc3d-42c1-9a1f-8657ec8777f4-kube-api-access-qwqz4") pod "network-check-target-vpjf9" (UID: "1422bf53-dc3d-42c1-9a1f-8657ec8777f4") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 03 13:54:17.427007 ip-10-0-134-229 kubenswrapper[2574]: I0603 13:54:17.426970 2574 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-vpjf9" Jun 03 13:54:17.427641 ip-10-0-134-229 kubenswrapper[2574]: I0603 13:54:17.426989 2574 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-9f7k7" Jun 03 13:54:17.427641 ip-10-0-134-229 kubenswrapper[2574]: E0603 13:54:17.427111 2574 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-vpjf9" podUID="1422bf53-dc3d-42c1-9a1f-8657ec8777f4" Jun 03 13:54:17.427641 ip-10-0-134-229 kubenswrapper[2574]: E0603 13:54:17.427236 2574 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-9f7k7" podUID="6f47d39b-6eb0-4d5f-921b-0d56c194113e" Jun 03 13:54:18.427091 ip-10-0-134-229 kubenswrapper[2574]: I0603 13:54:18.427057 2574 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-g8xw8" Jun 03 13:54:18.427585 ip-10-0-134-229 kubenswrapper[2574]: E0603 13:54:18.427171 2574 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-g8xw8" podUID="14b4e9c6-79e5-4c10-96b7-cc3cd27b89aa" Jun 03 13:54:19.427581 ip-10-0-134-229 kubenswrapper[2574]: I0603 13:54:19.427547 2574 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-vpjf9" Jun 03 13:54:19.427926 ip-10-0-134-229 kubenswrapper[2574]: E0603 13:54:19.427653 2574 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-vpjf9" podUID="1422bf53-dc3d-42c1-9a1f-8657ec8777f4" Jun 03 13:54:19.427926 ip-10-0-134-229 kubenswrapper[2574]: I0603 13:54:19.427700 2574 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-9f7k7" Jun 03 13:54:19.427926 ip-10-0-134-229 kubenswrapper[2574]: E0603 13:54:19.427780 2574 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-9f7k7" podUID="6f47d39b-6eb0-4d5f-921b-0d56c194113e" Jun 03 13:54:20.427836 ip-10-0-134-229 kubenswrapper[2574]: I0603 13:54:20.427495 2574 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-g8xw8" Jun 03 13:54:20.428556 ip-10-0-134-229 kubenswrapper[2574]: E0603 13:54:20.427918 2574 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-g8xw8" podUID="14b4e9c6-79e5-4c10-96b7-cc3cd27b89aa" Jun 03 13:54:20.588774 ip-10-0-134-229 kubenswrapper[2574]: I0603 13:54:20.588728 2574 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-node-tuning-operator/tuned-l2f2s" event={"ID":"963383f0-b900-46cb-81f8-4e92934bb58e","Type":"ContainerStarted","Data":"aa3124dd2aa1640e4e55d7133353e138023fc5545aba457812edfdd110fc5e8c"} Jun 03 13:54:20.590127 ip-10-0-134-229 kubenswrapper[2574]: I0603 13:54:20.590090 2574 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-dns/node-resolver-pc2nh" event={"ID":"aaa611e0-e507-419d-8a90-f692f2d26ee5","Type":"ContainerStarted","Data":"ac523cd85fc87407e80193c31a1f0e301f345e900a8fcec109a6f3c0b6bc67b3"} Jun 03 13:54:20.591244 ip-10-0-134-229 kubenswrapper[2574]: I0603 13:54:20.591223 2574 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-zhqfp" event={"ID":"92d4e3fb-b640-4739-bf3a-6bf0ee60d517","Type":"ContainerStarted","Data":"d758263e814e928d3eae19d73314a37790bb3050bd5e805c0e15a424477099f2"} Jun 03 13:54:20.593862 ip-10-0-134-229 kubenswrapper[2574]: I0603 13:54:20.593813 2574 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-kfq8c" event={"ID":"f88ee55a-f56d-41d1-9216-18124b7f55f3","Type":"ContainerStarted","Data":"0f77eea8931ee07a98b6c986bb8294780851e6a7fc6c646831a8230907b83abe"} Jun 03 13:54:20.593862 ip-10-0-134-229 kubenswrapper[2574]: I0603 13:54:20.593836 2574 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-kfq8c" event={"ID":"f88ee55a-f56d-41d1-9216-18124b7f55f3","Type":"ContainerStarted","Data":"f6a780764e29f2363f9696efceb3858437712b687868683b81632204df926c7e"} Jun 03 13:54:20.593862 ip-10-0-134-229 kubenswrapper[2574]: I0603 13:54:20.593844 2574 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-kfq8c" event={"ID":"f88ee55a-f56d-41d1-9216-18124b7f55f3","Type":"ContainerStarted","Data":"4ef019192ca1eb1bf7e04566882034b76ba962f5a91af08a75d4657c8211c550"} Jun 03 13:54:20.593862 ip-10-0-134-229 kubenswrapper[2574]: I0603 13:54:20.593854 2574 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-kfq8c" event={"ID":"f88ee55a-f56d-41d1-9216-18124b7f55f3","Type":"ContainerStarted","Data":"eae9b282f2884dcd6dc583966d7b1aa5d91d0cccf75dd3b230f0e4b21423ce8a"} Jun 03 13:54:20.594070 ip-10-0-134-229 kubenswrapper[2574]: I0603 13:54:20.593863 2574 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-kfq8c" event={"ID":"f88ee55a-f56d-41d1-9216-18124b7f55f3","Type":"ContainerStarted","Data":"6c20213234c9b31ed948be51a960fb6ef4a2825c03c47e2654cb0951bf5f9908"} Jun 03 13:54:20.594070 ip-10-0-134-229 kubenswrapper[2574]: I0603 13:54:20.593876 2574 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-kfq8c" event={"ID":"f88ee55a-f56d-41d1-9216-18124b7f55f3","Type":"ContainerStarted","Data":"fd26f9622a2080865a8d5967bfa8ee42b629deff5a587753f9db76f7e7053e73"} Jun 03 13:54:20.595001 ip-10-0-134-229 kubenswrapper[2574]: I0603 13:54:20.594983 2574 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-jkcw2" event={"ID":"9ccfb5b8-aff0-4122-a190-c406b390bdae","Type":"ContainerStarted","Data":"8a31483b33dc238a34fcc769ce0d09b215ebf7aa9630b70523b2fab8dda50623"} Jun 03 13:54:20.596125 ip-10-0-134-229 kubenswrapper[2574]: I0603 13:54:20.596106 2574 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kube-system/konnectivity-agent-5mz8g" event={"ID":"8c5a5cc8-abff-454b-8b7c-6e4064a2c8c0","Type":"ContainerStarted","Data":"7bbed7589eb37d85439797fdc2d8a76ca7efca64a8067344ce3e2089c165d65a"} Jun 03 13:54:20.597503 ip-10-0-134-229 kubenswrapper[2574]: I0603 13:54:20.597480 2574 generic.go:358] "Generic (PLEG): container finished" podID="77b2aeec-d4be-45f6-b355-4030387080ad" containerID="6433821f6a97200c847360dede50b943fa773df6e57cffd31b38687d222bab95" exitCode=0 Jun 03 13:54:20.597586 ip-10-0-134-229 kubenswrapper[2574]: I0603 13:54:20.597554 2574 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-v264j" event={"ID":"77b2aeec-d4be-45f6-b355-4030387080ad","Type":"ContainerDied","Data":"6433821f6a97200c847360dede50b943fa773df6e57cffd31b38687d222bab95"} Jun 03 13:54:20.598830 ip-10-0-134-229 kubenswrapper[2574]: I0603 13:54:20.598789 2574 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/node-ca-7ql52" event={"ID":"5e68f084-d02c-4757-9842-1c01178fcfcb","Type":"ContainerStarted","Data":"91498379e7a7e2dcb2d6d0cf324509f87fc7cbbaccddddd08983f8c740658982"} Jun 03 13:54:20.607994 ip-10-0-134-229 kubenswrapper[2574]: I0603 13:54:20.607953 2574 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-cluster-node-tuning-operator/tuned-l2f2s" podStartSLOduration=4.011019768 podStartE2EDuration="21.607943727s" podCreationTimestamp="2026-06-03 13:53:59 +0000 UTC" firstStartedPulling="2026-06-03 13:54:01.94269344 +0000 UTC m=+3.126700750" lastFinishedPulling="2026-06-03 13:54:19.539617384 +0000 UTC m=+20.723624709" observedRunningTime="2026-06-03 13:54:20.607892935 +0000 UTC m=+21.791900267" watchObservedRunningTime="2026-06-03 13:54:20.607943727 +0000 UTC m=+21.791951055" Jun 03 13:54:20.628180 ip-10-0-134-229 kubenswrapper[2574]: I0603 13:54:20.628152 2574 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-multus/multus-jkcw2" podStartSLOduration=3.983556698 podStartE2EDuration="21.628141514s" podCreationTimestamp="2026-06-03 13:53:59 +0000 UTC" firstStartedPulling="2026-06-03 13:54:01.935013924 +0000 UTC m=+3.119021249" lastFinishedPulling="2026-06-03 13:54:19.579598744 +0000 UTC m=+20.763606065" observedRunningTime="2026-06-03 13:54:20.62775902 +0000 UTC m=+21.811766350" watchObservedRunningTime="2026-06-03 13:54:20.628141514 +0000 UTC m=+21.812148843" Jun 03 13:54:20.646849 ip-10-0-134-229 kubenswrapper[2574]: I0603 13:54:20.646811 2574 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-dns/node-resolver-pc2nh" podStartSLOduration=4.004735815 podStartE2EDuration="21.646800377s" podCreationTimestamp="2026-06-03 13:53:59 +0000 UTC" firstStartedPulling="2026-06-03 13:54:01.93583446 +0000 UTC m=+3.119841774" lastFinishedPulling="2026-06-03 13:54:19.577899025 +0000 UTC m=+20.761906336" observedRunningTime="2026-06-03 13:54:20.64652398 +0000 UTC m=+21.830531303" watchObservedRunningTime="2026-06-03 13:54:20.646800377 +0000 UTC m=+21.830807707" Jun 03 13:54:20.662667 ip-10-0-134-229 kubenswrapper[2574]: I0603 13:54:20.662632 2574 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="kube-system/konnectivity-agent-5mz8g" podStartSLOduration=4.069642805 podStartE2EDuration="21.662621946s" podCreationTimestamp="2026-06-03 13:53:59 +0000 UTC" firstStartedPulling="2026-06-03 13:54:01.946705788 +0000 UTC m=+3.130713104" lastFinishedPulling="2026-06-03 13:54:19.539684933 +0000 UTC m=+20.723692245" observedRunningTime="2026-06-03 13:54:20.662536929 +0000 UTC m=+21.846544257" watchObservedRunningTime="2026-06-03 13:54:20.662621946 +0000 UTC m=+21.846629274" Jun 03 13:54:20.702491 ip-10-0-134-229 kubenswrapper[2574]: I0603 13:54:20.702344 2574 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-image-registry/node-ca-7ql52" podStartSLOduration=8.52275014 podStartE2EDuration="21.702327969s" podCreationTimestamp="2026-06-03 13:53:59 +0000 UTC" firstStartedPulling="2026-06-03 13:54:01.945274499 +0000 UTC m=+3.129281809" lastFinishedPulling="2026-06-03 13:54:15.124852325 +0000 UTC m=+16.308859638" observedRunningTime="2026-06-03 13:54:20.702202299 +0000 UTC m=+21.886209629" watchObservedRunningTime="2026-06-03 13:54:20.702327969 +0000 UTC m=+21.886335299" Jun 03 13:54:20.707521 ip-10-0-134-229 kubenswrapper[2574]: I0603 13:54:20.707496 2574 plugin_watcher.go:194] "Adding socket path or updating timestamp to desired state cache" path="/var/lib/kubelet/plugins_registry/ebs.csi.aws.com-reg.sock" Jun 03 13:54:21.199174 ip-10-0-134-229 kubenswrapper[2574]: I0603 13:54:21.198894 2574 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="kube-system/konnectivity-agent-5mz8g" Jun 03 13:54:21.199581 ip-10-0-134-229 kubenswrapper[2574]: I0603 13:54:21.199566 2574 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="started" pod="kube-system/konnectivity-agent-5mz8g" Jun 03 13:54:21.375616 ip-10-0-134-229 kubenswrapper[2574]: I0603 13:54:21.375509 2574 reconciler.go:161] "OperationExecutor.RegisterPlugin started" plugin={"SocketPath":"/var/lib/kubelet/plugins_registry/ebs.csi.aws.com-reg.sock","Timestamp":"2026-06-03T13:54:20.707520397Z","UUID":"4832ae3f-9b1a-473c-b6a4-360d57ca71da","Handler":null,"Name":"","Endpoint":""} Jun 03 13:54:21.378201 ip-10-0-134-229 kubenswrapper[2574]: I0603 13:54:21.378173 2574 csi_plugin.go:106] kubernetes.io/csi: Trying to validate a new CSI Driver with name: ebs.csi.aws.com endpoint: /var/lib/kubelet/plugins/ebs.csi.aws.com/csi.sock versions: 1.0.0 Jun 03 13:54:21.378321 ip-10-0-134-229 kubenswrapper[2574]: I0603 13:54:21.378211 2574 csi_plugin.go:119] kubernetes.io/csi: Register new plugin with name: ebs.csi.aws.com at endpoint: /var/lib/kubelet/plugins/ebs.csi.aws.com/csi.sock Jun 03 13:54:21.427483 ip-10-0-134-229 kubenswrapper[2574]: I0603 13:54:21.427451 2574 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-vpjf9" Jun 03 13:54:21.427633 ip-10-0-134-229 kubenswrapper[2574]: I0603 13:54:21.427495 2574 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-9f7k7" Jun 03 13:54:21.427633 ip-10-0-134-229 kubenswrapper[2574]: E0603 13:54:21.427572 2574 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-vpjf9" podUID="1422bf53-dc3d-42c1-9a1f-8657ec8777f4" Jun 03 13:54:21.427757 ip-10-0-134-229 kubenswrapper[2574]: E0603 13:54:21.427664 2574 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-9f7k7" podUID="6f47d39b-6eb0-4d5f-921b-0d56c194113e" Jun 03 13:54:21.602840 ip-10-0-134-229 kubenswrapper[2574]: I0603 13:54:21.602801 2574 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-zhqfp" event={"ID":"92d4e3fb-b640-4739-bf3a-6bf0ee60d517","Type":"ContainerStarted","Data":"2e492fb31f8fcf42a763a742b38ad2f886729f4aa980831fa6521c0a16c74c9c"} Jun 03 13:54:21.605341 ip-10-0-134-229 kubenswrapper[2574]: I0603 13:54:21.605317 2574 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-network-operator/iptables-alerter-ft4ch" event={"ID":"e868100e-e4c6-48f1-b00c-ae9c32f7de33","Type":"ContainerStarted","Data":"2b1d8c80b35af4e10f222cd4878975e8a45e2c6ef100d50f6ef5f83803737c62"} Jun 03 13:54:21.605714 ip-10-0-134-229 kubenswrapper[2574]: I0603 13:54:21.605695 2574 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kube-system/konnectivity-agent-5mz8g" Jun 03 13:54:21.605857 ip-10-0-134-229 kubenswrapper[2574]: I0603 13:54:21.605746 2574 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="kube-system/konnectivity-agent-5mz8g" Jun 03 13:54:22.426536 ip-10-0-134-229 kubenswrapper[2574]: I0603 13:54:22.426468 2574 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-g8xw8" Jun 03 13:54:22.426683 ip-10-0-134-229 kubenswrapper[2574]: E0603 13:54:22.426584 2574 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-g8xw8" podUID="14b4e9c6-79e5-4c10-96b7-cc3cd27b89aa" Jun 03 13:54:22.608071 ip-10-0-134-229 kubenswrapper[2574]: I0603 13:54:22.608034 2574 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-zhqfp" event={"ID":"92d4e3fb-b640-4739-bf3a-6bf0ee60d517","Type":"ContainerStarted","Data":"ce6cf67039fc12451c7d4d8928eb9a1eddd3d37fbc5d2b531d8867d0bb667812"} Jun 03 13:54:22.610689 ip-10-0-134-229 kubenswrapper[2574]: I0603 13:54:22.610662 2574 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-kfq8c" event={"ID":"f88ee55a-f56d-41d1-9216-18124b7f55f3","Type":"ContainerStarted","Data":"68f338e4492432363b2d255aa2dad2756339c5117a97a0371a691bf96d0035ca"} Jun 03 13:54:22.628663 ip-10-0-134-229 kubenswrapper[2574]: I0603 13:54:22.626604 2574 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-zhqfp" podStartSLOduration=4.008725282 podStartE2EDuration="23.626587895s" podCreationTimestamp="2026-06-03 13:53:59 +0000 UTC" firstStartedPulling="2026-06-03 13:54:01.941432318 +0000 UTC m=+3.125439627" lastFinishedPulling="2026-06-03 13:54:21.559294933 +0000 UTC m=+22.743302240" observedRunningTime="2026-06-03 13:54:22.626470593 +0000 UTC m=+23.810477917" watchObservedRunningTime="2026-06-03 13:54:22.626587895 +0000 UTC m=+23.810595224" Jun 03 13:54:22.628663 ip-10-0-134-229 kubenswrapper[2574]: I0603 13:54:22.627649 2574 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-network-operator/iptables-alerter-ft4ch" podStartSLOduration=6.032181363 podStartE2EDuration="23.627634697s" podCreationTimestamp="2026-06-03 13:53:59 +0000 UTC" firstStartedPulling="2026-06-03 13:54:01.943902831 +0000 UTC m=+3.127910151" lastFinishedPulling="2026-06-03 13:54:19.539356178 +0000 UTC m=+20.723363485" observedRunningTime="2026-06-03 13:54:21.635403957 +0000 UTC m=+22.819411286" watchObservedRunningTime="2026-06-03 13:54:22.627634697 +0000 UTC m=+23.811642027" Jun 03 13:54:22.689087 ip-10-0-134-229 kubenswrapper[2574]: I0603 13:54:22.689021 2574 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/14b4e9c6-79e5-4c10-96b7-cc3cd27b89aa-original-pull-secret\") pod \"global-pull-secret-syncer-g8xw8\" (UID: \"14b4e9c6-79e5-4c10-96b7-cc3cd27b89aa\") " pod="kube-system/global-pull-secret-syncer-g8xw8" Jun 03 13:54:22.689214 ip-10-0-134-229 kubenswrapper[2574]: E0603 13:54:22.689181 2574 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jun 03 13:54:22.689368 ip-10-0-134-229 kubenswrapper[2574]: E0603 13:54:22.689351 2574 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/14b4e9c6-79e5-4c10-96b7-cc3cd27b89aa-original-pull-secret podName:14b4e9c6-79e5-4c10-96b7-cc3cd27b89aa nodeName:}" failed. No retries permitted until 2026-06-03 13:54:38.689333309 +0000 UTC m=+39.873340628 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/14b4e9c6-79e5-4c10-96b7-cc3cd27b89aa-original-pull-secret") pod "global-pull-secret-syncer-g8xw8" (UID: "14b4e9c6-79e5-4c10-96b7-cc3cd27b89aa") : object "kube-system"/"original-pull-secret" not registered Jun 03 13:54:23.426499 ip-10-0-134-229 kubenswrapper[2574]: I0603 13:54:23.426461 2574 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-vpjf9" Jun 03 13:54:23.426682 ip-10-0-134-229 kubenswrapper[2574]: I0603 13:54:23.426461 2574 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-9f7k7" Jun 03 13:54:23.426682 ip-10-0-134-229 kubenswrapper[2574]: E0603 13:54:23.426574 2574 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-vpjf9" podUID="1422bf53-dc3d-42c1-9a1f-8657ec8777f4" Jun 03 13:54:23.426789 ip-10-0-134-229 kubenswrapper[2574]: E0603 13:54:23.426695 2574 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-9f7k7" podUID="6f47d39b-6eb0-4d5f-921b-0d56c194113e" Jun 03 13:54:24.426748 ip-10-0-134-229 kubenswrapper[2574]: I0603 13:54:24.426715 2574 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-g8xw8" Jun 03 13:54:24.427311 ip-10-0-134-229 kubenswrapper[2574]: E0603 13:54:24.426823 2574 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-g8xw8" podUID="14b4e9c6-79e5-4c10-96b7-cc3cd27b89aa" Jun 03 13:54:25.427488 ip-10-0-134-229 kubenswrapper[2574]: I0603 13:54:25.427451 2574 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-vpjf9" Jun 03 13:54:25.427488 ip-10-0-134-229 kubenswrapper[2574]: I0603 13:54:25.427478 2574 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-9f7k7" Jun 03 13:54:25.427870 ip-10-0-134-229 kubenswrapper[2574]: E0603 13:54:25.427569 2574 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-vpjf9" podUID="1422bf53-dc3d-42c1-9a1f-8657ec8777f4" Jun 03 13:54:25.427870 ip-10-0-134-229 kubenswrapper[2574]: E0603 13:54:25.427694 2574 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-9f7k7" podUID="6f47d39b-6eb0-4d5f-921b-0d56c194113e" Jun 03 13:54:25.619055 ip-10-0-134-229 kubenswrapper[2574]: I0603 13:54:25.618881 2574 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-kfq8c" event={"ID":"f88ee55a-f56d-41d1-9216-18124b7f55f3","Type":"ContainerStarted","Data":"b9335ca91f84cee6c64ca7f1a9a4b475953376377d6ccc0638ddd2b2c7920ded"} Jun 03 13:54:25.619165 ip-10-0-134-229 kubenswrapper[2574]: I0603 13:54:25.619148 2574 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-kfq8c" Jun 03 13:54:25.619216 ip-10-0-134-229 kubenswrapper[2574]: I0603 13:54:25.619178 2574 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-kfq8c" Jun 03 13:54:25.634004 ip-10-0-134-229 kubenswrapper[2574]: I0603 13:54:25.633984 2574 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-kfq8c" Jun 03 13:54:25.645536 ip-10-0-134-229 kubenswrapper[2574]: I0603 13:54:25.645498 2574 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-ovn-kubernetes/ovnkube-node-kfq8c" podStartSLOduration=8.953504617 podStartE2EDuration="26.645486848s" podCreationTimestamp="2026-06-03 13:53:59 +0000 UTC" firstStartedPulling="2026-06-03 13:54:01.941606708 +0000 UTC m=+3.125614015" lastFinishedPulling="2026-06-03 13:54:19.633588938 +0000 UTC m=+20.817596246" observedRunningTime="2026-06-03 13:54:25.644922381 +0000 UTC m=+26.828929709" watchObservedRunningTime="2026-06-03 13:54:25.645486848 +0000 UTC m=+26.829494177" Jun 03 13:54:26.426838 ip-10-0-134-229 kubenswrapper[2574]: I0603 13:54:26.426811 2574 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-g8xw8" Jun 03 13:54:26.426986 ip-10-0-134-229 kubenswrapper[2574]: E0603 13:54:26.426900 2574 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-g8xw8" podUID="14b4e9c6-79e5-4c10-96b7-cc3cd27b89aa" Jun 03 13:54:26.622008 ip-10-0-134-229 kubenswrapper[2574]: I0603 13:54:26.621975 2574 generic.go:358] "Generic (PLEG): container finished" podID="77b2aeec-d4be-45f6-b355-4030387080ad" containerID="489ba411c3e0c84b8383cdb970bddf305d99fcfc1b128b0ebc34953ea91044ff" exitCode=0 Jun 03 13:54:26.622472 ip-10-0-134-229 kubenswrapper[2574]: I0603 13:54:26.622069 2574 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-v264j" event={"ID":"77b2aeec-d4be-45f6-b355-4030387080ad","Type":"ContainerDied","Data":"489ba411c3e0c84b8383cdb970bddf305d99fcfc1b128b0ebc34953ea91044ff"} Jun 03 13:54:26.623221 ip-10-0-134-229 kubenswrapper[2574]: I0603 13:54:26.622707 2574 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-kfq8c" Jun 03 13:54:26.638098 ip-10-0-134-229 kubenswrapper[2574]: I0603 13:54:26.638079 2574 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-kfq8c" Jun 03 13:54:27.427463 ip-10-0-134-229 kubenswrapper[2574]: I0603 13:54:27.427431 2574 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-vpjf9" Jun 03 13:54:27.427622 ip-10-0-134-229 kubenswrapper[2574]: I0603 13:54:27.427442 2574 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-9f7k7" Jun 03 13:54:27.427622 ip-10-0-134-229 kubenswrapper[2574]: E0603 13:54:27.427515 2574 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-vpjf9" podUID="1422bf53-dc3d-42c1-9a1f-8657ec8777f4" Jun 03 13:54:27.427622 ip-10-0-134-229 kubenswrapper[2574]: E0603 13:54:27.427592 2574 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-9f7k7" podUID="6f47d39b-6eb0-4d5f-921b-0d56c194113e" Jun 03 13:54:27.499873 ip-10-0-134-229 kubenswrapper[2574]: I0603 13:54:27.499364 2574 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kube-system/global-pull-secret-syncer-g8xw8"] Jun 03 13:54:27.499873 ip-10-0-134-229 kubenswrapper[2574]: I0603 13:54:27.499476 2574 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-g8xw8" Jun 03 13:54:27.499873 ip-10-0-134-229 kubenswrapper[2574]: E0603 13:54:27.499604 2574 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-g8xw8" podUID="14b4e9c6-79e5-4c10-96b7-cc3cd27b89aa" Jun 03 13:54:27.501355 ip-10-0-134-229 kubenswrapper[2574]: I0603 13:54:27.501307 2574 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-target-vpjf9"] Jun 03 13:54:27.502673 ip-10-0-134-229 kubenswrapper[2574]: I0603 13:54:27.502622 2574 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-multus/network-metrics-daemon-9f7k7"] Jun 03 13:54:27.626084 ip-10-0-134-229 kubenswrapper[2574]: I0603 13:54:27.625866 2574 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-vpjf9" Jun 03 13:54:27.626435 ip-10-0-134-229 kubenswrapper[2574]: I0603 13:54:27.625895 2574 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-v264j" event={"ID":"77b2aeec-d4be-45f6-b355-4030387080ad","Type":"ContainerStarted","Data":"7cf33614b96e04161eeb66ba89f6c7e8daa1969265793f660da8ac7a620b3948"} Jun 03 13:54:27.626435 ip-10-0-134-229 kubenswrapper[2574]: I0603 13:54:27.625908 2574 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-9f7k7" Jun 03 13:54:27.626435 ip-10-0-134-229 kubenswrapper[2574]: E0603 13:54:27.626161 2574 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-vpjf9" podUID="1422bf53-dc3d-42c1-9a1f-8657ec8777f4" Jun 03 13:54:27.626435 ip-10-0-134-229 kubenswrapper[2574]: E0603 13:54:27.626301 2574 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-9f7k7" podUID="6f47d39b-6eb0-4d5f-921b-0d56c194113e" Jun 03 13:54:28.631960 ip-10-0-134-229 kubenswrapper[2574]: I0603 13:54:28.631919 2574 generic.go:358] "Generic (PLEG): container finished" podID="77b2aeec-d4be-45f6-b355-4030387080ad" containerID="7cf33614b96e04161eeb66ba89f6c7e8daa1969265793f660da8ac7a620b3948" exitCode=0 Jun 03 13:54:28.632431 ip-10-0-134-229 kubenswrapper[2574]: I0603 13:54:28.631999 2574 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-v264j" event={"ID":"77b2aeec-d4be-45f6-b355-4030387080ad","Type":"ContainerDied","Data":"7cf33614b96e04161eeb66ba89f6c7e8daa1969265793f660da8ac7a620b3948"} Jun 03 13:54:29.427946 ip-10-0-134-229 kubenswrapper[2574]: I0603 13:54:29.427922 2574 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-vpjf9" Jun 03 13:54:29.428208 ip-10-0-134-229 kubenswrapper[2574]: I0603 13:54:29.427991 2574 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-9f7k7" Jun 03 13:54:29.428208 ip-10-0-134-229 kubenswrapper[2574]: I0603 13:54:29.428010 2574 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-g8xw8" Jun 03 13:54:29.428208 ip-10-0-134-229 kubenswrapper[2574]: E0603 13:54:29.428012 2574 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-vpjf9" podUID="1422bf53-dc3d-42c1-9a1f-8657ec8777f4" Jun 03 13:54:29.428208 ip-10-0-134-229 kubenswrapper[2574]: E0603 13:54:29.428056 2574 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-9f7k7" podUID="6f47d39b-6eb0-4d5f-921b-0d56c194113e" Jun 03 13:54:29.428208 ip-10-0-134-229 kubenswrapper[2574]: E0603 13:54:29.428122 2574 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-g8xw8" podUID="14b4e9c6-79e5-4c10-96b7-cc3cd27b89aa" Jun 03 13:54:30.637409 ip-10-0-134-229 kubenswrapper[2574]: I0603 13:54:30.637365 2574 generic.go:358] "Generic (PLEG): container finished" podID="77b2aeec-d4be-45f6-b355-4030387080ad" containerID="73e545756ceb70b48333c2218e98d74975635ef21e752e1d755e0c01783774d2" exitCode=0 Jun 03 13:54:30.638052 ip-10-0-134-229 kubenswrapper[2574]: I0603 13:54:30.637436 2574 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-v264j" event={"ID":"77b2aeec-d4be-45f6-b355-4030387080ad","Type":"ContainerDied","Data":"73e545756ceb70b48333c2218e98d74975635ef21e752e1d755e0c01783774d2"} Jun 03 13:54:31.426509 ip-10-0-134-229 kubenswrapper[2574]: I0603 13:54:31.426474 2574 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-vpjf9" Jun 03 13:54:31.426687 ip-10-0-134-229 kubenswrapper[2574]: I0603 13:54:31.426486 2574 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-9f7k7" Jun 03 13:54:31.426687 ip-10-0-134-229 kubenswrapper[2574]: E0603 13:54:31.426595 2574 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-vpjf9" podUID="1422bf53-dc3d-42c1-9a1f-8657ec8777f4" Jun 03 13:54:31.426687 ip-10-0-134-229 kubenswrapper[2574]: I0603 13:54:31.426486 2574 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-g8xw8" Jun 03 13:54:31.426687 ip-10-0-134-229 kubenswrapper[2574]: E0603 13:54:31.426679 2574 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-9f7k7" podUID="6f47d39b-6eb0-4d5f-921b-0d56c194113e" Jun 03 13:54:31.426920 ip-10-0-134-229 kubenswrapper[2574]: E0603 13:54:31.426757 2574 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-g8xw8" podUID="14b4e9c6-79e5-4c10-96b7-cc3cd27b89aa" Jun 03 13:54:32.668508 ip-10-0-134-229 kubenswrapper[2574]: I0603 13:54:32.668480 2574 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-134-229.ec2.internal" event="NodeReady" Jun 03 13:54:32.669307 ip-10-0-134-229 kubenswrapper[2574]: I0603 13:54:32.668600 2574 kubelet_node_status.go:550] "Fast updating node status as it just became ready" Jun 03 13:54:32.714144 ip-10-0-134-229 kubenswrapper[2574]: I0603 13:54:32.714118 2574 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-dns/dns-default-cmpk7"] Jun 03 13:54:32.737233 ip-10-0-134-229 kubenswrapper[2574]: I0603 13:54:32.737206 2574 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-ingress-canary/ingress-canary-r2b65"] Jun 03 13:54:32.737417 ip-10-0-134-229 kubenswrapper[2574]: I0603 13:54:32.737395 2574 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-cmpk7" Jun 03 13:54:32.739786 ip-10-0-134-229 kubenswrapper[2574]: I0603 13:54:32.739765 2574 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"dns-default\"" Jun 03 13:54:32.739911 ip-10-0-134-229 kubenswrapper[2574]: I0603 13:54:32.739764 2574 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-default-metrics-tls\"" Jun 03 13:54:32.739911 ip-10-0-134-229 kubenswrapper[2574]: I0603 13:54:32.739812 2574 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-dockercfg-zsshc\"" Jun 03 13:54:32.757042 ip-10-0-134-229 kubenswrapper[2574]: I0603 13:54:32.757023 2574 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-dns/dns-default-cmpk7"] Jun 03 13:54:32.757154 ip-10-0-134-229 kubenswrapper[2574]: I0603 13:54:32.757045 2574 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-ingress-canary/ingress-canary-r2b65"] Jun 03 13:54:32.757154 ip-10-0-134-229 kubenswrapper[2574]: I0603 13:54:32.757124 2574 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress-canary/ingress-canary-r2b65" Jun 03 13:54:32.759554 ip-10-0-134-229 kubenswrapper[2574]: I0603 13:54:32.759537 2574 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-canary\"/\"canary-serving-cert\"" Jun 03 13:54:32.759641 ip-10-0-134-229 kubenswrapper[2574]: I0603 13:54:32.759553 2574 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress-canary\"/\"openshift-service-ca.crt\"" Jun 03 13:54:32.759641 ip-10-0-134-229 kubenswrapper[2574]: I0603 13:54:32.759558 2574 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-canary\"/\"default-dockercfg-gxcmr\"" Jun 03 13:54:32.759878 ip-10-0-134-229 kubenswrapper[2574]: I0603 13:54:32.759862 2574 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress-canary\"/\"kube-root-ca.crt\"" Jun 03 13:54:32.869427 ip-10-0-134-229 kubenswrapper[2574]: I0603 13:54:32.869390 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-6b5xg\" (UniqueName: \"kubernetes.io/projected/4308a21d-77ba-4b27-acb7-feb7eafe3b61-kube-api-access-6b5xg\") pod \"dns-default-cmpk7\" (UID: \"4308a21d-77ba-4b27-acb7-feb7eafe3b61\") " pod="openshift-dns/dns-default-cmpk7" Jun 03 13:54:32.869568 ip-10-0-134-229 kubenswrapper[2574]: I0603 13:54:32.869456 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/b1e2fd2f-3d6b-4353-8897-804eee07eac8-cert\") pod \"ingress-canary-r2b65\" (UID: \"b1e2fd2f-3d6b-4353-8897-804eee07eac8\") " pod="openshift-ingress-canary/ingress-canary-r2b65" Jun 03 13:54:32.869568 ip-10-0-134-229 kubenswrapper[2574]: I0603 13:54:32.869474 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/4308a21d-77ba-4b27-acb7-feb7eafe3b61-tmp-dir\") pod \"dns-default-cmpk7\" (UID: \"4308a21d-77ba-4b27-acb7-feb7eafe3b61\") " pod="openshift-dns/dns-default-cmpk7" Jun 03 13:54:32.869568 ip-10-0-134-229 kubenswrapper[2574]: I0603 13:54:32.869495 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-xxcsc\" (UniqueName: \"kubernetes.io/projected/b1e2fd2f-3d6b-4353-8897-804eee07eac8-kube-api-access-xxcsc\") pod \"ingress-canary-r2b65\" (UID: \"b1e2fd2f-3d6b-4353-8897-804eee07eac8\") " pod="openshift-ingress-canary/ingress-canary-r2b65" Jun 03 13:54:32.869568 ip-10-0-134-229 kubenswrapper[2574]: I0603 13:54:32.869511 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/4308a21d-77ba-4b27-acb7-feb7eafe3b61-metrics-tls\") pod \"dns-default-cmpk7\" (UID: \"4308a21d-77ba-4b27-acb7-feb7eafe3b61\") " pod="openshift-dns/dns-default-cmpk7" Jun 03 13:54:32.869568 ip-10-0-134-229 kubenswrapper[2574]: I0603 13:54:32.869535 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/4308a21d-77ba-4b27-acb7-feb7eafe3b61-config-volume\") pod \"dns-default-cmpk7\" (UID: \"4308a21d-77ba-4b27-acb7-feb7eafe3b61\") " pod="openshift-dns/dns-default-cmpk7" Jun 03 13:54:32.970633 ip-10-0-134-229 kubenswrapper[2574]: I0603 13:54:32.970560 2574 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/b1e2fd2f-3d6b-4353-8897-804eee07eac8-cert\") pod \"ingress-canary-r2b65\" (UID: \"b1e2fd2f-3d6b-4353-8897-804eee07eac8\") " pod="openshift-ingress-canary/ingress-canary-r2b65" Jun 03 13:54:32.970633 ip-10-0-134-229 kubenswrapper[2574]: I0603 13:54:32.970599 2574 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/4308a21d-77ba-4b27-acb7-feb7eafe3b61-tmp-dir\") pod \"dns-default-cmpk7\" (UID: \"4308a21d-77ba-4b27-acb7-feb7eafe3b61\") " pod="openshift-dns/dns-default-cmpk7" Jun 03 13:54:32.970633 ip-10-0-134-229 kubenswrapper[2574]: I0603 13:54:32.970628 2574 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-xxcsc\" (UniqueName: \"kubernetes.io/projected/b1e2fd2f-3d6b-4353-8897-804eee07eac8-kube-api-access-xxcsc\") pod \"ingress-canary-r2b65\" (UID: \"b1e2fd2f-3d6b-4353-8897-804eee07eac8\") " pod="openshift-ingress-canary/ingress-canary-r2b65" Jun 03 13:54:32.970854 ip-10-0-134-229 kubenswrapper[2574]: I0603 13:54:32.970653 2574 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/4308a21d-77ba-4b27-acb7-feb7eafe3b61-metrics-tls\") pod \"dns-default-cmpk7\" (UID: \"4308a21d-77ba-4b27-acb7-feb7eafe3b61\") " pod="openshift-dns/dns-default-cmpk7" Jun 03 13:54:32.970854 ip-10-0-134-229 kubenswrapper[2574]: I0603 13:54:32.970694 2574 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/4308a21d-77ba-4b27-acb7-feb7eafe3b61-config-volume\") pod \"dns-default-cmpk7\" (UID: \"4308a21d-77ba-4b27-acb7-feb7eafe3b61\") " pod="openshift-dns/dns-default-cmpk7" Jun 03 13:54:32.970854 ip-10-0-134-229 kubenswrapper[2574]: E0603 13:54:32.970705 2574 secret.go:189] Couldn't get secret openshift-ingress-canary/canary-serving-cert: secret "canary-serving-cert" not found Jun 03 13:54:32.970854 ip-10-0-134-229 kubenswrapper[2574]: I0603 13:54:32.970755 2574 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-6b5xg\" (UniqueName: \"kubernetes.io/projected/4308a21d-77ba-4b27-acb7-feb7eafe3b61-kube-api-access-6b5xg\") pod \"dns-default-cmpk7\" (UID: \"4308a21d-77ba-4b27-acb7-feb7eafe3b61\") " pod="openshift-dns/dns-default-cmpk7" Jun 03 13:54:32.970854 ip-10-0-134-229 kubenswrapper[2574]: E0603 13:54:32.970772 2574 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/b1e2fd2f-3d6b-4353-8897-804eee07eac8-cert podName:b1e2fd2f-3d6b-4353-8897-804eee07eac8 nodeName:}" failed. No retries permitted until 2026-06-03 13:54:33.47075137 +0000 UTC m=+34.654758679 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "cert" (UniqueName: "kubernetes.io/secret/b1e2fd2f-3d6b-4353-8897-804eee07eac8-cert") pod "ingress-canary-r2b65" (UID: "b1e2fd2f-3d6b-4353-8897-804eee07eac8") : secret "canary-serving-cert" not found Jun 03 13:54:32.970854 ip-10-0-134-229 kubenswrapper[2574]: E0603 13:54:32.970819 2574 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jun 03 13:54:32.971165 ip-10-0-134-229 kubenswrapper[2574]: E0603 13:54:32.970877 2574 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/4308a21d-77ba-4b27-acb7-feb7eafe3b61-metrics-tls podName:4308a21d-77ba-4b27-acb7-feb7eafe3b61 nodeName:}" failed. No retries permitted until 2026-06-03 13:54:33.470859179 +0000 UTC m=+34.654866486 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/4308a21d-77ba-4b27-acb7-feb7eafe3b61-metrics-tls") pod "dns-default-cmpk7" (UID: "4308a21d-77ba-4b27-acb7-feb7eafe3b61") : secret "dns-default-metrics-tls" not found Jun 03 13:54:32.971165 ip-10-0-134-229 kubenswrapper[2574]: I0603 13:54:32.971002 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/4308a21d-77ba-4b27-acb7-feb7eafe3b61-tmp-dir\") pod \"dns-default-cmpk7\" (UID: \"4308a21d-77ba-4b27-acb7-feb7eafe3b61\") " pod="openshift-dns/dns-default-cmpk7" Jun 03 13:54:32.971338 ip-10-0-134-229 kubenswrapper[2574]: I0603 13:54:32.971317 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/4308a21d-77ba-4b27-acb7-feb7eafe3b61-config-volume\") pod \"dns-default-cmpk7\" (UID: \"4308a21d-77ba-4b27-acb7-feb7eafe3b61\") " pod="openshift-dns/dns-default-cmpk7" Jun 03 13:54:32.981309 ip-10-0-134-229 kubenswrapper[2574]: I0603 13:54:32.981278 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-6b5xg\" (UniqueName: \"kubernetes.io/projected/4308a21d-77ba-4b27-acb7-feb7eafe3b61-kube-api-access-6b5xg\") pod \"dns-default-cmpk7\" (UID: \"4308a21d-77ba-4b27-acb7-feb7eafe3b61\") " pod="openshift-dns/dns-default-cmpk7" Jun 03 13:54:32.981530 ip-10-0-134-229 kubenswrapper[2574]: I0603 13:54:32.981510 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-xxcsc\" (UniqueName: \"kubernetes.io/projected/b1e2fd2f-3d6b-4353-8897-804eee07eac8-kube-api-access-xxcsc\") pod \"ingress-canary-r2b65\" (UID: \"b1e2fd2f-3d6b-4353-8897-804eee07eac8\") " pod="openshift-ingress-canary/ingress-canary-r2b65" Jun 03 13:54:33.071654 ip-10-0-134-229 kubenswrapper[2574]: I0603 13:54:33.071622 2574 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/6f47d39b-6eb0-4d5f-921b-0d56c194113e-metrics-certs\") pod \"network-metrics-daemon-9f7k7\" (UID: \"6f47d39b-6eb0-4d5f-921b-0d56c194113e\") " pod="openshift-multus/network-metrics-daemon-9f7k7" Jun 03 13:54:33.071762 ip-10-0-134-229 kubenswrapper[2574]: E0603 13:54:33.071740 2574 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jun 03 13:54:33.071834 ip-10-0-134-229 kubenswrapper[2574]: E0603 13:54:33.071822 2574 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/6f47d39b-6eb0-4d5f-921b-0d56c194113e-metrics-certs podName:6f47d39b-6eb0-4d5f-921b-0d56c194113e nodeName:}" failed. No retries permitted until 2026-06-03 13:55:05.071802989 +0000 UTC m=+66.255810310 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/6f47d39b-6eb0-4d5f-921b-0d56c194113e-metrics-certs") pod "network-metrics-daemon-9f7k7" (UID: "6f47d39b-6eb0-4d5f-921b-0d56c194113e") : object "openshift-multus"/"metrics-daemon-secret" not registered Jun 03 13:54:33.172972 ip-10-0-134-229 kubenswrapper[2574]: I0603 13:54:33.172937 2574 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-qwqz4\" (UniqueName: \"kubernetes.io/projected/1422bf53-dc3d-42c1-9a1f-8657ec8777f4-kube-api-access-qwqz4\") pod \"network-check-target-vpjf9\" (UID: \"1422bf53-dc3d-42c1-9a1f-8657ec8777f4\") " pod="openshift-network-diagnostics/network-check-target-vpjf9" Jun 03 13:54:33.173119 ip-10-0-134-229 kubenswrapper[2574]: E0603 13:54:33.173099 2574 projected.go:289] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jun 03 13:54:33.173183 ip-10-0-134-229 kubenswrapper[2574]: E0603 13:54:33.173127 2574 projected.go:289] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jun 03 13:54:33.173183 ip-10-0-134-229 kubenswrapper[2574]: E0603 13:54:33.173140 2574 projected.go:194] Error preparing data for projected volume kube-api-access-qwqz4 for pod openshift-network-diagnostics/network-check-target-vpjf9: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 03 13:54:33.173251 ip-10-0-134-229 kubenswrapper[2574]: E0603 13:54:33.173212 2574 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/1422bf53-dc3d-42c1-9a1f-8657ec8777f4-kube-api-access-qwqz4 podName:1422bf53-dc3d-42c1-9a1f-8657ec8777f4 nodeName:}" failed. No retries permitted until 2026-06-03 13:55:05.173195326 +0000 UTC m=+66.357202651 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "kube-api-access-qwqz4" (UniqueName: "kubernetes.io/projected/1422bf53-dc3d-42c1-9a1f-8657ec8777f4-kube-api-access-qwqz4") pod "network-check-target-vpjf9" (UID: "1422bf53-dc3d-42c1-9a1f-8657ec8777f4") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 03 13:54:33.426884 ip-10-0-134-229 kubenswrapper[2574]: I0603 13:54:33.426853 2574 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-9f7k7" Jun 03 13:54:33.427056 ip-10-0-134-229 kubenswrapper[2574]: I0603 13:54:33.426853 2574 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-vpjf9" Jun 03 13:54:33.427056 ip-10-0-134-229 kubenswrapper[2574]: I0603 13:54:33.426977 2574 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-g8xw8" Jun 03 13:54:33.429498 ip-10-0-134-229 kubenswrapper[2574]: I0603 13:54:33.429362 2574 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"kube-root-ca.crt\"" Jun 03 13:54:33.429498 ip-10-0-134-229 kubenswrapper[2574]: I0603 13:54:33.429393 2574 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-secret\"" Jun 03 13:54:33.429498 ip-10-0-134-229 kubenswrapper[2574]: I0603 13:54:33.429406 2574 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"openshift-service-ca.crt\"" Jun 03 13:54:33.429498 ip-10-0-134-229 kubenswrapper[2574]: I0603 13:54:33.429456 2574 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-sa-dockercfg-tj8sj\"" Jun 03 13:54:33.429753 ip-10-0-134-229 kubenswrapper[2574]: I0603 13:54:33.429550 2574 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"original-pull-secret\"" Jun 03 13:54:33.429948 ip-10-0-134-229 kubenswrapper[2574]: I0603 13:54:33.429934 2574 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"default-dockercfg-n9kxv\"" Jun 03 13:54:33.475019 ip-10-0-134-229 kubenswrapper[2574]: I0603 13:54:33.474991 2574 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/b1e2fd2f-3d6b-4353-8897-804eee07eac8-cert\") pod \"ingress-canary-r2b65\" (UID: \"b1e2fd2f-3d6b-4353-8897-804eee07eac8\") " pod="openshift-ingress-canary/ingress-canary-r2b65" Jun 03 13:54:33.475132 ip-10-0-134-229 kubenswrapper[2574]: I0603 13:54:33.475030 2574 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/4308a21d-77ba-4b27-acb7-feb7eafe3b61-metrics-tls\") pod \"dns-default-cmpk7\" (UID: \"4308a21d-77ba-4b27-acb7-feb7eafe3b61\") " pod="openshift-dns/dns-default-cmpk7" Jun 03 13:54:33.475194 ip-10-0-134-229 kubenswrapper[2574]: E0603 13:54:33.475133 2574 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jun 03 13:54:33.475194 ip-10-0-134-229 kubenswrapper[2574]: E0603 13:54:33.475150 2574 secret.go:189] Couldn't get secret openshift-ingress-canary/canary-serving-cert: secret "canary-serving-cert" not found Jun 03 13:54:33.475194 ip-10-0-134-229 kubenswrapper[2574]: E0603 13:54:33.475180 2574 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/4308a21d-77ba-4b27-acb7-feb7eafe3b61-metrics-tls podName:4308a21d-77ba-4b27-acb7-feb7eafe3b61 nodeName:}" failed. No retries permitted until 2026-06-03 13:54:34.475167314 +0000 UTC m=+35.659174625 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/4308a21d-77ba-4b27-acb7-feb7eafe3b61-metrics-tls") pod "dns-default-cmpk7" (UID: "4308a21d-77ba-4b27-acb7-feb7eafe3b61") : secret "dns-default-metrics-tls" not found Jun 03 13:54:33.475339 ip-10-0-134-229 kubenswrapper[2574]: E0603 13:54:33.475275 2574 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/b1e2fd2f-3d6b-4353-8897-804eee07eac8-cert podName:b1e2fd2f-3d6b-4353-8897-804eee07eac8 nodeName:}" failed. No retries permitted until 2026-06-03 13:54:34.475261236 +0000 UTC m=+35.659268543 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "cert" (UniqueName: "kubernetes.io/secret/b1e2fd2f-3d6b-4353-8897-804eee07eac8-cert") pod "ingress-canary-r2b65" (UID: "b1e2fd2f-3d6b-4353-8897-804eee07eac8") : secret "canary-serving-cert" not found Jun 03 13:54:34.484411 ip-10-0-134-229 kubenswrapper[2574]: I0603 13:54:34.484368 2574 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/b1e2fd2f-3d6b-4353-8897-804eee07eac8-cert\") pod \"ingress-canary-r2b65\" (UID: \"b1e2fd2f-3d6b-4353-8897-804eee07eac8\") " pod="openshift-ingress-canary/ingress-canary-r2b65" Jun 03 13:54:34.484411 ip-10-0-134-229 kubenswrapper[2574]: I0603 13:54:34.484416 2574 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/4308a21d-77ba-4b27-acb7-feb7eafe3b61-metrics-tls\") pod \"dns-default-cmpk7\" (UID: \"4308a21d-77ba-4b27-acb7-feb7eafe3b61\") " pod="openshift-dns/dns-default-cmpk7" Jun 03 13:54:34.484887 ip-10-0-134-229 kubenswrapper[2574]: E0603 13:54:34.484545 2574 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jun 03 13:54:34.484887 ip-10-0-134-229 kubenswrapper[2574]: E0603 13:54:34.484606 2574 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/4308a21d-77ba-4b27-acb7-feb7eafe3b61-metrics-tls podName:4308a21d-77ba-4b27-acb7-feb7eafe3b61 nodeName:}" failed. No retries permitted until 2026-06-03 13:54:36.484591178 +0000 UTC m=+37.668598498 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/4308a21d-77ba-4b27-acb7-feb7eafe3b61-metrics-tls") pod "dns-default-cmpk7" (UID: "4308a21d-77ba-4b27-acb7-feb7eafe3b61") : secret "dns-default-metrics-tls" not found Jun 03 13:54:34.484887 ip-10-0-134-229 kubenswrapper[2574]: E0603 13:54:34.484637 2574 secret.go:189] Couldn't get secret openshift-ingress-canary/canary-serving-cert: secret "canary-serving-cert" not found Jun 03 13:54:34.484887 ip-10-0-134-229 kubenswrapper[2574]: E0603 13:54:34.484701 2574 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/b1e2fd2f-3d6b-4353-8897-804eee07eac8-cert podName:b1e2fd2f-3d6b-4353-8897-804eee07eac8 nodeName:}" failed. No retries permitted until 2026-06-03 13:54:36.484687415 +0000 UTC m=+37.668694724 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "cert" (UniqueName: "kubernetes.io/secret/b1e2fd2f-3d6b-4353-8897-804eee07eac8-cert") pod "ingress-canary-r2b65" (UID: "b1e2fd2f-3d6b-4353-8897-804eee07eac8") : secret "canary-serving-cert" not found Jun 03 13:54:36.499960 ip-10-0-134-229 kubenswrapper[2574]: I0603 13:54:36.499702 2574 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/b1e2fd2f-3d6b-4353-8897-804eee07eac8-cert\") pod \"ingress-canary-r2b65\" (UID: \"b1e2fd2f-3d6b-4353-8897-804eee07eac8\") " pod="openshift-ingress-canary/ingress-canary-r2b65" Jun 03 13:54:36.500393 ip-10-0-134-229 kubenswrapper[2574]: I0603 13:54:36.499981 2574 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/4308a21d-77ba-4b27-acb7-feb7eafe3b61-metrics-tls\") pod \"dns-default-cmpk7\" (UID: \"4308a21d-77ba-4b27-acb7-feb7eafe3b61\") " pod="openshift-dns/dns-default-cmpk7" Jun 03 13:54:36.500393 ip-10-0-134-229 kubenswrapper[2574]: E0603 13:54:36.499865 2574 secret.go:189] Couldn't get secret openshift-ingress-canary/canary-serving-cert: secret "canary-serving-cert" not found Jun 03 13:54:36.500393 ip-10-0-134-229 kubenswrapper[2574]: E0603 13:54:36.500113 2574 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/b1e2fd2f-3d6b-4353-8897-804eee07eac8-cert podName:b1e2fd2f-3d6b-4353-8897-804eee07eac8 nodeName:}" failed. No retries permitted until 2026-06-03 13:54:40.500095133 +0000 UTC m=+41.684102440 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "cert" (UniqueName: "kubernetes.io/secret/b1e2fd2f-3d6b-4353-8897-804eee07eac8-cert") pod "ingress-canary-r2b65" (UID: "b1e2fd2f-3d6b-4353-8897-804eee07eac8") : secret "canary-serving-cert" not found Jun 03 13:54:36.500393 ip-10-0-134-229 kubenswrapper[2574]: E0603 13:54:36.500140 2574 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jun 03 13:54:36.500393 ip-10-0-134-229 kubenswrapper[2574]: E0603 13:54:36.500189 2574 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/4308a21d-77ba-4b27-acb7-feb7eafe3b61-metrics-tls podName:4308a21d-77ba-4b27-acb7-feb7eafe3b61 nodeName:}" failed. No retries permitted until 2026-06-03 13:54:40.500174109 +0000 UTC m=+41.684181431 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/4308a21d-77ba-4b27-acb7-feb7eafe3b61-metrics-tls") pod "dns-default-cmpk7" (UID: "4308a21d-77ba-4b27-acb7-feb7eafe3b61") : secret "dns-default-metrics-tls" not found Jun 03 13:54:38.652324 ip-10-0-134-229 kubenswrapper[2574]: I0603 13:54:38.652280 2574 generic.go:358] "Generic (PLEG): container finished" podID="77b2aeec-d4be-45f6-b355-4030387080ad" containerID="e4fe7519bc0457881ea18c79f891a2e81c8f4b7ee17761a70788c5930ece1eaa" exitCode=0 Jun 03 13:54:38.652726 ip-10-0-134-229 kubenswrapper[2574]: I0603 13:54:38.652353 2574 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-v264j" event={"ID":"77b2aeec-d4be-45f6-b355-4030387080ad","Type":"ContainerDied","Data":"e4fe7519bc0457881ea18c79f891a2e81c8f4b7ee17761a70788c5930ece1eaa"} Jun 03 13:54:38.716555 ip-10-0-134-229 kubenswrapper[2574]: I0603 13:54:38.716523 2574 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/14b4e9c6-79e5-4c10-96b7-cc3cd27b89aa-original-pull-secret\") pod \"global-pull-secret-syncer-g8xw8\" (UID: \"14b4e9c6-79e5-4c10-96b7-cc3cd27b89aa\") " pod="kube-system/global-pull-secret-syncer-g8xw8" Jun 03 13:54:38.720326 ip-10-0-134-229 kubenswrapper[2574]: I0603 13:54:38.720243 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/14b4e9c6-79e5-4c10-96b7-cc3cd27b89aa-original-pull-secret\") pod \"global-pull-secret-syncer-g8xw8\" (UID: \"14b4e9c6-79e5-4c10-96b7-cc3cd27b89aa\") " pod="kube-system/global-pull-secret-syncer-g8xw8" Jun 03 13:54:38.846517 ip-10-0-134-229 kubenswrapper[2574]: I0603 13:54:38.846491 2574 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-g8xw8" Jun 03 13:54:38.999569 ip-10-0-134-229 kubenswrapper[2574]: I0603 13:54:38.999543 2574 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kube-system/global-pull-secret-syncer-g8xw8"] Jun 03 13:54:39.002441 ip-10-0-134-229 kubenswrapper[2574]: W0603 13:54:39.002411 2574 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod14b4e9c6_79e5_4c10_96b7_cc3cd27b89aa.slice/crio-5162020fda29016e9f76359fe8d054b7db95e470ea9376ae1b40ae104fb23133 WatchSource:0}: Error finding container 5162020fda29016e9f76359fe8d054b7db95e470ea9376ae1b40ae104fb23133: Status 404 returned error can't find the container with id 5162020fda29016e9f76359fe8d054b7db95e470ea9376ae1b40ae104fb23133 Jun 03 13:54:39.656270 ip-10-0-134-229 kubenswrapper[2574]: I0603 13:54:39.656231 2574 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kube-system/global-pull-secret-syncer-g8xw8" event={"ID":"14b4e9c6-79e5-4c10-96b7-cc3cd27b89aa","Type":"ContainerStarted","Data":"5162020fda29016e9f76359fe8d054b7db95e470ea9376ae1b40ae104fb23133"} Jun 03 13:54:39.660081 ip-10-0-134-229 kubenswrapper[2574]: I0603 13:54:39.660048 2574 generic.go:358] "Generic (PLEG): container finished" podID="77b2aeec-d4be-45f6-b355-4030387080ad" containerID="c117a6e6bc2d1161af1372fb92f66890bab93a863127a2ffe23b016fda61a8ba" exitCode=0 Jun 03 13:54:39.660225 ip-10-0-134-229 kubenswrapper[2574]: I0603 13:54:39.660097 2574 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-v264j" event={"ID":"77b2aeec-d4be-45f6-b355-4030387080ad","Type":"ContainerDied","Data":"c117a6e6bc2d1161af1372fb92f66890bab93a863127a2ffe23b016fda61a8ba"} Jun 03 13:54:40.528289 ip-10-0-134-229 kubenswrapper[2574]: I0603 13:54:40.528253 2574 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/b1e2fd2f-3d6b-4353-8897-804eee07eac8-cert\") pod \"ingress-canary-r2b65\" (UID: \"b1e2fd2f-3d6b-4353-8897-804eee07eac8\") " pod="openshift-ingress-canary/ingress-canary-r2b65" Jun 03 13:54:40.528289 ip-10-0-134-229 kubenswrapper[2574]: I0603 13:54:40.528292 2574 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/4308a21d-77ba-4b27-acb7-feb7eafe3b61-metrics-tls\") pod \"dns-default-cmpk7\" (UID: \"4308a21d-77ba-4b27-acb7-feb7eafe3b61\") " pod="openshift-dns/dns-default-cmpk7" Jun 03 13:54:40.528517 ip-10-0-134-229 kubenswrapper[2574]: E0603 13:54:40.528400 2574 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jun 03 13:54:40.528517 ip-10-0-134-229 kubenswrapper[2574]: E0603 13:54:40.528411 2574 secret.go:189] Couldn't get secret openshift-ingress-canary/canary-serving-cert: secret "canary-serving-cert" not found Jun 03 13:54:40.528517 ip-10-0-134-229 kubenswrapper[2574]: E0603 13:54:40.528462 2574 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/4308a21d-77ba-4b27-acb7-feb7eafe3b61-metrics-tls podName:4308a21d-77ba-4b27-acb7-feb7eafe3b61 nodeName:}" failed. No retries permitted until 2026-06-03 13:54:48.528447021 +0000 UTC m=+49.712454348 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/4308a21d-77ba-4b27-acb7-feb7eafe3b61-metrics-tls") pod "dns-default-cmpk7" (UID: "4308a21d-77ba-4b27-acb7-feb7eafe3b61") : secret "dns-default-metrics-tls" not found Jun 03 13:54:40.528517 ip-10-0-134-229 kubenswrapper[2574]: E0603 13:54:40.528477 2574 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/b1e2fd2f-3d6b-4353-8897-804eee07eac8-cert podName:b1e2fd2f-3d6b-4353-8897-804eee07eac8 nodeName:}" failed. No retries permitted until 2026-06-03 13:54:48.528470341 +0000 UTC m=+49.712477647 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "cert" (UniqueName: "kubernetes.io/secret/b1e2fd2f-3d6b-4353-8897-804eee07eac8-cert") pod "ingress-canary-r2b65" (UID: "b1e2fd2f-3d6b-4353-8897-804eee07eac8") : secret "canary-serving-cert" not found Jun 03 13:54:40.665559 ip-10-0-134-229 kubenswrapper[2574]: I0603 13:54:40.665525 2574 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-v264j" event={"ID":"77b2aeec-d4be-45f6-b355-4030387080ad","Type":"ContainerStarted","Data":"254ff3d2d001332786a2a4dae5b8c7666ea6dc8bb5406e5f69f558ef7b601b16"} Jun 03 13:54:40.690004 ip-10-0-134-229 kubenswrapper[2574]: I0603 13:54:40.689953 2574 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-multus/multus-additional-cni-plugins-v264j" podStartSLOduration=5.871712283 podStartE2EDuration="41.689937337s" podCreationTimestamp="2026-06-03 13:53:59 +0000 UTC" firstStartedPulling="2026-06-03 13:54:01.946350311 +0000 UTC m=+3.130357632" lastFinishedPulling="2026-06-03 13:54:37.76457538 +0000 UTC m=+38.948582686" observedRunningTime="2026-06-03 13:54:40.689414907 +0000 UTC m=+41.873422235" watchObservedRunningTime="2026-06-03 13:54:40.689937337 +0000 UTC m=+41.873944668" Jun 03 13:54:42.670725 ip-10-0-134-229 kubenswrapper[2574]: I0603 13:54:42.670687 2574 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kube-system/global-pull-secret-syncer-g8xw8" event={"ID":"14b4e9c6-79e5-4c10-96b7-cc3cd27b89aa","Type":"ContainerStarted","Data":"7947e2e33f0acaf70b35f4824578707eb065fc317826132b720e414c2fc317fc"} Jun 03 13:54:42.685704 ip-10-0-134-229 kubenswrapper[2574]: I0603 13:54:42.685660 2574 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="kube-system/global-pull-secret-syncer-g8xw8" podStartSLOduration=33.121435232 podStartE2EDuration="36.685645814s" podCreationTimestamp="2026-06-03 13:54:06 +0000 UTC" firstStartedPulling="2026-06-03 13:54:39.004118343 +0000 UTC m=+40.188125650" lastFinishedPulling="2026-06-03 13:54:42.568328925 +0000 UTC m=+43.752336232" observedRunningTime="2026-06-03 13:54:42.68528017 +0000 UTC m=+43.869287500" watchObservedRunningTime="2026-06-03 13:54:42.685645814 +0000 UTC m=+43.869653139" Jun 03 13:54:48.579858 ip-10-0-134-229 kubenswrapper[2574]: I0603 13:54:48.579803 2574 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/b1e2fd2f-3d6b-4353-8897-804eee07eac8-cert\") pod \"ingress-canary-r2b65\" (UID: \"b1e2fd2f-3d6b-4353-8897-804eee07eac8\") " pod="openshift-ingress-canary/ingress-canary-r2b65" Jun 03 13:54:48.579858 ip-10-0-134-229 kubenswrapper[2574]: I0603 13:54:48.579858 2574 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/4308a21d-77ba-4b27-acb7-feb7eafe3b61-metrics-tls\") pod \"dns-default-cmpk7\" (UID: \"4308a21d-77ba-4b27-acb7-feb7eafe3b61\") " pod="openshift-dns/dns-default-cmpk7" Jun 03 13:54:48.580339 ip-10-0-134-229 kubenswrapper[2574]: E0603 13:54:48.579963 2574 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jun 03 13:54:48.580339 ip-10-0-134-229 kubenswrapper[2574]: E0603 13:54:48.579967 2574 secret.go:189] Couldn't get secret openshift-ingress-canary/canary-serving-cert: secret "canary-serving-cert" not found Jun 03 13:54:48.580339 ip-10-0-134-229 kubenswrapper[2574]: E0603 13:54:48.580023 2574 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/4308a21d-77ba-4b27-acb7-feb7eafe3b61-metrics-tls podName:4308a21d-77ba-4b27-acb7-feb7eafe3b61 nodeName:}" failed. No retries permitted until 2026-06-03 13:55:04.580007638 +0000 UTC m=+65.764014961 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/4308a21d-77ba-4b27-acb7-feb7eafe3b61-metrics-tls") pod "dns-default-cmpk7" (UID: "4308a21d-77ba-4b27-acb7-feb7eafe3b61") : secret "dns-default-metrics-tls" not found Jun 03 13:54:48.580339 ip-10-0-134-229 kubenswrapper[2574]: E0603 13:54:48.580038 2574 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/b1e2fd2f-3d6b-4353-8897-804eee07eac8-cert podName:b1e2fd2f-3d6b-4353-8897-804eee07eac8 nodeName:}" failed. No retries permitted until 2026-06-03 13:55:04.580032408 +0000 UTC m=+65.764039714 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "cert" (UniqueName: "kubernetes.io/secret/b1e2fd2f-3d6b-4353-8897-804eee07eac8-cert") pod "ingress-canary-r2b65" (UID: "b1e2fd2f-3d6b-4353-8897-804eee07eac8") : secret "canary-serving-cert" not found Jun 03 13:54:58.646547 ip-10-0-134-229 kubenswrapper[2574]: I0603 13:54:58.646517 2574 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-kfq8c" Jun 03 13:55:04.593689 ip-10-0-134-229 kubenswrapper[2574]: I0603 13:55:04.593648 2574 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/b1e2fd2f-3d6b-4353-8897-804eee07eac8-cert\") pod \"ingress-canary-r2b65\" (UID: \"b1e2fd2f-3d6b-4353-8897-804eee07eac8\") " pod="openshift-ingress-canary/ingress-canary-r2b65" Jun 03 13:55:04.593689 ip-10-0-134-229 kubenswrapper[2574]: I0603 13:55:04.593688 2574 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/4308a21d-77ba-4b27-acb7-feb7eafe3b61-metrics-tls\") pod \"dns-default-cmpk7\" (UID: \"4308a21d-77ba-4b27-acb7-feb7eafe3b61\") " pod="openshift-dns/dns-default-cmpk7" Jun 03 13:55:04.594093 ip-10-0-134-229 kubenswrapper[2574]: E0603 13:55:04.593776 2574 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jun 03 13:55:04.594093 ip-10-0-134-229 kubenswrapper[2574]: E0603 13:55:04.593777 2574 secret.go:189] Couldn't get secret openshift-ingress-canary/canary-serving-cert: secret "canary-serving-cert" not found Jun 03 13:55:04.594093 ip-10-0-134-229 kubenswrapper[2574]: E0603 13:55:04.593828 2574 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/4308a21d-77ba-4b27-acb7-feb7eafe3b61-metrics-tls podName:4308a21d-77ba-4b27-acb7-feb7eafe3b61 nodeName:}" failed. No retries permitted until 2026-06-03 13:55:36.593815339 +0000 UTC m=+97.777822646 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/4308a21d-77ba-4b27-acb7-feb7eafe3b61-metrics-tls") pod "dns-default-cmpk7" (UID: "4308a21d-77ba-4b27-acb7-feb7eafe3b61") : secret "dns-default-metrics-tls" not found Jun 03 13:55:04.594093 ip-10-0-134-229 kubenswrapper[2574]: E0603 13:55:04.593843 2574 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/b1e2fd2f-3d6b-4353-8897-804eee07eac8-cert podName:b1e2fd2f-3d6b-4353-8897-804eee07eac8 nodeName:}" failed. No retries permitted until 2026-06-03 13:55:36.593836207 +0000 UTC m=+97.777843514 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "cert" (UniqueName: "kubernetes.io/secret/b1e2fd2f-3d6b-4353-8897-804eee07eac8-cert") pod "ingress-canary-r2b65" (UID: "b1e2fd2f-3d6b-4353-8897-804eee07eac8") : secret "canary-serving-cert" not found Jun 03 13:55:05.097138 ip-10-0-134-229 kubenswrapper[2574]: I0603 13:55:05.097098 2574 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/6f47d39b-6eb0-4d5f-921b-0d56c194113e-metrics-certs\") pod \"network-metrics-daemon-9f7k7\" (UID: \"6f47d39b-6eb0-4d5f-921b-0d56c194113e\") " pod="openshift-multus/network-metrics-daemon-9f7k7" Jun 03 13:55:05.099757 ip-10-0-134-229 kubenswrapper[2574]: I0603 13:55:05.099740 2574 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-secret\"" Jun 03 13:55:05.107719 ip-10-0-134-229 kubenswrapper[2574]: E0603 13:55:05.107702 2574 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: secret "metrics-daemon-secret" not found Jun 03 13:55:05.107777 ip-10-0-134-229 kubenswrapper[2574]: E0603 13:55:05.107769 2574 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/6f47d39b-6eb0-4d5f-921b-0d56c194113e-metrics-certs podName:6f47d39b-6eb0-4d5f-921b-0d56c194113e nodeName:}" failed. No retries permitted until 2026-06-03 13:56:09.107751692 +0000 UTC m=+130.291758999 (durationBeforeRetry 1m4s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/6f47d39b-6eb0-4d5f-921b-0d56c194113e-metrics-certs") pod "network-metrics-daemon-9f7k7" (UID: "6f47d39b-6eb0-4d5f-921b-0d56c194113e") : secret "metrics-daemon-secret" not found Jun 03 13:55:05.197970 ip-10-0-134-229 kubenswrapper[2574]: I0603 13:55:05.197947 2574 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-qwqz4\" (UniqueName: \"kubernetes.io/projected/1422bf53-dc3d-42c1-9a1f-8657ec8777f4-kube-api-access-qwqz4\") pod \"network-check-target-vpjf9\" (UID: \"1422bf53-dc3d-42c1-9a1f-8657ec8777f4\") " pod="openshift-network-diagnostics/network-check-target-vpjf9" Jun 03 13:55:05.200806 ip-10-0-134-229 kubenswrapper[2574]: I0603 13:55:05.200788 2574 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"kube-root-ca.crt\"" Jun 03 13:55:05.210644 ip-10-0-134-229 kubenswrapper[2574]: I0603 13:55:05.210623 2574 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"openshift-service-ca.crt\"" Jun 03 13:55:05.221390 ip-10-0-134-229 kubenswrapper[2574]: I0603 13:55:05.221351 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-qwqz4\" (UniqueName: \"kubernetes.io/projected/1422bf53-dc3d-42c1-9a1f-8657ec8777f4-kube-api-access-qwqz4\") pod \"network-check-target-vpjf9\" (UID: \"1422bf53-dc3d-42c1-9a1f-8657ec8777f4\") " pod="openshift-network-diagnostics/network-check-target-vpjf9" Jun 03 13:55:05.245030 ip-10-0-134-229 kubenswrapper[2574]: I0603 13:55:05.245010 2574 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"default-dockercfg-n9kxv\"" Jun 03 13:55:05.252834 ip-10-0-134-229 kubenswrapper[2574]: I0603 13:55:05.252819 2574 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-vpjf9" Jun 03 13:55:05.377068 ip-10-0-134-229 kubenswrapper[2574]: I0603 13:55:05.377044 2574 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-target-vpjf9"] Jun 03 13:55:05.379699 ip-10-0-134-229 kubenswrapper[2574]: W0603 13:55:05.379674 2574 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod1422bf53_dc3d_42c1_9a1f_8657ec8777f4.slice/crio-5ad5f0e5fd1453c229d354aaa4d21c2a7f7c8219220388809114962e2e569b41 WatchSource:0}: Error finding container 5ad5f0e5fd1453c229d354aaa4d21c2a7f7c8219220388809114962e2e569b41: Status 404 returned error can't find the container with id 5ad5f0e5fd1453c229d354aaa4d21c2a7f7c8219220388809114962e2e569b41 Jun 03 13:55:05.715601 ip-10-0-134-229 kubenswrapper[2574]: I0603 13:55:05.715522 2574 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-target-vpjf9" event={"ID":"1422bf53-dc3d-42c1-9a1f-8657ec8777f4","Type":"ContainerStarted","Data":"5ad5f0e5fd1453c229d354aaa4d21c2a7f7c8219220388809114962e2e569b41"} Jun 03 13:55:08.722555 ip-10-0-134-229 kubenswrapper[2574]: I0603 13:55:08.722520 2574 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-target-vpjf9" event={"ID":"1422bf53-dc3d-42c1-9a1f-8657ec8777f4","Type":"ContainerStarted","Data":"757342eef221fd0ba21a28ef7f86b5382334176208cf23ba42b4af12a0550324"} Jun 03 13:55:08.722995 ip-10-0-134-229 kubenswrapper[2574]: I0603 13:55:08.722629 2574 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-network-diagnostics/network-check-target-vpjf9" Jun 03 13:55:08.739148 ip-10-0-134-229 kubenswrapper[2574]: I0603 13:55:08.739109 2574 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-network-diagnostics/network-check-target-vpjf9" podStartSLOduration=66.849910641 podStartE2EDuration="1m9.739095237s" podCreationTimestamp="2026-06-03 13:53:59 +0000 UTC" firstStartedPulling="2026-06-03 13:55:05.381526893 +0000 UTC m=+66.565534200" lastFinishedPulling="2026-06-03 13:55:08.270711489 +0000 UTC m=+69.454718796" observedRunningTime="2026-06-03 13:55:08.737861 +0000 UTC m=+69.921868328" watchObservedRunningTime="2026-06-03 13:55:08.739095237 +0000 UTC m=+69.923102568" Jun 03 13:55:36.607336 ip-10-0-134-229 kubenswrapper[2574]: I0603 13:55:36.607218 2574 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/b1e2fd2f-3d6b-4353-8897-804eee07eac8-cert\") pod \"ingress-canary-r2b65\" (UID: \"b1e2fd2f-3d6b-4353-8897-804eee07eac8\") " pod="openshift-ingress-canary/ingress-canary-r2b65" Jun 03 13:55:36.607336 ip-10-0-134-229 kubenswrapper[2574]: I0603 13:55:36.607257 2574 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/4308a21d-77ba-4b27-acb7-feb7eafe3b61-metrics-tls\") pod \"dns-default-cmpk7\" (UID: \"4308a21d-77ba-4b27-acb7-feb7eafe3b61\") " pod="openshift-dns/dns-default-cmpk7" Jun 03 13:55:36.607816 ip-10-0-134-229 kubenswrapper[2574]: E0603 13:55:36.607362 2574 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jun 03 13:55:36.607816 ip-10-0-134-229 kubenswrapper[2574]: E0603 13:55:36.607363 2574 secret.go:189] Couldn't get secret openshift-ingress-canary/canary-serving-cert: secret "canary-serving-cert" not found Jun 03 13:55:36.607816 ip-10-0-134-229 kubenswrapper[2574]: E0603 13:55:36.607438 2574 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/4308a21d-77ba-4b27-acb7-feb7eafe3b61-metrics-tls podName:4308a21d-77ba-4b27-acb7-feb7eafe3b61 nodeName:}" failed. No retries permitted until 2026-06-03 13:56:40.607424883 +0000 UTC m=+161.791432190 (durationBeforeRetry 1m4s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/4308a21d-77ba-4b27-acb7-feb7eafe3b61-metrics-tls") pod "dns-default-cmpk7" (UID: "4308a21d-77ba-4b27-acb7-feb7eafe3b61") : secret "dns-default-metrics-tls" not found Jun 03 13:55:36.607816 ip-10-0-134-229 kubenswrapper[2574]: E0603 13:55:36.607454 2574 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/b1e2fd2f-3d6b-4353-8897-804eee07eac8-cert podName:b1e2fd2f-3d6b-4353-8897-804eee07eac8 nodeName:}" failed. No retries permitted until 2026-06-03 13:56:40.607447013 +0000 UTC m=+161.791454323 (durationBeforeRetry 1m4s). Error: MountVolume.SetUp failed for volume "cert" (UniqueName: "kubernetes.io/secret/b1e2fd2f-3d6b-4353-8897-804eee07eac8-cert") pod "ingress-canary-r2b65" (UID: "b1e2fd2f-3d6b-4353-8897-804eee07eac8") : secret "canary-serving-cert" not found Jun 03 13:55:39.726430 ip-10-0-134-229 kubenswrapper[2574]: I0603 13:55:39.726364 2574 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-network-diagnostics/network-check-target-vpjf9" Jun 03 13:56:06.781691 ip-10-0-134-229 kubenswrapper[2574]: I0603 13:56:06.781658 2574 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-ingress/router-default-7595fc69d5-8sg6s"] Jun 03 13:56:06.784295 ip-10-0-134-229 kubenswrapper[2574]: I0603 13:56:06.784278 2574 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/router-default-7595fc69d5-8sg6s" Jun 03 13:56:06.786433 ip-10-0-134-229 kubenswrapper[2574]: I0603 13:56:06.786406 2574 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"service-ca-bundle\"" Jun 03 13:56:06.786551 ip-10-0-134-229 kubenswrapper[2574]: I0603 13:56:06.786519 2574 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"router-stats-default\"" Jun 03 13:56:06.786551 ip-10-0-134-229 kubenswrapper[2574]: I0603 13:56:06.786528 2574 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"router-metrics-certs-default\"" Jun 03 13:56:06.786876 ip-10-0-134-229 kubenswrapper[2574]: I0603 13:56:06.786858 2574 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"router-dockercfg-xqjkl\"" Jun 03 13:56:06.787060 ip-10-0-134-229 kubenswrapper[2574]: I0603 13:56:06.787021 2574 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"kube-root-ca.crt\"" Jun 03 13:56:06.787294 ip-10-0-134-229 kubenswrapper[2574]: I0603 13:56:06.787281 2574 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"default-ingress-cert\"" Jun 03 13:56:06.787368 ip-10-0-134-229 kubenswrapper[2574]: I0603 13:56:06.787303 2574 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"openshift-service-ca.crt\"" Jun 03 13:56:06.797949 ip-10-0-134-229 kubenswrapper[2574]: I0603 13:56:06.797924 2574 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/router-default-7595fc69d5-8sg6s"] Jun 03 13:56:06.909844 ip-10-0-134-229 kubenswrapper[2574]: I0603 13:56:06.907473 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/8e495886-d0ff-45fd-b366-4f1758ae8c96-metrics-certs\") pod \"router-default-7595fc69d5-8sg6s\" (UID: \"8e495886-d0ff-45fd-b366-4f1758ae8c96\") " pod="openshift-ingress/router-default-7595fc69d5-8sg6s" Jun 03 13:56:06.909844 ip-10-0-134-229 kubenswrapper[2574]: I0603 13:56:06.907546 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"default-certificate\" (UniqueName: \"kubernetes.io/secret/8e495886-d0ff-45fd-b366-4f1758ae8c96-default-certificate\") pod \"router-default-7595fc69d5-8sg6s\" (UID: \"8e495886-d0ff-45fd-b366-4f1758ae8c96\") " pod="openshift-ingress/router-default-7595fc69d5-8sg6s" Jun 03 13:56:06.909844 ip-10-0-134-229 kubenswrapper[2574]: I0603 13:56:06.907611 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/8e495886-d0ff-45fd-b366-4f1758ae8c96-service-ca-bundle\") pod \"router-default-7595fc69d5-8sg6s\" (UID: \"8e495886-d0ff-45fd-b366-4f1758ae8c96\") " pod="openshift-ingress/router-default-7595fc69d5-8sg6s" Jun 03 13:56:06.909844 ip-10-0-134-229 kubenswrapper[2574]: I0603 13:56:06.907641 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"stats-auth\" (UniqueName: \"kubernetes.io/secret/8e495886-d0ff-45fd-b366-4f1758ae8c96-stats-auth\") pod \"router-default-7595fc69d5-8sg6s\" (UID: \"8e495886-d0ff-45fd-b366-4f1758ae8c96\") " pod="openshift-ingress/router-default-7595fc69d5-8sg6s" Jun 03 13:56:06.909844 ip-10-0-134-229 kubenswrapper[2574]: I0603 13:56:06.907681 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-rzddv\" (UniqueName: \"kubernetes.io/projected/8e495886-d0ff-45fd-b366-4f1758ae8c96-kube-api-access-rzddv\") pod \"router-default-7595fc69d5-8sg6s\" (UID: \"8e495886-d0ff-45fd-b366-4f1758ae8c96\") " pod="openshift-ingress/router-default-7595fc69d5-8sg6s" Jun 03 13:56:07.008569 ip-10-0-134-229 kubenswrapper[2574]: I0603 13:56:07.008533 2574 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/8e495886-d0ff-45fd-b366-4f1758ae8c96-metrics-certs\") pod \"router-default-7595fc69d5-8sg6s\" (UID: \"8e495886-d0ff-45fd-b366-4f1758ae8c96\") " pod="openshift-ingress/router-default-7595fc69d5-8sg6s" Jun 03 13:56:07.008649 ip-10-0-134-229 kubenswrapper[2574]: I0603 13:56:07.008582 2574 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"default-certificate\" (UniqueName: \"kubernetes.io/secret/8e495886-d0ff-45fd-b366-4f1758ae8c96-default-certificate\") pod \"router-default-7595fc69d5-8sg6s\" (UID: \"8e495886-d0ff-45fd-b366-4f1758ae8c96\") " pod="openshift-ingress/router-default-7595fc69d5-8sg6s" Jun 03 13:56:07.008649 ip-10-0-134-229 kubenswrapper[2574]: I0603 13:56:07.008612 2574 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/8e495886-d0ff-45fd-b366-4f1758ae8c96-service-ca-bundle\") pod \"router-default-7595fc69d5-8sg6s\" (UID: \"8e495886-d0ff-45fd-b366-4f1758ae8c96\") " pod="openshift-ingress/router-default-7595fc69d5-8sg6s" Jun 03 13:56:07.008649 ip-10-0-134-229 kubenswrapper[2574]: I0603 13:56:07.008627 2574 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"stats-auth\" (UniqueName: \"kubernetes.io/secret/8e495886-d0ff-45fd-b366-4f1758ae8c96-stats-auth\") pod \"router-default-7595fc69d5-8sg6s\" (UID: \"8e495886-d0ff-45fd-b366-4f1758ae8c96\") " pod="openshift-ingress/router-default-7595fc69d5-8sg6s" Jun 03 13:56:07.008649 ip-10-0-134-229 kubenswrapper[2574]: I0603 13:56:07.008646 2574 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-rzddv\" (UniqueName: \"kubernetes.io/projected/8e495886-d0ff-45fd-b366-4f1758ae8c96-kube-api-access-rzddv\") pod \"router-default-7595fc69d5-8sg6s\" (UID: \"8e495886-d0ff-45fd-b366-4f1758ae8c96\") " pod="openshift-ingress/router-default-7595fc69d5-8sg6s" Jun 03 13:56:07.008833 ip-10-0-134-229 kubenswrapper[2574]: E0603 13:56:07.008691 2574 secret.go:189] Couldn't get secret openshift-ingress/router-metrics-certs-default: secret "router-metrics-certs-default" not found Jun 03 13:56:07.008833 ip-10-0-134-229 kubenswrapper[2574]: E0603 13:56:07.008777 2574 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/8e495886-d0ff-45fd-b366-4f1758ae8c96-metrics-certs podName:8e495886-d0ff-45fd-b366-4f1758ae8c96 nodeName:}" failed. No retries permitted until 2026-06-03 13:56:07.508756998 +0000 UTC m=+128.692764309 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/8e495886-d0ff-45fd-b366-4f1758ae8c96-metrics-certs") pod "router-default-7595fc69d5-8sg6s" (UID: "8e495886-d0ff-45fd-b366-4f1758ae8c96") : secret "router-metrics-certs-default" not found Jun 03 13:56:07.008833 ip-10-0-134-229 kubenswrapper[2574]: E0603 13:56:07.008813 2574 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/8e495886-d0ff-45fd-b366-4f1758ae8c96-service-ca-bundle podName:8e495886-d0ff-45fd-b366-4f1758ae8c96 nodeName:}" failed. No retries permitted until 2026-06-03 13:56:07.508792245 +0000 UTC m=+128.692799576 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "service-ca-bundle" (UniqueName: "kubernetes.io/configmap/8e495886-d0ff-45fd-b366-4f1758ae8c96-service-ca-bundle") pod "router-default-7595fc69d5-8sg6s" (UID: "8e495886-d0ff-45fd-b366-4f1758ae8c96") : configmap references non-existent config key: service-ca.crt Jun 03 13:56:07.011041 ip-10-0-134-229 kubenswrapper[2574]: I0603 13:56:07.011010 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"stats-auth\" (UniqueName: \"kubernetes.io/secret/8e495886-d0ff-45fd-b366-4f1758ae8c96-stats-auth\") pod \"router-default-7595fc69d5-8sg6s\" (UID: \"8e495886-d0ff-45fd-b366-4f1758ae8c96\") " pod="openshift-ingress/router-default-7595fc69d5-8sg6s" Jun 03 13:56:07.011041 ip-10-0-134-229 kubenswrapper[2574]: I0603 13:56:07.011036 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"default-certificate\" (UniqueName: \"kubernetes.io/secret/8e495886-d0ff-45fd-b366-4f1758ae8c96-default-certificate\") pod \"router-default-7595fc69d5-8sg6s\" (UID: \"8e495886-d0ff-45fd-b366-4f1758ae8c96\") " pod="openshift-ingress/router-default-7595fc69d5-8sg6s" Jun 03 13:56:07.017001 ip-10-0-134-229 kubenswrapper[2574]: I0603 13:56:07.016975 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-rzddv\" (UniqueName: \"kubernetes.io/projected/8e495886-d0ff-45fd-b366-4f1758ae8c96-kube-api-access-rzddv\") pod \"router-default-7595fc69d5-8sg6s\" (UID: \"8e495886-d0ff-45fd-b366-4f1758ae8c96\") " pod="openshift-ingress/router-default-7595fc69d5-8sg6s" Jun 03 13:56:07.511230 ip-10-0-134-229 kubenswrapper[2574]: I0603 13:56:07.511186 2574 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/8e495886-d0ff-45fd-b366-4f1758ae8c96-metrics-certs\") pod \"router-default-7595fc69d5-8sg6s\" (UID: \"8e495886-d0ff-45fd-b366-4f1758ae8c96\") " pod="openshift-ingress/router-default-7595fc69d5-8sg6s" Jun 03 13:56:07.511424 ip-10-0-134-229 kubenswrapper[2574]: I0603 13:56:07.511256 2574 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/8e495886-d0ff-45fd-b366-4f1758ae8c96-service-ca-bundle\") pod \"router-default-7595fc69d5-8sg6s\" (UID: \"8e495886-d0ff-45fd-b366-4f1758ae8c96\") " pod="openshift-ingress/router-default-7595fc69d5-8sg6s" Jun 03 13:56:07.511424 ip-10-0-134-229 kubenswrapper[2574]: E0603 13:56:07.511322 2574 secret.go:189] Couldn't get secret openshift-ingress/router-metrics-certs-default: secret "router-metrics-certs-default" not found Jun 03 13:56:07.511424 ip-10-0-134-229 kubenswrapper[2574]: E0603 13:56:07.511414 2574 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/8e495886-d0ff-45fd-b366-4f1758ae8c96-metrics-certs podName:8e495886-d0ff-45fd-b366-4f1758ae8c96 nodeName:}" failed. No retries permitted until 2026-06-03 13:56:08.511398371 +0000 UTC m=+129.695405679 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/8e495886-d0ff-45fd-b366-4f1758ae8c96-metrics-certs") pod "router-default-7595fc69d5-8sg6s" (UID: "8e495886-d0ff-45fd-b366-4f1758ae8c96") : secret "router-metrics-certs-default" not found Jun 03 13:56:07.511539 ip-10-0-134-229 kubenswrapper[2574]: E0603 13:56:07.511427 2574 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/8e495886-d0ff-45fd-b366-4f1758ae8c96-service-ca-bundle podName:8e495886-d0ff-45fd-b366-4f1758ae8c96 nodeName:}" failed. No retries permitted until 2026-06-03 13:56:08.511421258 +0000 UTC m=+129.695428566 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "service-ca-bundle" (UniqueName: "kubernetes.io/configmap/8e495886-d0ff-45fd-b366-4f1758ae8c96-service-ca-bundle") pod "router-default-7595fc69d5-8sg6s" (UID: "8e495886-d0ff-45fd-b366-4f1758ae8c96") : configmap references non-existent config key: service-ca.crt Jun 03 13:56:08.518091 ip-10-0-134-229 kubenswrapper[2574]: I0603 13:56:08.518041 2574 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/8e495886-d0ff-45fd-b366-4f1758ae8c96-metrics-certs\") pod \"router-default-7595fc69d5-8sg6s\" (UID: \"8e495886-d0ff-45fd-b366-4f1758ae8c96\") " pod="openshift-ingress/router-default-7595fc69d5-8sg6s" Jun 03 13:56:08.518571 ip-10-0-134-229 kubenswrapper[2574]: I0603 13:56:08.518110 2574 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/8e495886-d0ff-45fd-b366-4f1758ae8c96-service-ca-bundle\") pod \"router-default-7595fc69d5-8sg6s\" (UID: \"8e495886-d0ff-45fd-b366-4f1758ae8c96\") " pod="openshift-ingress/router-default-7595fc69d5-8sg6s" Jun 03 13:56:08.518571 ip-10-0-134-229 kubenswrapper[2574]: E0603 13:56:08.518194 2574 secret.go:189] Couldn't get secret openshift-ingress/router-metrics-certs-default: secret "router-metrics-certs-default" not found Jun 03 13:56:08.518571 ip-10-0-134-229 kubenswrapper[2574]: E0603 13:56:08.518259 2574 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/8e495886-d0ff-45fd-b366-4f1758ae8c96-metrics-certs podName:8e495886-d0ff-45fd-b366-4f1758ae8c96 nodeName:}" failed. No retries permitted until 2026-06-03 13:56:10.518242786 +0000 UTC m=+131.702250100 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/8e495886-d0ff-45fd-b366-4f1758ae8c96-metrics-certs") pod "router-default-7595fc69d5-8sg6s" (UID: "8e495886-d0ff-45fd-b366-4f1758ae8c96") : secret "router-metrics-certs-default" not found Jun 03 13:56:08.518571 ip-10-0-134-229 kubenswrapper[2574]: E0603 13:56:08.518298 2574 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/8e495886-d0ff-45fd-b366-4f1758ae8c96-service-ca-bundle podName:8e495886-d0ff-45fd-b366-4f1758ae8c96 nodeName:}" failed. No retries permitted until 2026-06-03 13:56:10.518274244 +0000 UTC m=+131.702281569 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "service-ca-bundle" (UniqueName: "kubernetes.io/configmap/8e495886-d0ff-45fd-b366-4f1758ae8c96-service-ca-bundle") pod "router-default-7595fc69d5-8sg6s" (UID: "8e495886-d0ff-45fd-b366-4f1758ae8c96") : configmap references non-existent config key: service-ca.crt Jun 03 13:56:09.122365 ip-10-0-134-229 kubenswrapper[2574]: I0603 13:56:09.122329 2574 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/6f47d39b-6eb0-4d5f-921b-0d56c194113e-metrics-certs\") pod \"network-metrics-daemon-9f7k7\" (UID: \"6f47d39b-6eb0-4d5f-921b-0d56c194113e\") " pod="openshift-multus/network-metrics-daemon-9f7k7" Jun 03 13:56:09.122550 ip-10-0-134-229 kubenswrapper[2574]: E0603 13:56:09.122479 2574 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: secret "metrics-daemon-secret" not found Jun 03 13:56:09.122550 ip-10-0-134-229 kubenswrapper[2574]: E0603 13:56:09.122542 2574 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/6f47d39b-6eb0-4d5f-921b-0d56c194113e-metrics-certs podName:6f47d39b-6eb0-4d5f-921b-0d56c194113e nodeName:}" failed. No retries permitted until 2026-06-03 13:58:11.122525574 +0000 UTC m=+252.306532882 (durationBeforeRetry 2m2s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/6f47d39b-6eb0-4d5f-921b-0d56c194113e-metrics-certs") pod "network-metrics-daemon-9f7k7" (UID: "6f47d39b-6eb0-4d5f-921b-0d56c194113e") : secret "metrics-daemon-secret" not found Jun 03 13:56:10.531430 ip-10-0-134-229 kubenswrapper[2574]: I0603 13:56:10.531400 2574 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/8e495886-d0ff-45fd-b366-4f1758ae8c96-metrics-certs\") pod \"router-default-7595fc69d5-8sg6s\" (UID: \"8e495886-d0ff-45fd-b366-4f1758ae8c96\") " pod="openshift-ingress/router-default-7595fc69d5-8sg6s" Jun 03 13:56:10.531806 ip-10-0-134-229 kubenswrapper[2574]: I0603 13:56:10.531451 2574 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/8e495886-d0ff-45fd-b366-4f1758ae8c96-service-ca-bundle\") pod \"router-default-7595fc69d5-8sg6s\" (UID: \"8e495886-d0ff-45fd-b366-4f1758ae8c96\") " pod="openshift-ingress/router-default-7595fc69d5-8sg6s" Jun 03 13:56:10.531806 ip-10-0-134-229 kubenswrapper[2574]: E0603 13:56:10.531529 2574 secret.go:189] Couldn't get secret openshift-ingress/router-metrics-certs-default: secret "router-metrics-certs-default" not found Jun 03 13:56:10.531806 ip-10-0-134-229 kubenswrapper[2574]: E0603 13:56:10.531564 2574 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/8e495886-d0ff-45fd-b366-4f1758ae8c96-service-ca-bundle podName:8e495886-d0ff-45fd-b366-4f1758ae8c96 nodeName:}" failed. No retries permitted until 2026-06-03 13:56:14.531550829 +0000 UTC m=+135.715558136 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "service-ca-bundle" (UniqueName: "kubernetes.io/configmap/8e495886-d0ff-45fd-b366-4f1758ae8c96-service-ca-bundle") pod "router-default-7595fc69d5-8sg6s" (UID: "8e495886-d0ff-45fd-b366-4f1758ae8c96") : configmap references non-existent config key: service-ca.crt Jun 03 13:56:10.531806 ip-10-0-134-229 kubenswrapper[2574]: E0603 13:56:10.531578 2574 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/8e495886-d0ff-45fd-b366-4f1758ae8c96-metrics-certs podName:8e495886-d0ff-45fd-b366-4f1758ae8c96 nodeName:}" failed. No retries permitted until 2026-06-03 13:56:14.531571774 +0000 UTC m=+135.715579081 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/8e495886-d0ff-45fd-b366-4f1758ae8c96-metrics-certs") pod "router-default-7595fc69d5-8sg6s" (UID: "8e495886-d0ff-45fd-b366-4f1758ae8c96") : secret "router-metrics-certs-default" not found Jun 03 13:56:10.733852 ip-10-0-134-229 kubenswrapper[2574]: I0603 13:56:10.733818 2574 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-cluster-samples-operator/cluster-samples-operator-755bbf9bfb-nc585"] Jun 03 13:56:10.736080 ip-10-0-134-229 kubenswrapper[2574]: I0603 13:56:10.736062 2574 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-cluster-storage-operator/volume-data-source-validator-7598fd5bd-2kwr2"] Jun 03 13:56:10.736221 ip-10-0-134-229 kubenswrapper[2574]: I0603 13:56:10.736203 2574 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-samples-operator/cluster-samples-operator-755bbf9bfb-nc585" Jun 03 13:56:10.738129 ip-10-0-134-229 kubenswrapper[2574]: I0603 13:56:10.738108 2574 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-storage-operator/volume-data-source-validator-7598fd5bd-2kwr2" Jun 03 13:56:10.738554 ip-10-0-134-229 kubenswrapper[2574]: I0603 13:56:10.738538 2574 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-samples-operator\"/\"openshift-service-ca.crt\"" Jun 03 13:56:10.738639 ip-10-0-134-229 kubenswrapper[2574]: I0603 13:56:10.738623 2574 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-samples-operator\"/\"samples-operator-tls\"" Jun 03 13:56:10.738639 ip-10-0-134-229 kubenswrapper[2574]: I0603 13:56:10.738632 2574 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-samples-operator\"/\"cluster-samples-operator-dockercfg-2w66p\"" Jun 03 13:56:10.738723 ip-10-0-134-229 kubenswrapper[2574]: I0603 13:56:10.738670 2574 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-samples-operator\"/\"kube-root-ca.crt\"" Jun 03 13:56:10.740155 ip-10-0-134-229 kubenswrapper[2574]: I0603 13:56:10.740137 2574 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-storage-operator\"/\"openshift-service-ca.crt\"" Jun 03 13:56:10.740720 ip-10-0-134-229 kubenswrapper[2574]: I0603 13:56:10.740701 2574 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-storage-operator\"/\"kube-root-ca.crt\"" Jun 03 13:56:10.740812 ip-10-0-134-229 kubenswrapper[2574]: I0603 13:56:10.740774 2574 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-storage-operator\"/\"volume-data-source-validator-dockercfg-6ndrk\"" Jun 03 13:56:10.748735 ip-10-0-134-229 kubenswrapper[2574]: I0603 13:56:10.748713 2574 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-cluster-samples-operator/cluster-samples-operator-755bbf9bfb-nc585"] Jun 03 13:56:10.749671 ip-10-0-134-229 kubenswrapper[2574]: I0603 13:56:10.749654 2574 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-cluster-storage-operator/volume-data-source-validator-7598fd5bd-2kwr2"] Jun 03 13:56:10.833139 ip-10-0-134-229 kubenswrapper[2574]: I0603 13:56:10.833070 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-jp4ww\" (UniqueName: \"kubernetes.io/projected/0c8c9951-8478-4b84-887d-e49f6669f21f-kube-api-access-jp4ww\") pod \"volume-data-source-validator-7598fd5bd-2kwr2\" (UID: \"0c8c9951-8478-4b84-887d-e49f6669f21f\") " pod="openshift-cluster-storage-operator/volume-data-source-validator-7598fd5bd-2kwr2" Jun 03 13:56:10.833139 ip-10-0-134-229 kubenswrapper[2574]: I0603 13:56:10.833111 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/12f58cc7-5bbe-40ce-aec5-8bb255c37241-samples-operator-tls\") pod \"cluster-samples-operator-755bbf9bfb-nc585\" (UID: \"12f58cc7-5bbe-40ce-aec5-8bb255c37241\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-755bbf9bfb-nc585" Jun 03 13:56:10.833337 ip-10-0-134-229 kubenswrapper[2574]: I0603 13:56:10.833152 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-cd58l\" (UniqueName: \"kubernetes.io/projected/12f58cc7-5bbe-40ce-aec5-8bb255c37241-kube-api-access-cd58l\") pod \"cluster-samples-operator-755bbf9bfb-nc585\" (UID: \"12f58cc7-5bbe-40ce-aec5-8bb255c37241\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-755bbf9bfb-nc585" Jun 03 13:56:10.934140 ip-10-0-134-229 kubenswrapper[2574]: I0603 13:56:10.934100 2574 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-jp4ww\" (UniqueName: \"kubernetes.io/projected/0c8c9951-8478-4b84-887d-e49f6669f21f-kube-api-access-jp4ww\") pod \"volume-data-source-validator-7598fd5bd-2kwr2\" (UID: \"0c8c9951-8478-4b84-887d-e49f6669f21f\") " pod="openshift-cluster-storage-operator/volume-data-source-validator-7598fd5bd-2kwr2" Jun 03 13:56:10.934278 ip-10-0-134-229 kubenswrapper[2574]: I0603 13:56:10.934154 2574 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/12f58cc7-5bbe-40ce-aec5-8bb255c37241-samples-operator-tls\") pod \"cluster-samples-operator-755bbf9bfb-nc585\" (UID: \"12f58cc7-5bbe-40ce-aec5-8bb255c37241\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-755bbf9bfb-nc585" Jun 03 13:56:10.934278 ip-10-0-134-229 kubenswrapper[2574]: I0603 13:56:10.934202 2574 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-cd58l\" (UniqueName: \"kubernetes.io/projected/12f58cc7-5bbe-40ce-aec5-8bb255c37241-kube-api-access-cd58l\") pod \"cluster-samples-operator-755bbf9bfb-nc585\" (UID: \"12f58cc7-5bbe-40ce-aec5-8bb255c37241\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-755bbf9bfb-nc585" Jun 03 13:56:10.934409 ip-10-0-134-229 kubenswrapper[2574]: E0603 13:56:10.934333 2574 secret.go:189] Couldn't get secret openshift-cluster-samples-operator/samples-operator-tls: secret "samples-operator-tls" not found Jun 03 13:56:10.934475 ip-10-0-134-229 kubenswrapper[2574]: E0603 13:56:10.934433 2574 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/12f58cc7-5bbe-40ce-aec5-8bb255c37241-samples-operator-tls podName:12f58cc7-5bbe-40ce-aec5-8bb255c37241 nodeName:}" failed. No retries permitted until 2026-06-03 13:56:11.434410426 +0000 UTC m=+132.618417733 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "samples-operator-tls" (UniqueName: "kubernetes.io/secret/12f58cc7-5bbe-40ce-aec5-8bb255c37241-samples-operator-tls") pod "cluster-samples-operator-755bbf9bfb-nc585" (UID: "12f58cc7-5bbe-40ce-aec5-8bb255c37241") : secret "samples-operator-tls" not found Jun 03 13:56:10.944984 ip-10-0-134-229 kubenswrapper[2574]: I0603 13:56:10.944958 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-cd58l\" (UniqueName: \"kubernetes.io/projected/12f58cc7-5bbe-40ce-aec5-8bb255c37241-kube-api-access-cd58l\") pod \"cluster-samples-operator-755bbf9bfb-nc585\" (UID: \"12f58cc7-5bbe-40ce-aec5-8bb255c37241\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-755bbf9bfb-nc585" Jun 03 13:56:10.945305 ip-10-0-134-229 kubenswrapper[2574]: I0603 13:56:10.945287 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-jp4ww\" (UniqueName: \"kubernetes.io/projected/0c8c9951-8478-4b84-887d-e49f6669f21f-kube-api-access-jp4ww\") pod \"volume-data-source-validator-7598fd5bd-2kwr2\" (UID: \"0c8c9951-8478-4b84-887d-e49f6669f21f\") " pod="openshift-cluster-storage-operator/volume-data-source-validator-7598fd5bd-2kwr2" Jun 03 13:56:11.051598 ip-10-0-134-229 kubenswrapper[2574]: I0603 13:56:11.051568 2574 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-storage-operator/volume-data-source-validator-7598fd5bd-2kwr2" Jun 03 13:56:11.168652 ip-10-0-134-229 kubenswrapper[2574]: I0603 13:56:11.168620 2574 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-cluster-storage-operator/volume-data-source-validator-7598fd5bd-2kwr2"] Jun 03 13:56:11.172922 ip-10-0-134-229 kubenswrapper[2574]: W0603 13:56:11.172888 2574 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod0c8c9951_8478_4b84_887d_e49f6669f21f.slice/crio-4321dfe197163665fba0b95448eeffb9f3a3e9583a492e856df0af9f4009361a WatchSource:0}: Error finding container 4321dfe197163665fba0b95448eeffb9f3a3e9583a492e856df0af9f4009361a: Status 404 returned error can't find the container with id 4321dfe197163665fba0b95448eeffb9f3a3e9583a492e856df0af9f4009361a Jun 03 13:56:11.437176 ip-10-0-134-229 kubenswrapper[2574]: I0603 13:56:11.437148 2574 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/12f58cc7-5bbe-40ce-aec5-8bb255c37241-samples-operator-tls\") pod \"cluster-samples-operator-755bbf9bfb-nc585\" (UID: \"12f58cc7-5bbe-40ce-aec5-8bb255c37241\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-755bbf9bfb-nc585" Jun 03 13:56:11.437313 ip-10-0-134-229 kubenswrapper[2574]: E0603 13:56:11.437296 2574 secret.go:189] Couldn't get secret openshift-cluster-samples-operator/samples-operator-tls: secret "samples-operator-tls" not found Jun 03 13:56:11.437387 ip-10-0-134-229 kubenswrapper[2574]: E0603 13:56:11.437366 2574 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/12f58cc7-5bbe-40ce-aec5-8bb255c37241-samples-operator-tls podName:12f58cc7-5bbe-40ce-aec5-8bb255c37241 nodeName:}" failed. No retries permitted until 2026-06-03 13:56:12.437347947 +0000 UTC m=+133.621355274 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "samples-operator-tls" (UniqueName: "kubernetes.io/secret/12f58cc7-5bbe-40ce-aec5-8bb255c37241-samples-operator-tls") pod "cluster-samples-operator-755bbf9bfb-nc585" (UID: "12f58cc7-5bbe-40ce-aec5-8bb255c37241") : secret "samples-operator-tls" not found Jun 03 13:56:11.838331 ip-10-0-134-229 kubenswrapper[2574]: I0603 13:56:11.838256 2574 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-storage-operator/volume-data-source-validator-7598fd5bd-2kwr2" event={"ID":"0c8c9951-8478-4b84-887d-e49f6669f21f","Type":"ContainerStarted","Data":"4321dfe197163665fba0b95448eeffb9f3a3e9583a492e856df0af9f4009361a"} Jun 03 13:56:12.424273 ip-10-0-134-229 kubenswrapper[2574]: I0603 13:56:12.424243 2574 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_node-resolver-pc2nh_aaa611e0-e507-419d-8a90-f692f2d26ee5/dns-node-resolver/0.log" Jun 03 13:56:12.445539 ip-10-0-134-229 kubenswrapper[2574]: I0603 13:56:12.445503 2574 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/12f58cc7-5bbe-40ce-aec5-8bb255c37241-samples-operator-tls\") pod \"cluster-samples-operator-755bbf9bfb-nc585\" (UID: \"12f58cc7-5bbe-40ce-aec5-8bb255c37241\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-755bbf9bfb-nc585" Jun 03 13:56:12.445678 ip-10-0-134-229 kubenswrapper[2574]: E0603 13:56:12.445624 2574 secret.go:189] Couldn't get secret openshift-cluster-samples-operator/samples-operator-tls: secret "samples-operator-tls" not found Jun 03 13:56:12.445731 ip-10-0-134-229 kubenswrapper[2574]: E0603 13:56:12.445680 2574 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/12f58cc7-5bbe-40ce-aec5-8bb255c37241-samples-operator-tls podName:12f58cc7-5bbe-40ce-aec5-8bb255c37241 nodeName:}" failed. No retries permitted until 2026-06-03 13:56:14.445665737 +0000 UTC m=+135.629673043 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "samples-operator-tls" (UniqueName: "kubernetes.io/secret/12f58cc7-5bbe-40ce-aec5-8bb255c37241-samples-operator-tls") pod "cluster-samples-operator-755bbf9bfb-nc585" (UID: "12f58cc7-5bbe-40ce-aec5-8bb255c37241") : secret "samples-operator-tls" not found Jun 03 13:56:13.025823 ip-10-0-134-229 kubenswrapper[2574]: I0603 13:56:13.025803 2574 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_node-ca-7ql52_5e68f084-d02c-4757-9842-1c01178fcfcb/node-ca/0.log" Jun 03 13:56:13.843655 ip-10-0-134-229 kubenswrapper[2574]: I0603 13:56:13.843618 2574 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-storage-operator/volume-data-source-validator-7598fd5bd-2kwr2" event={"ID":"0c8c9951-8478-4b84-887d-e49f6669f21f","Type":"ContainerStarted","Data":"c9e67274d0e4b3706a9eae2a1382769216e8c6afee1b49c868b203954e82abaa"} Jun 03 13:56:13.860602 ip-10-0-134-229 kubenswrapper[2574]: I0603 13:56:13.860507 2574 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-cluster-storage-operator/volume-data-source-validator-7598fd5bd-2kwr2" podStartSLOduration=2.102128738 podStartE2EDuration="3.860495133s" podCreationTimestamp="2026-06-03 13:56:10 +0000 UTC" firstStartedPulling="2026-06-03 13:56:11.174650079 +0000 UTC m=+132.358657386" lastFinishedPulling="2026-06-03 13:56:12.933016474 +0000 UTC m=+134.117023781" observedRunningTime="2026-06-03 13:56:13.859856298 +0000 UTC m=+135.043863626" watchObservedRunningTime="2026-06-03 13:56:13.860495133 +0000 UTC m=+135.044502516" Jun 03 13:56:14.461236 ip-10-0-134-229 kubenswrapper[2574]: I0603 13:56:14.461191 2574 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/12f58cc7-5bbe-40ce-aec5-8bb255c37241-samples-operator-tls\") pod \"cluster-samples-operator-755bbf9bfb-nc585\" (UID: \"12f58cc7-5bbe-40ce-aec5-8bb255c37241\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-755bbf9bfb-nc585" Jun 03 13:56:14.461634 ip-10-0-134-229 kubenswrapper[2574]: E0603 13:56:14.461327 2574 secret.go:189] Couldn't get secret openshift-cluster-samples-operator/samples-operator-tls: secret "samples-operator-tls" not found Jun 03 13:56:14.461634 ip-10-0-134-229 kubenswrapper[2574]: E0603 13:56:14.461407 2574 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/12f58cc7-5bbe-40ce-aec5-8bb255c37241-samples-operator-tls podName:12f58cc7-5bbe-40ce-aec5-8bb255c37241 nodeName:}" failed. No retries permitted until 2026-06-03 13:56:18.461386655 +0000 UTC m=+139.645393974 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "samples-operator-tls" (UniqueName: "kubernetes.io/secret/12f58cc7-5bbe-40ce-aec5-8bb255c37241-samples-operator-tls") pod "cluster-samples-operator-755bbf9bfb-nc585" (UID: "12f58cc7-5bbe-40ce-aec5-8bb255c37241") : secret "samples-operator-tls" not found Jun 03 13:56:14.562011 ip-10-0-134-229 kubenswrapper[2574]: I0603 13:56:14.561961 2574 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/8e495886-d0ff-45fd-b366-4f1758ae8c96-service-ca-bundle\") pod \"router-default-7595fc69d5-8sg6s\" (UID: \"8e495886-d0ff-45fd-b366-4f1758ae8c96\") " pod="openshift-ingress/router-default-7595fc69d5-8sg6s" Jun 03 13:56:14.562173 ip-10-0-134-229 kubenswrapper[2574]: I0603 13:56:14.562037 2574 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/8e495886-d0ff-45fd-b366-4f1758ae8c96-metrics-certs\") pod \"router-default-7595fc69d5-8sg6s\" (UID: \"8e495886-d0ff-45fd-b366-4f1758ae8c96\") " pod="openshift-ingress/router-default-7595fc69d5-8sg6s" Jun 03 13:56:14.562173 ip-10-0-134-229 kubenswrapper[2574]: E0603 13:56:14.562133 2574 secret.go:189] Couldn't get secret openshift-ingress/router-metrics-certs-default: secret "router-metrics-certs-default" not found Jun 03 13:56:14.562173 ip-10-0-134-229 kubenswrapper[2574]: E0603 13:56:14.562144 2574 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/8e495886-d0ff-45fd-b366-4f1758ae8c96-service-ca-bundle podName:8e495886-d0ff-45fd-b366-4f1758ae8c96 nodeName:}" failed. No retries permitted until 2026-06-03 13:56:22.562125387 +0000 UTC m=+143.746132707 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "service-ca-bundle" (UniqueName: "kubernetes.io/configmap/8e495886-d0ff-45fd-b366-4f1758ae8c96-service-ca-bundle") pod "router-default-7595fc69d5-8sg6s" (UID: "8e495886-d0ff-45fd-b366-4f1758ae8c96") : configmap references non-existent config key: service-ca.crt Jun 03 13:56:14.562283 ip-10-0-134-229 kubenswrapper[2574]: E0603 13:56:14.562188 2574 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/8e495886-d0ff-45fd-b366-4f1758ae8c96-metrics-certs podName:8e495886-d0ff-45fd-b366-4f1758ae8c96 nodeName:}" failed. No retries permitted until 2026-06-03 13:56:22.562177233 +0000 UTC m=+143.746184540 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/8e495886-d0ff-45fd-b366-4f1758ae8c96-metrics-certs") pod "router-default-7595fc69d5-8sg6s" (UID: "8e495886-d0ff-45fd-b366-4f1758ae8c96") : secret "router-metrics-certs-default" not found Jun 03 13:56:15.733529 ip-10-0-134-229 kubenswrapper[2574]: I0603 13:56:15.733499 2574 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-96ddc787c-42dw4"] Jun 03 13:56:15.736266 ip-10-0-134-229 kubenswrapper[2574]: I0603 13:56:15.736247 2574 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-96ddc787c-42dw4" Jun 03 13:56:15.738709 ip-10-0-134-229 kubenswrapper[2574]: I0603 13:56:15.738687 2574 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-kube-storage-version-migrator-operator\"/\"config\"" Jun 03 13:56:15.738709 ip-10-0-134-229 kubenswrapper[2574]: I0603 13:56:15.738687 2574 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-kube-storage-version-migrator-operator\"/\"openshift-service-ca.crt\"" Jun 03 13:56:15.738845 ip-10-0-134-229 kubenswrapper[2574]: I0603 13:56:15.738687 2574 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-kube-storage-version-migrator-operator\"/\"serving-cert\"" Jun 03 13:56:15.738845 ip-10-0-134-229 kubenswrapper[2574]: I0603 13:56:15.738783 2574 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-kube-storage-version-migrator-operator\"/\"kube-root-ca.crt\"" Jun 03 13:56:15.739124 ip-10-0-134-229 kubenswrapper[2574]: I0603 13:56:15.739110 2574 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-kube-storage-version-migrator-operator\"/\"kube-storage-version-migrator-operator-dockercfg-dgjsq\"" Jun 03 13:56:15.746665 ip-10-0-134-229 kubenswrapper[2574]: I0603 13:56:15.746642 2574 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-96ddc787c-42dw4"] Jun 03 13:56:15.871257 ip-10-0-134-229 kubenswrapper[2574]: I0603 13:56:15.871233 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-8zltd\" (UniqueName: \"kubernetes.io/projected/cdfc9d22-1eec-4221-9c0f-c128485c764a-kube-api-access-8zltd\") pod \"kube-storage-version-migrator-operator-96ddc787c-42dw4\" (UID: \"cdfc9d22-1eec-4221-9c0f-c128485c764a\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-96ddc787c-42dw4" Jun 03 13:56:15.871402 ip-10-0-134-229 kubenswrapper[2574]: I0603 13:56:15.871265 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/cdfc9d22-1eec-4221-9c0f-c128485c764a-serving-cert\") pod \"kube-storage-version-migrator-operator-96ddc787c-42dw4\" (UID: \"cdfc9d22-1eec-4221-9c0f-c128485c764a\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-96ddc787c-42dw4" Jun 03 13:56:15.871402 ip-10-0-134-229 kubenswrapper[2574]: I0603 13:56:15.871291 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/cdfc9d22-1eec-4221-9c0f-c128485c764a-config\") pod \"kube-storage-version-migrator-operator-96ddc787c-42dw4\" (UID: \"cdfc9d22-1eec-4221-9c0f-c128485c764a\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-96ddc787c-42dw4" Jun 03 13:56:15.972224 ip-10-0-134-229 kubenswrapper[2574]: I0603 13:56:15.972194 2574 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-8zltd\" (UniqueName: \"kubernetes.io/projected/cdfc9d22-1eec-4221-9c0f-c128485c764a-kube-api-access-8zltd\") pod \"kube-storage-version-migrator-operator-96ddc787c-42dw4\" (UID: \"cdfc9d22-1eec-4221-9c0f-c128485c764a\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-96ddc787c-42dw4" Jun 03 13:56:15.972329 ip-10-0-134-229 kubenswrapper[2574]: I0603 13:56:15.972231 2574 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/cdfc9d22-1eec-4221-9c0f-c128485c764a-serving-cert\") pod \"kube-storage-version-migrator-operator-96ddc787c-42dw4\" (UID: \"cdfc9d22-1eec-4221-9c0f-c128485c764a\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-96ddc787c-42dw4" Jun 03 13:56:15.972329 ip-10-0-134-229 kubenswrapper[2574]: I0603 13:56:15.972269 2574 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/cdfc9d22-1eec-4221-9c0f-c128485c764a-config\") pod \"kube-storage-version-migrator-operator-96ddc787c-42dw4\" (UID: \"cdfc9d22-1eec-4221-9c0f-c128485c764a\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-96ddc787c-42dw4" Jun 03 13:56:15.972792 ip-10-0-134-229 kubenswrapper[2574]: I0603 13:56:15.972772 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/configmap/cdfc9d22-1eec-4221-9c0f-c128485c764a-config\") pod \"kube-storage-version-migrator-operator-96ddc787c-42dw4\" (UID: \"cdfc9d22-1eec-4221-9c0f-c128485c764a\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-96ddc787c-42dw4" Jun 03 13:56:15.974341 ip-10-0-134-229 kubenswrapper[2574]: I0603 13:56:15.974323 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/cdfc9d22-1eec-4221-9c0f-c128485c764a-serving-cert\") pod \"kube-storage-version-migrator-operator-96ddc787c-42dw4\" (UID: \"cdfc9d22-1eec-4221-9c0f-c128485c764a\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-96ddc787c-42dw4" Jun 03 13:56:15.980424 ip-10-0-134-229 kubenswrapper[2574]: I0603 13:56:15.980400 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-8zltd\" (UniqueName: \"kubernetes.io/projected/cdfc9d22-1eec-4221-9c0f-c128485c764a-kube-api-access-8zltd\") pod \"kube-storage-version-migrator-operator-96ddc787c-42dw4\" (UID: \"cdfc9d22-1eec-4221-9c0f-c128485c764a\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-96ddc787c-42dw4" Jun 03 13:56:16.045011 ip-10-0-134-229 kubenswrapper[2574]: I0603 13:56:16.044956 2574 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-96ddc787c-42dw4" Jun 03 13:56:16.159709 ip-10-0-134-229 kubenswrapper[2574]: I0603 13:56:16.159676 2574 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-96ddc787c-42dw4"] Jun 03 13:56:16.163873 ip-10-0-134-229 kubenswrapper[2574]: W0603 13:56:16.163844 2574 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podcdfc9d22_1eec_4221_9c0f_c128485c764a.slice/crio-ece9a491dbf8085a7d861def93a758177e842745d59cc2cdb147fdfe45aad343 WatchSource:0}: Error finding container ece9a491dbf8085a7d861def93a758177e842745d59cc2cdb147fdfe45aad343: Status 404 returned error can't find the container with id ece9a491dbf8085a7d861def93a758177e842745d59cc2cdb147fdfe45aad343 Jun 03 13:56:16.850636 ip-10-0-134-229 kubenswrapper[2574]: I0603 13:56:16.850591 2574 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-96ddc787c-42dw4" event={"ID":"cdfc9d22-1eec-4221-9c0f-c128485c764a","Type":"ContainerStarted","Data":"ece9a491dbf8085a7d861def93a758177e842745d59cc2cdb147fdfe45aad343"} Jun 03 13:56:17.015852 ip-10-0-134-229 kubenswrapper[2574]: I0603 13:56:17.015819 2574 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-image-registry/image-registry-75c86b6d9c-xcmd7"] Jun 03 13:56:17.018899 ip-10-0-134-229 kubenswrapper[2574]: I0603 13:56:17.018877 2574 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-75c86b6d9c-xcmd7" Jun 03 13:56:17.028326 ip-10-0-134-229 kubenswrapper[2574]: I0603 13:56:17.028289 2574 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"image-registry-tls\"" Jun 03 13:56:17.028764 ip-10-0-134-229 kubenswrapper[2574]: I0603 13:56:17.028743 2574 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"image-registry-private-configuration\"" Jun 03 13:56:17.028861 ip-10-0-134-229 kubenswrapper[2574]: I0603 13:56:17.028743 2574 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"registry-dockercfg-wvjmg\"" Jun 03 13:56:17.028921 ip-10-0-134-229 kubenswrapper[2574]: I0603 13:56:17.028875 2574 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"installation-pull-secrets\"" Jun 03 13:56:17.038774 ip-10-0-134-229 kubenswrapper[2574]: I0603 13:56:17.038754 2574 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-image-registry/image-registry-75c86b6d9c-xcmd7"] Jun 03 13:56:17.038936 ip-10-0-134-229 kubenswrapper[2574]: I0603 13:56:17.038920 2574 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"trusted-ca\"" Jun 03 13:56:17.181290 ip-10-0-134-229 kubenswrapper[2574]: I0603 13:56:17.181257 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/45018365-b30b-4ef0-b920-e0ddc6c71e9b-image-registry-private-configuration\") pod \"image-registry-75c86b6d9c-xcmd7\" (UID: \"45018365-b30b-4ef0-b920-e0ddc6c71e9b\") " pod="openshift-image-registry/image-registry-75c86b6d9c-xcmd7" Jun 03 13:56:17.181290 ip-10-0-134-229 kubenswrapper[2574]: I0603 13:56:17.181295 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/45018365-b30b-4ef0-b920-e0ddc6c71e9b-trusted-ca\") pod \"image-registry-75c86b6d9c-xcmd7\" (UID: \"45018365-b30b-4ef0-b920-e0ddc6c71e9b\") " pod="openshift-image-registry/image-registry-75c86b6d9c-xcmd7" Jun 03 13:56:17.181527 ip-10-0-134-229 kubenswrapper[2574]: I0603 13:56:17.181315 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-dzbqn\" (UniqueName: \"kubernetes.io/projected/45018365-b30b-4ef0-b920-e0ddc6c71e9b-kube-api-access-dzbqn\") pod \"image-registry-75c86b6d9c-xcmd7\" (UID: \"45018365-b30b-4ef0-b920-e0ddc6c71e9b\") " pod="openshift-image-registry/image-registry-75c86b6d9c-xcmd7" Jun 03 13:56:17.181527 ip-10-0-134-229 kubenswrapper[2574]: I0603 13:56:17.181339 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/45018365-b30b-4ef0-b920-e0ddc6c71e9b-bound-sa-token\") pod \"image-registry-75c86b6d9c-xcmd7\" (UID: \"45018365-b30b-4ef0-b920-e0ddc6c71e9b\") " pod="openshift-image-registry/image-registry-75c86b6d9c-xcmd7" Jun 03 13:56:17.181527 ip-10-0-134-229 kubenswrapper[2574]: I0603 13:56:17.181417 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/45018365-b30b-4ef0-b920-e0ddc6c71e9b-registry-certificates\") pod \"image-registry-75c86b6d9c-xcmd7\" (UID: \"45018365-b30b-4ef0-b920-e0ddc6c71e9b\") " pod="openshift-image-registry/image-registry-75c86b6d9c-xcmd7" Jun 03 13:56:17.181527 ip-10-0-134-229 kubenswrapper[2574]: I0603 13:56:17.181473 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/45018365-b30b-4ef0-b920-e0ddc6c71e9b-ca-trust-extracted\") pod \"image-registry-75c86b6d9c-xcmd7\" (UID: \"45018365-b30b-4ef0-b920-e0ddc6c71e9b\") " pod="openshift-image-registry/image-registry-75c86b6d9c-xcmd7" Jun 03 13:56:17.181733 ip-10-0-134-229 kubenswrapper[2574]: I0603 13:56:17.181534 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/45018365-b30b-4ef0-b920-e0ddc6c71e9b-installation-pull-secrets\") pod \"image-registry-75c86b6d9c-xcmd7\" (UID: \"45018365-b30b-4ef0-b920-e0ddc6c71e9b\") " pod="openshift-image-registry/image-registry-75c86b6d9c-xcmd7" Jun 03 13:56:17.181733 ip-10-0-134-229 kubenswrapper[2574]: I0603 13:56:17.181625 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/45018365-b30b-4ef0-b920-e0ddc6c71e9b-registry-tls\") pod \"image-registry-75c86b6d9c-xcmd7\" (UID: \"45018365-b30b-4ef0-b920-e0ddc6c71e9b\") " pod="openshift-image-registry/image-registry-75c86b6d9c-xcmd7" Jun 03 13:56:17.282986 ip-10-0-134-229 kubenswrapper[2574]: I0603 13:56:17.282954 2574 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/45018365-b30b-4ef0-b920-e0ddc6c71e9b-registry-tls\") pod \"image-registry-75c86b6d9c-xcmd7\" (UID: \"45018365-b30b-4ef0-b920-e0ddc6c71e9b\") " pod="openshift-image-registry/image-registry-75c86b6d9c-xcmd7" Jun 03 13:56:17.282986 ip-10-0-134-229 kubenswrapper[2574]: I0603 13:56:17.282991 2574 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/45018365-b30b-4ef0-b920-e0ddc6c71e9b-image-registry-private-configuration\") pod \"image-registry-75c86b6d9c-xcmd7\" (UID: \"45018365-b30b-4ef0-b920-e0ddc6c71e9b\") " pod="openshift-image-registry/image-registry-75c86b6d9c-xcmd7" Jun 03 13:56:17.283228 ip-10-0-134-229 kubenswrapper[2574]: I0603 13:56:17.283008 2574 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/45018365-b30b-4ef0-b920-e0ddc6c71e9b-trusted-ca\") pod \"image-registry-75c86b6d9c-xcmd7\" (UID: \"45018365-b30b-4ef0-b920-e0ddc6c71e9b\") " pod="openshift-image-registry/image-registry-75c86b6d9c-xcmd7" Jun 03 13:56:17.283228 ip-10-0-134-229 kubenswrapper[2574]: I0603 13:56:17.283026 2574 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-dzbqn\" (UniqueName: \"kubernetes.io/projected/45018365-b30b-4ef0-b920-e0ddc6c71e9b-kube-api-access-dzbqn\") pod \"image-registry-75c86b6d9c-xcmd7\" (UID: \"45018365-b30b-4ef0-b920-e0ddc6c71e9b\") " pod="openshift-image-registry/image-registry-75c86b6d9c-xcmd7" Jun 03 13:56:17.283228 ip-10-0-134-229 kubenswrapper[2574]: I0603 13:56:17.283046 2574 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/45018365-b30b-4ef0-b920-e0ddc6c71e9b-bound-sa-token\") pod \"image-registry-75c86b6d9c-xcmd7\" (UID: \"45018365-b30b-4ef0-b920-e0ddc6c71e9b\") " pod="openshift-image-registry/image-registry-75c86b6d9c-xcmd7" Jun 03 13:56:17.283228 ip-10-0-134-229 kubenswrapper[2574]: I0603 13:56:17.283063 2574 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/45018365-b30b-4ef0-b920-e0ddc6c71e9b-registry-certificates\") pod \"image-registry-75c86b6d9c-xcmd7\" (UID: \"45018365-b30b-4ef0-b920-e0ddc6c71e9b\") " pod="openshift-image-registry/image-registry-75c86b6d9c-xcmd7" Jun 03 13:56:17.283228 ip-10-0-134-229 kubenswrapper[2574]: E0603 13:56:17.283119 2574 projected.go:264] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found Jun 03 13:56:17.283228 ip-10-0-134-229 kubenswrapper[2574]: E0603 13:56:17.283142 2574 projected.go:194] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-75c86b6d9c-xcmd7: secret "image-registry-tls" not found Jun 03 13:56:17.283228 ip-10-0-134-229 kubenswrapper[2574]: E0603 13:56:17.283225 2574 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/45018365-b30b-4ef0-b920-e0ddc6c71e9b-registry-tls podName:45018365-b30b-4ef0-b920-e0ddc6c71e9b nodeName:}" failed. No retries permitted until 2026-06-03 13:56:17.783204334 +0000 UTC m=+138.967211655 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/45018365-b30b-4ef0-b920-e0ddc6c71e9b-registry-tls") pod "image-registry-75c86b6d9c-xcmd7" (UID: "45018365-b30b-4ef0-b920-e0ddc6c71e9b") : secret "image-registry-tls" not found Jun 03 13:56:17.283596 ip-10-0-134-229 kubenswrapper[2574]: I0603 13:56:17.283342 2574 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/45018365-b30b-4ef0-b920-e0ddc6c71e9b-ca-trust-extracted\") pod \"image-registry-75c86b6d9c-xcmd7\" (UID: \"45018365-b30b-4ef0-b920-e0ddc6c71e9b\") " pod="openshift-image-registry/image-registry-75c86b6d9c-xcmd7" Jun 03 13:56:17.283596 ip-10-0-134-229 kubenswrapper[2574]: I0603 13:56:17.283415 2574 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/45018365-b30b-4ef0-b920-e0ddc6c71e9b-installation-pull-secrets\") pod \"image-registry-75c86b6d9c-xcmd7\" (UID: \"45018365-b30b-4ef0-b920-e0ddc6c71e9b\") " pod="openshift-image-registry/image-registry-75c86b6d9c-xcmd7" Jun 03 13:56:17.283767 ip-10-0-134-229 kubenswrapper[2574]: I0603 13:56:17.283746 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/45018365-b30b-4ef0-b920-e0ddc6c71e9b-registry-certificates\") pod \"image-registry-75c86b6d9c-xcmd7\" (UID: \"45018365-b30b-4ef0-b920-e0ddc6c71e9b\") " pod="openshift-image-registry/image-registry-75c86b6d9c-xcmd7" Jun 03 13:56:17.283835 ip-10-0-134-229 kubenswrapper[2574]: I0603 13:56:17.283802 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/45018365-b30b-4ef0-b920-e0ddc6c71e9b-ca-trust-extracted\") pod \"image-registry-75c86b6d9c-xcmd7\" (UID: \"45018365-b30b-4ef0-b920-e0ddc6c71e9b\") " pod="openshift-image-registry/image-registry-75c86b6d9c-xcmd7" Jun 03 13:56:17.284026 ip-10-0-134-229 kubenswrapper[2574]: I0603 13:56:17.284005 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/45018365-b30b-4ef0-b920-e0ddc6c71e9b-trusted-ca\") pod \"image-registry-75c86b6d9c-xcmd7\" (UID: \"45018365-b30b-4ef0-b920-e0ddc6c71e9b\") " pod="openshift-image-registry/image-registry-75c86b6d9c-xcmd7" Jun 03 13:56:17.285471 ip-10-0-134-229 kubenswrapper[2574]: I0603 13:56:17.285450 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/45018365-b30b-4ef0-b920-e0ddc6c71e9b-image-registry-private-configuration\") pod \"image-registry-75c86b6d9c-xcmd7\" (UID: \"45018365-b30b-4ef0-b920-e0ddc6c71e9b\") " pod="openshift-image-registry/image-registry-75c86b6d9c-xcmd7" Jun 03 13:56:17.285570 ip-10-0-134-229 kubenswrapper[2574]: I0603 13:56:17.285517 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/45018365-b30b-4ef0-b920-e0ddc6c71e9b-installation-pull-secrets\") pod \"image-registry-75c86b6d9c-xcmd7\" (UID: \"45018365-b30b-4ef0-b920-e0ddc6c71e9b\") " pod="openshift-image-registry/image-registry-75c86b6d9c-xcmd7" Jun 03 13:56:17.294048 ip-10-0-134-229 kubenswrapper[2574]: I0603 13:56:17.294030 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/45018365-b30b-4ef0-b920-e0ddc6c71e9b-bound-sa-token\") pod \"image-registry-75c86b6d9c-xcmd7\" (UID: \"45018365-b30b-4ef0-b920-e0ddc6c71e9b\") " pod="openshift-image-registry/image-registry-75c86b6d9c-xcmd7" Jun 03 13:56:17.294140 ip-10-0-134-229 kubenswrapper[2574]: I0603 13:56:17.294080 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-dzbqn\" (UniqueName: \"kubernetes.io/projected/45018365-b30b-4ef0-b920-e0ddc6c71e9b-kube-api-access-dzbqn\") pod \"image-registry-75c86b6d9c-xcmd7\" (UID: \"45018365-b30b-4ef0-b920-e0ddc6c71e9b\") " pod="openshift-image-registry/image-registry-75c86b6d9c-xcmd7" Jun 03 13:56:17.786703 ip-10-0-134-229 kubenswrapper[2574]: I0603 13:56:17.786660 2574 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/45018365-b30b-4ef0-b920-e0ddc6c71e9b-registry-tls\") pod \"image-registry-75c86b6d9c-xcmd7\" (UID: \"45018365-b30b-4ef0-b920-e0ddc6c71e9b\") " pod="openshift-image-registry/image-registry-75c86b6d9c-xcmd7" Jun 03 13:56:17.786869 ip-10-0-134-229 kubenswrapper[2574]: E0603 13:56:17.786845 2574 projected.go:264] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found Jun 03 13:56:17.786919 ip-10-0-134-229 kubenswrapper[2574]: E0603 13:56:17.786872 2574 projected.go:194] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-75c86b6d9c-xcmd7: secret "image-registry-tls" not found Jun 03 13:56:17.786960 ip-10-0-134-229 kubenswrapper[2574]: E0603 13:56:17.786952 2574 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/45018365-b30b-4ef0-b920-e0ddc6c71e9b-registry-tls podName:45018365-b30b-4ef0-b920-e0ddc6c71e9b nodeName:}" failed. No retries permitted until 2026-06-03 13:56:18.786935186 +0000 UTC m=+139.970942493 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/45018365-b30b-4ef0-b920-e0ddc6c71e9b-registry-tls") pod "image-registry-75c86b6d9c-xcmd7" (UID: "45018365-b30b-4ef0-b920-e0ddc6c71e9b") : secret "image-registry-tls" not found Jun 03 13:56:18.492275 ip-10-0-134-229 kubenswrapper[2574]: I0603 13:56:18.492189 2574 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/12f58cc7-5bbe-40ce-aec5-8bb255c37241-samples-operator-tls\") pod \"cluster-samples-operator-755bbf9bfb-nc585\" (UID: \"12f58cc7-5bbe-40ce-aec5-8bb255c37241\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-755bbf9bfb-nc585" Jun 03 13:56:18.492736 ip-10-0-134-229 kubenswrapper[2574]: E0603 13:56:18.492342 2574 secret.go:189] Couldn't get secret openshift-cluster-samples-operator/samples-operator-tls: secret "samples-operator-tls" not found Jun 03 13:56:18.492736 ip-10-0-134-229 kubenswrapper[2574]: E0603 13:56:18.492517 2574 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/12f58cc7-5bbe-40ce-aec5-8bb255c37241-samples-operator-tls podName:12f58cc7-5bbe-40ce-aec5-8bb255c37241 nodeName:}" failed. No retries permitted until 2026-06-03 13:56:26.492494561 +0000 UTC m=+147.676501882 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "samples-operator-tls" (UniqueName: "kubernetes.io/secret/12f58cc7-5bbe-40ce-aec5-8bb255c37241-samples-operator-tls") pod "cluster-samples-operator-755bbf9bfb-nc585" (UID: "12f58cc7-5bbe-40ce-aec5-8bb255c37241") : secret "samples-operator-tls" not found Jun 03 13:56:18.794108 ip-10-0-134-229 kubenswrapper[2574]: I0603 13:56:18.794026 2574 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/45018365-b30b-4ef0-b920-e0ddc6c71e9b-registry-tls\") pod \"image-registry-75c86b6d9c-xcmd7\" (UID: \"45018365-b30b-4ef0-b920-e0ddc6c71e9b\") " pod="openshift-image-registry/image-registry-75c86b6d9c-xcmd7" Jun 03 13:56:18.794268 ip-10-0-134-229 kubenswrapper[2574]: E0603 13:56:18.794193 2574 projected.go:264] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found Jun 03 13:56:18.794268 ip-10-0-134-229 kubenswrapper[2574]: E0603 13:56:18.794218 2574 projected.go:194] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-75c86b6d9c-xcmd7: secret "image-registry-tls" not found Jun 03 13:56:18.794416 ip-10-0-134-229 kubenswrapper[2574]: E0603 13:56:18.794285 2574 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/45018365-b30b-4ef0-b920-e0ddc6c71e9b-registry-tls podName:45018365-b30b-4ef0-b920-e0ddc6c71e9b nodeName:}" failed. No retries permitted until 2026-06-03 13:56:20.794263577 +0000 UTC m=+141.978271110 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/45018365-b30b-4ef0-b920-e0ddc6c71e9b-registry-tls") pod "image-registry-75c86b6d9c-xcmd7" (UID: "45018365-b30b-4ef0-b920-e0ddc6c71e9b") : secret "image-registry-tls" not found Jun 03 13:56:18.855875 ip-10-0-134-229 kubenswrapper[2574]: I0603 13:56:18.855845 2574 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-96ddc787c-42dw4" event={"ID":"cdfc9d22-1eec-4221-9c0f-c128485c764a","Type":"ContainerStarted","Data":"66129da78833af48e9fbf4fb8327a4c001e148b433f76c27853d8e0d389d5149"} Jun 03 13:56:18.872479 ip-10-0-134-229 kubenswrapper[2574]: I0603 13:56:18.872412 2574 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-96ddc787c-42dw4" podStartSLOduration=1.8181254839999998 podStartE2EDuration="3.872397339s" podCreationTimestamp="2026-06-03 13:56:15 +0000 UTC" firstStartedPulling="2026-06-03 13:56:16.165493306 +0000 UTC m=+137.349500612" lastFinishedPulling="2026-06-03 13:56:18.219765151 +0000 UTC m=+139.403772467" observedRunningTime="2026-06-03 13:56:18.871513303 +0000 UTC m=+140.055520657" watchObservedRunningTime="2026-06-03 13:56:18.872397339 +0000 UTC m=+140.056404665" Jun 03 13:56:20.809199 ip-10-0-134-229 kubenswrapper[2574]: I0603 13:56:20.809158 2574 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/45018365-b30b-4ef0-b920-e0ddc6c71e9b-registry-tls\") pod \"image-registry-75c86b6d9c-xcmd7\" (UID: \"45018365-b30b-4ef0-b920-e0ddc6c71e9b\") " pod="openshift-image-registry/image-registry-75c86b6d9c-xcmd7" Jun 03 13:56:20.809608 ip-10-0-134-229 kubenswrapper[2574]: E0603 13:56:20.809315 2574 projected.go:264] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found Jun 03 13:56:20.809608 ip-10-0-134-229 kubenswrapper[2574]: E0603 13:56:20.809336 2574 projected.go:194] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-75c86b6d9c-xcmd7: secret "image-registry-tls" not found Jun 03 13:56:20.809608 ip-10-0-134-229 kubenswrapper[2574]: E0603 13:56:20.809413 2574 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/45018365-b30b-4ef0-b920-e0ddc6c71e9b-registry-tls podName:45018365-b30b-4ef0-b920-e0ddc6c71e9b nodeName:}" failed. No retries permitted until 2026-06-03 13:56:24.809396208 +0000 UTC m=+145.993403515 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/45018365-b30b-4ef0-b920-e0ddc6c71e9b-registry-tls") pod "image-registry-75c86b6d9c-xcmd7" (UID: "45018365-b30b-4ef0-b920-e0ddc6c71e9b") : secret "image-registry-tls" not found Jun 03 13:56:22.623319 ip-10-0-134-229 kubenswrapper[2574]: I0603 13:56:22.623282 2574 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/8e495886-d0ff-45fd-b366-4f1758ae8c96-metrics-certs\") pod \"router-default-7595fc69d5-8sg6s\" (UID: \"8e495886-d0ff-45fd-b366-4f1758ae8c96\") " pod="openshift-ingress/router-default-7595fc69d5-8sg6s" Jun 03 13:56:22.623741 ip-10-0-134-229 kubenswrapper[2574]: I0603 13:56:22.623395 2574 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/8e495886-d0ff-45fd-b366-4f1758ae8c96-service-ca-bundle\") pod \"router-default-7595fc69d5-8sg6s\" (UID: \"8e495886-d0ff-45fd-b366-4f1758ae8c96\") " pod="openshift-ingress/router-default-7595fc69d5-8sg6s" Jun 03 13:56:22.623741 ip-10-0-134-229 kubenswrapper[2574]: E0603 13:56:22.623461 2574 secret.go:189] Couldn't get secret openshift-ingress/router-metrics-certs-default: secret "router-metrics-certs-default" not found Jun 03 13:56:22.623741 ip-10-0-134-229 kubenswrapper[2574]: E0603 13:56:22.623527 2574 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/8e495886-d0ff-45fd-b366-4f1758ae8c96-metrics-certs podName:8e495886-d0ff-45fd-b366-4f1758ae8c96 nodeName:}" failed. No retries permitted until 2026-06-03 13:56:38.623508328 +0000 UTC m=+159.807515645 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/8e495886-d0ff-45fd-b366-4f1758ae8c96-metrics-certs") pod "router-default-7595fc69d5-8sg6s" (UID: "8e495886-d0ff-45fd-b366-4f1758ae8c96") : secret "router-metrics-certs-default" not found Jun 03 13:56:22.623741 ip-10-0-134-229 kubenswrapper[2574]: E0603 13:56:22.623583 2574 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/8e495886-d0ff-45fd-b366-4f1758ae8c96-service-ca-bundle podName:8e495886-d0ff-45fd-b366-4f1758ae8c96 nodeName:}" failed. No retries permitted until 2026-06-03 13:56:38.623562934 +0000 UTC m=+159.807570241 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "service-ca-bundle" (UniqueName: "kubernetes.io/configmap/8e495886-d0ff-45fd-b366-4f1758ae8c96-service-ca-bundle") pod "router-default-7595fc69d5-8sg6s" (UID: "8e495886-d0ff-45fd-b366-4f1758ae8c96") : configmap references non-existent config key: service-ca.crt Jun 03 13:56:24.840603 ip-10-0-134-229 kubenswrapper[2574]: I0603 13:56:24.840554 2574 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/45018365-b30b-4ef0-b920-e0ddc6c71e9b-registry-tls\") pod \"image-registry-75c86b6d9c-xcmd7\" (UID: \"45018365-b30b-4ef0-b920-e0ddc6c71e9b\") " pod="openshift-image-registry/image-registry-75c86b6d9c-xcmd7" Jun 03 13:56:24.840988 ip-10-0-134-229 kubenswrapper[2574]: E0603 13:56:24.840702 2574 projected.go:264] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found Jun 03 13:56:24.840988 ip-10-0-134-229 kubenswrapper[2574]: E0603 13:56:24.840721 2574 projected.go:194] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-75c86b6d9c-xcmd7: secret "image-registry-tls" not found Jun 03 13:56:24.840988 ip-10-0-134-229 kubenswrapper[2574]: E0603 13:56:24.840775 2574 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/45018365-b30b-4ef0-b920-e0ddc6c71e9b-registry-tls podName:45018365-b30b-4ef0-b920-e0ddc6c71e9b nodeName:}" failed. No retries permitted until 2026-06-03 13:56:32.840761871 +0000 UTC m=+154.024769178 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/45018365-b30b-4ef0-b920-e0ddc6c71e9b-registry-tls") pod "image-registry-75c86b6d9c-xcmd7" (UID: "45018365-b30b-4ef0-b920-e0ddc6c71e9b") : secret "image-registry-tls" not found Jun 03 13:56:26.553211 ip-10-0-134-229 kubenswrapper[2574]: I0603 13:56:26.553169 2574 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/12f58cc7-5bbe-40ce-aec5-8bb255c37241-samples-operator-tls\") pod \"cluster-samples-operator-755bbf9bfb-nc585\" (UID: \"12f58cc7-5bbe-40ce-aec5-8bb255c37241\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-755bbf9bfb-nc585" Jun 03 13:56:26.555663 ip-10-0-134-229 kubenswrapper[2574]: I0603 13:56:26.555640 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/12f58cc7-5bbe-40ce-aec5-8bb255c37241-samples-operator-tls\") pod \"cluster-samples-operator-755bbf9bfb-nc585\" (UID: \"12f58cc7-5bbe-40ce-aec5-8bb255c37241\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-755bbf9bfb-nc585" Jun 03 13:56:26.646512 ip-10-0-134-229 kubenswrapper[2574]: I0603 13:56:26.646482 2574 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-samples-operator/cluster-samples-operator-755bbf9bfb-nc585" Jun 03 13:56:26.766936 ip-10-0-134-229 kubenswrapper[2574]: I0603 13:56:26.766909 2574 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-cluster-samples-operator/cluster-samples-operator-755bbf9bfb-nc585"] Jun 03 13:56:26.872023 ip-10-0-134-229 kubenswrapper[2574]: I0603 13:56:26.871994 2574 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-samples-operator/cluster-samples-operator-755bbf9bfb-nc585" event={"ID":"12f58cc7-5bbe-40ce-aec5-8bb255c37241","Type":"ContainerStarted","Data":"97b86706e3ff587de84e0d990eaca515666144a8c82da90c734532c96e1d862c"} Jun 03 13:56:28.878185 ip-10-0-134-229 kubenswrapper[2574]: I0603 13:56:28.878147 2574 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-samples-operator/cluster-samples-operator-755bbf9bfb-nc585" event={"ID":"12f58cc7-5bbe-40ce-aec5-8bb255c37241","Type":"ContainerStarted","Data":"e89540a9183594efab083a7c740fcdf4747ccb485186d10b2b1bf13a2cd705d9"} Jun 03 13:56:28.878573 ip-10-0-134-229 kubenswrapper[2574]: I0603 13:56:28.878193 2574 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-samples-operator/cluster-samples-operator-755bbf9bfb-nc585" event={"ID":"12f58cc7-5bbe-40ce-aec5-8bb255c37241","Type":"ContainerStarted","Data":"4d7530a6ac474a256a532f4e746cbb92e33ecf465629590c46fdb073b4cd21ad"} Jun 03 13:56:28.895608 ip-10-0-134-229 kubenswrapper[2574]: I0603 13:56:28.895557 2574 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-cluster-samples-operator/cluster-samples-operator-755bbf9bfb-nc585" podStartSLOduration=16.979543284000002 podStartE2EDuration="18.895543728s" podCreationTimestamp="2026-06-03 13:56:10 +0000 UTC" firstStartedPulling="2026-06-03 13:56:26.810846645 +0000 UTC m=+147.994853954" lastFinishedPulling="2026-06-03 13:56:28.726847091 +0000 UTC m=+149.910854398" observedRunningTime="2026-06-03 13:56:28.894976879 +0000 UTC m=+150.078984207" watchObservedRunningTime="2026-06-03 13:56:28.895543728 +0000 UTC m=+150.079551056" Jun 03 13:56:32.903474 ip-10-0-134-229 kubenswrapper[2574]: I0603 13:56:32.903439 2574 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/45018365-b30b-4ef0-b920-e0ddc6c71e9b-registry-tls\") pod \"image-registry-75c86b6d9c-xcmd7\" (UID: \"45018365-b30b-4ef0-b920-e0ddc6c71e9b\") " pod="openshift-image-registry/image-registry-75c86b6d9c-xcmd7" Jun 03 13:56:32.905738 ip-10-0-134-229 kubenswrapper[2574]: I0603 13:56:32.905715 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/45018365-b30b-4ef0-b920-e0ddc6c71e9b-registry-tls\") pod \"image-registry-75c86b6d9c-xcmd7\" (UID: \"45018365-b30b-4ef0-b920-e0ddc6c71e9b\") " pod="openshift-image-registry/image-registry-75c86b6d9c-xcmd7" Jun 03 13:56:32.928594 ip-10-0-134-229 kubenswrapper[2574]: I0603 13:56:32.928566 2574 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-75c86b6d9c-xcmd7" Jun 03 13:56:33.049858 ip-10-0-134-229 kubenswrapper[2574]: I0603 13:56:33.049830 2574 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-image-registry/image-registry-75c86b6d9c-xcmd7"] Jun 03 13:56:33.053361 ip-10-0-134-229 kubenswrapper[2574]: W0603 13:56:33.053328 2574 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod45018365_b30b_4ef0_b920_e0ddc6c71e9b.slice/crio-dbfb56acb63662a86706f438224ecb0861135c4e2986d9a9abe666dca4437679 WatchSource:0}: Error finding container dbfb56acb63662a86706f438224ecb0861135c4e2986d9a9abe666dca4437679: Status 404 returned error can't find the container with id dbfb56acb63662a86706f438224ecb0861135c4e2986d9a9abe666dca4437679 Jun 03 13:56:33.893222 ip-10-0-134-229 kubenswrapper[2574]: I0603 13:56:33.893188 2574 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-75c86b6d9c-xcmd7" event={"ID":"45018365-b30b-4ef0-b920-e0ddc6c71e9b","Type":"ContainerStarted","Data":"8835b19b20c3204e7e865a636ef7718dd47aadf28b51c3fe3ac9b5d8671e473c"} Jun 03 13:56:33.893222 ip-10-0-134-229 kubenswrapper[2574]: I0603 13:56:33.893222 2574 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-75c86b6d9c-xcmd7" event={"ID":"45018365-b30b-4ef0-b920-e0ddc6c71e9b","Type":"ContainerStarted","Data":"dbfb56acb63662a86706f438224ecb0861135c4e2986d9a9abe666dca4437679"} Jun 03 13:56:33.893435 ip-10-0-134-229 kubenswrapper[2574]: I0603 13:56:33.893300 2574 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-image-registry/image-registry-75c86b6d9c-xcmd7" Jun 03 13:56:33.912627 ip-10-0-134-229 kubenswrapper[2574]: I0603 13:56:33.912585 2574 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-image-registry/image-registry-75c86b6d9c-xcmd7" podStartSLOduration=17.912573389 podStartE2EDuration="17.912573389s" podCreationTimestamp="2026-06-03 13:56:16 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2026-06-03 13:56:33.91213563 +0000 UTC m=+155.096142959" watchObservedRunningTime="2026-06-03 13:56:33.912573389 +0000 UTC m=+155.096580718" Jun 03 13:56:35.748829 ip-10-0-134-229 kubenswrapper[2574]: E0603 13:56:35.748783 2574 pod_workers.go:1301] "Error syncing pod, skipping" err="unmounted volumes=[metrics-tls], unattached volumes=[], failed to process volumes=[]: context deadline exceeded" pod="openshift-dns/dns-default-cmpk7" podUID="4308a21d-77ba-4b27-acb7-feb7eafe3b61" Jun 03 13:56:35.765003 ip-10-0-134-229 kubenswrapper[2574]: E0603 13:56:35.764971 2574 pod_workers.go:1301] "Error syncing pod, skipping" err="unmounted volumes=[cert], unattached volumes=[], failed to process volumes=[]: context deadline exceeded" pod="openshift-ingress-canary/ingress-canary-r2b65" podUID="b1e2fd2f-3d6b-4353-8897-804eee07eac8" Jun 03 13:56:35.898552 ip-10-0-134-229 kubenswrapper[2574]: I0603 13:56:35.898519 2574 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress-canary/ingress-canary-r2b65" Jun 03 13:56:35.898689 ip-10-0-134-229 kubenswrapper[2574]: I0603 13:56:35.898675 2574 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-cmpk7" Jun 03 13:56:36.436678 ip-10-0-134-229 kubenswrapper[2574]: E0603 13:56:36.436634 2574 pod_workers.go:1301] "Error syncing pod, skipping" err="unmounted volumes=[metrics-certs], unattached volumes=[], failed to process volumes=[]: context deadline exceeded" pod="openshift-multus/network-metrics-daemon-9f7k7" podUID="6f47d39b-6eb0-4d5f-921b-0d56c194113e" Jun 03 13:56:38.644966 ip-10-0-134-229 kubenswrapper[2574]: I0603 13:56:38.644931 2574 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/8e495886-d0ff-45fd-b366-4f1758ae8c96-metrics-certs\") pod \"router-default-7595fc69d5-8sg6s\" (UID: \"8e495886-d0ff-45fd-b366-4f1758ae8c96\") " pod="openshift-ingress/router-default-7595fc69d5-8sg6s" Jun 03 13:56:38.645333 ip-10-0-134-229 kubenswrapper[2574]: I0603 13:56:38.644992 2574 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/8e495886-d0ff-45fd-b366-4f1758ae8c96-service-ca-bundle\") pod \"router-default-7595fc69d5-8sg6s\" (UID: \"8e495886-d0ff-45fd-b366-4f1758ae8c96\") " pod="openshift-ingress/router-default-7595fc69d5-8sg6s" Jun 03 13:56:38.645581 ip-10-0-134-229 kubenswrapper[2574]: I0603 13:56:38.645560 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/8e495886-d0ff-45fd-b366-4f1758ae8c96-service-ca-bundle\") pod \"router-default-7595fc69d5-8sg6s\" (UID: \"8e495886-d0ff-45fd-b366-4f1758ae8c96\") " pod="openshift-ingress/router-default-7595fc69d5-8sg6s" Jun 03 13:56:38.647197 ip-10-0-134-229 kubenswrapper[2574]: I0603 13:56:38.647178 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/8e495886-d0ff-45fd-b366-4f1758ae8c96-metrics-certs\") pod \"router-default-7595fc69d5-8sg6s\" (UID: \"8e495886-d0ff-45fd-b366-4f1758ae8c96\") " pod="openshift-ingress/router-default-7595fc69d5-8sg6s" Jun 03 13:56:38.892931 ip-10-0-134-229 kubenswrapper[2574]: I0603 13:56:38.892900 2574 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/router-default-7595fc69d5-8sg6s" Jun 03 13:56:39.015546 ip-10-0-134-229 kubenswrapper[2574]: I0603 13:56:39.015516 2574 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/router-default-7595fc69d5-8sg6s"] Jun 03 13:56:39.019558 ip-10-0-134-229 kubenswrapper[2574]: W0603 13:56:39.019528 2574 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod8e495886_d0ff_45fd_b366_4f1758ae8c96.slice/crio-68e032f142b23c7839cf437513525f6694d55a05b76966c78d4b7c09be5f34f9 WatchSource:0}: Error finding container 68e032f142b23c7839cf437513525f6694d55a05b76966c78d4b7c09be5f34f9: Status 404 returned error can't find the container with id 68e032f142b23c7839cf437513525f6694d55a05b76966c78d4b7c09be5f34f9 Jun 03 13:56:39.909031 ip-10-0-134-229 kubenswrapper[2574]: I0603 13:56:39.908989 2574 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/router-default-7595fc69d5-8sg6s" event={"ID":"8e495886-d0ff-45fd-b366-4f1758ae8c96","Type":"ContainerStarted","Data":"9fa22fef4425cc3df034e9938df341033b4bfa8680e285b9c8a869e79067d1ed"} Jun 03 13:56:39.909031 ip-10-0-134-229 kubenswrapper[2574]: I0603 13:56:39.909034 2574 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/router-default-7595fc69d5-8sg6s" event={"ID":"8e495886-d0ff-45fd-b366-4f1758ae8c96","Type":"ContainerStarted","Data":"68e032f142b23c7839cf437513525f6694d55a05b76966c78d4b7c09be5f34f9"} Jun 03 13:56:39.927559 ip-10-0-134-229 kubenswrapper[2574]: I0603 13:56:39.927521 2574 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-ingress/router-default-7595fc69d5-8sg6s" podStartSLOduration=33.927504381 podStartE2EDuration="33.927504381s" podCreationTimestamp="2026-06-03 13:56:06 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2026-06-03 13:56:39.927285609 +0000 UTC m=+161.111292937" watchObservedRunningTime="2026-06-03 13:56:39.927504381 +0000 UTC m=+161.111511711" Jun 03 13:56:40.661063 ip-10-0-134-229 kubenswrapper[2574]: I0603 13:56:40.661009 2574 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/b1e2fd2f-3d6b-4353-8897-804eee07eac8-cert\") pod \"ingress-canary-r2b65\" (UID: \"b1e2fd2f-3d6b-4353-8897-804eee07eac8\") " pod="openshift-ingress-canary/ingress-canary-r2b65" Jun 03 13:56:40.661063 ip-10-0-134-229 kubenswrapper[2574]: I0603 13:56:40.661061 2574 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/4308a21d-77ba-4b27-acb7-feb7eafe3b61-metrics-tls\") pod \"dns-default-cmpk7\" (UID: \"4308a21d-77ba-4b27-acb7-feb7eafe3b61\") " pod="openshift-dns/dns-default-cmpk7" Jun 03 13:56:40.663300 ip-10-0-134-229 kubenswrapper[2574]: I0603 13:56:40.663271 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/4308a21d-77ba-4b27-acb7-feb7eafe3b61-metrics-tls\") pod \"dns-default-cmpk7\" (UID: \"4308a21d-77ba-4b27-acb7-feb7eafe3b61\") " pod="openshift-dns/dns-default-cmpk7" Jun 03 13:56:40.663412 ip-10-0-134-229 kubenswrapper[2574]: I0603 13:56:40.663387 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/b1e2fd2f-3d6b-4353-8897-804eee07eac8-cert\") pod \"ingress-canary-r2b65\" (UID: \"b1e2fd2f-3d6b-4353-8897-804eee07eac8\") " pod="openshift-ingress-canary/ingress-canary-r2b65" Jun 03 13:56:40.702169 ip-10-0-134-229 kubenswrapper[2574]: I0603 13:56:40.702147 2574 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-canary\"/\"default-dockercfg-gxcmr\"" Jun 03 13:56:40.702751 ip-10-0-134-229 kubenswrapper[2574]: I0603 13:56:40.702735 2574 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-dockercfg-zsshc\"" Jun 03 13:56:40.710314 ip-10-0-134-229 kubenswrapper[2574]: I0603 13:56:40.710299 2574 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-cmpk7" Jun 03 13:56:40.710407 ip-10-0-134-229 kubenswrapper[2574]: I0603 13:56:40.710387 2574 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress-canary/ingress-canary-r2b65" Jun 03 13:56:40.836292 ip-10-0-134-229 kubenswrapper[2574]: I0603 13:56:40.836265 2574 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-ingress-canary/ingress-canary-r2b65"] Jun 03 13:56:40.839652 ip-10-0-134-229 kubenswrapper[2574]: W0603 13:56:40.839618 2574 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podb1e2fd2f_3d6b_4353_8897_804eee07eac8.slice/crio-0500ed542f53bf9fc75f48b769f9d99d45342848e417701035bdbb5610eb3df9 WatchSource:0}: Error finding container 0500ed542f53bf9fc75f48b769f9d99d45342848e417701035bdbb5610eb3df9: Status 404 returned error can't find the container with id 0500ed542f53bf9fc75f48b769f9d99d45342848e417701035bdbb5610eb3df9 Jun 03 13:56:40.852565 ip-10-0-134-229 kubenswrapper[2574]: I0603 13:56:40.852533 2574 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-dns/dns-default-cmpk7"] Jun 03 13:56:40.855475 ip-10-0-134-229 kubenswrapper[2574]: W0603 13:56:40.855445 2574 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod4308a21d_77ba_4b27_acb7_feb7eafe3b61.slice/crio-622ddc5c02b7ceb2edda18f503c7eb3613b500e5494d49d18d5a4af18309a13d WatchSource:0}: Error finding container 622ddc5c02b7ceb2edda18f503c7eb3613b500e5494d49d18d5a4af18309a13d: Status 404 returned error can't find the container with id 622ddc5c02b7ceb2edda18f503c7eb3613b500e5494d49d18d5a4af18309a13d Jun 03 13:56:40.893132 ip-10-0-134-229 kubenswrapper[2574]: I0603 13:56:40.893114 2574 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/router-default-7595fc69d5-8sg6s" Jun 03 13:56:40.895967 ip-10-0-134-229 kubenswrapper[2574]: I0603 13:56:40.895948 2574 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/router-default-7595fc69d5-8sg6s" Jun 03 13:56:40.912528 ip-10-0-134-229 kubenswrapper[2574]: I0603 13:56:40.912474 2574 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-ingress-canary/ingress-canary-r2b65" event={"ID":"b1e2fd2f-3d6b-4353-8897-804eee07eac8","Type":"ContainerStarted","Data":"0500ed542f53bf9fc75f48b769f9d99d45342848e417701035bdbb5610eb3df9"} Jun 03 13:56:40.913499 ip-10-0-134-229 kubenswrapper[2574]: I0603 13:56:40.913461 2574 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-cmpk7" event={"ID":"4308a21d-77ba-4b27-acb7-feb7eafe3b61","Type":"ContainerStarted","Data":"622ddc5c02b7ceb2edda18f503c7eb3613b500e5494d49d18d5a4af18309a13d"} Jun 03 13:56:40.917897 ip-10-0-134-229 kubenswrapper[2574]: I0603 13:56:40.915142 2574 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/router-default-7595fc69d5-8sg6s" Jun 03 13:56:40.917897 ip-10-0-134-229 kubenswrapper[2574]: I0603 13:56:40.916360 2574 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/router-default-7595fc69d5-8sg6s" Jun 03 13:56:43.922703 ip-10-0-134-229 kubenswrapper[2574]: I0603 13:56:43.922667 2574 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-ingress-canary/ingress-canary-r2b65" event={"ID":"b1e2fd2f-3d6b-4353-8897-804eee07eac8","Type":"ContainerStarted","Data":"df37e0e3802cfd19a1bc232f01ed81d7602d3af8b5e8f35cc57c54a50de4b219"} Jun 03 13:56:43.924160 ip-10-0-134-229 kubenswrapper[2574]: I0603 13:56:43.924126 2574 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-cmpk7" event={"ID":"4308a21d-77ba-4b27-acb7-feb7eafe3b61","Type":"ContainerStarted","Data":"5f5f35aad0a58f9859f1f2e89e8409490fc4abe94b0ee35f96530ca5ab4a16a2"} Jun 03 13:56:43.924160 ip-10-0-134-229 kubenswrapper[2574]: I0603 13:56:43.924160 2574 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-cmpk7" event={"ID":"4308a21d-77ba-4b27-acb7-feb7eafe3b61","Type":"ContainerStarted","Data":"da13436802a3f804e00d4eb549bfec5aad620a1e4cdfca85462e2ca71783ca5d"} Jun 03 13:56:43.924319 ip-10-0-134-229 kubenswrapper[2574]: I0603 13:56:43.924249 2574 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-dns/dns-default-cmpk7" Jun 03 13:56:43.945253 ip-10-0-134-229 kubenswrapper[2574]: I0603 13:56:43.945209 2574 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-ingress-canary/ingress-canary-r2b65" podStartSLOduration=129.756693922 podStartE2EDuration="2m11.945197423s" podCreationTimestamp="2026-06-03 13:54:32 +0000 UTC" firstStartedPulling="2026-06-03 13:56:40.841543453 +0000 UTC m=+162.025550761" lastFinishedPulling="2026-06-03 13:56:43.030046956 +0000 UTC m=+164.214054262" observedRunningTime="2026-06-03 13:56:43.944784 +0000 UTC m=+165.128791329" watchObservedRunningTime="2026-06-03 13:56:43.945197423 +0000 UTC m=+165.129204748" Jun 03 13:56:43.976195 ip-10-0-134-229 kubenswrapper[2574]: I0603 13:56:43.976159 2574 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-dns/dns-default-cmpk7" podStartSLOduration=129.807105323 podStartE2EDuration="2m11.976148456s" podCreationTimestamp="2026-06-03 13:54:32 +0000 UTC" firstStartedPulling="2026-06-03 13:56:40.857075129 +0000 UTC m=+162.041082436" lastFinishedPulling="2026-06-03 13:56:43.026118259 +0000 UTC m=+164.210125569" observedRunningTime="2026-06-03 13:56:43.974534886 +0000 UTC m=+165.158542209" watchObservedRunningTime="2026-06-03 13:56:43.976148456 +0000 UTC m=+165.160155784" Jun 03 13:56:44.052838 ip-10-0-134-229 kubenswrapper[2574]: I0603 13:56:44.052802 2574 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-insights/insights-runtime-extractor-lcst5"] Jun 03 13:56:44.055819 ip-10-0-134-229 kubenswrapper[2574]: I0603 13:56:44.055803 2574 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-runtime-extractor-lcst5" Jun 03 13:56:44.058440 ip-10-0-134-229 kubenswrapper[2574]: I0603 13:56:44.058419 2574 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"kube-rbac-proxy\"" Jun 03 13:56:44.058627 ip-10-0-134-229 kubenswrapper[2574]: I0603 13:56:44.058591 2574 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-tls\"" Jun 03 13:56:44.058716 ip-10-0-134-229 kubenswrapper[2574]: I0603 13:56:44.058685 2574 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-sa-dockercfg-8c6lj\"" Jun 03 13:56:44.058785 ip-10-0-134-229 kubenswrapper[2574]: I0603 13:56:44.058747 2574 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"kube-root-ca.crt\"" Jun 03 13:56:44.059050 ip-10-0-134-229 kubenswrapper[2574]: I0603 13:56:44.059037 2574 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"openshift-service-ca.crt\"" Jun 03 13:56:44.066212 ip-10-0-134-229 kubenswrapper[2574]: I0603 13:56:44.066194 2574 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-runtime-extractor-lcst5"] Jun 03 13:56:44.100421 ip-10-0-134-229 kubenswrapper[2574]: I0603 13:56:44.100398 2574 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openshift-image-registry/image-registry-75c86b6d9c-xcmd7"] Jun 03 13:56:44.144429 ip-10-0-134-229 kubenswrapper[2574]: I0603 13:56:44.144401 2574 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-image-registry/image-registry-f5c6b7cb8-tfj84"] Jun 03 13:56:44.147202 ip-10-0-134-229 kubenswrapper[2574]: I0603 13:56:44.147186 2574 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-f5c6b7cb8-tfj84" Jun 03 13:56:44.173425 ip-10-0-134-229 kubenswrapper[2574]: I0603 13:56:44.167553 2574 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-image-registry/image-registry-f5c6b7cb8-tfj84"] Jun 03 13:56:44.190363 ip-10-0-134-229 kubenswrapper[2574]: I0603 13:56:44.189543 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/5ad03443-f73f-4a81-a61b-e93316f65a17-crio-socket\") pod \"insights-runtime-extractor-lcst5\" (UID: \"5ad03443-f73f-4a81-a61b-e93316f65a17\") " pod="openshift-insights/insights-runtime-extractor-lcst5" Jun 03 13:56:44.190363 ip-10-0-134-229 kubenswrapper[2574]: I0603 13:56:44.189631 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-2rsv9\" (UniqueName: \"kubernetes.io/projected/5ad03443-f73f-4a81-a61b-e93316f65a17-kube-api-access-2rsv9\") pod \"insights-runtime-extractor-lcst5\" (UID: \"5ad03443-f73f-4a81-a61b-e93316f65a17\") " pod="openshift-insights/insights-runtime-extractor-lcst5" Jun 03 13:56:44.190363 ip-10-0-134-229 kubenswrapper[2574]: I0603 13:56:44.189659 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/ccbe6a06-f89d-4332-87fa-6fa5d1d249dd-registry-tls\") pod \"image-registry-f5c6b7cb8-tfj84\" (UID: \"ccbe6a06-f89d-4332-87fa-6fa5d1d249dd\") " pod="openshift-image-registry/image-registry-f5c6b7cb8-tfj84" Jun 03 13:56:44.190363 ip-10-0-134-229 kubenswrapper[2574]: I0603 13:56:44.189778 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/ccbe6a06-f89d-4332-87fa-6fa5d1d249dd-registry-certificates\") pod \"image-registry-f5c6b7cb8-tfj84\" (UID: \"ccbe6a06-f89d-4332-87fa-6fa5d1d249dd\") " pod="openshift-image-registry/image-registry-f5c6b7cb8-tfj84" Jun 03 13:56:44.190363 ip-10-0-134-229 kubenswrapper[2574]: I0603 13:56:44.189805 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/5ad03443-f73f-4a81-a61b-e93316f65a17-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-lcst5\" (UID: \"5ad03443-f73f-4a81-a61b-e93316f65a17\") " pod="openshift-insights/insights-runtime-extractor-lcst5" Jun 03 13:56:44.190363 ip-10-0-134-229 kubenswrapper[2574]: I0603 13:56:44.189856 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/ccbe6a06-f89d-4332-87fa-6fa5d1d249dd-ca-trust-extracted\") pod \"image-registry-f5c6b7cb8-tfj84\" (UID: \"ccbe6a06-f89d-4332-87fa-6fa5d1d249dd\") " pod="openshift-image-registry/image-registry-f5c6b7cb8-tfj84" Jun 03 13:56:44.190363 ip-10-0-134-229 kubenswrapper[2574]: I0603 13:56:44.189918 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/5ad03443-f73f-4a81-a61b-e93316f65a17-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-lcst5\" (UID: \"5ad03443-f73f-4a81-a61b-e93316f65a17\") " pod="openshift-insights/insights-runtime-extractor-lcst5" Jun 03 13:56:44.190363 ip-10-0-134-229 kubenswrapper[2574]: I0603 13:56:44.189955 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/ccbe6a06-f89d-4332-87fa-6fa5d1d249dd-installation-pull-secrets\") pod \"image-registry-f5c6b7cb8-tfj84\" (UID: \"ccbe6a06-f89d-4332-87fa-6fa5d1d249dd\") " pod="openshift-image-registry/image-registry-f5c6b7cb8-tfj84" Jun 03 13:56:44.190363 ip-10-0-134-229 kubenswrapper[2574]: I0603 13:56:44.190036 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/ccbe6a06-f89d-4332-87fa-6fa5d1d249dd-trusted-ca\") pod \"image-registry-f5c6b7cb8-tfj84\" (UID: \"ccbe6a06-f89d-4332-87fa-6fa5d1d249dd\") " pod="openshift-image-registry/image-registry-f5c6b7cb8-tfj84" Jun 03 13:56:44.190363 ip-10-0-134-229 kubenswrapper[2574]: I0603 13:56:44.190072 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/ccbe6a06-f89d-4332-87fa-6fa5d1d249dd-bound-sa-token\") pod \"image-registry-f5c6b7cb8-tfj84\" (UID: \"ccbe6a06-f89d-4332-87fa-6fa5d1d249dd\") " pod="openshift-image-registry/image-registry-f5c6b7cb8-tfj84" Jun 03 13:56:44.190363 ip-10-0-134-229 kubenswrapper[2574]: I0603 13:56:44.190129 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/5ad03443-f73f-4a81-a61b-e93316f65a17-data-volume\") pod \"insights-runtime-extractor-lcst5\" (UID: \"5ad03443-f73f-4a81-a61b-e93316f65a17\") " pod="openshift-insights/insights-runtime-extractor-lcst5" Jun 03 13:56:44.190363 ip-10-0-134-229 kubenswrapper[2574]: I0603 13:56:44.190179 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/ccbe6a06-f89d-4332-87fa-6fa5d1d249dd-image-registry-private-configuration\") pod \"image-registry-f5c6b7cb8-tfj84\" (UID: \"ccbe6a06-f89d-4332-87fa-6fa5d1d249dd\") " pod="openshift-image-registry/image-registry-f5c6b7cb8-tfj84" Jun 03 13:56:44.190363 ip-10-0-134-229 kubenswrapper[2574]: I0603 13:56:44.190204 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-dlzqz\" (UniqueName: \"kubernetes.io/projected/ccbe6a06-f89d-4332-87fa-6fa5d1d249dd-kube-api-access-dlzqz\") pod \"image-registry-f5c6b7cb8-tfj84\" (UID: \"ccbe6a06-f89d-4332-87fa-6fa5d1d249dd\") " pod="openshift-image-registry/image-registry-f5c6b7cb8-tfj84" Jun 03 13:56:44.291434 ip-10-0-134-229 kubenswrapper[2574]: I0603 13:56:44.291399 2574 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/5ad03443-f73f-4a81-a61b-e93316f65a17-crio-socket\") pod \"insights-runtime-extractor-lcst5\" (UID: \"5ad03443-f73f-4a81-a61b-e93316f65a17\") " pod="openshift-insights/insights-runtime-extractor-lcst5" Jun 03 13:56:44.291434 ip-10-0-134-229 kubenswrapper[2574]: I0603 13:56:44.291433 2574 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-2rsv9\" (UniqueName: \"kubernetes.io/projected/5ad03443-f73f-4a81-a61b-e93316f65a17-kube-api-access-2rsv9\") pod \"insights-runtime-extractor-lcst5\" (UID: \"5ad03443-f73f-4a81-a61b-e93316f65a17\") " pod="openshift-insights/insights-runtime-extractor-lcst5" Jun 03 13:56:44.291662 ip-10-0-134-229 kubenswrapper[2574]: I0603 13:56:44.291450 2574 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/ccbe6a06-f89d-4332-87fa-6fa5d1d249dd-registry-tls\") pod \"image-registry-f5c6b7cb8-tfj84\" (UID: \"ccbe6a06-f89d-4332-87fa-6fa5d1d249dd\") " pod="openshift-image-registry/image-registry-f5c6b7cb8-tfj84" Jun 03 13:56:44.291662 ip-10-0-134-229 kubenswrapper[2574]: I0603 13:56:44.291472 2574 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/ccbe6a06-f89d-4332-87fa-6fa5d1d249dd-registry-certificates\") pod \"image-registry-f5c6b7cb8-tfj84\" (UID: \"ccbe6a06-f89d-4332-87fa-6fa5d1d249dd\") " pod="openshift-image-registry/image-registry-f5c6b7cb8-tfj84" Jun 03 13:56:44.291662 ip-10-0-134-229 kubenswrapper[2574]: I0603 13:56:44.291516 2574 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/5ad03443-f73f-4a81-a61b-e93316f65a17-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-lcst5\" (UID: \"5ad03443-f73f-4a81-a61b-e93316f65a17\") " pod="openshift-insights/insights-runtime-extractor-lcst5" Jun 03 13:56:44.291662 ip-10-0-134-229 kubenswrapper[2574]: I0603 13:56:44.291523 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/5ad03443-f73f-4a81-a61b-e93316f65a17-crio-socket\") pod \"insights-runtime-extractor-lcst5\" (UID: \"5ad03443-f73f-4a81-a61b-e93316f65a17\") " pod="openshift-insights/insights-runtime-extractor-lcst5" Jun 03 13:56:44.291662 ip-10-0-134-229 kubenswrapper[2574]: I0603 13:56:44.291534 2574 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/ccbe6a06-f89d-4332-87fa-6fa5d1d249dd-ca-trust-extracted\") pod \"image-registry-f5c6b7cb8-tfj84\" (UID: \"ccbe6a06-f89d-4332-87fa-6fa5d1d249dd\") " pod="openshift-image-registry/image-registry-f5c6b7cb8-tfj84" Jun 03 13:56:44.291662 ip-10-0-134-229 kubenswrapper[2574]: I0603 13:56:44.291635 2574 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/5ad03443-f73f-4a81-a61b-e93316f65a17-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-lcst5\" (UID: \"5ad03443-f73f-4a81-a61b-e93316f65a17\") " pod="openshift-insights/insights-runtime-extractor-lcst5" Jun 03 13:56:44.291954 ip-10-0-134-229 kubenswrapper[2574]: I0603 13:56:44.291684 2574 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/ccbe6a06-f89d-4332-87fa-6fa5d1d249dd-installation-pull-secrets\") pod \"image-registry-f5c6b7cb8-tfj84\" (UID: \"ccbe6a06-f89d-4332-87fa-6fa5d1d249dd\") " pod="openshift-image-registry/image-registry-f5c6b7cb8-tfj84" Jun 03 13:56:44.291954 ip-10-0-134-229 kubenswrapper[2574]: I0603 13:56:44.291834 2574 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/ccbe6a06-f89d-4332-87fa-6fa5d1d249dd-trusted-ca\") pod \"image-registry-f5c6b7cb8-tfj84\" (UID: \"ccbe6a06-f89d-4332-87fa-6fa5d1d249dd\") " pod="openshift-image-registry/image-registry-f5c6b7cb8-tfj84" Jun 03 13:56:44.291954 ip-10-0-134-229 kubenswrapper[2574]: I0603 13:56:44.291887 2574 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/ccbe6a06-f89d-4332-87fa-6fa5d1d249dd-bound-sa-token\") pod \"image-registry-f5c6b7cb8-tfj84\" (UID: \"ccbe6a06-f89d-4332-87fa-6fa5d1d249dd\") " pod="openshift-image-registry/image-registry-f5c6b7cb8-tfj84" Jun 03 13:56:44.291954 ip-10-0-134-229 kubenswrapper[2574]: I0603 13:56:44.291923 2574 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/5ad03443-f73f-4a81-a61b-e93316f65a17-data-volume\") pod \"insights-runtime-extractor-lcst5\" (UID: \"5ad03443-f73f-4a81-a61b-e93316f65a17\") " pod="openshift-insights/insights-runtime-extractor-lcst5" Jun 03 13:56:44.291954 ip-10-0-134-229 kubenswrapper[2574]: I0603 13:56:44.291950 2574 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/ccbe6a06-f89d-4332-87fa-6fa5d1d249dd-image-registry-private-configuration\") pod \"image-registry-f5c6b7cb8-tfj84\" (UID: \"ccbe6a06-f89d-4332-87fa-6fa5d1d249dd\") " pod="openshift-image-registry/image-registry-f5c6b7cb8-tfj84" Jun 03 13:56:44.292190 ip-10-0-134-229 kubenswrapper[2574]: I0603 13:56:44.291960 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/ccbe6a06-f89d-4332-87fa-6fa5d1d249dd-ca-trust-extracted\") pod \"image-registry-f5c6b7cb8-tfj84\" (UID: \"ccbe6a06-f89d-4332-87fa-6fa5d1d249dd\") " pod="openshift-image-registry/image-registry-f5c6b7cb8-tfj84" Jun 03 13:56:44.292190 ip-10-0-134-229 kubenswrapper[2574]: I0603 13:56:44.291979 2574 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-dlzqz\" (UniqueName: \"kubernetes.io/projected/ccbe6a06-f89d-4332-87fa-6fa5d1d249dd-kube-api-access-dlzqz\") pod \"image-registry-f5c6b7cb8-tfj84\" (UID: \"ccbe6a06-f89d-4332-87fa-6fa5d1d249dd\") " pod="openshift-image-registry/image-registry-f5c6b7cb8-tfj84" Jun 03 13:56:44.292318 ip-10-0-134-229 kubenswrapper[2574]: I0603 13:56:44.292238 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/5ad03443-f73f-4a81-a61b-e93316f65a17-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-lcst5\" (UID: \"5ad03443-f73f-4a81-a61b-e93316f65a17\") " pod="openshift-insights/insights-runtime-extractor-lcst5" Jun 03 13:56:44.292409 ip-10-0-134-229 kubenswrapper[2574]: I0603 13:56:44.292365 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/5ad03443-f73f-4a81-a61b-e93316f65a17-data-volume\") pod \"insights-runtime-extractor-lcst5\" (UID: \"5ad03443-f73f-4a81-a61b-e93316f65a17\") " pod="openshift-insights/insights-runtime-extractor-lcst5" Jun 03 13:56:44.292586 ip-10-0-134-229 kubenswrapper[2574]: I0603 13:56:44.292561 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/ccbe6a06-f89d-4332-87fa-6fa5d1d249dd-registry-certificates\") pod \"image-registry-f5c6b7cb8-tfj84\" (UID: \"ccbe6a06-f89d-4332-87fa-6fa5d1d249dd\") " pod="openshift-image-registry/image-registry-f5c6b7cb8-tfj84" Jun 03 13:56:44.293250 ip-10-0-134-229 kubenswrapper[2574]: I0603 13:56:44.293230 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/ccbe6a06-f89d-4332-87fa-6fa5d1d249dd-trusted-ca\") pod \"image-registry-f5c6b7cb8-tfj84\" (UID: \"ccbe6a06-f89d-4332-87fa-6fa5d1d249dd\") " pod="openshift-image-registry/image-registry-f5c6b7cb8-tfj84" Jun 03 13:56:44.294167 ip-10-0-134-229 kubenswrapper[2574]: I0603 13:56:44.294149 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/ccbe6a06-f89d-4332-87fa-6fa5d1d249dd-installation-pull-secrets\") pod \"image-registry-f5c6b7cb8-tfj84\" (UID: \"ccbe6a06-f89d-4332-87fa-6fa5d1d249dd\") " pod="openshift-image-registry/image-registry-f5c6b7cb8-tfj84" Jun 03 13:56:44.294267 ip-10-0-134-229 kubenswrapper[2574]: I0603 13:56:44.294223 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/5ad03443-f73f-4a81-a61b-e93316f65a17-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-lcst5\" (UID: \"5ad03443-f73f-4a81-a61b-e93316f65a17\") " pod="openshift-insights/insights-runtime-extractor-lcst5" Jun 03 13:56:44.294406 ip-10-0-134-229 kubenswrapper[2574]: I0603 13:56:44.294385 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/ccbe6a06-f89d-4332-87fa-6fa5d1d249dd-registry-tls\") pod \"image-registry-f5c6b7cb8-tfj84\" (UID: \"ccbe6a06-f89d-4332-87fa-6fa5d1d249dd\") " pod="openshift-image-registry/image-registry-f5c6b7cb8-tfj84" Jun 03 13:56:44.294525 ip-10-0-134-229 kubenswrapper[2574]: I0603 13:56:44.294510 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/ccbe6a06-f89d-4332-87fa-6fa5d1d249dd-image-registry-private-configuration\") pod \"image-registry-f5c6b7cb8-tfj84\" (UID: \"ccbe6a06-f89d-4332-87fa-6fa5d1d249dd\") " pod="openshift-image-registry/image-registry-f5c6b7cb8-tfj84" Jun 03 13:56:44.303615 ip-10-0-134-229 kubenswrapper[2574]: I0603 13:56:44.303587 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-dlzqz\" (UniqueName: \"kubernetes.io/projected/ccbe6a06-f89d-4332-87fa-6fa5d1d249dd-kube-api-access-dlzqz\") pod \"image-registry-f5c6b7cb8-tfj84\" (UID: \"ccbe6a06-f89d-4332-87fa-6fa5d1d249dd\") " pod="openshift-image-registry/image-registry-f5c6b7cb8-tfj84" Jun 03 13:56:44.303871 ip-10-0-134-229 kubenswrapper[2574]: I0603 13:56:44.303853 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/ccbe6a06-f89d-4332-87fa-6fa5d1d249dd-bound-sa-token\") pod \"image-registry-f5c6b7cb8-tfj84\" (UID: \"ccbe6a06-f89d-4332-87fa-6fa5d1d249dd\") " pod="openshift-image-registry/image-registry-f5c6b7cb8-tfj84" Jun 03 13:56:44.303871 ip-10-0-134-229 kubenswrapper[2574]: I0603 13:56:44.303830 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-2rsv9\" (UniqueName: \"kubernetes.io/projected/5ad03443-f73f-4a81-a61b-e93316f65a17-kube-api-access-2rsv9\") pod \"insights-runtime-extractor-lcst5\" (UID: \"5ad03443-f73f-4a81-a61b-e93316f65a17\") " pod="openshift-insights/insights-runtime-extractor-lcst5" Jun 03 13:56:44.365681 ip-10-0-134-229 kubenswrapper[2574]: I0603 13:56:44.365656 2574 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-runtime-extractor-lcst5" Jun 03 13:56:44.455767 ip-10-0-134-229 kubenswrapper[2574]: I0603 13:56:44.455738 2574 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-f5c6b7cb8-tfj84" Jun 03 13:56:44.497958 ip-10-0-134-229 kubenswrapper[2574]: I0603 13:56:44.497847 2574 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-runtime-extractor-lcst5"] Jun 03 13:56:44.500019 ip-10-0-134-229 kubenswrapper[2574]: W0603 13:56:44.499992 2574 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod5ad03443_f73f_4a81_a61b_e93316f65a17.slice/crio-99e35b0ce24fbcd04cd36b431aa7d9c7088b86982237f049ea81387d3e865cad WatchSource:0}: Error finding container 99e35b0ce24fbcd04cd36b431aa7d9c7088b86982237f049ea81387d3e865cad: Status 404 returned error can't find the container with id 99e35b0ce24fbcd04cd36b431aa7d9c7088b86982237f049ea81387d3e865cad Jun 03 13:56:44.591291 ip-10-0-134-229 kubenswrapper[2574]: I0603 13:56:44.591259 2574 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-image-registry/image-registry-f5c6b7cb8-tfj84"] Jun 03 13:56:44.593980 ip-10-0-134-229 kubenswrapper[2574]: W0603 13:56:44.593950 2574 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podccbe6a06_f89d_4332_87fa_6fa5d1d249dd.slice/crio-653f3e36f3928cf020a5b8c3a724dd691a8d85105802febe913f656bc8d67239 WatchSource:0}: Error finding container 653f3e36f3928cf020a5b8c3a724dd691a8d85105802febe913f656bc8d67239: Status 404 returned error can't find the container with id 653f3e36f3928cf020a5b8c3a724dd691a8d85105802febe913f656bc8d67239 Jun 03 13:56:44.928235 ip-10-0-134-229 kubenswrapper[2574]: I0603 13:56:44.928198 2574 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-f5c6b7cb8-tfj84" event={"ID":"ccbe6a06-f89d-4332-87fa-6fa5d1d249dd","Type":"ContainerStarted","Data":"9a1e2a8795efe60da8fac81c7f6b88574c3995ff5f8cf2a3b8e700484f9f3437"} Jun 03 13:56:44.928663 ip-10-0-134-229 kubenswrapper[2574]: I0603 13:56:44.928249 2574 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-image-registry/image-registry-f5c6b7cb8-tfj84" Jun 03 13:56:44.928663 ip-10-0-134-229 kubenswrapper[2574]: I0603 13:56:44.928264 2574 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-f5c6b7cb8-tfj84" event={"ID":"ccbe6a06-f89d-4332-87fa-6fa5d1d249dd","Type":"ContainerStarted","Data":"653f3e36f3928cf020a5b8c3a724dd691a8d85105802febe913f656bc8d67239"} Jun 03 13:56:44.929505 ip-10-0-134-229 kubenswrapper[2574]: I0603 13:56:44.929480 2574 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-lcst5" event={"ID":"5ad03443-f73f-4a81-a61b-e93316f65a17","Type":"ContainerStarted","Data":"08ab0496618b03a6edea51f4465e6f323544dfd8ded67fcf7dc099c0cb4e4adb"} Jun 03 13:56:44.929605 ip-10-0-134-229 kubenswrapper[2574]: I0603 13:56:44.929514 2574 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-lcst5" event={"ID":"5ad03443-f73f-4a81-a61b-e93316f65a17","Type":"ContainerStarted","Data":"99e35b0ce24fbcd04cd36b431aa7d9c7088b86982237f049ea81387d3e865cad"} Jun 03 13:56:44.948112 ip-10-0-134-229 kubenswrapper[2574]: I0603 13:56:44.948066 2574 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-image-registry/image-registry-f5c6b7cb8-tfj84" podStartSLOduration=0.948051364 podStartE2EDuration="948.051364ms" podCreationTimestamp="2026-06-03 13:56:44 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2026-06-03 13:56:44.947685821 +0000 UTC m=+166.131693151" watchObservedRunningTime="2026-06-03 13:56:44.948051364 +0000 UTC m=+166.132058694" Jun 03 13:56:45.934919 ip-10-0-134-229 kubenswrapper[2574]: I0603 13:56:45.934879 2574 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-lcst5" event={"ID":"5ad03443-f73f-4a81-a61b-e93316f65a17","Type":"ContainerStarted","Data":"39c9ce4a236c9ec34741a52151679490543bd66df9ef095f21d637a155f86782"} Jun 03 13:56:46.939318 ip-10-0-134-229 kubenswrapper[2574]: I0603 13:56:46.939285 2574 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-lcst5" event={"ID":"5ad03443-f73f-4a81-a61b-e93316f65a17","Type":"ContainerStarted","Data":"652afa2a1fc56e002909df19be37752ef12b0440fa3c43bef0b55d827e26275e"} Jun 03 13:56:46.955474 ip-10-0-134-229 kubenswrapper[2574]: I0603 13:56:46.955431 2574 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-insights/insights-runtime-extractor-lcst5" podStartSLOduration=0.776109199 podStartE2EDuration="2.95541778s" podCreationTimestamp="2026-06-03 13:56:44 +0000 UTC" firstStartedPulling="2026-06-03 13:56:44.565954279 +0000 UTC m=+165.749961586" lastFinishedPulling="2026-06-03 13:56:46.745262846 +0000 UTC m=+167.929270167" observedRunningTime="2026-06-03 13:56:46.955129192 +0000 UTC m=+168.139136526" watchObservedRunningTime="2026-06-03 13:56:46.95541778 +0000 UTC m=+168.139425108" Jun 03 13:56:47.306515 ip-10-0-134-229 kubenswrapper[2574]: I0603 13:56:47.306481 2574 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-monitoring/prometheus-operator-658bcd8bdf-tddj2"] Jun 03 13:56:47.310324 ip-10-0-134-229 kubenswrapper[2574]: I0603 13:56:47.310308 2574 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-operator-658bcd8bdf-tddj2" Jun 03 13:56:47.314012 ip-10-0-134-229 kubenswrapper[2574]: I0603 13:56:47.313993 2574 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-operator-tls\"" Jun 03 13:56:47.314717 ip-10-0-134-229 kubenswrapper[2574]: I0603 13:56:47.314697 2574 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"openshift-service-ca.crt\"" Jun 03 13:56:47.314717 ip-10-0-134-229 kubenswrapper[2574]: I0603 13:56:47.314708 2574 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-operator-kube-rbac-proxy-config\"" Jun 03 13:56:47.314850 ip-10-0-134-229 kubenswrapper[2574]: I0603 13:56:47.314745 2574 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"kube-root-ca.crt\"" Jun 03 13:56:47.314850 ip-10-0-134-229 kubenswrapper[2574]: I0603 13:56:47.314834 2574 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-operator-dockercfg-nm7j4\"" Jun 03 13:56:47.322833 ip-10-0-134-229 kubenswrapper[2574]: I0603 13:56:47.322816 2574 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"metrics-client-ca\"" Jun 03 13:56:47.326924 ip-10-0-134-229 kubenswrapper[2574]: I0603 13:56:47.326904 2574 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-operator-658bcd8bdf-tddj2"] Jun 03 13:56:47.416212 ip-10-0-134-229 kubenswrapper[2574]: I0603 13:56:47.416187 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-operator-tls\" (UniqueName: \"kubernetes.io/secret/286288aa-f0c9-4e33-9000-38045dcf8f52-prometheus-operator-tls\") pod \"prometheus-operator-658bcd8bdf-tddj2\" (UID: \"286288aa-f0c9-4e33-9000-38045dcf8f52\") " pod="openshift-monitoring/prometheus-operator-658bcd8bdf-tddj2" Jun 03 13:56:47.416344 ip-10-0-134-229 kubenswrapper[2574]: I0603 13:56:47.416220 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/286288aa-f0c9-4e33-9000-38045dcf8f52-metrics-client-ca\") pod \"prometheus-operator-658bcd8bdf-tddj2\" (UID: \"286288aa-f0c9-4e33-9000-38045dcf8f52\") " pod="openshift-monitoring/prometheus-operator-658bcd8bdf-tddj2" Jun 03 13:56:47.416344 ip-10-0-134-229 kubenswrapper[2574]: I0603 13:56:47.416245 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-operator-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/286288aa-f0c9-4e33-9000-38045dcf8f52-prometheus-operator-kube-rbac-proxy-config\") pod \"prometheus-operator-658bcd8bdf-tddj2\" (UID: \"286288aa-f0c9-4e33-9000-38045dcf8f52\") " pod="openshift-monitoring/prometheus-operator-658bcd8bdf-tddj2" Jun 03 13:56:47.416344 ip-10-0-134-229 kubenswrapper[2574]: I0603 13:56:47.416265 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-hxdvh\" (UniqueName: \"kubernetes.io/projected/286288aa-f0c9-4e33-9000-38045dcf8f52-kube-api-access-hxdvh\") pod \"prometheus-operator-658bcd8bdf-tddj2\" (UID: \"286288aa-f0c9-4e33-9000-38045dcf8f52\") " pod="openshift-monitoring/prometheus-operator-658bcd8bdf-tddj2" Jun 03 13:56:47.426772 ip-10-0-134-229 kubenswrapper[2574]: I0603 13:56:47.426747 2574 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-9f7k7" Jun 03 13:56:47.517415 ip-10-0-134-229 kubenswrapper[2574]: I0603 13:56:47.517354 2574 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"prometheus-operator-tls\" (UniqueName: \"kubernetes.io/secret/286288aa-f0c9-4e33-9000-38045dcf8f52-prometheus-operator-tls\") pod \"prometheus-operator-658bcd8bdf-tddj2\" (UID: \"286288aa-f0c9-4e33-9000-38045dcf8f52\") " pod="openshift-monitoring/prometheus-operator-658bcd8bdf-tddj2" Jun 03 13:56:47.517540 ip-10-0-134-229 kubenswrapper[2574]: I0603 13:56:47.517426 2574 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/286288aa-f0c9-4e33-9000-38045dcf8f52-metrics-client-ca\") pod \"prometheus-operator-658bcd8bdf-tddj2\" (UID: \"286288aa-f0c9-4e33-9000-38045dcf8f52\") " pod="openshift-monitoring/prometheus-operator-658bcd8bdf-tddj2" Jun 03 13:56:47.517540 ip-10-0-134-229 kubenswrapper[2574]: I0603 13:56:47.517470 2574 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"prometheus-operator-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/286288aa-f0c9-4e33-9000-38045dcf8f52-prometheus-operator-kube-rbac-proxy-config\") pod \"prometheus-operator-658bcd8bdf-tddj2\" (UID: \"286288aa-f0c9-4e33-9000-38045dcf8f52\") " pod="openshift-monitoring/prometheus-operator-658bcd8bdf-tddj2" Jun 03 13:56:47.517540 ip-10-0-134-229 kubenswrapper[2574]: I0603 13:56:47.517499 2574 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-hxdvh\" (UniqueName: \"kubernetes.io/projected/286288aa-f0c9-4e33-9000-38045dcf8f52-kube-api-access-hxdvh\") pod \"prometheus-operator-658bcd8bdf-tddj2\" (UID: \"286288aa-f0c9-4e33-9000-38045dcf8f52\") " pod="openshift-monitoring/prometheus-operator-658bcd8bdf-tddj2" Jun 03 13:56:47.517696 ip-10-0-134-229 kubenswrapper[2574]: E0603 13:56:47.517543 2574 secret.go:189] Couldn't get secret openshift-monitoring/prometheus-operator-tls: secret "prometheus-operator-tls" not found Jun 03 13:56:47.517696 ip-10-0-134-229 kubenswrapper[2574]: E0603 13:56:47.517598 2574 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/286288aa-f0c9-4e33-9000-38045dcf8f52-prometheus-operator-tls podName:286288aa-f0c9-4e33-9000-38045dcf8f52 nodeName:}" failed. No retries permitted until 2026-06-03 13:56:48.017583835 +0000 UTC m=+169.201591154 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "prometheus-operator-tls" (UniqueName: "kubernetes.io/secret/286288aa-f0c9-4e33-9000-38045dcf8f52-prometheus-operator-tls") pod "prometheus-operator-658bcd8bdf-tddj2" (UID: "286288aa-f0c9-4e33-9000-38045dcf8f52") : secret "prometheus-operator-tls" not found Jun 03 13:56:47.518119 ip-10-0-134-229 kubenswrapper[2574]: I0603 13:56:47.518096 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/286288aa-f0c9-4e33-9000-38045dcf8f52-metrics-client-ca\") pod \"prometheus-operator-658bcd8bdf-tddj2\" (UID: \"286288aa-f0c9-4e33-9000-38045dcf8f52\") " pod="openshift-monitoring/prometheus-operator-658bcd8bdf-tddj2" Jun 03 13:56:47.519775 ip-10-0-134-229 kubenswrapper[2574]: I0603 13:56:47.519755 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"prometheus-operator-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/286288aa-f0c9-4e33-9000-38045dcf8f52-prometheus-operator-kube-rbac-proxy-config\") pod \"prometheus-operator-658bcd8bdf-tddj2\" (UID: \"286288aa-f0c9-4e33-9000-38045dcf8f52\") " pod="openshift-monitoring/prometheus-operator-658bcd8bdf-tddj2" Jun 03 13:56:47.526184 ip-10-0-134-229 kubenswrapper[2574]: I0603 13:56:47.526162 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-hxdvh\" (UniqueName: \"kubernetes.io/projected/286288aa-f0c9-4e33-9000-38045dcf8f52-kube-api-access-hxdvh\") pod \"prometheus-operator-658bcd8bdf-tddj2\" (UID: \"286288aa-f0c9-4e33-9000-38045dcf8f52\") " pod="openshift-monitoring/prometheus-operator-658bcd8bdf-tddj2" Jun 03 13:56:48.021385 ip-10-0-134-229 kubenswrapper[2574]: I0603 13:56:48.021350 2574 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"prometheus-operator-tls\" (UniqueName: \"kubernetes.io/secret/286288aa-f0c9-4e33-9000-38045dcf8f52-prometheus-operator-tls\") pod \"prometheus-operator-658bcd8bdf-tddj2\" (UID: \"286288aa-f0c9-4e33-9000-38045dcf8f52\") " pod="openshift-monitoring/prometheus-operator-658bcd8bdf-tddj2" Jun 03 13:56:48.023704 ip-10-0-134-229 kubenswrapper[2574]: I0603 13:56:48.023679 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"prometheus-operator-tls\" (UniqueName: \"kubernetes.io/secret/286288aa-f0c9-4e33-9000-38045dcf8f52-prometheus-operator-tls\") pod \"prometheus-operator-658bcd8bdf-tddj2\" (UID: \"286288aa-f0c9-4e33-9000-38045dcf8f52\") " pod="openshift-monitoring/prometheus-operator-658bcd8bdf-tddj2" Jun 03 13:56:48.219048 ip-10-0-134-229 kubenswrapper[2574]: I0603 13:56:48.219015 2574 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-operator-658bcd8bdf-tddj2" Jun 03 13:56:48.338321 ip-10-0-134-229 kubenswrapper[2574]: I0603 13:56:48.338247 2574 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-operator-658bcd8bdf-tddj2"] Jun 03 13:56:48.340981 ip-10-0-134-229 kubenswrapper[2574]: W0603 13:56:48.340949 2574 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod286288aa_f0c9_4e33_9000_38045dcf8f52.slice/crio-9962769a736b45a632b0a87585e63d20040812119c99fa3b771cb6a0a9470e64 WatchSource:0}: Error finding container 9962769a736b45a632b0a87585e63d20040812119c99fa3b771cb6a0a9470e64: Status 404 returned error can't find the container with id 9962769a736b45a632b0a87585e63d20040812119c99fa3b771cb6a0a9470e64 Jun 03 13:56:48.947501 ip-10-0-134-229 kubenswrapper[2574]: I0603 13:56:48.947470 2574 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-operator-658bcd8bdf-tddj2" event={"ID":"286288aa-f0c9-4e33-9000-38045dcf8f52","Type":"ContainerStarted","Data":"9962769a736b45a632b0a87585e63d20040812119c99fa3b771cb6a0a9470e64"} Jun 03 13:56:49.952738 ip-10-0-134-229 kubenswrapper[2574]: I0603 13:56:49.952695 2574 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-operator-658bcd8bdf-tddj2" event={"ID":"286288aa-f0c9-4e33-9000-38045dcf8f52","Type":"ContainerStarted","Data":"99ef37d9b3c56486e42e47940fedfc78bd378f4f1b73cbb84c7af895d0de8b31"} Jun 03 13:56:49.952738 ip-10-0-134-229 kubenswrapper[2574]: I0603 13:56:49.952743 2574 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-operator-658bcd8bdf-tddj2" event={"ID":"286288aa-f0c9-4e33-9000-38045dcf8f52","Type":"ContainerStarted","Data":"fddf29a9f347bec200c937c6c758d721d843ae33d69f5d37fa302f740880133f"} Jun 03 13:56:49.970013 ip-10-0-134-229 kubenswrapper[2574]: I0603 13:56:49.969968 2574 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-monitoring/prometheus-operator-658bcd8bdf-tddj2" podStartSLOduration=1.54957108 podStartE2EDuration="2.969954232s" podCreationTimestamp="2026-06-03 13:56:47 +0000 UTC" firstStartedPulling="2026-06-03 13:56:48.343258925 +0000 UTC m=+169.527266232" lastFinishedPulling="2026-06-03 13:56:49.763642063 +0000 UTC m=+170.947649384" observedRunningTime="2026-06-03 13:56:49.969310545 +0000 UTC m=+171.153317907" watchObservedRunningTime="2026-06-03 13:56:49.969954232 +0000 UTC m=+171.153961560" Jun 03 13:56:51.639923 ip-10-0-134-229 kubenswrapper[2574]: I0603 13:56:51.639886 2574 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-monitoring/openshift-state-metrics-85658796db-hxnp7"] Jun 03 13:56:51.644504 ip-10-0-134-229 kubenswrapper[2574]: I0603 13:56:51.644488 2574 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/openshift-state-metrics-85658796db-hxnp7" Jun 03 13:56:51.646827 ip-10-0-134-229 kubenswrapper[2574]: I0603 13:56:51.646800 2574 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"openshift-state-metrics-dockercfg-jcnwh\"" Jun 03 13:56:51.646956 ip-10-0-134-229 kubenswrapper[2574]: I0603 13:56:51.646828 2574 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"openshift-state-metrics-tls\"" Jun 03 13:56:51.646956 ip-10-0-134-229 kubenswrapper[2574]: I0603 13:56:51.646862 2574 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"openshift-state-metrics-kube-rbac-proxy-config\"" Jun 03 13:56:51.652902 ip-10-0-134-229 kubenswrapper[2574]: I0603 13:56:51.652881 2574 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/openshift-state-metrics-85658796db-hxnp7"] Jun 03 13:56:51.660555 ip-10-0-134-229 kubenswrapper[2574]: I0603 13:56:51.660536 2574 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-monitoring/node-exporter-rcgss"] Jun 03 13:56:51.663717 ip-10-0-134-229 kubenswrapper[2574]: I0603 13:56:51.663703 2574 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/node-exporter-rcgss" Jun 03 13:56:51.665604 ip-10-0-134-229 kubenswrapper[2574]: I0603 13:56:51.665584 2574 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-tls\"" Jun 03 13:56:51.665768 ip-10-0-134-229 kubenswrapper[2574]: I0603 13:56:51.665752 2574 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"node-exporter-accelerators-collector-config\"" Jun 03 13:56:51.665835 ip-10-0-134-229 kubenswrapper[2574]: I0603 13:56:51.665787 2574 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-kube-rbac-proxy-config\"" Jun 03 13:56:51.666099 ip-10-0-134-229 kubenswrapper[2574]: I0603 13:56:51.666083 2574 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-dockercfg-vm544\"" Jun 03 13:56:51.747491 ip-10-0-134-229 kubenswrapper[2574]: I0603 13:56:51.747465 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-state-metrics-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/e07d69f8-1d21-4a42-b220-4b57e85432ff-openshift-state-metrics-kube-rbac-proxy-config\") pod \"openshift-state-metrics-85658796db-hxnp7\" (UID: \"e07d69f8-1d21-4a42-b220-4b57e85432ff\") " pod="openshift-monitoring/openshift-state-metrics-85658796db-hxnp7" Jun 03 13:56:51.747604 ip-10-0-134-229 kubenswrapper[2574]: I0603 13:56:51.747493 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"root\" (UniqueName: \"kubernetes.io/host-path/11db619d-addb-418d-a276-7fb653d69737-root\") pod \"node-exporter-rcgss\" (UID: \"11db619d-addb-418d-a276-7fb653d69737\") " pod="openshift-monitoring/node-exporter-rcgss" Jun 03 13:56:51.747604 ip-10-0-134-229 kubenswrapper[2574]: I0603 13:56:51.747522 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/11db619d-addb-418d-a276-7fb653d69737-node-exporter-wtmp\") pod \"node-exporter-rcgss\" (UID: \"11db619d-addb-418d-a276-7fb653d69737\") " pod="openshift-monitoring/node-exporter-rcgss" Jun 03 13:56:51.747604 ip-10-0-134-229 kubenswrapper[2574]: I0603 13:56:51.747541 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/11db619d-addb-418d-a276-7fb653d69737-node-exporter-textfile\") pod \"node-exporter-rcgss\" (UID: \"11db619d-addb-418d-a276-7fb653d69737\") " pod="openshift-monitoring/node-exporter-rcgss" Jun 03 13:56:51.747604 ip-10-0-134-229 kubenswrapper[2574]: I0603 13:56:51.747559 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/11db619d-addb-418d-a276-7fb653d69737-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-rcgss\" (UID: \"11db619d-addb-418d-a276-7fb653d69737\") " pod="openshift-monitoring/node-exporter-rcgss" Jun 03 13:56:51.747823 ip-10-0-134-229 kubenswrapper[2574]: I0603 13:56:51.747640 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/11db619d-addb-418d-a276-7fb653d69737-sys\") pod \"node-exporter-rcgss\" (UID: \"11db619d-addb-418d-a276-7fb653d69737\") " pod="openshift-monitoring/node-exporter-rcgss" Jun 03 13:56:51.747823 ip-10-0-134-229 kubenswrapper[2574]: I0603 13:56:51.747673 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/11db619d-addb-418d-a276-7fb653d69737-node-exporter-tls\") pod \"node-exporter-rcgss\" (UID: \"11db619d-addb-418d-a276-7fb653d69737\") " pod="openshift-monitoring/node-exporter-rcgss" Jun 03 13:56:51.747823 ip-10-0-134-229 kubenswrapper[2574]: I0603 13:56:51.747711 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-8qbqw\" (UniqueName: \"kubernetes.io/projected/e07d69f8-1d21-4a42-b220-4b57e85432ff-kube-api-access-8qbqw\") pod \"openshift-state-metrics-85658796db-hxnp7\" (UID: \"e07d69f8-1d21-4a42-b220-4b57e85432ff\") " pod="openshift-monitoring/openshift-state-metrics-85658796db-hxnp7" Jun 03 13:56:51.747823 ip-10-0-134-229 kubenswrapper[2574]: I0603 13:56:51.747753 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/11db619d-addb-418d-a276-7fb653d69737-metrics-client-ca\") pod \"node-exporter-rcgss\" (UID: \"11db619d-addb-418d-a276-7fb653d69737\") " pod="openshift-monitoring/node-exporter-rcgss" Jun 03 13:56:51.747823 ip-10-0-134-229 kubenswrapper[2574]: I0603 13:56:51.747779 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/e07d69f8-1d21-4a42-b220-4b57e85432ff-metrics-client-ca\") pod \"openshift-state-metrics-85658796db-hxnp7\" (UID: \"e07d69f8-1d21-4a42-b220-4b57e85432ff\") " pod="openshift-monitoring/openshift-state-metrics-85658796db-hxnp7" Jun 03 13:56:51.747823 ip-10-0-134-229 kubenswrapper[2574]: I0603 13:56:51.747813 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-drr8t\" (UniqueName: \"kubernetes.io/projected/11db619d-addb-418d-a276-7fb653d69737-kube-api-access-drr8t\") pod \"node-exporter-rcgss\" (UID: \"11db619d-addb-418d-a276-7fb653d69737\") " pod="openshift-monitoring/node-exporter-rcgss" Jun 03 13:56:51.748015 ip-10-0-134-229 kubenswrapper[2574]: I0603 13:56:51.747880 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/e07d69f8-1d21-4a42-b220-4b57e85432ff-openshift-state-metrics-tls\") pod \"openshift-state-metrics-85658796db-hxnp7\" (UID: \"e07d69f8-1d21-4a42-b220-4b57e85432ff\") " pod="openshift-monitoring/openshift-state-metrics-85658796db-hxnp7" Jun 03 13:56:51.748015 ip-10-0-134-229 kubenswrapper[2574]: I0603 13:56:51.747912 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/11db619d-addb-418d-a276-7fb653d69737-node-exporter-accelerators-collector-config\") pod \"node-exporter-rcgss\" (UID: \"11db619d-addb-418d-a276-7fb653d69737\") " pod="openshift-monitoring/node-exporter-rcgss" Jun 03 13:56:51.848893 ip-10-0-134-229 kubenswrapper[2574]: I0603 13:56:51.848866 2574 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/11db619d-addb-418d-a276-7fb653d69737-node-exporter-accelerators-collector-config\") pod \"node-exporter-rcgss\" (UID: \"11db619d-addb-418d-a276-7fb653d69737\") " pod="openshift-monitoring/node-exporter-rcgss" Jun 03 13:56:51.849008 ip-10-0-134-229 kubenswrapper[2574]: I0603 13:56:51.848899 2574 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"openshift-state-metrics-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/e07d69f8-1d21-4a42-b220-4b57e85432ff-openshift-state-metrics-kube-rbac-proxy-config\") pod \"openshift-state-metrics-85658796db-hxnp7\" (UID: \"e07d69f8-1d21-4a42-b220-4b57e85432ff\") " pod="openshift-monitoring/openshift-state-metrics-85658796db-hxnp7" Jun 03 13:56:51.849008 ip-10-0-134-229 kubenswrapper[2574]: I0603 13:56:51.848915 2574 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"root\" (UniqueName: \"kubernetes.io/host-path/11db619d-addb-418d-a276-7fb653d69737-root\") pod \"node-exporter-rcgss\" (UID: \"11db619d-addb-418d-a276-7fb653d69737\") " pod="openshift-monitoring/node-exporter-rcgss" Jun 03 13:56:51.849008 ip-10-0-134-229 kubenswrapper[2574]: I0603 13:56:51.848962 2574 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/11db619d-addb-418d-a276-7fb653d69737-node-exporter-wtmp\") pod \"node-exporter-rcgss\" (UID: \"11db619d-addb-418d-a276-7fb653d69737\") " pod="openshift-monitoring/node-exporter-rcgss" Jun 03 13:56:51.849008 ip-10-0-134-229 kubenswrapper[2574]: I0603 13:56:51.848990 2574 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/11db619d-addb-418d-a276-7fb653d69737-node-exporter-textfile\") pod \"node-exporter-rcgss\" (UID: \"11db619d-addb-418d-a276-7fb653d69737\") " pod="openshift-monitoring/node-exporter-rcgss" Jun 03 13:56:51.849155 ip-10-0-134-229 kubenswrapper[2574]: I0603 13:56:51.849016 2574 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/11db619d-addb-418d-a276-7fb653d69737-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-rcgss\" (UID: \"11db619d-addb-418d-a276-7fb653d69737\") " pod="openshift-monitoring/node-exporter-rcgss" Jun 03 13:56:51.849155 ip-10-0-134-229 kubenswrapper[2574]: I0603 13:56:51.849050 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"root\" (UniqueName: \"kubernetes.io/host-path/11db619d-addb-418d-a276-7fb653d69737-root\") pod \"node-exporter-rcgss\" (UID: \"11db619d-addb-418d-a276-7fb653d69737\") " pod="openshift-monitoring/node-exporter-rcgss" Jun 03 13:56:51.849155 ip-10-0-134-229 kubenswrapper[2574]: I0603 13:56:51.849063 2574 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/11db619d-addb-418d-a276-7fb653d69737-sys\") pod \"node-exporter-rcgss\" (UID: \"11db619d-addb-418d-a276-7fb653d69737\") " pod="openshift-monitoring/node-exporter-rcgss" Jun 03 13:56:51.849155 ip-10-0-134-229 kubenswrapper[2574]: I0603 13:56:51.849085 2574 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/11db619d-addb-418d-a276-7fb653d69737-node-exporter-tls\") pod \"node-exporter-rcgss\" (UID: \"11db619d-addb-418d-a276-7fb653d69737\") " pod="openshift-monitoring/node-exporter-rcgss" Jun 03 13:56:51.849155 ip-10-0-134-229 kubenswrapper[2574]: I0603 13:56:51.849120 2574 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-8qbqw\" (UniqueName: \"kubernetes.io/projected/e07d69f8-1d21-4a42-b220-4b57e85432ff-kube-api-access-8qbqw\") pod \"openshift-state-metrics-85658796db-hxnp7\" (UID: \"e07d69f8-1d21-4a42-b220-4b57e85432ff\") " pod="openshift-monitoring/openshift-state-metrics-85658796db-hxnp7" Jun 03 13:56:51.849155 ip-10-0-134-229 kubenswrapper[2574]: I0603 13:56:51.849147 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/11db619d-addb-418d-a276-7fb653d69737-node-exporter-wtmp\") pod \"node-exporter-rcgss\" (UID: \"11db619d-addb-418d-a276-7fb653d69737\") " pod="openshift-monitoring/node-exporter-rcgss" Jun 03 13:56:51.849475 ip-10-0-134-229 kubenswrapper[2574]: I0603 13:56:51.849165 2574 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/11db619d-addb-418d-a276-7fb653d69737-metrics-client-ca\") pod \"node-exporter-rcgss\" (UID: \"11db619d-addb-418d-a276-7fb653d69737\") " pod="openshift-monitoring/node-exporter-rcgss" Jun 03 13:56:51.849475 ip-10-0-134-229 kubenswrapper[2574]: I0603 13:56:51.849195 2574 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/e07d69f8-1d21-4a42-b220-4b57e85432ff-metrics-client-ca\") pod \"openshift-state-metrics-85658796db-hxnp7\" (UID: \"e07d69f8-1d21-4a42-b220-4b57e85432ff\") " pod="openshift-monitoring/openshift-state-metrics-85658796db-hxnp7" Jun 03 13:56:51.849475 ip-10-0-134-229 kubenswrapper[2574]: I0603 13:56:51.849232 2574 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-drr8t\" (UniqueName: \"kubernetes.io/projected/11db619d-addb-418d-a276-7fb653d69737-kube-api-access-drr8t\") pod \"node-exporter-rcgss\" (UID: \"11db619d-addb-418d-a276-7fb653d69737\") " pod="openshift-monitoring/node-exporter-rcgss" Jun 03 13:56:51.849475 ip-10-0-134-229 kubenswrapper[2574]: I0603 13:56:51.849163 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/11db619d-addb-418d-a276-7fb653d69737-sys\") pod \"node-exporter-rcgss\" (UID: \"11db619d-addb-418d-a276-7fb653d69737\") " pod="openshift-monitoring/node-exporter-rcgss" Jun 03 13:56:51.849475 ip-10-0-134-229 kubenswrapper[2574]: E0603 13:56:51.849197 2574 secret.go:189] Couldn't get secret openshift-monitoring/node-exporter-tls: secret "node-exporter-tls" not found Jun 03 13:56:51.849475 ip-10-0-134-229 kubenswrapper[2574]: E0603 13:56:51.849399 2574 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/11db619d-addb-418d-a276-7fb653d69737-node-exporter-tls podName:11db619d-addb-418d-a276-7fb653d69737 nodeName:}" failed. No retries permitted until 2026-06-03 13:56:52.349343823 +0000 UTC m=+173.533351132 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "node-exporter-tls" (UniqueName: "kubernetes.io/secret/11db619d-addb-418d-a276-7fb653d69737-node-exporter-tls") pod "node-exporter-rcgss" (UID: "11db619d-addb-418d-a276-7fb653d69737") : secret "node-exporter-tls" not found Jun 03 13:56:51.849475 ip-10-0-134-229 kubenswrapper[2574]: I0603 13:56:51.849288 2574 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"openshift-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/e07d69f8-1d21-4a42-b220-4b57e85432ff-openshift-state-metrics-tls\") pod \"openshift-state-metrics-85658796db-hxnp7\" (UID: \"e07d69f8-1d21-4a42-b220-4b57e85432ff\") " pod="openshift-monitoring/openshift-state-metrics-85658796db-hxnp7" Jun 03 13:56:51.849829 ip-10-0-134-229 kubenswrapper[2574]: I0603 13:56:51.849765 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/11db619d-addb-418d-a276-7fb653d69737-metrics-client-ca\") pod \"node-exporter-rcgss\" (UID: \"11db619d-addb-418d-a276-7fb653d69737\") " pod="openshift-monitoring/node-exporter-rcgss" Jun 03 13:56:51.849917 ip-10-0-134-229 kubenswrapper[2574]: I0603 13:56:51.849892 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/e07d69f8-1d21-4a42-b220-4b57e85432ff-metrics-client-ca\") pod \"openshift-state-metrics-85658796db-hxnp7\" (UID: \"e07d69f8-1d21-4a42-b220-4b57e85432ff\") " pod="openshift-monitoring/openshift-state-metrics-85658796db-hxnp7" Jun 03 13:56:51.849917 ip-10-0-134-229 kubenswrapper[2574]: I0603 13:56:51.849906 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/11db619d-addb-418d-a276-7fb653d69737-node-exporter-textfile\") pod \"node-exporter-rcgss\" (UID: \"11db619d-addb-418d-a276-7fb653d69737\") " pod="openshift-monitoring/node-exporter-rcgss" Jun 03 13:56:51.850091 ip-10-0-134-229 kubenswrapper[2574]: I0603 13:56:51.849973 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/11db619d-addb-418d-a276-7fb653d69737-node-exporter-accelerators-collector-config\") pod \"node-exporter-rcgss\" (UID: \"11db619d-addb-418d-a276-7fb653d69737\") " pod="openshift-monitoring/node-exporter-rcgss" Jun 03 13:56:51.851565 ip-10-0-134-229 kubenswrapper[2574]: I0603 13:56:51.851544 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"openshift-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/e07d69f8-1d21-4a42-b220-4b57e85432ff-openshift-state-metrics-tls\") pod \"openshift-state-metrics-85658796db-hxnp7\" (UID: \"e07d69f8-1d21-4a42-b220-4b57e85432ff\") " pod="openshift-monitoring/openshift-state-metrics-85658796db-hxnp7" Jun 03 13:56:51.851758 ip-10-0-134-229 kubenswrapper[2574]: I0603 13:56:51.851739 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/11db619d-addb-418d-a276-7fb653d69737-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-rcgss\" (UID: \"11db619d-addb-418d-a276-7fb653d69737\") " pod="openshift-monitoring/node-exporter-rcgss" Jun 03 13:56:51.851895 ip-10-0-134-229 kubenswrapper[2574]: I0603 13:56:51.851877 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"openshift-state-metrics-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/e07d69f8-1d21-4a42-b220-4b57e85432ff-openshift-state-metrics-kube-rbac-proxy-config\") pod \"openshift-state-metrics-85658796db-hxnp7\" (UID: \"e07d69f8-1d21-4a42-b220-4b57e85432ff\") " pod="openshift-monitoring/openshift-state-metrics-85658796db-hxnp7" Jun 03 13:56:51.859743 ip-10-0-134-229 kubenswrapper[2574]: I0603 13:56:51.859722 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-8qbqw\" (UniqueName: \"kubernetes.io/projected/e07d69f8-1d21-4a42-b220-4b57e85432ff-kube-api-access-8qbqw\") pod \"openshift-state-metrics-85658796db-hxnp7\" (UID: \"e07d69f8-1d21-4a42-b220-4b57e85432ff\") " pod="openshift-monitoring/openshift-state-metrics-85658796db-hxnp7" Jun 03 13:56:51.861887 ip-10-0-134-229 kubenswrapper[2574]: I0603 13:56:51.861868 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-drr8t\" (UniqueName: \"kubernetes.io/projected/11db619d-addb-418d-a276-7fb653d69737-kube-api-access-drr8t\") pod \"node-exporter-rcgss\" (UID: \"11db619d-addb-418d-a276-7fb653d69737\") " pod="openshift-monitoring/node-exporter-rcgss" Jun 03 13:56:51.953118 ip-10-0-134-229 kubenswrapper[2574]: I0603 13:56:51.953060 2574 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/openshift-state-metrics-85658796db-hxnp7" Jun 03 13:56:52.072282 ip-10-0-134-229 kubenswrapper[2574]: I0603 13:56:52.072246 2574 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/openshift-state-metrics-85658796db-hxnp7"] Jun 03 13:56:52.074932 ip-10-0-134-229 kubenswrapper[2574]: W0603 13:56:52.074904 2574 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pode07d69f8_1d21_4a42_b220_4b57e85432ff.slice/crio-cd505d6c36a4666d5d4ea591c0a7e4c6d0cb561abe6ab9b700b23de6881faf23 WatchSource:0}: Error finding container cd505d6c36a4666d5d4ea591c0a7e4c6d0cb561abe6ab9b700b23de6881faf23: Status 404 returned error can't find the container with id cd505d6c36a4666d5d4ea591c0a7e4c6d0cb561abe6ab9b700b23de6881faf23 Jun 03 13:56:52.353169 ip-10-0-134-229 kubenswrapper[2574]: I0603 13:56:52.353089 2574 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/11db619d-addb-418d-a276-7fb653d69737-node-exporter-tls\") pod \"node-exporter-rcgss\" (UID: \"11db619d-addb-418d-a276-7fb653d69737\") " pod="openshift-monitoring/node-exporter-rcgss" Jun 03 13:56:52.355303 ip-10-0-134-229 kubenswrapper[2574]: I0603 13:56:52.355286 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/11db619d-addb-418d-a276-7fb653d69737-node-exporter-tls\") pod \"node-exporter-rcgss\" (UID: \"11db619d-addb-418d-a276-7fb653d69737\") " pod="openshift-monitoring/node-exporter-rcgss" Jun 03 13:56:52.573010 ip-10-0-134-229 kubenswrapper[2574]: I0603 13:56:52.572974 2574 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/node-exporter-rcgss" Jun 03 13:56:52.581165 ip-10-0-134-229 kubenswrapper[2574]: W0603 13:56:52.581139 2574 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod11db619d_addb_418d_a276_7fb653d69737.slice/crio-31301ca81db427c7b4565dc4a651110296e56f4cadf708b92969fa7f0ef116ac WatchSource:0}: Error finding container 31301ca81db427c7b4565dc4a651110296e56f4cadf708b92969fa7f0ef116ac: Status 404 returned error can't find the container with id 31301ca81db427c7b4565dc4a651110296e56f4cadf708b92969fa7f0ef116ac Jun 03 13:56:52.962069 ip-10-0-134-229 kubenswrapper[2574]: I0603 13:56:52.962034 2574 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/openshift-state-metrics-85658796db-hxnp7" event={"ID":"e07d69f8-1d21-4a42-b220-4b57e85432ff","Type":"ContainerStarted","Data":"fbdf4e83d264e4d3ba3caf220f7d7806a40db876cee3718db72934323533ea8c"} Jun 03 13:56:52.962471 ip-10-0-134-229 kubenswrapper[2574]: I0603 13:56:52.962075 2574 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/openshift-state-metrics-85658796db-hxnp7" event={"ID":"e07d69f8-1d21-4a42-b220-4b57e85432ff","Type":"ContainerStarted","Data":"d3e9f6bb4f1adcd9502bebbbbd8966b87e15b1d998a72b6c77e047b4c62076c1"} Jun 03 13:56:52.962471 ip-10-0-134-229 kubenswrapper[2574]: I0603 13:56:52.962090 2574 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/openshift-state-metrics-85658796db-hxnp7" event={"ID":"e07d69f8-1d21-4a42-b220-4b57e85432ff","Type":"ContainerStarted","Data":"cd505d6c36a4666d5d4ea591c0a7e4c6d0cb561abe6ab9b700b23de6881faf23"} Jun 03 13:56:52.963029 ip-10-0-134-229 kubenswrapper[2574]: I0603 13:56:52.963007 2574 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-rcgss" event={"ID":"11db619d-addb-418d-a276-7fb653d69737","Type":"ContainerStarted","Data":"31301ca81db427c7b4565dc4a651110296e56f4cadf708b92969fa7f0ef116ac"} Jun 03 13:56:53.932315 ip-10-0-134-229 kubenswrapper[2574]: I0603 13:56:53.932282 2574 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-dns/dns-default-cmpk7" Jun 03 13:56:53.968519 ip-10-0-134-229 kubenswrapper[2574]: I0603 13:56:53.968482 2574 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/openshift-state-metrics-85658796db-hxnp7" event={"ID":"e07d69f8-1d21-4a42-b220-4b57e85432ff","Type":"ContainerStarted","Data":"c890b69ea9087b9ad23ddc93656b3b6ef87227c7e526ae065e72d2c13758cfba"} Jun 03 13:56:53.969990 ip-10-0-134-229 kubenswrapper[2574]: I0603 13:56:53.969963 2574 generic.go:358] "Generic (PLEG): container finished" podID="11db619d-addb-418d-a276-7fb653d69737" containerID="383e03b88b16868c41c2a80d9f3f1fd4f4029e7f008b7cb52103283ad80a8c85" exitCode=0 Jun 03 13:56:53.970124 ip-10-0-134-229 kubenswrapper[2574]: I0603 13:56:53.970046 2574 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-rcgss" event={"ID":"11db619d-addb-418d-a276-7fb653d69737","Type":"ContainerDied","Data":"383e03b88b16868c41c2a80d9f3f1fd4f4029e7f008b7cb52103283ad80a8c85"} Jun 03 13:56:53.990366 ip-10-0-134-229 kubenswrapper[2574]: I0603 13:56:53.990327 2574 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-monitoring/openshift-state-metrics-85658796db-hxnp7" podStartSLOduration=1.903194739 podStartE2EDuration="2.990311263s" podCreationTimestamp="2026-06-03 13:56:51 +0000 UTC" firstStartedPulling="2026-06-03 13:56:52.18855317 +0000 UTC m=+173.372560481" lastFinishedPulling="2026-06-03 13:56:53.275669684 +0000 UTC m=+174.459677005" observedRunningTime="2026-06-03 13:56:53.98907784 +0000 UTC m=+175.173085169" watchObservedRunningTime="2026-06-03 13:56:53.990311263 +0000 UTC m=+175.174318636" Jun 03 13:56:54.105826 ip-10-0-134-229 kubenswrapper[2574]: I0603 13:56:54.105798 2574 patch_prober.go:28] interesting pod/image-registry-75c86b6d9c-xcmd7 container/registry namespace/openshift-image-registry: Readiness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body={"errors":[{"code":"UNAVAILABLE","message":"service unavailable","detail":"health check failed: please see /debug/health"}]} Jun 03 13:56:54.105952 ip-10-0-134-229 kubenswrapper[2574]: I0603 13:56:54.105840 2574 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-image-registry/image-registry-75c86b6d9c-xcmd7" podUID="45018365-b30b-4ef0-b920-e0ddc6c71e9b" containerName="registry" probeResult="failure" output="HTTP probe failed with statuscode: 503" Jun 03 13:56:54.974024 ip-10-0-134-229 kubenswrapper[2574]: I0603 13:56:54.973988 2574 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-rcgss" event={"ID":"11db619d-addb-418d-a276-7fb653d69737","Type":"ContainerStarted","Data":"4a5a71039c4b19737b53671dc487be5750636da4698a9d180fa0449996a7e283"} Jun 03 13:56:54.974024 ip-10-0-134-229 kubenswrapper[2574]: I0603 13:56:54.974029 2574 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-rcgss" event={"ID":"11db619d-addb-418d-a276-7fb653d69737","Type":"ContainerStarted","Data":"60934a9dc6ba844824353737130fbb28137e7b30bf02ed82566da8ab24c12ec8"} Jun 03 13:56:54.993401 ip-10-0-134-229 kubenswrapper[2574]: I0603 13:56:54.993333 2574 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-monitoring/node-exporter-rcgss" podStartSLOduration=3.068917584 podStartE2EDuration="3.993316917s" podCreationTimestamp="2026-06-03 13:56:51 +0000 UTC" firstStartedPulling="2026-06-03 13:56:52.582683891 +0000 UTC m=+173.766691199" lastFinishedPulling="2026-06-03 13:56:53.507083214 +0000 UTC m=+174.691090532" observedRunningTime="2026-06-03 13:56:54.99154969 +0000 UTC m=+176.175557018" watchObservedRunningTime="2026-06-03 13:56:54.993316917 +0000 UTC m=+176.177324247" Jun 03 13:56:56.432607 ip-10-0-134-229 kubenswrapper[2574]: I0603 13:56:56.432578 2574 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-monitoring/monitoring-plugin-5768fcc9dd-pdcwt"] Jun 03 13:56:56.434834 ip-10-0-134-229 kubenswrapper[2574]: I0603 13:56:56.434815 2574 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/monitoring-plugin-5768fcc9dd-pdcwt" Jun 03 13:56:56.437016 ip-10-0-134-229 kubenswrapper[2574]: I0603 13:56:56.436999 2574 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"monitoring-plugin-cert\"" Jun 03 13:56:56.437133 ip-10-0-134-229 kubenswrapper[2574]: I0603 13:56:56.437033 2574 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"default-dockercfg-bv44j\"" Jun 03 13:56:56.444617 ip-10-0-134-229 kubenswrapper[2574]: I0603 13:56:56.444592 2574 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/monitoring-plugin-5768fcc9dd-pdcwt"] Jun 03 13:56:56.510987 ip-10-0-134-229 kubenswrapper[2574]: I0603 13:56:56.510956 2574 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-console/console-68d556b99d-hw6dm"] Jun 03 13:56:56.513198 ip-10-0-134-229 kubenswrapper[2574]: I0603 13:56:56.513182 2574 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-68d556b99d-hw6dm" Jun 03 13:56:56.515678 ip-10-0-134-229 kubenswrapper[2574]: I0603 13:56:56.515645 2574 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-serving-cert\"" Jun 03 13:56:56.515678 ip-10-0-134-229 kubenswrapper[2574]: I0603 13:56:56.515658 2574 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"oauth-serving-cert\"" Jun 03 13:56:56.515678 ip-10-0-134-229 kubenswrapper[2574]: I0603 13:56:56.515658 2574 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-dockercfg-xwklm\"" Jun 03 13:56:56.515898 ip-10-0-134-229 kubenswrapper[2574]: I0603 13:56:56.515690 2574 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-oauth-config\"" Jun 03 13:56:56.515898 ip-10-0-134-229 kubenswrapper[2574]: I0603 13:56:56.515779 2574 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"openshift-service-ca.crt\"" Jun 03 13:56:56.516003 ip-10-0-134-229 kubenswrapper[2574]: I0603 13:56:56.515989 2574 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"kube-root-ca.crt\"" Jun 03 13:56:56.516293 ip-10-0-134-229 kubenswrapper[2574]: I0603 13:56:56.516278 2574 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"console-config\"" Jun 03 13:56:56.516361 ip-10-0-134-229 kubenswrapper[2574]: I0603 13:56:56.516329 2574 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"service-ca\"" Jun 03 13:56:56.521155 ip-10-0-134-229 kubenswrapper[2574]: I0603 13:56:56.521135 2574 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"trusted-ca-bundle\"" Jun 03 13:56:56.525567 ip-10-0-134-229 kubenswrapper[2574]: I0603 13:56:56.525547 2574 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-68d556b99d-hw6dm"] Jun 03 13:56:56.590696 ip-10-0-134-229 kubenswrapper[2574]: I0603 13:56:56.590646 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/d4ae7b11-fd77-4477-a3ec-c450325cefae-console-config\") pod \"console-68d556b99d-hw6dm\" (UID: \"d4ae7b11-fd77-4477-a3ec-c450325cefae\") " pod="openshift-console/console-68d556b99d-hw6dm" Jun 03 13:56:56.590853 ip-10-0-134-229 kubenswrapper[2574]: I0603 13:56:56.590725 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-xfbx2\" (UniqueName: \"kubernetes.io/projected/d4ae7b11-fd77-4477-a3ec-c450325cefae-kube-api-access-xfbx2\") pod \"console-68d556b99d-hw6dm\" (UID: \"d4ae7b11-fd77-4477-a3ec-c450325cefae\") " pod="openshift-console/console-68d556b99d-hw6dm" Jun 03 13:56:56.590853 ip-10-0-134-229 kubenswrapper[2574]: I0603 13:56:56.590751 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/d4ae7b11-fd77-4477-a3ec-c450325cefae-oauth-serving-cert\") pod \"console-68d556b99d-hw6dm\" (UID: \"d4ae7b11-fd77-4477-a3ec-c450325cefae\") " pod="openshift-console/console-68d556b99d-hw6dm" Jun 03 13:56:56.590853 ip-10-0-134-229 kubenswrapper[2574]: I0603 13:56:56.590766 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/d4ae7b11-fd77-4477-a3ec-c450325cefae-service-ca\") pod \"console-68d556b99d-hw6dm\" (UID: \"d4ae7b11-fd77-4477-a3ec-c450325cefae\") " pod="openshift-console/console-68d556b99d-hw6dm" Jun 03 13:56:56.590853 ip-10-0-134-229 kubenswrapper[2574]: I0603 13:56:56.590792 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"monitoring-plugin-cert\" (UniqueName: \"kubernetes.io/secret/a4917932-d0e5-4dfa-a344-de6fd335cab9-monitoring-plugin-cert\") pod \"monitoring-plugin-5768fcc9dd-pdcwt\" (UID: \"a4917932-d0e5-4dfa-a344-de6fd335cab9\") " pod="openshift-monitoring/monitoring-plugin-5768fcc9dd-pdcwt" Jun 03 13:56:56.590978 ip-10-0-134-229 kubenswrapper[2574]: I0603 13:56:56.590888 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/d4ae7b11-fd77-4477-a3ec-c450325cefae-console-serving-cert\") pod \"console-68d556b99d-hw6dm\" (UID: \"d4ae7b11-fd77-4477-a3ec-c450325cefae\") " pod="openshift-console/console-68d556b99d-hw6dm" Jun 03 13:56:56.590978 ip-10-0-134-229 kubenswrapper[2574]: I0603 13:56:56.590913 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/d4ae7b11-fd77-4477-a3ec-c450325cefae-console-oauth-config\") pod \"console-68d556b99d-hw6dm\" (UID: \"d4ae7b11-fd77-4477-a3ec-c450325cefae\") " pod="openshift-console/console-68d556b99d-hw6dm" Jun 03 13:56:56.590978 ip-10-0-134-229 kubenswrapper[2574]: I0603 13:56:56.590936 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/d4ae7b11-fd77-4477-a3ec-c450325cefae-trusted-ca-bundle\") pod \"console-68d556b99d-hw6dm\" (UID: \"d4ae7b11-fd77-4477-a3ec-c450325cefae\") " pod="openshift-console/console-68d556b99d-hw6dm" Jun 03 13:56:56.691854 ip-10-0-134-229 kubenswrapper[2574]: I0603 13:56:56.691777 2574 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/d4ae7b11-fd77-4477-a3ec-c450325cefae-console-serving-cert\") pod \"console-68d556b99d-hw6dm\" (UID: \"d4ae7b11-fd77-4477-a3ec-c450325cefae\") " pod="openshift-console/console-68d556b99d-hw6dm" Jun 03 13:56:56.691854 ip-10-0-134-229 kubenswrapper[2574]: I0603 13:56:56.691810 2574 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/d4ae7b11-fd77-4477-a3ec-c450325cefae-console-oauth-config\") pod \"console-68d556b99d-hw6dm\" (UID: \"d4ae7b11-fd77-4477-a3ec-c450325cefae\") " pod="openshift-console/console-68d556b99d-hw6dm" Jun 03 13:56:56.691854 ip-10-0-134-229 kubenswrapper[2574]: I0603 13:56:56.691827 2574 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/d4ae7b11-fd77-4477-a3ec-c450325cefae-trusted-ca-bundle\") pod \"console-68d556b99d-hw6dm\" (UID: \"d4ae7b11-fd77-4477-a3ec-c450325cefae\") " pod="openshift-console/console-68d556b99d-hw6dm" Jun 03 13:56:56.692062 ip-10-0-134-229 kubenswrapper[2574]: I0603 13:56:56.691871 2574 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/d4ae7b11-fd77-4477-a3ec-c450325cefae-console-config\") pod \"console-68d556b99d-hw6dm\" (UID: \"d4ae7b11-fd77-4477-a3ec-c450325cefae\") " pod="openshift-console/console-68d556b99d-hw6dm" Jun 03 13:56:56.692062 ip-10-0-134-229 kubenswrapper[2574]: I0603 13:56:56.691920 2574 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-xfbx2\" (UniqueName: \"kubernetes.io/projected/d4ae7b11-fd77-4477-a3ec-c450325cefae-kube-api-access-xfbx2\") pod \"console-68d556b99d-hw6dm\" (UID: \"d4ae7b11-fd77-4477-a3ec-c450325cefae\") " pod="openshift-console/console-68d556b99d-hw6dm" Jun 03 13:56:56.692062 ip-10-0-134-229 kubenswrapper[2574]: I0603 13:56:56.691945 2574 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/d4ae7b11-fd77-4477-a3ec-c450325cefae-oauth-serving-cert\") pod \"console-68d556b99d-hw6dm\" (UID: \"d4ae7b11-fd77-4477-a3ec-c450325cefae\") " pod="openshift-console/console-68d556b99d-hw6dm" Jun 03 13:56:56.692062 ip-10-0-134-229 kubenswrapper[2574]: I0603 13:56:56.691986 2574 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/d4ae7b11-fd77-4477-a3ec-c450325cefae-service-ca\") pod \"console-68d556b99d-hw6dm\" (UID: \"d4ae7b11-fd77-4477-a3ec-c450325cefae\") " pod="openshift-console/console-68d556b99d-hw6dm" Jun 03 13:56:56.692062 ip-10-0-134-229 kubenswrapper[2574]: I0603 13:56:56.692022 2574 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"monitoring-plugin-cert\" (UniqueName: \"kubernetes.io/secret/a4917932-d0e5-4dfa-a344-de6fd335cab9-monitoring-plugin-cert\") pod \"monitoring-plugin-5768fcc9dd-pdcwt\" (UID: \"a4917932-d0e5-4dfa-a344-de6fd335cab9\") " pod="openshift-monitoring/monitoring-plugin-5768fcc9dd-pdcwt" Jun 03 13:56:56.692290 ip-10-0-134-229 kubenswrapper[2574]: E0603 13:56:56.692117 2574 secret.go:189] Couldn't get secret openshift-monitoring/monitoring-plugin-cert: secret "monitoring-plugin-cert" not found Jun 03 13:56:56.692290 ip-10-0-134-229 kubenswrapper[2574]: E0603 13:56:56.692174 2574 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/a4917932-d0e5-4dfa-a344-de6fd335cab9-monitoring-plugin-cert podName:a4917932-d0e5-4dfa-a344-de6fd335cab9 nodeName:}" failed. No retries permitted until 2026-06-03 13:56:57.192156643 +0000 UTC m=+178.376163954 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "monitoring-plugin-cert" (UniqueName: "kubernetes.io/secret/a4917932-d0e5-4dfa-a344-de6fd335cab9-monitoring-plugin-cert") pod "monitoring-plugin-5768fcc9dd-pdcwt" (UID: "a4917932-d0e5-4dfa-a344-de6fd335cab9") : secret "monitoring-plugin-cert" not found Jun 03 13:56:56.692750 ip-10-0-134-229 kubenswrapper[2574]: I0603 13:56:56.692727 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/d4ae7b11-fd77-4477-a3ec-c450325cefae-oauth-serving-cert\") pod \"console-68d556b99d-hw6dm\" (UID: \"d4ae7b11-fd77-4477-a3ec-c450325cefae\") " pod="openshift-console/console-68d556b99d-hw6dm" Jun 03 13:56:56.692830 ip-10-0-134-229 kubenswrapper[2574]: I0603 13:56:56.692730 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/d4ae7b11-fd77-4477-a3ec-c450325cefae-console-config\") pod \"console-68d556b99d-hw6dm\" (UID: \"d4ae7b11-fd77-4477-a3ec-c450325cefae\") " pod="openshift-console/console-68d556b99d-hw6dm" Jun 03 13:56:56.692884 ip-10-0-134-229 kubenswrapper[2574]: I0603 13:56:56.692866 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/d4ae7b11-fd77-4477-a3ec-c450325cefae-service-ca\") pod \"console-68d556b99d-hw6dm\" (UID: \"d4ae7b11-fd77-4477-a3ec-c450325cefae\") " pod="openshift-console/console-68d556b99d-hw6dm" Jun 03 13:56:56.692916 ip-10-0-134-229 kubenswrapper[2574]: I0603 13:56:56.692901 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/d4ae7b11-fd77-4477-a3ec-c450325cefae-trusted-ca-bundle\") pod \"console-68d556b99d-hw6dm\" (UID: \"d4ae7b11-fd77-4477-a3ec-c450325cefae\") " pod="openshift-console/console-68d556b99d-hw6dm" Jun 03 13:56:56.694313 ip-10-0-134-229 kubenswrapper[2574]: I0603 13:56:56.694281 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/d4ae7b11-fd77-4477-a3ec-c450325cefae-console-oauth-config\") pod \"console-68d556b99d-hw6dm\" (UID: \"d4ae7b11-fd77-4477-a3ec-c450325cefae\") " pod="openshift-console/console-68d556b99d-hw6dm" Jun 03 13:56:56.694422 ip-10-0-134-229 kubenswrapper[2574]: I0603 13:56:56.694368 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/d4ae7b11-fd77-4477-a3ec-c450325cefae-console-serving-cert\") pod \"console-68d556b99d-hw6dm\" (UID: \"d4ae7b11-fd77-4477-a3ec-c450325cefae\") " pod="openshift-console/console-68d556b99d-hw6dm" Jun 03 13:56:56.703686 ip-10-0-134-229 kubenswrapper[2574]: I0603 13:56:56.703665 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-xfbx2\" (UniqueName: \"kubernetes.io/projected/d4ae7b11-fd77-4477-a3ec-c450325cefae-kube-api-access-xfbx2\") pod \"console-68d556b99d-hw6dm\" (UID: \"d4ae7b11-fd77-4477-a3ec-c450325cefae\") " pod="openshift-console/console-68d556b99d-hw6dm" Jun 03 13:56:56.822814 ip-10-0-134-229 kubenswrapper[2574]: I0603 13:56:56.822786 2574 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-68d556b99d-hw6dm" Jun 03 13:56:56.953609 ip-10-0-134-229 kubenswrapper[2574]: I0603 13:56:56.953533 2574 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-68d556b99d-hw6dm"] Jun 03 13:56:56.955914 ip-10-0-134-229 kubenswrapper[2574]: W0603 13:56:56.955893 2574 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podd4ae7b11_fd77_4477_a3ec_c450325cefae.slice/crio-022c33ca8242fa6b56fc36cbdb048884afd3e97acdbbf33f3340ece6c4d333f3 WatchSource:0}: Error finding container 022c33ca8242fa6b56fc36cbdb048884afd3e97acdbbf33f3340ece6c4d333f3: Status 404 returned error can't find the container with id 022c33ca8242fa6b56fc36cbdb048884afd3e97acdbbf33f3340ece6c4d333f3 Jun 03 13:56:56.979728 ip-10-0-134-229 kubenswrapper[2574]: I0603 13:56:56.979682 2574 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-68d556b99d-hw6dm" event={"ID":"d4ae7b11-fd77-4477-a3ec-c450325cefae","Type":"ContainerStarted","Data":"022c33ca8242fa6b56fc36cbdb048884afd3e97acdbbf33f3340ece6c4d333f3"} Jun 03 13:56:57.195481 ip-10-0-134-229 kubenswrapper[2574]: I0603 13:56:57.195448 2574 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"monitoring-plugin-cert\" (UniqueName: \"kubernetes.io/secret/a4917932-d0e5-4dfa-a344-de6fd335cab9-monitoring-plugin-cert\") pod \"monitoring-plugin-5768fcc9dd-pdcwt\" (UID: \"a4917932-d0e5-4dfa-a344-de6fd335cab9\") " pod="openshift-monitoring/monitoring-plugin-5768fcc9dd-pdcwt" Jun 03 13:56:57.197771 ip-10-0-134-229 kubenswrapper[2574]: I0603 13:56:57.197742 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"monitoring-plugin-cert\" (UniqueName: \"kubernetes.io/secret/a4917932-d0e5-4dfa-a344-de6fd335cab9-monitoring-plugin-cert\") pod \"monitoring-plugin-5768fcc9dd-pdcwt\" (UID: \"a4917932-d0e5-4dfa-a344-de6fd335cab9\") " pod="openshift-monitoring/monitoring-plugin-5768fcc9dd-pdcwt" Jun 03 13:56:57.343472 ip-10-0-134-229 kubenswrapper[2574]: I0603 13:56:57.343393 2574 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/monitoring-plugin-5768fcc9dd-pdcwt" Jun 03 13:56:57.477725 ip-10-0-134-229 kubenswrapper[2574]: I0603 13:56:57.477646 2574 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/monitoring-plugin-5768fcc9dd-pdcwt"] Jun 03 13:56:57.480541 ip-10-0-134-229 kubenswrapper[2574]: W0603 13:56:57.480513 2574 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poda4917932_d0e5_4dfa_a344_de6fd335cab9.slice/crio-75641eea4e2609fc6071ae535d56985648d55faafa3af66f7de2bad7d02713b4 WatchSource:0}: Error finding container 75641eea4e2609fc6071ae535d56985648d55faafa3af66f7de2bad7d02713b4: Status 404 returned error can't find the container with id 75641eea4e2609fc6071ae535d56985648d55faafa3af66f7de2bad7d02713b4 Jun 03 13:56:57.984090 ip-10-0-134-229 kubenswrapper[2574]: I0603 13:56:57.984042 2574 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/monitoring-plugin-5768fcc9dd-pdcwt" event={"ID":"a4917932-d0e5-4dfa-a344-de6fd335cab9","Type":"ContainerStarted","Data":"75641eea4e2609fc6071ae535d56985648d55faafa3af66f7de2bad7d02713b4"} Jun 03 13:57:00.994444 ip-10-0-134-229 kubenswrapper[2574]: I0603 13:57:00.994401 2574 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-68d556b99d-hw6dm" event={"ID":"d4ae7b11-fd77-4477-a3ec-c450325cefae","Type":"ContainerStarted","Data":"2adf45a2d672bf55633603845b5476baf0e27d84f5d493290689b98dcdcd9a74"} Jun 03 13:57:00.995579 ip-10-0-134-229 kubenswrapper[2574]: I0603 13:57:00.995556 2574 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/monitoring-plugin-5768fcc9dd-pdcwt" event={"ID":"a4917932-d0e5-4dfa-a344-de6fd335cab9","Type":"ContainerStarted","Data":"8e83aa39a2e314190653aaf1a337ea99dd052c1bbdb00583db076203d1e692e6"} Jun 03 13:57:00.995757 ip-10-0-134-229 kubenswrapper[2574]: I0603 13:57:00.995741 2574 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-monitoring/monitoring-plugin-5768fcc9dd-pdcwt" Jun 03 13:57:01.000337 ip-10-0-134-229 kubenswrapper[2574]: I0603 13:57:01.000316 2574 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-monitoring/monitoring-plugin-5768fcc9dd-pdcwt" Jun 03 13:57:01.012998 ip-10-0-134-229 kubenswrapper[2574]: I0603 13:57:01.012953 2574 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-console/console-68d556b99d-hw6dm" podStartSLOduration=2.001232771 podStartE2EDuration="5.012938591s" podCreationTimestamp="2026-06-03 13:56:56 +0000 UTC" firstStartedPulling="2026-06-03 13:56:56.95788388 +0000 UTC m=+178.141891190" lastFinishedPulling="2026-06-03 13:56:59.96958969 +0000 UTC m=+181.153597010" observedRunningTime="2026-06-03 13:57:01.012229273 +0000 UTC m=+182.196236602" watchObservedRunningTime="2026-06-03 13:57:01.012938591 +0000 UTC m=+182.196945917" Jun 03 13:57:04.105093 ip-10-0-134-229 kubenswrapper[2574]: I0603 13:57:04.105063 2574 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-image-registry/image-registry-75c86b6d9c-xcmd7" Jun 03 13:57:04.123820 ip-10-0-134-229 kubenswrapper[2574]: I0603 13:57:04.123777 2574 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-monitoring/monitoring-plugin-5768fcc9dd-pdcwt" podStartSLOduration=5.638200125 podStartE2EDuration="8.123765135s" podCreationTimestamp="2026-06-03 13:56:56 +0000 UTC" firstStartedPulling="2026-06-03 13:56:57.48280339 +0000 UTC m=+178.666810697" lastFinishedPulling="2026-06-03 13:56:59.968368392 +0000 UTC m=+181.152375707" observedRunningTime="2026-06-03 13:57:01.049954025 +0000 UTC m=+182.233961353" watchObservedRunningTime="2026-06-03 13:57:04.123765135 +0000 UTC m=+185.307772464" Jun 03 13:57:05.939323 ip-10-0-134-229 kubenswrapper[2574]: I0603 13:57:05.939295 2574 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-image-registry/image-registry-f5c6b7cb8-tfj84" Jun 03 13:57:06.823176 ip-10-0-134-229 kubenswrapper[2574]: I0603 13:57:06.823142 2574 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/console-68d556b99d-hw6dm" Jun 03 13:57:06.823176 ip-10-0-134-229 kubenswrapper[2574]: I0603 13:57:06.823185 2574 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-console/console-68d556b99d-hw6dm" Jun 03 13:57:06.827969 ip-10-0-134-229 kubenswrapper[2574]: I0603 13:57:06.827939 2574 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-console/console-68d556b99d-hw6dm" Jun 03 13:57:07.016007 ip-10-0-134-229 kubenswrapper[2574]: I0603 13:57:07.015982 2574 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console/console-68d556b99d-hw6dm" Jun 03 13:57:09.119586 ip-10-0-134-229 kubenswrapper[2574]: I0603 13:57:09.119512 2574 kuberuntime_container.go:864] "Killing container with a grace period" pod="openshift-image-registry/image-registry-75c86b6d9c-xcmd7" podUID="45018365-b30b-4ef0-b920-e0ddc6c71e9b" containerName="registry" containerID="cri-o://8835b19b20c3204e7e865a636ef7718dd47aadf28b51c3fe3ac9b5d8671e473c" gracePeriod=30 Jun 03 13:57:09.354261 ip-10-0-134-229 kubenswrapper[2574]: I0603 13:57:09.354237 2574 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-75c86b6d9c-xcmd7" Jun 03 13:57:09.494215 ip-10-0-134-229 kubenswrapper[2574]: I0603 13:57:09.494186 2574 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/45018365-b30b-4ef0-b920-e0ddc6c71e9b-bound-sa-token\") pod \"45018365-b30b-4ef0-b920-e0ddc6c71e9b\" (UID: \"45018365-b30b-4ef0-b920-e0ddc6c71e9b\") " Jun 03 13:57:09.494413 ip-10-0-134-229 kubenswrapper[2574]: I0603 13:57:09.494219 2574 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/45018365-b30b-4ef0-b920-e0ddc6c71e9b-installation-pull-secrets\") pod \"45018365-b30b-4ef0-b920-e0ddc6c71e9b\" (UID: \"45018365-b30b-4ef0-b920-e0ddc6c71e9b\") " Jun 03 13:57:09.494413 ip-10-0-134-229 kubenswrapper[2574]: I0603 13:57:09.494251 2574 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/45018365-b30b-4ef0-b920-e0ddc6c71e9b-registry-certificates\") pod \"45018365-b30b-4ef0-b920-e0ddc6c71e9b\" (UID: \"45018365-b30b-4ef0-b920-e0ddc6c71e9b\") " Jun 03 13:57:09.494413 ip-10-0-134-229 kubenswrapper[2574]: I0603 13:57:09.494268 2574 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/45018365-b30b-4ef0-b920-e0ddc6c71e9b-registry-tls\") pod \"45018365-b30b-4ef0-b920-e0ddc6c71e9b\" (UID: \"45018365-b30b-4ef0-b920-e0ddc6c71e9b\") " Jun 03 13:57:09.494413 ip-10-0-134-229 kubenswrapper[2574]: I0603 13:57:09.494302 2574 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/45018365-b30b-4ef0-b920-e0ddc6c71e9b-ca-trust-extracted\") pod \"45018365-b30b-4ef0-b920-e0ddc6c71e9b\" (UID: \"45018365-b30b-4ef0-b920-e0ddc6c71e9b\") " Jun 03 13:57:09.494413 ip-10-0-134-229 kubenswrapper[2574]: I0603 13:57:09.494340 2574 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/45018365-b30b-4ef0-b920-e0ddc6c71e9b-image-registry-private-configuration\") pod \"45018365-b30b-4ef0-b920-e0ddc6c71e9b\" (UID: \"45018365-b30b-4ef0-b920-e0ddc6c71e9b\") " Jun 03 13:57:09.494413 ip-10-0-134-229 kubenswrapper[2574]: I0603 13:57:09.494368 2574 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-dzbqn\" (UniqueName: \"kubernetes.io/projected/45018365-b30b-4ef0-b920-e0ddc6c71e9b-kube-api-access-dzbqn\") pod \"45018365-b30b-4ef0-b920-e0ddc6c71e9b\" (UID: \"45018365-b30b-4ef0-b920-e0ddc6c71e9b\") " Jun 03 13:57:09.494728 ip-10-0-134-229 kubenswrapper[2574]: I0603 13:57:09.494495 2574 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/45018365-b30b-4ef0-b920-e0ddc6c71e9b-trusted-ca\") pod \"45018365-b30b-4ef0-b920-e0ddc6c71e9b\" (UID: \"45018365-b30b-4ef0-b920-e0ddc6c71e9b\") " Jun 03 13:57:09.494777 ip-10-0-134-229 kubenswrapper[2574]: I0603 13:57:09.494742 2574 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/45018365-b30b-4ef0-b920-e0ddc6c71e9b-registry-certificates" (OuterVolumeSpecName: "registry-certificates") pod "45018365-b30b-4ef0-b920-e0ddc6c71e9b" (UID: "45018365-b30b-4ef0-b920-e0ddc6c71e9b"). InnerVolumeSpecName "registry-certificates". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jun 03 13:57:09.495067 ip-10-0-134-229 kubenswrapper[2574]: I0603 13:57:09.495042 2574 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/45018365-b30b-4ef0-b920-e0ddc6c71e9b-trusted-ca" (OuterVolumeSpecName: "trusted-ca") pod "45018365-b30b-4ef0-b920-e0ddc6c71e9b" (UID: "45018365-b30b-4ef0-b920-e0ddc6c71e9b"). InnerVolumeSpecName "trusted-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jun 03 13:57:09.497118 ip-10-0-134-229 kubenswrapper[2574]: I0603 13:57:09.497054 2574 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/45018365-b30b-4ef0-b920-e0ddc6c71e9b-registry-tls" (OuterVolumeSpecName: "registry-tls") pod "45018365-b30b-4ef0-b920-e0ddc6c71e9b" (UID: "45018365-b30b-4ef0-b920-e0ddc6c71e9b"). InnerVolumeSpecName "registry-tls". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 03 13:57:09.497118 ip-10-0-134-229 kubenswrapper[2574]: I0603 13:57:09.497096 2574 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/45018365-b30b-4ef0-b920-e0ddc6c71e9b-kube-api-access-dzbqn" (OuterVolumeSpecName: "kube-api-access-dzbqn") pod "45018365-b30b-4ef0-b920-e0ddc6c71e9b" (UID: "45018365-b30b-4ef0-b920-e0ddc6c71e9b"). InnerVolumeSpecName "kube-api-access-dzbqn". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 03 13:57:09.497246 ip-10-0-134-229 kubenswrapper[2574]: I0603 13:57:09.497160 2574 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/45018365-b30b-4ef0-b920-e0ddc6c71e9b-installation-pull-secrets" (OuterVolumeSpecName: "installation-pull-secrets") pod "45018365-b30b-4ef0-b920-e0ddc6c71e9b" (UID: "45018365-b30b-4ef0-b920-e0ddc6c71e9b"). InnerVolumeSpecName "installation-pull-secrets". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jun 03 13:57:09.497246 ip-10-0-134-229 kubenswrapper[2574]: I0603 13:57:09.497174 2574 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/45018365-b30b-4ef0-b920-e0ddc6c71e9b-bound-sa-token" (OuterVolumeSpecName: "bound-sa-token") pod "45018365-b30b-4ef0-b920-e0ddc6c71e9b" (UID: "45018365-b30b-4ef0-b920-e0ddc6c71e9b"). InnerVolumeSpecName "bound-sa-token". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 03 13:57:09.497246 ip-10-0-134-229 kubenswrapper[2574]: I0603 13:57:09.497177 2574 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/45018365-b30b-4ef0-b920-e0ddc6c71e9b-image-registry-private-configuration" (OuterVolumeSpecName: "image-registry-private-configuration") pod "45018365-b30b-4ef0-b920-e0ddc6c71e9b" (UID: "45018365-b30b-4ef0-b920-e0ddc6c71e9b"). InnerVolumeSpecName "image-registry-private-configuration". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jun 03 13:57:09.505960 ip-10-0-134-229 kubenswrapper[2574]: I0603 13:57:09.505935 2574 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/45018365-b30b-4ef0-b920-e0ddc6c71e9b-ca-trust-extracted" (OuterVolumeSpecName: "ca-trust-extracted") pod "45018365-b30b-4ef0-b920-e0ddc6c71e9b" (UID: "45018365-b30b-4ef0-b920-e0ddc6c71e9b"). InnerVolumeSpecName "ca-trust-extracted". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jun 03 13:57:09.511799 ip-10-0-134-229 kubenswrapper[2574]: I0603 13:57:09.511780 2574 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-console/console-6c887d465b-k4q45"] Jun 03 13:57:09.512050 ip-10-0-134-229 kubenswrapper[2574]: I0603 13:57:09.512038 2574 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="45018365-b30b-4ef0-b920-e0ddc6c71e9b" containerName="registry" Jun 03 13:57:09.512091 ip-10-0-134-229 kubenswrapper[2574]: I0603 13:57:09.512052 2574 state_mem.go:107] "Deleted CPUSet assignment" podUID="45018365-b30b-4ef0-b920-e0ddc6c71e9b" containerName="registry" Jun 03 13:57:09.512144 ip-10-0-134-229 kubenswrapper[2574]: I0603 13:57:09.512133 2574 memory_manager.go:356] "RemoveStaleState removing state" podUID="45018365-b30b-4ef0-b920-e0ddc6c71e9b" containerName="registry" Jun 03 13:57:09.514909 ip-10-0-134-229 kubenswrapper[2574]: I0603 13:57:09.514893 2574 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-6c887d465b-k4q45" Jun 03 13:57:09.523790 ip-10-0-134-229 kubenswrapper[2574]: I0603 13:57:09.523769 2574 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-6c887d465b-k4q45"] Jun 03 13:57:09.595667 ip-10-0-134-229 kubenswrapper[2574]: I0603 13:57:09.595641 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/79c90f44-42ce-4ae2-beba-200f1a24c104-console-config\") pod \"console-6c887d465b-k4q45\" (UID: \"79c90f44-42ce-4ae2-beba-200f1a24c104\") " pod="openshift-console/console-6c887d465b-k4q45" Jun 03 13:57:09.595771 ip-10-0-134-229 kubenswrapper[2574]: I0603 13:57:09.595674 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/79c90f44-42ce-4ae2-beba-200f1a24c104-trusted-ca-bundle\") pod \"console-6c887d465b-k4q45\" (UID: \"79c90f44-42ce-4ae2-beba-200f1a24c104\") " pod="openshift-console/console-6c887d465b-k4q45" Jun 03 13:57:09.595771 ip-10-0-134-229 kubenswrapper[2574]: I0603 13:57:09.595749 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/79c90f44-42ce-4ae2-beba-200f1a24c104-service-ca\") pod \"console-6c887d465b-k4q45\" (UID: \"79c90f44-42ce-4ae2-beba-200f1a24c104\") " pod="openshift-console/console-6c887d465b-k4q45" Jun 03 13:57:09.595839 ip-10-0-134-229 kubenswrapper[2574]: I0603 13:57:09.595785 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/79c90f44-42ce-4ae2-beba-200f1a24c104-console-serving-cert\") pod \"console-6c887d465b-k4q45\" (UID: \"79c90f44-42ce-4ae2-beba-200f1a24c104\") " pod="openshift-console/console-6c887d465b-k4q45" Jun 03 13:57:09.595839 ip-10-0-134-229 kubenswrapper[2574]: I0603 13:57:09.595823 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/79c90f44-42ce-4ae2-beba-200f1a24c104-console-oauth-config\") pod \"console-6c887d465b-k4q45\" (UID: \"79c90f44-42ce-4ae2-beba-200f1a24c104\") " pod="openshift-console/console-6c887d465b-k4q45" Jun 03 13:57:09.595911 ip-10-0-134-229 kubenswrapper[2574]: I0603 13:57:09.595845 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-8phbf\" (UniqueName: \"kubernetes.io/projected/79c90f44-42ce-4ae2-beba-200f1a24c104-kube-api-access-8phbf\") pod \"console-6c887d465b-k4q45\" (UID: \"79c90f44-42ce-4ae2-beba-200f1a24c104\") " pod="openshift-console/console-6c887d465b-k4q45" Jun 03 13:57:09.595958 ip-10-0-134-229 kubenswrapper[2574]: I0603 13:57:09.595901 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/79c90f44-42ce-4ae2-beba-200f1a24c104-oauth-serving-cert\") pod \"console-6c887d465b-k4q45\" (UID: \"79c90f44-42ce-4ae2-beba-200f1a24c104\") " pod="openshift-console/console-6c887d465b-k4q45" Jun 03 13:57:09.596039 ip-10-0-134-229 kubenswrapper[2574]: I0603 13:57:09.596012 2574 reconciler_common.go:299] "Volume detached for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/45018365-b30b-4ef0-b920-e0ddc6c71e9b-image-registry-private-configuration\") on node \"ip-10-0-134-229.ec2.internal\" DevicePath \"\"" Jun 03 13:57:09.596122 ip-10-0-134-229 kubenswrapper[2574]: I0603 13:57:09.596038 2574 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-dzbqn\" (UniqueName: \"kubernetes.io/projected/45018365-b30b-4ef0-b920-e0ddc6c71e9b-kube-api-access-dzbqn\") on node \"ip-10-0-134-229.ec2.internal\" DevicePath \"\"" Jun 03 13:57:09.596122 ip-10-0-134-229 kubenswrapper[2574]: I0603 13:57:09.596058 2574 reconciler_common.go:299] "Volume detached for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/45018365-b30b-4ef0-b920-e0ddc6c71e9b-trusted-ca\") on node \"ip-10-0-134-229.ec2.internal\" DevicePath \"\"" Jun 03 13:57:09.596122 ip-10-0-134-229 kubenswrapper[2574]: I0603 13:57:09.596073 2574 reconciler_common.go:299] "Volume detached for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/45018365-b30b-4ef0-b920-e0ddc6c71e9b-bound-sa-token\") on node \"ip-10-0-134-229.ec2.internal\" DevicePath \"\"" Jun 03 13:57:09.596122 ip-10-0-134-229 kubenswrapper[2574]: I0603 13:57:09.596089 2574 reconciler_common.go:299] "Volume detached for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/45018365-b30b-4ef0-b920-e0ddc6c71e9b-installation-pull-secrets\") on node \"ip-10-0-134-229.ec2.internal\" DevicePath \"\"" Jun 03 13:57:09.596122 ip-10-0-134-229 kubenswrapper[2574]: I0603 13:57:09.596103 2574 reconciler_common.go:299] "Volume detached for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/45018365-b30b-4ef0-b920-e0ddc6c71e9b-registry-certificates\") on node \"ip-10-0-134-229.ec2.internal\" DevicePath \"\"" Jun 03 13:57:09.596122 ip-10-0-134-229 kubenswrapper[2574]: I0603 13:57:09.596121 2574 reconciler_common.go:299] "Volume detached for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/45018365-b30b-4ef0-b920-e0ddc6c71e9b-registry-tls\") on node \"ip-10-0-134-229.ec2.internal\" DevicePath \"\"" Jun 03 13:57:09.596302 ip-10-0-134-229 kubenswrapper[2574]: I0603 13:57:09.596136 2574 reconciler_common.go:299] "Volume detached for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/45018365-b30b-4ef0-b920-e0ddc6c71e9b-ca-trust-extracted\") on node \"ip-10-0-134-229.ec2.internal\" DevicePath \"\"" Jun 03 13:57:09.696994 ip-10-0-134-229 kubenswrapper[2574]: I0603 13:57:09.696969 2574 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/79c90f44-42ce-4ae2-beba-200f1a24c104-console-config\") pod \"console-6c887d465b-k4q45\" (UID: \"79c90f44-42ce-4ae2-beba-200f1a24c104\") " pod="openshift-console/console-6c887d465b-k4q45" Jun 03 13:57:09.697114 ip-10-0-134-229 kubenswrapper[2574]: I0603 13:57:09.697001 2574 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/79c90f44-42ce-4ae2-beba-200f1a24c104-trusted-ca-bundle\") pod \"console-6c887d465b-k4q45\" (UID: \"79c90f44-42ce-4ae2-beba-200f1a24c104\") " pod="openshift-console/console-6c887d465b-k4q45" Jun 03 13:57:09.697114 ip-10-0-134-229 kubenswrapper[2574]: I0603 13:57:09.697021 2574 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/79c90f44-42ce-4ae2-beba-200f1a24c104-service-ca\") pod \"console-6c887d465b-k4q45\" (UID: \"79c90f44-42ce-4ae2-beba-200f1a24c104\") " pod="openshift-console/console-6c887d465b-k4q45" Jun 03 13:57:09.697114 ip-10-0-134-229 kubenswrapper[2574]: I0603 13:57:09.697075 2574 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/79c90f44-42ce-4ae2-beba-200f1a24c104-console-serving-cert\") pod \"console-6c887d465b-k4q45\" (UID: \"79c90f44-42ce-4ae2-beba-200f1a24c104\") " pod="openshift-console/console-6c887d465b-k4q45" Jun 03 13:57:09.697114 ip-10-0-134-229 kubenswrapper[2574]: I0603 13:57:09.697101 2574 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/79c90f44-42ce-4ae2-beba-200f1a24c104-console-oauth-config\") pod \"console-6c887d465b-k4q45\" (UID: \"79c90f44-42ce-4ae2-beba-200f1a24c104\") " pod="openshift-console/console-6c887d465b-k4q45" Jun 03 13:57:09.697285 ip-10-0-134-229 kubenswrapper[2574]: I0603 13:57:09.697125 2574 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-8phbf\" (UniqueName: \"kubernetes.io/projected/79c90f44-42ce-4ae2-beba-200f1a24c104-kube-api-access-8phbf\") pod \"console-6c887d465b-k4q45\" (UID: \"79c90f44-42ce-4ae2-beba-200f1a24c104\") " pod="openshift-console/console-6c887d465b-k4q45" Jun 03 13:57:09.697285 ip-10-0-134-229 kubenswrapper[2574]: I0603 13:57:09.697154 2574 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/79c90f44-42ce-4ae2-beba-200f1a24c104-oauth-serving-cert\") pod \"console-6c887d465b-k4q45\" (UID: \"79c90f44-42ce-4ae2-beba-200f1a24c104\") " pod="openshift-console/console-6c887d465b-k4q45" Jun 03 13:57:09.697794 ip-10-0-134-229 kubenswrapper[2574]: I0603 13:57:09.697766 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/79c90f44-42ce-4ae2-beba-200f1a24c104-console-config\") pod \"console-6c887d465b-k4q45\" (UID: \"79c90f44-42ce-4ae2-beba-200f1a24c104\") " pod="openshift-console/console-6c887d465b-k4q45" Jun 03 13:57:09.697904 ip-10-0-134-229 kubenswrapper[2574]: I0603 13:57:09.697796 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/79c90f44-42ce-4ae2-beba-200f1a24c104-oauth-serving-cert\") pod \"console-6c887d465b-k4q45\" (UID: \"79c90f44-42ce-4ae2-beba-200f1a24c104\") " pod="openshift-console/console-6c887d465b-k4q45" Jun 03 13:57:09.697904 ip-10-0-134-229 kubenswrapper[2574]: I0603 13:57:09.697872 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/79c90f44-42ce-4ae2-beba-200f1a24c104-trusted-ca-bundle\") pod \"console-6c887d465b-k4q45\" (UID: \"79c90f44-42ce-4ae2-beba-200f1a24c104\") " pod="openshift-console/console-6c887d465b-k4q45" Jun 03 13:57:09.698013 ip-10-0-134-229 kubenswrapper[2574]: I0603 13:57:09.697904 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/79c90f44-42ce-4ae2-beba-200f1a24c104-service-ca\") pod \"console-6c887d465b-k4q45\" (UID: \"79c90f44-42ce-4ae2-beba-200f1a24c104\") " pod="openshift-console/console-6c887d465b-k4q45" Jun 03 13:57:09.699543 ip-10-0-134-229 kubenswrapper[2574]: I0603 13:57:09.699518 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/79c90f44-42ce-4ae2-beba-200f1a24c104-console-serving-cert\") pod \"console-6c887d465b-k4q45\" (UID: \"79c90f44-42ce-4ae2-beba-200f1a24c104\") " pod="openshift-console/console-6c887d465b-k4q45" Jun 03 13:57:09.699630 ip-10-0-134-229 kubenswrapper[2574]: I0603 13:57:09.699576 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/79c90f44-42ce-4ae2-beba-200f1a24c104-console-oauth-config\") pod \"console-6c887d465b-k4q45\" (UID: \"79c90f44-42ce-4ae2-beba-200f1a24c104\") " pod="openshift-console/console-6c887d465b-k4q45" Jun 03 13:57:09.706972 ip-10-0-134-229 kubenswrapper[2574]: I0603 13:57:09.706955 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-8phbf\" (UniqueName: \"kubernetes.io/projected/79c90f44-42ce-4ae2-beba-200f1a24c104-kube-api-access-8phbf\") pod \"console-6c887d465b-k4q45\" (UID: \"79c90f44-42ce-4ae2-beba-200f1a24c104\") " pod="openshift-console/console-6c887d465b-k4q45" Jun 03 13:57:09.823811 ip-10-0-134-229 kubenswrapper[2574]: I0603 13:57:09.823760 2574 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-6c887d465b-k4q45" Jun 03 13:57:09.953095 ip-10-0-134-229 kubenswrapper[2574]: I0603 13:57:09.952948 2574 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-6c887d465b-k4q45"] Jun 03 13:57:09.955509 ip-10-0-134-229 kubenswrapper[2574]: W0603 13:57:09.955487 2574 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod79c90f44_42ce_4ae2_beba_200f1a24c104.slice/crio-ed0f10d20c3a5ad7960edfed366ed512dc12363a431db3d7ed780e931a9a8503 WatchSource:0}: Error finding container ed0f10d20c3a5ad7960edfed366ed512dc12363a431db3d7ed780e931a9a8503: Status 404 returned error can't find the container with id ed0f10d20c3a5ad7960edfed366ed512dc12363a431db3d7ed780e931a9a8503 Jun 03 13:57:10.022518 ip-10-0-134-229 kubenswrapper[2574]: I0603 13:57:10.022488 2574 generic.go:358] "Generic (PLEG): container finished" podID="45018365-b30b-4ef0-b920-e0ddc6c71e9b" containerID="8835b19b20c3204e7e865a636ef7718dd47aadf28b51c3fe3ac9b5d8671e473c" exitCode=0 Jun 03 13:57:10.022669 ip-10-0-134-229 kubenswrapper[2574]: I0603 13:57:10.022534 2574 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-75c86b6d9c-xcmd7" Jun 03 13:57:10.022669 ip-10-0-134-229 kubenswrapper[2574]: I0603 13:57:10.022564 2574 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-75c86b6d9c-xcmd7" event={"ID":"45018365-b30b-4ef0-b920-e0ddc6c71e9b","Type":"ContainerDied","Data":"8835b19b20c3204e7e865a636ef7718dd47aadf28b51c3fe3ac9b5d8671e473c"} Jun 03 13:57:10.022669 ip-10-0-134-229 kubenswrapper[2574]: I0603 13:57:10.022612 2574 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-75c86b6d9c-xcmd7" event={"ID":"45018365-b30b-4ef0-b920-e0ddc6c71e9b","Type":"ContainerDied","Data":"dbfb56acb63662a86706f438224ecb0861135c4e2986d9a9abe666dca4437679"} Jun 03 13:57:10.022669 ip-10-0-134-229 kubenswrapper[2574]: I0603 13:57:10.022634 2574 scope.go:117] "RemoveContainer" containerID="8835b19b20c3204e7e865a636ef7718dd47aadf28b51c3fe3ac9b5d8671e473c" Jun 03 13:57:10.024240 ip-10-0-134-229 kubenswrapper[2574]: I0603 13:57:10.024215 2574 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-6c887d465b-k4q45" event={"ID":"79c90f44-42ce-4ae2-beba-200f1a24c104","Type":"ContainerStarted","Data":"766c0377c1b6f0a6edc1960a6b07f62932caa9d5e000773781ca53a4c9037501"} Jun 03 13:57:10.024352 ip-10-0-134-229 kubenswrapper[2574]: I0603 13:57:10.024250 2574 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-6c887d465b-k4q45" event={"ID":"79c90f44-42ce-4ae2-beba-200f1a24c104","Type":"ContainerStarted","Data":"ed0f10d20c3a5ad7960edfed366ed512dc12363a431db3d7ed780e931a9a8503"} Jun 03 13:57:10.031315 ip-10-0-134-229 kubenswrapper[2574]: I0603 13:57:10.031295 2574 scope.go:117] "RemoveContainer" containerID="8835b19b20c3204e7e865a636ef7718dd47aadf28b51c3fe3ac9b5d8671e473c" Jun 03 13:57:10.031731 ip-10-0-134-229 kubenswrapper[2574]: E0603 13:57:10.031600 2574 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"8835b19b20c3204e7e865a636ef7718dd47aadf28b51c3fe3ac9b5d8671e473c\": container with ID starting with 8835b19b20c3204e7e865a636ef7718dd47aadf28b51c3fe3ac9b5d8671e473c not found: ID does not exist" containerID="8835b19b20c3204e7e865a636ef7718dd47aadf28b51c3fe3ac9b5d8671e473c" Jun 03 13:57:10.031731 ip-10-0-134-229 kubenswrapper[2574]: I0603 13:57:10.031634 2574 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"8835b19b20c3204e7e865a636ef7718dd47aadf28b51c3fe3ac9b5d8671e473c"} err="failed to get container status \"8835b19b20c3204e7e865a636ef7718dd47aadf28b51c3fe3ac9b5d8671e473c\": rpc error: code = NotFound desc = could not find container \"8835b19b20c3204e7e865a636ef7718dd47aadf28b51c3fe3ac9b5d8671e473c\": container with ID starting with 8835b19b20c3204e7e865a636ef7718dd47aadf28b51c3fe3ac9b5d8671e473c not found: ID does not exist" Jun 03 13:57:10.043890 ip-10-0-134-229 kubenswrapper[2574]: I0603 13:57:10.043851 2574 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-console/console-6c887d465b-k4q45" podStartSLOduration=1.043840784 podStartE2EDuration="1.043840784s" podCreationTimestamp="2026-06-03 13:57:09 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2026-06-03 13:57:10.042834463 +0000 UTC m=+191.226841791" watchObservedRunningTime="2026-06-03 13:57:10.043840784 +0000 UTC m=+191.227848111" Jun 03 13:57:10.057260 ip-10-0-134-229 kubenswrapper[2574]: I0603 13:57:10.057229 2574 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openshift-image-registry/image-registry-75c86b6d9c-xcmd7"] Jun 03 13:57:10.060528 ip-10-0-134-229 kubenswrapper[2574]: I0603 13:57:10.060509 2574 kubelet.go:2547] "SyncLoop REMOVE" source="api" pods=["openshift-image-registry/image-registry-75c86b6d9c-xcmd7"] Jun 03 13:57:11.430580 ip-10-0-134-229 kubenswrapper[2574]: I0603 13:57:11.430549 2574 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="45018365-b30b-4ef0-b920-e0ddc6c71e9b" path="/var/lib/kubelet/pods/45018365-b30b-4ef0-b920-e0ddc6c71e9b/volumes" Jun 03 13:57:19.824829 ip-10-0-134-229 kubenswrapper[2574]: I0603 13:57:19.824798 2574 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/console-6c887d465b-k4q45" Jun 03 13:57:19.825369 ip-10-0-134-229 kubenswrapper[2574]: I0603 13:57:19.824896 2574 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-console/console-6c887d465b-k4q45" Jun 03 13:57:19.830364 ip-10-0-134-229 kubenswrapper[2574]: I0603 13:57:19.830341 2574 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-console/console-6c887d465b-k4q45" Jun 03 13:57:20.057491 ip-10-0-134-229 kubenswrapper[2574]: I0603 13:57:20.057466 2574 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console/console-6c887d465b-k4q45" Jun 03 13:57:20.104729 ip-10-0-134-229 kubenswrapper[2574]: I0603 13:57:20.104658 2574 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openshift-console/console-68d556b99d-hw6dm"] Jun 03 13:57:39.111330 ip-10-0-134-229 kubenswrapper[2574]: I0603 13:57:39.110148 2574 generic.go:358] "Generic (PLEG): container finished" podID="cdfc9d22-1eec-4221-9c0f-c128485c764a" containerID="66129da78833af48e9fbf4fb8327a4c001e148b433f76c27853d8e0d389d5149" exitCode=0 Jun 03 13:57:39.111330 ip-10-0-134-229 kubenswrapper[2574]: I0603 13:57:39.110251 2574 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-96ddc787c-42dw4" event={"ID":"cdfc9d22-1eec-4221-9c0f-c128485c764a","Type":"ContainerDied","Data":"66129da78833af48e9fbf4fb8327a4c001e148b433f76c27853d8e0d389d5149"} Jun 03 13:57:39.111330 ip-10-0-134-229 kubenswrapper[2574]: I0603 13:57:39.110688 2574 scope.go:117] "RemoveContainer" containerID="66129da78833af48e9fbf4fb8327a4c001e148b433f76c27853d8e0d389d5149" Jun 03 13:57:40.115365 ip-10-0-134-229 kubenswrapper[2574]: I0603 13:57:40.115332 2574 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-96ddc787c-42dw4" event={"ID":"cdfc9d22-1eec-4221-9c0f-c128485c764a","Type":"ContainerStarted","Data":"e6173b4739c0d3179eff59d722d3ec787411f6f27aee0ce5990650280253cd0f"} Jun 03 13:57:45.133755 ip-10-0-134-229 kubenswrapper[2574]: I0603 13:57:45.133722 2574 kuberuntime_container.go:864] "Killing container with a grace period" pod="openshift-console/console-68d556b99d-hw6dm" podUID="d4ae7b11-fd77-4477-a3ec-c450325cefae" containerName="console" containerID="cri-o://2adf45a2d672bf55633603845b5476baf0e27d84f5d493290689b98dcdcd9a74" gracePeriod=15 Jun 03 13:57:45.364435 ip-10-0-134-229 kubenswrapper[2574]: I0603 13:57:45.364411 2574 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console_console-68d556b99d-hw6dm_d4ae7b11-fd77-4477-a3ec-c450325cefae/console/0.log" Jun 03 13:57:45.364535 ip-10-0-134-229 kubenswrapper[2574]: I0603 13:57:45.364469 2574 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-68d556b99d-hw6dm" Jun 03 13:57:45.482948 ip-10-0-134-229 kubenswrapper[2574]: I0603 13:57:45.482885 2574 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-xfbx2\" (UniqueName: \"kubernetes.io/projected/d4ae7b11-fd77-4477-a3ec-c450325cefae-kube-api-access-xfbx2\") pod \"d4ae7b11-fd77-4477-a3ec-c450325cefae\" (UID: \"d4ae7b11-fd77-4477-a3ec-c450325cefae\") " Jun 03 13:57:45.482948 ip-10-0-134-229 kubenswrapper[2574]: I0603 13:57:45.482927 2574 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/d4ae7b11-fd77-4477-a3ec-c450325cefae-console-config\") pod \"d4ae7b11-fd77-4477-a3ec-c450325cefae\" (UID: \"d4ae7b11-fd77-4477-a3ec-c450325cefae\") " Jun 03 13:57:45.482948 ip-10-0-134-229 kubenswrapper[2574]: I0603 13:57:45.482943 2574 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/d4ae7b11-fd77-4477-a3ec-c450325cefae-oauth-serving-cert\") pod \"d4ae7b11-fd77-4477-a3ec-c450325cefae\" (UID: \"d4ae7b11-fd77-4477-a3ec-c450325cefae\") " Jun 03 13:57:45.483182 ip-10-0-134-229 kubenswrapper[2574]: I0603 13:57:45.482972 2574 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/d4ae7b11-fd77-4477-a3ec-c450325cefae-console-serving-cert\") pod \"d4ae7b11-fd77-4477-a3ec-c450325cefae\" (UID: \"d4ae7b11-fd77-4477-a3ec-c450325cefae\") " Jun 03 13:57:45.483182 ip-10-0-134-229 kubenswrapper[2574]: I0603 13:57:45.482994 2574 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/d4ae7b11-fd77-4477-a3ec-c450325cefae-trusted-ca-bundle\") pod \"d4ae7b11-fd77-4477-a3ec-c450325cefae\" (UID: \"d4ae7b11-fd77-4477-a3ec-c450325cefae\") " Jun 03 13:57:45.483182 ip-10-0-134-229 kubenswrapper[2574]: I0603 13:57:45.483020 2574 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/d4ae7b11-fd77-4477-a3ec-c450325cefae-console-oauth-config\") pod \"d4ae7b11-fd77-4477-a3ec-c450325cefae\" (UID: \"d4ae7b11-fd77-4477-a3ec-c450325cefae\") " Jun 03 13:57:45.483182 ip-10-0-134-229 kubenswrapper[2574]: I0603 13:57:45.483039 2574 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/d4ae7b11-fd77-4477-a3ec-c450325cefae-service-ca\") pod \"d4ae7b11-fd77-4477-a3ec-c450325cefae\" (UID: \"d4ae7b11-fd77-4477-a3ec-c450325cefae\") " Jun 03 13:57:45.483398 ip-10-0-134-229 kubenswrapper[2574]: I0603 13:57:45.483274 2574 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/d4ae7b11-fd77-4477-a3ec-c450325cefae-console-config" (OuterVolumeSpecName: "console-config") pod "d4ae7b11-fd77-4477-a3ec-c450325cefae" (UID: "d4ae7b11-fd77-4477-a3ec-c450325cefae"). InnerVolumeSpecName "console-config". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jun 03 13:57:45.483456 ip-10-0-134-229 kubenswrapper[2574]: I0603 13:57:45.483402 2574 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/d4ae7b11-fd77-4477-a3ec-c450325cefae-oauth-serving-cert" (OuterVolumeSpecName: "oauth-serving-cert") pod "d4ae7b11-fd77-4477-a3ec-c450325cefae" (UID: "d4ae7b11-fd77-4477-a3ec-c450325cefae"). InnerVolumeSpecName "oauth-serving-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jun 03 13:57:45.483525 ip-10-0-134-229 kubenswrapper[2574]: I0603 13:57:45.483507 2574 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/d4ae7b11-fd77-4477-a3ec-c450325cefae-service-ca" (OuterVolumeSpecName: "service-ca") pod "d4ae7b11-fd77-4477-a3ec-c450325cefae" (UID: "d4ae7b11-fd77-4477-a3ec-c450325cefae"). InnerVolumeSpecName "service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jun 03 13:57:45.483751 ip-10-0-134-229 kubenswrapper[2574]: I0603 13:57:45.483724 2574 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/d4ae7b11-fd77-4477-a3ec-c450325cefae-trusted-ca-bundle" (OuterVolumeSpecName: "trusted-ca-bundle") pod "d4ae7b11-fd77-4477-a3ec-c450325cefae" (UID: "d4ae7b11-fd77-4477-a3ec-c450325cefae"). InnerVolumeSpecName "trusted-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jun 03 13:57:45.485201 ip-10-0-134-229 kubenswrapper[2574]: I0603 13:57:45.485179 2574 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/d4ae7b11-fd77-4477-a3ec-c450325cefae-console-oauth-config" (OuterVolumeSpecName: "console-oauth-config") pod "d4ae7b11-fd77-4477-a3ec-c450325cefae" (UID: "d4ae7b11-fd77-4477-a3ec-c450325cefae"). InnerVolumeSpecName "console-oauth-config". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jun 03 13:57:45.485201 ip-10-0-134-229 kubenswrapper[2574]: I0603 13:57:45.485199 2574 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/d4ae7b11-fd77-4477-a3ec-c450325cefae-console-serving-cert" (OuterVolumeSpecName: "console-serving-cert") pod "d4ae7b11-fd77-4477-a3ec-c450325cefae" (UID: "d4ae7b11-fd77-4477-a3ec-c450325cefae"). InnerVolumeSpecName "console-serving-cert". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jun 03 13:57:45.485317 ip-10-0-134-229 kubenswrapper[2574]: I0603 13:57:45.485243 2574 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/d4ae7b11-fd77-4477-a3ec-c450325cefae-kube-api-access-xfbx2" (OuterVolumeSpecName: "kube-api-access-xfbx2") pod "d4ae7b11-fd77-4477-a3ec-c450325cefae" (UID: "d4ae7b11-fd77-4477-a3ec-c450325cefae"). InnerVolumeSpecName "kube-api-access-xfbx2". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 03 13:57:45.584518 ip-10-0-134-229 kubenswrapper[2574]: I0603 13:57:45.584485 2574 reconciler_common.go:299] "Volume detached for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/d4ae7b11-fd77-4477-a3ec-c450325cefae-console-serving-cert\") on node \"ip-10-0-134-229.ec2.internal\" DevicePath \"\"" Jun 03 13:57:45.584518 ip-10-0-134-229 kubenswrapper[2574]: I0603 13:57:45.584511 2574 reconciler_common.go:299] "Volume detached for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/d4ae7b11-fd77-4477-a3ec-c450325cefae-trusted-ca-bundle\") on node \"ip-10-0-134-229.ec2.internal\" DevicePath \"\"" Jun 03 13:57:45.584518 ip-10-0-134-229 kubenswrapper[2574]: I0603 13:57:45.584520 2574 reconciler_common.go:299] "Volume detached for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/d4ae7b11-fd77-4477-a3ec-c450325cefae-console-oauth-config\") on node \"ip-10-0-134-229.ec2.internal\" DevicePath \"\"" Jun 03 13:57:45.584716 ip-10-0-134-229 kubenswrapper[2574]: I0603 13:57:45.584529 2574 reconciler_common.go:299] "Volume detached for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/d4ae7b11-fd77-4477-a3ec-c450325cefae-service-ca\") on node \"ip-10-0-134-229.ec2.internal\" DevicePath \"\"" Jun 03 13:57:45.584716 ip-10-0-134-229 kubenswrapper[2574]: I0603 13:57:45.584539 2574 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-xfbx2\" (UniqueName: \"kubernetes.io/projected/d4ae7b11-fd77-4477-a3ec-c450325cefae-kube-api-access-xfbx2\") on node \"ip-10-0-134-229.ec2.internal\" DevicePath \"\"" Jun 03 13:57:45.584716 ip-10-0-134-229 kubenswrapper[2574]: I0603 13:57:45.584548 2574 reconciler_common.go:299] "Volume detached for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/d4ae7b11-fd77-4477-a3ec-c450325cefae-console-config\") on node \"ip-10-0-134-229.ec2.internal\" DevicePath \"\"" Jun 03 13:57:45.584716 ip-10-0-134-229 kubenswrapper[2574]: I0603 13:57:45.584556 2574 reconciler_common.go:299] "Volume detached for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/d4ae7b11-fd77-4477-a3ec-c450325cefae-oauth-serving-cert\") on node \"ip-10-0-134-229.ec2.internal\" DevicePath \"\"" Jun 03 13:57:46.132072 ip-10-0-134-229 kubenswrapper[2574]: I0603 13:57:46.132049 2574 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console_console-68d556b99d-hw6dm_d4ae7b11-fd77-4477-a3ec-c450325cefae/console/0.log" Jun 03 13:57:46.132224 ip-10-0-134-229 kubenswrapper[2574]: I0603 13:57:46.132089 2574 generic.go:358] "Generic (PLEG): container finished" podID="d4ae7b11-fd77-4477-a3ec-c450325cefae" containerID="2adf45a2d672bf55633603845b5476baf0e27d84f5d493290689b98dcdcd9a74" exitCode=2 Jun 03 13:57:46.132224 ip-10-0-134-229 kubenswrapper[2574]: I0603 13:57:46.132154 2574 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-68d556b99d-hw6dm" Jun 03 13:57:46.132224 ip-10-0-134-229 kubenswrapper[2574]: I0603 13:57:46.132176 2574 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-68d556b99d-hw6dm" event={"ID":"d4ae7b11-fd77-4477-a3ec-c450325cefae","Type":"ContainerDied","Data":"2adf45a2d672bf55633603845b5476baf0e27d84f5d493290689b98dcdcd9a74"} Jun 03 13:57:46.132224 ip-10-0-134-229 kubenswrapper[2574]: I0603 13:57:46.132207 2574 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-68d556b99d-hw6dm" event={"ID":"d4ae7b11-fd77-4477-a3ec-c450325cefae","Type":"ContainerDied","Data":"022c33ca8242fa6b56fc36cbdb048884afd3e97acdbbf33f3340ece6c4d333f3"} Jun 03 13:57:46.132397 ip-10-0-134-229 kubenswrapper[2574]: I0603 13:57:46.132227 2574 scope.go:117] "RemoveContainer" containerID="2adf45a2d672bf55633603845b5476baf0e27d84f5d493290689b98dcdcd9a74" Jun 03 13:57:46.140208 ip-10-0-134-229 kubenswrapper[2574]: I0603 13:57:46.140011 2574 scope.go:117] "RemoveContainer" containerID="2adf45a2d672bf55633603845b5476baf0e27d84f5d493290689b98dcdcd9a74" Jun 03 13:57:46.140475 ip-10-0-134-229 kubenswrapper[2574]: E0603 13:57:46.140283 2574 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"2adf45a2d672bf55633603845b5476baf0e27d84f5d493290689b98dcdcd9a74\": container with ID starting with 2adf45a2d672bf55633603845b5476baf0e27d84f5d493290689b98dcdcd9a74 not found: ID does not exist" containerID="2adf45a2d672bf55633603845b5476baf0e27d84f5d493290689b98dcdcd9a74" Jun 03 13:57:46.140475 ip-10-0-134-229 kubenswrapper[2574]: I0603 13:57:46.140308 2574 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"2adf45a2d672bf55633603845b5476baf0e27d84f5d493290689b98dcdcd9a74"} err="failed to get container status \"2adf45a2d672bf55633603845b5476baf0e27d84f5d493290689b98dcdcd9a74\": rpc error: code = NotFound desc = could not find container \"2adf45a2d672bf55633603845b5476baf0e27d84f5d493290689b98dcdcd9a74\": container with ID starting with 2adf45a2d672bf55633603845b5476baf0e27d84f5d493290689b98dcdcd9a74 not found: ID does not exist" Jun 03 13:57:46.168089 ip-10-0-134-229 kubenswrapper[2574]: I0603 13:57:46.168065 2574 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openshift-console/console-68d556b99d-hw6dm"] Jun 03 13:57:46.173937 ip-10-0-134-229 kubenswrapper[2574]: I0603 13:57:46.173918 2574 kubelet.go:2547] "SyncLoop REMOVE" source="api" pods=["openshift-console/console-68d556b99d-hw6dm"] Jun 03 13:57:47.430828 ip-10-0-134-229 kubenswrapper[2574]: I0603 13:57:47.430789 2574 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="d4ae7b11-fd77-4477-a3ec-c450325cefae" path="/var/lib/kubelet/pods/d4ae7b11-fd77-4477-a3ec-c450325cefae/volumes" Jun 03 13:58:11.185677 ip-10-0-134-229 kubenswrapper[2574]: I0603 13:58:11.185635 2574 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/6f47d39b-6eb0-4d5f-921b-0d56c194113e-metrics-certs\") pod \"network-metrics-daemon-9f7k7\" (UID: \"6f47d39b-6eb0-4d5f-921b-0d56c194113e\") " pod="openshift-multus/network-metrics-daemon-9f7k7" Jun 03 13:58:11.187870 ip-10-0-134-229 kubenswrapper[2574]: I0603 13:58:11.187848 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/6f47d39b-6eb0-4d5f-921b-0d56c194113e-metrics-certs\") pod \"network-metrics-daemon-9f7k7\" (UID: \"6f47d39b-6eb0-4d5f-921b-0d56c194113e\") " pod="openshift-multus/network-metrics-daemon-9f7k7" Jun 03 13:58:11.430339 ip-10-0-134-229 kubenswrapper[2574]: I0603 13:58:11.430307 2574 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-sa-dockercfg-tj8sj\"" Jun 03 13:58:11.438488 ip-10-0-134-229 kubenswrapper[2574]: I0603 13:58:11.438418 2574 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-9f7k7" Jun 03 13:58:11.558731 ip-10-0-134-229 kubenswrapper[2574]: I0603 13:58:11.558627 2574 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-multus/network-metrics-daemon-9f7k7"] Jun 03 13:58:11.561391 ip-10-0-134-229 kubenswrapper[2574]: W0603 13:58:11.561349 2574 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod6f47d39b_6eb0_4d5f_921b_0d56c194113e.slice/crio-19708f9b5b7628af0e61b098917a1624faeb75f2494c93fea0896f8cf2f82e9f WatchSource:0}: Error finding container 19708f9b5b7628af0e61b098917a1624faeb75f2494c93fea0896f8cf2f82e9f: Status 404 returned error can't find the container with id 19708f9b5b7628af0e61b098917a1624faeb75f2494c93fea0896f8cf2f82e9f Jun 03 13:58:12.204849 ip-10-0-134-229 kubenswrapper[2574]: I0603 13:58:12.204757 2574 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-9f7k7" event={"ID":"6f47d39b-6eb0-4d5f-921b-0d56c194113e","Type":"ContainerStarted","Data":"19708f9b5b7628af0e61b098917a1624faeb75f2494c93fea0896f8cf2f82e9f"} Jun 03 13:58:13.209042 ip-10-0-134-229 kubenswrapper[2574]: I0603 13:58:13.208996 2574 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-9f7k7" event={"ID":"6f47d39b-6eb0-4d5f-921b-0d56c194113e","Type":"ContainerStarted","Data":"2eb4c883df049b37383b3ee7abe7486e8261e9bfcfc501f9cfbdcec525a653d9"} Jun 03 13:58:13.209042 ip-10-0-134-229 kubenswrapper[2574]: I0603 13:58:13.209038 2574 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-9f7k7" event={"ID":"6f47d39b-6eb0-4d5f-921b-0d56c194113e","Type":"ContainerStarted","Data":"ef2e42784da461adc7f743a7a2afdeb1a71f4bcfaafc9232c5c8c9e82c8cd333"} Jun 03 13:58:13.227435 ip-10-0-134-229 kubenswrapper[2574]: I0603 13:58:13.227391 2574 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-multus/network-metrics-daemon-9f7k7" podStartSLOduration=253.17575653 podStartE2EDuration="4m14.227359813s" podCreationTimestamp="2026-06-03 13:53:59 +0000 UTC" firstStartedPulling="2026-06-03 13:58:11.563248317 +0000 UTC m=+252.747255623" lastFinishedPulling="2026-06-03 13:58:12.614851593 +0000 UTC m=+253.798858906" observedRunningTime="2026-06-03 13:58:13.225823043 +0000 UTC m=+254.409830384" watchObservedRunningTime="2026-06-03 13:58:13.227359813 +0000 UTC m=+254.411367145" Jun 03 13:58:15.379061 ip-10-0-134-229 kubenswrapper[2574]: I0603 13:58:15.379033 2574 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-console/console-dcd8c84fd-2jw47"] Jun 03 13:58:15.379467 ip-10-0-134-229 kubenswrapper[2574]: I0603 13:58:15.379300 2574 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="d4ae7b11-fd77-4477-a3ec-c450325cefae" containerName="console" Jun 03 13:58:15.379467 ip-10-0-134-229 kubenswrapper[2574]: I0603 13:58:15.379311 2574 state_mem.go:107] "Deleted CPUSet assignment" podUID="d4ae7b11-fd77-4477-a3ec-c450325cefae" containerName="console" Jun 03 13:58:15.379467 ip-10-0-134-229 kubenswrapper[2574]: I0603 13:58:15.379368 2574 memory_manager.go:356] "RemoveStaleState removing state" podUID="d4ae7b11-fd77-4477-a3ec-c450325cefae" containerName="console" Jun 03 13:58:15.381340 ip-10-0-134-229 kubenswrapper[2574]: I0603 13:58:15.381320 2574 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-dcd8c84fd-2jw47" Jun 03 13:58:15.437729 ip-10-0-134-229 kubenswrapper[2574]: I0603 13:58:15.437701 2574 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-dcd8c84fd-2jw47"] Jun 03 13:58:15.525938 ip-10-0-134-229 kubenswrapper[2574]: I0603 13:58:15.525903 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/e245ca28-ddf8-46ea-b07c-6b48c53f38de-service-ca\") pod \"console-dcd8c84fd-2jw47\" (UID: \"e245ca28-ddf8-46ea-b07c-6b48c53f38de\") " pod="openshift-console/console-dcd8c84fd-2jw47" Jun 03 13:58:15.525938 ip-10-0-134-229 kubenswrapper[2574]: I0603 13:58:15.525938 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-vtscl\" (UniqueName: \"kubernetes.io/projected/e245ca28-ddf8-46ea-b07c-6b48c53f38de-kube-api-access-vtscl\") pod \"console-dcd8c84fd-2jw47\" (UID: \"e245ca28-ddf8-46ea-b07c-6b48c53f38de\") " pod="openshift-console/console-dcd8c84fd-2jw47" Jun 03 13:58:15.526142 ip-10-0-134-229 kubenswrapper[2574]: I0603 13:58:15.525963 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/e245ca28-ddf8-46ea-b07c-6b48c53f38de-console-config\") pod \"console-dcd8c84fd-2jw47\" (UID: \"e245ca28-ddf8-46ea-b07c-6b48c53f38de\") " pod="openshift-console/console-dcd8c84fd-2jw47" Jun 03 13:58:15.526142 ip-10-0-134-229 kubenswrapper[2574]: I0603 13:58:15.526011 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/e245ca28-ddf8-46ea-b07c-6b48c53f38de-oauth-serving-cert\") pod \"console-dcd8c84fd-2jw47\" (UID: \"e245ca28-ddf8-46ea-b07c-6b48c53f38de\") " pod="openshift-console/console-dcd8c84fd-2jw47" Jun 03 13:58:15.526142 ip-10-0-134-229 kubenswrapper[2574]: I0603 13:58:15.526058 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/e245ca28-ddf8-46ea-b07c-6b48c53f38de-trusted-ca-bundle\") pod \"console-dcd8c84fd-2jw47\" (UID: \"e245ca28-ddf8-46ea-b07c-6b48c53f38de\") " pod="openshift-console/console-dcd8c84fd-2jw47" Jun 03 13:58:15.526266 ip-10-0-134-229 kubenswrapper[2574]: I0603 13:58:15.526151 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/e245ca28-ddf8-46ea-b07c-6b48c53f38de-console-serving-cert\") pod \"console-dcd8c84fd-2jw47\" (UID: \"e245ca28-ddf8-46ea-b07c-6b48c53f38de\") " pod="openshift-console/console-dcd8c84fd-2jw47" Jun 03 13:58:15.526266 ip-10-0-134-229 kubenswrapper[2574]: I0603 13:58:15.526181 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/e245ca28-ddf8-46ea-b07c-6b48c53f38de-console-oauth-config\") pod \"console-dcd8c84fd-2jw47\" (UID: \"e245ca28-ddf8-46ea-b07c-6b48c53f38de\") " pod="openshift-console/console-dcd8c84fd-2jw47" Jun 03 13:58:15.627429 ip-10-0-134-229 kubenswrapper[2574]: I0603 13:58:15.627393 2574 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/e245ca28-ddf8-46ea-b07c-6b48c53f38de-trusted-ca-bundle\") pod \"console-dcd8c84fd-2jw47\" (UID: \"e245ca28-ddf8-46ea-b07c-6b48c53f38de\") " pod="openshift-console/console-dcd8c84fd-2jw47" Jun 03 13:58:15.627605 ip-10-0-134-229 kubenswrapper[2574]: I0603 13:58:15.627444 2574 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/e245ca28-ddf8-46ea-b07c-6b48c53f38de-console-serving-cert\") pod \"console-dcd8c84fd-2jw47\" (UID: \"e245ca28-ddf8-46ea-b07c-6b48c53f38de\") " pod="openshift-console/console-dcd8c84fd-2jw47" Jun 03 13:58:15.627605 ip-10-0-134-229 kubenswrapper[2574]: I0603 13:58:15.627463 2574 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/e245ca28-ddf8-46ea-b07c-6b48c53f38de-console-oauth-config\") pod \"console-dcd8c84fd-2jw47\" (UID: \"e245ca28-ddf8-46ea-b07c-6b48c53f38de\") " pod="openshift-console/console-dcd8c84fd-2jw47" Jun 03 13:58:15.627605 ip-10-0-134-229 kubenswrapper[2574]: I0603 13:58:15.627495 2574 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/e245ca28-ddf8-46ea-b07c-6b48c53f38de-service-ca\") pod \"console-dcd8c84fd-2jw47\" (UID: \"e245ca28-ddf8-46ea-b07c-6b48c53f38de\") " pod="openshift-console/console-dcd8c84fd-2jw47" Jun 03 13:58:15.627605 ip-10-0-134-229 kubenswrapper[2574]: I0603 13:58:15.627524 2574 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-vtscl\" (UniqueName: \"kubernetes.io/projected/e245ca28-ddf8-46ea-b07c-6b48c53f38de-kube-api-access-vtscl\") pod \"console-dcd8c84fd-2jw47\" (UID: \"e245ca28-ddf8-46ea-b07c-6b48c53f38de\") " pod="openshift-console/console-dcd8c84fd-2jw47" Jun 03 13:58:15.627827 ip-10-0-134-229 kubenswrapper[2574]: I0603 13:58:15.627685 2574 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/e245ca28-ddf8-46ea-b07c-6b48c53f38de-console-config\") pod \"console-dcd8c84fd-2jw47\" (UID: \"e245ca28-ddf8-46ea-b07c-6b48c53f38de\") " pod="openshift-console/console-dcd8c84fd-2jw47" Jun 03 13:58:15.627827 ip-10-0-134-229 kubenswrapper[2574]: I0603 13:58:15.627732 2574 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/e245ca28-ddf8-46ea-b07c-6b48c53f38de-oauth-serving-cert\") pod \"console-dcd8c84fd-2jw47\" (UID: \"e245ca28-ddf8-46ea-b07c-6b48c53f38de\") " pod="openshift-console/console-dcd8c84fd-2jw47" Jun 03 13:58:15.628301 ip-10-0-134-229 kubenswrapper[2574]: I0603 13:58:15.628272 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/e245ca28-ddf8-46ea-b07c-6b48c53f38de-service-ca\") pod \"console-dcd8c84fd-2jw47\" (UID: \"e245ca28-ddf8-46ea-b07c-6b48c53f38de\") " pod="openshift-console/console-dcd8c84fd-2jw47" Jun 03 13:58:15.628428 ip-10-0-134-229 kubenswrapper[2574]: I0603 13:58:15.628361 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/e245ca28-ddf8-46ea-b07c-6b48c53f38de-trusted-ca-bundle\") pod \"console-dcd8c84fd-2jw47\" (UID: \"e245ca28-ddf8-46ea-b07c-6b48c53f38de\") " pod="openshift-console/console-dcd8c84fd-2jw47" Jun 03 13:58:15.628480 ip-10-0-134-229 kubenswrapper[2574]: I0603 13:58:15.628466 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/e245ca28-ddf8-46ea-b07c-6b48c53f38de-oauth-serving-cert\") pod \"console-dcd8c84fd-2jw47\" (UID: \"e245ca28-ddf8-46ea-b07c-6b48c53f38de\") " pod="openshift-console/console-dcd8c84fd-2jw47" Jun 03 13:58:15.628516 ip-10-0-134-229 kubenswrapper[2574]: I0603 13:58:15.628484 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/e245ca28-ddf8-46ea-b07c-6b48c53f38de-console-config\") pod \"console-dcd8c84fd-2jw47\" (UID: \"e245ca28-ddf8-46ea-b07c-6b48c53f38de\") " pod="openshift-console/console-dcd8c84fd-2jw47" Jun 03 13:58:15.630073 ip-10-0-134-229 kubenswrapper[2574]: I0603 13:58:15.630003 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/e245ca28-ddf8-46ea-b07c-6b48c53f38de-console-oauth-config\") pod \"console-dcd8c84fd-2jw47\" (UID: \"e245ca28-ddf8-46ea-b07c-6b48c53f38de\") " pod="openshift-console/console-dcd8c84fd-2jw47" Jun 03 13:58:15.630180 ip-10-0-134-229 kubenswrapper[2574]: I0603 13:58:15.630097 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/e245ca28-ddf8-46ea-b07c-6b48c53f38de-console-serving-cert\") pod \"console-dcd8c84fd-2jw47\" (UID: \"e245ca28-ddf8-46ea-b07c-6b48c53f38de\") " pod="openshift-console/console-dcd8c84fd-2jw47" Jun 03 13:58:15.636077 ip-10-0-134-229 kubenswrapper[2574]: I0603 13:58:15.636058 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-vtscl\" (UniqueName: \"kubernetes.io/projected/e245ca28-ddf8-46ea-b07c-6b48c53f38de-kube-api-access-vtscl\") pod \"console-dcd8c84fd-2jw47\" (UID: \"e245ca28-ddf8-46ea-b07c-6b48c53f38de\") " pod="openshift-console/console-dcd8c84fd-2jw47" Jun 03 13:58:15.690242 ip-10-0-134-229 kubenswrapper[2574]: I0603 13:58:15.690213 2574 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-dcd8c84fd-2jw47" Jun 03 13:58:15.812112 ip-10-0-134-229 kubenswrapper[2574]: I0603 13:58:15.812086 2574 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-dcd8c84fd-2jw47"] Jun 03 13:58:15.814631 ip-10-0-134-229 kubenswrapper[2574]: W0603 13:58:15.814599 2574 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pode245ca28_ddf8_46ea_b07c_6b48c53f38de.slice/crio-e347e17d2ce6da1f99d9cf724273b182d9e2a0fca8afe91954bde1b70084dd57 WatchSource:0}: Error finding container e347e17d2ce6da1f99d9cf724273b182d9e2a0fca8afe91954bde1b70084dd57: Status 404 returned error can't find the container with id e347e17d2ce6da1f99d9cf724273b182d9e2a0fca8afe91954bde1b70084dd57 Jun 03 13:58:16.220736 ip-10-0-134-229 kubenswrapper[2574]: I0603 13:58:16.220699 2574 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-dcd8c84fd-2jw47" event={"ID":"e245ca28-ddf8-46ea-b07c-6b48c53f38de","Type":"ContainerStarted","Data":"6a8165f2f6d53af9811926486ed5392020495382081649ef1a581bd107e3b9f3"} Jun 03 13:58:16.220911 ip-10-0-134-229 kubenswrapper[2574]: I0603 13:58:16.220747 2574 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-dcd8c84fd-2jw47" event={"ID":"e245ca28-ddf8-46ea-b07c-6b48c53f38de","Type":"ContainerStarted","Data":"e347e17d2ce6da1f99d9cf724273b182d9e2a0fca8afe91954bde1b70084dd57"} Jun 03 13:58:16.242958 ip-10-0-134-229 kubenswrapper[2574]: I0603 13:58:16.242907 2574 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-console/console-dcd8c84fd-2jw47" podStartSLOduration=1.242891692 podStartE2EDuration="1.242891692s" podCreationTimestamp="2026-06-03 13:58:15 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2026-06-03 13:58:16.241205144 +0000 UTC m=+257.425212473" watchObservedRunningTime="2026-06-03 13:58:16.242891692 +0000 UTC m=+257.426899021" Jun 03 13:58:25.690391 ip-10-0-134-229 kubenswrapper[2574]: I0603 13:58:25.690332 2574 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-console/console-dcd8c84fd-2jw47" Jun 03 13:58:25.690837 ip-10-0-134-229 kubenswrapper[2574]: I0603 13:58:25.690450 2574 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/console-dcd8c84fd-2jw47" Jun 03 13:58:25.695116 ip-10-0-134-229 kubenswrapper[2574]: I0603 13:58:25.695092 2574 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-console/console-dcd8c84fd-2jw47" Jun 03 13:58:26.251464 ip-10-0-134-229 kubenswrapper[2574]: I0603 13:58:26.251434 2574 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console/console-dcd8c84fd-2jw47" Jun 03 13:58:26.306758 ip-10-0-134-229 kubenswrapper[2574]: I0603 13:58:26.306722 2574 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openshift-console/console-6c887d465b-k4q45"] Jun 03 13:58:51.328167 ip-10-0-134-229 kubenswrapper[2574]: I0603 13:58:51.328128 2574 kuberuntime_container.go:864] "Killing container with a grace period" pod="openshift-console/console-6c887d465b-k4q45" podUID="79c90f44-42ce-4ae2-beba-200f1a24c104" containerName="console" containerID="cri-o://766c0377c1b6f0a6edc1960a6b07f62932caa9d5e000773781ca53a4c9037501" gracePeriod=15 Jun 03 13:58:51.564038 ip-10-0-134-229 kubenswrapper[2574]: I0603 13:58:51.564016 2574 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console_console-6c887d465b-k4q45_79c90f44-42ce-4ae2-beba-200f1a24c104/console/0.log" Jun 03 13:58:51.564153 ip-10-0-134-229 kubenswrapper[2574]: I0603 13:58:51.564075 2574 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-6c887d465b-k4q45" Jun 03 13:58:51.594214 ip-10-0-134-229 kubenswrapper[2574]: I0603 13:58:51.594153 2574 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/79c90f44-42ce-4ae2-beba-200f1a24c104-console-serving-cert\") pod \"79c90f44-42ce-4ae2-beba-200f1a24c104\" (UID: \"79c90f44-42ce-4ae2-beba-200f1a24c104\") " Jun 03 13:58:51.594214 ip-10-0-134-229 kubenswrapper[2574]: I0603 13:58:51.594188 2574 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/79c90f44-42ce-4ae2-beba-200f1a24c104-oauth-serving-cert\") pod \"79c90f44-42ce-4ae2-beba-200f1a24c104\" (UID: \"79c90f44-42ce-4ae2-beba-200f1a24c104\") " Jun 03 13:58:51.594214 ip-10-0-134-229 kubenswrapper[2574]: I0603 13:58:51.594208 2574 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/79c90f44-42ce-4ae2-beba-200f1a24c104-console-oauth-config\") pod \"79c90f44-42ce-4ae2-beba-200f1a24c104\" (UID: \"79c90f44-42ce-4ae2-beba-200f1a24c104\") " Jun 03 13:58:51.594484 ip-10-0-134-229 kubenswrapper[2574]: I0603 13:58:51.594225 2574 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/79c90f44-42ce-4ae2-beba-200f1a24c104-trusted-ca-bundle\") pod \"79c90f44-42ce-4ae2-beba-200f1a24c104\" (UID: \"79c90f44-42ce-4ae2-beba-200f1a24c104\") " Jun 03 13:58:51.594484 ip-10-0-134-229 kubenswrapper[2574]: I0603 13:58:51.594271 2574 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/79c90f44-42ce-4ae2-beba-200f1a24c104-service-ca\") pod \"79c90f44-42ce-4ae2-beba-200f1a24c104\" (UID: \"79c90f44-42ce-4ae2-beba-200f1a24c104\") " Jun 03 13:58:51.594484 ip-10-0-134-229 kubenswrapper[2574]: I0603 13:58:51.594286 2574 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/79c90f44-42ce-4ae2-beba-200f1a24c104-console-config\") pod \"79c90f44-42ce-4ae2-beba-200f1a24c104\" (UID: \"79c90f44-42ce-4ae2-beba-200f1a24c104\") " Jun 03 13:58:51.594484 ip-10-0-134-229 kubenswrapper[2574]: I0603 13:58:51.594315 2574 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-8phbf\" (UniqueName: \"kubernetes.io/projected/79c90f44-42ce-4ae2-beba-200f1a24c104-kube-api-access-8phbf\") pod \"79c90f44-42ce-4ae2-beba-200f1a24c104\" (UID: \"79c90f44-42ce-4ae2-beba-200f1a24c104\") " Jun 03 13:58:51.594885 ip-10-0-134-229 kubenswrapper[2574]: I0603 13:58:51.594830 2574 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/79c90f44-42ce-4ae2-beba-200f1a24c104-service-ca" (OuterVolumeSpecName: "service-ca") pod "79c90f44-42ce-4ae2-beba-200f1a24c104" (UID: "79c90f44-42ce-4ae2-beba-200f1a24c104"). InnerVolumeSpecName "service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jun 03 13:58:51.595002 ip-10-0-134-229 kubenswrapper[2574]: I0603 13:58:51.594840 2574 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/79c90f44-42ce-4ae2-beba-200f1a24c104-console-config" (OuterVolumeSpecName: "console-config") pod "79c90f44-42ce-4ae2-beba-200f1a24c104" (UID: "79c90f44-42ce-4ae2-beba-200f1a24c104"). InnerVolumeSpecName "console-config". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jun 03 13:58:51.595002 ip-10-0-134-229 kubenswrapper[2574]: I0603 13:58:51.594952 2574 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/79c90f44-42ce-4ae2-beba-200f1a24c104-oauth-serving-cert" (OuterVolumeSpecName: "oauth-serving-cert") pod "79c90f44-42ce-4ae2-beba-200f1a24c104" (UID: "79c90f44-42ce-4ae2-beba-200f1a24c104"). InnerVolumeSpecName "oauth-serving-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jun 03 13:58:51.595118 ip-10-0-134-229 kubenswrapper[2574]: I0603 13:58:51.595005 2574 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/79c90f44-42ce-4ae2-beba-200f1a24c104-trusted-ca-bundle" (OuterVolumeSpecName: "trusted-ca-bundle") pod "79c90f44-42ce-4ae2-beba-200f1a24c104" (UID: "79c90f44-42ce-4ae2-beba-200f1a24c104"). InnerVolumeSpecName "trusted-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jun 03 13:58:51.596552 ip-10-0-134-229 kubenswrapper[2574]: I0603 13:58:51.596523 2574 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/79c90f44-42ce-4ae2-beba-200f1a24c104-console-serving-cert" (OuterVolumeSpecName: "console-serving-cert") pod "79c90f44-42ce-4ae2-beba-200f1a24c104" (UID: "79c90f44-42ce-4ae2-beba-200f1a24c104"). InnerVolumeSpecName "console-serving-cert". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jun 03 13:58:51.596791 ip-10-0-134-229 kubenswrapper[2574]: I0603 13:58:51.596769 2574 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/79c90f44-42ce-4ae2-beba-200f1a24c104-console-oauth-config" (OuterVolumeSpecName: "console-oauth-config") pod "79c90f44-42ce-4ae2-beba-200f1a24c104" (UID: "79c90f44-42ce-4ae2-beba-200f1a24c104"). InnerVolumeSpecName "console-oauth-config". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jun 03 13:58:51.596791 ip-10-0-134-229 kubenswrapper[2574]: I0603 13:58:51.596781 2574 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/79c90f44-42ce-4ae2-beba-200f1a24c104-kube-api-access-8phbf" (OuterVolumeSpecName: "kube-api-access-8phbf") pod "79c90f44-42ce-4ae2-beba-200f1a24c104" (UID: "79c90f44-42ce-4ae2-beba-200f1a24c104"). InnerVolumeSpecName "kube-api-access-8phbf". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 03 13:58:51.695344 ip-10-0-134-229 kubenswrapper[2574]: I0603 13:58:51.695304 2574 reconciler_common.go:299] "Volume detached for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/79c90f44-42ce-4ae2-beba-200f1a24c104-service-ca\") on node \"ip-10-0-134-229.ec2.internal\" DevicePath \"\"" Jun 03 13:58:51.695344 ip-10-0-134-229 kubenswrapper[2574]: I0603 13:58:51.695338 2574 reconciler_common.go:299] "Volume detached for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/79c90f44-42ce-4ae2-beba-200f1a24c104-console-config\") on node \"ip-10-0-134-229.ec2.internal\" DevicePath \"\"" Jun 03 13:58:51.695344 ip-10-0-134-229 kubenswrapper[2574]: I0603 13:58:51.695349 2574 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-8phbf\" (UniqueName: \"kubernetes.io/projected/79c90f44-42ce-4ae2-beba-200f1a24c104-kube-api-access-8phbf\") on node \"ip-10-0-134-229.ec2.internal\" DevicePath \"\"" Jun 03 13:58:51.695554 ip-10-0-134-229 kubenswrapper[2574]: I0603 13:58:51.695359 2574 reconciler_common.go:299] "Volume detached for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/79c90f44-42ce-4ae2-beba-200f1a24c104-console-serving-cert\") on node \"ip-10-0-134-229.ec2.internal\" DevicePath \"\"" Jun 03 13:58:51.695554 ip-10-0-134-229 kubenswrapper[2574]: I0603 13:58:51.695369 2574 reconciler_common.go:299] "Volume detached for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/79c90f44-42ce-4ae2-beba-200f1a24c104-oauth-serving-cert\") on node \"ip-10-0-134-229.ec2.internal\" DevicePath \"\"" Jun 03 13:58:51.695554 ip-10-0-134-229 kubenswrapper[2574]: I0603 13:58:51.695399 2574 reconciler_common.go:299] "Volume detached for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/79c90f44-42ce-4ae2-beba-200f1a24c104-console-oauth-config\") on node \"ip-10-0-134-229.ec2.internal\" DevicePath \"\"" Jun 03 13:58:51.695554 ip-10-0-134-229 kubenswrapper[2574]: I0603 13:58:51.695407 2574 reconciler_common.go:299] "Volume detached for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/79c90f44-42ce-4ae2-beba-200f1a24c104-trusted-ca-bundle\") on node \"ip-10-0-134-229.ec2.internal\" DevicePath \"\"" Jun 03 13:58:52.317225 ip-10-0-134-229 kubenswrapper[2574]: I0603 13:58:52.317200 2574 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console_console-6c887d465b-k4q45_79c90f44-42ce-4ae2-beba-200f1a24c104/console/0.log" Jun 03 13:58:52.317430 ip-10-0-134-229 kubenswrapper[2574]: I0603 13:58:52.317237 2574 generic.go:358] "Generic (PLEG): container finished" podID="79c90f44-42ce-4ae2-beba-200f1a24c104" containerID="766c0377c1b6f0a6edc1960a6b07f62932caa9d5e000773781ca53a4c9037501" exitCode=2 Jun 03 13:58:52.317430 ip-10-0-134-229 kubenswrapper[2574]: I0603 13:58:52.317295 2574 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-6c887d465b-k4q45" Jun 03 13:58:52.317430 ip-10-0-134-229 kubenswrapper[2574]: I0603 13:58:52.317304 2574 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-6c887d465b-k4q45" event={"ID":"79c90f44-42ce-4ae2-beba-200f1a24c104","Type":"ContainerDied","Data":"766c0377c1b6f0a6edc1960a6b07f62932caa9d5e000773781ca53a4c9037501"} Jun 03 13:58:52.317430 ip-10-0-134-229 kubenswrapper[2574]: I0603 13:58:52.317333 2574 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-6c887d465b-k4q45" event={"ID":"79c90f44-42ce-4ae2-beba-200f1a24c104","Type":"ContainerDied","Data":"ed0f10d20c3a5ad7960edfed366ed512dc12363a431db3d7ed780e931a9a8503"} Jun 03 13:58:52.317430 ip-10-0-134-229 kubenswrapper[2574]: I0603 13:58:52.317351 2574 scope.go:117] "RemoveContainer" containerID="766c0377c1b6f0a6edc1960a6b07f62932caa9d5e000773781ca53a4c9037501" Jun 03 13:58:52.332886 ip-10-0-134-229 kubenswrapper[2574]: I0603 13:58:52.332709 2574 scope.go:117] "RemoveContainer" containerID="766c0377c1b6f0a6edc1960a6b07f62932caa9d5e000773781ca53a4c9037501" Jun 03 13:58:52.333115 ip-10-0-134-229 kubenswrapper[2574]: E0603 13:58:52.332976 2574 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"766c0377c1b6f0a6edc1960a6b07f62932caa9d5e000773781ca53a4c9037501\": container with ID starting with 766c0377c1b6f0a6edc1960a6b07f62932caa9d5e000773781ca53a4c9037501 not found: ID does not exist" containerID="766c0377c1b6f0a6edc1960a6b07f62932caa9d5e000773781ca53a4c9037501" Jun 03 13:58:52.333115 ip-10-0-134-229 kubenswrapper[2574]: I0603 13:58:52.333000 2574 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"766c0377c1b6f0a6edc1960a6b07f62932caa9d5e000773781ca53a4c9037501"} err="failed to get container status \"766c0377c1b6f0a6edc1960a6b07f62932caa9d5e000773781ca53a4c9037501\": rpc error: code = NotFound desc = could not find container \"766c0377c1b6f0a6edc1960a6b07f62932caa9d5e000773781ca53a4c9037501\": container with ID starting with 766c0377c1b6f0a6edc1960a6b07f62932caa9d5e000773781ca53a4c9037501 not found: ID does not exist" Jun 03 13:58:52.347888 ip-10-0-134-229 kubenswrapper[2574]: I0603 13:58:52.347860 2574 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openshift-console/console-6c887d465b-k4q45"] Jun 03 13:58:52.352583 ip-10-0-134-229 kubenswrapper[2574]: I0603 13:58:52.352559 2574 kubelet.go:2547] "SyncLoop REMOVE" source="api" pods=["openshift-console/console-6c887d465b-k4q45"] Jun 03 13:58:53.430084 ip-10-0-134-229 kubenswrapper[2574]: I0603 13:58:53.430047 2574 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="79c90f44-42ce-4ae2-beba-200f1a24c104" path="/var/lib/kubelet/pods/79c90f44-42ce-4ae2-beba-200f1a24c104/volumes" Jun 03 13:58:59.325929 ip-10-0-134-229 kubenswrapper[2574]: I0603 13:58:59.325906 2574 kubelet.go:1628] "Image garbage collection succeeded" Jun 03 13:59:40.492755 ip-10-0-134-229 kubenswrapper[2574]: I0603 13:59:40.492722 2574 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-marketplace/2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19d4dsrr"] Jun 03 13:59:40.493166 ip-10-0-134-229 kubenswrapper[2574]: I0603 13:59:40.492995 2574 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="79c90f44-42ce-4ae2-beba-200f1a24c104" containerName="console" Jun 03 13:59:40.493166 ip-10-0-134-229 kubenswrapper[2574]: I0603 13:59:40.493006 2574 state_mem.go:107] "Deleted CPUSet assignment" podUID="79c90f44-42ce-4ae2-beba-200f1a24c104" containerName="console" Jun 03 13:59:40.493166 ip-10-0-134-229 kubenswrapper[2574]: I0603 13:59:40.493063 2574 memory_manager.go:356] "RemoveStaleState removing state" podUID="79c90f44-42ce-4ae2-beba-200f1a24c104" containerName="console" Jun 03 13:59:40.495964 ip-10-0-134-229 kubenswrapper[2574]: I0603 13:59:40.495949 2574 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19d4dsrr" Jun 03 13:59:40.502348 ip-10-0-134-229 kubenswrapper[2574]: I0603 13:59:40.502323 2574 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"kube-root-ca.crt\"" Jun 03 13:59:40.502848 ip-10-0-134-229 kubenswrapper[2574]: I0603 13:59:40.502829 2574 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"openshift-service-ca.crt\"" Jun 03 13:59:40.503695 ip-10-0-134-229 kubenswrapper[2574]: I0603 13:59:40.503677 2574 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-marketplace\"/\"default-dockercfg-h5qff\"" Jun 03 13:59:40.518324 ip-10-0-134-229 kubenswrapper[2574]: I0603 13:59:40.518303 2574 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19d4dsrr"] Jun 03 13:59:40.629930 ip-10-0-134-229 kubenswrapper[2574]: I0603 13:59:40.629906 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-ddpr4\" (UniqueName: \"kubernetes.io/projected/d8b02837-c452-473e-9cff-b4243df3e103-kube-api-access-ddpr4\") pod \"2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19d4dsrr\" (UID: \"d8b02837-c452-473e-9cff-b4243df3e103\") " pod="openshift-marketplace/2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19d4dsrr" Jun 03 13:59:40.630045 ip-10-0-134-229 kubenswrapper[2574]: I0603 13:59:40.629982 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/d8b02837-c452-473e-9cff-b4243df3e103-bundle\") pod \"2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19d4dsrr\" (UID: \"d8b02837-c452-473e-9cff-b4243df3e103\") " pod="openshift-marketplace/2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19d4dsrr" Jun 03 13:59:40.630045 ip-10-0-134-229 kubenswrapper[2574]: I0603 13:59:40.630002 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/d8b02837-c452-473e-9cff-b4243df3e103-util\") pod \"2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19d4dsrr\" (UID: \"d8b02837-c452-473e-9cff-b4243df3e103\") " pod="openshift-marketplace/2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19d4dsrr" Jun 03 13:59:40.730806 ip-10-0-134-229 kubenswrapper[2574]: I0603 13:59:40.730784 2574 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/d8b02837-c452-473e-9cff-b4243df3e103-util\") pod \"2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19d4dsrr\" (UID: \"d8b02837-c452-473e-9cff-b4243df3e103\") " pod="openshift-marketplace/2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19d4dsrr" Jun 03 13:59:40.730915 ip-10-0-134-229 kubenswrapper[2574]: I0603 13:59:40.730824 2574 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-ddpr4\" (UniqueName: \"kubernetes.io/projected/d8b02837-c452-473e-9cff-b4243df3e103-kube-api-access-ddpr4\") pod \"2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19d4dsrr\" (UID: \"d8b02837-c452-473e-9cff-b4243df3e103\") " pod="openshift-marketplace/2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19d4dsrr" Jun 03 13:59:40.730975 ip-10-0-134-229 kubenswrapper[2574]: I0603 13:59:40.730942 2574 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/d8b02837-c452-473e-9cff-b4243df3e103-bundle\") pod \"2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19d4dsrr\" (UID: \"d8b02837-c452-473e-9cff-b4243df3e103\") " pod="openshift-marketplace/2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19d4dsrr" Jun 03 13:59:40.731188 ip-10-0-134-229 kubenswrapper[2574]: I0603 13:59:40.731167 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/d8b02837-c452-473e-9cff-b4243df3e103-util\") pod \"2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19d4dsrr\" (UID: \"d8b02837-c452-473e-9cff-b4243df3e103\") " pod="openshift-marketplace/2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19d4dsrr" Jun 03 13:59:40.731249 ip-10-0-134-229 kubenswrapper[2574]: I0603 13:59:40.731194 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/d8b02837-c452-473e-9cff-b4243df3e103-bundle\") pod \"2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19d4dsrr\" (UID: \"d8b02837-c452-473e-9cff-b4243df3e103\") " pod="openshift-marketplace/2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19d4dsrr" Jun 03 13:59:40.739831 ip-10-0-134-229 kubenswrapper[2574]: I0603 13:59:40.739811 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-ddpr4\" (UniqueName: \"kubernetes.io/projected/d8b02837-c452-473e-9cff-b4243df3e103-kube-api-access-ddpr4\") pod \"2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19d4dsrr\" (UID: \"d8b02837-c452-473e-9cff-b4243df3e103\") " pod="openshift-marketplace/2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19d4dsrr" Jun 03 13:59:40.804522 ip-10-0-134-229 kubenswrapper[2574]: I0603 13:59:40.804462 2574 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19d4dsrr" Jun 03 13:59:40.924836 ip-10-0-134-229 kubenswrapper[2574]: I0603 13:59:40.924803 2574 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19d4dsrr"] Jun 03 13:59:40.927892 ip-10-0-134-229 kubenswrapper[2574]: W0603 13:59:40.927867 2574 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podd8b02837_c452_473e_9cff_b4243df3e103.slice/crio-f70ee0749b46dada87cd38f59cbae1998d858b06cf6b3b526eb945124f4e27c5 WatchSource:0}: Error finding container f70ee0749b46dada87cd38f59cbae1998d858b06cf6b3b526eb945124f4e27c5: Status 404 returned error can't find the container with id f70ee0749b46dada87cd38f59cbae1998d858b06cf6b3b526eb945124f4e27c5 Jun 03 13:59:40.929735 ip-10-0-134-229 kubenswrapper[2574]: I0603 13:59:40.929718 2574 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider Jun 03 13:59:41.445215 ip-10-0-134-229 kubenswrapper[2574]: I0603 13:59:41.445175 2574 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19d4dsrr" event={"ID":"d8b02837-c452-473e-9cff-b4243df3e103","Type":"ContainerStarted","Data":"f70ee0749b46dada87cd38f59cbae1998d858b06cf6b3b526eb945124f4e27c5"} Jun 03 13:59:48.466846 ip-10-0-134-229 kubenswrapper[2574]: I0603 13:59:48.466812 2574 generic.go:358] "Generic (PLEG): container finished" podID="d8b02837-c452-473e-9cff-b4243df3e103" containerID="866f5b86822f1effc75f038305e98d3c652795ed50117bd9c2f73be05df52586" exitCode=0 Jun 03 13:59:48.467301 ip-10-0-134-229 kubenswrapper[2574]: I0603 13:59:48.466904 2574 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19d4dsrr" event={"ID":"d8b02837-c452-473e-9cff-b4243df3e103","Type":"ContainerDied","Data":"866f5b86822f1effc75f038305e98d3c652795ed50117bd9c2f73be05df52586"} Jun 03 13:59:51.476744 ip-10-0-134-229 kubenswrapper[2574]: I0603 13:59:51.476710 2574 generic.go:358] "Generic (PLEG): container finished" podID="d8b02837-c452-473e-9cff-b4243df3e103" containerID="32eaf9c39d90062263b720766b9d91b06449bf254a47c98762eef8668880d23a" exitCode=0 Jun 03 13:59:51.477113 ip-10-0-134-229 kubenswrapper[2574]: I0603 13:59:51.476781 2574 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19d4dsrr" event={"ID":"d8b02837-c452-473e-9cff-b4243df3e103","Type":"ContainerDied","Data":"32eaf9c39d90062263b720766b9d91b06449bf254a47c98762eef8668880d23a"} Jun 03 13:59:59.500704 ip-10-0-134-229 kubenswrapper[2574]: I0603 13:59:59.500671 2574 generic.go:358] "Generic (PLEG): container finished" podID="d8b02837-c452-473e-9cff-b4243df3e103" containerID="73730a8addd60094ac23b5c746ee78ae96c0f605e36a4cf3e337950067247648" exitCode=0 Jun 03 13:59:59.501038 ip-10-0-134-229 kubenswrapper[2574]: I0603 13:59:59.500755 2574 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19d4dsrr" event={"ID":"d8b02837-c452-473e-9cff-b4243df3e103","Type":"ContainerDied","Data":"73730a8addd60094ac23b5c746ee78ae96c0f605e36a4cf3e337950067247648"} Jun 03 14:00:00.621690 ip-10-0-134-229 kubenswrapper[2574]: I0603 14:00:00.621668 2574 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19d4dsrr" Jun 03 14:00:00.791566 ip-10-0-134-229 kubenswrapper[2574]: I0603 14:00:00.791488 2574 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-ddpr4\" (UniqueName: \"kubernetes.io/projected/d8b02837-c452-473e-9cff-b4243df3e103-kube-api-access-ddpr4\") pod \"d8b02837-c452-473e-9cff-b4243df3e103\" (UID: \"d8b02837-c452-473e-9cff-b4243df3e103\") " Jun 03 14:00:00.791566 ip-10-0-134-229 kubenswrapper[2574]: I0603 14:00:00.791563 2574 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/d8b02837-c452-473e-9cff-b4243df3e103-util\") pod \"d8b02837-c452-473e-9cff-b4243df3e103\" (UID: \"d8b02837-c452-473e-9cff-b4243df3e103\") " Jun 03 14:00:00.791745 ip-10-0-134-229 kubenswrapper[2574]: I0603 14:00:00.791615 2574 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/d8b02837-c452-473e-9cff-b4243df3e103-bundle\") pod \"d8b02837-c452-473e-9cff-b4243df3e103\" (UID: \"d8b02837-c452-473e-9cff-b4243df3e103\") " Jun 03 14:00:00.792244 ip-10-0-134-229 kubenswrapper[2574]: I0603 14:00:00.792212 2574 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/d8b02837-c452-473e-9cff-b4243df3e103-bundle" (OuterVolumeSpecName: "bundle") pod "d8b02837-c452-473e-9cff-b4243df3e103" (UID: "d8b02837-c452-473e-9cff-b4243df3e103"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jun 03 14:00:00.793715 ip-10-0-134-229 kubenswrapper[2574]: I0603 14:00:00.793692 2574 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/d8b02837-c452-473e-9cff-b4243df3e103-kube-api-access-ddpr4" (OuterVolumeSpecName: "kube-api-access-ddpr4") pod "d8b02837-c452-473e-9cff-b4243df3e103" (UID: "d8b02837-c452-473e-9cff-b4243df3e103"). InnerVolumeSpecName "kube-api-access-ddpr4". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 03 14:00:00.795671 ip-10-0-134-229 kubenswrapper[2574]: I0603 14:00:00.795651 2574 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/d8b02837-c452-473e-9cff-b4243df3e103-util" (OuterVolumeSpecName: "util") pod "d8b02837-c452-473e-9cff-b4243df3e103" (UID: "d8b02837-c452-473e-9cff-b4243df3e103"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jun 03 14:00:00.892436 ip-10-0-134-229 kubenswrapper[2574]: I0603 14:00:00.892410 2574 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/d8b02837-c452-473e-9cff-b4243df3e103-bundle\") on node \"ip-10-0-134-229.ec2.internal\" DevicePath \"\"" Jun 03 14:00:00.892436 ip-10-0-134-229 kubenswrapper[2574]: I0603 14:00:00.892432 2574 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-ddpr4\" (UniqueName: \"kubernetes.io/projected/d8b02837-c452-473e-9cff-b4243df3e103-kube-api-access-ddpr4\") on node \"ip-10-0-134-229.ec2.internal\" DevicePath \"\"" Jun 03 14:00:00.892578 ip-10-0-134-229 kubenswrapper[2574]: I0603 14:00:00.892443 2574 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/d8b02837-c452-473e-9cff-b4243df3e103-util\") on node \"ip-10-0-134-229.ec2.internal\" DevicePath \"\"" Jun 03 14:00:01.508174 ip-10-0-134-229 kubenswrapper[2574]: I0603 14:00:01.508145 2574 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19d4dsrr" event={"ID":"d8b02837-c452-473e-9cff-b4243df3e103","Type":"ContainerDied","Data":"f70ee0749b46dada87cd38f59cbae1998d858b06cf6b3b526eb945124f4e27c5"} Jun 03 14:00:01.508174 ip-10-0-134-229 kubenswrapper[2574]: I0603 14:00:01.508173 2574 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="f70ee0749b46dada87cd38f59cbae1998d858b06cf6b3b526eb945124f4e27c5" Jun 03 14:00:01.508174 ip-10-0-134-229 kubenswrapper[2574]: I0603 14:00:01.508174 2574 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19d4dsrr" Jun 03 14:00:08.602337 ip-10-0-134-229 kubenswrapper[2574]: I0603 14:00:08.602302 2574 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["cert-manager-operator/cert-manager-operator-controller-manager-54b9655956-4rgwj"] Jun 03 14:00:08.602823 ip-10-0-134-229 kubenswrapper[2574]: I0603 14:00:08.602590 2574 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="d8b02837-c452-473e-9cff-b4243df3e103" containerName="pull" Jun 03 14:00:08.602823 ip-10-0-134-229 kubenswrapper[2574]: I0603 14:00:08.602602 2574 state_mem.go:107] "Deleted CPUSet assignment" podUID="d8b02837-c452-473e-9cff-b4243df3e103" containerName="pull" Jun 03 14:00:08.602823 ip-10-0-134-229 kubenswrapper[2574]: I0603 14:00:08.602615 2574 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="d8b02837-c452-473e-9cff-b4243df3e103" containerName="util" Jun 03 14:00:08.602823 ip-10-0-134-229 kubenswrapper[2574]: I0603 14:00:08.602620 2574 state_mem.go:107] "Deleted CPUSet assignment" podUID="d8b02837-c452-473e-9cff-b4243df3e103" containerName="util" Jun 03 14:00:08.602823 ip-10-0-134-229 kubenswrapper[2574]: I0603 14:00:08.602631 2574 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="d8b02837-c452-473e-9cff-b4243df3e103" containerName="extract" Jun 03 14:00:08.602823 ip-10-0-134-229 kubenswrapper[2574]: I0603 14:00:08.602640 2574 state_mem.go:107] "Deleted CPUSet assignment" podUID="d8b02837-c452-473e-9cff-b4243df3e103" containerName="extract" Jun 03 14:00:08.602823 ip-10-0-134-229 kubenswrapper[2574]: I0603 14:00:08.602684 2574 memory_manager.go:356] "RemoveStaleState removing state" podUID="d8b02837-c452-473e-9cff-b4243df3e103" containerName="extract" Jun 03 14:00:08.606712 ip-10-0-134-229 kubenswrapper[2574]: I0603 14:00:08.606697 2574 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager-operator/cert-manager-operator-controller-manager-54b9655956-4rgwj" Jun 03 14:00:08.613006 ip-10-0-134-229 kubenswrapper[2574]: I0603 14:00:08.612981 2574 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"cert-manager-operator\"/\"cert-manager-operator-controller-manager-dockercfg-n8877\"" Jun 03 14:00:08.613134 ip-10-0-134-229 kubenswrapper[2574]: I0603 14:00:08.613086 2574 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"cert-manager-operator\"/\"openshift-service-ca.crt\"" Jun 03 14:00:08.614193 ip-10-0-134-229 kubenswrapper[2574]: I0603 14:00:08.614175 2574 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"cert-manager-operator\"/\"kube-root-ca.crt\"" Jun 03 14:00:08.634494 ip-10-0-134-229 kubenswrapper[2574]: I0603 14:00:08.634473 2574 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["cert-manager-operator/cert-manager-operator-controller-manager-54b9655956-4rgwj"] Jun 03 14:00:08.643216 ip-10-0-134-229 kubenswrapper[2574]: I0603 14:00:08.643190 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/79053676-f0a2-4518-99a8-61c262e04bc1-tmp\") pod \"cert-manager-operator-controller-manager-54b9655956-4rgwj\" (UID: \"79053676-f0a2-4518-99a8-61c262e04bc1\") " pod="cert-manager-operator/cert-manager-operator-controller-manager-54b9655956-4rgwj" Jun 03 14:00:08.643342 ip-10-0-134-229 kubenswrapper[2574]: I0603 14:00:08.643285 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-xzvhs\" (UniqueName: \"kubernetes.io/projected/79053676-f0a2-4518-99a8-61c262e04bc1-kube-api-access-xzvhs\") pod \"cert-manager-operator-controller-manager-54b9655956-4rgwj\" (UID: \"79053676-f0a2-4518-99a8-61c262e04bc1\") " pod="cert-manager-operator/cert-manager-operator-controller-manager-54b9655956-4rgwj" Jun 03 14:00:08.744150 ip-10-0-134-229 kubenswrapper[2574]: I0603 14:00:08.744125 2574 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-xzvhs\" (UniqueName: \"kubernetes.io/projected/79053676-f0a2-4518-99a8-61c262e04bc1-kube-api-access-xzvhs\") pod \"cert-manager-operator-controller-manager-54b9655956-4rgwj\" (UID: \"79053676-f0a2-4518-99a8-61c262e04bc1\") " pod="cert-manager-operator/cert-manager-operator-controller-manager-54b9655956-4rgwj" Jun 03 14:00:08.744308 ip-10-0-134-229 kubenswrapper[2574]: I0603 14:00:08.744168 2574 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/79053676-f0a2-4518-99a8-61c262e04bc1-tmp\") pod \"cert-manager-operator-controller-manager-54b9655956-4rgwj\" (UID: \"79053676-f0a2-4518-99a8-61c262e04bc1\") " pod="cert-manager-operator/cert-manager-operator-controller-manager-54b9655956-4rgwj" Jun 03 14:00:08.744531 ip-10-0-134-229 kubenswrapper[2574]: I0603 14:00:08.744514 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/79053676-f0a2-4518-99a8-61c262e04bc1-tmp\") pod \"cert-manager-operator-controller-manager-54b9655956-4rgwj\" (UID: \"79053676-f0a2-4518-99a8-61c262e04bc1\") " pod="cert-manager-operator/cert-manager-operator-controller-manager-54b9655956-4rgwj" Jun 03 14:00:08.756096 ip-10-0-134-229 kubenswrapper[2574]: I0603 14:00:08.756076 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-xzvhs\" (UniqueName: \"kubernetes.io/projected/79053676-f0a2-4518-99a8-61c262e04bc1-kube-api-access-xzvhs\") pod \"cert-manager-operator-controller-manager-54b9655956-4rgwj\" (UID: \"79053676-f0a2-4518-99a8-61c262e04bc1\") " pod="cert-manager-operator/cert-manager-operator-controller-manager-54b9655956-4rgwj" Jun 03 14:00:08.915507 ip-10-0-134-229 kubenswrapper[2574]: I0603 14:00:08.915472 2574 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager-operator/cert-manager-operator-controller-manager-54b9655956-4rgwj" Jun 03 14:00:09.040599 ip-10-0-134-229 kubenswrapper[2574]: I0603 14:00:09.040560 2574 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["cert-manager-operator/cert-manager-operator-controller-manager-54b9655956-4rgwj"] Jun 03 14:00:09.044625 ip-10-0-134-229 kubenswrapper[2574]: W0603 14:00:09.044583 2574 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod79053676_f0a2_4518_99a8_61c262e04bc1.slice/crio-8fc506cf39430d57a8f4df4262f88d614d212b0d88c85aaf18e7bc592dcf8b69 WatchSource:0}: Error finding container 8fc506cf39430d57a8f4df4262f88d614d212b0d88c85aaf18e7bc592dcf8b69: Status 404 returned error can't find the container with id 8fc506cf39430d57a8f4df4262f88d614d212b0d88c85aaf18e7bc592dcf8b69 Jun 03 14:00:09.529811 ip-10-0-134-229 kubenswrapper[2574]: I0603 14:00:09.529779 2574 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="cert-manager-operator/cert-manager-operator-controller-manager-54b9655956-4rgwj" event={"ID":"79053676-f0a2-4518-99a8-61c262e04bc1","Type":"ContainerStarted","Data":"8fc506cf39430d57a8f4df4262f88d614d212b0d88c85aaf18e7bc592dcf8b69"} Jun 03 14:00:11.537177 ip-10-0-134-229 kubenswrapper[2574]: I0603 14:00:11.537141 2574 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="cert-manager-operator/cert-manager-operator-controller-manager-54b9655956-4rgwj" event={"ID":"79053676-f0a2-4518-99a8-61c262e04bc1","Type":"ContainerStarted","Data":"cb9bf5fc90c5b7dd577de885ae43a9477f3759f253cc4c2c9db34037c70a9e27"} Jun 03 14:00:11.562569 ip-10-0-134-229 kubenswrapper[2574]: I0603 14:00:11.562524 2574 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="cert-manager-operator/cert-manager-operator-controller-manager-54b9655956-4rgwj" podStartSLOduration=1.6076833289999999 podStartE2EDuration="3.562511692s" podCreationTimestamp="2026-06-03 14:00:08 +0000 UTC" firstStartedPulling="2026-06-03 14:00:09.047263405 +0000 UTC m=+370.231270712" lastFinishedPulling="2026-06-03 14:00:11.002091765 +0000 UTC m=+372.186099075" observedRunningTime="2026-06-03 14:00:11.561339211 +0000 UTC m=+372.745346542" watchObservedRunningTime="2026-06-03 14:00:11.562511692 +0000 UTC m=+372.746519021" Jun 03 14:00:13.036158 ip-10-0-134-229 kubenswrapper[2574]: I0603 14:00:13.036125 2574 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fnlr85"] Jun 03 14:00:13.038219 ip-10-0-134-229 kubenswrapper[2574]: I0603 14:00:13.038203 2574 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fnlr85" Jun 03 14:00:13.040657 ip-10-0-134-229 kubenswrapper[2574]: I0603 14:00:13.040628 2574 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-marketplace\"/\"default-dockercfg-h5qff\"" Jun 03 14:00:13.040657 ip-10-0-134-229 kubenswrapper[2574]: I0603 14:00:13.040647 2574 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"openshift-service-ca.crt\"" Jun 03 14:00:13.041482 ip-10-0-134-229 kubenswrapper[2574]: I0603 14:00:13.041460 2574 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"kube-root-ca.crt\"" Jun 03 14:00:13.052446 ip-10-0-134-229 kubenswrapper[2574]: I0603 14:00:13.052423 2574 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fnlr85"] Jun 03 14:00:13.075512 ip-10-0-134-229 kubenswrapper[2574]: I0603 14:00:13.075486 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/7d282cb6-74e4-46fa-84d5-d8791f795160-util\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fnlr85\" (UID: \"7d282cb6-74e4-46fa-84d5-d8791f795160\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fnlr85" Jun 03 14:00:13.075610 ip-10-0-134-229 kubenswrapper[2574]: I0603 14:00:13.075530 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-8zcff\" (UniqueName: \"kubernetes.io/projected/7d282cb6-74e4-46fa-84d5-d8791f795160-kube-api-access-8zcff\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fnlr85\" (UID: \"7d282cb6-74e4-46fa-84d5-d8791f795160\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fnlr85" Jun 03 14:00:13.075610 ip-10-0-134-229 kubenswrapper[2574]: I0603 14:00:13.075589 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/7d282cb6-74e4-46fa-84d5-d8791f795160-bundle\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fnlr85\" (UID: \"7d282cb6-74e4-46fa-84d5-d8791f795160\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fnlr85" Jun 03 14:00:13.176699 ip-10-0-134-229 kubenswrapper[2574]: I0603 14:00:13.176666 2574 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/7d282cb6-74e4-46fa-84d5-d8791f795160-bundle\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fnlr85\" (UID: \"7d282cb6-74e4-46fa-84d5-d8791f795160\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fnlr85" Jun 03 14:00:13.176846 ip-10-0-134-229 kubenswrapper[2574]: I0603 14:00:13.176719 2574 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/7d282cb6-74e4-46fa-84d5-d8791f795160-util\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fnlr85\" (UID: \"7d282cb6-74e4-46fa-84d5-d8791f795160\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fnlr85" Jun 03 14:00:13.176846 ip-10-0-134-229 kubenswrapper[2574]: I0603 14:00:13.176752 2574 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-8zcff\" (UniqueName: \"kubernetes.io/projected/7d282cb6-74e4-46fa-84d5-d8791f795160-kube-api-access-8zcff\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fnlr85\" (UID: \"7d282cb6-74e4-46fa-84d5-d8791f795160\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fnlr85" Jun 03 14:00:13.177049 ip-10-0-134-229 kubenswrapper[2574]: I0603 14:00:13.177030 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/7d282cb6-74e4-46fa-84d5-d8791f795160-bundle\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fnlr85\" (UID: \"7d282cb6-74e4-46fa-84d5-d8791f795160\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fnlr85" Jun 03 14:00:13.177091 ip-10-0-134-229 kubenswrapper[2574]: I0603 14:00:13.177054 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/7d282cb6-74e4-46fa-84d5-d8791f795160-util\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fnlr85\" (UID: \"7d282cb6-74e4-46fa-84d5-d8791f795160\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fnlr85" Jun 03 14:00:13.188112 ip-10-0-134-229 kubenswrapper[2574]: I0603 14:00:13.188087 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-8zcff\" (UniqueName: \"kubernetes.io/projected/7d282cb6-74e4-46fa-84d5-d8791f795160-kube-api-access-8zcff\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fnlr85\" (UID: \"7d282cb6-74e4-46fa-84d5-d8791f795160\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fnlr85" Jun 03 14:00:13.347137 ip-10-0-134-229 kubenswrapper[2574]: I0603 14:00:13.347056 2574 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fnlr85" Jun 03 14:00:13.478814 ip-10-0-134-229 kubenswrapper[2574]: I0603 14:00:13.478785 2574 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fnlr85"] Jun 03 14:00:13.481717 ip-10-0-134-229 kubenswrapper[2574]: W0603 14:00:13.481687 2574 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod7d282cb6_74e4_46fa_84d5_d8791f795160.slice/crio-4d50df02029c33727e02b4dada074bbc371bb534e5788e533303079a13da96c4 WatchSource:0}: Error finding container 4d50df02029c33727e02b4dada074bbc371bb534e5788e533303079a13da96c4: Status 404 returned error can't find the container with id 4d50df02029c33727e02b4dada074bbc371bb534e5788e533303079a13da96c4 Jun 03 14:00:13.543943 ip-10-0-134-229 kubenswrapper[2574]: I0603 14:00:13.543915 2574 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fnlr85" event={"ID":"7d282cb6-74e4-46fa-84d5-d8791f795160","Type":"ContainerStarted","Data":"3fbf828f0bf88bfed2e3ae583fb6a31a734ff00908a59c9f5196c3af87bdc530"} Jun 03 14:00:13.544045 ip-10-0-134-229 kubenswrapper[2574]: I0603 14:00:13.543954 2574 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fnlr85" event={"ID":"7d282cb6-74e4-46fa-84d5-d8791f795160","Type":"ContainerStarted","Data":"4d50df02029c33727e02b4dada074bbc371bb534e5788e533303079a13da96c4"} Jun 03 14:00:14.547740 ip-10-0-134-229 kubenswrapper[2574]: I0603 14:00:14.547653 2574 generic.go:358] "Generic (PLEG): container finished" podID="7d282cb6-74e4-46fa-84d5-d8791f795160" containerID="3fbf828f0bf88bfed2e3ae583fb6a31a734ff00908a59c9f5196c3af87bdc530" exitCode=0 Jun 03 14:00:14.547740 ip-10-0-134-229 kubenswrapper[2574]: I0603 14:00:14.547724 2574 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fnlr85" event={"ID":"7d282cb6-74e4-46fa-84d5-d8791f795160","Type":"ContainerDied","Data":"3fbf828f0bf88bfed2e3ae583fb6a31a734ff00908a59c9f5196c3af87bdc530"} Jun 03 14:00:15.692490 ip-10-0-134-229 kubenswrapper[2574]: I0603 14:00:15.692453 2574 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["cert-manager/cert-manager-cainjector-68b757865b-c2jb8"] Jun 03 14:00:15.694809 ip-10-0-134-229 kubenswrapper[2574]: I0603 14:00:15.694790 2574 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager/cert-manager-cainjector-68b757865b-c2jb8" Jun 03 14:00:15.697263 ip-10-0-134-229 kubenswrapper[2574]: I0603 14:00:15.697238 2574 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"cert-manager\"/\"cert-manager-cainjector-dockercfg-z8q8l\"" Jun 03 14:00:15.697573 ip-10-0-134-229 kubenswrapper[2574]: I0603 14:00:15.697554 2574 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"cert-manager\"/\"openshift-service-ca.crt\"" Jun 03 14:00:15.697918 ip-10-0-134-229 kubenswrapper[2574]: I0603 14:00:15.697903 2574 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"cert-manager\"/\"kube-root-ca.crt\"" Jun 03 14:00:15.707132 ip-10-0-134-229 kubenswrapper[2574]: I0603 14:00:15.707111 2574 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["cert-manager/cert-manager-cainjector-68b757865b-c2jb8"] Jun 03 14:00:15.797514 ip-10-0-134-229 kubenswrapper[2574]: I0603 14:00:15.797486 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/7f2ea9f5-2eff-41b8-af35-8b236220ca2c-bound-sa-token\") pod \"cert-manager-cainjector-68b757865b-c2jb8\" (UID: \"7f2ea9f5-2eff-41b8-af35-8b236220ca2c\") " pod="cert-manager/cert-manager-cainjector-68b757865b-c2jb8" Jun 03 14:00:15.797698 ip-10-0-134-229 kubenswrapper[2574]: I0603 14:00:15.797525 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-tfjnd\" (UniqueName: \"kubernetes.io/projected/7f2ea9f5-2eff-41b8-af35-8b236220ca2c-kube-api-access-tfjnd\") pod \"cert-manager-cainjector-68b757865b-c2jb8\" (UID: \"7f2ea9f5-2eff-41b8-af35-8b236220ca2c\") " pod="cert-manager/cert-manager-cainjector-68b757865b-c2jb8" Jun 03 14:00:15.898458 ip-10-0-134-229 kubenswrapper[2574]: I0603 14:00:15.898422 2574 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/7f2ea9f5-2eff-41b8-af35-8b236220ca2c-bound-sa-token\") pod \"cert-manager-cainjector-68b757865b-c2jb8\" (UID: \"7f2ea9f5-2eff-41b8-af35-8b236220ca2c\") " pod="cert-manager/cert-manager-cainjector-68b757865b-c2jb8" Jun 03 14:00:15.898619 ip-10-0-134-229 kubenswrapper[2574]: I0603 14:00:15.898480 2574 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-tfjnd\" (UniqueName: \"kubernetes.io/projected/7f2ea9f5-2eff-41b8-af35-8b236220ca2c-kube-api-access-tfjnd\") pod \"cert-manager-cainjector-68b757865b-c2jb8\" (UID: \"7f2ea9f5-2eff-41b8-af35-8b236220ca2c\") " pod="cert-manager/cert-manager-cainjector-68b757865b-c2jb8" Jun 03 14:00:15.909246 ip-10-0-134-229 kubenswrapper[2574]: I0603 14:00:15.909215 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/7f2ea9f5-2eff-41b8-af35-8b236220ca2c-bound-sa-token\") pod \"cert-manager-cainjector-68b757865b-c2jb8\" (UID: \"7f2ea9f5-2eff-41b8-af35-8b236220ca2c\") " pod="cert-manager/cert-manager-cainjector-68b757865b-c2jb8" Jun 03 14:00:15.909444 ip-10-0-134-229 kubenswrapper[2574]: I0603 14:00:15.909425 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-tfjnd\" (UniqueName: \"kubernetes.io/projected/7f2ea9f5-2eff-41b8-af35-8b236220ca2c-kube-api-access-tfjnd\") pod \"cert-manager-cainjector-68b757865b-c2jb8\" (UID: \"7f2ea9f5-2eff-41b8-af35-8b236220ca2c\") " pod="cert-manager/cert-manager-cainjector-68b757865b-c2jb8" Jun 03 14:00:16.015422 ip-10-0-134-229 kubenswrapper[2574]: I0603 14:00:16.015339 2574 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager/cert-manager-cainjector-68b757865b-c2jb8" Jun 03 14:00:16.160943 ip-10-0-134-229 kubenswrapper[2574]: I0603 14:00:16.160906 2574 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["cert-manager/cert-manager-cainjector-68b757865b-c2jb8"] Jun 03 14:00:16.164048 ip-10-0-134-229 kubenswrapper[2574]: W0603 14:00:16.164017 2574 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod7f2ea9f5_2eff_41b8_af35_8b236220ca2c.slice/crio-6b91188dc9b017f9016626bcfda2c6662ada7a6b29801740a5d17ce44c483a56 WatchSource:0}: Error finding container 6b91188dc9b017f9016626bcfda2c6662ada7a6b29801740a5d17ce44c483a56: Status 404 returned error can't find the container with id 6b91188dc9b017f9016626bcfda2c6662ada7a6b29801740a5d17ce44c483a56 Jun 03 14:00:16.556025 ip-10-0-134-229 kubenswrapper[2574]: I0603 14:00:16.555985 2574 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="cert-manager/cert-manager-cainjector-68b757865b-c2jb8" event={"ID":"7f2ea9f5-2eff-41b8-af35-8b236220ca2c","Type":"ContainerStarted","Data":"6b91188dc9b017f9016626bcfda2c6662ada7a6b29801740a5d17ce44c483a56"} Jun 03 14:00:17.561049 ip-10-0-134-229 kubenswrapper[2574]: I0603 14:00:17.560962 2574 generic.go:358] "Generic (PLEG): container finished" podID="7d282cb6-74e4-46fa-84d5-d8791f795160" containerID="bdc7dc60a5225f1b0ba74632b7f2d0e38f68aed073a985f1f8adfede966073e3" exitCode=0 Jun 03 14:00:17.561489 ip-10-0-134-229 kubenswrapper[2574]: I0603 14:00:17.561086 2574 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fnlr85" event={"ID":"7d282cb6-74e4-46fa-84d5-d8791f795160","Type":"ContainerDied","Data":"bdc7dc60a5225f1b0ba74632b7f2d0e38f68aed073a985f1f8adfede966073e3"} Jun 03 14:00:18.565458 ip-10-0-134-229 kubenswrapper[2574]: I0603 14:00:18.565417 2574 generic.go:358] "Generic (PLEG): container finished" podID="7d282cb6-74e4-46fa-84d5-d8791f795160" containerID="c35920b476bc7e32650d047947ec23a7eef8ebc113d98b1ad744e3871526deb2" exitCode=0 Jun 03 14:00:18.565817 ip-10-0-134-229 kubenswrapper[2574]: I0603 14:00:18.565463 2574 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fnlr85" event={"ID":"7d282cb6-74e4-46fa-84d5-d8791f795160","Type":"ContainerDied","Data":"c35920b476bc7e32650d047947ec23a7eef8ebc113d98b1ad744e3871526deb2"} Jun 03 14:00:20.057756 ip-10-0-134-229 kubenswrapper[2574]: I0603 14:00:20.057713 2574 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["cert-manager/cert-manager-webhook-587ccfb98-lpq22"] Jun 03 14:00:20.063137 ip-10-0-134-229 kubenswrapper[2574]: I0603 14:00:20.063115 2574 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager/cert-manager-webhook-587ccfb98-lpq22" Jun 03 14:00:20.068009 ip-10-0-134-229 kubenswrapper[2574]: I0603 14:00:20.067987 2574 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"cert-manager\"/\"cert-manager-webhook-dockercfg-xtt2s\"" Jun 03 14:00:20.074154 ip-10-0-134-229 kubenswrapper[2574]: I0603 14:00:20.074131 2574 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["cert-manager/cert-manager-webhook-587ccfb98-lpq22"] Jun 03 14:00:20.135670 ip-10-0-134-229 kubenswrapper[2574]: I0603 14:00:20.135634 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-8mtpl\" (UniqueName: \"kubernetes.io/projected/20dfdb1f-140a-4296-a304-beac2ea06925-kube-api-access-8mtpl\") pod \"cert-manager-webhook-587ccfb98-lpq22\" (UID: \"20dfdb1f-140a-4296-a304-beac2ea06925\") " pod="cert-manager/cert-manager-webhook-587ccfb98-lpq22" Jun 03 14:00:20.135826 ip-10-0-134-229 kubenswrapper[2574]: I0603 14:00:20.135749 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/20dfdb1f-140a-4296-a304-beac2ea06925-bound-sa-token\") pod \"cert-manager-webhook-587ccfb98-lpq22\" (UID: \"20dfdb1f-140a-4296-a304-beac2ea06925\") " pod="cert-manager/cert-manager-webhook-587ccfb98-lpq22" Jun 03 14:00:20.209157 ip-10-0-134-229 kubenswrapper[2574]: I0603 14:00:20.209132 2574 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fnlr85" Jun 03 14:00:20.236708 ip-10-0-134-229 kubenswrapper[2574]: I0603 14:00:20.236678 2574 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-8zcff\" (UniqueName: \"kubernetes.io/projected/7d282cb6-74e4-46fa-84d5-d8791f795160-kube-api-access-8zcff\") pod \"7d282cb6-74e4-46fa-84d5-d8791f795160\" (UID: \"7d282cb6-74e4-46fa-84d5-d8791f795160\") " Jun 03 14:00:20.236868 ip-10-0-134-229 kubenswrapper[2574]: I0603 14:00:20.236725 2574 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/7d282cb6-74e4-46fa-84d5-d8791f795160-bundle\") pod \"7d282cb6-74e4-46fa-84d5-d8791f795160\" (UID: \"7d282cb6-74e4-46fa-84d5-d8791f795160\") " Jun 03 14:00:20.236868 ip-10-0-134-229 kubenswrapper[2574]: I0603 14:00:20.236765 2574 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/7d282cb6-74e4-46fa-84d5-d8791f795160-util\") pod \"7d282cb6-74e4-46fa-84d5-d8791f795160\" (UID: \"7d282cb6-74e4-46fa-84d5-d8791f795160\") " Jun 03 14:00:20.236998 ip-10-0-134-229 kubenswrapper[2574]: I0603 14:00:20.236926 2574 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-8mtpl\" (UniqueName: \"kubernetes.io/projected/20dfdb1f-140a-4296-a304-beac2ea06925-kube-api-access-8mtpl\") pod \"cert-manager-webhook-587ccfb98-lpq22\" (UID: \"20dfdb1f-140a-4296-a304-beac2ea06925\") " pod="cert-manager/cert-manager-webhook-587ccfb98-lpq22" Jun 03 14:00:20.237052 ip-10-0-134-229 kubenswrapper[2574]: I0603 14:00:20.236999 2574 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/20dfdb1f-140a-4296-a304-beac2ea06925-bound-sa-token\") pod \"cert-manager-webhook-587ccfb98-lpq22\" (UID: \"20dfdb1f-140a-4296-a304-beac2ea06925\") " pod="cert-manager/cert-manager-webhook-587ccfb98-lpq22" Jun 03 14:00:20.237242 ip-10-0-134-229 kubenswrapper[2574]: I0603 14:00:20.237217 2574 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/7d282cb6-74e4-46fa-84d5-d8791f795160-bundle" (OuterVolumeSpecName: "bundle") pod "7d282cb6-74e4-46fa-84d5-d8791f795160" (UID: "7d282cb6-74e4-46fa-84d5-d8791f795160"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jun 03 14:00:20.239218 ip-10-0-134-229 kubenswrapper[2574]: I0603 14:00:20.239188 2574 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/7d282cb6-74e4-46fa-84d5-d8791f795160-kube-api-access-8zcff" (OuterVolumeSpecName: "kube-api-access-8zcff") pod "7d282cb6-74e4-46fa-84d5-d8791f795160" (UID: "7d282cb6-74e4-46fa-84d5-d8791f795160"). InnerVolumeSpecName "kube-api-access-8zcff". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 03 14:00:20.241649 ip-10-0-134-229 kubenswrapper[2574]: I0603 14:00:20.241623 2574 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/7d282cb6-74e4-46fa-84d5-d8791f795160-util" (OuterVolumeSpecName: "util") pod "7d282cb6-74e4-46fa-84d5-d8791f795160" (UID: "7d282cb6-74e4-46fa-84d5-d8791f795160"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jun 03 14:00:20.246526 ip-10-0-134-229 kubenswrapper[2574]: I0603 14:00:20.246499 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/20dfdb1f-140a-4296-a304-beac2ea06925-bound-sa-token\") pod \"cert-manager-webhook-587ccfb98-lpq22\" (UID: \"20dfdb1f-140a-4296-a304-beac2ea06925\") " pod="cert-manager/cert-manager-webhook-587ccfb98-lpq22" Jun 03 14:00:20.246608 ip-10-0-134-229 kubenswrapper[2574]: I0603 14:00:20.246567 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-8mtpl\" (UniqueName: \"kubernetes.io/projected/20dfdb1f-140a-4296-a304-beac2ea06925-kube-api-access-8mtpl\") pod \"cert-manager-webhook-587ccfb98-lpq22\" (UID: \"20dfdb1f-140a-4296-a304-beac2ea06925\") " pod="cert-manager/cert-manager-webhook-587ccfb98-lpq22" Jun 03 14:00:20.337715 ip-10-0-134-229 kubenswrapper[2574]: I0603 14:00:20.337685 2574 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-8zcff\" (UniqueName: \"kubernetes.io/projected/7d282cb6-74e4-46fa-84d5-d8791f795160-kube-api-access-8zcff\") on node \"ip-10-0-134-229.ec2.internal\" DevicePath \"\"" Jun 03 14:00:20.337715 ip-10-0-134-229 kubenswrapper[2574]: I0603 14:00:20.337716 2574 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/7d282cb6-74e4-46fa-84d5-d8791f795160-bundle\") on node \"ip-10-0-134-229.ec2.internal\" DevicePath \"\"" Jun 03 14:00:20.337854 ip-10-0-134-229 kubenswrapper[2574]: I0603 14:00:20.337726 2574 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/7d282cb6-74e4-46fa-84d5-d8791f795160-util\") on node \"ip-10-0-134-229.ec2.internal\" DevicePath \"\"" Jun 03 14:00:20.373841 ip-10-0-134-229 kubenswrapper[2574]: I0603 14:00:20.373814 2574 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager/cert-manager-webhook-587ccfb98-lpq22" Jun 03 14:00:20.502434 ip-10-0-134-229 kubenswrapper[2574]: I0603 14:00:20.502407 2574 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["cert-manager/cert-manager-webhook-587ccfb98-lpq22"] Jun 03 14:00:20.505175 ip-10-0-134-229 kubenswrapper[2574]: W0603 14:00:20.505138 2574 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod20dfdb1f_140a_4296_a304_beac2ea06925.slice/crio-cec2d1c3a27a4411cfceb1e0630788c78b6a69db436a291ab4a90578ab137923 WatchSource:0}: Error finding container cec2d1c3a27a4411cfceb1e0630788c78b6a69db436a291ab4a90578ab137923: Status 404 returned error can't find the container with id cec2d1c3a27a4411cfceb1e0630788c78b6a69db436a291ab4a90578ab137923 Jun 03 14:00:20.573448 ip-10-0-134-229 kubenswrapper[2574]: I0603 14:00:20.573410 2574 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="cert-manager/cert-manager-cainjector-68b757865b-c2jb8" event={"ID":"7f2ea9f5-2eff-41b8-af35-8b236220ca2c","Type":"ContainerStarted","Data":"3ec58257afa3cbf18b9f9efd989b4204005f244bb0c5b28510095495ac122732"} Jun 03 14:00:20.575202 ip-10-0-134-229 kubenswrapper[2574]: I0603 14:00:20.575180 2574 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fnlr85" Jun 03 14:00:20.575299 ip-10-0-134-229 kubenswrapper[2574]: I0603 14:00:20.575182 2574 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fnlr85" event={"ID":"7d282cb6-74e4-46fa-84d5-d8791f795160","Type":"ContainerDied","Data":"4d50df02029c33727e02b4dada074bbc371bb534e5788e533303079a13da96c4"} Jun 03 14:00:20.575299 ip-10-0-134-229 kubenswrapper[2574]: I0603 14:00:20.575284 2574 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="4d50df02029c33727e02b4dada074bbc371bb534e5788e533303079a13da96c4" Jun 03 14:00:20.576614 ip-10-0-134-229 kubenswrapper[2574]: I0603 14:00:20.576594 2574 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="cert-manager/cert-manager-webhook-587ccfb98-lpq22" event={"ID":"20dfdb1f-140a-4296-a304-beac2ea06925","Type":"ContainerStarted","Data":"cec2d1c3a27a4411cfceb1e0630788c78b6a69db436a291ab4a90578ab137923"} Jun 03 14:00:20.576726 ip-10-0-134-229 kubenswrapper[2574]: I0603 14:00:20.576712 2574 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="cert-manager/cert-manager-webhook-587ccfb98-lpq22" Jun 03 14:00:20.632324 ip-10-0-134-229 kubenswrapper[2574]: I0603 14:00:20.632273 2574 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="cert-manager/cert-manager-cainjector-68b757865b-c2jb8" podStartSLOduration=1.538253082 podStartE2EDuration="5.632256979s" podCreationTimestamp="2026-06-03 14:00:15 +0000 UTC" firstStartedPulling="2026-06-03 14:00:16.16703283 +0000 UTC m=+377.351040136" lastFinishedPulling="2026-06-03 14:00:20.261036719 +0000 UTC m=+381.445044033" observedRunningTime="2026-06-03 14:00:20.630997249 +0000 UTC m=+381.815004577" watchObservedRunningTime="2026-06-03 14:00:20.632256979 +0000 UTC m=+381.816264307" Jun 03 14:00:20.672188 ip-10-0-134-229 kubenswrapper[2574]: I0603 14:00:20.672124 2574 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="cert-manager/cert-manager-webhook-587ccfb98-lpq22" podStartSLOduration=0.672109036 podStartE2EDuration="672.109036ms" podCreationTimestamp="2026-06-03 14:00:20 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2026-06-03 14:00:20.670443351 +0000 UTC m=+381.854450683" watchObservedRunningTime="2026-06-03 14:00:20.672109036 +0000 UTC m=+381.856116364" Jun 03 14:00:21.580714 ip-10-0-134-229 kubenswrapper[2574]: I0603 14:00:21.580672 2574 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="cert-manager/cert-manager-webhook-587ccfb98-lpq22" event={"ID":"20dfdb1f-140a-4296-a304-beac2ea06925","Type":"ContainerStarted","Data":"74786b2972bde5b2dbafabed69b7c3e6ab8998f4fc69974f613c070a9dc68c5e"} Jun 03 14:00:27.586997 ip-10-0-134-229 kubenswrapper[2574]: I0603 14:00:27.586960 2574 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="cert-manager/cert-manager-webhook-587ccfb98-lpq22" Jun 03 14:00:33.894474 ip-10-0-134-229 kubenswrapper[2574]: I0603 14:00:33.894438 2574 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-marketplace/410e69f41462d9d02a48f76ad929b5f41ed146182df7ab38cf9ce4e1cd5p22p"] Jun 03 14:00:33.894912 ip-10-0-134-229 kubenswrapper[2574]: I0603 14:00:33.894721 2574 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="7d282cb6-74e4-46fa-84d5-d8791f795160" containerName="pull" Jun 03 14:00:33.894912 ip-10-0-134-229 kubenswrapper[2574]: I0603 14:00:33.894732 2574 state_mem.go:107] "Deleted CPUSet assignment" podUID="7d282cb6-74e4-46fa-84d5-d8791f795160" containerName="pull" Jun 03 14:00:33.894912 ip-10-0-134-229 kubenswrapper[2574]: I0603 14:00:33.894757 2574 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="7d282cb6-74e4-46fa-84d5-d8791f795160" containerName="util" Jun 03 14:00:33.894912 ip-10-0-134-229 kubenswrapper[2574]: I0603 14:00:33.894763 2574 state_mem.go:107] "Deleted CPUSet assignment" podUID="7d282cb6-74e4-46fa-84d5-d8791f795160" containerName="util" Jun 03 14:00:33.894912 ip-10-0-134-229 kubenswrapper[2574]: I0603 14:00:33.894776 2574 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="7d282cb6-74e4-46fa-84d5-d8791f795160" containerName="extract" Jun 03 14:00:33.894912 ip-10-0-134-229 kubenswrapper[2574]: I0603 14:00:33.894782 2574 state_mem.go:107] "Deleted CPUSet assignment" podUID="7d282cb6-74e4-46fa-84d5-d8791f795160" containerName="extract" Jun 03 14:00:33.894912 ip-10-0-134-229 kubenswrapper[2574]: I0603 14:00:33.894845 2574 memory_manager.go:356] "RemoveStaleState removing state" podUID="7d282cb6-74e4-46fa-84d5-d8791f795160" containerName="extract" Jun 03 14:00:33.904890 ip-10-0-134-229 kubenswrapper[2574]: I0603 14:00:33.904865 2574 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/410e69f41462d9d02a48f76ad929b5f41ed146182df7ab38cf9ce4e1cd5p22p" Jun 03 14:00:33.905913 ip-10-0-134-229 kubenswrapper[2574]: I0603 14:00:33.905888 2574 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/410e69f41462d9d02a48f76ad929b5f41ed146182df7ab38cf9ce4e1cd5p22p"] Jun 03 14:00:33.907656 ip-10-0-134-229 kubenswrapper[2574]: I0603 14:00:33.907610 2574 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"openshift-service-ca.crt\"" Jun 03 14:00:33.907656 ip-10-0-134-229 kubenswrapper[2574]: I0603 14:00:33.907624 2574 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"kube-root-ca.crt\"" Jun 03 14:00:33.908333 ip-10-0-134-229 kubenswrapper[2574]: I0603 14:00:33.908317 2574 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-marketplace\"/\"default-dockercfg-h5qff\"" Jun 03 14:00:33.938864 ip-10-0-134-229 kubenswrapper[2574]: I0603 14:00:33.938831 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/11983bcf-7183-41ae-964b-ae40affae5cb-bundle\") pod \"410e69f41462d9d02a48f76ad929b5f41ed146182df7ab38cf9ce4e1cd5p22p\" (UID: \"11983bcf-7183-41ae-964b-ae40affae5cb\") " pod="openshift-marketplace/410e69f41462d9d02a48f76ad929b5f41ed146182df7ab38cf9ce4e1cd5p22p" Jun 03 14:00:33.938984 ip-10-0-134-229 kubenswrapper[2574]: I0603 14:00:33.938868 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/11983bcf-7183-41ae-964b-ae40affae5cb-util\") pod \"410e69f41462d9d02a48f76ad929b5f41ed146182df7ab38cf9ce4e1cd5p22p\" (UID: \"11983bcf-7183-41ae-964b-ae40affae5cb\") " pod="openshift-marketplace/410e69f41462d9d02a48f76ad929b5f41ed146182df7ab38cf9ce4e1cd5p22p" Jun 03 14:00:33.938984 ip-10-0-134-229 kubenswrapper[2574]: I0603 14:00:33.938896 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-h2rpj\" (UniqueName: \"kubernetes.io/projected/11983bcf-7183-41ae-964b-ae40affae5cb-kube-api-access-h2rpj\") pod \"410e69f41462d9d02a48f76ad929b5f41ed146182df7ab38cf9ce4e1cd5p22p\" (UID: \"11983bcf-7183-41ae-964b-ae40affae5cb\") " pod="openshift-marketplace/410e69f41462d9d02a48f76ad929b5f41ed146182df7ab38cf9ce4e1cd5p22p" Jun 03 14:00:34.040154 ip-10-0-134-229 kubenswrapper[2574]: I0603 14:00:34.040119 2574 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/11983bcf-7183-41ae-964b-ae40affae5cb-bundle\") pod \"410e69f41462d9d02a48f76ad929b5f41ed146182df7ab38cf9ce4e1cd5p22p\" (UID: \"11983bcf-7183-41ae-964b-ae40affae5cb\") " pod="openshift-marketplace/410e69f41462d9d02a48f76ad929b5f41ed146182df7ab38cf9ce4e1cd5p22p" Jun 03 14:00:34.040154 ip-10-0-134-229 kubenswrapper[2574]: I0603 14:00:34.040152 2574 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/11983bcf-7183-41ae-964b-ae40affae5cb-util\") pod \"410e69f41462d9d02a48f76ad929b5f41ed146182df7ab38cf9ce4e1cd5p22p\" (UID: \"11983bcf-7183-41ae-964b-ae40affae5cb\") " pod="openshift-marketplace/410e69f41462d9d02a48f76ad929b5f41ed146182df7ab38cf9ce4e1cd5p22p" Jun 03 14:00:34.040400 ip-10-0-134-229 kubenswrapper[2574]: I0603 14:00:34.040172 2574 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-h2rpj\" (UniqueName: \"kubernetes.io/projected/11983bcf-7183-41ae-964b-ae40affae5cb-kube-api-access-h2rpj\") pod \"410e69f41462d9d02a48f76ad929b5f41ed146182df7ab38cf9ce4e1cd5p22p\" (UID: \"11983bcf-7183-41ae-964b-ae40affae5cb\") " pod="openshift-marketplace/410e69f41462d9d02a48f76ad929b5f41ed146182df7ab38cf9ce4e1cd5p22p" Jun 03 14:00:34.040588 ip-10-0-134-229 kubenswrapper[2574]: I0603 14:00:34.040565 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/11983bcf-7183-41ae-964b-ae40affae5cb-bundle\") pod \"410e69f41462d9d02a48f76ad929b5f41ed146182df7ab38cf9ce4e1cd5p22p\" (UID: \"11983bcf-7183-41ae-964b-ae40affae5cb\") " pod="openshift-marketplace/410e69f41462d9d02a48f76ad929b5f41ed146182df7ab38cf9ce4e1cd5p22p" Jun 03 14:00:34.040656 ip-10-0-134-229 kubenswrapper[2574]: I0603 14:00:34.040600 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/11983bcf-7183-41ae-964b-ae40affae5cb-util\") pod \"410e69f41462d9d02a48f76ad929b5f41ed146182df7ab38cf9ce4e1cd5p22p\" (UID: \"11983bcf-7183-41ae-964b-ae40affae5cb\") " pod="openshift-marketplace/410e69f41462d9d02a48f76ad929b5f41ed146182df7ab38cf9ce4e1cd5p22p" Jun 03 14:00:34.048862 ip-10-0-134-229 kubenswrapper[2574]: I0603 14:00:34.048841 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-h2rpj\" (UniqueName: \"kubernetes.io/projected/11983bcf-7183-41ae-964b-ae40affae5cb-kube-api-access-h2rpj\") pod \"410e69f41462d9d02a48f76ad929b5f41ed146182df7ab38cf9ce4e1cd5p22p\" (UID: \"11983bcf-7183-41ae-964b-ae40affae5cb\") " pod="openshift-marketplace/410e69f41462d9d02a48f76ad929b5f41ed146182df7ab38cf9ce4e1cd5p22p" Jun 03 14:00:34.216271 ip-10-0-134-229 kubenswrapper[2574]: I0603 14:00:34.216197 2574 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/410e69f41462d9d02a48f76ad929b5f41ed146182df7ab38cf9ce4e1cd5p22p" Jun 03 14:00:34.351485 ip-10-0-134-229 kubenswrapper[2574]: I0603 14:00:34.351455 2574 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/410e69f41462d9d02a48f76ad929b5f41ed146182df7ab38cf9ce4e1cd5p22p"] Jun 03 14:00:34.353283 ip-10-0-134-229 kubenswrapper[2574]: W0603 14:00:34.353248 2574 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod11983bcf_7183_41ae_964b_ae40affae5cb.slice/crio-a5a81ee0740a08ab3b10410b3aad6383e86793a768ee129f8318b293fa400c77 WatchSource:0}: Error finding container a5a81ee0740a08ab3b10410b3aad6383e86793a768ee129f8318b293fa400c77: Status 404 returned error can't find the container with id a5a81ee0740a08ab3b10410b3aad6383e86793a768ee129f8318b293fa400c77 Jun 03 14:00:34.622646 ip-10-0-134-229 kubenswrapper[2574]: I0603 14:00:34.622613 2574 generic.go:358] "Generic (PLEG): container finished" podID="11983bcf-7183-41ae-964b-ae40affae5cb" containerID="309d06693cf6b4f80ec1cc79288efc940ac66ab5e2ae8480e1c354f14eea2fa2" exitCode=0 Jun 03 14:00:34.622808 ip-10-0-134-229 kubenswrapper[2574]: I0603 14:00:34.622699 2574 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/410e69f41462d9d02a48f76ad929b5f41ed146182df7ab38cf9ce4e1cd5p22p" event={"ID":"11983bcf-7183-41ae-964b-ae40affae5cb","Type":"ContainerDied","Data":"309d06693cf6b4f80ec1cc79288efc940ac66ab5e2ae8480e1c354f14eea2fa2"} Jun 03 14:00:34.622808 ip-10-0-134-229 kubenswrapper[2574]: I0603 14:00:34.622739 2574 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/410e69f41462d9d02a48f76ad929b5f41ed146182df7ab38cf9ce4e1cd5p22p" event={"ID":"11983bcf-7183-41ae-964b-ae40affae5cb","Type":"ContainerStarted","Data":"a5a81ee0740a08ab3b10410b3aad6383e86793a768ee129f8318b293fa400c77"} Jun 03 14:00:35.628034 ip-10-0-134-229 kubenswrapper[2574]: I0603 14:00:35.628004 2574 generic.go:358] "Generic (PLEG): container finished" podID="11983bcf-7183-41ae-964b-ae40affae5cb" containerID="e275d4e2aca0ab90cad0c211f412eb66d0104ab0279bd1e31f446581f766c698" exitCode=0 Jun 03 14:00:35.628392 ip-10-0-134-229 kubenswrapper[2574]: I0603 14:00:35.628046 2574 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/410e69f41462d9d02a48f76ad929b5f41ed146182df7ab38cf9ce4e1cd5p22p" event={"ID":"11983bcf-7183-41ae-964b-ae40affae5cb","Type":"ContainerDied","Data":"e275d4e2aca0ab90cad0c211f412eb66d0104ab0279bd1e31f446581f766c698"} Jun 03 14:00:36.638732 ip-10-0-134-229 kubenswrapper[2574]: I0603 14:00:36.638698 2574 generic.go:358] "Generic (PLEG): container finished" podID="11983bcf-7183-41ae-964b-ae40affae5cb" containerID="ed9103296bcc734f395b6a42b138d6b6b523d4e75683b7ea774c610e6c607f5b" exitCode=0 Jun 03 14:00:36.639084 ip-10-0-134-229 kubenswrapper[2574]: I0603 14:00:36.638766 2574 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/410e69f41462d9d02a48f76ad929b5f41ed146182df7ab38cf9ce4e1cd5p22p" event={"ID":"11983bcf-7183-41ae-964b-ae40affae5cb","Type":"ContainerDied","Data":"ed9103296bcc734f395b6a42b138d6b6b523d4e75683b7ea774c610e6c607f5b"} Jun 03 14:00:37.760964 ip-10-0-134-229 kubenswrapper[2574]: I0603 14:00:37.760940 2574 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/410e69f41462d9d02a48f76ad929b5f41ed146182df7ab38cf9ce4e1cd5p22p" Jun 03 14:00:37.872131 ip-10-0-134-229 kubenswrapper[2574]: I0603 14:00:37.872086 2574 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/11983bcf-7183-41ae-964b-ae40affae5cb-util\") pod \"11983bcf-7183-41ae-964b-ae40affae5cb\" (UID: \"11983bcf-7183-41ae-964b-ae40affae5cb\") " Jun 03 14:00:37.872131 ip-10-0-134-229 kubenswrapper[2574]: I0603 14:00:37.872135 2574 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-h2rpj\" (UniqueName: \"kubernetes.io/projected/11983bcf-7183-41ae-964b-ae40affae5cb-kube-api-access-h2rpj\") pod \"11983bcf-7183-41ae-964b-ae40affae5cb\" (UID: \"11983bcf-7183-41ae-964b-ae40affae5cb\") " Jun 03 14:00:37.872405 ip-10-0-134-229 kubenswrapper[2574]: I0603 14:00:37.872163 2574 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/11983bcf-7183-41ae-964b-ae40affae5cb-bundle\") pod \"11983bcf-7183-41ae-964b-ae40affae5cb\" (UID: \"11983bcf-7183-41ae-964b-ae40affae5cb\") " Jun 03 14:00:37.872870 ip-10-0-134-229 kubenswrapper[2574]: I0603 14:00:37.872847 2574 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/11983bcf-7183-41ae-964b-ae40affae5cb-bundle" (OuterVolumeSpecName: "bundle") pod "11983bcf-7183-41ae-964b-ae40affae5cb" (UID: "11983bcf-7183-41ae-964b-ae40affae5cb"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jun 03 14:00:37.874235 ip-10-0-134-229 kubenswrapper[2574]: I0603 14:00:37.874210 2574 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/11983bcf-7183-41ae-964b-ae40affae5cb-kube-api-access-h2rpj" (OuterVolumeSpecName: "kube-api-access-h2rpj") pod "11983bcf-7183-41ae-964b-ae40affae5cb" (UID: "11983bcf-7183-41ae-964b-ae40affae5cb"). InnerVolumeSpecName "kube-api-access-h2rpj". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 03 14:00:37.877835 ip-10-0-134-229 kubenswrapper[2574]: I0603 14:00:37.877803 2574 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/11983bcf-7183-41ae-964b-ae40affae5cb-util" (OuterVolumeSpecName: "util") pod "11983bcf-7183-41ae-964b-ae40affae5cb" (UID: "11983bcf-7183-41ae-964b-ae40affae5cb"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jun 03 14:00:37.973351 ip-10-0-134-229 kubenswrapper[2574]: I0603 14:00:37.973283 2574 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/11983bcf-7183-41ae-964b-ae40affae5cb-util\") on node \"ip-10-0-134-229.ec2.internal\" DevicePath \"\"" Jun 03 14:00:37.973351 ip-10-0-134-229 kubenswrapper[2574]: I0603 14:00:37.973308 2574 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-h2rpj\" (UniqueName: \"kubernetes.io/projected/11983bcf-7183-41ae-964b-ae40affae5cb-kube-api-access-h2rpj\") on node \"ip-10-0-134-229.ec2.internal\" DevicePath \"\"" Jun 03 14:00:37.973351 ip-10-0-134-229 kubenswrapper[2574]: I0603 14:00:37.973319 2574 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/11983bcf-7183-41ae-964b-ae40affae5cb-bundle\") on node \"ip-10-0-134-229.ec2.internal\" DevicePath \"\"" Jun 03 14:00:38.646546 ip-10-0-134-229 kubenswrapper[2574]: I0603 14:00:38.646511 2574 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/410e69f41462d9d02a48f76ad929b5f41ed146182df7ab38cf9ce4e1cd5p22p" event={"ID":"11983bcf-7183-41ae-964b-ae40affae5cb","Type":"ContainerDied","Data":"a5a81ee0740a08ab3b10410b3aad6383e86793a768ee129f8318b293fa400c77"} Jun 03 14:00:38.646546 ip-10-0-134-229 kubenswrapper[2574]: I0603 14:00:38.646546 2574 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="a5a81ee0740a08ab3b10410b3aad6383e86793a768ee129f8318b293fa400c77" Jun 03 14:00:38.646546 ip-10-0-134-229 kubenswrapper[2574]: I0603 14:00:38.646520 2574 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/410e69f41462d9d02a48f76ad929b5f41ed146182df7ab38cf9ce4e1cd5p22p" Jun 03 14:00:40.773636 ip-10-0-134-229 kubenswrapper[2574]: I0603 14:00:40.773604 2574 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-lws-operator/lws-controller-manager-6557d5d46d-dnfph"] Jun 03 14:00:40.773994 ip-10-0-134-229 kubenswrapper[2574]: I0603 14:00:40.773905 2574 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="11983bcf-7183-41ae-964b-ae40affae5cb" containerName="util" Jun 03 14:00:40.773994 ip-10-0-134-229 kubenswrapper[2574]: I0603 14:00:40.773919 2574 state_mem.go:107] "Deleted CPUSet assignment" podUID="11983bcf-7183-41ae-964b-ae40affae5cb" containerName="util" Jun 03 14:00:40.773994 ip-10-0-134-229 kubenswrapper[2574]: I0603 14:00:40.773927 2574 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="11983bcf-7183-41ae-964b-ae40affae5cb" containerName="pull" Jun 03 14:00:40.773994 ip-10-0-134-229 kubenswrapper[2574]: I0603 14:00:40.773933 2574 state_mem.go:107] "Deleted CPUSet assignment" podUID="11983bcf-7183-41ae-964b-ae40affae5cb" containerName="pull" Jun 03 14:00:40.773994 ip-10-0-134-229 kubenswrapper[2574]: I0603 14:00:40.773945 2574 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="11983bcf-7183-41ae-964b-ae40affae5cb" containerName="extract" Jun 03 14:00:40.773994 ip-10-0-134-229 kubenswrapper[2574]: I0603 14:00:40.773952 2574 state_mem.go:107] "Deleted CPUSet assignment" podUID="11983bcf-7183-41ae-964b-ae40affae5cb" containerName="extract" Jun 03 14:00:40.774166 ip-10-0-134-229 kubenswrapper[2574]: I0603 14:00:40.774009 2574 memory_manager.go:356] "RemoveStaleState removing state" podUID="11983bcf-7183-41ae-964b-ae40affae5cb" containerName="extract" Jun 03 14:00:40.776293 ip-10-0-134-229 kubenswrapper[2574]: I0603 14:00:40.776277 2574 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-lws-operator/lws-controller-manager-6557d5d46d-dnfph" Jun 03 14:00:40.779588 ip-10-0-134-229 kubenswrapper[2574]: I0603 14:00:40.779564 2574 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-lws-operator\"/\"kube-root-ca.crt\"" Jun 03 14:00:40.781011 ip-10-0-134-229 kubenswrapper[2574]: I0603 14:00:40.780995 2574 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-lws-operator\"/\"openshift-service-ca.crt\"" Jun 03 14:00:40.781552 ip-10-0-134-229 kubenswrapper[2574]: I0603 14:00:40.781535 2574 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-lws-operator\"/\"webhook-server-cert\"" Jun 03 14:00:40.781636 ip-10-0-134-229 kubenswrapper[2574]: I0603 14:00:40.781560 2574 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-lws-operator\"/\"lws-controller-manager-dockercfg-g87bd\"" Jun 03 14:00:40.781636 ip-10-0-134-229 kubenswrapper[2574]: I0603 14:00:40.781607 2574 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-lws-operator\"/\"metrics-server-cert\"" Jun 03 14:00:40.781750 ip-10-0-134-229 kubenswrapper[2574]: I0603 14:00:40.781631 2574 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-lws-operator\"/\"lws-manager-config\"" Jun 03 14:00:40.796734 ip-10-0-134-229 kubenswrapper[2574]: I0603 14:00:40.796711 2574 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-lws-operator/lws-controller-manager-6557d5d46d-dnfph"] Jun 03 14:00:40.895319 ip-10-0-134-229 kubenswrapper[2574]: I0603 14:00:40.895287 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"manager-config\" (UniqueName: \"kubernetes.io/configmap/593c0d82-e227-4084-9a6c-8727d166bd69-manager-config\") pod \"lws-controller-manager-6557d5d46d-dnfph\" (UID: \"593c0d82-e227-4084-9a6c-8727d166bd69\") " pod="openshift-lws-operator/lws-controller-manager-6557d5d46d-dnfph" Jun 03 14:00:40.895319 ip-10-0-134-229 kubenswrapper[2574]: I0603 14:00:40.895322 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-cert\" (UniqueName: \"kubernetes.io/secret/593c0d82-e227-4084-9a6c-8727d166bd69-metrics-cert\") pod \"lws-controller-manager-6557d5d46d-dnfph\" (UID: \"593c0d82-e227-4084-9a6c-8727d166bd69\") " pod="openshift-lws-operator/lws-controller-manager-6557d5d46d-dnfph" Jun 03 14:00:40.895522 ip-10-0-134-229 kubenswrapper[2574]: I0603 14:00:40.895352 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/593c0d82-e227-4084-9a6c-8727d166bd69-cert\") pod \"lws-controller-manager-6557d5d46d-dnfph\" (UID: \"593c0d82-e227-4084-9a6c-8727d166bd69\") " pod="openshift-lws-operator/lws-controller-manager-6557d5d46d-dnfph" Jun 03 14:00:40.895522 ip-10-0-134-229 kubenswrapper[2574]: I0603 14:00:40.895441 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-7tf4z\" (UniqueName: \"kubernetes.io/projected/593c0d82-e227-4084-9a6c-8727d166bd69-kube-api-access-7tf4z\") pod \"lws-controller-manager-6557d5d46d-dnfph\" (UID: \"593c0d82-e227-4084-9a6c-8727d166bd69\") " pod="openshift-lws-operator/lws-controller-manager-6557d5d46d-dnfph" Jun 03 14:00:40.996688 ip-10-0-134-229 kubenswrapper[2574]: I0603 14:00:40.996647 2574 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/593c0d82-e227-4084-9a6c-8727d166bd69-cert\") pod \"lws-controller-manager-6557d5d46d-dnfph\" (UID: \"593c0d82-e227-4084-9a6c-8727d166bd69\") " pod="openshift-lws-operator/lws-controller-manager-6557d5d46d-dnfph" Jun 03 14:00:40.996688 ip-10-0-134-229 kubenswrapper[2574]: I0603 14:00:40.996688 2574 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-7tf4z\" (UniqueName: \"kubernetes.io/projected/593c0d82-e227-4084-9a6c-8727d166bd69-kube-api-access-7tf4z\") pod \"lws-controller-manager-6557d5d46d-dnfph\" (UID: \"593c0d82-e227-4084-9a6c-8727d166bd69\") " pod="openshift-lws-operator/lws-controller-manager-6557d5d46d-dnfph" Jun 03 14:00:40.996914 ip-10-0-134-229 kubenswrapper[2574]: I0603 14:00:40.996763 2574 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"manager-config\" (UniqueName: \"kubernetes.io/configmap/593c0d82-e227-4084-9a6c-8727d166bd69-manager-config\") pod \"lws-controller-manager-6557d5d46d-dnfph\" (UID: \"593c0d82-e227-4084-9a6c-8727d166bd69\") " pod="openshift-lws-operator/lws-controller-manager-6557d5d46d-dnfph" Jun 03 14:00:40.996914 ip-10-0-134-229 kubenswrapper[2574]: I0603 14:00:40.996793 2574 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-cert\" (UniqueName: \"kubernetes.io/secret/593c0d82-e227-4084-9a6c-8727d166bd69-metrics-cert\") pod \"lws-controller-manager-6557d5d46d-dnfph\" (UID: \"593c0d82-e227-4084-9a6c-8727d166bd69\") " pod="openshift-lws-operator/lws-controller-manager-6557d5d46d-dnfph" Jun 03 14:00:40.997631 ip-10-0-134-229 kubenswrapper[2574]: I0603 14:00:40.997600 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"manager-config\" (UniqueName: \"kubernetes.io/configmap/593c0d82-e227-4084-9a6c-8727d166bd69-manager-config\") pod \"lws-controller-manager-6557d5d46d-dnfph\" (UID: \"593c0d82-e227-4084-9a6c-8727d166bd69\") " pod="openshift-lws-operator/lws-controller-manager-6557d5d46d-dnfph" Jun 03 14:00:40.999136 ip-10-0-134-229 kubenswrapper[2574]: I0603 14:00:40.999106 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-cert\" (UniqueName: \"kubernetes.io/secret/593c0d82-e227-4084-9a6c-8727d166bd69-metrics-cert\") pod \"lws-controller-manager-6557d5d46d-dnfph\" (UID: \"593c0d82-e227-4084-9a6c-8727d166bd69\") " pod="openshift-lws-operator/lws-controller-manager-6557d5d46d-dnfph" Jun 03 14:00:40.999252 ip-10-0-134-229 kubenswrapper[2574]: I0603 14:00:40.999208 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/593c0d82-e227-4084-9a6c-8727d166bd69-cert\") pod \"lws-controller-manager-6557d5d46d-dnfph\" (UID: \"593c0d82-e227-4084-9a6c-8727d166bd69\") " pod="openshift-lws-operator/lws-controller-manager-6557d5d46d-dnfph" Jun 03 14:00:41.006010 ip-10-0-134-229 kubenswrapper[2574]: I0603 14:00:41.005989 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-7tf4z\" (UniqueName: \"kubernetes.io/projected/593c0d82-e227-4084-9a6c-8727d166bd69-kube-api-access-7tf4z\") pod \"lws-controller-manager-6557d5d46d-dnfph\" (UID: \"593c0d82-e227-4084-9a6c-8727d166bd69\") " pod="openshift-lws-operator/lws-controller-manager-6557d5d46d-dnfph" Jun 03 14:00:41.085834 ip-10-0-134-229 kubenswrapper[2574]: I0603 14:00:41.085769 2574 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-lws-operator/lws-controller-manager-6557d5d46d-dnfph" Jun 03 14:00:41.222572 ip-10-0-134-229 kubenswrapper[2574]: I0603 14:00:41.222549 2574 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-lws-operator/lws-controller-manager-6557d5d46d-dnfph"] Jun 03 14:00:41.224666 ip-10-0-134-229 kubenswrapper[2574]: W0603 14:00:41.224637 2574 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod593c0d82_e227_4084_9a6c_8727d166bd69.slice/crio-c3608301f1959a6e92ab710d48066d4b0a3f1634ec9cadd1042980579528e857 WatchSource:0}: Error finding container c3608301f1959a6e92ab710d48066d4b0a3f1634ec9cadd1042980579528e857: Status 404 returned error can't find the container with id c3608301f1959a6e92ab710d48066d4b0a3f1634ec9cadd1042980579528e857 Jun 03 14:00:41.657002 ip-10-0-134-229 kubenswrapper[2574]: I0603 14:00:41.656965 2574 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-lws-operator/lws-controller-manager-6557d5d46d-dnfph" event={"ID":"593c0d82-e227-4084-9a6c-8727d166bd69","Type":"ContainerStarted","Data":"c3608301f1959a6e92ab710d48066d4b0a3f1634ec9cadd1042980579528e857"} Jun 03 14:00:44.668188 ip-10-0-134-229 kubenswrapper[2574]: I0603 14:00:44.668151 2574 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-lws-operator/lws-controller-manager-6557d5d46d-dnfph" event={"ID":"593c0d82-e227-4084-9a6c-8727d166bd69","Type":"ContainerStarted","Data":"38a57c0c3abe75cead312b183755bf9eca2393a3be0a92415b62de209a0a2ded"} Jun 03 14:00:44.668617 ip-10-0-134-229 kubenswrapper[2574]: I0603 14:00:44.668299 2574 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-lws-operator/lws-controller-manager-6557d5d46d-dnfph" Jun 03 14:00:44.685453 ip-10-0-134-229 kubenswrapper[2574]: I0603 14:00:44.685408 2574 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-lws-operator/lws-controller-manager-6557d5d46d-dnfph" podStartSLOduration=1.430236721 podStartE2EDuration="4.685394644s" podCreationTimestamp="2026-06-03 14:00:40 +0000 UTC" firstStartedPulling="2026-06-03 14:00:41.226523367 +0000 UTC m=+402.410530674" lastFinishedPulling="2026-06-03 14:00:44.481681289 +0000 UTC m=+405.665688597" observedRunningTime="2026-06-03 14:00:44.683554535 +0000 UTC m=+405.867561864" watchObservedRunningTime="2026-06-03 14:00:44.685394644 +0000 UTC m=+405.869402042" Jun 03 14:00:48.141749 ip-10-0-134-229 kubenswrapper[2574]: I0603 14:00:48.141710 2574 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-7c68786f4b-5tcpg"] Jun 03 14:00:48.146000 ip-10-0-134-229 kubenswrapper[2574]: I0603 14:00:48.145967 2574 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/opendatahub-operator-controller-manager-7c68786f4b-5tcpg" Jun 03 14:00:48.148534 ip-10-0-134-229 kubenswrapper[2574]: I0603 14:00:48.148513 2574 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-webhook-cert\"" Jun 03 14:00:48.148745 ip-10-0-134-229 kubenswrapper[2574]: I0603 14:00:48.148720 2574 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-manager-dockercfg-t5bnl\"" Jun 03 14:00:48.148802 ip-10-0-134-229 kubenswrapper[2574]: I0603 14:00:48.148771 2574 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"kube-root-ca.crt\"" Jun 03 14:00:48.148847 ip-10-0-134-229 kubenswrapper[2574]: I0603 14:00:48.148731 2574 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"openshift-service-ca.crt\"" Jun 03 14:00:48.148965 ip-10-0-134-229 kubenswrapper[2574]: I0603 14:00:48.148951 2574 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-manager-service-cert\"" Jun 03 14:00:48.160817 ip-10-0-134-229 kubenswrapper[2574]: I0603 14:00:48.160792 2574 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-7c68786f4b-5tcpg"] Jun 03 14:00:48.256086 ip-10-0-134-229 kubenswrapper[2574]: I0603 14:00:48.256054 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/676d002f-1298-4f7a-b2ee-dc943106f1d9-manifests\") pod \"opendatahub-operator-controller-manager-7c68786f4b-5tcpg\" (UID: \"676d002f-1298-4f7a-b2ee-dc943106f1d9\") " pod="opendatahub/opendatahub-operator-controller-manager-7c68786f4b-5tcpg" Jun 03 14:00:48.256219 ip-10-0-134-229 kubenswrapper[2574]: I0603 14:00:48.256100 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/676d002f-1298-4f7a-b2ee-dc943106f1d9-apiservice-cert\") pod \"opendatahub-operator-controller-manager-7c68786f4b-5tcpg\" (UID: \"676d002f-1298-4f7a-b2ee-dc943106f1d9\") " pod="opendatahub/opendatahub-operator-controller-manager-7c68786f4b-5tcpg" Jun 03 14:00:48.256219 ip-10-0-134-229 kubenswrapper[2574]: I0603 14:00:48.256126 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/676d002f-1298-4f7a-b2ee-dc943106f1d9-webhook-cert\") pod \"opendatahub-operator-controller-manager-7c68786f4b-5tcpg\" (UID: \"676d002f-1298-4f7a-b2ee-dc943106f1d9\") " pod="opendatahub/opendatahub-operator-controller-manager-7c68786f4b-5tcpg" Jun 03 14:00:48.256219 ip-10-0-134-229 kubenswrapper[2574]: I0603 14:00:48.256143 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/676d002f-1298-4f7a-b2ee-dc943106f1d9-tmp\") pod \"opendatahub-operator-controller-manager-7c68786f4b-5tcpg\" (UID: \"676d002f-1298-4f7a-b2ee-dc943106f1d9\") " pod="opendatahub/opendatahub-operator-controller-manager-7c68786f4b-5tcpg" Jun 03 14:00:48.256219 ip-10-0-134-229 kubenswrapper[2574]: I0603 14:00:48.256162 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-nrmsn\" (UniqueName: \"kubernetes.io/projected/676d002f-1298-4f7a-b2ee-dc943106f1d9-kube-api-access-nrmsn\") pod \"opendatahub-operator-controller-manager-7c68786f4b-5tcpg\" (UID: \"676d002f-1298-4f7a-b2ee-dc943106f1d9\") " pod="opendatahub/opendatahub-operator-controller-manager-7c68786f4b-5tcpg" Jun 03 14:00:48.356561 ip-10-0-134-229 kubenswrapper[2574]: I0603 14:00:48.356520 2574 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/676d002f-1298-4f7a-b2ee-dc943106f1d9-manifests\") pod \"opendatahub-operator-controller-manager-7c68786f4b-5tcpg\" (UID: \"676d002f-1298-4f7a-b2ee-dc943106f1d9\") " pod="opendatahub/opendatahub-operator-controller-manager-7c68786f4b-5tcpg" Jun 03 14:00:48.356746 ip-10-0-134-229 kubenswrapper[2574]: I0603 14:00:48.356580 2574 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/676d002f-1298-4f7a-b2ee-dc943106f1d9-apiservice-cert\") pod \"opendatahub-operator-controller-manager-7c68786f4b-5tcpg\" (UID: \"676d002f-1298-4f7a-b2ee-dc943106f1d9\") " pod="opendatahub/opendatahub-operator-controller-manager-7c68786f4b-5tcpg" Jun 03 14:00:48.356746 ip-10-0-134-229 kubenswrapper[2574]: I0603 14:00:48.356610 2574 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/676d002f-1298-4f7a-b2ee-dc943106f1d9-webhook-cert\") pod \"opendatahub-operator-controller-manager-7c68786f4b-5tcpg\" (UID: \"676d002f-1298-4f7a-b2ee-dc943106f1d9\") " pod="opendatahub/opendatahub-operator-controller-manager-7c68786f4b-5tcpg" Jun 03 14:00:48.356746 ip-10-0-134-229 kubenswrapper[2574]: I0603 14:00:48.356627 2574 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/676d002f-1298-4f7a-b2ee-dc943106f1d9-tmp\") pod \"opendatahub-operator-controller-manager-7c68786f4b-5tcpg\" (UID: \"676d002f-1298-4f7a-b2ee-dc943106f1d9\") " pod="opendatahub/opendatahub-operator-controller-manager-7c68786f4b-5tcpg" Jun 03 14:00:48.356746 ip-10-0-134-229 kubenswrapper[2574]: I0603 14:00:48.356648 2574 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-nrmsn\" (UniqueName: \"kubernetes.io/projected/676d002f-1298-4f7a-b2ee-dc943106f1d9-kube-api-access-nrmsn\") pod \"opendatahub-operator-controller-manager-7c68786f4b-5tcpg\" (UID: \"676d002f-1298-4f7a-b2ee-dc943106f1d9\") " pod="opendatahub/opendatahub-operator-controller-manager-7c68786f4b-5tcpg" Jun 03 14:00:48.357017 ip-10-0-134-229 kubenswrapper[2574]: I0603 14:00:48.356991 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/676d002f-1298-4f7a-b2ee-dc943106f1d9-manifests\") pod \"opendatahub-operator-controller-manager-7c68786f4b-5tcpg\" (UID: \"676d002f-1298-4f7a-b2ee-dc943106f1d9\") " pod="opendatahub/opendatahub-operator-controller-manager-7c68786f4b-5tcpg" Jun 03 14:00:48.358793 ip-10-0-134-229 kubenswrapper[2574]: I0603 14:00:48.358771 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/676d002f-1298-4f7a-b2ee-dc943106f1d9-tmp\") pod \"opendatahub-operator-controller-manager-7c68786f4b-5tcpg\" (UID: \"676d002f-1298-4f7a-b2ee-dc943106f1d9\") " pod="opendatahub/opendatahub-operator-controller-manager-7c68786f4b-5tcpg" Jun 03 14:00:48.359041 ip-10-0-134-229 kubenswrapper[2574]: I0603 14:00:48.359024 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/676d002f-1298-4f7a-b2ee-dc943106f1d9-webhook-cert\") pod \"opendatahub-operator-controller-manager-7c68786f4b-5tcpg\" (UID: \"676d002f-1298-4f7a-b2ee-dc943106f1d9\") " pod="opendatahub/opendatahub-operator-controller-manager-7c68786f4b-5tcpg" Jun 03 14:00:48.359081 ip-10-0-134-229 kubenswrapper[2574]: I0603 14:00:48.359062 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/676d002f-1298-4f7a-b2ee-dc943106f1d9-apiservice-cert\") pod \"opendatahub-operator-controller-manager-7c68786f4b-5tcpg\" (UID: \"676d002f-1298-4f7a-b2ee-dc943106f1d9\") " pod="opendatahub/opendatahub-operator-controller-manager-7c68786f4b-5tcpg" Jun 03 14:00:48.368312 ip-10-0-134-229 kubenswrapper[2574]: I0603 14:00:48.368283 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-nrmsn\" (UniqueName: \"kubernetes.io/projected/676d002f-1298-4f7a-b2ee-dc943106f1d9-kube-api-access-nrmsn\") pod \"opendatahub-operator-controller-manager-7c68786f4b-5tcpg\" (UID: \"676d002f-1298-4f7a-b2ee-dc943106f1d9\") " pod="opendatahub/opendatahub-operator-controller-manager-7c68786f4b-5tcpg" Jun 03 14:00:48.456253 ip-10-0-134-229 kubenswrapper[2574]: I0603 14:00:48.456163 2574 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/opendatahub-operator-controller-manager-7c68786f4b-5tcpg" Jun 03 14:00:48.597659 ip-10-0-134-229 kubenswrapper[2574]: I0603 14:00:48.597628 2574 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-7c68786f4b-5tcpg"] Jun 03 14:00:48.601573 ip-10-0-134-229 kubenswrapper[2574]: W0603 14:00:48.601542 2574 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod676d002f_1298_4f7a_b2ee_dc943106f1d9.slice/crio-a961faf3bf61e3d74bc1feaf97412cb0688feb7a8014e593f38c4596bc5181f7 WatchSource:0}: Error finding container a961faf3bf61e3d74bc1feaf97412cb0688feb7a8014e593f38c4596bc5181f7: Status 404 returned error can't find the container with id a961faf3bf61e3d74bc1feaf97412cb0688feb7a8014e593f38c4596bc5181f7 Jun 03 14:00:48.681672 ip-10-0-134-229 kubenswrapper[2574]: I0603 14:00:48.681632 2574 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-7c68786f4b-5tcpg" event={"ID":"676d002f-1298-4f7a-b2ee-dc943106f1d9","Type":"ContainerStarted","Data":"a961faf3bf61e3d74bc1feaf97412cb0688feb7a8014e593f38c4596bc5181f7"} Jun 03 14:00:51.692797 ip-10-0-134-229 kubenswrapper[2574]: I0603 14:00:51.692761 2574 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-7c68786f4b-5tcpg" event={"ID":"676d002f-1298-4f7a-b2ee-dc943106f1d9","Type":"ContainerStarted","Data":"85b019b25aa9b214941e76b65a1dc12bc2d560bd27ea5a40db64d9412577428c"} Jun 03 14:00:52.697024 ip-10-0-134-229 kubenswrapper[2574]: I0603 14:00:52.696983 2574 generic.go:358] "Generic (PLEG): container finished" podID="676d002f-1298-4f7a-b2ee-dc943106f1d9" containerID="85b019b25aa9b214941e76b65a1dc12bc2d560bd27ea5a40db64d9412577428c" exitCode=0 Jun 03 14:00:52.697410 ip-10-0-134-229 kubenswrapper[2574]: I0603 14:00:52.697073 2574 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-7c68786f4b-5tcpg" event={"ID":"676d002f-1298-4f7a-b2ee-dc943106f1d9","Type":"ContainerDied","Data":"85b019b25aa9b214941e76b65a1dc12bc2d560bd27ea5a40db64d9412577428c"} Jun 03 14:00:53.701713 ip-10-0-134-229 kubenswrapper[2574]: I0603 14:00:53.701677 2574 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-7c68786f4b-5tcpg" event={"ID":"676d002f-1298-4f7a-b2ee-dc943106f1d9","Type":"ContainerStarted","Data":"e549575922676196efeb3362ae3b5a966972c912c6cdce6570eb183ff80903f0"} Jun 03 14:00:53.702113 ip-10-0-134-229 kubenswrapper[2574]: I0603 14:00:53.701786 2574 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/opendatahub-operator-controller-manager-7c68786f4b-5tcpg" Jun 03 14:00:53.725334 ip-10-0-134-229 kubenswrapper[2574]: I0603 14:00:53.725281 2574 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="opendatahub/opendatahub-operator-controller-manager-7c68786f4b-5tcpg" podStartSLOduration=1.3236541929999999 podStartE2EDuration="5.725264435s" podCreationTimestamp="2026-06-03 14:00:48 +0000 UTC" firstStartedPulling="2026-06-03 14:00:48.60328148 +0000 UTC m=+409.787288787" lastFinishedPulling="2026-06-03 14:00:53.004891718 +0000 UTC m=+414.188899029" observedRunningTime="2026-06-03 14:00:53.724141794 +0000 UTC m=+414.908149117" watchObservedRunningTime="2026-06-03 14:00:53.725264435 +0000 UTC m=+414.909271765" Jun 03 14:00:55.674201 ip-10-0-134-229 kubenswrapper[2574]: I0603 14:00:55.674167 2574 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-lws-operator/lws-controller-manager-6557d5d46d-dnfph" Jun 03 14:01:04.707635 ip-10-0-134-229 kubenswrapper[2574]: I0603 14:01:04.707602 2574 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/opendatahub-operator-controller-manager-7c68786f4b-5tcpg" Jun 03 14:01:18.145145 ip-10-0-134-229 kubenswrapper[2574]: I0603 14:01:18.145064 2574 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-marketplace/4c892a6d2d8a57acbc49427d3a7d24e253bab25be2c607ef405d2c4835585sj"] Jun 03 14:01:18.148508 ip-10-0-134-229 kubenswrapper[2574]: I0603 14:01:18.148489 2574 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/4c892a6d2d8a57acbc49427d3a7d24e253bab25be2c607ef405d2c4835585sj" Jun 03 14:01:18.155521 ip-10-0-134-229 kubenswrapper[2574]: I0603 14:01:18.155494 2574 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"openshift-service-ca.crt\"" Jun 03 14:01:18.155521 ip-10-0-134-229 kubenswrapper[2574]: I0603 14:01:18.155509 2574 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"kube-root-ca.crt\"" Jun 03 14:01:18.156262 ip-10-0-134-229 kubenswrapper[2574]: I0603 14:01:18.156244 2574 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-marketplace\"/\"default-dockercfg-h5qff\"" Jun 03 14:01:18.197528 ip-10-0-134-229 kubenswrapper[2574]: I0603 14:01:18.197496 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/93c066d7-a2be-411d-a5fe-7891b175d0ba-util\") pod \"4c892a6d2d8a57acbc49427d3a7d24e253bab25be2c607ef405d2c4835585sj\" (UID: \"93c066d7-a2be-411d-a5fe-7891b175d0ba\") " pod="openshift-marketplace/4c892a6d2d8a57acbc49427d3a7d24e253bab25be2c607ef405d2c4835585sj" Jun 03 14:01:18.197657 ip-10-0-134-229 kubenswrapper[2574]: I0603 14:01:18.197535 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-9tmcg\" (UniqueName: \"kubernetes.io/projected/93c066d7-a2be-411d-a5fe-7891b175d0ba-kube-api-access-9tmcg\") pod \"4c892a6d2d8a57acbc49427d3a7d24e253bab25be2c607ef405d2c4835585sj\" (UID: \"93c066d7-a2be-411d-a5fe-7891b175d0ba\") " pod="openshift-marketplace/4c892a6d2d8a57acbc49427d3a7d24e253bab25be2c607ef405d2c4835585sj" Jun 03 14:01:18.197657 ip-10-0-134-229 kubenswrapper[2574]: I0603 14:01:18.197570 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/93c066d7-a2be-411d-a5fe-7891b175d0ba-bundle\") pod \"4c892a6d2d8a57acbc49427d3a7d24e253bab25be2c607ef405d2c4835585sj\" (UID: \"93c066d7-a2be-411d-a5fe-7891b175d0ba\") " pod="openshift-marketplace/4c892a6d2d8a57acbc49427d3a7d24e253bab25be2c607ef405d2c4835585sj" Jun 03 14:01:18.265634 ip-10-0-134-229 kubenswrapper[2574]: I0603 14:01:18.265598 2574 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/4c892a6d2d8a57acbc49427d3a7d24e253bab25be2c607ef405d2c4835585sj"] Jun 03 14:01:18.298182 ip-10-0-134-229 kubenswrapper[2574]: I0603 14:01:18.298153 2574 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/93c066d7-a2be-411d-a5fe-7891b175d0ba-util\") pod \"4c892a6d2d8a57acbc49427d3a7d24e253bab25be2c607ef405d2c4835585sj\" (UID: \"93c066d7-a2be-411d-a5fe-7891b175d0ba\") " pod="openshift-marketplace/4c892a6d2d8a57acbc49427d3a7d24e253bab25be2c607ef405d2c4835585sj" Jun 03 14:01:18.298313 ip-10-0-134-229 kubenswrapper[2574]: I0603 14:01:18.298187 2574 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-9tmcg\" (UniqueName: \"kubernetes.io/projected/93c066d7-a2be-411d-a5fe-7891b175d0ba-kube-api-access-9tmcg\") pod \"4c892a6d2d8a57acbc49427d3a7d24e253bab25be2c607ef405d2c4835585sj\" (UID: \"93c066d7-a2be-411d-a5fe-7891b175d0ba\") " pod="openshift-marketplace/4c892a6d2d8a57acbc49427d3a7d24e253bab25be2c607ef405d2c4835585sj" Jun 03 14:01:18.298313 ip-10-0-134-229 kubenswrapper[2574]: I0603 14:01:18.298218 2574 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/93c066d7-a2be-411d-a5fe-7891b175d0ba-bundle\") pod \"4c892a6d2d8a57acbc49427d3a7d24e253bab25be2c607ef405d2c4835585sj\" (UID: \"93c066d7-a2be-411d-a5fe-7891b175d0ba\") " pod="openshift-marketplace/4c892a6d2d8a57acbc49427d3a7d24e253bab25be2c607ef405d2c4835585sj" Jun 03 14:01:18.298569 ip-10-0-134-229 kubenswrapper[2574]: I0603 14:01:18.298549 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/93c066d7-a2be-411d-a5fe-7891b175d0ba-util\") pod \"4c892a6d2d8a57acbc49427d3a7d24e253bab25be2c607ef405d2c4835585sj\" (UID: \"93c066d7-a2be-411d-a5fe-7891b175d0ba\") " pod="openshift-marketplace/4c892a6d2d8a57acbc49427d3a7d24e253bab25be2c607ef405d2c4835585sj" Jun 03 14:01:18.298609 ip-10-0-134-229 kubenswrapper[2574]: I0603 14:01:18.298581 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/93c066d7-a2be-411d-a5fe-7891b175d0ba-bundle\") pod \"4c892a6d2d8a57acbc49427d3a7d24e253bab25be2c607ef405d2c4835585sj\" (UID: \"93c066d7-a2be-411d-a5fe-7891b175d0ba\") " pod="openshift-marketplace/4c892a6d2d8a57acbc49427d3a7d24e253bab25be2c607ef405d2c4835585sj" Jun 03 14:01:18.308541 ip-10-0-134-229 kubenswrapper[2574]: I0603 14:01:18.308515 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-9tmcg\" (UniqueName: \"kubernetes.io/projected/93c066d7-a2be-411d-a5fe-7891b175d0ba-kube-api-access-9tmcg\") pod \"4c892a6d2d8a57acbc49427d3a7d24e253bab25be2c607ef405d2c4835585sj\" (UID: \"93c066d7-a2be-411d-a5fe-7891b175d0ba\") " pod="openshift-marketplace/4c892a6d2d8a57acbc49427d3a7d24e253bab25be2c607ef405d2c4835585sj" Jun 03 14:01:18.458547 ip-10-0-134-229 kubenswrapper[2574]: I0603 14:01:18.458449 2574 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/4c892a6d2d8a57acbc49427d3a7d24e253bab25be2c607ef405d2c4835585sj" Jun 03 14:01:18.601572 ip-10-0-134-229 kubenswrapper[2574]: I0603 14:01:18.601546 2574 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/4c892a6d2d8a57acbc49427d3a7d24e253bab25be2c607ef405d2c4835585sj"] Jun 03 14:01:18.604110 ip-10-0-134-229 kubenswrapper[2574]: W0603 14:01:18.604084 2574 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod93c066d7_a2be_411d_a5fe_7891b175d0ba.slice/crio-98ba5dfbf953da91e53d6e7de6f79781da2ba5ed93e6ab68dae1eb7d28a9264a WatchSource:0}: Error finding container 98ba5dfbf953da91e53d6e7de6f79781da2ba5ed93e6ab68dae1eb7d28a9264a: Status 404 returned error can't find the container with id 98ba5dfbf953da91e53d6e7de6f79781da2ba5ed93e6ab68dae1eb7d28a9264a Jun 03 14:01:18.787528 ip-10-0-134-229 kubenswrapper[2574]: I0603 14:01:18.787490 2574 generic.go:358] "Generic (PLEG): container finished" podID="93c066d7-a2be-411d-a5fe-7891b175d0ba" containerID="91bd9a69fc28d004becee708826a24c2a356b63acb2cfe4204dcd3326f364e2c" exitCode=0 Jun 03 14:01:18.787698 ip-10-0-134-229 kubenswrapper[2574]: I0603 14:01:18.787576 2574 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/4c892a6d2d8a57acbc49427d3a7d24e253bab25be2c607ef405d2c4835585sj" event={"ID":"93c066d7-a2be-411d-a5fe-7891b175d0ba","Type":"ContainerDied","Data":"91bd9a69fc28d004becee708826a24c2a356b63acb2cfe4204dcd3326f364e2c"} Jun 03 14:01:18.787698 ip-10-0-134-229 kubenswrapper[2574]: I0603 14:01:18.787611 2574 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/4c892a6d2d8a57acbc49427d3a7d24e253bab25be2c607ef405d2c4835585sj" event={"ID":"93c066d7-a2be-411d-a5fe-7891b175d0ba","Type":"ContainerStarted","Data":"98ba5dfbf953da91e53d6e7de6f79781da2ba5ed93e6ab68dae1eb7d28a9264a"} Jun 03 14:01:19.794344 ip-10-0-134-229 kubenswrapper[2574]: I0603 14:01:19.794314 2574 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/4c892a6d2d8a57acbc49427d3a7d24e253bab25be2c607ef405d2c4835585sj" event={"ID":"93c066d7-a2be-411d-a5fe-7891b175d0ba","Type":"ContainerStarted","Data":"b1f660f836d2d535642ef6150b14706a756dac4243cf2bda2ff55e70c4702aa4"} Jun 03 14:01:20.798935 ip-10-0-134-229 kubenswrapper[2574]: I0603 14:01:20.798899 2574 generic.go:358] "Generic (PLEG): container finished" podID="93c066d7-a2be-411d-a5fe-7891b175d0ba" containerID="b1f660f836d2d535642ef6150b14706a756dac4243cf2bda2ff55e70c4702aa4" exitCode=0 Jun 03 14:01:20.799296 ip-10-0-134-229 kubenswrapper[2574]: I0603 14:01:20.798979 2574 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/4c892a6d2d8a57acbc49427d3a7d24e253bab25be2c607ef405d2c4835585sj" event={"ID":"93c066d7-a2be-411d-a5fe-7891b175d0ba","Type":"ContainerDied","Data":"b1f660f836d2d535642ef6150b14706a756dac4243cf2bda2ff55e70c4702aa4"} Jun 03 14:01:21.803263 ip-10-0-134-229 kubenswrapper[2574]: I0603 14:01:21.803219 2574 generic.go:358] "Generic (PLEG): container finished" podID="93c066d7-a2be-411d-a5fe-7891b175d0ba" containerID="d0f63411f228d21d8722ef9dcab4a77844c1fa38a0ca8595abc275802ff484c1" exitCode=0 Jun 03 14:01:21.803661 ip-10-0-134-229 kubenswrapper[2574]: I0603 14:01:21.803295 2574 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/4c892a6d2d8a57acbc49427d3a7d24e253bab25be2c607ef405d2c4835585sj" event={"ID":"93c066d7-a2be-411d-a5fe-7891b175d0ba","Type":"ContainerDied","Data":"d0f63411f228d21d8722ef9dcab4a77844c1fa38a0ca8595abc275802ff484c1"} Jun 03 14:01:22.931004 ip-10-0-134-229 kubenswrapper[2574]: I0603 14:01:22.930981 2574 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/4c892a6d2d8a57acbc49427d3a7d24e253bab25be2c607ef405d2c4835585sj" Jun 03 14:01:23.036489 ip-10-0-134-229 kubenswrapper[2574]: I0603 14:01:23.036462 2574 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-9tmcg\" (UniqueName: \"kubernetes.io/projected/93c066d7-a2be-411d-a5fe-7891b175d0ba-kube-api-access-9tmcg\") pod \"93c066d7-a2be-411d-a5fe-7891b175d0ba\" (UID: \"93c066d7-a2be-411d-a5fe-7891b175d0ba\") " Jun 03 14:01:23.036650 ip-10-0-134-229 kubenswrapper[2574]: I0603 14:01:23.036508 2574 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/93c066d7-a2be-411d-a5fe-7891b175d0ba-util\") pod \"93c066d7-a2be-411d-a5fe-7891b175d0ba\" (UID: \"93c066d7-a2be-411d-a5fe-7891b175d0ba\") " Jun 03 14:01:23.036691 ip-10-0-134-229 kubenswrapper[2574]: I0603 14:01:23.036643 2574 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/93c066d7-a2be-411d-a5fe-7891b175d0ba-bundle\") pod \"93c066d7-a2be-411d-a5fe-7891b175d0ba\" (UID: \"93c066d7-a2be-411d-a5fe-7891b175d0ba\") " Jun 03 14:01:23.037487 ip-10-0-134-229 kubenswrapper[2574]: I0603 14:01:23.037452 2574 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/93c066d7-a2be-411d-a5fe-7891b175d0ba-bundle" (OuterVolumeSpecName: "bundle") pod "93c066d7-a2be-411d-a5fe-7891b175d0ba" (UID: "93c066d7-a2be-411d-a5fe-7891b175d0ba"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jun 03 14:01:23.038572 ip-10-0-134-229 kubenswrapper[2574]: I0603 14:01:23.038549 2574 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/93c066d7-a2be-411d-a5fe-7891b175d0ba-kube-api-access-9tmcg" (OuterVolumeSpecName: "kube-api-access-9tmcg") pod "93c066d7-a2be-411d-a5fe-7891b175d0ba" (UID: "93c066d7-a2be-411d-a5fe-7891b175d0ba"). InnerVolumeSpecName "kube-api-access-9tmcg". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 03 14:01:23.043980 ip-10-0-134-229 kubenswrapper[2574]: I0603 14:01:23.043955 2574 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/93c066d7-a2be-411d-a5fe-7891b175d0ba-util" (OuterVolumeSpecName: "util") pod "93c066d7-a2be-411d-a5fe-7891b175d0ba" (UID: "93c066d7-a2be-411d-a5fe-7891b175d0ba"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jun 03 14:01:23.137640 ip-10-0-134-229 kubenswrapper[2574]: I0603 14:01:23.137612 2574 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-9tmcg\" (UniqueName: \"kubernetes.io/projected/93c066d7-a2be-411d-a5fe-7891b175d0ba-kube-api-access-9tmcg\") on node \"ip-10-0-134-229.ec2.internal\" DevicePath \"\"" Jun 03 14:01:23.137640 ip-10-0-134-229 kubenswrapper[2574]: I0603 14:01:23.137639 2574 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/93c066d7-a2be-411d-a5fe-7891b175d0ba-util\") on node \"ip-10-0-134-229.ec2.internal\" DevicePath \"\"" Jun 03 14:01:23.137808 ip-10-0-134-229 kubenswrapper[2574]: I0603 14:01:23.137648 2574 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/93c066d7-a2be-411d-a5fe-7891b175d0ba-bundle\") on node \"ip-10-0-134-229.ec2.internal\" DevicePath \"\"" Jun 03 14:01:23.811598 ip-10-0-134-229 kubenswrapper[2574]: I0603 14:01:23.811519 2574 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/4c892a6d2d8a57acbc49427d3a7d24e253bab25be2c607ef405d2c4835585sj" event={"ID":"93c066d7-a2be-411d-a5fe-7891b175d0ba","Type":"ContainerDied","Data":"98ba5dfbf953da91e53d6e7de6f79781da2ba5ed93e6ab68dae1eb7d28a9264a"} Jun 03 14:01:23.811598 ip-10-0-134-229 kubenswrapper[2574]: I0603 14:01:23.811553 2574 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="98ba5dfbf953da91e53d6e7de6f79781da2ba5ed93e6ab68dae1eb7d28a9264a" Jun 03 14:01:23.811598 ip-10-0-134-229 kubenswrapper[2574]: I0603 14:01:23.811567 2574 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/4c892a6d2d8a57acbc49427d3a7d24e253bab25be2c607ef405d2c4835585sj" Jun 03 14:01:32.571944 ip-10-0-134-229 kubenswrapper[2574]: I0603 14:01:32.571898 2574 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-marketplace/c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762a4hz49"] Jun 03 14:01:32.572415 ip-10-0-134-229 kubenswrapper[2574]: I0603 14:01:32.572312 2574 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="93c066d7-a2be-411d-a5fe-7891b175d0ba" containerName="pull" Jun 03 14:01:32.572415 ip-10-0-134-229 kubenswrapper[2574]: I0603 14:01:32.572328 2574 state_mem.go:107] "Deleted CPUSet assignment" podUID="93c066d7-a2be-411d-a5fe-7891b175d0ba" containerName="pull" Jun 03 14:01:32.572415 ip-10-0-134-229 kubenswrapper[2574]: I0603 14:01:32.572339 2574 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="93c066d7-a2be-411d-a5fe-7891b175d0ba" containerName="extract" Jun 03 14:01:32.572415 ip-10-0-134-229 kubenswrapper[2574]: I0603 14:01:32.572348 2574 state_mem.go:107] "Deleted CPUSet assignment" podUID="93c066d7-a2be-411d-a5fe-7891b175d0ba" containerName="extract" Jun 03 14:01:32.572415 ip-10-0-134-229 kubenswrapper[2574]: I0603 14:01:32.572361 2574 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="93c066d7-a2be-411d-a5fe-7891b175d0ba" containerName="util" Jun 03 14:01:32.572415 ip-10-0-134-229 kubenswrapper[2574]: I0603 14:01:32.572384 2574 state_mem.go:107] "Deleted CPUSet assignment" podUID="93c066d7-a2be-411d-a5fe-7891b175d0ba" containerName="util" Jun 03 14:01:32.572730 ip-10-0-134-229 kubenswrapper[2574]: I0603 14:01:32.572465 2574 memory_manager.go:356] "RemoveStaleState removing state" podUID="93c066d7-a2be-411d-a5fe-7891b175d0ba" containerName="extract" Jun 03 14:01:32.577117 ip-10-0-134-229 kubenswrapper[2574]: I0603 14:01:32.577090 2574 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762a4hz49" Jun 03 14:01:32.580195 ip-10-0-134-229 kubenswrapper[2574]: I0603 14:01:32.580166 2574 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"openshift-service-ca.crt\"" Jun 03 14:01:32.580195 ip-10-0-134-229 kubenswrapper[2574]: I0603 14:01:32.580179 2574 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-marketplace\"/\"default-dockercfg-h5qff\"" Jun 03 14:01:32.580994 ip-10-0-134-229 kubenswrapper[2574]: I0603 14:01:32.580978 2574 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"kube-root-ca.crt\"" Jun 03 14:01:32.588558 ip-10-0-134-229 kubenswrapper[2574]: I0603 14:01:32.588537 2574 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762a4hz49"] Jun 03 14:01:32.623331 ip-10-0-134-229 kubenswrapper[2574]: I0603 14:01:32.623308 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/1fdba84f-e0dd-4fa5-83a0-3315912872a8-util\") pod \"c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762a4hz49\" (UID: \"1fdba84f-e0dd-4fa5-83a0-3315912872a8\") " pod="openshift-marketplace/c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762a4hz49" Jun 03 14:01:32.623468 ip-10-0-134-229 kubenswrapper[2574]: I0603 14:01:32.623339 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-stq96\" (UniqueName: \"kubernetes.io/projected/1fdba84f-e0dd-4fa5-83a0-3315912872a8-kube-api-access-stq96\") pod \"c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762a4hz49\" (UID: \"1fdba84f-e0dd-4fa5-83a0-3315912872a8\") " pod="openshift-marketplace/c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762a4hz49" Jun 03 14:01:32.623468 ip-10-0-134-229 kubenswrapper[2574]: I0603 14:01:32.623365 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/1fdba84f-e0dd-4fa5-83a0-3315912872a8-bundle\") pod \"c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762a4hz49\" (UID: \"1fdba84f-e0dd-4fa5-83a0-3315912872a8\") " pod="openshift-marketplace/c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762a4hz49" Jun 03 14:01:32.724047 ip-10-0-134-229 kubenswrapper[2574]: I0603 14:01:32.724013 2574 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/1fdba84f-e0dd-4fa5-83a0-3315912872a8-util\") pod \"c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762a4hz49\" (UID: \"1fdba84f-e0dd-4fa5-83a0-3315912872a8\") " pod="openshift-marketplace/c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762a4hz49" Jun 03 14:01:32.724179 ip-10-0-134-229 kubenswrapper[2574]: I0603 14:01:32.724062 2574 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-stq96\" (UniqueName: \"kubernetes.io/projected/1fdba84f-e0dd-4fa5-83a0-3315912872a8-kube-api-access-stq96\") pod \"c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762a4hz49\" (UID: \"1fdba84f-e0dd-4fa5-83a0-3315912872a8\") " pod="openshift-marketplace/c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762a4hz49" Jun 03 14:01:32.724179 ip-10-0-134-229 kubenswrapper[2574]: I0603 14:01:32.724103 2574 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/1fdba84f-e0dd-4fa5-83a0-3315912872a8-bundle\") pod \"c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762a4hz49\" (UID: \"1fdba84f-e0dd-4fa5-83a0-3315912872a8\") " pod="openshift-marketplace/c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762a4hz49" Jun 03 14:01:32.724492 ip-10-0-134-229 kubenswrapper[2574]: I0603 14:01:32.724472 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/1fdba84f-e0dd-4fa5-83a0-3315912872a8-util\") pod \"c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762a4hz49\" (UID: \"1fdba84f-e0dd-4fa5-83a0-3315912872a8\") " pod="openshift-marketplace/c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762a4hz49" Jun 03 14:01:32.724492 ip-10-0-134-229 kubenswrapper[2574]: I0603 14:01:32.724484 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/1fdba84f-e0dd-4fa5-83a0-3315912872a8-bundle\") pod \"c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762a4hz49\" (UID: \"1fdba84f-e0dd-4fa5-83a0-3315912872a8\") " pod="openshift-marketplace/c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762a4hz49" Jun 03 14:01:32.740708 ip-10-0-134-229 kubenswrapper[2574]: I0603 14:01:32.740678 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-stq96\" (UniqueName: \"kubernetes.io/projected/1fdba84f-e0dd-4fa5-83a0-3315912872a8-kube-api-access-stq96\") pod \"c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762a4hz49\" (UID: \"1fdba84f-e0dd-4fa5-83a0-3315912872a8\") " pod="openshift-marketplace/c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762a4hz49" Jun 03 14:01:32.888842 ip-10-0-134-229 kubenswrapper[2574]: I0603 14:01:32.888811 2574 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762a4hz49" Jun 03 14:01:33.036516 ip-10-0-134-229 kubenswrapper[2574]: I0603 14:01:33.036489 2574 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762a4hz49"] Jun 03 14:01:33.037270 ip-10-0-134-229 kubenswrapper[2574]: W0603 14:01:33.037245 2574 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod1fdba84f_e0dd_4fa5_83a0_3315912872a8.slice/crio-0423de1c9df9db76283582f0968c19e2a0c5f94ab95625763e51b1b5da386cc4 WatchSource:0}: Error finding container 0423de1c9df9db76283582f0968c19e2a0c5f94ab95625763e51b1b5da386cc4: Status 404 returned error can't find the container with id 0423de1c9df9db76283582f0968c19e2a0c5f94ab95625763e51b1b5da386cc4 Jun 03 14:01:33.850040 ip-10-0-134-229 kubenswrapper[2574]: I0603 14:01:33.850004 2574 generic.go:358] "Generic (PLEG): container finished" podID="1fdba84f-e0dd-4fa5-83a0-3315912872a8" containerID="13affca6e6f0a3f16374d9cd45b63baf3cff89a173c9883daa6658ae1207e525" exitCode=0 Jun 03 14:01:33.850542 ip-10-0-134-229 kubenswrapper[2574]: I0603 14:01:33.850089 2574 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762a4hz49" event={"ID":"1fdba84f-e0dd-4fa5-83a0-3315912872a8","Type":"ContainerDied","Data":"13affca6e6f0a3f16374d9cd45b63baf3cff89a173c9883daa6658ae1207e525"} Jun 03 14:01:33.850542 ip-10-0-134-229 kubenswrapper[2574]: I0603 14:01:33.850139 2574 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762a4hz49" event={"ID":"1fdba84f-e0dd-4fa5-83a0-3315912872a8","Type":"ContainerStarted","Data":"0423de1c9df9db76283582f0968c19e2a0c5f94ab95625763e51b1b5da386cc4"} Jun 03 14:01:33.911886 ip-10-0-134-229 kubenswrapper[2574]: I0603 14:01:33.911856 2574 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["opendatahub/dashboard-redirect-549d6557c8-7tmxf"] Jun 03 14:01:33.915969 ip-10-0-134-229 kubenswrapper[2574]: I0603 14:01:33.915948 2574 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/dashboard-redirect-549d6557c8-7tmxf" Jun 03 14:01:33.918872 ip-10-0-134-229 kubenswrapper[2574]: I0603 14:01:33.918852 2574 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"default-dockercfg-5gbsr\"" Jun 03 14:01:33.918988 ip-10-0-134-229 kubenswrapper[2574]: I0603 14:01:33.918971 2574 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"dashboard-redirect-config\"" Jun 03 14:01:33.929419 ip-10-0-134-229 kubenswrapper[2574]: I0603 14:01:33.929396 2574 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["opendatahub/dashboard-redirect-549d6557c8-7tmxf"] Jun 03 14:01:34.036243 ip-10-0-134-229 kubenswrapper[2574]: I0603 14:01:34.036168 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"redirect-config\" (UniqueName: \"kubernetes.io/configmap/5431ed00-b744-4579-bdfe-f8ad6f1328c2-redirect-config\") pod \"dashboard-redirect-549d6557c8-7tmxf\" (UID: \"5431ed00-b744-4579-bdfe-f8ad6f1328c2\") " pod="opendatahub/dashboard-redirect-549d6557c8-7tmxf" Jun 03 14:01:34.036243 ip-10-0-134-229 kubenswrapper[2574]: I0603 14:01:34.036228 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-sxkff\" (UniqueName: \"kubernetes.io/projected/5431ed00-b744-4579-bdfe-f8ad6f1328c2-kube-api-access-sxkff\") pod \"dashboard-redirect-549d6557c8-7tmxf\" (UID: \"5431ed00-b744-4579-bdfe-f8ad6f1328c2\") " pod="opendatahub/dashboard-redirect-549d6557c8-7tmxf" Jun 03 14:01:34.137550 ip-10-0-134-229 kubenswrapper[2574]: I0603 14:01:34.137514 2574 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"redirect-config\" (UniqueName: \"kubernetes.io/configmap/5431ed00-b744-4579-bdfe-f8ad6f1328c2-redirect-config\") pod \"dashboard-redirect-549d6557c8-7tmxf\" (UID: \"5431ed00-b744-4579-bdfe-f8ad6f1328c2\") " pod="opendatahub/dashboard-redirect-549d6557c8-7tmxf" Jun 03 14:01:34.137708 ip-10-0-134-229 kubenswrapper[2574]: I0603 14:01:34.137611 2574 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-sxkff\" (UniqueName: \"kubernetes.io/projected/5431ed00-b744-4579-bdfe-f8ad6f1328c2-kube-api-access-sxkff\") pod \"dashboard-redirect-549d6557c8-7tmxf\" (UID: \"5431ed00-b744-4579-bdfe-f8ad6f1328c2\") " pod="opendatahub/dashboard-redirect-549d6557c8-7tmxf" Jun 03 14:01:34.138481 ip-10-0-134-229 kubenswrapper[2574]: I0603 14:01:34.138459 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"redirect-config\" (UniqueName: \"kubernetes.io/configmap/5431ed00-b744-4579-bdfe-f8ad6f1328c2-redirect-config\") pod \"dashboard-redirect-549d6557c8-7tmxf\" (UID: \"5431ed00-b744-4579-bdfe-f8ad6f1328c2\") " pod="opendatahub/dashboard-redirect-549d6557c8-7tmxf" Jun 03 14:01:34.147449 ip-10-0-134-229 kubenswrapper[2574]: I0603 14:01:34.147424 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-sxkff\" (UniqueName: \"kubernetes.io/projected/5431ed00-b744-4579-bdfe-f8ad6f1328c2-kube-api-access-sxkff\") pod \"dashboard-redirect-549d6557c8-7tmxf\" (UID: \"5431ed00-b744-4579-bdfe-f8ad6f1328c2\") " pod="opendatahub/dashboard-redirect-549d6557c8-7tmxf" Jun 03 14:01:34.225665 ip-10-0-134-229 kubenswrapper[2574]: I0603 14:01:34.225633 2574 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/dashboard-redirect-549d6557c8-7tmxf" Jun 03 14:01:34.361392 ip-10-0-134-229 kubenswrapper[2574]: I0603 14:01:34.361347 2574 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["opendatahub/dashboard-redirect-549d6557c8-7tmxf"] Jun 03 14:01:34.363314 ip-10-0-134-229 kubenswrapper[2574]: W0603 14:01:34.363285 2574 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod5431ed00_b744_4579_bdfe_f8ad6f1328c2.slice/crio-79f6d53589f84a222a8bffb1ba8671ca4fa6613266ed9fc1b819a63747cf85c6 WatchSource:0}: Error finding container 79f6d53589f84a222a8bffb1ba8671ca4fa6613266ed9fc1b819a63747cf85c6: Status 404 returned error can't find the container with id 79f6d53589f84a222a8bffb1ba8671ca4fa6613266ed9fc1b819a63747cf85c6 Jun 03 14:01:34.854297 ip-10-0-134-229 kubenswrapper[2574]: I0603 14:01:34.854255 2574 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="opendatahub/dashboard-redirect-549d6557c8-7tmxf" event={"ID":"5431ed00-b744-4579-bdfe-f8ad6f1328c2","Type":"ContainerStarted","Data":"79f6d53589f84a222a8bffb1ba8671ca4fa6613266ed9fc1b819a63747cf85c6"} Jun 03 14:01:34.856165 ip-10-0-134-229 kubenswrapper[2574]: I0603 14:01:34.856138 2574 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762a4hz49" event={"ID":"1fdba84f-e0dd-4fa5-83a0-3315912872a8","Type":"ContainerStarted","Data":"12ea0de4deed6d1c76fbf78abcb960343e322f1c896f2dd4dcecc173a4b726f9"} Jun 03 14:01:35.861947 ip-10-0-134-229 kubenswrapper[2574]: I0603 14:01:35.861902 2574 generic.go:358] "Generic (PLEG): container finished" podID="1fdba84f-e0dd-4fa5-83a0-3315912872a8" containerID="12ea0de4deed6d1c76fbf78abcb960343e322f1c896f2dd4dcecc173a4b726f9" exitCode=0 Jun 03 14:01:35.862384 ip-10-0-134-229 kubenswrapper[2574]: I0603 14:01:35.861952 2574 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762a4hz49" event={"ID":"1fdba84f-e0dd-4fa5-83a0-3315912872a8","Type":"ContainerDied","Data":"12ea0de4deed6d1c76fbf78abcb960343e322f1c896f2dd4dcecc173a4b726f9"} Jun 03 14:01:36.871471 ip-10-0-134-229 kubenswrapper[2574]: I0603 14:01:36.871431 2574 generic.go:358] "Generic (PLEG): container finished" podID="1fdba84f-e0dd-4fa5-83a0-3315912872a8" containerID="d8aab45b858130f8cf149434ef451f82e412d8b630a4e8d88697fd0462640377" exitCode=0 Jun 03 14:01:36.871950 ip-10-0-134-229 kubenswrapper[2574]: I0603 14:01:36.871547 2574 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762a4hz49" event={"ID":"1fdba84f-e0dd-4fa5-83a0-3315912872a8","Type":"ContainerDied","Data":"d8aab45b858130f8cf149434ef451f82e412d8b630a4e8d88697fd0462640377"} Jun 03 14:01:38.664411 ip-10-0-134-229 kubenswrapper[2574]: I0603 14:01:38.664362 2574 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762a4hz49" Jun 03 14:01:38.779621 ip-10-0-134-229 kubenswrapper[2574]: I0603 14:01:38.779587 2574 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/1fdba84f-e0dd-4fa5-83a0-3315912872a8-util\") pod \"1fdba84f-e0dd-4fa5-83a0-3315912872a8\" (UID: \"1fdba84f-e0dd-4fa5-83a0-3315912872a8\") " Jun 03 14:01:38.779822 ip-10-0-134-229 kubenswrapper[2574]: I0603 14:01:38.779672 2574 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-stq96\" (UniqueName: \"kubernetes.io/projected/1fdba84f-e0dd-4fa5-83a0-3315912872a8-kube-api-access-stq96\") pod \"1fdba84f-e0dd-4fa5-83a0-3315912872a8\" (UID: \"1fdba84f-e0dd-4fa5-83a0-3315912872a8\") " Jun 03 14:01:38.779822 ip-10-0-134-229 kubenswrapper[2574]: I0603 14:01:38.779706 2574 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/1fdba84f-e0dd-4fa5-83a0-3315912872a8-bundle\") pod \"1fdba84f-e0dd-4fa5-83a0-3315912872a8\" (UID: \"1fdba84f-e0dd-4fa5-83a0-3315912872a8\") " Jun 03 14:01:38.780991 ip-10-0-134-229 kubenswrapper[2574]: I0603 14:01:38.780951 2574 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/1fdba84f-e0dd-4fa5-83a0-3315912872a8-bundle" (OuterVolumeSpecName: "bundle") pod "1fdba84f-e0dd-4fa5-83a0-3315912872a8" (UID: "1fdba84f-e0dd-4fa5-83a0-3315912872a8"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jun 03 14:01:38.782410 ip-10-0-134-229 kubenswrapper[2574]: I0603 14:01:38.782357 2574 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/1fdba84f-e0dd-4fa5-83a0-3315912872a8-kube-api-access-stq96" (OuterVolumeSpecName: "kube-api-access-stq96") pod "1fdba84f-e0dd-4fa5-83a0-3315912872a8" (UID: "1fdba84f-e0dd-4fa5-83a0-3315912872a8"). InnerVolumeSpecName "kube-api-access-stq96". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 03 14:01:38.785545 ip-10-0-134-229 kubenswrapper[2574]: I0603 14:01:38.785508 2574 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/1fdba84f-e0dd-4fa5-83a0-3315912872a8-util" (OuterVolumeSpecName: "util") pod "1fdba84f-e0dd-4fa5-83a0-3315912872a8" (UID: "1fdba84f-e0dd-4fa5-83a0-3315912872a8"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jun 03 14:01:38.880455 ip-10-0-134-229 kubenswrapper[2574]: I0603 14:01:38.880420 2574 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-stq96\" (UniqueName: \"kubernetes.io/projected/1fdba84f-e0dd-4fa5-83a0-3315912872a8-kube-api-access-stq96\") on node \"ip-10-0-134-229.ec2.internal\" DevicePath \"\"" Jun 03 14:01:38.880455 ip-10-0-134-229 kubenswrapper[2574]: I0603 14:01:38.880454 2574 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/1fdba84f-e0dd-4fa5-83a0-3315912872a8-bundle\") on node \"ip-10-0-134-229.ec2.internal\" DevicePath \"\"" Jun 03 14:01:38.880694 ip-10-0-134-229 kubenswrapper[2574]: I0603 14:01:38.880469 2574 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/1fdba84f-e0dd-4fa5-83a0-3315912872a8-util\") on node \"ip-10-0-134-229.ec2.internal\" DevicePath \"\"" Jun 03 14:01:38.880777 ip-10-0-134-229 kubenswrapper[2574]: I0603 14:01:38.880733 2574 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762a4hz49" event={"ID":"1fdba84f-e0dd-4fa5-83a0-3315912872a8","Type":"ContainerDied","Data":"0423de1c9df9db76283582f0968c19e2a0c5f94ab95625763e51b1b5da386cc4"} Jun 03 14:01:38.880777 ip-10-0-134-229 kubenswrapper[2574]: I0603 14:01:38.880774 2574 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="0423de1c9df9db76283582f0968c19e2a0c5f94ab95625763e51b1b5da386cc4" Jun 03 14:01:38.880945 ip-10-0-134-229 kubenswrapper[2574]: I0603 14:01:38.880855 2574 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762a4hz49" Jun 03 14:01:39.885321 ip-10-0-134-229 kubenswrapper[2574]: I0603 14:01:39.885287 2574 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="opendatahub/dashboard-redirect-549d6557c8-7tmxf" event={"ID":"5431ed00-b744-4579-bdfe-f8ad6f1328c2","Type":"ContainerStarted","Data":"08bb3e3ce266d56817e4f20ab2d9bc3214081e2d51561e303b9cc031981cb26e"} Jun 03 14:01:39.910965 ip-10-0-134-229 kubenswrapper[2574]: I0603 14:01:39.910916 2574 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="opendatahub/dashboard-redirect-549d6557c8-7tmxf" podStartSLOduration=2.186359685 podStartE2EDuration="6.910901322s" podCreationTimestamp="2026-06-03 14:01:33 +0000 UTC" firstStartedPulling="2026-06-03 14:01:34.364659371 +0000 UTC m=+455.548666678" lastFinishedPulling="2026-06-03 14:01:39.089201008 +0000 UTC m=+460.273208315" observedRunningTime="2026-06-03 14:01:39.910002418 +0000 UTC m=+461.094009748" watchObservedRunningTime="2026-06-03 14:01:39.910901322 +0000 UTC m=+461.094908651" Jun 03 14:01:48.972837 ip-10-0-134-229 kubenswrapper[2574]: I0603 14:01:48.972802 2574 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-ingress/data-science-gateway-data-science-gateway-class-595b7776f8tdnqp"] Jun 03 14:01:48.973213 ip-10-0-134-229 kubenswrapper[2574]: I0603 14:01:48.973137 2574 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="1fdba84f-e0dd-4fa5-83a0-3315912872a8" containerName="pull" Jun 03 14:01:48.973213 ip-10-0-134-229 kubenswrapper[2574]: I0603 14:01:48.973151 2574 state_mem.go:107] "Deleted CPUSet assignment" podUID="1fdba84f-e0dd-4fa5-83a0-3315912872a8" containerName="pull" Jun 03 14:01:48.973213 ip-10-0-134-229 kubenswrapper[2574]: I0603 14:01:48.973161 2574 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="1fdba84f-e0dd-4fa5-83a0-3315912872a8" containerName="util" Jun 03 14:01:48.973213 ip-10-0-134-229 kubenswrapper[2574]: I0603 14:01:48.973166 2574 state_mem.go:107] "Deleted CPUSet assignment" podUID="1fdba84f-e0dd-4fa5-83a0-3315912872a8" containerName="util" Jun 03 14:01:48.973213 ip-10-0-134-229 kubenswrapper[2574]: I0603 14:01:48.973177 2574 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="1fdba84f-e0dd-4fa5-83a0-3315912872a8" containerName="extract" Jun 03 14:01:48.973213 ip-10-0-134-229 kubenswrapper[2574]: I0603 14:01:48.973183 2574 state_mem.go:107] "Deleted CPUSet assignment" podUID="1fdba84f-e0dd-4fa5-83a0-3315912872a8" containerName="extract" Jun 03 14:01:48.973428 ip-10-0-134-229 kubenswrapper[2574]: I0603 14:01:48.973239 2574 memory_manager.go:356] "RemoveStaleState removing state" podUID="1fdba84f-e0dd-4fa5-83a0-3315912872a8" containerName="extract" Jun 03 14:01:48.987879 ip-10-0-134-229 kubenswrapper[2574]: I0603 14:01:48.987842 2574 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-595b7776f8tdnqp" Jun 03 14:01:48.990922 ip-10-0-134-229 kubenswrapper[2574]: I0603 14:01:48.990900 2574 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"openshift-gw-ca-root-cert\"" Jun 03 14:01:48.991148 ip-10-0-134-229 kubenswrapper[2574]: I0603 14:01:48.990900 2574 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"data-science-gateway-data-science-gateway-class-dockercfg-x5mdf\"" Jun 03 14:01:48.994801 ip-10-0-134-229 kubenswrapper[2574]: I0603 14:01:48.994774 2574 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/data-science-gateway-data-science-gateway-class-595b7776f8tdnqp"] Jun 03 14:01:49.066767 ip-10-0-134-229 kubenswrapper[2574]: I0603 14:01:49.066731 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/a9c6cb6e-63a9-4aa4-a1af-17f58fc852e5-istio-podinfo\") pod \"data-science-gateway-data-science-gateway-class-595b7776f8tdnqp\" (UID: \"a9c6cb6e-63a9-4aa4-a1af-17f58fc852e5\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-595b7776f8tdnqp" Jun 03 14:01:49.066767 ip-10-0-134-229 kubenswrapper[2574]: I0603 14:01:49.066768 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/a9c6cb6e-63a9-4aa4-a1af-17f58fc852e5-istiod-ca-cert\") pod \"data-science-gateway-data-science-gateway-class-595b7776f8tdnqp\" (UID: \"a9c6cb6e-63a9-4aa4-a1af-17f58fc852e5\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-595b7776f8tdnqp" Jun 03 14:01:49.066993 ip-10-0-134-229 kubenswrapper[2574]: I0603 14:01:49.066789 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/a9c6cb6e-63a9-4aa4-a1af-17f58fc852e5-credential-socket\") pod \"data-science-gateway-data-science-gateway-class-595b7776f8tdnqp\" (UID: \"a9c6cb6e-63a9-4aa4-a1af-17f58fc852e5\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-595b7776f8tdnqp" Jun 03 14:01:49.066993 ip-10-0-134-229 kubenswrapper[2574]: I0603 14:01:49.066861 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/a9c6cb6e-63a9-4aa4-a1af-17f58fc852e5-workload-socket\") pod \"data-science-gateway-data-science-gateway-class-595b7776f8tdnqp\" (UID: \"a9c6cb6e-63a9-4aa4-a1af-17f58fc852e5\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-595b7776f8tdnqp" Jun 03 14:01:49.066993 ip-10-0-134-229 kubenswrapper[2574]: I0603 14:01:49.066890 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/a9c6cb6e-63a9-4aa4-a1af-17f58fc852e5-workload-certs\") pod \"data-science-gateway-data-science-gateway-class-595b7776f8tdnqp\" (UID: \"a9c6cb6e-63a9-4aa4-a1af-17f58fc852e5\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-595b7776f8tdnqp" Jun 03 14:01:49.066993 ip-10-0-134-229 kubenswrapper[2574]: I0603 14:01:49.066916 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/a9c6cb6e-63a9-4aa4-a1af-17f58fc852e5-istio-data\") pod \"data-science-gateway-data-science-gateway-class-595b7776f8tdnqp\" (UID: \"a9c6cb6e-63a9-4aa4-a1af-17f58fc852e5\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-595b7776f8tdnqp" Jun 03 14:01:49.066993 ip-10-0-134-229 kubenswrapper[2574]: I0603 14:01:49.066964 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-5bzn2\" (UniqueName: \"kubernetes.io/projected/a9c6cb6e-63a9-4aa4-a1af-17f58fc852e5-kube-api-access-5bzn2\") pod \"data-science-gateway-data-science-gateway-class-595b7776f8tdnqp\" (UID: \"a9c6cb6e-63a9-4aa4-a1af-17f58fc852e5\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-595b7776f8tdnqp" Jun 03 14:01:49.067197 ip-10-0-134-229 kubenswrapper[2574]: I0603 14:01:49.066993 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/a9c6cb6e-63a9-4aa4-a1af-17f58fc852e5-istio-envoy\") pod \"data-science-gateway-data-science-gateway-class-595b7776f8tdnqp\" (UID: \"a9c6cb6e-63a9-4aa4-a1af-17f58fc852e5\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-595b7776f8tdnqp" Jun 03 14:01:49.067197 ip-10-0-134-229 kubenswrapper[2574]: I0603 14:01:49.067025 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/a9c6cb6e-63a9-4aa4-a1af-17f58fc852e5-istio-token\") pod \"data-science-gateway-data-science-gateway-class-595b7776f8tdnqp\" (UID: \"a9c6cb6e-63a9-4aa4-a1af-17f58fc852e5\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-595b7776f8tdnqp" Jun 03 14:01:49.167433 ip-10-0-134-229 kubenswrapper[2574]: I0603 14:01:49.167394 2574 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/a9c6cb6e-63a9-4aa4-a1af-17f58fc852e5-istio-token\") pod \"data-science-gateway-data-science-gateway-class-595b7776f8tdnqp\" (UID: \"a9c6cb6e-63a9-4aa4-a1af-17f58fc852e5\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-595b7776f8tdnqp" Jun 03 14:01:49.167679 ip-10-0-134-229 kubenswrapper[2574]: I0603 14:01:49.167459 2574 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/a9c6cb6e-63a9-4aa4-a1af-17f58fc852e5-istio-podinfo\") pod \"data-science-gateway-data-science-gateway-class-595b7776f8tdnqp\" (UID: \"a9c6cb6e-63a9-4aa4-a1af-17f58fc852e5\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-595b7776f8tdnqp" Jun 03 14:01:49.167679 ip-10-0-134-229 kubenswrapper[2574]: I0603 14:01:49.167487 2574 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/a9c6cb6e-63a9-4aa4-a1af-17f58fc852e5-istiod-ca-cert\") pod \"data-science-gateway-data-science-gateway-class-595b7776f8tdnqp\" (UID: \"a9c6cb6e-63a9-4aa4-a1af-17f58fc852e5\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-595b7776f8tdnqp" Jun 03 14:01:49.167679 ip-10-0-134-229 kubenswrapper[2574]: I0603 14:01:49.167516 2574 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/a9c6cb6e-63a9-4aa4-a1af-17f58fc852e5-credential-socket\") pod \"data-science-gateway-data-science-gateway-class-595b7776f8tdnqp\" (UID: \"a9c6cb6e-63a9-4aa4-a1af-17f58fc852e5\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-595b7776f8tdnqp" Jun 03 14:01:49.167679 ip-10-0-134-229 kubenswrapper[2574]: I0603 14:01:49.167550 2574 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/a9c6cb6e-63a9-4aa4-a1af-17f58fc852e5-workload-socket\") pod \"data-science-gateway-data-science-gateway-class-595b7776f8tdnqp\" (UID: \"a9c6cb6e-63a9-4aa4-a1af-17f58fc852e5\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-595b7776f8tdnqp" Jun 03 14:01:49.167679 ip-10-0-134-229 kubenswrapper[2574]: I0603 14:01:49.167573 2574 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/a9c6cb6e-63a9-4aa4-a1af-17f58fc852e5-workload-certs\") pod \"data-science-gateway-data-science-gateway-class-595b7776f8tdnqp\" (UID: \"a9c6cb6e-63a9-4aa4-a1af-17f58fc852e5\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-595b7776f8tdnqp" Jun 03 14:01:49.167679 ip-10-0-134-229 kubenswrapper[2574]: I0603 14:01:49.167603 2574 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/a9c6cb6e-63a9-4aa4-a1af-17f58fc852e5-istio-data\") pod \"data-science-gateway-data-science-gateway-class-595b7776f8tdnqp\" (UID: \"a9c6cb6e-63a9-4aa4-a1af-17f58fc852e5\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-595b7776f8tdnqp" Jun 03 14:01:49.167679 ip-10-0-134-229 kubenswrapper[2574]: I0603 14:01:49.167653 2574 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-5bzn2\" (UniqueName: \"kubernetes.io/projected/a9c6cb6e-63a9-4aa4-a1af-17f58fc852e5-kube-api-access-5bzn2\") pod \"data-science-gateway-data-science-gateway-class-595b7776f8tdnqp\" (UID: \"a9c6cb6e-63a9-4aa4-a1af-17f58fc852e5\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-595b7776f8tdnqp" Jun 03 14:01:49.168040 ip-10-0-134-229 kubenswrapper[2574]: I0603 14:01:49.167686 2574 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/a9c6cb6e-63a9-4aa4-a1af-17f58fc852e5-istio-envoy\") pod \"data-science-gateway-data-science-gateway-class-595b7776f8tdnqp\" (UID: \"a9c6cb6e-63a9-4aa4-a1af-17f58fc852e5\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-595b7776f8tdnqp" Jun 03 14:01:49.168040 ip-10-0-134-229 kubenswrapper[2574]: I0603 14:01:49.167972 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/a9c6cb6e-63a9-4aa4-a1af-17f58fc852e5-workload-socket\") pod \"data-science-gateway-data-science-gateway-class-595b7776f8tdnqp\" (UID: \"a9c6cb6e-63a9-4aa4-a1af-17f58fc852e5\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-595b7776f8tdnqp" Jun 03 14:01:49.168143 ip-10-0-134-229 kubenswrapper[2574]: I0603 14:01:49.168102 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/a9c6cb6e-63a9-4aa4-a1af-17f58fc852e5-credential-socket\") pod \"data-science-gateway-data-science-gateway-class-595b7776f8tdnqp\" (UID: \"a9c6cb6e-63a9-4aa4-a1af-17f58fc852e5\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-595b7776f8tdnqp" Jun 03 14:01:49.168143 ip-10-0-134-229 kubenswrapper[2574]: I0603 14:01:49.168127 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/a9c6cb6e-63a9-4aa4-a1af-17f58fc852e5-istio-data\") pod \"data-science-gateway-data-science-gateway-class-595b7776f8tdnqp\" (UID: \"a9c6cb6e-63a9-4aa4-a1af-17f58fc852e5\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-595b7776f8tdnqp" Jun 03 14:01:49.168242 ip-10-0-134-229 kubenswrapper[2574]: I0603 14:01:49.168192 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/a9c6cb6e-63a9-4aa4-a1af-17f58fc852e5-workload-certs\") pod \"data-science-gateway-data-science-gateway-class-595b7776f8tdnqp\" (UID: \"a9c6cb6e-63a9-4aa4-a1af-17f58fc852e5\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-595b7776f8tdnqp" Jun 03 14:01:49.168452 ip-10-0-134-229 kubenswrapper[2574]: I0603 14:01:49.168435 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/a9c6cb6e-63a9-4aa4-a1af-17f58fc852e5-istiod-ca-cert\") pod \"data-science-gateway-data-science-gateway-class-595b7776f8tdnqp\" (UID: \"a9c6cb6e-63a9-4aa4-a1af-17f58fc852e5\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-595b7776f8tdnqp" Jun 03 14:01:49.170016 ip-10-0-134-229 kubenswrapper[2574]: I0603 14:01:49.169998 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/a9c6cb6e-63a9-4aa4-a1af-17f58fc852e5-istio-podinfo\") pod \"data-science-gateway-data-science-gateway-class-595b7776f8tdnqp\" (UID: \"a9c6cb6e-63a9-4aa4-a1af-17f58fc852e5\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-595b7776f8tdnqp" Jun 03 14:01:49.170016 ip-10-0-134-229 kubenswrapper[2574]: I0603 14:01:49.170008 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/a9c6cb6e-63a9-4aa4-a1af-17f58fc852e5-istio-envoy\") pod \"data-science-gateway-data-science-gateway-class-595b7776f8tdnqp\" (UID: \"a9c6cb6e-63a9-4aa4-a1af-17f58fc852e5\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-595b7776f8tdnqp" Jun 03 14:01:49.184027 ip-10-0-134-229 kubenswrapper[2574]: I0603 14:01:49.184005 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/a9c6cb6e-63a9-4aa4-a1af-17f58fc852e5-istio-token\") pod \"data-science-gateway-data-science-gateway-class-595b7776f8tdnqp\" (UID: \"a9c6cb6e-63a9-4aa4-a1af-17f58fc852e5\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-595b7776f8tdnqp" Jun 03 14:01:49.184231 ip-10-0-134-229 kubenswrapper[2574]: I0603 14:01:49.184210 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-5bzn2\" (UniqueName: \"kubernetes.io/projected/a9c6cb6e-63a9-4aa4-a1af-17f58fc852e5-kube-api-access-5bzn2\") pod \"data-science-gateway-data-science-gateway-class-595b7776f8tdnqp\" (UID: \"a9c6cb6e-63a9-4aa4-a1af-17f58fc852e5\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-595b7776f8tdnqp" Jun 03 14:01:49.299799 ip-10-0-134-229 kubenswrapper[2574]: I0603 14:01:49.299722 2574 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-595b7776f8tdnqp" Jun 03 14:01:49.433452 ip-10-0-134-229 kubenswrapper[2574]: I0603 14:01:49.433426 2574 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/data-science-gateway-data-science-gateway-class-595b7776f8tdnqp"] Jun 03 14:01:49.435516 ip-10-0-134-229 kubenswrapper[2574]: W0603 14:01:49.435487 2574 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poda9c6cb6e_63a9_4aa4_a1af_17f58fc852e5.slice/crio-59b8d35a00698eb3b36c94d23190968d3161c5ab49b39c0e57c91b7303349dc5 WatchSource:0}: Error finding container 59b8d35a00698eb3b36c94d23190968d3161c5ab49b39c0e57c91b7303349dc5: Status 404 returned error can't find the container with id 59b8d35a00698eb3b36c94d23190968d3161c5ab49b39c0e57c91b7303349dc5 Jun 03 14:01:49.919615 ip-10-0-134-229 kubenswrapper[2574]: I0603 14:01:49.919574 2574 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-595b7776f8tdnqp" event={"ID":"a9c6cb6e-63a9-4aa4-a1af-17f58fc852e5","Type":"ContainerStarted","Data":"59b8d35a00698eb3b36c94d23190968d3161c5ab49b39c0e57c91b7303349dc5"} Jun 03 14:01:51.700431 ip-10-0-134-229 kubenswrapper[2574]: I0603 14:01:51.700347 2574 kubelet_resources.go:45] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236232Ki","pods":"250"} Jun 03 14:01:51.700723 ip-10-0-134-229 kubenswrapper[2574]: I0603 14:01:51.700472 2574 kubelet_resources.go:45] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236232Ki","pods":"250"} Jun 03 14:01:51.700723 ip-10-0-134-229 kubenswrapper[2574]: I0603 14:01:51.700505 2574 kubelet_resources.go:45] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236232Ki","pods":"250"} Jun 03 14:01:51.926649 ip-10-0-134-229 kubenswrapper[2574]: I0603 14:01:51.926614 2574 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-595b7776f8tdnqp" event={"ID":"a9c6cb6e-63a9-4aa4-a1af-17f58fc852e5","Type":"ContainerStarted","Data":"e899106114d90df3ea6ab2ad0431d91de5b2fa70313509f636d6562e64c873fa"} Jun 03 14:01:51.951022 ip-10-0-134-229 kubenswrapper[2574]: I0603 14:01:51.950935 2574 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-595b7776f8tdnqp" podStartSLOduration=1.688298547 podStartE2EDuration="3.950917654s" podCreationTimestamp="2026-06-03 14:01:48 +0000 UTC" firstStartedPulling="2026-06-03 14:01:49.437508053 +0000 UTC m=+470.621515360" lastFinishedPulling="2026-06-03 14:01:51.700127157 +0000 UTC m=+472.884134467" observedRunningTime="2026-06-03 14:01:51.947197433 +0000 UTC m=+473.131204762" watchObservedRunningTime="2026-06-03 14:01:51.950917654 +0000 UTC m=+473.134924984" Jun 03 14:01:52.299923 ip-10-0-134-229 kubenswrapper[2574]: I0603 14:01:52.299843 2574 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-595b7776f8tdnqp" Jun 03 14:01:52.301076 ip-10-0-134-229 kubenswrapper[2574]: I0603 14:01:52.301051 2574 patch_prober.go:28] interesting pod/data-science-gateway-data-science-gateway-class-595b7776f8tdnqp container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.32:15021/healthz/ready\": dial tcp 10.133.0.32:15021: connect: connection refused" start-of-body= Jun 03 14:01:52.301245 ip-10-0-134-229 kubenswrapper[2574]: I0603 14:01:52.301096 2574 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-595b7776f8tdnqp" podUID="a9c6cb6e-63a9-4aa4-a1af-17f58fc852e5" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.32:15021/healthz/ready\": dial tcp 10.133.0.32:15021: connect: connection refused" Jun 03 14:01:53.300137 ip-10-0-134-229 kubenswrapper[2574]: I0603 14:01:53.300096 2574 patch_prober.go:28] interesting pod/data-science-gateway-data-science-gateway-class-595b7776f8tdnqp container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.32:15021/healthz/ready\": dial tcp 10.133.0.32:15021: connect: connection refused" start-of-body= Jun 03 14:01:53.300552 ip-10-0-134-229 kubenswrapper[2574]: I0603 14:01:53.300155 2574 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-595b7776f8tdnqp" podUID="a9c6cb6e-63a9-4aa4-a1af-17f58fc852e5" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.32:15021/healthz/ready\": dial tcp 10.133.0.32:15021: connect: connection refused" Jun 03 14:01:54.304178 ip-10-0-134-229 kubenswrapper[2574]: I0603 14:01:54.304145 2574 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-595b7776f8tdnqp" Jun 03 14:01:54.936764 ip-10-0-134-229 kubenswrapper[2574]: I0603 14:01:54.936731 2574 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-595b7776f8tdnqp" Jun 03 14:01:54.937639 ip-10-0-134-229 kubenswrapper[2574]: I0603 14:01:54.937620 2574 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-595b7776f8tdnqp" Jun 03 14:02:08.270395 ip-10-0-134-229 kubenswrapper[2574]: I0603 14:02:08.270341 2574 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["kuadrant-system/kuadrant-operator-catalog-trrpv"] Jun 03 14:02:08.273138 ip-10-0-134-229 kubenswrapper[2574]: I0603 14:02:08.273122 2574 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-catalog-trrpv" Jun 03 14:02:08.275835 ip-10-0-134-229 kubenswrapper[2574]: I0603 14:02:08.275810 2574 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"kube-root-ca.crt\"" Jun 03 14:02:08.275950 ip-10-0-134-229 kubenswrapper[2574]: I0603 14:02:08.275850 2574 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"openshift-service-ca.crt\"" Jun 03 14:02:08.276605 ip-10-0-134-229 kubenswrapper[2574]: I0603 14:02:08.276591 2574 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"kuadrant-operator-catalog-dockercfg-rg8c2\"" Jun 03 14:02:08.281749 ip-10-0-134-229 kubenswrapper[2574]: I0603 14:02:08.281723 2574 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-catalog-trrpv"] Jun 03 14:02:08.318731 ip-10-0-134-229 kubenswrapper[2574]: I0603 14:02:08.318702 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-xslqg\" (UniqueName: \"kubernetes.io/projected/c342bed6-8c63-4a0e-b84d-aae3510e6e3f-kube-api-access-xslqg\") pod \"kuadrant-operator-catalog-trrpv\" (UID: \"c342bed6-8c63-4a0e-b84d-aae3510e6e3f\") " pod="kuadrant-system/kuadrant-operator-catalog-trrpv" Jun 03 14:02:08.420097 ip-10-0-134-229 kubenswrapper[2574]: I0603 14:02:08.420049 2574 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-xslqg\" (UniqueName: \"kubernetes.io/projected/c342bed6-8c63-4a0e-b84d-aae3510e6e3f-kube-api-access-xslqg\") pod \"kuadrant-operator-catalog-trrpv\" (UID: \"c342bed6-8c63-4a0e-b84d-aae3510e6e3f\") " pod="kuadrant-system/kuadrant-operator-catalog-trrpv" Jun 03 14:02:08.429082 ip-10-0-134-229 kubenswrapper[2574]: I0603 14:02:08.429040 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-xslqg\" (UniqueName: \"kubernetes.io/projected/c342bed6-8c63-4a0e-b84d-aae3510e6e3f-kube-api-access-xslqg\") pod \"kuadrant-operator-catalog-trrpv\" (UID: \"c342bed6-8c63-4a0e-b84d-aae3510e6e3f\") " pod="kuadrant-system/kuadrant-operator-catalog-trrpv" Jun 03 14:02:08.584072 ip-10-0-134-229 kubenswrapper[2574]: I0603 14:02:08.583978 2574 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-catalog-trrpv" Jun 03 14:02:08.642354 ip-10-0-134-229 kubenswrapper[2574]: I0603 14:02:08.642318 2574 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-catalog-trrpv"] Jun 03 14:02:08.716810 ip-10-0-134-229 kubenswrapper[2574]: I0603 14:02:08.716783 2574 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-catalog-trrpv"] Jun 03 14:02:08.718960 ip-10-0-134-229 kubenswrapper[2574]: W0603 14:02:08.718929 2574 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podc342bed6_8c63_4a0e_b84d_aae3510e6e3f.slice/crio-34ba13d00b722353eed079e91ef783b016d0f8c91f9659a641d0d31eaef23187 WatchSource:0}: Error finding container 34ba13d00b722353eed079e91ef783b016d0f8c91f9659a641d0d31eaef23187: Status 404 returned error can't find the container with id 34ba13d00b722353eed079e91ef783b016d0f8c91f9659a641d0d31eaef23187 Jun 03 14:02:08.867811 ip-10-0-134-229 kubenswrapper[2574]: I0603 14:02:08.867718 2574 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["kuadrant-system/kuadrant-operator-catalog-jxc59"] Jun 03 14:02:08.871255 ip-10-0-134-229 kubenswrapper[2574]: I0603 14:02:08.871232 2574 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-catalog-jxc59" Jun 03 14:02:08.880225 ip-10-0-134-229 kubenswrapper[2574]: I0603 14:02:08.880201 2574 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-catalog-jxc59"] Jun 03 14:02:08.924408 ip-10-0-134-229 kubenswrapper[2574]: I0603 14:02:08.924360 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-4jjbr\" (UniqueName: \"kubernetes.io/projected/59b9d4b1-5622-41e4-b853-64e86df6a596-kube-api-access-4jjbr\") pod \"kuadrant-operator-catalog-jxc59\" (UID: \"59b9d4b1-5622-41e4-b853-64e86df6a596\") " pod="kuadrant-system/kuadrant-operator-catalog-jxc59" Jun 03 14:02:08.987186 ip-10-0-134-229 kubenswrapper[2574]: I0603 14:02:08.987157 2574 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-catalog-trrpv" event={"ID":"c342bed6-8c63-4a0e-b84d-aae3510e6e3f","Type":"ContainerStarted","Data":"34ba13d00b722353eed079e91ef783b016d0f8c91f9659a641d0d31eaef23187"} Jun 03 14:02:09.025682 ip-10-0-134-229 kubenswrapper[2574]: I0603 14:02:09.025655 2574 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-4jjbr\" (UniqueName: \"kubernetes.io/projected/59b9d4b1-5622-41e4-b853-64e86df6a596-kube-api-access-4jjbr\") pod \"kuadrant-operator-catalog-jxc59\" (UID: \"59b9d4b1-5622-41e4-b853-64e86df6a596\") " pod="kuadrant-system/kuadrant-operator-catalog-jxc59" Jun 03 14:02:09.034013 ip-10-0-134-229 kubenswrapper[2574]: I0603 14:02:09.033992 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-4jjbr\" (UniqueName: \"kubernetes.io/projected/59b9d4b1-5622-41e4-b853-64e86df6a596-kube-api-access-4jjbr\") pod \"kuadrant-operator-catalog-jxc59\" (UID: \"59b9d4b1-5622-41e4-b853-64e86df6a596\") " pod="kuadrant-system/kuadrant-operator-catalog-jxc59" Jun 03 14:02:09.181061 ip-10-0-134-229 kubenswrapper[2574]: I0603 14:02:09.181027 2574 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-catalog-jxc59" Jun 03 14:02:09.320928 ip-10-0-134-229 kubenswrapper[2574]: I0603 14:02:09.320905 2574 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-catalog-jxc59"] Jun 03 14:02:09.325065 ip-10-0-134-229 kubenswrapper[2574]: W0603 14:02:09.325036 2574 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod59b9d4b1_5622_41e4_b853_64e86df6a596.slice/crio-95397b90d594bbca54ec63211d0e3064cc076f91916d087cff952c47d93ea97c WatchSource:0}: Error finding container 95397b90d594bbca54ec63211d0e3064cc076f91916d087cff952c47d93ea97c: Status 404 returned error can't find the container with id 95397b90d594bbca54ec63211d0e3064cc076f91916d087cff952c47d93ea97c Jun 03 14:02:09.991396 ip-10-0-134-229 kubenswrapper[2574]: I0603 14:02:09.991345 2574 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-catalog-jxc59" event={"ID":"59b9d4b1-5622-41e4-b853-64e86df6a596","Type":"ContainerStarted","Data":"95397b90d594bbca54ec63211d0e3064cc076f91916d087cff952c47d93ea97c"} Jun 03 14:02:11.999692 ip-10-0-134-229 kubenswrapper[2574]: I0603 14:02:11.999654 2574 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-catalog-jxc59" event={"ID":"59b9d4b1-5622-41e4-b853-64e86df6a596","Type":"ContainerStarted","Data":"1b51b867397599a8c8619bdde3b6ff8991c5fc67cf4f21dec08543dcec76d800"} Jun 03 14:02:12.000919 ip-10-0-134-229 kubenswrapper[2574]: I0603 14:02:12.000887 2574 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-catalog-trrpv" event={"ID":"c342bed6-8c63-4a0e-b84d-aae3510e6e3f","Type":"ContainerStarted","Data":"8e04d0ee9d63a54c6f83f3eccc6e94547d8494aeb68924b4a2893753d9ffb889"} Jun 03 14:02:12.001054 ip-10-0-134-229 kubenswrapper[2574]: I0603 14:02:12.000996 2574 kuberuntime_container.go:864] "Killing container with a grace period" pod="kuadrant-system/kuadrant-operator-catalog-trrpv" podUID="c342bed6-8c63-4a0e-b84d-aae3510e6e3f" containerName="registry-server" containerID="cri-o://8e04d0ee9d63a54c6f83f3eccc6e94547d8494aeb68924b4a2893753d9ffb889" gracePeriod=2 Jun 03 14:02:12.017769 ip-10-0-134-229 kubenswrapper[2574]: I0603 14:02:12.017728 2574 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="kuadrant-system/kuadrant-operator-catalog-jxc59" podStartSLOduration=2.3211649 podStartE2EDuration="4.017714536s" podCreationTimestamp="2026-06-03 14:02:08 +0000 UTC" firstStartedPulling="2026-06-03 14:02:09.326721221 +0000 UTC m=+490.510728545" lastFinishedPulling="2026-06-03 14:02:11.023270864 +0000 UTC m=+492.207278181" observedRunningTime="2026-06-03 14:02:12.01538595 +0000 UTC m=+493.199393269" watchObservedRunningTime="2026-06-03 14:02:12.017714536 +0000 UTC m=+493.201721864" Jun 03 14:02:12.031858 ip-10-0-134-229 kubenswrapper[2574]: I0603 14:02:12.031819 2574 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="kuadrant-system/kuadrant-operator-catalog-trrpv" podStartSLOduration=1.7314951619999999 podStartE2EDuration="4.031806529s" podCreationTimestamp="2026-06-03 14:02:08 +0000 UTC" firstStartedPulling="2026-06-03 14:02:08.72031503 +0000 UTC m=+489.904322337" lastFinishedPulling="2026-06-03 14:02:11.020626381 +0000 UTC m=+492.204633704" observedRunningTime="2026-06-03 14:02:12.030819449 +0000 UTC m=+493.214826778" watchObservedRunningTime="2026-06-03 14:02:12.031806529 +0000 UTC m=+493.215813859" Jun 03 14:02:12.249207 ip-10-0-134-229 kubenswrapper[2574]: I0603 14:02:12.249184 2574 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-catalog-trrpv" Jun 03 14:02:12.353821 ip-10-0-134-229 kubenswrapper[2574]: I0603 14:02:12.353749 2574 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-xslqg\" (UniqueName: \"kubernetes.io/projected/c342bed6-8c63-4a0e-b84d-aae3510e6e3f-kube-api-access-xslqg\") pod \"c342bed6-8c63-4a0e-b84d-aae3510e6e3f\" (UID: \"c342bed6-8c63-4a0e-b84d-aae3510e6e3f\") " Jun 03 14:02:12.355871 ip-10-0-134-229 kubenswrapper[2574]: I0603 14:02:12.355834 2574 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/c342bed6-8c63-4a0e-b84d-aae3510e6e3f-kube-api-access-xslqg" (OuterVolumeSpecName: "kube-api-access-xslqg") pod "c342bed6-8c63-4a0e-b84d-aae3510e6e3f" (UID: "c342bed6-8c63-4a0e-b84d-aae3510e6e3f"). InnerVolumeSpecName "kube-api-access-xslqg". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 03 14:02:12.455039 ip-10-0-134-229 kubenswrapper[2574]: I0603 14:02:12.455008 2574 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-xslqg\" (UniqueName: \"kubernetes.io/projected/c342bed6-8c63-4a0e-b84d-aae3510e6e3f-kube-api-access-xslqg\") on node \"ip-10-0-134-229.ec2.internal\" DevicePath \"\"" Jun 03 14:02:13.005820 ip-10-0-134-229 kubenswrapper[2574]: I0603 14:02:13.005788 2574 generic.go:358] "Generic (PLEG): container finished" podID="c342bed6-8c63-4a0e-b84d-aae3510e6e3f" containerID="8e04d0ee9d63a54c6f83f3eccc6e94547d8494aeb68924b4a2893753d9ffb889" exitCode=0 Jun 03 14:02:13.006204 ip-10-0-134-229 kubenswrapper[2574]: I0603 14:02:13.005851 2574 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-catalog-trrpv" Jun 03 14:02:13.006204 ip-10-0-134-229 kubenswrapper[2574]: I0603 14:02:13.005879 2574 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-catalog-trrpv" event={"ID":"c342bed6-8c63-4a0e-b84d-aae3510e6e3f","Type":"ContainerDied","Data":"8e04d0ee9d63a54c6f83f3eccc6e94547d8494aeb68924b4a2893753d9ffb889"} Jun 03 14:02:13.006204 ip-10-0-134-229 kubenswrapper[2574]: I0603 14:02:13.005919 2574 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-catalog-trrpv" event={"ID":"c342bed6-8c63-4a0e-b84d-aae3510e6e3f","Type":"ContainerDied","Data":"34ba13d00b722353eed079e91ef783b016d0f8c91f9659a641d0d31eaef23187"} Jun 03 14:02:13.006204 ip-10-0-134-229 kubenswrapper[2574]: I0603 14:02:13.005935 2574 scope.go:117] "RemoveContainer" containerID="8e04d0ee9d63a54c6f83f3eccc6e94547d8494aeb68924b4a2893753d9ffb889" Jun 03 14:02:13.015105 ip-10-0-134-229 kubenswrapper[2574]: I0603 14:02:13.015090 2574 scope.go:117] "RemoveContainer" containerID="8e04d0ee9d63a54c6f83f3eccc6e94547d8494aeb68924b4a2893753d9ffb889" Jun 03 14:02:13.015344 ip-10-0-134-229 kubenswrapper[2574]: E0603 14:02:13.015328 2574 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"8e04d0ee9d63a54c6f83f3eccc6e94547d8494aeb68924b4a2893753d9ffb889\": container with ID starting with 8e04d0ee9d63a54c6f83f3eccc6e94547d8494aeb68924b4a2893753d9ffb889 not found: ID does not exist" containerID="8e04d0ee9d63a54c6f83f3eccc6e94547d8494aeb68924b4a2893753d9ffb889" Jun 03 14:02:13.015410 ip-10-0-134-229 kubenswrapper[2574]: I0603 14:02:13.015355 2574 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"8e04d0ee9d63a54c6f83f3eccc6e94547d8494aeb68924b4a2893753d9ffb889"} err="failed to get container status \"8e04d0ee9d63a54c6f83f3eccc6e94547d8494aeb68924b4a2893753d9ffb889\": rpc error: code = NotFound desc = could not find container \"8e04d0ee9d63a54c6f83f3eccc6e94547d8494aeb68924b4a2893753d9ffb889\": container with ID starting with 8e04d0ee9d63a54c6f83f3eccc6e94547d8494aeb68924b4a2893753d9ffb889 not found: ID does not exist" Jun 03 14:02:13.027920 ip-10-0-134-229 kubenswrapper[2574]: I0603 14:02:13.027897 2574 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-catalog-trrpv"] Jun 03 14:02:13.034330 ip-10-0-134-229 kubenswrapper[2574]: I0603 14:02:13.034311 2574 kubelet.go:2547] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/kuadrant-operator-catalog-trrpv"] Jun 03 14:02:13.436087 ip-10-0-134-229 kubenswrapper[2574]: I0603 14:02:13.436044 2574 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="c342bed6-8c63-4a0e-b84d-aae3510e6e3f" path="/var/lib/kubelet/pods/c342bed6-8c63-4a0e-b84d-aae3510e6e3f/volumes" Jun 03 14:02:19.181912 ip-10-0-134-229 kubenswrapper[2574]: I0603 14:02:19.181872 2574 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/kuadrant-operator-catalog-jxc59" Jun 03 14:02:19.182346 ip-10-0-134-229 kubenswrapper[2574]: I0603 14:02:19.181922 2574 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="kuadrant-system/kuadrant-operator-catalog-jxc59" Jun 03 14:02:19.203863 ip-10-0-134-229 kubenswrapper[2574]: I0603 14:02:19.203837 2574 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="started" pod="kuadrant-system/kuadrant-operator-catalog-jxc59" Jun 03 14:02:20.050545 ip-10-0-134-229 kubenswrapper[2574]: I0603 14:02:20.050517 2574 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/kuadrant-operator-catalog-jxc59" Jun 03 14:02:27.458244 ip-10-0-134-229 kubenswrapper[2574]: I0603 14:02:27.458203 2574 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73c5m9d"] Jun 03 14:02:27.458647 ip-10-0-134-229 kubenswrapper[2574]: I0603 14:02:27.458524 2574 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="c342bed6-8c63-4a0e-b84d-aae3510e6e3f" containerName="registry-server" Jun 03 14:02:27.458647 ip-10-0-134-229 kubenswrapper[2574]: I0603 14:02:27.458536 2574 state_mem.go:107] "Deleted CPUSet assignment" podUID="c342bed6-8c63-4a0e-b84d-aae3510e6e3f" containerName="registry-server" Jun 03 14:02:27.458647 ip-10-0-134-229 kubenswrapper[2574]: I0603 14:02:27.458589 2574 memory_manager.go:356] "RemoveStaleState removing state" podUID="c342bed6-8c63-4a0e-b84d-aae3510e6e3f" containerName="registry-server" Jun 03 14:02:27.462105 ip-10-0-134-229 kubenswrapper[2574]: I0603 14:02:27.462086 2574 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73c5m9d" Jun 03 14:02:27.464886 ip-10-0-134-229 kubenswrapper[2574]: I0603 14:02:27.464861 2574 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"default-dockercfg-mbjwr\"" Jun 03 14:02:27.471818 ip-10-0-134-229 kubenswrapper[2574]: I0603 14:02:27.471793 2574 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73c5m9d"] Jun 03 14:02:27.567564 ip-10-0-134-229 kubenswrapper[2574]: I0603 14:02:27.567533 2574 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0hf7vs"] Jun 03 14:02:27.570176 ip-10-0-134-229 kubenswrapper[2574]: I0603 14:02:27.570156 2574 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0hf7vs" Jun 03 14:02:27.574036 ip-10-0-134-229 kubenswrapper[2574]: I0603 14:02:27.574011 2574 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0hf7vs"] Jun 03 14:02:27.578323 ip-10-0-134-229 kubenswrapper[2574]: I0603 14:02:27.578296 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/2973ab60-e6bc-4881-89f8-e86b89234318-util\") pod \"5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73c5m9d\" (UID: \"2973ab60-e6bc-4881-89f8-e86b89234318\") " pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73c5m9d" Jun 03 14:02:27.578487 ip-10-0-134-229 kubenswrapper[2574]: I0603 14:02:27.578365 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-thwbb\" (UniqueName: \"kubernetes.io/projected/2973ab60-e6bc-4881-89f8-e86b89234318-kube-api-access-thwbb\") pod \"5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73c5m9d\" (UID: \"2973ab60-e6bc-4881-89f8-e86b89234318\") " pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73c5m9d" Jun 03 14:02:27.578487 ip-10-0-134-229 kubenswrapper[2574]: I0603 14:02:27.578460 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/2973ab60-e6bc-4881-89f8-e86b89234318-bundle\") pod \"5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73c5m9d\" (UID: \"2973ab60-e6bc-4881-89f8-e86b89234318\") " pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73c5m9d" Jun 03 14:02:27.679638 ip-10-0-134-229 kubenswrapper[2574]: I0603 14:02:27.679611 2574 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-thwbb\" (UniqueName: \"kubernetes.io/projected/2973ab60-e6bc-4881-89f8-e86b89234318-kube-api-access-thwbb\") pod \"5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73c5m9d\" (UID: \"2973ab60-e6bc-4881-89f8-e86b89234318\") " pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73c5m9d" Jun 03 14:02:27.679788 ip-10-0-134-229 kubenswrapper[2574]: I0603 14:02:27.679657 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/36445452-29c7-4a5d-b8cf-7cf102474d3d-bundle\") pod \"19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0hf7vs\" (UID: \"36445452-29c7-4a5d-b8cf-7cf102474d3d\") " pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0hf7vs" Jun 03 14:02:27.679788 ip-10-0-134-229 kubenswrapper[2574]: I0603 14:02:27.679678 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-bh9cx\" (UniqueName: \"kubernetes.io/projected/36445452-29c7-4a5d-b8cf-7cf102474d3d-kube-api-access-bh9cx\") pod \"19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0hf7vs\" (UID: \"36445452-29c7-4a5d-b8cf-7cf102474d3d\") " pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0hf7vs" Jun 03 14:02:27.679788 ip-10-0-134-229 kubenswrapper[2574]: I0603 14:02:27.679708 2574 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/2973ab60-e6bc-4881-89f8-e86b89234318-bundle\") pod \"5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73c5m9d\" (UID: \"2973ab60-e6bc-4881-89f8-e86b89234318\") " pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73c5m9d" Jun 03 14:02:27.679788 ip-10-0-134-229 kubenswrapper[2574]: I0603 14:02:27.679750 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/36445452-29c7-4a5d-b8cf-7cf102474d3d-util\") pod \"19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0hf7vs\" (UID: \"36445452-29c7-4a5d-b8cf-7cf102474d3d\") " pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0hf7vs" Jun 03 14:02:27.679922 ip-10-0-134-229 kubenswrapper[2574]: I0603 14:02:27.679802 2574 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/2973ab60-e6bc-4881-89f8-e86b89234318-util\") pod \"5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73c5m9d\" (UID: \"2973ab60-e6bc-4881-89f8-e86b89234318\") " pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73c5m9d" Jun 03 14:02:27.680075 ip-10-0-134-229 kubenswrapper[2574]: I0603 14:02:27.680055 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/2973ab60-e6bc-4881-89f8-e86b89234318-bundle\") pod \"5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73c5m9d\" (UID: \"2973ab60-e6bc-4881-89f8-e86b89234318\") " pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73c5m9d" Jun 03 14:02:27.680111 ip-10-0-134-229 kubenswrapper[2574]: I0603 14:02:27.680102 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/2973ab60-e6bc-4881-89f8-e86b89234318-util\") pod \"5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73c5m9d\" (UID: \"2973ab60-e6bc-4881-89f8-e86b89234318\") " pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73c5m9d" Jun 03 14:02:27.688711 ip-10-0-134-229 kubenswrapper[2574]: I0603 14:02:27.688682 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-thwbb\" (UniqueName: \"kubernetes.io/projected/2973ab60-e6bc-4881-89f8-e86b89234318-kube-api-access-thwbb\") pod \"5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73c5m9d\" (UID: \"2973ab60-e6bc-4881-89f8-e86b89234318\") " pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73c5m9d" Jun 03 14:02:27.772710 ip-10-0-134-229 kubenswrapper[2574]: I0603 14:02:27.772644 2574 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73c5m9d" Jun 03 14:02:27.780596 ip-10-0-134-229 kubenswrapper[2574]: I0603 14:02:27.780564 2574 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/36445452-29c7-4a5d-b8cf-7cf102474d3d-bundle\") pod \"19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0hf7vs\" (UID: \"36445452-29c7-4a5d-b8cf-7cf102474d3d\") " pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0hf7vs" Jun 03 14:02:27.780700 ip-10-0-134-229 kubenswrapper[2574]: I0603 14:02:27.780601 2574 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-bh9cx\" (UniqueName: \"kubernetes.io/projected/36445452-29c7-4a5d-b8cf-7cf102474d3d-kube-api-access-bh9cx\") pod \"19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0hf7vs\" (UID: \"36445452-29c7-4a5d-b8cf-7cf102474d3d\") " pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0hf7vs" Jun 03 14:02:27.780765 ip-10-0-134-229 kubenswrapper[2574]: I0603 14:02:27.780740 2574 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/36445452-29c7-4a5d-b8cf-7cf102474d3d-util\") pod \"19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0hf7vs\" (UID: \"36445452-29c7-4a5d-b8cf-7cf102474d3d\") " pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0hf7vs" Jun 03 14:02:27.780935 ip-10-0-134-229 kubenswrapper[2574]: I0603 14:02:27.780916 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/36445452-29c7-4a5d-b8cf-7cf102474d3d-bundle\") pod \"19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0hf7vs\" (UID: \"36445452-29c7-4a5d-b8cf-7cf102474d3d\") " pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0hf7vs" Jun 03 14:02:27.781160 ip-10-0-134-229 kubenswrapper[2574]: I0603 14:02:27.781043 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/36445452-29c7-4a5d-b8cf-7cf102474d3d-util\") pod \"19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0hf7vs\" (UID: \"36445452-29c7-4a5d-b8cf-7cf102474d3d\") " pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0hf7vs" Jun 03 14:02:27.790046 ip-10-0-134-229 kubenswrapper[2574]: I0603 14:02:27.790016 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-bh9cx\" (UniqueName: \"kubernetes.io/projected/36445452-29c7-4a5d-b8cf-7cf102474d3d-kube-api-access-bh9cx\") pod \"19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0hf7vs\" (UID: \"36445452-29c7-4a5d-b8cf-7cf102474d3d\") " pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0hf7vs" Jun 03 14:02:27.868742 ip-10-0-134-229 kubenswrapper[2574]: I0603 14:02:27.868705 2574 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759mdnvw"] Jun 03 14:02:27.872770 ip-10-0-134-229 kubenswrapper[2574]: I0603 14:02:27.872738 2574 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759mdnvw" Jun 03 14:02:27.880676 ip-10-0-134-229 kubenswrapper[2574]: I0603 14:02:27.880640 2574 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0hf7vs" Jun 03 14:02:27.882232 ip-10-0-134-229 kubenswrapper[2574]: I0603 14:02:27.881497 2574 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759mdnvw"] Jun 03 14:02:27.907567 ip-10-0-134-229 kubenswrapper[2574]: I0603 14:02:27.907541 2574 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73c5m9d"] Jun 03 14:02:27.908916 ip-10-0-134-229 kubenswrapper[2574]: W0603 14:02:27.908876 2574 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod2973ab60_e6bc_4881_89f8_e86b89234318.slice/crio-98ef2e286ae5d77f70ad6375b40b6709c5f0ef14fc0d32e5d88794335cc8af43 WatchSource:0}: Error finding container 98ef2e286ae5d77f70ad6375b40b6709c5f0ef14fc0d32e5d88794335cc8af43: Status 404 returned error can't find the container with id 98ef2e286ae5d77f70ad6375b40b6709c5f0ef14fc0d32e5d88794335cc8af43 Jun 03 14:02:27.981984 ip-10-0-134-229 kubenswrapper[2574]: I0603 14:02:27.981956 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-xmxpj\" (UniqueName: \"kubernetes.io/projected/d2bf1c3c-90b9-4ba0-b592-faf2a873f3b8-kube-api-access-xmxpj\") pod \"0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759mdnvw\" (UID: \"d2bf1c3c-90b9-4ba0-b592-faf2a873f3b8\") " pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759mdnvw" Jun 03 14:02:27.982115 ip-10-0-134-229 kubenswrapper[2574]: I0603 14:02:27.982018 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/d2bf1c3c-90b9-4ba0-b592-faf2a873f3b8-util\") pod \"0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759mdnvw\" (UID: \"d2bf1c3c-90b9-4ba0-b592-faf2a873f3b8\") " pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759mdnvw" Jun 03 14:02:27.982115 ip-10-0-134-229 kubenswrapper[2574]: I0603 14:02:27.982054 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/d2bf1c3c-90b9-4ba0-b592-faf2a873f3b8-bundle\") pod \"0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759mdnvw\" (UID: \"d2bf1c3c-90b9-4ba0-b592-faf2a873f3b8\") " pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759mdnvw" Jun 03 14:02:28.016864 ip-10-0-134-229 kubenswrapper[2574]: I0603 14:02:28.016837 2574 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0hf7vs"] Jun 03 14:02:28.019674 ip-10-0-134-229 kubenswrapper[2574]: W0603 14:02:28.019641 2574 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod36445452_29c7_4a5d_b8cf_7cf102474d3d.slice/crio-3aeb0a4af2913c7a18d2414a463cb348e86f3b4896e9fa7a5097efd575d4334b WatchSource:0}: Error finding container 3aeb0a4af2913c7a18d2414a463cb348e86f3b4896e9fa7a5097efd575d4334b: Status 404 returned error can't find the container with id 3aeb0a4af2913c7a18d2414a463cb348e86f3b4896e9fa7a5097efd575d4334b Jun 03 14:02:28.055904 ip-10-0-134-229 kubenswrapper[2574]: I0603 14:02:28.055879 2574 generic.go:358] "Generic (PLEG): container finished" podID="2973ab60-e6bc-4881-89f8-e86b89234318" containerID="0f0ba067cd535dac5804366dc163b1f4f4fb201c7d4b58d30fbe8e349d3412c0" exitCode=0 Jun 03 14:02:28.056018 ip-10-0-134-229 kubenswrapper[2574]: I0603 14:02:28.055970 2574 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73c5m9d" event={"ID":"2973ab60-e6bc-4881-89f8-e86b89234318","Type":"ContainerDied","Data":"0f0ba067cd535dac5804366dc163b1f4f4fb201c7d4b58d30fbe8e349d3412c0"} Jun 03 14:02:28.056018 ip-10-0-134-229 kubenswrapper[2574]: I0603 14:02:28.056011 2574 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73c5m9d" event={"ID":"2973ab60-e6bc-4881-89f8-e86b89234318","Type":"ContainerStarted","Data":"98ef2e286ae5d77f70ad6375b40b6709c5f0ef14fc0d32e5d88794335cc8af43"} Jun 03 14:02:28.057095 ip-10-0-134-229 kubenswrapper[2574]: I0603 14:02:28.057068 2574 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0hf7vs" event={"ID":"36445452-29c7-4a5d-b8cf-7cf102474d3d","Type":"ContainerStarted","Data":"3aeb0a4af2913c7a18d2414a463cb348e86f3b4896e9fa7a5097efd575d4334b"} Jun 03 14:02:28.082473 ip-10-0-134-229 kubenswrapper[2574]: I0603 14:02:28.082448 2574 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-xmxpj\" (UniqueName: \"kubernetes.io/projected/d2bf1c3c-90b9-4ba0-b592-faf2a873f3b8-kube-api-access-xmxpj\") pod \"0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759mdnvw\" (UID: \"d2bf1c3c-90b9-4ba0-b592-faf2a873f3b8\") " pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759mdnvw" Jun 03 14:02:28.082578 ip-10-0-134-229 kubenswrapper[2574]: I0603 14:02:28.082490 2574 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/d2bf1c3c-90b9-4ba0-b592-faf2a873f3b8-util\") pod \"0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759mdnvw\" (UID: \"d2bf1c3c-90b9-4ba0-b592-faf2a873f3b8\") " pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759mdnvw" Jun 03 14:02:28.082629 ip-10-0-134-229 kubenswrapper[2574]: I0603 14:02:28.082609 2574 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/d2bf1c3c-90b9-4ba0-b592-faf2a873f3b8-bundle\") pod \"0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759mdnvw\" (UID: \"d2bf1c3c-90b9-4ba0-b592-faf2a873f3b8\") " pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759mdnvw" Jun 03 14:02:28.082760 ip-10-0-134-229 kubenswrapper[2574]: I0603 14:02:28.082745 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/d2bf1c3c-90b9-4ba0-b592-faf2a873f3b8-util\") pod \"0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759mdnvw\" (UID: \"d2bf1c3c-90b9-4ba0-b592-faf2a873f3b8\") " pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759mdnvw" Jun 03 14:02:28.082879 ip-10-0-134-229 kubenswrapper[2574]: I0603 14:02:28.082862 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/d2bf1c3c-90b9-4ba0-b592-faf2a873f3b8-bundle\") pod \"0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759mdnvw\" (UID: \"d2bf1c3c-90b9-4ba0-b592-faf2a873f3b8\") " pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759mdnvw" Jun 03 14:02:28.090918 ip-10-0-134-229 kubenswrapper[2574]: I0603 14:02:28.090892 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-xmxpj\" (UniqueName: \"kubernetes.io/projected/d2bf1c3c-90b9-4ba0-b592-faf2a873f3b8-kube-api-access-xmxpj\") pod \"0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759mdnvw\" (UID: \"d2bf1c3c-90b9-4ba0-b592-faf2a873f3b8\") " pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759mdnvw" Jun 03 14:02:28.186126 ip-10-0-134-229 kubenswrapper[2574]: I0603 14:02:28.186098 2574 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759mdnvw" Jun 03 14:02:28.265496 ip-10-0-134-229 kubenswrapper[2574]: I0603 14:02:28.265466 2574 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1gv8dc"] Jun 03 14:02:28.268727 ip-10-0-134-229 kubenswrapper[2574]: I0603 14:02:28.268705 2574 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1gv8dc" Jun 03 14:02:28.278026 ip-10-0-134-229 kubenswrapper[2574]: I0603 14:02:28.277756 2574 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1gv8dc"] Jun 03 14:02:28.320121 ip-10-0-134-229 kubenswrapper[2574]: I0603 14:02:28.320098 2574 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759mdnvw"] Jun 03 14:02:28.321834 ip-10-0-134-229 kubenswrapper[2574]: W0603 14:02:28.321809 2574 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podd2bf1c3c_90b9_4ba0_b592_faf2a873f3b8.slice/crio-65a9cb3b8faaddff79b01b05136501a666d7059d2163043c0d5d68d25a93498b WatchSource:0}: Error finding container 65a9cb3b8faaddff79b01b05136501a666d7059d2163043c0d5d68d25a93498b: Status 404 returned error can't find the container with id 65a9cb3b8faaddff79b01b05136501a666d7059d2163043c0d5d68d25a93498b Jun 03 14:02:28.384862 ip-10-0-134-229 kubenswrapper[2574]: I0603 14:02:28.384830 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/d786bc75-d2a2-4a1a-aba1-7204c7f79b54-bundle\") pod \"9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1gv8dc\" (UID: \"d786bc75-d2a2-4a1a-aba1-7204c7f79b54\") " pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1gv8dc" Jun 03 14:02:28.384983 ip-10-0-134-229 kubenswrapper[2574]: I0603 14:02:28.384894 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-r5jfp\" (UniqueName: \"kubernetes.io/projected/d786bc75-d2a2-4a1a-aba1-7204c7f79b54-kube-api-access-r5jfp\") pod \"9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1gv8dc\" (UID: \"d786bc75-d2a2-4a1a-aba1-7204c7f79b54\") " pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1gv8dc" Jun 03 14:02:28.385059 ip-10-0-134-229 kubenswrapper[2574]: I0603 14:02:28.385037 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/d786bc75-d2a2-4a1a-aba1-7204c7f79b54-util\") pod \"9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1gv8dc\" (UID: \"d786bc75-d2a2-4a1a-aba1-7204c7f79b54\") " pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1gv8dc" Jun 03 14:02:28.485496 ip-10-0-134-229 kubenswrapper[2574]: I0603 14:02:28.485460 2574 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/d786bc75-d2a2-4a1a-aba1-7204c7f79b54-bundle\") pod \"9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1gv8dc\" (UID: \"d786bc75-d2a2-4a1a-aba1-7204c7f79b54\") " pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1gv8dc" Jun 03 14:02:28.485848 ip-10-0-134-229 kubenswrapper[2574]: I0603 14:02:28.485503 2574 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-r5jfp\" (UniqueName: \"kubernetes.io/projected/d786bc75-d2a2-4a1a-aba1-7204c7f79b54-kube-api-access-r5jfp\") pod \"9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1gv8dc\" (UID: \"d786bc75-d2a2-4a1a-aba1-7204c7f79b54\") " pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1gv8dc" Jun 03 14:02:28.485848 ip-10-0-134-229 kubenswrapper[2574]: I0603 14:02:28.485600 2574 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/d786bc75-d2a2-4a1a-aba1-7204c7f79b54-util\") pod \"9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1gv8dc\" (UID: \"d786bc75-d2a2-4a1a-aba1-7204c7f79b54\") " pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1gv8dc" Jun 03 14:02:28.485920 ip-10-0-134-229 kubenswrapper[2574]: I0603 14:02:28.485873 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/d786bc75-d2a2-4a1a-aba1-7204c7f79b54-bundle\") pod \"9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1gv8dc\" (UID: \"d786bc75-d2a2-4a1a-aba1-7204c7f79b54\") " pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1gv8dc" Jun 03 14:02:28.485954 ip-10-0-134-229 kubenswrapper[2574]: I0603 14:02:28.485919 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/d786bc75-d2a2-4a1a-aba1-7204c7f79b54-util\") pod \"9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1gv8dc\" (UID: \"d786bc75-d2a2-4a1a-aba1-7204c7f79b54\") " pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1gv8dc" Jun 03 14:02:28.493959 ip-10-0-134-229 kubenswrapper[2574]: I0603 14:02:28.493927 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-r5jfp\" (UniqueName: \"kubernetes.io/projected/d786bc75-d2a2-4a1a-aba1-7204c7f79b54-kube-api-access-r5jfp\") pod \"9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1gv8dc\" (UID: \"d786bc75-d2a2-4a1a-aba1-7204c7f79b54\") " pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1gv8dc" Jun 03 14:02:28.580972 ip-10-0-134-229 kubenswrapper[2574]: I0603 14:02:28.580900 2574 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1gv8dc" Jun 03 14:02:28.709366 ip-10-0-134-229 kubenswrapper[2574]: I0603 14:02:28.709339 2574 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1gv8dc"] Jun 03 14:02:28.710897 ip-10-0-134-229 kubenswrapper[2574]: W0603 14:02:28.710868 2574 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podd786bc75_d2a2_4a1a_aba1_7204c7f79b54.slice/crio-e82124926285ce0710b27c9c8f5c51249f4368228934545194bbda4377c34f74 WatchSource:0}: Error finding container e82124926285ce0710b27c9c8f5c51249f4368228934545194bbda4377c34f74: Status 404 returned error can't find the container with id e82124926285ce0710b27c9c8f5c51249f4368228934545194bbda4377c34f74 Jun 03 14:02:29.061548 ip-10-0-134-229 kubenswrapper[2574]: I0603 14:02:29.061512 2574 generic.go:358] "Generic (PLEG): container finished" podID="d786bc75-d2a2-4a1a-aba1-7204c7f79b54" containerID="91543e7c8d617feb77d29bc7db36875ae6b0401535c5fac0f80cd86f355b374d" exitCode=0 Jun 03 14:02:29.061738 ip-10-0-134-229 kubenswrapper[2574]: I0603 14:02:29.061593 2574 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1gv8dc" event={"ID":"d786bc75-d2a2-4a1a-aba1-7204c7f79b54","Type":"ContainerDied","Data":"91543e7c8d617feb77d29bc7db36875ae6b0401535c5fac0f80cd86f355b374d"} Jun 03 14:02:29.061738 ip-10-0-134-229 kubenswrapper[2574]: I0603 14:02:29.061631 2574 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1gv8dc" event={"ID":"d786bc75-d2a2-4a1a-aba1-7204c7f79b54","Type":"ContainerStarted","Data":"e82124926285ce0710b27c9c8f5c51249f4368228934545194bbda4377c34f74"} Jun 03 14:02:29.063305 ip-10-0-134-229 kubenswrapper[2574]: I0603 14:02:29.063281 2574 generic.go:358] "Generic (PLEG): container finished" podID="2973ab60-e6bc-4881-89f8-e86b89234318" containerID="b5cdad71d78850dd33a14eec0689f84af5673a62c42a67cfb4742d4de183b4fa" exitCode=0 Jun 03 14:02:29.063439 ip-10-0-134-229 kubenswrapper[2574]: I0603 14:02:29.063366 2574 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73c5m9d" event={"ID":"2973ab60-e6bc-4881-89f8-e86b89234318","Type":"ContainerDied","Data":"b5cdad71d78850dd33a14eec0689f84af5673a62c42a67cfb4742d4de183b4fa"} Jun 03 14:02:29.064883 ip-10-0-134-229 kubenswrapper[2574]: I0603 14:02:29.064866 2574 generic.go:358] "Generic (PLEG): container finished" podID="36445452-29c7-4a5d-b8cf-7cf102474d3d" containerID="d8b0f03409b036208e6186103a8783728a844a2555e886786eae8d9be6fdd94a" exitCode=0 Jun 03 14:02:29.064983 ip-10-0-134-229 kubenswrapper[2574]: I0603 14:02:29.064938 2574 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0hf7vs" event={"ID":"36445452-29c7-4a5d-b8cf-7cf102474d3d","Type":"ContainerDied","Data":"d8b0f03409b036208e6186103a8783728a844a2555e886786eae8d9be6fdd94a"} Jun 03 14:02:29.066498 ip-10-0-134-229 kubenswrapper[2574]: I0603 14:02:29.066476 2574 generic.go:358] "Generic (PLEG): container finished" podID="d2bf1c3c-90b9-4ba0-b592-faf2a873f3b8" containerID="4c8c3bf7ff0c903fc113b774320dc79fcb982bf5cd6abbfa414085f848da031f" exitCode=0 Jun 03 14:02:29.066584 ip-10-0-134-229 kubenswrapper[2574]: I0603 14:02:29.066514 2574 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759mdnvw" event={"ID":"d2bf1c3c-90b9-4ba0-b592-faf2a873f3b8","Type":"ContainerDied","Data":"4c8c3bf7ff0c903fc113b774320dc79fcb982bf5cd6abbfa414085f848da031f"} Jun 03 14:02:29.066584 ip-10-0-134-229 kubenswrapper[2574]: I0603 14:02:29.066537 2574 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759mdnvw" event={"ID":"d2bf1c3c-90b9-4ba0-b592-faf2a873f3b8","Type":"ContainerStarted","Data":"65a9cb3b8faaddff79b01b05136501a666d7059d2163043c0d5d68d25a93498b"} Jun 03 14:02:30.073154 ip-10-0-134-229 kubenswrapper[2574]: I0603 14:02:30.073117 2574 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1gv8dc" event={"ID":"d786bc75-d2a2-4a1a-aba1-7204c7f79b54","Type":"ContainerStarted","Data":"c4ddad2fb2ef8e544534b16792b056bb8398aea908c51abf742a0aabd5259fa1"} Jun 03 14:02:30.075553 ip-10-0-134-229 kubenswrapper[2574]: I0603 14:02:30.075489 2574 generic.go:358] "Generic (PLEG): container finished" podID="2973ab60-e6bc-4881-89f8-e86b89234318" containerID="1df85f925561aae4475c1ed0c1fd0611a15546d10f1f66e6b16e4473a9f7e721" exitCode=0 Jun 03 14:02:30.075669 ip-10-0-134-229 kubenswrapper[2574]: I0603 14:02:30.075574 2574 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73c5m9d" event={"ID":"2973ab60-e6bc-4881-89f8-e86b89234318","Type":"ContainerDied","Data":"1df85f925561aae4475c1ed0c1fd0611a15546d10f1f66e6b16e4473a9f7e721"} Jun 03 14:02:30.077482 ip-10-0-134-229 kubenswrapper[2574]: I0603 14:02:30.077431 2574 generic.go:358] "Generic (PLEG): container finished" podID="36445452-29c7-4a5d-b8cf-7cf102474d3d" containerID="75f4baa2c6eebfefb5095850fec452b0deb2450856cdea644c3ad8f2813187d1" exitCode=0 Jun 03 14:02:30.077598 ip-10-0-134-229 kubenswrapper[2574]: I0603 14:02:30.077536 2574 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0hf7vs" event={"ID":"36445452-29c7-4a5d-b8cf-7cf102474d3d","Type":"ContainerDied","Data":"75f4baa2c6eebfefb5095850fec452b0deb2450856cdea644c3ad8f2813187d1"} Jun 03 14:02:30.079272 ip-10-0-134-229 kubenswrapper[2574]: I0603 14:02:30.079253 2574 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759mdnvw" event={"ID":"d2bf1c3c-90b9-4ba0-b592-faf2a873f3b8","Type":"ContainerStarted","Data":"616cfc1ff9edd330b9f62e1fedaceda34a3769537356a11b77f8024ee67e20d0"} Jun 03 14:02:31.084648 ip-10-0-134-229 kubenswrapper[2574]: I0603 14:02:31.084547 2574 generic.go:358] "Generic (PLEG): container finished" podID="36445452-29c7-4a5d-b8cf-7cf102474d3d" containerID="ef507367a523a12887133e1f07a56e7450066437d065856eb55baea892ae0f38" exitCode=0 Jun 03 14:02:31.084648 ip-10-0-134-229 kubenswrapper[2574]: I0603 14:02:31.084630 2574 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0hf7vs" event={"ID":"36445452-29c7-4a5d-b8cf-7cf102474d3d","Type":"ContainerDied","Data":"ef507367a523a12887133e1f07a56e7450066437d065856eb55baea892ae0f38"} Jun 03 14:02:31.086437 ip-10-0-134-229 kubenswrapper[2574]: I0603 14:02:31.086415 2574 generic.go:358] "Generic (PLEG): container finished" podID="d2bf1c3c-90b9-4ba0-b592-faf2a873f3b8" containerID="616cfc1ff9edd330b9f62e1fedaceda34a3769537356a11b77f8024ee67e20d0" exitCode=0 Jun 03 14:02:31.086562 ip-10-0-134-229 kubenswrapper[2574]: I0603 14:02:31.086494 2574 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759mdnvw" event={"ID":"d2bf1c3c-90b9-4ba0-b592-faf2a873f3b8","Type":"ContainerDied","Data":"616cfc1ff9edd330b9f62e1fedaceda34a3769537356a11b77f8024ee67e20d0"} Jun 03 14:02:31.088167 ip-10-0-134-229 kubenswrapper[2574]: I0603 14:02:31.088144 2574 generic.go:358] "Generic (PLEG): container finished" podID="d786bc75-d2a2-4a1a-aba1-7204c7f79b54" containerID="c4ddad2fb2ef8e544534b16792b056bb8398aea908c51abf742a0aabd5259fa1" exitCode=0 Jun 03 14:02:31.088234 ip-10-0-134-229 kubenswrapper[2574]: I0603 14:02:31.088217 2574 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1gv8dc" event={"ID":"d786bc75-d2a2-4a1a-aba1-7204c7f79b54","Type":"ContainerDied","Data":"c4ddad2fb2ef8e544534b16792b056bb8398aea908c51abf742a0aabd5259fa1"} Jun 03 14:02:31.223527 ip-10-0-134-229 kubenswrapper[2574]: I0603 14:02:31.223504 2574 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73c5m9d" Jun 03 14:02:31.307895 ip-10-0-134-229 kubenswrapper[2574]: I0603 14:02:31.307865 2574 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-thwbb\" (UniqueName: \"kubernetes.io/projected/2973ab60-e6bc-4881-89f8-e86b89234318-kube-api-access-thwbb\") pod \"2973ab60-e6bc-4881-89f8-e86b89234318\" (UID: \"2973ab60-e6bc-4881-89f8-e86b89234318\") " Jun 03 14:02:31.307995 ip-10-0-134-229 kubenswrapper[2574]: I0603 14:02:31.307914 2574 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/2973ab60-e6bc-4881-89f8-e86b89234318-util\") pod \"2973ab60-e6bc-4881-89f8-e86b89234318\" (UID: \"2973ab60-e6bc-4881-89f8-e86b89234318\") " Jun 03 14:02:31.307995 ip-10-0-134-229 kubenswrapper[2574]: I0603 14:02:31.307952 2574 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/2973ab60-e6bc-4881-89f8-e86b89234318-bundle\") pod \"2973ab60-e6bc-4881-89f8-e86b89234318\" (UID: \"2973ab60-e6bc-4881-89f8-e86b89234318\") " Jun 03 14:02:31.308575 ip-10-0-134-229 kubenswrapper[2574]: I0603 14:02:31.308546 2574 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/2973ab60-e6bc-4881-89f8-e86b89234318-bundle" (OuterVolumeSpecName: "bundle") pod "2973ab60-e6bc-4881-89f8-e86b89234318" (UID: "2973ab60-e6bc-4881-89f8-e86b89234318"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jun 03 14:02:31.309799 ip-10-0-134-229 kubenswrapper[2574]: I0603 14:02:31.309776 2574 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/2973ab60-e6bc-4881-89f8-e86b89234318-kube-api-access-thwbb" (OuterVolumeSpecName: "kube-api-access-thwbb") pod "2973ab60-e6bc-4881-89f8-e86b89234318" (UID: "2973ab60-e6bc-4881-89f8-e86b89234318"). InnerVolumeSpecName "kube-api-access-thwbb". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 03 14:02:31.313366 ip-10-0-134-229 kubenswrapper[2574]: I0603 14:02:31.313329 2574 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/2973ab60-e6bc-4881-89f8-e86b89234318-util" (OuterVolumeSpecName: "util") pod "2973ab60-e6bc-4881-89f8-e86b89234318" (UID: "2973ab60-e6bc-4881-89f8-e86b89234318"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jun 03 14:02:31.409255 ip-10-0-134-229 kubenswrapper[2574]: I0603 14:02:31.409229 2574 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/2973ab60-e6bc-4881-89f8-e86b89234318-util\") on node \"ip-10-0-134-229.ec2.internal\" DevicePath \"\"" Jun 03 14:02:31.409255 ip-10-0-134-229 kubenswrapper[2574]: I0603 14:02:31.409252 2574 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/2973ab60-e6bc-4881-89f8-e86b89234318-bundle\") on node \"ip-10-0-134-229.ec2.internal\" DevicePath \"\"" Jun 03 14:02:31.409412 ip-10-0-134-229 kubenswrapper[2574]: I0603 14:02:31.409263 2574 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-thwbb\" (UniqueName: \"kubernetes.io/projected/2973ab60-e6bc-4881-89f8-e86b89234318-kube-api-access-thwbb\") on node \"ip-10-0-134-229.ec2.internal\" DevicePath \"\"" Jun 03 14:02:32.093149 ip-10-0-134-229 kubenswrapper[2574]: I0603 14:02:32.093049 2574 generic.go:358] "Generic (PLEG): container finished" podID="d2bf1c3c-90b9-4ba0-b592-faf2a873f3b8" containerID="cb215db7f60e552a946e0f12d95189d356ead4fce77a5f4f05370804aae24c72" exitCode=0 Jun 03 14:02:32.093149 ip-10-0-134-229 kubenswrapper[2574]: I0603 14:02:32.093133 2574 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759mdnvw" event={"ID":"d2bf1c3c-90b9-4ba0-b592-faf2a873f3b8","Type":"ContainerDied","Data":"cb215db7f60e552a946e0f12d95189d356ead4fce77a5f4f05370804aae24c72"} Jun 03 14:02:32.094930 ip-10-0-134-229 kubenswrapper[2574]: I0603 14:02:32.094911 2574 generic.go:358] "Generic (PLEG): container finished" podID="d786bc75-d2a2-4a1a-aba1-7204c7f79b54" containerID="4681d2a24bd7e456c98fe97cd53a5d1df721bc2b4b92df668ca64718962f00bf" exitCode=0 Jun 03 14:02:32.094998 ip-10-0-134-229 kubenswrapper[2574]: I0603 14:02:32.094986 2574 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1gv8dc" event={"ID":"d786bc75-d2a2-4a1a-aba1-7204c7f79b54","Type":"ContainerDied","Data":"4681d2a24bd7e456c98fe97cd53a5d1df721bc2b4b92df668ca64718962f00bf"} Jun 03 14:02:32.096418 ip-10-0-134-229 kubenswrapper[2574]: I0603 14:02:32.096400 2574 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73c5m9d" event={"ID":"2973ab60-e6bc-4881-89f8-e86b89234318","Type":"ContainerDied","Data":"98ef2e286ae5d77f70ad6375b40b6709c5f0ef14fc0d32e5d88794335cc8af43"} Jun 03 14:02:32.096511 ip-10-0-134-229 kubenswrapper[2574]: I0603 14:02:32.096422 2574 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="98ef2e286ae5d77f70ad6375b40b6709c5f0ef14fc0d32e5d88794335cc8af43" Jun 03 14:02:32.096511 ip-10-0-134-229 kubenswrapper[2574]: I0603 14:02:32.096431 2574 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73c5m9d" Jun 03 14:02:32.224663 ip-10-0-134-229 kubenswrapper[2574]: I0603 14:02:32.224637 2574 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0hf7vs" Jun 03 14:02:32.316013 ip-10-0-134-229 kubenswrapper[2574]: I0603 14:02:32.315984 2574 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/36445452-29c7-4a5d-b8cf-7cf102474d3d-bundle\") pod \"36445452-29c7-4a5d-b8cf-7cf102474d3d\" (UID: \"36445452-29c7-4a5d-b8cf-7cf102474d3d\") " Jun 03 14:02:32.316180 ip-10-0-134-229 kubenswrapper[2574]: I0603 14:02:32.316028 2574 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/36445452-29c7-4a5d-b8cf-7cf102474d3d-util\") pod \"36445452-29c7-4a5d-b8cf-7cf102474d3d\" (UID: \"36445452-29c7-4a5d-b8cf-7cf102474d3d\") " Jun 03 14:02:32.316180 ip-10-0-134-229 kubenswrapper[2574]: I0603 14:02:32.316064 2574 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-bh9cx\" (UniqueName: \"kubernetes.io/projected/36445452-29c7-4a5d-b8cf-7cf102474d3d-kube-api-access-bh9cx\") pod \"36445452-29c7-4a5d-b8cf-7cf102474d3d\" (UID: \"36445452-29c7-4a5d-b8cf-7cf102474d3d\") " Jun 03 14:02:32.316510 ip-10-0-134-229 kubenswrapper[2574]: I0603 14:02:32.316479 2574 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/36445452-29c7-4a5d-b8cf-7cf102474d3d-bundle" (OuterVolumeSpecName: "bundle") pod "36445452-29c7-4a5d-b8cf-7cf102474d3d" (UID: "36445452-29c7-4a5d-b8cf-7cf102474d3d"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jun 03 14:02:32.318156 ip-10-0-134-229 kubenswrapper[2574]: I0603 14:02:32.318130 2574 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/36445452-29c7-4a5d-b8cf-7cf102474d3d-kube-api-access-bh9cx" (OuterVolumeSpecName: "kube-api-access-bh9cx") pod "36445452-29c7-4a5d-b8cf-7cf102474d3d" (UID: "36445452-29c7-4a5d-b8cf-7cf102474d3d"). InnerVolumeSpecName "kube-api-access-bh9cx". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 03 14:02:32.321461 ip-10-0-134-229 kubenswrapper[2574]: I0603 14:02:32.321439 2574 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/36445452-29c7-4a5d-b8cf-7cf102474d3d-util" (OuterVolumeSpecName: "util") pod "36445452-29c7-4a5d-b8cf-7cf102474d3d" (UID: "36445452-29c7-4a5d-b8cf-7cf102474d3d"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jun 03 14:02:32.417473 ip-10-0-134-229 kubenswrapper[2574]: I0603 14:02:32.417445 2574 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/36445452-29c7-4a5d-b8cf-7cf102474d3d-bundle\") on node \"ip-10-0-134-229.ec2.internal\" DevicePath \"\"" Jun 03 14:02:32.417473 ip-10-0-134-229 kubenswrapper[2574]: I0603 14:02:32.417469 2574 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/36445452-29c7-4a5d-b8cf-7cf102474d3d-util\") on node \"ip-10-0-134-229.ec2.internal\" DevicePath \"\"" Jun 03 14:02:32.417635 ip-10-0-134-229 kubenswrapper[2574]: I0603 14:02:32.417479 2574 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-bh9cx\" (UniqueName: \"kubernetes.io/projected/36445452-29c7-4a5d-b8cf-7cf102474d3d-kube-api-access-bh9cx\") on node \"ip-10-0-134-229.ec2.internal\" DevicePath \"\"" Jun 03 14:02:33.101900 ip-10-0-134-229 kubenswrapper[2574]: I0603 14:02:33.101865 2574 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0hf7vs" Jun 03 14:02:33.102245 ip-10-0-134-229 kubenswrapper[2574]: I0603 14:02:33.101870 2574 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0hf7vs" event={"ID":"36445452-29c7-4a5d-b8cf-7cf102474d3d","Type":"ContainerDied","Data":"3aeb0a4af2913c7a18d2414a463cb348e86f3b4896e9fa7a5097efd575d4334b"} Jun 03 14:02:33.102245 ip-10-0-134-229 kubenswrapper[2574]: I0603 14:02:33.101973 2574 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="3aeb0a4af2913c7a18d2414a463cb348e86f3b4896e9fa7a5097efd575d4334b" Jun 03 14:02:33.232294 ip-10-0-134-229 kubenswrapper[2574]: I0603 14:02:33.232270 2574 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1gv8dc" Jun 03 14:02:33.260271 ip-10-0-134-229 kubenswrapper[2574]: I0603 14:02:33.260249 2574 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759mdnvw" Jun 03 14:02:33.325055 ip-10-0-134-229 kubenswrapper[2574]: I0603 14:02:33.325025 2574 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/d2bf1c3c-90b9-4ba0-b592-faf2a873f3b8-util\") pod \"d2bf1c3c-90b9-4ba0-b592-faf2a873f3b8\" (UID: \"d2bf1c3c-90b9-4ba0-b592-faf2a873f3b8\") " Jun 03 14:02:33.325238 ip-10-0-134-229 kubenswrapper[2574]: I0603 14:02:33.325085 2574 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-xmxpj\" (UniqueName: \"kubernetes.io/projected/d2bf1c3c-90b9-4ba0-b592-faf2a873f3b8-kube-api-access-xmxpj\") pod \"d2bf1c3c-90b9-4ba0-b592-faf2a873f3b8\" (UID: \"d2bf1c3c-90b9-4ba0-b592-faf2a873f3b8\") " Jun 03 14:02:33.325238 ip-10-0-134-229 kubenswrapper[2574]: I0603 14:02:33.325101 2574 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-r5jfp\" (UniqueName: \"kubernetes.io/projected/d786bc75-d2a2-4a1a-aba1-7204c7f79b54-kube-api-access-r5jfp\") pod \"d786bc75-d2a2-4a1a-aba1-7204c7f79b54\" (UID: \"d786bc75-d2a2-4a1a-aba1-7204c7f79b54\") " Jun 03 14:02:33.325238 ip-10-0-134-229 kubenswrapper[2574]: I0603 14:02:33.325138 2574 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/d786bc75-d2a2-4a1a-aba1-7204c7f79b54-util\") pod \"d786bc75-d2a2-4a1a-aba1-7204c7f79b54\" (UID: \"d786bc75-d2a2-4a1a-aba1-7204c7f79b54\") " Jun 03 14:02:33.325238 ip-10-0-134-229 kubenswrapper[2574]: I0603 14:02:33.325170 2574 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/d2bf1c3c-90b9-4ba0-b592-faf2a873f3b8-bundle\") pod \"d2bf1c3c-90b9-4ba0-b592-faf2a873f3b8\" (UID: \"d2bf1c3c-90b9-4ba0-b592-faf2a873f3b8\") " Jun 03 14:02:33.325238 ip-10-0-134-229 kubenswrapper[2574]: I0603 14:02:33.325186 2574 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/d786bc75-d2a2-4a1a-aba1-7204c7f79b54-bundle\") pod \"d786bc75-d2a2-4a1a-aba1-7204c7f79b54\" (UID: \"d786bc75-d2a2-4a1a-aba1-7204c7f79b54\") " Jun 03 14:02:33.325719 ip-10-0-134-229 kubenswrapper[2574]: I0603 14:02:33.325673 2574 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/d2bf1c3c-90b9-4ba0-b592-faf2a873f3b8-bundle" (OuterVolumeSpecName: "bundle") pod "d2bf1c3c-90b9-4ba0-b592-faf2a873f3b8" (UID: "d2bf1c3c-90b9-4ba0-b592-faf2a873f3b8"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jun 03 14:02:33.325823 ip-10-0-134-229 kubenswrapper[2574]: I0603 14:02:33.325799 2574 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/d786bc75-d2a2-4a1a-aba1-7204c7f79b54-bundle" (OuterVolumeSpecName: "bundle") pod "d786bc75-d2a2-4a1a-aba1-7204c7f79b54" (UID: "d786bc75-d2a2-4a1a-aba1-7204c7f79b54"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jun 03 14:02:33.327316 ip-10-0-134-229 kubenswrapper[2574]: I0603 14:02:33.327294 2574 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/d2bf1c3c-90b9-4ba0-b592-faf2a873f3b8-kube-api-access-xmxpj" (OuterVolumeSpecName: "kube-api-access-xmxpj") pod "d2bf1c3c-90b9-4ba0-b592-faf2a873f3b8" (UID: "d2bf1c3c-90b9-4ba0-b592-faf2a873f3b8"). InnerVolumeSpecName "kube-api-access-xmxpj". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 03 14:02:33.327417 ip-10-0-134-229 kubenswrapper[2574]: I0603 14:02:33.327332 2574 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/d786bc75-d2a2-4a1a-aba1-7204c7f79b54-kube-api-access-r5jfp" (OuterVolumeSpecName: "kube-api-access-r5jfp") pod "d786bc75-d2a2-4a1a-aba1-7204c7f79b54" (UID: "d786bc75-d2a2-4a1a-aba1-7204c7f79b54"). InnerVolumeSpecName "kube-api-access-r5jfp". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 03 14:02:33.333659 ip-10-0-134-229 kubenswrapper[2574]: I0603 14:02:33.333630 2574 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/d786bc75-d2a2-4a1a-aba1-7204c7f79b54-util" (OuterVolumeSpecName: "util") pod "d786bc75-d2a2-4a1a-aba1-7204c7f79b54" (UID: "d786bc75-d2a2-4a1a-aba1-7204c7f79b54"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jun 03 14:02:33.333829 ip-10-0-134-229 kubenswrapper[2574]: I0603 14:02:33.333813 2574 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/d2bf1c3c-90b9-4ba0-b592-faf2a873f3b8-util" (OuterVolumeSpecName: "util") pod "d2bf1c3c-90b9-4ba0-b592-faf2a873f3b8" (UID: "d2bf1c3c-90b9-4ba0-b592-faf2a873f3b8"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jun 03 14:02:33.426254 ip-10-0-134-229 kubenswrapper[2574]: I0603 14:02:33.426223 2574 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/d2bf1c3c-90b9-4ba0-b592-faf2a873f3b8-bundle\") on node \"ip-10-0-134-229.ec2.internal\" DevicePath \"\"" Jun 03 14:02:33.426254 ip-10-0-134-229 kubenswrapper[2574]: I0603 14:02:33.426250 2574 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/d786bc75-d2a2-4a1a-aba1-7204c7f79b54-bundle\") on node \"ip-10-0-134-229.ec2.internal\" DevicePath \"\"" Jun 03 14:02:33.426472 ip-10-0-134-229 kubenswrapper[2574]: I0603 14:02:33.426262 2574 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/d2bf1c3c-90b9-4ba0-b592-faf2a873f3b8-util\") on node \"ip-10-0-134-229.ec2.internal\" DevicePath \"\"" Jun 03 14:02:33.426472 ip-10-0-134-229 kubenswrapper[2574]: I0603 14:02:33.426276 2574 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-xmxpj\" (UniqueName: \"kubernetes.io/projected/d2bf1c3c-90b9-4ba0-b592-faf2a873f3b8-kube-api-access-xmxpj\") on node \"ip-10-0-134-229.ec2.internal\" DevicePath \"\"" Jun 03 14:02:33.426472 ip-10-0-134-229 kubenswrapper[2574]: I0603 14:02:33.426289 2574 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-r5jfp\" (UniqueName: \"kubernetes.io/projected/d786bc75-d2a2-4a1a-aba1-7204c7f79b54-kube-api-access-r5jfp\") on node \"ip-10-0-134-229.ec2.internal\" DevicePath \"\"" Jun 03 14:02:33.426472 ip-10-0-134-229 kubenswrapper[2574]: I0603 14:02:33.426301 2574 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/d786bc75-d2a2-4a1a-aba1-7204c7f79b54-util\") on node \"ip-10-0-134-229.ec2.internal\" DevicePath \"\"" Jun 03 14:02:34.106986 ip-10-0-134-229 kubenswrapper[2574]: I0603 14:02:34.106958 2574 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759mdnvw" Jun 03 14:02:34.107417 ip-10-0-134-229 kubenswrapper[2574]: I0603 14:02:34.106982 2574 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759mdnvw" event={"ID":"d2bf1c3c-90b9-4ba0-b592-faf2a873f3b8","Type":"ContainerDied","Data":"65a9cb3b8faaddff79b01b05136501a666d7059d2163043c0d5d68d25a93498b"} Jun 03 14:02:34.107417 ip-10-0-134-229 kubenswrapper[2574]: I0603 14:02:34.107015 2574 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="65a9cb3b8faaddff79b01b05136501a666d7059d2163043c0d5d68d25a93498b" Jun 03 14:02:34.108785 ip-10-0-134-229 kubenswrapper[2574]: I0603 14:02:34.108759 2574 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1gv8dc" event={"ID":"d786bc75-d2a2-4a1a-aba1-7204c7f79b54","Type":"ContainerDied","Data":"e82124926285ce0710b27c9c8f5c51249f4368228934545194bbda4377c34f74"} Jun 03 14:02:34.108918 ip-10-0-134-229 kubenswrapper[2574]: I0603 14:02:34.108819 2574 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="e82124926285ce0710b27c9c8f5c51249f4368228934545194bbda4377c34f74" Jun 03 14:02:34.108918 ip-10-0-134-229 kubenswrapper[2574]: I0603 14:02:34.108844 2574 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1gv8dc" Jun 03 14:02:42.754923 ip-10-0-134-229 kubenswrapper[2574]: I0603 14:02:42.754832 2574 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["kuadrant-system/dns-operator-controller-manager-648d5c98bc-csdwr"] Jun 03 14:02:42.755348 ip-10-0-134-229 kubenswrapper[2574]: I0603 14:02:42.755187 2574 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="d2bf1c3c-90b9-4ba0-b592-faf2a873f3b8" containerName="pull" Jun 03 14:02:42.755348 ip-10-0-134-229 kubenswrapper[2574]: I0603 14:02:42.755200 2574 state_mem.go:107] "Deleted CPUSet assignment" podUID="d2bf1c3c-90b9-4ba0-b592-faf2a873f3b8" containerName="pull" Jun 03 14:02:42.755348 ip-10-0-134-229 kubenswrapper[2574]: I0603 14:02:42.755215 2574 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="36445452-29c7-4a5d-b8cf-7cf102474d3d" containerName="pull" Jun 03 14:02:42.755348 ip-10-0-134-229 kubenswrapper[2574]: I0603 14:02:42.755220 2574 state_mem.go:107] "Deleted CPUSet assignment" podUID="36445452-29c7-4a5d-b8cf-7cf102474d3d" containerName="pull" Jun 03 14:02:42.755348 ip-10-0-134-229 kubenswrapper[2574]: I0603 14:02:42.755226 2574 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="d786bc75-d2a2-4a1a-aba1-7204c7f79b54" containerName="pull" Jun 03 14:02:42.755348 ip-10-0-134-229 kubenswrapper[2574]: I0603 14:02:42.755231 2574 state_mem.go:107] "Deleted CPUSet assignment" podUID="d786bc75-d2a2-4a1a-aba1-7204c7f79b54" containerName="pull" Jun 03 14:02:42.755348 ip-10-0-134-229 kubenswrapper[2574]: I0603 14:02:42.755242 2574 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="d786bc75-d2a2-4a1a-aba1-7204c7f79b54" containerName="util" Jun 03 14:02:42.755348 ip-10-0-134-229 kubenswrapper[2574]: I0603 14:02:42.755247 2574 state_mem.go:107] "Deleted CPUSet assignment" podUID="d786bc75-d2a2-4a1a-aba1-7204c7f79b54" containerName="util" Jun 03 14:02:42.755348 ip-10-0-134-229 kubenswrapper[2574]: I0603 14:02:42.755254 2574 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="2973ab60-e6bc-4881-89f8-e86b89234318" containerName="pull" Jun 03 14:02:42.755348 ip-10-0-134-229 kubenswrapper[2574]: I0603 14:02:42.755259 2574 state_mem.go:107] "Deleted CPUSet assignment" podUID="2973ab60-e6bc-4881-89f8-e86b89234318" containerName="pull" Jun 03 14:02:42.755348 ip-10-0-134-229 kubenswrapper[2574]: I0603 14:02:42.755265 2574 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="d786bc75-d2a2-4a1a-aba1-7204c7f79b54" containerName="extract" Jun 03 14:02:42.755348 ip-10-0-134-229 kubenswrapper[2574]: I0603 14:02:42.755271 2574 state_mem.go:107] "Deleted CPUSet assignment" podUID="d786bc75-d2a2-4a1a-aba1-7204c7f79b54" containerName="extract" Jun 03 14:02:42.755348 ip-10-0-134-229 kubenswrapper[2574]: I0603 14:02:42.755280 2574 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="36445452-29c7-4a5d-b8cf-7cf102474d3d" containerName="extract" Jun 03 14:02:42.755348 ip-10-0-134-229 kubenswrapper[2574]: I0603 14:02:42.755284 2574 state_mem.go:107] "Deleted CPUSet assignment" podUID="36445452-29c7-4a5d-b8cf-7cf102474d3d" containerName="extract" Jun 03 14:02:42.755348 ip-10-0-134-229 kubenswrapper[2574]: I0603 14:02:42.755291 2574 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="d2bf1c3c-90b9-4ba0-b592-faf2a873f3b8" containerName="extract" Jun 03 14:02:42.755348 ip-10-0-134-229 kubenswrapper[2574]: I0603 14:02:42.755297 2574 state_mem.go:107] "Deleted CPUSet assignment" podUID="d2bf1c3c-90b9-4ba0-b592-faf2a873f3b8" containerName="extract" Jun 03 14:02:42.755348 ip-10-0-134-229 kubenswrapper[2574]: I0603 14:02:42.755305 2574 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="36445452-29c7-4a5d-b8cf-7cf102474d3d" containerName="util" Jun 03 14:02:42.755348 ip-10-0-134-229 kubenswrapper[2574]: I0603 14:02:42.755310 2574 state_mem.go:107] "Deleted CPUSet assignment" podUID="36445452-29c7-4a5d-b8cf-7cf102474d3d" containerName="util" Jun 03 14:02:42.755348 ip-10-0-134-229 kubenswrapper[2574]: I0603 14:02:42.755317 2574 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="2973ab60-e6bc-4881-89f8-e86b89234318" containerName="util" Jun 03 14:02:42.755348 ip-10-0-134-229 kubenswrapper[2574]: I0603 14:02:42.755321 2574 state_mem.go:107] "Deleted CPUSet assignment" podUID="2973ab60-e6bc-4881-89f8-e86b89234318" containerName="util" Jun 03 14:02:42.755348 ip-10-0-134-229 kubenswrapper[2574]: I0603 14:02:42.755328 2574 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="d2bf1c3c-90b9-4ba0-b592-faf2a873f3b8" containerName="util" Jun 03 14:02:42.755348 ip-10-0-134-229 kubenswrapper[2574]: I0603 14:02:42.755333 2574 state_mem.go:107] "Deleted CPUSet assignment" podUID="d2bf1c3c-90b9-4ba0-b592-faf2a873f3b8" containerName="util" Jun 03 14:02:42.755348 ip-10-0-134-229 kubenswrapper[2574]: I0603 14:02:42.755338 2574 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="2973ab60-e6bc-4881-89f8-e86b89234318" containerName="extract" Jun 03 14:02:42.755348 ip-10-0-134-229 kubenswrapper[2574]: I0603 14:02:42.755343 2574 state_mem.go:107] "Deleted CPUSet assignment" podUID="2973ab60-e6bc-4881-89f8-e86b89234318" containerName="extract" Jun 03 14:02:42.756051 ip-10-0-134-229 kubenswrapper[2574]: I0603 14:02:42.755409 2574 memory_manager.go:356] "RemoveStaleState removing state" podUID="d2bf1c3c-90b9-4ba0-b592-faf2a873f3b8" containerName="extract" Jun 03 14:02:42.756051 ip-10-0-134-229 kubenswrapper[2574]: I0603 14:02:42.755421 2574 memory_manager.go:356] "RemoveStaleState removing state" podUID="36445452-29c7-4a5d-b8cf-7cf102474d3d" containerName="extract" Jun 03 14:02:42.756051 ip-10-0-134-229 kubenswrapper[2574]: I0603 14:02:42.755427 2574 memory_manager.go:356] "RemoveStaleState removing state" podUID="d786bc75-d2a2-4a1a-aba1-7204c7f79b54" containerName="extract" Jun 03 14:02:42.756051 ip-10-0-134-229 kubenswrapper[2574]: I0603 14:02:42.755434 2574 memory_manager.go:356] "RemoveStaleState removing state" podUID="2973ab60-e6bc-4881-89f8-e86b89234318" containerName="extract" Jun 03 14:02:42.757266 ip-10-0-134-229 kubenswrapper[2574]: I0603 14:02:42.757250 2574 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/dns-operator-controller-manager-648d5c98bc-csdwr" Jun 03 14:02:42.759866 ip-10-0-134-229 kubenswrapper[2574]: I0603 14:02:42.759835 2574 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"dns-operator-controller-manager-dockercfg-9rqhp\"" Jun 03 14:02:42.760004 ip-10-0-134-229 kubenswrapper[2574]: I0603 14:02:42.759975 2574 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"dns-operator-controller-env\"" Jun 03 14:02:42.772039 ip-10-0-134-229 kubenswrapper[2574]: I0603 14:02:42.771996 2574 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/dns-operator-controller-manager-648d5c98bc-csdwr"] Jun 03 14:02:42.904551 ip-10-0-134-229 kubenswrapper[2574]: I0603 14:02:42.904510 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-sxb4p\" (UniqueName: \"kubernetes.io/projected/bc7c3cdb-9b11-427f-bf82-8985c5c76e92-kube-api-access-sxb4p\") pod \"dns-operator-controller-manager-648d5c98bc-csdwr\" (UID: \"bc7c3cdb-9b11-427f-bf82-8985c5c76e92\") " pod="kuadrant-system/dns-operator-controller-manager-648d5c98bc-csdwr" Jun 03 14:02:43.005397 ip-10-0-134-229 kubenswrapper[2574]: I0603 14:02:43.005304 2574 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-sxb4p\" (UniqueName: \"kubernetes.io/projected/bc7c3cdb-9b11-427f-bf82-8985c5c76e92-kube-api-access-sxb4p\") pod \"dns-operator-controller-manager-648d5c98bc-csdwr\" (UID: \"bc7c3cdb-9b11-427f-bf82-8985c5c76e92\") " pod="kuadrant-system/dns-operator-controller-manager-648d5c98bc-csdwr" Jun 03 14:02:43.013915 ip-10-0-134-229 kubenswrapper[2574]: I0603 14:02:43.013881 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-sxb4p\" (UniqueName: \"kubernetes.io/projected/bc7c3cdb-9b11-427f-bf82-8985c5c76e92-kube-api-access-sxb4p\") pod \"dns-operator-controller-manager-648d5c98bc-csdwr\" (UID: \"bc7c3cdb-9b11-427f-bf82-8985c5c76e92\") " pod="kuadrant-system/dns-operator-controller-manager-648d5c98bc-csdwr" Jun 03 14:02:43.073816 ip-10-0-134-229 kubenswrapper[2574]: I0603 14:02:43.073784 2574 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/dns-operator-controller-manager-648d5c98bc-csdwr" Jun 03 14:02:43.201501 ip-10-0-134-229 kubenswrapper[2574]: I0603 14:02:43.201423 2574 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/dns-operator-controller-manager-648d5c98bc-csdwr"] Jun 03 14:02:43.203827 ip-10-0-134-229 kubenswrapper[2574]: W0603 14:02:43.203789 2574 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podbc7c3cdb_9b11_427f_bf82_8985c5c76e92.slice/crio-17b1d0651de46506fbc4b83a59740d427666919af5c1656f030d9e1b4e5a2b6d WatchSource:0}: Error finding container 17b1d0651de46506fbc4b83a59740d427666919af5c1656f030d9e1b4e5a2b6d: Status 404 returned error can't find the container with id 17b1d0651de46506fbc4b83a59740d427666919af5c1656f030d9e1b4e5a2b6d Jun 03 14:02:44.147630 ip-10-0-134-229 kubenswrapper[2574]: I0603 14:02:44.147595 2574 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/dns-operator-controller-manager-648d5c98bc-csdwr" event={"ID":"bc7c3cdb-9b11-427f-bf82-8985c5c76e92","Type":"ContainerStarted","Data":"17b1d0651de46506fbc4b83a59740d427666919af5c1656f030d9e1b4e5a2b6d"} Jun 03 14:02:46.156791 ip-10-0-134-229 kubenswrapper[2574]: I0603 14:02:46.156755 2574 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/dns-operator-controller-manager-648d5c98bc-csdwr" event={"ID":"bc7c3cdb-9b11-427f-bf82-8985c5c76e92","Type":"ContainerStarted","Data":"a1decec336014a3a34bd5ff5569522aa744b50511dac54eec237d63f22cd447e"} Jun 03 14:02:46.156791 ip-10-0-134-229 kubenswrapper[2574]: I0603 14:02:46.156797 2574 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/dns-operator-controller-manager-648d5c98bc-csdwr" Jun 03 14:02:46.176565 ip-10-0-134-229 kubenswrapper[2574]: I0603 14:02:46.176521 2574 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="kuadrant-system/dns-operator-controller-manager-648d5c98bc-csdwr" podStartSLOduration=2.043088257 podStartE2EDuration="4.17650662s" podCreationTimestamp="2026-06-03 14:02:42 +0000 UTC" firstStartedPulling="2026-06-03 14:02:43.205661401 +0000 UTC m=+524.389668709" lastFinishedPulling="2026-06-03 14:02:45.339079745 +0000 UTC m=+526.523087072" observedRunningTime="2026-06-03 14:02:46.17380254 +0000 UTC m=+527.357809868" watchObservedRunningTime="2026-06-03 14:02:46.17650662 +0000 UTC m=+527.360513949" Jun 03 14:02:47.007810 ip-10-0-134-229 kubenswrapper[2574]: I0603 14:02:47.007776 2574 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["kuadrant-system/authorino-operator-657f44b778-pxn4p"] Jun 03 14:02:47.010292 ip-10-0-134-229 kubenswrapper[2574]: I0603 14:02:47.010276 2574 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-operator-657f44b778-pxn4p" Jun 03 14:02:47.012667 ip-10-0-134-229 kubenswrapper[2574]: I0603 14:02:47.012649 2574 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"authorino-operator-dockercfg-8jcgn\"" Jun 03 14:02:47.033288 ip-10-0-134-229 kubenswrapper[2574]: I0603 14:02:47.033261 2574 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-operator-657f44b778-pxn4p"] Jun 03 14:02:47.136990 ip-10-0-134-229 kubenswrapper[2574]: I0603 14:02:47.136956 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-f6x78\" (UniqueName: \"kubernetes.io/projected/a43442cc-6ac6-481b-9fa2-f41a757f51c9-kube-api-access-f6x78\") pod \"authorino-operator-657f44b778-pxn4p\" (UID: \"a43442cc-6ac6-481b-9fa2-f41a757f51c9\") " pod="kuadrant-system/authorino-operator-657f44b778-pxn4p" Jun 03 14:02:47.237786 ip-10-0-134-229 kubenswrapper[2574]: I0603 14:02:47.237747 2574 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-f6x78\" (UniqueName: \"kubernetes.io/projected/a43442cc-6ac6-481b-9fa2-f41a757f51c9-kube-api-access-f6x78\") pod \"authorino-operator-657f44b778-pxn4p\" (UID: \"a43442cc-6ac6-481b-9fa2-f41a757f51c9\") " pod="kuadrant-system/authorino-operator-657f44b778-pxn4p" Jun 03 14:02:47.248898 ip-10-0-134-229 kubenswrapper[2574]: I0603 14:02:47.248871 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-f6x78\" (UniqueName: \"kubernetes.io/projected/a43442cc-6ac6-481b-9fa2-f41a757f51c9-kube-api-access-f6x78\") pod \"authorino-operator-657f44b778-pxn4p\" (UID: \"a43442cc-6ac6-481b-9fa2-f41a757f51c9\") " pod="kuadrant-system/authorino-operator-657f44b778-pxn4p" Jun 03 14:02:47.320145 ip-10-0-134-229 kubenswrapper[2574]: I0603 14:02:47.320070 2574 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-operator-657f44b778-pxn4p" Jun 03 14:02:47.480951 ip-10-0-134-229 kubenswrapper[2574]: I0603 14:02:47.480923 2574 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-operator-657f44b778-pxn4p"] Jun 03 14:02:47.481633 ip-10-0-134-229 kubenswrapper[2574]: W0603 14:02:47.481608 2574 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poda43442cc_6ac6_481b_9fa2_f41a757f51c9.slice/crio-179bdc58030bef2f2b6bbc8c1e5d1121d18ab53921b1c049fecef0f68392bd2e WatchSource:0}: Error finding container 179bdc58030bef2f2b6bbc8c1e5d1121d18ab53921b1c049fecef0f68392bd2e: Status 404 returned error can't find the container with id 179bdc58030bef2f2b6bbc8c1e5d1121d18ab53921b1c049fecef0f68392bd2e Jun 03 14:02:48.167446 ip-10-0-134-229 kubenswrapper[2574]: I0603 14:02:48.167412 2574 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-operator-657f44b778-pxn4p" event={"ID":"a43442cc-6ac6-481b-9fa2-f41a757f51c9","Type":"ContainerStarted","Data":"179bdc58030bef2f2b6bbc8c1e5d1121d18ab53921b1c049fecef0f68392bd2e"} Jun 03 14:02:50.178028 ip-10-0-134-229 kubenswrapper[2574]: I0603 14:02:50.177990 2574 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-operator-657f44b778-pxn4p" event={"ID":"a43442cc-6ac6-481b-9fa2-f41a757f51c9","Type":"ContainerStarted","Data":"8346ce7d74be883f45a379bb2bd55fa57b92da45f2a19bcaf36b55a5b0b4f285"} Jun 03 14:02:50.178508 ip-10-0-134-229 kubenswrapper[2574]: I0603 14:02:50.178051 2574 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/authorino-operator-657f44b778-pxn4p" Jun 03 14:02:50.210163 ip-10-0-134-229 kubenswrapper[2574]: I0603 14:02:50.210117 2574 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="kuadrant-system/authorino-operator-657f44b778-pxn4p" podStartSLOduration=2.140491721 podStartE2EDuration="4.210104027s" podCreationTimestamp="2026-06-03 14:02:46 +0000 UTC" firstStartedPulling="2026-06-03 14:02:47.483635797 +0000 UTC m=+528.667643105" lastFinishedPulling="2026-06-03 14:02:49.553248087 +0000 UTC m=+530.737255411" observedRunningTime="2026-06-03 14:02:50.207655833 +0000 UTC m=+531.391663163" watchObservedRunningTime="2026-06-03 14:02:50.210104027 +0000 UTC m=+531.394111356" Jun 03 14:02:55.004607 ip-10-0-134-229 kubenswrapper[2574]: I0603 14:02:55.004574 2574 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-5f895dd7d5-v6ndl"] Jun 03 14:02:55.007359 ip-10-0-134-229 kubenswrapper[2574]: I0603 14:02:55.007340 2574 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-5f895dd7d5-v6ndl" Jun 03 14:02:55.009983 ip-10-0-134-229 kubenswrapper[2574]: I0603 14:02:55.009960 2574 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"kuadrant-operator-controller-manager-dockercfg-nzlkl\"" Jun 03 14:02:55.022907 ip-10-0-134-229 kubenswrapper[2574]: I0603 14:02:55.022881 2574 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-5f895dd7d5-v6ndl"] Jun 03 14:02:55.102218 ip-10-0-134-229 kubenswrapper[2574]: I0603 14:02:55.102195 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/47f54582-1ecc-42bd-acfd-f07f8f02a9e8-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-5f895dd7d5-v6ndl\" (UID: \"47f54582-1ecc-42bd-acfd-f07f8f02a9e8\") " pod="kuadrant-system/kuadrant-operator-controller-manager-5f895dd7d5-v6ndl" Jun 03 14:02:55.102218 ip-10-0-134-229 kubenswrapper[2574]: I0603 14:02:55.102224 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-zdsls\" (UniqueName: \"kubernetes.io/projected/47f54582-1ecc-42bd-acfd-f07f8f02a9e8-kube-api-access-zdsls\") pod \"kuadrant-operator-controller-manager-5f895dd7d5-v6ndl\" (UID: \"47f54582-1ecc-42bd-acfd-f07f8f02a9e8\") " pod="kuadrant-system/kuadrant-operator-controller-manager-5f895dd7d5-v6ndl" Jun 03 14:02:55.202719 ip-10-0-134-229 kubenswrapper[2574]: I0603 14:02:55.202696 2574 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/47f54582-1ecc-42bd-acfd-f07f8f02a9e8-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-5f895dd7d5-v6ndl\" (UID: \"47f54582-1ecc-42bd-acfd-f07f8f02a9e8\") " pod="kuadrant-system/kuadrant-operator-controller-manager-5f895dd7d5-v6ndl" Jun 03 14:02:55.202836 ip-10-0-134-229 kubenswrapper[2574]: I0603 14:02:55.202724 2574 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-zdsls\" (UniqueName: \"kubernetes.io/projected/47f54582-1ecc-42bd-acfd-f07f8f02a9e8-kube-api-access-zdsls\") pod \"kuadrant-operator-controller-manager-5f895dd7d5-v6ndl\" (UID: \"47f54582-1ecc-42bd-acfd-f07f8f02a9e8\") " pod="kuadrant-system/kuadrant-operator-controller-manager-5f895dd7d5-v6ndl" Jun 03 14:02:55.203089 ip-10-0-134-229 kubenswrapper[2574]: I0603 14:02:55.203066 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/47f54582-1ecc-42bd-acfd-f07f8f02a9e8-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-5f895dd7d5-v6ndl\" (UID: \"47f54582-1ecc-42bd-acfd-f07f8f02a9e8\") " pod="kuadrant-system/kuadrant-operator-controller-manager-5f895dd7d5-v6ndl" Jun 03 14:02:55.218311 ip-10-0-134-229 kubenswrapper[2574]: I0603 14:02:55.218290 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-zdsls\" (UniqueName: \"kubernetes.io/projected/47f54582-1ecc-42bd-acfd-f07f8f02a9e8-kube-api-access-zdsls\") pod \"kuadrant-operator-controller-manager-5f895dd7d5-v6ndl\" (UID: \"47f54582-1ecc-42bd-acfd-f07f8f02a9e8\") " pod="kuadrant-system/kuadrant-operator-controller-manager-5f895dd7d5-v6ndl" Jun 03 14:02:55.316846 ip-10-0-134-229 kubenswrapper[2574]: I0603 14:02:55.316789 2574 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-5f895dd7d5-v6ndl" Jun 03 14:02:55.448435 ip-10-0-134-229 kubenswrapper[2574]: I0603 14:02:55.448407 2574 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-5f895dd7d5-v6ndl"] Jun 03 14:02:55.451605 ip-10-0-134-229 kubenswrapper[2574]: W0603 14:02:55.451575 2574 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod47f54582_1ecc_42bd_acfd_f07f8f02a9e8.slice/crio-35ab5e69fbd7efa3fa76e6373569c8dc24f890abb4c0445351876e299c1e1078 WatchSource:0}: Error finding container 35ab5e69fbd7efa3fa76e6373569c8dc24f890abb4c0445351876e299c1e1078: Status 404 returned error can't find the container with id 35ab5e69fbd7efa3fa76e6373569c8dc24f890abb4c0445351876e299c1e1078 Jun 03 14:02:56.203044 ip-10-0-134-229 kubenswrapper[2574]: I0603 14:02:56.202994 2574 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-5f895dd7d5-v6ndl" event={"ID":"47f54582-1ecc-42bd-acfd-f07f8f02a9e8","Type":"ContainerStarted","Data":"35ab5e69fbd7efa3fa76e6373569c8dc24f890abb4c0445351876e299c1e1078"} Jun 03 14:02:57.162940 ip-10-0-134-229 kubenswrapper[2574]: I0603 14:02:57.162905 2574 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/dns-operator-controller-manager-648d5c98bc-csdwr" Jun 03 14:03:01.184148 ip-10-0-134-229 kubenswrapper[2574]: I0603 14:03:01.184112 2574 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/authorino-operator-657f44b778-pxn4p" Jun 03 14:03:01.223454 ip-10-0-134-229 kubenswrapper[2574]: I0603 14:03:01.223415 2574 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-5f895dd7d5-v6ndl" event={"ID":"47f54582-1ecc-42bd-acfd-f07f8f02a9e8","Type":"ContainerStarted","Data":"6934801cc71ee2d5cecbc83efdad06bb6d00d8b5c6d4e558ef96d60a6567c707"} Jun 03 14:03:01.223700 ip-10-0-134-229 kubenswrapper[2574]: I0603 14:03:01.223676 2574 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/kuadrant-operator-controller-manager-5f895dd7d5-v6ndl" Jun 03 14:03:01.253117 ip-10-0-134-229 kubenswrapper[2574]: I0603 14:03:01.253065 2574 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="kuadrant-system/kuadrant-operator-controller-manager-5f895dd7d5-v6ndl" podStartSLOduration=2.044702118 podStartE2EDuration="7.253050699s" podCreationTimestamp="2026-06-03 14:02:54 +0000 UTC" firstStartedPulling="2026-06-03 14:02:55.453829166 +0000 UTC m=+536.637836487" lastFinishedPulling="2026-06-03 14:03:00.662177761 +0000 UTC m=+541.846185068" observedRunningTime="2026-06-03 14:03:01.251459438 +0000 UTC m=+542.435466766" watchObservedRunningTime="2026-06-03 14:03:01.253050699 +0000 UTC m=+542.437058027" Jun 03 14:03:03.384889 ip-10-0-134-229 kubenswrapper[2574]: I0603 14:03:03.384856 2574 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["kuadrant-system/kuadrant-console-plugin-6cb54b5c86-56tr6"] Jun 03 14:03:03.387971 ip-10-0-134-229 kubenswrapper[2574]: I0603 14:03:03.387948 2574 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-console-plugin-6cb54b5c86-56tr6" Jun 03 14:03:03.391120 ip-10-0-134-229 kubenswrapper[2574]: I0603 14:03:03.391101 2574 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"plugin-serving-cert\"" Jun 03 14:03:03.391228 ip-10-0-134-229 kubenswrapper[2574]: I0603 14:03:03.391211 2574 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"kuadrant-console-nginx-conf\"" Jun 03 14:03:03.391739 ip-10-0-134-229 kubenswrapper[2574]: I0603 14:03:03.391723 2574 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"default-dockercfg-mbjwr\"" Jun 03 14:03:03.404958 ip-10-0-134-229 kubenswrapper[2574]: I0603 14:03:03.404939 2574 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-console-plugin-6cb54b5c86-56tr6"] Jun 03 14:03:03.481174 ip-10-0-134-229 kubenswrapper[2574]: I0603 14:03:03.481150 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"nginx-conf\" (UniqueName: \"kubernetes.io/configmap/03eae7fe-d177-41de-a727-2281dccd7f1b-nginx-conf\") pod \"kuadrant-console-plugin-6cb54b5c86-56tr6\" (UID: \"03eae7fe-d177-41de-a727-2281dccd7f1b\") " pod="kuadrant-system/kuadrant-console-plugin-6cb54b5c86-56tr6" Jun 03 14:03:03.481287 ip-10-0-134-229 kubenswrapper[2574]: I0603 14:03:03.481190 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-grrh7\" (UniqueName: \"kubernetes.io/projected/03eae7fe-d177-41de-a727-2281dccd7f1b-kube-api-access-grrh7\") pod \"kuadrant-console-plugin-6cb54b5c86-56tr6\" (UID: \"03eae7fe-d177-41de-a727-2281dccd7f1b\") " pod="kuadrant-system/kuadrant-console-plugin-6cb54b5c86-56tr6" Jun 03 14:03:03.481287 ip-10-0-134-229 kubenswrapper[2574]: I0603 14:03:03.481211 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugin-serving-cert\" (UniqueName: \"kubernetes.io/secret/03eae7fe-d177-41de-a727-2281dccd7f1b-plugin-serving-cert\") pod \"kuadrant-console-plugin-6cb54b5c86-56tr6\" (UID: \"03eae7fe-d177-41de-a727-2281dccd7f1b\") " pod="kuadrant-system/kuadrant-console-plugin-6cb54b5c86-56tr6" Jun 03 14:03:03.581776 ip-10-0-134-229 kubenswrapper[2574]: I0603 14:03:03.581746 2574 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"nginx-conf\" (UniqueName: \"kubernetes.io/configmap/03eae7fe-d177-41de-a727-2281dccd7f1b-nginx-conf\") pod \"kuadrant-console-plugin-6cb54b5c86-56tr6\" (UID: \"03eae7fe-d177-41de-a727-2281dccd7f1b\") " pod="kuadrant-system/kuadrant-console-plugin-6cb54b5c86-56tr6" Jun 03 14:03:03.581893 ip-10-0-134-229 kubenswrapper[2574]: I0603 14:03:03.581791 2574 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-grrh7\" (UniqueName: \"kubernetes.io/projected/03eae7fe-d177-41de-a727-2281dccd7f1b-kube-api-access-grrh7\") pod \"kuadrant-console-plugin-6cb54b5c86-56tr6\" (UID: \"03eae7fe-d177-41de-a727-2281dccd7f1b\") " pod="kuadrant-system/kuadrant-console-plugin-6cb54b5c86-56tr6" Jun 03 14:03:03.581893 ip-10-0-134-229 kubenswrapper[2574]: I0603 14:03:03.581816 2574 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"plugin-serving-cert\" (UniqueName: \"kubernetes.io/secret/03eae7fe-d177-41de-a727-2281dccd7f1b-plugin-serving-cert\") pod \"kuadrant-console-plugin-6cb54b5c86-56tr6\" (UID: \"03eae7fe-d177-41de-a727-2281dccd7f1b\") " pod="kuadrant-system/kuadrant-console-plugin-6cb54b5c86-56tr6" Jun 03 14:03:03.582368 ip-10-0-134-229 kubenswrapper[2574]: I0603 14:03:03.582348 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"nginx-conf\" (UniqueName: \"kubernetes.io/configmap/03eae7fe-d177-41de-a727-2281dccd7f1b-nginx-conf\") pod \"kuadrant-console-plugin-6cb54b5c86-56tr6\" (UID: \"03eae7fe-d177-41de-a727-2281dccd7f1b\") " pod="kuadrant-system/kuadrant-console-plugin-6cb54b5c86-56tr6" Jun 03 14:03:03.584141 ip-10-0-134-229 kubenswrapper[2574]: I0603 14:03:03.584120 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"plugin-serving-cert\" (UniqueName: \"kubernetes.io/secret/03eae7fe-d177-41de-a727-2281dccd7f1b-plugin-serving-cert\") pod \"kuadrant-console-plugin-6cb54b5c86-56tr6\" (UID: \"03eae7fe-d177-41de-a727-2281dccd7f1b\") " pod="kuadrant-system/kuadrant-console-plugin-6cb54b5c86-56tr6" Jun 03 14:03:03.590077 ip-10-0-134-229 kubenswrapper[2574]: I0603 14:03:03.590055 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-grrh7\" (UniqueName: \"kubernetes.io/projected/03eae7fe-d177-41de-a727-2281dccd7f1b-kube-api-access-grrh7\") pod \"kuadrant-console-plugin-6cb54b5c86-56tr6\" (UID: \"03eae7fe-d177-41de-a727-2281dccd7f1b\") " pod="kuadrant-system/kuadrant-console-plugin-6cb54b5c86-56tr6" Jun 03 14:03:03.697103 ip-10-0-134-229 kubenswrapper[2574]: I0603 14:03:03.697028 2574 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-console-plugin-6cb54b5c86-56tr6" Jun 03 14:03:03.820922 ip-10-0-134-229 kubenswrapper[2574]: I0603 14:03:03.820895 2574 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-console-plugin-6cb54b5c86-56tr6"] Jun 03 14:03:03.822258 ip-10-0-134-229 kubenswrapper[2574]: W0603 14:03:03.822228 2574 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod03eae7fe_d177_41de_a727_2281dccd7f1b.slice/crio-5659683cb773bea6a1869acfbd9f6a4ca2190d59199288e6088c5e1c6894125a WatchSource:0}: Error finding container 5659683cb773bea6a1869acfbd9f6a4ca2190d59199288e6088c5e1c6894125a: Status 404 returned error can't find the container with id 5659683cb773bea6a1869acfbd9f6a4ca2190d59199288e6088c5e1c6894125a Jun 03 14:03:04.233941 ip-10-0-134-229 kubenswrapper[2574]: I0603 14:03:04.233902 2574 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-console-plugin-6cb54b5c86-56tr6" event={"ID":"03eae7fe-d177-41de-a727-2281dccd7f1b","Type":"ContainerStarted","Data":"5659683cb773bea6a1869acfbd9f6a4ca2190d59199288e6088c5e1c6894125a"} Jun 03 14:03:12.230133 ip-10-0-134-229 kubenswrapper[2574]: I0603 14:03:12.230095 2574 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/kuadrant-operator-controller-manager-5f895dd7d5-v6ndl" Jun 03 14:03:13.937931 ip-10-0-134-229 kubenswrapper[2574]: I0603 14:03:13.937893 2574 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-5f895dd7d5-v6ndl"] Jun 03 14:03:13.938310 ip-10-0-134-229 kubenswrapper[2574]: I0603 14:03:13.938103 2574 kuberuntime_container.go:864] "Killing container with a grace period" pod="kuadrant-system/kuadrant-operator-controller-manager-5f895dd7d5-v6ndl" podUID="47f54582-1ecc-42bd-acfd-f07f8f02a9e8" containerName="manager" containerID="cri-o://6934801cc71ee2d5cecbc83efdad06bb6d00d8b5c6d4e558ef96d60a6567c707" gracePeriod=2 Jun 03 14:03:13.952598 ip-10-0-134-229 kubenswrapper[2574]: I0603 14:03:13.951987 2574 kubelet.go:2547] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-5f895dd7d5-v6ndl"] Jun 03 14:03:13.977115 ip-10-0-134-229 kubenswrapper[2574]: I0603 14:03:13.977080 2574 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-5f895dd7d5-svvsn"] Jun 03 14:03:13.977534 ip-10-0-134-229 kubenswrapper[2574]: I0603 14:03:13.977519 2574 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="47f54582-1ecc-42bd-acfd-f07f8f02a9e8" containerName="manager" Jun 03 14:03:13.977600 ip-10-0-134-229 kubenswrapper[2574]: I0603 14:03:13.977535 2574 state_mem.go:107] "Deleted CPUSet assignment" podUID="47f54582-1ecc-42bd-acfd-f07f8f02a9e8" containerName="manager" Jun 03 14:03:13.977644 ip-10-0-134-229 kubenswrapper[2574]: I0603 14:03:13.977620 2574 memory_manager.go:356] "RemoveStaleState removing state" podUID="47f54582-1ecc-42bd-acfd-f07f8f02a9e8" containerName="manager" Jun 03 14:03:13.979969 ip-10-0-134-229 kubenswrapper[2574]: I0603 14:03:13.979952 2574 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-5f895dd7d5-svvsn" Jun 03 14:03:13.999277 ip-10-0-134-229 kubenswrapper[2574]: I0603 14:03:13.999252 2574 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-5f895dd7d5-svvsn"] Jun 03 14:03:14.020021 ip-10-0-134-229 kubenswrapper[2574]: I0603 14:03:14.019979 2574 status_manager.go:895] "Failed to get status for pod" podUID="47f54582-1ecc-42bd-acfd-f07f8f02a9e8" pod="kuadrant-system/kuadrant-operator-controller-manager-5f895dd7d5-v6ndl" err="pods \"kuadrant-operator-controller-manager-5f895dd7d5-v6ndl\" is forbidden: User \"system:node:ip-10-0-134-229.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-134-229.ec2.internal' and this object" Jun 03 14:03:14.073930 ip-10-0-134-229 kubenswrapper[2574]: I0603 14:03:14.073904 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/1b0c2196-f19f-4e1c-be7b-8c77508754d1-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-5f895dd7d5-svvsn\" (UID: \"1b0c2196-f19f-4e1c-be7b-8c77508754d1\") " pod="kuadrant-system/kuadrant-operator-controller-manager-5f895dd7d5-svvsn" Jun 03 14:03:14.074053 ip-10-0-134-229 kubenswrapper[2574]: I0603 14:03:14.074032 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-mlws5\" (UniqueName: \"kubernetes.io/projected/1b0c2196-f19f-4e1c-be7b-8c77508754d1-kube-api-access-mlws5\") pod \"kuadrant-operator-controller-manager-5f895dd7d5-svvsn\" (UID: \"1b0c2196-f19f-4e1c-be7b-8c77508754d1\") " pod="kuadrant-system/kuadrant-operator-controller-manager-5f895dd7d5-svvsn" Jun 03 14:03:14.174575 ip-10-0-134-229 kubenswrapper[2574]: I0603 14:03:14.174541 2574 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/1b0c2196-f19f-4e1c-be7b-8c77508754d1-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-5f895dd7d5-svvsn\" (UID: \"1b0c2196-f19f-4e1c-be7b-8c77508754d1\") " pod="kuadrant-system/kuadrant-operator-controller-manager-5f895dd7d5-svvsn" Jun 03 14:03:14.174757 ip-10-0-134-229 kubenswrapper[2574]: I0603 14:03:14.174645 2574 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-mlws5\" (UniqueName: \"kubernetes.io/projected/1b0c2196-f19f-4e1c-be7b-8c77508754d1-kube-api-access-mlws5\") pod \"kuadrant-operator-controller-manager-5f895dd7d5-svvsn\" (UID: \"1b0c2196-f19f-4e1c-be7b-8c77508754d1\") " pod="kuadrant-system/kuadrant-operator-controller-manager-5f895dd7d5-svvsn" Jun 03 14:03:14.174939 ip-10-0-134-229 kubenswrapper[2574]: I0603 14:03:14.174917 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/1b0c2196-f19f-4e1c-be7b-8c77508754d1-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-5f895dd7d5-svvsn\" (UID: \"1b0c2196-f19f-4e1c-be7b-8c77508754d1\") " pod="kuadrant-system/kuadrant-operator-controller-manager-5f895dd7d5-svvsn" Jun 03 14:03:14.185265 ip-10-0-134-229 kubenswrapper[2574]: I0603 14:03:14.185240 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-mlws5\" (UniqueName: \"kubernetes.io/projected/1b0c2196-f19f-4e1c-be7b-8c77508754d1-kube-api-access-mlws5\") pod \"kuadrant-operator-controller-manager-5f895dd7d5-svvsn\" (UID: \"1b0c2196-f19f-4e1c-be7b-8c77508754d1\") " pod="kuadrant-system/kuadrant-operator-controller-manager-5f895dd7d5-svvsn" Jun 03 14:03:14.195625 ip-10-0-134-229 kubenswrapper[2574]: I0603 14:03:14.195577 2574 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-5f895dd7d5-v6ndl" Jun 03 14:03:14.197556 ip-10-0-134-229 kubenswrapper[2574]: I0603 14:03:14.197533 2574 status_manager.go:895] "Failed to get status for pod" podUID="47f54582-1ecc-42bd-acfd-f07f8f02a9e8" pod="kuadrant-system/kuadrant-operator-controller-manager-5f895dd7d5-v6ndl" err="pods \"kuadrant-operator-controller-manager-5f895dd7d5-v6ndl\" is forbidden: User \"system:node:ip-10-0-134-229.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-134-229.ec2.internal' and this object" Jun 03 14:03:14.275857 ip-10-0-134-229 kubenswrapper[2574]: I0603 14:03:14.275829 2574 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-zdsls\" (UniqueName: \"kubernetes.io/projected/47f54582-1ecc-42bd-acfd-f07f8f02a9e8-kube-api-access-zdsls\") pod \"47f54582-1ecc-42bd-acfd-f07f8f02a9e8\" (UID: \"47f54582-1ecc-42bd-acfd-f07f8f02a9e8\") " Jun 03 14:03:14.275974 ip-10-0-134-229 kubenswrapper[2574]: I0603 14:03:14.275865 2574 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/47f54582-1ecc-42bd-acfd-f07f8f02a9e8-extensions-socket-volume\") pod \"47f54582-1ecc-42bd-acfd-f07f8f02a9e8\" (UID: \"47f54582-1ecc-42bd-acfd-f07f8f02a9e8\") " Jun 03 14:03:14.276410 ip-10-0-134-229 kubenswrapper[2574]: I0603 14:03:14.276354 2574 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/47f54582-1ecc-42bd-acfd-f07f8f02a9e8-extensions-socket-volume" (OuterVolumeSpecName: "extensions-socket-volume") pod "47f54582-1ecc-42bd-acfd-f07f8f02a9e8" (UID: "47f54582-1ecc-42bd-acfd-f07f8f02a9e8"). InnerVolumeSpecName "extensions-socket-volume". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jun 03 14:03:14.278066 ip-10-0-134-229 kubenswrapper[2574]: I0603 14:03:14.278040 2574 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/47f54582-1ecc-42bd-acfd-f07f8f02a9e8-kube-api-access-zdsls" (OuterVolumeSpecName: "kube-api-access-zdsls") pod "47f54582-1ecc-42bd-acfd-f07f8f02a9e8" (UID: "47f54582-1ecc-42bd-acfd-f07f8f02a9e8"). InnerVolumeSpecName "kube-api-access-zdsls". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 03 14:03:14.280082 ip-10-0-134-229 kubenswrapper[2574]: I0603 14:03:14.280060 2574 generic.go:358] "Generic (PLEG): container finished" podID="47f54582-1ecc-42bd-acfd-f07f8f02a9e8" containerID="6934801cc71ee2d5cecbc83efdad06bb6d00d8b5c6d4e558ef96d60a6567c707" exitCode=0 Jun 03 14:03:14.280187 ip-10-0-134-229 kubenswrapper[2574]: I0603 14:03:14.280112 2574 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-5f895dd7d5-v6ndl" Jun 03 14:03:14.280187 ip-10-0-134-229 kubenswrapper[2574]: I0603 14:03:14.280145 2574 scope.go:117] "RemoveContainer" containerID="6934801cc71ee2d5cecbc83efdad06bb6d00d8b5c6d4e558ef96d60a6567c707" Jun 03 14:03:14.282253 ip-10-0-134-229 kubenswrapper[2574]: I0603 14:03:14.282222 2574 status_manager.go:895] "Failed to get status for pod" podUID="47f54582-1ecc-42bd-acfd-f07f8f02a9e8" pod="kuadrant-system/kuadrant-operator-controller-manager-5f895dd7d5-v6ndl" err="pods \"kuadrant-operator-controller-manager-5f895dd7d5-v6ndl\" is forbidden: User \"system:node:ip-10-0-134-229.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-134-229.ec2.internal' and this object" Jun 03 14:03:14.290481 ip-10-0-134-229 kubenswrapper[2574]: I0603 14:03:14.290465 2574 scope.go:117] "RemoveContainer" containerID="6934801cc71ee2d5cecbc83efdad06bb6d00d8b5c6d4e558ef96d60a6567c707" Jun 03 14:03:14.290838 ip-10-0-134-229 kubenswrapper[2574]: E0603 14:03:14.290810 2574 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"6934801cc71ee2d5cecbc83efdad06bb6d00d8b5c6d4e558ef96d60a6567c707\": container with ID starting with 6934801cc71ee2d5cecbc83efdad06bb6d00d8b5c6d4e558ef96d60a6567c707 not found: ID does not exist" containerID="6934801cc71ee2d5cecbc83efdad06bb6d00d8b5c6d4e558ef96d60a6567c707" Jun 03 14:03:14.290928 ip-10-0-134-229 kubenswrapper[2574]: I0603 14:03:14.290850 2574 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"6934801cc71ee2d5cecbc83efdad06bb6d00d8b5c6d4e558ef96d60a6567c707"} err="failed to get container status \"6934801cc71ee2d5cecbc83efdad06bb6d00d8b5c6d4e558ef96d60a6567c707\": rpc error: code = NotFound desc = could not find container \"6934801cc71ee2d5cecbc83efdad06bb6d00d8b5c6d4e558ef96d60a6567c707\": container with ID starting with 6934801cc71ee2d5cecbc83efdad06bb6d00d8b5c6d4e558ef96d60a6567c707 not found: ID does not exist" Jun 03 14:03:14.290996 ip-10-0-134-229 kubenswrapper[2574]: I0603 14:03:14.290950 2574 status_manager.go:895] "Failed to get status for pod" podUID="47f54582-1ecc-42bd-acfd-f07f8f02a9e8" pod="kuadrant-system/kuadrant-operator-controller-manager-5f895dd7d5-v6ndl" err="pods \"kuadrant-operator-controller-manager-5f895dd7d5-v6ndl\" is forbidden: User \"system:node:ip-10-0-134-229.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-134-229.ec2.internal' and this object" Jun 03 14:03:14.308323 ip-10-0-134-229 kubenswrapper[2574]: I0603 14:03:14.308300 2574 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-5f895dd7d5-svvsn" Jun 03 14:03:14.376954 ip-10-0-134-229 kubenswrapper[2574]: I0603 14:03:14.376898 2574 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-zdsls\" (UniqueName: \"kubernetes.io/projected/47f54582-1ecc-42bd-acfd-f07f8f02a9e8-kube-api-access-zdsls\") on node \"ip-10-0-134-229.ec2.internal\" DevicePath \"\"" Jun 03 14:03:14.376954 ip-10-0-134-229 kubenswrapper[2574]: I0603 14:03:14.376930 2574 reconciler_common.go:299] "Volume detached for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/47f54582-1ecc-42bd-acfd-f07f8f02a9e8-extensions-socket-volume\") on node \"ip-10-0-134-229.ec2.internal\" DevicePath \"\"" Jun 03 14:03:14.477274 ip-10-0-134-229 kubenswrapper[2574]: I0603 14:03:14.477240 2574 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-5f895dd7d5-svvsn"] Jun 03 14:03:15.433089 ip-10-0-134-229 kubenswrapper[2574]: I0603 14:03:15.433044 2574 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="47f54582-1ecc-42bd-acfd-f07f8f02a9e8" path="/var/lib/kubelet/pods/47f54582-1ecc-42bd-acfd-f07f8f02a9e8/volumes" Jun 03 14:03:28.364355 ip-10-0-134-229 kubenswrapper[2574]: W0603 14:03:28.364319 2574 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod1b0c2196_f19f_4e1c_be7b_8c77508754d1.slice/crio-23aadc8b7b809d69a5aa0947a2643b6af00da31132a6b6aaf16d1d2cd2f9da7a WatchSource:0}: Error finding container 23aadc8b7b809d69a5aa0947a2643b6af00da31132a6b6aaf16d1d2cd2f9da7a: Status 404 returned error can't find the container with id 23aadc8b7b809d69a5aa0947a2643b6af00da31132a6b6aaf16d1d2cd2f9da7a Jun 03 14:03:29.346446 ip-10-0-134-229 kubenswrapper[2574]: I0603 14:03:29.346411 2574 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-5f895dd7d5-svvsn" event={"ID":"1b0c2196-f19f-4e1c-be7b-8c77508754d1","Type":"ContainerStarted","Data":"6e1b4d20e94c920b27ceeeb8911223e11ba7c903f2bd547b4f00f4acb5122b0b"} Jun 03 14:03:29.346629 ip-10-0-134-229 kubenswrapper[2574]: I0603 14:03:29.346453 2574 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-5f895dd7d5-svvsn" event={"ID":"1b0c2196-f19f-4e1c-be7b-8c77508754d1","Type":"ContainerStarted","Data":"23aadc8b7b809d69a5aa0947a2643b6af00da31132a6b6aaf16d1d2cd2f9da7a"} Jun 03 14:03:29.346629 ip-10-0-134-229 kubenswrapper[2574]: I0603 14:03:29.346536 2574 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/kuadrant-operator-controller-manager-5f895dd7d5-svvsn" Jun 03 14:03:29.347738 ip-10-0-134-229 kubenswrapper[2574]: I0603 14:03:29.347705 2574 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-console-plugin-6cb54b5c86-56tr6" event={"ID":"03eae7fe-d177-41de-a727-2281dccd7f1b","Type":"ContainerStarted","Data":"61c60fdff895a9422d31aea85cc9ab639d7a5378a891e2d011e8ed32b293d21b"} Jun 03 14:03:29.368570 ip-10-0-134-229 kubenswrapper[2574]: I0603 14:03:29.368534 2574 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="kuadrant-system/kuadrant-operator-controller-manager-5f895dd7d5-svvsn" podStartSLOduration=16.368523221 podStartE2EDuration="16.368523221s" podCreationTimestamp="2026-06-03 14:03:13 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2026-06-03 14:03:29.366731824 +0000 UTC m=+570.550739166" watchObservedRunningTime="2026-06-03 14:03:29.368523221 +0000 UTC m=+570.552530549" Jun 03 14:03:29.388032 ip-10-0-134-229 kubenswrapper[2574]: I0603 14:03:29.387992 2574 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="kuadrant-system/kuadrant-console-plugin-6cb54b5c86-56tr6" podStartSLOduration=1.789608912 podStartE2EDuration="26.387981315s" podCreationTimestamp="2026-06-03 14:03:03 +0000 UTC" firstStartedPulling="2026-06-03 14:03:03.823727318 +0000 UTC m=+545.007734629" lastFinishedPulling="2026-06-03 14:03:28.42209972 +0000 UTC m=+569.606107032" observedRunningTime="2026-06-03 14:03:29.385005508 +0000 UTC m=+570.569012837" watchObservedRunningTime="2026-06-03 14:03:29.387981315 +0000 UTC m=+570.571988643" Jun 03 14:03:29.605912 ip-10-0-134-229 kubenswrapper[2574]: I0603 14:03:29.605836 2574 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-5f895dd7d5-svvsn"] Jun 03 14:03:31.354473 ip-10-0-134-229 kubenswrapper[2574]: I0603 14:03:31.354435 2574 kuberuntime_container.go:864] "Killing container with a grace period" pod="kuadrant-system/kuadrant-operator-controller-manager-5f895dd7d5-svvsn" podUID="1b0c2196-f19f-4e1c-be7b-8c77508754d1" containerName="manager" containerID="cri-o://6e1b4d20e94c920b27ceeeb8911223e11ba7c903f2bd547b4f00f4acb5122b0b" gracePeriod=10 Jun 03 14:03:31.588292 ip-10-0-134-229 kubenswrapper[2574]: I0603 14:03:31.588268 2574 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-5f895dd7d5-svvsn" Jun 03 14:03:31.737826 ip-10-0-134-229 kubenswrapper[2574]: I0603 14:03:31.737800 2574 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-mlws5\" (UniqueName: \"kubernetes.io/projected/1b0c2196-f19f-4e1c-be7b-8c77508754d1-kube-api-access-mlws5\") pod \"1b0c2196-f19f-4e1c-be7b-8c77508754d1\" (UID: \"1b0c2196-f19f-4e1c-be7b-8c77508754d1\") " Jun 03 14:03:31.737972 ip-10-0-134-229 kubenswrapper[2574]: I0603 14:03:31.737873 2574 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/1b0c2196-f19f-4e1c-be7b-8c77508754d1-extensions-socket-volume\") pod \"1b0c2196-f19f-4e1c-be7b-8c77508754d1\" (UID: \"1b0c2196-f19f-4e1c-be7b-8c77508754d1\") " Jun 03 14:03:31.738237 ip-10-0-134-229 kubenswrapper[2574]: I0603 14:03:31.738214 2574 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/1b0c2196-f19f-4e1c-be7b-8c77508754d1-extensions-socket-volume" (OuterVolumeSpecName: "extensions-socket-volume") pod "1b0c2196-f19f-4e1c-be7b-8c77508754d1" (UID: "1b0c2196-f19f-4e1c-be7b-8c77508754d1"). InnerVolumeSpecName "extensions-socket-volume". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jun 03 14:03:31.739852 ip-10-0-134-229 kubenswrapper[2574]: I0603 14:03:31.739833 2574 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/1b0c2196-f19f-4e1c-be7b-8c77508754d1-kube-api-access-mlws5" (OuterVolumeSpecName: "kube-api-access-mlws5") pod "1b0c2196-f19f-4e1c-be7b-8c77508754d1" (UID: "1b0c2196-f19f-4e1c-be7b-8c77508754d1"). InnerVolumeSpecName "kube-api-access-mlws5". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 03 14:03:31.838446 ip-10-0-134-229 kubenswrapper[2574]: I0603 14:03:31.838423 2574 reconciler_common.go:299] "Volume detached for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/1b0c2196-f19f-4e1c-be7b-8c77508754d1-extensions-socket-volume\") on node \"ip-10-0-134-229.ec2.internal\" DevicePath \"\"" Jun 03 14:03:31.838446 ip-10-0-134-229 kubenswrapper[2574]: I0603 14:03:31.838443 2574 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-mlws5\" (UniqueName: \"kubernetes.io/projected/1b0c2196-f19f-4e1c-be7b-8c77508754d1-kube-api-access-mlws5\") on node \"ip-10-0-134-229.ec2.internal\" DevicePath \"\"" Jun 03 14:03:32.358539 ip-10-0-134-229 kubenswrapper[2574]: I0603 14:03:32.358506 2574 generic.go:358] "Generic (PLEG): container finished" podID="1b0c2196-f19f-4e1c-be7b-8c77508754d1" containerID="6e1b4d20e94c920b27ceeeb8911223e11ba7c903f2bd547b4f00f4acb5122b0b" exitCode=0 Jun 03 14:03:32.358937 ip-10-0-134-229 kubenswrapper[2574]: I0603 14:03:32.358589 2574 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-5f895dd7d5-svvsn" Jun 03 14:03:32.358937 ip-10-0-134-229 kubenswrapper[2574]: I0603 14:03:32.358601 2574 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-5f895dd7d5-svvsn" event={"ID":"1b0c2196-f19f-4e1c-be7b-8c77508754d1","Type":"ContainerDied","Data":"6e1b4d20e94c920b27ceeeb8911223e11ba7c903f2bd547b4f00f4acb5122b0b"} Jun 03 14:03:32.358937 ip-10-0-134-229 kubenswrapper[2574]: I0603 14:03:32.358637 2574 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-5f895dd7d5-svvsn" event={"ID":"1b0c2196-f19f-4e1c-be7b-8c77508754d1","Type":"ContainerDied","Data":"23aadc8b7b809d69a5aa0947a2643b6af00da31132a6b6aaf16d1d2cd2f9da7a"} Jun 03 14:03:32.358937 ip-10-0-134-229 kubenswrapper[2574]: I0603 14:03:32.358668 2574 scope.go:117] "RemoveContainer" containerID="6e1b4d20e94c920b27ceeeb8911223e11ba7c903f2bd547b4f00f4acb5122b0b" Jun 03 14:03:32.367298 ip-10-0-134-229 kubenswrapper[2574]: I0603 14:03:32.367279 2574 scope.go:117] "RemoveContainer" containerID="6e1b4d20e94c920b27ceeeb8911223e11ba7c903f2bd547b4f00f4acb5122b0b" Jun 03 14:03:32.367567 ip-10-0-134-229 kubenswrapper[2574]: E0603 14:03:32.367546 2574 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"6e1b4d20e94c920b27ceeeb8911223e11ba7c903f2bd547b4f00f4acb5122b0b\": container with ID starting with 6e1b4d20e94c920b27ceeeb8911223e11ba7c903f2bd547b4f00f4acb5122b0b not found: ID does not exist" containerID="6e1b4d20e94c920b27ceeeb8911223e11ba7c903f2bd547b4f00f4acb5122b0b" Jun 03 14:03:32.367660 ip-10-0-134-229 kubenswrapper[2574]: I0603 14:03:32.367573 2574 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"6e1b4d20e94c920b27ceeeb8911223e11ba7c903f2bd547b4f00f4acb5122b0b"} err="failed to get container status \"6e1b4d20e94c920b27ceeeb8911223e11ba7c903f2bd547b4f00f4acb5122b0b\": rpc error: code = NotFound desc = could not find container \"6e1b4d20e94c920b27ceeeb8911223e11ba7c903f2bd547b4f00f4acb5122b0b\": container with ID starting with 6e1b4d20e94c920b27ceeeb8911223e11ba7c903f2bd547b4f00f4acb5122b0b not found: ID does not exist" Jun 03 14:03:32.384151 ip-10-0-134-229 kubenswrapper[2574]: I0603 14:03:32.384128 2574 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-5f895dd7d5-svvsn"] Jun 03 14:03:32.390408 ip-10-0-134-229 kubenswrapper[2574]: I0603 14:03:32.390369 2574 kubelet.go:2547] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-5f895dd7d5-svvsn"] Jun 03 14:03:33.431104 ip-10-0-134-229 kubenswrapper[2574]: I0603 14:03:33.431073 2574 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="1b0c2196-f19f-4e1c-be7b-8c77508754d1" path="/var/lib/kubelet/pods/1b0c2196-f19f-4e1c-be7b-8c77508754d1/volumes" Jun 03 14:03:45.857391 ip-10-0-134-229 kubenswrapper[2574]: I0603 14:03:45.857342 2574 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-ingress/maas-default-gateway-openshift-default-7df95f575-ktm9m"] Jun 03 14:03:45.857741 ip-10-0-134-229 kubenswrapper[2574]: I0603 14:03:45.857676 2574 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="1b0c2196-f19f-4e1c-be7b-8c77508754d1" containerName="manager" Jun 03 14:03:45.857741 ip-10-0-134-229 kubenswrapper[2574]: I0603 14:03:45.857687 2574 state_mem.go:107] "Deleted CPUSet assignment" podUID="1b0c2196-f19f-4e1c-be7b-8c77508754d1" containerName="manager" Jun 03 14:03:45.857815 ip-10-0-134-229 kubenswrapper[2574]: I0603 14:03:45.857758 2574 memory_manager.go:356] "RemoveStaleState removing state" podUID="1b0c2196-f19f-4e1c-be7b-8c77508754d1" containerName="manager" Jun 03 14:03:45.971275 ip-10-0-134-229 kubenswrapper[2574]: I0603 14:03:45.971246 2574 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/maas-default-gateway-openshift-default-7df95f575-ktm9m"] Jun 03 14:03:45.971440 ip-10-0-134-229 kubenswrapper[2574]: I0603 14:03:45.971351 2574 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/maas-default-gateway-openshift-default-7df95f575-ktm9m" Jun 03 14:03:45.973826 ip-10-0-134-229 kubenswrapper[2574]: I0603 14:03:45.973804 2574 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"maas-default-gateway-openshift-default-dockercfg-lz29l\"" Jun 03 14:03:46.052574 ip-10-0-134-229 kubenswrapper[2574]: I0603 14:03:46.052543 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/148a0c1c-ff44-4af0-b1f8-181a2549f1d4-istio-data\") pod \"maas-default-gateway-openshift-default-7df95f575-ktm9m\" (UID: \"148a0c1c-ff44-4af0-b1f8-181a2549f1d4\") " pod="openshift-ingress/maas-default-gateway-openshift-default-7df95f575-ktm9m" Jun 03 14:03:46.052695 ip-10-0-134-229 kubenswrapper[2574]: I0603 14:03:46.052584 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/148a0c1c-ff44-4af0-b1f8-181a2549f1d4-istiod-ca-cert\") pod \"maas-default-gateway-openshift-default-7df95f575-ktm9m\" (UID: \"148a0c1c-ff44-4af0-b1f8-181a2549f1d4\") " pod="openshift-ingress/maas-default-gateway-openshift-default-7df95f575-ktm9m" Jun 03 14:03:46.052695 ip-10-0-134-229 kubenswrapper[2574]: I0603 14:03:46.052604 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/148a0c1c-ff44-4af0-b1f8-181a2549f1d4-istio-podinfo\") pod \"maas-default-gateway-openshift-default-7df95f575-ktm9m\" (UID: \"148a0c1c-ff44-4af0-b1f8-181a2549f1d4\") " pod="openshift-ingress/maas-default-gateway-openshift-default-7df95f575-ktm9m" Jun 03 14:03:46.052795 ip-10-0-134-229 kubenswrapper[2574]: I0603 14:03:46.052690 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/148a0c1c-ff44-4af0-b1f8-181a2549f1d4-workload-socket\") pod \"maas-default-gateway-openshift-default-7df95f575-ktm9m\" (UID: \"148a0c1c-ff44-4af0-b1f8-181a2549f1d4\") " pod="openshift-ingress/maas-default-gateway-openshift-default-7df95f575-ktm9m" Jun 03 14:03:46.052795 ip-10-0-134-229 kubenswrapper[2574]: I0603 14:03:46.052718 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/148a0c1c-ff44-4af0-b1f8-181a2549f1d4-credential-socket\") pod \"maas-default-gateway-openshift-default-7df95f575-ktm9m\" (UID: \"148a0c1c-ff44-4af0-b1f8-181a2549f1d4\") " pod="openshift-ingress/maas-default-gateway-openshift-default-7df95f575-ktm9m" Jun 03 14:03:46.052795 ip-10-0-134-229 kubenswrapper[2574]: I0603 14:03:46.052736 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-xbbdr\" (UniqueName: \"kubernetes.io/projected/148a0c1c-ff44-4af0-b1f8-181a2549f1d4-kube-api-access-xbbdr\") pod \"maas-default-gateway-openshift-default-7df95f575-ktm9m\" (UID: \"148a0c1c-ff44-4af0-b1f8-181a2549f1d4\") " pod="openshift-ingress/maas-default-gateway-openshift-default-7df95f575-ktm9m" Jun 03 14:03:46.052927 ip-10-0-134-229 kubenswrapper[2574]: I0603 14:03:46.052810 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/148a0c1c-ff44-4af0-b1f8-181a2549f1d4-istio-token\") pod \"maas-default-gateway-openshift-default-7df95f575-ktm9m\" (UID: \"148a0c1c-ff44-4af0-b1f8-181a2549f1d4\") " pod="openshift-ingress/maas-default-gateway-openshift-default-7df95f575-ktm9m" Jun 03 14:03:46.052927 ip-10-0-134-229 kubenswrapper[2574]: I0603 14:03:46.052864 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/148a0c1c-ff44-4af0-b1f8-181a2549f1d4-workload-certs\") pod \"maas-default-gateway-openshift-default-7df95f575-ktm9m\" (UID: \"148a0c1c-ff44-4af0-b1f8-181a2549f1d4\") " pod="openshift-ingress/maas-default-gateway-openshift-default-7df95f575-ktm9m" Jun 03 14:03:46.052927 ip-10-0-134-229 kubenswrapper[2574]: I0603 14:03:46.052909 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/148a0c1c-ff44-4af0-b1f8-181a2549f1d4-istio-envoy\") pod \"maas-default-gateway-openshift-default-7df95f575-ktm9m\" (UID: \"148a0c1c-ff44-4af0-b1f8-181a2549f1d4\") " pod="openshift-ingress/maas-default-gateway-openshift-default-7df95f575-ktm9m" Jun 03 14:03:46.153524 ip-10-0-134-229 kubenswrapper[2574]: I0603 14:03:46.153491 2574 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/148a0c1c-ff44-4af0-b1f8-181a2549f1d4-istio-podinfo\") pod \"maas-default-gateway-openshift-default-7df95f575-ktm9m\" (UID: \"148a0c1c-ff44-4af0-b1f8-181a2549f1d4\") " pod="openshift-ingress/maas-default-gateway-openshift-default-7df95f575-ktm9m" Jun 03 14:03:46.153666 ip-10-0-134-229 kubenswrapper[2574]: I0603 14:03:46.153551 2574 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/148a0c1c-ff44-4af0-b1f8-181a2549f1d4-workload-socket\") pod \"maas-default-gateway-openshift-default-7df95f575-ktm9m\" (UID: \"148a0c1c-ff44-4af0-b1f8-181a2549f1d4\") " pod="openshift-ingress/maas-default-gateway-openshift-default-7df95f575-ktm9m" Jun 03 14:03:46.153666 ip-10-0-134-229 kubenswrapper[2574]: I0603 14:03:46.153569 2574 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/148a0c1c-ff44-4af0-b1f8-181a2549f1d4-credential-socket\") pod \"maas-default-gateway-openshift-default-7df95f575-ktm9m\" (UID: \"148a0c1c-ff44-4af0-b1f8-181a2549f1d4\") " pod="openshift-ingress/maas-default-gateway-openshift-default-7df95f575-ktm9m" Jun 03 14:03:46.153666 ip-10-0-134-229 kubenswrapper[2574]: I0603 14:03:46.153585 2574 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-xbbdr\" (UniqueName: \"kubernetes.io/projected/148a0c1c-ff44-4af0-b1f8-181a2549f1d4-kube-api-access-xbbdr\") pod \"maas-default-gateway-openshift-default-7df95f575-ktm9m\" (UID: \"148a0c1c-ff44-4af0-b1f8-181a2549f1d4\") " pod="openshift-ingress/maas-default-gateway-openshift-default-7df95f575-ktm9m" Jun 03 14:03:46.153666 ip-10-0-134-229 kubenswrapper[2574]: I0603 14:03:46.153603 2574 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/148a0c1c-ff44-4af0-b1f8-181a2549f1d4-istio-token\") pod \"maas-default-gateway-openshift-default-7df95f575-ktm9m\" (UID: \"148a0c1c-ff44-4af0-b1f8-181a2549f1d4\") " pod="openshift-ingress/maas-default-gateway-openshift-default-7df95f575-ktm9m" Jun 03 14:03:46.153666 ip-10-0-134-229 kubenswrapper[2574]: I0603 14:03:46.153620 2574 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/148a0c1c-ff44-4af0-b1f8-181a2549f1d4-workload-certs\") pod \"maas-default-gateway-openshift-default-7df95f575-ktm9m\" (UID: \"148a0c1c-ff44-4af0-b1f8-181a2549f1d4\") " pod="openshift-ingress/maas-default-gateway-openshift-default-7df95f575-ktm9m" Jun 03 14:03:46.153666 ip-10-0-134-229 kubenswrapper[2574]: I0603 14:03:46.153656 2574 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/148a0c1c-ff44-4af0-b1f8-181a2549f1d4-istio-envoy\") pod \"maas-default-gateway-openshift-default-7df95f575-ktm9m\" (UID: \"148a0c1c-ff44-4af0-b1f8-181a2549f1d4\") " pod="openshift-ingress/maas-default-gateway-openshift-default-7df95f575-ktm9m" Jun 03 14:03:46.153956 ip-10-0-134-229 kubenswrapper[2574]: I0603 14:03:46.153828 2574 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/148a0c1c-ff44-4af0-b1f8-181a2549f1d4-istio-data\") pod \"maas-default-gateway-openshift-default-7df95f575-ktm9m\" (UID: \"148a0c1c-ff44-4af0-b1f8-181a2549f1d4\") " pod="openshift-ingress/maas-default-gateway-openshift-default-7df95f575-ktm9m" Jun 03 14:03:46.153956 ip-10-0-134-229 kubenswrapper[2574]: I0603 14:03:46.153888 2574 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/148a0c1c-ff44-4af0-b1f8-181a2549f1d4-istiod-ca-cert\") pod \"maas-default-gateway-openshift-default-7df95f575-ktm9m\" (UID: \"148a0c1c-ff44-4af0-b1f8-181a2549f1d4\") " pod="openshift-ingress/maas-default-gateway-openshift-default-7df95f575-ktm9m" Jun 03 14:03:46.154060 ip-10-0-134-229 kubenswrapper[2574]: I0603 14:03:46.153973 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/148a0c1c-ff44-4af0-b1f8-181a2549f1d4-credential-socket\") pod \"maas-default-gateway-openshift-default-7df95f575-ktm9m\" (UID: \"148a0c1c-ff44-4af0-b1f8-181a2549f1d4\") " pod="openshift-ingress/maas-default-gateway-openshift-default-7df95f575-ktm9m" Jun 03 14:03:46.154060 ip-10-0-134-229 kubenswrapper[2574]: I0603 14:03:46.154022 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/148a0c1c-ff44-4af0-b1f8-181a2549f1d4-workload-socket\") pod \"maas-default-gateway-openshift-default-7df95f575-ktm9m\" (UID: \"148a0c1c-ff44-4af0-b1f8-181a2549f1d4\") " pod="openshift-ingress/maas-default-gateway-openshift-default-7df95f575-ktm9m" Jun 03 14:03:46.154178 ip-10-0-134-229 kubenswrapper[2574]: I0603 14:03:46.154153 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/148a0c1c-ff44-4af0-b1f8-181a2549f1d4-workload-certs\") pod \"maas-default-gateway-openshift-default-7df95f575-ktm9m\" (UID: \"148a0c1c-ff44-4af0-b1f8-181a2549f1d4\") " pod="openshift-ingress/maas-default-gateway-openshift-default-7df95f575-ktm9m" Jun 03 14:03:46.154237 ip-10-0-134-229 kubenswrapper[2574]: I0603 14:03:46.154214 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/148a0c1c-ff44-4af0-b1f8-181a2549f1d4-istio-data\") pod \"maas-default-gateway-openshift-default-7df95f575-ktm9m\" (UID: \"148a0c1c-ff44-4af0-b1f8-181a2549f1d4\") " pod="openshift-ingress/maas-default-gateway-openshift-default-7df95f575-ktm9m" Jun 03 14:03:46.154576 ip-10-0-134-229 kubenswrapper[2574]: I0603 14:03:46.154553 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/148a0c1c-ff44-4af0-b1f8-181a2549f1d4-istiod-ca-cert\") pod \"maas-default-gateway-openshift-default-7df95f575-ktm9m\" (UID: \"148a0c1c-ff44-4af0-b1f8-181a2549f1d4\") " pod="openshift-ingress/maas-default-gateway-openshift-default-7df95f575-ktm9m" Jun 03 14:03:46.155912 ip-10-0-134-229 kubenswrapper[2574]: I0603 14:03:46.155895 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/148a0c1c-ff44-4af0-b1f8-181a2549f1d4-istio-envoy\") pod \"maas-default-gateway-openshift-default-7df95f575-ktm9m\" (UID: \"148a0c1c-ff44-4af0-b1f8-181a2549f1d4\") " pod="openshift-ingress/maas-default-gateway-openshift-default-7df95f575-ktm9m" Jun 03 14:03:46.155985 ip-10-0-134-229 kubenswrapper[2574]: I0603 14:03:46.155951 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/148a0c1c-ff44-4af0-b1f8-181a2549f1d4-istio-podinfo\") pod \"maas-default-gateway-openshift-default-7df95f575-ktm9m\" (UID: \"148a0c1c-ff44-4af0-b1f8-181a2549f1d4\") " pod="openshift-ingress/maas-default-gateway-openshift-default-7df95f575-ktm9m" Jun 03 14:03:46.164125 ip-10-0-134-229 kubenswrapper[2574]: I0603 14:03:46.164103 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/148a0c1c-ff44-4af0-b1f8-181a2549f1d4-istio-token\") pod \"maas-default-gateway-openshift-default-7df95f575-ktm9m\" (UID: \"148a0c1c-ff44-4af0-b1f8-181a2549f1d4\") " pod="openshift-ingress/maas-default-gateway-openshift-default-7df95f575-ktm9m" Jun 03 14:03:46.164873 ip-10-0-134-229 kubenswrapper[2574]: I0603 14:03:46.164850 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-xbbdr\" (UniqueName: \"kubernetes.io/projected/148a0c1c-ff44-4af0-b1f8-181a2549f1d4-kube-api-access-xbbdr\") pod \"maas-default-gateway-openshift-default-7df95f575-ktm9m\" (UID: \"148a0c1c-ff44-4af0-b1f8-181a2549f1d4\") " pod="openshift-ingress/maas-default-gateway-openshift-default-7df95f575-ktm9m" Jun 03 14:03:46.281864 ip-10-0-134-229 kubenswrapper[2574]: I0603 14:03:46.281833 2574 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/maas-default-gateway-openshift-default-7df95f575-ktm9m" Jun 03 14:03:46.420468 ip-10-0-134-229 kubenswrapper[2574]: I0603 14:03:46.420432 2574 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/maas-default-gateway-openshift-default-7df95f575-ktm9m"] Jun 03 14:03:46.420704 ip-10-0-134-229 kubenswrapper[2574]: W0603 14:03:46.420574 2574 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod148a0c1c_ff44_4af0_b1f8_181a2549f1d4.slice/crio-5a5258be1cc876d5278545cf3e1f0ce895142a4699bb3b9da27cdf3606b5cb62 WatchSource:0}: Error finding container 5a5258be1cc876d5278545cf3e1f0ce895142a4699bb3b9da27cdf3606b5cb62: Status 404 returned error can't find the container with id 5a5258be1cc876d5278545cf3e1f0ce895142a4699bb3b9da27cdf3606b5cb62 Jun 03 14:03:46.422551 ip-10-0-134-229 kubenswrapper[2574]: I0603 14:03:46.422518 2574 kubelet_resources.go:45] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236232Ki","pods":"250"} Jun 03 14:03:46.422647 ip-10-0-134-229 kubenswrapper[2574]: I0603 14:03:46.422606 2574 kubelet_resources.go:45] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236232Ki","pods":"250"} Jun 03 14:03:46.422715 ip-10-0-134-229 kubenswrapper[2574]: I0603 14:03:46.422661 2574 kubelet_resources.go:45] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236232Ki","pods":"250"} Jun 03 14:03:47.416842 ip-10-0-134-229 kubenswrapper[2574]: I0603 14:03:47.416804 2574 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/maas-default-gateway-openshift-default-7df95f575-ktm9m" event={"ID":"148a0c1c-ff44-4af0-b1f8-181a2549f1d4","Type":"ContainerStarted","Data":"ce9309b22a845aabd0d204551bf677f8465f6698140aaac496380e3dbcdc34de"} Jun 03 14:03:47.416842 ip-10-0-134-229 kubenswrapper[2574]: I0603 14:03:47.416843 2574 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/maas-default-gateway-openshift-default-7df95f575-ktm9m" event={"ID":"148a0c1c-ff44-4af0-b1f8-181a2549f1d4","Type":"ContainerStarted","Data":"5a5258be1cc876d5278545cf3e1f0ce895142a4699bb3b9da27cdf3606b5cb62"} Jun 03 14:03:47.437950 ip-10-0-134-229 kubenswrapper[2574]: I0603 14:03:47.437904 2574 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-ingress/maas-default-gateway-openshift-default-7df95f575-ktm9m" podStartSLOduration=2.437891134 podStartE2EDuration="2.437891134s" podCreationTimestamp="2026-06-03 14:03:45 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2026-06-03 14:03:47.435799656 +0000 UTC m=+588.619806984" watchObservedRunningTime="2026-06-03 14:03:47.437891134 +0000 UTC m=+588.621898463" Jun 03 14:03:48.282978 ip-10-0-134-229 kubenswrapper[2574]: I0603 14:03:48.282943 2574 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/maas-default-gateway-openshift-default-7df95f575-ktm9m" Jun 03 14:03:48.288092 ip-10-0-134-229 kubenswrapper[2574]: I0603 14:03:48.288061 2574 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/maas-default-gateway-openshift-default-7df95f575-ktm9m" Jun 03 14:03:48.420747 ip-10-0-134-229 kubenswrapper[2574]: I0603 14:03:48.420718 2574 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/maas-default-gateway-openshift-default-7df95f575-ktm9m" Jun 03 14:03:48.421807 ip-10-0-134-229 kubenswrapper[2574]: I0603 14:03:48.421788 2574 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/maas-default-gateway-openshift-default-7df95f575-ktm9m" Jun 03 14:04:01.712237 ip-10-0-134-229 kubenswrapper[2574]: I0603 14:04:01.712200 2574 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-jldnj"] Jun 03 14:04:01.733236 ip-10-0-134-229 kubenswrapper[2574]: I0603 14:04:01.733211 2574 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-jldnj"] Jun 03 14:04:01.733422 ip-10-0-134-229 kubenswrapper[2574]: I0603 14:04:01.733310 2574 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-limitador-78c99df468-jldnj" Jun 03 14:04:01.735475 ip-10-0-134-229 kubenswrapper[2574]: I0603 14:04:01.735454 2574 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"limitador-limits-config-limitador\"" Jun 03 14:04:01.736176 ip-10-0-134-229 kubenswrapper[2574]: I0603 14:04:01.736153 2574 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-jldnj"] Jun 03 14:04:01.785827 ip-10-0-134-229 kubenswrapper[2574]: I0603 14:04:01.785804 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-v8zq4\" (UniqueName: \"kubernetes.io/projected/9f1ba4e3-13bd-4dfc-a2eb-1bc4c9b00333-kube-api-access-v8zq4\") pod \"limitador-limitador-78c99df468-jldnj\" (UID: \"9f1ba4e3-13bd-4dfc-a2eb-1bc4c9b00333\") " pod="kuadrant-system/limitador-limitador-78c99df468-jldnj" Jun 03 14:04:01.785933 ip-10-0-134-229 kubenswrapper[2574]: I0603 14:04:01.785841 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-file\" (UniqueName: \"kubernetes.io/configmap/9f1ba4e3-13bd-4dfc-a2eb-1bc4c9b00333-config-file\") pod \"limitador-limitador-78c99df468-jldnj\" (UID: \"9f1ba4e3-13bd-4dfc-a2eb-1bc4c9b00333\") " pod="kuadrant-system/limitador-limitador-78c99df468-jldnj" Jun 03 14:04:01.886314 ip-10-0-134-229 kubenswrapper[2574]: I0603 14:04:01.886279 2574 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"config-file\" (UniqueName: \"kubernetes.io/configmap/9f1ba4e3-13bd-4dfc-a2eb-1bc4c9b00333-config-file\") pod \"limitador-limitador-78c99df468-jldnj\" (UID: \"9f1ba4e3-13bd-4dfc-a2eb-1bc4c9b00333\") " pod="kuadrant-system/limitador-limitador-78c99df468-jldnj" Jun 03 14:04:01.886445 ip-10-0-134-229 kubenswrapper[2574]: I0603 14:04:01.886393 2574 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-v8zq4\" (UniqueName: \"kubernetes.io/projected/9f1ba4e3-13bd-4dfc-a2eb-1bc4c9b00333-kube-api-access-v8zq4\") pod \"limitador-limitador-78c99df468-jldnj\" (UID: \"9f1ba4e3-13bd-4dfc-a2eb-1bc4c9b00333\") " pod="kuadrant-system/limitador-limitador-78c99df468-jldnj" Jun 03 14:04:01.886871 ip-10-0-134-229 kubenswrapper[2574]: I0603 14:04:01.886854 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-file\" (UniqueName: \"kubernetes.io/configmap/9f1ba4e3-13bd-4dfc-a2eb-1bc4c9b00333-config-file\") pod \"limitador-limitador-78c99df468-jldnj\" (UID: \"9f1ba4e3-13bd-4dfc-a2eb-1bc4c9b00333\") " pod="kuadrant-system/limitador-limitador-78c99df468-jldnj" Jun 03 14:04:01.894503 ip-10-0-134-229 kubenswrapper[2574]: I0603 14:04:01.894474 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-v8zq4\" (UniqueName: \"kubernetes.io/projected/9f1ba4e3-13bd-4dfc-a2eb-1bc4c9b00333-kube-api-access-v8zq4\") pod \"limitador-limitador-78c99df468-jldnj\" (UID: \"9f1ba4e3-13bd-4dfc-a2eb-1bc4c9b00333\") " pod="kuadrant-system/limitador-limitador-78c99df468-jldnj" Jun 03 14:04:02.044648 ip-10-0-134-229 kubenswrapper[2574]: I0603 14:04:02.044572 2574 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-limitador-78c99df468-jldnj" Jun 03 14:04:02.174502 ip-10-0-134-229 kubenswrapper[2574]: I0603 14:04:02.174473 2574 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-jldnj"] Jun 03 14:04:02.175832 ip-10-0-134-229 kubenswrapper[2574]: W0603 14:04:02.175798 2574 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod9f1ba4e3_13bd_4dfc_a2eb_1bc4c9b00333.slice/crio-424e8b34ade140c78552509e04f847a46732ac54503ecd30512266d6eead093b WatchSource:0}: Error finding container 424e8b34ade140c78552509e04f847a46732ac54503ecd30512266d6eead093b: Status 404 returned error can't find the container with id 424e8b34ade140c78552509e04f847a46732ac54503ecd30512266d6eead093b Jun 03 14:04:02.313959 ip-10-0-134-229 kubenswrapper[2574]: I0603 14:04:02.313878 2574 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["kuadrant-system/authorino-7498df8756-wddlk"] Jun 03 14:04:02.317069 ip-10-0-134-229 kubenswrapper[2574]: I0603 14:04:02.317049 2574 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-7498df8756-wddlk" Jun 03 14:04:02.319811 ip-10-0-134-229 kubenswrapper[2574]: I0603 14:04:02.319790 2574 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"authorino-authorino-dockercfg-gjbmw\"" Jun 03 14:04:02.321274 ip-10-0-134-229 kubenswrapper[2574]: I0603 14:04:02.321249 2574 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-7498df8756-wddlk"] Jun 03 14:04:02.390524 ip-10-0-134-229 kubenswrapper[2574]: I0603 14:04:02.390499 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-6vh7x\" (UniqueName: \"kubernetes.io/projected/95c55f0e-1554-4e77-8478-f84c16ea2196-kube-api-access-6vh7x\") pod \"authorino-7498df8756-wddlk\" (UID: \"95c55f0e-1554-4e77-8478-f84c16ea2196\") " pod="kuadrant-system/authorino-7498df8756-wddlk" Jun 03 14:04:02.475656 ip-10-0-134-229 kubenswrapper[2574]: I0603 14:04:02.475625 2574 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-limitador-78c99df468-jldnj" event={"ID":"9f1ba4e3-13bd-4dfc-a2eb-1bc4c9b00333","Type":"ContainerStarted","Data":"424e8b34ade140c78552509e04f847a46732ac54503ecd30512266d6eead093b"} Jun 03 14:04:02.491342 ip-10-0-134-229 kubenswrapper[2574]: I0603 14:04:02.491316 2574 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-6vh7x\" (UniqueName: \"kubernetes.io/projected/95c55f0e-1554-4e77-8478-f84c16ea2196-kube-api-access-6vh7x\") pod \"authorino-7498df8756-wddlk\" (UID: \"95c55f0e-1554-4e77-8478-f84c16ea2196\") " pod="kuadrant-system/authorino-7498df8756-wddlk" Jun 03 14:04:02.501830 ip-10-0-134-229 kubenswrapper[2574]: I0603 14:04:02.501807 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-6vh7x\" (UniqueName: \"kubernetes.io/projected/95c55f0e-1554-4e77-8478-f84c16ea2196-kube-api-access-6vh7x\") pod \"authorino-7498df8756-wddlk\" (UID: \"95c55f0e-1554-4e77-8478-f84c16ea2196\") " pod="kuadrant-system/authorino-7498df8756-wddlk" Jun 03 14:04:02.627355 ip-10-0-134-229 kubenswrapper[2574]: I0603 14:04:02.627319 2574 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-7498df8756-wddlk" Jun 03 14:04:02.805334 ip-10-0-134-229 kubenswrapper[2574]: I0603 14:04:02.805251 2574 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-7498df8756-wddlk"] Jun 03 14:04:02.808332 ip-10-0-134-229 kubenswrapper[2574]: W0603 14:04:02.808303 2574 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod95c55f0e_1554_4e77_8478_f84c16ea2196.slice/crio-6641fa7453c346ac9fc5fe76164a50e73b6a867bdbf976c798fadb92deb78520 WatchSource:0}: Error finding container 6641fa7453c346ac9fc5fe76164a50e73b6a867bdbf976c798fadb92deb78520: Status 404 returned error can't find the container with id 6641fa7453c346ac9fc5fe76164a50e73b6a867bdbf976c798fadb92deb78520 Jun 03 14:04:03.480885 ip-10-0-134-229 kubenswrapper[2574]: I0603 14:04:03.480830 2574 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-7498df8756-wddlk" event={"ID":"95c55f0e-1554-4e77-8478-f84c16ea2196","Type":"ContainerStarted","Data":"6641fa7453c346ac9fc5fe76164a50e73b6a867bdbf976c798fadb92deb78520"} Jun 03 14:04:07.497212 ip-10-0-134-229 kubenswrapper[2574]: I0603 14:04:07.497174 2574 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-limitador-78c99df468-jldnj" event={"ID":"9f1ba4e3-13bd-4dfc-a2eb-1bc4c9b00333","Type":"ContainerStarted","Data":"4c96cd70a2e26421d2e59eb94baa3c5d796c2625da94d80f42435cdb2fcf09b5"} Jun 03 14:04:07.497666 ip-10-0-134-229 kubenswrapper[2574]: I0603 14:04:07.497306 2574 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/limitador-limitador-78c99df468-jldnj" Jun 03 14:04:07.498550 ip-10-0-134-229 kubenswrapper[2574]: I0603 14:04:07.498524 2574 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-7498df8756-wddlk" event={"ID":"95c55f0e-1554-4e77-8478-f84c16ea2196","Type":"ContainerStarted","Data":"25a3954f50c1067e2f13d83e677d783c0f43f53fa4349b6e98078ca552f10553"} Jun 03 14:04:07.514200 ip-10-0-134-229 kubenswrapper[2574]: I0603 14:04:07.514154 2574 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="kuadrant-system/limitador-limitador-78c99df468-jldnj" podStartSLOduration=1.820956955 podStartE2EDuration="6.514140917s" podCreationTimestamp="2026-06-03 14:04:01 +0000 UTC" firstStartedPulling="2026-06-03 14:04:02.177637112 +0000 UTC m=+603.361644418" lastFinishedPulling="2026-06-03 14:04:06.870821072 +0000 UTC m=+608.054828380" observedRunningTime="2026-06-03 14:04:07.513764861 +0000 UTC m=+608.697772204" watchObservedRunningTime="2026-06-03 14:04:07.514140917 +0000 UTC m=+608.698148247" Jun 03 14:04:07.529261 ip-10-0-134-229 kubenswrapper[2574]: I0603 14:04:07.529223 2574 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="kuadrant-system/authorino-7498df8756-wddlk" podStartSLOduration=1.468256896 podStartE2EDuration="5.529211841s" podCreationTimestamp="2026-06-03 14:04:02 +0000 UTC" firstStartedPulling="2026-06-03 14:04:02.810499449 +0000 UTC m=+603.994506761" lastFinishedPulling="2026-06-03 14:04:06.871454396 +0000 UTC m=+608.055461706" observedRunningTime="2026-06-03 14:04:07.527067128 +0000 UTC m=+608.711074456" watchObservedRunningTime="2026-06-03 14:04:07.529211841 +0000 UTC m=+608.713219213" Jun 03 14:04:18.503216 ip-10-0-134-229 kubenswrapper[2574]: I0603 14:04:18.503132 2574 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/limitador-limitador-78c99df468-jldnj" Jun 03 14:04:36.571272 ip-10-0-134-229 kubenswrapper[2574]: I0603 14:04:36.571235 2574 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-marketplace/32684d7096c88e320aaae000f43b8c5ea50d1c3368188ae50aa1502a709kgfg"] Jun 03 14:04:36.574209 ip-10-0-134-229 kubenswrapper[2574]: I0603 14:04:36.574192 2574 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/32684d7096c88e320aaae000f43b8c5ea50d1c3368188ae50aa1502a709kgfg" Jun 03 14:04:36.576802 ip-10-0-134-229 kubenswrapper[2574]: I0603 14:04:36.576780 2574 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"kube-root-ca.crt\"" Jun 03 14:04:36.576928 ip-10-0-134-229 kubenswrapper[2574]: I0603 14:04:36.576790 2574 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"openshift-service-ca.crt\"" Jun 03 14:04:36.577493 ip-10-0-134-229 kubenswrapper[2574]: I0603 14:04:36.577479 2574 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-marketplace\"/\"default-dockercfg-h5qff\"" Jun 03 14:04:36.585623 ip-10-0-134-229 kubenswrapper[2574]: I0603 14:04:36.585587 2574 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/32684d7096c88e320aaae000f43b8c5ea50d1c3368188ae50aa1502a709kgfg"] Jun 03 14:04:36.687133 ip-10-0-134-229 kubenswrapper[2574]: I0603 14:04:36.687086 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/ee54702b-89f4-45e9-bff0-7557cb45c82e-bundle\") pod \"32684d7096c88e320aaae000f43b8c5ea50d1c3368188ae50aa1502a709kgfg\" (UID: \"ee54702b-89f4-45e9-bff0-7557cb45c82e\") " pod="openshift-marketplace/32684d7096c88e320aaae000f43b8c5ea50d1c3368188ae50aa1502a709kgfg" Jun 03 14:04:36.687300 ip-10-0-134-229 kubenswrapper[2574]: I0603 14:04:36.687208 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/ee54702b-89f4-45e9-bff0-7557cb45c82e-util\") pod \"32684d7096c88e320aaae000f43b8c5ea50d1c3368188ae50aa1502a709kgfg\" (UID: \"ee54702b-89f4-45e9-bff0-7557cb45c82e\") " pod="openshift-marketplace/32684d7096c88e320aaae000f43b8c5ea50d1c3368188ae50aa1502a709kgfg" Jun 03 14:04:36.687300 ip-10-0-134-229 kubenswrapper[2574]: I0603 14:04:36.687235 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-7qftp\" (UniqueName: \"kubernetes.io/projected/ee54702b-89f4-45e9-bff0-7557cb45c82e-kube-api-access-7qftp\") pod \"32684d7096c88e320aaae000f43b8c5ea50d1c3368188ae50aa1502a709kgfg\" (UID: \"ee54702b-89f4-45e9-bff0-7557cb45c82e\") " pod="openshift-marketplace/32684d7096c88e320aaae000f43b8c5ea50d1c3368188ae50aa1502a709kgfg" Jun 03 14:04:36.787981 ip-10-0-134-229 kubenswrapper[2574]: I0603 14:04:36.787942 2574 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/ee54702b-89f4-45e9-bff0-7557cb45c82e-util\") pod \"32684d7096c88e320aaae000f43b8c5ea50d1c3368188ae50aa1502a709kgfg\" (UID: \"ee54702b-89f4-45e9-bff0-7557cb45c82e\") " pod="openshift-marketplace/32684d7096c88e320aaae000f43b8c5ea50d1c3368188ae50aa1502a709kgfg" Jun 03 14:04:36.787981 ip-10-0-134-229 kubenswrapper[2574]: I0603 14:04:36.787982 2574 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-7qftp\" (UniqueName: \"kubernetes.io/projected/ee54702b-89f4-45e9-bff0-7557cb45c82e-kube-api-access-7qftp\") pod \"32684d7096c88e320aaae000f43b8c5ea50d1c3368188ae50aa1502a709kgfg\" (UID: \"ee54702b-89f4-45e9-bff0-7557cb45c82e\") " pod="openshift-marketplace/32684d7096c88e320aaae000f43b8c5ea50d1c3368188ae50aa1502a709kgfg" Jun 03 14:04:36.788179 ip-10-0-134-229 kubenswrapper[2574]: I0603 14:04:36.788047 2574 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/ee54702b-89f4-45e9-bff0-7557cb45c82e-bundle\") pod \"32684d7096c88e320aaae000f43b8c5ea50d1c3368188ae50aa1502a709kgfg\" (UID: \"ee54702b-89f4-45e9-bff0-7557cb45c82e\") " pod="openshift-marketplace/32684d7096c88e320aaae000f43b8c5ea50d1c3368188ae50aa1502a709kgfg" Jun 03 14:04:36.788357 ip-10-0-134-229 kubenswrapper[2574]: I0603 14:04:36.788337 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/ee54702b-89f4-45e9-bff0-7557cb45c82e-util\") pod \"32684d7096c88e320aaae000f43b8c5ea50d1c3368188ae50aa1502a709kgfg\" (UID: \"ee54702b-89f4-45e9-bff0-7557cb45c82e\") " pod="openshift-marketplace/32684d7096c88e320aaae000f43b8c5ea50d1c3368188ae50aa1502a709kgfg" Jun 03 14:04:36.788473 ip-10-0-134-229 kubenswrapper[2574]: I0603 14:04:36.788456 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/ee54702b-89f4-45e9-bff0-7557cb45c82e-bundle\") pod \"32684d7096c88e320aaae000f43b8c5ea50d1c3368188ae50aa1502a709kgfg\" (UID: \"ee54702b-89f4-45e9-bff0-7557cb45c82e\") " pod="openshift-marketplace/32684d7096c88e320aaae000f43b8c5ea50d1c3368188ae50aa1502a709kgfg" Jun 03 14:04:36.798403 ip-10-0-134-229 kubenswrapper[2574]: I0603 14:04:36.798349 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-7qftp\" (UniqueName: \"kubernetes.io/projected/ee54702b-89f4-45e9-bff0-7557cb45c82e-kube-api-access-7qftp\") pod \"32684d7096c88e320aaae000f43b8c5ea50d1c3368188ae50aa1502a709kgfg\" (UID: \"ee54702b-89f4-45e9-bff0-7557cb45c82e\") " pod="openshift-marketplace/32684d7096c88e320aaae000f43b8c5ea50d1c3368188ae50aa1502a709kgfg" Jun 03 14:04:36.883184 ip-10-0-134-229 kubenswrapper[2574]: I0603 14:04:36.883158 2574 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/32684d7096c88e320aaae000f43b8c5ea50d1c3368188ae50aa1502a709kgfg" Jun 03 14:04:37.026093 ip-10-0-134-229 kubenswrapper[2574]: I0603 14:04:37.026049 2574 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/32684d7096c88e320aaae000f43b8c5ea50d1c3368188ae50aa1502a709kgfg"] Jun 03 14:04:37.026559 ip-10-0-134-229 kubenswrapper[2574]: W0603 14:04:37.026530 2574 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podee54702b_89f4_45e9_bff0_7557cb45c82e.slice/crio-d39af147a532d10f9f01a2695e92ae266844768c68185f32020551eb86057d67 WatchSource:0}: Error finding container d39af147a532d10f9f01a2695e92ae266844768c68185f32020551eb86057d67: Status 404 returned error can't find the container with id d39af147a532d10f9f01a2695e92ae266844768c68185f32020551eb86057d67 Jun 03 14:04:37.617260 ip-10-0-134-229 kubenswrapper[2574]: I0603 14:04:37.617174 2574 generic.go:358] "Generic (PLEG): container finished" podID="ee54702b-89f4-45e9-bff0-7557cb45c82e" containerID="99a7ac83a2f035d8fdad6bfbecff4dabbd5e1e4817d5655d37a0d146f2e2e6aa" exitCode=0 Jun 03 14:04:37.617722 ip-10-0-134-229 kubenswrapper[2574]: I0603 14:04:37.617265 2574 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/32684d7096c88e320aaae000f43b8c5ea50d1c3368188ae50aa1502a709kgfg" event={"ID":"ee54702b-89f4-45e9-bff0-7557cb45c82e","Type":"ContainerDied","Data":"99a7ac83a2f035d8fdad6bfbecff4dabbd5e1e4817d5655d37a0d146f2e2e6aa"} Jun 03 14:04:37.617722 ip-10-0-134-229 kubenswrapper[2574]: I0603 14:04:37.617306 2574 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/32684d7096c88e320aaae000f43b8c5ea50d1c3368188ae50aa1502a709kgfg" event={"ID":"ee54702b-89f4-45e9-bff0-7557cb45c82e","Type":"ContainerStarted","Data":"d39af147a532d10f9f01a2695e92ae266844768c68185f32020551eb86057d67"} Jun 03 14:04:39.626501 ip-10-0-134-229 kubenswrapper[2574]: I0603 14:04:39.626465 2574 generic.go:358] "Generic (PLEG): container finished" podID="ee54702b-89f4-45e9-bff0-7557cb45c82e" containerID="089fa6a606f04f035e99719c838445383b08206c0d44ff796c730ed9178de1e4" exitCode=0 Jun 03 14:04:39.626899 ip-10-0-134-229 kubenswrapper[2574]: I0603 14:04:39.626556 2574 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/32684d7096c88e320aaae000f43b8c5ea50d1c3368188ae50aa1502a709kgfg" event={"ID":"ee54702b-89f4-45e9-bff0-7557cb45c82e","Type":"ContainerDied","Data":"089fa6a606f04f035e99719c838445383b08206c0d44ff796c730ed9178de1e4"} Jun 03 14:04:40.631658 ip-10-0-134-229 kubenswrapper[2574]: I0603 14:04:40.631619 2574 generic.go:358] "Generic (PLEG): container finished" podID="ee54702b-89f4-45e9-bff0-7557cb45c82e" containerID="fb20949bd31e6cb36020478daf271120abb129023aa51f00084ebefb1ba46314" exitCode=0 Jun 03 14:04:40.632025 ip-10-0-134-229 kubenswrapper[2574]: I0603 14:04:40.631689 2574 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/32684d7096c88e320aaae000f43b8c5ea50d1c3368188ae50aa1502a709kgfg" event={"ID":"ee54702b-89f4-45e9-bff0-7557cb45c82e","Type":"ContainerDied","Data":"fb20949bd31e6cb36020478daf271120abb129023aa51f00084ebefb1ba46314"} Jun 03 14:04:41.762635 ip-10-0-134-229 kubenswrapper[2574]: I0603 14:04:41.762609 2574 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/32684d7096c88e320aaae000f43b8c5ea50d1c3368188ae50aa1502a709kgfg" Jun 03 14:04:41.942740 ip-10-0-134-229 kubenswrapper[2574]: I0603 14:04:41.942661 2574 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/ee54702b-89f4-45e9-bff0-7557cb45c82e-util\") pod \"ee54702b-89f4-45e9-bff0-7557cb45c82e\" (UID: \"ee54702b-89f4-45e9-bff0-7557cb45c82e\") " Jun 03 14:04:41.942740 ip-10-0-134-229 kubenswrapper[2574]: I0603 14:04:41.942712 2574 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/ee54702b-89f4-45e9-bff0-7557cb45c82e-bundle\") pod \"ee54702b-89f4-45e9-bff0-7557cb45c82e\" (UID: \"ee54702b-89f4-45e9-bff0-7557cb45c82e\") " Jun 03 14:04:41.942962 ip-10-0-134-229 kubenswrapper[2574]: I0603 14:04:41.942771 2574 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-7qftp\" (UniqueName: \"kubernetes.io/projected/ee54702b-89f4-45e9-bff0-7557cb45c82e-kube-api-access-7qftp\") pod \"ee54702b-89f4-45e9-bff0-7557cb45c82e\" (UID: \"ee54702b-89f4-45e9-bff0-7557cb45c82e\") " Jun 03 14:04:41.943250 ip-10-0-134-229 kubenswrapper[2574]: I0603 14:04:41.943225 2574 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/ee54702b-89f4-45e9-bff0-7557cb45c82e-bundle" (OuterVolumeSpecName: "bundle") pod "ee54702b-89f4-45e9-bff0-7557cb45c82e" (UID: "ee54702b-89f4-45e9-bff0-7557cb45c82e"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jun 03 14:04:41.944825 ip-10-0-134-229 kubenswrapper[2574]: I0603 14:04:41.944799 2574 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/ee54702b-89f4-45e9-bff0-7557cb45c82e-kube-api-access-7qftp" (OuterVolumeSpecName: "kube-api-access-7qftp") pod "ee54702b-89f4-45e9-bff0-7557cb45c82e" (UID: "ee54702b-89f4-45e9-bff0-7557cb45c82e"). InnerVolumeSpecName "kube-api-access-7qftp". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 03 14:04:41.948232 ip-10-0-134-229 kubenswrapper[2574]: I0603 14:04:41.948206 2574 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/ee54702b-89f4-45e9-bff0-7557cb45c82e-util" (OuterVolumeSpecName: "util") pod "ee54702b-89f4-45e9-bff0-7557cb45c82e" (UID: "ee54702b-89f4-45e9-bff0-7557cb45c82e"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jun 03 14:04:42.043906 ip-10-0-134-229 kubenswrapper[2574]: I0603 14:04:42.043871 2574 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-7qftp\" (UniqueName: \"kubernetes.io/projected/ee54702b-89f4-45e9-bff0-7557cb45c82e-kube-api-access-7qftp\") on node \"ip-10-0-134-229.ec2.internal\" DevicePath \"\"" Jun 03 14:04:42.043906 ip-10-0-134-229 kubenswrapper[2574]: I0603 14:04:42.043901 2574 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/ee54702b-89f4-45e9-bff0-7557cb45c82e-util\") on node \"ip-10-0-134-229.ec2.internal\" DevicePath \"\"" Jun 03 14:04:42.043906 ip-10-0-134-229 kubenswrapper[2574]: I0603 14:04:42.043911 2574 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/ee54702b-89f4-45e9-bff0-7557cb45c82e-bundle\") on node \"ip-10-0-134-229.ec2.internal\" DevicePath \"\"" Jun 03 14:04:42.640960 ip-10-0-134-229 kubenswrapper[2574]: I0603 14:04:42.640927 2574 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/32684d7096c88e320aaae000f43b8c5ea50d1c3368188ae50aa1502a709kgfg" Jun 03 14:04:42.641145 ip-10-0-134-229 kubenswrapper[2574]: I0603 14:04:42.640928 2574 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/32684d7096c88e320aaae000f43b8c5ea50d1c3368188ae50aa1502a709kgfg" event={"ID":"ee54702b-89f4-45e9-bff0-7557cb45c82e","Type":"ContainerDied","Data":"d39af147a532d10f9f01a2695e92ae266844768c68185f32020551eb86057d67"} Jun 03 14:04:42.641145 ip-10-0-134-229 kubenswrapper[2574]: I0603 14:04:42.641038 2574 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="d39af147a532d10f9f01a2695e92ae266844768c68185f32020551eb86057d67" Jun 03 14:05:35.783298 ip-10-0-134-229 kubenswrapper[2574]: I0603 14:05:35.783259 2574 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["kuadrant-system/authorino-8b475cf9f-rkpt9"] Jun 03 14:05:35.783792 ip-10-0-134-229 kubenswrapper[2574]: I0603 14:05:35.783621 2574 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="ee54702b-89f4-45e9-bff0-7557cb45c82e" containerName="util" Jun 03 14:05:35.783792 ip-10-0-134-229 kubenswrapper[2574]: I0603 14:05:35.783633 2574 state_mem.go:107] "Deleted CPUSet assignment" podUID="ee54702b-89f4-45e9-bff0-7557cb45c82e" containerName="util" Jun 03 14:05:35.783792 ip-10-0-134-229 kubenswrapper[2574]: I0603 14:05:35.783656 2574 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="ee54702b-89f4-45e9-bff0-7557cb45c82e" containerName="pull" Jun 03 14:05:35.783792 ip-10-0-134-229 kubenswrapper[2574]: I0603 14:05:35.783661 2574 state_mem.go:107] "Deleted CPUSet assignment" podUID="ee54702b-89f4-45e9-bff0-7557cb45c82e" containerName="pull" Jun 03 14:05:35.783792 ip-10-0-134-229 kubenswrapper[2574]: I0603 14:05:35.783667 2574 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="ee54702b-89f4-45e9-bff0-7557cb45c82e" containerName="extract" Jun 03 14:05:35.783792 ip-10-0-134-229 kubenswrapper[2574]: I0603 14:05:35.783674 2574 state_mem.go:107] "Deleted CPUSet assignment" podUID="ee54702b-89f4-45e9-bff0-7557cb45c82e" containerName="extract" Jun 03 14:05:35.783792 ip-10-0-134-229 kubenswrapper[2574]: I0603 14:05:35.783726 2574 memory_manager.go:356] "RemoveStaleState removing state" podUID="ee54702b-89f4-45e9-bff0-7557cb45c82e" containerName="extract" Jun 03 14:05:35.785731 ip-10-0-134-229 kubenswrapper[2574]: I0603 14:05:35.785712 2574 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-8b475cf9f-rkpt9" Jun 03 14:05:35.794089 ip-10-0-134-229 kubenswrapper[2574]: I0603 14:05:35.794063 2574 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-8b475cf9f-rkpt9"] Jun 03 14:05:35.908676 ip-10-0-134-229 kubenswrapper[2574]: I0603 14:05:35.908644 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-8jr2l\" (UniqueName: \"kubernetes.io/projected/cf40cdb1-bd01-4d47-a5b4-6f2e2b11eba0-kube-api-access-8jr2l\") pod \"authorino-8b475cf9f-rkpt9\" (UID: \"cf40cdb1-bd01-4d47-a5b4-6f2e2b11eba0\") " pod="kuadrant-system/authorino-8b475cf9f-rkpt9" Jun 03 14:05:36.002109 ip-10-0-134-229 kubenswrapper[2574]: I0603 14:05:36.002071 2574 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-8b475cf9f-rkpt9"] Jun 03 14:05:36.002361 ip-10-0-134-229 kubenswrapper[2574]: E0603 14:05:36.002334 2574 pod_workers.go:1301] "Error syncing pod, skipping" err="unmounted volumes=[kube-api-access-8jr2l], unattached volumes=[], failed to process volumes=[]: context canceled" pod="kuadrant-system/authorino-8b475cf9f-rkpt9" podUID="cf40cdb1-bd01-4d47-a5b4-6f2e2b11eba0" Jun 03 14:05:36.009968 ip-10-0-134-229 kubenswrapper[2574]: I0603 14:05:36.009946 2574 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-8jr2l\" (UniqueName: \"kubernetes.io/projected/cf40cdb1-bd01-4d47-a5b4-6f2e2b11eba0-kube-api-access-8jr2l\") pod \"authorino-8b475cf9f-rkpt9\" (UID: \"cf40cdb1-bd01-4d47-a5b4-6f2e2b11eba0\") " pod="kuadrant-system/authorino-8b475cf9f-rkpt9" Jun 03 14:05:36.021837 ip-10-0-134-229 kubenswrapper[2574]: I0603 14:05:36.021812 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-8jr2l\" (UniqueName: \"kubernetes.io/projected/cf40cdb1-bd01-4d47-a5b4-6f2e2b11eba0-kube-api-access-8jr2l\") pod \"authorino-8b475cf9f-rkpt9\" (UID: \"cf40cdb1-bd01-4d47-a5b4-6f2e2b11eba0\") " pod="kuadrant-system/authorino-8b475cf9f-rkpt9" Jun 03 14:05:36.031363 ip-10-0-134-229 kubenswrapper[2574]: I0603 14:05:36.031336 2574 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["kuadrant-system/authorino-74bb4d98d9-9sh5f"] Jun 03 14:05:36.034043 ip-10-0-134-229 kubenswrapper[2574]: I0603 14:05:36.034003 2574 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-74bb4d98d9-9sh5f" Jun 03 14:05:36.042363 ip-10-0-134-229 kubenswrapper[2574]: I0603 14:05:36.042342 2574 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-74bb4d98d9-9sh5f"] Jun 03 14:05:36.183007 ip-10-0-134-229 kubenswrapper[2574]: I0603 14:05:36.182974 2574 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-74bb4d98d9-9sh5f"] Jun 03 14:05:36.183247 ip-10-0-134-229 kubenswrapper[2574]: E0603 14:05:36.183225 2574 pod_workers.go:1301] "Error syncing pod, skipping" err="unmounted volumes=[kube-api-access-znkrq], unattached volumes=[], failed to process volumes=[]: context canceled" pod="kuadrant-system/authorino-74bb4d98d9-9sh5f" podUID="f983d64f-858e-4928-8ea2-b5d24744543c" Jun 03 14:05:36.211837 ip-10-0-134-229 kubenswrapper[2574]: I0603 14:05:36.211810 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-znkrq\" (UniqueName: \"kubernetes.io/projected/f983d64f-858e-4928-8ea2-b5d24744543c-kube-api-access-znkrq\") pod \"authorino-74bb4d98d9-9sh5f\" (UID: \"f983d64f-858e-4928-8ea2-b5d24744543c\") " pod="kuadrant-system/authorino-74bb4d98d9-9sh5f" Jun 03 14:05:36.313081 ip-10-0-134-229 kubenswrapper[2574]: I0603 14:05:36.313009 2574 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-znkrq\" (UniqueName: \"kubernetes.io/projected/f983d64f-858e-4928-8ea2-b5d24744543c-kube-api-access-znkrq\") pod \"authorino-74bb4d98d9-9sh5f\" (UID: \"f983d64f-858e-4928-8ea2-b5d24744543c\") " pod="kuadrant-system/authorino-74bb4d98d9-9sh5f" Jun 03 14:05:36.322284 ip-10-0-134-229 kubenswrapper[2574]: I0603 14:05:36.322262 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-znkrq\" (UniqueName: \"kubernetes.io/projected/f983d64f-858e-4928-8ea2-b5d24744543c-kube-api-access-znkrq\") pod \"authorino-74bb4d98d9-9sh5f\" (UID: \"f983d64f-858e-4928-8ea2-b5d24744543c\") " pod="kuadrant-system/authorino-74bb4d98d9-9sh5f" Jun 03 14:05:36.854930 ip-10-0-134-229 kubenswrapper[2574]: I0603 14:05:36.854893 2574 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-74bb4d98d9-9sh5f" Jun 03 14:05:36.855319 ip-10-0-134-229 kubenswrapper[2574]: I0603 14:05:36.854893 2574 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-8b475cf9f-rkpt9" Jun 03 14:05:36.859991 ip-10-0-134-229 kubenswrapper[2574]: I0603 14:05:36.859967 2574 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-74bb4d98d9-9sh5f" Jun 03 14:05:36.863204 ip-10-0-134-229 kubenswrapper[2574]: I0603 14:05:36.863185 2574 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-8b475cf9f-rkpt9" Jun 03 14:05:37.018162 ip-10-0-134-229 kubenswrapper[2574]: I0603 14:05:37.018136 2574 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-znkrq\" (UniqueName: \"kubernetes.io/projected/f983d64f-858e-4928-8ea2-b5d24744543c-kube-api-access-znkrq\") pod \"f983d64f-858e-4928-8ea2-b5d24744543c\" (UID: \"f983d64f-858e-4928-8ea2-b5d24744543c\") " Jun 03 14:05:37.018290 ip-10-0-134-229 kubenswrapper[2574]: I0603 14:05:37.018203 2574 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-8jr2l\" (UniqueName: \"kubernetes.io/projected/cf40cdb1-bd01-4d47-a5b4-6f2e2b11eba0-kube-api-access-8jr2l\") pod \"cf40cdb1-bd01-4d47-a5b4-6f2e2b11eba0\" (UID: \"cf40cdb1-bd01-4d47-a5b4-6f2e2b11eba0\") " Jun 03 14:05:37.020326 ip-10-0-134-229 kubenswrapper[2574]: I0603 14:05:37.020294 2574 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/cf40cdb1-bd01-4d47-a5b4-6f2e2b11eba0-kube-api-access-8jr2l" (OuterVolumeSpecName: "kube-api-access-8jr2l") pod "cf40cdb1-bd01-4d47-a5b4-6f2e2b11eba0" (UID: "cf40cdb1-bd01-4d47-a5b4-6f2e2b11eba0"). InnerVolumeSpecName "kube-api-access-8jr2l". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 03 14:05:37.020326 ip-10-0-134-229 kubenswrapper[2574]: I0603 14:05:37.020302 2574 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/f983d64f-858e-4928-8ea2-b5d24744543c-kube-api-access-znkrq" (OuterVolumeSpecName: "kube-api-access-znkrq") pod "f983d64f-858e-4928-8ea2-b5d24744543c" (UID: "f983d64f-858e-4928-8ea2-b5d24744543c"). InnerVolumeSpecName "kube-api-access-znkrq". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 03 14:05:37.119231 ip-10-0-134-229 kubenswrapper[2574]: I0603 14:05:37.119182 2574 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-znkrq\" (UniqueName: \"kubernetes.io/projected/f983d64f-858e-4928-8ea2-b5d24744543c-kube-api-access-znkrq\") on node \"ip-10-0-134-229.ec2.internal\" DevicePath \"\"" Jun 03 14:05:37.119231 ip-10-0-134-229 kubenswrapper[2574]: I0603 14:05:37.119205 2574 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-8jr2l\" (UniqueName: \"kubernetes.io/projected/cf40cdb1-bd01-4d47-a5b4-6f2e2b11eba0-kube-api-access-8jr2l\") on node \"ip-10-0-134-229.ec2.internal\" DevicePath \"\"" Jun 03 14:05:37.858760 ip-10-0-134-229 kubenswrapper[2574]: I0603 14:05:37.858675 2574 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-8b475cf9f-rkpt9" Jun 03 14:05:37.859194 ip-10-0-134-229 kubenswrapper[2574]: I0603 14:05:37.858675 2574 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-74bb4d98d9-9sh5f" Jun 03 14:05:37.899041 ip-10-0-134-229 kubenswrapper[2574]: I0603 14:05:37.899015 2574 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-8b475cf9f-rkpt9"] Jun 03 14:05:37.905039 ip-10-0-134-229 kubenswrapper[2574]: I0603 14:05:37.905003 2574 kubelet.go:2547] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/authorino-8b475cf9f-rkpt9"] Jun 03 14:05:37.930517 ip-10-0-134-229 kubenswrapper[2574]: I0603 14:05:37.930480 2574 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-74bb4d98d9-9sh5f"] Jun 03 14:05:37.935273 ip-10-0-134-229 kubenswrapper[2574]: I0603 14:05:37.935245 2574 kubelet.go:2547] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/authorino-74bb4d98d9-9sh5f"] Jun 03 14:05:38.147612 ip-10-0-134-229 kubenswrapper[2574]: I0603 14:05:38.147577 2574 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-7498df8756-wddlk"] Jun 03 14:05:38.147843 ip-10-0-134-229 kubenswrapper[2574]: I0603 14:05:38.147817 2574 kuberuntime_container.go:864] "Killing container with a grace period" pod="kuadrant-system/authorino-7498df8756-wddlk" podUID="95c55f0e-1554-4e77-8478-f84c16ea2196" containerName="authorino" containerID="cri-o://25a3954f50c1067e2f13d83e677d783c0f43f53fa4349b6e98078ca552f10553" gracePeriod=30 Jun 03 14:05:38.395848 ip-10-0-134-229 kubenswrapper[2574]: I0603 14:05:38.395821 2574 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-7498df8756-wddlk" Jun 03 14:05:38.428278 ip-10-0-134-229 kubenswrapper[2574]: I0603 14:05:38.428200 2574 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-6vh7x\" (UniqueName: \"kubernetes.io/projected/95c55f0e-1554-4e77-8478-f84c16ea2196-kube-api-access-6vh7x\") pod \"95c55f0e-1554-4e77-8478-f84c16ea2196\" (UID: \"95c55f0e-1554-4e77-8478-f84c16ea2196\") " Jun 03 14:05:38.430627 ip-10-0-134-229 kubenswrapper[2574]: I0603 14:05:38.430595 2574 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/95c55f0e-1554-4e77-8478-f84c16ea2196-kube-api-access-6vh7x" (OuterVolumeSpecName: "kube-api-access-6vh7x") pod "95c55f0e-1554-4e77-8478-f84c16ea2196" (UID: "95c55f0e-1554-4e77-8478-f84c16ea2196"). InnerVolumeSpecName "kube-api-access-6vh7x". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 03 14:05:38.528913 ip-10-0-134-229 kubenswrapper[2574]: I0603 14:05:38.528884 2574 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-6vh7x\" (UniqueName: \"kubernetes.io/projected/95c55f0e-1554-4e77-8478-f84c16ea2196-kube-api-access-6vh7x\") on node \"ip-10-0-134-229.ec2.internal\" DevicePath \"\"" Jun 03 14:05:38.863446 ip-10-0-134-229 kubenswrapper[2574]: I0603 14:05:38.863351 2574 generic.go:358] "Generic (PLEG): container finished" podID="95c55f0e-1554-4e77-8478-f84c16ea2196" containerID="25a3954f50c1067e2f13d83e677d783c0f43f53fa4349b6e98078ca552f10553" exitCode=0 Jun 03 14:05:38.863446 ip-10-0-134-229 kubenswrapper[2574]: I0603 14:05:38.863412 2574 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-7498df8756-wddlk" Jun 03 14:05:38.863932 ip-10-0-134-229 kubenswrapper[2574]: I0603 14:05:38.863442 2574 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-7498df8756-wddlk" event={"ID":"95c55f0e-1554-4e77-8478-f84c16ea2196","Type":"ContainerDied","Data":"25a3954f50c1067e2f13d83e677d783c0f43f53fa4349b6e98078ca552f10553"} Jun 03 14:05:38.863932 ip-10-0-134-229 kubenswrapper[2574]: I0603 14:05:38.863491 2574 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-7498df8756-wddlk" event={"ID":"95c55f0e-1554-4e77-8478-f84c16ea2196","Type":"ContainerDied","Data":"6641fa7453c346ac9fc5fe76164a50e73b6a867bdbf976c798fadb92deb78520"} Jun 03 14:05:38.863932 ip-10-0-134-229 kubenswrapper[2574]: I0603 14:05:38.863512 2574 scope.go:117] "RemoveContainer" containerID="25a3954f50c1067e2f13d83e677d783c0f43f53fa4349b6e98078ca552f10553" Jun 03 14:05:38.872138 ip-10-0-134-229 kubenswrapper[2574]: I0603 14:05:38.872121 2574 scope.go:117] "RemoveContainer" containerID="25a3954f50c1067e2f13d83e677d783c0f43f53fa4349b6e98078ca552f10553" Jun 03 14:05:38.872490 ip-10-0-134-229 kubenswrapper[2574]: E0603 14:05:38.872472 2574 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"25a3954f50c1067e2f13d83e677d783c0f43f53fa4349b6e98078ca552f10553\": container with ID starting with 25a3954f50c1067e2f13d83e677d783c0f43f53fa4349b6e98078ca552f10553 not found: ID does not exist" containerID="25a3954f50c1067e2f13d83e677d783c0f43f53fa4349b6e98078ca552f10553" Jun 03 14:05:38.872558 ip-10-0-134-229 kubenswrapper[2574]: I0603 14:05:38.872499 2574 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"25a3954f50c1067e2f13d83e677d783c0f43f53fa4349b6e98078ca552f10553"} err="failed to get container status \"25a3954f50c1067e2f13d83e677d783c0f43f53fa4349b6e98078ca552f10553\": rpc error: code = NotFound desc = could not find container \"25a3954f50c1067e2f13d83e677d783c0f43f53fa4349b6e98078ca552f10553\": container with ID starting with 25a3954f50c1067e2f13d83e677d783c0f43f53fa4349b6e98078ca552f10553 not found: ID does not exist" Jun 03 14:05:38.884594 ip-10-0-134-229 kubenswrapper[2574]: I0603 14:05:38.884574 2574 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-7498df8756-wddlk"] Jun 03 14:05:38.889170 ip-10-0-134-229 kubenswrapper[2574]: I0603 14:05:38.889148 2574 kubelet.go:2547] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/authorino-7498df8756-wddlk"] Jun 03 14:05:39.432520 ip-10-0-134-229 kubenswrapper[2574]: I0603 14:05:39.432490 2574 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="95c55f0e-1554-4e77-8478-f84c16ea2196" path="/var/lib/kubelet/pods/95c55f0e-1554-4e77-8478-f84c16ea2196/volumes" Jun 03 14:05:39.432810 ip-10-0-134-229 kubenswrapper[2574]: I0603 14:05:39.432797 2574 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="cf40cdb1-bd01-4d47-a5b4-6f2e2b11eba0" path="/var/lib/kubelet/pods/cf40cdb1-bd01-4d47-a5b4-6f2e2b11eba0/volumes" Jun 03 14:05:39.432992 ip-10-0-134-229 kubenswrapper[2574]: I0603 14:05:39.432980 2574 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="f983d64f-858e-4928-8ea2-b5d24744543c" path="/var/lib/kubelet/pods/f983d64f-858e-4928-8ea2-b5d24744543c/volumes" Jun 03 14:06:16.711946 ip-10-0-134-229 kubenswrapper[2574]: I0603 14:06:16.711912 2574 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-jldnj"] Jun 03 14:07:04.478313 ip-10-0-134-229 kubenswrapper[2574]: I0603 14:07:04.478282 2574 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["kuadrant-system/authorino-5894d98ccf-kmg2j"] Jun 03 14:07:04.478763 ip-10-0-134-229 kubenswrapper[2574]: I0603 14:07:04.478627 2574 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="95c55f0e-1554-4e77-8478-f84c16ea2196" containerName="authorino" Jun 03 14:07:04.478763 ip-10-0-134-229 kubenswrapper[2574]: I0603 14:07:04.478640 2574 state_mem.go:107] "Deleted CPUSet assignment" podUID="95c55f0e-1554-4e77-8478-f84c16ea2196" containerName="authorino" Jun 03 14:07:04.478763 ip-10-0-134-229 kubenswrapper[2574]: I0603 14:07:04.478703 2574 memory_manager.go:356] "RemoveStaleState removing state" podUID="95c55f0e-1554-4e77-8478-f84c16ea2196" containerName="authorino" Jun 03 14:07:04.480578 ip-10-0-134-229 kubenswrapper[2574]: I0603 14:07:04.480561 2574 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-5894d98ccf-kmg2j" Jun 03 14:07:04.483743 ip-10-0-134-229 kubenswrapper[2574]: I0603 14:07:04.483718 2574 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"authorino-server-cert\"" Jun 03 14:07:04.483866 ip-10-0-134-229 kubenswrapper[2574]: I0603 14:07:04.483755 2574 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"authorino-oidc-ca\"" Jun 03 14:07:04.483866 ip-10-0-134-229 kubenswrapper[2574]: I0603 14:07:04.483718 2574 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"authorino-authorino-dockercfg-gjbmw\"" Jun 03 14:07:04.490421 ip-10-0-134-229 kubenswrapper[2574]: I0603 14:07:04.490400 2574 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-5894d98ccf-kmg2j"] Jun 03 14:07:04.531142 ip-10-0-134-229 kubenswrapper[2574]: I0603 14:07:04.531112 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-nnn8l\" (UniqueName: \"kubernetes.io/projected/0318234a-f3f9-4f17-b983-e24922654cef-kube-api-access-nnn8l\") pod \"authorino-5894d98ccf-kmg2j\" (UID: \"0318234a-f3f9-4f17-b983-e24922654cef\") " pod="kuadrant-system/authorino-5894d98ccf-kmg2j" Jun 03 14:07:04.531264 ip-10-0-134-229 kubenswrapper[2574]: I0603 14:07:04.531168 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/0318234a-f3f9-4f17-b983-e24922654cef-tls-cert\") pod \"authorino-5894d98ccf-kmg2j\" (UID: \"0318234a-f3f9-4f17-b983-e24922654cef\") " pod="kuadrant-system/authorino-5894d98ccf-kmg2j" Jun 03 14:07:04.531264 ip-10-0-134-229 kubenswrapper[2574]: I0603 14:07:04.531226 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"oidc-ca\" (UniqueName: \"kubernetes.io/configmap/0318234a-f3f9-4f17-b983-e24922654cef-oidc-ca\") pod \"authorino-5894d98ccf-kmg2j\" (UID: \"0318234a-f3f9-4f17-b983-e24922654cef\") " pod="kuadrant-system/authorino-5894d98ccf-kmg2j" Jun 03 14:07:04.632319 ip-10-0-134-229 kubenswrapper[2574]: I0603 14:07:04.632289 2574 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-nnn8l\" (UniqueName: \"kubernetes.io/projected/0318234a-f3f9-4f17-b983-e24922654cef-kube-api-access-nnn8l\") pod \"authorino-5894d98ccf-kmg2j\" (UID: \"0318234a-f3f9-4f17-b983-e24922654cef\") " pod="kuadrant-system/authorino-5894d98ccf-kmg2j" Jun 03 14:07:04.632470 ip-10-0-134-229 kubenswrapper[2574]: I0603 14:07:04.632341 2574 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/0318234a-f3f9-4f17-b983-e24922654cef-tls-cert\") pod \"authorino-5894d98ccf-kmg2j\" (UID: \"0318234a-f3f9-4f17-b983-e24922654cef\") " pod="kuadrant-system/authorino-5894d98ccf-kmg2j" Jun 03 14:07:04.632470 ip-10-0-134-229 kubenswrapper[2574]: I0603 14:07:04.632399 2574 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"oidc-ca\" (UniqueName: \"kubernetes.io/configmap/0318234a-f3f9-4f17-b983-e24922654cef-oidc-ca\") pod \"authorino-5894d98ccf-kmg2j\" (UID: \"0318234a-f3f9-4f17-b983-e24922654cef\") " pod="kuadrant-system/authorino-5894d98ccf-kmg2j" Jun 03 14:07:04.632938 ip-10-0-134-229 kubenswrapper[2574]: I0603 14:07:04.632917 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"oidc-ca\" (UniqueName: \"kubernetes.io/configmap/0318234a-f3f9-4f17-b983-e24922654cef-oidc-ca\") pod \"authorino-5894d98ccf-kmg2j\" (UID: \"0318234a-f3f9-4f17-b983-e24922654cef\") " pod="kuadrant-system/authorino-5894d98ccf-kmg2j" Jun 03 14:07:04.634710 ip-10-0-134-229 kubenswrapper[2574]: I0603 14:07:04.634684 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/0318234a-f3f9-4f17-b983-e24922654cef-tls-cert\") pod \"authorino-5894d98ccf-kmg2j\" (UID: \"0318234a-f3f9-4f17-b983-e24922654cef\") " pod="kuadrant-system/authorino-5894d98ccf-kmg2j" Jun 03 14:07:04.641013 ip-10-0-134-229 kubenswrapper[2574]: I0603 14:07:04.640992 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-nnn8l\" (UniqueName: \"kubernetes.io/projected/0318234a-f3f9-4f17-b983-e24922654cef-kube-api-access-nnn8l\") pod \"authorino-5894d98ccf-kmg2j\" (UID: \"0318234a-f3f9-4f17-b983-e24922654cef\") " pod="kuadrant-system/authorino-5894d98ccf-kmg2j" Jun 03 14:07:04.791024 ip-10-0-134-229 kubenswrapper[2574]: I0603 14:07:04.790949 2574 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-5894d98ccf-kmg2j" Jun 03 14:07:04.915699 ip-10-0-134-229 kubenswrapper[2574]: I0603 14:07:04.915674 2574 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-5894d98ccf-kmg2j"] Jun 03 14:07:04.917063 ip-10-0-134-229 kubenswrapper[2574]: W0603 14:07:04.917027 2574 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod0318234a_f3f9_4f17_b983_e24922654cef.slice/crio-bbc6e497bba4682233dcbe42b5847281d374211804adbe161f330c72aef663ae WatchSource:0}: Error finding container bbc6e497bba4682233dcbe42b5847281d374211804adbe161f330c72aef663ae: Status 404 returned error can't find the container with id bbc6e497bba4682233dcbe42b5847281d374211804adbe161f330c72aef663ae Jun 03 14:07:04.918410 ip-10-0-134-229 kubenswrapper[2574]: I0603 14:07:04.918366 2574 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider Jun 03 14:07:05.177921 ip-10-0-134-229 kubenswrapper[2574]: I0603 14:07:05.177886 2574 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-5894d98ccf-kmg2j" event={"ID":"0318234a-f3f9-4f17-b983-e24922654cef","Type":"ContainerStarted","Data":"bbc6e497bba4682233dcbe42b5847281d374211804adbe161f330c72aef663ae"} Jun 03 14:07:06.188840 ip-10-0-134-229 kubenswrapper[2574]: I0603 14:07:06.188800 2574 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-5894d98ccf-kmg2j" event={"ID":"0318234a-f3f9-4f17-b983-e24922654cef","Type":"ContainerStarted","Data":"2f959b69565de608839deff7e672aeb40016a432a8a545933b4223a2a45def72"} Jun 03 14:07:06.206588 ip-10-0-134-229 kubenswrapper[2574]: I0603 14:07:06.206545 2574 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="kuadrant-system/authorino-5894d98ccf-kmg2j" podStartSLOduration=1.877990023 podStartE2EDuration="2.206531052s" podCreationTimestamp="2026-06-03 14:07:04 +0000 UTC" firstStartedPulling="2026-06-03 14:07:04.918546146 +0000 UTC m=+786.102553453" lastFinishedPulling="2026-06-03 14:07:05.247087172 +0000 UTC m=+786.431094482" observedRunningTime="2026-06-03 14:07:06.204407509 +0000 UTC m=+787.388414839" watchObservedRunningTime="2026-06-03 14:07:06.206531052 +0000 UTC m=+787.390538412" Jun 03 14:07:30.460792 ip-10-0-134-229 kubenswrapper[2574]: I0603 14:07:30.460703 2574 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-jldnj"] Jun 03 14:07:45.039778 ip-10-0-134-229 kubenswrapper[2574]: I0603 14:07:45.039738 2574 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-jldnj"] Jun 03 14:07:57.532639 ip-10-0-134-229 kubenswrapper[2574]: I0603 14:07:57.532602 2574 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-jldnj"] Jun 03 14:08:09.943404 ip-10-0-134-229 kubenswrapper[2574]: I0603 14:08:09.943351 2574 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-jldnj"] Jun 03 14:08:30.944251 ip-10-0-134-229 kubenswrapper[2574]: I0603 14:08:30.944208 2574 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-jldnj"] Jun 03 14:08:48.336221 ip-10-0-134-229 kubenswrapper[2574]: I0603 14:08:48.336132 2574 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-jldnj"] Jun 03 14:12:38.044997 ip-10-0-134-229 kubenswrapper[2574]: I0603 14:12:38.044962 2574 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-console/console-7ffb9d76fb-7wxxv"] Jun 03 14:12:38.047726 ip-10-0-134-229 kubenswrapper[2574]: I0603 14:12:38.047706 2574 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-7ffb9d76fb-7wxxv" Jun 03 14:12:38.091578 ip-10-0-134-229 kubenswrapper[2574]: I0603 14:12:38.091552 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/1e02c3ae-e583-4981-91de-b3dc9b9ea494-trusted-ca-bundle\") pod \"console-7ffb9d76fb-7wxxv\" (UID: \"1e02c3ae-e583-4981-91de-b3dc9b9ea494\") " pod="openshift-console/console-7ffb9d76fb-7wxxv" Jun 03 14:12:38.091755 ip-10-0-134-229 kubenswrapper[2574]: I0603 14:12:38.091594 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/1e02c3ae-e583-4981-91de-b3dc9b9ea494-console-config\") pod \"console-7ffb9d76fb-7wxxv\" (UID: \"1e02c3ae-e583-4981-91de-b3dc9b9ea494\") " pod="openshift-console/console-7ffb9d76fb-7wxxv" Jun 03 14:12:38.091755 ip-10-0-134-229 kubenswrapper[2574]: I0603 14:12:38.091660 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/1e02c3ae-e583-4981-91de-b3dc9b9ea494-service-ca\") pod \"console-7ffb9d76fb-7wxxv\" (UID: \"1e02c3ae-e583-4981-91de-b3dc9b9ea494\") " pod="openshift-console/console-7ffb9d76fb-7wxxv" Jun 03 14:12:38.091755 ip-10-0-134-229 kubenswrapper[2574]: I0603 14:12:38.091685 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-c5z6p\" (UniqueName: \"kubernetes.io/projected/1e02c3ae-e583-4981-91de-b3dc9b9ea494-kube-api-access-c5z6p\") pod \"console-7ffb9d76fb-7wxxv\" (UID: \"1e02c3ae-e583-4981-91de-b3dc9b9ea494\") " pod="openshift-console/console-7ffb9d76fb-7wxxv" Jun 03 14:12:38.091755 ip-10-0-134-229 kubenswrapper[2574]: I0603 14:12:38.091742 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/1e02c3ae-e583-4981-91de-b3dc9b9ea494-oauth-serving-cert\") pod \"console-7ffb9d76fb-7wxxv\" (UID: \"1e02c3ae-e583-4981-91de-b3dc9b9ea494\") " pod="openshift-console/console-7ffb9d76fb-7wxxv" Jun 03 14:12:38.091967 ip-10-0-134-229 kubenswrapper[2574]: I0603 14:12:38.091780 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/1e02c3ae-e583-4981-91de-b3dc9b9ea494-console-serving-cert\") pod \"console-7ffb9d76fb-7wxxv\" (UID: \"1e02c3ae-e583-4981-91de-b3dc9b9ea494\") " pod="openshift-console/console-7ffb9d76fb-7wxxv" Jun 03 14:12:38.091967 ip-10-0-134-229 kubenswrapper[2574]: I0603 14:12:38.091804 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/1e02c3ae-e583-4981-91de-b3dc9b9ea494-console-oauth-config\") pod \"console-7ffb9d76fb-7wxxv\" (UID: \"1e02c3ae-e583-4981-91de-b3dc9b9ea494\") " pod="openshift-console/console-7ffb9d76fb-7wxxv" Jun 03 14:12:38.111340 ip-10-0-134-229 kubenswrapper[2574]: I0603 14:12:38.111314 2574 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-7ffb9d76fb-7wxxv"] Jun 03 14:12:38.192166 ip-10-0-134-229 kubenswrapper[2574]: I0603 14:12:38.192139 2574 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/1e02c3ae-e583-4981-91de-b3dc9b9ea494-console-config\") pod \"console-7ffb9d76fb-7wxxv\" (UID: \"1e02c3ae-e583-4981-91de-b3dc9b9ea494\") " pod="openshift-console/console-7ffb9d76fb-7wxxv" Jun 03 14:12:38.192293 ip-10-0-134-229 kubenswrapper[2574]: I0603 14:12:38.192181 2574 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/1e02c3ae-e583-4981-91de-b3dc9b9ea494-service-ca\") pod \"console-7ffb9d76fb-7wxxv\" (UID: \"1e02c3ae-e583-4981-91de-b3dc9b9ea494\") " pod="openshift-console/console-7ffb9d76fb-7wxxv" Jun 03 14:12:38.192293 ip-10-0-134-229 kubenswrapper[2574]: I0603 14:12:38.192201 2574 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-c5z6p\" (UniqueName: \"kubernetes.io/projected/1e02c3ae-e583-4981-91de-b3dc9b9ea494-kube-api-access-c5z6p\") pod \"console-7ffb9d76fb-7wxxv\" (UID: \"1e02c3ae-e583-4981-91de-b3dc9b9ea494\") " pod="openshift-console/console-7ffb9d76fb-7wxxv" Jun 03 14:12:38.192293 ip-10-0-134-229 kubenswrapper[2574]: I0603 14:12:38.192234 2574 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/1e02c3ae-e583-4981-91de-b3dc9b9ea494-oauth-serving-cert\") pod \"console-7ffb9d76fb-7wxxv\" (UID: \"1e02c3ae-e583-4981-91de-b3dc9b9ea494\") " pod="openshift-console/console-7ffb9d76fb-7wxxv" Jun 03 14:12:38.192293 ip-10-0-134-229 kubenswrapper[2574]: I0603 14:12:38.192257 2574 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/1e02c3ae-e583-4981-91de-b3dc9b9ea494-console-serving-cert\") pod \"console-7ffb9d76fb-7wxxv\" (UID: \"1e02c3ae-e583-4981-91de-b3dc9b9ea494\") " pod="openshift-console/console-7ffb9d76fb-7wxxv" Jun 03 14:12:38.192293 ip-10-0-134-229 kubenswrapper[2574]: I0603 14:12:38.192272 2574 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/1e02c3ae-e583-4981-91de-b3dc9b9ea494-console-oauth-config\") pod \"console-7ffb9d76fb-7wxxv\" (UID: \"1e02c3ae-e583-4981-91de-b3dc9b9ea494\") " pod="openshift-console/console-7ffb9d76fb-7wxxv" Jun 03 14:12:38.192552 ip-10-0-134-229 kubenswrapper[2574]: I0603 14:12:38.192317 2574 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/1e02c3ae-e583-4981-91de-b3dc9b9ea494-trusted-ca-bundle\") pod \"console-7ffb9d76fb-7wxxv\" (UID: \"1e02c3ae-e583-4981-91de-b3dc9b9ea494\") " pod="openshift-console/console-7ffb9d76fb-7wxxv" Jun 03 14:12:38.192908 ip-10-0-134-229 kubenswrapper[2574]: I0603 14:12:38.192880 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/1e02c3ae-e583-4981-91de-b3dc9b9ea494-console-config\") pod \"console-7ffb9d76fb-7wxxv\" (UID: \"1e02c3ae-e583-4981-91de-b3dc9b9ea494\") " pod="openshift-console/console-7ffb9d76fb-7wxxv" Jun 03 14:12:38.193013 ip-10-0-134-229 kubenswrapper[2574]: I0603 14:12:38.192948 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/1e02c3ae-e583-4981-91de-b3dc9b9ea494-oauth-serving-cert\") pod \"console-7ffb9d76fb-7wxxv\" (UID: \"1e02c3ae-e583-4981-91de-b3dc9b9ea494\") " pod="openshift-console/console-7ffb9d76fb-7wxxv" Jun 03 14:12:38.193069 ip-10-0-134-229 kubenswrapper[2574]: I0603 14:12:38.193007 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/1e02c3ae-e583-4981-91de-b3dc9b9ea494-service-ca\") pod \"console-7ffb9d76fb-7wxxv\" (UID: \"1e02c3ae-e583-4981-91de-b3dc9b9ea494\") " pod="openshift-console/console-7ffb9d76fb-7wxxv" Jun 03 14:12:38.193228 ip-10-0-134-229 kubenswrapper[2574]: I0603 14:12:38.193205 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/1e02c3ae-e583-4981-91de-b3dc9b9ea494-trusted-ca-bundle\") pod \"console-7ffb9d76fb-7wxxv\" (UID: \"1e02c3ae-e583-4981-91de-b3dc9b9ea494\") " pod="openshift-console/console-7ffb9d76fb-7wxxv" Jun 03 14:12:38.194736 ip-10-0-134-229 kubenswrapper[2574]: I0603 14:12:38.194713 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/1e02c3ae-e583-4981-91de-b3dc9b9ea494-console-serving-cert\") pod \"console-7ffb9d76fb-7wxxv\" (UID: \"1e02c3ae-e583-4981-91de-b3dc9b9ea494\") " pod="openshift-console/console-7ffb9d76fb-7wxxv" Jun 03 14:12:38.194829 ip-10-0-134-229 kubenswrapper[2574]: I0603 14:12:38.194811 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/1e02c3ae-e583-4981-91de-b3dc9b9ea494-console-oauth-config\") pod \"console-7ffb9d76fb-7wxxv\" (UID: \"1e02c3ae-e583-4981-91de-b3dc9b9ea494\") " pod="openshift-console/console-7ffb9d76fb-7wxxv" Jun 03 14:12:38.200982 ip-10-0-134-229 kubenswrapper[2574]: I0603 14:12:38.200962 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-c5z6p\" (UniqueName: \"kubernetes.io/projected/1e02c3ae-e583-4981-91de-b3dc9b9ea494-kube-api-access-c5z6p\") pod \"console-7ffb9d76fb-7wxxv\" (UID: \"1e02c3ae-e583-4981-91de-b3dc9b9ea494\") " pod="openshift-console/console-7ffb9d76fb-7wxxv" Jun 03 14:12:38.356789 ip-10-0-134-229 kubenswrapper[2574]: I0603 14:12:38.356696 2574 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-7ffb9d76fb-7wxxv" Jun 03 14:12:38.491995 ip-10-0-134-229 kubenswrapper[2574]: I0603 14:12:38.491973 2574 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-7ffb9d76fb-7wxxv"] Jun 03 14:12:38.493895 ip-10-0-134-229 kubenswrapper[2574]: W0603 14:12:38.493865 2574 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod1e02c3ae_e583_4981_91de_b3dc9b9ea494.slice/crio-e8cdeed6e439b0574482068973cb788aff4cfa435ada6674cbddb17145439751 WatchSource:0}: Error finding container e8cdeed6e439b0574482068973cb788aff4cfa435ada6674cbddb17145439751: Status 404 returned error can't find the container with id e8cdeed6e439b0574482068973cb788aff4cfa435ada6674cbddb17145439751 Jun 03 14:12:38.495712 ip-10-0-134-229 kubenswrapper[2574]: I0603 14:12:38.495691 2574 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider Jun 03 14:12:39.423596 ip-10-0-134-229 kubenswrapper[2574]: I0603 14:12:39.423556 2574 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-7ffb9d76fb-7wxxv" event={"ID":"1e02c3ae-e583-4981-91de-b3dc9b9ea494","Type":"ContainerStarted","Data":"f0e2b85fd0734aca4abb13dd6314c8364edd0847659f9edb59530db5ff171471"} Jun 03 14:12:39.423596 ip-10-0-134-229 kubenswrapper[2574]: I0603 14:12:39.423599 2574 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-7ffb9d76fb-7wxxv" event={"ID":"1e02c3ae-e583-4981-91de-b3dc9b9ea494","Type":"ContainerStarted","Data":"e8cdeed6e439b0574482068973cb788aff4cfa435ada6674cbddb17145439751"} Jun 03 14:12:39.444791 ip-10-0-134-229 kubenswrapper[2574]: I0603 14:12:39.444743 2574 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-console/console-7ffb9d76fb-7wxxv" podStartSLOduration=1.444729042 podStartE2EDuration="1.444729042s" podCreationTimestamp="2026-06-03 14:12:38 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2026-06-03 14:12:39.443602222 +0000 UTC m=+1120.627609562" watchObservedRunningTime="2026-06-03 14:12:39.444729042 +0000 UTC m=+1120.628736370" Jun 03 14:12:48.357434 ip-10-0-134-229 kubenswrapper[2574]: I0603 14:12:48.357394 2574 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-console/console-7ffb9d76fb-7wxxv" Jun 03 14:12:48.358015 ip-10-0-134-229 kubenswrapper[2574]: I0603 14:12:48.357446 2574 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/console-7ffb9d76fb-7wxxv" Jun 03 14:12:48.362226 ip-10-0-134-229 kubenswrapper[2574]: I0603 14:12:48.362201 2574 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-console/console-7ffb9d76fb-7wxxv" Jun 03 14:12:48.459751 ip-10-0-134-229 kubenswrapper[2574]: I0603 14:12:48.459724 2574 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console/console-7ffb9d76fb-7wxxv" Jun 03 14:12:48.512214 ip-10-0-134-229 kubenswrapper[2574]: I0603 14:12:48.512181 2574 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openshift-console/console-dcd8c84fd-2jw47"] Jun 03 14:13:13.536820 ip-10-0-134-229 kubenswrapper[2574]: I0603 14:13:13.536763 2574 kuberuntime_container.go:864] "Killing container with a grace period" pod="openshift-console/console-dcd8c84fd-2jw47" podUID="e245ca28-ddf8-46ea-b07c-6b48c53f38de" containerName="console" containerID="cri-o://6a8165f2f6d53af9811926486ed5392020495382081649ef1a581bd107e3b9f3" gracePeriod=15 Jun 03 14:13:13.779463 ip-10-0-134-229 kubenswrapper[2574]: I0603 14:13:13.779437 2574 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console_console-dcd8c84fd-2jw47_e245ca28-ddf8-46ea-b07c-6b48c53f38de/console/0.log" Jun 03 14:13:13.779590 ip-10-0-134-229 kubenswrapper[2574]: I0603 14:13:13.779498 2574 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-dcd8c84fd-2jw47" Jun 03 14:13:13.898119 ip-10-0-134-229 kubenswrapper[2574]: I0603 14:13:13.898092 2574 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/e245ca28-ddf8-46ea-b07c-6b48c53f38de-console-oauth-config\") pod \"e245ca28-ddf8-46ea-b07c-6b48c53f38de\" (UID: \"e245ca28-ddf8-46ea-b07c-6b48c53f38de\") " Jun 03 14:13:13.898274 ip-10-0-134-229 kubenswrapper[2574]: I0603 14:13:13.898132 2574 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/e245ca28-ddf8-46ea-b07c-6b48c53f38de-oauth-serving-cert\") pod \"e245ca28-ddf8-46ea-b07c-6b48c53f38de\" (UID: \"e245ca28-ddf8-46ea-b07c-6b48c53f38de\") " Jun 03 14:13:13.898274 ip-10-0-134-229 kubenswrapper[2574]: I0603 14:13:13.898164 2574 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/e245ca28-ddf8-46ea-b07c-6b48c53f38de-console-serving-cert\") pod \"e245ca28-ddf8-46ea-b07c-6b48c53f38de\" (UID: \"e245ca28-ddf8-46ea-b07c-6b48c53f38de\") " Jun 03 14:13:13.898274 ip-10-0-134-229 kubenswrapper[2574]: I0603 14:13:13.898189 2574 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-vtscl\" (UniqueName: \"kubernetes.io/projected/e245ca28-ddf8-46ea-b07c-6b48c53f38de-kube-api-access-vtscl\") pod \"e245ca28-ddf8-46ea-b07c-6b48c53f38de\" (UID: \"e245ca28-ddf8-46ea-b07c-6b48c53f38de\") " Jun 03 14:13:13.898274 ip-10-0-134-229 kubenswrapper[2574]: I0603 14:13:13.898220 2574 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/e245ca28-ddf8-46ea-b07c-6b48c53f38de-console-config\") pod \"e245ca28-ddf8-46ea-b07c-6b48c53f38de\" (UID: \"e245ca28-ddf8-46ea-b07c-6b48c53f38de\") " Jun 03 14:13:13.898274 ip-10-0-134-229 kubenswrapper[2574]: I0603 14:13:13.898245 2574 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/e245ca28-ddf8-46ea-b07c-6b48c53f38de-service-ca\") pod \"e245ca28-ddf8-46ea-b07c-6b48c53f38de\" (UID: \"e245ca28-ddf8-46ea-b07c-6b48c53f38de\") " Jun 03 14:13:13.898560 ip-10-0-134-229 kubenswrapper[2574]: I0603 14:13:13.898331 2574 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/e245ca28-ddf8-46ea-b07c-6b48c53f38de-trusted-ca-bundle\") pod \"e245ca28-ddf8-46ea-b07c-6b48c53f38de\" (UID: \"e245ca28-ddf8-46ea-b07c-6b48c53f38de\") " Jun 03 14:13:13.898654 ip-10-0-134-229 kubenswrapper[2574]: I0603 14:13:13.898591 2574 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/e245ca28-ddf8-46ea-b07c-6b48c53f38de-oauth-serving-cert" (OuterVolumeSpecName: "oauth-serving-cert") pod "e245ca28-ddf8-46ea-b07c-6b48c53f38de" (UID: "e245ca28-ddf8-46ea-b07c-6b48c53f38de"). InnerVolumeSpecName "oauth-serving-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jun 03 14:13:13.898730 ip-10-0-134-229 kubenswrapper[2574]: I0603 14:13:13.898691 2574 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/e245ca28-ddf8-46ea-b07c-6b48c53f38de-console-config" (OuterVolumeSpecName: "console-config") pod "e245ca28-ddf8-46ea-b07c-6b48c53f38de" (UID: "e245ca28-ddf8-46ea-b07c-6b48c53f38de"). InnerVolumeSpecName "console-config". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jun 03 14:13:13.898730 ip-10-0-134-229 kubenswrapper[2574]: I0603 14:13:13.898699 2574 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/e245ca28-ddf8-46ea-b07c-6b48c53f38de-service-ca" (OuterVolumeSpecName: "service-ca") pod "e245ca28-ddf8-46ea-b07c-6b48c53f38de" (UID: "e245ca28-ddf8-46ea-b07c-6b48c53f38de"). InnerVolumeSpecName "service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jun 03 14:13:13.898945 ip-10-0-134-229 kubenswrapper[2574]: I0603 14:13:13.898919 2574 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/e245ca28-ddf8-46ea-b07c-6b48c53f38de-trusted-ca-bundle" (OuterVolumeSpecName: "trusted-ca-bundle") pod "e245ca28-ddf8-46ea-b07c-6b48c53f38de" (UID: "e245ca28-ddf8-46ea-b07c-6b48c53f38de"). InnerVolumeSpecName "trusted-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jun 03 14:13:13.900461 ip-10-0-134-229 kubenswrapper[2574]: I0603 14:13:13.900433 2574 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/e245ca28-ddf8-46ea-b07c-6b48c53f38de-console-serving-cert" (OuterVolumeSpecName: "console-serving-cert") pod "e245ca28-ddf8-46ea-b07c-6b48c53f38de" (UID: "e245ca28-ddf8-46ea-b07c-6b48c53f38de"). InnerVolumeSpecName "console-serving-cert". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jun 03 14:13:13.900461 ip-10-0-134-229 kubenswrapper[2574]: I0603 14:13:13.900451 2574 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/e245ca28-ddf8-46ea-b07c-6b48c53f38de-console-oauth-config" (OuterVolumeSpecName: "console-oauth-config") pod "e245ca28-ddf8-46ea-b07c-6b48c53f38de" (UID: "e245ca28-ddf8-46ea-b07c-6b48c53f38de"). InnerVolumeSpecName "console-oauth-config". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jun 03 14:13:13.900582 ip-10-0-134-229 kubenswrapper[2574]: I0603 14:13:13.900441 2574 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/e245ca28-ddf8-46ea-b07c-6b48c53f38de-kube-api-access-vtscl" (OuterVolumeSpecName: "kube-api-access-vtscl") pod "e245ca28-ddf8-46ea-b07c-6b48c53f38de" (UID: "e245ca28-ddf8-46ea-b07c-6b48c53f38de"). InnerVolumeSpecName "kube-api-access-vtscl". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 03 14:13:13.999117 ip-10-0-134-229 kubenswrapper[2574]: I0603 14:13:13.999094 2574 reconciler_common.go:299] "Volume detached for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/e245ca28-ddf8-46ea-b07c-6b48c53f38de-console-oauth-config\") on node \"ip-10-0-134-229.ec2.internal\" DevicePath \"\"" Jun 03 14:13:13.999117 ip-10-0-134-229 kubenswrapper[2574]: I0603 14:13:13.999116 2574 reconciler_common.go:299] "Volume detached for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/e245ca28-ddf8-46ea-b07c-6b48c53f38de-oauth-serving-cert\") on node \"ip-10-0-134-229.ec2.internal\" DevicePath \"\"" Jun 03 14:13:13.999259 ip-10-0-134-229 kubenswrapper[2574]: I0603 14:13:13.999126 2574 reconciler_common.go:299] "Volume detached for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/e245ca28-ddf8-46ea-b07c-6b48c53f38de-console-serving-cert\") on node \"ip-10-0-134-229.ec2.internal\" DevicePath \"\"" Jun 03 14:13:13.999259 ip-10-0-134-229 kubenswrapper[2574]: I0603 14:13:13.999137 2574 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-vtscl\" (UniqueName: \"kubernetes.io/projected/e245ca28-ddf8-46ea-b07c-6b48c53f38de-kube-api-access-vtscl\") on node \"ip-10-0-134-229.ec2.internal\" DevicePath \"\"" Jun 03 14:13:13.999259 ip-10-0-134-229 kubenswrapper[2574]: I0603 14:13:13.999146 2574 reconciler_common.go:299] "Volume detached for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/e245ca28-ddf8-46ea-b07c-6b48c53f38de-console-config\") on node \"ip-10-0-134-229.ec2.internal\" DevicePath \"\"" Jun 03 14:13:13.999259 ip-10-0-134-229 kubenswrapper[2574]: I0603 14:13:13.999154 2574 reconciler_common.go:299] "Volume detached for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/e245ca28-ddf8-46ea-b07c-6b48c53f38de-service-ca\") on node \"ip-10-0-134-229.ec2.internal\" DevicePath \"\"" Jun 03 14:13:13.999259 ip-10-0-134-229 kubenswrapper[2574]: I0603 14:13:13.999162 2574 reconciler_common.go:299] "Volume detached for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/e245ca28-ddf8-46ea-b07c-6b48c53f38de-trusted-ca-bundle\") on node \"ip-10-0-134-229.ec2.internal\" DevicePath \"\"" Jun 03 14:13:14.557995 ip-10-0-134-229 kubenswrapper[2574]: I0603 14:13:14.557967 2574 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console_console-dcd8c84fd-2jw47_e245ca28-ddf8-46ea-b07c-6b48c53f38de/console/0.log" Jun 03 14:13:14.558451 ip-10-0-134-229 kubenswrapper[2574]: I0603 14:13:14.558008 2574 generic.go:358] "Generic (PLEG): container finished" podID="e245ca28-ddf8-46ea-b07c-6b48c53f38de" containerID="6a8165f2f6d53af9811926486ed5392020495382081649ef1a581bd107e3b9f3" exitCode=2 Jun 03 14:13:14.558451 ip-10-0-134-229 kubenswrapper[2574]: I0603 14:13:14.558078 2574 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-dcd8c84fd-2jw47" event={"ID":"e245ca28-ddf8-46ea-b07c-6b48c53f38de","Type":"ContainerDied","Data":"6a8165f2f6d53af9811926486ed5392020495382081649ef1a581bd107e3b9f3"} Jun 03 14:13:14.558451 ip-10-0-134-229 kubenswrapper[2574]: I0603 14:13:14.558095 2574 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-dcd8c84fd-2jw47" Jun 03 14:13:14.558451 ip-10-0-134-229 kubenswrapper[2574]: I0603 14:13:14.558113 2574 scope.go:117] "RemoveContainer" containerID="6a8165f2f6d53af9811926486ed5392020495382081649ef1a581bd107e3b9f3" Jun 03 14:13:14.558451 ip-10-0-134-229 kubenswrapper[2574]: I0603 14:13:14.558103 2574 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-dcd8c84fd-2jw47" event={"ID":"e245ca28-ddf8-46ea-b07c-6b48c53f38de","Type":"ContainerDied","Data":"e347e17d2ce6da1f99d9cf724273b182d9e2a0fca8afe91954bde1b70084dd57"} Jun 03 14:13:14.567567 ip-10-0-134-229 kubenswrapper[2574]: I0603 14:13:14.567551 2574 scope.go:117] "RemoveContainer" containerID="6a8165f2f6d53af9811926486ed5392020495382081649ef1a581bd107e3b9f3" Jun 03 14:13:14.567793 ip-10-0-134-229 kubenswrapper[2574]: E0603 14:13:14.567773 2574 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"6a8165f2f6d53af9811926486ed5392020495382081649ef1a581bd107e3b9f3\": container with ID starting with 6a8165f2f6d53af9811926486ed5392020495382081649ef1a581bd107e3b9f3 not found: ID does not exist" containerID="6a8165f2f6d53af9811926486ed5392020495382081649ef1a581bd107e3b9f3" Jun 03 14:13:14.567862 ip-10-0-134-229 kubenswrapper[2574]: I0603 14:13:14.567804 2574 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"6a8165f2f6d53af9811926486ed5392020495382081649ef1a581bd107e3b9f3"} err="failed to get container status \"6a8165f2f6d53af9811926486ed5392020495382081649ef1a581bd107e3b9f3\": rpc error: code = NotFound desc = could not find container \"6a8165f2f6d53af9811926486ed5392020495382081649ef1a581bd107e3b9f3\": container with ID starting with 6a8165f2f6d53af9811926486ed5392020495382081649ef1a581bd107e3b9f3 not found: ID does not exist" Jun 03 14:13:14.581701 ip-10-0-134-229 kubenswrapper[2574]: I0603 14:13:14.581673 2574 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openshift-console/console-dcd8c84fd-2jw47"] Jun 03 14:13:14.586122 ip-10-0-134-229 kubenswrapper[2574]: I0603 14:13:14.586101 2574 kubelet.go:2547] "SyncLoop REMOVE" source="api" pods=["openshift-console/console-dcd8c84fd-2jw47"] Jun 03 14:13:15.431466 ip-10-0-134-229 kubenswrapper[2574]: I0603 14:13:15.431435 2574 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="e245ca28-ddf8-46ea-b07c-6b48c53f38de" path="/var/lib/kubelet/pods/e245ca28-ddf8-46ea-b07c-6b48c53f38de/volumes" Jun 03 14:15:00.154491 ip-10-0-134-229 kubenswrapper[2574]: I0603 14:15:00.154415 2574 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["opendatahub/maas-api-key-cleanup-29674935-vbr74"] Jun 03 14:15:00.154920 ip-10-0-134-229 kubenswrapper[2574]: I0603 14:15:00.154822 2574 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="e245ca28-ddf8-46ea-b07c-6b48c53f38de" containerName="console" Jun 03 14:15:00.154920 ip-10-0-134-229 kubenswrapper[2574]: I0603 14:15:00.154835 2574 state_mem.go:107] "Deleted CPUSet assignment" podUID="e245ca28-ddf8-46ea-b07c-6b48c53f38de" containerName="console" Jun 03 14:15:00.154995 ip-10-0-134-229 kubenswrapper[2574]: I0603 14:15:00.154947 2574 memory_manager.go:356] "RemoveStaleState removing state" podUID="e245ca28-ddf8-46ea-b07c-6b48c53f38de" containerName="console" Jun 03 14:15:00.157031 ip-10-0-134-229 kubenswrapper[2574]: I0603 14:15:00.157015 2574 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-api-key-cleanup-29674935-vbr74" Jun 03 14:15:00.159784 ip-10-0-134-229 kubenswrapper[2574]: I0603 14:15:00.159760 2574 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"maas-api-dockercfg-m6nlt\"" Jun 03 14:15:00.173678 ip-10-0-134-229 kubenswrapper[2574]: I0603 14:15:00.173658 2574 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-api-key-cleanup-29674935-vbr74"] Jun 03 14:15:00.294082 ip-10-0-134-229 kubenswrapper[2574]: I0603 14:15:00.294043 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-c7xrd\" (UniqueName: \"kubernetes.io/projected/fdf2aa7a-449d-48aa-989f-0c8228a4d2bf-kube-api-access-c7xrd\") pod \"maas-api-key-cleanup-29674935-vbr74\" (UID: \"fdf2aa7a-449d-48aa-989f-0c8228a4d2bf\") " pod="opendatahub/maas-api-key-cleanup-29674935-vbr74" Jun 03 14:15:00.395300 ip-10-0-134-229 kubenswrapper[2574]: I0603 14:15:00.395264 2574 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-c7xrd\" (UniqueName: \"kubernetes.io/projected/fdf2aa7a-449d-48aa-989f-0c8228a4d2bf-kube-api-access-c7xrd\") pod \"maas-api-key-cleanup-29674935-vbr74\" (UID: \"fdf2aa7a-449d-48aa-989f-0c8228a4d2bf\") " pod="opendatahub/maas-api-key-cleanup-29674935-vbr74" Jun 03 14:15:00.403677 ip-10-0-134-229 kubenswrapper[2574]: I0603 14:15:00.403646 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-c7xrd\" (UniqueName: \"kubernetes.io/projected/fdf2aa7a-449d-48aa-989f-0c8228a4d2bf-kube-api-access-c7xrd\") pod \"maas-api-key-cleanup-29674935-vbr74\" (UID: \"fdf2aa7a-449d-48aa-989f-0c8228a4d2bf\") " pod="opendatahub/maas-api-key-cleanup-29674935-vbr74" Jun 03 14:15:00.467574 ip-10-0-134-229 kubenswrapper[2574]: I0603 14:15:00.467501 2574 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-api-key-cleanup-29674935-vbr74" Jun 03 14:15:00.594153 ip-10-0-134-229 kubenswrapper[2574]: I0603 14:15:00.594122 2574 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-api-key-cleanup-29674935-vbr74"] Jun 03 14:15:00.595948 ip-10-0-134-229 kubenswrapper[2574]: W0603 14:15:00.595922 2574 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podfdf2aa7a_449d_48aa_989f_0c8228a4d2bf.slice/crio-6dc01869e61747f594bedc3752b39b5e796fe6e438be370bfa767024188e2f38 WatchSource:0}: Error finding container 6dc01869e61747f594bedc3752b39b5e796fe6e438be370bfa767024188e2f38: Status 404 returned error can't find the container with id 6dc01869e61747f594bedc3752b39b5e796fe6e438be370bfa767024188e2f38 Jun 03 14:15:00.982200 ip-10-0-134-229 kubenswrapper[2574]: I0603 14:15:00.982163 2574 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-api-key-cleanup-29674935-vbr74" event={"ID":"fdf2aa7a-449d-48aa-989f-0c8228a4d2bf","Type":"ContainerStarted","Data":"6dc01869e61747f594bedc3752b39b5e796fe6e438be370bfa767024188e2f38"} Jun 03 14:15:03.995354 ip-10-0-134-229 kubenswrapper[2574]: I0603 14:15:03.995324 2574 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-api-key-cleanup-29674935-vbr74" event={"ID":"fdf2aa7a-449d-48aa-989f-0c8228a4d2bf","Type":"ContainerStarted","Data":"223dd5a5feb5fd2b9f567bb3497c077ea68add33633e2ca4b07f1c564d5b39bc"} Jun 03 14:15:04.012691 ip-10-0-134-229 kubenswrapper[2574]: I0603 14:15:04.012645 2574 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="opendatahub/maas-api-key-cleanup-29674935-vbr74" podStartSLOduration=1.11389907 podStartE2EDuration="4.012629213s" podCreationTimestamp="2026-06-03 14:15:00 +0000 UTC" firstStartedPulling="2026-06-03 14:15:00.597749029 +0000 UTC m=+1261.781756336" lastFinishedPulling="2026-06-03 14:15:03.496479155 +0000 UTC m=+1264.680486479" observedRunningTime="2026-06-03 14:15:04.010474025 +0000 UTC m=+1265.194481365" watchObservedRunningTime="2026-06-03 14:15:04.012629213 +0000 UTC m=+1265.196636541" Jun 03 14:15:05.000907 ip-10-0-134-229 kubenswrapper[2574]: I0603 14:15:05.000875 2574 generic.go:358] "Generic (PLEG): container finished" podID="fdf2aa7a-449d-48aa-989f-0c8228a4d2bf" containerID="223dd5a5feb5fd2b9f567bb3497c077ea68add33633e2ca4b07f1c564d5b39bc" exitCode=0 Jun 03 14:15:05.001311 ip-10-0-134-229 kubenswrapper[2574]: I0603 14:15:05.000953 2574 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-api-key-cleanup-29674935-vbr74" event={"ID":"fdf2aa7a-449d-48aa-989f-0c8228a4d2bf","Type":"ContainerDied","Data":"223dd5a5feb5fd2b9f567bb3497c077ea68add33633e2ca4b07f1c564d5b39bc"} Jun 03 14:15:06.134541 ip-10-0-134-229 kubenswrapper[2574]: I0603 14:15:06.134515 2574 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-api-key-cleanup-29674935-vbr74" Jun 03 14:15:06.248521 ip-10-0-134-229 kubenswrapper[2574]: I0603 14:15:06.248495 2574 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-c7xrd\" (UniqueName: \"kubernetes.io/projected/fdf2aa7a-449d-48aa-989f-0c8228a4d2bf-kube-api-access-c7xrd\") pod \"fdf2aa7a-449d-48aa-989f-0c8228a4d2bf\" (UID: \"fdf2aa7a-449d-48aa-989f-0c8228a4d2bf\") " Jun 03 14:15:06.250614 ip-10-0-134-229 kubenswrapper[2574]: I0603 14:15:06.250593 2574 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/fdf2aa7a-449d-48aa-989f-0c8228a4d2bf-kube-api-access-c7xrd" (OuterVolumeSpecName: "kube-api-access-c7xrd") pod "fdf2aa7a-449d-48aa-989f-0c8228a4d2bf" (UID: "fdf2aa7a-449d-48aa-989f-0c8228a4d2bf"). InnerVolumeSpecName "kube-api-access-c7xrd". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 03 14:15:06.349968 ip-10-0-134-229 kubenswrapper[2574]: I0603 14:15:06.349937 2574 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-c7xrd\" (UniqueName: \"kubernetes.io/projected/fdf2aa7a-449d-48aa-989f-0c8228a4d2bf-kube-api-access-c7xrd\") on node \"ip-10-0-134-229.ec2.internal\" DevicePath \"\"" Jun 03 14:15:07.009626 ip-10-0-134-229 kubenswrapper[2574]: I0603 14:15:07.009587 2574 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-api-key-cleanup-29674935-vbr74" event={"ID":"fdf2aa7a-449d-48aa-989f-0c8228a4d2bf","Type":"ContainerDied","Data":"6dc01869e61747f594bedc3752b39b5e796fe6e438be370bfa767024188e2f38"} Jun 03 14:15:07.009626 ip-10-0-134-229 kubenswrapper[2574]: I0603 14:15:07.009625 2574 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="6dc01869e61747f594bedc3752b39b5e796fe6e438be370bfa767024188e2f38" Jun 03 14:15:07.009626 ip-10-0-134-229 kubenswrapper[2574]: I0603 14:15:07.009627 2574 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-api-key-cleanup-29674935-vbr74" Jun 03 14:15:21.344066 ip-10-0-134-229 kubenswrapper[2574]: I0603 14:15:21.344033 2574 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_authorino-5894d98ccf-kmg2j_0318234a-f3f9-4f17-b983-e24922654cef/authorino/0.log" Jun 03 14:15:25.667295 ip-10-0-134-229 kubenswrapper[2574]: I0603 14:15:25.667267 2574 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_dashboard-redirect-549d6557c8-7tmxf_5431ed00-b744-4579-bdfe-f8ad6f1328c2/nginx/0.log" Jun 03 14:15:26.248339 ip-10-0-134-229 kubenswrapper[2574]: I0603 14:15:26.248315 2574 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_maas-api-key-cleanup-29674935-vbr74_fdf2aa7a-449d-48aa-989f-0c8228a4d2bf/cleanup/0.log" Jun 03 14:15:26.719656 ip-10-0-134-229 kubenswrapper[2574]: I0603 14:15:26.719626 2574 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-7c68786f4b-5tcpg_676d002f-1298-4f7a-b2ee-dc943106f1d9/manager/0.log" Jun 03 14:15:26.732097 ip-10-0-134-229 kubenswrapper[2574]: I0603 14:15:26.732069 2574 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-7c68786f4b-5tcpg_676d002f-1298-4f7a-b2ee-dc943106f1d9/copy-manifests/0.log" Jun 03 14:15:27.831737 ip-10-0-134-229 kubenswrapper[2574]: I0603 14:15:27.831673 2574 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759mdnvw_d2bf1c3c-90b9-4ba0-b592-faf2a873f3b8/extract/0.log" Jun 03 14:15:27.839046 ip-10-0-134-229 kubenswrapper[2574]: I0603 14:15:27.839024 2574 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759mdnvw_d2bf1c3c-90b9-4ba0-b592-faf2a873f3b8/util/0.log" Jun 03 14:15:27.846998 ip-10-0-134-229 kubenswrapper[2574]: I0603 14:15:27.846978 2574 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759mdnvw_d2bf1c3c-90b9-4ba0-b592-faf2a873f3b8/pull/0.log" Jun 03 14:15:27.952538 ip-10-0-134-229 kubenswrapper[2574]: I0603 14:15:27.952516 2574 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0hf7vs_36445452-29c7-4a5d-b8cf-7cf102474d3d/util/0.log" Jun 03 14:15:27.960278 ip-10-0-134-229 kubenswrapper[2574]: I0603 14:15:27.960256 2574 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0hf7vs_36445452-29c7-4a5d-b8cf-7cf102474d3d/pull/0.log" Jun 03 14:15:27.969136 ip-10-0-134-229 kubenswrapper[2574]: I0603 14:15:27.969113 2574 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0hf7vs_36445452-29c7-4a5d-b8cf-7cf102474d3d/extract/0.log" Jun 03 14:15:28.077011 ip-10-0-134-229 kubenswrapper[2574]: I0603 14:15:28.076988 2574 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73c5m9d_2973ab60-e6bc-4881-89f8-e86b89234318/util/0.log" Jun 03 14:15:28.083825 ip-10-0-134-229 kubenswrapper[2574]: I0603 14:15:28.083754 2574 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73c5m9d_2973ab60-e6bc-4881-89f8-e86b89234318/pull/0.log" Jun 03 14:15:28.090330 ip-10-0-134-229 kubenswrapper[2574]: I0603 14:15:28.090306 2574 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73c5m9d_2973ab60-e6bc-4881-89f8-e86b89234318/extract/0.log" Jun 03 14:15:28.200213 ip-10-0-134-229 kubenswrapper[2574]: I0603 14:15:28.200185 2574 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1gv8dc_d786bc75-d2a2-4a1a-aba1-7204c7f79b54/util/0.log" Jun 03 14:15:28.207472 ip-10-0-134-229 kubenswrapper[2574]: I0603 14:15:28.207439 2574 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1gv8dc_d786bc75-d2a2-4a1a-aba1-7204c7f79b54/pull/0.log" Jun 03 14:15:28.214252 ip-10-0-134-229 kubenswrapper[2574]: I0603 14:15:28.214237 2574 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1gv8dc_d786bc75-d2a2-4a1a-aba1-7204c7f79b54/extract/0.log" Jun 03 14:15:28.324708 ip-10-0-134-229 kubenswrapper[2574]: I0603 14:15:28.324673 2574 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_authorino-5894d98ccf-kmg2j_0318234a-f3f9-4f17-b983-e24922654cef/authorino/0.log" Jun 03 14:15:28.434325 ip-10-0-134-229 kubenswrapper[2574]: I0603 14:15:28.434297 2574 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_authorino-operator-657f44b778-pxn4p_a43442cc-6ac6-481b-9fa2-f41a757f51c9/manager/0.log" Jun 03 14:15:28.539615 ip-10-0-134-229 kubenswrapper[2574]: I0603 14:15:28.539587 2574 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_dns-operator-controller-manager-648d5c98bc-csdwr_bc7c3cdb-9b11-427f-bf82-8985c5c76e92/manager/0.log" Jun 03 14:15:28.649143 ip-10-0-134-229 kubenswrapper[2574]: I0603 14:15:28.649119 2574 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_kuadrant-console-plugin-6cb54b5c86-56tr6_03eae7fe-d177-41de-a727-2281dccd7f1b/kuadrant-console-plugin/0.log" Jun 03 14:15:28.757500 ip-10-0-134-229 kubenswrapper[2574]: I0603 14:15:28.757431 2574 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_kuadrant-operator-catalog-jxc59_59b9d4b1-5622-41e4-b853-64e86df6a596/registry-server/0.log" Jun 03 14:15:28.984536 ip-10-0-134-229 kubenswrapper[2574]: I0603 14:15:28.984503 2574 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_limitador-limitador-78c99df468-jldnj_9f1ba4e3-13bd-4dfc-a2eb-1bc4c9b00333/limitador/0.log" Jun 03 14:15:29.432760 ip-10-0-134-229 kubenswrapper[2574]: I0603 14:15:29.432299 2574 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_data-science-gateway-data-science-gateway-class-595b7776f8tdnqp_a9c6cb6e-63a9-4aa4-a1af-17f58fc852e5/istio-proxy/0.log" Jun 03 14:15:29.868893 ip-10-0-134-229 kubenswrapper[2574]: I0603 14:15:29.868818 2574 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_maas-default-gateway-openshift-default-7df95f575-ktm9m_148a0c1c-ff44-4af0-b1f8-181a2549f1d4/istio-proxy/0.log" Jun 03 14:15:30.096292 ip-10-0-134-229 kubenswrapper[2574]: I0603 14:15:30.096266 2574 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_router-default-7595fc69d5-8sg6s_8e495886-d0ff-45fd-b366-4f1758ae8c96/router/0.log" Jun 03 14:15:35.564758 ip-10-0-134-229 kubenswrapper[2574]: I0603 14:15:35.564718 2574 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-must-gather-c6tt9/must-gather-xspq8"] Jun 03 14:15:35.565262 ip-10-0-134-229 kubenswrapper[2574]: I0603 14:15:35.565241 2574 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="fdf2aa7a-449d-48aa-989f-0c8228a4d2bf" containerName="cleanup" Jun 03 14:15:35.565335 ip-10-0-134-229 kubenswrapper[2574]: I0603 14:15:35.565265 2574 state_mem.go:107] "Deleted CPUSet assignment" podUID="fdf2aa7a-449d-48aa-989f-0c8228a4d2bf" containerName="cleanup" Jun 03 14:15:35.565418 ip-10-0-134-229 kubenswrapper[2574]: I0603 14:15:35.565361 2574 memory_manager.go:356] "RemoveStaleState removing state" podUID="fdf2aa7a-449d-48aa-989f-0c8228a4d2bf" containerName="cleanup" Jun 03 14:15:35.573208 ip-10-0-134-229 kubenswrapper[2574]: I0603 14:15:35.573184 2574 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-c6tt9/must-gather-xspq8" Jun 03 14:15:35.575861 ip-10-0-134-229 kubenswrapper[2574]: I0603 14:15:35.575838 2574 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-must-gather-c6tt9\"/\"openshift-service-ca.crt\"" Jun 03 14:15:35.575974 ip-10-0-134-229 kubenswrapper[2574]: I0603 14:15:35.575849 2574 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-must-gather-c6tt9\"/\"kube-root-ca.crt\"" Jun 03 14:15:35.576627 ip-10-0-134-229 kubenswrapper[2574]: I0603 14:15:35.576612 2574 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-must-gather-c6tt9\"/\"default-dockercfg-d9dxq\"" Jun 03 14:15:35.578138 ip-10-0-134-229 kubenswrapper[2574]: I0603 14:15:35.578112 2574 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-c6tt9/must-gather-xspq8"] Jun 03 14:15:35.689565 ip-10-0-134-229 kubenswrapper[2574]: I0603 14:15:35.689532 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"must-gather-output\" (UniqueName: \"kubernetes.io/empty-dir/be03f275-4d11-4271-bf8c-8ad74de29f1b-must-gather-output\") pod \"must-gather-xspq8\" (UID: \"be03f275-4d11-4271-bf8c-8ad74de29f1b\") " pod="openshift-must-gather-c6tt9/must-gather-xspq8" Jun 03 14:15:35.689724 ip-10-0-134-229 kubenswrapper[2574]: I0603 14:15:35.689584 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-6vzh8\" (UniqueName: \"kubernetes.io/projected/be03f275-4d11-4271-bf8c-8ad74de29f1b-kube-api-access-6vzh8\") pod \"must-gather-xspq8\" (UID: \"be03f275-4d11-4271-bf8c-8ad74de29f1b\") " pod="openshift-must-gather-c6tt9/must-gather-xspq8" Jun 03 14:15:35.790955 ip-10-0-134-229 kubenswrapper[2574]: I0603 14:15:35.790923 2574 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"must-gather-output\" (UniqueName: \"kubernetes.io/empty-dir/be03f275-4d11-4271-bf8c-8ad74de29f1b-must-gather-output\") pod \"must-gather-xspq8\" (UID: \"be03f275-4d11-4271-bf8c-8ad74de29f1b\") " pod="openshift-must-gather-c6tt9/must-gather-xspq8" Jun 03 14:15:35.791112 ip-10-0-134-229 kubenswrapper[2574]: I0603 14:15:35.790979 2574 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-6vzh8\" (UniqueName: \"kubernetes.io/projected/be03f275-4d11-4271-bf8c-8ad74de29f1b-kube-api-access-6vzh8\") pod \"must-gather-xspq8\" (UID: \"be03f275-4d11-4271-bf8c-8ad74de29f1b\") " pod="openshift-must-gather-c6tt9/must-gather-xspq8" Jun 03 14:15:35.791299 ip-10-0-134-229 kubenswrapper[2574]: I0603 14:15:35.791283 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"must-gather-output\" (UniqueName: \"kubernetes.io/empty-dir/be03f275-4d11-4271-bf8c-8ad74de29f1b-must-gather-output\") pod \"must-gather-xspq8\" (UID: \"be03f275-4d11-4271-bf8c-8ad74de29f1b\") " pod="openshift-must-gather-c6tt9/must-gather-xspq8" Jun 03 14:15:35.799200 ip-10-0-134-229 kubenswrapper[2574]: I0603 14:15:35.799168 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-6vzh8\" (UniqueName: \"kubernetes.io/projected/be03f275-4d11-4271-bf8c-8ad74de29f1b-kube-api-access-6vzh8\") pod \"must-gather-xspq8\" (UID: \"be03f275-4d11-4271-bf8c-8ad74de29f1b\") " pod="openshift-must-gather-c6tt9/must-gather-xspq8" Jun 03 14:15:35.882712 ip-10-0-134-229 kubenswrapper[2574]: I0603 14:15:35.882690 2574 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-c6tt9/must-gather-xspq8" Jun 03 14:15:36.010254 ip-10-0-134-229 kubenswrapper[2574]: I0603 14:15:36.010223 2574 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-c6tt9/must-gather-xspq8"] Jun 03 14:15:36.013716 ip-10-0-134-229 kubenswrapper[2574]: W0603 14:15:36.013688 2574 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-podbe03f275_4d11_4271_bf8c_8ad74de29f1b.slice/crio-2ac53a05b07eec62d3788265f89354c105728320ca80ce6ad580f7ef1343b143 WatchSource:0}: Error finding container 2ac53a05b07eec62d3788265f89354c105728320ca80ce6ad580f7ef1343b143: Status 404 returned error can't find the container with id 2ac53a05b07eec62d3788265f89354c105728320ca80ce6ad580f7ef1343b143 Jun 03 14:15:36.121747 ip-10-0-134-229 kubenswrapper[2574]: I0603 14:15:36.121713 2574 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-c6tt9/must-gather-xspq8" event={"ID":"be03f275-4d11-4271-bf8c-8ad74de29f1b","Type":"ContainerStarted","Data":"2ac53a05b07eec62d3788265f89354c105728320ca80ce6ad580f7ef1343b143"} Jun 03 14:15:37.128280 ip-10-0-134-229 kubenswrapper[2574]: I0603 14:15:37.128238 2574 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-c6tt9/must-gather-xspq8" event={"ID":"be03f275-4d11-4271-bf8c-8ad74de29f1b","Type":"ContainerStarted","Data":"3b6383209a39bfe74b64e3c64f9d2bdaf317eaff2c605869b355a46394d8c531"} Jun 03 14:15:37.131970 ip-10-0-134-229 kubenswrapper[2574]: I0603 14:15:37.128291 2574 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-c6tt9/must-gather-xspq8" event={"ID":"be03f275-4d11-4271-bf8c-8ad74de29f1b","Type":"ContainerStarted","Data":"39a5375d180649e4c4e4179a8d3270553db6368402884ea6fc8e90d12d1456ac"} Jun 03 14:15:37.148154 ip-10-0-134-229 kubenswrapper[2574]: I0603 14:15:37.148082 2574 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-must-gather-c6tt9/must-gather-xspq8" podStartSLOduration=1.365496538 podStartE2EDuration="2.148062846s" podCreationTimestamp="2026-06-03 14:15:35 +0000 UTC" firstStartedPulling="2026-06-03 14:15:36.015462818 +0000 UTC m=+1297.199470125" lastFinishedPulling="2026-06-03 14:15:36.798029122 +0000 UTC m=+1297.982036433" observedRunningTime="2026-06-03 14:15:37.146066111 +0000 UTC m=+1298.330073440" watchObservedRunningTime="2026-06-03 14:15:37.148062846 +0000 UTC m=+1298.332070177" Jun 03 14:15:38.675807 ip-10-0-134-229 kubenswrapper[2574]: I0603 14:15:38.675779 2574 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_global-pull-secret-syncer-g8xw8_14b4e9c6-79e5-4c10-96b7-cc3cd27b89aa/global-pull-secret-syncer/0.log" Jun 03 14:15:38.806823 ip-10-0-134-229 kubenswrapper[2574]: I0603 14:15:38.806786 2574 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_konnectivity-agent-5mz8g_8c5a5cc8-abff-454b-8b7c-6e4064a2c8c0/konnectivity-agent/0.log" Jun 03 14:15:38.944766 ip-10-0-134-229 kubenswrapper[2574]: I0603 14:15:38.944630 2574 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_kube-apiserver-proxy-ip-10-0-134-229.ec2.internal_fe2965869ce022bdc90ca9172d2df8d9/haproxy/0.log" Jun 03 14:15:42.769277 ip-10-0-134-229 kubenswrapper[2574]: I0603 14:15:42.769217 2574 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759mdnvw_d2bf1c3c-90b9-4ba0-b592-faf2a873f3b8/extract/0.log" Jun 03 14:15:42.795040 ip-10-0-134-229 kubenswrapper[2574]: I0603 14:15:42.795016 2574 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759mdnvw_d2bf1c3c-90b9-4ba0-b592-faf2a873f3b8/util/0.log" Jun 03 14:15:42.823272 ip-10-0-134-229 kubenswrapper[2574]: I0603 14:15:42.823245 2574 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759mdnvw_d2bf1c3c-90b9-4ba0-b592-faf2a873f3b8/pull/0.log" Jun 03 14:15:42.862396 ip-10-0-134-229 kubenswrapper[2574]: I0603 14:15:42.862354 2574 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0hf7vs_36445452-29c7-4a5d-b8cf-7cf102474d3d/extract/0.log" Jun 03 14:15:42.900121 ip-10-0-134-229 kubenswrapper[2574]: I0603 14:15:42.900070 2574 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0hf7vs_36445452-29c7-4a5d-b8cf-7cf102474d3d/util/0.log" Jun 03 14:15:42.932795 ip-10-0-134-229 kubenswrapper[2574]: I0603 14:15:42.932736 2574 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0hf7vs_36445452-29c7-4a5d-b8cf-7cf102474d3d/pull/0.log" Jun 03 14:15:42.971919 ip-10-0-134-229 kubenswrapper[2574]: I0603 14:15:42.971891 2574 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73c5m9d_2973ab60-e6bc-4881-89f8-e86b89234318/extract/0.log" Jun 03 14:15:43.004310 ip-10-0-134-229 kubenswrapper[2574]: I0603 14:15:43.004276 2574 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73c5m9d_2973ab60-e6bc-4881-89f8-e86b89234318/util/0.log" Jun 03 14:15:43.031500 ip-10-0-134-229 kubenswrapper[2574]: I0603 14:15:43.031423 2574 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73c5m9d_2973ab60-e6bc-4881-89f8-e86b89234318/pull/0.log" Jun 03 14:15:43.076800 ip-10-0-134-229 kubenswrapper[2574]: I0603 14:15:43.076768 2574 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1gv8dc_d786bc75-d2a2-4a1a-aba1-7204c7f79b54/extract/0.log" Jun 03 14:15:43.102833 ip-10-0-134-229 kubenswrapper[2574]: I0603 14:15:43.102800 2574 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1gv8dc_d786bc75-d2a2-4a1a-aba1-7204c7f79b54/util/0.log" Jun 03 14:15:43.127835 ip-10-0-134-229 kubenswrapper[2574]: I0603 14:15:43.127804 2574 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1gv8dc_d786bc75-d2a2-4a1a-aba1-7204c7f79b54/pull/0.log" Jun 03 14:15:43.164637 ip-10-0-134-229 kubenswrapper[2574]: I0603 14:15:43.164598 2574 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_authorino-5894d98ccf-kmg2j_0318234a-f3f9-4f17-b983-e24922654cef/authorino/0.log" Jun 03 14:15:43.196879 ip-10-0-134-229 kubenswrapper[2574]: I0603 14:15:43.196843 2574 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_authorino-operator-657f44b778-pxn4p_a43442cc-6ac6-481b-9fa2-f41a757f51c9/manager/0.log" Jun 03 14:15:43.230478 ip-10-0-134-229 kubenswrapper[2574]: I0603 14:15:43.230448 2574 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_dns-operator-controller-manager-648d5c98bc-csdwr_bc7c3cdb-9b11-427f-bf82-8985c5c76e92/manager/0.log" Jun 03 14:15:43.257112 ip-10-0-134-229 kubenswrapper[2574]: I0603 14:15:43.257080 2574 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_kuadrant-console-plugin-6cb54b5c86-56tr6_03eae7fe-d177-41de-a727-2281dccd7f1b/kuadrant-console-plugin/0.log" Jun 03 14:15:43.291093 ip-10-0-134-229 kubenswrapper[2574]: I0603 14:15:43.290997 2574 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_kuadrant-operator-catalog-jxc59_59b9d4b1-5622-41e4-b853-64e86df6a596/registry-server/0.log" Jun 03 14:15:43.354940 ip-10-0-134-229 kubenswrapper[2574]: I0603 14:15:43.354913 2574 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_limitador-limitador-78c99df468-jldnj_9f1ba4e3-13bd-4dfc-a2eb-1bc4c9b00333/limitador/0.log" Jun 03 14:15:45.150201 ip-10-0-134-229 kubenswrapper[2574]: I0603 14:15:45.150169 2574 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_monitoring-plugin-5768fcc9dd-pdcwt_a4917932-d0e5-4dfa-a344-de6fd335cab9/monitoring-plugin/0.log" Jun 03 14:15:45.286846 ip-10-0-134-229 kubenswrapper[2574]: I0603 14:15:45.286806 2574 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-rcgss_11db619d-addb-418d-a276-7fb653d69737/node-exporter/0.log" Jun 03 14:15:45.324458 ip-10-0-134-229 kubenswrapper[2574]: I0603 14:15:45.324426 2574 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-rcgss_11db619d-addb-418d-a276-7fb653d69737/kube-rbac-proxy/0.log" Jun 03 14:15:45.348097 ip-10-0-134-229 kubenswrapper[2574]: I0603 14:15:45.348072 2574 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-rcgss_11db619d-addb-418d-a276-7fb653d69737/init-textfile/0.log" Jun 03 14:15:45.452192 ip-10-0-134-229 kubenswrapper[2574]: I0603 14:15:45.452112 2574 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_openshift-state-metrics-85658796db-hxnp7_e07d69f8-1d21-4a42-b220-4b57e85432ff/kube-rbac-proxy-main/0.log" Jun 03 14:15:45.479043 ip-10-0-134-229 kubenswrapper[2574]: I0603 14:15:45.479009 2574 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_openshift-state-metrics-85658796db-hxnp7_e07d69f8-1d21-4a42-b220-4b57e85432ff/kube-rbac-proxy-self/0.log" Jun 03 14:15:45.504802 ip-10-0-134-229 kubenswrapper[2574]: I0603 14:15:45.504766 2574 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_openshift-state-metrics-85658796db-hxnp7_e07d69f8-1d21-4a42-b220-4b57e85432ff/openshift-state-metrics/0.log" Jun 03 14:15:45.790682 ip-10-0-134-229 kubenswrapper[2574]: I0603 14:15:45.790596 2574 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-operator-658bcd8bdf-tddj2_286288aa-f0c9-4e33-9000-38045dcf8f52/prometheus-operator/0.log" Jun 03 14:15:45.847246 ip-10-0-134-229 kubenswrapper[2574]: I0603 14:15:45.847219 2574 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-operator-658bcd8bdf-tddj2_286288aa-f0c9-4e33-9000-38045dcf8f52/kube-rbac-proxy/0.log" Jun 03 14:15:48.085551 ip-10-0-134-229 kubenswrapper[2574]: I0603 14:15:48.085518 2574 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-must-gather-c6tt9/perf-node-gather-daemonset-rp88x"] Jun 03 14:15:48.090367 ip-10-0-134-229 kubenswrapper[2574]: I0603 14:15:48.090339 2574 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-c6tt9/perf-node-gather-daemonset-rp88x" Jun 03 14:15:48.099541 ip-10-0-134-229 kubenswrapper[2574]: I0603 14:15:48.099513 2574 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-c6tt9/perf-node-gather-daemonset-rp88x"] Jun 03 14:15:48.232521 ip-10-0-134-229 kubenswrapper[2574]: I0603 14:15:48.232487 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/aa47fdec-4d7a-433e-8747-52d851014544-podres\") pod \"perf-node-gather-daemonset-rp88x\" (UID: \"aa47fdec-4d7a-433e-8747-52d851014544\") " pod="openshift-must-gather-c6tt9/perf-node-gather-daemonset-rp88x" Jun 03 14:15:48.232908 ip-10-0-134-229 kubenswrapper[2574]: I0603 14:15:48.232884 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/aa47fdec-4d7a-433e-8747-52d851014544-sys\") pod \"perf-node-gather-daemonset-rp88x\" (UID: \"aa47fdec-4d7a-433e-8747-52d851014544\") " pod="openshift-must-gather-c6tt9/perf-node-gather-daemonset-rp88x" Jun 03 14:15:48.233021 ip-10-0-134-229 kubenswrapper[2574]: I0603 14:15:48.232945 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/aa47fdec-4d7a-433e-8747-52d851014544-lib-modules\") pod \"perf-node-gather-daemonset-rp88x\" (UID: \"aa47fdec-4d7a-433e-8747-52d851014544\") " pod="openshift-must-gather-c6tt9/perf-node-gather-daemonset-rp88x" Jun 03 14:15:48.233021 ip-10-0-134-229 kubenswrapper[2574]: I0603 14:15:48.232975 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/aa47fdec-4d7a-433e-8747-52d851014544-proc\") pod \"perf-node-gather-daemonset-rp88x\" (UID: \"aa47fdec-4d7a-433e-8747-52d851014544\") " pod="openshift-must-gather-c6tt9/perf-node-gather-daemonset-rp88x" Jun 03 14:15:48.233021 ip-10-0-134-229 kubenswrapper[2574]: I0603 14:15:48.232994 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-sfsc9\" (UniqueName: \"kubernetes.io/projected/aa47fdec-4d7a-433e-8747-52d851014544-kube-api-access-sfsc9\") pod \"perf-node-gather-daemonset-rp88x\" (UID: \"aa47fdec-4d7a-433e-8747-52d851014544\") " pod="openshift-must-gather-c6tt9/perf-node-gather-daemonset-rp88x" Jun 03 14:15:48.334548 ip-10-0-134-229 kubenswrapper[2574]: I0603 14:15:48.333647 2574 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/aa47fdec-4d7a-433e-8747-52d851014544-sys\") pod \"perf-node-gather-daemonset-rp88x\" (UID: \"aa47fdec-4d7a-433e-8747-52d851014544\") " pod="openshift-must-gather-c6tt9/perf-node-gather-daemonset-rp88x" Jun 03 14:15:48.334548 ip-10-0-134-229 kubenswrapper[2574]: I0603 14:15:48.333725 2574 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/aa47fdec-4d7a-433e-8747-52d851014544-lib-modules\") pod \"perf-node-gather-daemonset-rp88x\" (UID: \"aa47fdec-4d7a-433e-8747-52d851014544\") " pod="openshift-must-gather-c6tt9/perf-node-gather-daemonset-rp88x" Jun 03 14:15:48.334548 ip-10-0-134-229 kubenswrapper[2574]: I0603 14:15:48.333758 2574 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/aa47fdec-4d7a-433e-8747-52d851014544-proc\") pod \"perf-node-gather-daemonset-rp88x\" (UID: \"aa47fdec-4d7a-433e-8747-52d851014544\") " pod="openshift-must-gather-c6tt9/perf-node-gather-daemonset-rp88x" Jun 03 14:15:48.334548 ip-10-0-134-229 kubenswrapper[2574]: I0603 14:15:48.333786 2574 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-sfsc9\" (UniqueName: \"kubernetes.io/projected/aa47fdec-4d7a-433e-8747-52d851014544-kube-api-access-sfsc9\") pod \"perf-node-gather-daemonset-rp88x\" (UID: \"aa47fdec-4d7a-433e-8747-52d851014544\") " pod="openshift-must-gather-c6tt9/perf-node-gather-daemonset-rp88x" Jun 03 14:15:48.334548 ip-10-0-134-229 kubenswrapper[2574]: I0603 14:15:48.333844 2574 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/aa47fdec-4d7a-433e-8747-52d851014544-podres\") pod \"perf-node-gather-daemonset-rp88x\" (UID: \"aa47fdec-4d7a-433e-8747-52d851014544\") " pod="openshift-must-gather-c6tt9/perf-node-gather-daemonset-rp88x" Jun 03 14:15:48.334548 ip-10-0-134-229 kubenswrapper[2574]: I0603 14:15:48.334013 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/aa47fdec-4d7a-433e-8747-52d851014544-podres\") pod \"perf-node-gather-daemonset-rp88x\" (UID: \"aa47fdec-4d7a-433e-8747-52d851014544\") " pod="openshift-must-gather-c6tt9/perf-node-gather-daemonset-rp88x" Jun 03 14:15:48.334548 ip-10-0-134-229 kubenswrapper[2574]: I0603 14:15:48.334075 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/aa47fdec-4d7a-433e-8747-52d851014544-sys\") pod \"perf-node-gather-daemonset-rp88x\" (UID: \"aa47fdec-4d7a-433e-8747-52d851014544\") " pod="openshift-must-gather-c6tt9/perf-node-gather-daemonset-rp88x" Jun 03 14:15:48.334548 ip-10-0-134-229 kubenswrapper[2574]: I0603 14:15:48.334155 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/aa47fdec-4d7a-433e-8747-52d851014544-lib-modules\") pod \"perf-node-gather-daemonset-rp88x\" (UID: \"aa47fdec-4d7a-433e-8747-52d851014544\") " pod="openshift-must-gather-c6tt9/perf-node-gather-daemonset-rp88x" Jun 03 14:15:48.334548 ip-10-0-134-229 kubenswrapper[2574]: I0603 14:15:48.334201 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/aa47fdec-4d7a-433e-8747-52d851014544-proc\") pod \"perf-node-gather-daemonset-rp88x\" (UID: \"aa47fdec-4d7a-433e-8747-52d851014544\") " pod="openshift-must-gather-c6tt9/perf-node-gather-daemonset-rp88x" Jun 03 14:15:48.342856 ip-10-0-134-229 kubenswrapper[2574]: I0603 14:15:48.342784 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-sfsc9\" (UniqueName: \"kubernetes.io/projected/aa47fdec-4d7a-433e-8747-52d851014544-kube-api-access-sfsc9\") pod \"perf-node-gather-daemonset-rp88x\" (UID: \"aa47fdec-4d7a-433e-8747-52d851014544\") " pod="openshift-must-gather-c6tt9/perf-node-gather-daemonset-rp88x" Jun 03 14:15:48.369063 ip-10-0-134-229 kubenswrapper[2574]: I0603 14:15:48.369032 2574 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console_console-7ffb9d76fb-7wxxv_1e02c3ae-e583-4981-91de-b3dc9b9ea494/console/0.log" Jun 03 14:15:48.407510 ip-10-0-134-229 kubenswrapper[2574]: I0603 14:15:48.407480 2574 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-c6tt9/perf-node-gather-daemonset-rp88x" Jun 03 14:15:48.589432 ip-10-0-134-229 kubenswrapper[2574]: I0603 14:15:48.589405 2574 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-c6tt9/perf-node-gather-daemonset-rp88x"] Jun 03 14:15:48.591636 ip-10-0-134-229 kubenswrapper[2574]: W0603 14:15:48.591607 2574 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-podaa47fdec_4d7a_433e_8747_52d851014544.slice/crio-45bd9dad5977d0a6c78bab038e6405eeaffe75ba6dcaf262dd6625a43bdc5f79 WatchSource:0}: Error finding container 45bd9dad5977d0a6c78bab038e6405eeaffe75ba6dcaf262dd6625a43bdc5f79: Status 404 returned error can't find the container with id 45bd9dad5977d0a6c78bab038e6405eeaffe75ba6dcaf262dd6625a43bdc5f79 Jun 03 14:15:48.955838 ip-10-0-134-229 kubenswrapper[2574]: I0603 14:15:48.955813 2574 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-cluster-storage-operator_volume-data-source-validator-7598fd5bd-2kwr2_0c8c9951-8478-4b84-887d-e49f6669f21f/volume-data-source-validator/0.log" Jun 03 14:15:49.190061 ip-10-0-134-229 kubenswrapper[2574]: I0603 14:15:49.190016 2574 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-c6tt9/perf-node-gather-daemonset-rp88x" event={"ID":"aa47fdec-4d7a-433e-8747-52d851014544","Type":"ContainerStarted","Data":"6712393b89f21d2a7630585924fab4e2f69b09f0e419e544dd6599279a854697"} Jun 03 14:15:49.190519 ip-10-0-134-229 kubenswrapper[2574]: I0603 14:15:49.190073 2574 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-must-gather-c6tt9/perf-node-gather-daemonset-rp88x" Jun 03 14:15:49.190519 ip-10-0-134-229 kubenswrapper[2574]: I0603 14:15:49.190088 2574 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-c6tt9/perf-node-gather-daemonset-rp88x" event={"ID":"aa47fdec-4d7a-433e-8747-52d851014544","Type":"ContainerStarted","Data":"45bd9dad5977d0a6c78bab038e6405eeaffe75ba6dcaf262dd6625a43bdc5f79"} Jun 03 14:15:49.205702 ip-10-0-134-229 kubenswrapper[2574]: I0603 14:15:49.205661 2574 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-must-gather-c6tt9/perf-node-gather-daemonset-rp88x" podStartSLOduration=1.205648157 podStartE2EDuration="1.205648157s" podCreationTimestamp="2026-06-03 14:15:48 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2026-06-03 14:15:49.205635481 +0000 UTC m=+1310.389642813" watchObservedRunningTime="2026-06-03 14:15:49.205648157 +0000 UTC m=+1310.389655486" Jun 03 14:15:49.806173 ip-10-0-134-229 kubenswrapper[2574]: I0603 14:15:49.806148 2574 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_dns-default-cmpk7_4308a21d-77ba-4b27-acb7-feb7eafe3b61/dns/0.log" Jun 03 14:15:49.828449 ip-10-0-134-229 kubenswrapper[2574]: I0603 14:15:49.828414 2574 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_dns-default-cmpk7_4308a21d-77ba-4b27-acb7-feb7eafe3b61/kube-rbac-proxy/0.log" Jun 03 14:15:49.905314 ip-10-0-134-229 kubenswrapper[2574]: I0603 14:15:49.905284 2574 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_node-resolver-pc2nh_aaa611e0-e507-419d-8a90-f692f2d26ee5/dns-node-resolver/0.log" Jun 03 14:15:50.380416 ip-10-0-134-229 kubenswrapper[2574]: I0603 14:15:50.380384 2574 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_image-registry-f5c6b7cb8-tfj84_ccbe6a06-f89d-4332-87fa-6fa5d1d249dd/registry/0.log" Jun 03 14:15:50.429029 ip-10-0-134-229 kubenswrapper[2574]: I0603 14:15:50.428998 2574 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_node-ca-7ql52_5e68f084-d02c-4757-9842-1c01178fcfcb/node-ca/0.log" Jun 03 14:15:51.277464 ip-10-0-134-229 kubenswrapper[2574]: I0603 14:15:51.277435 2574 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_data-science-gateway-data-science-gateway-class-595b7776f8tdnqp_a9c6cb6e-63a9-4aa4-a1af-17f58fc852e5/istio-proxy/0.log" Jun 03 14:15:51.409775 ip-10-0-134-229 kubenswrapper[2574]: I0603 14:15:51.409745 2574 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_maas-default-gateway-openshift-default-7df95f575-ktm9m_148a0c1c-ff44-4af0-b1f8-181a2549f1d4/istio-proxy/0.log" Jun 03 14:15:51.460116 ip-10-0-134-229 kubenswrapper[2574]: I0603 14:15:51.460084 2574 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_router-default-7595fc69d5-8sg6s_8e495886-d0ff-45fd-b366-4f1758ae8c96/router/0.log" Jun 03 14:15:52.032330 ip-10-0-134-229 kubenswrapper[2574]: I0603 14:15:52.032303 2574 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress-canary_ingress-canary-r2b65_b1e2fd2f-3d6b-4353-8897-804eee07eac8/serve-healthcheck-canary/0.log" Jun 03 14:15:52.657095 ip-10-0-134-229 kubenswrapper[2574]: I0603 14:15:52.657064 2574 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-lcst5_5ad03443-f73f-4a81-a61b-e93316f65a17/kube-rbac-proxy/0.log" Jun 03 14:15:52.707461 ip-10-0-134-229 kubenswrapper[2574]: I0603 14:15:52.707421 2574 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-lcst5_5ad03443-f73f-4a81-a61b-e93316f65a17/exporter/0.log" Jun 03 14:15:52.755924 ip-10-0-134-229 kubenswrapper[2574]: I0603 14:15:52.755895 2574 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-lcst5_5ad03443-f73f-4a81-a61b-e93316f65a17/extractor/0.log" Jun 03 14:15:54.934879 ip-10-0-134-229 kubenswrapper[2574]: I0603 14:15:54.934843 2574 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_dashboard-redirect-549d6557c8-7tmxf_5431ed00-b744-4579-bdfe-f8ad6f1328c2/nginx/0.log" Jun 03 14:15:55.058032 ip-10-0-134-229 kubenswrapper[2574]: I0603 14:15:55.058000 2574 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_maas-api-key-cleanup-29674935-vbr74_fdf2aa7a-449d-48aa-989f-0c8228a4d2bf/cleanup/0.log" Jun 03 14:15:55.206248 ip-10-0-134-229 kubenswrapper[2574]: I0603 14:15:55.206142 2574 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-must-gather-c6tt9/perf-node-gather-daemonset-rp88x" Jun 03 14:15:55.252193 ip-10-0-134-229 kubenswrapper[2574]: I0603 14:15:55.252151 2574 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-7c68786f4b-5tcpg_676d002f-1298-4f7a-b2ee-dc943106f1d9/manager/0.log" Jun 03 14:15:55.269617 ip-10-0-134-229 kubenswrapper[2574]: I0603 14:15:55.269592 2574 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-7c68786f4b-5tcpg_676d002f-1298-4f7a-b2ee-dc943106f1d9/copy-manifests/0.log" Jun 03 14:15:56.847181 ip-10-0-134-229 kubenswrapper[2574]: I0603 14:15:56.847101 2574 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-lws-operator_lws-controller-manager-6557d5d46d-dnfph_593c0d82-e227-4084-9a6c-8727d166bd69/manager/0.log" Jun 03 14:16:01.958914 ip-10-0-134-229 kubenswrapper[2574]: I0603 14:16:01.958881 2574 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-kube-storage-version-migrator-operator_kube-storage-version-migrator-operator-96ddc787c-42dw4_cdfc9d22-1eec-4221-9c0f-c128485c764a/kube-storage-version-migrator-operator/1.log" Jun 03 14:16:01.959745 ip-10-0-134-229 kubenswrapper[2574]: I0603 14:16:01.959724 2574 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-kube-storage-version-migrator-operator_kube-storage-version-migrator-operator-96ddc787c-42dw4_cdfc9d22-1eec-4221-9c0f-c128485c764a/kube-storage-version-migrator-operator/0.log" Jun 03 14:16:03.283096 ip-10-0-134-229 kubenswrapper[2574]: I0603 14:16:03.283066 2574 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-v264j_77b2aeec-d4be-45f6-b355-4030387080ad/kube-multus-additional-cni-plugins/0.log" Jun 03 14:16:03.303943 ip-10-0-134-229 kubenswrapper[2574]: I0603 14:16:03.303914 2574 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-v264j_77b2aeec-d4be-45f6-b355-4030387080ad/egress-router-binary-copy/0.log" Jun 03 14:16:03.323440 ip-10-0-134-229 kubenswrapper[2574]: I0603 14:16:03.323418 2574 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-v264j_77b2aeec-d4be-45f6-b355-4030387080ad/cni-plugins/0.log" Jun 03 14:16:03.347441 ip-10-0-134-229 kubenswrapper[2574]: I0603 14:16:03.347422 2574 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-v264j_77b2aeec-d4be-45f6-b355-4030387080ad/bond-cni-plugin/0.log" Jun 03 14:16:03.369355 ip-10-0-134-229 kubenswrapper[2574]: I0603 14:16:03.369335 2574 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-v264j_77b2aeec-d4be-45f6-b355-4030387080ad/routeoverride-cni/0.log" Jun 03 14:16:03.394044 ip-10-0-134-229 kubenswrapper[2574]: I0603 14:16:03.394022 2574 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-v264j_77b2aeec-d4be-45f6-b355-4030387080ad/whereabouts-cni-bincopy/0.log" Jun 03 14:16:03.415170 ip-10-0-134-229 kubenswrapper[2574]: I0603 14:16:03.415148 2574 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-v264j_77b2aeec-d4be-45f6-b355-4030387080ad/whereabouts-cni/0.log" Jun 03 14:16:03.454540 ip-10-0-134-229 kubenswrapper[2574]: I0603 14:16:03.454514 2574 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-jkcw2_9ccfb5b8-aff0-4122-a190-c406b390bdae/kube-multus/0.log" Jun 03 14:16:03.561672 ip-10-0-134-229 kubenswrapper[2574]: I0603 14:16:03.561605 2574 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_network-metrics-daemon-9f7k7_6f47d39b-6eb0-4d5f-921b-0d56c194113e/network-metrics-daemon/0.log" Jun 03 14:16:03.587615 ip-10-0-134-229 kubenswrapper[2574]: I0603 14:16:03.587589 2574 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_network-metrics-daemon-9f7k7_6f47d39b-6eb0-4d5f-921b-0d56c194113e/kube-rbac-proxy/0.log"