Jun 03 16:33:47.744264 ip-10-0-135-67 systemd[1]: Starting Kubernetes Kubelet... Jun 03 16:33:48.192030 ip-10-0-135-67 kubenswrapper[2568]: Flag --container-runtime-endpoint has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information. Jun 03 16:33:48.192030 ip-10-0-135-67 kubenswrapper[2568]: Flag --minimum-container-ttl-duration has been deprecated, Use --eviction-hard or --eviction-soft instead. Will be removed in a future version. Jun 03 16:33:48.192030 ip-10-0-135-67 kubenswrapper[2568]: Flag --volume-plugin-dir has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information. Jun 03 16:33:48.192030 ip-10-0-135-67 kubenswrapper[2568]: Flag --pod-infra-container-image has been deprecated, will be removed in 1.35. Image garbage collector will get sandbox image information from CRI. Jun 03 16:33:48.192030 ip-10-0-135-67 kubenswrapper[2568]: Flag --system-reserved has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information. Jun 03 16:33:48.193230 ip-10-0-135-67 kubenswrapper[2568]: I0603 16:33:48.192920 2568 server.go:212] "--pod-infra-container-image will not be pruned by the image garbage collector in kubelet and should also be set in the remote runtime" Jun 03 16:33:48.200407 ip-10-0-135-67 kubenswrapper[2568]: W0603 16:33:48.200388 2568 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jun 03 16:33:48.200407 ip-10-0-135-67 kubenswrapper[2568]: W0603 16:33:48.200404 2568 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jun 03 16:33:48.200407 ip-10-0-135-67 kubenswrapper[2568]: W0603 16:33:48.200408 2568 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jun 03 16:33:48.200407 ip-10-0-135-67 kubenswrapper[2568]: W0603 16:33:48.200411 2568 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jun 03 16:33:48.200407 ip-10-0-135-67 kubenswrapper[2568]: W0603 16:33:48.200415 2568 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jun 03 16:33:48.200605 ip-10-0-135-67 kubenswrapper[2568]: W0603 16:33:48.200418 2568 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jun 03 16:33:48.200605 ip-10-0-135-67 kubenswrapper[2568]: W0603 16:33:48.200421 2568 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jun 03 16:33:48.200605 ip-10-0-135-67 kubenswrapper[2568]: W0603 16:33:48.200424 2568 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jun 03 16:33:48.200605 ip-10-0-135-67 kubenswrapper[2568]: W0603 16:33:48.200427 2568 feature_gate.go:328] unrecognized feature gate: OVNObservability Jun 03 16:33:48.200605 ip-10-0-135-67 kubenswrapper[2568]: W0603 16:33:48.200430 2568 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jun 03 16:33:48.200605 ip-10-0-135-67 kubenswrapper[2568]: W0603 16:33:48.200432 2568 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jun 03 16:33:48.200605 ip-10-0-135-67 kubenswrapper[2568]: W0603 16:33:48.200435 2568 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jun 03 16:33:48.200605 ip-10-0-135-67 kubenswrapper[2568]: W0603 16:33:48.200438 2568 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jun 03 16:33:48.200605 ip-10-0-135-67 kubenswrapper[2568]: W0603 16:33:48.200440 2568 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jun 03 16:33:48.200605 ip-10-0-135-67 kubenswrapper[2568]: W0603 16:33:48.200443 2568 feature_gate.go:328] unrecognized feature gate: DualReplica Jun 03 16:33:48.200605 ip-10-0-135-67 kubenswrapper[2568]: W0603 16:33:48.200446 2568 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jun 03 16:33:48.200605 ip-10-0-135-67 kubenswrapper[2568]: W0603 16:33:48.200448 2568 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jun 03 16:33:48.200605 ip-10-0-135-67 kubenswrapper[2568]: W0603 16:33:48.200451 2568 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jun 03 16:33:48.200605 ip-10-0-135-67 kubenswrapper[2568]: W0603 16:33:48.200454 2568 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jun 03 16:33:48.200605 ip-10-0-135-67 kubenswrapper[2568]: W0603 16:33:48.200456 2568 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jun 03 16:33:48.200605 ip-10-0-135-67 kubenswrapper[2568]: W0603 16:33:48.200459 2568 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterOperations Jun 03 16:33:48.200605 ip-10-0-135-67 kubenswrapper[2568]: W0603 16:33:48.200461 2568 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jun 03 16:33:48.200605 ip-10-0-135-67 kubenswrapper[2568]: W0603 16:33:48.200464 2568 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jun 03 16:33:48.200605 ip-10-0-135-67 kubenswrapper[2568]: W0603 16:33:48.200466 2568 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jun 03 16:33:48.200605 ip-10-0-135-67 kubenswrapper[2568]: W0603 16:33:48.200468 2568 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jun 03 16:33:48.201090 ip-10-0-135-67 kubenswrapper[2568]: W0603 16:33:48.200471 2568 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jun 03 16:33:48.201090 ip-10-0-135-67 kubenswrapper[2568]: W0603 16:33:48.200473 2568 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jun 03 16:33:48.201090 ip-10-0-135-67 kubenswrapper[2568]: W0603 16:33:48.200476 2568 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jun 03 16:33:48.201090 ip-10-0-135-67 kubenswrapper[2568]: W0603 16:33:48.200479 2568 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jun 03 16:33:48.201090 ip-10-0-135-67 kubenswrapper[2568]: W0603 16:33:48.200481 2568 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jun 03 16:33:48.201090 ip-10-0-135-67 kubenswrapper[2568]: W0603 16:33:48.200484 2568 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jun 03 16:33:48.201090 ip-10-0-135-67 kubenswrapper[2568]: W0603 16:33:48.200486 2568 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jun 03 16:33:48.201090 ip-10-0-135-67 kubenswrapper[2568]: W0603 16:33:48.200489 2568 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jun 03 16:33:48.201090 ip-10-0-135-67 kubenswrapper[2568]: W0603 16:33:48.200491 2568 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jun 03 16:33:48.201090 ip-10-0-135-67 kubenswrapper[2568]: W0603 16:33:48.200494 2568 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jun 03 16:33:48.201090 ip-10-0-135-67 kubenswrapper[2568]: W0603 16:33:48.200497 2568 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jun 03 16:33:48.201090 ip-10-0-135-67 kubenswrapper[2568]: W0603 16:33:48.200500 2568 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jun 03 16:33:48.201090 ip-10-0-135-67 kubenswrapper[2568]: W0603 16:33:48.200502 2568 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jun 03 16:33:48.201090 ip-10-0-135-67 kubenswrapper[2568]: W0603 16:33:48.200506 2568 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jun 03 16:33:48.201090 ip-10-0-135-67 kubenswrapper[2568]: W0603 16:33:48.200508 2568 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jun 03 16:33:48.201090 ip-10-0-135-67 kubenswrapper[2568]: W0603 16:33:48.200511 2568 feature_gate.go:328] unrecognized feature gate: Example Jun 03 16:33:48.201090 ip-10-0-135-67 kubenswrapper[2568]: W0603 16:33:48.200514 2568 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jun 03 16:33:48.201090 ip-10-0-135-67 kubenswrapper[2568]: W0603 16:33:48.200516 2568 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jun 03 16:33:48.201090 ip-10-0-135-67 kubenswrapper[2568]: W0603 16:33:48.200518 2568 feature_gate.go:328] unrecognized feature gate: NewOLM Jun 03 16:33:48.201090 ip-10-0-135-67 kubenswrapper[2568]: W0603 16:33:48.200521 2568 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jun 03 16:33:48.201570 ip-10-0-135-67 kubenswrapper[2568]: W0603 16:33:48.200523 2568 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jun 03 16:33:48.201570 ip-10-0-135-67 kubenswrapper[2568]: W0603 16:33:48.200527 2568 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jun 03 16:33:48.201570 ip-10-0-135-67 kubenswrapper[2568]: W0603 16:33:48.200529 2568 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jun 03 16:33:48.201570 ip-10-0-135-67 kubenswrapper[2568]: W0603 16:33:48.200532 2568 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jun 03 16:33:48.201570 ip-10-0-135-67 kubenswrapper[2568]: W0603 16:33:48.200534 2568 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jun 03 16:33:48.201570 ip-10-0-135-67 kubenswrapper[2568]: W0603 16:33:48.200537 2568 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jun 03 16:33:48.201570 ip-10-0-135-67 kubenswrapper[2568]: W0603 16:33:48.200539 2568 feature_gate.go:328] unrecognized feature gate: IngressControllerLBSubnetsAWS Jun 03 16:33:48.201570 ip-10-0-135-67 kubenswrapper[2568]: W0603 16:33:48.200542 2568 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jun 03 16:33:48.201570 ip-10-0-135-67 kubenswrapper[2568]: W0603 16:33:48.200544 2568 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jun 03 16:33:48.201570 ip-10-0-135-67 kubenswrapper[2568]: W0603 16:33:48.200547 2568 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jun 03 16:33:48.201570 ip-10-0-135-67 kubenswrapper[2568]: W0603 16:33:48.200551 2568 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jun 03 16:33:48.201570 ip-10-0-135-67 kubenswrapper[2568]: W0603 16:33:48.200554 2568 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jun 03 16:33:48.201570 ip-10-0-135-67 kubenswrapper[2568]: W0603 16:33:48.200557 2568 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jun 03 16:33:48.201570 ip-10-0-135-67 kubenswrapper[2568]: W0603 16:33:48.200559 2568 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jun 03 16:33:48.201570 ip-10-0-135-67 kubenswrapper[2568]: W0603 16:33:48.200562 2568 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jun 03 16:33:48.201570 ip-10-0-135-67 kubenswrapper[2568]: W0603 16:33:48.200564 2568 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jun 03 16:33:48.201570 ip-10-0-135-67 kubenswrapper[2568]: W0603 16:33:48.200567 2568 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jun 03 16:33:48.201570 ip-10-0-135-67 kubenswrapper[2568]: W0603 16:33:48.200570 2568 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jun 03 16:33:48.201570 ip-10-0-135-67 kubenswrapper[2568]: W0603 16:33:48.200574 2568 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jun 03 16:33:48.202045 ip-10-0-135-67 kubenswrapper[2568]: W0603 16:33:48.200578 2568 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jun 03 16:33:48.202045 ip-10-0-135-67 kubenswrapper[2568]: W0603 16:33:48.200581 2568 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jun 03 16:33:48.202045 ip-10-0-135-67 kubenswrapper[2568]: W0603 16:33:48.200584 2568 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jun 03 16:33:48.202045 ip-10-0-135-67 kubenswrapper[2568]: W0603 16:33:48.200586 2568 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jun 03 16:33:48.202045 ip-10-0-135-67 kubenswrapper[2568]: W0603 16:33:48.200589 2568 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jun 03 16:33:48.202045 ip-10-0-135-67 kubenswrapper[2568]: W0603 16:33:48.200592 2568 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jun 03 16:33:48.202045 ip-10-0-135-67 kubenswrapper[2568]: W0603 16:33:48.200595 2568 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jun 03 16:33:48.202045 ip-10-0-135-67 kubenswrapper[2568]: W0603 16:33:48.200598 2568 feature_gate.go:328] unrecognized feature gate: InsightsConfigAPI Jun 03 16:33:48.202045 ip-10-0-135-67 kubenswrapper[2568]: W0603 16:33:48.200601 2568 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jun 03 16:33:48.202045 ip-10-0-135-67 kubenswrapper[2568]: W0603 16:33:48.200603 2568 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jun 03 16:33:48.202045 ip-10-0-135-67 kubenswrapper[2568]: W0603 16:33:48.200606 2568 feature_gate.go:328] unrecognized feature gate: SetEIPForNLBIngressController Jun 03 16:33:48.202045 ip-10-0-135-67 kubenswrapper[2568]: W0603 16:33:48.200609 2568 feature_gate.go:328] unrecognized feature gate: PinnedImages Jun 03 16:33:48.202045 ip-10-0-135-67 kubenswrapper[2568]: W0603 16:33:48.200612 2568 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jun 03 16:33:48.202045 ip-10-0-135-67 kubenswrapper[2568]: W0603 16:33:48.200614 2568 feature_gate.go:328] unrecognized feature gate: SignatureStores Jun 03 16:33:48.202045 ip-10-0-135-67 kubenswrapper[2568]: W0603 16:33:48.200618 2568 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jun 03 16:33:48.202045 ip-10-0-135-67 kubenswrapper[2568]: W0603 16:33:48.200621 2568 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jun 03 16:33:48.202045 ip-10-0-135-67 kubenswrapper[2568]: W0603 16:33:48.200624 2568 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jun 03 16:33:48.202045 ip-10-0-135-67 kubenswrapper[2568]: W0603 16:33:48.200627 2568 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jun 03 16:33:48.202045 ip-10-0-135-67 kubenswrapper[2568]: W0603 16:33:48.200630 2568 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jun 03 16:33:48.202045 ip-10-0-135-67 kubenswrapper[2568]: W0603 16:33:48.200632 2568 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jun 03 16:33:48.202526 ip-10-0-135-67 kubenswrapper[2568]: W0603 16:33:48.200635 2568 feature_gate.go:328] unrecognized feature gate: Example2 Jun 03 16:33:48.202526 ip-10-0-135-67 kubenswrapper[2568]: W0603 16:33:48.200638 2568 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jun 03 16:33:48.202526 ip-10-0-135-67 kubenswrapper[2568]: W0603 16:33:48.201025 2568 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jun 03 16:33:48.202526 ip-10-0-135-67 kubenswrapper[2568]: W0603 16:33:48.201032 2568 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jun 03 16:33:48.202526 ip-10-0-135-67 kubenswrapper[2568]: W0603 16:33:48.201035 2568 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jun 03 16:33:48.202526 ip-10-0-135-67 kubenswrapper[2568]: W0603 16:33:48.201038 2568 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jun 03 16:33:48.202526 ip-10-0-135-67 kubenswrapper[2568]: W0603 16:33:48.201040 2568 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jun 03 16:33:48.202526 ip-10-0-135-67 kubenswrapper[2568]: W0603 16:33:48.201043 2568 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jun 03 16:33:48.202526 ip-10-0-135-67 kubenswrapper[2568]: W0603 16:33:48.201047 2568 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jun 03 16:33:48.202526 ip-10-0-135-67 kubenswrapper[2568]: W0603 16:33:48.201050 2568 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jun 03 16:33:48.202526 ip-10-0-135-67 kubenswrapper[2568]: W0603 16:33:48.201052 2568 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jun 03 16:33:48.202526 ip-10-0-135-67 kubenswrapper[2568]: W0603 16:33:48.201055 2568 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jun 03 16:33:48.202526 ip-10-0-135-67 kubenswrapper[2568]: W0603 16:33:48.201058 2568 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jun 03 16:33:48.202526 ip-10-0-135-67 kubenswrapper[2568]: W0603 16:33:48.201061 2568 feature_gate.go:328] unrecognized feature gate: OVNObservability Jun 03 16:33:48.202526 ip-10-0-135-67 kubenswrapper[2568]: W0603 16:33:48.201063 2568 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jun 03 16:33:48.202526 ip-10-0-135-67 kubenswrapper[2568]: W0603 16:33:48.201066 2568 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jun 03 16:33:48.202526 ip-10-0-135-67 kubenswrapper[2568]: W0603 16:33:48.201069 2568 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jun 03 16:33:48.202526 ip-10-0-135-67 kubenswrapper[2568]: W0603 16:33:48.201071 2568 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jun 03 16:33:48.202526 ip-10-0-135-67 kubenswrapper[2568]: W0603 16:33:48.201074 2568 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jun 03 16:33:48.202526 ip-10-0-135-67 kubenswrapper[2568]: W0603 16:33:48.201077 2568 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jun 03 16:33:48.203027 ip-10-0-135-67 kubenswrapper[2568]: W0603 16:33:48.201079 2568 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jun 03 16:33:48.203027 ip-10-0-135-67 kubenswrapper[2568]: W0603 16:33:48.201082 2568 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jun 03 16:33:48.203027 ip-10-0-135-67 kubenswrapper[2568]: W0603 16:33:48.201085 2568 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jun 03 16:33:48.203027 ip-10-0-135-67 kubenswrapper[2568]: W0603 16:33:48.201087 2568 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jun 03 16:33:48.203027 ip-10-0-135-67 kubenswrapper[2568]: W0603 16:33:48.201090 2568 feature_gate.go:328] unrecognized feature gate: PinnedImages Jun 03 16:33:48.203027 ip-10-0-135-67 kubenswrapper[2568]: W0603 16:33:48.201093 2568 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jun 03 16:33:48.203027 ip-10-0-135-67 kubenswrapper[2568]: W0603 16:33:48.201097 2568 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jun 03 16:33:48.203027 ip-10-0-135-67 kubenswrapper[2568]: W0603 16:33:48.201099 2568 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jun 03 16:33:48.203027 ip-10-0-135-67 kubenswrapper[2568]: W0603 16:33:48.201104 2568 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jun 03 16:33:48.203027 ip-10-0-135-67 kubenswrapper[2568]: W0603 16:33:48.201107 2568 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jun 03 16:33:48.203027 ip-10-0-135-67 kubenswrapper[2568]: W0603 16:33:48.201111 2568 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jun 03 16:33:48.203027 ip-10-0-135-67 kubenswrapper[2568]: W0603 16:33:48.201113 2568 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jun 03 16:33:48.203027 ip-10-0-135-67 kubenswrapper[2568]: W0603 16:33:48.201116 2568 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jun 03 16:33:48.203027 ip-10-0-135-67 kubenswrapper[2568]: W0603 16:33:48.201119 2568 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jun 03 16:33:48.203027 ip-10-0-135-67 kubenswrapper[2568]: W0603 16:33:48.201121 2568 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jun 03 16:33:48.203027 ip-10-0-135-67 kubenswrapper[2568]: W0603 16:33:48.201124 2568 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jun 03 16:33:48.203027 ip-10-0-135-67 kubenswrapper[2568]: W0603 16:33:48.201127 2568 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jun 03 16:33:48.203027 ip-10-0-135-67 kubenswrapper[2568]: W0603 16:33:48.201129 2568 feature_gate.go:328] unrecognized feature gate: DualReplica Jun 03 16:33:48.203027 ip-10-0-135-67 kubenswrapper[2568]: W0603 16:33:48.201131 2568 feature_gate.go:328] unrecognized feature gate: SetEIPForNLBIngressController Jun 03 16:33:48.203027 ip-10-0-135-67 kubenswrapper[2568]: W0603 16:33:48.201134 2568 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jun 03 16:33:48.203566 ip-10-0-135-67 kubenswrapper[2568]: W0603 16:33:48.201137 2568 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jun 03 16:33:48.203566 ip-10-0-135-67 kubenswrapper[2568]: W0603 16:33:48.201140 2568 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jun 03 16:33:48.203566 ip-10-0-135-67 kubenswrapper[2568]: W0603 16:33:48.201143 2568 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jun 03 16:33:48.203566 ip-10-0-135-67 kubenswrapper[2568]: W0603 16:33:48.201147 2568 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jun 03 16:33:48.203566 ip-10-0-135-67 kubenswrapper[2568]: W0603 16:33:48.201151 2568 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jun 03 16:33:48.203566 ip-10-0-135-67 kubenswrapper[2568]: W0603 16:33:48.201153 2568 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jun 03 16:33:48.203566 ip-10-0-135-67 kubenswrapper[2568]: W0603 16:33:48.201156 2568 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jun 03 16:33:48.203566 ip-10-0-135-67 kubenswrapper[2568]: W0603 16:33:48.201159 2568 feature_gate.go:328] unrecognized feature gate: Example2 Jun 03 16:33:48.203566 ip-10-0-135-67 kubenswrapper[2568]: W0603 16:33:48.201161 2568 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jun 03 16:33:48.203566 ip-10-0-135-67 kubenswrapper[2568]: W0603 16:33:48.201163 2568 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jun 03 16:33:48.203566 ip-10-0-135-67 kubenswrapper[2568]: W0603 16:33:48.201166 2568 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jun 03 16:33:48.203566 ip-10-0-135-67 kubenswrapper[2568]: W0603 16:33:48.201169 2568 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jun 03 16:33:48.203566 ip-10-0-135-67 kubenswrapper[2568]: W0603 16:33:48.201171 2568 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jun 03 16:33:48.203566 ip-10-0-135-67 kubenswrapper[2568]: W0603 16:33:48.201174 2568 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterOperations Jun 03 16:33:48.203566 ip-10-0-135-67 kubenswrapper[2568]: W0603 16:33:48.201176 2568 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jun 03 16:33:48.203566 ip-10-0-135-67 kubenswrapper[2568]: W0603 16:33:48.201179 2568 feature_gate.go:328] unrecognized feature gate: IngressControllerLBSubnetsAWS Jun 03 16:33:48.203566 ip-10-0-135-67 kubenswrapper[2568]: W0603 16:33:48.201181 2568 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jun 03 16:33:48.203566 ip-10-0-135-67 kubenswrapper[2568]: W0603 16:33:48.201183 2568 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jun 03 16:33:48.203566 ip-10-0-135-67 kubenswrapper[2568]: W0603 16:33:48.201186 2568 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jun 03 16:33:48.203566 ip-10-0-135-67 kubenswrapper[2568]: W0603 16:33:48.201189 2568 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jun 03 16:33:48.204060 ip-10-0-135-67 kubenswrapper[2568]: W0603 16:33:48.201191 2568 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jun 03 16:33:48.204060 ip-10-0-135-67 kubenswrapper[2568]: W0603 16:33:48.201194 2568 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jun 03 16:33:48.204060 ip-10-0-135-67 kubenswrapper[2568]: W0603 16:33:48.201196 2568 feature_gate.go:328] unrecognized feature gate: Example Jun 03 16:33:48.204060 ip-10-0-135-67 kubenswrapper[2568]: W0603 16:33:48.201199 2568 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jun 03 16:33:48.204060 ip-10-0-135-67 kubenswrapper[2568]: W0603 16:33:48.201201 2568 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jun 03 16:33:48.204060 ip-10-0-135-67 kubenswrapper[2568]: W0603 16:33:48.201204 2568 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jun 03 16:33:48.204060 ip-10-0-135-67 kubenswrapper[2568]: W0603 16:33:48.201206 2568 feature_gate.go:328] unrecognized feature gate: SignatureStores Jun 03 16:33:48.204060 ip-10-0-135-67 kubenswrapper[2568]: W0603 16:33:48.201209 2568 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jun 03 16:33:48.204060 ip-10-0-135-67 kubenswrapper[2568]: W0603 16:33:48.201211 2568 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jun 03 16:33:48.204060 ip-10-0-135-67 kubenswrapper[2568]: W0603 16:33:48.201214 2568 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jun 03 16:33:48.204060 ip-10-0-135-67 kubenswrapper[2568]: W0603 16:33:48.201216 2568 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jun 03 16:33:48.204060 ip-10-0-135-67 kubenswrapper[2568]: W0603 16:33:48.201220 2568 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jun 03 16:33:48.204060 ip-10-0-135-67 kubenswrapper[2568]: W0603 16:33:48.201222 2568 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jun 03 16:33:48.204060 ip-10-0-135-67 kubenswrapper[2568]: W0603 16:33:48.201225 2568 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jun 03 16:33:48.204060 ip-10-0-135-67 kubenswrapper[2568]: W0603 16:33:48.201228 2568 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jun 03 16:33:48.204060 ip-10-0-135-67 kubenswrapper[2568]: W0603 16:33:48.201235 2568 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jun 03 16:33:48.204060 ip-10-0-135-67 kubenswrapper[2568]: W0603 16:33:48.201237 2568 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jun 03 16:33:48.204060 ip-10-0-135-67 kubenswrapper[2568]: W0603 16:33:48.201240 2568 feature_gate.go:328] unrecognized feature gate: NewOLM Jun 03 16:33:48.204060 ip-10-0-135-67 kubenswrapper[2568]: W0603 16:33:48.201242 2568 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jun 03 16:33:48.204060 ip-10-0-135-67 kubenswrapper[2568]: W0603 16:33:48.201245 2568 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jun 03 16:33:48.204541 ip-10-0-135-67 kubenswrapper[2568]: W0603 16:33:48.201247 2568 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jun 03 16:33:48.204541 ip-10-0-135-67 kubenswrapper[2568]: W0603 16:33:48.201250 2568 feature_gate.go:328] unrecognized feature gate: InsightsConfigAPI Jun 03 16:33:48.204541 ip-10-0-135-67 kubenswrapper[2568]: W0603 16:33:48.201252 2568 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jun 03 16:33:48.204541 ip-10-0-135-67 kubenswrapper[2568]: W0603 16:33:48.201255 2568 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jun 03 16:33:48.204541 ip-10-0-135-67 kubenswrapper[2568]: W0603 16:33:48.201257 2568 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jun 03 16:33:48.204541 ip-10-0-135-67 kubenswrapper[2568]: W0603 16:33:48.201260 2568 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jun 03 16:33:48.204541 ip-10-0-135-67 kubenswrapper[2568]: W0603 16:33:48.201262 2568 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jun 03 16:33:48.204541 ip-10-0-135-67 kubenswrapper[2568]: W0603 16:33:48.201265 2568 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jun 03 16:33:48.204541 ip-10-0-135-67 kubenswrapper[2568]: I0603 16:33:48.201344 2568 flags.go:64] FLAG: --address="0.0.0.0" Jun 03 16:33:48.204541 ip-10-0-135-67 kubenswrapper[2568]: I0603 16:33:48.201351 2568 flags.go:64] FLAG: --allowed-unsafe-sysctls="[]" Jun 03 16:33:48.204541 ip-10-0-135-67 kubenswrapper[2568]: I0603 16:33:48.201357 2568 flags.go:64] FLAG: --anonymous-auth="true" Jun 03 16:33:48.204541 ip-10-0-135-67 kubenswrapper[2568]: I0603 16:33:48.201362 2568 flags.go:64] FLAG: --application-metrics-count-limit="100" Jun 03 16:33:48.204541 ip-10-0-135-67 kubenswrapper[2568]: I0603 16:33:48.201368 2568 flags.go:64] FLAG: --authentication-token-webhook="false" Jun 03 16:33:48.204541 ip-10-0-135-67 kubenswrapper[2568]: I0603 16:33:48.201371 2568 flags.go:64] FLAG: --authentication-token-webhook-cache-ttl="2m0s" Jun 03 16:33:48.204541 ip-10-0-135-67 kubenswrapper[2568]: I0603 16:33:48.201375 2568 flags.go:64] FLAG: --authorization-mode="AlwaysAllow" Jun 03 16:33:48.204541 ip-10-0-135-67 kubenswrapper[2568]: I0603 16:33:48.201379 2568 flags.go:64] FLAG: --authorization-webhook-cache-authorized-ttl="5m0s" Jun 03 16:33:48.204541 ip-10-0-135-67 kubenswrapper[2568]: I0603 16:33:48.201382 2568 flags.go:64] FLAG: --authorization-webhook-cache-unauthorized-ttl="30s" Jun 03 16:33:48.204541 ip-10-0-135-67 kubenswrapper[2568]: I0603 16:33:48.201385 2568 flags.go:64] FLAG: --boot-id-file="/proc/sys/kernel/random/boot_id" Jun 03 16:33:48.204541 ip-10-0-135-67 kubenswrapper[2568]: I0603 16:33:48.201389 2568 flags.go:64] FLAG: --bootstrap-kubeconfig="/etc/kubernetes/kubeconfig" Jun 03 16:33:48.204541 ip-10-0-135-67 kubenswrapper[2568]: I0603 16:33:48.201392 2568 flags.go:64] FLAG: --cert-dir="/var/lib/kubelet/pki" Jun 03 16:33:48.204541 ip-10-0-135-67 kubenswrapper[2568]: I0603 16:33:48.201395 2568 flags.go:64] FLAG: --cgroup-driver="cgroupfs" Jun 03 16:33:48.204541 ip-10-0-135-67 kubenswrapper[2568]: I0603 16:33:48.201398 2568 flags.go:64] FLAG: --cgroup-root="" Jun 03 16:33:48.205087 ip-10-0-135-67 kubenswrapper[2568]: I0603 16:33:48.201401 2568 flags.go:64] FLAG: --cgroups-per-qos="true" Jun 03 16:33:48.205087 ip-10-0-135-67 kubenswrapper[2568]: I0603 16:33:48.201404 2568 flags.go:64] FLAG: --client-ca-file="" Jun 03 16:33:48.205087 ip-10-0-135-67 kubenswrapper[2568]: I0603 16:33:48.201406 2568 flags.go:64] FLAG: --cloud-config="" Jun 03 16:33:48.205087 ip-10-0-135-67 kubenswrapper[2568]: I0603 16:33:48.201409 2568 flags.go:64] FLAG: --cloud-provider="external" Jun 03 16:33:48.205087 ip-10-0-135-67 kubenswrapper[2568]: I0603 16:33:48.201412 2568 flags.go:64] FLAG: --cluster-dns="[]" Jun 03 16:33:48.205087 ip-10-0-135-67 kubenswrapper[2568]: I0603 16:33:48.201418 2568 flags.go:64] FLAG: --cluster-domain="" Jun 03 16:33:48.205087 ip-10-0-135-67 kubenswrapper[2568]: I0603 16:33:48.201421 2568 flags.go:64] FLAG: --config="/etc/kubernetes/kubelet.conf" Jun 03 16:33:48.205087 ip-10-0-135-67 kubenswrapper[2568]: I0603 16:33:48.201424 2568 flags.go:64] FLAG: --config-dir="" Jun 03 16:33:48.205087 ip-10-0-135-67 kubenswrapper[2568]: I0603 16:33:48.201427 2568 flags.go:64] FLAG: --container-hints="/etc/cadvisor/container_hints.json" Jun 03 16:33:48.205087 ip-10-0-135-67 kubenswrapper[2568]: I0603 16:33:48.201430 2568 flags.go:64] FLAG: --container-log-max-files="5" Jun 03 16:33:48.205087 ip-10-0-135-67 kubenswrapper[2568]: I0603 16:33:48.201434 2568 flags.go:64] FLAG: --container-log-max-size="10Mi" Jun 03 16:33:48.205087 ip-10-0-135-67 kubenswrapper[2568]: I0603 16:33:48.201438 2568 flags.go:64] FLAG: --container-runtime-endpoint="/var/run/crio/crio.sock" Jun 03 16:33:48.205087 ip-10-0-135-67 kubenswrapper[2568]: I0603 16:33:48.201441 2568 flags.go:64] FLAG: --containerd="/run/containerd/containerd.sock" Jun 03 16:33:48.205087 ip-10-0-135-67 kubenswrapper[2568]: I0603 16:33:48.201444 2568 flags.go:64] FLAG: --containerd-namespace="k8s.io" Jun 03 16:33:48.205087 ip-10-0-135-67 kubenswrapper[2568]: I0603 16:33:48.201447 2568 flags.go:64] FLAG: --contention-profiling="false" Jun 03 16:33:48.205087 ip-10-0-135-67 kubenswrapper[2568]: I0603 16:33:48.201450 2568 flags.go:64] FLAG: --cpu-cfs-quota="true" Jun 03 16:33:48.205087 ip-10-0-135-67 kubenswrapper[2568]: I0603 16:33:48.201453 2568 flags.go:64] FLAG: --cpu-cfs-quota-period="100ms" Jun 03 16:33:48.205087 ip-10-0-135-67 kubenswrapper[2568]: I0603 16:33:48.201456 2568 flags.go:64] FLAG: --cpu-manager-policy="none" Jun 03 16:33:48.205087 ip-10-0-135-67 kubenswrapper[2568]: I0603 16:33:48.201459 2568 flags.go:64] FLAG: --cpu-manager-policy-options="" Jun 03 16:33:48.205087 ip-10-0-135-67 kubenswrapper[2568]: I0603 16:33:48.201467 2568 flags.go:64] FLAG: --cpu-manager-reconcile-period="10s" Jun 03 16:33:48.205087 ip-10-0-135-67 kubenswrapper[2568]: I0603 16:33:48.201470 2568 flags.go:64] FLAG: --enable-controller-attach-detach="true" Jun 03 16:33:48.205087 ip-10-0-135-67 kubenswrapper[2568]: I0603 16:33:48.201473 2568 flags.go:64] FLAG: --enable-debugging-handlers="true" Jun 03 16:33:48.205087 ip-10-0-135-67 kubenswrapper[2568]: I0603 16:33:48.201476 2568 flags.go:64] FLAG: --enable-load-reader="false" Jun 03 16:33:48.205087 ip-10-0-135-67 kubenswrapper[2568]: I0603 16:33:48.201479 2568 flags.go:64] FLAG: --enable-server="true" Jun 03 16:33:48.205087 ip-10-0-135-67 kubenswrapper[2568]: I0603 16:33:48.201482 2568 flags.go:64] FLAG: --enforce-node-allocatable="[pods]" Jun 03 16:33:48.205691 ip-10-0-135-67 kubenswrapper[2568]: I0603 16:33:48.201486 2568 flags.go:64] FLAG: --event-burst="100" Jun 03 16:33:48.205691 ip-10-0-135-67 kubenswrapper[2568]: I0603 16:33:48.201489 2568 flags.go:64] FLAG: --event-qps="50" Jun 03 16:33:48.205691 ip-10-0-135-67 kubenswrapper[2568]: I0603 16:33:48.201492 2568 flags.go:64] FLAG: --event-storage-age-limit="default=0" Jun 03 16:33:48.205691 ip-10-0-135-67 kubenswrapper[2568]: I0603 16:33:48.201495 2568 flags.go:64] FLAG: --event-storage-event-limit="default=0" Jun 03 16:33:48.205691 ip-10-0-135-67 kubenswrapper[2568]: I0603 16:33:48.201498 2568 flags.go:64] FLAG: --eviction-hard="" Jun 03 16:33:48.205691 ip-10-0-135-67 kubenswrapper[2568]: I0603 16:33:48.201502 2568 flags.go:64] FLAG: --eviction-max-pod-grace-period="0" Jun 03 16:33:48.205691 ip-10-0-135-67 kubenswrapper[2568]: I0603 16:33:48.201505 2568 flags.go:64] FLAG: --eviction-minimum-reclaim="" Jun 03 16:33:48.205691 ip-10-0-135-67 kubenswrapper[2568]: I0603 16:33:48.201508 2568 flags.go:64] FLAG: --eviction-pressure-transition-period="5m0s" Jun 03 16:33:48.205691 ip-10-0-135-67 kubenswrapper[2568]: I0603 16:33:48.201511 2568 flags.go:64] FLAG: --eviction-soft="" Jun 03 16:33:48.205691 ip-10-0-135-67 kubenswrapper[2568]: I0603 16:33:48.201514 2568 flags.go:64] FLAG: --eviction-soft-grace-period="" Jun 03 16:33:48.205691 ip-10-0-135-67 kubenswrapper[2568]: I0603 16:33:48.201517 2568 flags.go:64] FLAG: --exit-on-lock-contention="false" Jun 03 16:33:48.205691 ip-10-0-135-67 kubenswrapper[2568]: I0603 16:33:48.201519 2568 flags.go:64] FLAG: --experimental-allocatable-ignore-eviction="false" Jun 03 16:33:48.205691 ip-10-0-135-67 kubenswrapper[2568]: I0603 16:33:48.201525 2568 flags.go:64] FLAG: --experimental-mounter-path="" Jun 03 16:33:48.205691 ip-10-0-135-67 kubenswrapper[2568]: I0603 16:33:48.201528 2568 flags.go:64] FLAG: --fail-cgroupv1="false" Jun 03 16:33:48.205691 ip-10-0-135-67 kubenswrapper[2568]: I0603 16:33:48.201530 2568 flags.go:64] FLAG: --fail-swap-on="true" Jun 03 16:33:48.205691 ip-10-0-135-67 kubenswrapper[2568]: I0603 16:33:48.201533 2568 flags.go:64] FLAG: --feature-gates="" Jun 03 16:33:48.205691 ip-10-0-135-67 kubenswrapper[2568]: I0603 16:33:48.201537 2568 flags.go:64] FLAG: --file-check-frequency="20s" Jun 03 16:33:48.205691 ip-10-0-135-67 kubenswrapper[2568]: I0603 16:33:48.201540 2568 flags.go:64] FLAG: --global-housekeeping-interval="1m0s" Jun 03 16:33:48.205691 ip-10-0-135-67 kubenswrapper[2568]: I0603 16:33:48.201543 2568 flags.go:64] FLAG: --hairpin-mode="promiscuous-bridge" Jun 03 16:33:48.205691 ip-10-0-135-67 kubenswrapper[2568]: I0603 16:33:48.201546 2568 flags.go:64] FLAG: --healthz-bind-address="127.0.0.1" Jun 03 16:33:48.205691 ip-10-0-135-67 kubenswrapper[2568]: I0603 16:33:48.201549 2568 flags.go:64] FLAG: --healthz-port="10248" Jun 03 16:33:48.205691 ip-10-0-135-67 kubenswrapper[2568]: I0603 16:33:48.201552 2568 flags.go:64] FLAG: --help="false" Jun 03 16:33:48.205691 ip-10-0-135-67 kubenswrapper[2568]: I0603 16:33:48.201555 2568 flags.go:64] FLAG: --hostname-override="ip-10-0-135-67.ec2.internal" Jun 03 16:33:48.205691 ip-10-0-135-67 kubenswrapper[2568]: I0603 16:33:48.201558 2568 flags.go:64] FLAG: --housekeeping-interval="10s" Jun 03 16:33:48.205691 ip-10-0-135-67 kubenswrapper[2568]: I0603 16:33:48.201561 2568 flags.go:64] FLAG: --http-check-frequency="20s" Jun 03 16:33:48.206301 ip-10-0-135-67 kubenswrapper[2568]: I0603 16:33:48.201563 2568 flags.go:64] FLAG: --image-credential-provider-bin-dir="/usr/libexec/kubelet-image-credential-provider-plugins" Jun 03 16:33:48.206301 ip-10-0-135-67 kubenswrapper[2568]: I0603 16:33:48.201567 2568 flags.go:64] FLAG: --image-credential-provider-config="/etc/kubernetes/credential-providers/ecr-credential-provider.yaml" Jun 03 16:33:48.206301 ip-10-0-135-67 kubenswrapper[2568]: I0603 16:33:48.201570 2568 flags.go:64] FLAG: --image-gc-high-threshold="85" Jun 03 16:33:48.206301 ip-10-0-135-67 kubenswrapper[2568]: I0603 16:33:48.201573 2568 flags.go:64] FLAG: --image-gc-low-threshold="80" Jun 03 16:33:48.206301 ip-10-0-135-67 kubenswrapper[2568]: I0603 16:33:48.201576 2568 flags.go:64] FLAG: --image-service-endpoint="" Jun 03 16:33:48.206301 ip-10-0-135-67 kubenswrapper[2568]: I0603 16:33:48.201579 2568 flags.go:64] FLAG: --kernel-memcg-notification="false" Jun 03 16:33:48.206301 ip-10-0-135-67 kubenswrapper[2568]: I0603 16:33:48.201582 2568 flags.go:64] FLAG: --kube-api-burst="100" Jun 03 16:33:48.206301 ip-10-0-135-67 kubenswrapper[2568]: I0603 16:33:48.201585 2568 flags.go:64] FLAG: --kube-api-content-type="application/vnd.kubernetes.protobuf" Jun 03 16:33:48.206301 ip-10-0-135-67 kubenswrapper[2568]: I0603 16:33:48.201588 2568 flags.go:64] FLAG: --kube-api-qps="50" Jun 03 16:33:48.206301 ip-10-0-135-67 kubenswrapper[2568]: I0603 16:33:48.201592 2568 flags.go:64] FLAG: --kube-reserved="" Jun 03 16:33:48.206301 ip-10-0-135-67 kubenswrapper[2568]: I0603 16:33:48.201595 2568 flags.go:64] FLAG: --kube-reserved-cgroup="" Jun 03 16:33:48.206301 ip-10-0-135-67 kubenswrapper[2568]: I0603 16:33:48.201597 2568 flags.go:64] FLAG: --kubeconfig="/var/lib/kubelet/kubeconfig" Jun 03 16:33:48.206301 ip-10-0-135-67 kubenswrapper[2568]: I0603 16:33:48.201600 2568 flags.go:64] FLAG: --kubelet-cgroups="" Jun 03 16:33:48.206301 ip-10-0-135-67 kubenswrapper[2568]: I0603 16:33:48.201603 2568 flags.go:64] FLAG: --local-storage-capacity-isolation="true" Jun 03 16:33:48.206301 ip-10-0-135-67 kubenswrapper[2568]: I0603 16:33:48.201606 2568 flags.go:64] FLAG: --lock-file="" Jun 03 16:33:48.206301 ip-10-0-135-67 kubenswrapper[2568]: I0603 16:33:48.201609 2568 flags.go:64] FLAG: --log-cadvisor-usage="false" Jun 03 16:33:48.206301 ip-10-0-135-67 kubenswrapper[2568]: I0603 16:33:48.201612 2568 flags.go:64] FLAG: --log-flush-frequency="5s" Jun 03 16:33:48.206301 ip-10-0-135-67 kubenswrapper[2568]: I0603 16:33:48.201614 2568 flags.go:64] FLAG: --log-json-info-buffer-size="0" Jun 03 16:33:48.206301 ip-10-0-135-67 kubenswrapper[2568]: I0603 16:33:48.201619 2568 flags.go:64] FLAG: --log-json-split-stream="false" Jun 03 16:33:48.206301 ip-10-0-135-67 kubenswrapper[2568]: I0603 16:33:48.201623 2568 flags.go:64] FLAG: --log-text-info-buffer-size="0" Jun 03 16:33:48.206301 ip-10-0-135-67 kubenswrapper[2568]: I0603 16:33:48.201626 2568 flags.go:64] FLAG: --log-text-split-stream="false" Jun 03 16:33:48.206301 ip-10-0-135-67 kubenswrapper[2568]: I0603 16:33:48.201629 2568 flags.go:64] FLAG: --logging-format="text" Jun 03 16:33:48.206301 ip-10-0-135-67 kubenswrapper[2568]: I0603 16:33:48.201632 2568 flags.go:64] FLAG: --machine-id-file="/etc/machine-id,/var/lib/dbus/machine-id" Jun 03 16:33:48.206859 ip-10-0-135-67 kubenswrapper[2568]: I0603 16:33:48.201635 2568 flags.go:64] FLAG: --make-iptables-util-chains="true" Jun 03 16:33:48.206859 ip-10-0-135-67 kubenswrapper[2568]: I0603 16:33:48.201638 2568 flags.go:64] FLAG: --manifest-url="" Jun 03 16:33:48.206859 ip-10-0-135-67 kubenswrapper[2568]: I0603 16:33:48.201641 2568 flags.go:64] FLAG: --manifest-url-header="" Jun 03 16:33:48.206859 ip-10-0-135-67 kubenswrapper[2568]: I0603 16:33:48.201645 2568 flags.go:64] FLAG: --max-housekeeping-interval="15s" Jun 03 16:33:48.206859 ip-10-0-135-67 kubenswrapper[2568]: I0603 16:33:48.201648 2568 flags.go:64] FLAG: --max-open-files="1000000" Jun 03 16:33:48.206859 ip-10-0-135-67 kubenswrapper[2568]: I0603 16:33:48.201652 2568 flags.go:64] FLAG: --max-pods="110" Jun 03 16:33:48.206859 ip-10-0-135-67 kubenswrapper[2568]: I0603 16:33:48.201655 2568 flags.go:64] FLAG: --maximum-dead-containers="-1" Jun 03 16:33:48.206859 ip-10-0-135-67 kubenswrapper[2568]: I0603 16:33:48.201658 2568 flags.go:64] FLAG: --maximum-dead-containers-per-container="1" Jun 03 16:33:48.206859 ip-10-0-135-67 kubenswrapper[2568]: I0603 16:33:48.201661 2568 flags.go:64] FLAG: --memory-manager-policy="None" Jun 03 16:33:48.206859 ip-10-0-135-67 kubenswrapper[2568]: I0603 16:33:48.201664 2568 flags.go:64] FLAG: --minimum-container-ttl-duration="6m0s" Jun 03 16:33:48.206859 ip-10-0-135-67 kubenswrapper[2568]: I0603 16:33:48.201667 2568 flags.go:64] FLAG: --minimum-image-ttl-duration="2m0s" Jun 03 16:33:48.206859 ip-10-0-135-67 kubenswrapper[2568]: I0603 16:33:48.201670 2568 flags.go:64] FLAG: --node-ip="0.0.0.0" Jun 03 16:33:48.206859 ip-10-0-135-67 kubenswrapper[2568]: I0603 16:33:48.201673 2568 flags.go:64] FLAG: --node-labels="node-role.kubernetes.io/worker=,node.openshift.io/os_id=rhel" Jun 03 16:33:48.206859 ip-10-0-135-67 kubenswrapper[2568]: I0603 16:33:48.201680 2568 flags.go:64] FLAG: --node-status-max-images="50" Jun 03 16:33:48.206859 ip-10-0-135-67 kubenswrapper[2568]: I0603 16:33:48.201683 2568 flags.go:64] FLAG: --node-status-update-frequency="10s" Jun 03 16:33:48.206859 ip-10-0-135-67 kubenswrapper[2568]: I0603 16:33:48.201686 2568 flags.go:64] FLAG: --oom-score-adj="-999" Jun 03 16:33:48.206859 ip-10-0-135-67 kubenswrapper[2568]: I0603 16:33:48.201691 2568 flags.go:64] FLAG: --pod-cidr="" Jun 03 16:33:48.206859 ip-10-0-135-67 kubenswrapper[2568]: I0603 16:33:48.201694 2568 flags.go:64] FLAG: --pod-infra-container-image="quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:f1083dc6abd9805f79797fa11c9accacc4a38caa073c94cb99097faffce05983" Jun 03 16:33:48.206859 ip-10-0-135-67 kubenswrapper[2568]: I0603 16:33:48.201700 2568 flags.go:64] FLAG: --pod-manifest-path="" Jun 03 16:33:48.206859 ip-10-0-135-67 kubenswrapper[2568]: I0603 16:33:48.201703 2568 flags.go:64] FLAG: --pod-max-pids="-1" Jun 03 16:33:48.206859 ip-10-0-135-67 kubenswrapper[2568]: I0603 16:33:48.201706 2568 flags.go:64] FLAG: --pods-per-core="0" Jun 03 16:33:48.206859 ip-10-0-135-67 kubenswrapper[2568]: I0603 16:33:48.201708 2568 flags.go:64] FLAG: --port="10250" Jun 03 16:33:48.206859 ip-10-0-135-67 kubenswrapper[2568]: I0603 16:33:48.201711 2568 flags.go:64] FLAG: --protect-kernel-defaults="false" Jun 03 16:33:48.206859 ip-10-0-135-67 kubenswrapper[2568]: I0603 16:33:48.201714 2568 flags.go:64] FLAG: --provider-id="aws:///us-east-1a/i-07075f992662379db" Jun 03 16:33:48.207463 ip-10-0-135-67 kubenswrapper[2568]: I0603 16:33:48.201717 2568 flags.go:64] FLAG: --qos-reserved="" Jun 03 16:33:48.207463 ip-10-0-135-67 kubenswrapper[2568]: I0603 16:33:48.201720 2568 flags.go:64] FLAG: --read-only-port="10255" Jun 03 16:33:48.207463 ip-10-0-135-67 kubenswrapper[2568]: I0603 16:33:48.201723 2568 flags.go:64] FLAG: --register-node="true" Jun 03 16:33:48.207463 ip-10-0-135-67 kubenswrapper[2568]: I0603 16:33:48.201726 2568 flags.go:64] FLAG: --register-schedulable="true" Jun 03 16:33:48.207463 ip-10-0-135-67 kubenswrapper[2568]: I0603 16:33:48.201729 2568 flags.go:64] FLAG: --register-with-taints="" Jun 03 16:33:48.207463 ip-10-0-135-67 kubenswrapper[2568]: I0603 16:33:48.201733 2568 flags.go:64] FLAG: --registry-burst="10" Jun 03 16:33:48.207463 ip-10-0-135-67 kubenswrapper[2568]: I0603 16:33:48.201736 2568 flags.go:64] FLAG: --registry-qps="5" Jun 03 16:33:48.207463 ip-10-0-135-67 kubenswrapper[2568]: I0603 16:33:48.201739 2568 flags.go:64] FLAG: --reserved-cpus="" Jun 03 16:33:48.207463 ip-10-0-135-67 kubenswrapper[2568]: I0603 16:33:48.201742 2568 flags.go:64] FLAG: --reserved-memory="" Jun 03 16:33:48.207463 ip-10-0-135-67 kubenswrapper[2568]: I0603 16:33:48.201745 2568 flags.go:64] FLAG: --resolv-conf="/etc/resolv.conf" Jun 03 16:33:48.207463 ip-10-0-135-67 kubenswrapper[2568]: I0603 16:33:48.201748 2568 flags.go:64] FLAG: --root-dir="/var/lib/kubelet" Jun 03 16:33:48.207463 ip-10-0-135-67 kubenswrapper[2568]: I0603 16:33:48.201751 2568 flags.go:64] FLAG: --rotate-certificates="false" Jun 03 16:33:48.207463 ip-10-0-135-67 kubenswrapper[2568]: I0603 16:33:48.201754 2568 flags.go:64] FLAG: --rotate-server-certificates="false" Jun 03 16:33:48.207463 ip-10-0-135-67 kubenswrapper[2568]: I0603 16:33:48.201757 2568 flags.go:64] FLAG: --runonce="false" Jun 03 16:33:48.207463 ip-10-0-135-67 kubenswrapper[2568]: I0603 16:33:48.201760 2568 flags.go:64] FLAG: --runtime-cgroups="/system.slice/crio.service" Jun 03 16:33:48.207463 ip-10-0-135-67 kubenswrapper[2568]: I0603 16:33:48.201763 2568 flags.go:64] FLAG: --runtime-request-timeout="2m0s" Jun 03 16:33:48.207463 ip-10-0-135-67 kubenswrapper[2568]: I0603 16:33:48.201766 2568 flags.go:64] FLAG: --seccomp-default="false" Jun 03 16:33:48.207463 ip-10-0-135-67 kubenswrapper[2568]: I0603 16:33:48.201769 2568 flags.go:64] FLAG: --serialize-image-pulls="true" Jun 03 16:33:48.207463 ip-10-0-135-67 kubenswrapper[2568]: I0603 16:33:48.201771 2568 flags.go:64] FLAG: --storage-driver-buffer-duration="1m0s" Jun 03 16:33:48.207463 ip-10-0-135-67 kubenswrapper[2568]: I0603 16:33:48.201774 2568 flags.go:64] FLAG: --storage-driver-db="cadvisor" Jun 03 16:33:48.207463 ip-10-0-135-67 kubenswrapper[2568]: I0603 16:33:48.201777 2568 flags.go:64] FLAG: --storage-driver-host="localhost:8086" Jun 03 16:33:48.207463 ip-10-0-135-67 kubenswrapper[2568]: I0603 16:33:48.201780 2568 flags.go:64] FLAG: --storage-driver-password="root" Jun 03 16:33:48.207463 ip-10-0-135-67 kubenswrapper[2568]: I0603 16:33:48.201783 2568 flags.go:64] FLAG: --storage-driver-secure="false" Jun 03 16:33:48.207463 ip-10-0-135-67 kubenswrapper[2568]: I0603 16:33:48.201786 2568 flags.go:64] FLAG: --storage-driver-table="stats" Jun 03 16:33:48.207463 ip-10-0-135-67 kubenswrapper[2568]: I0603 16:33:48.201790 2568 flags.go:64] FLAG: --storage-driver-user="root" Jun 03 16:33:48.207463 ip-10-0-135-67 kubenswrapper[2568]: I0603 16:33:48.201793 2568 flags.go:64] FLAG: --streaming-connection-idle-timeout="4h0m0s" Jun 03 16:33:48.208101 ip-10-0-135-67 kubenswrapper[2568]: I0603 16:33:48.201796 2568 flags.go:64] FLAG: --sync-frequency="1m0s" Jun 03 16:33:48.208101 ip-10-0-135-67 kubenswrapper[2568]: I0603 16:33:48.201799 2568 flags.go:64] FLAG: --system-cgroups="" Jun 03 16:33:48.208101 ip-10-0-135-67 kubenswrapper[2568]: I0603 16:33:48.201802 2568 flags.go:64] FLAG: --system-reserved="cpu=500m,ephemeral-storage=1Gi,memory=1Gi" Jun 03 16:33:48.208101 ip-10-0-135-67 kubenswrapper[2568]: I0603 16:33:48.201808 2568 flags.go:64] FLAG: --system-reserved-cgroup="" Jun 03 16:33:48.208101 ip-10-0-135-67 kubenswrapper[2568]: I0603 16:33:48.201810 2568 flags.go:64] FLAG: --tls-cert-file="" Jun 03 16:33:48.208101 ip-10-0-135-67 kubenswrapper[2568]: I0603 16:33:48.201813 2568 flags.go:64] FLAG: --tls-cipher-suites="[]" Jun 03 16:33:48.208101 ip-10-0-135-67 kubenswrapper[2568]: I0603 16:33:48.201817 2568 flags.go:64] FLAG: --tls-min-version="" Jun 03 16:33:48.208101 ip-10-0-135-67 kubenswrapper[2568]: I0603 16:33:48.201820 2568 flags.go:64] FLAG: --tls-private-key-file="" Jun 03 16:33:48.208101 ip-10-0-135-67 kubenswrapper[2568]: I0603 16:33:48.201822 2568 flags.go:64] FLAG: --topology-manager-policy="none" Jun 03 16:33:48.208101 ip-10-0-135-67 kubenswrapper[2568]: I0603 16:33:48.201825 2568 flags.go:64] FLAG: --topology-manager-policy-options="" Jun 03 16:33:48.208101 ip-10-0-135-67 kubenswrapper[2568]: I0603 16:33:48.201828 2568 flags.go:64] FLAG: --topology-manager-scope="container" Jun 03 16:33:48.208101 ip-10-0-135-67 kubenswrapper[2568]: I0603 16:33:48.201832 2568 flags.go:64] FLAG: --v="2" Jun 03 16:33:48.208101 ip-10-0-135-67 kubenswrapper[2568]: I0603 16:33:48.201836 2568 flags.go:64] FLAG: --version="false" Jun 03 16:33:48.208101 ip-10-0-135-67 kubenswrapper[2568]: I0603 16:33:48.201840 2568 flags.go:64] FLAG: --vmodule="" Jun 03 16:33:48.208101 ip-10-0-135-67 kubenswrapper[2568]: I0603 16:33:48.201844 2568 flags.go:64] FLAG: --volume-plugin-dir="/etc/kubernetes/kubelet-plugins/volume/exec" Jun 03 16:33:48.208101 ip-10-0-135-67 kubenswrapper[2568]: I0603 16:33:48.201847 2568 flags.go:64] FLAG: --volume-stats-agg-period="1m0s" Jun 03 16:33:48.208101 ip-10-0-135-67 kubenswrapper[2568]: W0603 16:33:48.201934 2568 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jun 03 16:33:48.208101 ip-10-0-135-67 kubenswrapper[2568]: W0603 16:33:48.201937 2568 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jun 03 16:33:48.208101 ip-10-0-135-67 kubenswrapper[2568]: W0603 16:33:48.201940 2568 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jun 03 16:33:48.208101 ip-10-0-135-67 kubenswrapper[2568]: W0603 16:33:48.201943 2568 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jun 03 16:33:48.208101 ip-10-0-135-67 kubenswrapper[2568]: W0603 16:33:48.201945 2568 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterOperations Jun 03 16:33:48.208101 ip-10-0-135-67 kubenswrapper[2568]: W0603 16:33:48.201948 2568 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jun 03 16:33:48.208101 ip-10-0-135-67 kubenswrapper[2568]: W0603 16:33:48.201951 2568 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jun 03 16:33:48.208672 ip-10-0-135-67 kubenswrapper[2568]: W0603 16:33:48.201953 2568 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jun 03 16:33:48.208672 ip-10-0-135-67 kubenswrapper[2568]: W0603 16:33:48.201957 2568 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jun 03 16:33:48.208672 ip-10-0-135-67 kubenswrapper[2568]: W0603 16:33:48.201961 2568 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jun 03 16:33:48.208672 ip-10-0-135-67 kubenswrapper[2568]: W0603 16:33:48.201964 2568 feature_gate.go:328] unrecognized feature gate: OVNObservability Jun 03 16:33:48.208672 ip-10-0-135-67 kubenswrapper[2568]: W0603 16:33:48.201967 2568 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jun 03 16:33:48.208672 ip-10-0-135-67 kubenswrapper[2568]: W0603 16:33:48.201970 2568 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jun 03 16:33:48.208672 ip-10-0-135-67 kubenswrapper[2568]: W0603 16:33:48.201972 2568 feature_gate.go:328] unrecognized feature gate: InsightsConfigAPI Jun 03 16:33:48.208672 ip-10-0-135-67 kubenswrapper[2568]: W0603 16:33:48.201976 2568 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jun 03 16:33:48.208672 ip-10-0-135-67 kubenswrapper[2568]: W0603 16:33:48.201979 2568 feature_gate.go:328] unrecognized feature gate: PinnedImages Jun 03 16:33:48.208672 ip-10-0-135-67 kubenswrapper[2568]: W0603 16:33:48.201982 2568 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jun 03 16:33:48.208672 ip-10-0-135-67 kubenswrapper[2568]: W0603 16:33:48.201985 2568 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jun 03 16:33:48.208672 ip-10-0-135-67 kubenswrapper[2568]: W0603 16:33:48.201987 2568 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jun 03 16:33:48.208672 ip-10-0-135-67 kubenswrapper[2568]: W0603 16:33:48.201990 2568 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jun 03 16:33:48.208672 ip-10-0-135-67 kubenswrapper[2568]: W0603 16:33:48.201992 2568 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jun 03 16:33:48.208672 ip-10-0-135-67 kubenswrapper[2568]: W0603 16:33:48.201995 2568 feature_gate.go:328] unrecognized feature gate: NewOLM Jun 03 16:33:48.208672 ip-10-0-135-67 kubenswrapper[2568]: W0603 16:33:48.201998 2568 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jun 03 16:33:48.208672 ip-10-0-135-67 kubenswrapper[2568]: W0603 16:33:48.202013 2568 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jun 03 16:33:48.208672 ip-10-0-135-67 kubenswrapper[2568]: W0603 16:33:48.202016 2568 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jun 03 16:33:48.208672 ip-10-0-135-67 kubenswrapper[2568]: W0603 16:33:48.202018 2568 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jun 03 16:33:48.209164 ip-10-0-135-67 kubenswrapper[2568]: W0603 16:33:48.202021 2568 feature_gate.go:328] unrecognized feature gate: SetEIPForNLBIngressController Jun 03 16:33:48.209164 ip-10-0-135-67 kubenswrapper[2568]: W0603 16:33:48.202026 2568 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jun 03 16:33:48.209164 ip-10-0-135-67 kubenswrapper[2568]: W0603 16:33:48.202028 2568 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jun 03 16:33:48.209164 ip-10-0-135-67 kubenswrapper[2568]: W0603 16:33:48.202031 2568 feature_gate.go:328] unrecognized feature gate: IngressControllerLBSubnetsAWS Jun 03 16:33:48.209164 ip-10-0-135-67 kubenswrapper[2568]: W0603 16:33:48.202034 2568 feature_gate.go:328] unrecognized feature gate: SignatureStores Jun 03 16:33:48.209164 ip-10-0-135-67 kubenswrapper[2568]: W0603 16:33:48.202037 2568 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jun 03 16:33:48.209164 ip-10-0-135-67 kubenswrapper[2568]: W0603 16:33:48.202040 2568 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jun 03 16:33:48.209164 ip-10-0-135-67 kubenswrapper[2568]: W0603 16:33:48.202042 2568 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jun 03 16:33:48.209164 ip-10-0-135-67 kubenswrapper[2568]: W0603 16:33:48.202045 2568 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jun 03 16:33:48.209164 ip-10-0-135-67 kubenswrapper[2568]: W0603 16:33:48.202048 2568 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jun 03 16:33:48.209164 ip-10-0-135-67 kubenswrapper[2568]: W0603 16:33:48.202051 2568 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jun 03 16:33:48.209164 ip-10-0-135-67 kubenswrapper[2568]: W0603 16:33:48.202053 2568 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jun 03 16:33:48.209164 ip-10-0-135-67 kubenswrapper[2568]: W0603 16:33:48.202056 2568 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jun 03 16:33:48.209164 ip-10-0-135-67 kubenswrapper[2568]: W0603 16:33:48.202059 2568 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jun 03 16:33:48.209164 ip-10-0-135-67 kubenswrapper[2568]: W0603 16:33:48.202062 2568 feature_gate.go:328] unrecognized feature gate: Example Jun 03 16:33:48.209164 ip-10-0-135-67 kubenswrapper[2568]: W0603 16:33:48.202064 2568 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jun 03 16:33:48.209164 ip-10-0-135-67 kubenswrapper[2568]: W0603 16:33:48.202067 2568 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jun 03 16:33:48.209164 ip-10-0-135-67 kubenswrapper[2568]: W0603 16:33:48.202069 2568 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jun 03 16:33:48.209164 ip-10-0-135-67 kubenswrapper[2568]: W0603 16:33:48.202072 2568 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jun 03 16:33:48.209164 ip-10-0-135-67 kubenswrapper[2568]: W0603 16:33:48.202074 2568 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jun 03 16:33:48.209657 ip-10-0-135-67 kubenswrapper[2568]: W0603 16:33:48.202082 2568 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jun 03 16:33:48.209657 ip-10-0-135-67 kubenswrapper[2568]: W0603 16:33:48.202086 2568 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jun 03 16:33:48.209657 ip-10-0-135-67 kubenswrapper[2568]: W0603 16:33:48.202090 2568 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jun 03 16:33:48.209657 ip-10-0-135-67 kubenswrapper[2568]: W0603 16:33:48.202094 2568 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jun 03 16:33:48.209657 ip-10-0-135-67 kubenswrapper[2568]: W0603 16:33:48.202096 2568 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jun 03 16:33:48.209657 ip-10-0-135-67 kubenswrapper[2568]: W0603 16:33:48.202099 2568 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jun 03 16:33:48.209657 ip-10-0-135-67 kubenswrapper[2568]: W0603 16:33:48.202101 2568 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jun 03 16:33:48.209657 ip-10-0-135-67 kubenswrapper[2568]: W0603 16:33:48.202104 2568 feature_gate.go:328] unrecognized feature gate: DualReplica Jun 03 16:33:48.209657 ip-10-0-135-67 kubenswrapper[2568]: W0603 16:33:48.202106 2568 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jun 03 16:33:48.209657 ip-10-0-135-67 kubenswrapper[2568]: W0603 16:33:48.202109 2568 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jun 03 16:33:48.209657 ip-10-0-135-67 kubenswrapper[2568]: W0603 16:33:48.202111 2568 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jun 03 16:33:48.209657 ip-10-0-135-67 kubenswrapper[2568]: W0603 16:33:48.202113 2568 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jun 03 16:33:48.209657 ip-10-0-135-67 kubenswrapper[2568]: W0603 16:33:48.202116 2568 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jun 03 16:33:48.209657 ip-10-0-135-67 kubenswrapper[2568]: W0603 16:33:48.202120 2568 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jun 03 16:33:48.209657 ip-10-0-135-67 kubenswrapper[2568]: W0603 16:33:48.202123 2568 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jun 03 16:33:48.209657 ip-10-0-135-67 kubenswrapper[2568]: W0603 16:33:48.202125 2568 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jun 03 16:33:48.209657 ip-10-0-135-67 kubenswrapper[2568]: W0603 16:33:48.202128 2568 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jun 03 16:33:48.209657 ip-10-0-135-67 kubenswrapper[2568]: W0603 16:33:48.202131 2568 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jun 03 16:33:48.209657 ip-10-0-135-67 kubenswrapper[2568]: W0603 16:33:48.202133 2568 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jun 03 16:33:48.209657 ip-10-0-135-67 kubenswrapper[2568]: W0603 16:33:48.202136 2568 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jun 03 16:33:48.210219 ip-10-0-135-67 kubenswrapper[2568]: W0603 16:33:48.202138 2568 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jun 03 16:33:48.210219 ip-10-0-135-67 kubenswrapper[2568]: W0603 16:33:48.202141 2568 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jun 03 16:33:48.210219 ip-10-0-135-67 kubenswrapper[2568]: W0603 16:33:48.202143 2568 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jun 03 16:33:48.210219 ip-10-0-135-67 kubenswrapper[2568]: W0603 16:33:48.202146 2568 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jun 03 16:33:48.210219 ip-10-0-135-67 kubenswrapper[2568]: W0603 16:33:48.202148 2568 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jun 03 16:33:48.210219 ip-10-0-135-67 kubenswrapper[2568]: W0603 16:33:48.202151 2568 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jun 03 16:33:48.210219 ip-10-0-135-67 kubenswrapper[2568]: W0603 16:33:48.202153 2568 feature_gate.go:328] unrecognized feature gate: Example2 Jun 03 16:33:48.210219 ip-10-0-135-67 kubenswrapper[2568]: W0603 16:33:48.202156 2568 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jun 03 16:33:48.210219 ip-10-0-135-67 kubenswrapper[2568]: W0603 16:33:48.202159 2568 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jun 03 16:33:48.210219 ip-10-0-135-67 kubenswrapper[2568]: W0603 16:33:48.202161 2568 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jun 03 16:33:48.210219 ip-10-0-135-67 kubenswrapper[2568]: W0603 16:33:48.202164 2568 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jun 03 16:33:48.210219 ip-10-0-135-67 kubenswrapper[2568]: W0603 16:33:48.202167 2568 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jun 03 16:33:48.210219 ip-10-0-135-67 kubenswrapper[2568]: W0603 16:33:48.202170 2568 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jun 03 16:33:48.210219 ip-10-0-135-67 kubenswrapper[2568]: W0603 16:33:48.202173 2568 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jun 03 16:33:48.210219 ip-10-0-135-67 kubenswrapper[2568]: W0603 16:33:48.202175 2568 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jun 03 16:33:48.210219 ip-10-0-135-67 kubenswrapper[2568]: W0603 16:33:48.202178 2568 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jun 03 16:33:48.210219 ip-10-0-135-67 kubenswrapper[2568]: W0603 16:33:48.202181 2568 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jun 03 16:33:48.210219 ip-10-0-135-67 kubenswrapper[2568]: W0603 16:33:48.202184 2568 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jun 03 16:33:48.210219 ip-10-0-135-67 kubenswrapper[2568]: W0603 16:33:48.202186 2568 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jun 03 16:33:48.210219 ip-10-0-135-67 kubenswrapper[2568]: W0603 16:33:48.202189 2568 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jun 03 16:33:48.210701 ip-10-0-135-67 kubenswrapper[2568]: I0603 16:33:48.203055 2568 feature_gate.go:384] feature gates: {map[DynamicResourceAllocation:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutatingAdmissionPolicy:false NodeSwap:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:false]} Jun 03 16:33:48.211129 ip-10-0-135-67 kubenswrapper[2568]: I0603 16:33:48.211110 2568 server.go:530] "Kubelet version" kubeletVersion="v1.33.12" Jun 03 16:33:48.211158 ip-10-0-135-67 kubenswrapper[2568]: I0603 16:33:48.211129 2568 server.go:532] "Golang settings" GOGC="" GOMAXPROCS="" GOTRACEBACK="" Jun 03 16:33:48.211196 ip-10-0-135-67 kubenswrapper[2568]: W0603 16:33:48.211177 2568 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jun 03 16:33:48.211196 ip-10-0-135-67 kubenswrapper[2568]: W0603 16:33:48.211195 2568 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jun 03 16:33:48.211255 ip-10-0-135-67 kubenswrapper[2568]: W0603 16:33:48.211200 2568 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jun 03 16:33:48.211255 ip-10-0-135-67 kubenswrapper[2568]: W0603 16:33:48.211206 2568 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jun 03 16:33:48.211255 ip-10-0-135-67 kubenswrapper[2568]: W0603 16:33:48.211209 2568 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jun 03 16:33:48.211255 ip-10-0-135-67 kubenswrapper[2568]: W0603 16:33:48.211212 2568 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jun 03 16:33:48.211255 ip-10-0-135-67 kubenswrapper[2568]: W0603 16:33:48.211215 2568 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jun 03 16:33:48.211255 ip-10-0-135-67 kubenswrapper[2568]: W0603 16:33:48.211217 2568 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jun 03 16:33:48.211255 ip-10-0-135-67 kubenswrapper[2568]: W0603 16:33:48.211220 2568 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jun 03 16:33:48.211255 ip-10-0-135-67 kubenswrapper[2568]: W0603 16:33:48.211223 2568 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jun 03 16:33:48.211255 ip-10-0-135-67 kubenswrapper[2568]: W0603 16:33:48.211226 2568 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jun 03 16:33:48.211255 ip-10-0-135-67 kubenswrapper[2568]: W0603 16:33:48.211229 2568 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jun 03 16:33:48.211255 ip-10-0-135-67 kubenswrapper[2568]: W0603 16:33:48.211232 2568 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterOperations Jun 03 16:33:48.211255 ip-10-0-135-67 kubenswrapper[2568]: W0603 16:33:48.211234 2568 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jun 03 16:33:48.211255 ip-10-0-135-67 kubenswrapper[2568]: W0603 16:33:48.211237 2568 feature_gate.go:328] unrecognized feature gate: Example Jun 03 16:33:48.211255 ip-10-0-135-67 kubenswrapper[2568]: W0603 16:33:48.211239 2568 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jun 03 16:33:48.211255 ip-10-0-135-67 kubenswrapper[2568]: W0603 16:33:48.211242 2568 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jun 03 16:33:48.211255 ip-10-0-135-67 kubenswrapper[2568]: W0603 16:33:48.211244 2568 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jun 03 16:33:48.211255 ip-10-0-135-67 kubenswrapper[2568]: W0603 16:33:48.211247 2568 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jun 03 16:33:48.211255 ip-10-0-135-67 kubenswrapper[2568]: W0603 16:33:48.211249 2568 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jun 03 16:33:48.211255 ip-10-0-135-67 kubenswrapper[2568]: W0603 16:33:48.211252 2568 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jun 03 16:33:48.211723 ip-10-0-135-67 kubenswrapper[2568]: W0603 16:33:48.211254 2568 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jun 03 16:33:48.211723 ip-10-0-135-67 kubenswrapper[2568]: W0603 16:33:48.211257 2568 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jun 03 16:33:48.211723 ip-10-0-135-67 kubenswrapper[2568]: W0603 16:33:48.211260 2568 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jun 03 16:33:48.211723 ip-10-0-135-67 kubenswrapper[2568]: W0603 16:33:48.211263 2568 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jun 03 16:33:48.211723 ip-10-0-135-67 kubenswrapper[2568]: W0603 16:33:48.211266 2568 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jun 03 16:33:48.211723 ip-10-0-135-67 kubenswrapper[2568]: W0603 16:33:48.211269 2568 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jun 03 16:33:48.211723 ip-10-0-135-67 kubenswrapper[2568]: W0603 16:33:48.211272 2568 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jun 03 16:33:48.211723 ip-10-0-135-67 kubenswrapper[2568]: W0603 16:33:48.211274 2568 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jun 03 16:33:48.211723 ip-10-0-135-67 kubenswrapper[2568]: W0603 16:33:48.211277 2568 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jun 03 16:33:48.211723 ip-10-0-135-67 kubenswrapper[2568]: W0603 16:33:48.211279 2568 feature_gate.go:328] unrecognized feature gate: Example2 Jun 03 16:33:48.211723 ip-10-0-135-67 kubenswrapper[2568]: W0603 16:33:48.211282 2568 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jun 03 16:33:48.211723 ip-10-0-135-67 kubenswrapper[2568]: W0603 16:33:48.211284 2568 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jun 03 16:33:48.211723 ip-10-0-135-67 kubenswrapper[2568]: W0603 16:33:48.211287 2568 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jun 03 16:33:48.211723 ip-10-0-135-67 kubenswrapper[2568]: W0603 16:33:48.211289 2568 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jun 03 16:33:48.211723 ip-10-0-135-67 kubenswrapper[2568]: W0603 16:33:48.211292 2568 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jun 03 16:33:48.211723 ip-10-0-135-67 kubenswrapper[2568]: W0603 16:33:48.211294 2568 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jun 03 16:33:48.211723 ip-10-0-135-67 kubenswrapper[2568]: W0603 16:33:48.211296 2568 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jun 03 16:33:48.211723 ip-10-0-135-67 kubenswrapper[2568]: W0603 16:33:48.211299 2568 feature_gate.go:328] unrecognized feature gate: NewOLM Jun 03 16:33:48.211723 ip-10-0-135-67 kubenswrapper[2568]: W0603 16:33:48.211301 2568 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jun 03 16:33:48.211723 ip-10-0-135-67 kubenswrapper[2568]: W0603 16:33:48.211304 2568 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jun 03 16:33:48.212282 ip-10-0-135-67 kubenswrapper[2568]: W0603 16:33:48.211307 2568 feature_gate.go:328] unrecognized feature gate: InsightsConfigAPI Jun 03 16:33:48.212282 ip-10-0-135-67 kubenswrapper[2568]: W0603 16:33:48.211309 2568 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jun 03 16:33:48.212282 ip-10-0-135-67 kubenswrapper[2568]: W0603 16:33:48.211311 2568 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jun 03 16:33:48.212282 ip-10-0-135-67 kubenswrapper[2568]: W0603 16:33:48.211314 2568 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jun 03 16:33:48.212282 ip-10-0-135-67 kubenswrapper[2568]: W0603 16:33:48.211316 2568 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jun 03 16:33:48.212282 ip-10-0-135-67 kubenswrapper[2568]: W0603 16:33:48.211319 2568 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jun 03 16:33:48.212282 ip-10-0-135-67 kubenswrapper[2568]: W0603 16:33:48.211321 2568 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jun 03 16:33:48.212282 ip-10-0-135-67 kubenswrapper[2568]: W0603 16:33:48.211323 2568 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jun 03 16:33:48.212282 ip-10-0-135-67 kubenswrapper[2568]: W0603 16:33:48.211326 2568 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jun 03 16:33:48.212282 ip-10-0-135-67 kubenswrapper[2568]: W0603 16:33:48.211329 2568 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jun 03 16:33:48.212282 ip-10-0-135-67 kubenswrapper[2568]: W0603 16:33:48.211332 2568 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jun 03 16:33:48.212282 ip-10-0-135-67 kubenswrapper[2568]: W0603 16:33:48.211336 2568 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jun 03 16:33:48.212282 ip-10-0-135-67 kubenswrapper[2568]: W0603 16:33:48.211339 2568 feature_gate.go:328] unrecognized feature gate: SetEIPForNLBIngressController Jun 03 16:33:48.212282 ip-10-0-135-67 kubenswrapper[2568]: W0603 16:33:48.211342 2568 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jun 03 16:33:48.212282 ip-10-0-135-67 kubenswrapper[2568]: W0603 16:33:48.211345 2568 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jun 03 16:33:48.212282 ip-10-0-135-67 kubenswrapper[2568]: W0603 16:33:48.211347 2568 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jun 03 16:33:48.212282 ip-10-0-135-67 kubenswrapper[2568]: W0603 16:33:48.211350 2568 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jun 03 16:33:48.212282 ip-10-0-135-67 kubenswrapper[2568]: W0603 16:33:48.211353 2568 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jun 03 16:33:48.212282 ip-10-0-135-67 kubenswrapper[2568]: W0603 16:33:48.211355 2568 feature_gate.go:328] unrecognized feature gate: PinnedImages Jun 03 16:33:48.212746 ip-10-0-135-67 kubenswrapper[2568]: W0603 16:33:48.211358 2568 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jun 03 16:33:48.212746 ip-10-0-135-67 kubenswrapper[2568]: W0603 16:33:48.211361 2568 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jun 03 16:33:48.212746 ip-10-0-135-67 kubenswrapper[2568]: W0603 16:33:48.211363 2568 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jun 03 16:33:48.212746 ip-10-0-135-67 kubenswrapper[2568]: W0603 16:33:48.211365 2568 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jun 03 16:33:48.212746 ip-10-0-135-67 kubenswrapper[2568]: W0603 16:33:48.211368 2568 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jun 03 16:33:48.212746 ip-10-0-135-67 kubenswrapper[2568]: W0603 16:33:48.211370 2568 feature_gate.go:328] unrecognized feature gate: DualReplica Jun 03 16:33:48.212746 ip-10-0-135-67 kubenswrapper[2568]: W0603 16:33:48.211373 2568 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jun 03 16:33:48.212746 ip-10-0-135-67 kubenswrapper[2568]: W0603 16:33:48.211376 2568 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jun 03 16:33:48.212746 ip-10-0-135-67 kubenswrapper[2568]: W0603 16:33:48.211378 2568 feature_gate.go:328] unrecognized feature gate: SignatureStores Jun 03 16:33:48.212746 ip-10-0-135-67 kubenswrapper[2568]: W0603 16:33:48.211381 2568 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jun 03 16:33:48.212746 ip-10-0-135-67 kubenswrapper[2568]: W0603 16:33:48.211384 2568 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jun 03 16:33:48.212746 ip-10-0-135-67 kubenswrapper[2568]: W0603 16:33:48.211386 2568 feature_gate.go:328] unrecognized feature gate: IngressControllerLBSubnetsAWS Jun 03 16:33:48.212746 ip-10-0-135-67 kubenswrapper[2568]: W0603 16:33:48.211389 2568 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jun 03 16:33:48.212746 ip-10-0-135-67 kubenswrapper[2568]: W0603 16:33:48.211392 2568 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jun 03 16:33:48.212746 ip-10-0-135-67 kubenswrapper[2568]: W0603 16:33:48.211394 2568 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jun 03 16:33:48.212746 ip-10-0-135-67 kubenswrapper[2568]: W0603 16:33:48.211397 2568 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jun 03 16:33:48.212746 ip-10-0-135-67 kubenswrapper[2568]: W0603 16:33:48.211399 2568 feature_gate.go:328] unrecognized feature gate: OVNObservability Jun 03 16:33:48.212746 ip-10-0-135-67 kubenswrapper[2568]: W0603 16:33:48.211402 2568 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jun 03 16:33:48.212746 ip-10-0-135-67 kubenswrapper[2568]: W0603 16:33:48.211405 2568 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jun 03 16:33:48.212746 ip-10-0-135-67 kubenswrapper[2568]: W0603 16:33:48.211407 2568 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jun 03 16:33:48.213240 ip-10-0-135-67 kubenswrapper[2568]: W0603 16:33:48.211410 2568 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jun 03 16:33:48.213240 ip-10-0-135-67 kubenswrapper[2568]: W0603 16:33:48.211413 2568 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jun 03 16:33:48.213240 ip-10-0-135-67 kubenswrapper[2568]: W0603 16:33:48.211415 2568 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jun 03 16:33:48.213240 ip-10-0-135-67 kubenswrapper[2568]: W0603 16:33:48.211418 2568 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jun 03 16:33:48.213240 ip-10-0-135-67 kubenswrapper[2568]: W0603 16:33:48.211421 2568 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jun 03 16:33:48.213240 ip-10-0-135-67 kubenswrapper[2568]: W0603 16:33:48.211423 2568 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jun 03 16:33:48.213240 ip-10-0-135-67 kubenswrapper[2568]: I0603 16:33:48.211429 2568 feature_gate.go:384] feature gates: {map[DynamicResourceAllocation:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutatingAdmissionPolicy:false NodeSwap:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:false]} Jun 03 16:33:48.213240 ip-10-0-135-67 kubenswrapper[2568]: W0603 16:33:48.211519 2568 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jun 03 16:33:48.213240 ip-10-0-135-67 kubenswrapper[2568]: W0603 16:33:48.211523 2568 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jun 03 16:33:48.213240 ip-10-0-135-67 kubenswrapper[2568]: W0603 16:33:48.211526 2568 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jun 03 16:33:48.213240 ip-10-0-135-67 kubenswrapper[2568]: W0603 16:33:48.211530 2568 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jun 03 16:33:48.213240 ip-10-0-135-67 kubenswrapper[2568]: W0603 16:33:48.211533 2568 feature_gate.go:328] unrecognized feature gate: PinnedImages Jun 03 16:33:48.213240 ip-10-0-135-67 kubenswrapper[2568]: W0603 16:33:48.211536 2568 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jun 03 16:33:48.213240 ip-10-0-135-67 kubenswrapper[2568]: W0603 16:33:48.211538 2568 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jun 03 16:33:48.213240 ip-10-0-135-67 kubenswrapper[2568]: W0603 16:33:48.211541 2568 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jun 03 16:33:48.213607 ip-10-0-135-67 kubenswrapper[2568]: W0603 16:33:48.211543 2568 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jun 03 16:33:48.213607 ip-10-0-135-67 kubenswrapper[2568]: W0603 16:33:48.211546 2568 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jun 03 16:33:48.213607 ip-10-0-135-67 kubenswrapper[2568]: W0603 16:33:48.211548 2568 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jun 03 16:33:48.213607 ip-10-0-135-67 kubenswrapper[2568]: W0603 16:33:48.211552 2568 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jun 03 16:33:48.213607 ip-10-0-135-67 kubenswrapper[2568]: W0603 16:33:48.211555 2568 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jun 03 16:33:48.213607 ip-10-0-135-67 kubenswrapper[2568]: W0603 16:33:48.211557 2568 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jun 03 16:33:48.213607 ip-10-0-135-67 kubenswrapper[2568]: W0603 16:33:48.211560 2568 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jun 03 16:33:48.213607 ip-10-0-135-67 kubenswrapper[2568]: W0603 16:33:48.211563 2568 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jun 03 16:33:48.213607 ip-10-0-135-67 kubenswrapper[2568]: W0603 16:33:48.211565 2568 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jun 03 16:33:48.213607 ip-10-0-135-67 kubenswrapper[2568]: W0603 16:33:48.211568 2568 feature_gate.go:328] unrecognized feature gate: SetEIPForNLBIngressController Jun 03 16:33:48.213607 ip-10-0-135-67 kubenswrapper[2568]: W0603 16:33:48.211570 2568 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jun 03 16:33:48.213607 ip-10-0-135-67 kubenswrapper[2568]: W0603 16:33:48.211573 2568 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jun 03 16:33:48.213607 ip-10-0-135-67 kubenswrapper[2568]: W0603 16:33:48.211575 2568 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jun 03 16:33:48.213607 ip-10-0-135-67 kubenswrapper[2568]: W0603 16:33:48.211578 2568 feature_gate.go:328] unrecognized feature gate: Example Jun 03 16:33:48.213607 ip-10-0-135-67 kubenswrapper[2568]: W0603 16:33:48.211580 2568 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jun 03 16:33:48.213607 ip-10-0-135-67 kubenswrapper[2568]: W0603 16:33:48.211583 2568 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jun 03 16:33:48.213607 ip-10-0-135-67 kubenswrapper[2568]: W0603 16:33:48.211585 2568 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jun 03 16:33:48.213607 ip-10-0-135-67 kubenswrapper[2568]: W0603 16:33:48.211588 2568 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jun 03 16:33:48.213607 ip-10-0-135-67 kubenswrapper[2568]: W0603 16:33:48.211591 2568 feature_gate.go:328] unrecognized feature gate: InsightsConfigAPI Jun 03 16:33:48.213607 ip-10-0-135-67 kubenswrapper[2568]: W0603 16:33:48.211593 2568 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jun 03 16:33:48.214157 ip-10-0-135-67 kubenswrapper[2568]: W0603 16:33:48.211596 2568 feature_gate.go:328] unrecognized feature gate: NewOLM Jun 03 16:33:48.214157 ip-10-0-135-67 kubenswrapper[2568]: W0603 16:33:48.211598 2568 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jun 03 16:33:48.214157 ip-10-0-135-67 kubenswrapper[2568]: W0603 16:33:48.211601 2568 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jun 03 16:33:48.214157 ip-10-0-135-67 kubenswrapper[2568]: W0603 16:33:48.211604 2568 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jun 03 16:33:48.214157 ip-10-0-135-67 kubenswrapper[2568]: W0603 16:33:48.211606 2568 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterOperations Jun 03 16:33:48.214157 ip-10-0-135-67 kubenswrapper[2568]: W0603 16:33:48.211609 2568 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jun 03 16:33:48.214157 ip-10-0-135-67 kubenswrapper[2568]: W0603 16:33:48.211611 2568 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jun 03 16:33:48.214157 ip-10-0-135-67 kubenswrapper[2568]: W0603 16:33:48.211614 2568 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jun 03 16:33:48.214157 ip-10-0-135-67 kubenswrapper[2568]: W0603 16:33:48.211616 2568 feature_gate.go:328] unrecognized feature gate: SignatureStores Jun 03 16:33:48.214157 ip-10-0-135-67 kubenswrapper[2568]: W0603 16:33:48.211619 2568 feature_gate.go:328] unrecognized feature gate: OVNObservability Jun 03 16:33:48.214157 ip-10-0-135-67 kubenswrapper[2568]: W0603 16:33:48.211622 2568 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jun 03 16:33:48.214157 ip-10-0-135-67 kubenswrapper[2568]: W0603 16:33:48.211624 2568 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jun 03 16:33:48.214157 ip-10-0-135-67 kubenswrapper[2568]: W0603 16:33:48.211627 2568 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jun 03 16:33:48.214157 ip-10-0-135-67 kubenswrapper[2568]: W0603 16:33:48.211629 2568 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jun 03 16:33:48.214157 ip-10-0-135-67 kubenswrapper[2568]: W0603 16:33:48.211632 2568 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jun 03 16:33:48.214157 ip-10-0-135-67 kubenswrapper[2568]: W0603 16:33:48.211634 2568 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jun 03 16:33:48.214157 ip-10-0-135-67 kubenswrapper[2568]: W0603 16:33:48.211637 2568 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jun 03 16:33:48.214157 ip-10-0-135-67 kubenswrapper[2568]: W0603 16:33:48.211639 2568 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jun 03 16:33:48.214157 ip-10-0-135-67 kubenswrapper[2568]: W0603 16:33:48.211641 2568 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jun 03 16:33:48.214157 ip-10-0-135-67 kubenswrapper[2568]: W0603 16:33:48.211644 2568 feature_gate.go:328] unrecognized feature gate: DualReplica Jun 03 16:33:48.214644 ip-10-0-135-67 kubenswrapper[2568]: W0603 16:33:48.211647 2568 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jun 03 16:33:48.214644 ip-10-0-135-67 kubenswrapper[2568]: W0603 16:33:48.211649 2568 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jun 03 16:33:48.214644 ip-10-0-135-67 kubenswrapper[2568]: W0603 16:33:48.211651 2568 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jun 03 16:33:48.214644 ip-10-0-135-67 kubenswrapper[2568]: W0603 16:33:48.211654 2568 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jun 03 16:33:48.214644 ip-10-0-135-67 kubenswrapper[2568]: W0603 16:33:48.211657 2568 feature_gate.go:328] unrecognized feature gate: IngressControllerLBSubnetsAWS Jun 03 16:33:48.214644 ip-10-0-135-67 kubenswrapper[2568]: W0603 16:33:48.211660 2568 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jun 03 16:33:48.214644 ip-10-0-135-67 kubenswrapper[2568]: W0603 16:33:48.211664 2568 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jun 03 16:33:48.214644 ip-10-0-135-67 kubenswrapper[2568]: W0603 16:33:48.211667 2568 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jun 03 16:33:48.214644 ip-10-0-135-67 kubenswrapper[2568]: W0603 16:33:48.211670 2568 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jun 03 16:33:48.214644 ip-10-0-135-67 kubenswrapper[2568]: W0603 16:33:48.211673 2568 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jun 03 16:33:48.214644 ip-10-0-135-67 kubenswrapper[2568]: W0603 16:33:48.211675 2568 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jun 03 16:33:48.214644 ip-10-0-135-67 kubenswrapper[2568]: W0603 16:33:48.211678 2568 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jun 03 16:33:48.214644 ip-10-0-135-67 kubenswrapper[2568]: W0603 16:33:48.211680 2568 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jun 03 16:33:48.214644 ip-10-0-135-67 kubenswrapper[2568]: W0603 16:33:48.211683 2568 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jun 03 16:33:48.214644 ip-10-0-135-67 kubenswrapper[2568]: W0603 16:33:48.211685 2568 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jun 03 16:33:48.214644 ip-10-0-135-67 kubenswrapper[2568]: W0603 16:33:48.211688 2568 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jun 03 16:33:48.214644 ip-10-0-135-67 kubenswrapper[2568]: W0603 16:33:48.211690 2568 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jun 03 16:33:48.214644 ip-10-0-135-67 kubenswrapper[2568]: W0603 16:33:48.211693 2568 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jun 03 16:33:48.214644 ip-10-0-135-67 kubenswrapper[2568]: W0603 16:33:48.211695 2568 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jun 03 16:33:48.215113 ip-10-0-135-67 kubenswrapper[2568]: W0603 16:33:48.211698 2568 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jun 03 16:33:48.215113 ip-10-0-135-67 kubenswrapper[2568]: W0603 16:33:48.211700 2568 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jun 03 16:33:48.215113 ip-10-0-135-67 kubenswrapper[2568]: W0603 16:33:48.211703 2568 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jun 03 16:33:48.215113 ip-10-0-135-67 kubenswrapper[2568]: W0603 16:33:48.211705 2568 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jun 03 16:33:48.215113 ip-10-0-135-67 kubenswrapper[2568]: W0603 16:33:48.211708 2568 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jun 03 16:33:48.215113 ip-10-0-135-67 kubenswrapper[2568]: W0603 16:33:48.211710 2568 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jun 03 16:33:48.215113 ip-10-0-135-67 kubenswrapper[2568]: W0603 16:33:48.211713 2568 feature_gate.go:328] unrecognized feature gate: Example2 Jun 03 16:33:48.215113 ip-10-0-135-67 kubenswrapper[2568]: W0603 16:33:48.211715 2568 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jun 03 16:33:48.215113 ip-10-0-135-67 kubenswrapper[2568]: W0603 16:33:48.211718 2568 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jun 03 16:33:48.215113 ip-10-0-135-67 kubenswrapper[2568]: W0603 16:33:48.211720 2568 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jun 03 16:33:48.215113 ip-10-0-135-67 kubenswrapper[2568]: W0603 16:33:48.211722 2568 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jun 03 16:33:48.215113 ip-10-0-135-67 kubenswrapper[2568]: W0603 16:33:48.211725 2568 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jun 03 16:33:48.215113 ip-10-0-135-67 kubenswrapper[2568]: W0603 16:33:48.211727 2568 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jun 03 16:33:48.215113 ip-10-0-135-67 kubenswrapper[2568]: W0603 16:33:48.211730 2568 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jun 03 16:33:48.215113 ip-10-0-135-67 kubenswrapper[2568]: W0603 16:33:48.211733 2568 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jun 03 16:33:48.215113 ip-10-0-135-67 kubenswrapper[2568]: W0603 16:33:48.211735 2568 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jun 03 16:33:48.215113 ip-10-0-135-67 kubenswrapper[2568]: W0603 16:33:48.211738 2568 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jun 03 16:33:48.215113 ip-10-0-135-67 kubenswrapper[2568]: W0603 16:33:48.211741 2568 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jun 03 16:33:48.215113 ip-10-0-135-67 kubenswrapper[2568]: W0603 16:33:48.211743 2568 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jun 03 16:33:48.215613 ip-10-0-135-67 kubenswrapper[2568]: I0603 16:33:48.211748 2568 feature_gate.go:384] feature gates: {map[DynamicResourceAllocation:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutatingAdmissionPolicy:false NodeSwap:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:false]} Jun 03 16:33:48.215613 ip-10-0-135-67 kubenswrapper[2568]: I0603 16:33:48.213367 2568 server.go:962] "Client rotation is on, will bootstrap in background" Jun 03 16:33:48.216813 ip-10-0-135-67 kubenswrapper[2568]: I0603 16:33:48.216800 2568 bootstrap.go:101] "Use the bootstrap credentials to request a cert, and set kubeconfig to point to the certificate dir" Jun 03 16:33:48.217757 ip-10-0-135-67 kubenswrapper[2568]: I0603 16:33:48.217746 2568 server.go:1019] "Starting client certificate rotation" Jun 03 16:33:48.217862 ip-10-0-135-67 kubenswrapper[2568]: I0603 16:33:48.217847 2568 certificate_manager.go:422] "Certificate rotation is enabled" logger="kubernetes.io/kube-apiserver-client-kubelet" Jun 03 16:33:48.217895 ip-10-0-135-67 kubenswrapper[2568]: I0603 16:33:48.217886 2568 certificate_manager.go:566] "Rotating certificates" logger="kubernetes.io/kube-apiserver-client-kubelet" Jun 03 16:33:48.243894 ip-10-0-135-67 kubenswrapper[2568]: I0603 16:33:48.243877 2568 dynamic_cafile_content.go:123] "Loaded a new CA Bundle and Verifier" name="client-ca-bundle::/etc/kubernetes/kubelet-ca.crt" Jun 03 16:33:48.245780 ip-10-0-135-67 kubenswrapper[2568]: I0603 16:33:48.245761 2568 dynamic_cafile_content.go:161] "Starting controller" name="client-ca-bundle::/etc/kubernetes/kubelet-ca.crt" Jun 03 16:33:48.258504 ip-10-0-135-67 kubenswrapper[2568]: I0603 16:33:48.258481 2568 log.go:25] "Validated CRI v1 runtime API" Jun 03 16:33:48.263935 ip-10-0-135-67 kubenswrapper[2568]: I0603 16:33:48.263916 2568 log.go:25] "Validated CRI v1 image API" Jun 03 16:33:48.265666 ip-10-0-135-67 kubenswrapper[2568]: I0603 16:33:48.265653 2568 server.go:1452] "Using cgroup driver setting received from the CRI runtime" cgroupDriver="systemd" Jun 03 16:33:48.269796 ip-10-0-135-67 kubenswrapper[2568]: I0603 16:33:48.269774 2568 fs.go:135] Filesystem UUIDs: map[26e1633f-9176-4119-afe8-6e4ac37d2a3b:/dev/nvme0n1p3 7B77-95E7:/dev/nvme0n1p2 7f85a4c9-678a-4c03-8fb1-11e952486fba:/dev/nvme0n1p4] Jun 03 16:33:48.269858 ip-10-0-135-67 kubenswrapper[2568]: I0603 16:33:48.269792 2568 fs.go:136] Filesystem partitions: map[/dev/nvme0n1p3:{mountpoint:/boot major:259 minor:3 fsType:ext4 blockSize:0} /dev/nvme0n1p4:{mountpoint:/var major:259 minor:4 fsType:xfs blockSize:0} /dev/shm:{mountpoint:/dev/shm major:0 minor:22 fsType:tmpfs blockSize:0} /run:{mountpoint:/run major:0 minor:24 fsType:tmpfs blockSize:0} /tmp:{mountpoint:/tmp major:0 minor:31 fsType:tmpfs blockSize:0} composefs_0-33:{mountpoint:/ major:0 minor:33 fsType:overlay blockSize:0}] Jun 03 16:33:48.272930 ip-10-0-135-67 kubenswrapper[2568]: I0603 16:33:48.272913 2568 reflector.go:430] "Caches populated" logger="kubernetes.io/kube-apiserver-client-kubelet" type="*v1.CertificateSigningRequest" reflector="k8s.io/client-go/tools/watch/informerwatcher.go:162" Jun 03 16:33:48.273998 ip-10-0-135-67 kubenswrapper[2568]: I0603 16:33:48.273895 2568 manager.go:217] Machine: {Timestamp:2026-06-03 16:33:48.273390793 +0000 UTC m=+0.415565438 CPUVendorID:GenuineIntel NumCores:8 NumPhysicalCores:4 NumSockets:1 CpuFrequency:3099653 MemoryCapacity:33164496896 SwapCapacity:0 MemoryByType:map[] NVMInfo:{MemoryModeCapacity:0 AppDirectModeCapacity:0 AvgPowerBudget:0} HugePages:[{PageSize:1048576 NumPages:0} {PageSize:2048 NumPages:0}] MachineID:ec25c316e5e5dc99137c1c846b7dd4e6 SystemUUID:ec25c316-e5e5-dc99-137c-1c846b7dd4e6 BootID:d3849150-945c-48d9-8fc8-cd8ded771c7f Filesystems:[{Device:/dev/nvme0n1p3 DeviceMajor:259 DeviceMinor:3 Capacity:366869504 Type:vfs Inodes:98304 HasInodes:true} {Device:/dev/shm DeviceMajor:0 DeviceMinor:22 Capacity:16582246400 Type:vfs Inodes:4048400 HasInodes:true} {Device:/run DeviceMajor:0 DeviceMinor:24 Capacity:6632902656 Type:vfs Inodes:819200 HasInodes:true} {Device:/dev/nvme0n1p4 DeviceMajor:259 DeviceMinor:4 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:composefs_0-33 DeviceMajor:0 DeviceMinor:33 Capacity:6103040 Type:vfs Inodes:18446744073709551615 HasInodes:true} {Device:/tmp DeviceMajor:0 DeviceMinor:31 Capacity:16582250496 Type:vfs Inodes:1048576 HasInodes:true}] DiskMap:map[259:0:{Name:nvme0n1 Major:259 Minor:0 Size:128849018880 Scheduler:none}] NetworkDevices:[{Name:br-ex MacAddress:02:9e:39:ef:62:ad Speed:0 Mtu:9001} {Name:ens5 MacAddress:02:9e:39:ef:62:ad Speed:0 Mtu:9001} {Name:ovs-system MacAddress:0a:83:78:9d:b7:22 Speed:0 Mtu:1500}] Topology:[{Id:0 Memory:33164496896 HugePages:[{PageSize:1048576 NumPages:0} {PageSize:2048 NumPages:0}] Cores:[{Id:0 Threads:[0 4] Caches:[{Id:0 Size:32768 Type:Data Level:1} {Id:0 Size:32768 Type:Instruction Level:1} {Id:0 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:1 Threads:[1 5] Caches:[{Id:1 Size:32768 Type:Data Level:1} {Id:1 Size:32768 Type:Instruction Level:1} {Id:1 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:2 Threads:[2 6] Caches:[{Id:2 Size:32768 Type:Data Level:1} {Id:2 Size:32768 Type:Instruction Level:1} {Id:2 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:3 Threads:[3 7] Caches:[{Id:3 Size:32768 Type:Data Level:1} {Id:3 Size:32768 Type:Instruction Level:1} {Id:3 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:}] Caches:[{Id:0 Size:37486592 Type:Unified Level:3}] Distances:[10]}] CloudProvider:Unknown InstanceType:Unknown InstanceID:None} Jun 03 16:33:48.273998 ip-10-0-135-67 kubenswrapper[2568]: I0603 16:33:48.273993 2568 manager_no_libpfm.go:29] cAdvisor is build without cgo and/or libpfm support. Perf event counters are not available. Jun 03 16:33:48.274170 ip-10-0-135-67 kubenswrapper[2568]: I0603 16:33:48.274071 2568 manager.go:233] Version: {KernelVersion:5.14.0-570.117.1.el9_6.x86_64 ContainerOsVersion:Red Hat Enterprise Linux CoreOS 9.6.20260521-1 (Plow) DockerVersion: DockerAPIVersion: CadvisorVersion: CadvisorRevision:} Jun 03 16:33:48.275914 ip-10-0-135-67 kubenswrapper[2568]: I0603 16:33:48.275889 2568 container_manager_linux.go:270] "Container manager verified user specified cgroup-root exists" cgroupRoot=[] Jun 03 16:33:48.276052 ip-10-0-135-67 kubenswrapper[2568]: I0603 16:33:48.275916 2568 container_manager_linux.go:275] "Creating Container Manager object based on Node Config" nodeConfig={"NodeName":"ip-10-0-135-67.ec2.internal","RuntimeCgroupsName":"/system.slice/crio.service","SystemCgroupsName":"/system.slice","KubeletCgroupsName":"","KubeletOOMScoreAdj":-999,"ContainerRuntime":"","CgroupsPerQOS":true,"CgroupRoot":"/","CgroupDriver":"systemd","KubeletRootDir":"/var/lib/kubelet","ProtectKernelDefaults":true,"KubeReservedCgroupName":"","SystemReservedCgroupName":"","ReservedSystemCPUs":{},"EnforceNodeAllocatable":{"pods":{}},"KubeReserved":null,"SystemReserved":{"cpu":"500m","ephemeral-storage":"1Gi","memory":"1Gi"},"HardEvictionThresholds":[{"Signal":"nodefs.inodesFree","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.05},"GracePeriod":0,"MinReclaim":null},{"Signal":"imagefs.available","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.15},"GracePeriod":0,"MinReclaim":null},{"Signal":"imagefs.inodesFree","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.05},"GracePeriod":0,"MinReclaim":null},{"Signal":"memory.available","Operator":"LessThan","Value":{"Quantity":"100Mi","Percentage":0},"GracePeriod":0,"MinReclaim":null},{"Signal":"nodefs.available","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.1},"GracePeriod":0,"MinReclaim":null}],"QOSReserved":{},"CPUManagerPolicy":"none","CPUManagerPolicyOptions":null,"TopologyManagerScope":"container","CPUManagerReconcilePeriod":10000000000,"MemoryManagerPolicy":"None","MemoryManagerReservedMemory":null,"PodPidsLimit":4096,"EnforceCPULimits":true,"CPUCFSQuotaPeriod":100000000,"TopologyManagerPolicy":"none","TopologyManagerPolicyOptions":null,"CgroupVersion":2} Jun 03 16:33:48.276101 ip-10-0-135-67 kubenswrapper[2568]: I0603 16:33:48.276062 2568 topology_manager.go:138] "Creating topology manager with none policy" Jun 03 16:33:48.276101 ip-10-0-135-67 kubenswrapper[2568]: I0603 16:33:48.276070 2568 container_manager_linux.go:306] "Creating device plugin manager" Jun 03 16:33:48.276101 ip-10-0-135-67 kubenswrapper[2568]: I0603 16:33:48.276077 2568 manager.go:141] "Creating Device Plugin manager" path="/var/lib/kubelet/device-plugins/kubelet.sock" Jun 03 16:33:48.276101 ip-10-0-135-67 kubenswrapper[2568]: I0603 16:33:48.276094 2568 server.go:72] "Creating device plugin registration server" version="v1beta1" socket="/var/lib/kubelet/device-plugins/kubelet.sock" Jun 03 16:33:48.277743 ip-10-0-135-67 kubenswrapper[2568]: I0603 16:33:48.277732 2568 state_mem.go:36] "Initialized new in-memory state store" Jun 03 16:33:48.277858 ip-10-0-135-67 kubenswrapper[2568]: I0603 16:33:48.277849 2568 server.go:1267] "Using root directory" path="/var/lib/kubelet" Jun 03 16:33:48.279841 ip-10-0-135-67 kubenswrapper[2568]: I0603 16:33:48.279830 2568 kubelet.go:491] "Attempting to sync node with API server" Jun 03 16:33:48.279875 ip-10-0-135-67 kubenswrapper[2568]: I0603 16:33:48.279849 2568 kubelet.go:386] "Adding static pod path" path="/etc/kubernetes/manifests" Jun 03 16:33:48.280533 ip-10-0-135-67 kubenswrapper[2568]: I0603 16:33:48.280524 2568 file.go:69] "Watching path" path="/etc/kubernetes/manifests" Jun 03 16:33:48.280568 ip-10-0-135-67 kubenswrapper[2568]: I0603 16:33:48.280536 2568 kubelet.go:397] "Adding apiserver pod source" Jun 03 16:33:48.280568 ip-10-0-135-67 kubenswrapper[2568]: I0603 16:33:48.280544 2568 apiserver.go:42] "Waiting for node sync before watching apiserver pods" Jun 03 16:33:48.281554 ip-10-0-135-67 kubenswrapper[2568]: I0603 16:33:48.281542 2568 state_mem.go:40] "Initialized new in-memory state store for pod resource information tracking" Jun 03 16:33:48.281611 ip-10-0-135-67 kubenswrapper[2568]: I0603 16:33:48.281564 2568 state_mem.go:40] "Initialized new in-memory state store for pod resource information tracking" Jun 03 16:33:48.284899 ip-10-0-135-67 kubenswrapper[2568]: I0603 16:33:48.284883 2568 kuberuntime_manager.go:279] "Container runtime initialized" containerRuntime="cri-o" version="1.33.12-3.rhaos4.20.git64c6a00.el9" apiVersion="v1" Jun 03 16:33:48.286711 ip-10-0-135-67 kubenswrapper[2568]: I0603 16:33:48.286698 2568 kubelet.go:953] "Not starting ClusterTrustBundle informer because we are in static kubelet mode or the ClusterTrustBundleProjection featuregate is disabled" Jun 03 16:33:48.289026 ip-10-0-135-67 kubenswrapper[2568]: I0603 16:33:48.288998 2568 plugins.go:616] "Loaded volume plugin" pluginName="kubernetes.io/portworx-volume" Jun 03 16:33:48.289083 ip-10-0-135-67 kubenswrapper[2568]: I0603 16:33:48.289035 2568 plugins.go:616] "Loaded volume plugin" pluginName="kubernetes.io/empty-dir" Jun 03 16:33:48.289083 ip-10-0-135-67 kubenswrapper[2568]: I0603 16:33:48.289056 2568 plugins.go:616] "Loaded volume plugin" pluginName="kubernetes.io/git-repo" Jun 03 16:33:48.289083 ip-10-0-135-67 kubenswrapper[2568]: I0603 16:33:48.289064 2568 plugins.go:616] "Loaded volume plugin" pluginName="kubernetes.io/host-path" Jun 03 16:33:48.289083 ip-10-0-135-67 kubenswrapper[2568]: I0603 16:33:48.289073 2568 plugins.go:616] "Loaded volume plugin" pluginName="kubernetes.io/nfs" Jun 03 16:33:48.289083 ip-10-0-135-67 kubenswrapper[2568]: I0603 16:33:48.289079 2568 plugins.go:616] "Loaded volume plugin" pluginName="kubernetes.io/secret" Jun 03 16:33:48.289083 ip-10-0-135-67 kubenswrapper[2568]: I0603 16:33:48.289084 2568 plugins.go:616] "Loaded volume plugin" pluginName="kubernetes.io/iscsi" Jun 03 16:33:48.289250 ip-10-0-135-67 kubenswrapper[2568]: I0603 16:33:48.289090 2568 plugins.go:616] "Loaded volume plugin" pluginName="kubernetes.io/downward-api" Jun 03 16:33:48.289250 ip-10-0-135-67 kubenswrapper[2568]: I0603 16:33:48.289096 2568 plugins.go:616] "Loaded volume plugin" pluginName="kubernetes.io/fc" Jun 03 16:33:48.289250 ip-10-0-135-67 kubenswrapper[2568]: I0603 16:33:48.289102 2568 plugins.go:616] "Loaded volume plugin" pluginName="kubernetes.io/configmap" Jun 03 16:33:48.289250 ip-10-0-135-67 kubenswrapper[2568]: I0603 16:33:48.289114 2568 plugins.go:616] "Loaded volume plugin" pluginName="kubernetes.io/projected" Jun 03 16:33:48.289250 ip-10-0-135-67 kubenswrapper[2568]: I0603 16:33:48.289120 2568 plugins.go:616] "Loaded volume plugin" pluginName="kubernetes.io/local-volume" Jun 03 16:33:48.290061 ip-10-0-135-67 kubenswrapper[2568]: I0603 16:33:48.290049 2568 plugins.go:616] "Loaded volume plugin" pluginName="kubernetes.io/csi" Jun 03 16:33:48.290151 ip-10-0-135-67 kubenswrapper[2568]: I0603 16:33:48.290062 2568 plugins.go:616] "Loaded volume plugin" pluginName="kubernetes.io/image" Jun 03 16:33:48.293063 ip-10-0-135-67 kubenswrapper[2568]: I0603 16:33:48.293048 2568 watchdog_linux.go:99] "Systemd watchdog is not enabled" Jun 03 16:33:48.293142 ip-10-0-135-67 kubenswrapper[2568]: I0603 16:33:48.293081 2568 server.go:1295] "Started kubelet" Jun 03 16:33:48.293222 ip-10-0-135-67 kubenswrapper[2568]: I0603 16:33:48.293155 2568 server.go:180] "Starting to listen" address="0.0.0.0" port=10250 Jun 03 16:33:48.293273 ip-10-0-135-67 kubenswrapper[2568]: I0603 16:33:48.293215 2568 ratelimit.go:55] "Setting rate limiting for endpoint" service="podresources" qps=100 burstTokens=10 Jun 03 16:33:48.293323 ip-10-0-135-67 kubenswrapper[2568]: I0603 16:33:48.293273 2568 server_v1.go:47] "podresources" method="list" useActivePods=true Jun 03 16:33:48.293853 ip-10-0-135-67 systemd[1]: Started Kubernetes Kubelet. Jun 03 16:33:48.293991 ip-10-0-135-67 kubenswrapper[2568]: I0603 16:33:48.293977 2568 csi_plugin.go:988] Failed to contact API server when waiting for CSINode publishing: csinodes.storage.k8s.io "ip-10-0-135-67.ec2.internal" is forbidden: User "system:anonymous" cannot get resource "csinodes" in API group "storage.k8s.io" at the cluster scope Jun 03 16:33:48.294075 ip-10-0-135-67 kubenswrapper[2568]: E0603 16:33:48.293998 2568 reflector.go:200] "Failed to watch" err="failed to list *v1.Node: nodes \"ip-10-0-135-67.ec2.internal\" is forbidden: User \"system:anonymous\" cannot list resource \"nodes\" in API group \"\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Node" Jun 03 16:33:48.294140 ip-10-0-135-67 kubenswrapper[2568]: E0603 16:33:48.294118 2568 reflector.go:200] "Failed to watch" err="failed to list *v1.Service: services is forbidden: User \"system:anonymous\" cannot list resource \"services\" in API group \"\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Service" Jun 03 16:33:48.296434 ip-10-0-135-67 kubenswrapper[2568]: I0603 16:33:48.296416 2568 server.go:255] "Starting to serve the podresources API" endpoint="unix:/var/lib/kubelet/pod-resources/kubelet.sock" Jun 03 16:33:48.296725 ip-10-0-135-67 kubenswrapper[2568]: I0603 16:33:48.296713 2568 server.go:317] "Adding debug handlers to kubelet server" Jun 03 16:33:48.306227 ip-10-0-135-67 kubenswrapper[2568]: E0603 16:33:48.303723 2568 event.go:359] "Server rejected event (will not retry!)" err="events is forbidden: User \"system:anonymous\" cannot create resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-135-67.ec2.internal.18b59f58116af297 default 0 0001-01-01 00:00:00 +0000 UTC map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-135-67.ec2.internal,UID:ip-10-0-135-67.ec2.internal,APIVersion:,ResourceVersion:,FieldPath:,},Reason:Starting,Message:Starting kubelet.,Source:EventSource{Component:kubelet,Host:ip-10-0-135-67.ec2.internal,},FirstTimestamp:2026-06-03 16:33:48.293059223 +0000 UTC m=+0.435233868,LastTimestamp:2026-06-03 16:33:48.293059223 +0000 UTC m=+0.435233868,Count:1,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-135-67.ec2.internal,}" Jun 03 16:33:48.309754 ip-10-0-135-67 kubenswrapper[2568]: E0603 16:33:48.309735 2568 kubelet.go:1618] "Image garbage collection failed once. Stats initialization may not have completed yet" err="failed to get imageFs info: unable to find data in memory cache" Jun 03 16:33:48.310612 ip-10-0-135-67 kubenswrapper[2568]: I0603 16:33:48.310592 2568 fs_resource_analyzer.go:67] "Starting FS ResourceAnalyzer" Jun 03 16:33:48.310697 ip-10-0-135-67 kubenswrapper[2568]: I0603 16:33:48.310612 2568 certificate_manager.go:422] "Certificate rotation is enabled" logger="kubernetes.io/kubelet-serving" Jun 03 16:33:48.310806 ip-10-0-135-67 kubenswrapper[2568]: I0603 16:33:48.310785 2568 volume_manager.go:295] "The desired_state_of_world populator starts" Jun 03 16:33:48.310932 ip-10-0-135-67 kubenswrapper[2568]: I0603 16:33:48.310922 2568 volume_manager.go:297] "Starting Kubelet Volume Manager" Jun 03 16:33:48.311071 ip-10-0-135-67 kubenswrapper[2568]: I0603 16:33:48.311056 2568 desired_state_of_world_populator.go:150] "Desired state populator starts to run" Jun 03 16:33:48.311166 ip-10-0-135-67 kubenswrapper[2568]: I0603 16:33:48.311138 2568 reconstruct.go:97] "Volume reconstruction finished" Jun 03 16:33:48.311166 ip-10-0-135-67 kubenswrapper[2568]: I0603 16:33:48.311147 2568 reconciler.go:26] "Reconciler: start to sync state" Jun 03 16:33:48.311327 ip-10-0-135-67 kubenswrapper[2568]: I0603 16:33:48.311312 2568 factory.go:55] Registering systemd factory Jun 03 16:33:48.311368 ip-10-0-135-67 kubenswrapper[2568]: I0603 16:33:48.311329 2568 factory.go:223] Registration of the systemd container factory successfully Jun 03 16:33:48.311538 ip-10-0-135-67 kubenswrapper[2568]: I0603 16:33:48.311522 2568 factory.go:153] Registering CRI-O factory Jun 03 16:33:48.311538 ip-10-0-135-67 kubenswrapper[2568]: I0603 16:33:48.311539 2568 factory.go:223] Registration of the crio container factory successfully Jun 03 16:33:48.311672 ip-10-0-135-67 kubenswrapper[2568]: I0603 16:33:48.311582 2568 factory.go:221] Registration of the containerd container factory failed: unable to create containerd client: containerd: cannot unix dial containerd api service: dial unix /run/containerd/containerd.sock: connect: no such file or directory Jun 03 16:33:48.311672 ip-10-0-135-67 kubenswrapper[2568]: E0603 16:33:48.311593 2568 kubelet_node_status.go:515] "Error getting the current node from lister" err="node \"ip-10-0-135-67.ec2.internal\" not found" Jun 03 16:33:48.311672 ip-10-0-135-67 kubenswrapper[2568]: I0603 16:33:48.311600 2568 factory.go:103] Registering Raw factory Jun 03 16:33:48.311672 ip-10-0-135-67 kubenswrapper[2568]: I0603 16:33:48.311629 2568 manager.go:1196] Started watching for new ooms in manager Jun 03 16:33:48.311929 ip-10-0-135-67 kubenswrapper[2568]: I0603 16:33:48.311915 2568 manager.go:319] Starting recovery of all containers Jun 03 16:33:48.312560 ip-10-0-135-67 kubenswrapper[2568]: E0603 16:33:48.312531 2568 controller.go:145] "Failed to ensure lease exists, will retry" err="leases.coordination.k8s.io \"ip-10-0-135-67.ec2.internal\" is forbidden: User \"system:anonymous\" cannot get resource \"leases\" in API group \"coordination.k8s.io\" in the namespace \"kube-node-lease\"" interval="200ms" Jun 03 16:33:48.312881 ip-10-0-135-67 kubenswrapper[2568]: E0603 16:33:48.312712 2568 reflector.go:200] "Failed to watch" err="failed to list *v1.CSIDriver: csidrivers.storage.k8s.io is forbidden: User \"system:anonymous\" cannot list resource \"csidrivers\" in API group \"storage.k8s.io\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.CSIDriver" Jun 03 16:33:48.316363 ip-10-0-135-67 kubenswrapper[2568]: I0603 16:33:48.316337 2568 csr.go:274] "Certificate signing request is approved, waiting to be issued" logger="kubernetes.io/kube-apiserver-client-kubelet" csr="csr-jk2m5" Jun 03 16:33:48.320075 ip-10-0-135-67 kubenswrapper[2568]: I0603 16:33:48.320055 2568 manager.go:324] Recovery completed Jun 03 16:33:48.322966 ip-10-0-135-67 kubenswrapper[2568]: I0603 16:33:48.322950 2568 csr.go:270] "Certificate signing request is issued" logger="kubernetes.io/kube-apiserver-client-kubelet" csr="csr-jk2m5" Jun 03 16:33:48.324361 ip-10-0-135-67 kubenswrapper[2568]: I0603 16:33:48.324348 2568 kubelet_node_status.go:413] "Setting node annotation to enable volume controller attach/detach" Jun 03 16:33:48.326096 ip-10-0-135-67 kubenswrapper[2568]: I0603 16:33:48.326079 2568 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-135-67.ec2.internal" event="NodeHasSufficientMemory" Jun 03 16:33:48.326220 ip-10-0-135-67 kubenswrapper[2568]: I0603 16:33:48.326112 2568 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-135-67.ec2.internal" event="NodeHasNoDiskPressure" Jun 03 16:33:48.326220 ip-10-0-135-67 kubenswrapper[2568]: I0603 16:33:48.326127 2568 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-135-67.ec2.internal" event="NodeHasSufficientPID" Jun 03 16:33:48.326612 ip-10-0-135-67 kubenswrapper[2568]: I0603 16:33:48.326601 2568 cpu_manager.go:222] "Starting CPU manager" policy="none" Jun 03 16:33:48.326612 ip-10-0-135-67 kubenswrapper[2568]: I0603 16:33:48.326611 2568 cpu_manager.go:223] "Reconciling" reconcilePeriod="10s" Jun 03 16:33:48.326709 ip-10-0-135-67 kubenswrapper[2568]: I0603 16:33:48.326629 2568 state_mem.go:36] "Initialized new in-memory state store" Jun 03 16:33:48.328898 ip-10-0-135-67 kubenswrapper[2568]: I0603 16:33:48.328886 2568 policy_none.go:49] "None policy: Start" Jun 03 16:33:48.328942 ip-10-0-135-67 kubenswrapper[2568]: I0603 16:33:48.328902 2568 memory_manager.go:186] "Starting memorymanager" policy="None" Jun 03 16:33:48.328942 ip-10-0-135-67 kubenswrapper[2568]: I0603 16:33:48.328912 2568 state_mem.go:35] "Initializing new in-memory state store" Jun 03 16:33:48.363598 ip-10-0-135-67 kubenswrapper[2568]: I0603 16:33:48.363582 2568 manager.go:341] "Starting Device Plugin manager" Jun 03 16:33:48.383834 ip-10-0-135-67 kubenswrapper[2568]: E0603 16:33:48.363616 2568 manager.go:517] "Failed to read data from checkpoint" err="checkpoint is not found" checkpoint="kubelet_internal_checkpoint" Jun 03 16:33:48.383834 ip-10-0-135-67 kubenswrapper[2568]: I0603 16:33:48.363630 2568 server.go:85] "Starting device plugin registration server" Jun 03 16:33:48.383834 ip-10-0-135-67 kubenswrapper[2568]: I0603 16:33:48.363841 2568 eviction_manager.go:189] "Eviction manager: starting control loop" Jun 03 16:33:48.383834 ip-10-0-135-67 kubenswrapper[2568]: I0603 16:33:48.363853 2568 container_log_manager.go:189] "Initializing container log rotate workers" workers=1 monitorPeriod="10s" Jun 03 16:33:48.383834 ip-10-0-135-67 kubenswrapper[2568]: I0603 16:33:48.363988 2568 plugin_watcher.go:51] "Plugin Watcher Start" path="/var/lib/kubelet/plugins_registry" Jun 03 16:33:48.383834 ip-10-0-135-67 kubenswrapper[2568]: I0603 16:33:48.364074 2568 plugin_manager.go:116] "The desired_state_of_world populator (plugin watcher) starts" Jun 03 16:33:48.383834 ip-10-0-135-67 kubenswrapper[2568]: I0603 16:33:48.364084 2568 plugin_manager.go:118] "Starting Kubelet Plugin Manager" Jun 03 16:33:48.383834 ip-10-0-135-67 kubenswrapper[2568]: E0603 16:33:48.365120 2568 eviction_manager.go:267] "eviction manager: failed to check if we have separate container filesystem. Ignoring." err="non-existent label \"crio-containers\"" Jun 03 16:33:48.383834 ip-10-0-135-67 kubenswrapper[2568]: E0603 16:33:48.365148 2568 eviction_manager.go:292] "Eviction manager: failed to get summary stats" err="failed to get node info: node \"ip-10-0-135-67.ec2.internal\" not found" Jun 03 16:33:48.404105 ip-10-0-135-67 kubenswrapper[2568]: I0603 16:33:48.404077 2568 kubelet_network_linux.go:49] "Initialized iptables rules." protocol="IPv4" Jun 03 16:33:48.405192 ip-10-0-135-67 kubenswrapper[2568]: I0603 16:33:48.405175 2568 kubelet_network_linux.go:49] "Initialized iptables rules." protocol="IPv6" Jun 03 16:33:48.405192 ip-10-0-135-67 kubenswrapper[2568]: I0603 16:33:48.405191 2568 status_manager.go:230] "Starting to sync pod status with apiserver" Jun 03 16:33:48.405332 ip-10-0-135-67 kubenswrapper[2568]: I0603 16:33:48.405205 2568 watchdog_linux.go:127] "Systemd watchdog is not enabled or the interval is invalid, so health checking will not be started." Jun 03 16:33:48.405332 ip-10-0-135-67 kubenswrapper[2568]: I0603 16:33:48.405212 2568 kubelet.go:2451] "Starting kubelet main sync loop" Jun 03 16:33:48.405332 ip-10-0-135-67 kubenswrapper[2568]: E0603 16:33:48.405244 2568 kubelet.go:2475] "Skipping pod synchronization" err="PLEG is not healthy: pleg has yet to be successful" Jun 03 16:33:48.409345 ip-10-0-135-67 kubenswrapper[2568]: I0603 16:33:48.409328 2568 reflector.go:430] "Caches populated" type="*v1.RuntimeClass" reflector="k8s.io/client-go/informers/factory.go:160" Jun 03 16:33:48.464696 ip-10-0-135-67 kubenswrapper[2568]: I0603 16:33:48.464651 2568 kubelet_node_status.go:413] "Setting node annotation to enable volume controller attach/detach" Jun 03 16:33:48.465511 ip-10-0-135-67 kubenswrapper[2568]: I0603 16:33:48.465494 2568 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-135-67.ec2.internal" event="NodeHasSufficientMemory" Jun 03 16:33:48.465583 ip-10-0-135-67 kubenswrapper[2568]: I0603 16:33:48.465523 2568 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-135-67.ec2.internal" event="NodeHasNoDiskPressure" Jun 03 16:33:48.465583 ip-10-0-135-67 kubenswrapper[2568]: I0603 16:33:48.465533 2568 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-135-67.ec2.internal" event="NodeHasSufficientPID" Jun 03 16:33:48.465583 ip-10-0-135-67 kubenswrapper[2568]: I0603 16:33:48.465554 2568 kubelet_node_status.go:78] "Attempting to register node" node="ip-10-0-135-67.ec2.internal" Jun 03 16:33:48.474759 ip-10-0-135-67 kubenswrapper[2568]: I0603 16:33:48.474742 2568 kubelet_node_status.go:81] "Successfully registered node" node="ip-10-0-135-67.ec2.internal" Jun 03 16:33:48.474847 ip-10-0-135-67 kubenswrapper[2568]: E0603 16:33:48.474767 2568 kubelet_node_status.go:597] "Error updating node status, will retry" err="error getting node \"ip-10-0-135-67.ec2.internal\": node \"ip-10-0-135-67.ec2.internal\" not found" Jun 03 16:33:48.488116 ip-10-0-135-67 kubenswrapper[2568]: E0603 16:33:48.488096 2568 kubelet_node_status.go:515] "Error getting the current node from lister" err="node \"ip-10-0-135-67.ec2.internal\" not found" Jun 03 16:33:48.505840 ip-10-0-135-67 kubenswrapper[2568]: I0603 16:33:48.505807 2568 kubelet.go:2537] "SyncLoop ADD" source="file" pods=["kube-system/kube-apiserver-proxy-ip-10-0-135-67.ec2.internal","openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-135-67.ec2.internal"] Jun 03 16:33:48.505904 ip-10-0-135-67 kubenswrapper[2568]: I0603 16:33:48.505875 2568 kubelet_node_status.go:413] "Setting node annotation to enable volume controller attach/detach" Jun 03 16:33:48.506556 ip-10-0-135-67 kubenswrapper[2568]: I0603 16:33:48.506544 2568 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-135-67.ec2.internal" event="NodeHasSufficientMemory" Jun 03 16:33:48.506640 ip-10-0-135-67 kubenswrapper[2568]: I0603 16:33:48.506567 2568 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-135-67.ec2.internal" event="NodeHasNoDiskPressure" Jun 03 16:33:48.506640 ip-10-0-135-67 kubenswrapper[2568]: I0603 16:33:48.506580 2568 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-135-67.ec2.internal" event="NodeHasSufficientPID" Jun 03 16:33:48.507650 ip-10-0-135-67 kubenswrapper[2568]: I0603 16:33:48.507638 2568 kubelet_node_status.go:413] "Setting node annotation to enable volume controller attach/detach" Jun 03 16:33:48.507804 ip-10-0-135-67 kubenswrapper[2568]: I0603 16:33:48.507788 2568 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/kube-apiserver-proxy-ip-10-0-135-67.ec2.internal" Jun 03 16:33:48.507862 ip-10-0-135-67 kubenswrapper[2568]: I0603 16:33:48.507821 2568 kubelet_node_status.go:413] "Setting node annotation to enable volume controller attach/detach" Jun 03 16:33:48.510909 ip-10-0-135-67 kubenswrapper[2568]: I0603 16:33:48.510895 2568 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-135-67.ec2.internal" event="NodeHasSufficientMemory" Jun 03 16:33:48.511016 ip-10-0-135-67 kubenswrapper[2568]: I0603 16:33:48.510914 2568 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-135-67.ec2.internal" event="NodeHasSufficientMemory" Jun 03 16:33:48.511016 ip-10-0-135-67 kubenswrapper[2568]: I0603 16:33:48.510923 2568 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-135-67.ec2.internal" event="NodeHasNoDiskPressure" Jun 03 16:33:48.511016 ip-10-0-135-67 kubenswrapper[2568]: I0603 16:33:48.510933 2568 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-135-67.ec2.internal" event="NodeHasNoDiskPressure" Jun 03 16:33:48.511016 ip-10-0-135-67 kubenswrapper[2568]: I0603 16:33:48.510938 2568 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-135-67.ec2.internal" event="NodeHasSufficientPID" Jun 03 16:33:48.511016 ip-10-0-135-67 kubenswrapper[2568]: I0603 16:33:48.510949 2568 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-135-67.ec2.internal" event="NodeHasSufficientPID" Jun 03 16:33:48.511665 ip-10-0-135-67 kubenswrapper[2568]: I0603 16:33:48.511650 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/542287c42e1ce445fdbebaa3fcb48471-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-135-67.ec2.internal\" (UID: \"542287c42e1ce445fdbebaa3fcb48471\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-135-67.ec2.internal" Jun 03 16:33:48.511706 ip-10-0-135-67 kubenswrapper[2568]: I0603 16:33:48.511673 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/542287c42e1ce445fdbebaa3fcb48471-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-135-67.ec2.internal\" (UID: \"542287c42e1ce445fdbebaa3fcb48471\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-135-67.ec2.internal" Jun 03 16:33:48.511706 ip-10-0-135-67 kubenswrapper[2568]: I0603 16:33:48.511690 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/host-path/4639241fb18cd938c7f40c97e0b0879c-config\") pod \"kube-apiserver-proxy-ip-10-0-135-67.ec2.internal\" (UID: \"4639241fb18cd938c7f40c97e0b0879c\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-135-67.ec2.internal" Jun 03 16:33:48.512094 ip-10-0-135-67 kubenswrapper[2568]: I0603 16:33:48.512079 2568 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-135-67.ec2.internal" Jun 03 16:33:48.512176 ip-10-0-135-67 kubenswrapper[2568]: I0603 16:33:48.512103 2568 kubelet_node_status.go:413] "Setting node annotation to enable volume controller attach/detach" Jun 03 16:33:48.512712 ip-10-0-135-67 kubenswrapper[2568]: I0603 16:33:48.512695 2568 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-135-67.ec2.internal" event="NodeHasSufficientMemory" Jun 03 16:33:48.512790 ip-10-0-135-67 kubenswrapper[2568]: I0603 16:33:48.512722 2568 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-135-67.ec2.internal" event="NodeHasNoDiskPressure" Jun 03 16:33:48.512790 ip-10-0-135-67 kubenswrapper[2568]: I0603 16:33:48.512734 2568 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-135-67.ec2.internal" event="NodeHasSufficientPID" Jun 03 16:33:48.539573 ip-10-0-135-67 kubenswrapper[2568]: E0603 16:33:48.539554 2568 kubelet.go:3336] "No need to create a mirror pod, since failed to get node info from the cluster" err="node \"ip-10-0-135-67.ec2.internal\" not found" node="ip-10-0-135-67.ec2.internal" Jun 03 16:33:48.543792 ip-10-0-135-67 kubenswrapper[2568]: E0603 16:33:48.543774 2568 kubelet.go:3336] "No need to create a mirror pod, since failed to get node info from the cluster" err="node \"ip-10-0-135-67.ec2.internal\" not found" node="ip-10-0-135-67.ec2.internal" Jun 03 16:33:48.588408 ip-10-0-135-67 kubenswrapper[2568]: E0603 16:33:48.588388 2568 kubelet_node_status.go:515] "Error getting the current node from lister" err="node \"ip-10-0-135-67.ec2.internal\" not found" Jun 03 16:33:48.612669 ip-10-0-135-67 kubenswrapper[2568]: I0603 16:33:48.612648 2568 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/542287c42e1ce445fdbebaa3fcb48471-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-135-67.ec2.internal\" (UID: \"542287c42e1ce445fdbebaa3fcb48471\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-135-67.ec2.internal" Jun 03 16:33:48.612735 ip-10-0-135-67 kubenswrapper[2568]: I0603 16:33:48.612675 2568 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/542287c42e1ce445fdbebaa3fcb48471-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-135-67.ec2.internal\" (UID: \"542287c42e1ce445fdbebaa3fcb48471\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-135-67.ec2.internal" Jun 03 16:33:48.612735 ip-10-0-135-67 kubenswrapper[2568]: I0603 16:33:48.612692 2568 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/host-path/4639241fb18cd938c7f40c97e0b0879c-config\") pod \"kube-apiserver-proxy-ip-10-0-135-67.ec2.internal\" (UID: \"4639241fb18cd938c7f40c97e0b0879c\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-135-67.ec2.internal" Jun 03 16:33:48.612735 ip-10-0-135-67 kubenswrapper[2568]: I0603 16:33:48.612723 2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/host-path/4639241fb18cd938c7f40c97e0b0879c-config\") pod \"kube-apiserver-proxy-ip-10-0-135-67.ec2.internal\" (UID: \"4639241fb18cd938c7f40c97e0b0879c\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-135-67.ec2.internal" Jun 03 16:33:48.612832 ip-10-0-135-67 kubenswrapper[2568]: I0603 16:33:48.612733 2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/542287c42e1ce445fdbebaa3fcb48471-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-135-67.ec2.internal\" (UID: \"542287c42e1ce445fdbebaa3fcb48471\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-135-67.ec2.internal" Jun 03 16:33:48.612832 ip-10-0-135-67 kubenswrapper[2568]: I0603 16:33:48.612746 2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/542287c42e1ce445fdbebaa3fcb48471-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-135-67.ec2.internal\" (UID: \"542287c42e1ce445fdbebaa3fcb48471\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-135-67.ec2.internal" Jun 03 16:33:48.688804 ip-10-0-135-67 kubenswrapper[2568]: E0603 16:33:48.688774 2568 kubelet_node_status.go:515] "Error getting the current node from lister" err="node \"ip-10-0-135-67.ec2.internal\" not found" Jun 03 16:33:48.789459 ip-10-0-135-67 kubenswrapper[2568]: E0603 16:33:48.789436 2568 kubelet_node_status.go:515] "Error getting the current node from lister" err="node \"ip-10-0-135-67.ec2.internal\" not found" Jun 03 16:33:48.841907 ip-10-0-135-67 kubenswrapper[2568]: I0603 16:33:48.841886 2568 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/kube-apiserver-proxy-ip-10-0-135-67.ec2.internal" Jun 03 16:33:48.847448 ip-10-0-135-67 kubenswrapper[2568]: I0603 16:33:48.847404 2568 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-135-67.ec2.internal" Jun 03 16:33:48.889645 ip-10-0-135-67 kubenswrapper[2568]: E0603 16:33:48.889627 2568 kubelet_node_status.go:515] "Error getting the current node from lister" err="node \"ip-10-0-135-67.ec2.internal\" not found" Jun 03 16:33:48.990093 ip-10-0-135-67 kubenswrapper[2568]: E0603 16:33:48.990074 2568 kubelet_node_status.go:515] "Error getting the current node from lister" err="node \"ip-10-0-135-67.ec2.internal\" not found" Jun 03 16:33:49.090547 ip-10-0-135-67 kubenswrapper[2568]: E0603 16:33:49.090496 2568 kubelet_node_status.go:515] "Error getting the current node from lister" err="node \"ip-10-0-135-67.ec2.internal\" not found" Jun 03 16:33:49.190943 ip-10-0-135-67 kubenswrapper[2568]: E0603 16:33:49.190923 2568 kubelet_node_status.go:515] "Error getting the current node from lister" err="node \"ip-10-0-135-67.ec2.internal\" not found" Jun 03 16:33:49.217450 ip-10-0-135-67 kubenswrapper[2568]: I0603 16:33:49.217431 2568 transport.go:147] "Certificate rotation detected, shutting down client connections to start using new credentials" Jun 03 16:33:49.217961 ip-10-0-135-67 kubenswrapper[2568]: I0603 16:33:49.217542 2568 reflector.go:556] "Warning: watch ended with error" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.RuntimeClass" err="very short watch: k8s.io/client-go/informers/factory.go:160: Unexpected watch close - watch lasted less than a second and no items received" Jun 03 16:33:49.291956 ip-10-0-135-67 kubenswrapper[2568]: E0603 16:33:49.291936 2568 kubelet_node_status.go:515] "Error getting the current node from lister" err="node \"ip-10-0-135-67.ec2.internal\" not found" Jun 03 16:33:49.311758 ip-10-0-135-67 kubenswrapper[2568]: I0603 16:33:49.311728 2568 certificate_manager.go:566] "Rotating certificates" logger="kubernetes.io/kubelet-serving" Jun 03 16:33:49.321696 ip-10-0-135-67 kubenswrapper[2568]: I0603 16:33:49.321677 2568 reflector.go:430] "Caches populated" logger="kubernetes.io/kubelet-serving" type="*v1.CertificateSigningRequest" reflector="k8s.io/client-go/tools/watch/informerwatcher.go:162" Jun 03 16:33:49.325215 ip-10-0-135-67 kubenswrapper[2568]: I0603 16:33:49.325192 2568 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kube-apiserver-client-kubelet" expiration="2028-06-02 16:28:48 +0000 UTC" deadline="2028-02-07 12:19:49.137902457 +0000 UTC" Jun 03 16:33:49.325215 ip-10-0-135-67 kubenswrapper[2568]: I0603 16:33:49.325214 2568 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kube-apiserver-client-kubelet" sleep="14731h45m59.81269068s" Jun 03 16:33:49.340198 ip-10-0-135-67 kubenswrapper[2568]: I0603 16:33:49.340181 2568 csr.go:274] "Certificate signing request is approved, waiting to be issued" logger="kubernetes.io/kubelet-serving" csr="csr-lmpb7" Jun 03 16:33:49.347428 ip-10-0-135-67 kubenswrapper[2568]: I0603 16:33:49.347388 2568 csr.go:270] "Certificate signing request is issued" logger="kubernetes.io/kubelet-serving" csr="csr-lmpb7" Jun 03 16:33:49.374734 ip-10-0-135-67 kubenswrapper[2568]: W0603 16:33:49.374711 2568 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod542287c42e1ce445fdbebaa3fcb48471.slice/crio-013b53430d1c0eb6ad8a08d62956c24c7cb13e6da65aaee8a882a0165f3a7827 WatchSource:0}: Error finding container 013b53430d1c0eb6ad8a08d62956c24c7cb13e6da65aaee8a882a0165f3a7827: Status 404 returned error can't find the container with id 013b53430d1c0eb6ad8a08d62956c24c7cb13e6da65aaee8a882a0165f3a7827 Jun 03 16:33:49.374923 ip-10-0-135-67 kubenswrapper[2568]: W0603 16:33:49.374904 2568 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod4639241fb18cd938c7f40c97e0b0879c.slice/crio-998218a9b93223463621e462af7cf628c10a99278b5dd9fbd4dacda5d97e20bb WatchSource:0}: Error finding container 998218a9b93223463621e462af7cf628c10a99278b5dd9fbd4dacda5d97e20bb: Status 404 returned error can't find the container with id 998218a9b93223463621e462af7cf628c10a99278b5dd9fbd4dacda5d97e20bb Jun 03 16:33:49.379140 ip-10-0-135-67 kubenswrapper[2568]: I0603 16:33:49.379125 2568 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider Jun 03 16:33:49.388271 ip-10-0-135-67 kubenswrapper[2568]: I0603 16:33:49.388255 2568 reflector.go:430] "Caches populated" type="*v1.Node" reflector="k8s.io/client-go/informers/factory.go:160" Jun 03 16:33:49.408148 ip-10-0-135-67 kubenswrapper[2568]: I0603 16:33:49.408105 2568 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-135-67.ec2.internal" event={"ID":"4639241fb18cd938c7f40c97e0b0879c","Type":"ContainerStarted","Data":"998218a9b93223463621e462af7cf628c10a99278b5dd9fbd4dacda5d97e20bb"} Jun 03 16:33:49.408933 ip-10-0-135-67 kubenswrapper[2568]: I0603 16:33:49.408916 2568 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-135-67.ec2.internal" event={"ID":"542287c42e1ce445fdbebaa3fcb48471","Type":"ContainerStarted","Data":"013b53430d1c0eb6ad8a08d62956c24c7cb13e6da65aaee8a882a0165f3a7827"} Jun 03 16:33:49.411068 ip-10-0-135-67 kubenswrapper[2568]: I0603 16:33:49.411056 2568 kubelet.go:3340] "Creating a mirror pod for static pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-135-67.ec2.internal" Jun 03 16:33:49.426552 ip-10-0-135-67 kubenswrapper[2568]: I0603 16:33:49.426533 2568 warnings.go:110] "Warning: metadata.name: this is used in the Pod's hostname, which can result in surprising behavior; a DNS label is recommended: [must not contain dots]" Jun 03 16:33:49.428258 ip-10-0-135-67 kubenswrapper[2568]: I0603 16:33:49.428246 2568 kubelet.go:3340] "Creating a mirror pod for static pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-135-67.ec2.internal" Jun 03 16:33:49.435725 ip-10-0-135-67 kubenswrapper[2568]: I0603 16:33:49.435713 2568 warnings.go:110] "Warning: metadata.name: this is used in the Pod's hostname, which can result in surprising behavior; a DNS label is recommended: [must not contain dots]" Jun 03 16:33:49.608481 ip-10-0-135-67 kubenswrapper[2568]: I0603 16:33:49.608422 2568 reflector.go:430] "Caches populated" type="*v1.CSIDriver" reflector="k8s.io/client-go/informers/factory.go:160" Jun 03 16:33:49.758305 ip-10-0-135-67 kubenswrapper[2568]: I0603 16:33:49.758276 2568 reflector.go:430] "Caches populated" type="*v1.Service" reflector="k8s.io/client-go/informers/factory.go:160" Jun 03 16:33:50.152757 ip-10-0-135-67 kubenswrapper[2568]: I0603 16:33:50.152725 2568 reflector.go:430] "Caches populated" type="*v1.RuntimeClass" reflector="k8s.io/client-go/informers/factory.go:160" Jun 03 16:33:50.281556 ip-10-0-135-67 kubenswrapper[2568]: I0603 16:33:50.281381 2568 apiserver.go:52] "Watching apiserver" Jun 03 16:33:50.285887 ip-10-0-135-67 kubenswrapper[2568]: I0603 16:33:50.285865 2568 reflector.go:430] "Caches populated" type="*v1.Pod" reflector="pkg/kubelet/config/apiserver.go:66" Jun 03 16:33:50.286983 ip-10-0-135-67 kubenswrapper[2568]: I0603 16:33:50.286959 2568 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-multus/multus-additional-cni-plugins-q2q9l","openshift-multus/multus-kf7b6","openshift-network-diagnostics/network-check-target-569p4","openshift-network-operator/iptables-alerter-hnms9","kube-system/konnectivity-agent-vcz76","kube-system/kube-apiserver-proxy-ip-10-0-135-67.ec2.internal","openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-pr68x","openshift-multus/network-metrics-daemon-54gnw","openshift-ovn-kubernetes/ovnkube-node-94fdt","openshift-cluster-node-tuning-operator/tuned-kpfxt","openshift-dns/node-resolver-wrnbf","openshift-image-registry/node-ca-ktq4g","openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-135-67.ec2.internal"] Jun 03 16:33:50.290106 ip-10-0-135-67 kubenswrapper[2568]: I0603 16:33:50.290085 2568 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-pr68x" Jun 03 16:33:50.291715 ip-10-0-135-67 kubenswrapper[2568]: I0603 16:33:50.291513 2568 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-kf7b6" Jun 03 16:33:50.292234 ip-10-0-135-67 kubenswrapper[2568]: I0603 16:33:50.292216 2568 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-csi-drivers\"/\"aws-ebs-csi-driver-node-sa-dockercfg-dgqsw\"" Jun 03 16:33:50.292324 ip-10-0-135-67 kubenswrapper[2568]: I0603 16:33:50.292233 2568 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-csi-drivers\"/\"aws-ebs-csi-driver-node-metrics-serving-cert\"" Jun 03 16:33:50.292324 ip-10-0-135-67 kubenswrapper[2568]: I0603 16:33:50.292277 2568 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-csi-drivers\"/\"openshift-service-ca.crt\"" Jun 03 16:33:50.292324 ip-10-0-135-67 kubenswrapper[2568]: I0603 16:33:50.292282 2568 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-csi-drivers\"/\"kube-root-ca.crt\"" Jun 03 16:33:50.292869 ip-10-0-135-67 kubenswrapper[2568]: I0603 16:33:50.292843 2568 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-operator/iptables-alerter-hnms9" Jun 03 16:33:50.294439 ip-10-0-135-67 kubenswrapper[2568]: I0603 16:33:50.294418 2568 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"openshift-service-ca.crt\"" Jun 03 16:33:50.295575 ip-10-0-135-67 kubenswrapper[2568]: I0603 16:33:50.295556 2568 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"kube-root-ca.crt\"" Jun 03 16:33:50.295575 ip-10-0-135-67 kubenswrapper[2568]: I0603 16:33:50.295568 2568 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"cni-copy-resources\"" Jun 03 16:33:50.296121 ip-10-0-135-67 kubenswrapper[2568]: I0603 16:33:50.296102 2568 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"default-dockercfg-bc6wv\"" Jun 03 16:33:50.296206 ip-10-0-135-67 kubenswrapper[2568]: I0603 16:33:50.296109 2568 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-569p4" Jun 03 16:33:50.296698 ip-10-0-135-67 kubenswrapper[2568]: E0603 16:33:50.296668 2568 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-569p4" podUID="4a9428e9-7e73-44e5-ab4e-8dcb9028335e" Jun 03 16:33:50.296903 ip-10-0-135-67 kubenswrapper[2568]: I0603 16:33:50.296878 2568 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"openshift-service-ca.crt\"" Jun 03 16:33:50.297653 ip-10-0-135-67 kubenswrapper[2568]: I0603 16:33:50.297635 2568 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"kube-root-ca.crt\"" Jun 03 16:33:50.298272 ip-10-0-135-67 kubenswrapper[2568]: I0603 16:33:50.298149 2568 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"iptables-alerter-script\"" Jun 03 16:33:50.298272 ip-10-0-135-67 kubenswrapper[2568]: I0603 16:33:50.298216 2568 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/konnectivity-agent-vcz76" Jun 03 16:33:50.298760 ip-10-0-135-67 kubenswrapper[2568]: I0603 16:33:50.298741 2568 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"multus-daemon-config\"" Jun 03 16:33:50.300062 ip-10-0-135-67 kubenswrapper[2568]: I0603 16:33:50.299630 2568 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-operator\"/\"iptables-alerter-dockercfg-fjlgl\"" Jun 03 16:33:50.300062 ip-10-0-135-67 kubenswrapper[2568]: I0603 16:33:50.299830 2568 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-additional-cni-plugins-q2q9l" Jun 03 16:33:50.300228 ip-10-0-135-67 kubenswrapper[2568]: I0603 16:33:50.300202 2568 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-54gnw" Jun 03 16:33:50.300334 ip-10-0-135-67 kubenswrapper[2568]: E0603 16:33:50.300277 2568 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-54gnw" podUID="ddc210bb-9544-4ca7-b2de-f84c92d84510" Jun 03 16:33:50.301404 ip-10-0-135-67 kubenswrapper[2568]: I0603 16:33:50.301388 2568 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kube-system\"/\"konnectivity-ca-bundle\"" Jun 03 16:33:50.302531 ip-10-0-135-67 kubenswrapper[2568]: I0603 16:33:50.302452 2568 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"konnectivity-agent\"" Jun 03 16:33:50.303076 ip-10-0-135-67 kubenswrapper[2568]: I0603 16:33:50.302507 2568 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"default-dockercfg-6jscc\"" Jun 03 16:33:50.303429 ip-10-0-135-67 kubenswrapper[2568]: I0603 16:33:50.302639 2568 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"default-cni-sysctl-allowlist\"" Jun 03 16:33:50.304033 ip-10-0-135-67 kubenswrapper[2568]: I0603 16:33:50.302683 2568 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"multus-ancillary-tools-dockercfg-s9mwr\"" Jun 03 16:33:50.304118 ip-10-0-135-67 kubenswrapper[2568]: I0603 16:33:50.302719 2568 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"whereabouts-flatfile-config\"" Jun 03 16:33:50.304177 ip-10-0-135-67 kubenswrapper[2568]: I0603 16:33:50.303758 2568 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ovn-kubernetes/ovnkube-node-94fdt" Jun 03 16:33:50.304800 ip-10-0-135-67 kubenswrapper[2568]: I0603 16:33:50.303875 2568 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-node-tuning-operator/tuned-kpfxt" Jun 03 16:33:50.305890 ip-10-0-135-67 kubenswrapper[2568]: I0603 16:33:50.305853 2568 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"kube-root-ca.crt\"" Jun 03 16:33:50.306068 ip-10-0-135-67 kubenswrapper[2568]: I0603 16:33:50.306038 2568 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"ovnkube-config\"" Jun 03 16:33:50.306578 ip-10-0-135-67 kubenswrapper[2568]: I0603 16:33:50.306414 2568 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ovn-kubernetes\"/\"ovn-node-metrics-cert\"" Jun 03 16:33:50.306578 ip-10-0-135-67 kubenswrapper[2568]: I0603 16:33:50.306445 2568 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ovn-kubernetes\"/\"ovn-kubernetes-node-dockercfg-4kzz9\"" Jun 03 16:33:50.306578 ip-10-0-135-67 kubenswrapper[2568]: I0603 16:33:50.306499 2568 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"kube-root-ca.crt\"" Jun 03 16:33:50.306819 ip-10-0-135-67 kubenswrapper[2568]: I0603 16:33:50.306628 2568 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"openshift-service-ca.crt\"" Jun 03 16:33:50.306819 ip-10-0-135-67 kubenswrapper[2568]: I0603 16:33:50.306783 2568 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"openshift-service-ca.crt\"" Jun 03 16:33:50.307407 ip-10-0-135-67 kubenswrapper[2568]: I0603 16:33:50.306973 2568 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"env-overrides\"" Jun 03 16:33:50.307407 ip-10-0-135-67 kubenswrapper[2568]: I0603 16:33:50.307194 2568 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"ovnkube-script-lib\"" Jun 03 16:33:50.307407 ip-10-0-135-67 kubenswrapper[2568]: I0603 16:33:50.307263 2568 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"tuned-dockercfg-fpcsj\"" Jun 03 16:33:50.310089 ip-10-0-135-67 kubenswrapper[2568]: I0603 16:33:50.310068 2568 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/node-ca-ktq4g" Jun 03 16:33:50.310485 ip-10-0-135-67 kubenswrapper[2568]: I0603 16:33:50.310466 2568 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/node-resolver-wrnbf" Jun 03 16:33:50.312489 ip-10-0-135-67 kubenswrapper[2568]: I0603 16:33:50.312469 2568 desired_state_of_world_populator.go:158] "Finished populating initial desired state of world" Jun 03 16:33:50.313102 ip-10-0-135-67 kubenswrapper[2568]: I0603 16:33:50.313085 2568 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"node-ca-dockercfg-lqx45\"" Jun 03 16:33:50.313450 ip-10-0-135-67 kubenswrapper[2568]: I0603 16:33:50.313334 2568 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"openshift-service-ca.crt\"" Jun 03 16:33:50.313576 ip-10-0-135-67 kubenswrapper[2568]: I0603 16:33:50.313541 2568 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"kube-root-ca.crt\"" Jun 03 16:33:50.314106 ip-10-0-135-67 kubenswrapper[2568]: I0603 16:33:50.314077 2568 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"image-registry-certificates\"" Jun 03 16:33:50.314209 ip-10-0-135-67 kubenswrapper[2568]: I0603 16:33:50.314193 2568 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"kube-root-ca.crt\"" Jun 03 16:33:50.314303 ip-10-0-135-67 kubenswrapper[2568]: I0603 16:33:50.314279 2568 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"openshift-service-ca.crt\"" Jun 03 16:33:50.314372 ip-10-0-135-67 kubenswrapper[2568]: I0603 16:33:50.314301 2568 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"node-resolver-dockercfg-f9m8t\"" Jun 03 16:33:50.320064 ip-10-0-135-67 kubenswrapper[2568]: I0603 16:33:50.320042 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-gwzmz\" (UniqueName: \"kubernetes.io/projected/4a9428e9-7e73-44e5-ab4e-8dcb9028335e-kube-api-access-gwzmz\") pod \"network-check-target-569p4\" (UID: \"4a9428e9-7e73-44e5-ab4e-8dcb9028335e\") " pod="openshift-network-diagnostics/network-check-target-569p4" Jun 03 16:33:50.320159 ip-10-0-135-67 kubenswrapper[2568]: I0603 16:33:50.320101 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/dd3dac0d-018e-4c8a-98c7-daedef6dedb9-host-slash\") pod \"ovnkube-node-94fdt\" (UID: \"dd3dac0d-018e-4c8a-98c7-daedef6dedb9\") " pod="openshift-ovn-kubernetes/ovnkube-node-94fdt" Jun 03 16:33:50.320159 ip-10-0-135-67 kubenswrapper[2568]: I0603 16:33:50.320128 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/dd3dac0d-018e-4c8a-98c7-daedef6dedb9-host-cni-bin\") pod \"ovnkube-node-94fdt\" (UID: \"dd3dac0d-018e-4c8a-98c7-daedef6dedb9\") " pod="openshift-ovn-kubernetes/ovnkube-node-94fdt" Jun 03 16:33:50.320159 ip-10-0-135-67 kubenswrapper[2568]: I0603 16:33:50.320151 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/dd3dac0d-018e-4c8a-98c7-daedef6dedb9-host-cni-netd\") pod \"ovnkube-node-94fdt\" (UID: \"dd3dac0d-018e-4c8a-98c7-daedef6dedb9\") " pod="openshift-ovn-kubernetes/ovnkube-node-94fdt" Jun 03 16:33:50.320363 ip-10-0-135-67 kubenswrapper[2568]: I0603 16:33:50.320178 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/4a0bbce9-a5e7-409d-af6c-911d3173c133-multus-socket-dir-parent\") pod \"multus-kf7b6\" (UID: \"4a0bbce9-a5e7-409d-af6c-911d3173c133\") " pod="openshift-multus/multus-kf7b6" Jun 03 16:33:50.320363 ip-10-0-135-67 kubenswrapper[2568]: I0603 16:33:50.320246 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/4a0bbce9-a5e7-409d-af6c-911d3173c133-host-var-lib-cni-multus\") pod \"multus-kf7b6\" (UID: \"4a0bbce9-a5e7-409d-af6c-911d3173c133\") " pod="openshift-multus/multus-kf7b6" Jun 03 16:33:50.320363 ip-10-0-135-67 kubenswrapper[2568]: I0603 16:33:50.320272 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/ce603907-50de-4706-9fa0-5edcca2ea9ea-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-q2q9l\" (UID: \"ce603907-50de-4706-9fa0-5edcca2ea9ea\") " pod="openshift-multus/multus-additional-cni-plugins-q2q9l" Jun 03 16:33:50.320363 ip-10-0-135-67 kubenswrapper[2568]: I0603 16:33:50.320297 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run\" (UniqueName: \"kubernetes.io/host-path/c39b8a66-ab5e-4021-aad1-575bbb72a504-run\") pod \"tuned-kpfxt\" (UID: \"c39b8a66-ab5e-4021-aad1-575bbb72a504\") " pod="openshift-cluster-node-tuning-operator/tuned-kpfxt" Jun 03 16:33:50.320363 ip-10-0-135-67 kubenswrapper[2568]: I0603 16:33:50.320327 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/d250f8ac-2da7-4c87-85e2-dad87073a681-tmp-dir\") pod \"node-resolver-wrnbf\" (UID: \"d250f8ac-2da7-4c87-85e2-dad87073a681\") " pod="openshift-dns/node-resolver-wrnbf" Jun 03 16:33:50.320363 ip-10-0-135-67 kubenswrapper[2568]: I0603 16:33:50.320356 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/4a0bbce9-a5e7-409d-af6c-911d3173c133-system-cni-dir\") pod \"multus-kf7b6\" (UID: \"4a0bbce9-a5e7-409d-af6c-911d3173c133\") " pod="openshift-multus/multus-kf7b6" Jun 03 16:33:50.320663 ip-10-0-135-67 kubenswrapper[2568]: I0603 16:33:50.320379 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/4a0bbce9-a5e7-409d-af6c-911d3173c133-cnibin\") pod \"multus-kf7b6\" (UID: \"4a0bbce9-a5e7-409d-af6c-911d3173c133\") " pod="openshift-multus/multus-kf7b6" Jun 03 16:33:50.320663 ip-10-0-135-67 kubenswrapper[2568]: I0603 16:33:50.320401 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/064d2e30-5154-4209-9774-4aa8196c55c7-registration-dir\") pod \"aws-ebs-csi-driver-node-pr68x\" (UID: \"064d2e30-5154-4209-9774-4aa8196c55c7\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-pr68x" Jun 03 16:33:50.320663 ip-10-0-135-67 kubenswrapper[2568]: I0603 16:33:50.320424 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/064d2e30-5154-4209-9774-4aa8196c55c7-sys-fs\") pod \"aws-ebs-csi-driver-node-pr68x\" (UID: \"064d2e30-5154-4209-9774-4aa8196c55c7\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-pr68x" Jun 03 16:33:50.320663 ip-10-0-135-67 kubenswrapper[2568]: I0603 16:33:50.320468 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/dd3dac0d-018e-4c8a-98c7-daedef6dedb9-etc-openvswitch\") pod \"ovnkube-node-94fdt\" (UID: \"dd3dac0d-018e-4c8a-98c7-daedef6dedb9\") " pod="openshift-ovn-kubernetes/ovnkube-node-94fdt" Jun 03 16:33:50.320663 ip-10-0-135-67 kubenswrapper[2568]: I0603 16:33:50.320491 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/4a0bbce9-a5e7-409d-af6c-911d3173c133-host-var-lib-kubelet\") pod \"multus-kf7b6\" (UID: \"4a0bbce9-a5e7-409d-af6c-911d3173c133\") " pod="openshift-multus/multus-kf7b6" Jun 03 16:33:50.320663 ip-10-0-135-67 kubenswrapper[2568]: I0603 16:33:50.320514 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/ce603907-50de-4706-9fa0-5edcca2ea9ea-tuning-conf-dir\") pod \"multus-additional-cni-plugins-q2q9l\" (UID: \"ce603907-50de-4706-9fa0-5edcca2ea9ea\") " pod="openshift-multus/multus-additional-cni-plugins-q2q9l" Jun 03 16:33:50.320663 ip-10-0-135-67 kubenswrapper[2568]: I0603 16:33:50.320537 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/f40f3f2b-b437-46a6-8ea2-b770ea9bd2a3-host\") pod \"node-ca-ktq4g\" (UID: \"f40f3f2b-b437-46a6-8ea2-b770ea9bd2a3\") " pod="openshift-image-registry/node-ca-ktq4g" Jun 03 16:33:50.320663 ip-10-0-135-67 kubenswrapper[2568]: I0603 16:33:50.320569 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/064d2e30-5154-4209-9774-4aa8196c55c7-socket-dir\") pod \"aws-ebs-csi-driver-node-pr68x\" (UID: \"064d2e30-5154-4209-9774-4aa8196c55c7\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-pr68x" Jun 03 16:33:50.320663 ip-10-0-135-67 kubenswrapper[2568]: I0603 16:33:50.320616 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/ce603907-50de-4706-9fa0-5edcca2ea9ea-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-q2q9l\" (UID: \"ce603907-50de-4706-9fa0-5edcca2ea9ea\") " pod="openshift-multus/multus-additional-cni-plugins-q2q9l" Jun 03 16:33:50.321105 ip-10-0-135-67 kubenswrapper[2568]: I0603 16:33:50.320721 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/c39b8a66-ab5e-4021-aad1-575bbb72a504-etc-sysctl-d\") pod \"tuned-kpfxt\" (UID: \"c39b8a66-ab5e-4021-aad1-575bbb72a504\") " pod="openshift-cluster-node-tuning-operator/tuned-kpfxt" Jun 03 16:33:50.321105 ip-10-0-135-67 kubenswrapper[2568]: I0603 16:33:50.320748 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/c39b8a66-ab5e-4021-aad1-575bbb72a504-lib-modules\") pod \"tuned-kpfxt\" (UID: \"c39b8a66-ab5e-4021-aad1-575bbb72a504\") " pod="openshift-cluster-node-tuning-operator/tuned-kpfxt" Jun 03 16:33:50.321105 ip-10-0-135-67 kubenswrapper[2568]: I0603 16:33:50.320779 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/dd3dac0d-018e-4c8a-98c7-daedef6dedb9-run-systemd\") pod \"ovnkube-node-94fdt\" (UID: \"dd3dac0d-018e-4c8a-98c7-daedef6dedb9\") " pod="openshift-ovn-kubernetes/ovnkube-node-94fdt" Jun 03 16:33:50.321105 ip-10-0-135-67 kubenswrapper[2568]: I0603 16:33:50.320804 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/dd3dac0d-018e-4c8a-98c7-daedef6dedb9-var-lib-openvswitch\") pod \"ovnkube-node-94fdt\" (UID: \"dd3dac0d-018e-4c8a-98c7-daedef6dedb9\") " pod="openshift-ovn-kubernetes/ovnkube-node-94fdt" Jun 03 16:33:50.321105 ip-10-0-135-67 kubenswrapper[2568]: I0603 16:33:50.320828 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/c39b8a66-ab5e-4021-aad1-575bbb72a504-etc-sysconfig\") pod \"tuned-kpfxt\" (UID: \"c39b8a66-ab5e-4021-aad1-575bbb72a504\") " pod="openshift-cluster-node-tuning-operator/tuned-kpfxt" Jun 03 16:33:50.321105 ip-10-0-135-67 kubenswrapper[2568]: I0603 16:33:50.320857 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/d250f8ac-2da7-4c87-85e2-dad87073a681-hosts-file\") pod \"node-resolver-wrnbf\" (UID: \"d250f8ac-2da7-4c87-85e2-dad87073a681\") " pod="openshift-dns/node-resolver-wrnbf" Jun 03 16:33:50.321105 ip-10-0-135-67 kubenswrapper[2568]: I0603 16:33:50.320902 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/064d2e30-5154-4209-9774-4aa8196c55c7-device-dir\") pod \"aws-ebs-csi-driver-node-pr68x\" (UID: \"064d2e30-5154-4209-9774-4aa8196c55c7\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-pr68x" Jun 03 16:33:50.321105 ip-10-0-135-67 kubenswrapper[2568]: I0603 16:33:50.320928 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/ce603907-50de-4706-9fa0-5edcca2ea9ea-os-release\") pod \"multus-additional-cni-plugins-q2q9l\" (UID: \"ce603907-50de-4706-9fa0-5edcca2ea9ea\") " pod="openshift-multus/multus-additional-cni-plugins-q2q9l" Jun 03 16:33:50.321105 ip-10-0-135-67 kubenswrapper[2568]: I0603 16:33:50.320950 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/dd3dac0d-018e-4c8a-98c7-daedef6dedb9-env-overrides\") pod \"ovnkube-node-94fdt\" (UID: \"dd3dac0d-018e-4c8a-98c7-daedef6dedb9\") " pod="openshift-ovn-kubernetes/ovnkube-node-94fdt" Jun 03 16:33:50.321105 ip-10-0-135-67 kubenswrapper[2568]: I0603 16:33:50.320966 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/4a0bbce9-a5e7-409d-af6c-911d3173c133-host-run-k8s-cni-cncf-io\") pod \"multus-kf7b6\" (UID: \"4a0bbce9-a5e7-409d-af6c-911d3173c133\") " pod="openshift-multus/multus-kf7b6" Jun 03 16:33:50.321105 ip-10-0-135-67 kubenswrapper[2568]: I0603 16:33:50.320980 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/4a0bbce9-a5e7-409d-af6c-911d3173c133-multus-conf-dir\") pod \"multus-kf7b6\" (UID: \"4a0bbce9-a5e7-409d-af6c-911d3173c133\") " pod="openshift-multus/multus-kf7b6" Jun 03 16:33:50.321105 ip-10-0-135-67 kubenswrapper[2568]: I0603 16:33:50.320994 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/4a0bbce9-a5e7-409d-af6c-911d3173c133-multus-daemon-config\") pod \"multus-kf7b6\" (UID: \"4a0bbce9-a5e7-409d-af6c-911d3173c133\") " pod="openshift-multus/multus-kf7b6" Jun 03 16:33:50.321105 ip-10-0-135-67 kubenswrapper[2568]: I0603 16:33:50.321032 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-qcl58\" (UniqueName: \"kubernetes.io/projected/eeccbde1-c0af-4476-bffb-29e92945d422-kube-api-access-qcl58\") pod \"iptables-alerter-hnms9\" (UID: \"eeccbde1-c0af-4476-bffb-29e92945d422\") " pod="openshift-network-operator/iptables-alerter-hnms9" Jun 03 16:33:50.321105 ip-10-0-135-67 kubenswrapper[2568]: I0603 16:33:50.321059 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/c39b8a66-ab5e-4021-aad1-575bbb72a504-etc-sysctl-conf\") pod \"tuned-kpfxt\" (UID: \"c39b8a66-ab5e-4021-aad1-575bbb72a504\") " pod="openshift-cluster-node-tuning-operator/tuned-kpfxt" Jun 03 16:33:50.321743 ip-10-0-135-67 kubenswrapper[2568]: I0603 16:33:50.321111 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/f40f3f2b-b437-46a6-8ea2-b770ea9bd2a3-serviceca\") pod \"node-ca-ktq4g\" (UID: \"f40f3f2b-b437-46a6-8ea2-b770ea9bd2a3\") " pod="openshift-image-registry/node-ca-ktq4g" Jun 03 16:33:50.321743 ip-10-0-135-67 kubenswrapper[2568]: I0603 16:33:50.321229 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/dd3dac0d-018e-4c8a-98c7-daedef6dedb9-systemd-units\") pod \"ovnkube-node-94fdt\" (UID: \"dd3dac0d-018e-4c8a-98c7-daedef6dedb9\") " pod="openshift-ovn-kubernetes/ovnkube-node-94fdt" Jun 03 16:33:50.321743 ip-10-0-135-67 kubenswrapper[2568]: I0603 16:33:50.321257 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/dd3dac0d-018e-4c8a-98c7-daedef6dedb9-host-run-ovn-kubernetes\") pod \"ovnkube-node-94fdt\" (UID: \"dd3dac0d-018e-4c8a-98c7-daedef6dedb9\") " pod="openshift-ovn-kubernetes/ovnkube-node-94fdt" Jun 03 16:33:50.321743 ip-10-0-135-67 kubenswrapper[2568]: I0603 16:33:50.321325 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/dd3dac0d-018e-4c8a-98c7-daedef6dedb9-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-94fdt\" (UID: \"dd3dac0d-018e-4c8a-98c7-daedef6dedb9\") " pod="openshift-ovn-kubernetes/ovnkube-node-94fdt" Jun 03 16:33:50.321743 ip-10-0-135-67 kubenswrapper[2568]: I0603 16:33:50.321357 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-nbdjp\" (UniqueName: \"kubernetes.io/projected/dd3dac0d-018e-4c8a-98c7-daedef6dedb9-kube-api-access-nbdjp\") pod \"ovnkube-node-94fdt\" (UID: \"dd3dac0d-018e-4c8a-98c7-daedef6dedb9\") " pod="openshift-ovn-kubernetes/ovnkube-node-94fdt" Jun 03 16:33:50.321743 ip-10-0-135-67 kubenswrapper[2568]: I0603 16:33:50.321399 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/eeccbde1-c0af-4476-bffb-29e92945d422-host-slash\") pod \"iptables-alerter-hnms9\" (UID: \"eeccbde1-c0af-4476-bffb-29e92945d422\") " pod="openshift-network-operator/iptables-alerter-hnms9" Jun 03 16:33:50.321743 ip-10-0-135-67 kubenswrapper[2568]: I0603 16:33:50.321422 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/c39b8a66-ab5e-4021-aad1-575bbb72a504-sys\") pod \"tuned-kpfxt\" (UID: \"c39b8a66-ab5e-4021-aad1-575bbb72a504\") " pod="openshift-cluster-node-tuning-operator/tuned-kpfxt" Jun 03 16:33:50.321743 ip-10-0-135-67 kubenswrapper[2568]: I0603 16:33:50.321437 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/dd3dac0d-018e-4c8a-98c7-daedef6dedb9-node-log\") pod \"ovnkube-node-94fdt\" (UID: \"dd3dac0d-018e-4c8a-98c7-daedef6dedb9\") " pod="openshift-ovn-kubernetes/ovnkube-node-94fdt" Jun 03 16:33:50.321743 ip-10-0-135-67 kubenswrapper[2568]: I0603 16:33:50.321451 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/dd3dac0d-018e-4c8a-98c7-daedef6dedb9-ovnkube-config\") pod \"ovnkube-node-94fdt\" (UID: \"dd3dac0d-018e-4c8a-98c7-daedef6dedb9\") " pod="openshift-ovn-kubernetes/ovnkube-node-94fdt" Jun 03 16:33:50.321743 ip-10-0-135-67 kubenswrapper[2568]: I0603 16:33:50.321480 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/dd3dac0d-018e-4c8a-98c7-daedef6dedb9-ovn-node-metrics-cert\") pod \"ovnkube-node-94fdt\" (UID: \"dd3dac0d-018e-4c8a-98c7-daedef6dedb9\") " pod="openshift-ovn-kubernetes/ovnkube-node-94fdt" Jun 03 16:33:50.321743 ip-10-0-135-67 kubenswrapper[2568]: I0603 16:33:50.321515 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/ce603907-50de-4706-9fa0-5edcca2ea9ea-cnibin\") pod \"multus-additional-cni-plugins-q2q9l\" (UID: \"ce603907-50de-4706-9fa0-5edcca2ea9ea\") " pod="openshift-multus/multus-additional-cni-plugins-q2q9l" Jun 03 16:33:50.321743 ip-10-0-135-67 kubenswrapper[2568]: I0603 16:33:50.321556 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/ce603907-50de-4706-9fa0-5edcca2ea9ea-cni-binary-copy\") pod \"multus-additional-cni-plugins-q2q9l\" (UID: \"ce603907-50de-4706-9fa0-5edcca2ea9ea\") " pod="openshift-multus/multus-additional-cni-plugins-q2q9l" Jun 03 16:33:50.321743 ip-10-0-135-67 kubenswrapper[2568]: I0603 16:33:50.321584 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/dd3dac0d-018e-4c8a-98c7-daedef6dedb9-run-openvswitch\") pod \"ovnkube-node-94fdt\" (UID: \"dd3dac0d-018e-4c8a-98c7-daedef6dedb9\") " pod="openshift-ovn-kubernetes/ovnkube-node-94fdt" Jun 03 16:33:50.321743 ip-10-0-135-67 kubenswrapper[2568]: I0603 16:33:50.321606 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/c39b8a66-ab5e-4021-aad1-575bbb72a504-etc-systemd\") pod \"tuned-kpfxt\" (UID: \"c39b8a66-ab5e-4021-aad1-575bbb72a504\") " pod="openshift-cluster-node-tuning-operator/tuned-kpfxt" Jun 03 16:33:50.321743 ip-10-0-135-67 kubenswrapper[2568]: I0603 16:33:50.321628 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/c39b8a66-ab5e-4021-aad1-575bbb72a504-var-lib-kubelet\") pod \"tuned-kpfxt\" (UID: \"c39b8a66-ab5e-4021-aad1-575bbb72a504\") " pod="openshift-cluster-node-tuning-operator/tuned-kpfxt" Jun 03 16:33:50.321743 ip-10-0-135-67 kubenswrapper[2568]: I0603 16:33:50.321649 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/c39b8a66-ab5e-4021-aad1-575bbb72a504-etc-tuned\") pod \"tuned-kpfxt\" (UID: \"c39b8a66-ab5e-4021-aad1-575bbb72a504\") " pod="openshift-cluster-node-tuning-operator/tuned-kpfxt" Jun 03 16:33:50.322603 ip-10-0-135-67 kubenswrapper[2568]: I0603 16:33:50.321673 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-b2vzb\" (UniqueName: \"kubernetes.io/projected/f40f3f2b-b437-46a6-8ea2-b770ea9bd2a3-kube-api-access-b2vzb\") pod \"node-ca-ktq4g\" (UID: \"f40f3f2b-b437-46a6-8ea2-b770ea9bd2a3\") " pod="openshift-image-registry/node-ca-ktq4g" Jun 03 16:33:50.322603 ip-10-0-135-67 kubenswrapper[2568]: I0603 16:33:50.321697 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/064d2e30-5154-4209-9774-4aa8196c55c7-kubelet-dir\") pod \"aws-ebs-csi-driver-node-pr68x\" (UID: \"064d2e30-5154-4209-9774-4aa8196c55c7\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-pr68x" Jun 03 16:33:50.322603 ip-10-0-135-67 kubenswrapper[2568]: I0603 16:33:50.321723 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-t72ww\" (UniqueName: \"kubernetes.io/projected/ddc210bb-9544-4ca7-b2de-f84c92d84510-kube-api-access-t72ww\") pod \"network-metrics-daemon-54gnw\" (UID: \"ddc210bb-9544-4ca7-b2de-f84c92d84510\") " pod="openshift-multus/network-metrics-daemon-54gnw" Jun 03 16:33:50.322603 ip-10-0-135-67 kubenswrapper[2568]: I0603 16:33:50.321750 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/dd3dac0d-018e-4c8a-98c7-daedef6dedb9-host-run-netns\") pod \"ovnkube-node-94fdt\" (UID: \"dd3dac0d-018e-4c8a-98c7-daedef6dedb9\") " pod="openshift-ovn-kubernetes/ovnkube-node-94fdt" Jun 03 16:33:50.322603 ip-10-0-135-67 kubenswrapper[2568]: I0603 16:33:50.321774 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-4kbgz\" (UniqueName: \"kubernetes.io/projected/4a0bbce9-a5e7-409d-af6c-911d3173c133-kube-api-access-4kbgz\") pod \"multus-kf7b6\" (UID: \"4a0bbce9-a5e7-409d-af6c-911d3173c133\") " pod="openshift-multus/multus-kf7b6" Jun 03 16:33:50.322603 ip-10-0-135-67 kubenswrapper[2568]: I0603 16:33:50.321799 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/969318db-7cb1-4ad5-99f2-66d7f803c8a3-agent-certs\") pod \"konnectivity-agent-vcz76\" (UID: \"969318db-7cb1-4ad5-99f2-66d7f803c8a3\") " pod="kube-system/konnectivity-agent-vcz76" Jun 03 16:33:50.322603 ip-10-0-135-67 kubenswrapper[2568]: I0603 16:33:50.321822 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-j5m84\" (UniqueName: \"kubernetes.io/projected/d250f8ac-2da7-4c87-85e2-dad87073a681-kube-api-access-j5m84\") pod \"node-resolver-wrnbf\" (UID: \"d250f8ac-2da7-4c87-85e2-dad87073a681\") " pod="openshift-dns/node-resolver-wrnbf" Jun 03 16:33:50.322603 ip-10-0-135-67 kubenswrapper[2568]: I0603 16:33:50.321847 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/ddc210bb-9544-4ca7-b2de-f84c92d84510-metrics-certs\") pod \"network-metrics-daemon-54gnw\" (UID: \"ddc210bb-9544-4ca7-b2de-f84c92d84510\") " pod="openshift-multus/network-metrics-daemon-54gnw" Jun 03 16:33:50.322603 ip-10-0-135-67 kubenswrapper[2568]: I0603 16:33:50.321872 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/4a0bbce9-a5e7-409d-af6c-911d3173c133-host-run-netns\") pod \"multus-kf7b6\" (UID: \"4a0bbce9-a5e7-409d-af6c-911d3173c133\") " pod="openshift-multus/multus-kf7b6" Jun 03 16:33:50.322603 ip-10-0-135-67 kubenswrapper[2568]: I0603 16:33:50.321897 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/969318db-7cb1-4ad5-99f2-66d7f803c8a3-konnectivity-ca\") pod \"konnectivity-agent-vcz76\" (UID: \"969318db-7cb1-4ad5-99f2-66d7f803c8a3\") " pod="kube-system/konnectivity-agent-vcz76" Jun 03 16:33:50.322603 ip-10-0-135-67 kubenswrapper[2568]: I0603 16:33:50.321919 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/c39b8a66-ab5e-4021-aad1-575bbb72a504-tmp\") pod \"tuned-kpfxt\" (UID: \"c39b8a66-ab5e-4021-aad1-575bbb72a504\") " pod="openshift-cluster-node-tuning-operator/tuned-kpfxt" Jun 03 16:33:50.322603 ip-10-0-135-67 kubenswrapper[2568]: I0603 16:33:50.321941 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/dd3dac0d-018e-4c8a-98c7-daedef6dedb9-ovnkube-script-lib\") pod \"ovnkube-node-94fdt\" (UID: \"dd3dac0d-018e-4c8a-98c7-daedef6dedb9\") " pod="openshift-ovn-kubernetes/ovnkube-node-94fdt" Jun 03 16:33:50.322603 ip-10-0-135-67 kubenswrapper[2568]: I0603 16:33:50.321967 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/c39b8a66-ab5e-4021-aad1-575bbb72a504-etc-kubernetes\") pod \"tuned-kpfxt\" (UID: \"c39b8a66-ab5e-4021-aad1-575bbb72a504\") " pod="openshift-cluster-node-tuning-operator/tuned-kpfxt" Jun 03 16:33:50.322603 ip-10-0-135-67 kubenswrapper[2568]: I0603 16:33:50.321991 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-9dsxq\" (UniqueName: \"kubernetes.io/projected/c39b8a66-ab5e-4021-aad1-575bbb72a504-kube-api-access-9dsxq\") pod \"tuned-kpfxt\" (UID: \"c39b8a66-ab5e-4021-aad1-575bbb72a504\") " pod="openshift-cluster-node-tuning-operator/tuned-kpfxt" Jun 03 16:33:50.322603 ip-10-0-135-67 kubenswrapper[2568]: I0603 16:33:50.322031 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/064d2e30-5154-4209-9774-4aa8196c55c7-etc-selinux\") pod \"aws-ebs-csi-driver-node-pr68x\" (UID: \"064d2e30-5154-4209-9774-4aa8196c55c7\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-pr68x" Jun 03 16:33:50.322603 ip-10-0-135-67 kubenswrapper[2568]: I0603 16:33:50.322056 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/4a0bbce9-a5e7-409d-af6c-911d3173c133-os-release\") pod \"multus-kf7b6\" (UID: \"4a0bbce9-a5e7-409d-af6c-911d3173c133\") " pod="openshift-multus/multus-kf7b6" Jun 03 16:33:50.323366 ip-10-0-135-67 kubenswrapper[2568]: I0603 16:33:50.322080 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/4a0bbce9-a5e7-409d-af6c-911d3173c133-cni-binary-copy\") pod \"multus-kf7b6\" (UID: \"4a0bbce9-a5e7-409d-af6c-911d3173c133\") " pod="openshift-multus/multus-kf7b6" Jun 03 16:33:50.323366 ip-10-0-135-67 kubenswrapper[2568]: I0603 16:33:50.322103 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/ce603907-50de-4706-9fa0-5edcca2ea9ea-system-cni-dir\") pod \"multus-additional-cni-plugins-q2q9l\" (UID: \"ce603907-50de-4706-9fa0-5edcca2ea9ea\") " pod="openshift-multus/multus-additional-cni-plugins-q2q9l" Jun 03 16:33:50.323366 ip-10-0-135-67 kubenswrapper[2568]: I0603 16:33:50.322143 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/c39b8a66-ab5e-4021-aad1-575bbb72a504-host\") pod \"tuned-kpfxt\" (UID: \"c39b8a66-ab5e-4021-aad1-575bbb72a504\") " pod="openshift-cluster-node-tuning-operator/tuned-kpfxt" Jun 03 16:33:50.323366 ip-10-0-135-67 kubenswrapper[2568]: I0603 16:33:50.322193 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-cr28s\" (UniqueName: \"kubernetes.io/projected/064d2e30-5154-4209-9774-4aa8196c55c7-kube-api-access-cr28s\") pod \"aws-ebs-csi-driver-node-pr68x\" (UID: \"064d2e30-5154-4209-9774-4aa8196c55c7\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-pr68x" Jun 03 16:33:50.323366 ip-10-0-135-67 kubenswrapper[2568]: I0603 16:33:50.322225 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/dd3dac0d-018e-4c8a-98c7-daedef6dedb9-run-ovn\") pod \"ovnkube-node-94fdt\" (UID: \"dd3dac0d-018e-4c8a-98c7-daedef6dedb9\") " pod="openshift-ovn-kubernetes/ovnkube-node-94fdt" Jun 03 16:33:50.323366 ip-10-0-135-67 kubenswrapper[2568]: I0603 16:33:50.322255 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/dd3dac0d-018e-4c8a-98c7-daedef6dedb9-log-socket\") pod \"ovnkube-node-94fdt\" (UID: \"dd3dac0d-018e-4c8a-98c7-daedef6dedb9\") " pod="openshift-ovn-kubernetes/ovnkube-node-94fdt" Jun 03 16:33:50.323366 ip-10-0-135-67 kubenswrapper[2568]: I0603 16:33:50.322281 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/4a0bbce9-a5e7-409d-af6c-911d3173c133-multus-cni-dir\") pod \"multus-kf7b6\" (UID: \"4a0bbce9-a5e7-409d-af6c-911d3173c133\") " pod="openshift-multus/multus-kf7b6" Jun 03 16:33:50.323366 ip-10-0-135-67 kubenswrapper[2568]: I0603 16:33:50.322310 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/4a0bbce9-a5e7-409d-af6c-911d3173c133-hostroot\") pod \"multus-kf7b6\" (UID: \"4a0bbce9-a5e7-409d-af6c-911d3173c133\") " pod="openshift-multus/multus-kf7b6" Jun 03 16:33:50.323366 ip-10-0-135-67 kubenswrapper[2568]: I0603 16:33:50.322369 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/4a0bbce9-a5e7-409d-af6c-911d3173c133-etc-kubernetes\") pod \"multus-kf7b6\" (UID: \"4a0bbce9-a5e7-409d-af6c-911d3173c133\") " pod="openshift-multus/multus-kf7b6" Jun 03 16:33:50.323366 ip-10-0-135-67 kubenswrapper[2568]: I0603 16:33:50.322394 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-f9xg6\" (UniqueName: \"kubernetes.io/projected/ce603907-50de-4706-9fa0-5edcca2ea9ea-kube-api-access-f9xg6\") pod \"multus-additional-cni-plugins-q2q9l\" (UID: \"ce603907-50de-4706-9fa0-5edcca2ea9ea\") " pod="openshift-multus/multus-additional-cni-plugins-q2q9l" Jun 03 16:33:50.323366 ip-10-0-135-67 kubenswrapper[2568]: I0603 16:33:50.322431 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/c39b8a66-ab5e-4021-aad1-575bbb72a504-etc-modprobe-d\") pod \"tuned-kpfxt\" (UID: \"c39b8a66-ab5e-4021-aad1-575bbb72a504\") " pod="openshift-cluster-node-tuning-operator/tuned-kpfxt" Jun 03 16:33:50.323366 ip-10-0-135-67 kubenswrapper[2568]: I0603 16:33:50.322454 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/dd3dac0d-018e-4c8a-98c7-daedef6dedb9-host-kubelet\") pod \"ovnkube-node-94fdt\" (UID: \"dd3dac0d-018e-4c8a-98c7-daedef6dedb9\") " pod="openshift-ovn-kubernetes/ovnkube-node-94fdt" Jun 03 16:33:50.323366 ip-10-0-135-67 kubenswrapper[2568]: I0603 16:33:50.322475 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/4a0bbce9-a5e7-409d-af6c-911d3173c133-host-var-lib-cni-bin\") pod \"multus-kf7b6\" (UID: \"4a0bbce9-a5e7-409d-af6c-911d3173c133\") " pod="openshift-multus/multus-kf7b6" Jun 03 16:33:50.323366 ip-10-0-135-67 kubenswrapper[2568]: I0603 16:33:50.322517 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/4a0bbce9-a5e7-409d-af6c-911d3173c133-host-run-multus-certs\") pod \"multus-kf7b6\" (UID: \"4a0bbce9-a5e7-409d-af6c-911d3173c133\") " pod="openshift-multus/multus-kf7b6" Jun 03 16:33:50.323366 ip-10-0-135-67 kubenswrapper[2568]: I0603 16:33:50.322549 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/eeccbde1-c0af-4476-bffb-29e92945d422-iptables-alerter-script\") pod \"iptables-alerter-hnms9\" (UID: \"eeccbde1-c0af-4476-bffb-29e92945d422\") " pod="openshift-network-operator/iptables-alerter-hnms9" Jun 03 16:33:50.348030 ip-10-0-135-67 kubenswrapper[2568]: I0603 16:33:50.347987 2568 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kubelet-serving" expiration="2028-06-02 16:28:49 +0000 UTC" deadline="2027-12-19 12:50:01.014732673 +0000 UTC" Jun 03 16:33:50.348122 ip-10-0-135-67 kubenswrapper[2568]: I0603 16:33:50.348030 2568 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kubelet-serving" sleep="13532h16m10.6667055s" Jun 03 16:33:50.423601 ip-10-0-135-67 kubenswrapper[2568]: I0603 16:33:50.423548 2568 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/dd3dac0d-018e-4c8a-98c7-daedef6dedb9-host-cni-bin\") pod \"ovnkube-node-94fdt\" (UID: \"dd3dac0d-018e-4c8a-98c7-daedef6dedb9\") " pod="openshift-ovn-kubernetes/ovnkube-node-94fdt" Jun 03 16:33:50.423601 ip-10-0-135-67 kubenswrapper[2568]: I0603 16:33:50.423588 2568 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/dd3dac0d-018e-4c8a-98c7-daedef6dedb9-host-cni-netd\") pod \"ovnkube-node-94fdt\" (UID: \"dd3dac0d-018e-4c8a-98c7-daedef6dedb9\") " pod="openshift-ovn-kubernetes/ovnkube-node-94fdt" Jun 03 16:33:50.423772 ip-10-0-135-67 kubenswrapper[2568]: I0603 16:33:50.423613 2568 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/4a0bbce9-a5e7-409d-af6c-911d3173c133-multus-socket-dir-parent\") pod \"multus-kf7b6\" (UID: \"4a0bbce9-a5e7-409d-af6c-911d3173c133\") " pod="openshift-multus/multus-kf7b6" Jun 03 16:33:50.423772 ip-10-0-135-67 kubenswrapper[2568]: I0603 16:33:50.423641 2568 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/4a0bbce9-a5e7-409d-af6c-911d3173c133-host-var-lib-cni-multus\") pod \"multus-kf7b6\" (UID: \"4a0bbce9-a5e7-409d-af6c-911d3173c133\") " pod="openshift-multus/multus-kf7b6" Jun 03 16:33:50.423772 ip-10-0-135-67 kubenswrapper[2568]: I0603 16:33:50.423662 2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/dd3dac0d-018e-4c8a-98c7-daedef6dedb9-host-cni-netd\") pod \"ovnkube-node-94fdt\" (UID: \"dd3dac0d-018e-4c8a-98c7-daedef6dedb9\") " pod="openshift-ovn-kubernetes/ovnkube-node-94fdt" Jun 03 16:33:50.423772 ip-10-0-135-67 kubenswrapper[2568]: I0603 16:33:50.423662 2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/dd3dac0d-018e-4c8a-98c7-daedef6dedb9-host-cni-bin\") pod \"ovnkube-node-94fdt\" (UID: \"dd3dac0d-018e-4c8a-98c7-daedef6dedb9\") " pod="openshift-ovn-kubernetes/ovnkube-node-94fdt" Jun 03 16:33:50.423772 ip-10-0-135-67 kubenswrapper[2568]: I0603 16:33:50.423668 2568 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/ce603907-50de-4706-9fa0-5edcca2ea9ea-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-q2q9l\" (UID: \"ce603907-50de-4706-9fa0-5edcca2ea9ea\") " pod="openshift-multus/multus-additional-cni-plugins-q2q9l" Jun 03 16:33:50.423772 ip-10-0-135-67 kubenswrapper[2568]: I0603 16:33:50.423711 2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/4a0bbce9-a5e7-409d-af6c-911d3173c133-multus-socket-dir-parent\") pod \"multus-kf7b6\" (UID: \"4a0bbce9-a5e7-409d-af6c-911d3173c133\") " pod="openshift-multus/multus-kf7b6" Jun 03 16:33:50.423772 ip-10-0-135-67 kubenswrapper[2568]: I0603 16:33:50.423727 2568 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"run\" (UniqueName: \"kubernetes.io/host-path/c39b8a66-ab5e-4021-aad1-575bbb72a504-run\") pod \"tuned-kpfxt\" (UID: \"c39b8a66-ab5e-4021-aad1-575bbb72a504\") " pod="openshift-cluster-node-tuning-operator/tuned-kpfxt" Jun 03 16:33:50.423772 ip-10-0-135-67 kubenswrapper[2568]: I0603 16:33:50.423749 2568 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/d250f8ac-2da7-4c87-85e2-dad87073a681-tmp-dir\") pod \"node-resolver-wrnbf\" (UID: \"d250f8ac-2da7-4c87-85e2-dad87073a681\") " pod="openshift-dns/node-resolver-wrnbf" Jun 03 16:33:50.423772 ip-10-0-135-67 kubenswrapper[2568]: I0603 16:33:50.423758 2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/4a0bbce9-a5e7-409d-af6c-911d3173c133-host-var-lib-cni-multus\") pod \"multus-kf7b6\" (UID: \"4a0bbce9-a5e7-409d-af6c-911d3173c133\") " pod="openshift-multus/multus-kf7b6" Jun 03 16:33:50.424182 ip-10-0-135-67 kubenswrapper[2568]: I0603 16:33:50.423763 2568 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/4a0bbce9-a5e7-409d-af6c-911d3173c133-system-cni-dir\") pod \"multus-kf7b6\" (UID: \"4a0bbce9-a5e7-409d-af6c-911d3173c133\") " pod="openshift-multus/multus-kf7b6" Jun 03 16:33:50.424182 ip-10-0-135-67 kubenswrapper[2568]: I0603 16:33:50.423797 2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/4a0bbce9-a5e7-409d-af6c-911d3173c133-system-cni-dir\") pod \"multus-kf7b6\" (UID: \"4a0bbce9-a5e7-409d-af6c-911d3173c133\") " pod="openshift-multus/multus-kf7b6" Jun 03 16:33:50.424182 ip-10-0-135-67 kubenswrapper[2568]: I0603 16:33:50.423819 2568 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/4a0bbce9-a5e7-409d-af6c-911d3173c133-cnibin\") pod \"multus-kf7b6\" (UID: \"4a0bbce9-a5e7-409d-af6c-911d3173c133\") " pod="openshift-multus/multus-kf7b6" Jun 03 16:33:50.424182 ip-10-0-135-67 kubenswrapper[2568]: I0603 16:33:50.423829 2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"run\" (UniqueName: \"kubernetes.io/host-path/c39b8a66-ab5e-4021-aad1-575bbb72a504-run\") pod \"tuned-kpfxt\" (UID: \"c39b8a66-ab5e-4021-aad1-575bbb72a504\") " pod="openshift-cluster-node-tuning-operator/tuned-kpfxt" Jun 03 16:33:50.424182 ip-10-0-135-67 kubenswrapper[2568]: I0603 16:33:50.423850 2568 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/064d2e30-5154-4209-9774-4aa8196c55c7-registration-dir\") pod \"aws-ebs-csi-driver-node-pr68x\" (UID: \"064d2e30-5154-4209-9774-4aa8196c55c7\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-pr68x" Jun 03 16:33:50.424182 ip-10-0-135-67 kubenswrapper[2568]: I0603 16:33:50.423882 2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/4a0bbce9-a5e7-409d-af6c-911d3173c133-cnibin\") pod \"multus-kf7b6\" (UID: \"4a0bbce9-a5e7-409d-af6c-911d3173c133\") " pod="openshift-multus/multus-kf7b6" Jun 03 16:33:50.424182 ip-10-0-135-67 kubenswrapper[2568]: I0603 16:33:50.423886 2568 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/064d2e30-5154-4209-9774-4aa8196c55c7-sys-fs\") pod \"aws-ebs-csi-driver-node-pr68x\" (UID: \"064d2e30-5154-4209-9774-4aa8196c55c7\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-pr68x" Jun 03 16:33:50.424182 ip-10-0-135-67 kubenswrapper[2568]: I0603 16:33:50.423915 2568 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/dd3dac0d-018e-4c8a-98c7-daedef6dedb9-etc-openvswitch\") pod \"ovnkube-node-94fdt\" (UID: \"dd3dac0d-018e-4c8a-98c7-daedef6dedb9\") " pod="openshift-ovn-kubernetes/ovnkube-node-94fdt" Jun 03 16:33:50.424182 ip-10-0-135-67 kubenswrapper[2568]: I0603 16:33:50.423916 2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/064d2e30-5154-4209-9774-4aa8196c55c7-registration-dir\") pod \"aws-ebs-csi-driver-node-pr68x\" (UID: \"064d2e30-5154-4209-9774-4aa8196c55c7\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-pr68x" Jun 03 16:33:50.424182 ip-10-0-135-67 kubenswrapper[2568]: I0603 16:33:50.423989 2568 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/4a0bbce9-a5e7-409d-af6c-911d3173c133-host-var-lib-kubelet\") pod \"multus-kf7b6\" (UID: \"4a0bbce9-a5e7-409d-af6c-911d3173c133\") " pod="openshift-multus/multus-kf7b6" Jun 03 16:33:50.424182 ip-10-0-135-67 kubenswrapper[2568]: I0603 16:33:50.423995 2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/dd3dac0d-018e-4c8a-98c7-daedef6dedb9-etc-openvswitch\") pod \"ovnkube-node-94fdt\" (UID: \"dd3dac0d-018e-4c8a-98c7-daedef6dedb9\") " pod="openshift-ovn-kubernetes/ovnkube-node-94fdt" Jun 03 16:33:50.424182 ip-10-0-135-67 kubenswrapper[2568]: I0603 16:33:50.424045 2568 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/ce603907-50de-4706-9fa0-5edcca2ea9ea-tuning-conf-dir\") pod \"multus-additional-cni-plugins-q2q9l\" (UID: \"ce603907-50de-4706-9fa0-5edcca2ea9ea\") " pod="openshift-multus/multus-additional-cni-plugins-q2q9l" Jun 03 16:33:50.424182 ip-10-0-135-67 kubenswrapper[2568]: I0603 16:33:50.424061 2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/064d2e30-5154-4209-9774-4aa8196c55c7-sys-fs\") pod \"aws-ebs-csi-driver-node-pr68x\" (UID: \"064d2e30-5154-4209-9774-4aa8196c55c7\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-pr68x" Jun 03 16:33:50.424182 ip-10-0-135-67 kubenswrapper[2568]: I0603 16:33:50.424070 2568 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/f40f3f2b-b437-46a6-8ea2-b770ea9bd2a3-host\") pod \"node-ca-ktq4g\" (UID: \"f40f3f2b-b437-46a6-8ea2-b770ea9bd2a3\") " pod="openshift-image-registry/node-ca-ktq4g" Jun 03 16:33:50.424182 ip-10-0-135-67 kubenswrapper[2568]: I0603 16:33:50.424092 2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/d250f8ac-2da7-4c87-85e2-dad87073a681-tmp-dir\") pod \"node-resolver-wrnbf\" (UID: \"d250f8ac-2da7-4c87-85e2-dad87073a681\") " pod="openshift-dns/node-resolver-wrnbf" Jun 03 16:33:50.424182 ip-10-0-135-67 kubenswrapper[2568]: I0603 16:33:50.424098 2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/4a0bbce9-a5e7-409d-af6c-911d3173c133-host-var-lib-kubelet\") pod \"multus-kf7b6\" (UID: \"4a0bbce9-a5e7-409d-af6c-911d3173c133\") " pod="openshift-multus/multus-kf7b6" Jun 03 16:33:50.424182 ip-10-0-135-67 kubenswrapper[2568]: I0603 16:33:50.424106 2568 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/064d2e30-5154-4209-9774-4aa8196c55c7-socket-dir\") pod \"aws-ebs-csi-driver-node-pr68x\" (UID: \"064d2e30-5154-4209-9774-4aa8196c55c7\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-pr68x" Jun 03 16:33:50.424182 ip-10-0-135-67 kubenswrapper[2568]: I0603 16:33:50.424132 2568 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/ce603907-50de-4706-9fa0-5edcca2ea9ea-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-q2q9l\" (UID: \"ce603907-50de-4706-9fa0-5edcca2ea9ea\") " pod="openshift-multus/multus-additional-cni-plugins-q2q9l" Jun 03 16:33:50.424974 ip-10-0-135-67 kubenswrapper[2568]: I0603 16:33:50.424147 2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host\" (UniqueName: \"kubernetes.io/host-path/f40f3f2b-b437-46a6-8ea2-b770ea9bd2a3-host\") pod \"node-ca-ktq4g\" (UID: \"f40f3f2b-b437-46a6-8ea2-b770ea9bd2a3\") " pod="openshift-image-registry/node-ca-ktq4g" Jun 03 16:33:50.424974 ip-10-0-135-67 kubenswrapper[2568]: I0603 16:33:50.424157 2568 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/c39b8a66-ab5e-4021-aad1-575bbb72a504-etc-sysctl-d\") pod \"tuned-kpfxt\" (UID: \"c39b8a66-ab5e-4021-aad1-575bbb72a504\") " pod="openshift-cluster-node-tuning-operator/tuned-kpfxt" Jun 03 16:33:50.424974 ip-10-0-135-67 kubenswrapper[2568]: I0603 16:33:50.424179 2568 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/c39b8a66-ab5e-4021-aad1-575bbb72a504-lib-modules\") pod \"tuned-kpfxt\" (UID: \"c39b8a66-ab5e-4021-aad1-575bbb72a504\") " pod="openshift-cluster-node-tuning-operator/tuned-kpfxt" Jun 03 16:33:50.424974 ip-10-0-135-67 kubenswrapper[2568]: I0603 16:33:50.424203 2568 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/dd3dac0d-018e-4c8a-98c7-daedef6dedb9-run-systemd\") pod \"ovnkube-node-94fdt\" (UID: \"dd3dac0d-018e-4c8a-98c7-daedef6dedb9\") " pod="openshift-ovn-kubernetes/ovnkube-node-94fdt" Jun 03 16:33:50.424974 ip-10-0-135-67 kubenswrapper[2568]: I0603 16:33:50.424220 2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/ce603907-50de-4706-9fa0-5edcca2ea9ea-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-q2q9l\" (UID: \"ce603907-50de-4706-9fa0-5edcca2ea9ea\") " pod="openshift-multus/multus-additional-cni-plugins-q2q9l" Jun 03 16:33:50.424974 ip-10-0-135-67 kubenswrapper[2568]: I0603 16:33:50.424254 2568 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/dd3dac0d-018e-4c8a-98c7-daedef6dedb9-var-lib-openvswitch\") pod \"ovnkube-node-94fdt\" (UID: \"dd3dac0d-018e-4c8a-98c7-daedef6dedb9\") " pod="openshift-ovn-kubernetes/ovnkube-node-94fdt" Jun 03 16:33:50.424974 ip-10-0-135-67 kubenswrapper[2568]: I0603 16:33:50.424259 2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/ce603907-50de-4706-9fa0-5edcca2ea9ea-tuning-conf-dir\") pod \"multus-additional-cni-plugins-q2q9l\" (UID: \"ce603907-50de-4706-9fa0-5edcca2ea9ea\") " pod="openshift-multus/multus-additional-cni-plugins-q2q9l" Jun 03 16:33:50.424974 ip-10-0-135-67 kubenswrapper[2568]: I0603 16:33:50.424279 2568 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/c39b8a66-ab5e-4021-aad1-575bbb72a504-etc-sysconfig\") pod \"tuned-kpfxt\" (UID: \"c39b8a66-ab5e-4021-aad1-575bbb72a504\") " pod="openshift-cluster-node-tuning-operator/tuned-kpfxt" Jun 03 16:33:50.424974 ip-10-0-135-67 kubenswrapper[2568]: I0603 16:33:50.424298 2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/c39b8a66-ab5e-4021-aad1-575bbb72a504-etc-sysctl-d\") pod \"tuned-kpfxt\" (UID: \"c39b8a66-ab5e-4021-aad1-575bbb72a504\") " pod="openshift-cluster-node-tuning-operator/tuned-kpfxt" Jun 03 16:33:50.424974 ip-10-0-135-67 kubenswrapper[2568]: I0603 16:33:50.424302 2568 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/d250f8ac-2da7-4c87-85e2-dad87073a681-hosts-file\") pod \"node-resolver-wrnbf\" (UID: \"d250f8ac-2da7-4c87-85e2-dad87073a681\") " pod="openshift-dns/node-resolver-wrnbf" Jun 03 16:33:50.424974 ip-10-0-135-67 kubenswrapper[2568]: I0603 16:33:50.424334 2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/dd3dac0d-018e-4c8a-98c7-daedef6dedb9-run-systemd\") pod \"ovnkube-node-94fdt\" (UID: \"dd3dac0d-018e-4c8a-98c7-daedef6dedb9\") " pod="openshift-ovn-kubernetes/ovnkube-node-94fdt" Jun 03 16:33:50.424974 ip-10-0-135-67 kubenswrapper[2568]: I0603 16:33:50.424342 2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/064d2e30-5154-4209-9774-4aa8196c55c7-socket-dir\") pod \"aws-ebs-csi-driver-node-pr68x\" (UID: \"064d2e30-5154-4209-9774-4aa8196c55c7\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-pr68x" Jun 03 16:33:50.424974 ip-10-0-135-67 kubenswrapper[2568]: I0603 16:33:50.424345 2568 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/064d2e30-5154-4209-9774-4aa8196c55c7-device-dir\") pod \"aws-ebs-csi-driver-node-pr68x\" (UID: \"064d2e30-5154-4209-9774-4aa8196c55c7\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-pr68x" Jun 03 16:33:50.424974 ip-10-0-135-67 kubenswrapper[2568]: I0603 16:33:50.424384 2568 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/ce603907-50de-4706-9fa0-5edcca2ea9ea-os-release\") pod \"multus-additional-cni-plugins-q2q9l\" (UID: \"ce603907-50de-4706-9fa0-5edcca2ea9ea\") " pod="openshift-multus/multus-additional-cni-plugins-q2q9l" Jun 03 16:33:50.424974 ip-10-0-135-67 kubenswrapper[2568]: I0603 16:33:50.424411 2568 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/dd3dac0d-018e-4c8a-98c7-daedef6dedb9-env-overrides\") pod \"ovnkube-node-94fdt\" (UID: \"dd3dac0d-018e-4c8a-98c7-daedef6dedb9\") " pod="openshift-ovn-kubernetes/ovnkube-node-94fdt" Jun 03 16:33:50.424974 ip-10-0-135-67 kubenswrapper[2568]: I0603 16:33:50.424429 2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/dd3dac0d-018e-4c8a-98c7-daedef6dedb9-var-lib-openvswitch\") pod \"ovnkube-node-94fdt\" (UID: \"dd3dac0d-018e-4c8a-98c7-daedef6dedb9\") " pod="openshift-ovn-kubernetes/ovnkube-node-94fdt" Jun 03 16:33:50.424974 ip-10-0-135-67 kubenswrapper[2568]: I0603 16:33:50.424436 2568 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/4a0bbce9-a5e7-409d-af6c-911d3173c133-host-run-k8s-cni-cncf-io\") pod \"multus-kf7b6\" (UID: \"4a0bbce9-a5e7-409d-af6c-911d3173c133\") " pod="openshift-multus/multus-kf7b6" Jun 03 16:33:50.425810 ip-10-0-135-67 kubenswrapper[2568]: I0603 16:33:50.424387 2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/064d2e30-5154-4209-9774-4aa8196c55c7-device-dir\") pod \"aws-ebs-csi-driver-node-pr68x\" (UID: \"064d2e30-5154-4209-9774-4aa8196c55c7\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-pr68x" Jun 03 16:33:50.425810 ip-10-0-135-67 kubenswrapper[2568]: I0603 16:33:50.424451 2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/c39b8a66-ab5e-4021-aad1-575bbb72a504-lib-modules\") pod \"tuned-kpfxt\" (UID: \"c39b8a66-ab5e-4021-aad1-575bbb72a504\") " pod="openshift-cluster-node-tuning-operator/tuned-kpfxt" Jun 03 16:33:50.425810 ip-10-0-135-67 kubenswrapper[2568]: I0603 16:33:50.424460 2568 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/4a0bbce9-a5e7-409d-af6c-911d3173c133-multus-conf-dir\") pod \"multus-kf7b6\" (UID: \"4a0bbce9-a5e7-409d-af6c-911d3173c133\") " pod="openshift-multus/multus-kf7b6" Jun 03 16:33:50.425810 ip-10-0-135-67 kubenswrapper[2568]: I0603 16:33:50.424485 2568 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/4a0bbce9-a5e7-409d-af6c-911d3173c133-multus-daemon-config\") pod \"multus-kf7b6\" (UID: \"4a0bbce9-a5e7-409d-af6c-911d3173c133\") " pod="openshift-multus/multus-kf7b6" Jun 03 16:33:50.425810 ip-10-0-135-67 kubenswrapper[2568]: I0603 16:33:50.424510 2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/ce603907-50de-4706-9fa0-5edcca2ea9ea-os-release\") pod \"multus-additional-cni-plugins-q2q9l\" (UID: \"ce603907-50de-4706-9fa0-5edcca2ea9ea\") " pod="openshift-multus/multus-additional-cni-plugins-q2q9l" Jun 03 16:33:50.425810 ip-10-0-135-67 kubenswrapper[2568]: I0603 16:33:50.424510 2568 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-qcl58\" (UniqueName: \"kubernetes.io/projected/eeccbde1-c0af-4476-bffb-29e92945d422-kube-api-access-qcl58\") pod \"iptables-alerter-hnms9\" (UID: \"eeccbde1-c0af-4476-bffb-29e92945d422\") " pod="openshift-network-operator/iptables-alerter-hnms9" Jun 03 16:33:50.425810 ip-10-0-135-67 kubenswrapper[2568]: I0603 16:33:50.424551 2568 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/c39b8a66-ab5e-4021-aad1-575bbb72a504-etc-sysctl-conf\") pod \"tuned-kpfxt\" (UID: \"c39b8a66-ab5e-4021-aad1-575bbb72a504\") " pod="openshift-cluster-node-tuning-operator/tuned-kpfxt" Jun 03 16:33:50.425810 ip-10-0-135-67 kubenswrapper[2568]: I0603 16:33:50.424576 2568 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/f40f3f2b-b437-46a6-8ea2-b770ea9bd2a3-serviceca\") pod \"node-ca-ktq4g\" (UID: \"f40f3f2b-b437-46a6-8ea2-b770ea9bd2a3\") " pod="openshift-image-registry/node-ca-ktq4g" Jun 03 16:33:50.425810 ip-10-0-135-67 kubenswrapper[2568]: I0603 16:33:50.424605 2568 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/dd3dac0d-018e-4c8a-98c7-daedef6dedb9-systemd-units\") pod \"ovnkube-node-94fdt\" (UID: \"dd3dac0d-018e-4c8a-98c7-daedef6dedb9\") " pod="openshift-ovn-kubernetes/ovnkube-node-94fdt" Jun 03 16:33:50.425810 ip-10-0-135-67 kubenswrapper[2568]: I0603 16:33:50.424631 2568 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/dd3dac0d-018e-4c8a-98c7-daedef6dedb9-host-run-ovn-kubernetes\") pod \"ovnkube-node-94fdt\" (UID: \"dd3dac0d-018e-4c8a-98c7-daedef6dedb9\") " pod="openshift-ovn-kubernetes/ovnkube-node-94fdt" Jun 03 16:33:50.425810 ip-10-0-135-67 kubenswrapper[2568]: I0603 16:33:50.424761 2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/4a0bbce9-a5e7-409d-af6c-911d3173c133-host-run-k8s-cni-cncf-io\") pod \"multus-kf7b6\" (UID: \"4a0bbce9-a5e7-409d-af6c-911d3173c133\") " pod="openshift-multus/multus-kf7b6" Jun 03 16:33:50.425810 ip-10-0-135-67 kubenswrapper[2568]: I0603 16:33:50.424811 2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/4a0bbce9-a5e7-409d-af6c-911d3173c133-multus-conf-dir\") pod \"multus-kf7b6\" (UID: \"4a0bbce9-a5e7-409d-af6c-911d3173c133\") " pod="openshift-multus/multus-kf7b6" Jun 03 16:33:50.425810 ip-10-0-135-67 kubenswrapper[2568]: I0603 16:33:50.424348 2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/d250f8ac-2da7-4c87-85e2-dad87073a681-hosts-file\") pod \"node-resolver-wrnbf\" (UID: \"d250f8ac-2da7-4c87-85e2-dad87073a681\") " pod="openshift-dns/node-resolver-wrnbf" Jun 03 16:33:50.425810 ip-10-0-135-67 kubenswrapper[2568]: I0603 16:33:50.424871 2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/dd3dac0d-018e-4c8a-98c7-daedef6dedb9-env-overrides\") pod \"ovnkube-node-94fdt\" (UID: \"dd3dac0d-018e-4c8a-98c7-daedef6dedb9\") " pod="openshift-ovn-kubernetes/ovnkube-node-94fdt" Jun 03 16:33:50.425810 ip-10-0-135-67 kubenswrapper[2568]: I0603 16:33:50.424918 2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/c39b8a66-ab5e-4021-aad1-575bbb72a504-etc-sysconfig\") pod \"tuned-kpfxt\" (UID: \"c39b8a66-ab5e-4021-aad1-575bbb72a504\") " pod="openshift-cluster-node-tuning-operator/tuned-kpfxt" Jun 03 16:33:50.425810 ip-10-0-135-67 kubenswrapper[2568]: I0603 16:33:50.425025 2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/c39b8a66-ab5e-4021-aad1-575bbb72a504-etc-sysctl-conf\") pod \"tuned-kpfxt\" (UID: \"c39b8a66-ab5e-4021-aad1-575bbb72a504\") " pod="openshift-cluster-node-tuning-operator/tuned-kpfxt" Jun 03 16:33:50.425810 ip-10-0-135-67 kubenswrapper[2568]: I0603 16:33:50.425063 2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/dd3dac0d-018e-4c8a-98c7-daedef6dedb9-systemd-units\") pod \"ovnkube-node-94fdt\" (UID: \"dd3dac0d-018e-4c8a-98c7-daedef6dedb9\") " pod="openshift-ovn-kubernetes/ovnkube-node-94fdt" Jun 03 16:33:50.426665 ip-10-0-135-67 kubenswrapper[2568]: I0603 16:33:50.424658 2568 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/dd3dac0d-018e-4c8a-98c7-daedef6dedb9-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-94fdt\" (UID: \"dd3dac0d-018e-4c8a-98c7-daedef6dedb9\") " pod="openshift-ovn-kubernetes/ovnkube-node-94fdt" Jun 03 16:33:50.426665 ip-10-0-135-67 kubenswrapper[2568]: I0603 16:33:50.425104 2568 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-nbdjp\" (UniqueName: \"kubernetes.io/projected/dd3dac0d-018e-4c8a-98c7-daedef6dedb9-kube-api-access-nbdjp\") pod \"ovnkube-node-94fdt\" (UID: \"dd3dac0d-018e-4c8a-98c7-daedef6dedb9\") " pod="openshift-ovn-kubernetes/ovnkube-node-94fdt" Jun 03 16:33:50.426665 ip-10-0-135-67 kubenswrapper[2568]: I0603 16:33:50.425125 2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/dd3dac0d-018e-4c8a-98c7-daedef6dedb9-host-run-ovn-kubernetes\") pod \"ovnkube-node-94fdt\" (UID: \"dd3dac0d-018e-4c8a-98c7-daedef6dedb9\") " pod="openshift-ovn-kubernetes/ovnkube-node-94fdt" Jun 03 16:33:50.426665 ip-10-0-135-67 kubenswrapper[2568]: I0603 16:33:50.425128 2568 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/eeccbde1-c0af-4476-bffb-29e92945d422-host-slash\") pod \"iptables-alerter-hnms9\" (UID: \"eeccbde1-c0af-4476-bffb-29e92945d422\") " pod="openshift-network-operator/iptables-alerter-hnms9" Jun 03 16:33:50.426665 ip-10-0-135-67 kubenswrapper[2568]: I0603 16:33:50.425164 2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/eeccbde1-c0af-4476-bffb-29e92945d422-host-slash\") pod \"iptables-alerter-hnms9\" (UID: \"eeccbde1-c0af-4476-bffb-29e92945d422\") " pod="openshift-network-operator/iptables-alerter-hnms9" Jun 03 16:33:50.426665 ip-10-0-135-67 kubenswrapper[2568]: I0603 16:33:50.425170 2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/ce603907-50de-4706-9fa0-5edcca2ea9ea-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-q2q9l\" (UID: \"ce603907-50de-4706-9fa0-5edcca2ea9ea\") " pod="openshift-multus/multus-additional-cni-plugins-q2q9l" Jun 03 16:33:50.426665 ip-10-0-135-67 kubenswrapper[2568]: I0603 16:33:50.425182 2568 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/c39b8a66-ab5e-4021-aad1-575bbb72a504-sys\") pod \"tuned-kpfxt\" (UID: \"c39b8a66-ab5e-4021-aad1-575bbb72a504\") " pod="openshift-cluster-node-tuning-operator/tuned-kpfxt" Jun 03 16:33:50.426665 ip-10-0-135-67 kubenswrapper[2568]: I0603 16:33:50.425217 2568 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/dd3dac0d-018e-4c8a-98c7-daedef6dedb9-node-log\") pod \"ovnkube-node-94fdt\" (UID: \"dd3dac0d-018e-4c8a-98c7-daedef6dedb9\") " pod="openshift-ovn-kubernetes/ovnkube-node-94fdt" Jun 03 16:33:50.426665 ip-10-0-135-67 kubenswrapper[2568]: I0603 16:33:50.425224 2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/c39b8a66-ab5e-4021-aad1-575bbb72a504-sys\") pod \"tuned-kpfxt\" (UID: \"c39b8a66-ab5e-4021-aad1-575bbb72a504\") " pod="openshift-cluster-node-tuning-operator/tuned-kpfxt" Jun 03 16:33:50.426665 ip-10-0-135-67 kubenswrapper[2568]: I0603 16:33:50.425244 2568 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/dd3dac0d-018e-4c8a-98c7-daedef6dedb9-ovnkube-config\") pod \"ovnkube-node-94fdt\" (UID: \"dd3dac0d-018e-4c8a-98c7-daedef6dedb9\") " pod="openshift-ovn-kubernetes/ovnkube-node-94fdt" Jun 03 16:33:50.426665 ip-10-0-135-67 kubenswrapper[2568]: I0603 16:33:50.425254 2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/f40f3f2b-b437-46a6-8ea2-b770ea9bd2a3-serviceca\") pod \"node-ca-ktq4g\" (UID: \"f40f3f2b-b437-46a6-8ea2-b770ea9bd2a3\") " pod="openshift-image-registry/node-ca-ktq4g" Jun 03 16:33:50.426665 ip-10-0-135-67 kubenswrapper[2568]: I0603 16:33:50.425264 2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/dd3dac0d-018e-4c8a-98c7-daedef6dedb9-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-94fdt\" (UID: \"dd3dac0d-018e-4c8a-98c7-daedef6dedb9\") " pod="openshift-ovn-kubernetes/ovnkube-node-94fdt" Jun 03 16:33:50.426665 ip-10-0-135-67 kubenswrapper[2568]: I0603 16:33:50.425269 2568 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/dd3dac0d-018e-4c8a-98c7-daedef6dedb9-ovn-node-metrics-cert\") pod \"ovnkube-node-94fdt\" (UID: \"dd3dac0d-018e-4c8a-98c7-daedef6dedb9\") " pod="openshift-ovn-kubernetes/ovnkube-node-94fdt" Jun 03 16:33:50.426665 ip-10-0-135-67 kubenswrapper[2568]: I0603 16:33:50.425298 2568 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/ce603907-50de-4706-9fa0-5edcca2ea9ea-cnibin\") pod \"multus-additional-cni-plugins-q2q9l\" (UID: \"ce603907-50de-4706-9fa0-5edcca2ea9ea\") " pod="openshift-multus/multus-additional-cni-plugins-q2q9l" Jun 03 16:33:50.426665 ip-10-0-135-67 kubenswrapper[2568]: I0603 16:33:50.425323 2568 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/ce603907-50de-4706-9fa0-5edcca2ea9ea-cni-binary-copy\") pod \"multus-additional-cni-plugins-q2q9l\" (UID: \"ce603907-50de-4706-9fa0-5edcca2ea9ea\") " pod="openshift-multus/multus-additional-cni-plugins-q2q9l" Jun 03 16:33:50.426665 ip-10-0-135-67 kubenswrapper[2568]: I0603 16:33:50.425332 2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/4a0bbce9-a5e7-409d-af6c-911d3173c133-multus-daemon-config\") pod \"multus-kf7b6\" (UID: \"4a0bbce9-a5e7-409d-af6c-911d3173c133\") " pod="openshift-multus/multus-kf7b6" Jun 03 16:33:50.426665 ip-10-0-135-67 kubenswrapper[2568]: I0603 16:33:50.425353 2568 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/dd3dac0d-018e-4c8a-98c7-daedef6dedb9-run-openvswitch\") pod \"ovnkube-node-94fdt\" (UID: \"dd3dac0d-018e-4c8a-98c7-daedef6dedb9\") " pod="openshift-ovn-kubernetes/ovnkube-node-94fdt" Jun 03 16:33:50.427468 ip-10-0-135-67 kubenswrapper[2568]: I0603 16:33:50.425387 2568 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/c39b8a66-ab5e-4021-aad1-575bbb72a504-etc-systemd\") pod \"tuned-kpfxt\" (UID: \"c39b8a66-ab5e-4021-aad1-575bbb72a504\") " pod="openshift-cluster-node-tuning-operator/tuned-kpfxt" Jun 03 16:33:50.427468 ip-10-0-135-67 kubenswrapper[2568]: I0603 16:33:50.425389 2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/ce603907-50de-4706-9fa0-5edcca2ea9ea-cnibin\") pod \"multus-additional-cni-plugins-q2q9l\" (UID: \"ce603907-50de-4706-9fa0-5edcca2ea9ea\") " pod="openshift-multus/multus-additional-cni-plugins-q2q9l" Jun 03 16:33:50.427468 ip-10-0-135-67 kubenswrapper[2568]: I0603 16:33:50.425413 2568 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/c39b8a66-ab5e-4021-aad1-575bbb72a504-var-lib-kubelet\") pod \"tuned-kpfxt\" (UID: \"c39b8a66-ab5e-4021-aad1-575bbb72a504\") " pod="openshift-cluster-node-tuning-operator/tuned-kpfxt" Jun 03 16:33:50.427468 ip-10-0-135-67 kubenswrapper[2568]: I0603 16:33:50.425438 2568 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/c39b8a66-ab5e-4021-aad1-575bbb72a504-etc-tuned\") pod \"tuned-kpfxt\" (UID: \"c39b8a66-ab5e-4021-aad1-575bbb72a504\") " pod="openshift-cluster-node-tuning-operator/tuned-kpfxt" Jun 03 16:33:50.427468 ip-10-0-135-67 kubenswrapper[2568]: I0603 16:33:50.425449 2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/dd3dac0d-018e-4c8a-98c7-daedef6dedb9-run-openvswitch\") pod \"ovnkube-node-94fdt\" (UID: \"dd3dac0d-018e-4c8a-98c7-daedef6dedb9\") " pod="openshift-ovn-kubernetes/ovnkube-node-94fdt" Jun 03 16:33:50.427468 ip-10-0-135-67 kubenswrapper[2568]: I0603 16:33:50.425469 2568 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-b2vzb\" (UniqueName: \"kubernetes.io/projected/f40f3f2b-b437-46a6-8ea2-b770ea9bd2a3-kube-api-access-b2vzb\") pod \"node-ca-ktq4g\" (UID: \"f40f3f2b-b437-46a6-8ea2-b770ea9bd2a3\") " pod="openshift-image-registry/node-ca-ktq4g" Jun 03 16:33:50.427468 ip-10-0-135-67 kubenswrapper[2568]: I0603 16:33:50.425497 2568 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/064d2e30-5154-4209-9774-4aa8196c55c7-kubelet-dir\") pod \"aws-ebs-csi-driver-node-pr68x\" (UID: \"064d2e30-5154-4209-9774-4aa8196c55c7\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-pr68x" Jun 03 16:33:50.427468 ip-10-0-135-67 kubenswrapper[2568]: I0603 16:33:50.425506 2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/c39b8a66-ab5e-4021-aad1-575bbb72a504-var-lib-kubelet\") pod \"tuned-kpfxt\" (UID: \"c39b8a66-ab5e-4021-aad1-575bbb72a504\") " pod="openshift-cluster-node-tuning-operator/tuned-kpfxt" Jun 03 16:33:50.427468 ip-10-0-135-67 kubenswrapper[2568]: I0603 16:33:50.425525 2568 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-t72ww\" (UniqueName: \"kubernetes.io/projected/ddc210bb-9544-4ca7-b2de-f84c92d84510-kube-api-access-t72ww\") pod \"network-metrics-daemon-54gnw\" (UID: \"ddc210bb-9544-4ca7-b2de-f84c92d84510\") " pod="openshift-multus/network-metrics-daemon-54gnw" Jun 03 16:33:50.427468 ip-10-0-135-67 kubenswrapper[2568]: I0603 16:33:50.425551 2568 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/dd3dac0d-018e-4c8a-98c7-daedef6dedb9-host-run-netns\") pod \"ovnkube-node-94fdt\" (UID: \"dd3dac0d-018e-4c8a-98c7-daedef6dedb9\") " pod="openshift-ovn-kubernetes/ovnkube-node-94fdt" Jun 03 16:33:50.427468 ip-10-0-135-67 kubenswrapper[2568]: I0603 16:33:50.425551 2568 swap_util.go:74] "error creating dir to test if tmpfs noswap is enabled. Assuming not supported" mount path="" error="stat /var/lib/kubelet/plugins/kubernetes.io/empty-dir: no such file or directory" Jun 03 16:33:50.427468 ip-10-0-135-67 kubenswrapper[2568]: I0603 16:33:50.425412 2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/dd3dac0d-018e-4c8a-98c7-daedef6dedb9-node-log\") pod \"ovnkube-node-94fdt\" (UID: \"dd3dac0d-018e-4c8a-98c7-daedef6dedb9\") " pod="openshift-ovn-kubernetes/ovnkube-node-94fdt" Jun 03 16:33:50.427468 ip-10-0-135-67 kubenswrapper[2568]: I0603 16:33:50.425601 2568 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-4kbgz\" (UniqueName: \"kubernetes.io/projected/4a0bbce9-a5e7-409d-af6c-911d3173c133-kube-api-access-4kbgz\") pod \"multus-kf7b6\" (UID: \"4a0bbce9-a5e7-409d-af6c-911d3173c133\") " pod="openshift-multus/multus-kf7b6" Jun 03 16:33:50.427468 ip-10-0-135-67 kubenswrapper[2568]: I0603 16:33:50.425627 2568 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/969318db-7cb1-4ad5-99f2-66d7f803c8a3-agent-certs\") pod \"konnectivity-agent-vcz76\" (UID: \"969318db-7cb1-4ad5-99f2-66d7f803c8a3\") " pod="kube-system/konnectivity-agent-vcz76" Jun 03 16:33:50.427468 ip-10-0-135-67 kubenswrapper[2568]: I0603 16:33:50.425655 2568 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-j5m84\" (UniqueName: \"kubernetes.io/projected/d250f8ac-2da7-4c87-85e2-dad87073a681-kube-api-access-j5m84\") pod \"node-resolver-wrnbf\" (UID: \"d250f8ac-2da7-4c87-85e2-dad87073a681\") " pod="openshift-dns/node-resolver-wrnbf" Jun 03 16:33:50.427468 ip-10-0-135-67 kubenswrapper[2568]: I0603 16:33:50.425701 2568 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/ddc210bb-9544-4ca7-b2de-f84c92d84510-metrics-certs\") pod \"network-metrics-daemon-54gnw\" (UID: \"ddc210bb-9544-4ca7-b2de-f84c92d84510\") " pod="openshift-multus/network-metrics-daemon-54gnw" Jun 03 16:33:50.427468 ip-10-0-135-67 kubenswrapper[2568]: I0603 16:33:50.425726 2568 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/4a0bbce9-a5e7-409d-af6c-911d3173c133-host-run-netns\") pod \"multus-kf7b6\" (UID: \"4a0bbce9-a5e7-409d-af6c-911d3173c133\") " pod="openshift-multus/multus-kf7b6" Jun 03 16:33:50.427468 ip-10-0-135-67 kubenswrapper[2568]: I0603 16:33:50.425751 2568 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/969318db-7cb1-4ad5-99f2-66d7f803c8a3-konnectivity-ca\") pod \"konnectivity-agent-vcz76\" (UID: \"969318db-7cb1-4ad5-99f2-66d7f803c8a3\") " pod="kube-system/konnectivity-agent-vcz76" Jun 03 16:33:50.428269 ip-10-0-135-67 kubenswrapper[2568]: I0603 16:33:50.425796 2568 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/c39b8a66-ab5e-4021-aad1-575bbb72a504-tmp\") pod \"tuned-kpfxt\" (UID: \"c39b8a66-ab5e-4021-aad1-575bbb72a504\") " pod="openshift-cluster-node-tuning-operator/tuned-kpfxt" Jun 03 16:33:50.428269 ip-10-0-135-67 kubenswrapper[2568]: I0603 16:33:50.425824 2568 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/dd3dac0d-018e-4c8a-98c7-daedef6dedb9-ovnkube-script-lib\") pod \"ovnkube-node-94fdt\" (UID: \"dd3dac0d-018e-4c8a-98c7-daedef6dedb9\") " pod="openshift-ovn-kubernetes/ovnkube-node-94fdt" Jun 03 16:33:50.428269 ip-10-0-135-67 kubenswrapper[2568]: I0603 16:33:50.425851 2568 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/c39b8a66-ab5e-4021-aad1-575bbb72a504-etc-kubernetes\") pod \"tuned-kpfxt\" (UID: \"c39b8a66-ab5e-4021-aad1-575bbb72a504\") " pod="openshift-cluster-node-tuning-operator/tuned-kpfxt" Jun 03 16:33:50.428269 ip-10-0-135-67 kubenswrapper[2568]: I0603 16:33:50.425869 2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/dd3dac0d-018e-4c8a-98c7-daedef6dedb9-ovnkube-config\") pod \"ovnkube-node-94fdt\" (UID: \"dd3dac0d-018e-4c8a-98c7-daedef6dedb9\") " pod="openshift-ovn-kubernetes/ovnkube-node-94fdt" Jun 03 16:33:50.428269 ip-10-0-135-67 kubenswrapper[2568]: I0603 16:33:50.425884 2568 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-9dsxq\" (UniqueName: \"kubernetes.io/projected/c39b8a66-ab5e-4021-aad1-575bbb72a504-kube-api-access-9dsxq\") pod \"tuned-kpfxt\" (UID: \"c39b8a66-ab5e-4021-aad1-575bbb72a504\") " pod="openshift-cluster-node-tuning-operator/tuned-kpfxt" Jun 03 16:33:50.428269 ip-10-0-135-67 kubenswrapper[2568]: I0603 16:33:50.425899 2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/ce603907-50de-4706-9fa0-5edcca2ea9ea-cni-binary-copy\") pod \"multus-additional-cni-plugins-q2q9l\" (UID: \"ce603907-50de-4706-9fa0-5edcca2ea9ea\") " pod="openshift-multus/multus-additional-cni-plugins-q2q9l" Jun 03 16:33:50.428269 ip-10-0-135-67 kubenswrapper[2568]: I0603 16:33:50.425914 2568 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/064d2e30-5154-4209-9774-4aa8196c55c7-etc-selinux\") pod \"aws-ebs-csi-driver-node-pr68x\" (UID: \"064d2e30-5154-4209-9774-4aa8196c55c7\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-pr68x" Jun 03 16:33:50.428269 ip-10-0-135-67 kubenswrapper[2568]: I0603 16:33:50.425939 2568 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/4a0bbce9-a5e7-409d-af6c-911d3173c133-os-release\") pod \"multus-kf7b6\" (UID: \"4a0bbce9-a5e7-409d-af6c-911d3173c133\") " pod="openshift-multus/multus-kf7b6" Jun 03 16:33:50.428269 ip-10-0-135-67 kubenswrapper[2568]: I0603 16:33:50.425987 2568 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/4a0bbce9-a5e7-409d-af6c-911d3173c133-cni-binary-copy\") pod \"multus-kf7b6\" (UID: \"4a0bbce9-a5e7-409d-af6c-911d3173c133\") " pod="openshift-multus/multus-kf7b6" Jun 03 16:33:50.428269 ip-10-0-135-67 kubenswrapper[2568]: I0603 16:33:50.426031 2568 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/ce603907-50de-4706-9fa0-5edcca2ea9ea-system-cni-dir\") pod \"multus-additional-cni-plugins-q2q9l\" (UID: \"ce603907-50de-4706-9fa0-5edcca2ea9ea\") " pod="openshift-multus/multus-additional-cni-plugins-q2q9l" Jun 03 16:33:50.428269 ip-10-0-135-67 kubenswrapper[2568]: I0603 16:33:50.426059 2568 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/c39b8a66-ab5e-4021-aad1-575bbb72a504-host\") pod \"tuned-kpfxt\" (UID: \"c39b8a66-ab5e-4021-aad1-575bbb72a504\") " pod="openshift-cluster-node-tuning-operator/tuned-kpfxt" Jun 03 16:33:50.428269 ip-10-0-135-67 kubenswrapper[2568]: I0603 16:33:50.426088 2568 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-cr28s\" (UniqueName: \"kubernetes.io/projected/064d2e30-5154-4209-9774-4aa8196c55c7-kube-api-access-cr28s\") pod \"aws-ebs-csi-driver-node-pr68x\" (UID: \"064d2e30-5154-4209-9774-4aa8196c55c7\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-pr68x" Jun 03 16:33:50.428269 ip-10-0-135-67 kubenswrapper[2568]: I0603 16:33:50.426118 2568 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/dd3dac0d-018e-4c8a-98c7-daedef6dedb9-run-ovn\") pod \"ovnkube-node-94fdt\" (UID: \"dd3dac0d-018e-4c8a-98c7-daedef6dedb9\") " pod="openshift-ovn-kubernetes/ovnkube-node-94fdt" Jun 03 16:33:50.428269 ip-10-0-135-67 kubenswrapper[2568]: I0603 16:33:50.426153 2568 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/dd3dac0d-018e-4c8a-98c7-daedef6dedb9-log-socket\") pod \"ovnkube-node-94fdt\" (UID: \"dd3dac0d-018e-4c8a-98c7-daedef6dedb9\") " pod="openshift-ovn-kubernetes/ovnkube-node-94fdt" Jun 03 16:33:50.428269 ip-10-0-135-67 kubenswrapper[2568]: I0603 16:33:50.426182 2568 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/4a0bbce9-a5e7-409d-af6c-911d3173c133-multus-cni-dir\") pod \"multus-kf7b6\" (UID: \"4a0bbce9-a5e7-409d-af6c-911d3173c133\") " pod="openshift-multus/multus-kf7b6" Jun 03 16:33:50.428269 ip-10-0-135-67 kubenswrapper[2568]: I0603 16:33:50.426180 2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/dd3dac0d-018e-4c8a-98c7-daedef6dedb9-host-run-netns\") pod \"ovnkube-node-94fdt\" (UID: \"dd3dac0d-018e-4c8a-98c7-daedef6dedb9\") " pod="openshift-ovn-kubernetes/ovnkube-node-94fdt" Jun 03 16:33:50.428269 ip-10-0-135-67 kubenswrapper[2568]: I0603 16:33:50.426793 2568 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/4a0bbce9-a5e7-409d-af6c-911d3173c133-hostroot\") pod \"multus-kf7b6\" (UID: \"4a0bbce9-a5e7-409d-af6c-911d3173c133\") " pod="openshift-multus/multus-kf7b6" Jun 03 16:33:50.428269 ip-10-0-135-67 kubenswrapper[2568]: E0603 16:33:50.426900 2568 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jun 03 16:33:50.437745 ip-10-0-135-67 kubenswrapper[2568]: E0603 16:33:50.427026 2568 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/ddc210bb-9544-4ca7-b2de-f84c92d84510-metrics-certs podName:ddc210bb-9544-4ca7-b2de-f84c92d84510 nodeName:}" failed. No retries permitted until 2026-06-03 16:33:50.926965619 +0000 UTC m=+3.069140267 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/ddc210bb-9544-4ca7-b2de-f84c92d84510-metrics-certs") pod "network-metrics-daemon-54gnw" (UID: "ddc210bb-9544-4ca7-b2de-f84c92d84510") : object "openshift-multus"/"metrics-daemon-secret" not registered Jun 03 16:33:50.437745 ip-10-0-135-67 kubenswrapper[2568]: I0603 16:33:50.427211 2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/4a0bbce9-a5e7-409d-af6c-911d3173c133-host-run-netns\") pod \"multus-kf7b6\" (UID: \"4a0bbce9-a5e7-409d-af6c-911d3173c133\") " pod="openshift-multus/multus-kf7b6" Jun 03 16:33:50.437745 ip-10-0-135-67 kubenswrapper[2568]: I0603 16:33:50.427352 2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/4a0bbce9-a5e7-409d-af6c-911d3173c133-hostroot\") pod \"multus-kf7b6\" (UID: \"4a0bbce9-a5e7-409d-af6c-911d3173c133\") " pod="openshift-multus/multus-kf7b6" Jun 03 16:33:50.437745 ip-10-0-135-67 kubenswrapper[2568]: I0603 16:33:50.427776 2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/969318db-7cb1-4ad5-99f2-66d7f803c8a3-konnectivity-ca\") pod \"konnectivity-agent-vcz76\" (UID: \"969318db-7cb1-4ad5-99f2-66d7f803c8a3\") " pod="kube-system/konnectivity-agent-vcz76" Jun 03 16:33:50.437745 ip-10-0-135-67 kubenswrapper[2568]: I0603 16:33:50.427832 2568 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/4a0bbce9-a5e7-409d-af6c-911d3173c133-etc-kubernetes\") pod \"multus-kf7b6\" (UID: \"4a0bbce9-a5e7-409d-af6c-911d3173c133\") " pod="openshift-multus/multus-kf7b6" Jun 03 16:33:50.437745 ip-10-0-135-67 kubenswrapper[2568]: I0603 16:33:50.427873 2568 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-f9xg6\" (UniqueName: \"kubernetes.io/projected/ce603907-50de-4706-9fa0-5edcca2ea9ea-kube-api-access-f9xg6\") pod \"multus-additional-cni-plugins-q2q9l\" (UID: \"ce603907-50de-4706-9fa0-5edcca2ea9ea\") " pod="openshift-multus/multus-additional-cni-plugins-q2q9l" Jun 03 16:33:50.437745 ip-10-0-135-67 kubenswrapper[2568]: I0603 16:33:50.427903 2568 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/c39b8a66-ab5e-4021-aad1-575bbb72a504-etc-modprobe-d\") pod \"tuned-kpfxt\" (UID: \"c39b8a66-ab5e-4021-aad1-575bbb72a504\") " pod="openshift-cluster-node-tuning-operator/tuned-kpfxt" Jun 03 16:33:50.437745 ip-10-0-135-67 kubenswrapper[2568]: I0603 16:33:50.427938 2568 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/dd3dac0d-018e-4c8a-98c7-daedef6dedb9-host-kubelet\") pod \"ovnkube-node-94fdt\" (UID: \"dd3dac0d-018e-4c8a-98c7-daedef6dedb9\") " pod="openshift-ovn-kubernetes/ovnkube-node-94fdt" Jun 03 16:33:50.437745 ip-10-0-135-67 kubenswrapper[2568]: I0603 16:33:50.427974 2568 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/4a0bbce9-a5e7-409d-af6c-911d3173c133-host-var-lib-cni-bin\") pod \"multus-kf7b6\" (UID: \"4a0bbce9-a5e7-409d-af6c-911d3173c133\") " pod="openshift-multus/multus-kf7b6" Jun 03 16:33:50.437745 ip-10-0-135-67 kubenswrapper[2568]: I0603 16:33:50.428030 2568 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/4a0bbce9-a5e7-409d-af6c-911d3173c133-host-run-multus-certs\") pod \"multus-kf7b6\" (UID: \"4a0bbce9-a5e7-409d-af6c-911d3173c133\") " pod="openshift-multus/multus-kf7b6" Jun 03 16:33:50.437745 ip-10-0-135-67 kubenswrapper[2568]: I0603 16:33:50.428069 2568 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/eeccbde1-c0af-4476-bffb-29e92945d422-iptables-alerter-script\") pod \"iptables-alerter-hnms9\" (UID: \"eeccbde1-c0af-4476-bffb-29e92945d422\") " pod="openshift-network-operator/iptables-alerter-hnms9" Jun 03 16:33:50.437745 ip-10-0-135-67 kubenswrapper[2568]: I0603 16:33:50.428102 2568 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-gwzmz\" (UniqueName: \"kubernetes.io/projected/4a9428e9-7e73-44e5-ab4e-8dcb9028335e-kube-api-access-gwzmz\") pod \"network-check-target-569p4\" (UID: \"4a9428e9-7e73-44e5-ab4e-8dcb9028335e\") " pod="openshift-network-diagnostics/network-check-target-569p4" Jun 03 16:33:50.437745 ip-10-0-135-67 kubenswrapper[2568]: I0603 16:33:50.425554 2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/c39b8a66-ab5e-4021-aad1-575bbb72a504-etc-systemd\") pod \"tuned-kpfxt\" (UID: \"c39b8a66-ab5e-4021-aad1-575bbb72a504\") " pod="openshift-cluster-node-tuning-operator/tuned-kpfxt" Jun 03 16:33:50.437745 ip-10-0-135-67 kubenswrapper[2568]: I0603 16:33:50.428138 2568 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/dd3dac0d-018e-4c8a-98c7-daedef6dedb9-host-slash\") pod \"ovnkube-node-94fdt\" (UID: \"dd3dac0d-018e-4c8a-98c7-daedef6dedb9\") " pod="openshift-ovn-kubernetes/ovnkube-node-94fdt" Jun 03 16:33:50.437745 ip-10-0-135-67 kubenswrapper[2568]: I0603 16:33:50.428157 2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/c39b8a66-ab5e-4021-aad1-575bbb72a504-etc-kubernetes\") pod \"tuned-kpfxt\" (UID: \"c39b8a66-ab5e-4021-aad1-575bbb72a504\") " pod="openshift-cluster-node-tuning-operator/tuned-kpfxt" Jun 03 16:33:50.437745 ip-10-0-135-67 kubenswrapper[2568]: I0603 16:33:50.428224 2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/064d2e30-5154-4209-9774-4aa8196c55c7-kubelet-dir\") pod \"aws-ebs-csi-driver-node-pr68x\" (UID: \"064d2e30-5154-4209-9774-4aa8196c55c7\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-pr68x" Jun 03 16:33:50.437745 ip-10-0-135-67 kubenswrapper[2568]: I0603 16:33:50.428315 2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/064d2e30-5154-4209-9774-4aa8196c55c7-etc-selinux\") pod \"aws-ebs-csi-driver-node-pr68x\" (UID: \"064d2e30-5154-4209-9774-4aa8196c55c7\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-pr68x" Jun 03 16:33:50.438569 ip-10-0-135-67 kubenswrapper[2568]: I0603 16:33:50.428385 2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/4a0bbce9-a5e7-409d-af6c-911d3173c133-os-release\") pod \"multus-kf7b6\" (UID: \"4a0bbce9-a5e7-409d-af6c-911d3173c133\") " pod="openshift-multus/multus-kf7b6" Jun 03 16:33:50.438569 ip-10-0-135-67 kubenswrapper[2568]: I0603 16:33:50.428830 2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/ce603907-50de-4706-9fa0-5edcca2ea9ea-system-cni-dir\") pod \"multus-additional-cni-plugins-q2q9l\" (UID: \"ce603907-50de-4706-9fa0-5edcca2ea9ea\") " pod="openshift-multus/multus-additional-cni-plugins-q2q9l" Jun 03 16:33:50.438569 ip-10-0-135-67 kubenswrapper[2568]: I0603 16:33:50.428853 2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/4a0bbce9-a5e7-409d-af6c-911d3173c133-cni-binary-copy\") pod \"multus-kf7b6\" (UID: \"4a0bbce9-a5e7-409d-af6c-911d3173c133\") " pod="openshift-multus/multus-kf7b6" Jun 03 16:33:50.438569 ip-10-0-135-67 kubenswrapper[2568]: I0603 16:33:50.428900 2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host\" (UniqueName: \"kubernetes.io/host-path/c39b8a66-ab5e-4021-aad1-575bbb72a504-host\") pod \"tuned-kpfxt\" (UID: \"c39b8a66-ab5e-4021-aad1-575bbb72a504\") " pod="openshift-cluster-node-tuning-operator/tuned-kpfxt" Jun 03 16:33:50.438569 ip-10-0-135-67 kubenswrapper[2568]: I0603 16:33:50.428918 2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/4a0bbce9-a5e7-409d-af6c-911d3173c133-etc-kubernetes\") pod \"multus-kf7b6\" (UID: \"4a0bbce9-a5e7-409d-af6c-911d3173c133\") " pod="openshift-multus/multus-kf7b6" Jun 03 16:33:50.438569 ip-10-0-135-67 kubenswrapper[2568]: I0603 16:33:50.428971 2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/dd3dac0d-018e-4c8a-98c7-daedef6dedb9-log-socket\") pod \"ovnkube-node-94fdt\" (UID: \"dd3dac0d-018e-4c8a-98c7-daedef6dedb9\") " pod="openshift-ovn-kubernetes/ovnkube-node-94fdt" Jun 03 16:33:50.438569 ip-10-0-135-67 kubenswrapper[2568]: I0603 16:33:50.428993 2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/4a0bbce9-a5e7-409d-af6c-911d3173c133-multus-cni-dir\") pod \"multus-kf7b6\" (UID: \"4a0bbce9-a5e7-409d-af6c-911d3173c133\") " pod="openshift-multus/multus-kf7b6" Jun 03 16:33:50.438569 ip-10-0-135-67 kubenswrapper[2568]: I0603 16:33:50.429037 2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/dd3dac0d-018e-4c8a-98c7-daedef6dedb9-run-ovn\") pod \"ovnkube-node-94fdt\" (UID: \"dd3dac0d-018e-4c8a-98c7-daedef6dedb9\") " pod="openshift-ovn-kubernetes/ovnkube-node-94fdt" Jun 03 16:33:50.438569 ip-10-0-135-67 kubenswrapper[2568]: I0603 16:33:50.429068 2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/c39b8a66-ab5e-4021-aad1-575bbb72a504-etc-tuned\") pod \"tuned-kpfxt\" (UID: \"c39b8a66-ab5e-4021-aad1-575bbb72a504\") " pod="openshift-cluster-node-tuning-operator/tuned-kpfxt" Jun 03 16:33:50.438569 ip-10-0-135-67 kubenswrapper[2568]: I0603 16:33:50.429133 2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/c39b8a66-ab5e-4021-aad1-575bbb72a504-etc-modprobe-d\") pod \"tuned-kpfxt\" (UID: \"c39b8a66-ab5e-4021-aad1-575bbb72a504\") " pod="openshift-cluster-node-tuning-operator/tuned-kpfxt" Jun 03 16:33:50.438569 ip-10-0-135-67 kubenswrapper[2568]: I0603 16:33:50.429149 2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/dd3dac0d-018e-4c8a-98c7-daedef6dedb9-host-kubelet\") pod \"ovnkube-node-94fdt\" (UID: \"dd3dac0d-018e-4c8a-98c7-daedef6dedb9\") " pod="openshift-ovn-kubernetes/ovnkube-node-94fdt" Jun 03 16:33:50.438569 ip-10-0-135-67 kubenswrapper[2568]: I0603 16:33:50.429256 2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/dd3dac0d-018e-4c8a-98c7-daedef6dedb9-host-slash\") pod \"ovnkube-node-94fdt\" (UID: \"dd3dac0d-018e-4c8a-98c7-daedef6dedb9\") " pod="openshift-ovn-kubernetes/ovnkube-node-94fdt" Jun 03 16:33:50.438569 ip-10-0-135-67 kubenswrapper[2568]: I0603 16:33:50.429312 2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/4a0bbce9-a5e7-409d-af6c-911d3173c133-host-var-lib-cni-bin\") pod \"multus-kf7b6\" (UID: \"4a0bbce9-a5e7-409d-af6c-911d3173c133\") " pod="openshift-multus/multus-kf7b6" Jun 03 16:33:50.438569 ip-10-0-135-67 kubenswrapper[2568]: I0603 16:33:50.429362 2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/4a0bbce9-a5e7-409d-af6c-911d3173c133-host-run-multus-certs\") pod \"multus-kf7b6\" (UID: \"4a0bbce9-a5e7-409d-af6c-911d3173c133\") " pod="openshift-multus/multus-kf7b6" Jun 03 16:33:50.438569 ip-10-0-135-67 kubenswrapper[2568]: I0603 16:33:50.429581 2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/dd3dac0d-018e-4c8a-98c7-daedef6dedb9-ovnkube-script-lib\") pod \"ovnkube-node-94fdt\" (UID: \"dd3dac0d-018e-4c8a-98c7-daedef6dedb9\") " pod="openshift-ovn-kubernetes/ovnkube-node-94fdt" Jun 03 16:33:50.438569 ip-10-0-135-67 kubenswrapper[2568]: I0603 16:33:50.429686 2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/c39b8a66-ab5e-4021-aad1-575bbb72a504-tmp\") pod \"tuned-kpfxt\" (UID: \"c39b8a66-ab5e-4021-aad1-575bbb72a504\") " pod="openshift-cluster-node-tuning-operator/tuned-kpfxt" Jun 03 16:33:50.438569 ip-10-0-135-67 kubenswrapper[2568]: I0603 16:33:50.429729 2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/eeccbde1-c0af-4476-bffb-29e92945d422-iptables-alerter-script\") pod \"iptables-alerter-hnms9\" (UID: \"eeccbde1-c0af-4476-bffb-29e92945d422\") " pod="openshift-network-operator/iptables-alerter-hnms9" Jun 03 16:33:50.438569 ip-10-0-135-67 kubenswrapper[2568]: I0603 16:33:50.431957 2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/dd3dac0d-018e-4c8a-98c7-daedef6dedb9-ovn-node-metrics-cert\") pod \"ovnkube-node-94fdt\" (UID: \"dd3dac0d-018e-4c8a-98c7-daedef6dedb9\") " pod="openshift-ovn-kubernetes/ovnkube-node-94fdt" Jun 03 16:33:50.439476 ip-10-0-135-67 kubenswrapper[2568]: I0603 16:33:50.433570 2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/969318db-7cb1-4ad5-99f2-66d7f803c8a3-agent-certs\") pod \"konnectivity-agent-vcz76\" (UID: \"969318db-7cb1-4ad5-99f2-66d7f803c8a3\") " pod="kube-system/konnectivity-agent-vcz76" Jun 03 16:33:50.439476 ip-10-0-135-67 kubenswrapper[2568]: I0603 16:33:50.433672 2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-nbdjp\" (UniqueName: \"kubernetes.io/projected/dd3dac0d-018e-4c8a-98c7-daedef6dedb9-kube-api-access-nbdjp\") pod \"ovnkube-node-94fdt\" (UID: \"dd3dac0d-018e-4c8a-98c7-daedef6dedb9\") " pod="openshift-ovn-kubernetes/ovnkube-node-94fdt" Jun 03 16:33:50.439476 ip-10-0-135-67 kubenswrapper[2568]: E0603 16:33:50.434506 2568 projected.go:289] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jun 03 16:33:50.439476 ip-10-0-135-67 kubenswrapper[2568]: E0603 16:33:50.434531 2568 projected.go:289] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jun 03 16:33:50.439476 ip-10-0-135-67 kubenswrapper[2568]: E0603 16:33:50.434544 2568 projected.go:194] Error preparing data for projected volume kube-api-access-gwzmz for pod openshift-network-diagnostics/network-check-target-569p4: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 03 16:33:50.439476 ip-10-0-135-67 kubenswrapper[2568]: E0603 16:33:50.434665 2568 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/4a9428e9-7e73-44e5-ab4e-8dcb9028335e-kube-api-access-gwzmz podName:4a9428e9-7e73-44e5-ab4e-8dcb9028335e nodeName:}" failed. No retries permitted until 2026-06-03 16:33:50.934593096 +0000 UTC m=+3.076767738 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "kube-api-access-gwzmz" (UniqueName: "kubernetes.io/projected/4a9428e9-7e73-44e5-ab4e-8dcb9028335e-kube-api-access-gwzmz") pod "network-check-target-569p4" (UID: "4a9428e9-7e73-44e5-ab4e-8dcb9028335e") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 03 16:33:50.439476 ip-10-0-135-67 kubenswrapper[2568]: I0603 16:33:50.435139 2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-j5m84\" (UniqueName: \"kubernetes.io/projected/d250f8ac-2da7-4c87-85e2-dad87073a681-kube-api-access-j5m84\") pod \"node-resolver-wrnbf\" (UID: \"d250f8ac-2da7-4c87-85e2-dad87073a681\") " pod="openshift-dns/node-resolver-wrnbf" Jun 03 16:33:50.439476 ip-10-0-135-67 kubenswrapper[2568]: I0603 16:33:50.435808 2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-qcl58\" (UniqueName: \"kubernetes.io/projected/eeccbde1-c0af-4476-bffb-29e92945d422-kube-api-access-qcl58\") pod \"iptables-alerter-hnms9\" (UID: \"eeccbde1-c0af-4476-bffb-29e92945d422\") " pod="openshift-network-operator/iptables-alerter-hnms9" Jun 03 16:33:50.439476 ip-10-0-135-67 kubenswrapper[2568]: I0603 16:33:50.436644 2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-t72ww\" (UniqueName: \"kubernetes.io/projected/ddc210bb-9544-4ca7-b2de-f84c92d84510-kube-api-access-t72ww\") pod \"network-metrics-daemon-54gnw\" (UID: \"ddc210bb-9544-4ca7-b2de-f84c92d84510\") " pod="openshift-multus/network-metrics-daemon-54gnw" Jun 03 16:33:50.439476 ip-10-0-135-67 kubenswrapper[2568]: I0603 16:33:50.436896 2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-cr28s\" (UniqueName: \"kubernetes.io/projected/064d2e30-5154-4209-9774-4aa8196c55c7-kube-api-access-cr28s\") pod \"aws-ebs-csi-driver-node-pr68x\" (UID: \"064d2e30-5154-4209-9774-4aa8196c55c7\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-pr68x" Jun 03 16:33:50.439476 ip-10-0-135-67 kubenswrapper[2568]: I0603 16:33:50.437331 2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-4kbgz\" (UniqueName: \"kubernetes.io/projected/4a0bbce9-a5e7-409d-af6c-911d3173c133-kube-api-access-4kbgz\") pod \"multus-kf7b6\" (UID: \"4a0bbce9-a5e7-409d-af6c-911d3173c133\") " pod="openshift-multus/multus-kf7b6" Jun 03 16:33:50.439476 ip-10-0-135-67 kubenswrapper[2568]: I0603 16:33:50.437339 2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-b2vzb\" (UniqueName: \"kubernetes.io/projected/f40f3f2b-b437-46a6-8ea2-b770ea9bd2a3-kube-api-access-b2vzb\") pod \"node-ca-ktq4g\" (UID: \"f40f3f2b-b437-46a6-8ea2-b770ea9bd2a3\") " pod="openshift-image-registry/node-ca-ktq4g" Jun 03 16:33:50.439476 ip-10-0-135-67 kubenswrapper[2568]: I0603 16:33:50.437548 2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-f9xg6\" (UniqueName: \"kubernetes.io/projected/ce603907-50de-4706-9fa0-5edcca2ea9ea-kube-api-access-f9xg6\") pod \"multus-additional-cni-plugins-q2q9l\" (UID: \"ce603907-50de-4706-9fa0-5edcca2ea9ea\") " pod="openshift-multus/multus-additional-cni-plugins-q2q9l" Jun 03 16:33:50.439476 ip-10-0-135-67 kubenswrapper[2568]: I0603 16:33:50.438481 2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-9dsxq\" (UniqueName: \"kubernetes.io/projected/c39b8a66-ab5e-4021-aad1-575bbb72a504-kube-api-access-9dsxq\") pod \"tuned-kpfxt\" (UID: \"c39b8a66-ab5e-4021-aad1-575bbb72a504\") " pod="openshift-cluster-node-tuning-operator/tuned-kpfxt" Jun 03 16:33:50.609886 ip-10-0-135-67 kubenswrapper[2568]: I0603 16:33:50.609854 2568 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-pr68x" Jun 03 16:33:50.617708 ip-10-0-135-67 kubenswrapper[2568]: I0603 16:33:50.617686 2568 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-kf7b6" Jun 03 16:33:50.628250 ip-10-0-135-67 kubenswrapper[2568]: I0603 16:33:50.628228 2568 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-operator/iptables-alerter-hnms9" Jun 03 16:33:50.634862 ip-10-0-135-67 kubenswrapper[2568]: I0603 16:33:50.634844 2568 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/konnectivity-agent-vcz76" Jun 03 16:33:50.645407 ip-10-0-135-67 kubenswrapper[2568]: I0603 16:33:50.645381 2568 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-additional-cni-plugins-q2q9l" Jun 03 16:33:50.651064 ip-10-0-135-67 kubenswrapper[2568]: I0603 16:33:50.651046 2568 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ovn-kubernetes/ovnkube-node-94fdt" Jun 03 16:33:50.658598 ip-10-0-135-67 kubenswrapper[2568]: I0603 16:33:50.658578 2568 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-node-tuning-operator/tuned-kpfxt" Jun 03 16:33:50.667131 ip-10-0-135-67 kubenswrapper[2568]: I0603 16:33:50.667115 2568 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/node-ca-ktq4g" Jun 03 16:33:50.674685 ip-10-0-135-67 kubenswrapper[2568]: I0603 16:33:50.674631 2568 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/node-resolver-wrnbf" Jun 03 16:33:50.931498 ip-10-0-135-67 kubenswrapper[2568]: I0603 16:33:50.931424 2568 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/ddc210bb-9544-4ca7-b2de-f84c92d84510-metrics-certs\") pod \"network-metrics-daemon-54gnw\" (UID: \"ddc210bb-9544-4ca7-b2de-f84c92d84510\") " pod="openshift-multus/network-metrics-daemon-54gnw" Jun 03 16:33:50.931648 ip-10-0-135-67 kubenswrapper[2568]: E0603 16:33:50.931544 2568 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jun 03 16:33:50.931648 ip-10-0-135-67 kubenswrapper[2568]: E0603 16:33:50.931613 2568 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/ddc210bb-9544-4ca7-b2de-f84c92d84510-metrics-certs podName:ddc210bb-9544-4ca7-b2de-f84c92d84510 nodeName:}" failed. No retries permitted until 2026-06-03 16:33:51.931594175 +0000 UTC m=+4.073768807 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/ddc210bb-9544-4ca7-b2de-f84c92d84510-metrics-certs") pod "network-metrics-daemon-54gnw" (UID: "ddc210bb-9544-4ca7-b2de-f84c92d84510") : object "openshift-multus"/"metrics-daemon-secret" not registered Jun 03 16:33:51.032211 ip-10-0-135-67 kubenswrapper[2568]: I0603 16:33:51.032183 2568 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-gwzmz\" (UniqueName: \"kubernetes.io/projected/4a9428e9-7e73-44e5-ab4e-8dcb9028335e-kube-api-access-gwzmz\") pod \"network-check-target-569p4\" (UID: \"4a9428e9-7e73-44e5-ab4e-8dcb9028335e\") " pod="openshift-network-diagnostics/network-check-target-569p4" Jun 03 16:33:51.032372 ip-10-0-135-67 kubenswrapper[2568]: E0603 16:33:51.032308 2568 projected.go:289] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jun 03 16:33:51.032372 ip-10-0-135-67 kubenswrapper[2568]: E0603 16:33:51.032331 2568 projected.go:289] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jun 03 16:33:51.032372 ip-10-0-135-67 kubenswrapper[2568]: E0603 16:33:51.032343 2568 projected.go:194] Error preparing data for projected volume kube-api-access-gwzmz for pod openshift-network-diagnostics/network-check-target-569p4: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 03 16:33:51.032512 ip-10-0-135-67 kubenswrapper[2568]: E0603 16:33:51.032397 2568 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/4a9428e9-7e73-44e5-ab4e-8dcb9028335e-kube-api-access-gwzmz podName:4a9428e9-7e73-44e5-ab4e-8dcb9028335e nodeName:}" failed. No retries permitted until 2026-06-03 16:33:52.03237669 +0000 UTC m=+4.174551329 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "kube-api-access-gwzmz" (UniqueName: "kubernetes.io/projected/4a9428e9-7e73-44e5-ab4e-8dcb9028335e-kube-api-access-gwzmz") pod "network-check-target-569p4" (UID: "4a9428e9-7e73-44e5-ab4e-8dcb9028335e") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 03 16:33:51.223128 ip-10-0-135-67 kubenswrapper[2568]: I0603 16:33:51.223059 2568 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["kube-system/global-pull-secret-syncer-jmmft"] Jun 03 16:33:51.226396 ip-10-0-135-67 kubenswrapper[2568]: I0603 16:33:51.226372 2568 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-jmmft" Jun 03 16:33:51.226522 ip-10-0-135-67 kubenswrapper[2568]: E0603 16:33:51.226453 2568 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-jmmft" podUID="5c5a9b32-c7b7-4da2-85fa-7db4f429606d" Jun 03 16:33:51.333833 ip-10-0-135-67 kubenswrapper[2568]: I0603 16:33:51.333804 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/5c5a9b32-c7b7-4da2-85fa-7db4f429606d-original-pull-secret\") pod \"global-pull-secret-syncer-jmmft\" (UID: \"5c5a9b32-c7b7-4da2-85fa-7db4f429606d\") " pod="kube-system/global-pull-secret-syncer-jmmft" Jun 03 16:33:51.334180 ip-10-0-135-67 kubenswrapper[2568]: I0603 16:33:51.333845 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/5c5a9b32-c7b7-4da2-85fa-7db4f429606d-dbus\") pod \"global-pull-secret-syncer-jmmft\" (UID: \"5c5a9b32-c7b7-4da2-85fa-7db4f429606d\") " pod="kube-system/global-pull-secret-syncer-jmmft" Jun 03 16:33:51.334180 ip-10-0-135-67 kubenswrapper[2568]: I0603 16:33:51.333892 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/5c5a9b32-c7b7-4da2-85fa-7db4f429606d-kubelet-config\") pod \"global-pull-secret-syncer-jmmft\" (UID: \"5c5a9b32-c7b7-4da2-85fa-7db4f429606d\") " pod="kube-system/global-pull-secret-syncer-jmmft" Jun 03 16:33:51.348873 ip-10-0-135-67 kubenswrapper[2568]: I0603 16:33:51.348841 2568 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kubelet-serving" expiration="2028-06-02 16:28:49 +0000 UTC" deadline="2028-01-25 06:39:53.35607824 +0000 UTC" Jun 03 16:33:51.348873 ip-10-0-135-67 kubenswrapper[2568]: I0603 16:33:51.348867 2568 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kubelet-serving" sleep="14414h6m2.007213161s" Jun 03 16:33:51.381536 ip-10-0-135-67 kubenswrapper[2568]: W0603 16:33:51.381316 2568 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poddd3dac0d_018e_4c8a_98c7_daedef6dedb9.slice/crio-00cc80e94ce88117bf1f2cee84cf33f1eff52991bf079394132b96a6e5eab4af WatchSource:0}: Error finding container 00cc80e94ce88117bf1f2cee84cf33f1eff52991bf079394132b96a6e5eab4af: Status 404 returned error can't find the container with id 00cc80e94ce88117bf1f2cee84cf33f1eff52991bf079394132b96a6e5eab4af Jun 03 16:33:51.382630 ip-10-0-135-67 kubenswrapper[2568]: W0603 16:33:51.382604 2568 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podd250f8ac_2da7_4c87_85e2_dad87073a681.slice/crio-26e9d00c99278e3c0ab07d2a2039458d84174dc59b722255db338bcb7c09cd1f WatchSource:0}: Error finding container 26e9d00c99278e3c0ab07d2a2039458d84174dc59b722255db338bcb7c09cd1f: Status 404 returned error can't find the container with id 26e9d00c99278e3c0ab07d2a2039458d84174dc59b722255db338bcb7c09cd1f Jun 03 16:33:51.384180 ip-10-0-135-67 kubenswrapper[2568]: W0603 16:33:51.384160 2568 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod4a0bbce9_a5e7_409d_af6c_911d3173c133.slice/crio-16726a0658849ddbbc5bbafa94df23a4f083a40c3b0fa08b9fae06ca3d236bd5 WatchSource:0}: Error finding container 16726a0658849ddbbc5bbafa94df23a4f083a40c3b0fa08b9fae06ca3d236bd5: Status 404 returned error can't find the container with id 16726a0658849ddbbc5bbafa94df23a4f083a40c3b0fa08b9fae06ca3d236bd5 Jun 03 16:33:51.387567 ip-10-0-135-67 kubenswrapper[2568]: W0603 16:33:51.387546 2568 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podc39b8a66_ab5e_4021_aad1_575bbb72a504.slice/crio-20d6528b2fcac6e9d851ec457678f59cfbf56c2df154629b6d178c53bea848bf WatchSource:0}: Error finding container 20d6528b2fcac6e9d851ec457678f59cfbf56c2df154629b6d178c53bea848bf: Status 404 returned error can't find the container with id 20d6528b2fcac6e9d851ec457678f59cfbf56c2df154629b6d178c53bea848bf Jun 03 16:33:51.389262 ip-10-0-135-67 kubenswrapper[2568]: W0603 16:33:51.389113 2568 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podce603907_50de_4706_9fa0_5edcca2ea9ea.slice/crio-017e4aae20936dab18898024c59d1898dc481d7983854c8c977d33b1a1e03810 WatchSource:0}: Error finding container 017e4aae20936dab18898024c59d1898dc481d7983854c8c977d33b1a1e03810: Status 404 returned error can't find the container with id 017e4aae20936dab18898024c59d1898dc481d7983854c8c977d33b1a1e03810 Jun 03 16:33:51.390078 ip-10-0-135-67 kubenswrapper[2568]: W0603 16:33:51.390056 2568 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod969318db_7cb1_4ad5_99f2_66d7f803c8a3.slice/crio-4210da616ce0156df22c211eeddaf4384783a59607db6447280e77a449223ba8 WatchSource:0}: Error finding container 4210da616ce0156df22c211eeddaf4384783a59607db6447280e77a449223ba8: Status 404 returned error can't find the container with id 4210da616ce0156df22c211eeddaf4384783a59607db6447280e77a449223ba8 Jun 03 16:33:51.392330 ip-10-0-135-67 kubenswrapper[2568]: W0603 16:33:51.392142 2568 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod064d2e30_5154_4209_9774_4aa8196c55c7.slice/crio-34f7a2721406265660d56d854eab895a0b46b8b9e697d5a0e9e14ee120b31a39 WatchSource:0}: Error finding container 34f7a2721406265660d56d854eab895a0b46b8b9e697d5a0e9e14ee120b31a39: Status 404 returned error can't find the container with id 34f7a2721406265660d56d854eab895a0b46b8b9e697d5a0e9e14ee120b31a39 Jun 03 16:33:51.396169 ip-10-0-135-67 kubenswrapper[2568]: W0603 16:33:51.395280 2568 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podf40f3f2b_b437_46a6_8ea2_b770ea9bd2a3.slice/crio-0c7567d86fe083cb9564068e39573f43c5d0f3fbbe521f3592c0ca39814fad23 WatchSource:0}: Error finding container 0c7567d86fe083cb9564068e39573f43c5d0f3fbbe521f3592c0ca39814fad23: Status 404 returned error can't find the container with id 0c7567d86fe083cb9564068e39573f43c5d0f3fbbe521f3592c0ca39814fad23 Jun 03 16:33:51.405392 ip-10-0-135-67 kubenswrapper[2568]: I0603 16:33:51.405373 2568 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-54gnw" Jun 03 16:33:51.405511 ip-10-0-135-67 kubenswrapper[2568]: E0603 16:33:51.405493 2568 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-54gnw" podUID="ddc210bb-9544-4ca7-b2de-f84c92d84510" Jun 03 16:33:51.413140 ip-10-0-135-67 kubenswrapper[2568]: I0603 16:33:51.413114 2568 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-node-tuning-operator/tuned-kpfxt" event={"ID":"c39b8a66-ab5e-4021-aad1-575bbb72a504","Type":"ContainerStarted","Data":"20d6528b2fcac6e9d851ec457678f59cfbf56c2df154629b6d178c53bea848bf"} Jun 03 16:33:51.414176 ip-10-0-135-67 kubenswrapper[2568]: I0603 16:33:51.414141 2568 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-kf7b6" event={"ID":"4a0bbce9-a5e7-409d-af6c-911d3173c133","Type":"ContainerStarted","Data":"16726a0658849ddbbc5bbafa94df23a4f083a40c3b0fa08b9fae06ca3d236bd5"} Jun 03 16:33:51.415140 ip-10-0-135-67 kubenswrapper[2568]: I0603 16:33:51.415123 2568 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-94fdt" event={"ID":"dd3dac0d-018e-4c8a-98c7-daedef6dedb9","Type":"ContainerStarted","Data":"00cc80e94ce88117bf1f2cee84cf33f1eff52991bf079394132b96a6e5eab4af"} Jun 03 16:33:51.416045 ip-10-0-135-67 kubenswrapper[2568]: I0603 16:33:51.416026 2568 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-q2q9l" event={"ID":"ce603907-50de-4706-9fa0-5edcca2ea9ea","Type":"ContainerStarted","Data":"017e4aae20936dab18898024c59d1898dc481d7983854c8c977d33b1a1e03810"} Jun 03 16:33:51.418517 ip-10-0-135-67 kubenswrapper[2568]: I0603 16:33:51.418498 2568 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-network-operator/iptables-alerter-hnms9" event={"ID":"eeccbde1-c0af-4476-bffb-29e92945d422","Type":"ContainerStarted","Data":"c285b779fe67c2661650648daf1e1dab59b64ad31c95c1976c5169b25660c24a"} Jun 03 16:33:51.420726 ip-10-0-135-67 kubenswrapper[2568]: I0603 16:33:51.420703 2568 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-pr68x" event={"ID":"064d2e30-5154-4209-9774-4aa8196c55c7","Type":"ContainerStarted","Data":"34f7a2721406265660d56d854eab895a0b46b8b9e697d5a0e9e14ee120b31a39"} Jun 03 16:33:51.424025 ip-10-0-135-67 kubenswrapper[2568]: I0603 16:33:51.423990 2568 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kube-system/konnectivity-agent-vcz76" event={"ID":"969318db-7cb1-4ad5-99f2-66d7f803c8a3","Type":"ContainerStarted","Data":"4210da616ce0156df22c211eeddaf4384783a59607db6447280e77a449223ba8"} Jun 03 16:33:51.426329 ip-10-0-135-67 kubenswrapper[2568]: I0603 16:33:51.426305 2568 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/node-ca-ktq4g" event={"ID":"f40f3f2b-b437-46a6-8ea2-b770ea9bd2a3","Type":"ContainerStarted","Data":"0c7567d86fe083cb9564068e39573f43c5d0f3fbbe521f3592c0ca39814fad23"} Jun 03 16:33:51.427268 ip-10-0-135-67 kubenswrapper[2568]: I0603 16:33:51.427241 2568 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-dns/node-resolver-wrnbf" event={"ID":"d250f8ac-2da7-4c87-85e2-dad87073a681","Type":"ContainerStarted","Data":"26e9d00c99278e3c0ab07d2a2039458d84174dc59b722255db338bcb7c09cd1f"} Jun 03 16:33:51.434523 ip-10-0-135-67 kubenswrapper[2568]: I0603 16:33:51.434505 2568 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/5c5a9b32-c7b7-4da2-85fa-7db4f429606d-kubelet-config\") pod \"global-pull-secret-syncer-jmmft\" (UID: \"5c5a9b32-c7b7-4da2-85fa-7db4f429606d\") " pod="kube-system/global-pull-secret-syncer-jmmft" Jun 03 16:33:51.434595 ip-10-0-135-67 kubenswrapper[2568]: I0603 16:33:51.434535 2568 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/5c5a9b32-c7b7-4da2-85fa-7db4f429606d-original-pull-secret\") pod \"global-pull-secret-syncer-jmmft\" (UID: \"5c5a9b32-c7b7-4da2-85fa-7db4f429606d\") " pod="kube-system/global-pull-secret-syncer-jmmft" Jun 03 16:33:51.434595 ip-10-0-135-67 kubenswrapper[2568]: I0603 16:33:51.434556 2568 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/5c5a9b32-c7b7-4da2-85fa-7db4f429606d-dbus\") pod \"global-pull-secret-syncer-jmmft\" (UID: \"5c5a9b32-c7b7-4da2-85fa-7db4f429606d\") " pod="kube-system/global-pull-secret-syncer-jmmft" Jun 03 16:33:51.434681 ip-10-0-135-67 kubenswrapper[2568]: E0603 16:33:51.434647 2568 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jun 03 16:33:51.434728 ip-10-0-135-67 kubenswrapper[2568]: I0603 16:33:51.434683 2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/5c5a9b32-c7b7-4da2-85fa-7db4f429606d-dbus\") pod \"global-pull-secret-syncer-jmmft\" (UID: \"5c5a9b32-c7b7-4da2-85fa-7db4f429606d\") " pod="kube-system/global-pull-secret-syncer-jmmft" Jun 03 16:33:51.434728 ip-10-0-135-67 kubenswrapper[2568]: I0603 16:33:51.434686 2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/5c5a9b32-c7b7-4da2-85fa-7db4f429606d-kubelet-config\") pod \"global-pull-secret-syncer-jmmft\" (UID: \"5c5a9b32-c7b7-4da2-85fa-7db4f429606d\") " pod="kube-system/global-pull-secret-syncer-jmmft" Jun 03 16:33:51.434728 ip-10-0-135-67 kubenswrapper[2568]: E0603 16:33:51.434715 2568 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/5c5a9b32-c7b7-4da2-85fa-7db4f429606d-original-pull-secret podName:5c5a9b32-c7b7-4da2-85fa-7db4f429606d nodeName:}" failed. No retries permitted until 2026-06-03 16:33:51.934695141 +0000 UTC m=+4.076869780 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/5c5a9b32-c7b7-4da2-85fa-7db4f429606d-original-pull-secret") pod "global-pull-secret-syncer-jmmft" (UID: "5c5a9b32-c7b7-4da2-85fa-7db4f429606d") : object "kube-system"/"original-pull-secret" not registered Jun 03 16:33:51.939736 ip-10-0-135-67 kubenswrapper[2568]: I0603 16:33:51.938983 2568 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/ddc210bb-9544-4ca7-b2de-f84c92d84510-metrics-certs\") pod \"network-metrics-daemon-54gnw\" (UID: \"ddc210bb-9544-4ca7-b2de-f84c92d84510\") " pod="openshift-multus/network-metrics-daemon-54gnw" Jun 03 16:33:51.939736 ip-10-0-135-67 kubenswrapper[2568]: I0603 16:33:51.939078 2568 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/5c5a9b32-c7b7-4da2-85fa-7db4f429606d-original-pull-secret\") pod \"global-pull-secret-syncer-jmmft\" (UID: \"5c5a9b32-c7b7-4da2-85fa-7db4f429606d\") " pod="kube-system/global-pull-secret-syncer-jmmft" Jun 03 16:33:51.939736 ip-10-0-135-67 kubenswrapper[2568]: E0603 16:33:51.939208 2568 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jun 03 16:33:51.939736 ip-10-0-135-67 kubenswrapper[2568]: E0603 16:33:51.939265 2568 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/5c5a9b32-c7b7-4da2-85fa-7db4f429606d-original-pull-secret podName:5c5a9b32-c7b7-4da2-85fa-7db4f429606d nodeName:}" failed. No retries permitted until 2026-06-03 16:33:52.939247201 +0000 UTC m=+5.081421849 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/5c5a9b32-c7b7-4da2-85fa-7db4f429606d-original-pull-secret") pod "global-pull-secret-syncer-jmmft" (UID: "5c5a9b32-c7b7-4da2-85fa-7db4f429606d") : object "kube-system"/"original-pull-secret" not registered Jun 03 16:33:51.939736 ip-10-0-135-67 kubenswrapper[2568]: E0603 16:33:51.939619 2568 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jun 03 16:33:51.939736 ip-10-0-135-67 kubenswrapper[2568]: E0603 16:33:51.939663 2568 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/ddc210bb-9544-4ca7-b2de-f84c92d84510-metrics-certs podName:ddc210bb-9544-4ca7-b2de-f84c92d84510 nodeName:}" failed. No retries permitted until 2026-06-03 16:33:53.939649025 +0000 UTC m=+6.081823664 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/ddc210bb-9544-4ca7-b2de-f84c92d84510-metrics-certs") pod "network-metrics-daemon-54gnw" (UID: "ddc210bb-9544-4ca7-b2de-f84c92d84510") : object "openshift-multus"/"metrics-daemon-secret" not registered Jun 03 16:33:52.040066 ip-10-0-135-67 kubenswrapper[2568]: I0603 16:33:52.039538 2568 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-gwzmz\" (UniqueName: \"kubernetes.io/projected/4a9428e9-7e73-44e5-ab4e-8dcb9028335e-kube-api-access-gwzmz\") pod \"network-check-target-569p4\" (UID: \"4a9428e9-7e73-44e5-ab4e-8dcb9028335e\") " pod="openshift-network-diagnostics/network-check-target-569p4" Jun 03 16:33:52.040066 ip-10-0-135-67 kubenswrapper[2568]: E0603 16:33:52.039731 2568 projected.go:289] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jun 03 16:33:52.040066 ip-10-0-135-67 kubenswrapper[2568]: E0603 16:33:52.039750 2568 projected.go:289] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jun 03 16:33:52.040066 ip-10-0-135-67 kubenswrapper[2568]: E0603 16:33:52.039765 2568 projected.go:194] Error preparing data for projected volume kube-api-access-gwzmz for pod openshift-network-diagnostics/network-check-target-569p4: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 03 16:33:52.040066 ip-10-0-135-67 kubenswrapper[2568]: E0603 16:33:52.039827 2568 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/4a9428e9-7e73-44e5-ab4e-8dcb9028335e-kube-api-access-gwzmz podName:4a9428e9-7e73-44e5-ab4e-8dcb9028335e nodeName:}" failed. No retries permitted until 2026-06-03 16:33:54.039798685 +0000 UTC m=+6.181973322 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "kube-api-access-gwzmz" (UniqueName: "kubernetes.io/projected/4a9428e9-7e73-44e5-ab4e-8dcb9028335e-kube-api-access-gwzmz") pod "network-check-target-569p4" (UID: "4a9428e9-7e73-44e5-ab4e-8dcb9028335e") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 03 16:33:52.416464 ip-10-0-135-67 kubenswrapper[2568]: I0603 16:33:52.415886 2568 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-569p4" Jun 03 16:33:52.416464 ip-10-0-135-67 kubenswrapper[2568]: E0603 16:33:52.416049 2568 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-569p4" podUID="4a9428e9-7e73-44e5-ab4e-8dcb9028335e" Jun 03 16:33:52.444935 ip-10-0-135-67 kubenswrapper[2568]: I0603 16:33:52.444388 2568 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-135-67.ec2.internal" event={"ID":"4639241fb18cd938c7f40c97e0b0879c","Type":"ContainerStarted","Data":"98f799a306ef999c05d6a8d22f46986af5fa0ddf06978d4debfc6b0f13404141"} Jun 03 16:33:52.458678 ip-10-0-135-67 kubenswrapper[2568]: I0603 16:33:52.458094 2568 generic.go:358] "Generic (PLEG): container finished" podID="542287c42e1ce445fdbebaa3fcb48471" containerID="9d443469aa00fcf3ee0656e379a296bc4ea723c4e5984455ef8b2ab34de4bfd8" exitCode=0 Jun 03 16:33:52.458678 ip-10-0-135-67 kubenswrapper[2568]: I0603 16:33:52.458136 2568 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-135-67.ec2.internal" event={"ID":"542287c42e1ce445fdbebaa3fcb48471","Type":"ContainerDied","Data":"9d443469aa00fcf3ee0656e379a296bc4ea723c4e5984455ef8b2ab34de4bfd8"} Jun 03 16:33:52.459292 ip-10-0-135-67 kubenswrapper[2568]: I0603 16:33:52.459240 2568 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="kube-system/kube-apiserver-proxy-ip-10-0-135-67.ec2.internal" podStartSLOduration=3.459225778 podStartE2EDuration="3.459225778s" podCreationTimestamp="2026-06-03 16:33:49 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2026-06-03 16:33:52.457688727 +0000 UTC m=+4.599863383" watchObservedRunningTime="2026-06-03 16:33:52.459225778 +0000 UTC m=+4.601400436" Jun 03 16:33:52.945773 ip-10-0-135-67 kubenswrapper[2568]: I0603 16:33:52.945679 2568 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/5c5a9b32-c7b7-4da2-85fa-7db4f429606d-original-pull-secret\") pod \"global-pull-secret-syncer-jmmft\" (UID: \"5c5a9b32-c7b7-4da2-85fa-7db4f429606d\") " pod="kube-system/global-pull-secret-syncer-jmmft" Jun 03 16:33:52.945934 ip-10-0-135-67 kubenswrapper[2568]: E0603 16:33:52.945826 2568 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jun 03 16:33:52.945934 ip-10-0-135-67 kubenswrapper[2568]: E0603 16:33:52.945888 2568 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/5c5a9b32-c7b7-4da2-85fa-7db4f429606d-original-pull-secret podName:5c5a9b32-c7b7-4da2-85fa-7db4f429606d nodeName:}" failed. No retries permitted until 2026-06-03 16:33:54.945870566 +0000 UTC m=+7.088045215 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/5c5a9b32-c7b7-4da2-85fa-7db4f429606d-original-pull-secret") pod "global-pull-secret-syncer-jmmft" (UID: "5c5a9b32-c7b7-4da2-85fa-7db4f429606d") : object "kube-system"/"original-pull-secret" not registered Jun 03 16:33:53.405903 ip-10-0-135-67 kubenswrapper[2568]: I0603 16:33:53.405869 2568 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-54gnw" Jun 03 16:33:53.406087 ip-10-0-135-67 kubenswrapper[2568]: E0603 16:33:53.405999 2568 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-54gnw" podUID="ddc210bb-9544-4ca7-b2de-f84c92d84510" Jun 03 16:33:53.406455 ip-10-0-135-67 kubenswrapper[2568]: I0603 16:33:53.406435 2568 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-jmmft" Jun 03 16:33:53.406568 ip-10-0-135-67 kubenswrapper[2568]: E0603 16:33:53.406531 2568 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-jmmft" podUID="5c5a9b32-c7b7-4da2-85fa-7db4f429606d" Jun 03 16:33:53.482553 ip-10-0-135-67 kubenswrapper[2568]: I0603 16:33:53.482520 2568 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-135-67.ec2.internal" event={"ID":"542287c42e1ce445fdbebaa3fcb48471","Type":"ContainerStarted","Data":"38d4120d758c9645e702df33bcfaf58729bad2d479b9ec2b34b3c63ee05400cf"} Jun 03 16:33:53.956213 ip-10-0-135-67 kubenswrapper[2568]: I0603 16:33:53.956178 2568 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/ddc210bb-9544-4ca7-b2de-f84c92d84510-metrics-certs\") pod \"network-metrics-daemon-54gnw\" (UID: \"ddc210bb-9544-4ca7-b2de-f84c92d84510\") " pod="openshift-multus/network-metrics-daemon-54gnw" Jun 03 16:33:53.956399 ip-10-0-135-67 kubenswrapper[2568]: E0603 16:33:53.956311 2568 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jun 03 16:33:53.956399 ip-10-0-135-67 kubenswrapper[2568]: E0603 16:33:53.956375 2568 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/ddc210bb-9544-4ca7-b2de-f84c92d84510-metrics-certs podName:ddc210bb-9544-4ca7-b2de-f84c92d84510 nodeName:}" failed. No retries permitted until 2026-06-03 16:33:57.956355738 +0000 UTC m=+10.098530377 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/ddc210bb-9544-4ca7-b2de-f84c92d84510-metrics-certs") pod "network-metrics-daemon-54gnw" (UID: "ddc210bb-9544-4ca7-b2de-f84c92d84510") : object "openshift-multus"/"metrics-daemon-secret" not registered Jun 03 16:33:54.057209 ip-10-0-135-67 kubenswrapper[2568]: I0603 16:33:54.057173 2568 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-gwzmz\" (UniqueName: \"kubernetes.io/projected/4a9428e9-7e73-44e5-ab4e-8dcb9028335e-kube-api-access-gwzmz\") pod \"network-check-target-569p4\" (UID: \"4a9428e9-7e73-44e5-ab4e-8dcb9028335e\") " pod="openshift-network-diagnostics/network-check-target-569p4" Jun 03 16:33:54.057386 ip-10-0-135-67 kubenswrapper[2568]: E0603 16:33:54.057370 2568 projected.go:289] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jun 03 16:33:54.057443 ip-10-0-135-67 kubenswrapper[2568]: E0603 16:33:54.057391 2568 projected.go:289] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jun 03 16:33:54.057443 ip-10-0-135-67 kubenswrapper[2568]: E0603 16:33:54.057404 2568 projected.go:194] Error preparing data for projected volume kube-api-access-gwzmz for pod openshift-network-diagnostics/network-check-target-569p4: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 03 16:33:54.057541 ip-10-0-135-67 kubenswrapper[2568]: E0603 16:33:54.057460 2568 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/4a9428e9-7e73-44e5-ab4e-8dcb9028335e-kube-api-access-gwzmz podName:4a9428e9-7e73-44e5-ab4e-8dcb9028335e nodeName:}" failed. No retries permitted until 2026-06-03 16:33:58.057442952 +0000 UTC m=+10.199617591 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "kube-api-access-gwzmz" (UniqueName: "kubernetes.io/projected/4a9428e9-7e73-44e5-ab4e-8dcb9028335e-kube-api-access-gwzmz") pod "network-check-target-569p4" (UID: "4a9428e9-7e73-44e5-ab4e-8dcb9028335e") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 03 16:33:54.406017 ip-10-0-135-67 kubenswrapper[2568]: I0603 16:33:54.405967 2568 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-569p4" Jun 03 16:33:54.406249 ip-10-0-135-67 kubenswrapper[2568]: E0603 16:33:54.406180 2568 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-569p4" podUID="4a9428e9-7e73-44e5-ab4e-8dcb9028335e" Jun 03 16:33:54.964094 ip-10-0-135-67 kubenswrapper[2568]: I0603 16:33:54.964059 2568 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/5c5a9b32-c7b7-4da2-85fa-7db4f429606d-original-pull-secret\") pod \"global-pull-secret-syncer-jmmft\" (UID: \"5c5a9b32-c7b7-4da2-85fa-7db4f429606d\") " pod="kube-system/global-pull-secret-syncer-jmmft" Jun 03 16:33:54.964568 ip-10-0-135-67 kubenswrapper[2568]: E0603 16:33:54.964187 2568 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jun 03 16:33:54.964568 ip-10-0-135-67 kubenswrapper[2568]: E0603 16:33:54.964250 2568 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/5c5a9b32-c7b7-4da2-85fa-7db4f429606d-original-pull-secret podName:5c5a9b32-c7b7-4da2-85fa-7db4f429606d nodeName:}" failed. No retries permitted until 2026-06-03 16:33:58.964234392 +0000 UTC m=+11.106409043 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/5c5a9b32-c7b7-4da2-85fa-7db4f429606d-original-pull-secret") pod "global-pull-secret-syncer-jmmft" (UID: "5c5a9b32-c7b7-4da2-85fa-7db4f429606d") : object "kube-system"/"original-pull-secret" not registered Jun 03 16:33:55.406042 ip-10-0-135-67 kubenswrapper[2568]: I0603 16:33:55.405995 2568 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-54gnw" Jun 03 16:33:55.406208 ip-10-0-135-67 kubenswrapper[2568]: I0603 16:33:55.406075 2568 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-jmmft" Jun 03 16:33:55.406208 ip-10-0-135-67 kubenswrapper[2568]: E0603 16:33:55.406178 2568 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-jmmft" podUID="5c5a9b32-c7b7-4da2-85fa-7db4f429606d" Jun 03 16:33:55.406316 ip-10-0-135-67 kubenswrapper[2568]: E0603 16:33:55.406263 2568 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-54gnw" podUID="ddc210bb-9544-4ca7-b2de-f84c92d84510" Jun 03 16:33:56.409623 ip-10-0-135-67 kubenswrapper[2568]: I0603 16:33:56.409593 2568 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-569p4" Jun 03 16:33:56.410289 ip-10-0-135-67 kubenswrapper[2568]: E0603 16:33:56.409712 2568 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-569p4" podUID="4a9428e9-7e73-44e5-ab4e-8dcb9028335e" Jun 03 16:33:57.405712 ip-10-0-135-67 kubenswrapper[2568]: I0603 16:33:57.405585 2568 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-jmmft" Jun 03 16:33:57.405712 ip-10-0-135-67 kubenswrapper[2568]: I0603 16:33:57.405604 2568 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-54gnw" Jun 03 16:33:57.405940 ip-10-0-135-67 kubenswrapper[2568]: E0603 16:33:57.405713 2568 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-jmmft" podUID="5c5a9b32-c7b7-4da2-85fa-7db4f429606d" Jun 03 16:33:57.405940 ip-10-0-135-67 kubenswrapper[2568]: E0603 16:33:57.405820 2568 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-54gnw" podUID="ddc210bb-9544-4ca7-b2de-f84c92d84510" Jun 03 16:33:57.990529 ip-10-0-135-67 kubenswrapper[2568]: I0603 16:33:57.990495 2568 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/ddc210bb-9544-4ca7-b2de-f84c92d84510-metrics-certs\") pod \"network-metrics-daemon-54gnw\" (UID: \"ddc210bb-9544-4ca7-b2de-f84c92d84510\") " pod="openshift-multus/network-metrics-daemon-54gnw" Jun 03 16:33:57.990971 ip-10-0-135-67 kubenswrapper[2568]: E0603 16:33:57.990653 2568 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jun 03 16:33:57.990971 ip-10-0-135-67 kubenswrapper[2568]: E0603 16:33:57.990730 2568 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/ddc210bb-9544-4ca7-b2de-f84c92d84510-metrics-certs podName:ddc210bb-9544-4ca7-b2de-f84c92d84510 nodeName:}" failed. No retries permitted until 2026-06-03 16:34:05.990710422 +0000 UTC m=+18.132885074 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/ddc210bb-9544-4ca7-b2de-f84c92d84510-metrics-certs") pod "network-metrics-daemon-54gnw" (UID: "ddc210bb-9544-4ca7-b2de-f84c92d84510") : object "openshift-multus"/"metrics-daemon-secret" not registered Jun 03 16:33:58.091388 ip-10-0-135-67 kubenswrapper[2568]: I0603 16:33:58.091343 2568 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-gwzmz\" (UniqueName: \"kubernetes.io/projected/4a9428e9-7e73-44e5-ab4e-8dcb9028335e-kube-api-access-gwzmz\") pod \"network-check-target-569p4\" (UID: \"4a9428e9-7e73-44e5-ab4e-8dcb9028335e\") " pod="openshift-network-diagnostics/network-check-target-569p4" Jun 03 16:33:58.091557 ip-10-0-135-67 kubenswrapper[2568]: E0603 16:33:58.091499 2568 projected.go:289] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jun 03 16:33:58.091557 ip-10-0-135-67 kubenswrapper[2568]: E0603 16:33:58.091518 2568 projected.go:289] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jun 03 16:33:58.091557 ip-10-0-135-67 kubenswrapper[2568]: E0603 16:33:58.091528 2568 projected.go:194] Error preparing data for projected volume kube-api-access-gwzmz for pod openshift-network-diagnostics/network-check-target-569p4: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 03 16:33:58.091709 ip-10-0-135-67 kubenswrapper[2568]: E0603 16:33:58.091584 2568 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/4a9428e9-7e73-44e5-ab4e-8dcb9028335e-kube-api-access-gwzmz podName:4a9428e9-7e73-44e5-ab4e-8dcb9028335e nodeName:}" failed. No retries permitted until 2026-06-03 16:34:06.091568147 +0000 UTC m=+18.233742793 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "kube-api-access-gwzmz" (UniqueName: "kubernetes.io/projected/4a9428e9-7e73-44e5-ab4e-8dcb9028335e-kube-api-access-gwzmz") pod "network-check-target-569p4" (UID: "4a9428e9-7e73-44e5-ab4e-8dcb9028335e") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 03 16:33:58.408639 ip-10-0-135-67 kubenswrapper[2568]: I0603 16:33:58.408613 2568 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-569p4" Jun 03 16:33:58.408812 ip-10-0-135-67 kubenswrapper[2568]: E0603 16:33:58.408704 2568 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-569p4" podUID="4a9428e9-7e73-44e5-ab4e-8dcb9028335e" Jun 03 16:33:58.999695 ip-10-0-135-67 kubenswrapper[2568]: I0603 16:33:58.999617 2568 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/5c5a9b32-c7b7-4da2-85fa-7db4f429606d-original-pull-secret\") pod \"global-pull-secret-syncer-jmmft\" (UID: \"5c5a9b32-c7b7-4da2-85fa-7db4f429606d\") " pod="kube-system/global-pull-secret-syncer-jmmft" Jun 03 16:33:59.000160 ip-10-0-135-67 kubenswrapper[2568]: E0603 16:33:58.999830 2568 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jun 03 16:33:59.000160 ip-10-0-135-67 kubenswrapper[2568]: E0603 16:33:58.999895 2568 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/5c5a9b32-c7b7-4da2-85fa-7db4f429606d-original-pull-secret podName:5c5a9b32-c7b7-4da2-85fa-7db4f429606d nodeName:}" failed. No retries permitted until 2026-06-03 16:34:06.999876614 +0000 UTC m=+19.142051245 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/5c5a9b32-c7b7-4da2-85fa-7db4f429606d-original-pull-secret") pod "global-pull-secret-syncer-jmmft" (UID: "5c5a9b32-c7b7-4da2-85fa-7db4f429606d") : object "kube-system"/"original-pull-secret" not registered Jun 03 16:33:59.406500 ip-10-0-135-67 kubenswrapper[2568]: I0603 16:33:59.406427 2568 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-54gnw" Jun 03 16:33:59.406654 ip-10-0-135-67 kubenswrapper[2568]: I0603 16:33:59.406440 2568 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-jmmft" Jun 03 16:33:59.406654 ip-10-0-135-67 kubenswrapper[2568]: E0603 16:33:59.406551 2568 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-54gnw" podUID="ddc210bb-9544-4ca7-b2de-f84c92d84510" Jun 03 16:33:59.406654 ip-10-0-135-67 kubenswrapper[2568]: E0603 16:33:59.406634 2568 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-jmmft" podUID="5c5a9b32-c7b7-4da2-85fa-7db4f429606d" Jun 03 16:34:00.409582 ip-10-0-135-67 kubenswrapper[2568]: I0603 16:34:00.409549 2568 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-569p4" Jun 03 16:34:00.410067 ip-10-0-135-67 kubenswrapper[2568]: E0603 16:34:00.409678 2568 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-569p4" podUID="4a9428e9-7e73-44e5-ab4e-8dcb9028335e" Jun 03 16:34:01.406566 ip-10-0-135-67 kubenswrapper[2568]: I0603 16:34:01.406388 2568 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-jmmft" Jun 03 16:34:01.406724 ip-10-0-135-67 kubenswrapper[2568]: I0603 16:34:01.406447 2568 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-54gnw" Jun 03 16:34:01.406724 ip-10-0-135-67 kubenswrapper[2568]: E0603 16:34:01.406646 2568 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-jmmft" podUID="5c5a9b32-c7b7-4da2-85fa-7db4f429606d" Jun 03 16:34:01.406821 ip-10-0-135-67 kubenswrapper[2568]: E0603 16:34:01.406727 2568 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-54gnw" podUID="ddc210bb-9544-4ca7-b2de-f84c92d84510" Jun 03 16:34:01.495618 ip-10-0-135-67 kubenswrapper[2568]: I0603 16:34:01.495584 2568 generic.go:358] "Generic (PLEG): container finished" podID="ce603907-50de-4706-9fa0-5edcca2ea9ea" containerID="cec97800d50dfd61b49ef3077f07c6d1a9de6e147070b76fbdf7dd3eacddd250" exitCode=0 Jun 03 16:34:01.496198 ip-10-0-135-67 kubenswrapper[2568]: I0603 16:34:01.495669 2568 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-q2q9l" event={"ID":"ce603907-50de-4706-9fa0-5edcca2ea9ea","Type":"ContainerDied","Data":"cec97800d50dfd61b49ef3077f07c6d1a9de6e147070b76fbdf7dd3eacddd250"} Jun 03 16:34:01.497336 ip-10-0-135-67 kubenswrapper[2568]: I0603 16:34:01.497288 2568 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-pr68x" event={"ID":"064d2e30-5154-4209-9774-4aa8196c55c7","Type":"ContainerStarted","Data":"5afe0170320e47317cf145d2cae1e9d56449b33b9b086a7d4306e6020854954b"} Jun 03 16:34:01.499191 ip-10-0-135-67 kubenswrapper[2568]: I0603 16:34:01.499164 2568 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kube-system/konnectivity-agent-vcz76" event={"ID":"969318db-7cb1-4ad5-99f2-66d7f803c8a3","Type":"ContainerStarted","Data":"bdb347f72bce9d121566d01e67e1b363082e9aa7d2c084e9ce0fd6e5169abd36"} Jun 03 16:34:01.503534 ip-10-0-135-67 kubenswrapper[2568]: I0603 16:34:01.503507 2568 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/node-ca-ktq4g" event={"ID":"f40f3f2b-b437-46a6-8ea2-b770ea9bd2a3","Type":"ContainerStarted","Data":"35612347c4544d53c83ee437e0c5cd0a0251510eafa387fa28224def7e950780"} Jun 03 16:34:01.505173 ip-10-0-135-67 kubenswrapper[2568]: I0603 16:34:01.505149 2568 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-dns/node-resolver-wrnbf" event={"ID":"d250f8ac-2da7-4c87-85e2-dad87073a681","Type":"ContainerStarted","Data":"9c3ec969d2a6c0f4ec1d892daa42f1d46c43d0f006c20d0f474a30b4db6e2597"} Jun 03 16:34:01.506677 ip-10-0-135-67 kubenswrapper[2568]: I0603 16:34:01.506654 2568 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-node-tuning-operator/tuned-kpfxt" event={"ID":"c39b8a66-ab5e-4021-aad1-575bbb72a504","Type":"ContainerStarted","Data":"3c09dbb04d4585198bfcaec409c23fcc001a4b53f144d69abc75c7389e865d70"} Jun 03 16:34:01.512131 ip-10-0-135-67 kubenswrapper[2568]: I0603 16:34:01.512071 2568 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-135-67.ec2.internal" podStartSLOduration=12.512057804 podStartE2EDuration="12.512057804s" podCreationTimestamp="2026-06-03 16:33:49 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2026-06-03 16:33:53.495394171 +0000 UTC m=+5.637568826" watchObservedRunningTime="2026-06-03 16:34:01.512057804 +0000 UTC m=+13.654232464" Jun 03 16:34:01.525855 ip-10-0-135-67 kubenswrapper[2568]: I0603 16:34:01.525808 2568 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-cluster-node-tuning-operator/tuned-kpfxt" podStartSLOduration=4.206641124 podStartE2EDuration="13.525792534s" podCreationTimestamp="2026-06-03 16:33:48 +0000 UTC" firstStartedPulling="2026-06-03 16:33:51.389616809 +0000 UTC m=+3.531791440" lastFinishedPulling="2026-06-03 16:34:00.708768214 +0000 UTC m=+12.850942850" observedRunningTime="2026-06-03 16:34:01.52508808 +0000 UTC m=+13.667262738" watchObservedRunningTime="2026-06-03 16:34:01.525792534 +0000 UTC m=+13.667967191" Jun 03 16:34:01.536198 ip-10-0-135-67 kubenswrapper[2568]: I0603 16:34:01.536115 2568 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-image-registry/node-ca-ktq4g" podStartSLOduration=4.269309546 podStartE2EDuration="13.536101139s" podCreationTimestamp="2026-06-03 16:33:48 +0000 UTC" firstStartedPulling="2026-06-03 16:33:51.399126979 +0000 UTC m=+3.541301625" lastFinishedPulling="2026-06-03 16:34:00.665918583 +0000 UTC m=+12.808093218" observedRunningTime="2026-06-03 16:34:01.535895321 +0000 UTC m=+13.678069975" watchObservedRunningTime="2026-06-03 16:34:01.536101139 +0000 UTC m=+13.678275794" Jun 03 16:34:01.547435 ip-10-0-135-67 kubenswrapper[2568]: I0603 16:34:01.547391 2568 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-dns/node-resolver-wrnbf" podStartSLOduration=4.247793887 podStartE2EDuration="13.547377673s" podCreationTimestamp="2026-06-03 16:33:48 +0000 UTC" firstStartedPulling="2026-06-03 16:33:51.385117278 +0000 UTC m=+3.527291911" lastFinishedPulling="2026-06-03 16:34:00.684701051 +0000 UTC m=+12.826875697" observedRunningTime="2026-06-03 16:34:01.546660392 +0000 UTC m=+13.688835049" watchObservedRunningTime="2026-06-03 16:34:01.547377673 +0000 UTC m=+13.689552329" Jun 03 16:34:01.570942 ip-10-0-135-67 kubenswrapper[2568]: I0603 16:34:01.570896 2568 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="kube-system/konnectivity-agent-vcz76" podStartSLOduration=4.297549495 podStartE2EDuration="13.570885228s" podCreationTimestamp="2026-06-03 16:33:48 +0000 UTC" firstStartedPulling="2026-06-03 16:33:51.394420319 +0000 UTC m=+3.536594955" lastFinishedPulling="2026-06-03 16:34:00.667756055 +0000 UTC m=+12.809930688" observedRunningTime="2026-06-03 16:34:01.570026149 +0000 UTC m=+13.712200805" watchObservedRunningTime="2026-06-03 16:34:01.570885228 +0000 UTC m=+13.713059882" Jun 03 16:34:02.198701 ip-10-0-135-67 kubenswrapper[2568]: I0603 16:34:02.198677 2568 plugin_watcher.go:194] "Adding socket path or updating timestamp to desired state cache" path="/var/lib/kubelet/plugins_registry/ebs.csi.aws.com-reg.sock" Jun 03 16:34:02.371828 ip-10-0-135-67 kubenswrapper[2568]: I0603 16:34:02.371699 2568 reconciler.go:161] "OperationExecutor.RegisterPlugin started" plugin={"SocketPath":"/var/lib/kubelet/plugins_registry/ebs.csi.aws.com-reg.sock","Timestamp":"2026-06-03T16:34:02.198698312Z","UUID":"8e7134bc-00b4-4d14-a291-18f437bd005e","Handler":null,"Name":"","Endpoint":""} Jun 03 16:34:02.373290 ip-10-0-135-67 kubenswrapper[2568]: I0603 16:34:02.373271 2568 csi_plugin.go:106] kubernetes.io/csi: Trying to validate a new CSI Driver with name: ebs.csi.aws.com endpoint: /var/lib/kubelet/plugins/ebs.csi.aws.com/csi.sock versions: 1.0.0 Jun 03 16:34:02.373290 ip-10-0-135-67 kubenswrapper[2568]: I0603 16:34:02.373296 2568 csi_plugin.go:119] kubernetes.io/csi: Register new plugin with name: ebs.csi.aws.com at endpoint: /var/lib/kubelet/plugins/ebs.csi.aws.com/csi.sock Jun 03 16:34:02.409037 ip-10-0-135-67 kubenswrapper[2568]: I0603 16:34:02.408969 2568 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-569p4" Jun 03 16:34:02.409214 ip-10-0-135-67 kubenswrapper[2568]: E0603 16:34:02.409109 2568 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-569p4" podUID="4a9428e9-7e73-44e5-ab4e-8dcb9028335e" Jun 03 16:34:02.510198 ip-10-0-135-67 kubenswrapper[2568]: I0603 16:34:02.510158 2568 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-network-operator/iptables-alerter-hnms9" event={"ID":"eeccbde1-c0af-4476-bffb-29e92945d422","Type":"ContainerStarted","Data":"716c9d2ac3b1d66c2b5838534c5ad6284fc39fce48b0b72167dbb022926906f0"} Jun 03 16:34:02.512656 ip-10-0-135-67 kubenswrapper[2568]: I0603 16:34:02.512629 2568 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-pr68x" event={"ID":"064d2e30-5154-4209-9774-4aa8196c55c7","Type":"ContainerStarted","Data":"4a46402745f330d9668ccaefb771f719978a493749212644fb2f338cb5ae81a7"} Jun 03 16:34:02.523103 ip-10-0-135-67 kubenswrapper[2568]: I0603 16:34:02.523038 2568 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-network-operator/iptables-alerter-hnms9" podStartSLOduration=5.253269875 podStartE2EDuration="14.522997314s" podCreationTimestamp="2026-06-03 16:33:48 +0000 UTC" firstStartedPulling="2026-06-03 16:33:51.395810358 +0000 UTC m=+3.537984993" lastFinishedPulling="2026-06-03 16:34:00.665537792 +0000 UTC m=+12.807712432" observedRunningTime="2026-06-03 16:34:02.522642209 +0000 UTC m=+14.664816866" watchObservedRunningTime="2026-06-03 16:34:02.522997314 +0000 UTC m=+14.665171978" Jun 03 16:34:03.406254 ip-10-0-135-67 kubenswrapper[2568]: I0603 16:34:03.406225 2568 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-jmmft" Jun 03 16:34:03.406388 ip-10-0-135-67 kubenswrapper[2568]: I0603 16:34:03.406227 2568 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-54gnw" Jun 03 16:34:03.406388 ip-10-0-135-67 kubenswrapper[2568]: E0603 16:34:03.406334 2568 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-jmmft" podUID="5c5a9b32-c7b7-4da2-85fa-7db4f429606d" Jun 03 16:34:03.406502 ip-10-0-135-67 kubenswrapper[2568]: E0603 16:34:03.406384 2568 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-54gnw" podUID="ddc210bb-9544-4ca7-b2de-f84c92d84510" Jun 03 16:34:03.517091 ip-10-0-135-67 kubenswrapper[2568]: I0603 16:34:03.516996 2568 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-pr68x" event={"ID":"064d2e30-5154-4209-9774-4aa8196c55c7","Type":"ContainerStarted","Data":"afe4f866c48740d926b2e983e5520409b4f9a2216de5d4605f121b1277f0c5cd"} Jun 03 16:34:03.530146 ip-10-0-135-67 kubenswrapper[2568]: I0603 16:34:03.530102 2568 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-pr68x" podStartSLOduration=3.663554895 podStartE2EDuration="15.530085331s" podCreationTimestamp="2026-06-03 16:33:48 +0000 UTC" firstStartedPulling="2026-06-03 16:33:51.395833229 +0000 UTC m=+3.538007879" lastFinishedPulling="2026-06-03 16:34:03.26236367 +0000 UTC m=+15.404538315" observedRunningTime="2026-06-03 16:34:03.529745094 +0000 UTC m=+15.671919749" watchObservedRunningTime="2026-06-03 16:34:03.530085331 +0000 UTC m=+15.672259984" Jun 03 16:34:04.409094 ip-10-0-135-67 kubenswrapper[2568]: I0603 16:34:04.409062 2568 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-569p4" Jun 03 16:34:04.409271 ip-10-0-135-67 kubenswrapper[2568]: E0603 16:34:04.409195 2568 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-569p4" podUID="4a9428e9-7e73-44e5-ab4e-8dcb9028335e" Jun 03 16:34:04.892141 ip-10-0-135-67 kubenswrapper[2568]: I0603 16:34:04.891899 2568 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="kube-system/konnectivity-agent-vcz76" Jun 03 16:34:04.892578 ip-10-0-135-67 kubenswrapper[2568]: I0603 16:34:04.892544 2568 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="started" pod="kube-system/konnectivity-agent-vcz76" Jun 03 16:34:05.405828 ip-10-0-135-67 kubenswrapper[2568]: I0603 16:34:05.405798 2568 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-jmmft" Jun 03 16:34:05.405994 ip-10-0-135-67 kubenswrapper[2568]: I0603 16:34:05.405798 2568 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-54gnw" Jun 03 16:34:05.405994 ip-10-0-135-67 kubenswrapper[2568]: E0603 16:34:05.405914 2568 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-jmmft" podUID="5c5a9b32-c7b7-4da2-85fa-7db4f429606d" Jun 03 16:34:05.406121 ip-10-0-135-67 kubenswrapper[2568]: E0603 16:34:05.406020 2568 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-54gnw" podUID="ddc210bb-9544-4ca7-b2de-f84c92d84510" Jun 03 16:34:05.519580 ip-10-0-135-67 kubenswrapper[2568]: I0603 16:34:05.519547 2568 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kube-system/konnectivity-agent-vcz76" Jun 03 16:34:05.520153 ip-10-0-135-67 kubenswrapper[2568]: I0603 16:34:05.520123 2568 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="kube-system/konnectivity-agent-vcz76" Jun 03 16:34:06.064115 ip-10-0-135-67 kubenswrapper[2568]: I0603 16:34:06.064083 2568 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/ddc210bb-9544-4ca7-b2de-f84c92d84510-metrics-certs\") pod \"network-metrics-daemon-54gnw\" (UID: \"ddc210bb-9544-4ca7-b2de-f84c92d84510\") " pod="openshift-multus/network-metrics-daemon-54gnw" Jun 03 16:34:06.064536 ip-10-0-135-67 kubenswrapper[2568]: E0603 16:34:06.064247 2568 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jun 03 16:34:06.064536 ip-10-0-135-67 kubenswrapper[2568]: E0603 16:34:06.064307 2568 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/ddc210bb-9544-4ca7-b2de-f84c92d84510-metrics-certs podName:ddc210bb-9544-4ca7-b2de-f84c92d84510 nodeName:}" failed. No retries permitted until 2026-06-03 16:34:22.064288556 +0000 UTC m=+34.206463189 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/ddc210bb-9544-4ca7-b2de-f84c92d84510-metrics-certs") pod "network-metrics-daemon-54gnw" (UID: "ddc210bb-9544-4ca7-b2de-f84c92d84510") : object "openshift-multus"/"metrics-daemon-secret" not registered Jun 03 16:34:06.164777 ip-10-0-135-67 kubenswrapper[2568]: I0603 16:34:06.164740 2568 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-gwzmz\" (UniqueName: \"kubernetes.io/projected/4a9428e9-7e73-44e5-ab4e-8dcb9028335e-kube-api-access-gwzmz\") pod \"network-check-target-569p4\" (UID: \"4a9428e9-7e73-44e5-ab4e-8dcb9028335e\") " pod="openshift-network-diagnostics/network-check-target-569p4" Jun 03 16:34:06.164941 ip-10-0-135-67 kubenswrapper[2568]: E0603 16:34:06.164864 2568 projected.go:289] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jun 03 16:34:06.164941 ip-10-0-135-67 kubenswrapper[2568]: E0603 16:34:06.164886 2568 projected.go:289] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jun 03 16:34:06.164941 ip-10-0-135-67 kubenswrapper[2568]: E0603 16:34:06.164899 2568 projected.go:194] Error preparing data for projected volume kube-api-access-gwzmz for pod openshift-network-diagnostics/network-check-target-569p4: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 03 16:34:06.165113 ip-10-0-135-67 kubenswrapper[2568]: E0603 16:34:06.164962 2568 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/4a9428e9-7e73-44e5-ab4e-8dcb9028335e-kube-api-access-gwzmz podName:4a9428e9-7e73-44e5-ab4e-8dcb9028335e nodeName:}" failed. No retries permitted until 2026-06-03 16:34:22.164943976 +0000 UTC m=+34.307118621 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "kube-api-access-gwzmz" (UniqueName: "kubernetes.io/projected/4a9428e9-7e73-44e5-ab4e-8dcb9028335e-kube-api-access-gwzmz") pod "network-check-target-569p4" (UID: "4a9428e9-7e73-44e5-ab4e-8dcb9028335e") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 03 16:34:06.406325 ip-10-0-135-67 kubenswrapper[2568]: I0603 16:34:06.406242 2568 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-569p4" Jun 03 16:34:06.406483 ip-10-0-135-67 kubenswrapper[2568]: E0603 16:34:06.406370 2568 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-569p4" podUID="4a9428e9-7e73-44e5-ab4e-8dcb9028335e" Jun 03 16:34:07.072075 ip-10-0-135-67 kubenswrapper[2568]: I0603 16:34:07.072036 2568 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/5c5a9b32-c7b7-4da2-85fa-7db4f429606d-original-pull-secret\") pod \"global-pull-secret-syncer-jmmft\" (UID: \"5c5a9b32-c7b7-4da2-85fa-7db4f429606d\") " pod="kube-system/global-pull-secret-syncer-jmmft" Jun 03 16:34:07.072512 ip-10-0-135-67 kubenswrapper[2568]: E0603 16:34:07.072192 2568 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jun 03 16:34:07.072512 ip-10-0-135-67 kubenswrapper[2568]: E0603 16:34:07.072284 2568 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/5c5a9b32-c7b7-4da2-85fa-7db4f429606d-original-pull-secret podName:5c5a9b32-c7b7-4da2-85fa-7db4f429606d nodeName:}" failed. No retries permitted until 2026-06-03 16:34:23.072255616 +0000 UTC m=+35.214430265 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/5c5a9b32-c7b7-4da2-85fa-7db4f429606d-original-pull-secret") pod "global-pull-secret-syncer-jmmft" (UID: "5c5a9b32-c7b7-4da2-85fa-7db4f429606d") : object "kube-system"/"original-pull-secret" not registered Jun 03 16:34:07.405520 ip-10-0-135-67 kubenswrapper[2568]: I0603 16:34:07.405435 2568 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-54gnw" Jun 03 16:34:07.405520 ip-10-0-135-67 kubenswrapper[2568]: I0603 16:34:07.405484 2568 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-jmmft" Jun 03 16:34:07.405732 ip-10-0-135-67 kubenswrapper[2568]: E0603 16:34:07.405570 2568 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-54gnw" podUID="ddc210bb-9544-4ca7-b2de-f84c92d84510" Jun 03 16:34:07.405732 ip-10-0-135-67 kubenswrapper[2568]: E0603 16:34:07.405660 2568 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-jmmft" podUID="5c5a9b32-c7b7-4da2-85fa-7db4f429606d" Jun 03 16:34:08.411667 ip-10-0-135-67 kubenswrapper[2568]: I0603 16:34:08.411641 2568 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-569p4" Jun 03 16:34:08.412058 ip-10-0-135-67 kubenswrapper[2568]: E0603 16:34:08.411725 2568 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-569p4" podUID="4a9428e9-7e73-44e5-ab4e-8dcb9028335e" Jun 03 16:34:09.406014 ip-10-0-135-67 kubenswrapper[2568]: I0603 16:34:09.405964 2568 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-54gnw" Jun 03 16:34:09.406284 ip-10-0-135-67 kubenswrapper[2568]: I0603 16:34:09.406025 2568 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-jmmft" Jun 03 16:34:09.406284 ip-10-0-135-67 kubenswrapper[2568]: E0603 16:34:09.406109 2568 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-54gnw" podUID="ddc210bb-9544-4ca7-b2de-f84c92d84510" Jun 03 16:34:09.406284 ip-10-0-135-67 kubenswrapper[2568]: E0603 16:34:09.406218 2568 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-jmmft" podUID="5c5a9b32-c7b7-4da2-85fa-7db4f429606d" Jun 03 16:34:10.406072 ip-10-0-135-67 kubenswrapper[2568]: I0603 16:34:10.406037 2568 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-569p4" Jun 03 16:34:10.406549 ip-10-0-135-67 kubenswrapper[2568]: E0603 16:34:10.406149 2568 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-569p4" podUID="4a9428e9-7e73-44e5-ab4e-8dcb9028335e" Jun 03 16:34:11.405574 ip-10-0-135-67 kubenswrapper[2568]: I0603 16:34:11.405542 2568 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-jmmft" Jun 03 16:34:11.405835 ip-10-0-135-67 kubenswrapper[2568]: I0603 16:34:11.405542 2568 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-54gnw" Jun 03 16:34:11.405835 ip-10-0-135-67 kubenswrapper[2568]: E0603 16:34:11.405639 2568 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-jmmft" podUID="5c5a9b32-c7b7-4da2-85fa-7db4f429606d" Jun 03 16:34:11.405835 ip-10-0-135-67 kubenswrapper[2568]: E0603 16:34:11.405759 2568 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-54gnw" podUID="ddc210bb-9544-4ca7-b2de-f84c92d84510" Jun 03 16:34:12.405785 ip-10-0-135-67 kubenswrapper[2568]: I0603 16:34:12.405756 2568 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-569p4" Jun 03 16:34:12.406248 ip-10-0-135-67 kubenswrapper[2568]: E0603 16:34:12.405871 2568 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-569p4" podUID="4a9428e9-7e73-44e5-ab4e-8dcb9028335e" Jun 03 16:34:13.405415 ip-10-0-135-67 kubenswrapper[2568]: I0603 16:34:13.405379 2568 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-54gnw" Jun 03 16:34:13.405591 ip-10-0-135-67 kubenswrapper[2568]: I0603 16:34:13.405379 2568 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-jmmft" Jun 03 16:34:13.405591 ip-10-0-135-67 kubenswrapper[2568]: E0603 16:34:13.405520 2568 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-54gnw" podUID="ddc210bb-9544-4ca7-b2de-f84c92d84510" Jun 03 16:34:13.405714 ip-10-0-135-67 kubenswrapper[2568]: E0603 16:34:13.405603 2568 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-jmmft" podUID="5c5a9b32-c7b7-4da2-85fa-7db4f429606d" Jun 03 16:34:14.405554 ip-10-0-135-67 kubenswrapper[2568]: I0603 16:34:14.405368 2568 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-569p4" Jun 03 16:34:14.406020 ip-10-0-135-67 kubenswrapper[2568]: E0603 16:34:14.405636 2568 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-569p4" podUID="4a9428e9-7e73-44e5-ab4e-8dcb9028335e" Jun 03 16:34:14.537182 ip-10-0-135-67 kubenswrapper[2568]: I0603 16:34:14.537158 2568 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-94fdt_dd3dac0d-018e-4c8a-98c7-daedef6dedb9/ovn-acl-logging/0.log" Jun 03 16:34:14.537496 ip-10-0-135-67 kubenswrapper[2568]: I0603 16:34:14.537476 2568 generic.go:358] "Generic (PLEG): container finished" podID="dd3dac0d-018e-4c8a-98c7-daedef6dedb9" containerID="9e0e35e68fa4a77a10fd3692d0ec1852ada569b94dc6cc4f0669ae130cfc43b6" exitCode=1 Jun 03 16:34:14.537558 ip-10-0-135-67 kubenswrapper[2568]: I0603 16:34:14.537544 2568 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-94fdt" event={"ID":"dd3dac0d-018e-4c8a-98c7-daedef6dedb9","Type":"ContainerStarted","Data":"b7929eb0c4cbca99c7eeb588a60230adcb183c0aeb230a6ceabad2f3322a481f"} Jun 03 16:34:14.537598 ip-10-0-135-67 kubenswrapper[2568]: I0603 16:34:14.537574 2568 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-94fdt" event={"ID":"dd3dac0d-018e-4c8a-98c7-daedef6dedb9","Type":"ContainerStarted","Data":"e4770bd0c449882c9308f844066ace7a7e1f5729510f8c0a72a6d32087409cef"} Jun 03 16:34:14.537598 ip-10-0-135-67 kubenswrapper[2568]: I0603 16:34:14.537589 2568 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-94fdt" event={"ID":"dd3dac0d-018e-4c8a-98c7-daedef6dedb9","Type":"ContainerStarted","Data":"3af3274af534420a04537cb22c3e0aba7997a28f594b460848edad5c48f958b8"} Jun 03 16:34:14.537687 ip-10-0-135-67 kubenswrapper[2568]: I0603 16:34:14.537603 2568 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-94fdt" event={"ID":"dd3dac0d-018e-4c8a-98c7-daedef6dedb9","Type":"ContainerStarted","Data":"d95fd29a9b72a6a9ea3c63be467ceca0e98368a3aa1b679ae6efa1b5c2a3a7b9"} Jun 03 16:34:14.537687 ip-10-0-135-67 kubenswrapper[2568]: I0603 16:34:14.537615 2568 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-94fdt" event={"ID":"dd3dac0d-018e-4c8a-98c7-daedef6dedb9","Type":"ContainerDied","Data":"9e0e35e68fa4a77a10fd3692d0ec1852ada569b94dc6cc4f0669ae130cfc43b6"} Jun 03 16:34:14.537687 ip-10-0-135-67 kubenswrapper[2568]: I0603 16:34:14.537630 2568 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-94fdt" event={"ID":"dd3dac0d-018e-4c8a-98c7-daedef6dedb9","Type":"ContainerStarted","Data":"8f2ce2e7e8cec4ba1cfbaaae937bae79cd3ba361b7b5470dd15fd7c15cac1437"} Jun 03 16:34:14.539270 ip-10-0-135-67 kubenswrapper[2568]: I0603 16:34:14.539245 2568 generic.go:358] "Generic (PLEG): container finished" podID="ce603907-50de-4706-9fa0-5edcca2ea9ea" containerID="ddb35ae259fecdd63b3fa2df1e7361a3efbb8c0392fe86abb159b4bddb6e3ce2" exitCode=0 Jun 03 16:34:14.539369 ip-10-0-135-67 kubenswrapper[2568]: I0603 16:34:14.539321 2568 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-q2q9l" event={"ID":"ce603907-50de-4706-9fa0-5edcca2ea9ea","Type":"ContainerDied","Data":"ddb35ae259fecdd63b3fa2df1e7361a3efbb8c0392fe86abb159b4bddb6e3ce2"} Jun 03 16:34:14.540601 ip-10-0-135-67 kubenswrapper[2568]: I0603 16:34:14.540580 2568 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-kf7b6" event={"ID":"4a0bbce9-a5e7-409d-af6c-911d3173c133","Type":"ContainerStarted","Data":"8a6135fff01bca362552535b9f6942a0eb8312fe8dcd4f25d4c9d3424658701a"} Jun 03 16:34:14.610617 ip-10-0-135-67 kubenswrapper[2568]: I0603 16:34:14.610527 2568 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-multus/multus-kf7b6" podStartSLOduration=3.994398844 podStartE2EDuration="26.610514949s" podCreationTimestamp="2026-06-03 16:33:48 +0000 UTC" firstStartedPulling="2026-06-03 16:33:51.386497226 +0000 UTC m=+3.528671874" lastFinishedPulling="2026-06-03 16:34:14.002613338 +0000 UTC m=+26.144787979" observedRunningTime="2026-06-03 16:34:14.610436922 +0000 UTC m=+26.752611576" watchObservedRunningTime="2026-06-03 16:34:14.610514949 +0000 UTC m=+26.752689594" Jun 03 16:34:15.405925 ip-10-0-135-67 kubenswrapper[2568]: I0603 16:34:15.405830 2568 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-jmmft" Jun 03 16:34:15.406305 ip-10-0-135-67 kubenswrapper[2568]: I0603 16:34:15.405838 2568 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-54gnw" Jun 03 16:34:15.406305 ip-10-0-135-67 kubenswrapper[2568]: E0603 16:34:15.405941 2568 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-jmmft" podUID="5c5a9b32-c7b7-4da2-85fa-7db4f429606d" Jun 03 16:34:15.406305 ip-10-0-135-67 kubenswrapper[2568]: E0603 16:34:15.406042 2568 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-54gnw" podUID="ddc210bb-9544-4ca7-b2de-f84c92d84510" Jun 03 16:34:15.544207 ip-10-0-135-67 kubenswrapper[2568]: I0603 16:34:15.544170 2568 generic.go:358] "Generic (PLEG): container finished" podID="ce603907-50de-4706-9fa0-5edcca2ea9ea" containerID="9c70d9e2ed6383bc3c32d6d9e719f90112503f80a44c7e5e7a9df1158de5c7cf" exitCode=0 Jun 03 16:34:15.544359 ip-10-0-135-67 kubenswrapper[2568]: I0603 16:34:15.544251 2568 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-q2q9l" event={"ID":"ce603907-50de-4706-9fa0-5edcca2ea9ea","Type":"ContainerDied","Data":"9c70d9e2ed6383bc3c32d6d9e719f90112503f80a44c7e5e7a9df1158de5c7cf"} Jun 03 16:34:16.405590 ip-10-0-135-67 kubenswrapper[2568]: I0603 16:34:16.405563 2568 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-569p4" Jun 03 16:34:16.405704 ip-10-0-135-67 kubenswrapper[2568]: E0603 16:34:16.405685 2568 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-569p4" podUID="4a9428e9-7e73-44e5-ab4e-8dcb9028335e" Jun 03 16:34:16.551255 ip-10-0-135-67 kubenswrapper[2568]: I0603 16:34:16.551191 2568 generic.go:358] "Generic (PLEG): container finished" podID="ce603907-50de-4706-9fa0-5edcca2ea9ea" containerID="372edce8233e3512153ff4af94d353cd58325cf31614a525cc4d921355d44790" exitCode=0 Jun 03 16:34:16.551631 ip-10-0-135-67 kubenswrapper[2568]: I0603 16:34:16.551271 2568 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-q2q9l" event={"ID":"ce603907-50de-4706-9fa0-5edcca2ea9ea","Type":"ContainerDied","Data":"372edce8233e3512153ff4af94d353cd58325cf31614a525cc4d921355d44790"} Jun 03 16:34:16.554365 ip-10-0-135-67 kubenswrapper[2568]: I0603 16:34:16.554347 2568 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-94fdt_dd3dac0d-018e-4c8a-98c7-daedef6dedb9/ovn-acl-logging/0.log" Jun 03 16:34:16.554729 ip-10-0-135-67 kubenswrapper[2568]: I0603 16:34:16.554706 2568 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-94fdt" event={"ID":"dd3dac0d-018e-4c8a-98c7-daedef6dedb9","Type":"ContainerStarted","Data":"4c791c0f8e9e6386dab33b3068d7b82cd9f5da91825e403a333918eb084f7f4e"} Jun 03 16:34:17.405659 ip-10-0-135-67 kubenswrapper[2568]: I0603 16:34:17.405627 2568 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-54gnw" Jun 03 16:34:17.405834 ip-10-0-135-67 kubenswrapper[2568]: I0603 16:34:17.405662 2568 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-jmmft" Jun 03 16:34:17.405834 ip-10-0-135-67 kubenswrapper[2568]: E0603 16:34:17.405765 2568 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-54gnw" podUID="ddc210bb-9544-4ca7-b2de-f84c92d84510" Jun 03 16:34:17.405928 ip-10-0-135-67 kubenswrapper[2568]: E0603 16:34:17.405890 2568 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-jmmft" podUID="5c5a9b32-c7b7-4da2-85fa-7db4f429606d" Jun 03 16:34:18.406281 ip-10-0-135-67 kubenswrapper[2568]: I0603 16:34:18.406251 2568 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-569p4" Jun 03 16:34:18.406831 ip-10-0-135-67 kubenswrapper[2568]: E0603 16:34:18.406338 2568 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-569p4" podUID="4a9428e9-7e73-44e5-ab4e-8dcb9028335e" Jun 03 16:34:19.405618 ip-10-0-135-67 kubenswrapper[2568]: I0603 16:34:19.405378 2568 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-jmmft" Jun 03 16:34:19.405814 ip-10-0-135-67 kubenswrapper[2568]: I0603 16:34:19.405392 2568 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-54gnw" Jun 03 16:34:19.405814 ip-10-0-135-67 kubenswrapper[2568]: E0603 16:34:19.405727 2568 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-jmmft" podUID="5c5a9b32-c7b7-4da2-85fa-7db4f429606d" Jun 03 16:34:19.405814 ip-10-0-135-67 kubenswrapper[2568]: E0603 16:34:19.405791 2568 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-54gnw" podUID="ddc210bb-9544-4ca7-b2de-f84c92d84510" Jun 03 16:34:19.562279 ip-10-0-135-67 kubenswrapper[2568]: I0603 16:34:19.562252 2568 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-94fdt_dd3dac0d-018e-4c8a-98c7-daedef6dedb9/ovn-acl-logging/0.log" Jun 03 16:34:19.562660 ip-10-0-135-67 kubenswrapper[2568]: I0603 16:34:19.562581 2568 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-94fdt" event={"ID":"dd3dac0d-018e-4c8a-98c7-daedef6dedb9","Type":"ContainerStarted","Data":"77f4c4aea4a05b8fff0d67aba7a9f126518750fc44c0af5aed8e45735a8b0fa7"} Jun 03 16:34:19.562926 ip-10-0-135-67 kubenswrapper[2568]: I0603 16:34:19.562910 2568 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-94fdt" Jun 03 16:34:19.563099 ip-10-0-135-67 kubenswrapper[2568]: I0603 16:34:19.563082 2568 scope.go:117] "RemoveContainer" containerID="9e0e35e68fa4a77a10fd3692d0ec1852ada569b94dc6cc4f0669ae130cfc43b6" Jun 03 16:34:19.580229 ip-10-0-135-67 kubenswrapper[2568]: I0603 16:34:19.580210 2568 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-94fdt" Jun 03 16:34:20.406515 ip-10-0-135-67 kubenswrapper[2568]: I0603 16:34:20.406483 2568 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-569p4" Jun 03 16:34:20.406701 ip-10-0-135-67 kubenswrapper[2568]: E0603 16:34:20.406629 2568 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-569p4" podUID="4a9428e9-7e73-44e5-ab4e-8dcb9028335e" Jun 03 16:34:20.524339 ip-10-0-135-67 kubenswrapper[2568]: I0603 16:34:20.524307 2568 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kube-system/global-pull-secret-syncer-jmmft"] Jun 03 16:34:20.524493 ip-10-0-135-67 kubenswrapper[2568]: I0603 16:34:20.524410 2568 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-jmmft" Jun 03 16:34:20.524562 ip-10-0-135-67 kubenswrapper[2568]: E0603 16:34:20.524494 2568 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-jmmft" podUID="5c5a9b32-c7b7-4da2-85fa-7db4f429606d" Jun 03 16:34:20.525213 ip-10-0-135-67 kubenswrapper[2568]: I0603 16:34:20.525185 2568 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-multus/network-metrics-daemon-54gnw"] Jun 03 16:34:20.525392 ip-10-0-135-67 kubenswrapper[2568]: I0603 16:34:20.525279 2568 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-54gnw" Jun 03 16:34:20.525392 ip-10-0-135-67 kubenswrapper[2568]: E0603 16:34:20.525376 2568 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-54gnw" podUID="ddc210bb-9544-4ca7-b2de-f84c92d84510" Jun 03 16:34:20.526551 ip-10-0-135-67 kubenswrapper[2568]: I0603 16:34:20.526520 2568 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-target-569p4"] Jun 03 16:34:20.569189 ip-10-0-135-67 kubenswrapper[2568]: I0603 16:34:20.569156 2568 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-94fdt_dd3dac0d-018e-4c8a-98c7-daedef6dedb9/ovn-acl-logging/0.log" Jun 03 16:34:20.569587 ip-10-0-135-67 kubenswrapper[2568]: I0603 16:34:20.569535 2568 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-94fdt" event={"ID":"dd3dac0d-018e-4c8a-98c7-daedef6dedb9","Type":"ContainerStarted","Data":"a87fa740f52029e5064d28deb960f9f62c928db29f600da986b1460dff1ab377"} Jun 03 16:34:20.569587 ip-10-0-135-67 kubenswrapper[2568]: I0603 16:34:20.569574 2568 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-569p4" Jun 03 16:34:20.569701 ip-10-0-135-67 kubenswrapper[2568]: E0603 16:34:20.569676 2568 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-569p4" podUID="4a9428e9-7e73-44e5-ab4e-8dcb9028335e" Jun 03 16:34:20.570305 ip-10-0-135-67 kubenswrapper[2568]: I0603 16:34:20.570283 2568 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-94fdt" Jun 03 16:34:20.570422 ip-10-0-135-67 kubenswrapper[2568]: I0603 16:34:20.570399 2568 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-94fdt" Jun 03 16:34:20.585334 ip-10-0-135-67 kubenswrapper[2568]: I0603 16:34:20.585310 2568 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-94fdt" Jun 03 16:34:20.598469 ip-10-0-135-67 kubenswrapper[2568]: I0603 16:34:20.598423 2568 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-ovn-kubernetes/ovnkube-node-94fdt" podStartSLOduration=9.999593663 podStartE2EDuration="32.598408459s" podCreationTimestamp="2026-06-03 16:33:48 +0000 UTC" firstStartedPulling="2026-06-03 16:33:51.383216721 +0000 UTC m=+3.525391356" lastFinishedPulling="2026-06-03 16:34:13.982031512 +0000 UTC m=+26.124206152" observedRunningTime="2026-06-03 16:34:20.597331818 +0000 UTC m=+32.739506473" watchObservedRunningTime="2026-06-03 16:34:20.598408459 +0000 UTC m=+32.740583118" Jun 03 16:34:22.090284 ip-10-0-135-67 kubenswrapper[2568]: I0603 16:34:22.090249 2568 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/ddc210bb-9544-4ca7-b2de-f84c92d84510-metrics-certs\") pod \"network-metrics-daemon-54gnw\" (UID: \"ddc210bb-9544-4ca7-b2de-f84c92d84510\") " pod="openshift-multus/network-metrics-daemon-54gnw" Jun 03 16:34:22.090638 ip-10-0-135-67 kubenswrapper[2568]: E0603 16:34:22.090346 2568 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jun 03 16:34:22.090638 ip-10-0-135-67 kubenswrapper[2568]: E0603 16:34:22.090392 2568 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/ddc210bb-9544-4ca7-b2de-f84c92d84510-metrics-certs podName:ddc210bb-9544-4ca7-b2de-f84c92d84510 nodeName:}" failed. No retries permitted until 2026-06-03 16:34:54.090378192 +0000 UTC m=+66.232552824 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/ddc210bb-9544-4ca7-b2de-f84c92d84510-metrics-certs") pod "network-metrics-daemon-54gnw" (UID: "ddc210bb-9544-4ca7-b2de-f84c92d84510") : object "openshift-multus"/"metrics-daemon-secret" not registered Jun 03 16:34:22.190761 ip-10-0-135-67 kubenswrapper[2568]: I0603 16:34:22.190731 2568 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-gwzmz\" (UniqueName: \"kubernetes.io/projected/4a9428e9-7e73-44e5-ab4e-8dcb9028335e-kube-api-access-gwzmz\") pod \"network-check-target-569p4\" (UID: \"4a9428e9-7e73-44e5-ab4e-8dcb9028335e\") " pod="openshift-network-diagnostics/network-check-target-569p4" Jun 03 16:34:22.190928 ip-10-0-135-67 kubenswrapper[2568]: E0603 16:34:22.190867 2568 projected.go:289] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jun 03 16:34:22.190928 ip-10-0-135-67 kubenswrapper[2568]: E0603 16:34:22.190884 2568 projected.go:289] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jun 03 16:34:22.190928 ip-10-0-135-67 kubenswrapper[2568]: E0603 16:34:22.190897 2568 projected.go:194] Error preparing data for projected volume kube-api-access-gwzmz for pod openshift-network-diagnostics/network-check-target-569p4: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 03 16:34:22.191099 ip-10-0-135-67 kubenswrapper[2568]: E0603 16:34:22.190942 2568 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/4a9428e9-7e73-44e5-ab4e-8dcb9028335e-kube-api-access-gwzmz podName:4a9428e9-7e73-44e5-ab4e-8dcb9028335e nodeName:}" failed. No retries permitted until 2026-06-03 16:34:54.190930763 +0000 UTC m=+66.333105394 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "kube-api-access-gwzmz" (UniqueName: "kubernetes.io/projected/4a9428e9-7e73-44e5-ab4e-8dcb9028335e-kube-api-access-gwzmz") pod "network-check-target-569p4" (UID: "4a9428e9-7e73-44e5-ab4e-8dcb9028335e") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 03 16:34:22.405652 ip-10-0-135-67 kubenswrapper[2568]: I0603 16:34:22.405596 2568 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-569p4" Jun 03 16:34:22.405652 ip-10-0-135-67 kubenswrapper[2568]: I0603 16:34:22.405611 2568 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-54gnw" Jun 03 16:34:22.405827 ip-10-0-135-67 kubenswrapper[2568]: I0603 16:34:22.405611 2568 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-jmmft" Jun 03 16:34:22.405827 ip-10-0-135-67 kubenswrapper[2568]: E0603 16:34:22.405684 2568 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-569p4" podUID="4a9428e9-7e73-44e5-ab4e-8dcb9028335e" Jun 03 16:34:22.405827 ip-10-0-135-67 kubenswrapper[2568]: E0603 16:34:22.405782 2568 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-jmmft" podUID="5c5a9b32-c7b7-4da2-85fa-7db4f429606d" Jun 03 16:34:22.405934 ip-10-0-135-67 kubenswrapper[2568]: E0603 16:34:22.405881 2568 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-54gnw" podUID="ddc210bb-9544-4ca7-b2de-f84c92d84510" Jun 03 16:34:23.099019 ip-10-0-135-67 kubenswrapper[2568]: I0603 16:34:23.098974 2568 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/5c5a9b32-c7b7-4da2-85fa-7db4f429606d-original-pull-secret\") pod \"global-pull-secret-syncer-jmmft\" (UID: \"5c5a9b32-c7b7-4da2-85fa-7db4f429606d\") " pod="kube-system/global-pull-secret-syncer-jmmft" Jun 03 16:34:23.099397 ip-10-0-135-67 kubenswrapper[2568]: E0603 16:34:23.099097 2568 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jun 03 16:34:23.099397 ip-10-0-135-67 kubenswrapper[2568]: E0603 16:34:23.099152 2568 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/5c5a9b32-c7b7-4da2-85fa-7db4f429606d-original-pull-secret podName:5c5a9b32-c7b7-4da2-85fa-7db4f429606d nodeName:}" failed. No retries permitted until 2026-06-03 16:34:55.09913633 +0000 UTC m=+67.241310962 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/5c5a9b32-c7b7-4da2-85fa-7db4f429606d-original-pull-secret") pod "global-pull-secret-syncer-jmmft" (UID: "5c5a9b32-c7b7-4da2-85fa-7db4f429606d") : object "kube-system"/"original-pull-secret" not registered Jun 03 16:34:24.405841 ip-10-0-135-67 kubenswrapper[2568]: I0603 16:34:24.405663 2568 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-569p4" Jun 03 16:34:24.406272 ip-10-0-135-67 kubenswrapper[2568]: I0603 16:34:24.405673 2568 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-54gnw" Jun 03 16:34:24.406272 ip-10-0-135-67 kubenswrapper[2568]: E0603 16:34:24.405908 2568 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-569p4" podUID="4a9428e9-7e73-44e5-ab4e-8dcb9028335e" Jun 03 16:34:24.406272 ip-10-0-135-67 kubenswrapper[2568]: I0603 16:34:24.405673 2568 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-jmmft" Jun 03 16:34:24.406272 ip-10-0-135-67 kubenswrapper[2568]: E0603 16:34:24.406038 2568 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-54gnw" podUID="ddc210bb-9544-4ca7-b2de-f84c92d84510" Jun 03 16:34:24.406272 ip-10-0-135-67 kubenswrapper[2568]: E0603 16:34:24.406133 2568 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-jmmft" podUID="5c5a9b32-c7b7-4da2-85fa-7db4f429606d" Jun 03 16:34:26.405396 ip-10-0-135-67 kubenswrapper[2568]: I0603 16:34:26.405364 2568 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-54gnw" Jun 03 16:34:26.405835 ip-10-0-135-67 kubenswrapper[2568]: I0603 16:34:26.405364 2568 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-569p4" Jun 03 16:34:26.405835 ip-10-0-135-67 kubenswrapper[2568]: E0603 16:34:26.405502 2568 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-54gnw" podUID="ddc210bb-9544-4ca7-b2de-f84c92d84510" Jun 03 16:34:26.405835 ip-10-0-135-67 kubenswrapper[2568]: I0603 16:34:26.405375 2568 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-jmmft" Jun 03 16:34:26.405835 ip-10-0-135-67 kubenswrapper[2568]: E0603 16:34:26.405564 2568 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-569p4" podUID="4a9428e9-7e73-44e5-ab4e-8dcb9028335e" Jun 03 16:34:26.405835 ip-10-0-135-67 kubenswrapper[2568]: E0603 16:34:26.405657 2568 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-jmmft" podUID="5c5a9b32-c7b7-4da2-85fa-7db4f429606d" Jun 03 16:34:26.712870 ip-10-0-135-67 kubenswrapper[2568]: I0603 16:34:26.712839 2568 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-135-67.ec2.internal" event="NodeReady" Jun 03 16:34:26.713024 ip-10-0-135-67 kubenswrapper[2568]: I0603 16:34:26.712982 2568 kubelet_node_status.go:550] "Fast updating node status as it just became ready" Jun 03 16:34:26.748634 ip-10-0-135-67 kubenswrapper[2568]: I0603 16:34:26.748613 2568 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-image-registry/image-registry-74745bdc9c-rk4cq"] Jun 03 16:34:26.769746 ip-10-0-135-67 kubenswrapper[2568]: I0603 16:34:26.769723 2568 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-image-registry/image-registry-74745bdc9c-rk4cq"] Jun 03 16:34:26.769746 ip-10-0-135-67 kubenswrapper[2568]: I0603 16:34:26.769751 2568 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-dns/dns-default-tn2hz"] Jun 03 16:34:26.769878 ip-10-0-135-67 kubenswrapper[2568]: I0603 16:34:26.769870 2568 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-74745bdc9c-rk4cq" Jun 03 16:34:26.772050 ip-10-0-135-67 kubenswrapper[2568]: I0603 16:34:26.772031 2568 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"installation-pull-secrets\"" Jun 03 16:34:26.772792 ip-10-0-135-67 kubenswrapper[2568]: I0603 16:34:26.772778 2568 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"registry-dockercfg-pccbg\"" Jun 03 16:34:26.772792 ip-10-0-135-67 kubenswrapper[2568]: I0603 16:34:26.772782 2568 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"image-registry-private-configuration\"" Jun 03 16:34:26.773114 ip-10-0-135-67 kubenswrapper[2568]: I0603 16:34:26.773100 2568 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"image-registry-tls\"" Jun 03 16:34:26.786550 ip-10-0-135-67 kubenswrapper[2568]: I0603 16:34:26.786531 2568 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"trusted-ca\"" Jun 03 16:34:26.793044 ip-10-0-135-67 kubenswrapper[2568]: I0603 16:34:26.793022 2568 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-ingress-canary/ingress-canary-mjr7l"] Jun 03 16:34:26.793237 ip-10-0-135-67 kubenswrapper[2568]: I0603 16:34:26.793221 2568 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-tn2hz" Jun 03 16:34:26.795271 ip-10-0-135-67 kubenswrapper[2568]: I0603 16:34:26.795255 2568 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-dockercfg-6d9kw\"" Jun 03 16:34:26.795527 ip-10-0-135-67 kubenswrapper[2568]: I0603 16:34:26.795510 2568 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-default-metrics-tls\"" Jun 03 16:34:26.795613 ip-10-0-135-67 kubenswrapper[2568]: I0603 16:34:26.795535 2568 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"dns-default\"" Jun 03 16:34:26.816577 ip-10-0-135-67 kubenswrapper[2568]: I0603 16:34:26.816554 2568 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-ingress-canary/ingress-canary-mjr7l"] Jun 03 16:34:26.816577 ip-10-0-135-67 kubenswrapper[2568]: I0603 16:34:26.816575 2568 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-dns/dns-default-tn2hz"] Jun 03 16:34:26.816695 ip-10-0-135-67 kubenswrapper[2568]: I0603 16:34:26.816647 2568 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress-canary/ingress-canary-mjr7l" Jun 03 16:34:26.819036 ip-10-0-135-67 kubenswrapper[2568]: I0603 16:34:26.818996 2568 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-canary\"/\"canary-serving-cert\"" Jun 03 16:34:26.819129 ip-10-0-135-67 kubenswrapper[2568]: I0603 16:34:26.819038 2568 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-canary\"/\"default-dockercfg-kldw8\"" Jun 03 16:34:26.819129 ip-10-0-135-67 kubenswrapper[2568]: I0603 16:34:26.819091 2568 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress-canary\"/\"kube-root-ca.crt\"" Jun 03 16:34:26.819247 ip-10-0-135-67 kubenswrapper[2568]: I0603 16:34:26.819023 2568 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress-canary\"/\"openshift-service-ca.crt\"" Jun 03 16:34:26.821222 ip-10-0-135-67 kubenswrapper[2568]: I0603 16:34:26.821200 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/1adc570a-c47f-4bc0-a3f5-a7e90c775e3a-image-registry-private-configuration\") pod \"image-registry-74745bdc9c-rk4cq\" (UID: \"1adc570a-c47f-4bc0-a3f5-a7e90c775e3a\") " pod="openshift-image-registry/image-registry-74745bdc9c-rk4cq" Jun 03 16:34:26.821307 ip-10-0-135-67 kubenswrapper[2568]: I0603 16:34:26.821225 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/1adc570a-c47f-4bc0-a3f5-a7e90c775e3a-trusted-ca\") pod \"image-registry-74745bdc9c-rk4cq\" (UID: \"1adc570a-c47f-4bc0-a3f5-a7e90c775e3a\") " pod="openshift-image-registry/image-registry-74745bdc9c-rk4cq" Jun 03 16:34:26.821307 ip-10-0-135-67 kubenswrapper[2568]: I0603 16:34:26.821256 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/0f3a9c08-8974-46c9-9245-fbfc1a73e96c-config-volume\") pod \"dns-default-tn2hz\" (UID: \"0f3a9c08-8974-46c9-9245-fbfc1a73e96c\") " pod="openshift-dns/dns-default-tn2hz" Jun 03 16:34:26.821401 ip-10-0-135-67 kubenswrapper[2568]: I0603 16:34:26.821351 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/1adc570a-c47f-4bc0-a3f5-a7e90c775e3a-registry-tls\") pod \"image-registry-74745bdc9c-rk4cq\" (UID: \"1adc570a-c47f-4bc0-a3f5-a7e90c775e3a\") " pod="openshift-image-registry/image-registry-74745bdc9c-rk4cq" Jun 03 16:34:26.821443 ip-10-0-135-67 kubenswrapper[2568]: I0603 16:34:26.821398 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/1adc570a-c47f-4bc0-a3f5-a7e90c775e3a-bound-sa-token\") pod \"image-registry-74745bdc9c-rk4cq\" (UID: \"1adc570a-c47f-4bc0-a3f5-a7e90c775e3a\") " pod="openshift-image-registry/image-registry-74745bdc9c-rk4cq" Jun 03 16:34:26.821443 ip-10-0-135-67 kubenswrapper[2568]: I0603 16:34:26.821417 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/0f3a9c08-8974-46c9-9245-fbfc1a73e96c-metrics-tls\") pod \"dns-default-tn2hz\" (UID: \"0f3a9c08-8974-46c9-9245-fbfc1a73e96c\") " pod="openshift-dns/dns-default-tn2hz" Jun 03 16:34:26.821515 ip-10-0-135-67 kubenswrapper[2568]: I0603 16:34:26.821443 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/1adc570a-c47f-4bc0-a3f5-a7e90c775e3a-ca-trust-extracted\") pod \"image-registry-74745bdc9c-rk4cq\" (UID: \"1adc570a-c47f-4bc0-a3f5-a7e90c775e3a\") " pod="openshift-image-registry/image-registry-74745bdc9c-rk4cq" Jun 03 16:34:26.821515 ip-10-0-135-67 kubenswrapper[2568]: I0603 16:34:26.821468 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/1adc570a-c47f-4bc0-a3f5-a7e90c775e3a-installation-pull-secrets\") pod \"image-registry-74745bdc9c-rk4cq\" (UID: \"1adc570a-c47f-4bc0-a3f5-a7e90c775e3a\") " pod="openshift-image-registry/image-registry-74745bdc9c-rk4cq" Jun 03 16:34:26.821515 ip-10-0-135-67 kubenswrapper[2568]: I0603 16:34:26.821494 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/1adc570a-c47f-4bc0-a3f5-a7e90c775e3a-registry-certificates\") pod \"image-registry-74745bdc9c-rk4cq\" (UID: \"1adc570a-c47f-4bc0-a3f5-a7e90c775e3a\") " pod="openshift-image-registry/image-registry-74745bdc9c-rk4cq" Jun 03 16:34:26.821622 ip-10-0-135-67 kubenswrapper[2568]: I0603 16:34:26.821521 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/0f3a9c08-8974-46c9-9245-fbfc1a73e96c-tmp-dir\") pod \"dns-default-tn2hz\" (UID: \"0f3a9c08-8974-46c9-9245-fbfc1a73e96c\") " pod="openshift-dns/dns-default-tn2hz" Jun 03 16:34:26.821622 ip-10-0-135-67 kubenswrapper[2568]: I0603 16:34:26.821545 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-s9v8v\" (UniqueName: \"kubernetes.io/projected/0f3a9c08-8974-46c9-9245-fbfc1a73e96c-kube-api-access-s9v8v\") pod \"dns-default-tn2hz\" (UID: \"0f3a9c08-8974-46c9-9245-fbfc1a73e96c\") " pod="openshift-dns/dns-default-tn2hz" Jun 03 16:34:26.821622 ip-10-0-135-67 kubenswrapper[2568]: I0603 16:34:26.821568 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-6hr94\" (UniqueName: \"kubernetes.io/projected/1adc570a-c47f-4bc0-a3f5-a7e90c775e3a-kube-api-access-6hr94\") pod \"image-registry-74745bdc9c-rk4cq\" (UID: \"1adc570a-c47f-4bc0-a3f5-a7e90c775e3a\") " pod="openshift-image-registry/image-registry-74745bdc9c-rk4cq" Jun 03 16:34:26.922562 ip-10-0-135-67 kubenswrapper[2568]: I0603 16:34:26.922484 2568 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/0f3a9c08-8974-46c9-9245-fbfc1a73e96c-metrics-tls\") pod \"dns-default-tn2hz\" (UID: \"0f3a9c08-8974-46c9-9245-fbfc1a73e96c\") " pod="openshift-dns/dns-default-tn2hz" Jun 03 16:34:26.922562 ip-10-0-135-67 kubenswrapper[2568]: I0603 16:34:26.922527 2568 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/1adc570a-c47f-4bc0-a3f5-a7e90c775e3a-ca-trust-extracted\") pod \"image-registry-74745bdc9c-rk4cq\" (UID: \"1adc570a-c47f-4bc0-a3f5-a7e90c775e3a\") " pod="openshift-image-registry/image-registry-74745bdc9c-rk4cq" Jun 03 16:34:26.922562 ip-10-0-135-67 kubenswrapper[2568]: I0603 16:34:26.922547 2568 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/1adc570a-c47f-4bc0-a3f5-a7e90c775e3a-installation-pull-secrets\") pod \"image-registry-74745bdc9c-rk4cq\" (UID: \"1adc570a-c47f-4bc0-a3f5-a7e90c775e3a\") " pod="openshift-image-registry/image-registry-74745bdc9c-rk4cq" Jun 03 16:34:26.922797 ip-10-0-135-67 kubenswrapper[2568]: I0603 16:34:26.922617 2568 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/1adc570a-c47f-4bc0-a3f5-a7e90c775e3a-registry-certificates\") pod \"image-registry-74745bdc9c-rk4cq\" (UID: \"1adc570a-c47f-4bc0-a3f5-a7e90c775e3a\") " pod="openshift-image-registry/image-registry-74745bdc9c-rk4cq" Jun 03 16:34:26.922797 ip-10-0-135-67 kubenswrapper[2568]: I0603 16:34:26.922666 2568 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/0f3a9c08-8974-46c9-9245-fbfc1a73e96c-tmp-dir\") pod \"dns-default-tn2hz\" (UID: \"0f3a9c08-8974-46c9-9245-fbfc1a73e96c\") " pod="openshift-dns/dns-default-tn2hz" Jun 03 16:34:26.922797 ip-10-0-135-67 kubenswrapper[2568]: I0603 16:34:26.922693 2568 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-s9v8v\" (UniqueName: \"kubernetes.io/projected/0f3a9c08-8974-46c9-9245-fbfc1a73e96c-kube-api-access-s9v8v\") pod \"dns-default-tn2hz\" (UID: \"0f3a9c08-8974-46c9-9245-fbfc1a73e96c\") " pod="openshift-dns/dns-default-tn2hz" Jun 03 16:34:26.922797 ip-10-0-135-67 kubenswrapper[2568]: I0603 16:34:26.922711 2568 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-6hr94\" (UniqueName: \"kubernetes.io/projected/1adc570a-c47f-4bc0-a3f5-a7e90c775e3a-kube-api-access-6hr94\") pod \"image-registry-74745bdc9c-rk4cq\" (UID: \"1adc570a-c47f-4bc0-a3f5-a7e90c775e3a\") " pod="openshift-image-registry/image-registry-74745bdc9c-rk4cq" Jun 03 16:34:26.922797 ip-10-0-135-67 kubenswrapper[2568]: I0603 16:34:26.922757 2568 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/1adc570a-c47f-4bc0-a3f5-a7e90c775e3a-image-registry-private-configuration\") pod \"image-registry-74745bdc9c-rk4cq\" (UID: \"1adc570a-c47f-4bc0-a3f5-a7e90c775e3a\") " pod="openshift-image-registry/image-registry-74745bdc9c-rk4cq" Jun 03 16:34:26.922797 ip-10-0-135-67 kubenswrapper[2568]: I0603 16:34:26.922784 2568 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/1adc570a-c47f-4bc0-a3f5-a7e90c775e3a-trusted-ca\") pod \"image-registry-74745bdc9c-rk4cq\" (UID: \"1adc570a-c47f-4bc0-a3f5-a7e90c775e3a\") " pod="openshift-image-registry/image-registry-74745bdc9c-rk4cq" Jun 03 16:34:26.923127 ip-10-0-135-67 kubenswrapper[2568]: E0603 16:34:26.922797 2568 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jun 03 16:34:26.923127 ip-10-0-135-67 kubenswrapper[2568]: I0603 16:34:26.922832 2568 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/0f3a9c08-8974-46c9-9245-fbfc1a73e96c-config-volume\") pod \"dns-default-tn2hz\" (UID: \"0f3a9c08-8974-46c9-9245-fbfc1a73e96c\") " pod="openshift-dns/dns-default-tn2hz" Jun 03 16:34:26.923127 ip-10-0-135-67 kubenswrapper[2568]: E0603 16:34:26.922865 2568 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/0f3a9c08-8974-46c9-9245-fbfc1a73e96c-metrics-tls podName:0f3a9c08-8974-46c9-9245-fbfc1a73e96c nodeName:}" failed. No retries permitted until 2026-06-03 16:34:27.422849227 +0000 UTC m=+39.565023859 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/0f3a9c08-8974-46c9-9245-fbfc1a73e96c-metrics-tls") pod "dns-default-tn2hz" (UID: "0f3a9c08-8974-46c9-9245-fbfc1a73e96c") : secret "dns-default-metrics-tls" not found Jun 03 16:34:26.923127 ip-10-0-135-67 kubenswrapper[2568]: I0603 16:34:26.922883 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/7839d8fc-3e8c-481e-93f6-5e2eb79ee81f-cert\") pod \"ingress-canary-mjr7l\" (UID: \"7839d8fc-3e8c-481e-93f6-5e2eb79ee81f\") " pod="openshift-ingress-canary/ingress-canary-mjr7l" Jun 03 16:34:26.923127 ip-10-0-135-67 kubenswrapper[2568]: I0603 16:34:26.922904 2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/1adc570a-c47f-4bc0-a3f5-a7e90c775e3a-ca-trust-extracted\") pod \"image-registry-74745bdc9c-rk4cq\" (UID: \"1adc570a-c47f-4bc0-a3f5-a7e90c775e3a\") " pod="openshift-image-registry/image-registry-74745bdc9c-rk4cq" Jun 03 16:34:26.923127 ip-10-0-135-67 kubenswrapper[2568]: I0603 16:34:26.922916 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-5vcss\" (UniqueName: \"kubernetes.io/projected/7839d8fc-3e8c-481e-93f6-5e2eb79ee81f-kube-api-access-5vcss\") pod \"ingress-canary-mjr7l\" (UID: \"7839d8fc-3e8c-481e-93f6-5e2eb79ee81f\") " pod="openshift-ingress-canary/ingress-canary-mjr7l" Jun 03 16:34:26.923127 ip-10-0-135-67 kubenswrapper[2568]: I0603 16:34:26.922971 2568 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/1adc570a-c47f-4bc0-a3f5-a7e90c775e3a-registry-tls\") pod \"image-registry-74745bdc9c-rk4cq\" (UID: \"1adc570a-c47f-4bc0-a3f5-a7e90c775e3a\") " pod="openshift-image-registry/image-registry-74745bdc9c-rk4cq" Jun 03 16:34:26.923127 ip-10-0-135-67 kubenswrapper[2568]: I0603 16:34:26.922997 2568 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/1adc570a-c47f-4bc0-a3f5-a7e90c775e3a-bound-sa-token\") pod \"image-registry-74745bdc9c-rk4cq\" (UID: \"1adc570a-c47f-4bc0-a3f5-a7e90c775e3a\") " pod="openshift-image-registry/image-registry-74745bdc9c-rk4cq" Jun 03 16:34:26.923127 ip-10-0-135-67 kubenswrapper[2568]: I0603 16:34:26.923076 2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/0f3a9c08-8974-46c9-9245-fbfc1a73e96c-tmp-dir\") pod \"dns-default-tn2hz\" (UID: \"0f3a9c08-8974-46c9-9245-fbfc1a73e96c\") " pod="openshift-dns/dns-default-tn2hz" Jun 03 16:34:26.923568 ip-10-0-135-67 kubenswrapper[2568]: I0603 16:34:26.923306 2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/1adc570a-c47f-4bc0-a3f5-a7e90c775e3a-registry-certificates\") pod \"image-registry-74745bdc9c-rk4cq\" (UID: \"1adc570a-c47f-4bc0-a3f5-a7e90c775e3a\") " pod="openshift-image-registry/image-registry-74745bdc9c-rk4cq" Jun 03 16:34:26.923568 ip-10-0-135-67 kubenswrapper[2568]: E0603 16:34:26.923326 2568 projected.go:264] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found Jun 03 16:34:26.923568 ip-10-0-135-67 kubenswrapper[2568]: I0603 16:34:26.923327 2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/0f3a9c08-8974-46c9-9245-fbfc1a73e96c-config-volume\") pod \"dns-default-tn2hz\" (UID: \"0f3a9c08-8974-46c9-9245-fbfc1a73e96c\") " pod="openshift-dns/dns-default-tn2hz" Jun 03 16:34:26.923568 ip-10-0-135-67 kubenswrapper[2568]: E0603 16:34:26.923340 2568 projected.go:194] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-74745bdc9c-rk4cq: secret "image-registry-tls" not found Jun 03 16:34:26.923568 ip-10-0-135-67 kubenswrapper[2568]: E0603 16:34:26.923392 2568 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/1adc570a-c47f-4bc0-a3f5-a7e90c775e3a-registry-tls podName:1adc570a-c47f-4bc0-a3f5-a7e90c775e3a nodeName:}" failed. No retries permitted until 2026-06-03 16:34:27.423379954 +0000 UTC m=+39.565554586 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/1adc570a-c47f-4bc0-a3f5-a7e90c775e3a-registry-tls") pod "image-registry-74745bdc9c-rk4cq" (UID: "1adc570a-c47f-4bc0-a3f5-a7e90c775e3a") : secret "image-registry-tls" not found Jun 03 16:34:26.924145 ip-10-0-135-67 kubenswrapper[2568]: I0603 16:34:26.924124 2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/1adc570a-c47f-4bc0-a3f5-a7e90c775e3a-trusted-ca\") pod \"image-registry-74745bdc9c-rk4cq\" (UID: \"1adc570a-c47f-4bc0-a3f5-a7e90c775e3a\") " pod="openshift-image-registry/image-registry-74745bdc9c-rk4cq" Jun 03 16:34:26.926907 ip-10-0-135-67 kubenswrapper[2568]: I0603 16:34:26.926887 2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/1adc570a-c47f-4bc0-a3f5-a7e90c775e3a-image-registry-private-configuration\") pod \"image-registry-74745bdc9c-rk4cq\" (UID: \"1adc570a-c47f-4bc0-a3f5-a7e90c775e3a\") " pod="openshift-image-registry/image-registry-74745bdc9c-rk4cq" Jun 03 16:34:26.926907 ip-10-0-135-67 kubenswrapper[2568]: I0603 16:34:26.926888 2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/1adc570a-c47f-4bc0-a3f5-a7e90c775e3a-installation-pull-secrets\") pod \"image-registry-74745bdc9c-rk4cq\" (UID: \"1adc570a-c47f-4bc0-a3f5-a7e90c775e3a\") " pod="openshift-image-registry/image-registry-74745bdc9c-rk4cq" Jun 03 16:34:26.931922 ip-10-0-135-67 kubenswrapper[2568]: I0603 16:34:26.931885 2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/1adc570a-c47f-4bc0-a3f5-a7e90c775e3a-bound-sa-token\") pod \"image-registry-74745bdc9c-rk4cq\" (UID: \"1adc570a-c47f-4bc0-a3f5-a7e90c775e3a\") " pod="openshift-image-registry/image-registry-74745bdc9c-rk4cq" Jun 03 16:34:26.932344 ip-10-0-135-67 kubenswrapper[2568]: I0603 16:34:26.932326 2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-s9v8v\" (UniqueName: \"kubernetes.io/projected/0f3a9c08-8974-46c9-9245-fbfc1a73e96c-kube-api-access-s9v8v\") pod \"dns-default-tn2hz\" (UID: \"0f3a9c08-8974-46c9-9245-fbfc1a73e96c\") " pod="openshift-dns/dns-default-tn2hz" Jun 03 16:34:26.932440 ip-10-0-135-67 kubenswrapper[2568]: I0603 16:34:26.932425 2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-6hr94\" (UniqueName: \"kubernetes.io/projected/1adc570a-c47f-4bc0-a3f5-a7e90c775e3a-kube-api-access-6hr94\") pod \"image-registry-74745bdc9c-rk4cq\" (UID: \"1adc570a-c47f-4bc0-a3f5-a7e90c775e3a\") " pod="openshift-image-registry/image-registry-74745bdc9c-rk4cq" Jun 03 16:34:27.023564 ip-10-0-135-67 kubenswrapper[2568]: I0603 16:34:27.023545 2568 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/7839d8fc-3e8c-481e-93f6-5e2eb79ee81f-cert\") pod \"ingress-canary-mjr7l\" (UID: \"7839d8fc-3e8c-481e-93f6-5e2eb79ee81f\") " pod="openshift-ingress-canary/ingress-canary-mjr7l" Jun 03 16:34:27.023656 ip-10-0-135-67 kubenswrapper[2568]: I0603 16:34:27.023572 2568 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-5vcss\" (UniqueName: \"kubernetes.io/projected/7839d8fc-3e8c-481e-93f6-5e2eb79ee81f-kube-api-access-5vcss\") pod \"ingress-canary-mjr7l\" (UID: \"7839d8fc-3e8c-481e-93f6-5e2eb79ee81f\") " pod="openshift-ingress-canary/ingress-canary-mjr7l" Jun 03 16:34:27.023695 ip-10-0-135-67 kubenswrapper[2568]: E0603 16:34:27.023679 2568 secret.go:189] Couldn't get secret openshift-ingress-canary/canary-serving-cert: secret "canary-serving-cert" not found Jun 03 16:34:27.023749 ip-10-0-135-67 kubenswrapper[2568]: E0603 16:34:27.023738 2568 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/7839d8fc-3e8c-481e-93f6-5e2eb79ee81f-cert podName:7839d8fc-3e8c-481e-93f6-5e2eb79ee81f nodeName:}" failed. No retries permitted until 2026-06-03 16:34:27.523724431 +0000 UTC m=+39.665899063 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "cert" (UniqueName: "kubernetes.io/secret/7839d8fc-3e8c-481e-93f6-5e2eb79ee81f-cert") pod "ingress-canary-mjr7l" (UID: "7839d8fc-3e8c-481e-93f6-5e2eb79ee81f") : secret "canary-serving-cert" not found Jun 03 16:34:27.033950 ip-10-0-135-67 kubenswrapper[2568]: I0603 16:34:27.033924 2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-5vcss\" (UniqueName: \"kubernetes.io/projected/7839d8fc-3e8c-481e-93f6-5e2eb79ee81f-kube-api-access-5vcss\") pod \"ingress-canary-mjr7l\" (UID: \"7839d8fc-3e8c-481e-93f6-5e2eb79ee81f\") " pod="openshift-ingress-canary/ingress-canary-mjr7l" Jun 03 16:34:27.427302 ip-10-0-135-67 kubenswrapper[2568]: I0603 16:34:27.427251 2568 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/1adc570a-c47f-4bc0-a3f5-a7e90c775e3a-registry-tls\") pod \"image-registry-74745bdc9c-rk4cq\" (UID: \"1adc570a-c47f-4bc0-a3f5-a7e90c775e3a\") " pod="openshift-image-registry/image-registry-74745bdc9c-rk4cq" Jun 03 16:34:27.427302 ip-10-0-135-67 kubenswrapper[2568]: I0603 16:34:27.427284 2568 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/0f3a9c08-8974-46c9-9245-fbfc1a73e96c-metrics-tls\") pod \"dns-default-tn2hz\" (UID: \"0f3a9c08-8974-46c9-9245-fbfc1a73e96c\") " pod="openshift-dns/dns-default-tn2hz" Jun 03 16:34:27.427789 ip-10-0-135-67 kubenswrapper[2568]: E0603 16:34:27.427380 2568 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jun 03 16:34:27.427789 ip-10-0-135-67 kubenswrapper[2568]: E0603 16:34:27.427406 2568 projected.go:264] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found Jun 03 16:34:27.427789 ip-10-0-135-67 kubenswrapper[2568]: E0603 16:34:27.427427 2568 projected.go:194] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-74745bdc9c-rk4cq: secret "image-registry-tls" not found Jun 03 16:34:27.427789 ip-10-0-135-67 kubenswrapper[2568]: E0603 16:34:27.427441 2568 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/0f3a9c08-8974-46c9-9245-fbfc1a73e96c-metrics-tls podName:0f3a9c08-8974-46c9-9245-fbfc1a73e96c nodeName:}" failed. No retries permitted until 2026-06-03 16:34:28.427428162 +0000 UTC m=+40.569602794 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/0f3a9c08-8974-46c9-9245-fbfc1a73e96c-metrics-tls") pod "dns-default-tn2hz" (UID: "0f3a9c08-8974-46c9-9245-fbfc1a73e96c") : secret "dns-default-metrics-tls" not found Jun 03 16:34:27.427789 ip-10-0-135-67 kubenswrapper[2568]: E0603 16:34:27.427472 2568 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/1adc570a-c47f-4bc0-a3f5-a7e90c775e3a-registry-tls podName:1adc570a-c47f-4bc0-a3f5-a7e90c775e3a nodeName:}" failed. No retries permitted until 2026-06-03 16:34:28.427458603 +0000 UTC m=+40.569633241 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/1adc570a-c47f-4bc0-a3f5-a7e90c775e3a-registry-tls") pod "image-registry-74745bdc9c-rk4cq" (UID: "1adc570a-c47f-4bc0-a3f5-a7e90c775e3a") : secret "image-registry-tls" not found Jun 03 16:34:27.528555 ip-10-0-135-67 kubenswrapper[2568]: I0603 16:34:27.528507 2568 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/7839d8fc-3e8c-481e-93f6-5e2eb79ee81f-cert\") pod \"ingress-canary-mjr7l\" (UID: \"7839d8fc-3e8c-481e-93f6-5e2eb79ee81f\") " pod="openshift-ingress-canary/ingress-canary-mjr7l" Jun 03 16:34:27.528717 ip-10-0-135-67 kubenswrapper[2568]: E0603 16:34:27.528624 2568 secret.go:189] Couldn't get secret openshift-ingress-canary/canary-serving-cert: secret "canary-serving-cert" not found Jun 03 16:34:27.528717 ip-10-0-135-67 kubenswrapper[2568]: E0603 16:34:27.528676 2568 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/7839d8fc-3e8c-481e-93f6-5e2eb79ee81f-cert podName:7839d8fc-3e8c-481e-93f6-5e2eb79ee81f nodeName:}" failed. No retries permitted until 2026-06-03 16:34:28.528661112 +0000 UTC m=+40.670835748 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "cert" (UniqueName: "kubernetes.io/secret/7839d8fc-3e8c-481e-93f6-5e2eb79ee81f-cert") pod "ingress-canary-mjr7l" (UID: "7839d8fc-3e8c-481e-93f6-5e2eb79ee81f") : secret "canary-serving-cert" not found Jun 03 16:34:27.584384 ip-10-0-135-67 kubenswrapper[2568]: I0603 16:34:27.584356 2568 generic.go:358] "Generic (PLEG): container finished" podID="ce603907-50de-4706-9fa0-5edcca2ea9ea" containerID="ace17ca6578663bc49ee1e5efb1b89fac097e2fd2137c320b269af434d851e9d" exitCode=0 Jun 03 16:34:27.584514 ip-10-0-135-67 kubenswrapper[2568]: I0603 16:34:27.584398 2568 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-q2q9l" event={"ID":"ce603907-50de-4706-9fa0-5edcca2ea9ea","Type":"ContainerDied","Data":"ace17ca6578663bc49ee1e5efb1b89fac097e2fd2137c320b269af434d851e9d"} Jun 03 16:34:28.406395 ip-10-0-135-67 kubenswrapper[2568]: I0603 16:34:28.406368 2568 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-569p4" Jun 03 16:34:28.406570 ip-10-0-135-67 kubenswrapper[2568]: I0603 16:34:28.406552 2568 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-jmmft" Jun 03 16:34:28.406698 ip-10-0-135-67 kubenswrapper[2568]: I0603 16:34:28.406674 2568 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-54gnw" Jun 03 16:34:28.408713 ip-10-0-135-67 kubenswrapper[2568]: I0603 16:34:28.408682 2568 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"openshift-service-ca.crt\"" Jun 03 16:34:28.408713 ip-10-0-135-67 kubenswrapper[2568]: I0603 16:34:28.408693 2568 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"kube-root-ca.crt\"" Jun 03 16:34:28.408713 ip-10-0-135-67 kubenswrapper[2568]: I0603 16:34:28.408684 2568 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"default-dockercfg-r657c\"" Jun 03 16:34:28.409087 ip-10-0-135-67 kubenswrapper[2568]: I0603 16:34:28.408741 2568 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-secret\"" Jun 03 16:34:28.409361 ip-10-0-135-67 kubenswrapper[2568]: I0603 16:34:28.409345 2568 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-sa-dockercfg-fx9bm\"" Jun 03 16:34:28.409361 ip-10-0-135-67 kubenswrapper[2568]: I0603 16:34:28.409354 2568 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"original-pull-secret\"" Jun 03 16:34:28.435140 ip-10-0-135-67 kubenswrapper[2568]: I0603 16:34:28.435121 2568 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/1adc570a-c47f-4bc0-a3f5-a7e90c775e3a-registry-tls\") pod \"image-registry-74745bdc9c-rk4cq\" (UID: \"1adc570a-c47f-4bc0-a3f5-a7e90c775e3a\") " pod="openshift-image-registry/image-registry-74745bdc9c-rk4cq" Jun 03 16:34:28.435463 ip-10-0-135-67 kubenswrapper[2568]: I0603 16:34:28.435150 2568 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/0f3a9c08-8974-46c9-9245-fbfc1a73e96c-metrics-tls\") pod \"dns-default-tn2hz\" (UID: \"0f3a9c08-8974-46c9-9245-fbfc1a73e96c\") " pod="openshift-dns/dns-default-tn2hz" Jun 03 16:34:28.435463 ip-10-0-135-67 kubenswrapper[2568]: E0603 16:34:28.435251 2568 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jun 03 16:34:28.435463 ip-10-0-135-67 kubenswrapper[2568]: E0603 16:34:28.435263 2568 projected.go:264] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found Jun 03 16:34:28.435463 ip-10-0-135-67 kubenswrapper[2568]: E0603 16:34:28.435281 2568 projected.go:194] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-74745bdc9c-rk4cq: secret "image-registry-tls" not found Jun 03 16:34:28.435463 ip-10-0-135-67 kubenswrapper[2568]: E0603 16:34:28.435294 2568 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/0f3a9c08-8974-46c9-9245-fbfc1a73e96c-metrics-tls podName:0f3a9c08-8974-46c9-9245-fbfc1a73e96c nodeName:}" failed. No retries permitted until 2026-06-03 16:34:30.43528168 +0000 UTC m=+42.577456316 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/0f3a9c08-8974-46c9-9245-fbfc1a73e96c-metrics-tls") pod "dns-default-tn2hz" (UID: "0f3a9c08-8974-46c9-9245-fbfc1a73e96c") : secret "dns-default-metrics-tls" not found Jun 03 16:34:28.435463 ip-10-0-135-67 kubenswrapper[2568]: E0603 16:34:28.435330 2568 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/1adc570a-c47f-4bc0-a3f5-a7e90c775e3a-registry-tls podName:1adc570a-c47f-4bc0-a3f5-a7e90c775e3a nodeName:}" failed. No retries permitted until 2026-06-03 16:34:30.435313985 +0000 UTC m=+42.577488622 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/1adc570a-c47f-4bc0-a3f5-a7e90c775e3a-registry-tls") pod "image-registry-74745bdc9c-rk4cq" (UID: "1adc570a-c47f-4bc0-a3f5-a7e90c775e3a") : secret "image-registry-tls" not found Jun 03 16:34:28.536256 ip-10-0-135-67 kubenswrapper[2568]: I0603 16:34:28.536231 2568 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/7839d8fc-3e8c-481e-93f6-5e2eb79ee81f-cert\") pod \"ingress-canary-mjr7l\" (UID: \"7839d8fc-3e8c-481e-93f6-5e2eb79ee81f\") " pod="openshift-ingress-canary/ingress-canary-mjr7l" Jun 03 16:34:28.536390 ip-10-0-135-67 kubenswrapper[2568]: E0603 16:34:28.536375 2568 secret.go:189] Couldn't get secret openshift-ingress-canary/canary-serving-cert: secret "canary-serving-cert" not found Jun 03 16:34:28.536444 ip-10-0-135-67 kubenswrapper[2568]: E0603 16:34:28.536434 2568 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/7839d8fc-3e8c-481e-93f6-5e2eb79ee81f-cert podName:7839d8fc-3e8c-481e-93f6-5e2eb79ee81f nodeName:}" failed. No retries permitted until 2026-06-03 16:34:30.536417083 +0000 UTC m=+42.678591717 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "cert" (UniqueName: "kubernetes.io/secret/7839d8fc-3e8c-481e-93f6-5e2eb79ee81f-cert") pod "ingress-canary-mjr7l" (UID: "7839d8fc-3e8c-481e-93f6-5e2eb79ee81f") : secret "canary-serving-cert" not found Jun 03 16:34:28.589121 ip-10-0-135-67 kubenswrapper[2568]: I0603 16:34:28.589095 2568 generic.go:358] "Generic (PLEG): container finished" podID="ce603907-50de-4706-9fa0-5edcca2ea9ea" containerID="ce85c8bfa9309e5fc85d8f386239f4b62ca255eee668c8c613d7b84c5ed61af9" exitCode=0 Jun 03 16:34:28.589211 ip-10-0-135-67 kubenswrapper[2568]: I0603 16:34:28.589157 2568 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-q2q9l" event={"ID":"ce603907-50de-4706-9fa0-5edcca2ea9ea","Type":"ContainerDied","Data":"ce85c8bfa9309e5fc85d8f386239f4b62ca255eee668c8c613d7b84c5ed61af9"} Jun 03 16:34:29.593939 ip-10-0-135-67 kubenswrapper[2568]: I0603 16:34:29.593908 2568 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-q2q9l" event={"ID":"ce603907-50de-4706-9fa0-5edcca2ea9ea","Type":"ContainerStarted","Data":"f88584b2ac2e2c8c093711f8590f8bf583cdc40b9e674d349803f8d02ad4665f"} Jun 03 16:34:29.612979 ip-10-0-135-67 kubenswrapper[2568]: I0603 16:34:29.612936 2568 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-multus/multus-additional-cni-plugins-q2q9l" podStartSLOduration=5.864755884 podStartE2EDuration="41.612924105s" podCreationTimestamp="2026-06-03 16:33:48 +0000 UTC" firstStartedPulling="2026-06-03 16:33:51.394135199 +0000 UTC m=+3.536309837" lastFinishedPulling="2026-06-03 16:34:27.14230341 +0000 UTC m=+39.284478058" observedRunningTime="2026-06-03 16:34:29.611622262 +0000 UTC m=+41.753796916" watchObservedRunningTime="2026-06-03 16:34:29.612924105 +0000 UTC m=+41.755098759" Jun 03 16:34:30.449466 ip-10-0-135-67 kubenswrapper[2568]: I0603 16:34:30.449390 2568 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/1adc570a-c47f-4bc0-a3f5-a7e90c775e3a-registry-tls\") pod \"image-registry-74745bdc9c-rk4cq\" (UID: \"1adc570a-c47f-4bc0-a3f5-a7e90c775e3a\") " pod="openshift-image-registry/image-registry-74745bdc9c-rk4cq" Jun 03 16:34:30.449466 ip-10-0-135-67 kubenswrapper[2568]: I0603 16:34:30.449423 2568 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/0f3a9c08-8974-46c9-9245-fbfc1a73e96c-metrics-tls\") pod \"dns-default-tn2hz\" (UID: \"0f3a9c08-8974-46c9-9245-fbfc1a73e96c\") " pod="openshift-dns/dns-default-tn2hz" Jun 03 16:34:30.449643 ip-10-0-135-67 kubenswrapper[2568]: E0603 16:34:30.449526 2568 projected.go:264] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found Jun 03 16:34:30.449643 ip-10-0-135-67 kubenswrapper[2568]: E0603 16:34:30.449538 2568 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jun 03 16:34:30.449643 ip-10-0-135-67 kubenswrapper[2568]: E0603 16:34:30.449543 2568 projected.go:194] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-74745bdc9c-rk4cq: secret "image-registry-tls" not found Jun 03 16:34:30.449643 ip-10-0-135-67 kubenswrapper[2568]: E0603 16:34:30.449587 2568 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/0f3a9c08-8974-46c9-9245-fbfc1a73e96c-metrics-tls podName:0f3a9c08-8974-46c9-9245-fbfc1a73e96c nodeName:}" failed. No retries permitted until 2026-06-03 16:34:34.449573237 +0000 UTC m=+46.591747870 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/0f3a9c08-8974-46c9-9245-fbfc1a73e96c-metrics-tls") pod "dns-default-tn2hz" (UID: "0f3a9c08-8974-46c9-9245-fbfc1a73e96c") : secret "dns-default-metrics-tls" not found Jun 03 16:34:30.449643 ip-10-0-135-67 kubenswrapper[2568]: E0603 16:34:30.449601 2568 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/1adc570a-c47f-4bc0-a3f5-a7e90c775e3a-registry-tls podName:1adc570a-c47f-4bc0-a3f5-a7e90c775e3a nodeName:}" failed. No retries permitted until 2026-06-03 16:34:34.449594403 +0000 UTC m=+46.591769035 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/1adc570a-c47f-4bc0-a3f5-a7e90c775e3a-registry-tls") pod "image-registry-74745bdc9c-rk4cq" (UID: "1adc570a-c47f-4bc0-a3f5-a7e90c775e3a") : secret "image-registry-tls" not found Jun 03 16:34:30.550563 ip-10-0-135-67 kubenswrapper[2568]: I0603 16:34:30.550535 2568 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/7839d8fc-3e8c-481e-93f6-5e2eb79ee81f-cert\") pod \"ingress-canary-mjr7l\" (UID: \"7839d8fc-3e8c-481e-93f6-5e2eb79ee81f\") " pod="openshift-ingress-canary/ingress-canary-mjr7l" Jun 03 16:34:30.550691 ip-10-0-135-67 kubenswrapper[2568]: E0603 16:34:30.550624 2568 secret.go:189] Couldn't get secret openshift-ingress-canary/canary-serving-cert: secret "canary-serving-cert" not found Jun 03 16:34:30.550691 ip-10-0-135-67 kubenswrapper[2568]: E0603 16:34:30.550667 2568 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/7839d8fc-3e8c-481e-93f6-5e2eb79ee81f-cert podName:7839d8fc-3e8c-481e-93f6-5e2eb79ee81f nodeName:}" failed. No retries permitted until 2026-06-03 16:34:34.550654462 +0000 UTC m=+46.692829093 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "cert" (UniqueName: "kubernetes.io/secret/7839d8fc-3e8c-481e-93f6-5e2eb79ee81f-cert") pod "ingress-canary-mjr7l" (UID: "7839d8fc-3e8c-481e-93f6-5e2eb79ee81f") : secret "canary-serving-cert" not found Jun 03 16:34:34.478788 ip-10-0-135-67 kubenswrapper[2568]: I0603 16:34:34.478610 2568 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/0f3a9c08-8974-46c9-9245-fbfc1a73e96c-metrics-tls\") pod \"dns-default-tn2hz\" (UID: \"0f3a9c08-8974-46c9-9245-fbfc1a73e96c\") " pod="openshift-dns/dns-default-tn2hz" Jun 03 16:34:34.479187 ip-10-0-135-67 kubenswrapper[2568]: E0603 16:34:34.478747 2568 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jun 03 16:34:34.479187 ip-10-0-135-67 kubenswrapper[2568]: I0603 16:34:34.478849 2568 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/1adc570a-c47f-4bc0-a3f5-a7e90c775e3a-registry-tls\") pod \"image-registry-74745bdc9c-rk4cq\" (UID: \"1adc570a-c47f-4bc0-a3f5-a7e90c775e3a\") " pod="openshift-image-registry/image-registry-74745bdc9c-rk4cq" Jun 03 16:34:34.479187 ip-10-0-135-67 kubenswrapper[2568]: E0603 16:34:34.478900 2568 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/0f3a9c08-8974-46c9-9245-fbfc1a73e96c-metrics-tls podName:0f3a9c08-8974-46c9-9245-fbfc1a73e96c nodeName:}" failed. No retries permitted until 2026-06-03 16:34:42.478884592 +0000 UTC m=+54.621059230 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/0f3a9c08-8974-46c9-9245-fbfc1a73e96c-metrics-tls") pod "dns-default-tn2hz" (UID: "0f3a9c08-8974-46c9-9245-fbfc1a73e96c") : secret "dns-default-metrics-tls" not found Jun 03 16:34:34.479187 ip-10-0-135-67 kubenswrapper[2568]: E0603 16:34:34.478932 2568 projected.go:264] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found Jun 03 16:34:34.479187 ip-10-0-135-67 kubenswrapper[2568]: E0603 16:34:34.478942 2568 projected.go:194] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-74745bdc9c-rk4cq: secret "image-registry-tls" not found Jun 03 16:34:34.479187 ip-10-0-135-67 kubenswrapper[2568]: E0603 16:34:34.478983 2568 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/1adc570a-c47f-4bc0-a3f5-a7e90c775e3a-registry-tls podName:1adc570a-c47f-4bc0-a3f5-a7e90c775e3a nodeName:}" failed. No retries permitted until 2026-06-03 16:34:42.478972176 +0000 UTC m=+54.621146809 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/1adc570a-c47f-4bc0-a3f5-a7e90c775e3a-registry-tls") pod "image-registry-74745bdc9c-rk4cq" (UID: "1adc570a-c47f-4bc0-a3f5-a7e90c775e3a") : secret "image-registry-tls" not found Jun 03 16:34:34.579114 ip-10-0-135-67 kubenswrapper[2568]: I0603 16:34:34.579089 2568 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/7839d8fc-3e8c-481e-93f6-5e2eb79ee81f-cert\") pod \"ingress-canary-mjr7l\" (UID: \"7839d8fc-3e8c-481e-93f6-5e2eb79ee81f\") " pod="openshift-ingress-canary/ingress-canary-mjr7l" Jun 03 16:34:34.579238 ip-10-0-135-67 kubenswrapper[2568]: E0603 16:34:34.579188 2568 secret.go:189] Couldn't get secret openshift-ingress-canary/canary-serving-cert: secret "canary-serving-cert" not found Jun 03 16:34:34.579238 ip-10-0-135-67 kubenswrapper[2568]: E0603 16:34:34.579231 2568 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/7839d8fc-3e8c-481e-93f6-5e2eb79ee81f-cert podName:7839d8fc-3e8c-481e-93f6-5e2eb79ee81f nodeName:}" failed. No retries permitted until 2026-06-03 16:34:42.579218588 +0000 UTC m=+54.721393220 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "cert" (UniqueName: "kubernetes.io/secret/7839d8fc-3e8c-481e-93f6-5e2eb79ee81f-cert") pod "ingress-canary-mjr7l" (UID: "7839d8fc-3e8c-481e-93f6-5e2eb79ee81f") : secret "canary-serving-cert" not found Jun 03 16:34:42.534349 ip-10-0-135-67 kubenswrapper[2568]: I0603 16:34:42.534311 2568 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/1adc570a-c47f-4bc0-a3f5-a7e90c775e3a-registry-tls\") pod \"image-registry-74745bdc9c-rk4cq\" (UID: \"1adc570a-c47f-4bc0-a3f5-a7e90c775e3a\") " pod="openshift-image-registry/image-registry-74745bdc9c-rk4cq" Jun 03 16:34:42.534349 ip-10-0-135-67 kubenswrapper[2568]: I0603 16:34:42.534350 2568 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/0f3a9c08-8974-46c9-9245-fbfc1a73e96c-metrics-tls\") pod \"dns-default-tn2hz\" (UID: \"0f3a9c08-8974-46c9-9245-fbfc1a73e96c\") " pod="openshift-dns/dns-default-tn2hz" Jun 03 16:34:42.534799 ip-10-0-135-67 kubenswrapper[2568]: E0603 16:34:42.534451 2568 projected.go:264] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found Jun 03 16:34:42.534799 ip-10-0-135-67 kubenswrapper[2568]: E0603 16:34:42.534469 2568 projected.go:194] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-74745bdc9c-rk4cq: secret "image-registry-tls" not found Jun 03 16:34:42.534799 ip-10-0-135-67 kubenswrapper[2568]: E0603 16:34:42.534469 2568 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jun 03 16:34:42.534799 ip-10-0-135-67 kubenswrapper[2568]: E0603 16:34:42.534524 2568 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/1adc570a-c47f-4bc0-a3f5-a7e90c775e3a-registry-tls podName:1adc570a-c47f-4bc0-a3f5-a7e90c775e3a nodeName:}" failed. No retries permitted until 2026-06-03 16:34:58.534509137 +0000 UTC m=+70.676683769 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/1adc570a-c47f-4bc0-a3f5-a7e90c775e3a-registry-tls") pod "image-registry-74745bdc9c-rk4cq" (UID: "1adc570a-c47f-4bc0-a3f5-a7e90c775e3a") : secret "image-registry-tls" not found Jun 03 16:34:42.534799 ip-10-0-135-67 kubenswrapper[2568]: E0603 16:34:42.534585 2568 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/0f3a9c08-8974-46c9-9245-fbfc1a73e96c-metrics-tls podName:0f3a9c08-8974-46c9-9245-fbfc1a73e96c nodeName:}" failed. No retries permitted until 2026-06-03 16:34:58.534573707 +0000 UTC m=+70.676748339 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/0f3a9c08-8974-46c9-9245-fbfc1a73e96c-metrics-tls") pod "dns-default-tn2hz" (UID: "0f3a9c08-8974-46c9-9245-fbfc1a73e96c") : secret "dns-default-metrics-tls" not found Jun 03 16:34:42.635178 ip-10-0-135-67 kubenswrapper[2568]: I0603 16:34:42.635149 2568 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/7839d8fc-3e8c-481e-93f6-5e2eb79ee81f-cert\") pod \"ingress-canary-mjr7l\" (UID: \"7839d8fc-3e8c-481e-93f6-5e2eb79ee81f\") " pod="openshift-ingress-canary/ingress-canary-mjr7l" Jun 03 16:34:42.635306 ip-10-0-135-67 kubenswrapper[2568]: E0603 16:34:42.635263 2568 secret.go:189] Couldn't get secret openshift-ingress-canary/canary-serving-cert: secret "canary-serving-cert" not found Jun 03 16:34:42.635306 ip-10-0-135-67 kubenswrapper[2568]: E0603 16:34:42.635303 2568 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/7839d8fc-3e8c-481e-93f6-5e2eb79ee81f-cert podName:7839d8fc-3e8c-481e-93f6-5e2eb79ee81f nodeName:}" failed. No retries permitted until 2026-06-03 16:34:58.63529224 +0000 UTC m=+70.777466871 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "cert" (UniqueName: "kubernetes.io/secret/7839d8fc-3e8c-481e-93f6-5e2eb79ee81f-cert") pod "ingress-canary-mjr7l" (UID: "7839d8fc-3e8c-481e-93f6-5e2eb79ee81f") : secret "canary-serving-cert" not found Jun 03 16:34:52.583635 ip-10-0-135-67 kubenswrapper[2568]: I0603 16:34:52.583609 2568 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-94fdt" Jun 03 16:34:54.110234 ip-10-0-135-67 kubenswrapper[2568]: I0603 16:34:54.110187 2568 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/ddc210bb-9544-4ca7-b2de-f84c92d84510-metrics-certs\") pod \"network-metrics-daemon-54gnw\" (UID: \"ddc210bb-9544-4ca7-b2de-f84c92d84510\") " pod="openshift-multus/network-metrics-daemon-54gnw" Jun 03 16:34:54.112193 ip-10-0-135-67 kubenswrapper[2568]: I0603 16:34:54.112176 2568 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-secret\"" Jun 03 16:34:54.120704 ip-10-0-135-67 kubenswrapper[2568]: E0603 16:34:54.120687 2568 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: secret "metrics-daemon-secret" not found Jun 03 16:34:54.120779 ip-10-0-135-67 kubenswrapper[2568]: E0603 16:34:54.120754 2568 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/ddc210bb-9544-4ca7-b2de-f84c92d84510-metrics-certs podName:ddc210bb-9544-4ca7-b2de-f84c92d84510 nodeName:}" failed. No retries permitted until 2026-06-03 16:35:58.120733055 +0000 UTC m=+130.262907687 (durationBeforeRetry 1m4s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/ddc210bb-9544-4ca7-b2de-f84c92d84510-metrics-certs") pod "network-metrics-daemon-54gnw" (UID: "ddc210bb-9544-4ca7-b2de-f84c92d84510") : secret "metrics-daemon-secret" not found Jun 03 16:34:54.210478 ip-10-0-135-67 kubenswrapper[2568]: I0603 16:34:54.210448 2568 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-gwzmz\" (UniqueName: \"kubernetes.io/projected/4a9428e9-7e73-44e5-ab4e-8dcb9028335e-kube-api-access-gwzmz\") pod \"network-check-target-569p4\" (UID: \"4a9428e9-7e73-44e5-ab4e-8dcb9028335e\") " pod="openshift-network-diagnostics/network-check-target-569p4" Jun 03 16:34:54.212712 ip-10-0-135-67 kubenswrapper[2568]: I0603 16:34:54.212698 2568 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"kube-root-ca.crt\"" Jun 03 16:34:54.223465 ip-10-0-135-67 kubenswrapper[2568]: I0603 16:34:54.223446 2568 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"openshift-service-ca.crt\"" Jun 03 16:34:54.234919 ip-10-0-135-67 kubenswrapper[2568]: I0603 16:34:54.234893 2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-gwzmz\" (UniqueName: \"kubernetes.io/projected/4a9428e9-7e73-44e5-ab4e-8dcb9028335e-kube-api-access-gwzmz\") pod \"network-check-target-569p4\" (UID: \"4a9428e9-7e73-44e5-ab4e-8dcb9028335e\") " pod="openshift-network-diagnostics/network-check-target-569p4" Jun 03 16:34:54.520429 ip-10-0-135-67 kubenswrapper[2568]: I0603 16:34:54.520404 2568 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"default-dockercfg-r657c\"" Jun 03 16:34:54.529068 ip-10-0-135-67 kubenswrapper[2568]: I0603 16:34:54.529046 2568 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-569p4" Jun 03 16:34:54.653925 ip-10-0-135-67 kubenswrapper[2568]: I0603 16:34:54.653898 2568 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-target-569p4"] Jun 03 16:34:54.657265 ip-10-0-135-67 kubenswrapper[2568]: W0603 16:34:54.657236 2568 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod4a9428e9_7e73_44e5_ab4e_8dcb9028335e.slice/crio-2a6e956ec9e16fe2d201209f63e77f9f192bc870dd33676917c425b346d19ab7 WatchSource:0}: Error finding container 2a6e956ec9e16fe2d201209f63e77f9f192bc870dd33676917c425b346d19ab7: Status 404 returned error can't find the container with id 2a6e956ec9e16fe2d201209f63e77f9f192bc870dd33676917c425b346d19ab7 Jun 03 16:34:55.116624 ip-10-0-135-67 kubenswrapper[2568]: I0603 16:34:55.116592 2568 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/5c5a9b32-c7b7-4da2-85fa-7db4f429606d-original-pull-secret\") pod \"global-pull-secret-syncer-jmmft\" (UID: \"5c5a9b32-c7b7-4da2-85fa-7db4f429606d\") " pod="kube-system/global-pull-secret-syncer-jmmft" Jun 03 16:34:55.119014 ip-10-0-135-67 kubenswrapper[2568]: I0603 16:34:55.118988 2568 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"original-pull-secret\"" Jun 03 16:34:55.129707 ip-10-0-135-67 kubenswrapper[2568]: I0603 16:34:55.129686 2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/5c5a9b32-c7b7-4da2-85fa-7db4f429606d-original-pull-secret\") pod \"global-pull-secret-syncer-jmmft\" (UID: \"5c5a9b32-c7b7-4da2-85fa-7db4f429606d\") " pod="kube-system/global-pull-secret-syncer-jmmft" Jun 03 16:34:55.425214 ip-10-0-135-67 kubenswrapper[2568]: I0603 16:34:55.425138 2568 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-jmmft" Jun 03 16:34:55.565436 ip-10-0-135-67 kubenswrapper[2568]: I0603 16:34:55.565400 2568 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kube-system/global-pull-secret-syncer-jmmft"] Jun 03 16:34:55.569110 ip-10-0-135-67 kubenswrapper[2568]: W0603 16:34:55.569076 2568 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod5c5a9b32_c7b7_4da2_85fa_7db4f429606d.slice/crio-a61898aeb99d6bd018339f2f12a5a6751b8576a90d0955980c9f4290fe1341d0 WatchSource:0}: Error finding container a61898aeb99d6bd018339f2f12a5a6751b8576a90d0955980c9f4290fe1341d0: Status 404 returned error can't find the container with id a61898aeb99d6bd018339f2f12a5a6751b8576a90d0955980c9f4290fe1341d0 Jun 03 16:34:55.643577 ip-10-0-135-67 kubenswrapper[2568]: I0603 16:34:55.643548 2568 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kube-system/global-pull-secret-syncer-jmmft" event={"ID":"5c5a9b32-c7b7-4da2-85fa-7db4f429606d","Type":"ContainerStarted","Data":"a61898aeb99d6bd018339f2f12a5a6751b8576a90d0955980c9f4290fe1341d0"} Jun 03 16:34:55.644661 ip-10-0-135-67 kubenswrapper[2568]: I0603 16:34:55.644634 2568 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-target-569p4" event={"ID":"4a9428e9-7e73-44e5-ab4e-8dcb9028335e","Type":"ContainerStarted","Data":"2a6e956ec9e16fe2d201209f63e77f9f192bc870dd33676917c425b346d19ab7"} Jun 03 16:34:58.545170 ip-10-0-135-67 kubenswrapper[2568]: I0603 16:34:58.545129 2568 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/1adc570a-c47f-4bc0-a3f5-a7e90c775e3a-registry-tls\") pod \"image-registry-74745bdc9c-rk4cq\" (UID: \"1adc570a-c47f-4bc0-a3f5-a7e90c775e3a\") " pod="openshift-image-registry/image-registry-74745bdc9c-rk4cq" Jun 03 16:34:58.545714 ip-10-0-135-67 kubenswrapper[2568]: I0603 16:34:58.545180 2568 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/0f3a9c08-8974-46c9-9245-fbfc1a73e96c-metrics-tls\") pod \"dns-default-tn2hz\" (UID: \"0f3a9c08-8974-46c9-9245-fbfc1a73e96c\") " pod="openshift-dns/dns-default-tn2hz" Jun 03 16:34:58.545714 ip-10-0-135-67 kubenswrapper[2568]: E0603 16:34:58.545311 2568 projected.go:264] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found Jun 03 16:34:58.545714 ip-10-0-135-67 kubenswrapper[2568]: E0603 16:34:58.545324 2568 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jun 03 16:34:58.545714 ip-10-0-135-67 kubenswrapper[2568]: E0603 16:34:58.545336 2568 projected.go:194] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-74745bdc9c-rk4cq: secret "image-registry-tls" not found Jun 03 16:34:58.545714 ip-10-0-135-67 kubenswrapper[2568]: E0603 16:34:58.545389 2568 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/0f3a9c08-8974-46c9-9245-fbfc1a73e96c-metrics-tls podName:0f3a9c08-8974-46c9-9245-fbfc1a73e96c nodeName:}" failed. No retries permitted until 2026-06-03 16:35:30.545370586 +0000 UTC m=+102.687545220 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/0f3a9c08-8974-46c9-9245-fbfc1a73e96c-metrics-tls") pod "dns-default-tn2hz" (UID: "0f3a9c08-8974-46c9-9245-fbfc1a73e96c") : secret "dns-default-metrics-tls" not found Jun 03 16:34:58.545714 ip-10-0-135-67 kubenswrapper[2568]: E0603 16:34:58.545408 2568 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/1adc570a-c47f-4bc0-a3f5-a7e90c775e3a-registry-tls podName:1adc570a-c47f-4bc0-a3f5-a7e90c775e3a nodeName:}" failed. No retries permitted until 2026-06-03 16:35:30.545398451 +0000 UTC m=+102.687573083 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/1adc570a-c47f-4bc0-a3f5-a7e90c775e3a-registry-tls") pod "image-registry-74745bdc9c-rk4cq" (UID: "1adc570a-c47f-4bc0-a3f5-a7e90c775e3a") : secret "image-registry-tls" not found Jun 03 16:34:58.646092 ip-10-0-135-67 kubenswrapper[2568]: I0603 16:34:58.646057 2568 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/7839d8fc-3e8c-481e-93f6-5e2eb79ee81f-cert\") pod \"ingress-canary-mjr7l\" (UID: \"7839d8fc-3e8c-481e-93f6-5e2eb79ee81f\") " pod="openshift-ingress-canary/ingress-canary-mjr7l" Jun 03 16:34:58.646238 ip-10-0-135-67 kubenswrapper[2568]: E0603 16:34:58.646193 2568 secret.go:189] Couldn't get secret openshift-ingress-canary/canary-serving-cert: secret "canary-serving-cert" not found Jun 03 16:34:58.646305 ip-10-0-135-67 kubenswrapper[2568]: E0603 16:34:58.646246 2568 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/7839d8fc-3e8c-481e-93f6-5e2eb79ee81f-cert podName:7839d8fc-3e8c-481e-93f6-5e2eb79ee81f nodeName:}" failed. No retries permitted until 2026-06-03 16:35:30.646230787 +0000 UTC m=+102.788405424 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "cert" (UniqueName: "kubernetes.io/secret/7839d8fc-3e8c-481e-93f6-5e2eb79ee81f-cert") pod "ingress-canary-mjr7l" (UID: "7839d8fc-3e8c-481e-93f6-5e2eb79ee81f") : secret "canary-serving-cert" not found Jun 03 16:35:00.655037 ip-10-0-135-67 kubenswrapper[2568]: I0603 16:35:00.654992 2568 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kube-system/global-pull-secret-syncer-jmmft" event={"ID":"5c5a9b32-c7b7-4da2-85fa-7db4f429606d","Type":"ContainerStarted","Data":"097f2df6e0f1f178b48716ed8b5df39b73b0746eb91c7bcad3cf9825800e2d88"} Jun 03 16:35:00.656335 ip-10-0-135-67 kubenswrapper[2568]: I0603 16:35:00.656304 2568 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-target-569p4" event={"ID":"4a9428e9-7e73-44e5-ab4e-8dcb9028335e","Type":"ContainerStarted","Data":"ec8138521b22fedbc121ccad81f4780a7770860677291959da245a6be032dd8f"} Jun 03 16:35:00.656478 ip-10-0-135-67 kubenswrapper[2568]: I0603 16:35:00.656462 2568 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-network-diagnostics/network-check-target-569p4" Jun 03 16:35:00.669648 ip-10-0-135-67 kubenswrapper[2568]: I0603 16:35:00.669578 2568 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="kube-system/global-pull-secret-syncer-jmmft" podStartSLOduration=64.900145984 podStartE2EDuration="1m9.669566542s" podCreationTimestamp="2026-06-03 16:33:51 +0000 UTC" firstStartedPulling="2026-06-03 16:34:55.571267713 +0000 UTC m=+67.713442346" lastFinishedPulling="2026-06-03 16:35:00.340688254 +0000 UTC m=+72.482862904" observedRunningTime="2026-06-03 16:35:00.66919625 +0000 UTC m=+72.811370905" watchObservedRunningTime="2026-06-03 16:35:00.669566542 +0000 UTC m=+72.811741192" Jun 03 16:35:00.683093 ip-10-0-135-67 kubenswrapper[2568]: I0603 16:35:00.683053 2568 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-network-diagnostics/network-check-target-569p4" podStartSLOduration=67.0129207 podStartE2EDuration="1m12.683040213s" podCreationTimestamp="2026-06-03 16:33:48 +0000 UTC" firstStartedPulling="2026-06-03 16:34:54.658929694 +0000 UTC m=+66.801104327" lastFinishedPulling="2026-06-03 16:35:00.329049193 +0000 UTC m=+72.471223840" observedRunningTime="2026-06-03 16:35:00.682162449 +0000 UTC m=+72.824337102" watchObservedRunningTime="2026-06-03 16:35:00.683040213 +0000 UTC m=+72.825214867" Jun 03 16:35:30.558110 ip-10-0-135-67 kubenswrapper[2568]: I0603 16:35:30.558073 2568 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/1adc570a-c47f-4bc0-a3f5-a7e90c775e3a-registry-tls\") pod \"image-registry-74745bdc9c-rk4cq\" (UID: \"1adc570a-c47f-4bc0-a3f5-a7e90c775e3a\") " pod="openshift-image-registry/image-registry-74745bdc9c-rk4cq" Jun 03 16:35:30.558570 ip-10-0-135-67 kubenswrapper[2568]: I0603 16:35:30.558119 2568 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/0f3a9c08-8974-46c9-9245-fbfc1a73e96c-metrics-tls\") pod \"dns-default-tn2hz\" (UID: \"0f3a9c08-8974-46c9-9245-fbfc1a73e96c\") " pod="openshift-dns/dns-default-tn2hz" Jun 03 16:35:30.558570 ip-10-0-135-67 kubenswrapper[2568]: E0603 16:35:30.558204 2568 projected.go:264] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found Jun 03 16:35:30.558570 ip-10-0-135-67 kubenswrapper[2568]: E0603 16:35:30.558222 2568 projected.go:194] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-74745bdc9c-rk4cq: secret "image-registry-tls" not found Jun 03 16:35:30.558570 ip-10-0-135-67 kubenswrapper[2568]: E0603 16:35:30.558254 2568 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jun 03 16:35:30.558570 ip-10-0-135-67 kubenswrapper[2568]: E0603 16:35:30.558283 2568 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/1adc570a-c47f-4bc0-a3f5-a7e90c775e3a-registry-tls podName:1adc570a-c47f-4bc0-a3f5-a7e90c775e3a nodeName:}" failed. No retries permitted until 2026-06-03 16:36:34.558268791 +0000 UTC m=+166.700443423 (durationBeforeRetry 1m4s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/1adc570a-c47f-4bc0-a3f5-a7e90c775e3a-registry-tls") pod "image-registry-74745bdc9c-rk4cq" (UID: "1adc570a-c47f-4bc0-a3f5-a7e90c775e3a") : secret "image-registry-tls" not found Jun 03 16:35:30.558570 ip-10-0-135-67 kubenswrapper[2568]: E0603 16:35:30.558307 2568 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/0f3a9c08-8974-46c9-9245-fbfc1a73e96c-metrics-tls podName:0f3a9c08-8974-46c9-9245-fbfc1a73e96c nodeName:}" failed. No retries permitted until 2026-06-03 16:36:34.558291119 +0000 UTC m=+166.700465754 (durationBeforeRetry 1m4s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/0f3a9c08-8974-46c9-9245-fbfc1a73e96c-metrics-tls") pod "dns-default-tn2hz" (UID: "0f3a9c08-8974-46c9-9245-fbfc1a73e96c") : secret "dns-default-metrics-tls" not found Jun 03 16:35:30.658939 ip-10-0-135-67 kubenswrapper[2568]: I0603 16:35:30.658913 2568 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/7839d8fc-3e8c-481e-93f6-5e2eb79ee81f-cert\") pod \"ingress-canary-mjr7l\" (UID: \"7839d8fc-3e8c-481e-93f6-5e2eb79ee81f\") " pod="openshift-ingress-canary/ingress-canary-mjr7l" Jun 03 16:35:30.659097 ip-10-0-135-67 kubenswrapper[2568]: E0603 16:35:30.659033 2568 secret.go:189] Couldn't get secret openshift-ingress-canary/canary-serving-cert: secret "canary-serving-cert" not found Jun 03 16:35:30.659097 ip-10-0-135-67 kubenswrapper[2568]: E0603 16:35:30.659074 2568 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/7839d8fc-3e8c-481e-93f6-5e2eb79ee81f-cert podName:7839d8fc-3e8c-481e-93f6-5e2eb79ee81f nodeName:}" failed. No retries permitted until 2026-06-03 16:36:34.659062592 +0000 UTC m=+166.801237224 (durationBeforeRetry 1m4s). Error: MountVolume.SetUp failed for volume "cert" (UniqueName: "kubernetes.io/secret/7839d8fc-3e8c-481e-93f6-5e2eb79ee81f-cert") pod "ingress-canary-mjr7l" (UID: "7839d8fc-3e8c-481e-93f6-5e2eb79ee81f") : secret "canary-serving-cert" not found Jun 03 16:35:31.660821 ip-10-0-135-67 kubenswrapper[2568]: I0603 16:35:31.660788 2568 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-network-diagnostics/network-check-target-569p4" Jun 03 16:35:48.682369 ip-10-0-135-67 kubenswrapper[2568]: I0603 16:35:48.682333 2568 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-console-operator/console-operator-86d7c6cc77-mwpf2"] Jun 03 16:35:48.683987 ip-10-0-135-67 kubenswrapper[2568]: I0603 16:35:48.683971 2568 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console-operator/console-operator-86d7c6cc77-mwpf2" Jun 03 16:35:48.686090 ip-10-0-135-67 kubenswrapper[2568]: I0603 16:35:48.686064 2568 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console-operator\"/\"console-operator-config\"" Jun 03 16:35:48.686184 ip-10-0-135-67 kubenswrapper[2568]: I0603 16:35:48.686064 2568 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console-operator\"/\"console-operator-dockercfg-z7ldt\"" Jun 03 16:35:48.686621 ip-10-0-135-67 kubenswrapper[2568]: I0603 16:35:48.686600 2568 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console-operator\"/\"serving-cert\"" Jun 03 16:35:48.686621 ip-10-0-135-67 kubenswrapper[2568]: I0603 16:35:48.686612 2568 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console-operator\"/\"openshift-service-ca.crt\"" Jun 03 16:35:48.686841 ip-10-0-135-67 kubenswrapper[2568]: I0603 16:35:48.686653 2568 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console-operator\"/\"kube-root-ca.crt\"" Jun 03 16:35:48.690766 ip-10-0-135-67 kubenswrapper[2568]: I0603 16:35:48.690747 2568 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console-operator\"/\"trusted-ca\"" Jun 03 16:35:48.694062 ip-10-0-135-67 kubenswrapper[2568]: I0603 16:35:48.694039 2568 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-console-operator/console-operator-86d7c6cc77-mwpf2"] Jun 03 16:35:48.783603 ip-10-0-135-67 kubenswrapper[2568]: I0603 16:35:48.783571 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/b1e67fcc-fd50-4a1e-af4e-48c44fb8db7d-config\") pod \"console-operator-86d7c6cc77-mwpf2\" (UID: \"b1e67fcc-fd50-4a1e-af4e-48c44fb8db7d\") " pod="openshift-console-operator/console-operator-86d7c6cc77-mwpf2" Jun 03 16:35:48.783603 ip-10-0-135-67 kubenswrapper[2568]: I0603 16:35:48.783603 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/b1e67fcc-fd50-4a1e-af4e-48c44fb8db7d-trusted-ca\") pod \"console-operator-86d7c6cc77-mwpf2\" (UID: \"b1e67fcc-fd50-4a1e-af4e-48c44fb8db7d\") " pod="openshift-console-operator/console-operator-86d7c6cc77-mwpf2" Jun 03 16:35:48.783826 ip-10-0-135-67 kubenswrapper[2568]: I0603 16:35:48.783652 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/b1e67fcc-fd50-4a1e-af4e-48c44fb8db7d-serving-cert\") pod \"console-operator-86d7c6cc77-mwpf2\" (UID: \"b1e67fcc-fd50-4a1e-af4e-48c44fb8db7d\") " pod="openshift-console-operator/console-operator-86d7c6cc77-mwpf2" Jun 03 16:35:48.783826 ip-10-0-135-67 kubenswrapper[2568]: I0603 16:35:48.783671 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-6sjph\" (UniqueName: \"kubernetes.io/projected/b1e67fcc-fd50-4a1e-af4e-48c44fb8db7d-kube-api-access-6sjph\") pod \"console-operator-86d7c6cc77-mwpf2\" (UID: \"b1e67fcc-fd50-4a1e-af4e-48c44fb8db7d\") " pod="openshift-console-operator/console-operator-86d7c6cc77-mwpf2" Jun 03 16:35:48.788772 ip-10-0-135-67 kubenswrapper[2568]: I0603 16:35:48.788745 2568 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-monitoring/cluster-monitoring-operator-69b6cbdb88-tzxs6"] Jun 03 16:35:48.790525 ip-10-0-135-67 kubenswrapper[2568]: I0603 16:35:48.790507 2568 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/cluster-monitoring-operator-69b6cbdb88-tzxs6" Jun 03 16:35:48.792579 ip-10-0-135-67 kubenswrapper[2568]: I0603 16:35:48.792562 2568 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"cluster-monitoring-operator-tls\"" Jun 03 16:35:48.792673 ip-10-0-135-67 kubenswrapper[2568]: I0603 16:35:48.792614 2568 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"kube-root-ca.crt\"" Jun 03 16:35:48.793567 ip-10-0-135-67 kubenswrapper[2568]: I0603 16:35:48.793547 2568 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"openshift-service-ca.crt\"" Jun 03 16:35:48.793651 ip-10-0-135-67 kubenswrapper[2568]: I0603 16:35:48.793586 2568 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"telemetry-config\"" Jun 03 16:35:48.793651 ip-10-0-135-67 kubenswrapper[2568]: I0603 16:35:48.793547 2568 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"cluster-monitoring-operator-dockercfg-74dsk\"" Jun 03 16:35:48.804318 ip-10-0-135-67 kubenswrapper[2568]: I0603 16:35:48.804294 2568 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/cluster-monitoring-operator-69b6cbdb88-tzxs6"] Jun 03 16:35:48.884218 ip-10-0-135-67 kubenswrapper[2568]: I0603 16:35:48.884186 2568 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/b1e67fcc-fd50-4a1e-af4e-48c44fb8db7d-serving-cert\") pod \"console-operator-86d7c6cc77-mwpf2\" (UID: \"b1e67fcc-fd50-4a1e-af4e-48c44fb8db7d\") " pod="openshift-console-operator/console-operator-86d7c6cc77-mwpf2" Jun 03 16:35:48.884218 ip-10-0-135-67 kubenswrapper[2568]: I0603 16:35:48.884219 2568 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-6sjph\" (UniqueName: \"kubernetes.io/projected/b1e67fcc-fd50-4a1e-af4e-48c44fb8db7d-kube-api-access-6sjph\") pod \"console-operator-86d7c6cc77-mwpf2\" (UID: \"b1e67fcc-fd50-4a1e-af4e-48c44fb8db7d\") " pod="openshift-console-operator/console-operator-86d7c6cc77-mwpf2" Jun 03 16:35:48.884453 ip-10-0-135-67 kubenswrapper[2568]: I0603 16:35:48.884247 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-7z8sx\" (UniqueName: \"kubernetes.io/projected/48e00082-b030-48ac-aa35-9cb1ab31fae8-kube-api-access-7z8sx\") pod \"cluster-monitoring-operator-69b6cbdb88-tzxs6\" (UID: \"48e00082-b030-48ac-aa35-9cb1ab31fae8\") " pod="openshift-monitoring/cluster-monitoring-operator-69b6cbdb88-tzxs6" Jun 03 16:35:48.884453 ip-10-0-135-67 kubenswrapper[2568]: I0603 16:35:48.884313 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"telemetry-config\" (UniqueName: \"kubernetes.io/configmap/48e00082-b030-48ac-aa35-9cb1ab31fae8-telemetry-config\") pod \"cluster-monitoring-operator-69b6cbdb88-tzxs6\" (UID: \"48e00082-b030-48ac-aa35-9cb1ab31fae8\") " pod="openshift-monitoring/cluster-monitoring-operator-69b6cbdb88-tzxs6" Jun 03 16:35:48.884453 ip-10-0-135-67 kubenswrapper[2568]: I0603 16:35:48.884366 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/48e00082-b030-48ac-aa35-9cb1ab31fae8-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-69b6cbdb88-tzxs6\" (UID: \"48e00082-b030-48ac-aa35-9cb1ab31fae8\") " pod="openshift-monitoring/cluster-monitoring-operator-69b6cbdb88-tzxs6" Jun 03 16:35:48.884620 ip-10-0-135-67 kubenswrapper[2568]: I0603 16:35:48.884488 2568 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/b1e67fcc-fd50-4a1e-af4e-48c44fb8db7d-config\") pod \"console-operator-86d7c6cc77-mwpf2\" (UID: \"b1e67fcc-fd50-4a1e-af4e-48c44fb8db7d\") " pod="openshift-console-operator/console-operator-86d7c6cc77-mwpf2" Jun 03 16:35:48.884620 ip-10-0-135-67 kubenswrapper[2568]: I0603 16:35:48.884520 2568 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/b1e67fcc-fd50-4a1e-af4e-48c44fb8db7d-trusted-ca\") pod \"console-operator-86d7c6cc77-mwpf2\" (UID: \"b1e67fcc-fd50-4a1e-af4e-48c44fb8db7d\") " pod="openshift-console-operator/console-operator-86d7c6cc77-mwpf2" Jun 03 16:35:48.885099 ip-10-0-135-67 kubenswrapper[2568]: I0603 16:35:48.885077 2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/configmap/b1e67fcc-fd50-4a1e-af4e-48c44fb8db7d-config\") pod \"console-operator-86d7c6cc77-mwpf2\" (UID: \"b1e67fcc-fd50-4a1e-af4e-48c44fb8db7d\") " pod="openshift-console-operator/console-operator-86d7c6cc77-mwpf2" Jun 03 16:35:48.885328 ip-10-0-135-67 kubenswrapper[2568]: I0603 16:35:48.885311 2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/b1e67fcc-fd50-4a1e-af4e-48c44fb8db7d-trusted-ca\") pod \"console-operator-86d7c6cc77-mwpf2\" (UID: \"b1e67fcc-fd50-4a1e-af4e-48c44fb8db7d\") " pod="openshift-console-operator/console-operator-86d7c6cc77-mwpf2" Jun 03 16:35:48.886594 ip-10-0-135-67 kubenswrapper[2568]: I0603 16:35:48.886566 2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/b1e67fcc-fd50-4a1e-af4e-48c44fb8db7d-serving-cert\") pod \"console-operator-86d7c6cc77-mwpf2\" (UID: \"b1e67fcc-fd50-4a1e-af4e-48c44fb8db7d\") " pod="openshift-console-operator/console-operator-86d7c6cc77-mwpf2" Jun 03 16:35:48.904269 ip-10-0-135-67 kubenswrapper[2568]: I0603 16:35:48.904247 2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-6sjph\" (UniqueName: \"kubernetes.io/projected/b1e67fcc-fd50-4a1e-af4e-48c44fb8db7d-kube-api-access-6sjph\") pod \"console-operator-86d7c6cc77-mwpf2\" (UID: \"b1e67fcc-fd50-4a1e-af4e-48c44fb8db7d\") " pod="openshift-console-operator/console-operator-86d7c6cc77-mwpf2" Jun 03 16:35:48.985877 ip-10-0-135-67 kubenswrapper[2568]: I0603 16:35:48.985810 2568 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-7z8sx\" (UniqueName: \"kubernetes.io/projected/48e00082-b030-48ac-aa35-9cb1ab31fae8-kube-api-access-7z8sx\") pod \"cluster-monitoring-operator-69b6cbdb88-tzxs6\" (UID: \"48e00082-b030-48ac-aa35-9cb1ab31fae8\") " pod="openshift-monitoring/cluster-monitoring-operator-69b6cbdb88-tzxs6" Jun 03 16:35:48.985877 ip-10-0-135-67 kubenswrapper[2568]: I0603 16:35:48.985853 2568 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"telemetry-config\" (UniqueName: \"kubernetes.io/configmap/48e00082-b030-48ac-aa35-9cb1ab31fae8-telemetry-config\") pod \"cluster-monitoring-operator-69b6cbdb88-tzxs6\" (UID: \"48e00082-b030-48ac-aa35-9cb1ab31fae8\") " pod="openshift-monitoring/cluster-monitoring-operator-69b6cbdb88-tzxs6" Jun 03 16:35:48.985877 ip-10-0-135-67 kubenswrapper[2568]: I0603 16:35:48.985873 2568 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/48e00082-b030-48ac-aa35-9cb1ab31fae8-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-69b6cbdb88-tzxs6\" (UID: \"48e00082-b030-48ac-aa35-9cb1ab31fae8\") " pod="openshift-monitoring/cluster-monitoring-operator-69b6cbdb88-tzxs6" Jun 03 16:35:48.986108 ip-10-0-135-67 kubenswrapper[2568]: E0603 16:35:48.985980 2568 secret.go:189] Couldn't get secret openshift-monitoring/cluster-monitoring-operator-tls: secret "cluster-monitoring-operator-tls" not found Jun 03 16:35:48.986108 ip-10-0-135-67 kubenswrapper[2568]: E0603 16:35:48.986103 2568 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/48e00082-b030-48ac-aa35-9cb1ab31fae8-cluster-monitoring-operator-tls podName:48e00082-b030-48ac-aa35-9cb1ab31fae8 nodeName:}" failed. No retries permitted until 2026-06-03 16:35:49.486087575 +0000 UTC m=+121.628262210 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "cluster-monitoring-operator-tls" (UniqueName: "kubernetes.io/secret/48e00082-b030-48ac-aa35-9cb1ab31fae8-cluster-monitoring-operator-tls") pod "cluster-monitoring-operator-69b6cbdb88-tzxs6" (UID: "48e00082-b030-48ac-aa35-9cb1ab31fae8") : secret "cluster-monitoring-operator-tls" not found Jun 03 16:35:48.986575 ip-10-0-135-67 kubenswrapper[2568]: I0603 16:35:48.986555 2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"telemetry-config\" (UniqueName: \"kubernetes.io/configmap/48e00082-b030-48ac-aa35-9cb1ab31fae8-telemetry-config\") pod \"cluster-monitoring-operator-69b6cbdb88-tzxs6\" (UID: \"48e00082-b030-48ac-aa35-9cb1ab31fae8\") " pod="openshift-monitoring/cluster-monitoring-operator-69b6cbdb88-tzxs6" Jun 03 16:35:48.993214 ip-10-0-135-67 kubenswrapper[2568]: I0603 16:35:48.993194 2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-7z8sx\" (UniqueName: \"kubernetes.io/projected/48e00082-b030-48ac-aa35-9cb1ab31fae8-kube-api-access-7z8sx\") pod \"cluster-monitoring-operator-69b6cbdb88-tzxs6\" (UID: \"48e00082-b030-48ac-aa35-9cb1ab31fae8\") " pod="openshift-monitoring/cluster-monitoring-operator-69b6cbdb88-tzxs6" Jun 03 16:35:48.997329 ip-10-0-135-67 kubenswrapper[2568]: I0603 16:35:48.997042 2568 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console-operator/console-operator-86d7c6cc77-mwpf2" Jun 03 16:35:49.112824 ip-10-0-135-67 kubenswrapper[2568]: I0603 16:35:49.112795 2568 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-console-operator/console-operator-86d7c6cc77-mwpf2"] Jun 03 16:35:49.115665 ip-10-0-135-67 kubenswrapper[2568]: W0603 16:35:49.115635 2568 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podb1e67fcc_fd50_4a1e_af4e_48c44fb8db7d.slice/crio-5989440421c5c4448948617a655c9f8fe59fa7c38a0e863577eeaf2e260fbbdc WatchSource:0}: Error finding container 5989440421c5c4448948617a655c9f8fe59fa7c38a0e863577eeaf2e260fbbdc: Status 404 returned error can't find the container with id 5989440421c5c4448948617a655c9f8fe59fa7c38a0e863577eeaf2e260fbbdc Jun 03 16:35:49.490259 ip-10-0-135-67 kubenswrapper[2568]: I0603 16:35:49.490227 2568 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/48e00082-b030-48ac-aa35-9cb1ab31fae8-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-69b6cbdb88-tzxs6\" (UID: \"48e00082-b030-48ac-aa35-9cb1ab31fae8\") " pod="openshift-monitoring/cluster-monitoring-operator-69b6cbdb88-tzxs6" Jun 03 16:35:49.490422 ip-10-0-135-67 kubenswrapper[2568]: E0603 16:35:49.490369 2568 secret.go:189] Couldn't get secret openshift-monitoring/cluster-monitoring-operator-tls: secret "cluster-monitoring-operator-tls" not found Jun 03 16:35:49.490469 ip-10-0-135-67 kubenswrapper[2568]: E0603 16:35:49.490431 2568 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/48e00082-b030-48ac-aa35-9cb1ab31fae8-cluster-monitoring-operator-tls podName:48e00082-b030-48ac-aa35-9cb1ab31fae8 nodeName:}" failed. No retries permitted until 2026-06-03 16:35:50.490416655 +0000 UTC m=+122.632591287 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "cluster-monitoring-operator-tls" (UniqueName: "kubernetes.io/secret/48e00082-b030-48ac-aa35-9cb1ab31fae8-cluster-monitoring-operator-tls") pod "cluster-monitoring-operator-69b6cbdb88-tzxs6" (UID: "48e00082-b030-48ac-aa35-9cb1ab31fae8") : secret "cluster-monitoring-operator-tls" not found Jun 03 16:35:49.748070 ip-10-0-135-67 kubenswrapper[2568]: I0603 16:35:49.748036 2568 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-console-operator/console-operator-86d7c6cc77-mwpf2" event={"ID":"b1e67fcc-fd50-4a1e-af4e-48c44fb8db7d","Type":"ContainerStarted","Data":"5989440421c5c4448948617a655c9f8fe59fa7c38a0e863577eeaf2e260fbbdc"} Jun 03 16:35:50.497048 ip-10-0-135-67 kubenswrapper[2568]: I0603 16:35:50.497016 2568 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/48e00082-b030-48ac-aa35-9cb1ab31fae8-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-69b6cbdb88-tzxs6\" (UID: \"48e00082-b030-48ac-aa35-9cb1ab31fae8\") " pod="openshift-monitoring/cluster-monitoring-operator-69b6cbdb88-tzxs6" Jun 03 16:35:50.497205 ip-10-0-135-67 kubenswrapper[2568]: E0603 16:35:50.497098 2568 secret.go:189] Couldn't get secret openshift-monitoring/cluster-monitoring-operator-tls: secret "cluster-monitoring-operator-tls" not found Jun 03 16:35:50.497205 ip-10-0-135-67 kubenswrapper[2568]: E0603 16:35:50.497164 2568 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/48e00082-b030-48ac-aa35-9cb1ab31fae8-cluster-monitoring-operator-tls podName:48e00082-b030-48ac-aa35-9cb1ab31fae8 nodeName:}" failed. No retries permitted until 2026-06-03 16:35:52.497148139 +0000 UTC m=+124.639322771 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "cluster-monitoring-operator-tls" (UniqueName: "kubernetes.io/secret/48e00082-b030-48ac-aa35-9cb1ab31fae8-cluster-monitoring-operator-tls") pod "cluster-monitoring-operator-69b6cbdb88-tzxs6" (UID: "48e00082-b030-48ac-aa35-9cb1ab31fae8") : secret "cluster-monitoring-operator-tls" not found Jun 03 16:35:52.509574 ip-10-0-135-67 kubenswrapper[2568]: I0603 16:35:52.509543 2568 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/48e00082-b030-48ac-aa35-9cb1ab31fae8-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-69b6cbdb88-tzxs6\" (UID: \"48e00082-b030-48ac-aa35-9cb1ab31fae8\") " pod="openshift-monitoring/cluster-monitoring-operator-69b6cbdb88-tzxs6" Jun 03 16:35:52.509935 ip-10-0-135-67 kubenswrapper[2568]: E0603 16:35:52.509662 2568 secret.go:189] Couldn't get secret openshift-monitoring/cluster-monitoring-operator-tls: secret "cluster-monitoring-operator-tls" not found Jun 03 16:35:52.509935 ip-10-0-135-67 kubenswrapper[2568]: E0603 16:35:52.509715 2568 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/48e00082-b030-48ac-aa35-9cb1ab31fae8-cluster-monitoring-operator-tls podName:48e00082-b030-48ac-aa35-9cb1ab31fae8 nodeName:}" failed. No retries permitted until 2026-06-03 16:35:56.50969886 +0000 UTC m=+128.651873494 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "cluster-monitoring-operator-tls" (UniqueName: "kubernetes.io/secret/48e00082-b030-48ac-aa35-9cb1ab31fae8-cluster-monitoring-operator-tls") pod "cluster-monitoring-operator-69b6cbdb88-tzxs6" (UID: "48e00082-b030-48ac-aa35-9cb1ab31fae8") : secret "cluster-monitoring-operator-tls" not found Jun 03 16:35:52.755126 ip-10-0-135-67 kubenswrapper[2568]: I0603 16:35:52.755103 2568 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-86d7c6cc77-mwpf2_b1e67fcc-fd50-4a1e-af4e-48c44fb8db7d/console-operator/0.log" Jun 03 16:35:52.755260 ip-10-0-135-67 kubenswrapper[2568]: I0603 16:35:52.755145 2568 generic.go:358] "Generic (PLEG): container finished" podID="b1e67fcc-fd50-4a1e-af4e-48c44fb8db7d" containerID="2b6e0b299ee048481ece49c2d074fd1d4e5a07e133057dba7df4df7c26419596" exitCode=255 Jun 03 16:35:52.755260 ip-10-0-135-67 kubenswrapper[2568]: I0603 16:35:52.755203 2568 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-console-operator/console-operator-86d7c6cc77-mwpf2" event={"ID":"b1e67fcc-fd50-4a1e-af4e-48c44fb8db7d","Type":"ContainerDied","Data":"2b6e0b299ee048481ece49c2d074fd1d4e5a07e133057dba7df4df7c26419596"} Jun 03 16:35:52.755434 ip-10-0-135-67 kubenswrapper[2568]: I0603 16:35:52.755417 2568 scope.go:117] "RemoveContainer" containerID="2b6e0b299ee048481ece49c2d074fd1d4e5a07e133057dba7df4df7c26419596" Jun 03 16:35:53.758279 ip-10-0-135-67 kubenswrapper[2568]: I0603 16:35:53.758250 2568 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-86d7c6cc77-mwpf2_b1e67fcc-fd50-4a1e-af4e-48c44fb8db7d/console-operator/1.log" Jun 03 16:35:53.758686 ip-10-0-135-67 kubenswrapper[2568]: I0603 16:35:53.758576 2568 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-86d7c6cc77-mwpf2_b1e67fcc-fd50-4a1e-af4e-48c44fb8db7d/console-operator/0.log" Jun 03 16:35:53.758686 ip-10-0-135-67 kubenswrapper[2568]: I0603 16:35:53.758606 2568 generic.go:358] "Generic (PLEG): container finished" podID="b1e67fcc-fd50-4a1e-af4e-48c44fb8db7d" containerID="1230cfec5c72014674f382eb615697f74e488de33be0a8611e9c825261a2d898" exitCode=255 Jun 03 16:35:53.758686 ip-10-0-135-67 kubenswrapper[2568]: I0603 16:35:53.758650 2568 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-console-operator/console-operator-86d7c6cc77-mwpf2" event={"ID":"b1e67fcc-fd50-4a1e-af4e-48c44fb8db7d","Type":"ContainerDied","Data":"1230cfec5c72014674f382eb615697f74e488de33be0a8611e9c825261a2d898"} Jun 03 16:35:53.758686 ip-10-0-135-67 kubenswrapper[2568]: I0603 16:35:53.758679 2568 scope.go:117] "RemoveContainer" containerID="2b6e0b299ee048481ece49c2d074fd1d4e5a07e133057dba7df4df7c26419596" Jun 03 16:35:53.758966 ip-10-0-135-67 kubenswrapper[2568]: I0603 16:35:53.758947 2568 scope.go:117] "RemoveContainer" containerID="1230cfec5c72014674f382eb615697f74e488de33be0a8611e9c825261a2d898" Jun 03 16:35:53.759174 ip-10-0-135-67 kubenswrapper[2568]: E0603 16:35:53.759154 2568 pod_workers.go:1301] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"console-operator\" with CrashLoopBackOff: \"back-off 10s restarting failed container=console-operator pod=console-operator-86d7c6cc77-mwpf2_openshift-console-operator(b1e67fcc-fd50-4a1e-af4e-48c44fb8db7d)\"" pod="openshift-console-operator/console-operator-86d7c6cc77-mwpf2" podUID="b1e67fcc-fd50-4a1e-af4e-48c44fb8db7d" Jun 03 16:35:54.440293 ip-10-0-135-67 kubenswrapper[2568]: I0603 16:35:54.440263 2568 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-kube-storage-version-migrator/migrator-96c6f749-9jl2b"] Jun 03 16:35:54.443019 ip-10-0-135-67 kubenswrapper[2568]: I0603 16:35:54.442984 2568 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-kube-storage-version-migrator/migrator-96c6f749-9jl2b" Jun 03 16:35:54.444981 ip-10-0-135-67 kubenswrapper[2568]: I0603 16:35:54.444965 2568 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-kube-storage-version-migrator\"/\"kube-storage-version-migrator-sa-dockercfg-zbcxg\"" Jun 03 16:35:54.445088 ip-10-0-135-67 kubenswrapper[2568]: I0603 16:35:54.444968 2568 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-kube-storage-version-migrator\"/\"kube-root-ca.crt\"" Jun 03 16:35:54.445482 ip-10-0-135-67 kubenswrapper[2568]: I0603 16:35:54.445465 2568 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-kube-storage-version-migrator\"/\"openshift-service-ca.crt\"" Jun 03 16:35:54.449542 ip-10-0-135-67 kubenswrapper[2568]: I0603 16:35:54.449192 2568 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-kube-storage-version-migrator/migrator-96c6f749-9jl2b"] Jun 03 16:35:54.627773 ip-10-0-135-67 kubenswrapper[2568]: I0603 16:35:54.627748 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-d76dn\" (UniqueName: \"kubernetes.io/projected/9be31efe-89c6-4af0-bdb5-dee0b6353d81-kube-api-access-d76dn\") pod \"migrator-96c6f749-9jl2b\" (UID: \"9be31efe-89c6-4af0-bdb5-dee0b6353d81\") " pod="openshift-kube-storage-version-migrator/migrator-96c6f749-9jl2b" Jun 03 16:35:54.728499 ip-10-0-135-67 kubenswrapper[2568]: I0603 16:35:54.728436 2568 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-d76dn\" (UniqueName: \"kubernetes.io/projected/9be31efe-89c6-4af0-bdb5-dee0b6353d81-kube-api-access-d76dn\") pod \"migrator-96c6f749-9jl2b\" (UID: \"9be31efe-89c6-4af0-bdb5-dee0b6353d81\") " pod="openshift-kube-storage-version-migrator/migrator-96c6f749-9jl2b" Jun 03 16:35:54.735278 ip-10-0-135-67 kubenswrapper[2568]: I0603 16:35:54.735254 2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-d76dn\" (UniqueName: \"kubernetes.io/projected/9be31efe-89c6-4af0-bdb5-dee0b6353d81-kube-api-access-d76dn\") pod \"migrator-96c6f749-9jl2b\" (UID: \"9be31efe-89c6-4af0-bdb5-dee0b6353d81\") " pod="openshift-kube-storage-version-migrator/migrator-96c6f749-9jl2b" Jun 03 16:35:54.752404 ip-10-0-135-67 kubenswrapper[2568]: I0603 16:35:54.752383 2568 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-kube-storage-version-migrator/migrator-96c6f749-9jl2b" Jun 03 16:35:54.762075 ip-10-0-135-67 kubenswrapper[2568]: I0603 16:35:54.762056 2568 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-86d7c6cc77-mwpf2_b1e67fcc-fd50-4a1e-af4e-48c44fb8db7d/console-operator/1.log" Jun 03 16:35:54.762356 ip-10-0-135-67 kubenswrapper[2568]: I0603 16:35:54.762347 2568 scope.go:117] "RemoveContainer" containerID="1230cfec5c72014674f382eb615697f74e488de33be0a8611e9c825261a2d898" Jun 03 16:35:54.762512 ip-10-0-135-67 kubenswrapper[2568]: E0603 16:35:54.762496 2568 pod_workers.go:1301] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"console-operator\" with CrashLoopBackOff: \"back-off 10s restarting failed container=console-operator pod=console-operator-86d7c6cc77-mwpf2_openshift-console-operator(b1e67fcc-fd50-4a1e-af4e-48c44fb8db7d)\"" pod="openshift-console-operator/console-operator-86d7c6cc77-mwpf2" podUID="b1e67fcc-fd50-4a1e-af4e-48c44fb8db7d" Jun 03 16:35:54.867070 ip-10-0-135-67 kubenswrapper[2568]: I0603 16:35:54.867043 2568 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-kube-storage-version-migrator/migrator-96c6f749-9jl2b"] Jun 03 16:35:54.871786 ip-10-0-135-67 kubenswrapper[2568]: W0603 16:35:54.871757 2568 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod9be31efe_89c6_4af0_bdb5_dee0b6353d81.slice/crio-3637d0e0a49f58a11d86ec813e7d493d98e1febecf20f330757fc481b2f8d85c WatchSource:0}: Error finding container 3637d0e0a49f58a11d86ec813e7d493d98e1febecf20f330757fc481b2f8d85c: Status 404 returned error can't find the container with id 3637d0e0a49f58a11d86ec813e7d493d98e1febecf20f330757fc481b2f8d85c Jun 03 16:35:55.765018 ip-10-0-135-67 kubenswrapper[2568]: I0603 16:35:55.764970 2568 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator/migrator-96c6f749-9jl2b" event={"ID":"9be31efe-89c6-4af0-bdb5-dee0b6353d81","Type":"ContainerStarted","Data":"3637d0e0a49f58a11d86ec813e7d493d98e1febecf20f330757fc481b2f8d85c"} Jun 03 16:35:56.099365 ip-10-0-135-67 kubenswrapper[2568]: I0603 16:35:56.099279 2568 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-service-ca/service-ca-685df94d57-q5h7h"] Jun 03 16:35:56.101158 ip-10-0-135-67 kubenswrapper[2568]: I0603 16:35:56.101138 2568 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-service-ca/service-ca-685df94d57-q5h7h" Jun 03 16:35:56.103248 ip-10-0-135-67 kubenswrapper[2568]: I0603 16:35:56.103223 2568 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-service-ca\"/\"openshift-service-ca.crt\"" Jun 03 16:35:56.103390 ip-10-0-135-67 kubenswrapper[2568]: I0603 16:35:56.103375 2568 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-service-ca\"/\"signing-key\"" Jun 03 16:35:56.103445 ip-10-0-135-67 kubenswrapper[2568]: I0603 16:35:56.103374 2568 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-service-ca\"/\"signing-cabundle\"" Jun 03 16:35:56.103931 ip-10-0-135-67 kubenswrapper[2568]: I0603 16:35:56.103916 2568 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-service-ca\"/\"kube-root-ca.crt\"" Jun 03 16:35:56.104107 ip-10-0-135-67 kubenswrapper[2568]: I0603 16:35:56.104079 2568 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-service-ca\"/\"service-ca-dockercfg-zggl4\"" Jun 03 16:35:56.108798 ip-10-0-135-67 kubenswrapper[2568]: I0603 16:35:56.108778 2568 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-service-ca/service-ca-685df94d57-q5h7h"] Jun 03 16:35:56.240449 ip-10-0-135-67 kubenswrapper[2568]: I0603 16:35:56.240425 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"signing-cabundle\" (UniqueName: \"kubernetes.io/configmap/9d27ac4a-5d70-4dc4-9062-98acdb38c38b-signing-cabundle\") pod \"service-ca-685df94d57-q5h7h\" (UID: \"9d27ac4a-5d70-4dc4-9062-98acdb38c38b\") " pod="openshift-service-ca/service-ca-685df94d57-q5h7h" Jun 03 16:35:56.240583 ip-10-0-135-67 kubenswrapper[2568]: I0603 16:35:56.240468 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"signing-key\" (UniqueName: \"kubernetes.io/secret/9d27ac4a-5d70-4dc4-9062-98acdb38c38b-signing-key\") pod \"service-ca-685df94d57-q5h7h\" (UID: \"9d27ac4a-5d70-4dc4-9062-98acdb38c38b\") " pod="openshift-service-ca/service-ca-685df94d57-q5h7h" Jun 03 16:35:56.240583 ip-10-0-135-67 kubenswrapper[2568]: I0603 16:35:56.240494 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-lkw5j\" (UniqueName: \"kubernetes.io/projected/9d27ac4a-5d70-4dc4-9062-98acdb38c38b-kube-api-access-lkw5j\") pod \"service-ca-685df94d57-q5h7h\" (UID: \"9d27ac4a-5d70-4dc4-9062-98acdb38c38b\") " pod="openshift-service-ca/service-ca-685df94d57-q5h7h" Jun 03 16:35:56.341276 ip-10-0-135-67 kubenswrapper[2568]: I0603 16:35:56.341244 2568 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"signing-cabundle\" (UniqueName: \"kubernetes.io/configmap/9d27ac4a-5d70-4dc4-9062-98acdb38c38b-signing-cabundle\") pod \"service-ca-685df94d57-q5h7h\" (UID: \"9d27ac4a-5d70-4dc4-9062-98acdb38c38b\") " pod="openshift-service-ca/service-ca-685df94d57-q5h7h" Jun 03 16:35:56.341424 ip-10-0-135-67 kubenswrapper[2568]: I0603 16:35:56.341303 2568 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"signing-key\" (UniqueName: \"kubernetes.io/secret/9d27ac4a-5d70-4dc4-9062-98acdb38c38b-signing-key\") pod \"service-ca-685df94d57-q5h7h\" (UID: \"9d27ac4a-5d70-4dc4-9062-98acdb38c38b\") " pod="openshift-service-ca/service-ca-685df94d57-q5h7h" Jun 03 16:35:56.341424 ip-10-0-135-67 kubenswrapper[2568]: I0603 16:35:56.341327 2568 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-lkw5j\" (UniqueName: \"kubernetes.io/projected/9d27ac4a-5d70-4dc4-9062-98acdb38c38b-kube-api-access-lkw5j\") pod \"service-ca-685df94d57-q5h7h\" (UID: \"9d27ac4a-5d70-4dc4-9062-98acdb38c38b\") " pod="openshift-service-ca/service-ca-685df94d57-q5h7h" Jun 03 16:35:56.342068 ip-10-0-135-67 kubenswrapper[2568]: I0603 16:35:56.342044 2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"signing-cabundle\" (UniqueName: \"kubernetes.io/configmap/9d27ac4a-5d70-4dc4-9062-98acdb38c38b-signing-cabundle\") pod \"service-ca-685df94d57-q5h7h\" (UID: \"9d27ac4a-5d70-4dc4-9062-98acdb38c38b\") " pod="openshift-service-ca/service-ca-685df94d57-q5h7h" Jun 03 16:35:56.343977 ip-10-0-135-67 kubenswrapper[2568]: I0603 16:35:56.343954 2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"signing-key\" (UniqueName: \"kubernetes.io/secret/9d27ac4a-5d70-4dc4-9062-98acdb38c38b-signing-key\") pod \"service-ca-685df94d57-q5h7h\" (UID: \"9d27ac4a-5d70-4dc4-9062-98acdb38c38b\") " pod="openshift-service-ca/service-ca-685df94d57-q5h7h" Jun 03 16:35:56.349508 ip-10-0-135-67 kubenswrapper[2568]: I0603 16:35:56.349443 2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-lkw5j\" (UniqueName: \"kubernetes.io/projected/9d27ac4a-5d70-4dc4-9062-98acdb38c38b-kube-api-access-lkw5j\") pod \"service-ca-685df94d57-q5h7h\" (UID: \"9d27ac4a-5d70-4dc4-9062-98acdb38c38b\") " pod="openshift-service-ca/service-ca-685df94d57-q5h7h" Jun 03 16:35:56.410800 ip-10-0-135-67 kubenswrapper[2568]: I0603 16:35:56.410778 2568 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-service-ca/service-ca-685df94d57-q5h7h" Jun 03 16:35:56.437134 ip-10-0-135-67 kubenswrapper[2568]: I0603 16:35:56.437108 2568 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_node-resolver-wrnbf_d250f8ac-2da7-4c87-85e2-dad87073a681/dns-node-resolver/0.log" Jun 03 16:35:56.548627 ip-10-0-135-67 kubenswrapper[2568]: E0603 16:35:56.548602 2568 secret.go:189] Couldn't get secret openshift-monitoring/cluster-monitoring-operator-tls: secret "cluster-monitoring-operator-tls" not found Jun 03 16:35:56.548738 ip-10-0-135-67 kubenswrapper[2568]: I0603 16:35:56.548534 2568 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/48e00082-b030-48ac-aa35-9cb1ab31fae8-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-69b6cbdb88-tzxs6\" (UID: \"48e00082-b030-48ac-aa35-9cb1ab31fae8\") " pod="openshift-monitoring/cluster-monitoring-operator-69b6cbdb88-tzxs6" Jun 03 16:35:56.548738 ip-10-0-135-67 kubenswrapper[2568]: E0603 16:35:56.548720 2568 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/48e00082-b030-48ac-aa35-9cb1ab31fae8-cluster-monitoring-operator-tls podName:48e00082-b030-48ac-aa35-9cb1ab31fae8 nodeName:}" failed. No retries permitted until 2026-06-03 16:36:04.54869569 +0000 UTC m=+136.690870337 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "cluster-monitoring-operator-tls" (UniqueName: "kubernetes.io/secret/48e00082-b030-48ac-aa35-9cb1ab31fae8-cluster-monitoring-operator-tls") pod "cluster-monitoring-operator-69b6cbdb88-tzxs6" (UID: "48e00082-b030-48ac-aa35-9cb1ab31fae8") : secret "cluster-monitoring-operator-tls" not found Jun 03 16:35:56.583735 ip-10-0-135-67 kubenswrapper[2568]: I0603 16:35:56.583710 2568 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-service-ca/service-ca-685df94d57-q5h7h"] Jun 03 16:35:56.587941 ip-10-0-135-67 kubenswrapper[2568]: W0603 16:35:56.587917 2568 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod9d27ac4a_5d70_4dc4_9062_98acdb38c38b.slice/crio-946997fcbad8223a8579985f0eb531390df7d9a2fd989d66e86b9d8bac86489f WatchSource:0}: Error finding container 946997fcbad8223a8579985f0eb531390df7d9a2fd989d66e86b9d8bac86489f: Status 404 returned error can't find the container with id 946997fcbad8223a8579985f0eb531390df7d9a2fd989d66e86b9d8bac86489f Jun 03 16:35:56.768098 ip-10-0-135-67 kubenswrapper[2568]: I0603 16:35:56.768061 2568 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-service-ca/service-ca-685df94d57-q5h7h" event={"ID":"9d27ac4a-5d70-4dc4-9062-98acdb38c38b","Type":"ContainerStarted","Data":"946997fcbad8223a8579985f0eb531390df7d9a2fd989d66e86b9d8bac86489f"} Jun 03 16:35:56.769526 ip-10-0-135-67 kubenswrapper[2568]: I0603 16:35:56.769500 2568 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator/migrator-96c6f749-9jl2b" event={"ID":"9be31efe-89c6-4af0-bdb5-dee0b6353d81","Type":"ContainerStarted","Data":"c64212549c7648c469e7bf75821920f47dcc7bd9ae24b235bb1c731b34e2b11c"} Jun 03 16:35:56.769624 ip-10-0-135-67 kubenswrapper[2568]: I0603 16:35:56.769534 2568 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator/migrator-96c6f749-9jl2b" event={"ID":"9be31efe-89c6-4af0-bdb5-dee0b6353d81","Type":"ContainerStarted","Data":"8bef96dcac2c480a8d106cb40237ad93dee0f45b2ba5206aa36f18fc1dd22850"} Jun 03 16:35:56.784394 ip-10-0-135-67 kubenswrapper[2568]: I0603 16:35:56.784353 2568 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-kube-storage-version-migrator/migrator-96c6f749-9jl2b" podStartSLOduration=1.169391286 podStartE2EDuration="2.784339601s" podCreationTimestamp="2026-06-03 16:35:54 +0000 UTC" firstStartedPulling="2026-06-03 16:35:54.873534337 +0000 UTC m=+127.015708972" lastFinishedPulling="2026-06-03 16:35:56.488482651 +0000 UTC m=+128.630657287" observedRunningTime="2026-06-03 16:35:56.78375729 +0000 UTC m=+128.925931956" watchObservedRunningTime="2026-06-03 16:35:56.784339601 +0000 UTC m=+128.926514254" Jun 03 16:35:57.437239 ip-10-0-135-67 kubenswrapper[2568]: I0603 16:35:57.437209 2568 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_node-ca-ktq4g_f40f3f2b-b437-46a6-8ea2-b770ea9bd2a3/node-ca/0.log" Jun 03 16:35:58.158010 ip-10-0-135-67 kubenswrapper[2568]: I0603 16:35:58.157979 2568 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/ddc210bb-9544-4ca7-b2de-f84c92d84510-metrics-certs\") pod \"network-metrics-daemon-54gnw\" (UID: \"ddc210bb-9544-4ca7-b2de-f84c92d84510\") " pod="openshift-multus/network-metrics-daemon-54gnw" Jun 03 16:35:58.158366 ip-10-0-135-67 kubenswrapper[2568]: E0603 16:35:58.158125 2568 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: secret "metrics-daemon-secret" not found Jun 03 16:35:58.158366 ip-10-0-135-67 kubenswrapper[2568]: E0603 16:35:58.158185 2568 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/ddc210bb-9544-4ca7-b2de-f84c92d84510-metrics-certs podName:ddc210bb-9544-4ca7-b2de-f84c92d84510 nodeName:}" failed. No retries permitted until 2026-06-03 16:38:00.158169507 +0000 UTC m=+252.300344138 (durationBeforeRetry 2m2s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/ddc210bb-9544-4ca7-b2de-f84c92d84510-metrics-certs") pod "network-metrics-daemon-54gnw" (UID: "ddc210bb-9544-4ca7-b2de-f84c92d84510") : secret "metrics-daemon-secret" not found Jun 03 16:35:58.998173 ip-10-0-135-67 kubenswrapper[2568]: I0603 16:35:58.998148 2568 kubelet.go:2658] "SyncLoop (probe)" probe="liveness" status="unhealthy" pod="openshift-console-operator/console-operator-86d7c6cc77-mwpf2" Jun 03 16:35:58.998309 ip-10-0-135-67 kubenswrapper[2568]: I0603 16:35:58.998180 2568 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console-operator/console-operator-86d7c6cc77-mwpf2" Jun 03 16:35:58.998491 ip-10-0-135-67 kubenswrapper[2568]: I0603 16:35:58.998479 2568 scope.go:117] "RemoveContainer" containerID="1230cfec5c72014674f382eb615697f74e488de33be0a8611e9c825261a2d898" Jun 03 16:35:58.998639 ip-10-0-135-67 kubenswrapper[2568]: E0603 16:35:58.998623 2568 pod_workers.go:1301] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"console-operator\" with CrashLoopBackOff: \"back-off 10s restarting failed container=console-operator pod=console-operator-86d7c6cc77-mwpf2_openshift-console-operator(b1e67fcc-fd50-4a1e-af4e-48c44fb8db7d)\"" pod="openshift-console-operator/console-operator-86d7c6cc77-mwpf2" podUID="b1e67fcc-fd50-4a1e-af4e-48c44fb8db7d" Jun 03 16:35:59.777087 ip-10-0-135-67 kubenswrapper[2568]: I0603 16:35:59.777053 2568 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-service-ca/service-ca-685df94d57-q5h7h" event={"ID":"9d27ac4a-5d70-4dc4-9062-98acdb38c38b","Type":"ContainerStarted","Data":"67b3c6b3059f139e72faef5329352f4db9f59d6af732dda6aad91dc1da6d9568"} Jun 03 16:35:59.796231 ip-10-0-135-67 kubenswrapper[2568]: I0603 16:35:59.796190 2568 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-service-ca/service-ca-685df94d57-q5h7h" podStartSLOduration=1.6516468930000001 podStartE2EDuration="3.796176509s" podCreationTimestamp="2026-06-03 16:35:56 +0000 UTC" firstStartedPulling="2026-06-03 16:35:56.589625292 +0000 UTC m=+128.731799941" lastFinishedPulling="2026-06-03 16:35:58.734154923 +0000 UTC m=+130.876329557" observedRunningTime="2026-06-03 16:35:59.795323773 +0000 UTC m=+131.937498429" watchObservedRunningTime="2026-06-03 16:35:59.796176509 +0000 UTC m=+131.938351164" Jun 03 16:36:04.606735 ip-10-0-135-67 kubenswrapper[2568]: I0603 16:36:04.606700 2568 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/48e00082-b030-48ac-aa35-9cb1ab31fae8-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-69b6cbdb88-tzxs6\" (UID: \"48e00082-b030-48ac-aa35-9cb1ab31fae8\") " pod="openshift-monitoring/cluster-monitoring-operator-69b6cbdb88-tzxs6" Jun 03 16:36:04.607165 ip-10-0-135-67 kubenswrapper[2568]: E0603 16:36:04.606812 2568 secret.go:189] Couldn't get secret openshift-monitoring/cluster-monitoring-operator-tls: secret "cluster-monitoring-operator-tls" not found Jun 03 16:36:04.607165 ip-10-0-135-67 kubenswrapper[2568]: E0603 16:36:04.606888 2568 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/48e00082-b030-48ac-aa35-9cb1ab31fae8-cluster-monitoring-operator-tls podName:48e00082-b030-48ac-aa35-9cb1ab31fae8 nodeName:}" failed. No retries permitted until 2026-06-03 16:36:20.606866623 +0000 UTC m=+152.749041276 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "cluster-monitoring-operator-tls" (UniqueName: "kubernetes.io/secret/48e00082-b030-48ac-aa35-9cb1ab31fae8-cluster-monitoring-operator-tls") pod "cluster-monitoring-operator-69b6cbdb88-tzxs6" (UID: "48e00082-b030-48ac-aa35-9cb1ab31fae8") : secret "cluster-monitoring-operator-tls" not found Jun 03 16:36:14.406093 ip-10-0-135-67 kubenswrapper[2568]: I0603 16:36:14.406064 2568 scope.go:117] "RemoveContainer" containerID="1230cfec5c72014674f382eb615697f74e488de33be0a8611e9c825261a2d898" Jun 03 16:36:14.815772 ip-10-0-135-67 kubenswrapper[2568]: I0603 16:36:14.815746 2568 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-86d7c6cc77-mwpf2_b1e67fcc-fd50-4a1e-af4e-48c44fb8db7d/console-operator/1.log" Jun 03 16:36:14.815931 ip-10-0-135-67 kubenswrapper[2568]: I0603 16:36:14.815819 2568 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-console-operator/console-operator-86d7c6cc77-mwpf2" event={"ID":"b1e67fcc-fd50-4a1e-af4e-48c44fb8db7d","Type":"ContainerStarted","Data":"73595c381ded1ce750d268f31f404dd0b4c941e91ce66aab02a6ff0748d296d6"} Jun 03 16:36:14.816125 ip-10-0-135-67 kubenswrapper[2568]: I0603 16:36:14.816103 2568 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console-operator/console-operator-86d7c6cc77-mwpf2" Jun 03 16:36:14.830051 ip-10-0-135-67 kubenswrapper[2568]: I0603 16:36:14.829991 2568 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-console-operator/console-operator-86d7c6cc77-mwpf2" podStartSLOduration=24.205712437 podStartE2EDuration="26.829979919s" podCreationTimestamp="2026-06-03 16:35:48 +0000 UTC" firstStartedPulling="2026-06-03 16:35:49.117434496 +0000 UTC m=+121.259609128" lastFinishedPulling="2026-06-03 16:35:51.741701975 +0000 UTC m=+123.883876610" observedRunningTime="2026-06-03 16:36:14.828807363 +0000 UTC m=+146.970982017" watchObservedRunningTime="2026-06-03 16:36:14.829979919 +0000 UTC m=+146.972154573" Jun 03 16:36:15.130507 ip-10-0-135-67 kubenswrapper[2568]: I0603 16:36:15.130438 2568 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console-operator/console-operator-86d7c6cc77-mwpf2" Jun 03 16:36:17.316534 ip-10-0-135-67 kubenswrapper[2568]: I0603 16:36:17.316503 2568 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-insights/insights-runtime-extractor-kwjkx"] Jun 03 16:36:17.318687 ip-10-0-135-67 kubenswrapper[2568]: I0603 16:36:17.318665 2568 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-network-console/networking-console-plugin-76c9bb5fdf-fmks7"] Jun 03 16:36:17.318834 ip-10-0-135-67 kubenswrapper[2568]: I0603 16:36:17.318815 2568 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-runtime-extractor-kwjkx" Jun 03 16:36:17.320642 ip-10-0-135-67 kubenswrapper[2568]: I0603 16:36:17.320624 2568 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-console/networking-console-plugin-76c9bb5fdf-fmks7" Jun 03 16:36:17.320956 ip-10-0-135-67 kubenswrapper[2568]: I0603 16:36:17.320930 2568 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-sa-dockercfg-m97v2\"" Jun 03 16:36:17.321097 ip-10-0-135-67 kubenswrapper[2568]: I0603 16:36:17.321076 2568 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"kube-root-ca.crt\"" Jun 03 16:36:17.321177 ip-10-0-135-67 kubenswrapper[2568]: I0603 16:36:17.321080 2568 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-tls\"" Jun 03 16:36:17.321271 ip-10-0-135-67 kubenswrapper[2568]: I0603 16:36:17.321080 2568 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"kube-rbac-proxy\"" Jun 03 16:36:17.321271 ip-10-0-135-67 kubenswrapper[2568]: I0603 16:36:17.321080 2568 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"openshift-service-ca.crt\"" Jun 03 16:36:17.323200 ip-10-0-135-67 kubenswrapper[2568]: I0603 16:36:17.323183 2568 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-console\"/\"networking-console-plugin\"" Jun 03 16:36:17.323390 ip-10-0-135-67 kubenswrapper[2568]: I0603 16:36:17.323374 2568 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-console\"/\"default-dockercfg-8gk8s\"" Jun 03 16:36:17.323483 ip-10-0-135-67 kubenswrapper[2568]: I0603 16:36:17.323468 2568 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-console\"/\"networking-console-plugin-cert\"" Jun 03 16:36:17.330236 ip-10-0-135-67 kubenswrapper[2568]: I0603 16:36:17.330217 2568 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-network-console/networking-console-plugin-76c9bb5fdf-fmks7"] Jun 03 16:36:17.334349 ip-10-0-135-67 kubenswrapper[2568]: I0603 16:36:17.334329 2568 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-runtime-extractor-kwjkx"] Jun 03 16:36:17.402503 ip-10-0-135-67 kubenswrapper[2568]: I0603 16:36:17.402482 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/46731be4-da64-4d9c-ba2d-b2b7c8ceefbd-networking-console-plugin-cert\") pod \"networking-console-plugin-76c9bb5fdf-fmks7\" (UID: \"46731be4-da64-4d9c-ba2d-b2b7c8ceefbd\") " pod="openshift-network-console/networking-console-plugin-76c9bb5fdf-fmks7" Jun 03 16:36:17.402619 ip-10-0-135-67 kubenswrapper[2568]: I0603 16:36:17.402512 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/4cf0c8f9-cdc4-473e-9089-b042490e78a1-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-kwjkx\" (UID: \"4cf0c8f9-cdc4-473e-9089-b042490e78a1\") " pod="openshift-insights/insights-runtime-extractor-kwjkx" Jun 03 16:36:17.402619 ip-10-0-135-67 kubenswrapper[2568]: I0603 16:36:17.402546 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/4cf0c8f9-cdc4-473e-9089-b042490e78a1-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-kwjkx\" (UID: \"4cf0c8f9-cdc4-473e-9089-b042490e78a1\") " pod="openshift-insights/insights-runtime-extractor-kwjkx" Jun 03 16:36:17.402699 ip-10-0-135-67 kubenswrapper[2568]: I0603 16:36:17.402630 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/4cf0c8f9-cdc4-473e-9089-b042490e78a1-crio-socket\") pod \"insights-runtime-extractor-kwjkx\" (UID: \"4cf0c8f9-cdc4-473e-9089-b042490e78a1\") " pod="openshift-insights/insights-runtime-extractor-kwjkx" Jun 03 16:36:17.402699 ip-10-0-135-67 kubenswrapper[2568]: I0603 16:36:17.402656 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/4cf0c8f9-cdc4-473e-9089-b042490e78a1-data-volume\") pod \"insights-runtime-extractor-kwjkx\" (UID: \"4cf0c8f9-cdc4-473e-9089-b042490e78a1\") " pod="openshift-insights/insights-runtime-extractor-kwjkx" Jun 03 16:36:17.402699 ip-10-0-135-67 kubenswrapper[2568]: I0603 16:36:17.402672 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-xqqkm\" (UniqueName: \"kubernetes.io/projected/4cf0c8f9-cdc4-473e-9089-b042490e78a1-kube-api-access-xqqkm\") pod \"insights-runtime-extractor-kwjkx\" (UID: \"4cf0c8f9-cdc4-473e-9089-b042490e78a1\") " pod="openshift-insights/insights-runtime-extractor-kwjkx" Jun 03 16:36:17.402812 ip-10-0-135-67 kubenswrapper[2568]: I0603 16:36:17.402742 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"nginx-conf\" (UniqueName: \"kubernetes.io/configmap/46731be4-da64-4d9c-ba2d-b2b7c8ceefbd-nginx-conf\") pod \"networking-console-plugin-76c9bb5fdf-fmks7\" (UID: \"46731be4-da64-4d9c-ba2d-b2b7c8ceefbd\") " pod="openshift-network-console/networking-console-plugin-76c9bb5fdf-fmks7" Jun 03 16:36:17.416247 ip-10-0-135-67 kubenswrapper[2568]: I0603 16:36:17.416219 2568 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-console/downloads-c65b8dc4b-rwv6s"] Jun 03 16:36:17.418261 ip-10-0-135-67 kubenswrapper[2568]: I0603 16:36:17.418243 2568 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/downloads-c65b8dc4b-rwv6s" Jun 03 16:36:17.420503 ip-10-0-135-67 kubenswrapper[2568]: I0603 16:36:17.420467 2568 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"default-dockercfg-7tg85\"" Jun 03 16:36:17.420843 ip-10-0-135-67 kubenswrapper[2568]: I0603 16:36:17.420817 2568 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"openshift-service-ca.crt\"" Jun 03 16:36:17.420930 ip-10-0-135-67 kubenswrapper[2568]: I0603 16:36:17.420876 2568 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"kube-root-ca.crt\"" Jun 03 16:36:17.428162 ip-10-0-135-67 kubenswrapper[2568]: I0603 16:36:17.428139 2568 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-console/downloads-c65b8dc4b-rwv6s"] Jun 03 16:36:17.503428 ip-10-0-135-67 kubenswrapper[2568]: I0603 16:36:17.503405 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-vxbbh\" (UniqueName: \"kubernetes.io/projected/f8c27eb0-19f6-4e05-b152-cada0ca804ed-kube-api-access-vxbbh\") pod \"downloads-c65b8dc4b-rwv6s\" (UID: \"f8c27eb0-19f6-4e05-b152-cada0ca804ed\") " pod="openshift-console/downloads-c65b8dc4b-rwv6s" Jun 03 16:36:17.503525 ip-10-0-135-67 kubenswrapper[2568]: I0603 16:36:17.503452 2568 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/4cf0c8f9-cdc4-473e-9089-b042490e78a1-crio-socket\") pod \"insights-runtime-extractor-kwjkx\" (UID: \"4cf0c8f9-cdc4-473e-9089-b042490e78a1\") " pod="openshift-insights/insights-runtime-extractor-kwjkx" Jun 03 16:36:17.503525 ip-10-0-135-67 kubenswrapper[2568]: I0603 16:36:17.503481 2568 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/4cf0c8f9-cdc4-473e-9089-b042490e78a1-data-volume\") pod \"insights-runtime-extractor-kwjkx\" (UID: \"4cf0c8f9-cdc4-473e-9089-b042490e78a1\") " pod="openshift-insights/insights-runtime-extractor-kwjkx" Jun 03 16:36:17.503525 ip-10-0-135-67 kubenswrapper[2568]: I0603 16:36:17.503517 2568 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-xqqkm\" (UniqueName: \"kubernetes.io/projected/4cf0c8f9-cdc4-473e-9089-b042490e78a1-kube-api-access-xqqkm\") pod \"insights-runtime-extractor-kwjkx\" (UID: \"4cf0c8f9-cdc4-473e-9089-b042490e78a1\") " pod="openshift-insights/insights-runtime-extractor-kwjkx" Jun 03 16:36:17.503636 ip-10-0-135-67 kubenswrapper[2568]: I0603 16:36:17.503545 2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/4cf0c8f9-cdc4-473e-9089-b042490e78a1-crio-socket\") pod \"insights-runtime-extractor-kwjkx\" (UID: \"4cf0c8f9-cdc4-473e-9089-b042490e78a1\") " pod="openshift-insights/insights-runtime-extractor-kwjkx" Jun 03 16:36:17.503636 ip-10-0-135-67 kubenswrapper[2568]: I0603 16:36:17.503608 2568 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"nginx-conf\" (UniqueName: \"kubernetes.io/configmap/46731be4-da64-4d9c-ba2d-b2b7c8ceefbd-nginx-conf\") pod \"networking-console-plugin-76c9bb5fdf-fmks7\" (UID: \"46731be4-da64-4d9c-ba2d-b2b7c8ceefbd\") " pod="openshift-network-console/networking-console-plugin-76c9bb5fdf-fmks7" Jun 03 16:36:17.503714 ip-10-0-135-67 kubenswrapper[2568]: I0603 16:36:17.503638 2568 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/46731be4-da64-4d9c-ba2d-b2b7c8ceefbd-networking-console-plugin-cert\") pod \"networking-console-plugin-76c9bb5fdf-fmks7\" (UID: \"46731be4-da64-4d9c-ba2d-b2b7c8ceefbd\") " pod="openshift-network-console/networking-console-plugin-76c9bb5fdf-fmks7" Jun 03 16:36:17.503714 ip-10-0-135-67 kubenswrapper[2568]: I0603 16:36:17.503658 2568 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/4cf0c8f9-cdc4-473e-9089-b042490e78a1-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-kwjkx\" (UID: \"4cf0c8f9-cdc4-473e-9089-b042490e78a1\") " pod="openshift-insights/insights-runtime-extractor-kwjkx" Jun 03 16:36:17.503714 ip-10-0-135-67 kubenswrapper[2568]: I0603 16:36:17.503693 2568 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/4cf0c8f9-cdc4-473e-9089-b042490e78a1-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-kwjkx\" (UID: \"4cf0c8f9-cdc4-473e-9089-b042490e78a1\") " pod="openshift-insights/insights-runtime-extractor-kwjkx" Jun 03 16:36:17.503860 ip-10-0-135-67 kubenswrapper[2568]: I0603 16:36:17.503770 2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/4cf0c8f9-cdc4-473e-9089-b042490e78a1-data-volume\") pod \"insights-runtime-extractor-kwjkx\" (UID: \"4cf0c8f9-cdc4-473e-9089-b042490e78a1\") " pod="openshift-insights/insights-runtime-extractor-kwjkx" Jun 03 16:36:17.504255 ip-10-0-135-67 kubenswrapper[2568]: I0603 16:36:17.504225 2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/4cf0c8f9-cdc4-473e-9089-b042490e78a1-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-kwjkx\" (UID: \"4cf0c8f9-cdc4-473e-9089-b042490e78a1\") " pod="openshift-insights/insights-runtime-extractor-kwjkx" Jun 03 16:36:17.504336 ip-10-0-135-67 kubenswrapper[2568]: I0603 16:36:17.504270 2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"nginx-conf\" (UniqueName: \"kubernetes.io/configmap/46731be4-da64-4d9c-ba2d-b2b7c8ceefbd-nginx-conf\") pod \"networking-console-plugin-76c9bb5fdf-fmks7\" (UID: \"46731be4-da64-4d9c-ba2d-b2b7c8ceefbd\") " pod="openshift-network-console/networking-console-plugin-76c9bb5fdf-fmks7" Jun 03 16:36:17.506096 ip-10-0-135-67 kubenswrapper[2568]: I0603 16:36:17.506080 2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/46731be4-da64-4d9c-ba2d-b2b7c8ceefbd-networking-console-plugin-cert\") pod \"networking-console-plugin-76c9bb5fdf-fmks7\" (UID: \"46731be4-da64-4d9c-ba2d-b2b7c8ceefbd\") " pod="openshift-network-console/networking-console-plugin-76c9bb5fdf-fmks7" Jun 03 16:36:17.506151 ip-10-0-135-67 kubenswrapper[2568]: I0603 16:36:17.506132 2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/4cf0c8f9-cdc4-473e-9089-b042490e78a1-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-kwjkx\" (UID: \"4cf0c8f9-cdc4-473e-9089-b042490e78a1\") " pod="openshift-insights/insights-runtime-extractor-kwjkx" Jun 03 16:36:17.513437 ip-10-0-135-67 kubenswrapper[2568]: I0603 16:36:17.513414 2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-xqqkm\" (UniqueName: \"kubernetes.io/projected/4cf0c8f9-cdc4-473e-9089-b042490e78a1-kube-api-access-xqqkm\") pod \"insights-runtime-extractor-kwjkx\" (UID: \"4cf0c8f9-cdc4-473e-9089-b042490e78a1\") " pod="openshift-insights/insights-runtime-extractor-kwjkx" Jun 03 16:36:17.604912 ip-10-0-135-67 kubenswrapper[2568]: I0603 16:36:17.604861 2568 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-vxbbh\" (UniqueName: \"kubernetes.io/projected/f8c27eb0-19f6-4e05-b152-cada0ca804ed-kube-api-access-vxbbh\") pod \"downloads-c65b8dc4b-rwv6s\" (UID: \"f8c27eb0-19f6-4e05-b152-cada0ca804ed\") " pod="openshift-console/downloads-c65b8dc4b-rwv6s" Jun 03 16:36:17.612470 ip-10-0-135-67 kubenswrapper[2568]: I0603 16:36:17.612449 2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-vxbbh\" (UniqueName: \"kubernetes.io/projected/f8c27eb0-19f6-4e05-b152-cada0ca804ed-kube-api-access-vxbbh\") pod \"downloads-c65b8dc4b-rwv6s\" (UID: \"f8c27eb0-19f6-4e05-b152-cada0ca804ed\") " pod="openshift-console/downloads-c65b8dc4b-rwv6s" Jun 03 16:36:17.629371 ip-10-0-135-67 kubenswrapper[2568]: I0603 16:36:17.629349 2568 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-runtime-extractor-kwjkx" Jun 03 16:36:17.634392 ip-10-0-135-67 kubenswrapper[2568]: I0603 16:36:17.634368 2568 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-console/networking-console-plugin-76c9bb5fdf-fmks7" Jun 03 16:36:17.731371 ip-10-0-135-67 kubenswrapper[2568]: I0603 16:36:17.731300 2568 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/downloads-c65b8dc4b-rwv6s" Jun 03 16:36:17.756278 ip-10-0-135-67 kubenswrapper[2568]: I0603 16:36:17.756250 2568 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-runtime-extractor-kwjkx"] Jun 03 16:36:17.759064 ip-10-0-135-67 kubenswrapper[2568]: W0603 16:36:17.759029 2568 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod4cf0c8f9_cdc4_473e_9089_b042490e78a1.slice/crio-b0e10cb91838209b7e36e483cbc175ab0bdcc62a47fc171bc55865bfd2b8e65a WatchSource:0}: Error finding container b0e10cb91838209b7e36e483cbc175ab0bdcc62a47fc171bc55865bfd2b8e65a: Status 404 returned error can't find the container with id b0e10cb91838209b7e36e483cbc175ab0bdcc62a47fc171bc55865bfd2b8e65a Jun 03 16:36:17.772555 ip-10-0-135-67 kubenswrapper[2568]: I0603 16:36:17.772534 2568 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-network-console/networking-console-plugin-76c9bb5fdf-fmks7"] Jun 03 16:36:17.775512 ip-10-0-135-67 kubenswrapper[2568]: W0603 16:36:17.775483 2568 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod46731be4_da64_4d9c_ba2d_b2b7c8ceefbd.slice/crio-44d10cc7a261245621f2f714599af771d23e179bf8fa78da3dd7d95a8d2fa319 WatchSource:0}: Error finding container 44d10cc7a261245621f2f714599af771d23e179bf8fa78da3dd7d95a8d2fa319: Status 404 returned error can't find the container with id 44d10cc7a261245621f2f714599af771d23e179bf8fa78da3dd7d95a8d2fa319 Jun 03 16:36:17.824484 ip-10-0-135-67 kubenswrapper[2568]: I0603 16:36:17.824459 2568 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-network-console/networking-console-plugin-76c9bb5fdf-fmks7" event={"ID":"46731be4-da64-4d9c-ba2d-b2b7c8ceefbd","Type":"ContainerStarted","Data":"44d10cc7a261245621f2f714599af771d23e179bf8fa78da3dd7d95a8d2fa319"} Jun 03 16:36:17.826607 ip-10-0-135-67 kubenswrapper[2568]: I0603 16:36:17.826568 2568 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-kwjkx" event={"ID":"4cf0c8f9-cdc4-473e-9089-b042490e78a1","Type":"ContainerStarted","Data":"d2bc2c4a22b0a34fc8162d30eba2d23495956a1c8f45aa6442950311b4a15a11"} Jun 03 16:36:17.826707 ip-10-0-135-67 kubenswrapper[2568]: I0603 16:36:17.826609 2568 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-kwjkx" event={"ID":"4cf0c8f9-cdc4-473e-9089-b042490e78a1","Type":"ContainerStarted","Data":"b0e10cb91838209b7e36e483cbc175ab0bdcc62a47fc171bc55865bfd2b8e65a"} Jun 03 16:36:17.860237 ip-10-0-135-67 kubenswrapper[2568]: I0603 16:36:17.860177 2568 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-console/downloads-c65b8dc4b-rwv6s"] Jun 03 16:36:17.863793 ip-10-0-135-67 kubenswrapper[2568]: W0603 16:36:17.863748 2568 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podf8c27eb0_19f6_4e05_b152_cada0ca804ed.slice/crio-306fa62b8fc5c437206ba75de540d9af8f16c8475aae668bf16819eec94b86fb WatchSource:0}: Error finding container 306fa62b8fc5c437206ba75de540d9af8f16c8475aae668bf16819eec94b86fb: Status 404 returned error can't find the container with id 306fa62b8fc5c437206ba75de540d9af8f16c8475aae668bf16819eec94b86fb Jun 03 16:36:18.831184 ip-10-0-135-67 kubenswrapper[2568]: I0603 16:36:18.831038 2568 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-console/downloads-c65b8dc4b-rwv6s" event={"ID":"f8c27eb0-19f6-4e05-b152-cada0ca804ed","Type":"ContainerStarted","Data":"306fa62b8fc5c437206ba75de540d9af8f16c8475aae668bf16819eec94b86fb"} Jun 03 16:36:18.832950 ip-10-0-135-67 kubenswrapper[2568]: I0603 16:36:18.832917 2568 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-kwjkx" event={"ID":"4cf0c8f9-cdc4-473e-9089-b042490e78a1","Type":"ContainerStarted","Data":"22bab571a61776cd21d4c157911e6c2e7d2c5e8ba5f46e6bfec3fb3998bffdc5"} Jun 03 16:36:19.838125 ip-10-0-135-67 kubenswrapper[2568]: I0603 16:36:19.838056 2568 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-network-console/networking-console-plugin-76c9bb5fdf-fmks7" event={"ID":"46731be4-da64-4d9c-ba2d-b2b7c8ceefbd","Type":"ContainerStarted","Data":"a3f8d39e79d60e45508a26de7cf062ffa71c81393279a918dce6e896dcbd5bdb"} Jun 03 16:36:19.851488 ip-10-0-135-67 kubenswrapper[2568]: I0603 16:36:19.851438 2568 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-network-console/networking-console-plugin-76c9bb5fdf-fmks7" podStartSLOduration=1.646645927 podStartE2EDuration="2.851423699s" podCreationTimestamp="2026-06-03 16:36:17 +0000 UTC" firstStartedPulling="2026-06-03 16:36:17.777938484 +0000 UTC m=+149.920113128" lastFinishedPulling="2026-06-03 16:36:18.982716267 +0000 UTC m=+151.124890900" observedRunningTime="2026-06-03 16:36:19.850876382 +0000 UTC m=+151.993051036" watchObservedRunningTime="2026-06-03 16:36:19.851423699 +0000 UTC m=+151.993598354" Jun 03 16:36:20.630174 ip-10-0-135-67 kubenswrapper[2568]: I0603 16:36:20.630145 2568 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/48e00082-b030-48ac-aa35-9cb1ab31fae8-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-69b6cbdb88-tzxs6\" (UID: \"48e00082-b030-48ac-aa35-9cb1ab31fae8\") " pod="openshift-monitoring/cluster-monitoring-operator-69b6cbdb88-tzxs6" Jun 03 16:36:20.632199 ip-10-0-135-67 kubenswrapper[2568]: I0603 16:36:20.632175 2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/48e00082-b030-48ac-aa35-9cb1ab31fae8-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-69b6cbdb88-tzxs6\" (UID: \"48e00082-b030-48ac-aa35-9cb1ab31fae8\") " pod="openshift-monitoring/cluster-monitoring-operator-69b6cbdb88-tzxs6" Jun 03 16:36:20.844990 ip-10-0-135-67 kubenswrapper[2568]: I0603 16:36:20.844954 2568 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-kwjkx" event={"ID":"4cf0c8f9-cdc4-473e-9089-b042490e78a1","Type":"ContainerStarted","Data":"8289dd0c25002bd2fc0c580732e81671c243a5181f45e378d88df1210d993583"} Jun 03 16:36:20.861483 ip-10-0-135-67 kubenswrapper[2568]: I0603 16:36:20.861431 2568 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-insights/insights-runtime-extractor-kwjkx" podStartSLOduration=1.2347080990000001 podStartE2EDuration="3.861412788s" podCreationTimestamp="2026-06-03 16:36:17 +0000 UTC" firstStartedPulling="2026-06-03 16:36:17.81855686 +0000 UTC m=+149.960731491" lastFinishedPulling="2026-06-03 16:36:20.445261549 +0000 UTC m=+152.587436180" observedRunningTime="2026-06-03 16:36:20.860485434 +0000 UTC m=+153.002660089" watchObservedRunningTime="2026-06-03 16:36:20.861412788 +0000 UTC m=+153.003587443" Jun 03 16:36:20.898989 ip-10-0-135-67 kubenswrapper[2568]: I0603 16:36:20.898960 2568 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/cluster-monitoring-operator-69b6cbdb88-tzxs6" Jun 03 16:36:21.024150 ip-10-0-135-67 kubenswrapper[2568]: I0603 16:36:21.024106 2568 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/cluster-monitoring-operator-69b6cbdb88-tzxs6"] Jun 03 16:36:21.026777 ip-10-0-135-67 kubenswrapper[2568]: W0603 16:36:21.026749 2568 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod48e00082_b030_48ac_aa35_9cb1ab31fae8.slice/crio-4231cf352ef4893b51fda04ad46813007155415b20b4d112f3c835c2bf7d6866 WatchSource:0}: Error finding container 4231cf352ef4893b51fda04ad46813007155415b20b4d112f3c835c2bf7d6866: Status 404 returned error can't find the container with id 4231cf352ef4893b51fda04ad46813007155415b20b4d112f3c835c2bf7d6866 Jun 03 16:36:21.848914 ip-10-0-135-67 kubenswrapper[2568]: I0603 16:36:21.848863 2568 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/cluster-monitoring-operator-69b6cbdb88-tzxs6" event={"ID":"48e00082-b030-48ac-aa35-9cb1ab31fae8","Type":"ContainerStarted","Data":"4231cf352ef4893b51fda04ad46813007155415b20b4d112f3c835c2bf7d6866"} Jun 03 16:36:23.026491 ip-10-0-135-67 kubenswrapper[2568]: I0603 16:36:23.026454 2568 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-console/console-b7bc65d87-nsc2l"] Jun 03 16:36:23.028531 ip-10-0-135-67 kubenswrapper[2568]: I0603 16:36:23.028509 2568 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-b7bc65d87-nsc2l" Jun 03 16:36:23.031391 ip-10-0-135-67 kubenswrapper[2568]: I0603 16:36:23.031201 2568 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"oauth-serving-cert\"" Jun 03 16:36:23.031391 ip-10-0-135-67 kubenswrapper[2568]: I0603 16:36:23.031234 2568 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"console-config\"" Jun 03 16:36:23.031391 ip-10-0-135-67 kubenswrapper[2568]: I0603 16:36:23.031240 2568 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"service-ca\"" Jun 03 16:36:23.031391 ip-10-0-135-67 kubenswrapper[2568]: I0603 16:36:23.031242 2568 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-oauth-config\"" Jun 03 16:36:23.031391 ip-10-0-135-67 kubenswrapper[2568]: I0603 16:36:23.031296 2568 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-dockercfg-6vt6b\"" Jun 03 16:36:23.031391 ip-10-0-135-67 kubenswrapper[2568]: I0603 16:36:23.031208 2568 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-serving-cert\"" Jun 03 16:36:23.036883 ip-10-0-135-67 kubenswrapper[2568]: I0603 16:36:23.036853 2568 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-b7bc65d87-nsc2l"] Jun 03 16:36:23.153599 ip-10-0-135-67 kubenswrapper[2568]: I0603 16:36:23.153517 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/65ec0a70-0b84-48c2-bbc9-bde3b6880feb-oauth-serving-cert\") pod \"console-b7bc65d87-nsc2l\" (UID: \"65ec0a70-0b84-48c2-bbc9-bde3b6880feb\") " pod="openshift-console/console-b7bc65d87-nsc2l" Jun 03 16:36:23.153599 ip-10-0-135-67 kubenswrapper[2568]: I0603 16:36:23.153564 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/65ec0a70-0b84-48c2-bbc9-bde3b6880feb-console-serving-cert\") pod \"console-b7bc65d87-nsc2l\" (UID: \"65ec0a70-0b84-48c2-bbc9-bde3b6880feb\") " pod="openshift-console/console-b7bc65d87-nsc2l" Jun 03 16:36:23.153789 ip-10-0-135-67 kubenswrapper[2568]: I0603 16:36:23.153648 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-nzxhn\" (UniqueName: \"kubernetes.io/projected/65ec0a70-0b84-48c2-bbc9-bde3b6880feb-kube-api-access-nzxhn\") pod \"console-b7bc65d87-nsc2l\" (UID: \"65ec0a70-0b84-48c2-bbc9-bde3b6880feb\") " pod="openshift-console/console-b7bc65d87-nsc2l" Jun 03 16:36:23.153789 ip-10-0-135-67 kubenswrapper[2568]: I0603 16:36:23.153677 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/65ec0a70-0b84-48c2-bbc9-bde3b6880feb-service-ca\") pod \"console-b7bc65d87-nsc2l\" (UID: \"65ec0a70-0b84-48c2-bbc9-bde3b6880feb\") " pod="openshift-console/console-b7bc65d87-nsc2l" Jun 03 16:36:23.153789 ip-10-0-135-67 kubenswrapper[2568]: I0603 16:36:23.153737 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/65ec0a70-0b84-48c2-bbc9-bde3b6880feb-console-oauth-config\") pod \"console-b7bc65d87-nsc2l\" (UID: \"65ec0a70-0b84-48c2-bbc9-bde3b6880feb\") " pod="openshift-console/console-b7bc65d87-nsc2l" Jun 03 16:36:23.153882 ip-10-0-135-67 kubenswrapper[2568]: I0603 16:36:23.153801 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/65ec0a70-0b84-48c2-bbc9-bde3b6880feb-console-config\") pod \"console-b7bc65d87-nsc2l\" (UID: \"65ec0a70-0b84-48c2-bbc9-bde3b6880feb\") " pod="openshift-console/console-b7bc65d87-nsc2l" Jun 03 16:36:23.255183 ip-10-0-135-67 kubenswrapper[2568]: I0603 16:36:23.255148 2568 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/65ec0a70-0b84-48c2-bbc9-bde3b6880feb-console-oauth-config\") pod \"console-b7bc65d87-nsc2l\" (UID: \"65ec0a70-0b84-48c2-bbc9-bde3b6880feb\") " pod="openshift-console/console-b7bc65d87-nsc2l" Jun 03 16:36:23.255385 ip-10-0-135-67 kubenswrapper[2568]: I0603 16:36:23.255199 2568 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/65ec0a70-0b84-48c2-bbc9-bde3b6880feb-console-config\") pod \"console-b7bc65d87-nsc2l\" (UID: \"65ec0a70-0b84-48c2-bbc9-bde3b6880feb\") " pod="openshift-console/console-b7bc65d87-nsc2l" Jun 03 16:36:23.255385 ip-10-0-135-67 kubenswrapper[2568]: I0603 16:36:23.255249 2568 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/65ec0a70-0b84-48c2-bbc9-bde3b6880feb-oauth-serving-cert\") pod \"console-b7bc65d87-nsc2l\" (UID: \"65ec0a70-0b84-48c2-bbc9-bde3b6880feb\") " pod="openshift-console/console-b7bc65d87-nsc2l" Jun 03 16:36:23.255385 ip-10-0-135-67 kubenswrapper[2568]: I0603 16:36:23.255274 2568 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/65ec0a70-0b84-48c2-bbc9-bde3b6880feb-console-serving-cert\") pod \"console-b7bc65d87-nsc2l\" (UID: \"65ec0a70-0b84-48c2-bbc9-bde3b6880feb\") " pod="openshift-console/console-b7bc65d87-nsc2l" Jun 03 16:36:23.255385 ip-10-0-135-67 kubenswrapper[2568]: I0603 16:36:23.255320 2568 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-nzxhn\" (UniqueName: \"kubernetes.io/projected/65ec0a70-0b84-48c2-bbc9-bde3b6880feb-kube-api-access-nzxhn\") pod \"console-b7bc65d87-nsc2l\" (UID: \"65ec0a70-0b84-48c2-bbc9-bde3b6880feb\") " pod="openshift-console/console-b7bc65d87-nsc2l" Jun 03 16:36:23.255385 ip-10-0-135-67 kubenswrapper[2568]: I0603 16:36:23.255347 2568 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/65ec0a70-0b84-48c2-bbc9-bde3b6880feb-service-ca\") pod \"console-b7bc65d87-nsc2l\" (UID: \"65ec0a70-0b84-48c2-bbc9-bde3b6880feb\") " pod="openshift-console/console-b7bc65d87-nsc2l" Jun 03 16:36:23.257753 ip-10-0-135-67 kubenswrapper[2568]: I0603 16:36:23.257720 2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/65ec0a70-0b84-48c2-bbc9-bde3b6880feb-console-serving-cert\") pod \"console-b7bc65d87-nsc2l\" (UID: \"65ec0a70-0b84-48c2-bbc9-bde3b6880feb\") " pod="openshift-console/console-b7bc65d87-nsc2l" Jun 03 16:36:23.257753 ip-10-0-135-67 kubenswrapper[2568]: I0603 16:36:23.257742 2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/65ec0a70-0b84-48c2-bbc9-bde3b6880feb-console-oauth-config\") pod \"console-b7bc65d87-nsc2l\" (UID: \"65ec0a70-0b84-48c2-bbc9-bde3b6880feb\") " pod="openshift-console/console-b7bc65d87-nsc2l" Jun 03 16:36:23.257911 ip-10-0-135-67 kubenswrapper[2568]: I0603 16:36:23.257799 2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/65ec0a70-0b84-48c2-bbc9-bde3b6880feb-console-config\") pod \"console-b7bc65d87-nsc2l\" (UID: \"65ec0a70-0b84-48c2-bbc9-bde3b6880feb\") " pod="openshift-console/console-b7bc65d87-nsc2l" Jun 03 16:36:23.257911 ip-10-0-135-67 kubenswrapper[2568]: I0603 16:36:23.257829 2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/65ec0a70-0b84-48c2-bbc9-bde3b6880feb-service-ca\") pod \"console-b7bc65d87-nsc2l\" (UID: \"65ec0a70-0b84-48c2-bbc9-bde3b6880feb\") " pod="openshift-console/console-b7bc65d87-nsc2l" Jun 03 16:36:23.257911 ip-10-0-135-67 kubenswrapper[2568]: I0603 16:36:23.257869 2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/65ec0a70-0b84-48c2-bbc9-bde3b6880feb-oauth-serving-cert\") pod \"console-b7bc65d87-nsc2l\" (UID: \"65ec0a70-0b84-48c2-bbc9-bde3b6880feb\") " pod="openshift-console/console-b7bc65d87-nsc2l" Jun 03 16:36:23.262114 ip-10-0-135-67 kubenswrapper[2568]: I0603 16:36:23.262093 2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-nzxhn\" (UniqueName: \"kubernetes.io/projected/65ec0a70-0b84-48c2-bbc9-bde3b6880feb-kube-api-access-nzxhn\") pod \"console-b7bc65d87-nsc2l\" (UID: \"65ec0a70-0b84-48c2-bbc9-bde3b6880feb\") " pod="openshift-console/console-b7bc65d87-nsc2l" Jun 03 16:36:23.339169 ip-10-0-135-67 kubenswrapper[2568]: I0603 16:36:23.338993 2568 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-b7bc65d87-nsc2l" Jun 03 16:36:23.353244 ip-10-0-135-67 kubenswrapper[2568]: I0603 16:36:23.353217 2568 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-monitoring/prometheus-operator-admission-webhook-59b7f8756b-6mxg6"] Jun 03 16:36:23.356390 ip-10-0-135-67 kubenswrapper[2568]: I0603 16:36:23.356370 2568 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-operator-admission-webhook-59b7f8756b-6mxg6" Jun 03 16:36:23.363439 ip-10-0-135-67 kubenswrapper[2568]: I0603 16:36:23.359056 2568 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-operator-admission-webhook-dockercfg-fg2bw\"" Jun 03 16:36:23.363439 ip-10-0-135-67 kubenswrapper[2568]: I0603 16:36:23.359200 2568 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-operator-admission-webhook-tls\"" Jun 03 16:36:23.366646 ip-10-0-135-67 kubenswrapper[2568]: I0603 16:36:23.366609 2568 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-operator-admission-webhook-59b7f8756b-6mxg6"] Jun 03 16:36:23.458030 ip-10-0-135-67 kubenswrapper[2568]: I0603 16:36:23.457804 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certificates\" (UniqueName: \"kubernetes.io/secret/84bdc7c7-212d-47d8-90b7-52853cf73684-tls-certificates\") pod \"prometheus-operator-admission-webhook-59b7f8756b-6mxg6\" (UID: \"84bdc7c7-212d-47d8-90b7-52853cf73684\") " pod="openshift-monitoring/prometheus-operator-admission-webhook-59b7f8756b-6mxg6" Jun 03 16:36:23.486788 ip-10-0-135-67 kubenswrapper[2568]: I0603 16:36:23.486759 2568 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-b7bc65d87-nsc2l"] Jun 03 16:36:23.489965 ip-10-0-135-67 kubenswrapper[2568]: W0603 16:36:23.489938 2568 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod65ec0a70_0b84_48c2_bbc9_bde3b6880feb.slice/crio-11aa7ee000b18f3cbd1dfd24f542c1f154e2f1418ff0f1f10b47eff6722263a7 WatchSource:0}: Error finding container 11aa7ee000b18f3cbd1dfd24f542c1f154e2f1418ff0f1f10b47eff6722263a7: Status 404 returned error can't find the container with id 11aa7ee000b18f3cbd1dfd24f542c1f154e2f1418ff0f1f10b47eff6722263a7 Jun 03 16:36:23.559229 ip-10-0-135-67 kubenswrapper[2568]: I0603 16:36:23.559177 2568 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"tls-certificates\" (UniqueName: \"kubernetes.io/secret/84bdc7c7-212d-47d8-90b7-52853cf73684-tls-certificates\") pod \"prometheus-operator-admission-webhook-59b7f8756b-6mxg6\" (UID: \"84bdc7c7-212d-47d8-90b7-52853cf73684\") " pod="openshift-monitoring/prometheus-operator-admission-webhook-59b7f8756b-6mxg6" Jun 03 16:36:23.561738 ip-10-0-135-67 kubenswrapper[2568]: I0603 16:36:23.561704 2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-certificates\" (UniqueName: \"kubernetes.io/secret/84bdc7c7-212d-47d8-90b7-52853cf73684-tls-certificates\") pod \"prometheus-operator-admission-webhook-59b7f8756b-6mxg6\" (UID: \"84bdc7c7-212d-47d8-90b7-52853cf73684\") " pod="openshift-monitoring/prometheus-operator-admission-webhook-59b7f8756b-6mxg6" Jun 03 16:36:23.678507 ip-10-0-135-67 kubenswrapper[2568]: I0603 16:36:23.678428 2568 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-operator-admission-webhook-59b7f8756b-6mxg6" Jun 03 16:36:23.794937 ip-10-0-135-67 kubenswrapper[2568]: I0603 16:36:23.794901 2568 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-operator-admission-webhook-59b7f8756b-6mxg6"] Jun 03 16:36:23.798735 ip-10-0-135-67 kubenswrapper[2568]: W0603 16:36:23.798706 2568 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod84bdc7c7_212d_47d8_90b7_52853cf73684.slice/crio-25e77bfe7d6c3487b96d233f4e9590c91fcbd3f811ebfa12bba21beca02b97eb WatchSource:0}: Error finding container 25e77bfe7d6c3487b96d233f4e9590c91fcbd3f811ebfa12bba21beca02b97eb: Status 404 returned error can't find the container with id 25e77bfe7d6c3487b96d233f4e9590c91fcbd3f811ebfa12bba21beca02b97eb Jun 03 16:36:23.855975 ip-10-0-135-67 kubenswrapper[2568]: I0603 16:36:23.855939 2568 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-b7bc65d87-nsc2l" event={"ID":"65ec0a70-0b84-48c2-bbc9-bde3b6880feb","Type":"ContainerStarted","Data":"11aa7ee000b18f3cbd1dfd24f542c1f154e2f1418ff0f1f10b47eff6722263a7"} Jun 03 16:36:23.857423 ip-10-0-135-67 kubenswrapper[2568]: I0603 16:36:23.857389 2568 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/cluster-monitoring-operator-69b6cbdb88-tzxs6" event={"ID":"48e00082-b030-48ac-aa35-9cb1ab31fae8","Type":"ContainerStarted","Data":"5f35a436cba8b92c48ebcd0e9c26ebf795a690bca1e396a070a4caf69068fb98"} Jun 03 16:36:23.858523 ip-10-0-135-67 kubenswrapper[2568]: I0603 16:36:23.858498 2568 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-operator-admission-webhook-59b7f8756b-6mxg6" event={"ID":"84bdc7c7-212d-47d8-90b7-52853cf73684","Type":"ContainerStarted","Data":"25e77bfe7d6c3487b96d233f4e9590c91fcbd3f811ebfa12bba21beca02b97eb"} Jun 03 16:36:23.871546 ip-10-0-135-67 kubenswrapper[2568]: I0603 16:36:23.871496 2568 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-monitoring/cluster-monitoring-operator-69b6cbdb88-tzxs6" podStartSLOduration=34.038420876 podStartE2EDuration="35.871478056s" podCreationTimestamp="2026-06-03 16:35:48 +0000 UTC" firstStartedPulling="2026-06-03 16:36:21.02897295 +0000 UTC m=+153.171147596" lastFinishedPulling="2026-06-03 16:36:22.862030139 +0000 UTC m=+155.004204776" observedRunningTime="2026-06-03 16:36:23.871074933 +0000 UTC m=+156.013249588" watchObservedRunningTime="2026-06-03 16:36:23.871478056 +0000 UTC m=+156.013652713" Jun 03 16:36:25.867277 ip-10-0-135-67 kubenswrapper[2568]: I0603 16:36:25.867233 2568 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-operator-admission-webhook-59b7f8756b-6mxg6" event={"ID":"84bdc7c7-212d-47d8-90b7-52853cf73684","Type":"ContainerStarted","Data":"471460670fdc4dfca6be1accf8d4f5a7421d800ebca6da698af67729c49074d8"} Jun 03 16:36:25.867705 ip-10-0-135-67 kubenswrapper[2568]: I0603 16:36:25.867437 2568 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-monitoring/prometheus-operator-admission-webhook-59b7f8756b-6mxg6" Jun 03 16:36:25.873733 ip-10-0-135-67 kubenswrapper[2568]: I0603 16:36:25.873698 2568 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-monitoring/prometheus-operator-admission-webhook-59b7f8756b-6mxg6" Jun 03 16:36:25.881426 ip-10-0-135-67 kubenswrapper[2568]: I0603 16:36:25.881371 2568 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-monitoring/prometheus-operator-admission-webhook-59b7f8756b-6mxg6" podStartSLOduration=1.234061885 podStartE2EDuration="2.881354812s" podCreationTimestamp="2026-06-03 16:36:23 +0000 UTC" firstStartedPulling="2026-06-03 16:36:23.800875706 +0000 UTC m=+155.943050352" lastFinishedPulling="2026-06-03 16:36:25.448168643 +0000 UTC m=+157.590343279" observedRunningTime="2026-06-03 16:36:25.880401316 +0000 UTC m=+158.022575973" watchObservedRunningTime="2026-06-03 16:36:25.881354812 +0000 UTC m=+158.023529471" Jun 03 16:36:26.412784 ip-10-0-135-67 kubenswrapper[2568]: I0603 16:36:26.412756 2568 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-monitoring/prometheus-operator-658bcd8bdf-sfc6m"] Jun 03 16:36:26.415143 ip-10-0-135-67 kubenswrapper[2568]: I0603 16:36:26.415118 2568 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-operator-658bcd8bdf-sfc6m" Jun 03 16:36:26.417130 ip-10-0-135-67 kubenswrapper[2568]: I0603 16:36:26.417104 2568 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-operator-kube-rbac-proxy-config\"" Jun 03 16:36:26.417253 ip-10-0-135-67 kubenswrapper[2568]: I0603 16:36:26.417103 2568 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-operator-tls\"" Jun 03 16:36:26.417660 ip-10-0-135-67 kubenswrapper[2568]: I0603 16:36:26.417637 2568 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"metrics-client-ca\"" Jun 03 16:36:26.417880 ip-10-0-135-67 kubenswrapper[2568]: I0603 16:36:26.417763 2568 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-operator-dockercfg-g5cs7\"" Jun 03 16:36:26.425149 ip-10-0-135-67 kubenswrapper[2568]: I0603 16:36:26.425126 2568 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-operator-658bcd8bdf-sfc6m"] Jun 03 16:36:26.487883 ip-10-0-135-67 kubenswrapper[2568]: I0603 16:36:26.487852 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-operator-tls\" (UniqueName: \"kubernetes.io/secret/9d684eec-bf8e-4476-b54d-03535a181804-prometheus-operator-tls\") pod \"prometheus-operator-658bcd8bdf-sfc6m\" (UID: \"9d684eec-bf8e-4476-b54d-03535a181804\") " pod="openshift-monitoring/prometheus-operator-658bcd8bdf-sfc6m" Jun 03 16:36:26.488016 ip-10-0-135-67 kubenswrapper[2568]: I0603 16:36:26.487901 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/9d684eec-bf8e-4476-b54d-03535a181804-metrics-client-ca\") pod \"prometheus-operator-658bcd8bdf-sfc6m\" (UID: \"9d684eec-bf8e-4476-b54d-03535a181804\") " pod="openshift-monitoring/prometheus-operator-658bcd8bdf-sfc6m" Jun 03 16:36:26.488016 ip-10-0-135-67 kubenswrapper[2568]: I0603 16:36:26.487951 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-4xswp\" (UniqueName: \"kubernetes.io/projected/9d684eec-bf8e-4476-b54d-03535a181804-kube-api-access-4xswp\") pod \"prometheus-operator-658bcd8bdf-sfc6m\" (UID: \"9d684eec-bf8e-4476-b54d-03535a181804\") " pod="openshift-monitoring/prometheus-operator-658bcd8bdf-sfc6m" Jun 03 16:36:26.488113 ip-10-0-135-67 kubenswrapper[2568]: I0603 16:36:26.488093 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-operator-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/9d684eec-bf8e-4476-b54d-03535a181804-prometheus-operator-kube-rbac-proxy-config\") pod \"prometheus-operator-658bcd8bdf-sfc6m\" (UID: \"9d684eec-bf8e-4476-b54d-03535a181804\") " pod="openshift-monitoring/prometheus-operator-658bcd8bdf-sfc6m" Jun 03 16:36:26.589924 ip-10-0-135-67 kubenswrapper[2568]: I0603 16:36:26.589430 2568 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"prometheus-operator-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/9d684eec-bf8e-4476-b54d-03535a181804-prometheus-operator-kube-rbac-proxy-config\") pod \"prometheus-operator-658bcd8bdf-sfc6m\" (UID: \"9d684eec-bf8e-4476-b54d-03535a181804\") " pod="openshift-monitoring/prometheus-operator-658bcd8bdf-sfc6m" Jun 03 16:36:26.589924 ip-10-0-135-67 kubenswrapper[2568]: I0603 16:36:26.589492 2568 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"prometheus-operator-tls\" (UniqueName: \"kubernetes.io/secret/9d684eec-bf8e-4476-b54d-03535a181804-prometheus-operator-tls\") pod \"prometheus-operator-658bcd8bdf-sfc6m\" (UID: \"9d684eec-bf8e-4476-b54d-03535a181804\") " pod="openshift-monitoring/prometheus-operator-658bcd8bdf-sfc6m" Jun 03 16:36:26.589924 ip-10-0-135-67 kubenswrapper[2568]: I0603 16:36:26.589524 2568 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/9d684eec-bf8e-4476-b54d-03535a181804-metrics-client-ca\") pod \"prometheus-operator-658bcd8bdf-sfc6m\" (UID: \"9d684eec-bf8e-4476-b54d-03535a181804\") " pod="openshift-monitoring/prometheus-operator-658bcd8bdf-sfc6m" Jun 03 16:36:26.589924 ip-10-0-135-67 kubenswrapper[2568]: I0603 16:36:26.589565 2568 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-4xswp\" (UniqueName: \"kubernetes.io/projected/9d684eec-bf8e-4476-b54d-03535a181804-kube-api-access-4xswp\") pod \"prometheus-operator-658bcd8bdf-sfc6m\" (UID: \"9d684eec-bf8e-4476-b54d-03535a181804\") " pod="openshift-monitoring/prometheus-operator-658bcd8bdf-sfc6m" Jun 03 16:36:26.589924 ip-10-0-135-67 kubenswrapper[2568]: E0603 16:36:26.589910 2568 secret.go:189] Couldn't get secret openshift-monitoring/prometheus-operator-tls: secret "prometheus-operator-tls" not found Jun 03 16:36:26.590327 ip-10-0-135-67 kubenswrapper[2568]: E0603 16:36:26.589980 2568 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/9d684eec-bf8e-4476-b54d-03535a181804-prometheus-operator-tls podName:9d684eec-bf8e-4476-b54d-03535a181804 nodeName:}" failed. No retries permitted until 2026-06-03 16:36:27.089960983 +0000 UTC m=+159.232135615 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "prometheus-operator-tls" (UniqueName: "kubernetes.io/secret/9d684eec-bf8e-4476-b54d-03535a181804-prometheus-operator-tls") pod "prometheus-operator-658bcd8bdf-sfc6m" (UID: "9d684eec-bf8e-4476-b54d-03535a181804") : secret "prometheus-operator-tls" not found Jun 03 16:36:26.590639 ip-10-0-135-67 kubenswrapper[2568]: I0603 16:36:26.590615 2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/9d684eec-bf8e-4476-b54d-03535a181804-metrics-client-ca\") pod \"prometheus-operator-658bcd8bdf-sfc6m\" (UID: \"9d684eec-bf8e-4476-b54d-03535a181804\") " pod="openshift-monitoring/prometheus-operator-658bcd8bdf-sfc6m" Jun 03 16:36:26.592333 ip-10-0-135-67 kubenswrapper[2568]: I0603 16:36:26.592311 2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"prometheus-operator-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/9d684eec-bf8e-4476-b54d-03535a181804-prometheus-operator-kube-rbac-proxy-config\") pod \"prometheus-operator-658bcd8bdf-sfc6m\" (UID: \"9d684eec-bf8e-4476-b54d-03535a181804\") " pod="openshift-monitoring/prometheus-operator-658bcd8bdf-sfc6m" Jun 03 16:36:26.598021 ip-10-0-135-67 kubenswrapper[2568]: I0603 16:36:26.597983 2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-4xswp\" (UniqueName: \"kubernetes.io/projected/9d684eec-bf8e-4476-b54d-03535a181804-kube-api-access-4xswp\") pod \"prometheus-operator-658bcd8bdf-sfc6m\" (UID: \"9d684eec-bf8e-4476-b54d-03535a181804\") " pod="openshift-monitoring/prometheus-operator-658bcd8bdf-sfc6m" Jun 03 16:36:27.093689 ip-10-0-135-67 kubenswrapper[2568]: I0603 16:36:27.093640 2568 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"prometheus-operator-tls\" (UniqueName: \"kubernetes.io/secret/9d684eec-bf8e-4476-b54d-03535a181804-prometheus-operator-tls\") pod \"prometheus-operator-658bcd8bdf-sfc6m\" (UID: \"9d684eec-bf8e-4476-b54d-03535a181804\") " pod="openshift-monitoring/prometheus-operator-658bcd8bdf-sfc6m" Jun 03 16:36:27.096158 ip-10-0-135-67 kubenswrapper[2568]: I0603 16:36:27.096136 2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"prometheus-operator-tls\" (UniqueName: \"kubernetes.io/secret/9d684eec-bf8e-4476-b54d-03535a181804-prometheus-operator-tls\") pod \"prometheus-operator-658bcd8bdf-sfc6m\" (UID: \"9d684eec-bf8e-4476-b54d-03535a181804\") " pod="openshift-monitoring/prometheus-operator-658bcd8bdf-sfc6m" Jun 03 16:36:27.325544 ip-10-0-135-67 kubenswrapper[2568]: I0603 16:36:27.325502 2568 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-operator-658bcd8bdf-sfc6m" Jun 03 16:36:27.542343 ip-10-0-135-67 kubenswrapper[2568]: I0603 16:36:27.542285 2568 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-operator-658bcd8bdf-sfc6m"] Jun 03 16:36:27.546241 ip-10-0-135-67 kubenswrapper[2568]: W0603 16:36:27.546216 2568 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod9d684eec_bf8e_4476_b54d_03535a181804.slice/crio-4d8823a79e5cbe5767ddd5ef166c62bbb1cf3d2cc4f28cd410d0c3beb2920ee4 WatchSource:0}: Error finding container 4d8823a79e5cbe5767ddd5ef166c62bbb1cf3d2cc4f28cd410d0c3beb2920ee4: Status 404 returned error can't find the container with id 4d8823a79e5cbe5767ddd5ef166c62bbb1cf3d2cc4f28cd410d0c3beb2920ee4 Jun 03 16:36:27.876968 ip-10-0-135-67 kubenswrapper[2568]: I0603 16:36:27.876927 2568 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-b7bc65d87-nsc2l" event={"ID":"65ec0a70-0b84-48c2-bbc9-bde3b6880feb","Type":"ContainerStarted","Data":"8e19b6966f32a19995b07fa6584a74b4f38866caa8ab4bd63f1a45e9e8d3a90b"} Jun 03 16:36:27.879604 ip-10-0-135-67 kubenswrapper[2568]: I0603 16:36:27.879497 2568 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-operator-658bcd8bdf-sfc6m" event={"ID":"9d684eec-bf8e-4476-b54d-03535a181804","Type":"ContainerStarted","Data":"4d8823a79e5cbe5767ddd5ef166c62bbb1cf3d2cc4f28cd410d0c3beb2920ee4"} Jun 03 16:36:27.896697 ip-10-0-135-67 kubenswrapper[2568]: I0603 16:36:27.896653 2568 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-console/console-b7bc65d87-nsc2l" podStartSLOduration=0.94506561 podStartE2EDuration="4.896637892s" podCreationTimestamp="2026-06-03 16:36:23 +0000 UTC" firstStartedPulling="2026-06-03 16:36:23.491776278 +0000 UTC m=+155.633950909" lastFinishedPulling="2026-06-03 16:36:27.443348551 +0000 UTC m=+159.585523191" observedRunningTime="2026-06-03 16:36:27.896102691 +0000 UTC m=+160.038277349" watchObservedRunningTime="2026-06-03 16:36:27.896637892 +0000 UTC m=+160.038812546" Jun 03 16:36:29.778985 ip-10-0-135-67 kubenswrapper[2568]: E0603 16:36:29.778940 2568 pod_workers.go:1301] "Error syncing pod, skipping" err="unmounted volumes=[registry-tls], unattached volumes=[], failed to process volumes=[]: context deadline exceeded" pod="openshift-image-registry/image-registry-74745bdc9c-rk4cq" podUID="1adc570a-c47f-4bc0-a3f5-a7e90c775e3a" Jun 03 16:36:29.802799 ip-10-0-135-67 kubenswrapper[2568]: E0603 16:36:29.802763 2568 pod_workers.go:1301] "Error syncing pod, skipping" err="unmounted volumes=[metrics-tls], unattached volumes=[], failed to process volumes=[]: context deadline exceeded" pod="openshift-dns/dns-default-tn2hz" podUID="0f3a9c08-8974-46c9-9245-fbfc1a73e96c" Jun 03 16:36:29.824983 ip-10-0-135-67 kubenswrapper[2568]: E0603 16:36:29.824949 2568 pod_workers.go:1301] "Error syncing pod, skipping" err="unmounted volumes=[cert], unattached volumes=[], failed to process volumes=[]: context deadline exceeded" pod="openshift-ingress-canary/ingress-canary-mjr7l" podUID="7839d8fc-3e8c-481e-93f6-5e2eb79ee81f" Jun 03 16:36:29.886431 ip-10-0-135-67 kubenswrapper[2568]: I0603 16:36:29.886395 2568 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-operator-658bcd8bdf-sfc6m" event={"ID":"9d684eec-bf8e-4476-b54d-03535a181804","Type":"ContainerStarted","Data":"574c834c4afb19d642169ed5093ef8a441066b682cc084ca7ea5b42a42a48653"} Jun 03 16:36:29.886431 ip-10-0-135-67 kubenswrapper[2568]: I0603 16:36:29.886420 2568 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-tn2hz" Jun 03 16:36:29.886603 ip-10-0-135-67 kubenswrapper[2568]: I0603 16:36:29.886441 2568 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-operator-658bcd8bdf-sfc6m" event={"ID":"9d684eec-bf8e-4476-b54d-03535a181804","Type":"ContainerStarted","Data":"6e9ba4396c3a5f6fde595b27dd5f1bc1b5abbc402de16ca35666985329ce3a84"} Jun 03 16:36:29.903630 ip-10-0-135-67 kubenswrapper[2568]: I0603 16:36:29.903595 2568 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-monitoring/prometheus-operator-658bcd8bdf-sfc6m" podStartSLOduration=2.561909675 podStartE2EDuration="3.903583625s" podCreationTimestamp="2026-06-03 16:36:26 +0000 UTC" firstStartedPulling="2026-06-03 16:36:27.548722834 +0000 UTC m=+159.690897466" lastFinishedPulling="2026-06-03 16:36:28.890396767 +0000 UTC m=+161.032571416" observedRunningTime="2026-06-03 16:36:29.90235673 +0000 UTC m=+162.044531433" watchObservedRunningTime="2026-06-03 16:36:29.903583625 +0000 UTC m=+162.045758279" Jun 03 16:36:31.430079 ip-10-0-135-67 kubenswrapper[2568]: E0603 16:36:31.430033 2568 pod_workers.go:1301] "Error syncing pod, skipping" err="unmounted volumes=[metrics-certs], unattached volumes=[], failed to process volumes=[]: context deadline exceeded" pod="openshift-multus/network-metrics-daemon-54gnw" podUID="ddc210bb-9544-4ca7-b2de-f84c92d84510" Jun 03 16:36:31.752492 ip-10-0-135-67 kubenswrapper[2568]: I0603 16:36:31.752437 2568 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-monitoring/openshift-state-metrics-85658796db-trt8m"] Jun 03 16:36:31.756465 ip-10-0-135-67 kubenswrapper[2568]: I0603 16:36:31.756308 2568 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/openshift-state-metrics-85658796db-trt8m" Jun 03 16:36:31.765234 ip-10-0-135-67 kubenswrapper[2568]: I0603 16:36:31.764527 2568 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"openshift-state-metrics-tls\"" Jun 03 16:36:31.765234 ip-10-0-135-67 kubenswrapper[2568]: I0603 16:36:31.764752 2568 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"openshift-state-metrics-dockercfg-pfsvt\"" Jun 03 16:36:31.765234 ip-10-0-135-67 kubenswrapper[2568]: I0603 16:36:31.764939 2568 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"openshift-state-metrics-kube-rbac-proxy-config\"" Jun 03 16:36:31.767159 ip-10-0-135-67 kubenswrapper[2568]: I0603 16:36:31.766968 2568 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/openshift-state-metrics-85658796db-trt8m"] Jun 03 16:36:31.778454 ip-10-0-135-67 kubenswrapper[2568]: I0603 16:36:31.778352 2568 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-monitoring/kube-state-metrics-8469c486bb-pkwds"] Jun 03 16:36:31.781283 ip-10-0-135-67 kubenswrapper[2568]: I0603 16:36:31.781268 2568 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/kube-state-metrics-8469c486bb-pkwds" Jun 03 16:36:31.783912 ip-10-0-135-67 kubenswrapper[2568]: I0603 16:36:31.783893 2568 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"kube-state-metrics-tls\"" Jun 03 16:36:31.784508 ip-10-0-135-67 kubenswrapper[2568]: I0603 16:36:31.784178 2568 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"kube-state-metrics-dockercfg-mbd89\"" Jun 03 16:36:31.784742 ip-10-0-135-67 kubenswrapper[2568]: I0603 16:36:31.784301 2568 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"kube-state-metrics-custom-resource-state-configmap\"" Jun 03 16:36:31.784941 ip-10-0-135-67 kubenswrapper[2568]: I0603 16:36:31.784345 2568 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"kube-state-metrics-kube-rbac-proxy-config\"" Jun 03 16:36:31.787060 ip-10-0-135-67 kubenswrapper[2568]: I0603 16:36:31.787043 2568 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-monitoring/node-exporter-289mx"] Jun 03 16:36:31.794062 ip-10-0-135-67 kubenswrapper[2568]: I0603 16:36:31.794040 2568 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/kube-state-metrics-8469c486bb-pkwds"] Jun 03 16:36:31.794291 ip-10-0-135-67 kubenswrapper[2568]: I0603 16:36:31.794234 2568 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/node-exporter-289mx" Jun 03 16:36:31.797039 ip-10-0-135-67 kubenswrapper[2568]: I0603 16:36:31.796497 2568 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"node-exporter-accelerators-collector-config\"" Jun 03 16:36:31.797039 ip-10-0-135-67 kubenswrapper[2568]: I0603 16:36:31.796695 2568 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-tls\"" Jun 03 16:36:31.797039 ip-10-0-135-67 kubenswrapper[2568]: I0603 16:36:31.796888 2568 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-kube-rbac-proxy-config\"" Jun 03 16:36:31.797395 ip-10-0-135-67 kubenswrapper[2568]: I0603 16:36:31.797381 2568 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-dockercfg-glg92\"" Jun 03 16:36:31.833323 ip-10-0-135-67 kubenswrapper[2568]: I0603 16:36:31.833292 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-state-metrics-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/674fabaf-399c-4cec-8f61-c9e1c778f57b-openshift-state-metrics-kube-rbac-proxy-config\") pod \"openshift-state-metrics-85658796db-trt8m\" (UID: \"674fabaf-399c-4cec-8f61-c9e1c778f57b\") " pod="openshift-monitoring/openshift-state-metrics-85658796db-trt8m" Jun 03 16:36:31.833464 ip-10-0-135-67 kubenswrapper[2568]: I0603 16:36:31.833336 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/674fabaf-399c-4cec-8f61-c9e1c778f57b-metrics-client-ca\") pod \"openshift-state-metrics-85658796db-trt8m\" (UID: \"674fabaf-399c-4cec-8f61-c9e1c778f57b\") " pod="openshift-monitoring/openshift-state-metrics-85658796db-trt8m" Jun 03 16:36:31.833464 ip-10-0-135-67 kubenswrapper[2568]: I0603 16:36:31.833389 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/674fabaf-399c-4cec-8f61-c9e1c778f57b-openshift-state-metrics-tls\") pod \"openshift-state-metrics-85658796db-trt8m\" (UID: \"674fabaf-399c-4cec-8f61-c9e1c778f57b\") " pod="openshift-monitoring/openshift-state-metrics-85658796db-trt8m" Jun 03 16:36:31.833585 ip-10-0-135-67 kubenswrapper[2568]: I0603 16:36:31.833567 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-6mrdr\" (UniqueName: \"kubernetes.io/projected/674fabaf-399c-4cec-8f61-c9e1c778f57b-kube-api-access-6mrdr\") pod \"openshift-state-metrics-85658796db-trt8m\" (UID: \"674fabaf-399c-4cec-8f61-c9e1c778f57b\") " pod="openshift-monitoring/openshift-state-metrics-85658796db-trt8m" Jun 03 16:36:31.934542 ip-10-0-135-67 kubenswrapper[2568]: I0603 16:36:31.934513 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/24de6081-0ed9-49d4-b2fa-6f4e6d3c8d39-node-exporter-accelerators-collector-config\") pod \"node-exporter-289mx\" (UID: \"24de6081-0ed9-49d4-b2fa-6f4e6d3c8d39\") " pod="openshift-monitoring/node-exporter-289mx" Jun 03 16:36:31.934728 ip-10-0-135-67 kubenswrapper[2568]: I0603 16:36:31.934582 2568 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"openshift-state-metrics-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/674fabaf-399c-4cec-8f61-c9e1c778f57b-openshift-state-metrics-kube-rbac-proxy-config\") pod \"openshift-state-metrics-85658796db-trt8m\" (UID: \"674fabaf-399c-4cec-8f61-c9e1c778f57b\") " pod="openshift-monitoring/openshift-state-metrics-85658796db-trt8m" Jun 03 16:36:31.934728 ip-10-0-135-67 kubenswrapper[2568]: I0603 16:36:31.934611 2568 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/674fabaf-399c-4cec-8f61-c9e1c778f57b-metrics-client-ca\") pod \"openshift-state-metrics-85658796db-trt8m\" (UID: \"674fabaf-399c-4cec-8f61-c9e1c778f57b\") " pod="openshift-monitoring/openshift-state-metrics-85658796db-trt8m" Jun 03 16:36:31.934728 ip-10-0-135-67 kubenswrapper[2568]: I0603 16:36:31.934637 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-state-metrics-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/f61b4ac6-d530-43f4-8f5f-c44f45455887-kube-state-metrics-kube-rbac-proxy-config\") pod \"kube-state-metrics-8469c486bb-pkwds\" (UID: \"f61b4ac6-d530-43f4-8f5f-c44f45455887\") " pod="openshift-monitoring/kube-state-metrics-8469c486bb-pkwds" Jun 03 16:36:31.934728 ip-10-0-135-67 kubenswrapper[2568]: I0603 16:36:31.934705 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/f61b4ac6-d530-43f4-8f5f-c44f45455887-kube-state-metrics-tls\") pod \"kube-state-metrics-8469c486bb-pkwds\" (UID: \"f61b4ac6-d530-43f4-8f5f-c44f45455887\") " pod="openshift-monitoring/kube-state-metrics-8469c486bb-pkwds" Jun 03 16:36:31.934933 ip-10-0-135-67 kubenswrapper[2568]: I0603 16:36:31.934784 2568 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"openshift-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/674fabaf-399c-4cec-8f61-c9e1c778f57b-openshift-state-metrics-tls\") pod \"openshift-state-metrics-85658796db-trt8m\" (UID: \"674fabaf-399c-4cec-8f61-c9e1c778f57b\") " pod="openshift-monitoring/openshift-state-metrics-85658796db-trt8m" Jun 03 16:36:31.934933 ip-10-0-135-67 kubenswrapper[2568]: I0603 16:36:31.934810 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/24de6081-0ed9-49d4-b2fa-6f4e6d3c8d39-node-exporter-wtmp\") pod \"node-exporter-289mx\" (UID: \"24de6081-0ed9-49d4-b2fa-6f4e6d3c8d39\") " pod="openshift-monitoring/node-exporter-289mx" Jun 03 16:36:31.934933 ip-10-0-135-67 kubenswrapper[2568]: I0603 16:36:31.934845 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/f61b4ac6-d530-43f4-8f5f-c44f45455887-metrics-client-ca\") pod \"kube-state-metrics-8469c486bb-pkwds\" (UID: \"f61b4ac6-d530-43f4-8f5f-c44f45455887\") " pod="openshift-monitoring/kube-state-metrics-8469c486bb-pkwds" Jun 03 16:36:31.934933 ip-10-0-135-67 kubenswrapper[2568]: I0603 16:36:31.934902 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-fbrwj\" (UniqueName: \"kubernetes.io/projected/f61b4ac6-d530-43f4-8f5f-c44f45455887-kube-api-access-fbrwj\") pod \"kube-state-metrics-8469c486bb-pkwds\" (UID: \"f61b4ac6-d530-43f4-8f5f-c44f45455887\") " pod="openshift-monitoring/kube-state-metrics-8469c486bb-pkwds" Jun 03 16:36:31.935179 ip-10-0-135-67 kubenswrapper[2568]: I0603 16:36:31.934949 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"volume-directive-shadow\" (UniqueName: \"kubernetes.io/empty-dir/f61b4ac6-d530-43f4-8f5f-c44f45455887-volume-directive-shadow\") pod \"kube-state-metrics-8469c486bb-pkwds\" (UID: \"f61b4ac6-d530-43f4-8f5f-c44f45455887\") " pod="openshift-monitoring/kube-state-metrics-8469c486bb-pkwds" Jun 03 16:36:31.935179 ip-10-0-135-67 kubenswrapper[2568]: I0603 16:36:31.934986 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/24de6081-0ed9-49d4-b2fa-6f4e6d3c8d39-node-exporter-tls\") pod \"node-exporter-289mx\" (UID: \"24de6081-0ed9-49d4-b2fa-6f4e6d3c8d39\") " pod="openshift-monitoring/node-exporter-289mx" Jun 03 16:36:31.935179 ip-10-0-135-67 kubenswrapper[2568]: I0603 16:36:31.935090 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/24de6081-0ed9-49d4-b2fa-6f4e6d3c8d39-metrics-client-ca\") pod \"node-exporter-289mx\" (UID: \"24de6081-0ed9-49d4-b2fa-6f4e6d3c8d39\") " pod="openshift-monitoring/node-exporter-289mx" Jun 03 16:36:31.935179 ip-10-0-135-67 kubenswrapper[2568]: I0603 16:36:31.935163 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"root\" (UniqueName: \"kubernetes.io/host-path/24de6081-0ed9-49d4-b2fa-6f4e6d3c8d39-root\") pod \"node-exporter-289mx\" (UID: \"24de6081-0ed9-49d4-b2fa-6f4e6d3c8d39\") " pod="openshift-monitoring/node-exporter-289mx" Jun 03 16:36:31.935379 ip-10-0-135-67 kubenswrapper[2568]: I0603 16:36:31.935212 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-state-metrics-custom-resource-state-configmap\" (UniqueName: \"kubernetes.io/configmap/f61b4ac6-d530-43f4-8f5f-c44f45455887-kube-state-metrics-custom-resource-state-configmap\") pod \"kube-state-metrics-8469c486bb-pkwds\" (UID: \"f61b4ac6-d530-43f4-8f5f-c44f45455887\") " pod="openshift-monitoring/kube-state-metrics-8469c486bb-pkwds" Jun 03 16:36:31.935379 ip-10-0-135-67 kubenswrapper[2568]: I0603 16:36:31.935264 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/24de6081-0ed9-49d4-b2fa-6f4e6d3c8d39-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-289mx\" (UID: \"24de6081-0ed9-49d4-b2fa-6f4e6d3c8d39\") " pod="openshift-monitoring/node-exporter-289mx" Jun 03 16:36:31.935379 ip-10-0-135-67 kubenswrapper[2568]: I0603 16:36:31.935317 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/24de6081-0ed9-49d4-b2fa-6f4e6d3c8d39-sys\") pod \"node-exporter-289mx\" (UID: \"24de6081-0ed9-49d4-b2fa-6f4e6d3c8d39\") " pod="openshift-monitoring/node-exporter-289mx" Jun 03 16:36:31.935379 ip-10-0-135-67 kubenswrapper[2568]: I0603 16:36:31.935356 2568 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-6mrdr\" (UniqueName: \"kubernetes.io/projected/674fabaf-399c-4cec-8f61-c9e1c778f57b-kube-api-access-6mrdr\") pod \"openshift-state-metrics-85658796db-trt8m\" (UID: \"674fabaf-399c-4cec-8f61-c9e1c778f57b\") " pod="openshift-monitoring/openshift-state-metrics-85658796db-trt8m" Jun 03 16:36:31.935563 ip-10-0-135-67 kubenswrapper[2568]: I0603 16:36:31.935393 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/24de6081-0ed9-49d4-b2fa-6f4e6d3c8d39-node-exporter-textfile\") pod \"node-exporter-289mx\" (UID: \"24de6081-0ed9-49d4-b2fa-6f4e6d3c8d39\") " pod="openshift-monitoring/node-exporter-289mx" Jun 03 16:36:31.935563 ip-10-0-135-67 kubenswrapper[2568]: I0603 16:36:31.935416 2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/674fabaf-399c-4cec-8f61-c9e1c778f57b-metrics-client-ca\") pod \"openshift-state-metrics-85658796db-trt8m\" (UID: \"674fabaf-399c-4cec-8f61-c9e1c778f57b\") " pod="openshift-monitoring/openshift-state-metrics-85658796db-trt8m" Jun 03 16:36:31.935563 ip-10-0-135-67 kubenswrapper[2568]: I0603 16:36:31.935427 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-5h6dv\" (UniqueName: \"kubernetes.io/projected/24de6081-0ed9-49d4-b2fa-6f4e6d3c8d39-kube-api-access-5h6dv\") pod \"node-exporter-289mx\" (UID: \"24de6081-0ed9-49d4-b2fa-6f4e6d3c8d39\") " pod="openshift-monitoring/node-exporter-289mx" Jun 03 16:36:31.937513 ip-10-0-135-67 kubenswrapper[2568]: I0603 16:36:31.937486 2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"openshift-state-metrics-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/674fabaf-399c-4cec-8f61-c9e1c778f57b-openshift-state-metrics-kube-rbac-proxy-config\") pod \"openshift-state-metrics-85658796db-trt8m\" (UID: \"674fabaf-399c-4cec-8f61-c9e1c778f57b\") " pod="openshift-monitoring/openshift-state-metrics-85658796db-trt8m" Jun 03 16:36:31.937645 ip-10-0-135-67 kubenswrapper[2568]: I0603 16:36:31.937542 2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"openshift-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/674fabaf-399c-4cec-8f61-c9e1c778f57b-openshift-state-metrics-tls\") pod \"openshift-state-metrics-85658796db-trt8m\" (UID: \"674fabaf-399c-4cec-8f61-c9e1c778f57b\") " pod="openshift-monitoring/openshift-state-metrics-85658796db-trt8m" Jun 03 16:36:31.943759 ip-10-0-135-67 kubenswrapper[2568]: I0603 16:36:31.943703 2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-6mrdr\" (UniqueName: \"kubernetes.io/projected/674fabaf-399c-4cec-8f61-c9e1c778f57b-kube-api-access-6mrdr\") pod \"openshift-state-metrics-85658796db-trt8m\" (UID: \"674fabaf-399c-4cec-8f61-c9e1c778f57b\") " pod="openshift-monitoring/openshift-state-metrics-85658796db-trt8m" Jun 03 16:36:32.036523 ip-10-0-135-67 kubenswrapper[2568]: I0603 16:36:32.036434 2568 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/24de6081-0ed9-49d4-b2fa-6f4e6d3c8d39-node-exporter-accelerators-collector-config\") pod \"node-exporter-289mx\" (UID: \"24de6081-0ed9-49d4-b2fa-6f4e6d3c8d39\") " pod="openshift-monitoring/node-exporter-289mx" Jun 03 16:36:32.036523 ip-10-0-135-67 kubenswrapper[2568]: I0603 16:36:32.036496 2568 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-state-metrics-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/f61b4ac6-d530-43f4-8f5f-c44f45455887-kube-state-metrics-kube-rbac-proxy-config\") pod \"kube-state-metrics-8469c486bb-pkwds\" (UID: \"f61b4ac6-d530-43f4-8f5f-c44f45455887\") " pod="openshift-monitoring/kube-state-metrics-8469c486bb-pkwds" Jun 03 16:36:32.036730 ip-10-0-135-67 kubenswrapper[2568]: I0603 16:36:32.036549 2568 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/f61b4ac6-d530-43f4-8f5f-c44f45455887-kube-state-metrics-tls\") pod \"kube-state-metrics-8469c486bb-pkwds\" (UID: \"f61b4ac6-d530-43f4-8f5f-c44f45455887\") " pod="openshift-monitoring/kube-state-metrics-8469c486bb-pkwds" Jun 03 16:36:32.037221 ip-10-0-135-67 kubenswrapper[2568]: I0603 16:36:32.037193 2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/24de6081-0ed9-49d4-b2fa-6f4e6d3c8d39-node-exporter-accelerators-collector-config\") pod \"node-exporter-289mx\" (UID: \"24de6081-0ed9-49d4-b2fa-6f4e6d3c8d39\") " pod="openshift-monitoring/node-exporter-289mx" Jun 03 16:36:32.037317 ip-10-0-135-67 kubenswrapper[2568]: I0603 16:36:32.037259 2568 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/24de6081-0ed9-49d4-b2fa-6f4e6d3c8d39-node-exporter-wtmp\") pod \"node-exporter-289mx\" (UID: \"24de6081-0ed9-49d4-b2fa-6f4e6d3c8d39\") " pod="openshift-monitoring/node-exporter-289mx" Jun 03 16:36:32.037317 ip-10-0-135-67 kubenswrapper[2568]: I0603 16:36:32.037301 2568 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/f61b4ac6-d530-43f4-8f5f-c44f45455887-metrics-client-ca\") pod \"kube-state-metrics-8469c486bb-pkwds\" (UID: \"f61b4ac6-d530-43f4-8f5f-c44f45455887\") " pod="openshift-monitoring/kube-state-metrics-8469c486bb-pkwds" Jun 03 16:36:32.037412 ip-10-0-135-67 kubenswrapper[2568]: I0603 16:36:32.037328 2568 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-fbrwj\" (UniqueName: \"kubernetes.io/projected/f61b4ac6-d530-43f4-8f5f-c44f45455887-kube-api-access-fbrwj\") pod \"kube-state-metrics-8469c486bb-pkwds\" (UID: \"f61b4ac6-d530-43f4-8f5f-c44f45455887\") " pod="openshift-monitoring/kube-state-metrics-8469c486bb-pkwds" Jun 03 16:36:32.037412 ip-10-0-135-67 kubenswrapper[2568]: I0603 16:36:32.037360 2568 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"volume-directive-shadow\" (UniqueName: \"kubernetes.io/empty-dir/f61b4ac6-d530-43f4-8f5f-c44f45455887-volume-directive-shadow\") pod \"kube-state-metrics-8469c486bb-pkwds\" (UID: \"f61b4ac6-d530-43f4-8f5f-c44f45455887\") " pod="openshift-monitoring/kube-state-metrics-8469c486bb-pkwds" Jun 03 16:36:32.037412 ip-10-0-135-67 kubenswrapper[2568]: I0603 16:36:32.037394 2568 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/24de6081-0ed9-49d4-b2fa-6f4e6d3c8d39-node-exporter-tls\") pod \"node-exporter-289mx\" (UID: \"24de6081-0ed9-49d4-b2fa-6f4e6d3c8d39\") " pod="openshift-monitoring/node-exporter-289mx" Jun 03 16:36:32.037564 ip-10-0-135-67 kubenswrapper[2568]: I0603 16:36:32.037453 2568 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/24de6081-0ed9-49d4-b2fa-6f4e6d3c8d39-metrics-client-ca\") pod \"node-exporter-289mx\" (UID: \"24de6081-0ed9-49d4-b2fa-6f4e6d3c8d39\") " pod="openshift-monitoring/node-exporter-289mx" Jun 03 16:36:32.037564 ip-10-0-135-67 kubenswrapper[2568]: I0603 16:36:32.037484 2568 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"root\" (UniqueName: \"kubernetes.io/host-path/24de6081-0ed9-49d4-b2fa-6f4e6d3c8d39-root\") pod \"node-exporter-289mx\" (UID: \"24de6081-0ed9-49d4-b2fa-6f4e6d3c8d39\") " pod="openshift-monitoring/node-exporter-289mx" Jun 03 16:36:32.037564 ip-10-0-135-67 kubenswrapper[2568]: I0603 16:36:32.037519 2568 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-state-metrics-custom-resource-state-configmap\" (UniqueName: \"kubernetes.io/configmap/f61b4ac6-d530-43f4-8f5f-c44f45455887-kube-state-metrics-custom-resource-state-configmap\") pod \"kube-state-metrics-8469c486bb-pkwds\" (UID: \"f61b4ac6-d530-43f4-8f5f-c44f45455887\") " pod="openshift-monitoring/kube-state-metrics-8469c486bb-pkwds" Jun 03 16:36:32.037564 ip-10-0-135-67 kubenswrapper[2568]: I0603 16:36:32.037551 2568 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/24de6081-0ed9-49d4-b2fa-6f4e6d3c8d39-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-289mx\" (UID: \"24de6081-0ed9-49d4-b2fa-6f4e6d3c8d39\") " pod="openshift-monitoring/node-exporter-289mx" Jun 03 16:36:32.037747 ip-10-0-135-67 kubenswrapper[2568]: I0603 16:36:32.037599 2568 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/24de6081-0ed9-49d4-b2fa-6f4e6d3c8d39-sys\") pod \"node-exporter-289mx\" (UID: \"24de6081-0ed9-49d4-b2fa-6f4e6d3c8d39\") " pod="openshift-monitoring/node-exporter-289mx" Jun 03 16:36:32.037747 ip-10-0-135-67 kubenswrapper[2568]: I0603 16:36:32.037650 2568 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/24de6081-0ed9-49d4-b2fa-6f4e6d3c8d39-node-exporter-textfile\") pod \"node-exporter-289mx\" (UID: \"24de6081-0ed9-49d4-b2fa-6f4e6d3c8d39\") " pod="openshift-monitoring/node-exporter-289mx" Jun 03 16:36:32.037747 ip-10-0-135-67 kubenswrapper[2568]: I0603 16:36:32.037688 2568 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-5h6dv\" (UniqueName: \"kubernetes.io/projected/24de6081-0ed9-49d4-b2fa-6f4e6d3c8d39-kube-api-access-5h6dv\") pod \"node-exporter-289mx\" (UID: \"24de6081-0ed9-49d4-b2fa-6f4e6d3c8d39\") " pod="openshift-monitoring/node-exporter-289mx" Jun 03 16:36:32.037883 ip-10-0-135-67 kubenswrapper[2568]: I0603 16:36:32.037450 2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/24de6081-0ed9-49d4-b2fa-6f4e6d3c8d39-node-exporter-wtmp\") pod \"node-exporter-289mx\" (UID: \"24de6081-0ed9-49d4-b2fa-6f4e6d3c8d39\") " pod="openshift-monitoring/node-exporter-289mx" Jun 03 16:36:32.037883 ip-10-0-135-67 kubenswrapper[2568]: E0603 16:36:32.037850 2568 secret.go:189] Couldn't get secret openshift-monitoring/node-exporter-tls: secret "node-exporter-tls" not found Jun 03 16:36:32.037975 ip-10-0-135-67 kubenswrapper[2568]: E0603 16:36:32.037917 2568 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/24de6081-0ed9-49d4-b2fa-6f4e6d3c8d39-node-exporter-tls podName:24de6081-0ed9-49d4-b2fa-6f4e6d3c8d39 nodeName:}" failed. No retries permitted until 2026-06-03 16:36:32.537899368 +0000 UTC m=+164.680074008 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "node-exporter-tls" (UniqueName: "kubernetes.io/secret/24de6081-0ed9-49d4-b2fa-6f4e6d3c8d39-node-exporter-tls") pod "node-exporter-289mx" (UID: "24de6081-0ed9-49d4-b2fa-6f4e6d3c8d39") : secret "node-exporter-tls" not found Jun 03 16:36:32.038107 ip-10-0-135-67 kubenswrapper[2568]: I0603 16:36:32.038059 2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/f61b4ac6-d530-43f4-8f5f-c44f45455887-metrics-client-ca\") pod \"kube-state-metrics-8469c486bb-pkwds\" (UID: \"f61b4ac6-d530-43f4-8f5f-c44f45455887\") " pod="openshift-monitoring/kube-state-metrics-8469c486bb-pkwds" Jun 03 16:36:32.038166 ip-10-0-135-67 kubenswrapper[2568]: I0603 16:36:32.038099 2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/24de6081-0ed9-49d4-b2fa-6f4e6d3c8d39-sys\") pod \"node-exporter-289mx\" (UID: \"24de6081-0ed9-49d4-b2fa-6f4e6d3c8d39\") " pod="openshift-monitoring/node-exporter-289mx" Jun 03 16:36:32.038276 ip-10-0-135-67 kubenswrapper[2568]: I0603 16:36:32.038253 2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/24de6081-0ed9-49d4-b2fa-6f4e6d3c8d39-metrics-client-ca\") pod \"node-exporter-289mx\" (UID: \"24de6081-0ed9-49d4-b2fa-6f4e6d3c8d39\") " pod="openshift-monitoring/node-exporter-289mx" Jun 03 16:36:32.038342 ip-10-0-135-67 kubenswrapper[2568]: I0603 16:36:32.038317 2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"root\" (UniqueName: \"kubernetes.io/host-path/24de6081-0ed9-49d4-b2fa-6f4e6d3c8d39-root\") pod \"node-exporter-289mx\" (UID: \"24de6081-0ed9-49d4-b2fa-6f4e6d3c8d39\") " pod="openshift-monitoring/node-exporter-289mx" Jun 03 16:36:32.038389 ip-10-0-135-67 kubenswrapper[2568]: I0603 16:36:32.038345 2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"volume-directive-shadow\" (UniqueName: \"kubernetes.io/empty-dir/f61b4ac6-d530-43f4-8f5f-c44f45455887-volume-directive-shadow\") pod \"kube-state-metrics-8469c486bb-pkwds\" (UID: \"f61b4ac6-d530-43f4-8f5f-c44f45455887\") " pod="openshift-monitoring/kube-state-metrics-8469c486bb-pkwds" Jun 03 16:36:32.038441 ip-10-0-135-67 kubenswrapper[2568]: I0603 16:36:32.038382 2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/24de6081-0ed9-49d4-b2fa-6f4e6d3c8d39-node-exporter-textfile\") pod \"node-exporter-289mx\" (UID: \"24de6081-0ed9-49d4-b2fa-6f4e6d3c8d39\") " pod="openshift-monitoring/node-exporter-289mx" Jun 03 16:36:32.038681 ip-10-0-135-67 kubenswrapper[2568]: I0603 16:36:32.038638 2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-state-metrics-custom-resource-state-configmap\" (UniqueName: \"kubernetes.io/configmap/f61b4ac6-d530-43f4-8f5f-c44f45455887-kube-state-metrics-custom-resource-state-configmap\") pod \"kube-state-metrics-8469c486bb-pkwds\" (UID: \"f61b4ac6-d530-43f4-8f5f-c44f45455887\") " pod="openshift-monitoring/kube-state-metrics-8469c486bb-pkwds" Jun 03 16:36:32.040519 ip-10-0-135-67 kubenswrapper[2568]: I0603 16:36:32.040493 2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/f61b4ac6-d530-43f4-8f5f-c44f45455887-kube-state-metrics-tls\") pod \"kube-state-metrics-8469c486bb-pkwds\" (UID: \"f61b4ac6-d530-43f4-8f5f-c44f45455887\") " pod="openshift-monitoring/kube-state-metrics-8469c486bb-pkwds" Jun 03 16:36:32.040610 ip-10-0-135-67 kubenswrapper[2568]: I0603 16:36:32.040526 2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/24de6081-0ed9-49d4-b2fa-6f4e6d3c8d39-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-289mx\" (UID: \"24de6081-0ed9-49d4-b2fa-6f4e6d3c8d39\") " pod="openshift-monitoring/node-exporter-289mx" Jun 03 16:36:32.041165 ip-10-0-135-67 kubenswrapper[2568]: I0603 16:36:32.041141 2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-state-metrics-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/f61b4ac6-d530-43f4-8f5f-c44f45455887-kube-state-metrics-kube-rbac-proxy-config\") pod \"kube-state-metrics-8469c486bb-pkwds\" (UID: \"f61b4ac6-d530-43f4-8f5f-c44f45455887\") " pod="openshift-monitoring/kube-state-metrics-8469c486bb-pkwds" Jun 03 16:36:32.045595 ip-10-0-135-67 kubenswrapper[2568]: I0603 16:36:32.045559 2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-5h6dv\" (UniqueName: \"kubernetes.io/projected/24de6081-0ed9-49d4-b2fa-6f4e6d3c8d39-kube-api-access-5h6dv\") pod \"node-exporter-289mx\" (UID: \"24de6081-0ed9-49d4-b2fa-6f4e6d3c8d39\") " pod="openshift-monitoring/node-exporter-289mx" Jun 03 16:36:32.045989 ip-10-0-135-67 kubenswrapper[2568]: I0603 16:36:32.045955 2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-fbrwj\" (UniqueName: \"kubernetes.io/projected/f61b4ac6-d530-43f4-8f5f-c44f45455887-kube-api-access-fbrwj\") pod \"kube-state-metrics-8469c486bb-pkwds\" (UID: \"f61b4ac6-d530-43f4-8f5f-c44f45455887\") " pod="openshift-monitoring/kube-state-metrics-8469c486bb-pkwds" Jun 03 16:36:32.075808 ip-10-0-135-67 kubenswrapper[2568]: I0603 16:36:32.075780 2568 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/openshift-state-metrics-85658796db-trt8m" Jun 03 16:36:32.094772 ip-10-0-135-67 kubenswrapper[2568]: I0603 16:36:32.094720 2568 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/kube-state-metrics-8469c486bb-pkwds" Jun 03 16:36:32.544284 ip-10-0-135-67 kubenswrapper[2568]: I0603 16:36:32.543890 2568 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/24de6081-0ed9-49d4-b2fa-6f4e6d3c8d39-node-exporter-tls\") pod \"node-exporter-289mx\" (UID: \"24de6081-0ed9-49d4-b2fa-6f4e6d3c8d39\") " pod="openshift-monitoring/node-exporter-289mx" Jun 03 16:36:32.546842 ip-10-0-135-67 kubenswrapper[2568]: I0603 16:36:32.546821 2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/24de6081-0ed9-49d4-b2fa-6f4e6d3c8d39-node-exporter-tls\") pod \"node-exporter-289mx\" (UID: \"24de6081-0ed9-49d4-b2fa-6f4e6d3c8d39\") " pod="openshift-monitoring/node-exporter-289mx" Jun 03 16:36:32.706702 ip-10-0-135-67 kubenswrapper[2568]: I0603 16:36:32.706666 2568 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/node-exporter-289mx" Jun 03 16:36:32.869783 ip-10-0-135-67 kubenswrapper[2568]: I0603 16:36:32.869689 2568 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-monitoring/alertmanager-main-0"] Jun 03 16:36:32.873909 ip-10-0-135-67 kubenswrapper[2568]: I0603 16:36:32.873885 2568 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/alertmanager-main-0" Jun 03 16:36:32.875931 ip-10-0-135-67 kubenswrapper[2568]: I0603 16:36:32.875895 2568 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-cluster-tls-config\"" Jun 03 16:36:32.876133 ip-10-0-135-67 kubenswrapper[2568]: I0603 16:36:32.876109 2568 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-kube-rbac-proxy-web\"" Jun 03 16:36:32.876261 ip-10-0-135-67 kubenswrapper[2568]: I0603 16:36:32.876239 2568 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-dockercfg-zwgq4\"" Jun 03 16:36:32.876755 ip-10-0-135-67 kubenswrapper[2568]: I0603 16:36:32.876544 2568 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-tls-assets-0\"" Jun 03 16:36:32.876755 ip-10-0-135-67 kubenswrapper[2568]: I0603 16:36:32.876563 2568 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-generated\"" Jun 03 16:36:32.876755 ip-10-0-135-67 kubenswrapper[2568]: I0603 16:36:32.876563 2568 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"alertmanager-trusted-ca-bundle\"" Jun 03 16:36:32.876755 ip-10-0-135-67 kubenswrapper[2568]: I0603 16:36:32.876653 2568 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-tls\"" Jun 03 16:36:32.877032 ip-10-0-135-67 kubenswrapper[2568]: I0603 16:36:32.876865 2568 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-kube-rbac-proxy-metric\"" Jun 03 16:36:32.877132 ip-10-0-135-67 kubenswrapper[2568]: I0603 16:36:32.877113 2568 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-web-config\"" Jun 03 16:36:32.877513 ip-10-0-135-67 kubenswrapper[2568]: I0603 16:36:32.877494 2568 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-kube-rbac-proxy\"" Jun 03 16:36:32.893864 ip-10-0-135-67 kubenswrapper[2568]: I0603 16:36:32.893845 2568 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/alertmanager-main-0"] Jun 03 16:36:32.950527 ip-10-0-135-67 kubenswrapper[2568]: I0603 16:36:32.950495 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/3dc38f0d-f7bf-415b-a488-267c48ef13f3-secret-alertmanager-kube-rbac-proxy\") pod \"alertmanager-main-0\" (UID: \"3dc38f0d-f7bf-415b-a488-267c48ef13f3\") " pod="openshift-monitoring/alertmanager-main-0" Jun 03 16:36:32.950691 ip-10-0-135-67 kubenswrapper[2568]: I0603 16:36:32.950555 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/3dc38f0d-f7bf-415b-a488-267c48ef13f3-alertmanager-trusted-ca-bundle\") pod \"alertmanager-main-0\" (UID: \"3dc38f0d-f7bf-415b-a488-267c48ef13f3\") " pod="openshift-monitoring/alertmanager-main-0" Jun 03 16:36:32.950691 ip-10-0-135-67 kubenswrapper[2568]: I0603 16:36:32.950638 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/3dc38f0d-f7bf-415b-a488-267c48ef13f3-metrics-client-ca\") pod \"alertmanager-main-0\" (UID: \"3dc38f0d-f7bf-415b-a488-267c48ef13f3\") " pod="openshift-monitoring/alertmanager-main-0" Jun 03 16:36:32.950691 ip-10-0-135-67 kubenswrapper[2568]: I0603 16:36:32.950676 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/3dc38f0d-f7bf-415b-a488-267c48ef13f3-cluster-tls-config\") pod \"alertmanager-main-0\" (UID: \"3dc38f0d-f7bf-415b-a488-267c48ef13f3\") " pod="openshift-monitoring/alertmanager-main-0" Jun 03 16:36:32.950860 ip-10-0-135-67 kubenswrapper[2568]: I0603 16:36:32.950711 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/3dc38f0d-f7bf-415b-a488-267c48ef13f3-secret-alertmanager-kube-rbac-proxy-metric\") pod \"alertmanager-main-0\" (UID: \"3dc38f0d-f7bf-415b-a488-267c48ef13f3\") " pod="openshift-monitoring/alertmanager-main-0" Jun 03 16:36:32.950860 ip-10-0-135-67 kubenswrapper[2568]: I0603 16:36:32.950769 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/3dc38f0d-f7bf-415b-a488-267c48ef13f3-tls-assets\") pod \"alertmanager-main-0\" (UID: \"3dc38f0d-f7bf-415b-a488-267c48ef13f3\") " pod="openshift-monitoring/alertmanager-main-0" Jun 03 16:36:32.950960 ip-10-0-135-67 kubenswrapper[2568]: I0603 16:36:32.950872 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/3dc38f0d-f7bf-415b-a488-267c48ef13f3-secret-alertmanager-kube-rbac-proxy-web\") pod \"alertmanager-main-0\" (UID: \"3dc38f0d-f7bf-415b-a488-267c48ef13f3\") " pod="openshift-monitoring/alertmanager-main-0" Jun 03 16:36:32.950960 ip-10-0-135-67 kubenswrapper[2568]: I0603 16:36:32.950937 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/3dc38f0d-f7bf-415b-a488-267c48ef13f3-config-volume\") pod \"alertmanager-main-0\" (UID: \"3dc38f0d-f7bf-415b-a488-267c48ef13f3\") " pod="openshift-monitoring/alertmanager-main-0" Jun 03 16:36:32.951097 ip-10-0-135-67 kubenswrapper[2568]: I0603 16:36:32.950963 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/3dc38f0d-f7bf-415b-a488-267c48ef13f3-web-config\") pod \"alertmanager-main-0\" (UID: \"3dc38f0d-f7bf-415b-a488-267c48ef13f3\") " pod="openshift-monitoring/alertmanager-main-0" Jun 03 16:36:32.951097 ip-10-0-135-67 kubenswrapper[2568]: I0603 16:36:32.950993 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/3dc38f0d-f7bf-415b-a488-267c48ef13f3-secret-alertmanager-main-tls\") pod \"alertmanager-main-0\" (UID: \"3dc38f0d-f7bf-415b-a488-267c48ef13f3\") " pod="openshift-monitoring/alertmanager-main-0" Jun 03 16:36:32.951097 ip-10-0-135-67 kubenswrapper[2568]: I0603 16:36:32.951060 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/3dc38f0d-f7bf-415b-a488-267c48ef13f3-config-out\") pod \"alertmanager-main-0\" (UID: \"3dc38f0d-f7bf-415b-a488-267c48ef13f3\") " pod="openshift-monitoring/alertmanager-main-0" Jun 03 16:36:32.951097 ip-10-0-135-67 kubenswrapper[2568]: I0603 16:36:32.951087 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/3dc38f0d-f7bf-415b-a488-267c48ef13f3-alertmanager-main-db\") pod \"alertmanager-main-0\" (UID: \"3dc38f0d-f7bf-415b-a488-267c48ef13f3\") " pod="openshift-monitoring/alertmanager-main-0" Jun 03 16:36:32.951406 ip-10-0-135-67 kubenswrapper[2568]: I0603 16:36:32.951118 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-hcps9\" (UniqueName: \"kubernetes.io/projected/3dc38f0d-f7bf-415b-a488-267c48ef13f3-kube-api-access-hcps9\") pod \"alertmanager-main-0\" (UID: \"3dc38f0d-f7bf-415b-a488-267c48ef13f3\") " pod="openshift-monitoring/alertmanager-main-0" Jun 03 16:36:33.052118 ip-10-0-135-67 kubenswrapper[2568]: I0603 16:36:33.051713 2568 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/3dc38f0d-f7bf-415b-a488-267c48ef13f3-web-config\") pod \"alertmanager-main-0\" (UID: \"3dc38f0d-f7bf-415b-a488-267c48ef13f3\") " pod="openshift-monitoring/alertmanager-main-0" Jun 03 16:36:33.052118 ip-10-0-135-67 kubenswrapper[2568]: I0603 16:36:33.051768 2568 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/3dc38f0d-f7bf-415b-a488-267c48ef13f3-secret-alertmanager-main-tls\") pod \"alertmanager-main-0\" (UID: \"3dc38f0d-f7bf-415b-a488-267c48ef13f3\") " pod="openshift-monitoring/alertmanager-main-0" Jun 03 16:36:33.052118 ip-10-0-135-67 kubenswrapper[2568]: I0603 16:36:33.051806 2568 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/3dc38f0d-f7bf-415b-a488-267c48ef13f3-config-out\") pod \"alertmanager-main-0\" (UID: \"3dc38f0d-f7bf-415b-a488-267c48ef13f3\") " pod="openshift-monitoring/alertmanager-main-0" Jun 03 16:36:33.052118 ip-10-0-135-67 kubenswrapper[2568]: I0603 16:36:33.051833 2568 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/3dc38f0d-f7bf-415b-a488-267c48ef13f3-alertmanager-main-db\") pod \"alertmanager-main-0\" (UID: \"3dc38f0d-f7bf-415b-a488-267c48ef13f3\") " pod="openshift-monitoring/alertmanager-main-0" Jun 03 16:36:33.052118 ip-10-0-135-67 kubenswrapper[2568]: I0603 16:36:33.051870 2568 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-hcps9\" (UniqueName: \"kubernetes.io/projected/3dc38f0d-f7bf-415b-a488-267c48ef13f3-kube-api-access-hcps9\") pod \"alertmanager-main-0\" (UID: \"3dc38f0d-f7bf-415b-a488-267c48ef13f3\") " pod="openshift-monitoring/alertmanager-main-0" Jun 03 16:36:33.052118 ip-10-0-135-67 kubenswrapper[2568]: I0603 16:36:33.051924 2568 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/3dc38f0d-f7bf-415b-a488-267c48ef13f3-secret-alertmanager-kube-rbac-proxy\") pod \"alertmanager-main-0\" (UID: \"3dc38f0d-f7bf-415b-a488-267c48ef13f3\") " pod="openshift-monitoring/alertmanager-main-0" Jun 03 16:36:33.052118 ip-10-0-135-67 kubenswrapper[2568]: I0603 16:36:33.051974 2568 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/3dc38f0d-f7bf-415b-a488-267c48ef13f3-alertmanager-trusted-ca-bundle\") pod \"alertmanager-main-0\" (UID: \"3dc38f0d-f7bf-415b-a488-267c48ef13f3\") " pod="openshift-monitoring/alertmanager-main-0" Jun 03 16:36:33.052118 ip-10-0-135-67 kubenswrapper[2568]: I0603 16:36:33.052044 2568 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/3dc38f0d-f7bf-415b-a488-267c48ef13f3-metrics-client-ca\") pod \"alertmanager-main-0\" (UID: \"3dc38f0d-f7bf-415b-a488-267c48ef13f3\") " pod="openshift-monitoring/alertmanager-main-0" Jun 03 16:36:33.052604 ip-10-0-135-67 kubenswrapper[2568]: E0603 16:36:33.052509 2568 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/3dc38f0d-f7bf-415b-a488-267c48ef13f3-alertmanager-trusted-ca-bundle podName:3dc38f0d-f7bf-415b-a488-267c48ef13f3 nodeName:}" failed. No retries permitted until 2026-06-03 16:36:33.552486692 +0000 UTC m=+165.694661339 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "alertmanager-trusted-ca-bundle" (UniqueName: "kubernetes.io/configmap/3dc38f0d-f7bf-415b-a488-267c48ef13f3-alertmanager-trusted-ca-bundle") pod "alertmanager-main-0" (UID: "3dc38f0d-f7bf-415b-a488-267c48ef13f3") : configmap references non-existent config key: ca-bundle.crt Jun 03 16:36:33.052604 ip-10-0-135-67 kubenswrapper[2568]: I0603 16:36:33.052508 2568 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/3dc38f0d-f7bf-415b-a488-267c48ef13f3-cluster-tls-config\") pod \"alertmanager-main-0\" (UID: \"3dc38f0d-f7bf-415b-a488-267c48ef13f3\") " pod="openshift-monitoring/alertmanager-main-0" Jun 03 16:36:33.052604 ip-10-0-135-67 kubenswrapper[2568]: I0603 16:36:33.052564 2568 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/3dc38f0d-f7bf-415b-a488-267c48ef13f3-secret-alertmanager-kube-rbac-proxy-metric\") pod \"alertmanager-main-0\" (UID: \"3dc38f0d-f7bf-415b-a488-267c48ef13f3\") " pod="openshift-monitoring/alertmanager-main-0" Jun 03 16:36:33.052767 ip-10-0-135-67 kubenswrapper[2568]: I0603 16:36:33.052617 2568 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/3dc38f0d-f7bf-415b-a488-267c48ef13f3-tls-assets\") pod \"alertmanager-main-0\" (UID: \"3dc38f0d-f7bf-415b-a488-267c48ef13f3\") " pod="openshift-monitoring/alertmanager-main-0" Jun 03 16:36:33.052767 ip-10-0-135-67 kubenswrapper[2568]: I0603 16:36:33.052668 2568 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/3dc38f0d-f7bf-415b-a488-267c48ef13f3-secret-alertmanager-kube-rbac-proxy-web\") pod \"alertmanager-main-0\" (UID: \"3dc38f0d-f7bf-415b-a488-267c48ef13f3\") " pod="openshift-monitoring/alertmanager-main-0" Jun 03 16:36:33.052767 ip-10-0-135-67 kubenswrapper[2568]: I0603 16:36:33.052717 2568 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/3dc38f0d-f7bf-415b-a488-267c48ef13f3-config-volume\") pod \"alertmanager-main-0\" (UID: \"3dc38f0d-f7bf-415b-a488-267c48ef13f3\") " pod="openshift-monitoring/alertmanager-main-0" Jun 03 16:36:33.053587 ip-10-0-135-67 kubenswrapper[2568]: I0603 16:36:33.053264 2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/3dc38f0d-f7bf-415b-a488-267c48ef13f3-alertmanager-main-db\") pod \"alertmanager-main-0\" (UID: \"3dc38f0d-f7bf-415b-a488-267c48ef13f3\") " pod="openshift-monitoring/alertmanager-main-0" Jun 03 16:36:33.053587 ip-10-0-135-67 kubenswrapper[2568]: I0603 16:36:33.053567 2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/3dc38f0d-f7bf-415b-a488-267c48ef13f3-metrics-client-ca\") pod \"alertmanager-main-0\" (UID: \"3dc38f0d-f7bf-415b-a488-267c48ef13f3\") " pod="openshift-monitoring/alertmanager-main-0" Jun 03 16:36:33.057694 ip-10-0-135-67 kubenswrapper[2568]: I0603 16:36:33.056856 2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/3dc38f0d-f7bf-415b-a488-267c48ef13f3-secret-alertmanager-kube-rbac-proxy-metric\") pod \"alertmanager-main-0\" (UID: \"3dc38f0d-f7bf-415b-a488-267c48ef13f3\") " pod="openshift-monitoring/alertmanager-main-0" Jun 03 16:36:33.057694 ip-10-0-135-67 kubenswrapper[2568]: I0603 16:36:33.057258 2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/3dc38f0d-f7bf-415b-a488-267c48ef13f3-secret-alertmanager-kube-rbac-proxy\") pod \"alertmanager-main-0\" (UID: \"3dc38f0d-f7bf-415b-a488-267c48ef13f3\") " pod="openshift-monitoring/alertmanager-main-0" Jun 03 16:36:33.057694 ip-10-0-135-67 kubenswrapper[2568]: I0603 16:36:33.057528 2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/3dc38f0d-f7bf-415b-a488-267c48ef13f3-secret-alertmanager-kube-rbac-proxy-web\") pod \"alertmanager-main-0\" (UID: \"3dc38f0d-f7bf-415b-a488-267c48ef13f3\") " pod="openshift-monitoring/alertmanager-main-0" Jun 03 16:36:33.058356 ip-10-0-135-67 kubenswrapper[2568]: I0603 16:36:33.058316 2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/3dc38f0d-f7bf-415b-a488-267c48ef13f3-cluster-tls-config\") pod \"alertmanager-main-0\" (UID: \"3dc38f0d-f7bf-415b-a488-267c48ef13f3\") " pod="openshift-monitoring/alertmanager-main-0" Jun 03 16:36:33.058443 ip-10-0-135-67 kubenswrapper[2568]: I0603 16:36:33.058369 2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/3dc38f0d-f7bf-415b-a488-267c48ef13f3-config-out\") pod \"alertmanager-main-0\" (UID: \"3dc38f0d-f7bf-415b-a488-267c48ef13f3\") " pod="openshift-monitoring/alertmanager-main-0" Jun 03 16:36:33.059185 ip-10-0-135-67 kubenswrapper[2568]: I0603 16:36:33.059135 2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/3dc38f0d-f7bf-415b-a488-267c48ef13f3-web-config\") pod \"alertmanager-main-0\" (UID: \"3dc38f0d-f7bf-415b-a488-267c48ef13f3\") " pod="openshift-monitoring/alertmanager-main-0" Jun 03 16:36:33.060647 ip-10-0-135-67 kubenswrapper[2568]: I0603 16:36:33.060602 2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/3dc38f0d-f7bf-415b-a488-267c48ef13f3-config-volume\") pod \"alertmanager-main-0\" (UID: \"3dc38f0d-f7bf-415b-a488-267c48ef13f3\") " pod="openshift-monitoring/alertmanager-main-0" Jun 03 16:36:33.061399 ip-10-0-135-67 kubenswrapper[2568]: I0603 16:36:33.061355 2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/3dc38f0d-f7bf-415b-a488-267c48ef13f3-tls-assets\") pod \"alertmanager-main-0\" (UID: \"3dc38f0d-f7bf-415b-a488-267c48ef13f3\") " pod="openshift-monitoring/alertmanager-main-0" Jun 03 16:36:33.061576 ip-10-0-135-67 kubenswrapper[2568]: I0603 16:36:33.061553 2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-hcps9\" (UniqueName: \"kubernetes.io/projected/3dc38f0d-f7bf-415b-a488-267c48ef13f3-kube-api-access-hcps9\") pod \"alertmanager-main-0\" (UID: \"3dc38f0d-f7bf-415b-a488-267c48ef13f3\") " pod="openshift-monitoring/alertmanager-main-0" Jun 03 16:36:33.061649 ip-10-0-135-67 kubenswrapper[2568]: I0603 16:36:33.061615 2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/3dc38f0d-f7bf-415b-a488-267c48ef13f3-secret-alertmanager-main-tls\") pod \"alertmanager-main-0\" (UID: \"3dc38f0d-f7bf-415b-a488-267c48ef13f3\") " pod="openshift-monitoring/alertmanager-main-0" Jun 03 16:36:33.339548 ip-10-0-135-67 kubenswrapper[2568]: I0603 16:36:33.339507 2568 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-console/console-b7bc65d87-nsc2l" Jun 03 16:36:33.339725 ip-10-0-135-67 kubenswrapper[2568]: I0603 16:36:33.339598 2568 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/console-b7bc65d87-nsc2l" Jun 03 16:36:33.341105 ip-10-0-135-67 kubenswrapper[2568]: I0603 16:36:33.341076 2568 patch_prober.go:28] interesting pod/console-b7bc65d87-nsc2l container/console namespace/openshift-console: Startup probe status=failure output="Get \"https://10.132.0.16:8443/health\": dial tcp 10.132.0.16:8443: connect: connection refused" start-of-body= Jun 03 16:36:33.341230 ip-10-0-135-67 kubenswrapper[2568]: I0603 16:36:33.341124 2568 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-console/console-b7bc65d87-nsc2l" podUID="65ec0a70-0b84-48c2-bbc9-bde3b6880feb" containerName="console" probeResult="failure" output="Get \"https://10.132.0.16:8443/health\": dial tcp 10.132.0.16:8443: connect: connection refused" Jun 03 16:36:33.557649 ip-10-0-135-67 kubenswrapper[2568]: I0603 16:36:33.557610 2568 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/3dc38f0d-f7bf-415b-a488-267c48ef13f3-alertmanager-trusted-ca-bundle\") pod \"alertmanager-main-0\" (UID: \"3dc38f0d-f7bf-415b-a488-267c48ef13f3\") " pod="openshift-monitoring/alertmanager-main-0" Jun 03 16:36:33.558527 ip-10-0-135-67 kubenswrapper[2568]: I0603 16:36:33.558502 2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/3dc38f0d-f7bf-415b-a488-267c48ef13f3-alertmanager-trusted-ca-bundle\") pod \"alertmanager-main-0\" (UID: \"3dc38f0d-f7bf-415b-a488-267c48ef13f3\") " pod="openshift-monitoring/alertmanager-main-0" Jun 03 16:36:33.792495 ip-10-0-135-67 kubenswrapper[2568]: I0603 16:36:33.792446 2568 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/alertmanager-main-0" Jun 03 16:36:34.568083 ip-10-0-135-67 kubenswrapper[2568]: I0603 16:36:34.568047 2568 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/1adc570a-c47f-4bc0-a3f5-a7e90c775e3a-registry-tls\") pod \"image-registry-74745bdc9c-rk4cq\" (UID: \"1adc570a-c47f-4bc0-a3f5-a7e90c775e3a\") " pod="openshift-image-registry/image-registry-74745bdc9c-rk4cq" Jun 03 16:36:34.568513 ip-10-0-135-67 kubenswrapper[2568]: I0603 16:36:34.568158 2568 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/0f3a9c08-8974-46c9-9245-fbfc1a73e96c-metrics-tls\") pod \"dns-default-tn2hz\" (UID: \"0f3a9c08-8974-46c9-9245-fbfc1a73e96c\") " pod="openshift-dns/dns-default-tn2hz" Jun 03 16:36:34.570978 ip-10-0-135-67 kubenswrapper[2568]: I0603 16:36:34.570936 2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/0f3a9c08-8974-46c9-9245-fbfc1a73e96c-metrics-tls\") pod \"dns-default-tn2hz\" (UID: \"0f3a9c08-8974-46c9-9245-fbfc1a73e96c\") " pod="openshift-dns/dns-default-tn2hz" Jun 03 16:36:34.571168 ip-10-0-135-67 kubenswrapper[2568]: I0603 16:36:34.571144 2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/1adc570a-c47f-4bc0-a3f5-a7e90c775e3a-registry-tls\") pod \"image-registry-74745bdc9c-rk4cq\" (UID: \"1adc570a-c47f-4bc0-a3f5-a7e90c775e3a\") " pod="openshift-image-registry/image-registry-74745bdc9c-rk4cq" Jun 03 16:36:34.669535 ip-10-0-135-67 kubenswrapper[2568]: I0603 16:36:34.669356 2568 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/7839d8fc-3e8c-481e-93f6-5e2eb79ee81f-cert\") pod \"ingress-canary-mjr7l\" (UID: \"7839d8fc-3e8c-481e-93f6-5e2eb79ee81f\") " pod="openshift-ingress-canary/ingress-canary-mjr7l" Jun 03 16:36:34.672195 ip-10-0-135-67 kubenswrapper[2568]: I0603 16:36:34.672161 2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/7839d8fc-3e8c-481e-93f6-5e2eb79ee81f-cert\") pod \"ingress-canary-mjr7l\" (UID: \"7839d8fc-3e8c-481e-93f6-5e2eb79ee81f\") " pod="openshift-ingress-canary/ingress-canary-mjr7l" Jun 03 16:36:34.688767 ip-10-0-135-67 kubenswrapper[2568]: I0603 16:36:34.688740 2568 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-dockercfg-6d9kw\"" Jun 03 16:36:34.697290 ip-10-0-135-67 kubenswrapper[2568]: I0603 16:36:34.697229 2568 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-tn2hz" Jun 03 16:36:38.660719 ip-10-0-135-67 kubenswrapper[2568]: W0603 16:36:38.659962 2568 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod24de6081_0ed9_49d4_b2fa_6f4e6d3c8d39.slice/crio-efee930087256756bcca393bcd39fd367bfd21fffcb82ff4e96f97d77bca06ae WatchSource:0}: Error finding container efee930087256756bcca393bcd39fd367bfd21fffcb82ff4e96f97d77bca06ae: Status 404 returned error can't find the container with id efee930087256756bcca393bcd39fd367bfd21fffcb82ff4e96f97d77bca06ae Jun 03 16:36:38.804660 ip-10-0-135-67 kubenswrapper[2568]: I0603 16:36:38.804633 2568 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/openshift-state-metrics-85658796db-trt8m"] Jun 03 16:36:38.809132 ip-10-0-135-67 kubenswrapper[2568]: W0603 16:36:38.809101 2568 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod674fabaf_399c_4cec_8f61_c9e1c778f57b.slice/crio-869a68dbf81d5561547245b9ba6278b8f0db8449a804cc7c413094545e400c19 WatchSource:0}: Error finding container 869a68dbf81d5561547245b9ba6278b8f0db8449a804cc7c413094545e400c19: Status 404 returned error can't find the container with id 869a68dbf81d5561547245b9ba6278b8f0db8449a804cc7c413094545e400c19 Jun 03 16:36:38.836638 ip-10-0-135-67 kubenswrapper[2568]: I0603 16:36:38.836609 2568 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/alertmanager-main-0"] Jun 03 16:36:38.838426 ip-10-0-135-67 kubenswrapper[2568]: W0603 16:36:38.838395 2568 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod3dc38f0d_f7bf_415b_a488_267c48ef13f3.slice/crio-7d7eb9ea892f1c92a5d4a54642b01f0c73dc29a60ae36cad5892b397d6a0500b WatchSource:0}: Error finding container 7d7eb9ea892f1c92a5d4a54642b01f0c73dc29a60ae36cad5892b397d6a0500b: Status 404 returned error can't find the container with id 7d7eb9ea892f1c92a5d4a54642b01f0c73dc29a60ae36cad5892b397d6a0500b Jun 03 16:36:38.913414 ip-10-0-135-67 kubenswrapper[2568]: I0603 16:36:38.913382 2568 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-console/downloads-c65b8dc4b-rwv6s" event={"ID":"f8c27eb0-19f6-4e05-b152-cada0ca804ed","Type":"ContainerStarted","Data":"35478fa79236f62106faacaa52f0a456080b49ea1ad4f9c1cf19381b83145f6a"} Jun 03 16:36:38.913620 ip-10-0-135-67 kubenswrapper[2568]: I0603 16:36:38.913601 2568 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/downloads-c65b8dc4b-rwv6s" Jun 03 16:36:38.914695 ip-10-0-135-67 kubenswrapper[2568]: I0603 16:36:38.914671 2568 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"3dc38f0d-f7bf-415b-a488-267c48ef13f3","Type":"ContainerStarted","Data":"7d7eb9ea892f1c92a5d4a54642b01f0c73dc29a60ae36cad5892b397d6a0500b"} Jun 03 16:36:38.915147 ip-10-0-135-67 kubenswrapper[2568]: I0603 16:36:38.915125 2568 patch_prober.go:28] interesting pod/downloads-c65b8dc4b-rwv6s container/download-server namespace/openshift-console: Readiness probe status=failure output="Get \"http://10.132.0.15:8080/\": dial tcp 10.132.0.15:8080: connect: connection refused" start-of-body= Jun 03 16:36:38.915233 ip-10-0-135-67 kubenswrapper[2568]: I0603 16:36:38.915164 2568 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-console/downloads-c65b8dc4b-rwv6s" podUID="f8c27eb0-19f6-4e05-b152-cada0ca804ed" containerName="download-server" probeResult="failure" output="Get \"http://10.132.0.15:8080/\": dial tcp 10.132.0.15:8080: connect: connection refused" Jun 03 16:36:38.915887 ip-10-0-135-67 kubenswrapper[2568]: I0603 16:36:38.915852 2568 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-289mx" event={"ID":"24de6081-0ed9-49d4-b2fa-6f4e6d3c8d39","Type":"ContainerStarted","Data":"efee930087256756bcca393bcd39fd367bfd21fffcb82ff4e96f97d77bca06ae"} Jun 03 16:36:38.917307 ip-10-0-135-67 kubenswrapper[2568]: I0603 16:36:38.917286 2568 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/openshift-state-metrics-85658796db-trt8m" event={"ID":"674fabaf-399c-4cec-8f61-c9e1c778f57b","Type":"ContainerStarted","Data":"2177bd72775a763aec3f5c68aec98e6cf7783757947fba9c7a90a40f7401b152"} Jun 03 16:36:38.917401 ip-10-0-135-67 kubenswrapper[2568]: I0603 16:36:38.917312 2568 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/openshift-state-metrics-85658796db-trt8m" event={"ID":"674fabaf-399c-4cec-8f61-c9e1c778f57b","Type":"ContainerStarted","Data":"869a68dbf81d5561547245b9ba6278b8f0db8449a804cc7c413094545e400c19"} Jun 03 16:36:38.929497 ip-10-0-135-67 kubenswrapper[2568]: I0603 16:36:38.929451 2568 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-console/downloads-c65b8dc4b-rwv6s" podStartSLOduration=1.069245329 podStartE2EDuration="21.92943772s" podCreationTimestamp="2026-06-03 16:36:17 +0000 UTC" firstStartedPulling="2026-06-03 16:36:17.865532456 +0000 UTC m=+150.007707089" lastFinishedPulling="2026-06-03 16:36:38.725724836 +0000 UTC m=+170.867899480" observedRunningTime="2026-06-03 16:36:38.927872145 +0000 UTC m=+171.070046799" watchObservedRunningTime="2026-06-03 16:36:38.92943772 +0000 UTC m=+171.071612375" Jun 03 16:36:39.063331 ip-10-0-135-67 kubenswrapper[2568]: I0603 16:36:39.063145 2568 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/kube-state-metrics-8469c486bb-pkwds"] Jun 03 16:36:39.066052 ip-10-0-135-67 kubenswrapper[2568]: I0603 16:36:39.065991 2568 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-dns/dns-default-tn2hz"] Jun 03 16:36:39.066831 ip-10-0-135-67 kubenswrapper[2568]: W0603 16:36:39.066803 2568 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podf61b4ac6_d530_43f4_8f5f_c44f45455887.slice/crio-d9ade7fbecb01a0beb8b05e1a223461d1e8301e92940b5acb79a741ac248c432 WatchSource:0}: Error finding container d9ade7fbecb01a0beb8b05e1a223461d1e8301e92940b5acb79a741ac248c432: Status 404 returned error can't find the container with id d9ade7fbecb01a0beb8b05e1a223461d1e8301e92940b5acb79a741ac248c432 Jun 03 16:36:39.069488 ip-10-0-135-67 kubenswrapper[2568]: W0603 16:36:39.069455 2568 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod0f3a9c08_8974_46c9_9245_fbfc1a73e96c.slice/crio-cafdbea1b856ba8694babd07b7a9967afe1a8ec2ecc4b80514284c62e59e5245 WatchSource:0}: Error finding container cafdbea1b856ba8694babd07b7a9967afe1a8ec2ecc4b80514284c62e59e5245: Status 404 returned error can't find the container with id cafdbea1b856ba8694babd07b7a9967afe1a8ec2ecc4b80514284c62e59e5245 Jun 03 16:36:39.927837 ip-10-0-135-67 kubenswrapper[2568]: I0603 16:36:39.927749 2568 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-tn2hz" event={"ID":"0f3a9c08-8974-46c9-9245-fbfc1a73e96c","Type":"ContainerStarted","Data":"cafdbea1b856ba8694babd07b7a9967afe1a8ec2ecc4b80514284c62e59e5245"} Jun 03 16:36:39.931274 ip-10-0-135-67 kubenswrapper[2568]: I0603 16:36:39.930518 2568 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-289mx" event={"ID":"24de6081-0ed9-49d4-b2fa-6f4e6d3c8d39","Type":"ContainerStarted","Data":"966905d1d8f70a82c3e750656012191289a323e0b3d6a6ff01392c3207d30c39"} Jun 03 16:36:39.935926 ip-10-0-135-67 kubenswrapper[2568]: I0603 16:36:39.935878 2568 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/openshift-state-metrics-85658796db-trt8m" event={"ID":"674fabaf-399c-4cec-8f61-c9e1c778f57b","Type":"ContainerStarted","Data":"003ce4cf73b1b22d97d894c536ec90e233d8eadf85291297019d0124d7429a6e"} Jun 03 16:36:39.940098 ip-10-0-135-67 kubenswrapper[2568]: I0603 16:36:39.940049 2568 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/kube-state-metrics-8469c486bb-pkwds" event={"ID":"f61b4ac6-d530-43f4-8f5f-c44f45455887","Type":"ContainerStarted","Data":"d9ade7fbecb01a0beb8b05e1a223461d1e8301e92940b5acb79a741ac248c432"} Jun 03 16:36:39.953961 ip-10-0-135-67 kubenswrapper[2568]: I0603 16:36:39.953771 2568 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console/downloads-c65b8dc4b-rwv6s" Jun 03 16:36:40.945333 ip-10-0-135-67 kubenswrapper[2568]: I0603 16:36:40.945290 2568 generic.go:358] "Generic (PLEG): container finished" podID="24de6081-0ed9-49d4-b2fa-6f4e6d3c8d39" containerID="966905d1d8f70a82c3e750656012191289a323e0b3d6a6ff01392c3207d30c39" exitCode=0 Jun 03 16:36:40.945873 ip-10-0-135-67 kubenswrapper[2568]: I0603 16:36:40.945409 2568 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-289mx" event={"ID":"24de6081-0ed9-49d4-b2fa-6f4e6d3c8d39","Type":"ContainerDied","Data":"966905d1d8f70a82c3e750656012191289a323e0b3d6a6ff01392c3207d30c39"} Jun 03 16:36:41.630933 ip-10-0-135-67 kubenswrapper[2568]: I0603 16:36:41.630894 2568 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openshift-console/console-b7bc65d87-nsc2l"] Jun 03 16:36:42.405796 ip-10-0-135-67 kubenswrapper[2568]: I0603 16:36:42.405753 2568 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-74745bdc9c-rk4cq" Jun 03 16:36:42.408298 ip-10-0-135-67 kubenswrapper[2568]: I0603 16:36:42.408263 2568 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"registry-dockercfg-pccbg\"" Jun 03 16:36:42.417096 ip-10-0-135-67 kubenswrapper[2568]: I0603 16:36:42.417068 2568 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-74745bdc9c-rk4cq" Jun 03 16:36:42.687061 ip-10-0-135-67 kubenswrapper[2568]: I0603 16:36:42.686829 2568 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-image-registry/image-registry-74745bdc9c-rk4cq"] Jun 03 16:36:42.691352 ip-10-0-135-67 kubenswrapper[2568]: W0603 16:36:42.691242 2568 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod1adc570a_c47f_4bc0_a3f5_a7e90c775e3a.slice/crio-6d4633376cfe83682c8907ddf67aaa1d572550029286048738d4fb7fffbb11cb WatchSource:0}: Error finding container 6d4633376cfe83682c8907ddf67aaa1d572550029286048738d4fb7fffbb11cb: Status 404 returned error can't find the container with id 6d4633376cfe83682c8907ddf67aaa1d572550029286048738d4fb7fffbb11cb Jun 03 16:36:42.958842 ip-10-0-135-67 kubenswrapper[2568]: I0603 16:36:42.958654 2568 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-74745bdc9c-rk4cq" event={"ID":"1adc570a-c47f-4bc0-a3f5-a7e90c775e3a","Type":"ContainerStarted","Data":"d072546afec63ec921bcf08ce19ac742bfff3fe3987effc9cddf55245a71b755"} Jun 03 16:36:42.958842 ip-10-0-135-67 kubenswrapper[2568]: I0603 16:36:42.958699 2568 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-74745bdc9c-rk4cq" event={"ID":"1adc570a-c47f-4bc0-a3f5-a7e90c775e3a","Type":"ContainerStarted","Data":"6d4633376cfe83682c8907ddf67aaa1d572550029286048738d4fb7fffbb11cb"} Jun 03 16:36:42.959527 ip-10-0-135-67 kubenswrapper[2568]: I0603 16:36:42.959488 2568 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-image-registry/image-registry-74745bdc9c-rk4cq" Jun 03 16:36:42.961024 ip-10-0-135-67 kubenswrapper[2568]: I0603 16:36:42.960959 2568 generic.go:358] "Generic (PLEG): container finished" podID="3dc38f0d-f7bf-415b-a488-267c48ef13f3" containerID="52535e598fcfb94eb6dc052913c68ae937696c7a580a2e0d66c17ea5ae636caf" exitCode=0 Jun 03 16:36:42.962805 ip-10-0-135-67 kubenswrapper[2568]: I0603 16:36:42.962761 2568 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"3dc38f0d-f7bf-415b-a488-267c48ef13f3","Type":"ContainerDied","Data":"52535e598fcfb94eb6dc052913c68ae937696c7a580a2e0d66c17ea5ae636caf"} Jun 03 16:36:42.964834 ip-10-0-135-67 kubenswrapper[2568]: I0603 16:36:42.964637 2568 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/kube-state-metrics-8469c486bb-pkwds" event={"ID":"f61b4ac6-d530-43f4-8f5f-c44f45455887","Type":"ContainerStarted","Data":"fbff54bc8e6bca00265adb625e2126eac1fd0eae2c10fb64771ab9a471e78949"} Jun 03 16:36:42.964834 ip-10-0-135-67 kubenswrapper[2568]: I0603 16:36:42.964662 2568 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/kube-state-metrics-8469c486bb-pkwds" event={"ID":"f61b4ac6-d530-43f4-8f5f-c44f45455887","Type":"ContainerStarted","Data":"b51e7ad62f29efee1a481d2c4b019d3b0e8f23b1468733ab771c37ca058a49d2"} Jun 03 16:36:42.967816 ip-10-0-135-67 kubenswrapper[2568]: I0603 16:36:42.967271 2568 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/openshift-state-metrics-85658796db-trt8m" event={"ID":"674fabaf-399c-4cec-8f61-c9e1c778f57b","Type":"ContainerStarted","Data":"3b411d6127537e87802fb6bb304e02798f31a013cb2c55445ce1813401624095"} Jun 03 16:36:42.969306 ip-10-0-135-67 kubenswrapper[2568]: I0603 16:36:42.969259 2568 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-tn2hz" event={"ID":"0f3a9c08-8974-46c9-9245-fbfc1a73e96c","Type":"ContainerStarted","Data":"0208ddb2164bd62e59eabd332a5ec2ab2c1efa83b0b0cce04f897fc341d2828f"} Jun 03 16:36:42.982324 ip-10-0-135-67 kubenswrapper[2568]: I0603 16:36:42.978920 2568 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-image-registry/image-registry-74745bdc9c-rk4cq" podStartSLOduration=173.978905522 podStartE2EDuration="2m53.978905522s" podCreationTimestamp="2026-06-03 16:33:49 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2026-06-03 16:36:42.976839969 +0000 UTC m=+175.119014624" watchObservedRunningTime="2026-06-03 16:36:42.978905522 +0000 UTC m=+175.121080177" Jun 03 16:36:42.990052 ip-10-0-135-67 kubenswrapper[2568]: I0603 16:36:42.989884 2568 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-289mx" event={"ID":"24de6081-0ed9-49d4-b2fa-6f4e6d3c8d39","Type":"ContainerStarted","Data":"38a5b988bea83bea65ed831f69c937922e4d34e448628d86028e74dd021f1e9e"} Jun 03 16:36:42.990052 ip-10-0-135-67 kubenswrapper[2568]: I0603 16:36:42.989935 2568 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-289mx" event={"ID":"24de6081-0ed9-49d4-b2fa-6f4e6d3c8d39","Type":"ContainerStarted","Data":"05e63cdad3bb8148897ff2249420ed1d4642e6c5a6d5db4e6af3f186ced49281"} Jun 03 16:36:43.030811 ip-10-0-135-67 kubenswrapper[2568]: I0603 16:36:43.028704 2568 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-monitoring/openshift-state-metrics-85658796db-trt8m" podStartSLOduration=8.436308305 podStartE2EDuration="12.028685107s" podCreationTimestamp="2026-06-03 16:36:31 +0000 UTC" firstStartedPulling="2026-06-03 16:36:38.927226041 +0000 UTC m=+171.069400673" lastFinishedPulling="2026-06-03 16:36:42.519602843 +0000 UTC m=+174.661777475" observedRunningTime="2026-06-03 16:36:43.028362096 +0000 UTC m=+175.170536751" watchObservedRunningTime="2026-06-03 16:36:43.028685107 +0000 UTC m=+175.170859763" Jun 03 16:36:43.049405 ip-10-0-135-67 kubenswrapper[2568]: I0603 16:36:43.049351 2568 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-monitoring/node-exporter-289mx" podStartSLOduration=11.070017113 podStartE2EDuration="12.049332905s" podCreationTimestamp="2026-06-03 16:36:31 +0000 UTC" firstStartedPulling="2026-06-03 16:36:38.661821424 +0000 UTC m=+170.803996064" lastFinishedPulling="2026-06-03 16:36:39.641137219 +0000 UTC m=+171.783311856" observedRunningTime="2026-06-03 16:36:43.047711553 +0000 UTC m=+175.189886201" watchObservedRunningTime="2026-06-03 16:36:43.049332905 +0000 UTC m=+175.191507561" Jun 03 16:36:43.996297 ip-10-0-135-67 kubenswrapper[2568]: I0603 16:36:43.996254 2568 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/kube-state-metrics-8469c486bb-pkwds" event={"ID":"f61b4ac6-d530-43f4-8f5f-c44f45455887","Type":"ContainerStarted","Data":"21234382def89a14113679711f96e9965f2de702fcdea97508f9adbdf51ad779"} Jun 03 16:36:43.998746 ip-10-0-135-67 kubenswrapper[2568]: I0603 16:36:43.998697 2568 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-tn2hz" event={"ID":"0f3a9c08-8974-46c9-9245-fbfc1a73e96c","Type":"ContainerStarted","Data":"aa938cf3fc698406b5fa3f21cff2d2996441c8532fdbcd6770c06b28119d3625"} Jun 03 16:36:43.999480 ip-10-0-135-67 kubenswrapper[2568]: I0603 16:36:43.999456 2568 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-dns/dns-default-tn2hz" Jun 03 16:36:44.012244 ip-10-0-135-67 kubenswrapper[2568]: I0603 16:36:44.012157 2568 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-monitoring/kube-state-metrics-8469c486bb-pkwds" podStartSLOduration=9.562825107 podStartE2EDuration="13.012141732s" podCreationTimestamp="2026-06-03 16:36:31 +0000 UTC" firstStartedPulling="2026-06-03 16:36:39.069478941 +0000 UTC m=+171.211653593" lastFinishedPulling="2026-06-03 16:36:42.518795579 +0000 UTC m=+174.660970218" observedRunningTime="2026-06-03 16:36:44.011086689 +0000 UTC m=+176.153261350" watchObservedRunningTime="2026-06-03 16:36:44.012141732 +0000 UTC m=+176.154316387" Jun 03 16:36:45.406324 ip-10-0-135-67 kubenswrapper[2568]: I0603 16:36:45.406289 2568 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress-canary/ingress-canary-mjr7l" Jun 03 16:36:45.406755 ip-10-0-135-67 kubenswrapper[2568]: I0603 16:36:45.406493 2568 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-54gnw" Jun 03 16:36:45.408560 ip-10-0-135-67 kubenswrapper[2568]: I0603 16:36:45.408516 2568 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-canary\"/\"default-dockercfg-kldw8\"" Jun 03 16:36:45.417131 ip-10-0-135-67 kubenswrapper[2568]: I0603 16:36:45.417113 2568 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress-canary/ingress-canary-mjr7l" Jun 03 16:36:46.101608 ip-10-0-135-67 kubenswrapper[2568]: I0603 16:36:46.101553 2568 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-dns/dns-default-tn2hz" podStartSLOduration=136.653400385 podStartE2EDuration="2m20.101535149s" podCreationTimestamp="2026-06-03 16:34:26 +0000 UTC" firstStartedPulling="2026-06-03 16:36:39.072038205 +0000 UTC m=+171.214212844" lastFinishedPulling="2026-06-03 16:36:42.52017297 +0000 UTC m=+174.662347608" observedRunningTime="2026-06-03 16:36:44.02542675 +0000 UTC m=+176.167601405" watchObservedRunningTime="2026-06-03 16:36:46.101535149 +0000 UTC m=+178.243709804" Jun 03 16:36:46.103393 ip-10-0-135-67 kubenswrapper[2568]: I0603 16:36:46.103368 2568 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-ingress-canary/ingress-canary-mjr7l"] Jun 03 16:36:47.026287 ip-10-0-135-67 kubenswrapper[2568]: I0603 16:36:47.026235 2568 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"3dc38f0d-f7bf-415b-a488-267c48ef13f3","Type":"ContainerStarted","Data":"8ded85dc44066bd230659af2e22fd6ca3bad9e06b3e197922781805ebfbbea00"} Jun 03 16:36:47.026287 ip-10-0-135-67 kubenswrapper[2568]: I0603 16:36:47.026279 2568 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"3dc38f0d-f7bf-415b-a488-267c48ef13f3","Type":"ContainerStarted","Data":"50a0b27c468dd9448ac67f4568212de9bb2bbd116aba531ae2c7c7e314c7f331"} Jun 03 16:36:47.026287 ip-10-0-135-67 kubenswrapper[2568]: I0603 16:36:47.026295 2568 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"3dc38f0d-f7bf-415b-a488-267c48ef13f3","Type":"ContainerStarted","Data":"a663e5c95b4dc44d65b9e88e291ab6090e232eabf2346d76c105661bd5c25ef1"} Jun 03 16:36:47.026812 ip-10-0-135-67 kubenswrapper[2568]: I0603 16:36:47.026307 2568 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"3dc38f0d-f7bf-415b-a488-267c48ef13f3","Type":"ContainerStarted","Data":"f82b968d121a7621e94540892e448b9809f7136f6fe464ff395f073d8c6a5409"} Jun 03 16:36:47.026812 ip-10-0-135-67 kubenswrapper[2568]: I0603 16:36:47.026321 2568 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"3dc38f0d-f7bf-415b-a488-267c48ef13f3","Type":"ContainerStarted","Data":"dbb92c9f46a832f0cf635aa4784745766f10acd8e178e029d68ad75735e5883b"} Jun 03 16:36:47.027786 ip-10-0-135-67 kubenswrapper[2568]: I0603 16:36:47.027758 2568 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-ingress-canary/ingress-canary-mjr7l" event={"ID":"7839d8fc-3e8c-481e-93f6-5e2eb79ee81f","Type":"ContainerStarted","Data":"e23ce66b3baf897f855c014eb27850c3a73adc2615beace109a80beaa3ea4805"} Jun 03 16:36:49.037064 ip-10-0-135-67 kubenswrapper[2568]: I0603 16:36:49.037025 2568 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"3dc38f0d-f7bf-415b-a488-267c48ef13f3","Type":"ContainerStarted","Data":"6022a847ccdc866beaaf51f998cf3d4f23688b08a55b29f0580ed8b243abf060"} Jun 03 16:36:49.038422 ip-10-0-135-67 kubenswrapper[2568]: I0603 16:36:49.038387 2568 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-ingress-canary/ingress-canary-mjr7l" event={"ID":"7839d8fc-3e8c-481e-93f6-5e2eb79ee81f","Type":"ContainerStarted","Data":"5c354d7bf11f4950753c149c268118923db81c3be362c5455476c2d34ed05781"} Jun 03 16:36:49.066542 ip-10-0-135-67 kubenswrapper[2568]: I0603 16:36:49.066492 2568 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-monitoring/alertmanager-main-0" podStartSLOduration=7.357275893 podStartE2EDuration="17.066476757s" podCreationTimestamp="2026-06-03 16:36:32 +0000 UTC" firstStartedPulling="2026-06-03 16:36:38.840787054 +0000 UTC m=+170.982961705" lastFinishedPulling="2026-06-03 16:36:48.549987924 +0000 UTC m=+180.692162569" observedRunningTime="2026-06-03 16:36:49.065488904 +0000 UTC m=+181.207663558" watchObservedRunningTime="2026-06-03 16:36:49.066476757 +0000 UTC m=+181.208651411" Jun 03 16:36:49.079634 ip-10-0-135-67 kubenswrapper[2568]: I0603 16:36:49.079574 2568 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-ingress-canary/ingress-canary-mjr7l" podStartSLOduration=140.824025339 podStartE2EDuration="2m23.079559656s" podCreationTimestamp="2026-06-03 16:34:26 +0000 UTC" firstStartedPulling="2026-06-03 16:36:46.293117746 +0000 UTC m=+178.435292393" lastFinishedPulling="2026-06-03 16:36:48.548652068 +0000 UTC m=+180.690826710" observedRunningTime="2026-06-03 16:36:49.079271106 +0000 UTC m=+181.221445761" watchObservedRunningTime="2026-06-03 16:36:49.079559656 +0000 UTC m=+181.221734311" Jun 03 16:36:52.014155 ip-10-0-135-67 kubenswrapper[2568]: I0603 16:36:52.014127 2568 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-dns/dns-default-tn2hz" Jun 03 16:37:05.007149 ip-10-0-135-67 kubenswrapper[2568]: I0603 16:37:05.007120 2568 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-image-registry/image-registry-74745bdc9c-rk4cq" Jun 03 16:37:06.659436 ip-10-0-135-67 kubenswrapper[2568]: I0603 16:37:06.659372 2568 kuberuntime_container.go:864] "Killing container with a grace period" pod="openshift-console/console-b7bc65d87-nsc2l" podUID="65ec0a70-0b84-48c2-bbc9-bde3b6880feb" containerName="console" containerID="cri-o://8e19b6966f32a19995b07fa6584a74b4f38866caa8ab4bd63f1a45e9e8d3a90b" gracePeriod=15 Jun 03 16:37:06.897747 ip-10-0-135-67 kubenswrapper[2568]: I0603 16:37:06.897727 2568 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console_console-b7bc65d87-nsc2l_65ec0a70-0b84-48c2-bbc9-bde3b6880feb/console/0.log" Jun 03 16:37:06.897844 ip-10-0-135-67 kubenswrapper[2568]: I0603 16:37:06.897794 2568 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-b7bc65d87-nsc2l" Jun 03 16:37:06.956719 ip-10-0-135-67 kubenswrapper[2568]: I0603 16:37:06.956659 2568 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/65ec0a70-0b84-48c2-bbc9-bde3b6880feb-console-serving-cert\") pod \"65ec0a70-0b84-48c2-bbc9-bde3b6880feb\" (UID: \"65ec0a70-0b84-48c2-bbc9-bde3b6880feb\") " Jun 03 16:37:06.956816 ip-10-0-135-67 kubenswrapper[2568]: I0603 16:37:06.956719 2568 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/65ec0a70-0b84-48c2-bbc9-bde3b6880feb-service-ca\") pod \"65ec0a70-0b84-48c2-bbc9-bde3b6880feb\" (UID: \"65ec0a70-0b84-48c2-bbc9-bde3b6880feb\") " Jun 03 16:37:06.956816 ip-10-0-135-67 kubenswrapper[2568]: I0603 16:37:06.956758 2568 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/65ec0a70-0b84-48c2-bbc9-bde3b6880feb-console-oauth-config\") pod \"65ec0a70-0b84-48c2-bbc9-bde3b6880feb\" (UID: \"65ec0a70-0b84-48c2-bbc9-bde3b6880feb\") " Jun 03 16:37:06.956816 ip-10-0-135-67 kubenswrapper[2568]: I0603 16:37:06.956788 2568 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/65ec0a70-0b84-48c2-bbc9-bde3b6880feb-oauth-serving-cert\") pod \"65ec0a70-0b84-48c2-bbc9-bde3b6880feb\" (UID: \"65ec0a70-0b84-48c2-bbc9-bde3b6880feb\") " Jun 03 16:37:06.956816 ip-10-0-135-67 kubenswrapper[2568]: I0603 16:37:06.956802 2568 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/65ec0a70-0b84-48c2-bbc9-bde3b6880feb-console-config\") pod \"65ec0a70-0b84-48c2-bbc9-bde3b6880feb\" (UID: \"65ec0a70-0b84-48c2-bbc9-bde3b6880feb\") " Jun 03 16:37:06.957033 ip-10-0-135-67 kubenswrapper[2568]: I0603 16:37:06.956822 2568 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-nzxhn\" (UniqueName: \"kubernetes.io/projected/65ec0a70-0b84-48c2-bbc9-bde3b6880feb-kube-api-access-nzxhn\") pod \"65ec0a70-0b84-48c2-bbc9-bde3b6880feb\" (UID: \"65ec0a70-0b84-48c2-bbc9-bde3b6880feb\") " Jun 03 16:37:06.957230 ip-10-0-135-67 kubenswrapper[2568]: I0603 16:37:06.957193 2568 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/65ec0a70-0b84-48c2-bbc9-bde3b6880feb-oauth-serving-cert" (OuterVolumeSpecName: "oauth-serving-cert") pod "65ec0a70-0b84-48c2-bbc9-bde3b6880feb" (UID: "65ec0a70-0b84-48c2-bbc9-bde3b6880feb"). InnerVolumeSpecName "oauth-serving-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jun 03 16:37:06.957342 ip-10-0-135-67 kubenswrapper[2568]: I0603 16:37:06.957230 2568 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/65ec0a70-0b84-48c2-bbc9-bde3b6880feb-console-config" (OuterVolumeSpecName: "console-config") pod "65ec0a70-0b84-48c2-bbc9-bde3b6880feb" (UID: "65ec0a70-0b84-48c2-bbc9-bde3b6880feb"). InnerVolumeSpecName "console-config". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jun 03 16:37:06.957342 ip-10-0-135-67 kubenswrapper[2568]: I0603 16:37:06.957295 2568 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/65ec0a70-0b84-48c2-bbc9-bde3b6880feb-service-ca" (OuterVolumeSpecName: "service-ca") pod "65ec0a70-0b84-48c2-bbc9-bde3b6880feb" (UID: "65ec0a70-0b84-48c2-bbc9-bde3b6880feb"). InnerVolumeSpecName "service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jun 03 16:37:06.958961 ip-10-0-135-67 kubenswrapper[2568]: I0603 16:37:06.958937 2568 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/65ec0a70-0b84-48c2-bbc9-bde3b6880feb-console-oauth-config" (OuterVolumeSpecName: "console-oauth-config") pod "65ec0a70-0b84-48c2-bbc9-bde3b6880feb" (UID: "65ec0a70-0b84-48c2-bbc9-bde3b6880feb"). InnerVolumeSpecName "console-oauth-config". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jun 03 16:37:06.959070 ip-10-0-135-67 kubenswrapper[2568]: I0603 16:37:06.958992 2568 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/65ec0a70-0b84-48c2-bbc9-bde3b6880feb-console-serving-cert" (OuterVolumeSpecName: "console-serving-cert") pod "65ec0a70-0b84-48c2-bbc9-bde3b6880feb" (UID: "65ec0a70-0b84-48c2-bbc9-bde3b6880feb"). InnerVolumeSpecName "console-serving-cert". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jun 03 16:37:06.959070 ip-10-0-135-67 kubenswrapper[2568]: I0603 16:37:06.959025 2568 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/65ec0a70-0b84-48c2-bbc9-bde3b6880feb-kube-api-access-nzxhn" (OuterVolumeSpecName: "kube-api-access-nzxhn") pod "65ec0a70-0b84-48c2-bbc9-bde3b6880feb" (UID: "65ec0a70-0b84-48c2-bbc9-bde3b6880feb"). InnerVolumeSpecName "kube-api-access-nzxhn". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 03 16:37:07.058307 ip-10-0-135-67 kubenswrapper[2568]: I0603 16:37:07.058283 2568 reconciler_common.go:299] "Volume detached for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/65ec0a70-0b84-48c2-bbc9-bde3b6880feb-oauth-serving-cert\") on node \"ip-10-0-135-67.ec2.internal\" DevicePath \"\"" Jun 03 16:37:07.058307 ip-10-0-135-67 kubenswrapper[2568]: I0603 16:37:07.058306 2568 reconciler_common.go:299] "Volume detached for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/65ec0a70-0b84-48c2-bbc9-bde3b6880feb-console-config\") on node \"ip-10-0-135-67.ec2.internal\" DevicePath \"\"" Jun 03 16:37:07.058417 ip-10-0-135-67 kubenswrapper[2568]: I0603 16:37:07.058316 2568 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-nzxhn\" (UniqueName: \"kubernetes.io/projected/65ec0a70-0b84-48c2-bbc9-bde3b6880feb-kube-api-access-nzxhn\") on node \"ip-10-0-135-67.ec2.internal\" DevicePath \"\"" Jun 03 16:37:07.058417 ip-10-0-135-67 kubenswrapper[2568]: I0603 16:37:07.058325 2568 reconciler_common.go:299] "Volume detached for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/65ec0a70-0b84-48c2-bbc9-bde3b6880feb-console-serving-cert\") on node \"ip-10-0-135-67.ec2.internal\" DevicePath \"\"" Jun 03 16:37:07.058417 ip-10-0-135-67 kubenswrapper[2568]: I0603 16:37:07.058334 2568 reconciler_common.go:299] "Volume detached for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/65ec0a70-0b84-48c2-bbc9-bde3b6880feb-service-ca\") on node \"ip-10-0-135-67.ec2.internal\" DevicePath \"\"" Jun 03 16:37:07.058417 ip-10-0-135-67 kubenswrapper[2568]: I0603 16:37:07.058342 2568 reconciler_common.go:299] "Volume detached for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/65ec0a70-0b84-48c2-bbc9-bde3b6880feb-console-oauth-config\") on node \"ip-10-0-135-67.ec2.internal\" DevicePath \"\"" Jun 03 16:37:07.093569 ip-10-0-135-67 kubenswrapper[2568]: I0603 16:37:07.093544 2568 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console_console-b7bc65d87-nsc2l_65ec0a70-0b84-48c2-bbc9-bde3b6880feb/console/0.log" Jun 03 16:37:07.093662 ip-10-0-135-67 kubenswrapper[2568]: I0603 16:37:07.093585 2568 generic.go:358] "Generic (PLEG): container finished" podID="65ec0a70-0b84-48c2-bbc9-bde3b6880feb" containerID="8e19b6966f32a19995b07fa6584a74b4f38866caa8ab4bd63f1a45e9e8d3a90b" exitCode=2 Jun 03 16:37:07.093662 ip-10-0-135-67 kubenswrapper[2568]: I0603 16:37:07.093637 2568 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-b7bc65d87-nsc2l" event={"ID":"65ec0a70-0b84-48c2-bbc9-bde3b6880feb","Type":"ContainerDied","Data":"8e19b6966f32a19995b07fa6584a74b4f38866caa8ab4bd63f1a45e9e8d3a90b"} Jun 03 16:37:07.093662 ip-10-0-135-67 kubenswrapper[2568]: I0603 16:37:07.093650 2568 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-b7bc65d87-nsc2l" Jun 03 16:37:07.093804 ip-10-0-135-67 kubenswrapper[2568]: I0603 16:37:07.093665 2568 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-b7bc65d87-nsc2l" event={"ID":"65ec0a70-0b84-48c2-bbc9-bde3b6880feb","Type":"ContainerDied","Data":"11aa7ee000b18f3cbd1dfd24f542c1f154e2f1418ff0f1f10b47eff6722263a7"} Jun 03 16:37:07.093804 ip-10-0-135-67 kubenswrapper[2568]: I0603 16:37:07.093685 2568 scope.go:117] "RemoveContainer" containerID="8e19b6966f32a19995b07fa6584a74b4f38866caa8ab4bd63f1a45e9e8d3a90b" Jun 03 16:37:07.101256 ip-10-0-135-67 kubenswrapper[2568]: I0603 16:37:07.101237 2568 scope.go:117] "RemoveContainer" containerID="8e19b6966f32a19995b07fa6584a74b4f38866caa8ab4bd63f1a45e9e8d3a90b" Jun 03 16:37:07.101588 ip-10-0-135-67 kubenswrapper[2568]: E0603 16:37:07.101552 2568 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"8e19b6966f32a19995b07fa6584a74b4f38866caa8ab4bd63f1a45e9e8d3a90b\": container with ID starting with 8e19b6966f32a19995b07fa6584a74b4f38866caa8ab4bd63f1a45e9e8d3a90b not found: ID does not exist" containerID="8e19b6966f32a19995b07fa6584a74b4f38866caa8ab4bd63f1a45e9e8d3a90b" Jun 03 16:37:07.101688 ip-10-0-135-67 kubenswrapper[2568]: I0603 16:37:07.101597 2568 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"8e19b6966f32a19995b07fa6584a74b4f38866caa8ab4bd63f1a45e9e8d3a90b"} err="failed to get container status \"8e19b6966f32a19995b07fa6584a74b4f38866caa8ab4bd63f1a45e9e8d3a90b\": rpc error: code = NotFound desc = could not find container \"8e19b6966f32a19995b07fa6584a74b4f38866caa8ab4bd63f1a45e9e8d3a90b\": container with ID starting with 8e19b6966f32a19995b07fa6584a74b4f38866caa8ab4bd63f1a45e9e8d3a90b not found: ID does not exist" Jun 03 16:37:07.113050 ip-10-0-135-67 kubenswrapper[2568]: I0603 16:37:07.113026 2568 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openshift-console/console-b7bc65d87-nsc2l"] Jun 03 16:37:07.116610 ip-10-0-135-67 kubenswrapper[2568]: I0603 16:37:07.116589 2568 kubelet.go:2547] "SyncLoop REMOVE" source="api" pods=["openshift-console/console-b7bc65d87-nsc2l"] Jun 03 16:37:07.688933 ip-10-0-135-67 kubenswrapper[2568]: I0603 16:37:07.688895 2568 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openshift-image-registry/image-registry-74745bdc9c-rk4cq"] Jun 03 16:37:08.416758 ip-10-0-135-67 kubenswrapper[2568]: I0603 16:37:08.416716 2568 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="65ec0a70-0b84-48c2-bbc9-bde3b6880feb" path="/var/lib/kubelet/pods/65ec0a70-0b84-48c2-bbc9-bde3b6880feb/volumes" Jun 03 16:37:32.708493 ip-10-0-135-67 kubenswrapper[2568]: I0603 16:37:32.708431 2568 kuberuntime_container.go:864] "Killing container with a grace period" pod="openshift-image-registry/image-registry-74745bdc9c-rk4cq" podUID="1adc570a-c47f-4bc0-a3f5-a7e90c775e3a" containerName="registry" containerID="cri-o://d072546afec63ec921bcf08ce19ac742bfff3fe3987effc9cddf55245a71b755" gracePeriod=30 Jun 03 16:37:33.948160 ip-10-0-135-67 kubenswrapper[2568]: I0603 16:37:33.948137 2568 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-74745bdc9c-rk4cq" Jun 03 16:37:34.076376 ip-10-0-135-67 kubenswrapper[2568]: I0603 16:37:34.076294 2568 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/1adc570a-c47f-4bc0-a3f5-a7e90c775e3a-installation-pull-secrets\") pod \"1adc570a-c47f-4bc0-a3f5-a7e90c775e3a\" (UID: \"1adc570a-c47f-4bc0-a3f5-a7e90c775e3a\") " Jun 03 16:37:34.076376 ip-10-0-135-67 kubenswrapper[2568]: I0603 16:37:34.076337 2568 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/1adc570a-c47f-4bc0-a3f5-a7e90c775e3a-image-registry-private-configuration\") pod \"1adc570a-c47f-4bc0-a3f5-a7e90c775e3a\" (UID: \"1adc570a-c47f-4bc0-a3f5-a7e90c775e3a\") " Jun 03 16:37:34.076376 ip-10-0-135-67 kubenswrapper[2568]: I0603 16:37:34.076359 2568 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/1adc570a-c47f-4bc0-a3f5-a7e90c775e3a-ca-trust-extracted\") pod \"1adc570a-c47f-4bc0-a3f5-a7e90c775e3a\" (UID: \"1adc570a-c47f-4bc0-a3f5-a7e90c775e3a\") " Jun 03 16:37:34.076611 ip-10-0-135-67 kubenswrapper[2568]: I0603 16:37:34.076395 2568 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-6hr94\" (UniqueName: \"kubernetes.io/projected/1adc570a-c47f-4bc0-a3f5-a7e90c775e3a-kube-api-access-6hr94\") pod \"1adc570a-c47f-4bc0-a3f5-a7e90c775e3a\" (UID: \"1adc570a-c47f-4bc0-a3f5-a7e90c775e3a\") " Jun 03 16:37:34.076611 ip-10-0-135-67 kubenswrapper[2568]: I0603 16:37:34.076426 2568 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/1adc570a-c47f-4bc0-a3f5-a7e90c775e3a-registry-tls\") pod \"1adc570a-c47f-4bc0-a3f5-a7e90c775e3a\" (UID: \"1adc570a-c47f-4bc0-a3f5-a7e90c775e3a\") " Jun 03 16:37:34.076611 ip-10-0-135-67 kubenswrapper[2568]: I0603 16:37:34.076453 2568 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/1adc570a-c47f-4bc0-a3f5-a7e90c775e3a-bound-sa-token\") pod \"1adc570a-c47f-4bc0-a3f5-a7e90c775e3a\" (UID: \"1adc570a-c47f-4bc0-a3f5-a7e90c775e3a\") " Jun 03 16:37:34.076611 ip-10-0-135-67 kubenswrapper[2568]: I0603 16:37:34.076470 2568 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/1adc570a-c47f-4bc0-a3f5-a7e90c775e3a-trusted-ca\") pod \"1adc570a-c47f-4bc0-a3f5-a7e90c775e3a\" (UID: \"1adc570a-c47f-4bc0-a3f5-a7e90c775e3a\") " Jun 03 16:37:34.076611 ip-10-0-135-67 kubenswrapper[2568]: I0603 16:37:34.076550 2568 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/1adc570a-c47f-4bc0-a3f5-a7e90c775e3a-registry-certificates\") pod \"1adc570a-c47f-4bc0-a3f5-a7e90c775e3a\" (UID: \"1adc570a-c47f-4bc0-a3f5-a7e90c775e3a\") " Jun 03 16:37:34.077083 ip-10-0-135-67 kubenswrapper[2568]: I0603 16:37:34.077032 2568 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/1adc570a-c47f-4bc0-a3f5-a7e90c775e3a-trusted-ca" (OuterVolumeSpecName: "trusted-ca") pod "1adc570a-c47f-4bc0-a3f5-a7e90c775e3a" (UID: "1adc570a-c47f-4bc0-a3f5-a7e90c775e3a"). InnerVolumeSpecName "trusted-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jun 03 16:37:34.077203 ip-10-0-135-67 kubenswrapper[2568]: I0603 16:37:34.077091 2568 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/1adc570a-c47f-4bc0-a3f5-a7e90c775e3a-registry-certificates" (OuterVolumeSpecName: "registry-certificates") pod "1adc570a-c47f-4bc0-a3f5-a7e90c775e3a" (UID: "1adc570a-c47f-4bc0-a3f5-a7e90c775e3a"). InnerVolumeSpecName "registry-certificates". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jun 03 16:37:34.079226 ip-10-0-135-67 kubenswrapper[2568]: I0603 16:37:34.079201 2568 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/1adc570a-c47f-4bc0-a3f5-a7e90c775e3a-registry-tls" (OuterVolumeSpecName: "registry-tls") pod "1adc570a-c47f-4bc0-a3f5-a7e90c775e3a" (UID: "1adc570a-c47f-4bc0-a3f5-a7e90c775e3a"). InnerVolumeSpecName "registry-tls". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 03 16:37:34.079531 ip-10-0-135-67 kubenswrapper[2568]: I0603 16:37:34.079495 2568 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/1adc570a-c47f-4bc0-a3f5-a7e90c775e3a-image-registry-private-configuration" (OuterVolumeSpecName: "image-registry-private-configuration") pod "1adc570a-c47f-4bc0-a3f5-a7e90c775e3a" (UID: "1adc570a-c47f-4bc0-a3f5-a7e90c775e3a"). InnerVolumeSpecName "image-registry-private-configuration". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jun 03 16:37:34.079740 ip-10-0-135-67 kubenswrapper[2568]: I0603 16:37:34.079557 2568 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/1adc570a-c47f-4bc0-a3f5-a7e90c775e3a-bound-sa-token" (OuterVolumeSpecName: "bound-sa-token") pod "1adc570a-c47f-4bc0-a3f5-a7e90c775e3a" (UID: "1adc570a-c47f-4bc0-a3f5-a7e90c775e3a"). InnerVolumeSpecName "bound-sa-token". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 03 16:37:34.079740 ip-10-0-135-67 kubenswrapper[2568]: I0603 16:37:34.079566 2568 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/1adc570a-c47f-4bc0-a3f5-a7e90c775e3a-installation-pull-secrets" (OuterVolumeSpecName: "installation-pull-secrets") pod "1adc570a-c47f-4bc0-a3f5-a7e90c775e3a" (UID: "1adc570a-c47f-4bc0-a3f5-a7e90c775e3a"). InnerVolumeSpecName "installation-pull-secrets". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jun 03 16:37:34.079843 ip-10-0-135-67 kubenswrapper[2568]: I0603 16:37:34.079764 2568 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/1adc570a-c47f-4bc0-a3f5-a7e90c775e3a-kube-api-access-6hr94" (OuterVolumeSpecName: "kube-api-access-6hr94") pod "1adc570a-c47f-4bc0-a3f5-a7e90c775e3a" (UID: "1adc570a-c47f-4bc0-a3f5-a7e90c775e3a"). InnerVolumeSpecName "kube-api-access-6hr94". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 03 16:37:34.084916 ip-10-0-135-67 kubenswrapper[2568]: I0603 16:37:34.084895 2568 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/1adc570a-c47f-4bc0-a3f5-a7e90c775e3a-ca-trust-extracted" (OuterVolumeSpecName: "ca-trust-extracted") pod "1adc570a-c47f-4bc0-a3f5-a7e90c775e3a" (UID: "1adc570a-c47f-4bc0-a3f5-a7e90c775e3a"). InnerVolumeSpecName "ca-trust-extracted". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jun 03 16:37:34.166785 ip-10-0-135-67 kubenswrapper[2568]: I0603 16:37:34.166759 2568 generic.go:358] "Generic (PLEG): container finished" podID="1adc570a-c47f-4bc0-a3f5-a7e90c775e3a" containerID="d072546afec63ec921bcf08ce19ac742bfff3fe3987effc9cddf55245a71b755" exitCode=0 Jun 03 16:37:34.166884 ip-10-0-135-67 kubenswrapper[2568]: I0603 16:37:34.166823 2568 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-74745bdc9c-rk4cq" Jun 03 16:37:34.166884 ip-10-0-135-67 kubenswrapper[2568]: I0603 16:37:34.166833 2568 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-74745bdc9c-rk4cq" event={"ID":"1adc570a-c47f-4bc0-a3f5-a7e90c775e3a","Type":"ContainerDied","Data":"d072546afec63ec921bcf08ce19ac742bfff3fe3987effc9cddf55245a71b755"} Jun 03 16:37:34.166884 ip-10-0-135-67 kubenswrapper[2568]: I0603 16:37:34.166857 2568 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-74745bdc9c-rk4cq" event={"ID":"1adc570a-c47f-4bc0-a3f5-a7e90c775e3a","Type":"ContainerDied","Data":"6d4633376cfe83682c8907ddf67aaa1d572550029286048738d4fb7fffbb11cb"} Jun 03 16:37:34.166884 ip-10-0-135-67 kubenswrapper[2568]: I0603 16:37:34.166872 2568 scope.go:117] "RemoveContainer" containerID="d072546afec63ec921bcf08ce19ac742bfff3fe3987effc9cddf55245a71b755" Jun 03 16:37:34.176170 ip-10-0-135-67 kubenswrapper[2568]: I0603 16:37:34.176147 2568 scope.go:117] "RemoveContainer" containerID="d072546afec63ec921bcf08ce19ac742bfff3fe3987effc9cddf55245a71b755" Jun 03 16:37:34.176452 ip-10-0-135-67 kubenswrapper[2568]: E0603 16:37:34.176432 2568 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"d072546afec63ec921bcf08ce19ac742bfff3fe3987effc9cddf55245a71b755\": container with ID starting with d072546afec63ec921bcf08ce19ac742bfff3fe3987effc9cddf55245a71b755 not found: ID does not exist" containerID="d072546afec63ec921bcf08ce19ac742bfff3fe3987effc9cddf55245a71b755" Jun 03 16:37:34.176525 ip-10-0-135-67 kubenswrapper[2568]: I0603 16:37:34.176459 2568 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"d072546afec63ec921bcf08ce19ac742bfff3fe3987effc9cddf55245a71b755"} err="failed to get container status \"d072546afec63ec921bcf08ce19ac742bfff3fe3987effc9cddf55245a71b755\": rpc error: code = NotFound desc = could not find container \"d072546afec63ec921bcf08ce19ac742bfff3fe3987effc9cddf55245a71b755\": container with ID starting with d072546afec63ec921bcf08ce19ac742bfff3fe3987effc9cddf55245a71b755 not found: ID does not exist" Jun 03 16:37:34.177176 ip-10-0-135-67 kubenswrapper[2568]: I0603 16:37:34.177157 2568 reconciler_common.go:299] "Volume detached for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/1adc570a-c47f-4bc0-a3f5-a7e90c775e3a-registry-certificates\") on node \"ip-10-0-135-67.ec2.internal\" DevicePath \"\"" Jun 03 16:37:34.177240 ip-10-0-135-67 kubenswrapper[2568]: I0603 16:37:34.177184 2568 reconciler_common.go:299] "Volume detached for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/1adc570a-c47f-4bc0-a3f5-a7e90c775e3a-installation-pull-secrets\") on node \"ip-10-0-135-67.ec2.internal\" DevicePath \"\"" Jun 03 16:37:34.177240 ip-10-0-135-67 kubenswrapper[2568]: I0603 16:37:34.177202 2568 reconciler_common.go:299] "Volume detached for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/1adc570a-c47f-4bc0-a3f5-a7e90c775e3a-image-registry-private-configuration\") on node \"ip-10-0-135-67.ec2.internal\" DevicePath \"\"" Jun 03 16:37:34.177240 ip-10-0-135-67 kubenswrapper[2568]: I0603 16:37:34.177234 2568 reconciler_common.go:299] "Volume detached for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/1adc570a-c47f-4bc0-a3f5-a7e90c775e3a-ca-trust-extracted\") on node \"ip-10-0-135-67.ec2.internal\" DevicePath \"\"" Jun 03 16:37:34.177381 ip-10-0-135-67 kubenswrapper[2568]: I0603 16:37:34.177250 2568 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-6hr94\" (UniqueName: \"kubernetes.io/projected/1adc570a-c47f-4bc0-a3f5-a7e90c775e3a-kube-api-access-6hr94\") on node \"ip-10-0-135-67.ec2.internal\" DevicePath \"\"" Jun 03 16:37:34.177381 ip-10-0-135-67 kubenswrapper[2568]: I0603 16:37:34.177264 2568 reconciler_common.go:299] "Volume detached for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/1adc570a-c47f-4bc0-a3f5-a7e90c775e3a-registry-tls\") on node \"ip-10-0-135-67.ec2.internal\" DevicePath \"\"" Jun 03 16:37:34.177381 ip-10-0-135-67 kubenswrapper[2568]: I0603 16:37:34.177278 2568 reconciler_common.go:299] "Volume detached for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/1adc570a-c47f-4bc0-a3f5-a7e90c775e3a-bound-sa-token\") on node \"ip-10-0-135-67.ec2.internal\" DevicePath \"\"" Jun 03 16:37:34.177381 ip-10-0-135-67 kubenswrapper[2568]: I0603 16:37:34.177311 2568 reconciler_common.go:299] "Volume detached for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/1adc570a-c47f-4bc0-a3f5-a7e90c775e3a-trusted-ca\") on node \"ip-10-0-135-67.ec2.internal\" DevicePath \"\"" Jun 03 16:37:34.188384 ip-10-0-135-67 kubenswrapper[2568]: I0603 16:37:34.188364 2568 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openshift-image-registry/image-registry-74745bdc9c-rk4cq"] Jun 03 16:37:34.198349 ip-10-0-135-67 kubenswrapper[2568]: I0603 16:37:34.198326 2568 kubelet.go:2547] "SyncLoop REMOVE" source="api" pods=["openshift-image-registry/image-registry-74745bdc9c-rk4cq"] Jun 03 16:37:34.410300 ip-10-0-135-67 kubenswrapper[2568]: I0603 16:37:34.410222 2568 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="1adc570a-c47f-4bc0-a3f5-a7e90c775e3a" path="/var/lib/kubelet/pods/1adc570a-c47f-4bc0-a3f5-a7e90c775e3a/volumes" Jun 03 16:37:56.087364 ip-10-0-135-67 kubenswrapper[2568]: I0603 16:37:56.087324 2568 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-monitoring/telemeter-client-64d9fbdc45-k5bxp"] Jun 03 16:37:56.088417 ip-10-0-135-67 kubenswrapper[2568]: I0603 16:37:56.088389 2568 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="1adc570a-c47f-4bc0-a3f5-a7e90c775e3a" containerName="registry" Jun 03 16:37:56.088417 ip-10-0-135-67 kubenswrapper[2568]: I0603 16:37:56.088415 2568 state_mem.go:107] "Deleted CPUSet assignment" podUID="1adc570a-c47f-4bc0-a3f5-a7e90c775e3a" containerName="registry" Jun 03 16:37:56.088611 ip-10-0-135-67 kubenswrapper[2568]: I0603 16:37:56.088427 2568 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="65ec0a70-0b84-48c2-bbc9-bde3b6880feb" containerName="console" Jun 03 16:37:56.088611 ip-10-0-135-67 kubenswrapper[2568]: I0603 16:37:56.088437 2568 state_mem.go:107] "Deleted CPUSet assignment" podUID="65ec0a70-0b84-48c2-bbc9-bde3b6880feb" containerName="console" Jun 03 16:37:56.088611 ip-10-0-135-67 kubenswrapper[2568]: I0603 16:37:56.088510 2568 memory_manager.go:356] "RemoveStaleState removing state" podUID="65ec0a70-0b84-48c2-bbc9-bde3b6880feb" containerName="console" Jun 03 16:37:56.088611 ip-10-0-135-67 kubenswrapper[2568]: I0603 16:37:56.088524 2568 memory_manager.go:356] "RemoveStaleState removing state" podUID="1adc570a-c47f-4bc0-a3f5-a7e90c775e3a" containerName="registry" Jun 03 16:37:56.091529 ip-10-0-135-67 kubenswrapper[2568]: I0603 16:37:56.091511 2568 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/telemeter-client-64d9fbdc45-k5bxp" Jun 03 16:37:56.093801 ip-10-0-135-67 kubenswrapper[2568]: I0603 16:37:56.093677 2568 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"federate-client-certs\"" Jun 03 16:37:56.093961 ip-10-0-135-67 kubenswrapper[2568]: I0603 16:37:56.093941 2568 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"telemeter-client-dockercfg-zklpg\"" Jun 03 16:37:56.094054 ip-10-0-135-67 kubenswrapper[2568]: I0603 16:37:56.093971 2568 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"telemeter-client\"" Jun 03 16:37:56.094054 ip-10-0-135-67 kubenswrapper[2568]: I0603 16:37:56.093992 2568 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"telemeter-client-tls\"" Jun 03 16:37:56.094394 ip-10-0-135-67 kubenswrapper[2568]: I0603 16:37:56.094371 2568 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"telemeter-client-serving-certs-ca-bundle\"" Jun 03 16:37:56.094825 ip-10-0-135-67 kubenswrapper[2568]: I0603 16:37:56.094809 2568 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"telemeter-client-kube-rbac-proxy-config\"" Jun 03 16:37:56.099323 ip-10-0-135-67 kubenswrapper[2568]: I0603 16:37:56.099299 2568 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"telemeter-trusted-ca-bundle-8i12ta5c71j38\"" Jun 03 16:37:56.101448 ip-10-0-135-67 kubenswrapper[2568]: I0603 16:37:56.101422 2568 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/telemeter-client-64d9fbdc45-k5bxp"] Jun 03 16:37:56.145639 ip-10-0-135-67 kubenswrapper[2568]: I0603 16:37:56.145604 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-telemeter-client-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/3423b27c-4dd3-4af1-9a1f-4668f19b1aed-secret-telemeter-client-kube-rbac-proxy-config\") pod \"telemeter-client-64d9fbdc45-k5bxp\" (UID: \"3423b27c-4dd3-4af1-9a1f-4668f19b1aed\") " pod="openshift-monitoring/telemeter-client-64d9fbdc45-k5bxp" Jun 03 16:37:56.145871 ip-10-0-135-67 kubenswrapper[2568]: I0603 16:37:56.145850 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"telemeter-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/3423b27c-4dd3-4af1-9a1f-4668f19b1aed-telemeter-trusted-ca-bundle\") pod \"telemeter-client-64d9fbdc45-k5bxp\" (UID: \"3423b27c-4dd3-4af1-9a1f-4668f19b1aed\") " pod="openshift-monitoring/telemeter-client-64d9fbdc45-k5bxp" Jun 03 16:37:56.145985 ip-10-0-135-67 kubenswrapper[2568]: I0603 16:37:56.145971 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-l5z6c\" (UniqueName: \"kubernetes.io/projected/3423b27c-4dd3-4af1-9a1f-4668f19b1aed-kube-api-access-l5z6c\") pod \"telemeter-client-64d9fbdc45-k5bxp\" (UID: \"3423b27c-4dd3-4af1-9a1f-4668f19b1aed\") " pod="openshift-monitoring/telemeter-client-64d9fbdc45-k5bxp" Jun 03 16:37:56.146146 ip-10-0-135-67 kubenswrapper[2568]: I0603 16:37:56.146132 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/3423b27c-4dd3-4af1-9a1f-4668f19b1aed-metrics-client-ca\") pod \"telemeter-client-64d9fbdc45-k5bxp\" (UID: \"3423b27c-4dd3-4af1-9a1f-4668f19b1aed\") " pod="openshift-monitoring/telemeter-client-64d9fbdc45-k5bxp" Jun 03 16:37:56.146261 ip-10-0-135-67 kubenswrapper[2568]: I0603 16:37:56.146247 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/3423b27c-4dd3-4af1-9a1f-4668f19b1aed-serving-certs-ca-bundle\") pod \"telemeter-client-64d9fbdc45-k5bxp\" (UID: \"3423b27c-4dd3-4af1-9a1f-4668f19b1aed\") " pod="openshift-monitoring/telemeter-client-64d9fbdc45-k5bxp" Jun 03 16:37:56.146377 ip-10-0-135-67 kubenswrapper[2568]: I0603 16:37:56.146364 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"telemeter-client-tls\" (UniqueName: \"kubernetes.io/secret/3423b27c-4dd3-4af1-9a1f-4668f19b1aed-telemeter-client-tls\") pod \"telemeter-client-64d9fbdc45-k5bxp\" (UID: \"3423b27c-4dd3-4af1-9a1f-4668f19b1aed\") " pod="openshift-monitoring/telemeter-client-64d9fbdc45-k5bxp" Jun 03 16:37:56.146497 ip-10-0-135-67 kubenswrapper[2568]: I0603 16:37:56.146479 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-telemeter-client\" (UniqueName: \"kubernetes.io/secret/3423b27c-4dd3-4af1-9a1f-4668f19b1aed-secret-telemeter-client\") pod \"telemeter-client-64d9fbdc45-k5bxp\" (UID: \"3423b27c-4dd3-4af1-9a1f-4668f19b1aed\") " pod="openshift-monitoring/telemeter-client-64d9fbdc45-k5bxp" Jun 03 16:37:56.146556 ip-10-0-135-67 kubenswrapper[2568]: I0603 16:37:56.146514 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"federate-client-tls\" (UniqueName: \"kubernetes.io/secret/3423b27c-4dd3-4af1-9a1f-4668f19b1aed-federate-client-tls\") pod \"telemeter-client-64d9fbdc45-k5bxp\" (UID: \"3423b27c-4dd3-4af1-9a1f-4668f19b1aed\") " pod="openshift-monitoring/telemeter-client-64d9fbdc45-k5bxp" Jun 03 16:37:56.246844 ip-10-0-135-67 kubenswrapper[2568]: I0603 16:37:56.246813 2568 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"secret-telemeter-client-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/3423b27c-4dd3-4af1-9a1f-4668f19b1aed-secret-telemeter-client-kube-rbac-proxy-config\") pod \"telemeter-client-64d9fbdc45-k5bxp\" (UID: \"3423b27c-4dd3-4af1-9a1f-4668f19b1aed\") " pod="openshift-monitoring/telemeter-client-64d9fbdc45-k5bxp" Jun 03 16:37:56.246844 ip-10-0-135-67 kubenswrapper[2568]: I0603 16:37:56.246845 2568 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"telemeter-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/3423b27c-4dd3-4af1-9a1f-4668f19b1aed-telemeter-trusted-ca-bundle\") pod \"telemeter-client-64d9fbdc45-k5bxp\" (UID: \"3423b27c-4dd3-4af1-9a1f-4668f19b1aed\") " pod="openshift-monitoring/telemeter-client-64d9fbdc45-k5bxp" Jun 03 16:37:56.247098 ip-10-0-135-67 kubenswrapper[2568]: I0603 16:37:56.246867 2568 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-l5z6c\" (UniqueName: \"kubernetes.io/projected/3423b27c-4dd3-4af1-9a1f-4668f19b1aed-kube-api-access-l5z6c\") pod \"telemeter-client-64d9fbdc45-k5bxp\" (UID: \"3423b27c-4dd3-4af1-9a1f-4668f19b1aed\") " pod="openshift-monitoring/telemeter-client-64d9fbdc45-k5bxp" Jun 03 16:37:56.247169 ip-10-0-135-67 kubenswrapper[2568]: I0603 16:37:56.247142 2568 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/3423b27c-4dd3-4af1-9a1f-4668f19b1aed-metrics-client-ca\") pod \"telemeter-client-64d9fbdc45-k5bxp\" (UID: \"3423b27c-4dd3-4af1-9a1f-4668f19b1aed\") " pod="openshift-monitoring/telemeter-client-64d9fbdc45-k5bxp" Jun 03 16:37:56.247224 ip-10-0-135-67 kubenswrapper[2568]: I0603 16:37:56.247189 2568 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/3423b27c-4dd3-4af1-9a1f-4668f19b1aed-serving-certs-ca-bundle\") pod \"telemeter-client-64d9fbdc45-k5bxp\" (UID: \"3423b27c-4dd3-4af1-9a1f-4668f19b1aed\") " pod="openshift-monitoring/telemeter-client-64d9fbdc45-k5bxp" Jun 03 16:37:56.247224 ip-10-0-135-67 kubenswrapper[2568]: I0603 16:37:56.247221 2568 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"telemeter-client-tls\" (UniqueName: \"kubernetes.io/secret/3423b27c-4dd3-4af1-9a1f-4668f19b1aed-telemeter-client-tls\") pod \"telemeter-client-64d9fbdc45-k5bxp\" (UID: \"3423b27c-4dd3-4af1-9a1f-4668f19b1aed\") " pod="openshift-monitoring/telemeter-client-64d9fbdc45-k5bxp" Jun 03 16:37:56.247321 ip-10-0-135-67 kubenswrapper[2568]: I0603 16:37:56.247309 2568 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"secret-telemeter-client\" (UniqueName: \"kubernetes.io/secret/3423b27c-4dd3-4af1-9a1f-4668f19b1aed-secret-telemeter-client\") pod \"telemeter-client-64d9fbdc45-k5bxp\" (UID: \"3423b27c-4dd3-4af1-9a1f-4668f19b1aed\") " pod="openshift-monitoring/telemeter-client-64d9fbdc45-k5bxp" Jun 03 16:37:56.247372 ip-10-0-135-67 kubenswrapper[2568]: I0603 16:37:56.247339 2568 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"federate-client-tls\" (UniqueName: \"kubernetes.io/secret/3423b27c-4dd3-4af1-9a1f-4668f19b1aed-federate-client-tls\") pod \"telemeter-client-64d9fbdc45-k5bxp\" (UID: \"3423b27c-4dd3-4af1-9a1f-4668f19b1aed\") " pod="openshift-monitoring/telemeter-client-64d9fbdc45-k5bxp" Jun 03 16:37:56.247703 ip-10-0-135-67 kubenswrapper[2568]: I0603 16:37:56.247675 2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"telemeter-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/3423b27c-4dd3-4af1-9a1f-4668f19b1aed-telemeter-trusted-ca-bundle\") pod \"telemeter-client-64d9fbdc45-k5bxp\" (UID: \"3423b27c-4dd3-4af1-9a1f-4668f19b1aed\") " pod="openshift-monitoring/telemeter-client-64d9fbdc45-k5bxp" Jun 03 16:37:56.247818 ip-10-0-135-67 kubenswrapper[2568]: I0603 16:37:56.247796 2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/3423b27c-4dd3-4af1-9a1f-4668f19b1aed-metrics-client-ca\") pod \"telemeter-client-64d9fbdc45-k5bxp\" (UID: \"3423b27c-4dd3-4af1-9a1f-4668f19b1aed\") " pod="openshift-monitoring/telemeter-client-64d9fbdc45-k5bxp" Jun 03 16:37:56.247880 ip-10-0-135-67 kubenswrapper[2568]: I0603 16:37:56.247828 2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/3423b27c-4dd3-4af1-9a1f-4668f19b1aed-serving-certs-ca-bundle\") pod \"telemeter-client-64d9fbdc45-k5bxp\" (UID: \"3423b27c-4dd3-4af1-9a1f-4668f19b1aed\") " pod="openshift-monitoring/telemeter-client-64d9fbdc45-k5bxp" Jun 03 16:37:56.249518 ip-10-0-135-67 kubenswrapper[2568]: I0603 16:37:56.249495 2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-telemeter-client-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/3423b27c-4dd3-4af1-9a1f-4668f19b1aed-secret-telemeter-client-kube-rbac-proxy-config\") pod \"telemeter-client-64d9fbdc45-k5bxp\" (UID: \"3423b27c-4dd3-4af1-9a1f-4668f19b1aed\") " pod="openshift-monitoring/telemeter-client-64d9fbdc45-k5bxp" Jun 03 16:37:56.249729 ip-10-0-135-67 kubenswrapper[2568]: I0603 16:37:56.249698 2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"telemeter-client-tls\" (UniqueName: \"kubernetes.io/secret/3423b27c-4dd3-4af1-9a1f-4668f19b1aed-telemeter-client-tls\") pod \"telemeter-client-64d9fbdc45-k5bxp\" (UID: \"3423b27c-4dd3-4af1-9a1f-4668f19b1aed\") " pod="openshift-monitoring/telemeter-client-64d9fbdc45-k5bxp" Jun 03 16:37:56.250088 ip-10-0-135-67 kubenswrapper[2568]: I0603 16:37:56.250072 2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"federate-client-tls\" (UniqueName: \"kubernetes.io/secret/3423b27c-4dd3-4af1-9a1f-4668f19b1aed-federate-client-tls\") pod \"telemeter-client-64d9fbdc45-k5bxp\" (UID: \"3423b27c-4dd3-4af1-9a1f-4668f19b1aed\") " pod="openshift-monitoring/telemeter-client-64d9fbdc45-k5bxp" Jun 03 16:37:56.250217 ip-10-0-135-67 kubenswrapper[2568]: I0603 16:37:56.250197 2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-telemeter-client\" (UniqueName: \"kubernetes.io/secret/3423b27c-4dd3-4af1-9a1f-4668f19b1aed-secret-telemeter-client\") pod \"telemeter-client-64d9fbdc45-k5bxp\" (UID: \"3423b27c-4dd3-4af1-9a1f-4668f19b1aed\") " pod="openshift-monitoring/telemeter-client-64d9fbdc45-k5bxp" Jun 03 16:37:56.253752 ip-10-0-135-67 kubenswrapper[2568]: I0603 16:37:56.253732 2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-l5z6c\" (UniqueName: \"kubernetes.io/projected/3423b27c-4dd3-4af1-9a1f-4668f19b1aed-kube-api-access-l5z6c\") pod \"telemeter-client-64d9fbdc45-k5bxp\" (UID: \"3423b27c-4dd3-4af1-9a1f-4668f19b1aed\") " pod="openshift-monitoring/telemeter-client-64d9fbdc45-k5bxp" Jun 03 16:37:56.404761 ip-10-0-135-67 kubenswrapper[2568]: I0603 16:37:56.404683 2568 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/telemeter-client-64d9fbdc45-k5bxp" Jun 03 16:37:56.530544 ip-10-0-135-67 kubenswrapper[2568]: I0603 16:37:56.530477 2568 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/telemeter-client-64d9fbdc45-k5bxp"] Jun 03 16:37:56.536807 ip-10-0-135-67 kubenswrapper[2568]: W0603 16:37:56.536775 2568 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod3423b27c_4dd3_4af1_9a1f_4668f19b1aed.slice/crio-c9fed352addd5eefaccc3f3b04841f9a94289956431c24c0fc1f88f999f8948d WatchSource:0}: Error finding container c9fed352addd5eefaccc3f3b04841f9a94289956431c24c0fc1f88f999f8948d: Status 404 returned error can't find the container with id c9fed352addd5eefaccc3f3b04841f9a94289956431c24c0fc1f88f999f8948d Jun 03 16:37:57.235277 ip-10-0-135-67 kubenswrapper[2568]: I0603 16:37:57.235238 2568 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/telemeter-client-64d9fbdc45-k5bxp" event={"ID":"3423b27c-4dd3-4af1-9a1f-4668f19b1aed","Type":"ContainerStarted","Data":"c9fed352addd5eefaccc3f3b04841f9a94289956431c24c0fc1f88f999f8948d"} Jun 03 16:38:00.177401 ip-10-0-135-67 kubenswrapper[2568]: I0603 16:38:00.177360 2568 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/ddc210bb-9544-4ca7-b2de-f84c92d84510-metrics-certs\") pod \"network-metrics-daemon-54gnw\" (UID: \"ddc210bb-9544-4ca7-b2de-f84c92d84510\") " pod="openshift-multus/network-metrics-daemon-54gnw" Jun 03 16:38:00.179686 ip-10-0-135-67 kubenswrapper[2568]: I0603 16:38:00.179663 2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/ddc210bb-9544-4ca7-b2de-f84c92d84510-metrics-certs\") pod \"network-metrics-daemon-54gnw\" (UID: \"ddc210bb-9544-4ca7-b2de-f84c92d84510\") " pod="openshift-multus/network-metrics-daemon-54gnw" Jun 03 16:38:00.245018 ip-10-0-135-67 kubenswrapper[2568]: I0603 16:38:00.244965 2568 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/telemeter-client-64d9fbdc45-k5bxp" event={"ID":"3423b27c-4dd3-4af1-9a1f-4668f19b1aed","Type":"ContainerStarted","Data":"2f7029d547a565f6a1b3910311f035dd56f0004678b0522480147de46d09998f"} Jun 03 16:38:00.245018 ip-10-0-135-67 kubenswrapper[2568]: I0603 16:38:00.245020 2568 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/telemeter-client-64d9fbdc45-k5bxp" event={"ID":"3423b27c-4dd3-4af1-9a1f-4668f19b1aed","Type":"ContainerStarted","Data":"335f701a514b7441aaa41ba96ed0bdc8c441f47bd889c124e35a7ca875a4b6b7"} Jun 03 16:38:00.245210 ip-10-0-135-67 kubenswrapper[2568]: I0603 16:38:00.245035 2568 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/telemeter-client-64d9fbdc45-k5bxp" event={"ID":"3423b27c-4dd3-4af1-9a1f-4668f19b1aed","Type":"ContainerStarted","Data":"b80dcdc3803c264cbd0cd6522ba69f612061b98893b96b3e870c8f8649afbfa7"} Jun 03 16:38:00.268213 ip-10-0-135-67 kubenswrapper[2568]: I0603 16:38:00.268165 2568 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-monitoring/telemeter-client-64d9fbdc45-k5bxp" podStartSLOduration=1.259868844 podStartE2EDuration="4.268149234s" podCreationTimestamp="2026-06-03 16:37:56 +0000 UTC" firstStartedPulling="2026-06-03 16:37:56.538576825 +0000 UTC m=+248.680751457" lastFinishedPulling="2026-06-03 16:37:59.546857212 +0000 UTC m=+251.689031847" observedRunningTime="2026-06-03 16:38:00.26698143 +0000 UTC m=+252.409156142" watchObservedRunningTime="2026-06-03 16:38:00.268149234 +0000 UTC m=+252.410323887" Jun 03 16:38:00.409413 ip-10-0-135-67 kubenswrapper[2568]: I0603 16:38:00.409379 2568 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-sa-dockercfg-fx9bm\"" Jun 03 16:38:00.417885 ip-10-0-135-67 kubenswrapper[2568]: I0603 16:38:00.417864 2568 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-54gnw" Jun 03 16:38:00.541482 ip-10-0-135-67 kubenswrapper[2568]: I0603 16:38:00.541457 2568 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-multus/network-metrics-daemon-54gnw"] Jun 03 16:38:00.543825 ip-10-0-135-67 kubenswrapper[2568]: W0603 16:38:00.543801 2568 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podddc210bb_9544_4ca7_b2de_f84c92d84510.slice/crio-d460c06079202c1b94791edd8025aec2649125339ffbe994f53faea76e7e6a43 WatchSource:0}: Error finding container d460c06079202c1b94791edd8025aec2649125339ffbe994f53faea76e7e6a43: Status 404 returned error can't find the container with id d460c06079202c1b94791edd8025aec2649125339ffbe994f53faea76e7e6a43 Jun 03 16:38:01.029582 ip-10-0-135-67 kubenswrapper[2568]: I0603 16:38:01.029550 2568 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-console/console-789c8dd45d-kddjx"] Jun 03 16:38:01.033217 ip-10-0-135-67 kubenswrapper[2568]: I0603 16:38:01.033193 2568 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-789c8dd45d-kddjx" Jun 03 16:38:01.037373 ip-10-0-135-67 kubenswrapper[2568]: I0603 16:38:01.036800 2568 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-oauth-config\"" Jun 03 16:38:01.037373 ip-10-0-135-67 kubenswrapper[2568]: I0603 16:38:01.036980 2568 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"oauth-serving-cert\"" Jun 03 16:38:01.037632 ip-10-0-135-67 kubenswrapper[2568]: I0603 16:38:01.037535 2568 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"console-config\"" Jun 03 16:38:01.037692 ip-10-0-135-67 kubenswrapper[2568]: I0603 16:38:01.037673 2568 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-serving-cert\"" Jun 03 16:38:01.043581 ip-10-0-135-67 kubenswrapper[2568]: I0603 16:38:01.038180 2568 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"service-ca\"" Jun 03 16:38:01.043581 ip-10-0-135-67 kubenswrapper[2568]: I0603 16:38:01.038465 2568 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-dockercfg-6vt6b\"" Jun 03 16:38:01.045272 ip-10-0-135-67 kubenswrapper[2568]: I0603 16:38:01.045242 2568 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-789c8dd45d-kddjx"] Jun 03 16:38:01.046554 ip-10-0-135-67 kubenswrapper[2568]: I0603 16:38:01.046533 2568 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"trusted-ca-bundle\"" Jun 03 16:38:01.086208 ip-10-0-135-67 kubenswrapper[2568]: I0603 16:38:01.086174 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/4aa6eb4a-6c7e-4c1e-bd89-2bb19d8a7ca4-console-oauth-config\") pod \"console-789c8dd45d-kddjx\" (UID: \"4aa6eb4a-6c7e-4c1e-bd89-2bb19d8a7ca4\") " pod="openshift-console/console-789c8dd45d-kddjx" Jun 03 16:38:01.086347 ip-10-0-135-67 kubenswrapper[2568]: I0603 16:38:01.086215 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/4aa6eb4a-6c7e-4c1e-bd89-2bb19d8a7ca4-service-ca\") pod \"console-789c8dd45d-kddjx\" (UID: \"4aa6eb4a-6c7e-4c1e-bd89-2bb19d8a7ca4\") " pod="openshift-console/console-789c8dd45d-kddjx" Jun 03 16:38:01.086347 ip-10-0-135-67 kubenswrapper[2568]: I0603 16:38:01.086251 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-7sq8r\" (UniqueName: \"kubernetes.io/projected/4aa6eb4a-6c7e-4c1e-bd89-2bb19d8a7ca4-kube-api-access-7sq8r\") pod \"console-789c8dd45d-kddjx\" (UID: \"4aa6eb4a-6c7e-4c1e-bd89-2bb19d8a7ca4\") " pod="openshift-console/console-789c8dd45d-kddjx" Jun 03 16:38:01.086459 ip-10-0-135-67 kubenswrapper[2568]: I0603 16:38:01.086350 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/4aa6eb4a-6c7e-4c1e-bd89-2bb19d8a7ca4-trusted-ca-bundle\") pod \"console-789c8dd45d-kddjx\" (UID: \"4aa6eb4a-6c7e-4c1e-bd89-2bb19d8a7ca4\") " pod="openshift-console/console-789c8dd45d-kddjx" Jun 03 16:38:01.086459 ip-10-0-135-67 kubenswrapper[2568]: I0603 16:38:01.086408 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/4aa6eb4a-6c7e-4c1e-bd89-2bb19d8a7ca4-console-serving-cert\") pod \"console-789c8dd45d-kddjx\" (UID: \"4aa6eb4a-6c7e-4c1e-bd89-2bb19d8a7ca4\") " pod="openshift-console/console-789c8dd45d-kddjx" Jun 03 16:38:01.086459 ip-10-0-135-67 kubenswrapper[2568]: I0603 16:38:01.086441 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/4aa6eb4a-6c7e-4c1e-bd89-2bb19d8a7ca4-console-config\") pod \"console-789c8dd45d-kddjx\" (UID: \"4aa6eb4a-6c7e-4c1e-bd89-2bb19d8a7ca4\") " pod="openshift-console/console-789c8dd45d-kddjx" Jun 03 16:38:01.086613 ip-10-0-135-67 kubenswrapper[2568]: I0603 16:38:01.086468 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/4aa6eb4a-6c7e-4c1e-bd89-2bb19d8a7ca4-oauth-serving-cert\") pod \"console-789c8dd45d-kddjx\" (UID: \"4aa6eb4a-6c7e-4c1e-bd89-2bb19d8a7ca4\") " pod="openshift-console/console-789c8dd45d-kddjx" Jun 03 16:38:01.187648 ip-10-0-135-67 kubenswrapper[2568]: I0603 16:38:01.187612 2568 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/4aa6eb4a-6c7e-4c1e-bd89-2bb19d8a7ca4-console-serving-cert\") pod \"console-789c8dd45d-kddjx\" (UID: \"4aa6eb4a-6c7e-4c1e-bd89-2bb19d8a7ca4\") " pod="openshift-console/console-789c8dd45d-kddjx" Jun 03 16:38:01.188091 ip-10-0-135-67 kubenswrapper[2568]: I0603 16:38:01.187658 2568 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/4aa6eb4a-6c7e-4c1e-bd89-2bb19d8a7ca4-console-config\") pod \"console-789c8dd45d-kddjx\" (UID: \"4aa6eb4a-6c7e-4c1e-bd89-2bb19d8a7ca4\") " pod="openshift-console/console-789c8dd45d-kddjx" Jun 03 16:38:01.188091 ip-10-0-135-67 kubenswrapper[2568]: I0603 16:38:01.187696 2568 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/4aa6eb4a-6c7e-4c1e-bd89-2bb19d8a7ca4-oauth-serving-cert\") pod \"console-789c8dd45d-kddjx\" (UID: \"4aa6eb4a-6c7e-4c1e-bd89-2bb19d8a7ca4\") " pod="openshift-console/console-789c8dd45d-kddjx" Jun 03 16:38:01.188091 ip-10-0-135-67 kubenswrapper[2568]: I0603 16:38:01.187781 2568 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/4aa6eb4a-6c7e-4c1e-bd89-2bb19d8a7ca4-console-oauth-config\") pod \"console-789c8dd45d-kddjx\" (UID: \"4aa6eb4a-6c7e-4c1e-bd89-2bb19d8a7ca4\") " pod="openshift-console/console-789c8dd45d-kddjx" Jun 03 16:38:01.188091 ip-10-0-135-67 kubenswrapper[2568]: I0603 16:38:01.187808 2568 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/4aa6eb4a-6c7e-4c1e-bd89-2bb19d8a7ca4-service-ca\") pod \"console-789c8dd45d-kddjx\" (UID: \"4aa6eb4a-6c7e-4c1e-bd89-2bb19d8a7ca4\") " pod="openshift-console/console-789c8dd45d-kddjx" Jun 03 16:38:01.188091 ip-10-0-135-67 kubenswrapper[2568]: I0603 16:38:01.187842 2568 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-7sq8r\" (UniqueName: \"kubernetes.io/projected/4aa6eb4a-6c7e-4c1e-bd89-2bb19d8a7ca4-kube-api-access-7sq8r\") pod \"console-789c8dd45d-kddjx\" (UID: \"4aa6eb4a-6c7e-4c1e-bd89-2bb19d8a7ca4\") " pod="openshift-console/console-789c8dd45d-kddjx" Jun 03 16:38:01.188091 ip-10-0-135-67 kubenswrapper[2568]: I0603 16:38:01.187888 2568 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/4aa6eb4a-6c7e-4c1e-bd89-2bb19d8a7ca4-trusted-ca-bundle\") pod \"console-789c8dd45d-kddjx\" (UID: \"4aa6eb4a-6c7e-4c1e-bd89-2bb19d8a7ca4\") " pod="openshift-console/console-789c8dd45d-kddjx" Jun 03 16:38:01.188610 ip-10-0-135-67 kubenswrapper[2568]: I0603 16:38:01.188575 2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/4aa6eb4a-6c7e-4c1e-bd89-2bb19d8a7ca4-oauth-serving-cert\") pod \"console-789c8dd45d-kddjx\" (UID: \"4aa6eb4a-6c7e-4c1e-bd89-2bb19d8a7ca4\") " pod="openshift-console/console-789c8dd45d-kddjx" Jun 03 16:38:01.188898 ip-10-0-135-67 kubenswrapper[2568]: I0603 16:38:01.188878 2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/4aa6eb4a-6c7e-4c1e-bd89-2bb19d8a7ca4-service-ca\") pod \"console-789c8dd45d-kddjx\" (UID: \"4aa6eb4a-6c7e-4c1e-bd89-2bb19d8a7ca4\") " pod="openshift-console/console-789c8dd45d-kddjx" Jun 03 16:38:01.188957 ip-10-0-135-67 kubenswrapper[2568]: I0603 16:38:01.188935 2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/4aa6eb4a-6c7e-4c1e-bd89-2bb19d8a7ca4-console-config\") pod \"console-789c8dd45d-kddjx\" (UID: \"4aa6eb4a-6c7e-4c1e-bd89-2bb19d8a7ca4\") " pod="openshift-console/console-789c8dd45d-kddjx" Jun 03 16:38:01.189677 ip-10-0-135-67 kubenswrapper[2568]: I0603 16:38:01.189522 2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/4aa6eb4a-6c7e-4c1e-bd89-2bb19d8a7ca4-trusted-ca-bundle\") pod \"console-789c8dd45d-kddjx\" (UID: \"4aa6eb4a-6c7e-4c1e-bd89-2bb19d8a7ca4\") " pod="openshift-console/console-789c8dd45d-kddjx" Jun 03 16:38:01.190867 ip-10-0-135-67 kubenswrapper[2568]: I0603 16:38:01.190813 2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/4aa6eb4a-6c7e-4c1e-bd89-2bb19d8a7ca4-console-serving-cert\") pod \"console-789c8dd45d-kddjx\" (UID: \"4aa6eb4a-6c7e-4c1e-bd89-2bb19d8a7ca4\") " pod="openshift-console/console-789c8dd45d-kddjx" Jun 03 16:38:01.191535 ip-10-0-135-67 kubenswrapper[2568]: I0603 16:38:01.191511 2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/4aa6eb4a-6c7e-4c1e-bd89-2bb19d8a7ca4-console-oauth-config\") pod \"console-789c8dd45d-kddjx\" (UID: \"4aa6eb4a-6c7e-4c1e-bd89-2bb19d8a7ca4\") " pod="openshift-console/console-789c8dd45d-kddjx" Jun 03 16:38:01.196340 ip-10-0-135-67 kubenswrapper[2568]: I0603 16:38:01.196315 2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-7sq8r\" (UniqueName: \"kubernetes.io/projected/4aa6eb4a-6c7e-4c1e-bd89-2bb19d8a7ca4-kube-api-access-7sq8r\") pod \"console-789c8dd45d-kddjx\" (UID: \"4aa6eb4a-6c7e-4c1e-bd89-2bb19d8a7ca4\") " pod="openshift-console/console-789c8dd45d-kddjx" Jun 03 16:38:01.249320 ip-10-0-135-67 kubenswrapper[2568]: I0603 16:38:01.249269 2568 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-54gnw" event={"ID":"ddc210bb-9544-4ca7-b2de-f84c92d84510","Type":"ContainerStarted","Data":"d460c06079202c1b94791edd8025aec2649125339ffbe994f53faea76e7e6a43"} Jun 03 16:38:01.352640 ip-10-0-135-67 kubenswrapper[2568]: I0603 16:38:01.352556 2568 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-789c8dd45d-kddjx" Jun 03 16:38:01.500584 ip-10-0-135-67 kubenswrapper[2568]: I0603 16:38:01.500558 2568 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-789c8dd45d-kddjx"] Jun 03 16:38:01.648554 ip-10-0-135-67 kubenswrapper[2568]: W0603 16:38:01.648469 2568 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod4aa6eb4a_6c7e_4c1e_bd89_2bb19d8a7ca4.slice/crio-2fdfd1f83a087435576eeb6592c7d52059def89c411a2ae0572e8575f3b06bd6 WatchSource:0}: Error finding container 2fdfd1f83a087435576eeb6592c7d52059def89c411a2ae0572e8575f3b06bd6: Status 404 returned error can't find the container with id 2fdfd1f83a087435576eeb6592c7d52059def89c411a2ae0572e8575f3b06bd6 Jun 03 16:38:02.253961 ip-10-0-135-67 kubenswrapper[2568]: I0603 16:38:02.253924 2568 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-789c8dd45d-kddjx" event={"ID":"4aa6eb4a-6c7e-4c1e-bd89-2bb19d8a7ca4","Type":"ContainerStarted","Data":"276fcdfb4d59fe9e2ac27c209168744331cea52cab69538ce108961c49234b76"} Jun 03 16:38:02.253961 ip-10-0-135-67 kubenswrapper[2568]: I0603 16:38:02.253960 2568 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-789c8dd45d-kddjx" event={"ID":"4aa6eb4a-6c7e-4c1e-bd89-2bb19d8a7ca4","Type":"ContainerStarted","Data":"2fdfd1f83a087435576eeb6592c7d52059def89c411a2ae0572e8575f3b06bd6"} Jun 03 16:38:02.255481 ip-10-0-135-67 kubenswrapper[2568]: I0603 16:38:02.255458 2568 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-54gnw" event={"ID":"ddc210bb-9544-4ca7-b2de-f84c92d84510","Type":"ContainerStarted","Data":"168045611c22a54f6701bbb06ff578b3e38414eafbcd47a59ee5a798fae1bfee"} Jun 03 16:38:02.255587 ip-10-0-135-67 kubenswrapper[2568]: I0603 16:38:02.255487 2568 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-54gnw" event={"ID":"ddc210bb-9544-4ca7-b2de-f84c92d84510","Type":"ContainerStarted","Data":"e086b3ea75b0aa31778c7fea3290b0b187d2782a9f7c8e9dc2477f31c7e82c6b"} Jun 03 16:38:02.271050 ip-10-0-135-67 kubenswrapper[2568]: I0603 16:38:02.270989 2568 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-console/console-789c8dd45d-kddjx" podStartSLOduration=1.270976096 podStartE2EDuration="1.270976096s" podCreationTimestamp="2026-06-03 16:38:01 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2026-06-03 16:38:02.269617036 +0000 UTC m=+254.411791690" watchObservedRunningTime="2026-06-03 16:38:02.270976096 +0000 UTC m=+254.413150750" Jun 03 16:38:02.284881 ip-10-0-135-67 kubenswrapper[2568]: I0603 16:38:02.284833 2568 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-multus/network-metrics-daemon-54gnw" podStartSLOduration=253.15567758 podStartE2EDuration="4m14.284821429s" podCreationTimestamp="2026-06-03 16:33:48 +0000 UTC" firstStartedPulling="2026-06-03 16:38:00.545673229 +0000 UTC m=+252.687847861" lastFinishedPulling="2026-06-03 16:38:01.674817074 +0000 UTC m=+253.816991710" observedRunningTime="2026-06-03 16:38:02.283706625 +0000 UTC m=+254.425881279" watchObservedRunningTime="2026-06-03 16:38:02.284821429 +0000 UTC m=+254.426996127" Jun 03 16:38:11.353350 ip-10-0-135-67 kubenswrapper[2568]: I0603 16:38:11.353250 2568 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-console/console-789c8dd45d-kddjx" Jun 03 16:38:11.353350 ip-10-0-135-67 kubenswrapper[2568]: I0603 16:38:11.353299 2568 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/console-789c8dd45d-kddjx" Jun 03 16:38:11.358020 ip-10-0-135-67 kubenswrapper[2568]: I0603 16:38:11.357977 2568 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-console/console-789c8dd45d-kddjx" Jun 03 16:38:12.293043 ip-10-0-135-67 kubenswrapper[2568]: I0603 16:38:12.293011 2568 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console/console-789c8dd45d-kddjx" Jun 03 16:38:12.412282 ip-10-0-135-67 kubenswrapper[2568]: I0603 16:38:12.412251 2568 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-console/console-594696d8bf-kst4c"] Jun 03 16:38:12.414708 ip-10-0-135-67 kubenswrapper[2568]: I0603 16:38:12.414684 2568 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-594696d8bf-kst4c" Jun 03 16:38:12.421071 ip-10-0-135-67 kubenswrapper[2568]: I0603 16:38:12.421038 2568 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-594696d8bf-kst4c"] Jun 03 16:38:12.483539 ip-10-0-135-67 kubenswrapper[2568]: I0603 16:38:12.483508 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/c9c02cf6-177a-47af-ad2c-756b87157852-oauth-serving-cert\") pod \"console-594696d8bf-kst4c\" (UID: \"c9c02cf6-177a-47af-ad2c-756b87157852\") " pod="openshift-console/console-594696d8bf-kst4c" Jun 03 16:38:12.483670 ip-10-0-135-67 kubenswrapper[2568]: I0603 16:38:12.483548 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/c9c02cf6-177a-47af-ad2c-756b87157852-console-oauth-config\") pod \"console-594696d8bf-kst4c\" (UID: \"c9c02cf6-177a-47af-ad2c-756b87157852\") " pod="openshift-console/console-594696d8bf-kst4c" Jun 03 16:38:12.483670 ip-10-0-135-67 kubenswrapper[2568]: I0603 16:38:12.483575 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/c9c02cf6-177a-47af-ad2c-756b87157852-service-ca\") pod \"console-594696d8bf-kst4c\" (UID: \"c9c02cf6-177a-47af-ad2c-756b87157852\") " pod="openshift-console/console-594696d8bf-kst4c" Jun 03 16:38:12.483784 ip-10-0-135-67 kubenswrapper[2568]: I0603 16:38:12.483737 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/c9c02cf6-177a-47af-ad2c-756b87157852-trusted-ca-bundle\") pod \"console-594696d8bf-kst4c\" (UID: \"c9c02cf6-177a-47af-ad2c-756b87157852\") " pod="openshift-console/console-594696d8bf-kst4c" Jun 03 16:38:12.483900 ip-10-0-135-67 kubenswrapper[2568]: I0603 16:38:12.483874 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/c9c02cf6-177a-47af-ad2c-756b87157852-console-config\") pod \"console-594696d8bf-kst4c\" (UID: \"c9c02cf6-177a-47af-ad2c-756b87157852\") " pod="openshift-console/console-594696d8bf-kst4c" Jun 03 16:38:12.483999 ip-10-0-135-67 kubenswrapper[2568]: I0603 16:38:12.483927 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/c9c02cf6-177a-47af-ad2c-756b87157852-console-serving-cert\") pod \"console-594696d8bf-kst4c\" (UID: \"c9c02cf6-177a-47af-ad2c-756b87157852\") " pod="openshift-console/console-594696d8bf-kst4c" Jun 03 16:38:12.483999 ip-10-0-135-67 kubenswrapper[2568]: I0603 16:38:12.483962 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-5tfsj\" (UniqueName: \"kubernetes.io/projected/c9c02cf6-177a-47af-ad2c-756b87157852-kube-api-access-5tfsj\") pod \"console-594696d8bf-kst4c\" (UID: \"c9c02cf6-177a-47af-ad2c-756b87157852\") " pod="openshift-console/console-594696d8bf-kst4c" Jun 03 16:38:12.584703 ip-10-0-135-67 kubenswrapper[2568]: I0603 16:38:12.584640 2568 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/c9c02cf6-177a-47af-ad2c-756b87157852-console-oauth-config\") pod \"console-594696d8bf-kst4c\" (UID: \"c9c02cf6-177a-47af-ad2c-756b87157852\") " pod="openshift-console/console-594696d8bf-kst4c" Jun 03 16:38:12.584703 ip-10-0-135-67 kubenswrapper[2568]: I0603 16:38:12.584669 2568 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/c9c02cf6-177a-47af-ad2c-756b87157852-service-ca\") pod \"console-594696d8bf-kst4c\" (UID: \"c9c02cf6-177a-47af-ad2c-756b87157852\") " pod="openshift-console/console-594696d8bf-kst4c" Jun 03 16:38:12.584868 ip-10-0-135-67 kubenswrapper[2568]: I0603 16:38:12.584706 2568 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/c9c02cf6-177a-47af-ad2c-756b87157852-trusted-ca-bundle\") pod \"console-594696d8bf-kst4c\" (UID: \"c9c02cf6-177a-47af-ad2c-756b87157852\") " pod="openshift-console/console-594696d8bf-kst4c" Jun 03 16:38:12.584868 ip-10-0-135-67 kubenswrapper[2568]: I0603 16:38:12.584725 2568 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/c9c02cf6-177a-47af-ad2c-756b87157852-console-config\") pod \"console-594696d8bf-kst4c\" (UID: \"c9c02cf6-177a-47af-ad2c-756b87157852\") " pod="openshift-console/console-594696d8bf-kst4c" Jun 03 16:38:12.584868 ip-10-0-135-67 kubenswrapper[2568]: I0603 16:38:12.584758 2568 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/c9c02cf6-177a-47af-ad2c-756b87157852-console-serving-cert\") pod \"console-594696d8bf-kst4c\" (UID: \"c9c02cf6-177a-47af-ad2c-756b87157852\") " pod="openshift-console/console-594696d8bf-kst4c" Jun 03 16:38:12.584868 ip-10-0-135-67 kubenswrapper[2568]: I0603 16:38:12.584786 2568 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-5tfsj\" (UniqueName: \"kubernetes.io/projected/c9c02cf6-177a-47af-ad2c-756b87157852-kube-api-access-5tfsj\") pod \"console-594696d8bf-kst4c\" (UID: \"c9c02cf6-177a-47af-ad2c-756b87157852\") " pod="openshift-console/console-594696d8bf-kst4c" Jun 03 16:38:12.584868 ip-10-0-135-67 kubenswrapper[2568]: I0603 16:38:12.584839 2568 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/c9c02cf6-177a-47af-ad2c-756b87157852-oauth-serving-cert\") pod \"console-594696d8bf-kst4c\" (UID: \"c9c02cf6-177a-47af-ad2c-756b87157852\") " pod="openshift-console/console-594696d8bf-kst4c" Jun 03 16:38:12.585408 ip-10-0-135-67 kubenswrapper[2568]: I0603 16:38:12.585384 2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/c9c02cf6-177a-47af-ad2c-756b87157852-service-ca\") pod \"console-594696d8bf-kst4c\" (UID: \"c9c02cf6-177a-47af-ad2c-756b87157852\") " pod="openshift-console/console-594696d8bf-kst4c" Jun 03 16:38:12.585523 ip-10-0-135-67 kubenswrapper[2568]: I0603 16:38:12.585497 2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/c9c02cf6-177a-47af-ad2c-756b87157852-console-config\") pod \"console-594696d8bf-kst4c\" (UID: \"c9c02cf6-177a-47af-ad2c-756b87157852\") " pod="openshift-console/console-594696d8bf-kst4c" Jun 03 16:38:12.585605 ip-10-0-135-67 kubenswrapper[2568]: I0603 16:38:12.585584 2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/c9c02cf6-177a-47af-ad2c-756b87157852-oauth-serving-cert\") pod \"console-594696d8bf-kst4c\" (UID: \"c9c02cf6-177a-47af-ad2c-756b87157852\") " pod="openshift-console/console-594696d8bf-kst4c" Jun 03 16:38:12.585682 ip-10-0-135-67 kubenswrapper[2568]: I0603 16:38:12.585665 2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/c9c02cf6-177a-47af-ad2c-756b87157852-trusted-ca-bundle\") pod \"console-594696d8bf-kst4c\" (UID: \"c9c02cf6-177a-47af-ad2c-756b87157852\") " pod="openshift-console/console-594696d8bf-kst4c" Jun 03 16:38:12.587231 ip-10-0-135-67 kubenswrapper[2568]: I0603 16:38:12.587203 2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/c9c02cf6-177a-47af-ad2c-756b87157852-console-serving-cert\") pod \"console-594696d8bf-kst4c\" (UID: \"c9c02cf6-177a-47af-ad2c-756b87157852\") " pod="openshift-console/console-594696d8bf-kst4c" Jun 03 16:38:12.587231 ip-10-0-135-67 kubenswrapper[2568]: I0603 16:38:12.587212 2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/c9c02cf6-177a-47af-ad2c-756b87157852-console-oauth-config\") pod \"console-594696d8bf-kst4c\" (UID: \"c9c02cf6-177a-47af-ad2c-756b87157852\") " pod="openshift-console/console-594696d8bf-kst4c" Jun 03 16:38:12.592705 ip-10-0-135-67 kubenswrapper[2568]: I0603 16:38:12.592684 2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-5tfsj\" (UniqueName: \"kubernetes.io/projected/c9c02cf6-177a-47af-ad2c-756b87157852-kube-api-access-5tfsj\") pod \"console-594696d8bf-kst4c\" (UID: \"c9c02cf6-177a-47af-ad2c-756b87157852\") " pod="openshift-console/console-594696d8bf-kst4c" Jun 03 16:38:12.725325 ip-10-0-135-67 kubenswrapper[2568]: I0603 16:38:12.725300 2568 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-594696d8bf-kst4c" Jun 03 16:38:12.849060 ip-10-0-135-67 kubenswrapper[2568]: I0603 16:38:12.848871 2568 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-594696d8bf-kst4c"] Jun 03 16:38:12.851644 ip-10-0-135-67 kubenswrapper[2568]: W0603 16:38:12.851616 2568 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podc9c02cf6_177a_47af_ad2c_756b87157852.slice/crio-d85da68e62a8df94f931dfc4c00c229354d570c647a6890e987903ebe167d4da WatchSource:0}: Error finding container d85da68e62a8df94f931dfc4c00c229354d570c647a6890e987903ebe167d4da: Status 404 returned error can't find the container with id d85da68e62a8df94f931dfc4c00c229354d570c647a6890e987903ebe167d4da Jun 03 16:38:13.295025 ip-10-0-135-67 kubenswrapper[2568]: I0603 16:38:13.294967 2568 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-594696d8bf-kst4c" event={"ID":"c9c02cf6-177a-47af-ad2c-756b87157852","Type":"ContainerStarted","Data":"2279414b99b5eb4a5b86f96480f8dec329dc5d8f47b916475e4166b82a8ea47f"} Jun 03 16:38:13.295212 ip-10-0-135-67 kubenswrapper[2568]: I0603 16:38:13.295039 2568 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-594696d8bf-kst4c" event={"ID":"c9c02cf6-177a-47af-ad2c-756b87157852","Type":"ContainerStarted","Data":"d85da68e62a8df94f931dfc4c00c229354d570c647a6890e987903ebe167d4da"} Jun 03 16:38:13.312011 ip-10-0-135-67 kubenswrapper[2568]: I0603 16:38:13.311964 2568 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-console/console-594696d8bf-kst4c" podStartSLOduration=1.311951953 podStartE2EDuration="1.311951953s" podCreationTimestamp="2026-06-03 16:38:12 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2026-06-03 16:38:13.310418948 +0000 UTC m=+265.452593602" watchObservedRunningTime="2026-06-03 16:38:13.311951953 +0000 UTC m=+265.454126606" Jun 03 16:38:22.725950 ip-10-0-135-67 kubenswrapper[2568]: I0603 16:38:22.725918 2568 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-console/console-594696d8bf-kst4c" Jun 03 16:38:22.725950 ip-10-0-135-67 kubenswrapper[2568]: I0603 16:38:22.725954 2568 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/console-594696d8bf-kst4c" Jun 03 16:38:22.730361 ip-10-0-135-67 kubenswrapper[2568]: I0603 16:38:22.730343 2568 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-console/console-594696d8bf-kst4c" Jun 03 16:38:23.328794 ip-10-0-135-67 kubenswrapper[2568]: I0603 16:38:23.328763 2568 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console/console-594696d8bf-kst4c" Jun 03 16:38:23.374660 ip-10-0-135-67 kubenswrapper[2568]: I0603 16:38:23.374629 2568 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openshift-console/console-789c8dd45d-kddjx"] Jun 03 16:38:48.324270 ip-10-0-135-67 kubenswrapper[2568]: I0603 16:38:48.324238 2568 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-86d7c6cc77-mwpf2_b1e67fcc-fd50-4a1e-af4e-48c44fb8db7d/console-operator/1.log" Jun 03 16:38:48.325426 ip-10-0-135-67 kubenswrapper[2568]: I0603 16:38:48.325403 2568 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-86d7c6cc77-mwpf2_b1e67fcc-fd50-4a1e-af4e-48c44fb8db7d/console-operator/1.log" Jun 03 16:38:48.330861 ip-10-0-135-67 kubenswrapper[2568]: I0603 16:38:48.330842 2568 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-94fdt_dd3dac0d-018e-4c8a-98c7-daedef6dedb9/ovn-acl-logging/0.log" Jun 03 16:38:48.331752 ip-10-0-135-67 kubenswrapper[2568]: I0603 16:38:48.331732 2568 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-94fdt_dd3dac0d-018e-4c8a-98c7-daedef6dedb9/ovn-acl-logging/0.log" Jun 03 16:38:48.333604 ip-10-0-135-67 kubenswrapper[2568]: I0603 16:38:48.333587 2568 kubelet.go:1628] "Image garbage collection succeeded" Jun 03 16:38:48.395221 ip-10-0-135-67 kubenswrapper[2568]: I0603 16:38:48.395085 2568 kuberuntime_container.go:864] "Killing container with a grace period" pod="openshift-console/console-789c8dd45d-kddjx" podUID="4aa6eb4a-6c7e-4c1e-bd89-2bb19d8a7ca4" containerName="console" containerID="cri-o://276fcdfb4d59fe9e2ac27c209168744331cea52cab69538ce108961c49234b76" gracePeriod=15 Jun 03 16:38:48.638393 ip-10-0-135-67 kubenswrapper[2568]: I0603 16:38:48.638373 2568 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console_console-789c8dd45d-kddjx_4aa6eb4a-6c7e-4c1e-bd89-2bb19d8a7ca4/console/0.log" Jun 03 16:38:48.638476 ip-10-0-135-67 kubenswrapper[2568]: I0603 16:38:48.638431 2568 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-789c8dd45d-kddjx" Jun 03 16:38:48.668363 ip-10-0-135-67 kubenswrapper[2568]: I0603 16:38:48.668340 2568 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/4aa6eb4a-6c7e-4c1e-bd89-2bb19d8a7ca4-console-oauth-config\") pod \"4aa6eb4a-6c7e-4c1e-bd89-2bb19d8a7ca4\" (UID: \"4aa6eb4a-6c7e-4c1e-bd89-2bb19d8a7ca4\") " Jun 03 16:38:48.668471 ip-10-0-135-67 kubenswrapper[2568]: I0603 16:38:48.668371 2568 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-7sq8r\" (UniqueName: \"kubernetes.io/projected/4aa6eb4a-6c7e-4c1e-bd89-2bb19d8a7ca4-kube-api-access-7sq8r\") pod \"4aa6eb4a-6c7e-4c1e-bd89-2bb19d8a7ca4\" (UID: \"4aa6eb4a-6c7e-4c1e-bd89-2bb19d8a7ca4\") " Jun 03 16:38:48.668471 ip-10-0-135-67 kubenswrapper[2568]: I0603 16:38:48.668405 2568 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/4aa6eb4a-6c7e-4c1e-bd89-2bb19d8a7ca4-console-config\") pod \"4aa6eb4a-6c7e-4c1e-bd89-2bb19d8a7ca4\" (UID: \"4aa6eb4a-6c7e-4c1e-bd89-2bb19d8a7ca4\") " Jun 03 16:38:48.668471 ip-10-0-135-67 kubenswrapper[2568]: I0603 16:38:48.668424 2568 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/4aa6eb4a-6c7e-4c1e-bd89-2bb19d8a7ca4-console-serving-cert\") pod \"4aa6eb4a-6c7e-4c1e-bd89-2bb19d8a7ca4\" (UID: \"4aa6eb4a-6c7e-4c1e-bd89-2bb19d8a7ca4\") " Jun 03 16:38:48.668654 ip-10-0-135-67 kubenswrapper[2568]: I0603 16:38:48.668630 2568 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/4aa6eb4a-6c7e-4c1e-bd89-2bb19d8a7ca4-oauth-serving-cert\") pod \"4aa6eb4a-6c7e-4c1e-bd89-2bb19d8a7ca4\" (UID: \"4aa6eb4a-6c7e-4c1e-bd89-2bb19d8a7ca4\") " Jun 03 16:38:48.668716 ip-10-0-135-67 kubenswrapper[2568]: I0603 16:38:48.668701 2568 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/4aa6eb4a-6c7e-4c1e-bd89-2bb19d8a7ca4-trusted-ca-bundle\") pod \"4aa6eb4a-6c7e-4c1e-bd89-2bb19d8a7ca4\" (UID: \"4aa6eb4a-6c7e-4c1e-bd89-2bb19d8a7ca4\") " Jun 03 16:38:48.668770 ip-10-0-135-67 kubenswrapper[2568]: I0603 16:38:48.668743 2568 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/4aa6eb4a-6c7e-4c1e-bd89-2bb19d8a7ca4-service-ca\") pod \"4aa6eb4a-6c7e-4c1e-bd89-2bb19d8a7ca4\" (UID: \"4aa6eb4a-6c7e-4c1e-bd89-2bb19d8a7ca4\") " Jun 03 16:38:48.668918 ip-10-0-135-67 kubenswrapper[2568]: I0603 16:38:48.668883 2568 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/4aa6eb4a-6c7e-4c1e-bd89-2bb19d8a7ca4-console-config" (OuterVolumeSpecName: "console-config") pod "4aa6eb4a-6c7e-4c1e-bd89-2bb19d8a7ca4" (UID: "4aa6eb4a-6c7e-4c1e-bd89-2bb19d8a7ca4"). InnerVolumeSpecName "console-config". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jun 03 16:38:48.668996 ip-10-0-135-67 kubenswrapper[2568]: I0603 16:38:48.668937 2568 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/4aa6eb4a-6c7e-4c1e-bd89-2bb19d8a7ca4-oauth-serving-cert" (OuterVolumeSpecName: "oauth-serving-cert") pod "4aa6eb4a-6c7e-4c1e-bd89-2bb19d8a7ca4" (UID: "4aa6eb4a-6c7e-4c1e-bd89-2bb19d8a7ca4"). InnerVolumeSpecName "oauth-serving-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jun 03 16:38:48.669155 ip-10-0-135-67 kubenswrapper[2568]: I0603 16:38:48.669130 2568 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/4aa6eb4a-6c7e-4c1e-bd89-2bb19d8a7ca4-trusted-ca-bundle" (OuterVolumeSpecName: "trusted-ca-bundle") pod "4aa6eb4a-6c7e-4c1e-bd89-2bb19d8a7ca4" (UID: "4aa6eb4a-6c7e-4c1e-bd89-2bb19d8a7ca4"). InnerVolumeSpecName "trusted-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jun 03 16:38:48.669194 ip-10-0-135-67 kubenswrapper[2568]: I0603 16:38:48.669180 2568 reconciler_common.go:299] "Volume detached for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/4aa6eb4a-6c7e-4c1e-bd89-2bb19d8a7ca4-console-config\") on node \"ip-10-0-135-67.ec2.internal\" DevicePath \"\"" Jun 03 16:38:48.669234 ip-10-0-135-67 kubenswrapper[2568]: I0603 16:38:48.669202 2568 reconciler_common.go:299] "Volume detached for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/4aa6eb4a-6c7e-4c1e-bd89-2bb19d8a7ca4-oauth-serving-cert\") on node \"ip-10-0-135-67.ec2.internal\" DevicePath \"\"" Jun 03 16:38:48.669234 ip-10-0-135-67 kubenswrapper[2568]: I0603 16:38:48.669210 2568 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/4aa6eb4a-6c7e-4c1e-bd89-2bb19d8a7ca4-service-ca" (OuterVolumeSpecName: "service-ca") pod "4aa6eb4a-6c7e-4c1e-bd89-2bb19d8a7ca4" (UID: "4aa6eb4a-6c7e-4c1e-bd89-2bb19d8a7ca4"). InnerVolumeSpecName "service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jun 03 16:38:48.670490 ip-10-0-135-67 kubenswrapper[2568]: I0603 16:38:48.670464 2568 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/4aa6eb4a-6c7e-4c1e-bd89-2bb19d8a7ca4-console-serving-cert" (OuterVolumeSpecName: "console-serving-cert") pod "4aa6eb4a-6c7e-4c1e-bd89-2bb19d8a7ca4" (UID: "4aa6eb4a-6c7e-4c1e-bd89-2bb19d8a7ca4"). InnerVolumeSpecName "console-serving-cert". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jun 03 16:38:48.670706 ip-10-0-135-67 kubenswrapper[2568]: I0603 16:38:48.670685 2568 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/4aa6eb4a-6c7e-4c1e-bd89-2bb19d8a7ca4-kube-api-access-7sq8r" (OuterVolumeSpecName: "kube-api-access-7sq8r") pod "4aa6eb4a-6c7e-4c1e-bd89-2bb19d8a7ca4" (UID: "4aa6eb4a-6c7e-4c1e-bd89-2bb19d8a7ca4"). InnerVolumeSpecName "kube-api-access-7sq8r". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 03 16:38:48.670878 ip-10-0-135-67 kubenswrapper[2568]: I0603 16:38:48.670864 2568 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/4aa6eb4a-6c7e-4c1e-bd89-2bb19d8a7ca4-console-oauth-config" (OuterVolumeSpecName: "console-oauth-config") pod "4aa6eb4a-6c7e-4c1e-bd89-2bb19d8a7ca4" (UID: "4aa6eb4a-6c7e-4c1e-bd89-2bb19d8a7ca4"). InnerVolumeSpecName "console-oauth-config". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jun 03 16:38:48.770158 ip-10-0-135-67 kubenswrapper[2568]: I0603 16:38:48.770134 2568 reconciler_common.go:299] "Volume detached for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/4aa6eb4a-6c7e-4c1e-bd89-2bb19d8a7ca4-console-oauth-config\") on node \"ip-10-0-135-67.ec2.internal\" DevicePath \"\"" Jun 03 16:38:48.770158 ip-10-0-135-67 kubenswrapper[2568]: I0603 16:38:48.770158 2568 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-7sq8r\" (UniqueName: \"kubernetes.io/projected/4aa6eb4a-6c7e-4c1e-bd89-2bb19d8a7ca4-kube-api-access-7sq8r\") on node \"ip-10-0-135-67.ec2.internal\" DevicePath \"\"" Jun 03 16:38:48.770333 ip-10-0-135-67 kubenswrapper[2568]: I0603 16:38:48.770173 2568 reconciler_common.go:299] "Volume detached for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/4aa6eb4a-6c7e-4c1e-bd89-2bb19d8a7ca4-console-serving-cert\") on node \"ip-10-0-135-67.ec2.internal\" DevicePath \"\"" Jun 03 16:38:48.770333 ip-10-0-135-67 kubenswrapper[2568]: I0603 16:38:48.770186 2568 reconciler_common.go:299] "Volume detached for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/4aa6eb4a-6c7e-4c1e-bd89-2bb19d8a7ca4-trusted-ca-bundle\") on node \"ip-10-0-135-67.ec2.internal\" DevicePath \"\"" Jun 03 16:38:48.770333 ip-10-0-135-67 kubenswrapper[2568]: I0603 16:38:48.770199 2568 reconciler_common.go:299] "Volume detached for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/4aa6eb4a-6c7e-4c1e-bd89-2bb19d8a7ca4-service-ca\") on node \"ip-10-0-135-67.ec2.internal\" DevicePath \"\"" Jun 03 16:38:49.401991 ip-10-0-135-67 kubenswrapper[2568]: I0603 16:38:49.401961 2568 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console_console-789c8dd45d-kddjx_4aa6eb4a-6c7e-4c1e-bd89-2bb19d8a7ca4/console/0.log" Jun 03 16:38:49.402368 ip-10-0-135-67 kubenswrapper[2568]: I0603 16:38:49.402022 2568 generic.go:358] "Generic (PLEG): container finished" podID="4aa6eb4a-6c7e-4c1e-bd89-2bb19d8a7ca4" containerID="276fcdfb4d59fe9e2ac27c209168744331cea52cab69538ce108961c49234b76" exitCode=2 Jun 03 16:38:49.402368 ip-10-0-135-67 kubenswrapper[2568]: I0603 16:38:49.402075 2568 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-789c8dd45d-kddjx" event={"ID":"4aa6eb4a-6c7e-4c1e-bd89-2bb19d8a7ca4","Type":"ContainerDied","Data":"276fcdfb4d59fe9e2ac27c209168744331cea52cab69538ce108961c49234b76"} Jun 03 16:38:49.402368 ip-10-0-135-67 kubenswrapper[2568]: I0603 16:38:49.402102 2568 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-789c8dd45d-kddjx" Jun 03 16:38:49.402368 ip-10-0-135-67 kubenswrapper[2568]: I0603 16:38:49.402112 2568 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-789c8dd45d-kddjx" event={"ID":"4aa6eb4a-6c7e-4c1e-bd89-2bb19d8a7ca4","Type":"ContainerDied","Data":"2fdfd1f83a087435576eeb6592c7d52059def89c411a2ae0572e8575f3b06bd6"} Jun 03 16:38:49.402368 ip-10-0-135-67 kubenswrapper[2568]: I0603 16:38:49.402133 2568 scope.go:117] "RemoveContainer" containerID="276fcdfb4d59fe9e2ac27c209168744331cea52cab69538ce108961c49234b76" Jun 03 16:38:49.410618 ip-10-0-135-67 kubenswrapper[2568]: I0603 16:38:49.410600 2568 scope.go:117] "RemoveContainer" containerID="276fcdfb4d59fe9e2ac27c209168744331cea52cab69538ce108961c49234b76" Jun 03 16:38:49.410861 ip-10-0-135-67 kubenswrapper[2568]: E0603 16:38:49.410840 2568 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"276fcdfb4d59fe9e2ac27c209168744331cea52cab69538ce108961c49234b76\": container with ID starting with 276fcdfb4d59fe9e2ac27c209168744331cea52cab69538ce108961c49234b76 not found: ID does not exist" containerID="276fcdfb4d59fe9e2ac27c209168744331cea52cab69538ce108961c49234b76" Jun 03 16:38:49.410904 ip-10-0-135-67 kubenswrapper[2568]: I0603 16:38:49.410869 2568 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"276fcdfb4d59fe9e2ac27c209168744331cea52cab69538ce108961c49234b76"} err="failed to get container status \"276fcdfb4d59fe9e2ac27c209168744331cea52cab69538ce108961c49234b76\": rpc error: code = NotFound desc = could not find container \"276fcdfb4d59fe9e2ac27c209168744331cea52cab69538ce108961c49234b76\": container with ID starting with 276fcdfb4d59fe9e2ac27c209168744331cea52cab69538ce108961c49234b76 not found: ID does not exist" Jun 03 16:38:49.421519 ip-10-0-135-67 kubenswrapper[2568]: I0603 16:38:49.421496 2568 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openshift-console/console-789c8dd45d-kddjx"] Jun 03 16:38:49.424271 ip-10-0-135-67 kubenswrapper[2568]: I0603 16:38:49.424251 2568 kubelet.go:2547] "SyncLoop REMOVE" source="api" pods=["openshift-console/console-789c8dd45d-kddjx"] Jun 03 16:38:50.409156 ip-10-0-135-67 kubenswrapper[2568]: I0603 16:38:50.409121 2568 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="4aa6eb4a-6c7e-4c1e-bd89-2bb19d8a7ca4" path="/var/lib/kubelet/pods/4aa6eb4a-6c7e-4c1e-bd89-2bb19d8a7ca4/volumes" Jun 03 16:39:21.247956 ip-10-0-135-67 kubenswrapper[2568]: I0603 16:39:21.247923 2568 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-marketplace/2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19dl4dvd"] Jun 03 16:39:21.248428 ip-10-0-135-67 kubenswrapper[2568]: I0603 16:39:21.248267 2568 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="4aa6eb4a-6c7e-4c1e-bd89-2bb19d8a7ca4" containerName="console" Jun 03 16:39:21.248428 ip-10-0-135-67 kubenswrapper[2568]: I0603 16:39:21.248279 2568 state_mem.go:107] "Deleted CPUSet assignment" podUID="4aa6eb4a-6c7e-4c1e-bd89-2bb19d8a7ca4" containerName="console" Jun 03 16:39:21.248428 ip-10-0-135-67 kubenswrapper[2568]: I0603 16:39:21.248333 2568 memory_manager.go:356] "RemoveStaleState removing state" podUID="4aa6eb4a-6c7e-4c1e-bd89-2bb19d8a7ca4" containerName="console" Jun 03 16:39:21.251285 ip-10-0-135-67 kubenswrapper[2568]: I0603 16:39:21.251268 2568 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19dl4dvd" Jun 03 16:39:21.253587 ip-10-0-135-67 kubenswrapper[2568]: I0603 16:39:21.253567 2568 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"kube-root-ca.crt\"" Jun 03 16:39:21.253709 ip-10-0-135-67 kubenswrapper[2568]: I0603 16:39:21.253624 2568 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"openshift-service-ca.crt\"" Jun 03 16:39:21.254333 ip-10-0-135-67 kubenswrapper[2568]: I0603 16:39:21.254317 2568 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-marketplace\"/\"default-dockercfg-mhpmz\"" Jun 03 16:39:21.259814 ip-10-0-135-67 kubenswrapper[2568]: I0603 16:39:21.259790 2568 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19dl4dvd"] Jun 03 16:39:21.321576 ip-10-0-135-67 kubenswrapper[2568]: I0603 16:39:21.321552 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-c2hm6\" (UniqueName: \"kubernetes.io/projected/1400afed-da43-467e-9497-34b2eef9fd23-kube-api-access-c2hm6\") pod \"2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19dl4dvd\" (UID: \"1400afed-da43-467e-9497-34b2eef9fd23\") " pod="openshift-marketplace/2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19dl4dvd" Jun 03 16:39:21.321686 ip-10-0-135-67 kubenswrapper[2568]: I0603 16:39:21.321614 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/1400afed-da43-467e-9497-34b2eef9fd23-util\") pod \"2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19dl4dvd\" (UID: \"1400afed-da43-467e-9497-34b2eef9fd23\") " pod="openshift-marketplace/2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19dl4dvd" Jun 03 16:39:21.321686 ip-10-0-135-67 kubenswrapper[2568]: I0603 16:39:21.321639 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/1400afed-da43-467e-9497-34b2eef9fd23-bundle\") pod \"2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19dl4dvd\" (UID: \"1400afed-da43-467e-9497-34b2eef9fd23\") " pod="openshift-marketplace/2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19dl4dvd" Jun 03 16:39:21.422980 ip-10-0-135-67 kubenswrapper[2568]: I0603 16:39:21.422950 2568 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-c2hm6\" (UniqueName: \"kubernetes.io/projected/1400afed-da43-467e-9497-34b2eef9fd23-kube-api-access-c2hm6\") pod \"2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19dl4dvd\" (UID: \"1400afed-da43-467e-9497-34b2eef9fd23\") " pod="openshift-marketplace/2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19dl4dvd" Jun 03 16:39:21.423118 ip-10-0-135-67 kubenswrapper[2568]: I0603 16:39:21.423018 2568 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/1400afed-da43-467e-9497-34b2eef9fd23-util\") pod \"2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19dl4dvd\" (UID: \"1400afed-da43-467e-9497-34b2eef9fd23\") " pod="openshift-marketplace/2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19dl4dvd" Jun 03 16:39:21.423118 ip-10-0-135-67 kubenswrapper[2568]: I0603 16:39:21.423039 2568 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/1400afed-da43-467e-9497-34b2eef9fd23-bundle\") pod \"2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19dl4dvd\" (UID: \"1400afed-da43-467e-9497-34b2eef9fd23\") " pod="openshift-marketplace/2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19dl4dvd" Jun 03 16:39:21.423339 ip-10-0-135-67 kubenswrapper[2568]: I0603 16:39:21.423324 2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/1400afed-da43-467e-9497-34b2eef9fd23-bundle\") pod \"2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19dl4dvd\" (UID: \"1400afed-da43-467e-9497-34b2eef9fd23\") " pod="openshift-marketplace/2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19dl4dvd" Jun 03 16:39:21.423383 ip-10-0-135-67 kubenswrapper[2568]: I0603 16:39:21.423351 2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/1400afed-da43-467e-9497-34b2eef9fd23-util\") pod \"2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19dl4dvd\" (UID: \"1400afed-da43-467e-9497-34b2eef9fd23\") " pod="openshift-marketplace/2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19dl4dvd" Jun 03 16:39:21.432572 ip-10-0-135-67 kubenswrapper[2568]: I0603 16:39:21.432547 2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-c2hm6\" (UniqueName: \"kubernetes.io/projected/1400afed-da43-467e-9497-34b2eef9fd23-kube-api-access-c2hm6\") pod \"2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19dl4dvd\" (UID: \"1400afed-da43-467e-9497-34b2eef9fd23\") " pod="openshift-marketplace/2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19dl4dvd" Jun 03 16:39:21.561159 ip-10-0-135-67 kubenswrapper[2568]: I0603 16:39:21.561100 2568 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19dl4dvd" Jun 03 16:39:21.690024 ip-10-0-135-67 kubenswrapper[2568]: I0603 16:39:21.689975 2568 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19dl4dvd"] Jun 03 16:39:21.697989 ip-10-0-135-67 kubenswrapper[2568]: I0603 16:39:21.697969 2568 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider Jun 03 16:39:22.491159 ip-10-0-135-67 kubenswrapper[2568]: I0603 16:39:22.491122 2568 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19dl4dvd" event={"ID":"1400afed-da43-467e-9497-34b2eef9fd23","Type":"ContainerStarted","Data":"84137559d0700f728d4bf8d9c30d87cdde5b48dcd4b907204b1b9cded2a23916"} Jun 03 16:39:30.517357 ip-10-0-135-67 kubenswrapper[2568]: I0603 16:39:30.517325 2568 generic.go:358] "Generic (PLEG): container finished" podID="1400afed-da43-467e-9497-34b2eef9fd23" containerID="da156c6fb37da414041b7cb78102ee1fea43fa17d0e00d2c271db54730db4108" exitCode=0 Jun 03 16:39:30.517767 ip-10-0-135-67 kubenswrapper[2568]: I0603 16:39:30.517402 2568 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19dl4dvd" event={"ID":"1400afed-da43-467e-9497-34b2eef9fd23","Type":"ContainerDied","Data":"da156c6fb37da414041b7cb78102ee1fea43fa17d0e00d2c271db54730db4108"} Jun 03 16:39:33.528088 ip-10-0-135-67 kubenswrapper[2568]: I0603 16:39:33.528047 2568 generic.go:358] "Generic (PLEG): container finished" podID="1400afed-da43-467e-9497-34b2eef9fd23" containerID="40fa85d173b79bc7d891da605e5e3f37f9c0aa2f6cb47b9cdc61e5598a6d8f14" exitCode=0 Jun 03 16:39:33.528570 ip-10-0-135-67 kubenswrapper[2568]: I0603 16:39:33.528119 2568 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19dl4dvd" event={"ID":"1400afed-da43-467e-9497-34b2eef9fd23","Type":"ContainerDied","Data":"40fa85d173b79bc7d891da605e5e3f37f9c0aa2f6cb47b9cdc61e5598a6d8f14"} Jun 03 16:39:41.556332 ip-10-0-135-67 kubenswrapper[2568]: I0603 16:39:41.556294 2568 generic.go:358] "Generic (PLEG): container finished" podID="1400afed-da43-467e-9497-34b2eef9fd23" containerID="6a335579f8ba455bb55c57d91f5eefd6820fa6f74116b986985a1346e8162940" exitCode=0 Jun 03 16:39:41.556685 ip-10-0-135-67 kubenswrapper[2568]: I0603 16:39:41.556365 2568 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19dl4dvd" event={"ID":"1400afed-da43-467e-9497-34b2eef9fd23","Type":"ContainerDied","Data":"6a335579f8ba455bb55c57d91f5eefd6820fa6f74116b986985a1346e8162940"} Jun 03 16:39:42.681750 ip-10-0-135-67 kubenswrapper[2568]: I0603 16:39:42.681728 2568 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19dl4dvd" Jun 03 16:39:42.701947 ip-10-0-135-67 kubenswrapper[2568]: I0603 16:39:42.701916 2568 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-c2hm6\" (UniqueName: \"kubernetes.io/projected/1400afed-da43-467e-9497-34b2eef9fd23-kube-api-access-c2hm6\") pod \"1400afed-da43-467e-9497-34b2eef9fd23\" (UID: \"1400afed-da43-467e-9497-34b2eef9fd23\") " Jun 03 16:39:42.702105 ip-10-0-135-67 kubenswrapper[2568]: I0603 16:39:42.701976 2568 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/1400afed-da43-467e-9497-34b2eef9fd23-util\") pod \"1400afed-da43-467e-9497-34b2eef9fd23\" (UID: \"1400afed-da43-467e-9497-34b2eef9fd23\") " Jun 03 16:39:42.702105 ip-10-0-135-67 kubenswrapper[2568]: I0603 16:39:42.701997 2568 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/1400afed-da43-467e-9497-34b2eef9fd23-bundle\") pod \"1400afed-da43-467e-9497-34b2eef9fd23\" (UID: \"1400afed-da43-467e-9497-34b2eef9fd23\") " Jun 03 16:39:42.702685 ip-10-0-135-67 kubenswrapper[2568]: I0603 16:39:42.702660 2568 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/1400afed-da43-467e-9497-34b2eef9fd23-bundle" (OuterVolumeSpecName: "bundle") pod "1400afed-da43-467e-9497-34b2eef9fd23" (UID: "1400afed-da43-467e-9497-34b2eef9fd23"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jun 03 16:39:42.704202 ip-10-0-135-67 kubenswrapper[2568]: I0603 16:39:42.704173 2568 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/1400afed-da43-467e-9497-34b2eef9fd23-kube-api-access-c2hm6" (OuterVolumeSpecName: "kube-api-access-c2hm6") pod "1400afed-da43-467e-9497-34b2eef9fd23" (UID: "1400afed-da43-467e-9497-34b2eef9fd23"). InnerVolumeSpecName "kube-api-access-c2hm6". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 03 16:39:42.706327 ip-10-0-135-67 kubenswrapper[2568]: I0603 16:39:42.706304 2568 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/1400afed-da43-467e-9497-34b2eef9fd23-util" (OuterVolumeSpecName: "util") pod "1400afed-da43-467e-9497-34b2eef9fd23" (UID: "1400afed-da43-467e-9497-34b2eef9fd23"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jun 03 16:39:42.803070 ip-10-0-135-67 kubenswrapper[2568]: I0603 16:39:42.803039 2568 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/1400afed-da43-467e-9497-34b2eef9fd23-util\") on node \"ip-10-0-135-67.ec2.internal\" DevicePath \"\"" Jun 03 16:39:42.803070 ip-10-0-135-67 kubenswrapper[2568]: I0603 16:39:42.803068 2568 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/1400afed-da43-467e-9497-34b2eef9fd23-bundle\") on node \"ip-10-0-135-67.ec2.internal\" DevicePath \"\"" Jun 03 16:39:42.803070 ip-10-0-135-67 kubenswrapper[2568]: I0603 16:39:42.803078 2568 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-c2hm6\" (UniqueName: \"kubernetes.io/projected/1400afed-da43-467e-9497-34b2eef9fd23-kube-api-access-c2hm6\") on node \"ip-10-0-135-67.ec2.internal\" DevicePath \"\"" Jun 03 16:39:43.563036 ip-10-0-135-67 kubenswrapper[2568]: I0603 16:39:43.562985 2568 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19dl4dvd" event={"ID":"1400afed-da43-467e-9497-34b2eef9fd23","Type":"ContainerDied","Data":"84137559d0700f728d4bf8d9c30d87cdde5b48dcd4b907204b1b9cded2a23916"} Jun 03 16:39:43.563036 ip-10-0-135-67 kubenswrapper[2568]: I0603 16:39:43.563031 2568 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="84137559d0700f728d4bf8d9c30d87cdde5b48dcd4b907204b1b9cded2a23916" Jun 03 16:39:43.563257 ip-10-0-135-67 kubenswrapper[2568]: I0603 16:39:43.563063 2568 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19dl4dvd" Jun 03 16:39:49.212879 ip-10-0-135-67 kubenswrapper[2568]: I0603 16:39:49.212839 2568 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["cert-manager-operator/cert-manager-operator-controller-manager-54b9655956-tcxsb"] Jun 03 16:39:49.213431 ip-10-0-135-67 kubenswrapper[2568]: I0603 16:39:49.213192 2568 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="1400afed-da43-467e-9497-34b2eef9fd23" containerName="extract" Jun 03 16:39:49.213431 ip-10-0-135-67 kubenswrapper[2568]: I0603 16:39:49.213203 2568 state_mem.go:107] "Deleted CPUSet assignment" podUID="1400afed-da43-467e-9497-34b2eef9fd23" containerName="extract" Jun 03 16:39:49.213431 ip-10-0-135-67 kubenswrapper[2568]: I0603 16:39:49.213219 2568 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="1400afed-da43-467e-9497-34b2eef9fd23" containerName="pull" Jun 03 16:39:49.213431 ip-10-0-135-67 kubenswrapper[2568]: I0603 16:39:49.213225 2568 state_mem.go:107] "Deleted CPUSet assignment" podUID="1400afed-da43-467e-9497-34b2eef9fd23" containerName="pull" Jun 03 16:39:49.213431 ip-10-0-135-67 kubenswrapper[2568]: I0603 16:39:49.213241 2568 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="1400afed-da43-467e-9497-34b2eef9fd23" containerName="util" Jun 03 16:39:49.213431 ip-10-0-135-67 kubenswrapper[2568]: I0603 16:39:49.213247 2568 state_mem.go:107] "Deleted CPUSet assignment" podUID="1400afed-da43-467e-9497-34b2eef9fd23" containerName="util" Jun 03 16:39:49.213431 ip-10-0-135-67 kubenswrapper[2568]: I0603 16:39:49.213293 2568 memory_manager.go:356] "RemoveStaleState removing state" podUID="1400afed-da43-467e-9497-34b2eef9fd23" containerName="extract" Jun 03 16:39:49.262823 ip-10-0-135-67 kubenswrapper[2568]: I0603 16:39:49.262787 2568 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["cert-manager-operator/cert-manager-operator-controller-manager-54b9655956-tcxsb"] Jun 03 16:39:49.262980 ip-10-0-135-67 kubenswrapper[2568]: I0603 16:39:49.262827 2568 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager-operator/cert-manager-operator-controller-manager-54b9655956-tcxsb" Jun 03 16:39:49.265070 ip-10-0-135-67 kubenswrapper[2568]: I0603 16:39:49.265047 2568 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"cert-manager-operator\"/\"cert-manager-operator-controller-manager-dockercfg-42fk5\"" Jun 03 16:39:49.265201 ip-10-0-135-67 kubenswrapper[2568]: I0603 16:39:49.265056 2568 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"cert-manager-operator\"/\"kube-root-ca.crt\"" Jun 03 16:39:49.265201 ip-10-0-135-67 kubenswrapper[2568]: I0603 16:39:49.265107 2568 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"cert-manager-operator\"/\"openshift-service-ca.crt\"" Jun 03 16:39:49.346945 ip-10-0-135-67 kubenswrapper[2568]: I0603 16:39:49.346923 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-kzng8\" (UniqueName: \"kubernetes.io/projected/65d691be-edf7-455c-8042-f348d9c543e1-kube-api-access-kzng8\") pod \"cert-manager-operator-controller-manager-54b9655956-tcxsb\" (UID: \"65d691be-edf7-455c-8042-f348d9c543e1\") " pod="cert-manager-operator/cert-manager-operator-controller-manager-54b9655956-tcxsb" Jun 03 16:39:49.347072 ip-10-0-135-67 kubenswrapper[2568]: I0603 16:39:49.346975 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/65d691be-edf7-455c-8042-f348d9c543e1-tmp\") pod \"cert-manager-operator-controller-manager-54b9655956-tcxsb\" (UID: \"65d691be-edf7-455c-8042-f348d9c543e1\") " pod="cert-manager-operator/cert-manager-operator-controller-manager-54b9655956-tcxsb" Jun 03 16:39:49.448116 ip-10-0-135-67 kubenswrapper[2568]: I0603 16:39:49.448081 2568 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-kzng8\" (UniqueName: \"kubernetes.io/projected/65d691be-edf7-455c-8042-f348d9c543e1-kube-api-access-kzng8\") pod \"cert-manager-operator-controller-manager-54b9655956-tcxsb\" (UID: \"65d691be-edf7-455c-8042-f348d9c543e1\") " pod="cert-manager-operator/cert-manager-operator-controller-manager-54b9655956-tcxsb" Jun 03 16:39:49.448252 ip-10-0-135-67 kubenswrapper[2568]: I0603 16:39:49.448137 2568 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/65d691be-edf7-455c-8042-f348d9c543e1-tmp\") pod \"cert-manager-operator-controller-manager-54b9655956-tcxsb\" (UID: \"65d691be-edf7-455c-8042-f348d9c543e1\") " pod="cert-manager-operator/cert-manager-operator-controller-manager-54b9655956-tcxsb" Jun 03 16:39:49.448499 ip-10-0-135-67 kubenswrapper[2568]: I0603 16:39:49.448484 2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/65d691be-edf7-455c-8042-f348d9c543e1-tmp\") pod \"cert-manager-operator-controller-manager-54b9655956-tcxsb\" (UID: \"65d691be-edf7-455c-8042-f348d9c543e1\") " pod="cert-manager-operator/cert-manager-operator-controller-manager-54b9655956-tcxsb" Jun 03 16:39:49.455136 ip-10-0-135-67 kubenswrapper[2568]: I0603 16:39:49.455115 2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-kzng8\" (UniqueName: \"kubernetes.io/projected/65d691be-edf7-455c-8042-f348d9c543e1-kube-api-access-kzng8\") pod \"cert-manager-operator-controller-manager-54b9655956-tcxsb\" (UID: \"65d691be-edf7-455c-8042-f348d9c543e1\") " pod="cert-manager-operator/cert-manager-operator-controller-manager-54b9655956-tcxsb" Jun 03 16:39:49.572326 ip-10-0-135-67 kubenswrapper[2568]: I0603 16:39:49.572301 2568 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager-operator/cert-manager-operator-controller-manager-54b9655956-tcxsb" Jun 03 16:39:49.709628 ip-10-0-135-67 kubenswrapper[2568]: I0603 16:39:49.709595 2568 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["cert-manager-operator/cert-manager-operator-controller-manager-54b9655956-tcxsb"] Jun 03 16:39:49.713302 ip-10-0-135-67 kubenswrapper[2568]: W0603 16:39:49.713273 2568 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod65d691be_edf7_455c_8042_f348d9c543e1.slice/crio-98a18b3f6dc217da66b696eb682ce7800ec78338e66115a8aaed109e25338a03 WatchSource:0}: Error finding container 98a18b3f6dc217da66b696eb682ce7800ec78338e66115a8aaed109e25338a03: Status 404 returned error can't find the container with id 98a18b3f6dc217da66b696eb682ce7800ec78338e66115a8aaed109e25338a03 Jun 03 16:39:50.586557 ip-10-0-135-67 kubenswrapper[2568]: I0603 16:39:50.586522 2568 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="cert-manager-operator/cert-manager-operator-controller-manager-54b9655956-tcxsb" event={"ID":"65d691be-edf7-455c-8042-f348d9c543e1","Type":"ContainerStarted","Data":"98a18b3f6dc217da66b696eb682ce7800ec78338e66115a8aaed109e25338a03"} Jun 03 16:39:53.598947 ip-10-0-135-67 kubenswrapper[2568]: I0603 16:39:53.598914 2568 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="cert-manager-operator/cert-manager-operator-controller-manager-54b9655956-tcxsb" event={"ID":"65d691be-edf7-455c-8042-f348d9c543e1","Type":"ContainerStarted","Data":"2c18d093afd9b666a0a828e8937b78b05977228d86e7bfbed7c40fbec58e39a5"} Jun 03 16:39:53.618176 ip-10-0-135-67 kubenswrapper[2568]: I0603 16:39:53.618126 2568 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="cert-manager-operator/cert-manager-operator-controller-manager-54b9655956-tcxsb" podStartSLOduration=1.433239231 podStartE2EDuration="4.618110566s" podCreationTimestamp="2026-06-03 16:39:49 +0000 UTC" firstStartedPulling="2026-06-03 16:39:49.715806248 +0000 UTC m=+361.857980880" lastFinishedPulling="2026-06-03 16:39:52.900677579 +0000 UTC m=+365.042852215" observedRunningTime="2026-06-03 16:39:53.617371152 +0000 UTC m=+365.759545805" watchObservedRunningTime="2026-06-03 16:39:53.618110566 +0000 UTC m=+365.760285223" Jun 03 16:39:54.234254 ip-10-0-135-67 kubenswrapper[2568]: I0603 16:39:54.234221 2568 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fgtczs"] Jun 03 16:39:54.236499 ip-10-0-135-67 kubenswrapper[2568]: I0603 16:39:54.236482 2568 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fgtczs" Jun 03 16:39:54.238501 ip-10-0-135-67 kubenswrapper[2568]: I0603 16:39:54.238476 2568 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"openshift-service-ca.crt\"" Jun 03 16:39:54.238638 ip-10-0-135-67 kubenswrapper[2568]: I0603 16:39:54.238533 2568 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"kube-root-ca.crt\"" Jun 03 16:39:54.238638 ip-10-0-135-67 kubenswrapper[2568]: I0603 16:39:54.238489 2568 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-marketplace\"/\"default-dockercfg-mhpmz\"" Jun 03 16:39:54.249290 ip-10-0-135-67 kubenswrapper[2568]: I0603 16:39:54.249268 2568 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fgtczs"] Jun 03 16:39:54.282923 ip-10-0-135-67 kubenswrapper[2568]: I0603 16:39:54.282893 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/a02a9694-f008-4498-84f9-9843a5950a2e-bundle\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fgtczs\" (UID: \"a02a9694-f008-4498-84f9-9843a5950a2e\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fgtczs" Jun 03 16:39:54.283040 ip-10-0-135-67 kubenswrapper[2568]: I0603 16:39:54.282926 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-rgb7v\" (UniqueName: \"kubernetes.io/projected/a02a9694-f008-4498-84f9-9843a5950a2e-kube-api-access-rgb7v\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fgtczs\" (UID: \"a02a9694-f008-4498-84f9-9843a5950a2e\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fgtczs" Jun 03 16:39:54.283040 ip-10-0-135-67 kubenswrapper[2568]: I0603 16:39:54.282993 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/a02a9694-f008-4498-84f9-9843a5950a2e-util\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fgtczs\" (UID: \"a02a9694-f008-4498-84f9-9843a5950a2e\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fgtczs" Jun 03 16:39:54.384233 ip-10-0-135-67 kubenswrapper[2568]: I0603 16:39:54.384204 2568 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/a02a9694-f008-4498-84f9-9843a5950a2e-bundle\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fgtczs\" (UID: \"a02a9694-f008-4498-84f9-9843a5950a2e\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fgtczs" Jun 03 16:39:54.384321 ip-10-0-135-67 kubenswrapper[2568]: I0603 16:39:54.384296 2568 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-rgb7v\" (UniqueName: \"kubernetes.io/projected/a02a9694-f008-4498-84f9-9843a5950a2e-kube-api-access-rgb7v\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fgtczs\" (UID: \"a02a9694-f008-4498-84f9-9843a5950a2e\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fgtczs" Jun 03 16:39:54.384391 ip-10-0-135-67 kubenswrapper[2568]: I0603 16:39:54.384374 2568 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/a02a9694-f008-4498-84f9-9843a5950a2e-util\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fgtczs\" (UID: \"a02a9694-f008-4498-84f9-9843a5950a2e\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fgtczs" Jun 03 16:39:54.384577 ip-10-0-135-67 kubenswrapper[2568]: I0603 16:39:54.384561 2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/a02a9694-f008-4498-84f9-9843a5950a2e-bundle\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fgtczs\" (UID: \"a02a9694-f008-4498-84f9-9843a5950a2e\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fgtczs" Jun 03 16:39:54.384700 ip-10-0-135-67 kubenswrapper[2568]: I0603 16:39:54.384684 2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/a02a9694-f008-4498-84f9-9843a5950a2e-util\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fgtczs\" (UID: \"a02a9694-f008-4498-84f9-9843a5950a2e\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fgtczs" Jun 03 16:39:54.393041 ip-10-0-135-67 kubenswrapper[2568]: I0603 16:39:54.393021 2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-rgb7v\" (UniqueName: \"kubernetes.io/projected/a02a9694-f008-4498-84f9-9843a5950a2e-kube-api-access-rgb7v\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fgtczs\" (UID: \"a02a9694-f008-4498-84f9-9843a5950a2e\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fgtczs" Jun 03 16:39:54.545437 ip-10-0-135-67 kubenswrapper[2568]: I0603 16:39:54.545405 2568 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fgtczs" Jun 03 16:39:54.683782 ip-10-0-135-67 kubenswrapper[2568]: I0603 16:39:54.683749 2568 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fgtczs"] Jun 03 16:39:54.687866 ip-10-0-135-67 kubenswrapper[2568]: W0603 16:39:54.687840 2568 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poda02a9694_f008_4498_84f9_9843a5950a2e.slice/crio-433478c9a59139ab48b7369a0e5ef8b801066bb521f92c9f0b9d4fef8f33a290 WatchSource:0}: Error finding container 433478c9a59139ab48b7369a0e5ef8b801066bb521f92c9f0b9d4fef8f33a290: Status 404 returned error can't find the container with id 433478c9a59139ab48b7369a0e5ef8b801066bb521f92c9f0b9d4fef8f33a290 Jun 03 16:39:55.260369 ip-10-0-135-67 kubenswrapper[2568]: I0603 16:39:55.260335 2568 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["cert-manager/cert-manager-webhook-587ccfb98-5xx9j"] Jun 03 16:39:55.262518 ip-10-0-135-67 kubenswrapper[2568]: I0603 16:39:55.262498 2568 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager/cert-manager-webhook-587ccfb98-5xx9j" Jun 03 16:39:55.264369 ip-10-0-135-67 kubenswrapper[2568]: I0603 16:39:55.264349 2568 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"cert-manager\"/\"openshift-service-ca.crt\"" Jun 03 16:39:55.264989 ip-10-0-135-67 kubenswrapper[2568]: I0603 16:39:55.264974 2568 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"cert-manager\"/\"kube-root-ca.crt\"" Jun 03 16:39:55.265069 ip-10-0-135-67 kubenswrapper[2568]: I0603 16:39:55.264973 2568 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"cert-manager\"/\"cert-manager-webhook-dockercfg-b6frn\"" Jun 03 16:39:55.272493 ip-10-0-135-67 kubenswrapper[2568]: I0603 16:39:55.272465 2568 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["cert-manager/cert-manager-webhook-587ccfb98-5xx9j"] Jun 03 16:39:55.292884 ip-10-0-135-67 kubenswrapper[2568]: I0603 16:39:55.292855 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-27c46\" (UniqueName: \"kubernetes.io/projected/e914badd-e108-4874-bbad-9954f9cb5f32-kube-api-access-27c46\") pod \"cert-manager-webhook-587ccfb98-5xx9j\" (UID: \"e914badd-e108-4874-bbad-9954f9cb5f32\") " pod="cert-manager/cert-manager-webhook-587ccfb98-5xx9j" Jun 03 16:39:55.292966 ip-10-0-135-67 kubenswrapper[2568]: I0603 16:39:55.292909 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/e914badd-e108-4874-bbad-9954f9cb5f32-bound-sa-token\") pod \"cert-manager-webhook-587ccfb98-5xx9j\" (UID: \"e914badd-e108-4874-bbad-9954f9cb5f32\") " pod="cert-manager/cert-manager-webhook-587ccfb98-5xx9j" Jun 03 16:39:55.393921 ip-10-0-135-67 kubenswrapper[2568]: I0603 16:39:55.393896 2568 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-27c46\" (UniqueName: \"kubernetes.io/projected/e914badd-e108-4874-bbad-9954f9cb5f32-kube-api-access-27c46\") pod \"cert-manager-webhook-587ccfb98-5xx9j\" (UID: \"e914badd-e108-4874-bbad-9954f9cb5f32\") " pod="cert-manager/cert-manager-webhook-587ccfb98-5xx9j" Jun 03 16:39:55.394083 ip-10-0-135-67 kubenswrapper[2568]: I0603 16:39:55.393941 2568 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/e914badd-e108-4874-bbad-9954f9cb5f32-bound-sa-token\") pod \"cert-manager-webhook-587ccfb98-5xx9j\" (UID: \"e914badd-e108-4874-bbad-9954f9cb5f32\") " pod="cert-manager/cert-manager-webhook-587ccfb98-5xx9j" Jun 03 16:39:55.401579 ip-10-0-135-67 kubenswrapper[2568]: I0603 16:39:55.401553 2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/e914badd-e108-4874-bbad-9954f9cb5f32-bound-sa-token\") pod \"cert-manager-webhook-587ccfb98-5xx9j\" (UID: \"e914badd-e108-4874-bbad-9954f9cb5f32\") " pod="cert-manager/cert-manager-webhook-587ccfb98-5xx9j" Jun 03 16:39:55.401691 ip-10-0-135-67 kubenswrapper[2568]: I0603 16:39:55.401683 2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-27c46\" (UniqueName: \"kubernetes.io/projected/e914badd-e108-4874-bbad-9954f9cb5f32-kube-api-access-27c46\") pod \"cert-manager-webhook-587ccfb98-5xx9j\" (UID: \"e914badd-e108-4874-bbad-9954f9cb5f32\") " pod="cert-manager/cert-manager-webhook-587ccfb98-5xx9j" Jun 03 16:39:55.585664 ip-10-0-135-67 kubenswrapper[2568]: I0603 16:39:55.585603 2568 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager/cert-manager-webhook-587ccfb98-5xx9j" Jun 03 16:39:55.607931 ip-10-0-135-67 kubenswrapper[2568]: I0603 16:39:55.607903 2568 generic.go:358] "Generic (PLEG): container finished" podID="a02a9694-f008-4498-84f9-9843a5950a2e" containerID="3dda1dc1f0b10f301e4a1a9c008bcf60652615297a8d68186cd64e03a09944f3" exitCode=0 Jun 03 16:39:55.608050 ip-10-0-135-67 kubenswrapper[2568]: I0603 16:39:55.607988 2568 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fgtczs" event={"ID":"a02a9694-f008-4498-84f9-9843a5950a2e","Type":"ContainerDied","Data":"3dda1dc1f0b10f301e4a1a9c008bcf60652615297a8d68186cd64e03a09944f3"} Jun 03 16:39:55.608050 ip-10-0-135-67 kubenswrapper[2568]: I0603 16:39:55.608031 2568 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fgtczs" event={"ID":"a02a9694-f008-4498-84f9-9843a5950a2e","Type":"ContainerStarted","Data":"433478c9a59139ab48b7369a0e5ef8b801066bb521f92c9f0b9d4fef8f33a290"} Jun 03 16:39:55.712167 ip-10-0-135-67 kubenswrapper[2568]: I0603 16:39:55.712138 2568 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["cert-manager/cert-manager-webhook-587ccfb98-5xx9j"] Jun 03 16:39:55.714667 ip-10-0-135-67 kubenswrapper[2568]: W0603 16:39:55.714638 2568 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pode914badd_e108_4874_bbad_9954f9cb5f32.slice/crio-3cfcd65c7245d170a914199efc72f5821cb68bf27fe09fb5590de5bdbdb33279 WatchSource:0}: Error finding container 3cfcd65c7245d170a914199efc72f5821cb68bf27fe09fb5590de5bdbdb33279: Status 404 returned error can't find the container with id 3cfcd65c7245d170a914199efc72f5821cb68bf27fe09fb5590de5bdbdb33279 Jun 03 16:39:56.613941 ip-10-0-135-67 kubenswrapper[2568]: I0603 16:39:56.613900 2568 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="cert-manager/cert-manager-webhook-587ccfb98-5xx9j" event={"ID":"e914badd-e108-4874-bbad-9954f9cb5f32","Type":"ContainerStarted","Data":"3cfcd65c7245d170a914199efc72f5821cb68bf27fe09fb5590de5bdbdb33279"} Jun 03 16:39:58.621817 ip-10-0-135-67 kubenswrapper[2568]: I0603 16:39:58.621791 2568 generic.go:358] "Generic (PLEG): container finished" podID="a02a9694-f008-4498-84f9-9843a5950a2e" containerID="69ec39b9435072f576eff207a2c421fe201af08ec63410d2a03145bb8e1157b8" exitCode=0 Jun 03 16:39:58.622196 ip-10-0-135-67 kubenswrapper[2568]: I0603 16:39:58.621878 2568 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fgtczs" event={"ID":"a02a9694-f008-4498-84f9-9843a5950a2e","Type":"ContainerDied","Data":"69ec39b9435072f576eff207a2c421fe201af08ec63410d2a03145bb8e1157b8"} Jun 03 16:39:58.623485 ip-10-0-135-67 kubenswrapper[2568]: I0603 16:39:58.623464 2568 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="cert-manager/cert-manager-webhook-587ccfb98-5xx9j" event={"ID":"e914badd-e108-4874-bbad-9954f9cb5f32","Type":"ContainerStarted","Data":"be2842231d77d811ba70a6207d148d2ec58663a67d54923d3ff4a2fc4f8910f2"} Jun 03 16:39:58.623641 ip-10-0-135-67 kubenswrapper[2568]: I0603 16:39:58.623575 2568 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="cert-manager/cert-manager-webhook-587ccfb98-5xx9j" Jun 03 16:39:58.656753 ip-10-0-135-67 kubenswrapper[2568]: I0603 16:39:58.656713 2568 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="cert-manager/cert-manager-webhook-587ccfb98-5xx9j" podStartSLOduration=0.823585171 podStartE2EDuration="3.656698217s" podCreationTimestamp="2026-06-03 16:39:55 +0000 UTC" firstStartedPulling="2026-06-03 16:39:55.716471418 +0000 UTC m=+367.858646050" lastFinishedPulling="2026-06-03 16:39:58.549584464 +0000 UTC m=+370.691759096" observedRunningTime="2026-06-03 16:39:58.655203546 +0000 UTC m=+370.797378199" watchObservedRunningTime="2026-06-03 16:39:58.656698217 +0000 UTC m=+370.798872871" Jun 03 16:39:58.765196 ip-10-0-135-67 kubenswrapper[2568]: I0603 16:39:58.765166 2568 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["cert-manager/cert-manager-cainjector-68b757865b-jmcbg"] Jun 03 16:39:58.768135 ip-10-0-135-67 kubenswrapper[2568]: I0603 16:39:58.768117 2568 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager/cert-manager-cainjector-68b757865b-jmcbg" Jun 03 16:39:58.770052 ip-10-0-135-67 kubenswrapper[2568]: I0603 16:39:58.769994 2568 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"cert-manager\"/\"cert-manager-cainjector-dockercfg-594rt\"" Jun 03 16:39:58.776224 ip-10-0-135-67 kubenswrapper[2568]: I0603 16:39:58.776203 2568 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["cert-manager/cert-manager-cainjector-68b757865b-jmcbg"] Jun 03 16:39:58.822156 ip-10-0-135-67 kubenswrapper[2568]: I0603 16:39:58.822136 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/a8c71017-f612-42fa-84d0-78279e7740a1-bound-sa-token\") pod \"cert-manager-cainjector-68b757865b-jmcbg\" (UID: \"a8c71017-f612-42fa-84d0-78279e7740a1\") " pod="cert-manager/cert-manager-cainjector-68b757865b-jmcbg" Jun 03 16:39:58.822262 ip-10-0-135-67 kubenswrapper[2568]: I0603 16:39:58.822177 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-n99ml\" (UniqueName: \"kubernetes.io/projected/a8c71017-f612-42fa-84d0-78279e7740a1-kube-api-access-n99ml\") pod \"cert-manager-cainjector-68b757865b-jmcbg\" (UID: \"a8c71017-f612-42fa-84d0-78279e7740a1\") " pod="cert-manager/cert-manager-cainjector-68b757865b-jmcbg" Jun 03 16:39:58.922937 ip-10-0-135-67 kubenswrapper[2568]: I0603 16:39:58.922915 2568 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/a8c71017-f612-42fa-84d0-78279e7740a1-bound-sa-token\") pod \"cert-manager-cainjector-68b757865b-jmcbg\" (UID: \"a8c71017-f612-42fa-84d0-78279e7740a1\") " pod="cert-manager/cert-manager-cainjector-68b757865b-jmcbg" Jun 03 16:39:58.923136 ip-10-0-135-67 kubenswrapper[2568]: I0603 16:39:58.922955 2568 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-n99ml\" (UniqueName: \"kubernetes.io/projected/a8c71017-f612-42fa-84d0-78279e7740a1-kube-api-access-n99ml\") pod \"cert-manager-cainjector-68b757865b-jmcbg\" (UID: \"a8c71017-f612-42fa-84d0-78279e7740a1\") " pod="cert-manager/cert-manager-cainjector-68b757865b-jmcbg" Jun 03 16:39:58.930326 ip-10-0-135-67 kubenswrapper[2568]: I0603 16:39:58.930305 2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/a8c71017-f612-42fa-84d0-78279e7740a1-bound-sa-token\") pod \"cert-manager-cainjector-68b757865b-jmcbg\" (UID: \"a8c71017-f612-42fa-84d0-78279e7740a1\") " pod="cert-manager/cert-manager-cainjector-68b757865b-jmcbg" Jun 03 16:39:58.930466 ip-10-0-135-67 kubenswrapper[2568]: I0603 16:39:58.930447 2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-n99ml\" (UniqueName: \"kubernetes.io/projected/a8c71017-f612-42fa-84d0-78279e7740a1-kube-api-access-n99ml\") pod \"cert-manager-cainjector-68b757865b-jmcbg\" (UID: \"a8c71017-f612-42fa-84d0-78279e7740a1\") " pod="cert-manager/cert-manager-cainjector-68b757865b-jmcbg" Jun 03 16:39:59.120425 ip-10-0-135-67 kubenswrapper[2568]: I0603 16:39:59.120368 2568 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager/cert-manager-cainjector-68b757865b-jmcbg" Jun 03 16:39:59.242349 ip-10-0-135-67 kubenswrapper[2568]: I0603 16:39:59.242322 2568 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["cert-manager/cert-manager-cainjector-68b757865b-jmcbg"] Jun 03 16:39:59.248481 ip-10-0-135-67 kubenswrapper[2568]: W0603 16:39:59.248454 2568 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-poda8c71017_f612_42fa_84d0_78279e7740a1.slice/crio-1a8d4921e4db0669645360ddb7e66645bee74a9cdf3060f895c7e1355d5c2b22 WatchSource:0}: Error finding container 1a8d4921e4db0669645360ddb7e66645bee74a9cdf3060f895c7e1355d5c2b22: Status 404 returned error can't find the container with id 1a8d4921e4db0669645360ddb7e66645bee74a9cdf3060f895c7e1355d5c2b22 Jun 03 16:39:59.628520 ip-10-0-135-67 kubenswrapper[2568]: I0603 16:39:59.628468 2568 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="cert-manager/cert-manager-cainjector-68b757865b-jmcbg" event={"ID":"a8c71017-f612-42fa-84d0-78279e7740a1","Type":"ContainerStarted","Data":"27e95feffce2d4d443dd858b9301b6cb49b33d96c1e4ae54a2fdb20034e80e75"} Jun 03 16:39:59.628520 ip-10-0-135-67 kubenswrapper[2568]: I0603 16:39:59.628513 2568 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="cert-manager/cert-manager-cainjector-68b757865b-jmcbg" event={"ID":"a8c71017-f612-42fa-84d0-78279e7740a1","Type":"ContainerStarted","Data":"1a8d4921e4db0669645360ddb7e66645bee74a9cdf3060f895c7e1355d5c2b22"} Jun 03 16:39:59.630533 ip-10-0-135-67 kubenswrapper[2568]: I0603 16:39:59.630508 2568 generic.go:358] "Generic (PLEG): container finished" podID="a02a9694-f008-4498-84f9-9843a5950a2e" containerID="92269e23bb9bc3a386dd8357710f4286b071474d5049d8bebff1be9c3c911e3c" exitCode=0 Jun 03 16:39:59.630663 ip-10-0-135-67 kubenswrapper[2568]: I0603 16:39:59.630592 2568 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fgtczs" event={"ID":"a02a9694-f008-4498-84f9-9843a5950a2e","Type":"ContainerDied","Data":"92269e23bb9bc3a386dd8357710f4286b071474d5049d8bebff1be9c3c911e3c"} Jun 03 16:39:59.643957 ip-10-0-135-67 kubenswrapper[2568]: I0603 16:39:59.643912 2568 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="cert-manager/cert-manager-cainjector-68b757865b-jmcbg" podStartSLOduration=1.6438990599999999 podStartE2EDuration="1.64389906s" podCreationTimestamp="2026-06-03 16:39:58 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2026-06-03 16:39:59.64222022 +0000 UTC m=+371.784394874" watchObservedRunningTime="2026-06-03 16:39:59.64389906 +0000 UTC m=+371.786073713" Jun 03 16:40:00.762474 ip-10-0-135-67 kubenswrapper[2568]: I0603 16:40:00.762453 2568 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fgtczs" Jun 03 16:40:00.838445 ip-10-0-135-67 kubenswrapper[2568]: I0603 16:40:00.838417 2568 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/a02a9694-f008-4498-84f9-9843a5950a2e-util\") pod \"a02a9694-f008-4498-84f9-9843a5950a2e\" (UID: \"a02a9694-f008-4498-84f9-9843a5950a2e\") " Jun 03 16:40:00.838568 ip-10-0-135-67 kubenswrapper[2568]: I0603 16:40:00.838457 2568 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-rgb7v\" (UniqueName: \"kubernetes.io/projected/a02a9694-f008-4498-84f9-9843a5950a2e-kube-api-access-rgb7v\") pod \"a02a9694-f008-4498-84f9-9843a5950a2e\" (UID: \"a02a9694-f008-4498-84f9-9843a5950a2e\") " Jun 03 16:40:00.838568 ip-10-0-135-67 kubenswrapper[2568]: I0603 16:40:00.838477 2568 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/a02a9694-f008-4498-84f9-9843a5950a2e-bundle\") pod \"a02a9694-f008-4498-84f9-9843a5950a2e\" (UID: \"a02a9694-f008-4498-84f9-9843a5950a2e\") " Jun 03 16:40:00.838849 ip-10-0-135-67 kubenswrapper[2568]: I0603 16:40:00.838820 2568 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/a02a9694-f008-4498-84f9-9843a5950a2e-bundle" (OuterVolumeSpecName: "bundle") pod "a02a9694-f008-4498-84f9-9843a5950a2e" (UID: "a02a9694-f008-4498-84f9-9843a5950a2e"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jun 03 16:40:00.842018 ip-10-0-135-67 kubenswrapper[2568]: I0603 16:40:00.840679 2568 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/a02a9694-f008-4498-84f9-9843a5950a2e-kube-api-access-rgb7v" (OuterVolumeSpecName: "kube-api-access-rgb7v") pod "a02a9694-f008-4498-84f9-9843a5950a2e" (UID: "a02a9694-f008-4498-84f9-9843a5950a2e"). InnerVolumeSpecName "kube-api-access-rgb7v". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 03 16:40:00.844178 ip-10-0-135-67 kubenswrapper[2568]: I0603 16:40:00.844135 2568 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/a02a9694-f008-4498-84f9-9843a5950a2e-util" (OuterVolumeSpecName: "util") pod "a02a9694-f008-4498-84f9-9843a5950a2e" (UID: "a02a9694-f008-4498-84f9-9843a5950a2e"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jun 03 16:40:00.939544 ip-10-0-135-67 kubenswrapper[2568]: I0603 16:40:00.939494 2568 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/a02a9694-f008-4498-84f9-9843a5950a2e-util\") on node \"ip-10-0-135-67.ec2.internal\" DevicePath \"\"" Jun 03 16:40:00.939544 ip-10-0-135-67 kubenswrapper[2568]: I0603 16:40:00.939515 2568 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-rgb7v\" (UniqueName: \"kubernetes.io/projected/a02a9694-f008-4498-84f9-9843a5950a2e-kube-api-access-rgb7v\") on node \"ip-10-0-135-67.ec2.internal\" DevicePath \"\"" Jun 03 16:40:00.939544 ip-10-0-135-67 kubenswrapper[2568]: I0603 16:40:00.939526 2568 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/a02a9694-f008-4498-84f9-9843a5950a2e-bundle\") on node \"ip-10-0-135-67.ec2.internal\" DevicePath \"\"" Jun 03 16:40:01.638318 ip-10-0-135-67 kubenswrapper[2568]: I0603 16:40:01.638282 2568 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fgtczs" event={"ID":"a02a9694-f008-4498-84f9-9843a5950a2e","Type":"ContainerDied","Data":"433478c9a59139ab48b7369a0e5ef8b801066bb521f92c9f0b9d4fef8f33a290"} Jun 03 16:40:01.638318 ip-10-0-135-67 kubenswrapper[2568]: I0603 16:40:01.638319 2568 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="433478c9a59139ab48b7369a0e5ef8b801066bb521f92c9f0b9d4fef8f33a290" Jun 03 16:40:01.638520 ip-10-0-135-67 kubenswrapper[2568]: I0603 16:40:01.638301 2568 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fgtczs" Jun 03 16:40:04.633696 ip-10-0-135-67 kubenswrapper[2568]: I0603 16:40:04.633663 2568 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="cert-manager/cert-manager-webhook-587ccfb98-5xx9j" Jun 03 16:40:14.188995 ip-10-0-135-67 kubenswrapper[2568]: I0603 16:40:14.188957 2568 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["cert-manager/cert-manager-79c8d999ff-spz7t"] Jun 03 16:40:14.189369 ip-10-0-135-67 kubenswrapper[2568]: I0603 16:40:14.189346 2568 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="a02a9694-f008-4498-84f9-9843a5950a2e" containerName="pull" Jun 03 16:40:14.189369 ip-10-0-135-67 kubenswrapper[2568]: I0603 16:40:14.189359 2568 state_mem.go:107] "Deleted CPUSet assignment" podUID="a02a9694-f008-4498-84f9-9843a5950a2e" containerName="pull" Jun 03 16:40:14.189483 ip-10-0-135-67 kubenswrapper[2568]: I0603 16:40:14.189369 2568 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="a02a9694-f008-4498-84f9-9843a5950a2e" containerName="util" Jun 03 16:40:14.189483 ip-10-0-135-67 kubenswrapper[2568]: I0603 16:40:14.189377 2568 state_mem.go:107] "Deleted CPUSet assignment" podUID="a02a9694-f008-4498-84f9-9843a5950a2e" containerName="util" Jun 03 16:40:14.189483 ip-10-0-135-67 kubenswrapper[2568]: I0603 16:40:14.189383 2568 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="a02a9694-f008-4498-84f9-9843a5950a2e" containerName="extract" Jun 03 16:40:14.189483 ip-10-0-135-67 kubenswrapper[2568]: I0603 16:40:14.189389 2568 state_mem.go:107] "Deleted CPUSet assignment" podUID="a02a9694-f008-4498-84f9-9843a5950a2e" containerName="extract" Jun 03 16:40:14.189483 ip-10-0-135-67 kubenswrapper[2568]: I0603 16:40:14.189442 2568 memory_manager.go:356] "RemoveStaleState removing state" podUID="a02a9694-f008-4498-84f9-9843a5950a2e" containerName="extract" Jun 03 16:40:14.192950 ip-10-0-135-67 kubenswrapper[2568]: I0603 16:40:14.192928 2568 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager/cert-manager-79c8d999ff-spz7t" Jun 03 16:40:14.195259 ip-10-0-135-67 kubenswrapper[2568]: I0603 16:40:14.195234 2568 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"cert-manager\"/\"cert-manager-dockercfg-mdhc6\"" Jun 03 16:40:14.197768 ip-10-0-135-67 kubenswrapper[2568]: I0603 16:40:14.197746 2568 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["cert-manager/cert-manager-79c8d999ff-spz7t"] Jun 03 16:40:14.250783 ip-10-0-135-67 kubenswrapper[2568]: I0603 16:40:14.250750 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-92bzf\" (UniqueName: \"kubernetes.io/projected/46e21b36-d363-49ee-bcd6-b392e7181fea-kube-api-access-92bzf\") pod \"cert-manager-79c8d999ff-spz7t\" (UID: \"46e21b36-d363-49ee-bcd6-b392e7181fea\") " pod="cert-manager/cert-manager-79c8d999ff-spz7t" Jun 03 16:40:14.250926 ip-10-0-135-67 kubenswrapper[2568]: I0603 16:40:14.250812 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/46e21b36-d363-49ee-bcd6-b392e7181fea-bound-sa-token\") pod \"cert-manager-79c8d999ff-spz7t\" (UID: \"46e21b36-d363-49ee-bcd6-b392e7181fea\") " pod="cert-manager/cert-manager-79c8d999ff-spz7t" Jun 03 16:40:14.351232 ip-10-0-135-67 kubenswrapper[2568]: I0603 16:40:14.351190 2568 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-92bzf\" (UniqueName: \"kubernetes.io/projected/46e21b36-d363-49ee-bcd6-b392e7181fea-kube-api-access-92bzf\") pod \"cert-manager-79c8d999ff-spz7t\" (UID: \"46e21b36-d363-49ee-bcd6-b392e7181fea\") " pod="cert-manager/cert-manager-79c8d999ff-spz7t" Jun 03 16:40:14.351372 ip-10-0-135-67 kubenswrapper[2568]: I0603 16:40:14.351281 2568 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/46e21b36-d363-49ee-bcd6-b392e7181fea-bound-sa-token\") pod \"cert-manager-79c8d999ff-spz7t\" (UID: \"46e21b36-d363-49ee-bcd6-b392e7181fea\") " pod="cert-manager/cert-manager-79c8d999ff-spz7t" Jun 03 16:40:14.358961 ip-10-0-135-67 kubenswrapper[2568]: I0603 16:40:14.358935 2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/46e21b36-d363-49ee-bcd6-b392e7181fea-bound-sa-token\") pod \"cert-manager-79c8d999ff-spz7t\" (UID: \"46e21b36-d363-49ee-bcd6-b392e7181fea\") " pod="cert-manager/cert-manager-79c8d999ff-spz7t" Jun 03 16:40:14.359093 ip-10-0-135-67 kubenswrapper[2568]: I0603 16:40:14.358970 2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-92bzf\" (UniqueName: \"kubernetes.io/projected/46e21b36-d363-49ee-bcd6-b392e7181fea-kube-api-access-92bzf\") pod \"cert-manager-79c8d999ff-spz7t\" (UID: \"46e21b36-d363-49ee-bcd6-b392e7181fea\") " pod="cert-manager/cert-manager-79c8d999ff-spz7t" Jun 03 16:40:14.503123 ip-10-0-135-67 kubenswrapper[2568]: I0603 16:40:14.503089 2568 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager/cert-manager-79c8d999ff-spz7t" Jun 03 16:40:14.629979 ip-10-0-135-67 kubenswrapper[2568]: I0603 16:40:14.629951 2568 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["cert-manager/cert-manager-79c8d999ff-spz7t"] Jun 03 16:40:14.632402 ip-10-0-135-67 kubenswrapper[2568]: W0603 16:40:14.632377 2568 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod46e21b36_d363_49ee_bcd6_b392e7181fea.slice/crio-7b062ee642d3ae03ad8d8ae0483f946a9db4b895ab4e683dc7e9a594a628304d WatchSource:0}: Error finding container 7b062ee642d3ae03ad8d8ae0483f946a9db4b895ab4e683dc7e9a594a628304d: Status 404 returned error can't find the container with id 7b062ee642d3ae03ad8d8ae0483f946a9db4b895ab4e683dc7e9a594a628304d Jun 03 16:40:14.681707 ip-10-0-135-67 kubenswrapper[2568]: I0603 16:40:14.681677 2568 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="cert-manager/cert-manager-79c8d999ff-spz7t" event={"ID":"46e21b36-d363-49ee-bcd6-b392e7181fea","Type":"ContainerStarted","Data":"7b062ee642d3ae03ad8d8ae0483f946a9db4b895ab4e683dc7e9a594a628304d"} Jun 03 16:40:15.508341 ip-10-0-135-67 kubenswrapper[2568]: I0603 16:40:15.508308 2568 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-marketplace/410e69f41462d9d02a48f76ad929b5f41ed146182df7ab38cf9ce4e1cd9knkh"] Jun 03 16:40:15.512270 ip-10-0-135-67 kubenswrapper[2568]: I0603 16:40:15.512253 2568 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/410e69f41462d9d02a48f76ad929b5f41ed146182df7ab38cf9ce4e1cd9knkh" Jun 03 16:40:15.514392 ip-10-0-135-67 kubenswrapper[2568]: I0603 16:40:15.514367 2568 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"kube-root-ca.crt\"" Jun 03 16:40:15.514849 ip-10-0-135-67 kubenswrapper[2568]: I0603 16:40:15.514826 2568 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"openshift-service-ca.crt\"" Jun 03 16:40:15.514939 ip-10-0-135-67 kubenswrapper[2568]: I0603 16:40:15.514850 2568 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-marketplace\"/\"default-dockercfg-mhpmz\"" Jun 03 16:40:15.518611 ip-10-0-135-67 kubenswrapper[2568]: I0603 16:40:15.518583 2568 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/410e69f41462d9d02a48f76ad929b5f41ed146182df7ab38cf9ce4e1cd9knkh"] Jun 03 16:40:15.561512 ip-10-0-135-67 kubenswrapper[2568]: I0603 16:40:15.561483 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/a7265fa0-4c2b-4271-a845-d9765f6c3cb3-util\") pod \"410e69f41462d9d02a48f76ad929b5f41ed146182df7ab38cf9ce4e1cd9knkh\" (UID: \"a7265fa0-4c2b-4271-a845-d9765f6c3cb3\") " pod="openshift-marketplace/410e69f41462d9d02a48f76ad929b5f41ed146182df7ab38cf9ce4e1cd9knkh" Jun 03 16:40:15.561669 ip-10-0-135-67 kubenswrapper[2568]: I0603 16:40:15.561550 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/a7265fa0-4c2b-4271-a845-d9765f6c3cb3-bundle\") pod \"410e69f41462d9d02a48f76ad929b5f41ed146182df7ab38cf9ce4e1cd9knkh\" (UID: \"a7265fa0-4c2b-4271-a845-d9765f6c3cb3\") " pod="openshift-marketplace/410e69f41462d9d02a48f76ad929b5f41ed146182df7ab38cf9ce4e1cd9knkh" Jun 03 16:40:15.561669 ip-10-0-135-67 kubenswrapper[2568]: I0603 16:40:15.561588 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-pq7fk\" (UniqueName: \"kubernetes.io/projected/a7265fa0-4c2b-4271-a845-d9765f6c3cb3-kube-api-access-pq7fk\") pod \"410e69f41462d9d02a48f76ad929b5f41ed146182df7ab38cf9ce4e1cd9knkh\" (UID: \"a7265fa0-4c2b-4271-a845-d9765f6c3cb3\") " pod="openshift-marketplace/410e69f41462d9d02a48f76ad929b5f41ed146182df7ab38cf9ce4e1cd9knkh" Jun 03 16:40:15.662355 ip-10-0-135-67 kubenswrapper[2568]: I0603 16:40:15.662323 2568 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/a7265fa0-4c2b-4271-a845-d9765f6c3cb3-bundle\") pod \"410e69f41462d9d02a48f76ad929b5f41ed146182df7ab38cf9ce4e1cd9knkh\" (UID: \"a7265fa0-4c2b-4271-a845-d9765f6c3cb3\") " pod="openshift-marketplace/410e69f41462d9d02a48f76ad929b5f41ed146182df7ab38cf9ce4e1cd9knkh" Jun 03 16:40:15.662523 ip-10-0-135-67 kubenswrapper[2568]: I0603 16:40:15.662363 2568 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-pq7fk\" (UniqueName: \"kubernetes.io/projected/a7265fa0-4c2b-4271-a845-d9765f6c3cb3-kube-api-access-pq7fk\") pod \"410e69f41462d9d02a48f76ad929b5f41ed146182df7ab38cf9ce4e1cd9knkh\" (UID: \"a7265fa0-4c2b-4271-a845-d9765f6c3cb3\") " pod="openshift-marketplace/410e69f41462d9d02a48f76ad929b5f41ed146182df7ab38cf9ce4e1cd9knkh" Jun 03 16:40:15.662523 ip-10-0-135-67 kubenswrapper[2568]: I0603 16:40:15.662420 2568 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/a7265fa0-4c2b-4271-a845-d9765f6c3cb3-util\") pod \"410e69f41462d9d02a48f76ad929b5f41ed146182df7ab38cf9ce4e1cd9knkh\" (UID: \"a7265fa0-4c2b-4271-a845-d9765f6c3cb3\") " pod="openshift-marketplace/410e69f41462d9d02a48f76ad929b5f41ed146182df7ab38cf9ce4e1cd9knkh" Jun 03 16:40:15.662776 ip-10-0-135-67 kubenswrapper[2568]: I0603 16:40:15.662756 2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/a7265fa0-4c2b-4271-a845-d9765f6c3cb3-util\") pod \"410e69f41462d9d02a48f76ad929b5f41ed146182df7ab38cf9ce4e1cd9knkh\" (UID: \"a7265fa0-4c2b-4271-a845-d9765f6c3cb3\") " pod="openshift-marketplace/410e69f41462d9d02a48f76ad929b5f41ed146182df7ab38cf9ce4e1cd9knkh" Jun 03 16:40:15.662837 ip-10-0-135-67 kubenswrapper[2568]: I0603 16:40:15.662772 2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/a7265fa0-4c2b-4271-a845-d9765f6c3cb3-bundle\") pod \"410e69f41462d9d02a48f76ad929b5f41ed146182df7ab38cf9ce4e1cd9knkh\" (UID: \"a7265fa0-4c2b-4271-a845-d9765f6c3cb3\") " pod="openshift-marketplace/410e69f41462d9d02a48f76ad929b5f41ed146182df7ab38cf9ce4e1cd9knkh" Jun 03 16:40:15.669413 ip-10-0-135-67 kubenswrapper[2568]: I0603 16:40:15.669379 2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-pq7fk\" (UniqueName: \"kubernetes.io/projected/a7265fa0-4c2b-4271-a845-d9765f6c3cb3-kube-api-access-pq7fk\") pod \"410e69f41462d9d02a48f76ad929b5f41ed146182df7ab38cf9ce4e1cd9knkh\" (UID: \"a7265fa0-4c2b-4271-a845-d9765f6c3cb3\") " pod="openshift-marketplace/410e69f41462d9d02a48f76ad929b5f41ed146182df7ab38cf9ce4e1cd9knkh" Jun 03 16:40:15.686224 ip-10-0-135-67 kubenswrapper[2568]: I0603 16:40:15.686199 2568 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="cert-manager/cert-manager-79c8d999ff-spz7t" event={"ID":"46e21b36-d363-49ee-bcd6-b392e7181fea","Type":"ContainerStarted","Data":"34498637f738aee84da49a6470c05e889feb59a4b58cc125d3b299ebb1873b94"} Jun 03 16:40:15.701895 ip-10-0-135-67 kubenswrapper[2568]: I0603 16:40:15.701853 2568 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="cert-manager/cert-manager-79c8d999ff-spz7t" podStartSLOduration=1.701840141 podStartE2EDuration="1.701840141s" podCreationTimestamp="2026-06-03 16:40:14 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2026-06-03 16:40:15.699424002 +0000 UTC m=+387.841598656" watchObservedRunningTime="2026-06-03 16:40:15.701840141 +0000 UTC m=+387.844014795" Jun 03 16:40:15.823710 ip-10-0-135-67 kubenswrapper[2568]: I0603 16:40:15.823638 2568 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/410e69f41462d9d02a48f76ad929b5f41ed146182df7ab38cf9ce4e1cd9knkh" Jun 03 16:40:15.947196 ip-10-0-135-67 kubenswrapper[2568]: I0603 16:40:15.947172 2568 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/410e69f41462d9d02a48f76ad929b5f41ed146182df7ab38cf9ce4e1cd9knkh"] Jun 03 16:40:15.949346 ip-10-0-135-67 kubenswrapper[2568]: W0603 16:40:15.949316 2568 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poda7265fa0_4c2b_4271_a845_d9765f6c3cb3.slice/crio-3a49632af40feaf9a993bef43d8207b90cbf1bb581464c68ba41dab3a858c748 WatchSource:0}: Error finding container 3a49632af40feaf9a993bef43d8207b90cbf1bb581464c68ba41dab3a858c748: Status 404 returned error can't find the container with id 3a49632af40feaf9a993bef43d8207b90cbf1bb581464c68ba41dab3a858c748 Jun 03 16:40:16.690897 ip-10-0-135-67 kubenswrapper[2568]: I0603 16:40:16.690867 2568 generic.go:358] "Generic (PLEG): container finished" podID="a7265fa0-4c2b-4271-a845-d9765f6c3cb3" containerID="626d69c16a628f4e3ee78cdbbd4da85e18f7af3248c7794ab8e1b26ec5160b91" exitCode=0 Jun 03 16:40:16.691277 ip-10-0-135-67 kubenswrapper[2568]: I0603 16:40:16.690960 2568 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/410e69f41462d9d02a48f76ad929b5f41ed146182df7ab38cf9ce4e1cd9knkh" event={"ID":"a7265fa0-4c2b-4271-a845-d9765f6c3cb3","Type":"ContainerDied","Data":"626d69c16a628f4e3ee78cdbbd4da85e18f7af3248c7794ab8e1b26ec5160b91"} Jun 03 16:40:16.691277 ip-10-0-135-67 kubenswrapper[2568]: I0603 16:40:16.691013 2568 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/410e69f41462d9d02a48f76ad929b5f41ed146182df7ab38cf9ce4e1cd9knkh" event={"ID":"a7265fa0-4c2b-4271-a845-d9765f6c3cb3","Type":"ContainerStarted","Data":"3a49632af40feaf9a993bef43d8207b90cbf1bb581464c68ba41dab3a858c748"} Jun 03 16:40:17.696264 ip-10-0-135-67 kubenswrapper[2568]: I0603 16:40:17.696189 2568 generic.go:358] "Generic (PLEG): container finished" podID="a7265fa0-4c2b-4271-a845-d9765f6c3cb3" containerID="df6280f81d464062215f359d84ebf64a2a6c3ca3519c9ccbb3cb06b6a36a174e" exitCode=0 Jun 03 16:40:17.696573 ip-10-0-135-67 kubenswrapper[2568]: I0603 16:40:17.696270 2568 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/410e69f41462d9d02a48f76ad929b5f41ed146182df7ab38cf9ce4e1cd9knkh" event={"ID":"a7265fa0-4c2b-4271-a845-d9765f6c3cb3","Type":"ContainerDied","Data":"df6280f81d464062215f359d84ebf64a2a6c3ca3519c9ccbb3cb06b6a36a174e"} Jun 03 16:40:18.701383 ip-10-0-135-67 kubenswrapper[2568]: I0603 16:40:18.701347 2568 generic.go:358] "Generic (PLEG): container finished" podID="a7265fa0-4c2b-4271-a845-d9765f6c3cb3" containerID="390f203fcf8099f4bbb3014a379303b200c3e6a596ee2dca55578a8a0b49ede8" exitCode=0 Jun 03 16:40:18.701745 ip-10-0-135-67 kubenswrapper[2568]: I0603 16:40:18.701437 2568 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/410e69f41462d9d02a48f76ad929b5f41ed146182df7ab38cf9ce4e1cd9knkh" event={"ID":"a7265fa0-4c2b-4271-a845-d9765f6c3cb3","Type":"ContainerDied","Data":"390f203fcf8099f4bbb3014a379303b200c3e6a596ee2dca55578a8a0b49ede8"} Jun 03 16:40:19.826550 ip-10-0-135-67 kubenswrapper[2568]: I0603 16:40:19.826529 2568 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/410e69f41462d9d02a48f76ad929b5f41ed146182df7ab38cf9ce4e1cd9knkh" Jun 03 16:40:19.891361 ip-10-0-135-67 kubenswrapper[2568]: I0603 16:40:19.891332 2568 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-pq7fk\" (UniqueName: \"kubernetes.io/projected/a7265fa0-4c2b-4271-a845-d9765f6c3cb3-kube-api-access-pq7fk\") pod \"a7265fa0-4c2b-4271-a845-d9765f6c3cb3\" (UID: \"a7265fa0-4c2b-4271-a845-d9765f6c3cb3\") " Jun 03 16:40:19.891500 ip-10-0-135-67 kubenswrapper[2568]: I0603 16:40:19.891413 2568 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/a7265fa0-4c2b-4271-a845-d9765f6c3cb3-util\") pod \"a7265fa0-4c2b-4271-a845-d9765f6c3cb3\" (UID: \"a7265fa0-4c2b-4271-a845-d9765f6c3cb3\") " Jun 03 16:40:19.891500 ip-10-0-135-67 kubenswrapper[2568]: I0603 16:40:19.891453 2568 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/a7265fa0-4c2b-4271-a845-d9765f6c3cb3-bundle\") pod \"a7265fa0-4c2b-4271-a845-d9765f6c3cb3\" (UID: \"a7265fa0-4c2b-4271-a845-d9765f6c3cb3\") " Jun 03 16:40:19.892141 ip-10-0-135-67 kubenswrapper[2568]: I0603 16:40:19.892109 2568 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/a7265fa0-4c2b-4271-a845-d9765f6c3cb3-bundle" (OuterVolumeSpecName: "bundle") pod "a7265fa0-4c2b-4271-a845-d9765f6c3cb3" (UID: "a7265fa0-4c2b-4271-a845-d9765f6c3cb3"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jun 03 16:40:19.893445 ip-10-0-135-67 kubenswrapper[2568]: I0603 16:40:19.893413 2568 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/a7265fa0-4c2b-4271-a845-d9765f6c3cb3-kube-api-access-pq7fk" (OuterVolumeSpecName: "kube-api-access-pq7fk") pod "a7265fa0-4c2b-4271-a845-d9765f6c3cb3" (UID: "a7265fa0-4c2b-4271-a845-d9765f6c3cb3"). InnerVolumeSpecName "kube-api-access-pq7fk". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 03 16:40:19.899266 ip-10-0-135-67 kubenswrapper[2568]: I0603 16:40:19.899237 2568 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/a7265fa0-4c2b-4271-a845-d9765f6c3cb3-util" (OuterVolumeSpecName: "util") pod "a7265fa0-4c2b-4271-a845-d9765f6c3cb3" (UID: "a7265fa0-4c2b-4271-a845-d9765f6c3cb3"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jun 03 16:40:19.991993 ip-10-0-135-67 kubenswrapper[2568]: I0603 16:40:19.991931 2568 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-pq7fk\" (UniqueName: \"kubernetes.io/projected/a7265fa0-4c2b-4271-a845-d9765f6c3cb3-kube-api-access-pq7fk\") on node \"ip-10-0-135-67.ec2.internal\" DevicePath \"\"" Jun 03 16:40:19.991993 ip-10-0-135-67 kubenswrapper[2568]: I0603 16:40:19.991960 2568 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/a7265fa0-4c2b-4271-a845-d9765f6c3cb3-util\") on node \"ip-10-0-135-67.ec2.internal\" DevicePath \"\"" Jun 03 16:40:19.991993 ip-10-0-135-67 kubenswrapper[2568]: I0603 16:40:19.991972 2568 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/a7265fa0-4c2b-4271-a845-d9765f6c3cb3-bundle\") on node \"ip-10-0-135-67.ec2.internal\" DevicePath \"\"" Jun 03 16:40:20.709604 ip-10-0-135-67 kubenswrapper[2568]: I0603 16:40:20.709529 2568 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/410e69f41462d9d02a48f76ad929b5f41ed146182df7ab38cf9ce4e1cd9knkh" event={"ID":"a7265fa0-4c2b-4271-a845-d9765f6c3cb3","Type":"ContainerDied","Data":"3a49632af40feaf9a993bef43d8207b90cbf1bb581464c68ba41dab3a858c748"} Jun 03 16:40:20.709604 ip-10-0-135-67 kubenswrapper[2568]: I0603 16:40:20.709555 2568 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/410e69f41462d9d02a48f76ad929b5f41ed146182df7ab38cf9ce4e1cd9knkh" Jun 03 16:40:20.709778 ip-10-0-135-67 kubenswrapper[2568]: I0603 16:40:20.709563 2568 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="3a49632af40feaf9a993bef43d8207b90cbf1bb581464c68ba41dab3a858c748" Jun 03 16:40:32.256943 ip-10-0-135-67 kubenswrapper[2568]: I0603 16:40:32.256904 2568 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-5f84758474-km5sn"] Jun 03 16:40:32.257352 ip-10-0-135-67 kubenswrapper[2568]: I0603 16:40:32.257239 2568 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="a7265fa0-4c2b-4271-a845-d9765f6c3cb3" containerName="extract" Jun 03 16:40:32.257352 ip-10-0-135-67 kubenswrapper[2568]: I0603 16:40:32.257249 2568 state_mem.go:107] "Deleted CPUSet assignment" podUID="a7265fa0-4c2b-4271-a845-d9765f6c3cb3" containerName="extract" Jun 03 16:40:32.257352 ip-10-0-135-67 kubenswrapper[2568]: I0603 16:40:32.257261 2568 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="a7265fa0-4c2b-4271-a845-d9765f6c3cb3" containerName="pull" Jun 03 16:40:32.257352 ip-10-0-135-67 kubenswrapper[2568]: I0603 16:40:32.257266 2568 state_mem.go:107] "Deleted CPUSet assignment" podUID="a7265fa0-4c2b-4271-a845-d9765f6c3cb3" containerName="pull" Jun 03 16:40:32.257352 ip-10-0-135-67 kubenswrapper[2568]: I0603 16:40:32.257287 2568 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="a7265fa0-4c2b-4271-a845-d9765f6c3cb3" containerName="util" Jun 03 16:40:32.257352 ip-10-0-135-67 kubenswrapper[2568]: I0603 16:40:32.257292 2568 state_mem.go:107] "Deleted CPUSet assignment" podUID="a7265fa0-4c2b-4271-a845-d9765f6c3cb3" containerName="util" Jun 03 16:40:32.257352 ip-10-0-135-67 kubenswrapper[2568]: I0603 16:40:32.257342 2568 memory_manager.go:356] "RemoveStaleState removing state" podUID="a7265fa0-4c2b-4271-a845-d9765f6c3cb3" containerName="extract" Jun 03 16:40:32.262169 ip-10-0-135-67 kubenswrapper[2568]: I0603 16:40:32.262148 2568 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/opendatahub-operator-controller-manager-5f84758474-km5sn" Jun 03 16:40:32.266188 ip-10-0-135-67 kubenswrapper[2568]: I0603 16:40:32.266162 2568 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-webhook-cert\"" Jun 03 16:40:32.266338 ip-10-0-135-67 kubenswrapper[2568]: I0603 16:40:32.266171 2568 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-manager-service-cert\"" Jun 03 16:40:32.266338 ip-10-0-135-67 kubenswrapper[2568]: I0603 16:40:32.266311 2568 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"openshift-service-ca.crt\"" Jun 03 16:40:32.266338 ip-10-0-135-67 kubenswrapper[2568]: I0603 16:40:32.266325 2568 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"kube-root-ca.crt\"" Jun 03 16:40:32.266731 ip-10-0-135-67 kubenswrapper[2568]: I0603 16:40:32.266718 2568 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-manager-dockercfg-zrctl\"" Jun 03 16:40:32.280377 ip-10-0-135-67 kubenswrapper[2568]: I0603 16:40:32.280357 2568 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-5f84758474-km5sn"] Jun 03 16:40:32.394716 ip-10-0-135-67 kubenswrapper[2568]: I0603 16:40:32.394684 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/8333f4cf-cd6f-4918-a180-63e7fcfee215-webhook-cert\") pod \"opendatahub-operator-controller-manager-5f84758474-km5sn\" (UID: \"8333f4cf-cd6f-4918-a180-63e7fcfee215\") " pod="opendatahub/opendatahub-operator-controller-manager-5f84758474-km5sn" Jun 03 16:40:32.394834 ip-10-0-135-67 kubenswrapper[2568]: I0603 16:40:32.394737 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/8333f4cf-cd6f-4918-a180-63e7fcfee215-tmp\") pod \"opendatahub-operator-controller-manager-5f84758474-km5sn\" (UID: \"8333f4cf-cd6f-4918-a180-63e7fcfee215\") " pod="opendatahub/opendatahub-operator-controller-manager-5f84758474-km5sn" Jun 03 16:40:32.394834 ip-10-0-135-67 kubenswrapper[2568]: I0603 16:40:32.394824 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/8333f4cf-cd6f-4918-a180-63e7fcfee215-apiservice-cert\") pod \"opendatahub-operator-controller-manager-5f84758474-km5sn\" (UID: \"8333f4cf-cd6f-4918-a180-63e7fcfee215\") " pod="opendatahub/opendatahub-operator-controller-manager-5f84758474-km5sn" Jun 03 16:40:32.394939 ip-10-0-135-67 kubenswrapper[2568]: I0603 16:40:32.394871 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/8333f4cf-cd6f-4918-a180-63e7fcfee215-manifests\") pod \"opendatahub-operator-controller-manager-5f84758474-km5sn\" (UID: \"8333f4cf-cd6f-4918-a180-63e7fcfee215\") " pod="opendatahub/opendatahub-operator-controller-manager-5f84758474-km5sn" Jun 03 16:40:32.394986 ip-10-0-135-67 kubenswrapper[2568]: I0603 16:40:32.394939 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-zhvck\" (UniqueName: \"kubernetes.io/projected/8333f4cf-cd6f-4918-a180-63e7fcfee215-kube-api-access-zhvck\") pod \"opendatahub-operator-controller-manager-5f84758474-km5sn\" (UID: \"8333f4cf-cd6f-4918-a180-63e7fcfee215\") " pod="opendatahub/opendatahub-operator-controller-manager-5f84758474-km5sn" Jun 03 16:40:32.495777 ip-10-0-135-67 kubenswrapper[2568]: I0603 16:40:32.495755 2568 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/8333f4cf-cd6f-4918-a180-63e7fcfee215-tmp\") pod \"opendatahub-operator-controller-manager-5f84758474-km5sn\" (UID: \"8333f4cf-cd6f-4918-a180-63e7fcfee215\") " pod="opendatahub/opendatahub-operator-controller-manager-5f84758474-km5sn" Jun 03 16:40:32.495883 ip-10-0-135-67 kubenswrapper[2568]: I0603 16:40:32.495804 2568 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/8333f4cf-cd6f-4918-a180-63e7fcfee215-apiservice-cert\") pod \"opendatahub-operator-controller-manager-5f84758474-km5sn\" (UID: \"8333f4cf-cd6f-4918-a180-63e7fcfee215\") " pod="opendatahub/opendatahub-operator-controller-manager-5f84758474-km5sn" Jun 03 16:40:32.495883 ip-10-0-135-67 kubenswrapper[2568]: I0603 16:40:32.495841 2568 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/8333f4cf-cd6f-4918-a180-63e7fcfee215-manifests\") pod \"opendatahub-operator-controller-manager-5f84758474-km5sn\" (UID: \"8333f4cf-cd6f-4918-a180-63e7fcfee215\") " pod="opendatahub/opendatahub-operator-controller-manager-5f84758474-km5sn" Jun 03 16:40:32.495883 ip-10-0-135-67 kubenswrapper[2568]: I0603 16:40:32.495866 2568 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-zhvck\" (UniqueName: \"kubernetes.io/projected/8333f4cf-cd6f-4918-a180-63e7fcfee215-kube-api-access-zhvck\") pod \"opendatahub-operator-controller-manager-5f84758474-km5sn\" (UID: \"8333f4cf-cd6f-4918-a180-63e7fcfee215\") " pod="opendatahub/opendatahub-operator-controller-manager-5f84758474-km5sn" Jun 03 16:40:32.495995 ip-10-0-135-67 kubenswrapper[2568]: I0603 16:40:32.495887 2568 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/8333f4cf-cd6f-4918-a180-63e7fcfee215-webhook-cert\") pod \"opendatahub-operator-controller-manager-5f84758474-km5sn\" (UID: \"8333f4cf-cd6f-4918-a180-63e7fcfee215\") " pod="opendatahub/opendatahub-operator-controller-manager-5f84758474-km5sn" Jun 03 16:40:32.496263 ip-10-0-135-67 kubenswrapper[2568]: I0603 16:40:32.496240 2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/8333f4cf-cd6f-4918-a180-63e7fcfee215-manifests\") pod \"opendatahub-operator-controller-manager-5f84758474-km5sn\" (UID: \"8333f4cf-cd6f-4918-a180-63e7fcfee215\") " pod="opendatahub/opendatahub-operator-controller-manager-5f84758474-km5sn" Jun 03 16:40:32.498028 ip-10-0-135-67 kubenswrapper[2568]: I0603 16:40:32.497991 2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/8333f4cf-cd6f-4918-a180-63e7fcfee215-tmp\") pod \"opendatahub-operator-controller-manager-5f84758474-km5sn\" (UID: \"8333f4cf-cd6f-4918-a180-63e7fcfee215\") " pod="opendatahub/opendatahub-operator-controller-manager-5f84758474-km5sn" Jun 03 16:40:32.498266 ip-10-0-135-67 kubenswrapper[2568]: I0603 16:40:32.498245 2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/8333f4cf-cd6f-4918-a180-63e7fcfee215-apiservice-cert\") pod \"opendatahub-operator-controller-manager-5f84758474-km5sn\" (UID: \"8333f4cf-cd6f-4918-a180-63e7fcfee215\") " pod="opendatahub/opendatahub-operator-controller-manager-5f84758474-km5sn" Jun 03 16:40:32.498377 ip-10-0-135-67 kubenswrapper[2568]: I0603 16:40:32.498359 2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/8333f4cf-cd6f-4918-a180-63e7fcfee215-webhook-cert\") pod \"opendatahub-operator-controller-manager-5f84758474-km5sn\" (UID: \"8333f4cf-cd6f-4918-a180-63e7fcfee215\") " pod="opendatahub/opendatahub-operator-controller-manager-5f84758474-km5sn" Jun 03 16:40:32.504233 ip-10-0-135-67 kubenswrapper[2568]: I0603 16:40:32.504208 2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-zhvck\" (UniqueName: \"kubernetes.io/projected/8333f4cf-cd6f-4918-a180-63e7fcfee215-kube-api-access-zhvck\") pod \"opendatahub-operator-controller-manager-5f84758474-km5sn\" (UID: \"8333f4cf-cd6f-4918-a180-63e7fcfee215\") " pod="opendatahub/opendatahub-operator-controller-manager-5f84758474-km5sn" Jun 03 16:40:32.573564 ip-10-0-135-67 kubenswrapper[2568]: I0603 16:40:32.573510 2568 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/opendatahub-operator-controller-manager-5f84758474-km5sn" Jun 03 16:40:32.708612 ip-10-0-135-67 kubenswrapper[2568]: I0603 16:40:32.708584 2568 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-5f84758474-km5sn"] Jun 03 16:40:32.711497 ip-10-0-135-67 kubenswrapper[2568]: W0603 16:40:32.711473 2568 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod8333f4cf_cd6f_4918_a180_63e7fcfee215.slice/crio-1e596bede0bbae6f32136cd38ac5a9fec7e823ba4725413fea67144c4ac74a23 WatchSource:0}: Error finding container 1e596bede0bbae6f32136cd38ac5a9fec7e823ba4725413fea67144c4ac74a23: Status 404 returned error can't find the container with id 1e596bede0bbae6f32136cd38ac5a9fec7e823ba4725413fea67144c4ac74a23 Jun 03 16:40:32.753867 ip-10-0-135-67 kubenswrapper[2568]: I0603 16:40:32.753844 2568 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-5f84758474-km5sn" event={"ID":"8333f4cf-cd6f-4918-a180-63e7fcfee215","Type":"ContainerStarted","Data":"1e596bede0bbae6f32136cd38ac5a9fec7e823ba4725413fea67144c4ac74a23"} Jun 03 16:40:36.769693 ip-10-0-135-67 kubenswrapper[2568]: I0603 16:40:36.769651 2568 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-5f84758474-km5sn" event={"ID":"8333f4cf-cd6f-4918-a180-63e7fcfee215","Type":"ContainerStarted","Data":"aac6b867e0d265a8834db934e6a20a2930889daf754c91950938b9616a55c05c"} Jun 03 16:40:37.774549 ip-10-0-135-67 kubenswrapper[2568]: I0603 16:40:37.774511 2568 generic.go:358] "Generic (PLEG): container finished" podID="8333f4cf-cd6f-4918-a180-63e7fcfee215" containerID="aac6b867e0d265a8834db934e6a20a2930889daf754c91950938b9616a55c05c" exitCode=0 Jun 03 16:40:37.774989 ip-10-0-135-67 kubenswrapper[2568]: I0603 16:40:37.774599 2568 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-5f84758474-km5sn" event={"ID":"8333f4cf-cd6f-4918-a180-63e7fcfee215","Type":"ContainerDied","Data":"aac6b867e0d265a8834db934e6a20a2930889daf754c91950938b9616a55c05c"} Jun 03 16:40:38.780126 ip-10-0-135-67 kubenswrapper[2568]: I0603 16:40:38.780091 2568 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-5f84758474-km5sn" event={"ID":"8333f4cf-cd6f-4918-a180-63e7fcfee215","Type":"ContainerStarted","Data":"86f0657684d065240a56fec0add828cd5b65954f192f53782c8f5d261134fe63"} Jun 03 16:40:38.780589 ip-10-0-135-67 kubenswrapper[2568]: I0603 16:40:38.780212 2568 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/opendatahub-operator-controller-manager-5f84758474-km5sn" Jun 03 16:40:38.800526 ip-10-0-135-67 kubenswrapper[2568]: I0603 16:40:38.800481 2568 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="opendatahub/opendatahub-operator-controller-manager-5f84758474-km5sn" podStartSLOduration=1.391308995 podStartE2EDuration="6.800465999s" podCreationTimestamp="2026-06-03 16:40:32 +0000 UTC" firstStartedPulling="2026-06-03 16:40:32.713199607 +0000 UTC m=+404.855374239" lastFinishedPulling="2026-06-03 16:40:38.122356602 +0000 UTC m=+410.264531243" observedRunningTime="2026-06-03 16:40:38.798108416 +0000 UTC m=+410.940283069" watchObservedRunningTime="2026-06-03 16:40:38.800465999 +0000 UTC m=+410.942640653" Jun 03 16:40:49.785760 ip-10-0-135-67 kubenswrapper[2568]: I0603 16:40:49.785722 2568 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/opendatahub-operator-controller-manager-5f84758474-km5sn" Jun 03 16:40:52.957944 ip-10-0-135-67 kubenswrapper[2568]: I0603 16:40:52.957904 2568 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-ingress/kube-auth-proxy-598f4f7759-b6b48"] Jun 03 16:40:52.968639 ip-10-0-135-67 kubenswrapper[2568]: I0603 16:40:52.968603 2568 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/kube-auth-proxy-598f4f7759-b6b48" Jun 03 16:40:52.970320 ip-10-0-135-67 kubenswrapper[2568]: I0603 16:40:52.970289 2568 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/kube-auth-proxy-598f4f7759-b6b48"] Jun 03 16:40:52.971099 ip-10-0-135-67 kubenswrapper[2568]: I0603 16:40:52.971069 2568 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"kube-auth-proxy-tls\"" Jun 03 16:40:52.971257 ip-10-0-135-67 kubenswrapper[2568]: I0603 16:40:52.971079 2568 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"kube-auth-proxy-creds\"" Jun 03 16:40:52.971688 ip-10-0-135-67 kubenswrapper[2568]: I0603 16:40:52.971667 2568 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"kube-root-ca.crt\"" Jun 03 16:40:52.971855 ip-10-0-135-67 kubenswrapper[2568]: I0603 16:40:52.971836 2568 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"openshift-service-ca.crt\"" Jun 03 16:40:52.971951 ip-10-0-135-67 kubenswrapper[2568]: I0603 16:40:52.971899 2568 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"kube-auth-proxy-dockercfg-xs9ww\"" Jun 03 16:40:53.165316 ip-10-0-135-67 kubenswrapper[2568]: I0603 16:40:53.165284 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/fcb7566e-d1ea-47f6-9a52-6587b52d501d-tmp\") pod \"kube-auth-proxy-598f4f7759-b6b48\" (UID: \"fcb7566e-d1ea-47f6-9a52-6587b52d501d\") " pod="openshift-ingress/kube-auth-proxy-598f4f7759-b6b48" Jun 03 16:40:53.165316 ip-10-0-135-67 kubenswrapper[2568]: I0603 16:40:53.165316 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-x7kkp\" (UniqueName: \"kubernetes.io/projected/fcb7566e-d1ea-47f6-9a52-6587b52d501d-kube-api-access-x7kkp\") pod \"kube-auth-proxy-598f4f7759-b6b48\" (UID: \"fcb7566e-d1ea-47f6-9a52-6587b52d501d\") " pod="openshift-ingress/kube-auth-proxy-598f4f7759-b6b48" Jun 03 16:40:53.165500 ip-10-0-135-67 kubenswrapper[2568]: I0603 16:40:53.165340 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/fcb7566e-d1ea-47f6-9a52-6587b52d501d-tls-certs\") pod \"kube-auth-proxy-598f4f7759-b6b48\" (UID: \"fcb7566e-d1ea-47f6-9a52-6587b52d501d\") " pod="openshift-ingress/kube-auth-proxy-598f4f7759-b6b48" Jun 03 16:40:53.266376 ip-10-0-135-67 kubenswrapper[2568]: I0603 16:40:53.266349 2568 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/fcb7566e-d1ea-47f6-9a52-6587b52d501d-tmp\") pod \"kube-auth-proxy-598f4f7759-b6b48\" (UID: \"fcb7566e-d1ea-47f6-9a52-6587b52d501d\") " pod="openshift-ingress/kube-auth-proxy-598f4f7759-b6b48" Jun 03 16:40:53.266490 ip-10-0-135-67 kubenswrapper[2568]: I0603 16:40:53.266380 2568 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-x7kkp\" (UniqueName: \"kubernetes.io/projected/fcb7566e-d1ea-47f6-9a52-6587b52d501d-kube-api-access-x7kkp\") pod \"kube-auth-proxy-598f4f7759-b6b48\" (UID: \"fcb7566e-d1ea-47f6-9a52-6587b52d501d\") " pod="openshift-ingress/kube-auth-proxy-598f4f7759-b6b48" Jun 03 16:40:53.266490 ip-10-0-135-67 kubenswrapper[2568]: I0603 16:40:53.266407 2568 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/fcb7566e-d1ea-47f6-9a52-6587b52d501d-tls-certs\") pod \"kube-auth-proxy-598f4f7759-b6b48\" (UID: \"fcb7566e-d1ea-47f6-9a52-6587b52d501d\") " pod="openshift-ingress/kube-auth-proxy-598f4f7759-b6b48" Jun 03 16:40:53.268577 ip-10-0-135-67 kubenswrapper[2568]: I0603 16:40:53.268554 2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/fcb7566e-d1ea-47f6-9a52-6587b52d501d-tmp\") pod \"kube-auth-proxy-598f4f7759-b6b48\" (UID: \"fcb7566e-d1ea-47f6-9a52-6587b52d501d\") " pod="openshift-ingress/kube-auth-proxy-598f4f7759-b6b48" Jun 03 16:40:53.268762 ip-10-0-135-67 kubenswrapper[2568]: I0603 16:40:53.268745 2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/fcb7566e-d1ea-47f6-9a52-6587b52d501d-tls-certs\") pod \"kube-auth-proxy-598f4f7759-b6b48\" (UID: \"fcb7566e-d1ea-47f6-9a52-6587b52d501d\") " pod="openshift-ingress/kube-auth-proxy-598f4f7759-b6b48" Jun 03 16:40:53.274485 ip-10-0-135-67 kubenswrapper[2568]: I0603 16:40:53.274462 2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-x7kkp\" (UniqueName: \"kubernetes.io/projected/fcb7566e-d1ea-47f6-9a52-6587b52d501d-kube-api-access-x7kkp\") pod \"kube-auth-proxy-598f4f7759-b6b48\" (UID: \"fcb7566e-d1ea-47f6-9a52-6587b52d501d\") " pod="openshift-ingress/kube-auth-proxy-598f4f7759-b6b48" Jun 03 16:40:53.281357 ip-10-0-135-67 kubenswrapper[2568]: I0603 16:40:53.281336 2568 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/kube-auth-proxy-598f4f7759-b6b48" Jun 03 16:40:53.404415 ip-10-0-135-67 kubenswrapper[2568]: I0603 16:40:53.404273 2568 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/kube-auth-proxy-598f4f7759-b6b48"] Jun 03 16:40:53.406726 ip-10-0-135-67 kubenswrapper[2568]: W0603 16:40:53.406701 2568 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podfcb7566e_d1ea_47f6_9a52_6587b52d501d.slice/crio-c6f4df5d4df480c9b9b97a3b0e591513e89d1108ceff4e915d9e00ca78ff33ee WatchSource:0}: Error finding container c6f4df5d4df480c9b9b97a3b0e591513e89d1108ceff4e915d9e00ca78ff33ee: Status 404 returned error can't find the container with id c6f4df5d4df480c9b9b97a3b0e591513e89d1108ceff4e915d9e00ca78ff33ee Jun 03 16:40:53.831690 ip-10-0-135-67 kubenswrapper[2568]: I0603 16:40:53.831656 2568 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/kube-auth-proxy-598f4f7759-b6b48" event={"ID":"fcb7566e-d1ea-47f6-9a52-6587b52d501d","Type":"ContainerStarted","Data":"c6f4df5d4df480c9b9b97a3b0e591513e89d1108ceff4e915d9e00ca78ff33ee"} Jun 03 16:40:55.071815 ip-10-0-135-67 kubenswrapper[2568]: I0603 16:40:55.071775 2568 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-marketplace/4c892a6d2d8a57acbc49427d3a7d24e253bab25be2c607ef405d2c4835tprpr"] Jun 03 16:40:55.082031 ip-10-0-135-67 kubenswrapper[2568]: I0603 16:40:55.081882 2568 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/4c892a6d2d8a57acbc49427d3a7d24e253bab25be2c607ef405d2c4835tprpr"] Jun 03 16:40:55.082179 ip-10-0-135-67 kubenswrapper[2568]: I0603 16:40:55.082036 2568 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/4c892a6d2d8a57acbc49427d3a7d24e253bab25be2c607ef405d2c4835tprpr" Jun 03 16:40:55.084085 ip-10-0-135-67 kubenswrapper[2568]: I0603 16:40:55.084059 2568 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"openshift-service-ca.crt\"" Jun 03 16:40:55.084687 ip-10-0-135-67 kubenswrapper[2568]: I0603 16:40:55.084671 2568 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"kube-root-ca.crt\"" Jun 03 16:40:55.084884 ip-10-0-135-67 kubenswrapper[2568]: I0603 16:40:55.084869 2568 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-marketplace\"/\"default-dockercfg-mhpmz\"" Jun 03 16:40:55.178049 ip-10-0-135-67 kubenswrapper[2568]: I0603 16:40:55.177997 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-6hhwm\" (UniqueName: \"kubernetes.io/projected/e164ec80-4b61-492b-9a88-9a6cc4480a72-kube-api-access-6hhwm\") pod \"4c892a6d2d8a57acbc49427d3a7d24e253bab25be2c607ef405d2c4835tprpr\" (UID: \"e164ec80-4b61-492b-9a88-9a6cc4480a72\") " pod="openshift-marketplace/4c892a6d2d8a57acbc49427d3a7d24e253bab25be2c607ef405d2c4835tprpr" Jun 03 16:40:55.178204 ip-10-0-135-67 kubenswrapper[2568]: I0603 16:40:55.178066 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/e164ec80-4b61-492b-9a88-9a6cc4480a72-bundle\") pod \"4c892a6d2d8a57acbc49427d3a7d24e253bab25be2c607ef405d2c4835tprpr\" (UID: \"e164ec80-4b61-492b-9a88-9a6cc4480a72\") " pod="openshift-marketplace/4c892a6d2d8a57acbc49427d3a7d24e253bab25be2c607ef405d2c4835tprpr" Jun 03 16:40:55.178263 ip-10-0-135-67 kubenswrapper[2568]: I0603 16:40:55.178203 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/e164ec80-4b61-492b-9a88-9a6cc4480a72-util\") pod \"4c892a6d2d8a57acbc49427d3a7d24e253bab25be2c607ef405d2c4835tprpr\" (UID: \"e164ec80-4b61-492b-9a88-9a6cc4480a72\") " pod="openshift-marketplace/4c892a6d2d8a57acbc49427d3a7d24e253bab25be2c607ef405d2c4835tprpr" Jun 03 16:40:55.279304 ip-10-0-135-67 kubenswrapper[2568]: I0603 16:40:55.279262 2568 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/e164ec80-4b61-492b-9a88-9a6cc4480a72-util\") pod \"4c892a6d2d8a57acbc49427d3a7d24e253bab25be2c607ef405d2c4835tprpr\" (UID: \"e164ec80-4b61-492b-9a88-9a6cc4480a72\") " pod="openshift-marketplace/4c892a6d2d8a57acbc49427d3a7d24e253bab25be2c607ef405d2c4835tprpr" Jun 03 16:40:55.279480 ip-10-0-135-67 kubenswrapper[2568]: I0603 16:40:55.279378 2568 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-6hhwm\" (UniqueName: \"kubernetes.io/projected/e164ec80-4b61-492b-9a88-9a6cc4480a72-kube-api-access-6hhwm\") pod \"4c892a6d2d8a57acbc49427d3a7d24e253bab25be2c607ef405d2c4835tprpr\" (UID: \"e164ec80-4b61-492b-9a88-9a6cc4480a72\") " pod="openshift-marketplace/4c892a6d2d8a57acbc49427d3a7d24e253bab25be2c607ef405d2c4835tprpr" Jun 03 16:40:55.279480 ip-10-0-135-67 kubenswrapper[2568]: I0603 16:40:55.279425 2568 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/e164ec80-4b61-492b-9a88-9a6cc4480a72-bundle\") pod \"4c892a6d2d8a57acbc49427d3a7d24e253bab25be2c607ef405d2c4835tprpr\" (UID: \"e164ec80-4b61-492b-9a88-9a6cc4480a72\") " pod="openshift-marketplace/4c892a6d2d8a57acbc49427d3a7d24e253bab25be2c607ef405d2c4835tprpr" Jun 03 16:40:55.279722 ip-10-0-135-67 kubenswrapper[2568]: I0603 16:40:55.279698 2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/e164ec80-4b61-492b-9a88-9a6cc4480a72-util\") pod \"4c892a6d2d8a57acbc49427d3a7d24e253bab25be2c607ef405d2c4835tprpr\" (UID: \"e164ec80-4b61-492b-9a88-9a6cc4480a72\") " pod="openshift-marketplace/4c892a6d2d8a57acbc49427d3a7d24e253bab25be2c607ef405d2c4835tprpr" Jun 03 16:40:55.279812 ip-10-0-135-67 kubenswrapper[2568]: I0603 16:40:55.279736 2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/e164ec80-4b61-492b-9a88-9a6cc4480a72-bundle\") pod \"4c892a6d2d8a57acbc49427d3a7d24e253bab25be2c607ef405d2c4835tprpr\" (UID: \"e164ec80-4b61-492b-9a88-9a6cc4480a72\") " pod="openshift-marketplace/4c892a6d2d8a57acbc49427d3a7d24e253bab25be2c607ef405d2c4835tprpr" Jun 03 16:40:55.293305 ip-10-0-135-67 kubenswrapper[2568]: I0603 16:40:55.293269 2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-6hhwm\" (UniqueName: \"kubernetes.io/projected/e164ec80-4b61-492b-9a88-9a6cc4480a72-kube-api-access-6hhwm\") pod \"4c892a6d2d8a57acbc49427d3a7d24e253bab25be2c607ef405d2c4835tprpr\" (UID: \"e164ec80-4b61-492b-9a88-9a6cc4480a72\") " pod="openshift-marketplace/4c892a6d2d8a57acbc49427d3a7d24e253bab25be2c607ef405d2c4835tprpr" Jun 03 16:40:55.396245 ip-10-0-135-67 kubenswrapper[2568]: I0603 16:40:55.396181 2568 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/4c892a6d2d8a57acbc49427d3a7d24e253bab25be2c607ef405d2c4835tprpr" Jun 03 16:40:55.536555 ip-10-0-135-67 kubenswrapper[2568]: I0603 16:40:55.536523 2568 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/4c892a6d2d8a57acbc49427d3a7d24e253bab25be2c607ef405d2c4835tprpr"] Jun 03 16:40:55.538657 ip-10-0-135-67 kubenswrapper[2568]: W0603 16:40:55.538625 2568 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pode164ec80_4b61_492b_9a88_9a6cc4480a72.slice/crio-f3a25114aaccecf1aadac6681ae6878186a35f44dbbb73f2b22864d64b726a38 WatchSource:0}: Error finding container f3a25114aaccecf1aadac6681ae6878186a35f44dbbb73f2b22864d64b726a38: Status 404 returned error can't find the container with id f3a25114aaccecf1aadac6681ae6878186a35f44dbbb73f2b22864d64b726a38 Jun 03 16:40:55.841192 ip-10-0-135-67 kubenswrapper[2568]: I0603 16:40:55.841163 2568 generic.go:358] "Generic (PLEG): container finished" podID="e164ec80-4b61-492b-9a88-9a6cc4480a72" containerID="488eb013467e69b3fa3f3558d2bf89ad1e7a0b882d2c4e2acd32e557be171ee9" exitCode=0 Jun 03 16:40:55.841350 ip-10-0-135-67 kubenswrapper[2568]: I0603 16:40:55.841250 2568 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/4c892a6d2d8a57acbc49427d3a7d24e253bab25be2c607ef405d2c4835tprpr" event={"ID":"e164ec80-4b61-492b-9a88-9a6cc4480a72","Type":"ContainerDied","Data":"488eb013467e69b3fa3f3558d2bf89ad1e7a0b882d2c4e2acd32e557be171ee9"} Jun 03 16:40:55.841350 ip-10-0-135-67 kubenswrapper[2568]: I0603 16:40:55.841288 2568 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/4c892a6d2d8a57acbc49427d3a7d24e253bab25be2c607ef405d2c4835tprpr" event={"ID":"e164ec80-4b61-492b-9a88-9a6cc4480a72","Type":"ContainerStarted","Data":"f3a25114aaccecf1aadac6681ae6878186a35f44dbbb73f2b22864d64b726a38"} Jun 03 16:40:56.845883 ip-10-0-135-67 kubenswrapper[2568]: I0603 16:40:56.845850 2568 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/kube-auth-proxy-598f4f7759-b6b48" event={"ID":"fcb7566e-d1ea-47f6-9a52-6587b52d501d","Type":"ContainerStarted","Data":"e2db01eea8b89a6067b51cf04f2f404ae23e23bcd55154d791634ab244270647"} Jun 03 16:40:56.860881 ip-10-0-135-67 kubenswrapper[2568]: I0603 16:40:56.860835 2568 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-ingress/kube-auth-proxy-598f4f7759-b6b48" podStartSLOduration=1.647613571 podStartE2EDuration="4.860821463s" podCreationTimestamp="2026-06-03 16:40:52 +0000 UTC" firstStartedPulling="2026-06-03 16:40:53.408442292 +0000 UTC m=+425.550616927" lastFinishedPulling="2026-06-03 16:40:56.621650187 +0000 UTC m=+428.763824819" observedRunningTime="2026-06-03 16:40:56.859126429 +0000 UTC m=+429.001301084" watchObservedRunningTime="2026-06-03 16:40:56.860821463 +0000 UTC m=+429.002996118" Jun 03 16:40:57.850620 ip-10-0-135-67 kubenswrapper[2568]: I0603 16:40:57.850589 2568 generic.go:358] "Generic (PLEG): container finished" podID="e164ec80-4b61-492b-9a88-9a6cc4480a72" containerID="fb2979991e63ad2e07c90fa45478994315cdf753c3ba67eb60d51eeee82711f9" exitCode=0 Jun 03 16:40:57.850989 ip-10-0-135-67 kubenswrapper[2568]: I0603 16:40:57.850688 2568 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/4c892a6d2d8a57acbc49427d3a7d24e253bab25be2c607ef405d2c4835tprpr" event={"ID":"e164ec80-4b61-492b-9a88-9a6cc4480a72","Type":"ContainerDied","Data":"fb2979991e63ad2e07c90fa45478994315cdf753c3ba67eb60d51eeee82711f9"} Jun 03 16:40:58.858258 ip-10-0-135-67 kubenswrapper[2568]: I0603 16:40:58.858220 2568 generic.go:358] "Generic (PLEG): container finished" podID="e164ec80-4b61-492b-9a88-9a6cc4480a72" containerID="4860f1a025ffd66806d96a6f2b808ae3335e097cf28755aba3426f8fc0cda74c" exitCode=0 Jun 03 16:40:58.858665 ip-10-0-135-67 kubenswrapper[2568]: I0603 16:40:58.858304 2568 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/4c892a6d2d8a57acbc49427d3a7d24e253bab25be2c607ef405d2c4835tprpr" event={"ID":"e164ec80-4b61-492b-9a88-9a6cc4480a72","Type":"ContainerDied","Data":"4860f1a025ffd66806d96a6f2b808ae3335e097cf28755aba3426f8fc0cda74c"} Jun 03 16:40:59.994524 ip-10-0-135-67 kubenswrapper[2568]: I0603 16:40:59.994495 2568 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/4c892a6d2d8a57acbc49427d3a7d24e253bab25be2c607ef405d2c4835tprpr" Jun 03 16:41:00.019401 ip-10-0-135-67 kubenswrapper[2568]: I0603 16:41:00.019377 2568 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/e164ec80-4b61-492b-9a88-9a6cc4480a72-util\") pod \"e164ec80-4b61-492b-9a88-9a6cc4480a72\" (UID: \"e164ec80-4b61-492b-9a88-9a6cc4480a72\") " Jun 03 16:41:00.019512 ip-10-0-135-67 kubenswrapper[2568]: I0603 16:41:00.019419 2568 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-6hhwm\" (UniqueName: \"kubernetes.io/projected/e164ec80-4b61-492b-9a88-9a6cc4480a72-kube-api-access-6hhwm\") pod \"e164ec80-4b61-492b-9a88-9a6cc4480a72\" (UID: \"e164ec80-4b61-492b-9a88-9a6cc4480a72\") " Jun 03 16:41:00.019512 ip-10-0-135-67 kubenswrapper[2568]: I0603 16:41:00.019451 2568 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/e164ec80-4b61-492b-9a88-9a6cc4480a72-bundle\") pod \"e164ec80-4b61-492b-9a88-9a6cc4480a72\" (UID: \"e164ec80-4b61-492b-9a88-9a6cc4480a72\") " Jun 03 16:41:00.020571 ip-10-0-135-67 kubenswrapper[2568]: I0603 16:41:00.020538 2568 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/e164ec80-4b61-492b-9a88-9a6cc4480a72-bundle" (OuterVolumeSpecName: "bundle") pod "e164ec80-4b61-492b-9a88-9a6cc4480a72" (UID: "e164ec80-4b61-492b-9a88-9a6cc4480a72"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jun 03 16:41:00.021689 ip-10-0-135-67 kubenswrapper[2568]: I0603 16:41:00.021654 2568 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/e164ec80-4b61-492b-9a88-9a6cc4480a72-kube-api-access-6hhwm" (OuterVolumeSpecName: "kube-api-access-6hhwm") pod "e164ec80-4b61-492b-9a88-9a6cc4480a72" (UID: "e164ec80-4b61-492b-9a88-9a6cc4480a72"). InnerVolumeSpecName "kube-api-access-6hhwm". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 03 16:41:00.026113 ip-10-0-135-67 kubenswrapper[2568]: I0603 16:41:00.026083 2568 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/e164ec80-4b61-492b-9a88-9a6cc4480a72-util" (OuterVolumeSpecName: "util") pod "e164ec80-4b61-492b-9a88-9a6cc4480a72" (UID: "e164ec80-4b61-492b-9a88-9a6cc4480a72"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jun 03 16:41:00.120793 ip-10-0-135-67 kubenswrapper[2568]: I0603 16:41:00.120724 2568 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/e164ec80-4b61-492b-9a88-9a6cc4480a72-util\") on node \"ip-10-0-135-67.ec2.internal\" DevicePath \"\"" Jun 03 16:41:00.120793 ip-10-0-135-67 kubenswrapper[2568]: I0603 16:41:00.120751 2568 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-6hhwm\" (UniqueName: \"kubernetes.io/projected/e164ec80-4b61-492b-9a88-9a6cc4480a72-kube-api-access-6hhwm\") on node \"ip-10-0-135-67.ec2.internal\" DevicePath \"\"" Jun 03 16:41:00.120793 ip-10-0-135-67 kubenswrapper[2568]: I0603 16:41:00.120761 2568 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/e164ec80-4b61-492b-9a88-9a6cc4480a72-bundle\") on node \"ip-10-0-135-67.ec2.internal\" DevicePath \"\"" Jun 03 16:41:00.867292 ip-10-0-135-67 kubenswrapper[2568]: I0603 16:41:00.867246 2568 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/4c892a6d2d8a57acbc49427d3a7d24e253bab25be2c607ef405d2c4835tprpr" event={"ID":"e164ec80-4b61-492b-9a88-9a6cc4480a72","Type":"ContainerDied","Data":"f3a25114aaccecf1aadac6681ae6878186a35f44dbbb73f2b22864d64b726a38"} Jun 03 16:41:00.867292 ip-10-0-135-67 kubenswrapper[2568]: I0603 16:41:00.867272 2568 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/4c892a6d2d8a57acbc49427d3a7d24e253bab25be2c607ef405d2c4835tprpr" Jun 03 16:41:00.867292 ip-10-0-135-67 kubenswrapper[2568]: I0603 16:41:00.867287 2568 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="f3a25114aaccecf1aadac6681ae6878186a35f44dbbb73f2b22864d64b726a38" Jun 03 16:41:01.410980 ip-10-0-135-67 kubenswrapper[2568]: I0603 16:41:01.410950 2568 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-lws-operator/lws-controller-manager-69bc585896-vqzbf"] Jun 03 16:41:01.411353 ip-10-0-135-67 kubenswrapper[2568]: I0603 16:41:01.411304 2568 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="e164ec80-4b61-492b-9a88-9a6cc4480a72" containerName="util" Jun 03 16:41:01.411353 ip-10-0-135-67 kubenswrapper[2568]: I0603 16:41:01.411317 2568 state_mem.go:107] "Deleted CPUSet assignment" podUID="e164ec80-4b61-492b-9a88-9a6cc4480a72" containerName="util" Jun 03 16:41:01.411353 ip-10-0-135-67 kubenswrapper[2568]: I0603 16:41:01.411336 2568 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="e164ec80-4b61-492b-9a88-9a6cc4480a72" containerName="pull" Jun 03 16:41:01.411353 ip-10-0-135-67 kubenswrapper[2568]: I0603 16:41:01.411341 2568 state_mem.go:107] "Deleted CPUSet assignment" podUID="e164ec80-4b61-492b-9a88-9a6cc4480a72" containerName="pull" Jun 03 16:41:01.411353 ip-10-0-135-67 kubenswrapper[2568]: I0603 16:41:01.411348 2568 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="e164ec80-4b61-492b-9a88-9a6cc4480a72" containerName="extract" Jun 03 16:41:01.411353 ip-10-0-135-67 kubenswrapper[2568]: I0603 16:41:01.411353 2568 state_mem.go:107] "Deleted CPUSet assignment" podUID="e164ec80-4b61-492b-9a88-9a6cc4480a72" containerName="extract" Jun 03 16:41:01.411532 ip-10-0-135-67 kubenswrapper[2568]: I0603 16:41:01.411407 2568 memory_manager.go:356] "RemoveStaleState removing state" podUID="e164ec80-4b61-492b-9a88-9a6cc4480a72" containerName="extract" Jun 03 16:41:01.415702 ip-10-0-135-67 kubenswrapper[2568]: I0603 16:41:01.415687 2568 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-lws-operator/lws-controller-manager-69bc585896-vqzbf" Jun 03 16:41:01.417796 ip-10-0-135-67 kubenswrapper[2568]: I0603 16:41:01.417774 2568 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-lws-operator\"/\"lws-manager-config\"" Jun 03 16:41:01.418657 ip-10-0-135-67 kubenswrapper[2568]: I0603 16:41:01.418638 2568 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-lws-operator\"/\"openshift-service-ca.crt\"" Jun 03 16:41:01.418855 ip-10-0-135-67 kubenswrapper[2568]: I0603 16:41:01.418792 2568 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-lws-operator\"/\"lws-controller-manager-dockercfg-6h8bk\"" Jun 03 16:41:01.418975 ip-10-0-135-67 kubenswrapper[2568]: I0603 16:41:01.418947 2568 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-lws-operator\"/\"kube-root-ca.crt\"" Jun 03 16:41:01.419087 ip-10-0-135-67 kubenswrapper[2568]: I0603 16:41:01.419036 2568 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-lws-operator\"/\"metrics-server-cert\"" Jun 03 16:41:01.419190 ip-10-0-135-67 kubenswrapper[2568]: I0603 16:41:01.419171 2568 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-lws-operator\"/\"webhook-server-cert\"" Jun 03 16:41:01.421269 ip-10-0-135-67 kubenswrapper[2568]: I0603 16:41:01.421249 2568 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-lws-operator/lws-controller-manager-69bc585896-vqzbf"] Jun 03 16:41:01.432835 ip-10-0-135-67 kubenswrapper[2568]: I0603 16:41:01.432808 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/9c9fc1b3-19e7-4da6-92c9-0415194e0271-cert\") pod \"lws-controller-manager-69bc585896-vqzbf\" (UID: \"9c9fc1b3-19e7-4da6-92c9-0415194e0271\") " pod="openshift-lws-operator/lws-controller-manager-69bc585896-vqzbf" Jun 03 16:41:01.432946 ip-10-0-135-67 kubenswrapper[2568]: I0603 16:41:01.432844 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-4gcmz\" (UniqueName: \"kubernetes.io/projected/9c9fc1b3-19e7-4da6-92c9-0415194e0271-kube-api-access-4gcmz\") pod \"lws-controller-manager-69bc585896-vqzbf\" (UID: \"9c9fc1b3-19e7-4da6-92c9-0415194e0271\") " pod="openshift-lws-operator/lws-controller-manager-69bc585896-vqzbf" Jun 03 16:41:01.432946 ip-10-0-135-67 kubenswrapper[2568]: I0603 16:41:01.432882 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-cert\" (UniqueName: \"kubernetes.io/secret/9c9fc1b3-19e7-4da6-92c9-0415194e0271-metrics-cert\") pod \"lws-controller-manager-69bc585896-vqzbf\" (UID: \"9c9fc1b3-19e7-4da6-92c9-0415194e0271\") " pod="openshift-lws-operator/lws-controller-manager-69bc585896-vqzbf" Jun 03 16:41:01.433107 ip-10-0-135-67 kubenswrapper[2568]: I0603 16:41:01.432993 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"manager-config\" (UniqueName: \"kubernetes.io/configmap/9c9fc1b3-19e7-4da6-92c9-0415194e0271-manager-config\") pod \"lws-controller-manager-69bc585896-vqzbf\" (UID: \"9c9fc1b3-19e7-4da6-92c9-0415194e0271\") " pod="openshift-lws-operator/lws-controller-manager-69bc585896-vqzbf" Jun 03 16:41:01.533477 ip-10-0-135-67 kubenswrapper[2568]: I0603 16:41:01.533442 2568 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/9c9fc1b3-19e7-4da6-92c9-0415194e0271-cert\") pod \"lws-controller-manager-69bc585896-vqzbf\" (UID: \"9c9fc1b3-19e7-4da6-92c9-0415194e0271\") " pod="openshift-lws-operator/lws-controller-manager-69bc585896-vqzbf" Jun 03 16:41:01.533477 ip-10-0-135-67 kubenswrapper[2568]: I0603 16:41:01.533481 2568 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-4gcmz\" (UniqueName: \"kubernetes.io/projected/9c9fc1b3-19e7-4da6-92c9-0415194e0271-kube-api-access-4gcmz\") pod \"lws-controller-manager-69bc585896-vqzbf\" (UID: \"9c9fc1b3-19e7-4da6-92c9-0415194e0271\") " pod="openshift-lws-operator/lws-controller-manager-69bc585896-vqzbf" Jun 03 16:41:01.533689 ip-10-0-135-67 kubenswrapper[2568]: I0603 16:41:01.533505 2568 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-cert\" (UniqueName: \"kubernetes.io/secret/9c9fc1b3-19e7-4da6-92c9-0415194e0271-metrics-cert\") pod \"lws-controller-manager-69bc585896-vqzbf\" (UID: \"9c9fc1b3-19e7-4da6-92c9-0415194e0271\") " pod="openshift-lws-operator/lws-controller-manager-69bc585896-vqzbf" Jun 03 16:41:01.533689 ip-10-0-135-67 kubenswrapper[2568]: I0603 16:41:01.533554 2568 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"manager-config\" (UniqueName: \"kubernetes.io/configmap/9c9fc1b3-19e7-4da6-92c9-0415194e0271-manager-config\") pod \"lws-controller-manager-69bc585896-vqzbf\" (UID: \"9c9fc1b3-19e7-4da6-92c9-0415194e0271\") " pod="openshift-lws-operator/lws-controller-manager-69bc585896-vqzbf" Jun 03 16:41:01.534321 ip-10-0-135-67 kubenswrapper[2568]: I0603 16:41:01.534300 2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"manager-config\" (UniqueName: \"kubernetes.io/configmap/9c9fc1b3-19e7-4da6-92c9-0415194e0271-manager-config\") pod \"lws-controller-manager-69bc585896-vqzbf\" (UID: \"9c9fc1b3-19e7-4da6-92c9-0415194e0271\") " pod="openshift-lws-operator/lws-controller-manager-69bc585896-vqzbf" Jun 03 16:41:01.536125 ip-10-0-135-67 kubenswrapper[2568]: I0603 16:41:01.536091 2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/9c9fc1b3-19e7-4da6-92c9-0415194e0271-cert\") pod \"lws-controller-manager-69bc585896-vqzbf\" (UID: \"9c9fc1b3-19e7-4da6-92c9-0415194e0271\") " pod="openshift-lws-operator/lws-controller-manager-69bc585896-vqzbf" Jun 03 16:41:01.537089 ip-10-0-135-67 kubenswrapper[2568]: I0603 16:41:01.537072 2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-cert\" (UniqueName: \"kubernetes.io/secret/9c9fc1b3-19e7-4da6-92c9-0415194e0271-metrics-cert\") pod \"lws-controller-manager-69bc585896-vqzbf\" (UID: \"9c9fc1b3-19e7-4da6-92c9-0415194e0271\") " pod="openshift-lws-operator/lws-controller-manager-69bc585896-vqzbf" Jun 03 16:41:01.551481 ip-10-0-135-67 kubenswrapper[2568]: I0603 16:41:01.551458 2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-4gcmz\" (UniqueName: \"kubernetes.io/projected/9c9fc1b3-19e7-4da6-92c9-0415194e0271-kube-api-access-4gcmz\") pod \"lws-controller-manager-69bc585896-vqzbf\" (UID: \"9c9fc1b3-19e7-4da6-92c9-0415194e0271\") " pod="openshift-lws-operator/lws-controller-manager-69bc585896-vqzbf" Jun 03 16:41:01.726721 ip-10-0-135-67 kubenswrapper[2568]: I0603 16:41:01.726636 2568 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-lws-operator/lws-controller-manager-69bc585896-vqzbf" Jun 03 16:41:01.883457 ip-10-0-135-67 kubenswrapper[2568]: I0603 16:41:01.883425 2568 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-lws-operator/lws-controller-manager-69bc585896-vqzbf"] Jun 03 16:41:01.886063 ip-10-0-135-67 kubenswrapper[2568]: W0603 16:41:01.886036 2568 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod9c9fc1b3_19e7_4da6_92c9_0415194e0271.slice/crio-028a774da286b492f1d40651e28636fd7fb9a63baea18ec400b34f240d6e7e03 WatchSource:0}: Error finding container 028a774da286b492f1d40651e28636fd7fb9a63baea18ec400b34f240d6e7e03: Status 404 returned error can't find the container with id 028a774da286b492f1d40651e28636fd7fb9a63baea18ec400b34f240d6e7e03 Jun 03 16:41:02.880315 ip-10-0-135-67 kubenswrapper[2568]: I0603 16:41:02.880276 2568 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-lws-operator/lws-controller-manager-69bc585896-vqzbf" event={"ID":"9c9fc1b3-19e7-4da6-92c9-0415194e0271","Type":"ContainerStarted","Data":"028a774da286b492f1d40651e28636fd7fb9a63baea18ec400b34f240d6e7e03"} Jun 03 16:41:04.889566 ip-10-0-135-67 kubenswrapper[2568]: I0603 16:41:04.889471 2568 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-lws-operator/lws-controller-manager-69bc585896-vqzbf" event={"ID":"9c9fc1b3-19e7-4da6-92c9-0415194e0271","Type":"ContainerStarted","Data":"52897c791987f8462141de2ec6f1812ffc5fe70c981e06f44cb04ada7434b49f"} Jun 03 16:41:04.889907 ip-10-0-135-67 kubenswrapper[2568]: I0603 16:41:04.889570 2568 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-lws-operator/lws-controller-manager-69bc585896-vqzbf" Jun 03 16:41:04.904684 ip-10-0-135-67 kubenswrapper[2568]: I0603 16:41:04.904602 2568 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-lws-operator/lws-controller-manager-69bc585896-vqzbf" podStartSLOduration=1.259531621 podStartE2EDuration="3.904588792s" podCreationTimestamp="2026-06-03 16:41:01 +0000 UTC" firstStartedPulling="2026-06-03 16:41:01.887891119 +0000 UTC m=+434.030065751" lastFinishedPulling="2026-06-03 16:41:04.532948282 +0000 UTC m=+436.675122922" observedRunningTime="2026-06-03 16:41:04.904351297 +0000 UTC m=+437.046525952" watchObservedRunningTime="2026-06-03 16:41:04.904588792 +0000 UTC m=+437.046763447" Jun 03 16:41:09.952201 ip-10-0-135-67 kubenswrapper[2568]: I0603 16:41:09.952117 2568 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-marketplace/c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762a79jxs"] Jun 03 16:41:09.955473 ip-10-0-135-67 kubenswrapper[2568]: I0603 16:41:09.955450 2568 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762a79jxs" Jun 03 16:41:09.958152 ip-10-0-135-67 kubenswrapper[2568]: I0603 16:41:09.958132 2568 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-marketplace\"/\"default-dockercfg-mhpmz\"" Jun 03 16:41:09.958331 ip-10-0-135-67 kubenswrapper[2568]: I0603 16:41:09.958319 2568 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"openshift-service-ca.crt\"" Jun 03 16:41:09.958817 ip-10-0-135-67 kubenswrapper[2568]: I0603 16:41:09.958800 2568 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"kube-root-ca.crt\"" Jun 03 16:41:09.975235 ip-10-0-135-67 kubenswrapper[2568]: I0603 16:41:09.975204 2568 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762a79jxs"] Jun 03 16:41:10.017778 ip-10-0-135-67 kubenswrapper[2568]: I0603 16:41:10.017747 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/26a13018-4874-4c54-ac49-9461af810ef0-bundle\") pod \"c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762a79jxs\" (UID: \"26a13018-4874-4c54-ac49-9461af810ef0\") " pod="openshift-marketplace/c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762a79jxs" Jun 03 16:41:10.017928 ip-10-0-135-67 kubenswrapper[2568]: I0603 16:41:10.017867 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-djccd\" (UniqueName: \"kubernetes.io/projected/26a13018-4874-4c54-ac49-9461af810ef0-kube-api-access-djccd\") pod \"c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762a79jxs\" (UID: \"26a13018-4874-4c54-ac49-9461af810ef0\") " pod="openshift-marketplace/c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762a79jxs" Jun 03 16:41:10.017928 ip-10-0-135-67 kubenswrapper[2568]: I0603 16:41:10.017897 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/26a13018-4874-4c54-ac49-9461af810ef0-util\") pod \"c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762a79jxs\" (UID: \"26a13018-4874-4c54-ac49-9461af810ef0\") " pod="openshift-marketplace/c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762a79jxs" Jun 03 16:41:10.118419 ip-10-0-135-67 kubenswrapper[2568]: I0603 16:41:10.118369 2568 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-djccd\" (UniqueName: \"kubernetes.io/projected/26a13018-4874-4c54-ac49-9461af810ef0-kube-api-access-djccd\") pod \"c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762a79jxs\" (UID: \"26a13018-4874-4c54-ac49-9461af810ef0\") " pod="openshift-marketplace/c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762a79jxs" Jun 03 16:41:10.118614 ip-10-0-135-67 kubenswrapper[2568]: I0603 16:41:10.118428 2568 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/26a13018-4874-4c54-ac49-9461af810ef0-util\") pod \"c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762a79jxs\" (UID: \"26a13018-4874-4c54-ac49-9461af810ef0\") " pod="openshift-marketplace/c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762a79jxs" Jun 03 16:41:10.118614 ip-10-0-135-67 kubenswrapper[2568]: I0603 16:41:10.118496 2568 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/26a13018-4874-4c54-ac49-9461af810ef0-bundle\") pod \"c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762a79jxs\" (UID: \"26a13018-4874-4c54-ac49-9461af810ef0\") " pod="openshift-marketplace/c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762a79jxs" Jun 03 16:41:10.118848 ip-10-0-135-67 kubenswrapper[2568]: I0603 16:41:10.118817 2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/26a13018-4874-4c54-ac49-9461af810ef0-util\") pod \"c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762a79jxs\" (UID: \"26a13018-4874-4c54-ac49-9461af810ef0\") " pod="openshift-marketplace/c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762a79jxs" Jun 03 16:41:10.118917 ip-10-0-135-67 kubenswrapper[2568]: I0603 16:41:10.118872 2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/26a13018-4874-4c54-ac49-9461af810ef0-bundle\") pod \"c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762a79jxs\" (UID: \"26a13018-4874-4c54-ac49-9461af810ef0\") " pod="openshift-marketplace/c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762a79jxs" Jun 03 16:41:10.133886 ip-10-0-135-67 kubenswrapper[2568]: I0603 16:41:10.133863 2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-djccd\" (UniqueName: \"kubernetes.io/projected/26a13018-4874-4c54-ac49-9461af810ef0-kube-api-access-djccd\") pod \"c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762a79jxs\" (UID: \"26a13018-4874-4c54-ac49-9461af810ef0\") " pod="openshift-marketplace/c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762a79jxs" Jun 03 16:41:10.268074 ip-10-0-135-67 kubenswrapper[2568]: I0603 16:41:10.268042 2568 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762a79jxs" Jun 03 16:41:10.419280 ip-10-0-135-67 kubenswrapper[2568]: W0603 16:41:10.419250 2568 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod26a13018_4874_4c54_ac49_9461af810ef0.slice/crio-476df402cf39b1bb4cb8317b5274c68eea9722e56e31d2f6ec9c11122e3c69c6 WatchSource:0}: Error finding container 476df402cf39b1bb4cb8317b5274c68eea9722e56e31d2f6ec9c11122e3c69c6: Status 404 returned error can't find the container with id 476df402cf39b1bb4cb8317b5274c68eea9722e56e31d2f6ec9c11122e3c69c6 Jun 03 16:41:10.421099 ip-10-0-135-67 kubenswrapper[2568]: I0603 16:41:10.421077 2568 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762a79jxs"] Jun 03 16:41:10.912507 ip-10-0-135-67 kubenswrapper[2568]: I0603 16:41:10.912415 2568 generic.go:358] "Generic (PLEG): container finished" podID="26a13018-4874-4c54-ac49-9461af810ef0" containerID="806a2c38ff4ff4c9dda68d1b0437f9ada6e451853bef740acff60887b44b28b8" exitCode=0 Jun 03 16:41:10.912507 ip-10-0-135-67 kubenswrapper[2568]: I0603 16:41:10.912494 2568 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762a79jxs" event={"ID":"26a13018-4874-4c54-ac49-9461af810ef0","Type":"ContainerDied","Data":"806a2c38ff4ff4c9dda68d1b0437f9ada6e451853bef740acff60887b44b28b8"} Jun 03 16:41:10.912680 ip-10-0-135-67 kubenswrapper[2568]: I0603 16:41:10.912525 2568 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762a79jxs" event={"ID":"26a13018-4874-4c54-ac49-9461af810ef0","Type":"ContainerStarted","Data":"476df402cf39b1bb4cb8317b5274c68eea9722e56e31d2f6ec9c11122e3c69c6"} Jun 03 16:41:11.917578 ip-10-0-135-67 kubenswrapper[2568]: I0603 16:41:11.917547 2568 generic.go:358] "Generic (PLEG): container finished" podID="26a13018-4874-4c54-ac49-9461af810ef0" containerID="7283ade2571a5c4741ce91c7051f49dafbb338699d16c611b73e5f5b6f40ad6a" exitCode=0 Jun 03 16:41:11.917978 ip-10-0-135-67 kubenswrapper[2568]: I0603 16:41:11.917604 2568 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762a79jxs" event={"ID":"26a13018-4874-4c54-ac49-9461af810ef0","Type":"ContainerDied","Data":"7283ade2571a5c4741ce91c7051f49dafbb338699d16c611b73e5f5b6f40ad6a"} Jun 03 16:41:12.924067 ip-10-0-135-67 kubenswrapper[2568]: I0603 16:41:12.924034 2568 generic.go:358] "Generic (PLEG): container finished" podID="26a13018-4874-4c54-ac49-9461af810ef0" containerID="c0fe2d2b7b445bb7d100bf92913564ccb6a5b4113a0a91e595b945b98e416ebb" exitCode=0 Jun 03 16:41:12.924650 ip-10-0-135-67 kubenswrapper[2568]: I0603 16:41:12.924147 2568 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762a79jxs" event={"ID":"26a13018-4874-4c54-ac49-9461af810ef0","Type":"ContainerDied","Data":"c0fe2d2b7b445bb7d100bf92913564ccb6a5b4113a0a91e595b945b98e416ebb"} Jun 03 16:41:14.057182 ip-10-0-135-67 kubenswrapper[2568]: I0603 16:41:14.057155 2568 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762a79jxs" Jun 03 16:41:14.151601 ip-10-0-135-67 kubenswrapper[2568]: I0603 16:41:14.151572 2568 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/26a13018-4874-4c54-ac49-9461af810ef0-bundle\") pod \"26a13018-4874-4c54-ac49-9461af810ef0\" (UID: \"26a13018-4874-4c54-ac49-9461af810ef0\") " Jun 03 16:41:14.151793 ip-10-0-135-67 kubenswrapper[2568]: I0603 16:41:14.151619 2568 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/26a13018-4874-4c54-ac49-9461af810ef0-util\") pod \"26a13018-4874-4c54-ac49-9461af810ef0\" (UID: \"26a13018-4874-4c54-ac49-9461af810ef0\") " Jun 03 16:41:14.151793 ip-10-0-135-67 kubenswrapper[2568]: I0603 16:41:14.151675 2568 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-djccd\" (UniqueName: \"kubernetes.io/projected/26a13018-4874-4c54-ac49-9461af810ef0-kube-api-access-djccd\") pod \"26a13018-4874-4c54-ac49-9461af810ef0\" (UID: \"26a13018-4874-4c54-ac49-9461af810ef0\") " Jun 03 16:41:14.152533 ip-10-0-135-67 kubenswrapper[2568]: I0603 16:41:14.152507 2568 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/26a13018-4874-4c54-ac49-9461af810ef0-bundle" (OuterVolumeSpecName: "bundle") pod "26a13018-4874-4c54-ac49-9461af810ef0" (UID: "26a13018-4874-4c54-ac49-9461af810ef0"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jun 03 16:41:14.153759 ip-10-0-135-67 kubenswrapper[2568]: I0603 16:41:14.153733 2568 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/26a13018-4874-4c54-ac49-9461af810ef0-kube-api-access-djccd" (OuterVolumeSpecName: "kube-api-access-djccd") pod "26a13018-4874-4c54-ac49-9461af810ef0" (UID: "26a13018-4874-4c54-ac49-9461af810ef0"). InnerVolumeSpecName "kube-api-access-djccd". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 03 16:41:14.156877 ip-10-0-135-67 kubenswrapper[2568]: I0603 16:41:14.156851 2568 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/26a13018-4874-4c54-ac49-9461af810ef0-util" (OuterVolumeSpecName: "util") pod "26a13018-4874-4c54-ac49-9461af810ef0" (UID: "26a13018-4874-4c54-ac49-9461af810ef0"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jun 03 16:41:14.252754 ip-10-0-135-67 kubenswrapper[2568]: I0603 16:41:14.252727 2568 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-djccd\" (UniqueName: \"kubernetes.io/projected/26a13018-4874-4c54-ac49-9461af810ef0-kube-api-access-djccd\") on node \"ip-10-0-135-67.ec2.internal\" DevicePath \"\"" Jun 03 16:41:14.252754 ip-10-0-135-67 kubenswrapper[2568]: I0603 16:41:14.252755 2568 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/26a13018-4874-4c54-ac49-9461af810ef0-bundle\") on node \"ip-10-0-135-67.ec2.internal\" DevicePath \"\"" Jun 03 16:41:14.252884 ip-10-0-135-67 kubenswrapper[2568]: I0603 16:41:14.252764 2568 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/26a13018-4874-4c54-ac49-9461af810ef0-util\") on node \"ip-10-0-135-67.ec2.internal\" DevicePath \"\"" Jun 03 16:41:14.932795 ip-10-0-135-67 kubenswrapper[2568]: I0603 16:41:14.932764 2568 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762a79jxs" Jun 03 16:41:14.932966 ip-10-0-135-67 kubenswrapper[2568]: I0603 16:41:14.932754 2568 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762a79jxs" event={"ID":"26a13018-4874-4c54-ac49-9461af810ef0","Type":"ContainerDied","Data":"476df402cf39b1bb4cb8317b5274c68eea9722e56e31d2f6ec9c11122e3c69c6"} Jun 03 16:41:14.932966 ip-10-0-135-67 kubenswrapper[2568]: I0603 16:41:14.932881 2568 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="476df402cf39b1bb4cb8317b5274c68eea9722e56e31d2f6ec9c11122e3c69c6" Jun 03 16:41:15.895564 ip-10-0-135-67 kubenswrapper[2568]: I0603 16:41:15.895536 2568 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-lws-operator/lws-controller-manager-69bc585896-vqzbf" Jun 03 16:42:08.629231 ip-10-0-135-67 kubenswrapper[2568]: I0603 16:42:08.629194 2568 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e05gp8c"] Jun 03 16:42:08.629805 ip-10-0-135-67 kubenswrapper[2568]: I0603 16:42:08.629697 2568 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="26a13018-4874-4c54-ac49-9461af810ef0" containerName="pull" Jun 03 16:42:08.629805 ip-10-0-135-67 kubenswrapper[2568]: I0603 16:42:08.629714 2568 state_mem.go:107] "Deleted CPUSet assignment" podUID="26a13018-4874-4c54-ac49-9461af810ef0" containerName="pull" Jun 03 16:42:08.629805 ip-10-0-135-67 kubenswrapper[2568]: I0603 16:42:08.629724 2568 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="26a13018-4874-4c54-ac49-9461af810ef0" containerName="extract" Jun 03 16:42:08.629805 ip-10-0-135-67 kubenswrapper[2568]: I0603 16:42:08.629729 2568 state_mem.go:107] "Deleted CPUSet assignment" podUID="26a13018-4874-4c54-ac49-9461af810ef0" containerName="extract" Jun 03 16:42:08.629805 ip-10-0-135-67 kubenswrapper[2568]: I0603 16:42:08.629742 2568 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="26a13018-4874-4c54-ac49-9461af810ef0" containerName="util" Jun 03 16:42:08.629805 ip-10-0-135-67 kubenswrapper[2568]: I0603 16:42:08.629748 2568 state_mem.go:107] "Deleted CPUSet assignment" podUID="26a13018-4874-4c54-ac49-9461af810ef0" containerName="util" Jun 03 16:42:08.629805 ip-10-0-135-67 kubenswrapper[2568]: I0603 16:42:08.629802 2568 memory_manager.go:356] "RemoveStaleState removing state" podUID="26a13018-4874-4c54-ac49-9461af810ef0" containerName="extract" Jun 03 16:42:08.632124 ip-10-0-135-67 kubenswrapper[2568]: I0603 16:42:08.632105 2568 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e05gp8c" Jun 03 16:42:08.635110 ip-10-0-135-67 kubenswrapper[2568]: I0603 16:42:08.635088 2568 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"openshift-service-ca.crt\"" Jun 03 16:42:08.635229 ip-10-0-135-67 kubenswrapper[2568]: I0603 16:42:08.635167 2568 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"kube-root-ca.crt\"" Jun 03 16:42:08.635310 ip-10-0-135-67 kubenswrapper[2568]: I0603 16:42:08.635297 2568 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"default-dockercfg-8lh8p\"" Jun 03 16:42:08.644425 ip-10-0-135-67 kubenswrapper[2568]: I0603 16:42:08.644400 2568 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e05gp8c"] Jun 03 16:42:08.705319 ip-10-0-135-67 kubenswrapper[2568]: I0603 16:42:08.705278 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/af8ad6c3-2b9a-4751-8407-f4e59900033e-util\") pod \"19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e05gp8c\" (UID: \"af8ad6c3-2b9a-4751-8407-f4e59900033e\") " pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e05gp8c" Jun 03 16:42:08.705477 ip-10-0-135-67 kubenswrapper[2568]: I0603 16:42:08.705390 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-kjgkv\" (UniqueName: \"kubernetes.io/projected/af8ad6c3-2b9a-4751-8407-f4e59900033e-kube-api-access-kjgkv\") pod \"19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e05gp8c\" (UID: \"af8ad6c3-2b9a-4751-8407-f4e59900033e\") " pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e05gp8c" Jun 03 16:42:08.705477 ip-10-0-135-67 kubenswrapper[2568]: I0603 16:42:08.705421 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/af8ad6c3-2b9a-4751-8407-f4e59900033e-bundle\") pod \"19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e05gp8c\" (UID: \"af8ad6c3-2b9a-4751-8407-f4e59900033e\") " pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e05gp8c" Jun 03 16:42:08.806658 ip-10-0-135-67 kubenswrapper[2568]: I0603 16:42:08.806625 2568 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/af8ad6c3-2b9a-4751-8407-f4e59900033e-util\") pod \"19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e05gp8c\" (UID: \"af8ad6c3-2b9a-4751-8407-f4e59900033e\") " pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e05gp8c" Jun 03 16:42:08.806836 ip-10-0-135-67 kubenswrapper[2568]: I0603 16:42:08.806699 2568 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-kjgkv\" (UniqueName: \"kubernetes.io/projected/af8ad6c3-2b9a-4751-8407-f4e59900033e-kube-api-access-kjgkv\") pod \"19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e05gp8c\" (UID: \"af8ad6c3-2b9a-4751-8407-f4e59900033e\") " pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e05gp8c" Jun 03 16:42:08.806836 ip-10-0-135-67 kubenswrapper[2568]: I0603 16:42:08.806722 2568 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/af8ad6c3-2b9a-4751-8407-f4e59900033e-bundle\") pod \"19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e05gp8c\" (UID: \"af8ad6c3-2b9a-4751-8407-f4e59900033e\") " pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e05gp8c" Jun 03 16:42:08.807044 ip-10-0-135-67 kubenswrapper[2568]: I0603 16:42:08.806999 2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/af8ad6c3-2b9a-4751-8407-f4e59900033e-util\") pod \"19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e05gp8c\" (UID: \"af8ad6c3-2b9a-4751-8407-f4e59900033e\") " pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e05gp8c" Jun 03 16:42:08.807088 ip-10-0-135-67 kubenswrapper[2568]: I0603 16:42:08.807071 2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/af8ad6c3-2b9a-4751-8407-f4e59900033e-bundle\") pod \"19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e05gp8c\" (UID: \"af8ad6c3-2b9a-4751-8407-f4e59900033e\") " pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e05gp8c" Jun 03 16:42:08.815274 ip-10-0-135-67 kubenswrapper[2568]: I0603 16:42:08.815250 2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-kjgkv\" (UniqueName: \"kubernetes.io/projected/af8ad6c3-2b9a-4751-8407-f4e59900033e-kube-api-access-kjgkv\") pod \"19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e05gp8c\" (UID: \"af8ad6c3-2b9a-4751-8407-f4e59900033e\") " pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e05gp8c" Jun 03 16:42:08.941172 ip-10-0-135-67 kubenswrapper[2568]: I0603 16:42:08.941076 2568 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e05gp8c" Jun 03 16:42:09.070565 ip-10-0-135-67 kubenswrapper[2568]: I0603 16:42:09.070528 2568 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e05gp8c"] Jun 03 16:42:09.072891 ip-10-0-135-67 kubenswrapper[2568]: W0603 16:42:09.072863 2568 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podaf8ad6c3_2b9a_4751_8407_f4e59900033e.slice/crio-e79774f7532156986b30f919c0e267a06569aba31a9fda10efc9a3954f95066f WatchSource:0}: Error finding container e79774f7532156986b30f919c0e267a06569aba31a9fda10efc9a3954f95066f: Status 404 returned error can't find the container with id e79774f7532156986b30f919c0e267a06569aba31a9fda10efc9a3954f95066f Jun 03 16:42:09.128984 ip-10-0-135-67 kubenswrapper[2568]: I0603 16:42:09.128956 2568 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e05gp8c" event={"ID":"af8ad6c3-2b9a-4751-8407-f4e59900033e","Type":"ContainerStarted","Data":"e79774f7532156986b30f919c0e267a06569aba31a9fda10efc9a3954f95066f"} Jun 03 16:42:09.230276 ip-10-0-135-67 kubenswrapper[2568]: I0603 16:42:09.230203 2568 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73q49dg"] Jun 03 16:42:09.232772 ip-10-0-135-67 kubenswrapper[2568]: I0603 16:42:09.232755 2568 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73q49dg" Jun 03 16:42:09.241335 ip-10-0-135-67 kubenswrapper[2568]: I0603 16:42:09.241313 2568 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73q49dg"] Jun 03 16:42:09.310220 ip-10-0-135-67 kubenswrapper[2568]: I0603 16:42:09.310183 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/23e7591f-cd45-44fe-9c67-cecdcb347126-bundle\") pod \"5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73q49dg\" (UID: \"23e7591f-cd45-44fe-9c67-cecdcb347126\") " pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73q49dg" Jun 03 16:42:09.310386 ip-10-0-135-67 kubenswrapper[2568]: I0603 16:42:09.310267 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/23e7591f-cd45-44fe-9c67-cecdcb347126-util\") pod \"5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73q49dg\" (UID: \"23e7591f-cd45-44fe-9c67-cecdcb347126\") " pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73q49dg" Jun 03 16:42:09.310386 ip-10-0-135-67 kubenswrapper[2568]: I0603 16:42:09.310300 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-cstqn\" (UniqueName: \"kubernetes.io/projected/23e7591f-cd45-44fe-9c67-cecdcb347126-kube-api-access-cstqn\") pod \"5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73q49dg\" (UID: \"23e7591f-cd45-44fe-9c67-cecdcb347126\") " pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73q49dg" Jun 03 16:42:09.410970 ip-10-0-135-67 kubenswrapper[2568]: I0603 16:42:09.410937 2568 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/23e7591f-cd45-44fe-9c67-cecdcb347126-bundle\") pod \"5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73q49dg\" (UID: \"23e7591f-cd45-44fe-9c67-cecdcb347126\") " pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73q49dg" Jun 03 16:42:09.411154 ip-10-0-135-67 kubenswrapper[2568]: I0603 16:42:09.410978 2568 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/23e7591f-cd45-44fe-9c67-cecdcb347126-util\") pod \"5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73q49dg\" (UID: \"23e7591f-cd45-44fe-9c67-cecdcb347126\") " pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73q49dg" Jun 03 16:42:09.411154 ip-10-0-135-67 kubenswrapper[2568]: I0603 16:42:09.411021 2568 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-cstqn\" (UniqueName: \"kubernetes.io/projected/23e7591f-cd45-44fe-9c67-cecdcb347126-kube-api-access-cstqn\") pod \"5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73q49dg\" (UID: \"23e7591f-cd45-44fe-9c67-cecdcb347126\") " pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73q49dg" Jun 03 16:42:09.411330 ip-10-0-135-67 kubenswrapper[2568]: I0603 16:42:09.411309 2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/23e7591f-cd45-44fe-9c67-cecdcb347126-bundle\") pod \"5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73q49dg\" (UID: \"23e7591f-cd45-44fe-9c67-cecdcb347126\") " pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73q49dg" Jun 03 16:42:09.411409 ip-10-0-135-67 kubenswrapper[2568]: I0603 16:42:09.411388 2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/23e7591f-cd45-44fe-9c67-cecdcb347126-util\") pod \"5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73q49dg\" (UID: \"23e7591f-cd45-44fe-9c67-cecdcb347126\") " pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73q49dg" Jun 03 16:42:09.419355 ip-10-0-135-67 kubenswrapper[2568]: I0603 16:42:09.419336 2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-cstqn\" (UniqueName: \"kubernetes.io/projected/23e7591f-cd45-44fe-9c67-cecdcb347126-kube-api-access-cstqn\") pod \"5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73q49dg\" (UID: \"23e7591f-cd45-44fe-9c67-cecdcb347126\") " pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73q49dg" Jun 03 16:42:09.542486 ip-10-0-135-67 kubenswrapper[2568]: I0603 16:42:09.542455 2568 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73q49dg" Jun 03 16:42:09.629577 ip-10-0-135-67 kubenswrapper[2568]: I0603 16:42:09.629545 2568 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef164bzd"] Jun 03 16:42:09.633929 ip-10-0-135-67 kubenswrapper[2568]: I0603 16:42:09.633901 2568 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef164bzd" Jun 03 16:42:09.637906 ip-10-0-135-67 kubenswrapper[2568]: I0603 16:42:09.637870 2568 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef164bzd"] Jun 03 16:42:09.673412 ip-10-0-135-67 kubenswrapper[2568]: I0603 16:42:09.673388 2568 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73q49dg"] Jun 03 16:42:09.674858 ip-10-0-135-67 kubenswrapper[2568]: W0603 16:42:09.674839 2568 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod23e7591f_cd45_44fe_9c67_cecdcb347126.slice/crio-c13cabcae77e3762af738da6dc1d9a72f92b9c4efb9084467491f9727589f740 WatchSource:0}: Error finding container c13cabcae77e3762af738da6dc1d9a72f92b9c4efb9084467491f9727589f740: Status 404 returned error can't find the container with id c13cabcae77e3762af738da6dc1d9a72f92b9c4efb9084467491f9727589f740 Jun 03 16:42:09.713356 ip-10-0-135-67 kubenswrapper[2568]: I0603 16:42:09.713331 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/19b4a4f7-3790-4de1-bd6c-d0b5eecaf14a-bundle\") pod \"9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef164bzd\" (UID: \"19b4a4f7-3790-4de1-bd6c-d0b5eecaf14a\") " pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef164bzd" Jun 03 16:42:09.713457 ip-10-0-135-67 kubenswrapper[2568]: I0603 16:42:09.713364 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-sbdsd\" (UniqueName: \"kubernetes.io/projected/19b4a4f7-3790-4de1-bd6c-d0b5eecaf14a-kube-api-access-sbdsd\") pod \"9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef164bzd\" (UID: \"19b4a4f7-3790-4de1-bd6c-d0b5eecaf14a\") " pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef164bzd" Jun 03 16:42:09.713457 ip-10-0-135-67 kubenswrapper[2568]: I0603 16:42:09.713412 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/19b4a4f7-3790-4de1-bd6c-d0b5eecaf14a-util\") pod \"9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef164bzd\" (UID: \"19b4a4f7-3790-4de1-bd6c-d0b5eecaf14a\") " pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef164bzd" Jun 03 16:42:09.814468 ip-10-0-135-67 kubenswrapper[2568]: I0603 16:42:09.814391 2568 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/19b4a4f7-3790-4de1-bd6c-d0b5eecaf14a-bundle\") pod \"9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef164bzd\" (UID: \"19b4a4f7-3790-4de1-bd6c-d0b5eecaf14a\") " pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef164bzd" Jun 03 16:42:09.814468 ip-10-0-135-67 kubenswrapper[2568]: I0603 16:42:09.814426 2568 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-sbdsd\" (UniqueName: \"kubernetes.io/projected/19b4a4f7-3790-4de1-bd6c-d0b5eecaf14a-kube-api-access-sbdsd\") pod \"9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef164bzd\" (UID: \"19b4a4f7-3790-4de1-bd6c-d0b5eecaf14a\") " pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef164bzd" Jun 03 16:42:09.814468 ip-10-0-135-67 kubenswrapper[2568]: I0603 16:42:09.814462 2568 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/19b4a4f7-3790-4de1-bd6c-d0b5eecaf14a-util\") pod \"9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef164bzd\" (UID: \"19b4a4f7-3790-4de1-bd6c-d0b5eecaf14a\") " pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef164bzd" Jun 03 16:42:09.814761 ip-10-0-135-67 kubenswrapper[2568]: I0603 16:42:09.814727 2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/19b4a4f7-3790-4de1-bd6c-d0b5eecaf14a-bundle\") pod \"9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef164bzd\" (UID: \"19b4a4f7-3790-4de1-bd6c-d0b5eecaf14a\") " pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef164bzd" Jun 03 16:42:09.814761 ip-10-0-135-67 kubenswrapper[2568]: I0603 16:42:09.814755 2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/19b4a4f7-3790-4de1-bd6c-d0b5eecaf14a-util\") pod \"9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef164bzd\" (UID: \"19b4a4f7-3790-4de1-bd6c-d0b5eecaf14a\") " pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef164bzd" Jun 03 16:42:09.823401 ip-10-0-135-67 kubenswrapper[2568]: I0603 16:42:09.823382 2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-sbdsd\" (UniqueName: \"kubernetes.io/projected/19b4a4f7-3790-4de1-bd6c-d0b5eecaf14a-kube-api-access-sbdsd\") pod \"9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef164bzd\" (UID: \"19b4a4f7-3790-4de1-bd6c-d0b5eecaf14a\") " pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef164bzd" Jun 03 16:42:09.948728 ip-10-0-135-67 kubenswrapper[2568]: I0603 16:42:09.948697 2568 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef164bzd" Jun 03 16:42:10.071941 ip-10-0-135-67 kubenswrapper[2568]: I0603 16:42:10.071858 2568 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef164bzd"] Jun 03 16:42:10.075347 ip-10-0-135-67 kubenswrapper[2568]: W0603 16:42:10.075323 2568 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod19b4a4f7_3790_4de1_bd6c_d0b5eecaf14a.slice/crio-ca3675730ec01f073862ef622aea9d6c5c647b200b445710006165e555b9774d WatchSource:0}: Error finding container ca3675730ec01f073862ef622aea9d6c5c647b200b445710006165e555b9774d: Status 404 returned error can't find the container with id ca3675730ec01f073862ef622aea9d6c5c647b200b445710006165e555b9774d Jun 03 16:42:10.134062 ip-10-0-135-67 kubenswrapper[2568]: I0603 16:42:10.134034 2568 generic.go:358] "Generic (PLEG): container finished" podID="af8ad6c3-2b9a-4751-8407-f4e59900033e" containerID="df2e9195ce1ca0398c1d785ca447b305ee6509b515d632fd00ecce8449cafbdc" exitCode=0 Jun 03 16:42:10.134177 ip-10-0-135-67 kubenswrapper[2568]: I0603 16:42:10.134143 2568 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e05gp8c" event={"ID":"af8ad6c3-2b9a-4751-8407-f4e59900033e","Type":"ContainerDied","Data":"df2e9195ce1ca0398c1d785ca447b305ee6509b515d632fd00ecce8449cafbdc"} Jun 03 16:42:10.135693 ip-10-0-135-67 kubenswrapper[2568]: I0603 16:42:10.135665 2568 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef164bzd" event={"ID":"19b4a4f7-3790-4de1-bd6c-d0b5eecaf14a","Type":"ContainerStarted","Data":"66d250117cc146c717b178ce30558afbad7f5fa1a00f056fa9d050b3fe517caf"} Jun 03 16:42:10.135789 ip-10-0-135-67 kubenswrapper[2568]: I0603 16:42:10.135701 2568 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef164bzd" event={"ID":"19b4a4f7-3790-4de1-bd6c-d0b5eecaf14a","Type":"ContainerStarted","Data":"ca3675730ec01f073862ef622aea9d6c5c647b200b445710006165e555b9774d"} Jun 03 16:42:10.137308 ip-10-0-135-67 kubenswrapper[2568]: I0603 16:42:10.137199 2568 generic.go:358] "Generic (PLEG): container finished" podID="23e7591f-cd45-44fe-9c67-cecdcb347126" containerID="0f08ec7e49149ea21b917e40d9f9004a5ffaf4b7321ecea5379b5b76e6f0c661" exitCode=0 Jun 03 16:42:10.137308 ip-10-0-135-67 kubenswrapper[2568]: I0603 16:42:10.137252 2568 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73q49dg" event={"ID":"23e7591f-cd45-44fe-9c67-cecdcb347126","Type":"ContainerDied","Data":"0f08ec7e49149ea21b917e40d9f9004a5ffaf4b7321ecea5379b5b76e6f0c661"} Jun 03 16:42:10.137308 ip-10-0-135-67 kubenswrapper[2568]: I0603 16:42:10.137286 2568 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73q49dg" event={"ID":"23e7591f-cd45-44fe-9c67-cecdcb347126","Type":"ContainerStarted","Data":"c13cabcae77e3762af738da6dc1d9a72f92b9c4efb9084467491f9727589f740"} Jun 03 16:42:10.230954 ip-10-0-135-67 kubenswrapper[2568]: I0603 16:42:10.230920 2568 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b7596ggtk"] Jun 03 16:42:10.233488 ip-10-0-135-67 kubenswrapper[2568]: I0603 16:42:10.233472 2568 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b7596ggtk" Jun 03 16:42:10.244296 ip-10-0-135-67 kubenswrapper[2568]: I0603 16:42:10.244273 2568 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b7596ggtk"] Jun 03 16:42:10.319620 ip-10-0-135-67 kubenswrapper[2568]: I0603 16:42:10.319592 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/acc83364-b4c7-4074-941a-3765c95b24e4-bundle\") pod \"0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b7596ggtk\" (UID: \"acc83364-b4c7-4074-941a-3765c95b24e4\") " pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b7596ggtk" Jun 03 16:42:10.319769 ip-10-0-135-67 kubenswrapper[2568]: I0603 16:42:10.319645 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-w6vxg\" (UniqueName: \"kubernetes.io/projected/acc83364-b4c7-4074-941a-3765c95b24e4-kube-api-access-w6vxg\") pod \"0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b7596ggtk\" (UID: \"acc83364-b4c7-4074-941a-3765c95b24e4\") " pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b7596ggtk" Jun 03 16:42:10.319769 ip-10-0-135-67 kubenswrapper[2568]: I0603 16:42:10.319670 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/acc83364-b4c7-4074-941a-3765c95b24e4-util\") pod \"0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b7596ggtk\" (UID: \"acc83364-b4c7-4074-941a-3765c95b24e4\") " pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b7596ggtk" Jun 03 16:42:10.420299 ip-10-0-135-67 kubenswrapper[2568]: I0603 16:42:10.420221 2568 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-w6vxg\" (UniqueName: \"kubernetes.io/projected/acc83364-b4c7-4074-941a-3765c95b24e4-kube-api-access-w6vxg\") pod \"0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b7596ggtk\" (UID: \"acc83364-b4c7-4074-941a-3765c95b24e4\") " pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b7596ggtk" Jun 03 16:42:10.420299 ip-10-0-135-67 kubenswrapper[2568]: I0603 16:42:10.420265 2568 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/acc83364-b4c7-4074-941a-3765c95b24e4-util\") pod \"0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b7596ggtk\" (UID: \"acc83364-b4c7-4074-941a-3765c95b24e4\") " pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b7596ggtk" Jun 03 16:42:10.420511 ip-10-0-135-67 kubenswrapper[2568]: I0603 16:42:10.420323 2568 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/acc83364-b4c7-4074-941a-3765c95b24e4-bundle\") pod \"0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b7596ggtk\" (UID: \"acc83364-b4c7-4074-941a-3765c95b24e4\") " pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b7596ggtk" Jun 03 16:42:10.420746 ip-10-0-135-67 kubenswrapper[2568]: I0603 16:42:10.420717 2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/acc83364-b4c7-4074-941a-3765c95b24e4-util\") pod \"0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b7596ggtk\" (UID: \"acc83364-b4c7-4074-941a-3765c95b24e4\") " pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b7596ggtk" Jun 03 16:42:10.420870 ip-10-0-135-67 kubenswrapper[2568]: I0603 16:42:10.420761 2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/acc83364-b4c7-4074-941a-3765c95b24e4-bundle\") pod \"0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b7596ggtk\" (UID: \"acc83364-b4c7-4074-941a-3765c95b24e4\") " pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b7596ggtk" Jun 03 16:42:10.428137 ip-10-0-135-67 kubenswrapper[2568]: I0603 16:42:10.428111 2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-w6vxg\" (UniqueName: \"kubernetes.io/projected/acc83364-b4c7-4074-941a-3765c95b24e4-kube-api-access-w6vxg\") pod \"0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b7596ggtk\" (UID: \"acc83364-b4c7-4074-941a-3765c95b24e4\") " pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b7596ggtk" Jun 03 16:42:10.542760 ip-10-0-135-67 kubenswrapper[2568]: I0603 16:42:10.542729 2568 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b7596ggtk" Jun 03 16:42:10.672090 ip-10-0-135-67 kubenswrapper[2568]: I0603 16:42:10.672058 2568 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b7596ggtk"] Jun 03 16:42:10.706945 ip-10-0-135-67 kubenswrapper[2568]: W0603 16:42:10.706904 2568 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podacc83364_b4c7_4074_941a_3765c95b24e4.slice/crio-0b48c1dba97bea9018f3caf029724abf4f4b0813ddddc001ae6cd174fc7b0b42 WatchSource:0}: Error finding container 0b48c1dba97bea9018f3caf029724abf4f4b0813ddddc001ae6cd174fc7b0b42: Status 404 returned error can't find the container with id 0b48c1dba97bea9018f3caf029724abf4f4b0813ddddc001ae6cd174fc7b0b42 Jun 03 16:42:11.142305 ip-10-0-135-67 kubenswrapper[2568]: I0603 16:42:11.142268 2568 generic.go:358] "Generic (PLEG): container finished" podID="af8ad6c3-2b9a-4751-8407-f4e59900033e" containerID="6d4937e9ebfe0377ac125989a2332dc8ec685e2a96ec511bea253bdd2927aaad" exitCode=0 Jun 03 16:42:11.142437 ip-10-0-135-67 kubenswrapper[2568]: I0603 16:42:11.142310 2568 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e05gp8c" event={"ID":"af8ad6c3-2b9a-4751-8407-f4e59900033e","Type":"ContainerDied","Data":"6d4937e9ebfe0377ac125989a2332dc8ec685e2a96ec511bea253bdd2927aaad"} Jun 03 16:42:11.143757 ip-10-0-135-67 kubenswrapper[2568]: I0603 16:42:11.143732 2568 generic.go:358] "Generic (PLEG): container finished" podID="acc83364-b4c7-4074-941a-3765c95b24e4" containerID="856812bbd9fab434ad3173f0649476fcaf32a6c7af27bfb7e1b4a4f5ed083878" exitCode=0 Jun 03 16:42:11.143853 ip-10-0-135-67 kubenswrapper[2568]: I0603 16:42:11.143818 2568 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b7596ggtk" event={"ID":"acc83364-b4c7-4074-941a-3765c95b24e4","Type":"ContainerDied","Data":"856812bbd9fab434ad3173f0649476fcaf32a6c7af27bfb7e1b4a4f5ed083878"} Jun 03 16:42:11.143853 ip-10-0-135-67 kubenswrapper[2568]: I0603 16:42:11.143850 2568 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b7596ggtk" event={"ID":"acc83364-b4c7-4074-941a-3765c95b24e4","Type":"ContainerStarted","Data":"0b48c1dba97bea9018f3caf029724abf4f4b0813ddddc001ae6cd174fc7b0b42"} Jun 03 16:42:11.145323 ip-10-0-135-67 kubenswrapper[2568]: I0603 16:42:11.145297 2568 generic.go:358] "Generic (PLEG): container finished" podID="19b4a4f7-3790-4de1-bd6c-d0b5eecaf14a" containerID="66d250117cc146c717b178ce30558afbad7f5fa1a00f056fa9d050b3fe517caf" exitCode=0 Jun 03 16:42:11.145438 ip-10-0-135-67 kubenswrapper[2568]: I0603 16:42:11.145358 2568 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef164bzd" event={"ID":"19b4a4f7-3790-4de1-bd6c-d0b5eecaf14a","Type":"ContainerDied","Data":"66d250117cc146c717b178ce30558afbad7f5fa1a00f056fa9d050b3fe517caf"} Jun 03 16:42:11.147243 ip-10-0-135-67 kubenswrapper[2568]: I0603 16:42:11.147220 2568 generic.go:358] "Generic (PLEG): container finished" podID="23e7591f-cd45-44fe-9c67-cecdcb347126" containerID="e67610a890528f540754b89ae44e1c6336613638620ccfe5baa35ae4314b0f77" exitCode=0 Jun 03 16:42:11.147351 ip-10-0-135-67 kubenswrapper[2568]: I0603 16:42:11.147297 2568 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73q49dg" event={"ID":"23e7591f-cd45-44fe-9c67-cecdcb347126","Type":"ContainerDied","Data":"e67610a890528f540754b89ae44e1c6336613638620ccfe5baa35ae4314b0f77"} Jun 03 16:42:12.154461 ip-10-0-135-67 kubenswrapper[2568]: I0603 16:42:12.154432 2568 generic.go:358] "Generic (PLEG): container finished" podID="af8ad6c3-2b9a-4751-8407-f4e59900033e" containerID="71878207fc5ecf520bc8bf8589b3496e5698b796dfba995369b040c044477628" exitCode=0 Jun 03 16:42:12.154798 ip-10-0-135-67 kubenswrapper[2568]: I0603 16:42:12.154514 2568 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e05gp8c" event={"ID":"af8ad6c3-2b9a-4751-8407-f4e59900033e","Type":"ContainerDied","Data":"71878207fc5ecf520bc8bf8589b3496e5698b796dfba995369b040c044477628"} Jun 03 16:42:12.156080 ip-10-0-135-67 kubenswrapper[2568]: I0603 16:42:12.156059 2568 generic.go:358] "Generic (PLEG): container finished" podID="acc83364-b4c7-4074-941a-3765c95b24e4" containerID="e5604ddaeced93583043da160af3e364ee9f6409265cfaa24b85e89ee6d4207a" exitCode=0 Jun 03 16:42:12.156190 ip-10-0-135-67 kubenswrapper[2568]: I0603 16:42:12.156138 2568 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b7596ggtk" event={"ID":"acc83364-b4c7-4074-941a-3765c95b24e4","Type":"ContainerDied","Data":"e5604ddaeced93583043da160af3e364ee9f6409265cfaa24b85e89ee6d4207a"} Jun 03 16:42:12.157823 ip-10-0-135-67 kubenswrapper[2568]: I0603 16:42:12.157798 2568 generic.go:358] "Generic (PLEG): container finished" podID="19b4a4f7-3790-4de1-bd6c-d0b5eecaf14a" containerID="947744c7bbd4175cbf350e0a5e1335ffe504af0105f38b1e9df071d394fa2edd" exitCode=0 Jun 03 16:42:12.157924 ip-10-0-135-67 kubenswrapper[2568]: I0603 16:42:12.157875 2568 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef164bzd" event={"ID":"19b4a4f7-3790-4de1-bd6c-d0b5eecaf14a","Type":"ContainerDied","Data":"947744c7bbd4175cbf350e0a5e1335ffe504af0105f38b1e9df071d394fa2edd"} Jun 03 16:42:12.159774 ip-10-0-135-67 kubenswrapper[2568]: I0603 16:42:12.159755 2568 generic.go:358] "Generic (PLEG): container finished" podID="23e7591f-cd45-44fe-9c67-cecdcb347126" containerID="719da9781747bae1b5cc55e77b0627a0f7f21e0a36cf37e313c247ff573933a2" exitCode=0 Jun 03 16:42:12.159866 ip-10-0-135-67 kubenswrapper[2568]: I0603 16:42:12.159827 2568 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73q49dg" event={"ID":"23e7591f-cd45-44fe-9c67-cecdcb347126","Type":"ContainerDied","Data":"719da9781747bae1b5cc55e77b0627a0f7f21e0a36cf37e313c247ff573933a2"} Jun 03 16:42:13.165014 ip-10-0-135-67 kubenswrapper[2568]: I0603 16:42:13.164965 2568 generic.go:358] "Generic (PLEG): container finished" podID="acc83364-b4c7-4074-941a-3765c95b24e4" containerID="6b7d5294b7cfa854f884faa7731c073e8b76fc32c9b5326f2e5a58134d94e67c" exitCode=0 Jun 03 16:42:13.165421 ip-10-0-135-67 kubenswrapper[2568]: I0603 16:42:13.165055 2568 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b7596ggtk" event={"ID":"acc83364-b4c7-4074-941a-3765c95b24e4","Type":"ContainerDied","Data":"6b7d5294b7cfa854f884faa7731c073e8b76fc32c9b5326f2e5a58134d94e67c"} Jun 03 16:42:13.166817 ip-10-0-135-67 kubenswrapper[2568]: I0603 16:42:13.166798 2568 generic.go:358] "Generic (PLEG): container finished" podID="19b4a4f7-3790-4de1-bd6c-d0b5eecaf14a" containerID="e6d77d95023cb7f7276f25bed3ec887296882460d134c98629f24d654b5c7e16" exitCode=0 Jun 03 16:42:13.166904 ip-10-0-135-67 kubenswrapper[2568]: I0603 16:42:13.166844 2568 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef164bzd" event={"ID":"19b4a4f7-3790-4de1-bd6c-d0b5eecaf14a","Type":"ContainerDied","Data":"e6d77d95023cb7f7276f25bed3ec887296882460d134c98629f24d654b5c7e16"} Jun 03 16:42:13.318633 ip-10-0-135-67 kubenswrapper[2568]: I0603 16:42:13.318612 2568 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73q49dg" Jun 03 16:42:13.321892 ip-10-0-135-67 kubenswrapper[2568]: I0603 16:42:13.321874 2568 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e05gp8c" Jun 03 16:42:13.447806 ip-10-0-135-67 kubenswrapper[2568]: I0603 16:42:13.447727 2568 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/23e7591f-cd45-44fe-9c67-cecdcb347126-util\") pod \"23e7591f-cd45-44fe-9c67-cecdcb347126\" (UID: \"23e7591f-cd45-44fe-9c67-cecdcb347126\") " Jun 03 16:42:13.447806 ip-10-0-135-67 kubenswrapper[2568]: I0603 16:42:13.447773 2568 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/af8ad6c3-2b9a-4751-8407-f4e59900033e-util\") pod \"af8ad6c3-2b9a-4751-8407-f4e59900033e\" (UID: \"af8ad6c3-2b9a-4751-8407-f4e59900033e\") " Jun 03 16:42:13.448036 ip-10-0-135-67 kubenswrapper[2568]: I0603 16:42:13.447836 2568 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/af8ad6c3-2b9a-4751-8407-f4e59900033e-bundle\") pod \"af8ad6c3-2b9a-4751-8407-f4e59900033e\" (UID: \"af8ad6c3-2b9a-4751-8407-f4e59900033e\") " Jun 03 16:42:13.448036 ip-10-0-135-67 kubenswrapper[2568]: I0603 16:42:13.447858 2568 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-cstqn\" (UniqueName: \"kubernetes.io/projected/23e7591f-cd45-44fe-9c67-cecdcb347126-kube-api-access-cstqn\") pod \"23e7591f-cd45-44fe-9c67-cecdcb347126\" (UID: \"23e7591f-cd45-44fe-9c67-cecdcb347126\") " Jun 03 16:42:13.448036 ip-10-0-135-67 kubenswrapper[2568]: I0603 16:42:13.447892 2568 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-kjgkv\" (UniqueName: \"kubernetes.io/projected/af8ad6c3-2b9a-4751-8407-f4e59900033e-kube-api-access-kjgkv\") pod \"af8ad6c3-2b9a-4751-8407-f4e59900033e\" (UID: \"af8ad6c3-2b9a-4751-8407-f4e59900033e\") " Jun 03 16:42:13.448036 ip-10-0-135-67 kubenswrapper[2568]: I0603 16:42:13.447987 2568 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/23e7591f-cd45-44fe-9c67-cecdcb347126-bundle\") pod \"23e7591f-cd45-44fe-9c67-cecdcb347126\" (UID: \"23e7591f-cd45-44fe-9c67-cecdcb347126\") " Jun 03 16:42:13.448508 ip-10-0-135-67 kubenswrapper[2568]: I0603 16:42:13.448480 2568 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/af8ad6c3-2b9a-4751-8407-f4e59900033e-bundle" (OuterVolumeSpecName: "bundle") pod "af8ad6c3-2b9a-4751-8407-f4e59900033e" (UID: "af8ad6c3-2b9a-4751-8407-f4e59900033e"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jun 03 16:42:13.449062 ip-10-0-135-67 kubenswrapper[2568]: I0603 16:42:13.449031 2568 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/23e7591f-cd45-44fe-9c67-cecdcb347126-bundle" (OuterVolumeSpecName: "bundle") pod "23e7591f-cd45-44fe-9c67-cecdcb347126" (UID: "23e7591f-cd45-44fe-9c67-cecdcb347126"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jun 03 16:42:13.450382 ip-10-0-135-67 kubenswrapper[2568]: I0603 16:42:13.450357 2568 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/af8ad6c3-2b9a-4751-8407-f4e59900033e-kube-api-access-kjgkv" (OuterVolumeSpecName: "kube-api-access-kjgkv") pod "af8ad6c3-2b9a-4751-8407-f4e59900033e" (UID: "af8ad6c3-2b9a-4751-8407-f4e59900033e"). InnerVolumeSpecName "kube-api-access-kjgkv". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 03 16:42:13.450472 ip-10-0-135-67 kubenswrapper[2568]: I0603 16:42:13.450378 2568 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/23e7591f-cd45-44fe-9c67-cecdcb347126-kube-api-access-cstqn" (OuterVolumeSpecName: "kube-api-access-cstqn") pod "23e7591f-cd45-44fe-9c67-cecdcb347126" (UID: "23e7591f-cd45-44fe-9c67-cecdcb347126"). InnerVolumeSpecName "kube-api-access-cstqn". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 03 16:42:13.455558 ip-10-0-135-67 kubenswrapper[2568]: I0603 16:42:13.455532 2568 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/23e7591f-cd45-44fe-9c67-cecdcb347126-util" (OuterVolumeSpecName: "util") pod "23e7591f-cd45-44fe-9c67-cecdcb347126" (UID: "23e7591f-cd45-44fe-9c67-cecdcb347126"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jun 03 16:42:13.455885 ip-10-0-135-67 kubenswrapper[2568]: I0603 16:42:13.455869 2568 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/af8ad6c3-2b9a-4751-8407-f4e59900033e-util" (OuterVolumeSpecName: "util") pod "af8ad6c3-2b9a-4751-8407-f4e59900033e" (UID: "af8ad6c3-2b9a-4751-8407-f4e59900033e"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jun 03 16:42:13.548904 ip-10-0-135-67 kubenswrapper[2568]: I0603 16:42:13.548870 2568 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/af8ad6c3-2b9a-4751-8407-f4e59900033e-util\") on node \"ip-10-0-135-67.ec2.internal\" DevicePath \"\"" Jun 03 16:42:13.549077 ip-10-0-135-67 kubenswrapper[2568]: I0603 16:42:13.548918 2568 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/af8ad6c3-2b9a-4751-8407-f4e59900033e-bundle\") on node \"ip-10-0-135-67.ec2.internal\" DevicePath \"\"" Jun 03 16:42:13.549077 ip-10-0-135-67 kubenswrapper[2568]: I0603 16:42:13.548929 2568 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-cstqn\" (UniqueName: \"kubernetes.io/projected/23e7591f-cd45-44fe-9c67-cecdcb347126-kube-api-access-cstqn\") on node \"ip-10-0-135-67.ec2.internal\" DevicePath \"\"" Jun 03 16:42:13.549077 ip-10-0-135-67 kubenswrapper[2568]: I0603 16:42:13.548938 2568 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-kjgkv\" (UniqueName: \"kubernetes.io/projected/af8ad6c3-2b9a-4751-8407-f4e59900033e-kube-api-access-kjgkv\") on node \"ip-10-0-135-67.ec2.internal\" DevicePath \"\"" Jun 03 16:42:13.549077 ip-10-0-135-67 kubenswrapper[2568]: I0603 16:42:13.548948 2568 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/23e7591f-cd45-44fe-9c67-cecdcb347126-bundle\") on node \"ip-10-0-135-67.ec2.internal\" DevicePath \"\"" Jun 03 16:42:13.549077 ip-10-0-135-67 kubenswrapper[2568]: I0603 16:42:13.548957 2568 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/23e7591f-cd45-44fe-9c67-cecdcb347126-util\") on node \"ip-10-0-135-67.ec2.internal\" DevicePath \"\"" Jun 03 16:42:14.173057 ip-10-0-135-67 kubenswrapper[2568]: I0603 16:42:14.173020 2568 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e05gp8c" event={"ID":"af8ad6c3-2b9a-4751-8407-f4e59900033e","Type":"ContainerDied","Data":"e79774f7532156986b30f919c0e267a06569aba31a9fda10efc9a3954f95066f"} Jun 03 16:42:14.173565 ip-10-0-135-67 kubenswrapper[2568]: I0603 16:42:14.173063 2568 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="e79774f7532156986b30f919c0e267a06569aba31a9fda10efc9a3954f95066f" Jun 03 16:42:14.173565 ip-10-0-135-67 kubenswrapper[2568]: I0603 16:42:14.173069 2568 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e05gp8c" Jun 03 16:42:14.174827 ip-10-0-135-67 kubenswrapper[2568]: I0603 16:42:14.174802 2568 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73q49dg" event={"ID":"23e7591f-cd45-44fe-9c67-cecdcb347126","Type":"ContainerDied","Data":"c13cabcae77e3762af738da6dc1d9a72f92b9c4efb9084467491f9727589f740"} Jun 03 16:42:14.174965 ip-10-0-135-67 kubenswrapper[2568]: I0603 16:42:14.174832 2568 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="c13cabcae77e3762af738da6dc1d9a72f92b9c4efb9084467491f9727589f740" Jun 03 16:42:14.174965 ip-10-0-135-67 kubenswrapper[2568]: I0603 16:42:14.174883 2568 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73q49dg" Jun 03 16:42:14.322209 ip-10-0-135-67 kubenswrapper[2568]: I0603 16:42:14.322185 2568 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef164bzd" Jun 03 16:42:14.325141 ip-10-0-135-67 kubenswrapper[2568]: I0603 16:42:14.325123 2568 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b7596ggtk" Jun 03 16:42:14.456339 ip-10-0-135-67 kubenswrapper[2568]: I0603 16:42:14.456257 2568 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/acc83364-b4c7-4074-941a-3765c95b24e4-util\") pod \"acc83364-b4c7-4074-941a-3765c95b24e4\" (UID: \"acc83364-b4c7-4074-941a-3765c95b24e4\") " Jun 03 16:42:14.456339 ip-10-0-135-67 kubenswrapper[2568]: I0603 16:42:14.456300 2568 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/19b4a4f7-3790-4de1-bd6c-d0b5eecaf14a-util\") pod \"19b4a4f7-3790-4de1-bd6c-d0b5eecaf14a\" (UID: \"19b4a4f7-3790-4de1-bd6c-d0b5eecaf14a\") " Jun 03 16:42:14.456555 ip-10-0-135-67 kubenswrapper[2568]: I0603 16:42:14.456364 2568 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-sbdsd\" (UniqueName: \"kubernetes.io/projected/19b4a4f7-3790-4de1-bd6c-d0b5eecaf14a-kube-api-access-sbdsd\") pod \"19b4a4f7-3790-4de1-bd6c-d0b5eecaf14a\" (UID: \"19b4a4f7-3790-4de1-bd6c-d0b5eecaf14a\") " Jun 03 16:42:14.456555 ip-10-0-135-67 kubenswrapper[2568]: I0603 16:42:14.456419 2568 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/acc83364-b4c7-4074-941a-3765c95b24e4-bundle\") pod \"acc83364-b4c7-4074-941a-3765c95b24e4\" (UID: \"acc83364-b4c7-4074-941a-3765c95b24e4\") " Jun 03 16:42:14.456555 ip-10-0-135-67 kubenswrapper[2568]: I0603 16:42:14.456443 2568 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-w6vxg\" (UniqueName: \"kubernetes.io/projected/acc83364-b4c7-4074-941a-3765c95b24e4-kube-api-access-w6vxg\") pod \"acc83364-b4c7-4074-941a-3765c95b24e4\" (UID: \"acc83364-b4c7-4074-941a-3765c95b24e4\") " Jun 03 16:42:14.456555 ip-10-0-135-67 kubenswrapper[2568]: I0603 16:42:14.456508 2568 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/19b4a4f7-3790-4de1-bd6c-d0b5eecaf14a-bundle\") pod \"19b4a4f7-3790-4de1-bd6c-d0b5eecaf14a\" (UID: \"19b4a4f7-3790-4de1-bd6c-d0b5eecaf14a\") " Jun 03 16:42:14.456953 ip-10-0-135-67 kubenswrapper[2568]: I0603 16:42:14.456911 2568 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/acc83364-b4c7-4074-941a-3765c95b24e4-bundle" (OuterVolumeSpecName: "bundle") pod "acc83364-b4c7-4074-941a-3765c95b24e4" (UID: "acc83364-b4c7-4074-941a-3765c95b24e4"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jun 03 16:42:14.457223 ip-10-0-135-67 kubenswrapper[2568]: I0603 16:42:14.457196 2568 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/19b4a4f7-3790-4de1-bd6c-d0b5eecaf14a-bundle" (OuterVolumeSpecName: "bundle") pod "19b4a4f7-3790-4de1-bd6c-d0b5eecaf14a" (UID: "19b4a4f7-3790-4de1-bd6c-d0b5eecaf14a"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jun 03 16:42:14.459031 ip-10-0-135-67 kubenswrapper[2568]: I0603 16:42:14.458994 2568 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/acc83364-b4c7-4074-941a-3765c95b24e4-kube-api-access-w6vxg" (OuterVolumeSpecName: "kube-api-access-w6vxg") pod "acc83364-b4c7-4074-941a-3765c95b24e4" (UID: "acc83364-b4c7-4074-941a-3765c95b24e4"). InnerVolumeSpecName "kube-api-access-w6vxg". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 03 16:42:14.459106 ip-10-0-135-67 kubenswrapper[2568]: I0603 16:42:14.459029 2568 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/19b4a4f7-3790-4de1-bd6c-d0b5eecaf14a-kube-api-access-sbdsd" (OuterVolumeSpecName: "kube-api-access-sbdsd") pod "19b4a4f7-3790-4de1-bd6c-d0b5eecaf14a" (UID: "19b4a4f7-3790-4de1-bd6c-d0b5eecaf14a"). InnerVolumeSpecName "kube-api-access-sbdsd". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 03 16:42:14.461814 ip-10-0-135-67 kubenswrapper[2568]: I0603 16:42:14.461778 2568 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/acc83364-b4c7-4074-941a-3765c95b24e4-util" (OuterVolumeSpecName: "util") pod "acc83364-b4c7-4074-941a-3765c95b24e4" (UID: "acc83364-b4c7-4074-941a-3765c95b24e4"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jun 03 16:42:14.464701 ip-10-0-135-67 kubenswrapper[2568]: I0603 16:42:14.464677 2568 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/19b4a4f7-3790-4de1-bd6c-d0b5eecaf14a-util" (OuterVolumeSpecName: "util") pod "19b4a4f7-3790-4de1-bd6c-d0b5eecaf14a" (UID: "19b4a4f7-3790-4de1-bd6c-d0b5eecaf14a"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jun 03 16:42:14.557387 ip-10-0-135-67 kubenswrapper[2568]: I0603 16:42:14.557351 2568 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/acc83364-b4c7-4074-941a-3765c95b24e4-bundle\") on node \"ip-10-0-135-67.ec2.internal\" DevicePath \"\"" Jun 03 16:42:14.557387 ip-10-0-135-67 kubenswrapper[2568]: I0603 16:42:14.557381 2568 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-w6vxg\" (UniqueName: \"kubernetes.io/projected/acc83364-b4c7-4074-941a-3765c95b24e4-kube-api-access-w6vxg\") on node \"ip-10-0-135-67.ec2.internal\" DevicePath \"\"" Jun 03 16:42:14.557387 ip-10-0-135-67 kubenswrapper[2568]: I0603 16:42:14.557394 2568 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/19b4a4f7-3790-4de1-bd6c-d0b5eecaf14a-bundle\") on node \"ip-10-0-135-67.ec2.internal\" DevicePath \"\"" Jun 03 16:42:14.557601 ip-10-0-135-67 kubenswrapper[2568]: I0603 16:42:14.557404 2568 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/acc83364-b4c7-4074-941a-3765c95b24e4-util\") on node \"ip-10-0-135-67.ec2.internal\" DevicePath \"\"" Jun 03 16:42:14.557601 ip-10-0-135-67 kubenswrapper[2568]: I0603 16:42:14.557412 2568 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/19b4a4f7-3790-4de1-bd6c-d0b5eecaf14a-util\") on node \"ip-10-0-135-67.ec2.internal\" DevicePath \"\"" Jun 03 16:42:14.557601 ip-10-0-135-67 kubenswrapper[2568]: I0603 16:42:14.557420 2568 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-sbdsd\" (UniqueName: \"kubernetes.io/projected/19b4a4f7-3790-4de1-bd6c-d0b5eecaf14a-kube-api-access-sbdsd\") on node \"ip-10-0-135-67.ec2.internal\" DevicePath \"\"" Jun 03 16:42:15.180075 ip-10-0-135-67 kubenswrapper[2568]: I0603 16:42:15.180039 2568 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef164bzd" event={"ID":"19b4a4f7-3790-4de1-bd6c-d0b5eecaf14a","Type":"ContainerDied","Data":"ca3675730ec01f073862ef622aea9d6c5c647b200b445710006165e555b9774d"} Jun 03 16:42:15.180535 ip-10-0-135-67 kubenswrapper[2568]: I0603 16:42:15.180085 2568 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="ca3675730ec01f073862ef622aea9d6c5c647b200b445710006165e555b9774d" Jun 03 16:42:15.180535 ip-10-0-135-67 kubenswrapper[2568]: I0603 16:42:15.180048 2568 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef164bzd" Jun 03 16:42:15.181716 ip-10-0-135-67 kubenswrapper[2568]: I0603 16:42:15.181683 2568 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b7596ggtk" event={"ID":"acc83364-b4c7-4074-941a-3765c95b24e4","Type":"ContainerDied","Data":"0b48c1dba97bea9018f3caf029724abf4f4b0813ddddc001ae6cd174fc7b0b42"} Jun 03 16:42:15.181863 ip-10-0-135-67 kubenswrapper[2568]: I0603 16:42:15.181719 2568 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="0b48c1dba97bea9018f3caf029724abf4f4b0813ddddc001ae6cd174fc7b0b42" Jun 03 16:42:15.181863 ip-10-0-135-67 kubenswrapper[2568]: I0603 16:42:15.181724 2568 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b7596ggtk" Jun 03 16:42:41.289430 ip-10-0-135-67 kubenswrapper[2568]: I0603 16:42:41.289354 2568 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["kuadrant-system/kuadrant-console-plugin-6cb54b5c86-5swtz"] Jun 03 16:42:41.289780 ip-10-0-135-67 kubenswrapper[2568]: I0603 16:42:41.289734 2568 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="19b4a4f7-3790-4de1-bd6c-d0b5eecaf14a" containerName="util" Jun 03 16:42:41.289780 ip-10-0-135-67 kubenswrapper[2568]: I0603 16:42:41.289747 2568 state_mem.go:107] "Deleted CPUSet assignment" podUID="19b4a4f7-3790-4de1-bd6c-d0b5eecaf14a" containerName="util" Jun 03 16:42:41.289780 ip-10-0-135-67 kubenswrapper[2568]: I0603 16:42:41.289755 2568 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="23e7591f-cd45-44fe-9c67-cecdcb347126" containerName="pull" Jun 03 16:42:41.289780 ip-10-0-135-67 kubenswrapper[2568]: I0603 16:42:41.289762 2568 state_mem.go:107] "Deleted CPUSet assignment" podUID="23e7591f-cd45-44fe-9c67-cecdcb347126" containerName="pull" Jun 03 16:42:41.289780 ip-10-0-135-67 kubenswrapper[2568]: I0603 16:42:41.289771 2568 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="af8ad6c3-2b9a-4751-8407-f4e59900033e" containerName="util" Jun 03 16:42:41.289780 ip-10-0-135-67 kubenswrapper[2568]: I0603 16:42:41.289776 2568 state_mem.go:107] "Deleted CPUSet assignment" podUID="af8ad6c3-2b9a-4751-8407-f4e59900033e" containerName="util" Jun 03 16:42:41.289780 ip-10-0-135-67 kubenswrapper[2568]: I0603 16:42:41.289782 2568 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="acc83364-b4c7-4074-941a-3765c95b24e4" containerName="util" Jun 03 16:42:41.289990 ip-10-0-135-67 kubenswrapper[2568]: I0603 16:42:41.289787 2568 state_mem.go:107] "Deleted CPUSet assignment" podUID="acc83364-b4c7-4074-941a-3765c95b24e4" containerName="util" Jun 03 16:42:41.289990 ip-10-0-135-67 kubenswrapper[2568]: I0603 16:42:41.289793 2568 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="af8ad6c3-2b9a-4751-8407-f4e59900033e" containerName="extract" Jun 03 16:42:41.289990 ip-10-0-135-67 kubenswrapper[2568]: I0603 16:42:41.289798 2568 state_mem.go:107] "Deleted CPUSet assignment" podUID="af8ad6c3-2b9a-4751-8407-f4e59900033e" containerName="extract" Jun 03 16:42:41.289990 ip-10-0-135-67 kubenswrapper[2568]: I0603 16:42:41.289805 2568 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="23e7591f-cd45-44fe-9c67-cecdcb347126" containerName="extract" Jun 03 16:42:41.289990 ip-10-0-135-67 kubenswrapper[2568]: I0603 16:42:41.289810 2568 state_mem.go:107] "Deleted CPUSet assignment" podUID="23e7591f-cd45-44fe-9c67-cecdcb347126" containerName="extract" Jun 03 16:42:41.289990 ip-10-0-135-67 kubenswrapper[2568]: I0603 16:42:41.289816 2568 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="19b4a4f7-3790-4de1-bd6c-d0b5eecaf14a" containerName="extract" Jun 03 16:42:41.289990 ip-10-0-135-67 kubenswrapper[2568]: I0603 16:42:41.289821 2568 state_mem.go:107] "Deleted CPUSet assignment" podUID="19b4a4f7-3790-4de1-bd6c-d0b5eecaf14a" containerName="extract" Jun 03 16:42:41.289990 ip-10-0-135-67 kubenswrapper[2568]: I0603 16:42:41.289829 2568 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="19b4a4f7-3790-4de1-bd6c-d0b5eecaf14a" containerName="pull" Jun 03 16:42:41.289990 ip-10-0-135-67 kubenswrapper[2568]: I0603 16:42:41.289833 2568 state_mem.go:107] "Deleted CPUSet assignment" podUID="19b4a4f7-3790-4de1-bd6c-d0b5eecaf14a" containerName="pull" Jun 03 16:42:41.289990 ip-10-0-135-67 kubenswrapper[2568]: I0603 16:42:41.289849 2568 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="acc83364-b4c7-4074-941a-3765c95b24e4" containerName="pull" Jun 03 16:42:41.289990 ip-10-0-135-67 kubenswrapper[2568]: I0603 16:42:41.289853 2568 state_mem.go:107] "Deleted CPUSet assignment" podUID="acc83364-b4c7-4074-941a-3765c95b24e4" containerName="pull" Jun 03 16:42:41.289990 ip-10-0-135-67 kubenswrapper[2568]: I0603 16:42:41.289859 2568 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="acc83364-b4c7-4074-941a-3765c95b24e4" containerName="extract" Jun 03 16:42:41.289990 ip-10-0-135-67 kubenswrapper[2568]: I0603 16:42:41.289863 2568 state_mem.go:107] "Deleted CPUSet assignment" podUID="acc83364-b4c7-4074-941a-3765c95b24e4" containerName="extract" Jun 03 16:42:41.289990 ip-10-0-135-67 kubenswrapper[2568]: I0603 16:42:41.289871 2568 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="af8ad6c3-2b9a-4751-8407-f4e59900033e" containerName="pull" Jun 03 16:42:41.289990 ip-10-0-135-67 kubenswrapper[2568]: I0603 16:42:41.289875 2568 state_mem.go:107] "Deleted CPUSet assignment" podUID="af8ad6c3-2b9a-4751-8407-f4e59900033e" containerName="pull" Jun 03 16:42:41.289990 ip-10-0-135-67 kubenswrapper[2568]: I0603 16:42:41.289881 2568 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="23e7591f-cd45-44fe-9c67-cecdcb347126" containerName="util" Jun 03 16:42:41.289990 ip-10-0-135-67 kubenswrapper[2568]: I0603 16:42:41.289886 2568 state_mem.go:107] "Deleted CPUSet assignment" podUID="23e7591f-cd45-44fe-9c67-cecdcb347126" containerName="util" Jun 03 16:42:41.289990 ip-10-0-135-67 kubenswrapper[2568]: I0603 16:42:41.289939 2568 memory_manager.go:356] "RemoveStaleState removing state" podUID="af8ad6c3-2b9a-4751-8407-f4e59900033e" containerName="extract" Jun 03 16:42:41.289990 ip-10-0-135-67 kubenswrapper[2568]: I0603 16:42:41.289946 2568 memory_manager.go:356] "RemoveStaleState removing state" podUID="acc83364-b4c7-4074-941a-3765c95b24e4" containerName="extract" Jun 03 16:42:41.289990 ip-10-0-135-67 kubenswrapper[2568]: I0603 16:42:41.289954 2568 memory_manager.go:356] "RemoveStaleState removing state" podUID="23e7591f-cd45-44fe-9c67-cecdcb347126" containerName="extract" Jun 03 16:42:41.289990 ip-10-0-135-67 kubenswrapper[2568]: I0603 16:42:41.289963 2568 memory_manager.go:356] "RemoveStaleState removing state" podUID="19b4a4f7-3790-4de1-bd6c-d0b5eecaf14a" containerName="extract" Jun 03 16:42:41.292044 ip-10-0-135-67 kubenswrapper[2568]: I0603 16:42:41.292026 2568 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-console-plugin-6cb54b5c86-5swtz" Jun 03 16:42:41.294636 ip-10-0-135-67 kubenswrapper[2568]: I0603 16:42:41.294469 2568 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"openshift-service-ca.crt\"" Jun 03 16:42:41.294636 ip-10-0-135-67 kubenswrapper[2568]: I0603 16:42:41.294499 2568 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"kube-root-ca.crt\"" Jun 03 16:42:41.294636 ip-10-0-135-67 kubenswrapper[2568]: I0603 16:42:41.294586 2568 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"plugin-serving-cert\"" Jun 03 16:42:41.294885 ip-10-0-135-67 kubenswrapper[2568]: I0603 16:42:41.294861 2568 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"kuadrant-console-nginx-conf\"" Jun 03 16:42:41.295526 ip-10-0-135-67 kubenswrapper[2568]: I0603 16:42:41.295508 2568 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"default-dockercfg-8lh8p\"" Jun 03 16:42:41.302898 ip-10-0-135-67 kubenswrapper[2568]: I0603 16:42:41.302870 2568 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-console-plugin-6cb54b5c86-5swtz"] Jun 03 16:42:41.374534 ip-10-0-135-67 kubenswrapper[2568]: I0603 16:42:41.374495 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-dgv8f\" (UniqueName: \"kubernetes.io/projected/489d2859-3969-4a25-be37-5c339cc4dc8b-kube-api-access-dgv8f\") pod \"kuadrant-console-plugin-6cb54b5c86-5swtz\" (UID: \"489d2859-3969-4a25-be37-5c339cc4dc8b\") " pod="kuadrant-system/kuadrant-console-plugin-6cb54b5c86-5swtz" Jun 03 16:42:41.374697 ip-10-0-135-67 kubenswrapper[2568]: I0603 16:42:41.374544 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"nginx-conf\" (UniqueName: \"kubernetes.io/configmap/489d2859-3969-4a25-be37-5c339cc4dc8b-nginx-conf\") pod \"kuadrant-console-plugin-6cb54b5c86-5swtz\" (UID: \"489d2859-3969-4a25-be37-5c339cc4dc8b\") " pod="kuadrant-system/kuadrant-console-plugin-6cb54b5c86-5swtz" Jun 03 16:42:41.374697 ip-10-0-135-67 kubenswrapper[2568]: I0603 16:42:41.374567 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugin-serving-cert\" (UniqueName: \"kubernetes.io/secret/489d2859-3969-4a25-be37-5c339cc4dc8b-plugin-serving-cert\") pod \"kuadrant-console-plugin-6cb54b5c86-5swtz\" (UID: \"489d2859-3969-4a25-be37-5c339cc4dc8b\") " pod="kuadrant-system/kuadrant-console-plugin-6cb54b5c86-5swtz" Jun 03 16:42:41.476084 ip-10-0-135-67 kubenswrapper[2568]: I0603 16:42:41.476044 2568 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-dgv8f\" (UniqueName: \"kubernetes.io/projected/489d2859-3969-4a25-be37-5c339cc4dc8b-kube-api-access-dgv8f\") pod \"kuadrant-console-plugin-6cb54b5c86-5swtz\" (UID: \"489d2859-3969-4a25-be37-5c339cc4dc8b\") " pod="kuadrant-system/kuadrant-console-plugin-6cb54b5c86-5swtz" Jun 03 16:42:41.476248 ip-10-0-135-67 kubenswrapper[2568]: I0603 16:42:41.476100 2568 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"nginx-conf\" (UniqueName: \"kubernetes.io/configmap/489d2859-3969-4a25-be37-5c339cc4dc8b-nginx-conf\") pod \"kuadrant-console-plugin-6cb54b5c86-5swtz\" (UID: \"489d2859-3969-4a25-be37-5c339cc4dc8b\") " pod="kuadrant-system/kuadrant-console-plugin-6cb54b5c86-5swtz" Jun 03 16:42:41.476248 ip-10-0-135-67 kubenswrapper[2568]: I0603 16:42:41.476119 2568 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"plugin-serving-cert\" (UniqueName: \"kubernetes.io/secret/489d2859-3969-4a25-be37-5c339cc4dc8b-plugin-serving-cert\") pod \"kuadrant-console-plugin-6cb54b5c86-5swtz\" (UID: \"489d2859-3969-4a25-be37-5c339cc4dc8b\") " pod="kuadrant-system/kuadrant-console-plugin-6cb54b5c86-5swtz" Jun 03 16:42:41.476717 ip-10-0-135-67 kubenswrapper[2568]: I0603 16:42:41.476694 2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"nginx-conf\" (UniqueName: \"kubernetes.io/configmap/489d2859-3969-4a25-be37-5c339cc4dc8b-nginx-conf\") pod \"kuadrant-console-plugin-6cb54b5c86-5swtz\" (UID: \"489d2859-3969-4a25-be37-5c339cc4dc8b\") " pod="kuadrant-system/kuadrant-console-plugin-6cb54b5c86-5swtz" Jun 03 16:42:41.478547 ip-10-0-135-67 kubenswrapper[2568]: I0603 16:42:41.478524 2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"plugin-serving-cert\" (UniqueName: \"kubernetes.io/secret/489d2859-3969-4a25-be37-5c339cc4dc8b-plugin-serving-cert\") pod \"kuadrant-console-plugin-6cb54b5c86-5swtz\" (UID: \"489d2859-3969-4a25-be37-5c339cc4dc8b\") " pod="kuadrant-system/kuadrant-console-plugin-6cb54b5c86-5swtz" Jun 03 16:42:41.483217 ip-10-0-135-67 kubenswrapper[2568]: I0603 16:42:41.483197 2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-dgv8f\" (UniqueName: \"kubernetes.io/projected/489d2859-3969-4a25-be37-5c339cc4dc8b-kube-api-access-dgv8f\") pod \"kuadrant-console-plugin-6cb54b5c86-5swtz\" (UID: \"489d2859-3969-4a25-be37-5c339cc4dc8b\") " pod="kuadrant-system/kuadrant-console-plugin-6cb54b5c86-5swtz" Jun 03 16:42:41.603397 ip-10-0-135-67 kubenswrapper[2568]: I0603 16:42:41.603325 2568 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-console-plugin-6cb54b5c86-5swtz" Jun 03 16:42:41.727447 ip-10-0-135-67 kubenswrapper[2568]: I0603 16:42:41.727413 2568 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-console-plugin-6cb54b5c86-5swtz"] Jun 03 16:42:41.729138 ip-10-0-135-67 kubenswrapper[2568]: W0603 16:42:41.729108 2568 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod489d2859_3969_4a25_be37_5c339cc4dc8b.slice/crio-764abc55d209cfc5a59fb9e47265b346300e81c1c8d16441fa1bc27930b38157 WatchSource:0}: Error finding container 764abc55d209cfc5a59fb9e47265b346300e81c1c8d16441fa1bc27930b38157: Status 404 returned error can't find the container with id 764abc55d209cfc5a59fb9e47265b346300e81c1c8d16441fa1bc27930b38157 Jun 03 16:42:42.285410 ip-10-0-135-67 kubenswrapper[2568]: I0603 16:42:42.285371 2568 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-console-plugin-6cb54b5c86-5swtz" event={"ID":"489d2859-3969-4a25-be37-5c339cc4dc8b","Type":"ContainerStarted","Data":"764abc55d209cfc5a59fb9e47265b346300e81c1c8d16441fa1bc27930b38157"} Jun 03 16:42:51.521153 ip-10-0-135-67 kubenswrapper[2568]: I0603 16:42:51.521118 2568 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-6bc9f4c76f-btztq"] Jun 03 16:42:51.524072 ip-10-0-135-67 kubenswrapper[2568]: I0603 16:42:51.524050 2568 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-6bc9f4c76f-btztq" Jun 03 16:42:51.526930 ip-10-0-135-67 kubenswrapper[2568]: I0603 16:42:51.526910 2568 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"kuadrant-operator-controller-manager-dockercfg-qqh2p\"" Jun 03 16:42:51.536054 ip-10-0-135-67 kubenswrapper[2568]: I0603 16:42:51.535992 2568 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-6bc9f4c76f-btztq"] Jun 03 16:42:51.571642 ip-10-0-135-67 kubenswrapper[2568]: I0603 16:42:51.571615 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-w2xwv\" (UniqueName: \"kubernetes.io/projected/67a0b20e-bba4-40c3-bd0f-b51993e16e79-kube-api-access-w2xwv\") pod \"kuadrant-operator-controller-manager-6bc9f4c76f-btztq\" (UID: \"67a0b20e-bba4-40c3-bd0f-b51993e16e79\") " pod="kuadrant-system/kuadrant-operator-controller-manager-6bc9f4c76f-btztq" Jun 03 16:42:51.571773 ip-10-0-135-67 kubenswrapper[2568]: I0603 16:42:51.571662 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/67a0b20e-bba4-40c3-bd0f-b51993e16e79-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-6bc9f4c76f-btztq\" (UID: \"67a0b20e-bba4-40c3-bd0f-b51993e16e79\") " pod="kuadrant-system/kuadrant-operator-controller-manager-6bc9f4c76f-btztq" Jun 03 16:42:51.672660 ip-10-0-135-67 kubenswrapper[2568]: I0603 16:42:51.672631 2568 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-w2xwv\" (UniqueName: \"kubernetes.io/projected/67a0b20e-bba4-40c3-bd0f-b51993e16e79-kube-api-access-w2xwv\") pod \"kuadrant-operator-controller-manager-6bc9f4c76f-btztq\" (UID: \"67a0b20e-bba4-40c3-bd0f-b51993e16e79\") " pod="kuadrant-system/kuadrant-operator-controller-manager-6bc9f4c76f-btztq" Jun 03 16:42:51.672660 ip-10-0-135-67 kubenswrapper[2568]: I0603 16:42:51.672669 2568 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/67a0b20e-bba4-40c3-bd0f-b51993e16e79-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-6bc9f4c76f-btztq\" (UID: \"67a0b20e-bba4-40c3-bd0f-b51993e16e79\") " pod="kuadrant-system/kuadrant-operator-controller-manager-6bc9f4c76f-btztq" Jun 03 16:42:51.673075 ip-10-0-135-67 kubenswrapper[2568]: I0603 16:42:51.673041 2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/67a0b20e-bba4-40c3-bd0f-b51993e16e79-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-6bc9f4c76f-btztq\" (UID: \"67a0b20e-bba4-40c3-bd0f-b51993e16e79\") " pod="kuadrant-system/kuadrant-operator-controller-manager-6bc9f4c76f-btztq" Jun 03 16:42:51.683166 ip-10-0-135-67 kubenswrapper[2568]: I0603 16:42:51.683139 2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-w2xwv\" (UniqueName: \"kubernetes.io/projected/67a0b20e-bba4-40c3-bd0f-b51993e16e79-kube-api-access-w2xwv\") pod \"kuadrant-operator-controller-manager-6bc9f4c76f-btztq\" (UID: \"67a0b20e-bba4-40c3-bd0f-b51993e16e79\") " pod="kuadrant-system/kuadrant-operator-controller-manager-6bc9f4c76f-btztq" Jun 03 16:42:51.838255 ip-10-0-135-67 kubenswrapper[2568]: I0603 16:42:51.838175 2568 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-6bc9f4c76f-btztq" Jun 03 16:42:51.990703 ip-10-0-135-67 kubenswrapper[2568]: I0603 16:42:51.990672 2568 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-6bc9f4c76f-btztq"] Jun 03 16:42:51.992613 ip-10-0-135-67 kubenswrapper[2568]: W0603 16:42:51.992579 2568 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod67a0b20e_bba4_40c3_bd0f_b51993e16e79.slice/crio-6a318419aaa1e49679ab052edb1ee2caed28eee7e64e71735d60f2bfe73d24a7 WatchSource:0}: Error finding container 6a318419aaa1e49679ab052edb1ee2caed28eee7e64e71735d60f2bfe73d24a7: Status 404 returned error can't find the container with id 6a318419aaa1e49679ab052edb1ee2caed28eee7e64e71735d60f2bfe73d24a7 Jun 03 16:42:52.327329 ip-10-0-135-67 kubenswrapper[2568]: I0603 16:42:52.327295 2568 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-6bc9f4c76f-btztq" event={"ID":"67a0b20e-bba4-40c3-bd0f-b51993e16e79","Type":"ContainerStarted","Data":"6a318419aaa1e49679ab052edb1ee2caed28eee7e64e71735d60f2bfe73d24a7"} Jun 03 16:43:07.397783 ip-10-0-135-67 kubenswrapper[2568]: I0603 16:43:07.397690 2568 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-console-plugin-6cb54b5c86-5swtz" event={"ID":"489d2859-3969-4a25-be37-5c339cc4dc8b","Type":"ContainerStarted","Data":"01f950b7acd6f023588ac42f290dbf968a8d3ff6982468b513f055f29c210bca"} Jun 03 16:43:12.421459 ip-10-0-135-67 kubenswrapper[2568]: I0603 16:43:12.421420 2568 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-6bc9f4c76f-btztq" event={"ID":"67a0b20e-bba4-40c3-bd0f-b51993e16e79","Type":"ContainerStarted","Data":"b24862d35fba00db47e4f3a4fcdd96c1dfe88c9fe10e8064854b63c23073a606"} Jun 03 16:43:12.421912 ip-10-0-135-67 kubenswrapper[2568]: I0603 16:43:12.421551 2568 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/kuadrant-operator-controller-manager-6bc9f4c76f-btztq" Jun 03 16:43:12.439990 ip-10-0-135-67 kubenswrapper[2568]: I0603 16:43:12.439948 2568 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="kuadrant-system/kuadrant-console-plugin-6cb54b5c86-5swtz" podStartSLOduration=6.148047458 podStartE2EDuration="31.439936308s" podCreationTimestamp="2026-06-03 16:42:41 +0000 UTC" firstStartedPulling="2026-06-03 16:42:41.730755365 +0000 UTC m=+533.872929998" lastFinishedPulling="2026-06-03 16:43:07.022644208 +0000 UTC m=+559.164818848" observedRunningTime="2026-06-03 16:43:07.418840904 +0000 UTC m=+559.561015559" watchObservedRunningTime="2026-06-03 16:43:12.439936308 +0000 UTC m=+564.582110966" Jun 03 16:43:12.440142 ip-10-0-135-67 kubenswrapper[2568]: I0603 16:43:12.440061 2568 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="kuadrant-system/kuadrant-operator-controller-manager-6bc9f4c76f-btztq" podStartSLOduration=2.108571011 podStartE2EDuration="21.440053154s" podCreationTimestamp="2026-06-03 16:42:51 +0000 UTC" firstStartedPulling="2026-06-03 16:42:51.995738375 +0000 UTC m=+544.137913011" lastFinishedPulling="2026-06-03 16:43:11.327220517 +0000 UTC m=+563.469395154" observedRunningTime="2026-06-03 16:43:12.438280039 +0000 UTC m=+564.580454703" watchObservedRunningTime="2026-06-03 16:43:12.440053154 +0000 UTC m=+564.582227811" Jun 03 16:43:21.021351 ip-10-0-135-67 kubenswrapper[2568]: I0603 16:43:21.021318 2568 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openshift-console/console-594696d8bf-kst4c"] Jun 03 16:43:23.427716 ip-10-0-135-67 kubenswrapper[2568]: I0603 16:43:23.427681 2568 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/kuadrant-operator-controller-manager-6bc9f4c76f-btztq" Jun 03 16:43:35.971364 ip-10-0-135-67 kubenswrapper[2568]: I0603 16:43:35.971328 2568 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-6bc9f4c76f-btztq"] Jun 03 16:43:35.971793 ip-10-0-135-67 kubenswrapper[2568]: I0603 16:43:35.971561 2568 kuberuntime_container.go:864] "Killing container with a grace period" pod="kuadrant-system/kuadrant-operator-controller-manager-6bc9f4c76f-btztq" podUID="67a0b20e-bba4-40c3-bd0f-b51993e16e79" containerName="manager" containerID="cri-o://b24862d35fba00db47e4f3a4fcdd96c1dfe88c9fe10e8064854b63c23073a606" gracePeriod=10 Jun 03 16:43:36.212546 ip-10-0-135-67 kubenswrapper[2568]: I0603 16:43:36.212523 2568 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-6bc9f4c76f-btztq" Jun 03 16:43:36.271707 ip-10-0-135-67 kubenswrapper[2568]: I0603 16:43:36.271678 2568 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/67a0b20e-bba4-40c3-bd0f-b51993e16e79-extensions-socket-volume\") pod \"67a0b20e-bba4-40c3-bd0f-b51993e16e79\" (UID: \"67a0b20e-bba4-40c3-bd0f-b51993e16e79\") " Jun 03 16:43:36.271853 ip-10-0-135-67 kubenswrapper[2568]: I0603 16:43:36.271752 2568 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-w2xwv\" (UniqueName: \"kubernetes.io/projected/67a0b20e-bba4-40c3-bd0f-b51993e16e79-kube-api-access-w2xwv\") pod \"67a0b20e-bba4-40c3-bd0f-b51993e16e79\" (UID: \"67a0b20e-bba4-40c3-bd0f-b51993e16e79\") " Jun 03 16:43:36.272162 ip-10-0-135-67 kubenswrapper[2568]: I0603 16:43:36.272130 2568 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/67a0b20e-bba4-40c3-bd0f-b51993e16e79-extensions-socket-volume" (OuterVolumeSpecName: "extensions-socket-volume") pod "67a0b20e-bba4-40c3-bd0f-b51993e16e79" (UID: "67a0b20e-bba4-40c3-bd0f-b51993e16e79"). InnerVolumeSpecName "extensions-socket-volume". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jun 03 16:43:36.273794 ip-10-0-135-67 kubenswrapper[2568]: I0603 16:43:36.273768 2568 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/67a0b20e-bba4-40c3-bd0f-b51993e16e79-kube-api-access-w2xwv" (OuterVolumeSpecName: "kube-api-access-w2xwv") pod "67a0b20e-bba4-40c3-bd0f-b51993e16e79" (UID: "67a0b20e-bba4-40c3-bd0f-b51993e16e79"). InnerVolumeSpecName "kube-api-access-w2xwv". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 03 16:43:36.373020 ip-10-0-135-67 kubenswrapper[2568]: I0603 16:43:36.372972 2568 reconciler_common.go:299] "Volume detached for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/67a0b20e-bba4-40c3-bd0f-b51993e16e79-extensions-socket-volume\") on node \"ip-10-0-135-67.ec2.internal\" DevicePath \"\"" Jun 03 16:43:36.373119 ip-10-0-135-67 kubenswrapper[2568]: I0603 16:43:36.373022 2568 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-w2xwv\" (UniqueName: \"kubernetes.io/projected/67a0b20e-bba4-40c3-bd0f-b51993e16e79-kube-api-access-w2xwv\") on node \"ip-10-0-135-67.ec2.internal\" DevicePath \"\"" Jun 03 16:43:36.508367 ip-10-0-135-67 kubenswrapper[2568]: I0603 16:43:36.508327 2568 generic.go:358] "Generic (PLEG): container finished" podID="67a0b20e-bba4-40c3-bd0f-b51993e16e79" containerID="b24862d35fba00db47e4f3a4fcdd96c1dfe88c9fe10e8064854b63c23073a606" exitCode=0 Jun 03 16:43:36.508513 ip-10-0-135-67 kubenswrapper[2568]: I0603 16:43:36.508372 2568 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-6bc9f4c76f-btztq" event={"ID":"67a0b20e-bba4-40c3-bd0f-b51993e16e79","Type":"ContainerDied","Data":"b24862d35fba00db47e4f3a4fcdd96c1dfe88c9fe10e8064854b63c23073a606"} Jun 03 16:43:36.508513 ip-10-0-135-67 kubenswrapper[2568]: I0603 16:43:36.508415 2568 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-6bc9f4c76f-btztq" event={"ID":"67a0b20e-bba4-40c3-bd0f-b51993e16e79","Type":"ContainerDied","Data":"6a318419aaa1e49679ab052edb1ee2caed28eee7e64e71735d60f2bfe73d24a7"} Jun 03 16:43:36.508513 ip-10-0-135-67 kubenswrapper[2568]: I0603 16:43:36.508435 2568 scope.go:117] "RemoveContainer" containerID="b24862d35fba00db47e4f3a4fcdd96c1dfe88c9fe10e8064854b63c23073a606" Jun 03 16:43:36.508513 ip-10-0-135-67 kubenswrapper[2568]: I0603 16:43:36.508451 2568 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-6bc9f4c76f-btztq" Jun 03 16:43:36.517564 ip-10-0-135-67 kubenswrapper[2568]: I0603 16:43:36.517546 2568 scope.go:117] "RemoveContainer" containerID="b24862d35fba00db47e4f3a4fcdd96c1dfe88c9fe10e8064854b63c23073a606" Jun 03 16:43:36.517842 ip-10-0-135-67 kubenswrapper[2568]: E0603 16:43:36.517811 2568 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"b24862d35fba00db47e4f3a4fcdd96c1dfe88c9fe10e8064854b63c23073a606\": container with ID starting with b24862d35fba00db47e4f3a4fcdd96c1dfe88c9fe10e8064854b63c23073a606 not found: ID does not exist" containerID="b24862d35fba00db47e4f3a4fcdd96c1dfe88c9fe10e8064854b63c23073a606" Jun 03 16:43:36.517913 ip-10-0-135-67 kubenswrapper[2568]: I0603 16:43:36.517850 2568 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"b24862d35fba00db47e4f3a4fcdd96c1dfe88c9fe10e8064854b63c23073a606"} err="failed to get container status \"b24862d35fba00db47e4f3a4fcdd96c1dfe88c9fe10e8064854b63c23073a606\": rpc error: code = NotFound desc = could not find container \"b24862d35fba00db47e4f3a4fcdd96c1dfe88c9fe10e8064854b63c23073a606\": container with ID starting with b24862d35fba00db47e4f3a4fcdd96c1dfe88c9fe10e8064854b63c23073a606 not found: ID does not exist" Jun 03 16:43:36.530325 ip-10-0-135-67 kubenswrapper[2568]: I0603 16:43:36.530255 2568 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-6bc9f4c76f-btztq"] Jun 03 16:43:36.534331 ip-10-0-135-67 kubenswrapper[2568]: I0603 16:43:36.534307 2568 kubelet.go:2547] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-6bc9f4c76f-btztq"] Jun 03 16:43:38.410265 ip-10-0-135-67 kubenswrapper[2568]: I0603 16:43:38.410229 2568 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="67a0b20e-bba4-40c3-bd0f-b51993e16e79" path="/var/lib/kubelet/pods/67a0b20e-bba4-40c3-bd0f-b51993e16e79/volumes" Jun 03 16:43:45.104503 ip-10-0-135-67 kubenswrapper[2568]: I0603 16:43:45.104469 2568 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-jmf7m"] Jun 03 16:43:45.105037 ip-10-0-135-67 kubenswrapper[2568]: I0603 16:43:45.104992 2568 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="67a0b20e-bba4-40c3-bd0f-b51993e16e79" containerName="manager" Jun 03 16:43:45.105037 ip-10-0-135-67 kubenswrapper[2568]: I0603 16:43:45.105034 2568 state_mem.go:107] "Deleted CPUSet assignment" podUID="67a0b20e-bba4-40c3-bd0f-b51993e16e79" containerName="manager" Jun 03 16:43:45.105171 ip-10-0-135-67 kubenswrapper[2568]: I0603 16:43:45.105133 2568 memory_manager.go:356] "RemoveStaleState removing state" podUID="67a0b20e-bba4-40c3-bd0f-b51993e16e79" containerName="manager" Jun 03 16:43:45.152252 ip-10-0-135-67 kubenswrapper[2568]: I0603 16:43:45.152221 2568 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-jmf7m"] Jun 03 16:43:45.152252 ip-10-0-135-67 kubenswrapper[2568]: I0603 16:43:45.152251 2568 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-jmf7m"] Jun 03 16:43:45.152434 ip-10-0-135-67 kubenswrapper[2568]: I0603 16:43:45.152359 2568 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-limitador-78c99df468-jmf7m" Jun 03 16:43:45.154358 ip-10-0-135-67 kubenswrapper[2568]: I0603 16:43:45.154336 2568 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"limitador-limits-config-limitador\"" Jun 03 16:43:45.248602 ip-10-0-135-67 kubenswrapper[2568]: I0603 16:43:45.248579 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-6v2hs\" (UniqueName: \"kubernetes.io/projected/3b49a9e3-b45a-44fc-b443-39cbe26599db-kube-api-access-6v2hs\") pod \"limitador-limitador-78c99df468-jmf7m\" (UID: \"3b49a9e3-b45a-44fc-b443-39cbe26599db\") " pod="kuadrant-system/limitador-limitador-78c99df468-jmf7m" Jun 03 16:43:45.248708 ip-10-0-135-67 kubenswrapper[2568]: I0603 16:43:45.248611 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-file\" (UniqueName: \"kubernetes.io/configmap/3b49a9e3-b45a-44fc-b443-39cbe26599db-config-file\") pod \"limitador-limitador-78c99df468-jmf7m\" (UID: \"3b49a9e3-b45a-44fc-b443-39cbe26599db\") " pod="kuadrant-system/limitador-limitador-78c99df468-jmf7m" Jun 03 16:43:45.349627 ip-10-0-135-67 kubenswrapper[2568]: I0603 16:43:45.349594 2568 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-6v2hs\" (UniqueName: \"kubernetes.io/projected/3b49a9e3-b45a-44fc-b443-39cbe26599db-kube-api-access-6v2hs\") pod \"limitador-limitador-78c99df468-jmf7m\" (UID: \"3b49a9e3-b45a-44fc-b443-39cbe26599db\") " pod="kuadrant-system/limitador-limitador-78c99df468-jmf7m" Jun 03 16:43:45.349748 ip-10-0-135-67 kubenswrapper[2568]: I0603 16:43:45.349634 2568 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"config-file\" (UniqueName: \"kubernetes.io/configmap/3b49a9e3-b45a-44fc-b443-39cbe26599db-config-file\") pod \"limitador-limitador-78c99df468-jmf7m\" (UID: \"3b49a9e3-b45a-44fc-b443-39cbe26599db\") " pod="kuadrant-system/limitador-limitador-78c99df468-jmf7m" Jun 03 16:43:45.350283 ip-10-0-135-67 kubenswrapper[2568]: I0603 16:43:45.350266 2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-file\" (UniqueName: \"kubernetes.io/configmap/3b49a9e3-b45a-44fc-b443-39cbe26599db-config-file\") pod \"limitador-limitador-78c99df468-jmf7m\" (UID: \"3b49a9e3-b45a-44fc-b443-39cbe26599db\") " pod="kuadrant-system/limitador-limitador-78c99df468-jmf7m" Jun 03 16:43:45.357213 ip-10-0-135-67 kubenswrapper[2568]: I0603 16:43:45.357161 2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-6v2hs\" (UniqueName: \"kubernetes.io/projected/3b49a9e3-b45a-44fc-b443-39cbe26599db-kube-api-access-6v2hs\") pod \"limitador-limitador-78c99df468-jmf7m\" (UID: \"3b49a9e3-b45a-44fc-b443-39cbe26599db\") " pod="kuadrant-system/limitador-limitador-78c99df468-jmf7m" Jun 03 16:43:45.462551 ip-10-0-135-67 kubenswrapper[2568]: I0603 16:43:45.462525 2568 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-limitador-78c99df468-jmf7m" Jun 03 16:43:45.589536 ip-10-0-135-67 kubenswrapper[2568]: I0603 16:43:45.589512 2568 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-jmf7m"] Jun 03 16:43:45.591227 ip-10-0-135-67 kubenswrapper[2568]: W0603 16:43:45.591191 2568 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod3b49a9e3_b45a_44fc_b443_39cbe26599db.slice/crio-2caf259fe91641e20b4571b8769fc2912351027e08cada21d09f23ee673098d3 WatchSource:0}: Error finding container 2caf259fe91641e20b4571b8769fc2912351027e08cada21d09f23ee673098d3: Status 404 returned error can't find the container with id 2caf259fe91641e20b4571b8769fc2912351027e08cada21d09f23ee673098d3 Jun 03 16:43:45.654563 ip-10-0-135-67 kubenswrapper[2568]: I0603 16:43:45.654497 2568 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["kuadrant-system/authorino-7498df8756-5fbvl"] Jun 03 16:43:45.694501 ip-10-0-135-67 kubenswrapper[2568]: I0603 16:43:45.694479 2568 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-7498df8756-5fbvl"] Jun 03 16:43:45.694624 ip-10-0-135-67 kubenswrapper[2568]: I0603 16:43:45.694588 2568 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-7498df8756-5fbvl" Jun 03 16:43:45.696909 ip-10-0-135-67 kubenswrapper[2568]: I0603 16:43:45.696889 2568 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"authorino-authorino-dockercfg-kk8gn\"" Jun 03 16:43:45.753548 ip-10-0-135-67 kubenswrapper[2568]: I0603 16:43:45.753523 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-s6clp\" (UniqueName: \"kubernetes.io/projected/2e9089e5-7382-4ac2-83b7-337d79e36568-kube-api-access-s6clp\") pod \"authorino-7498df8756-5fbvl\" (UID: \"2e9089e5-7382-4ac2-83b7-337d79e36568\") " pod="kuadrant-system/authorino-7498df8756-5fbvl" Jun 03 16:43:45.853952 ip-10-0-135-67 kubenswrapper[2568]: I0603 16:43:45.853925 2568 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-s6clp\" (UniqueName: \"kubernetes.io/projected/2e9089e5-7382-4ac2-83b7-337d79e36568-kube-api-access-s6clp\") pod \"authorino-7498df8756-5fbvl\" (UID: \"2e9089e5-7382-4ac2-83b7-337d79e36568\") " pod="kuadrant-system/authorino-7498df8756-5fbvl" Jun 03 16:43:45.861415 ip-10-0-135-67 kubenswrapper[2568]: I0603 16:43:45.861393 2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-s6clp\" (UniqueName: \"kubernetes.io/projected/2e9089e5-7382-4ac2-83b7-337d79e36568-kube-api-access-s6clp\") pod \"authorino-7498df8756-5fbvl\" (UID: \"2e9089e5-7382-4ac2-83b7-337d79e36568\") " pod="kuadrant-system/authorino-7498df8756-5fbvl" Jun 03 16:43:46.003512 ip-10-0-135-67 kubenswrapper[2568]: I0603 16:43:46.003474 2568 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-7498df8756-5fbvl" Jun 03 16:43:46.042808 ip-10-0-135-67 kubenswrapper[2568]: I0603 16:43:46.042663 2568 kuberuntime_container.go:864] "Killing container with a grace period" pod="openshift-console/console-594696d8bf-kst4c" podUID="c9c02cf6-177a-47af-ad2c-756b87157852" containerName="console" containerID="cri-o://2279414b99b5eb4a5b86f96480f8dec329dc5d8f47b916475e4166b82a8ea47f" gracePeriod=15 Jun 03 16:43:46.176388 ip-10-0-135-67 kubenswrapper[2568]: I0603 16:43:46.176346 2568 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-7498df8756-5fbvl"] Jun 03 16:43:46.183564 ip-10-0-135-67 kubenswrapper[2568]: W0603 16:43:46.183530 2568 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod2e9089e5_7382_4ac2_83b7_337d79e36568.slice/crio-643dc5944e901b403b67182442eaa9ba047a3f587dbe67b1783aa0ccc96e61a6 WatchSource:0}: Error finding container 643dc5944e901b403b67182442eaa9ba047a3f587dbe67b1783aa0ccc96e61a6: Status 404 returned error can't find the container with id 643dc5944e901b403b67182442eaa9ba047a3f587dbe67b1783aa0ccc96e61a6 Jun 03 16:43:46.333759 ip-10-0-135-67 kubenswrapper[2568]: I0603 16:43:46.333228 2568 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console_console-594696d8bf-kst4c_c9c02cf6-177a-47af-ad2c-756b87157852/console/0.log" Jun 03 16:43:46.333759 ip-10-0-135-67 kubenswrapper[2568]: I0603 16:43:46.333383 2568 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-594696d8bf-kst4c" Jun 03 16:43:46.459492 ip-10-0-135-67 kubenswrapper[2568]: I0603 16:43:46.459466 2568 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/c9c02cf6-177a-47af-ad2c-756b87157852-trusted-ca-bundle\") pod \"c9c02cf6-177a-47af-ad2c-756b87157852\" (UID: \"c9c02cf6-177a-47af-ad2c-756b87157852\") " Jun 03 16:43:46.459651 ip-10-0-135-67 kubenswrapper[2568]: I0603 16:43:46.459507 2568 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/c9c02cf6-177a-47af-ad2c-756b87157852-console-config\") pod \"c9c02cf6-177a-47af-ad2c-756b87157852\" (UID: \"c9c02cf6-177a-47af-ad2c-756b87157852\") " Jun 03 16:43:46.459651 ip-10-0-135-67 kubenswrapper[2568]: I0603 16:43:46.459541 2568 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/c9c02cf6-177a-47af-ad2c-756b87157852-service-ca\") pod \"c9c02cf6-177a-47af-ad2c-756b87157852\" (UID: \"c9c02cf6-177a-47af-ad2c-756b87157852\") " Jun 03 16:43:46.459651 ip-10-0-135-67 kubenswrapper[2568]: I0603 16:43:46.459569 2568 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/c9c02cf6-177a-47af-ad2c-756b87157852-oauth-serving-cert\") pod \"c9c02cf6-177a-47af-ad2c-756b87157852\" (UID: \"c9c02cf6-177a-47af-ad2c-756b87157852\") " Jun 03 16:43:46.459825 ip-10-0-135-67 kubenswrapper[2568]: I0603 16:43:46.459686 2568 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/c9c02cf6-177a-47af-ad2c-756b87157852-console-serving-cert\") pod \"c9c02cf6-177a-47af-ad2c-756b87157852\" (UID: \"c9c02cf6-177a-47af-ad2c-756b87157852\") " Jun 03 16:43:46.459825 ip-10-0-135-67 kubenswrapper[2568]: I0603 16:43:46.459797 2568 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-5tfsj\" (UniqueName: \"kubernetes.io/projected/c9c02cf6-177a-47af-ad2c-756b87157852-kube-api-access-5tfsj\") pod \"c9c02cf6-177a-47af-ad2c-756b87157852\" (UID: \"c9c02cf6-177a-47af-ad2c-756b87157852\") " Jun 03 16:43:46.459929 ip-10-0-135-67 kubenswrapper[2568]: I0603 16:43:46.459840 2568 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/c9c02cf6-177a-47af-ad2c-756b87157852-console-oauth-config\") pod \"c9c02cf6-177a-47af-ad2c-756b87157852\" (UID: \"c9c02cf6-177a-47af-ad2c-756b87157852\") " Jun 03 16:43:46.459992 ip-10-0-135-67 kubenswrapper[2568]: I0603 16:43:46.459943 2568 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/c9c02cf6-177a-47af-ad2c-756b87157852-trusted-ca-bundle" (OuterVolumeSpecName: "trusted-ca-bundle") pod "c9c02cf6-177a-47af-ad2c-756b87157852" (UID: "c9c02cf6-177a-47af-ad2c-756b87157852"). InnerVolumeSpecName "trusted-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jun 03 16:43:46.459992 ip-10-0-135-67 kubenswrapper[2568]: I0603 16:43:46.459950 2568 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/c9c02cf6-177a-47af-ad2c-756b87157852-oauth-serving-cert" (OuterVolumeSpecName: "oauth-serving-cert") pod "c9c02cf6-177a-47af-ad2c-756b87157852" (UID: "c9c02cf6-177a-47af-ad2c-756b87157852"). InnerVolumeSpecName "oauth-serving-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jun 03 16:43:46.459992 ip-10-0-135-67 kubenswrapper[2568]: I0603 16:43:46.459972 2568 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/c9c02cf6-177a-47af-ad2c-756b87157852-console-config" (OuterVolumeSpecName: "console-config") pod "c9c02cf6-177a-47af-ad2c-756b87157852" (UID: "c9c02cf6-177a-47af-ad2c-756b87157852"). InnerVolumeSpecName "console-config". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jun 03 16:43:46.460204 ip-10-0-135-67 kubenswrapper[2568]: I0603 16:43:46.460185 2568 reconciler_common.go:299] "Volume detached for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/c9c02cf6-177a-47af-ad2c-756b87157852-oauth-serving-cert\") on node \"ip-10-0-135-67.ec2.internal\" DevicePath \"\"" Jun 03 16:43:46.460266 ip-10-0-135-67 kubenswrapper[2568]: I0603 16:43:46.460211 2568 reconciler_common.go:299] "Volume detached for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/c9c02cf6-177a-47af-ad2c-756b87157852-trusted-ca-bundle\") on node \"ip-10-0-135-67.ec2.internal\" DevicePath \"\"" Jun 03 16:43:46.460266 ip-10-0-135-67 kubenswrapper[2568]: I0603 16:43:46.460232 2568 reconciler_common.go:299] "Volume detached for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/c9c02cf6-177a-47af-ad2c-756b87157852-console-config\") on node \"ip-10-0-135-67.ec2.internal\" DevicePath \"\"" Jun 03 16:43:46.460403 ip-10-0-135-67 kubenswrapper[2568]: I0603 16:43:46.460384 2568 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/c9c02cf6-177a-47af-ad2c-756b87157852-service-ca" (OuterVolumeSpecName: "service-ca") pod "c9c02cf6-177a-47af-ad2c-756b87157852" (UID: "c9c02cf6-177a-47af-ad2c-756b87157852"). InnerVolumeSpecName "service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jun 03 16:43:46.462279 ip-10-0-135-67 kubenswrapper[2568]: I0603 16:43:46.462251 2568 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/c9c02cf6-177a-47af-ad2c-756b87157852-console-oauth-config" (OuterVolumeSpecName: "console-oauth-config") pod "c9c02cf6-177a-47af-ad2c-756b87157852" (UID: "c9c02cf6-177a-47af-ad2c-756b87157852"). InnerVolumeSpecName "console-oauth-config". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jun 03 16:43:46.462279 ip-10-0-135-67 kubenswrapper[2568]: I0603 16:43:46.462270 2568 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/c9c02cf6-177a-47af-ad2c-756b87157852-kube-api-access-5tfsj" (OuterVolumeSpecName: "kube-api-access-5tfsj") pod "c9c02cf6-177a-47af-ad2c-756b87157852" (UID: "c9c02cf6-177a-47af-ad2c-756b87157852"). InnerVolumeSpecName "kube-api-access-5tfsj". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 03 16:43:46.462417 ip-10-0-135-67 kubenswrapper[2568]: I0603 16:43:46.462271 2568 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/c9c02cf6-177a-47af-ad2c-756b87157852-console-serving-cert" (OuterVolumeSpecName: "console-serving-cert") pod "c9c02cf6-177a-47af-ad2c-756b87157852" (UID: "c9c02cf6-177a-47af-ad2c-756b87157852"). InnerVolumeSpecName "console-serving-cert". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jun 03 16:43:46.548047 ip-10-0-135-67 kubenswrapper[2568]: I0603 16:43:46.548018 2568 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-limitador-78c99df468-jmf7m" event={"ID":"3b49a9e3-b45a-44fc-b443-39cbe26599db","Type":"ContainerStarted","Data":"2caf259fe91641e20b4571b8769fc2912351027e08cada21d09f23ee673098d3"} Jun 03 16:43:46.549133 ip-10-0-135-67 kubenswrapper[2568]: I0603 16:43:46.549107 2568 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-7498df8756-5fbvl" event={"ID":"2e9089e5-7382-4ac2-83b7-337d79e36568","Type":"ContainerStarted","Data":"643dc5944e901b403b67182442eaa9ba047a3f587dbe67b1783aa0ccc96e61a6"} Jun 03 16:43:46.550337 ip-10-0-135-67 kubenswrapper[2568]: I0603 16:43:46.550320 2568 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console_console-594696d8bf-kst4c_c9c02cf6-177a-47af-ad2c-756b87157852/console/0.log" Jun 03 16:43:46.550429 ip-10-0-135-67 kubenswrapper[2568]: I0603 16:43:46.550357 2568 generic.go:358] "Generic (PLEG): container finished" podID="c9c02cf6-177a-47af-ad2c-756b87157852" containerID="2279414b99b5eb4a5b86f96480f8dec329dc5d8f47b916475e4166b82a8ea47f" exitCode=2 Jun 03 16:43:46.550429 ip-10-0-135-67 kubenswrapper[2568]: I0603 16:43:46.550404 2568 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-594696d8bf-kst4c" event={"ID":"c9c02cf6-177a-47af-ad2c-756b87157852","Type":"ContainerDied","Data":"2279414b99b5eb4a5b86f96480f8dec329dc5d8f47b916475e4166b82a8ea47f"} Jun 03 16:43:46.550534 ip-10-0-135-67 kubenswrapper[2568]: I0603 16:43:46.550440 2568 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-594696d8bf-kst4c" event={"ID":"c9c02cf6-177a-47af-ad2c-756b87157852","Type":"ContainerDied","Data":"d85da68e62a8df94f931dfc4c00c229354d570c647a6890e987903ebe167d4da"} Jun 03 16:43:46.550534 ip-10-0-135-67 kubenswrapper[2568]: I0603 16:43:46.550414 2568 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-594696d8bf-kst4c" Jun 03 16:43:46.550534 ip-10-0-135-67 kubenswrapper[2568]: I0603 16:43:46.550457 2568 scope.go:117] "RemoveContainer" containerID="2279414b99b5eb4a5b86f96480f8dec329dc5d8f47b916475e4166b82a8ea47f" Jun 03 16:43:46.562249 ip-10-0-135-67 kubenswrapper[2568]: I0603 16:43:46.562114 2568 scope.go:117] "RemoveContainer" containerID="2279414b99b5eb4a5b86f96480f8dec329dc5d8f47b916475e4166b82a8ea47f" Jun 03 16:43:46.562520 ip-10-0-135-67 kubenswrapper[2568]: E0603 16:43:46.562487 2568 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"2279414b99b5eb4a5b86f96480f8dec329dc5d8f47b916475e4166b82a8ea47f\": container with ID starting with 2279414b99b5eb4a5b86f96480f8dec329dc5d8f47b916475e4166b82a8ea47f not found: ID does not exist" containerID="2279414b99b5eb4a5b86f96480f8dec329dc5d8f47b916475e4166b82a8ea47f" Jun 03 16:43:46.562626 ip-10-0-135-67 kubenswrapper[2568]: I0603 16:43:46.562540 2568 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"2279414b99b5eb4a5b86f96480f8dec329dc5d8f47b916475e4166b82a8ea47f"} err="failed to get container status \"2279414b99b5eb4a5b86f96480f8dec329dc5d8f47b916475e4166b82a8ea47f\": rpc error: code = NotFound desc = could not find container \"2279414b99b5eb4a5b86f96480f8dec329dc5d8f47b916475e4166b82a8ea47f\": container with ID starting with 2279414b99b5eb4a5b86f96480f8dec329dc5d8f47b916475e4166b82a8ea47f not found: ID does not exist" Jun 03 16:43:46.563538 ip-10-0-135-67 kubenswrapper[2568]: I0603 16:43:46.563512 2568 reconciler_common.go:299] "Volume detached for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/c9c02cf6-177a-47af-ad2c-756b87157852-service-ca\") on node \"ip-10-0-135-67.ec2.internal\" DevicePath \"\"" Jun 03 16:43:46.563619 ip-10-0-135-67 kubenswrapper[2568]: I0603 16:43:46.563550 2568 reconciler_common.go:299] "Volume detached for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/c9c02cf6-177a-47af-ad2c-756b87157852-console-serving-cert\") on node \"ip-10-0-135-67.ec2.internal\" DevicePath \"\"" Jun 03 16:43:46.563619 ip-10-0-135-67 kubenswrapper[2568]: I0603 16:43:46.563565 2568 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-5tfsj\" (UniqueName: \"kubernetes.io/projected/c9c02cf6-177a-47af-ad2c-756b87157852-kube-api-access-5tfsj\") on node \"ip-10-0-135-67.ec2.internal\" DevicePath \"\"" Jun 03 16:43:46.563619 ip-10-0-135-67 kubenswrapper[2568]: I0603 16:43:46.563579 2568 reconciler_common.go:299] "Volume detached for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/c9c02cf6-177a-47af-ad2c-756b87157852-console-oauth-config\") on node \"ip-10-0-135-67.ec2.internal\" DevicePath \"\"" Jun 03 16:43:46.574814 ip-10-0-135-67 kubenswrapper[2568]: I0603 16:43:46.574757 2568 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openshift-console/console-594696d8bf-kst4c"] Jun 03 16:43:46.584805 ip-10-0-135-67 kubenswrapper[2568]: I0603 16:43:46.584781 2568 kubelet.go:2547] "SyncLoop REMOVE" source="api" pods=["openshift-console/console-594696d8bf-kst4c"] Jun 03 16:43:48.412862 ip-10-0-135-67 kubenswrapper[2568]: I0603 16:43:48.411858 2568 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="c9c02cf6-177a-47af-ad2c-756b87157852" path="/var/lib/kubelet/pods/c9c02cf6-177a-47af-ad2c-756b87157852/volumes" Jun 03 16:43:49.929119 ip-10-0-135-67 kubenswrapper[2568]: I0603 16:43:49.929083 2568 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-86d7c6cc77-mwpf2_b1e67fcc-fd50-4a1e-af4e-48c44fb8db7d/console-operator/1.log" Jun 03 16:43:49.929119 ip-10-0-135-67 kubenswrapper[2568]: I0603 16:43:49.929117 2568 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-86d7c6cc77-mwpf2_b1e67fcc-fd50-4a1e-af4e-48c44fb8db7d/console-operator/1.log" Jun 03 16:43:49.935436 ip-10-0-135-67 kubenswrapper[2568]: I0603 16:43:49.935405 2568 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-94fdt_dd3dac0d-018e-4c8a-98c7-daedef6dedb9/ovn-acl-logging/0.log" Jun 03 16:43:49.935599 ip-10-0-135-67 kubenswrapper[2568]: I0603 16:43:49.935579 2568 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-94fdt_dd3dac0d-018e-4c8a-98c7-daedef6dedb9/ovn-acl-logging/0.log" Jun 03 16:43:50.570775 ip-10-0-135-67 kubenswrapper[2568]: I0603 16:43:50.570735 2568 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-limitador-78c99df468-jmf7m" event={"ID":"3b49a9e3-b45a-44fc-b443-39cbe26599db","Type":"ContainerStarted","Data":"a016e9687819f0b1198d4548c4502f0f9a984cf9a6fcfb9bc1ad771f8a733102"} Jun 03 16:43:50.571097 ip-10-0-135-67 kubenswrapper[2568]: I0603 16:43:50.570883 2568 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/limitador-limitador-78c99df468-jmf7m" Jun 03 16:43:50.572346 ip-10-0-135-67 kubenswrapper[2568]: I0603 16:43:50.572316 2568 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-7498df8756-5fbvl" event={"ID":"2e9089e5-7382-4ac2-83b7-337d79e36568","Type":"ContainerStarted","Data":"35ed6869f1cc37ac6eee65ff1073472fd1c3d0f7a6c10789ea296b3018cc3f93"} Jun 03 16:43:50.586827 ip-10-0-135-67 kubenswrapper[2568]: I0603 16:43:50.586775 2568 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="kuadrant-system/limitador-limitador-78c99df468-jmf7m" podStartSLOduration=1.236179911 podStartE2EDuration="5.586762315s" podCreationTimestamp="2026-06-03 16:43:45 +0000 UTC" firstStartedPulling="2026-06-03 16:43:45.593158963 +0000 UTC m=+597.735333595" lastFinishedPulling="2026-06-03 16:43:49.943741362 +0000 UTC m=+602.085915999" observedRunningTime="2026-06-03 16:43:50.584334824 +0000 UTC m=+602.726509478" watchObservedRunningTime="2026-06-03 16:43:50.586762315 +0000 UTC m=+602.728936974" Jun 03 16:43:50.597813 ip-10-0-135-67 kubenswrapper[2568]: I0603 16:43:50.597769 2568 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="kuadrant-system/authorino-7498df8756-5fbvl" podStartSLOduration=1.834742826 podStartE2EDuration="5.597757667s" podCreationTimestamp="2026-06-03 16:43:45 +0000 UTC" firstStartedPulling="2026-06-03 16:43:46.186503661 +0000 UTC m=+598.328678298" lastFinishedPulling="2026-06-03 16:43:49.949518491 +0000 UTC m=+602.091693139" observedRunningTime="2026-06-03 16:43:50.596190489 +0000 UTC m=+602.738365142" watchObservedRunningTime="2026-06-03 16:43:50.597757667 +0000 UTC m=+602.739932370" Jun 03 16:44:01.577495 ip-10-0-135-67 kubenswrapper[2568]: I0603 16:44:01.577463 2568 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/limitador-limitador-78c99df468-jmf7m" Jun 03 16:44:16.691997 ip-10-0-135-67 kubenswrapper[2568]: I0603 16:44:16.691907 2568 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-marketplace/32684d7096c88e320aaae000f43b8c5ea50d1c3368188ae50aa1502a70v6zsr"] Jun 03 16:44:16.692455 ip-10-0-135-67 kubenswrapper[2568]: I0603 16:44:16.692435 2568 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="c9c02cf6-177a-47af-ad2c-756b87157852" containerName="console" Jun 03 16:44:16.692455 ip-10-0-135-67 kubenswrapper[2568]: I0603 16:44:16.692455 2568 state_mem.go:107] "Deleted CPUSet assignment" podUID="c9c02cf6-177a-47af-ad2c-756b87157852" containerName="console" Jun 03 16:44:16.692584 ip-10-0-135-67 kubenswrapper[2568]: I0603 16:44:16.692570 2568 memory_manager.go:356] "RemoveStaleState removing state" podUID="c9c02cf6-177a-47af-ad2c-756b87157852" containerName="console" Jun 03 16:44:16.694759 ip-10-0-135-67 kubenswrapper[2568]: I0603 16:44:16.694739 2568 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/32684d7096c88e320aaae000f43b8c5ea50d1c3368188ae50aa1502a70v6zsr" Jun 03 16:44:16.696906 ip-10-0-135-67 kubenswrapper[2568]: I0603 16:44:16.696885 2568 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"kube-root-ca.crt\"" Jun 03 16:44:16.697148 ip-10-0-135-67 kubenswrapper[2568]: I0603 16:44:16.697132 2568 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-marketplace\"/\"default-dockercfg-mhpmz\"" Jun 03 16:44:16.697621 ip-10-0-135-67 kubenswrapper[2568]: I0603 16:44:16.697607 2568 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"openshift-service-ca.crt\"" Jun 03 16:44:16.702257 ip-10-0-135-67 kubenswrapper[2568]: I0603 16:44:16.702224 2568 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/32684d7096c88e320aaae000f43b8c5ea50d1c3368188ae50aa1502a70v6zsr"] Jun 03 16:44:16.707505 ip-10-0-135-67 kubenswrapper[2568]: I0603 16:44:16.707484 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/629da8ce-4675-4c34-b57d-491be232e4ac-util\") pod \"32684d7096c88e320aaae000f43b8c5ea50d1c3368188ae50aa1502a70v6zsr\" (UID: \"629da8ce-4675-4c34-b57d-491be232e4ac\") " pod="openshift-marketplace/32684d7096c88e320aaae000f43b8c5ea50d1c3368188ae50aa1502a70v6zsr" Jun 03 16:44:16.707593 ip-10-0-135-67 kubenswrapper[2568]: I0603 16:44:16.707528 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/629da8ce-4675-4c34-b57d-491be232e4ac-bundle\") pod \"32684d7096c88e320aaae000f43b8c5ea50d1c3368188ae50aa1502a70v6zsr\" (UID: \"629da8ce-4675-4c34-b57d-491be232e4ac\") " pod="openshift-marketplace/32684d7096c88e320aaae000f43b8c5ea50d1c3368188ae50aa1502a70v6zsr" Jun 03 16:44:16.707593 ip-10-0-135-67 kubenswrapper[2568]: I0603 16:44:16.707553 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-l5pxk\" (UniqueName: \"kubernetes.io/projected/629da8ce-4675-4c34-b57d-491be232e4ac-kube-api-access-l5pxk\") pod \"32684d7096c88e320aaae000f43b8c5ea50d1c3368188ae50aa1502a70v6zsr\" (UID: \"629da8ce-4675-4c34-b57d-491be232e4ac\") " pod="openshift-marketplace/32684d7096c88e320aaae000f43b8c5ea50d1c3368188ae50aa1502a70v6zsr" Jun 03 16:44:16.808850 ip-10-0-135-67 kubenswrapper[2568]: I0603 16:44:16.808825 2568 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/629da8ce-4675-4c34-b57d-491be232e4ac-bundle\") pod \"32684d7096c88e320aaae000f43b8c5ea50d1c3368188ae50aa1502a70v6zsr\" (UID: \"629da8ce-4675-4c34-b57d-491be232e4ac\") " pod="openshift-marketplace/32684d7096c88e320aaae000f43b8c5ea50d1c3368188ae50aa1502a70v6zsr" Jun 03 16:44:16.808953 ip-10-0-135-67 kubenswrapper[2568]: I0603 16:44:16.808856 2568 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-l5pxk\" (UniqueName: \"kubernetes.io/projected/629da8ce-4675-4c34-b57d-491be232e4ac-kube-api-access-l5pxk\") pod \"32684d7096c88e320aaae000f43b8c5ea50d1c3368188ae50aa1502a70v6zsr\" (UID: \"629da8ce-4675-4c34-b57d-491be232e4ac\") " pod="openshift-marketplace/32684d7096c88e320aaae000f43b8c5ea50d1c3368188ae50aa1502a70v6zsr" Jun 03 16:44:16.808953 ip-10-0-135-67 kubenswrapper[2568]: I0603 16:44:16.808913 2568 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/629da8ce-4675-4c34-b57d-491be232e4ac-util\") pod \"32684d7096c88e320aaae000f43b8c5ea50d1c3368188ae50aa1502a70v6zsr\" (UID: \"629da8ce-4675-4c34-b57d-491be232e4ac\") " pod="openshift-marketplace/32684d7096c88e320aaae000f43b8c5ea50d1c3368188ae50aa1502a70v6zsr" Jun 03 16:44:16.809225 ip-10-0-135-67 kubenswrapper[2568]: I0603 16:44:16.809207 2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/629da8ce-4675-4c34-b57d-491be232e4ac-bundle\") pod \"32684d7096c88e320aaae000f43b8c5ea50d1c3368188ae50aa1502a70v6zsr\" (UID: \"629da8ce-4675-4c34-b57d-491be232e4ac\") " pod="openshift-marketplace/32684d7096c88e320aaae000f43b8c5ea50d1c3368188ae50aa1502a70v6zsr" Jun 03 16:44:16.809261 ip-10-0-135-67 kubenswrapper[2568]: I0603 16:44:16.809234 2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/629da8ce-4675-4c34-b57d-491be232e4ac-util\") pod \"32684d7096c88e320aaae000f43b8c5ea50d1c3368188ae50aa1502a70v6zsr\" (UID: \"629da8ce-4675-4c34-b57d-491be232e4ac\") " pod="openshift-marketplace/32684d7096c88e320aaae000f43b8c5ea50d1c3368188ae50aa1502a70v6zsr" Jun 03 16:44:16.816758 ip-10-0-135-67 kubenswrapper[2568]: I0603 16:44:16.816738 2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-l5pxk\" (UniqueName: \"kubernetes.io/projected/629da8ce-4675-4c34-b57d-491be232e4ac-kube-api-access-l5pxk\") pod \"32684d7096c88e320aaae000f43b8c5ea50d1c3368188ae50aa1502a70v6zsr\" (UID: \"629da8ce-4675-4c34-b57d-491be232e4ac\") " pod="openshift-marketplace/32684d7096c88e320aaae000f43b8c5ea50d1c3368188ae50aa1502a70v6zsr" Jun 03 16:44:17.004737 ip-10-0-135-67 kubenswrapper[2568]: I0603 16:44:17.004717 2568 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/32684d7096c88e320aaae000f43b8c5ea50d1c3368188ae50aa1502a70v6zsr" Jun 03 16:44:17.130345 ip-10-0-135-67 kubenswrapper[2568]: I0603 16:44:17.130319 2568 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/32684d7096c88e320aaae000f43b8c5ea50d1c3368188ae50aa1502a70v6zsr"] Jun 03 16:44:17.132317 ip-10-0-135-67 kubenswrapper[2568]: W0603 16:44:17.132291 2568 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod629da8ce_4675_4c34_b57d_491be232e4ac.slice/crio-2f0c66e8a604631b57bb7d5268a514da32272586d729fafc9b2ab07806a82482 WatchSource:0}: Error finding container 2f0c66e8a604631b57bb7d5268a514da32272586d729fafc9b2ab07806a82482: Status 404 returned error can't find the container with id 2f0c66e8a604631b57bb7d5268a514da32272586d729fafc9b2ab07806a82482 Jun 03 16:44:17.680927 ip-10-0-135-67 kubenswrapper[2568]: I0603 16:44:17.680897 2568 generic.go:358] "Generic (PLEG): container finished" podID="629da8ce-4675-4c34-b57d-491be232e4ac" containerID="1379becbe73be8baac0f5071cdee064056f0514adb646275cdba76775c34f5c3" exitCode=0 Jun 03 16:44:17.681105 ip-10-0-135-67 kubenswrapper[2568]: I0603 16:44:17.680982 2568 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/32684d7096c88e320aaae000f43b8c5ea50d1c3368188ae50aa1502a70v6zsr" event={"ID":"629da8ce-4675-4c34-b57d-491be232e4ac","Type":"ContainerDied","Data":"1379becbe73be8baac0f5071cdee064056f0514adb646275cdba76775c34f5c3"} Jun 03 16:44:17.681105 ip-10-0-135-67 kubenswrapper[2568]: I0603 16:44:17.681039 2568 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/32684d7096c88e320aaae000f43b8c5ea50d1c3368188ae50aa1502a70v6zsr" event={"ID":"629da8ce-4675-4c34-b57d-491be232e4ac","Type":"ContainerStarted","Data":"2f0c66e8a604631b57bb7d5268a514da32272586d729fafc9b2ab07806a82482"} Jun 03 16:44:18.686032 ip-10-0-135-67 kubenswrapper[2568]: I0603 16:44:18.685927 2568 generic.go:358] "Generic (PLEG): container finished" podID="629da8ce-4675-4c34-b57d-491be232e4ac" containerID="69010bdc5711f704645dbbecae78283f0c59595d8309ed872fe8a93ffdcce6c4" exitCode=0 Jun 03 16:44:18.686032 ip-10-0-135-67 kubenswrapper[2568]: I0603 16:44:18.685967 2568 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/32684d7096c88e320aaae000f43b8c5ea50d1c3368188ae50aa1502a70v6zsr" event={"ID":"629da8ce-4675-4c34-b57d-491be232e4ac","Type":"ContainerDied","Data":"69010bdc5711f704645dbbecae78283f0c59595d8309ed872fe8a93ffdcce6c4"} Jun 03 16:44:19.691639 ip-10-0-135-67 kubenswrapper[2568]: I0603 16:44:19.691602 2568 generic.go:358] "Generic (PLEG): container finished" podID="629da8ce-4675-4c34-b57d-491be232e4ac" containerID="854e716e51ff3a4ca198a990f467cf82fabedcb91dba9d6e86d4091816a39582" exitCode=0 Jun 03 16:44:19.691995 ip-10-0-135-67 kubenswrapper[2568]: I0603 16:44:19.691681 2568 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/32684d7096c88e320aaae000f43b8c5ea50d1c3368188ae50aa1502a70v6zsr" event={"ID":"629da8ce-4675-4c34-b57d-491be232e4ac","Type":"ContainerDied","Data":"854e716e51ff3a4ca198a990f467cf82fabedcb91dba9d6e86d4091816a39582"} Jun 03 16:44:20.821137 ip-10-0-135-67 kubenswrapper[2568]: I0603 16:44:20.821115 2568 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/32684d7096c88e320aaae000f43b8c5ea50d1c3368188ae50aa1502a70v6zsr" Jun 03 16:44:20.842419 ip-10-0-135-67 kubenswrapper[2568]: I0603 16:44:20.842393 2568 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/629da8ce-4675-4c34-b57d-491be232e4ac-bundle\") pod \"629da8ce-4675-4c34-b57d-491be232e4ac\" (UID: \"629da8ce-4675-4c34-b57d-491be232e4ac\") " Jun 03 16:44:20.842560 ip-10-0-135-67 kubenswrapper[2568]: I0603 16:44:20.842442 2568 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-l5pxk\" (UniqueName: \"kubernetes.io/projected/629da8ce-4675-4c34-b57d-491be232e4ac-kube-api-access-l5pxk\") pod \"629da8ce-4675-4c34-b57d-491be232e4ac\" (UID: \"629da8ce-4675-4c34-b57d-491be232e4ac\") " Jun 03 16:44:20.842560 ip-10-0-135-67 kubenswrapper[2568]: I0603 16:44:20.842497 2568 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/629da8ce-4675-4c34-b57d-491be232e4ac-util\") pod \"629da8ce-4675-4c34-b57d-491be232e4ac\" (UID: \"629da8ce-4675-4c34-b57d-491be232e4ac\") " Jun 03 16:44:20.842865 ip-10-0-135-67 kubenswrapper[2568]: I0603 16:44:20.842836 2568 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/629da8ce-4675-4c34-b57d-491be232e4ac-bundle" (OuterVolumeSpecName: "bundle") pod "629da8ce-4675-4c34-b57d-491be232e4ac" (UID: "629da8ce-4675-4c34-b57d-491be232e4ac"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jun 03 16:44:20.844982 ip-10-0-135-67 kubenswrapper[2568]: I0603 16:44:20.844948 2568 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/629da8ce-4675-4c34-b57d-491be232e4ac-kube-api-access-l5pxk" (OuterVolumeSpecName: "kube-api-access-l5pxk") pod "629da8ce-4675-4c34-b57d-491be232e4ac" (UID: "629da8ce-4675-4c34-b57d-491be232e4ac"). InnerVolumeSpecName "kube-api-access-l5pxk". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 03 16:44:20.851647 ip-10-0-135-67 kubenswrapper[2568]: I0603 16:44:20.851616 2568 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/629da8ce-4675-4c34-b57d-491be232e4ac-util" (OuterVolumeSpecName: "util") pod "629da8ce-4675-4c34-b57d-491be232e4ac" (UID: "629da8ce-4675-4c34-b57d-491be232e4ac"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jun 03 16:44:20.943567 ip-10-0-135-67 kubenswrapper[2568]: I0603 16:44:20.943531 2568 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/629da8ce-4675-4c34-b57d-491be232e4ac-bundle\") on node \"ip-10-0-135-67.ec2.internal\" DevicePath \"\"" Jun 03 16:44:20.943567 ip-10-0-135-67 kubenswrapper[2568]: I0603 16:44:20.943564 2568 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-l5pxk\" (UniqueName: \"kubernetes.io/projected/629da8ce-4675-4c34-b57d-491be232e4ac-kube-api-access-l5pxk\") on node \"ip-10-0-135-67.ec2.internal\" DevicePath \"\"" Jun 03 16:44:20.943567 ip-10-0-135-67 kubenswrapper[2568]: I0603 16:44:20.943576 2568 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/629da8ce-4675-4c34-b57d-491be232e4ac-util\") on node \"ip-10-0-135-67.ec2.internal\" DevicePath \"\"" Jun 03 16:44:21.701589 ip-10-0-135-67 kubenswrapper[2568]: I0603 16:44:21.701541 2568 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/32684d7096c88e320aaae000f43b8c5ea50d1c3368188ae50aa1502a70v6zsr" event={"ID":"629da8ce-4675-4c34-b57d-491be232e4ac","Type":"ContainerDied","Data":"2f0c66e8a604631b57bb7d5268a514da32272586d729fafc9b2ab07806a82482"} Jun 03 16:44:21.701828 ip-10-0-135-67 kubenswrapper[2568]: I0603 16:44:21.701592 2568 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="2f0c66e8a604631b57bb7d5268a514da32272586d729fafc9b2ab07806a82482" Jun 03 16:44:21.701828 ip-10-0-135-67 kubenswrapper[2568]: I0603 16:44:21.701601 2568 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/32684d7096c88e320aaae000f43b8c5ea50d1c3368188ae50aa1502a70v6zsr" Jun 03 16:45:09.624621 ip-10-0-135-67 kubenswrapper[2568]: I0603 16:45:09.624587 2568 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["kuadrant-system/authorino-8b475cf9f-cql4h"] Jun 03 16:45:09.625085 ip-10-0-135-67 kubenswrapper[2568]: I0603 16:45:09.624985 2568 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="629da8ce-4675-4c34-b57d-491be232e4ac" containerName="pull" Jun 03 16:45:09.625085 ip-10-0-135-67 kubenswrapper[2568]: I0603 16:45:09.625013 2568 state_mem.go:107] "Deleted CPUSet assignment" podUID="629da8ce-4675-4c34-b57d-491be232e4ac" containerName="pull" Jun 03 16:45:09.625085 ip-10-0-135-67 kubenswrapper[2568]: I0603 16:45:09.625023 2568 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="629da8ce-4675-4c34-b57d-491be232e4ac" containerName="extract" Jun 03 16:45:09.625085 ip-10-0-135-67 kubenswrapper[2568]: I0603 16:45:09.625029 2568 state_mem.go:107] "Deleted CPUSet assignment" podUID="629da8ce-4675-4c34-b57d-491be232e4ac" containerName="extract" Jun 03 16:45:09.625085 ip-10-0-135-67 kubenswrapper[2568]: I0603 16:45:09.625047 2568 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="629da8ce-4675-4c34-b57d-491be232e4ac" containerName="util" Jun 03 16:45:09.625085 ip-10-0-135-67 kubenswrapper[2568]: I0603 16:45:09.625053 2568 state_mem.go:107] "Deleted CPUSet assignment" podUID="629da8ce-4675-4c34-b57d-491be232e4ac" containerName="util" Jun 03 16:45:09.625276 ip-10-0-135-67 kubenswrapper[2568]: I0603 16:45:09.625115 2568 memory_manager.go:356] "RemoveStaleState removing state" podUID="629da8ce-4675-4c34-b57d-491be232e4ac" containerName="extract" Jun 03 16:45:09.626925 ip-10-0-135-67 kubenswrapper[2568]: I0603 16:45:09.626910 2568 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-8b475cf9f-cql4h" Jun 03 16:45:09.635392 ip-10-0-135-67 kubenswrapper[2568]: I0603 16:45:09.635366 2568 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-8b475cf9f-cql4h"] Jun 03 16:45:09.653316 ip-10-0-135-67 kubenswrapper[2568]: I0603 16:45:09.653287 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-qgqzm\" (UniqueName: \"kubernetes.io/projected/ca040277-f7c2-45ce-abf2-730ae89d30ac-kube-api-access-qgqzm\") pod \"authorino-8b475cf9f-cql4h\" (UID: \"ca040277-f7c2-45ce-abf2-730ae89d30ac\") " pod="kuadrant-system/authorino-8b475cf9f-cql4h" Jun 03 16:45:09.753669 ip-10-0-135-67 kubenswrapper[2568]: I0603 16:45:09.753639 2568 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-qgqzm\" (UniqueName: \"kubernetes.io/projected/ca040277-f7c2-45ce-abf2-730ae89d30ac-kube-api-access-qgqzm\") pod \"authorino-8b475cf9f-cql4h\" (UID: \"ca040277-f7c2-45ce-abf2-730ae89d30ac\") " pod="kuadrant-system/authorino-8b475cf9f-cql4h" Jun 03 16:45:09.761168 ip-10-0-135-67 kubenswrapper[2568]: I0603 16:45:09.761146 2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-qgqzm\" (UniqueName: \"kubernetes.io/projected/ca040277-f7c2-45ce-abf2-730ae89d30ac-kube-api-access-qgqzm\") pod \"authorino-8b475cf9f-cql4h\" (UID: \"ca040277-f7c2-45ce-abf2-730ae89d30ac\") " pod="kuadrant-system/authorino-8b475cf9f-cql4h" Jun 03 16:45:09.853660 ip-10-0-135-67 kubenswrapper[2568]: I0603 16:45:09.853630 2568 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-8b475cf9f-cql4h"] Jun 03 16:45:09.853861 ip-10-0-135-67 kubenswrapper[2568]: I0603 16:45:09.853845 2568 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-8b475cf9f-cql4h" Jun 03 16:45:09.881615 ip-10-0-135-67 kubenswrapper[2568]: I0603 16:45:09.881546 2568 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["kuadrant-system/authorino-56f585f496-9kjcs"] Jun 03 16:45:09.884497 ip-10-0-135-67 kubenswrapper[2568]: I0603 16:45:09.884480 2568 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-56f585f496-9kjcs" Jun 03 16:45:09.894272 ip-10-0-135-67 kubenswrapper[2568]: I0603 16:45:09.894250 2568 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-56f585f496-9kjcs"] Jun 03 16:45:09.956072 ip-10-0-135-67 kubenswrapper[2568]: I0603 16:45:09.956042 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-5jlrz\" (UniqueName: \"kubernetes.io/projected/f0fba173-9819-429d-9aa9-77a554d3c13f-kube-api-access-5jlrz\") pod \"authorino-56f585f496-9kjcs\" (UID: \"f0fba173-9819-429d-9aa9-77a554d3c13f\") " pod="kuadrant-system/authorino-56f585f496-9kjcs" Jun 03 16:45:09.989355 ip-10-0-135-67 kubenswrapper[2568]: I0603 16:45:09.989175 2568 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-8b475cf9f-cql4h"] Jun 03 16:45:09.991696 ip-10-0-135-67 kubenswrapper[2568]: W0603 16:45:09.991668 2568 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-podca040277_f7c2_45ce_abf2_730ae89d30ac.slice/crio-7bc33e1fdf9fefa0c2f54113c9557858df7d304ddfb59e03ae59a604422d133c WatchSource:0}: Error finding container 7bc33e1fdf9fefa0c2f54113c9557858df7d304ddfb59e03ae59a604422d133c: Status 404 returned error can't find the container with id 7bc33e1fdf9fefa0c2f54113c9557858df7d304ddfb59e03ae59a604422d133c Jun 03 16:45:09.993092 ip-10-0-135-67 kubenswrapper[2568]: I0603 16:45:09.993073 2568 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider Jun 03 16:45:10.056810 ip-10-0-135-67 kubenswrapper[2568]: I0603 16:45:10.056781 2568 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-5jlrz\" (UniqueName: \"kubernetes.io/projected/f0fba173-9819-429d-9aa9-77a554d3c13f-kube-api-access-5jlrz\") pod \"authorino-56f585f496-9kjcs\" (UID: \"f0fba173-9819-429d-9aa9-77a554d3c13f\") " pod="kuadrant-system/authorino-56f585f496-9kjcs" Jun 03 16:45:10.065132 ip-10-0-135-67 kubenswrapper[2568]: I0603 16:45:10.065107 2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-5jlrz\" (UniqueName: \"kubernetes.io/projected/f0fba173-9819-429d-9aa9-77a554d3c13f-kube-api-access-5jlrz\") pod \"authorino-56f585f496-9kjcs\" (UID: \"f0fba173-9819-429d-9aa9-77a554d3c13f\") " pod="kuadrant-system/authorino-56f585f496-9kjcs" Jun 03 16:45:10.197817 ip-10-0-135-67 kubenswrapper[2568]: I0603 16:45:10.197759 2568 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-56f585f496-9kjcs" Jun 03 16:45:10.326454 ip-10-0-135-67 kubenswrapper[2568]: I0603 16:45:10.326429 2568 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-56f585f496-9kjcs"] Jun 03 16:45:10.327356 ip-10-0-135-67 kubenswrapper[2568]: W0603 16:45:10.327335 2568 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-podf0fba173_9819_429d_9aa9_77a554d3c13f.slice/crio-a95b890a6eb7c130991215ff7ad91e95c71c425e9abfb4e7135bdb74bc359599 WatchSource:0}: Error finding container a95b890a6eb7c130991215ff7ad91e95c71c425e9abfb4e7135bdb74bc359599: Status 404 returned error can't find the container with id a95b890a6eb7c130991215ff7ad91e95c71c425e9abfb4e7135bdb74bc359599 Jun 03 16:45:10.777904 ip-10-0-135-67 kubenswrapper[2568]: I0603 16:45:10.777871 2568 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-56f585f496-9kjcs"] Jun 03 16:45:10.896111 ip-10-0-135-67 kubenswrapper[2568]: I0603 16:45:10.896031 2568 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-56f585f496-9kjcs" event={"ID":"f0fba173-9819-429d-9aa9-77a554d3c13f","Type":"ContainerStarted","Data":"df5e098ce94cd94f94108c9ff29b7876e511f41ded96fdd6fb5d3d8efe538a3a"} Jun 03 16:45:10.896111 ip-10-0-135-67 kubenswrapper[2568]: I0603 16:45:10.896074 2568 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-56f585f496-9kjcs" event={"ID":"f0fba173-9819-429d-9aa9-77a554d3c13f","Type":"ContainerStarted","Data":"a95b890a6eb7c130991215ff7ad91e95c71c425e9abfb4e7135bdb74bc359599"} Jun 03 16:45:10.897600 ip-10-0-135-67 kubenswrapper[2568]: I0603 16:45:10.897570 2568 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-8b475cf9f-cql4h" event={"ID":"ca040277-f7c2-45ce-abf2-730ae89d30ac","Type":"ContainerStarted","Data":"0760b9cf2129881ad19831fc51313e646668bfbf580d69e05e35e699bdefd79f"} Jun 03 16:45:10.897717 ip-10-0-135-67 kubenswrapper[2568]: I0603 16:45:10.897605 2568 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-8b475cf9f-cql4h" event={"ID":"ca040277-f7c2-45ce-abf2-730ae89d30ac","Type":"ContainerStarted","Data":"7bc33e1fdf9fefa0c2f54113c9557858df7d304ddfb59e03ae59a604422d133c"} Jun 03 16:45:10.897717 ip-10-0-135-67 kubenswrapper[2568]: I0603 16:45:10.897626 2568 kuberuntime_container.go:864] "Killing container with a grace period" pod="kuadrant-system/authorino-8b475cf9f-cql4h" podUID="ca040277-f7c2-45ce-abf2-730ae89d30ac" containerName="authorino" containerID="cri-o://0760b9cf2129881ad19831fc51313e646668bfbf580d69e05e35e699bdefd79f" gracePeriod=30 Jun 03 16:45:10.909911 ip-10-0-135-67 kubenswrapper[2568]: I0603 16:45:10.909861 2568 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="kuadrant-system/authorino-56f585f496-9kjcs" podStartSLOduration=1.599145654 podStartE2EDuration="1.909842692s" podCreationTimestamp="2026-06-03 16:45:09 +0000 UTC" firstStartedPulling="2026-06-03 16:45:10.328685189 +0000 UTC m=+682.470859834" lastFinishedPulling="2026-06-03 16:45:10.63938224 +0000 UTC m=+682.781556872" observedRunningTime="2026-06-03 16:45:10.909639189 +0000 UTC m=+683.051813845" watchObservedRunningTime="2026-06-03 16:45:10.909842692 +0000 UTC m=+683.052017349" Jun 03 16:45:10.924261 ip-10-0-135-67 kubenswrapper[2568]: I0603 16:45:10.924214 2568 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="kuadrant-system/authorino-8b475cf9f-cql4h" podStartSLOduration=1.543510339 podStartE2EDuration="1.924199463s" podCreationTimestamp="2026-06-03 16:45:09 +0000 UTC" firstStartedPulling="2026-06-03 16:45:09.993233148 +0000 UTC m=+682.135407780" lastFinishedPulling="2026-06-03 16:45:10.373922269 +0000 UTC m=+682.516096904" observedRunningTime="2026-06-03 16:45:10.923930173 +0000 UTC m=+683.066104826" watchObservedRunningTime="2026-06-03 16:45:10.924199463 +0000 UTC m=+683.066374118" Jun 03 16:45:11.145093 ip-10-0-135-67 kubenswrapper[2568]: I0603 16:45:11.145070 2568 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-8b475cf9f-cql4h" Jun 03 16:45:11.166611 ip-10-0-135-67 kubenswrapper[2568]: I0603 16:45:11.166546 2568 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-qgqzm\" (UniqueName: \"kubernetes.io/projected/ca040277-f7c2-45ce-abf2-730ae89d30ac-kube-api-access-qgqzm\") pod \"ca040277-f7c2-45ce-abf2-730ae89d30ac\" (UID: \"ca040277-f7c2-45ce-abf2-730ae89d30ac\") " Jun 03 16:45:11.168525 ip-10-0-135-67 kubenswrapper[2568]: I0603 16:45:11.168494 2568 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/ca040277-f7c2-45ce-abf2-730ae89d30ac-kube-api-access-qgqzm" (OuterVolumeSpecName: "kube-api-access-qgqzm") pod "ca040277-f7c2-45ce-abf2-730ae89d30ac" (UID: "ca040277-f7c2-45ce-abf2-730ae89d30ac"). InnerVolumeSpecName "kube-api-access-qgqzm". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 03 16:45:11.267626 ip-10-0-135-67 kubenswrapper[2568]: I0603 16:45:11.267600 2568 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-qgqzm\" (UniqueName: \"kubernetes.io/projected/ca040277-f7c2-45ce-abf2-730ae89d30ac-kube-api-access-qgqzm\") on node \"ip-10-0-135-67.ec2.internal\" DevicePath \"\"" Jun 03 16:45:11.902383 ip-10-0-135-67 kubenswrapper[2568]: I0603 16:45:11.902341 2568 generic.go:358] "Generic (PLEG): container finished" podID="ca040277-f7c2-45ce-abf2-730ae89d30ac" containerID="0760b9cf2129881ad19831fc51313e646668bfbf580d69e05e35e699bdefd79f" exitCode=0 Jun 03 16:45:11.902800 ip-10-0-135-67 kubenswrapper[2568]: I0603 16:45:11.902386 2568 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-8b475cf9f-cql4h" Jun 03 16:45:11.902800 ip-10-0-135-67 kubenswrapper[2568]: I0603 16:45:11.902426 2568 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-8b475cf9f-cql4h" event={"ID":"ca040277-f7c2-45ce-abf2-730ae89d30ac","Type":"ContainerDied","Data":"0760b9cf2129881ad19831fc51313e646668bfbf580d69e05e35e699bdefd79f"} Jun 03 16:45:11.902800 ip-10-0-135-67 kubenswrapper[2568]: I0603 16:45:11.902464 2568 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-8b475cf9f-cql4h" event={"ID":"ca040277-f7c2-45ce-abf2-730ae89d30ac","Type":"ContainerDied","Data":"7bc33e1fdf9fefa0c2f54113c9557858df7d304ddfb59e03ae59a604422d133c"} Jun 03 16:45:11.902800 ip-10-0-135-67 kubenswrapper[2568]: I0603 16:45:11.902485 2568 scope.go:117] "RemoveContainer" containerID="0760b9cf2129881ad19831fc51313e646668bfbf580d69e05e35e699bdefd79f" Jun 03 16:45:11.902800 ip-10-0-135-67 kubenswrapper[2568]: I0603 16:45:11.902675 2568 kuberuntime_container.go:864] "Killing container with a grace period" pod="kuadrant-system/authorino-56f585f496-9kjcs" podUID="f0fba173-9819-429d-9aa9-77a554d3c13f" containerName="authorino" containerID="cri-o://df5e098ce94cd94f94108c9ff29b7876e511f41ded96fdd6fb5d3d8efe538a3a" gracePeriod=30 Jun 03 16:45:11.912072 ip-10-0-135-67 kubenswrapper[2568]: I0603 16:45:11.912053 2568 scope.go:117] "RemoveContainer" containerID="0760b9cf2129881ad19831fc51313e646668bfbf580d69e05e35e699bdefd79f" Jun 03 16:45:11.912344 ip-10-0-135-67 kubenswrapper[2568]: E0603 16:45:11.912324 2568 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"0760b9cf2129881ad19831fc51313e646668bfbf580d69e05e35e699bdefd79f\": container with ID starting with 0760b9cf2129881ad19831fc51313e646668bfbf580d69e05e35e699bdefd79f not found: ID does not exist" containerID="0760b9cf2129881ad19831fc51313e646668bfbf580d69e05e35e699bdefd79f" Jun 03 16:45:11.912414 ip-10-0-135-67 kubenswrapper[2568]: I0603 16:45:11.912353 2568 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"0760b9cf2129881ad19831fc51313e646668bfbf580d69e05e35e699bdefd79f"} err="failed to get container status \"0760b9cf2129881ad19831fc51313e646668bfbf580d69e05e35e699bdefd79f\": rpc error: code = NotFound desc = could not find container \"0760b9cf2129881ad19831fc51313e646668bfbf580d69e05e35e699bdefd79f\": container with ID starting with 0760b9cf2129881ad19831fc51313e646668bfbf580d69e05e35e699bdefd79f not found: ID does not exist" Jun 03 16:45:11.922710 ip-10-0-135-67 kubenswrapper[2568]: I0603 16:45:11.922689 2568 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-8b475cf9f-cql4h"] Jun 03 16:45:11.925755 ip-10-0-135-67 kubenswrapper[2568]: I0603 16:45:11.925735 2568 kubelet.go:2547] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/authorino-8b475cf9f-cql4h"] Jun 03 16:45:12.148274 ip-10-0-135-67 kubenswrapper[2568]: I0603 16:45:12.148250 2568 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-56f585f496-9kjcs" Jun 03 16:45:12.175318 ip-10-0-135-67 kubenswrapper[2568]: I0603 16:45:12.175254 2568 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-5jlrz\" (UniqueName: \"kubernetes.io/projected/f0fba173-9819-429d-9aa9-77a554d3c13f-kube-api-access-5jlrz\") pod \"f0fba173-9819-429d-9aa9-77a554d3c13f\" (UID: \"f0fba173-9819-429d-9aa9-77a554d3c13f\") " Jun 03 16:45:12.177217 ip-10-0-135-67 kubenswrapper[2568]: I0603 16:45:12.177194 2568 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/f0fba173-9819-429d-9aa9-77a554d3c13f-kube-api-access-5jlrz" (OuterVolumeSpecName: "kube-api-access-5jlrz") pod "f0fba173-9819-429d-9aa9-77a554d3c13f" (UID: "f0fba173-9819-429d-9aa9-77a554d3c13f"). InnerVolumeSpecName "kube-api-access-5jlrz". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 03 16:45:12.276572 ip-10-0-135-67 kubenswrapper[2568]: I0603 16:45:12.276548 2568 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-5jlrz\" (UniqueName: \"kubernetes.io/projected/f0fba173-9819-429d-9aa9-77a554d3c13f-kube-api-access-5jlrz\") on node \"ip-10-0-135-67.ec2.internal\" DevicePath \"\"" Jun 03 16:45:12.410689 ip-10-0-135-67 kubenswrapper[2568]: I0603 16:45:12.410661 2568 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="ca040277-f7c2-45ce-abf2-730ae89d30ac" path="/var/lib/kubelet/pods/ca040277-f7c2-45ce-abf2-730ae89d30ac/volumes" Jun 03 16:45:12.440944 ip-10-0-135-67 kubenswrapper[2568]: I0603 16:45:12.440860 2568 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-7498df8756-5fbvl"] Jun 03 16:45:12.441135 ip-10-0-135-67 kubenswrapper[2568]: I0603 16:45:12.441113 2568 kuberuntime_container.go:864] "Killing container with a grace period" pod="kuadrant-system/authorino-7498df8756-5fbvl" podUID="2e9089e5-7382-4ac2-83b7-337d79e36568" containerName="authorino" containerID="cri-o://35ed6869f1cc37ac6eee65ff1073472fd1c3d0f7a6c10789ea296b3018cc3f93" gracePeriod=30 Jun 03 16:45:12.677625 ip-10-0-135-67 kubenswrapper[2568]: I0603 16:45:12.677604 2568 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-7498df8756-5fbvl" Jun 03 16:45:12.780544 ip-10-0-135-67 kubenswrapper[2568]: I0603 16:45:12.780513 2568 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-s6clp\" (UniqueName: \"kubernetes.io/projected/2e9089e5-7382-4ac2-83b7-337d79e36568-kube-api-access-s6clp\") pod \"2e9089e5-7382-4ac2-83b7-337d79e36568\" (UID: \"2e9089e5-7382-4ac2-83b7-337d79e36568\") " Jun 03 16:45:12.782506 ip-10-0-135-67 kubenswrapper[2568]: I0603 16:45:12.782479 2568 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/2e9089e5-7382-4ac2-83b7-337d79e36568-kube-api-access-s6clp" (OuterVolumeSpecName: "kube-api-access-s6clp") pod "2e9089e5-7382-4ac2-83b7-337d79e36568" (UID: "2e9089e5-7382-4ac2-83b7-337d79e36568"). InnerVolumeSpecName "kube-api-access-s6clp". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 03 16:45:12.881840 ip-10-0-135-67 kubenswrapper[2568]: I0603 16:45:12.881792 2568 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-s6clp\" (UniqueName: \"kubernetes.io/projected/2e9089e5-7382-4ac2-83b7-337d79e36568-kube-api-access-s6clp\") on node \"ip-10-0-135-67.ec2.internal\" DevicePath \"\"" Jun 03 16:45:12.908859 ip-10-0-135-67 kubenswrapper[2568]: I0603 16:45:12.908822 2568 generic.go:358] "Generic (PLEG): container finished" podID="f0fba173-9819-429d-9aa9-77a554d3c13f" containerID="df5e098ce94cd94f94108c9ff29b7876e511f41ded96fdd6fb5d3d8efe538a3a" exitCode=0 Jun 03 16:45:12.909305 ip-10-0-135-67 kubenswrapper[2568]: I0603 16:45:12.908879 2568 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-56f585f496-9kjcs" Jun 03 16:45:12.909305 ip-10-0-135-67 kubenswrapper[2568]: I0603 16:45:12.908911 2568 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-56f585f496-9kjcs" event={"ID":"f0fba173-9819-429d-9aa9-77a554d3c13f","Type":"ContainerDied","Data":"df5e098ce94cd94f94108c9ff29b7876e511f41ded96fdd6fb5d3d8efe538a3a"} Jun 03 16:45:12.909305 ip-10-0-135-67 kubenswrapper[2568]: I0603 16:45:12.908953 2568 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-56f585f496-9kjcs" event={"ID":"f0fba173-9819-429d-9aa9-77a554d3c13f","Type":"ContainerDied","Data":"a95b890a6eb7c130991215ff7ad91e95c71c425e9abfb4e7135bdb74bc359599"} Jun 03 16:45:12.909305 ip-10-0-135-67 kubenswrapper[2568]: I0603 16:45:12.908973 2568 scope.go:117] "RemoveContainer" containerID="df5e098ce94cd94f94108c9ff29b7876e511f41ded96fdd6fb5d3d8efe538a3a" Jun 03 16:45:12.910230 ip-10-0-135-67 kubenswrapper[2568]: I0603 16:45:12.910203 2568 generic.go:358] "Generic (PLEG): container finished" podID="2e9089e5-7382-4ac2-83b7-337d79e36568" containerID="35ed6869f1cc37ac6eee65ff1073472fd1c3d0f7a6c10789ea296b3018cc3f93" exitCode=0 Jun 03 16:45:12.910304 ip-10-0-135-67 kubenswrapper[2568]: I0603 16:45:12.910264 2568 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-7498df8756-5fbvl" Jun 03 16:45:12.910304 ip-10-0-135-67 kubenswrapper[2568]: I0603 16:45:12.910285 2568 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-7498df8756-5fbvl" event={"ID":"2e9089e5-7382-4ac2-83b7-337d79e36568","Type":"ContainerDied","Data":"35ed6869f1cc37ac6eee65ff1073472fd1c3d0f7a6c10789ea296b3018cc3f93"} Jun 03 16:45:12.910399 ip-10-0-135-67 kubenswrapper[2568]: I0603 16:45:12.910319 2568 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-7498df8756-5fbvl" event={"ID":"2e9089e5-7382-4ac2-83b7-337d79e36568","Type":"ContainerDied","Data":"643dc5944e901b403b67182442eaa9ba047a3f587dbe67b1783aa0ccc96e61a6"} Jun 03 16:45:12.924403 ip-10-0-135-67 kubenswrapper[2568]: I0603 16:45:12.924381 2568 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-56f585f496-9kjcs"] Jun 03 16:45:12.927968 ip-10-0-135-67 kubenswrapper[2568]: I0603 16:45:12.927944 2568 kubelet.go:2547] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/authorino-56f585f496-9kjcs"] Jun 03 16:45:12.928327 ip-10-0-135-67 kubenswrapper[2568]: I0603 16:45:12.928305 2568 scope.go:117] "RemoveContainer" containerID="df5e098ce94cd94f94108c9ff29b7876e511f41ded96fdd6fb5d3d8efe538a3a" Jun 03 16:45:12.928571 ip-10-0-135-67 kubenswrapper[2568]: E0603 16:45:12.928553 2568 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"df5e098ce94cd94f94108c9ff29b7876e511f41ded96fdd6fb5d3d8efe538a3a\": container with ID starting with df5e098ce94cd94f94108c9ff29b7876e511f41ded96fdd6fb5d3d8efe538a3a not found: ID does not exist" containerID="df5e098ce94cd94f94108c9ff29b7876e511f41ded96fdd6fb5d3d8efe538a3a" Jun 03 16:45:12.928620 ip-10-0-135-67 kubenswrapper[2568]: I0603 16:45:12.928580 2568 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"df5e098ce94cd94f94108c9ff29b7876e511f41ded96fdd6fb5d3d8efe538a3a"} err="failed to get container status \"df5e098ce94cd94f94108c9ff29b7876e511f41ded96fdd6fb5d3d8efe538a3a\": rpc error: code = NotFound desc = could not find container \"df5e098ce94cd94f94108c9ff29b7876e511f41ded96fdd6fb5d3d8efe538a3a\": container with ID starting with df5e098ce94cd94f94108c9ff29b7876e511f41ded96fdd6fb5d3d8efe538a3a not found: ID does not exist" Jun 03 16:45:12.928620 ip-10-0-135-67 kubenswrapper[2568]: I0603 16:45:12.928597 2568 scope.go:117] "RemoveContainer" containerID="35ed6869f1cc37ac6eee65ff1073472fd1c3d0f7a6c10789ea296b3018cc3f93" Jun 03 16:45:12.936497 ip-10-0-135-67 kubenswrapper[2568]: I0603 16:45:12.936476 2568 scope.go:117] "RemoveContainer" containerID="35ed6869f1cc37ac6eee65ff1073472fd1c3d0f7a6c10789ea296b3018cc3f93" Jun 03 16:45:12.936750 ip-10-0-135-67 kubenswrapper[2568]: E0603 16:45:12.936733 2568 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"35ed6869f1cc37ac6eee65ff1073472fd1c3d0f7a6c10789ea296b3018cc3f93\": container with ID starting with 35ed6869f1cc37ac6eee65ff1073472fd1c3d0f7a6c10789ea296b3018cc3f93 not found: ID does not exist" containerID="35ed6869f1cc37ac6eee65ff1073472fd1c3d0f7a6c10789ea296b3018cc3f93" Jun 03 16:45:12.936750 ip-10-0-135-67 kubenswrapper[2568]: I0603 16:45:12.936743 2568 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-7498df8756-5fbvl"] Jun 03 16:45:12.936825 ip-10-0-135-67 kubenswrapper[2568]: I0603 16:45:12.936757 2568 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"35ed6869f1cc37ac6eee65ff1073472fd1c3d0f7a6c10789ea296b3018cc3f93"} err="failed to get container status \"35ed6869f1cc37ac6eee65ff1073472fd1c3d0f7a6c10789ea296b3018cc3f93\": rpc error: code = NotFound desc = could not find container \"35ed6869f1cc37ac6eee65ff1073472fd1c3d0f7a6c10789ea296b3018cc3f93\": container with ID starting with 35ed6869f1cc37ac6eee65ff1073472fd1c3d0f7a6c10789ea296b3018cc3f93 not found: ID does not exist" Jun 03 16:45:12.941587 ip-10-0-135-67 kubenswrapper[2568]: I0603 16:45:12.941568 2568 kubelet.go:2547] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/authorino-7498df8756-5fbvl"] Jun 03 16:45:14.411127 ip-10-0-135-67 kubenswrapper[2568]: I0603 16:45:14.411097 2568 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="2e9089e5-7382-4ac2-83b7-337d79e36568" path="/var/lib/kubelet/pods/2e9089e5-7382-4ac2-83b7-337d79e36568/volumes" Jun 03 16:45:14.411517 ip-10-0-135-67 kubenswrapper[2568]: I0603 16:45:14.411438 2568 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="f0fba173-9819-429d-9aa9-77a554d3c13f" path="/var/lib/kubelet/pods/f0fba173-9819-429d-9aa9-77a554d3c13f/volumes" Jun 03 16:45:15.911320 ip-10-0-135-67 kubenswrapper[2568]: I0603 16:45:15.911283 2568 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["opendatahub/maas-controller-585f56b77d-tvgvz"] Jun 03 16:45:15.911683 ip-10-0-135-67 kubenswrapper[2568]: I0603 16:45:15.911676 2568 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="f0fba173-9819-429d-9aa9-77a554d3c13f" containerName="authorino" Jun 03 16:45:15.911726 ip-10-0-135-67 kubenswrapper[2568]: I0603 16:45:15.911688 2568 state_mem.go:107] "Deleted CPUSet assignment" podUID="f0fba173-9819-429d-9aa9-77a554d3c13f" containerName="authorino" Jun 03 16:45:15.911726 ip-10-0-135-67 kubenswrapper[2568]: I0603 16:45:15.911704 2568 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="ca040277-f7c2-45ce-abf2-730ae89d30ac" containerName="authorino" Jun 03 16:45:15.911726 ip-10-0-135-67 kubenswrapper[2568]: I0603 16:45:15.911711 2568 state_mem.go:107] "Deleted CPUSet assignment" podUID="ca040277-f7c2-45ce-abf2-730ae89d30ac" containerName="authorino" Jun 03 16:45:15.911726 ip-10-0-135-67 kubenswrapper[2568]: I0603 16:45:15.911725 2568 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="2e9089e5-7382-4ac2-83b7-337d79e36568" containerName="authorino" Jun 03 16:45:15.911847 ip-10-0-135-67 kubenswrapper[2568]: I0603 16:45:15.911732 2568 state_mem.go:107] "Deleted CPUSet assignment" podUID="2e9089e5-7382-4ac2-83b7-337d79e36568" containerName="authorino" Jun 03 16:45:15.911847 ip-10-0-135-67 kubenswrapper[2568]: I0603 16:45:15.911791 2568 memory_manager.go:356] "RemoveStaleState removing state" podUID="ca040277-f7c2-45ce-abf2-730ae89d30ac" containerName="authorino" Jun 03 16:45:15.911847 ip-10-0-135-67 kubenswrapper[2568]: I0603 16:45:15.911800 2568 memory_manager.go:356] "RemoveStaleState removing state" podUID="2e9089e5-7382-4ac2-83b7-337d79e36568" containerName="authorino" Jun 03 16:45:15.911847 ip-10-0-135-67 kubenswrapper[2568]: I0603 16:45:15.911808 2568 memory_manager.go:356] "RemoveStaleState removing state" podUID="f0fba173-9819-429d-9aa9-77a554d3c13f" containerName="authorino" Jun 03 16:45:15.914718 ip-10-0-135-67 kubenswrapper[2568]: I0603 16:45:15.914700 2568 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-585f56b77d-tvgvz" Jun 03 16:45:15.916977 ip-10-0-135-67 kubenswrapper[2568]: I0603 16:45:15.916953 2568 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"maas-controller-dockercfg-vpkcd\"" Jun 03 16:45:15.917101 ip-10-0-135-67 kubenswrapper[2568]: I0603 16:45:15.916954 2568 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"maas-parameters\"" Jun 03 16:45:15.924468 ip-10-0-135-67 kubenswrapper[2568]: I0603 16:45:15.923934 2568 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-controller-585f56b77d-tvgvz"] Jun 03 16:45:16.007974 ip-10-0-135-67 kubenswrapper[2568]: I0603 16:45:16.007938 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-qxvtb\" (UniqueName: \"kubernetes.io/projected/85fe1aa7-d873-4b8b-a6c7-05eb186a0cab-kube-api-access-qxvtb\") pod \"maas-controller-585f56b77d-tvgvz\" (UID: \"85fe1aa7-d873-4b8b-a6c7-05eb186a0cab\") " pod="opendatahub/maas-controller-585f56b77d-tvgvz" Jun 03 16:45:16.106337 ip-10-0-135-67 kubenswrapper[2568]: I0603 16:45:16.106300 2568 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["opendatahub/maas-controller-58995fd7b7-9qk6w"] Jun 03 16:45:16.108734 ip-10-0-135-67 kubenswrapper[2568]: I0603 16:45:16.108718 2568 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-58995fd7b7-9qk6w" Jun 03 16:45:16.109017 ip-10-0-135-67 kubenswrapper[2568]: I0603 16:45:16.108980 2568 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-qxvtb\" (UniqueName: \"kubernetes.io/projected/85fe1aa7-d873-4b8b-a6c7-05eb186a0cab-kube-api-access-qxvtb\") pod \"maas-controller-585f56b77d-tvgvz\" (UID: \"85fe1aa7-d873-4b8b-a6c7-05eb186a0cab\") " pod="opendatahub/maas-controller-585f56b77d-tvgvz" Jun 03 16:45:16.125380 ip-10-0-135-67 kubenswrapper[2568]: I0603 16:45:16.125348 2568 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-controller-58995fd7b7-9qk6w"] Jun 03 16:45:16.127988 ip-10-0-135-67 kubenswrapper[2568]: I0603 16:45:16.127963 2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-qxvtb\" (UniqueName: \"kubernetes.io/projected/85fe1aa7-d873-4b8b-a6c7-05eb186a0cab-kube-api-access-qxvtb\") pod \"maas-controller-585f56b77d-tvgvz\" (UID: \"85fe1aa7-d873-4b8b-a6c7-05eb186a0cab\") " pod="opendatahub/maas-controller-585f56b77d-tvgvz" Jun 03 16:45:16.209765 ip-10-0-135-67 kubenswrapper[2568]: I0603 16:45:16.209696 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-m2kgn\" (UniqueName: \"kubernetes.io/projected/ab4a0f7f-cce9-4270-86f8-78bd0a18e078-kube-api-access-m2kgn\") pod \"maas-controller-58995fd7b7-9qk6w\" (UID: \"ab4a0f7f-cce9-4270-86f8-78bd0a18e078\") " pod="opendatahub/maas-controller-58995fd7b7-9qk6w" Jun 03 16:45:16.230732 ip-10-0-135-67 kubenswrapper[2568]: I0603 16:45:16.230706 2568 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-585f56b77d-tvgvz" Jun 03 16:45:16.311726 ip-10-0-135-67 kubenswrapper[2568]: I0603 16:45:16.310851 2568 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-m2kgn\" (UniqueName: \"kubernetes.io/projected/ab4a0f7f-cce9-4270-86f8-78bd0a18e078-kube-api-access-m2kgn\") pod \"maas-controller-58995fd7b7-9qk6w\" (UID: \"ab4a0f7f-cce9-4270-86f8-78bd0a18e078\") " pod="opendatahub/maas-controller-58995fd7b7-9qk6w" Jun 03 16:45:16.318923 ip-10-0-135-67 kubenswrapper[2568]: I0603 16:45:16.318888 2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-m2kgn\" (UniqueName: \"kubernetes.io/projected/ab4a0f7f-cce9-4270-86f8-78bd0a18e078-kube-api-access-m2kgn\") pod \"maas-controller-58995fd7b7-9qk6w\" (UID: \"ab4a0f7f-cce9-4270-86f8-78bd0a18e078\") " pod="opendatahub/maas-controller-58995fd7b7-9qk6w" Jun 03 16:45:16.360898 ip-10-0-135-67 kubenswrapper[2568]: I0603 16:45:16.360872 2568 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-controller-585f56b77d-tvgvz"] Jun 03 16:45:16.362399 ip-10-0-135-67 kubenswrapper[2568]: W0603 16:45:16.362367 2568 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod85fe1aa7_d873_4b8b_a6c7_05eb186a0cab.slice/crio-b382141433eb6d580a5d5db570e31e06eff5f8b36e504665eeaa5b0c96392073 WatchSource:0}: Error finding container b382141433eb6d580a5d5db570e31e06eff5f8b36e504665eeaa5b0c96392073: Status 404 returned error can't find the container with id b382141433eb6d580a5d5db570e31e06eff5f8b36e504665eeaa5b0c96392073 Jun 03 16:45:16.418625 ip-10-0-135-67 kubenswrapper[2568]: I0603 16:45:16.418600 2568 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-58995fd7b7-9qk6w" Jun 03 16:45:16.545090 ip-10-0-135-67 kubenswrapper[2568]: I0603 16:45:16.545066 2568 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-controller-58995fd7b7-9qk6w"] Jun 03 16:45:16.546628 ip-10-0-135-67 kubenswrapper[2568]: W0603 16:45:16.546596 2568 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podab4a0f7f_cce9_4270_86f8_78bd0a18e078.slice/crio-6c2bc7c9cd97998bcfb978cbde6dd27ffc31d0a72515adc375875b39747f27a1 WatchSource:0}: Error finding container 6c2bc7c9cd97998bcfb978cbde6dd27ffc31d0a72515adc375875b39747f27a1: Status 404 returned error can't find the container with id 6c2bc7c9cd97998bcfb978cbde6dd27ffc31d0a72515adc375875b39747f27a1 Jun 03 16:45:16.931309 ip-10-0-135-67 kubenswrapper[2568]: I0603 16:45:16.931270 2568 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-58995fd7b7-9qk6w" event={"ID":"ab4a0f7f-cce9-4270-86f8-78bd0a18e078","Type":"ContainerStarted","Data":"6c2bc7c9cd97998bcfb978cbde6dd27ffc31d0a72515adc375875b39747f27a1"} Jun 03 16:45:16.932205 ip-10-0-135-67 kubenswrapper[2568]: I0603 16:45:16.932182 2568 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-585f56b77d-tvgvz" event={"ID":"85fe1aa7-d873-4b8b-a6c7-05eb186a0cab","Type":"ContainerStarted","Data":"b382141433eb6d580a5d5db570e31e06eff5f8b36e504665eeaa5b0c96392073"} Jun 03 16:45:19.946703 ip-10-0-135-67 kubenswrapper[2568]: I0603 16:45:19.946666 2568 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-58995fd7b7-9qk6w" event={"ID":"ab4a0f7f-cce9-4270-86f8-78bd0a18e078","Type":"ContainerStarted","Data":"6dcc306784c099af5c3f60170cd453dfc9e6f4bf3bf52b7d4a9757ae89735872"} Jun 03 16:45:19.950628 ip-10-0-135-67 kubenswrapper[2568]: I0603 16:45:19.947521 2568 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/maas-controller-58995fd7b7-9qk6w" Jun 03 16:45:19.955053 ip-10-0-135-67 kubenswrapper[2568]: I0603 16:45:19.955025 2568 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-585f56b77d-tvgvz" event={"ID":"85fe1aa7-d873-4b8b-a6c7-05eb186a0cab","Type":"ContainerStarted","Data":"148faeb7da62b8ad51bd7bea1a9f68ac172b4b86cec647f9e0b04f2a4edc64ad"} Jun 03 16:45:19.955200 ip-10-0-135-67 kubenswrapper[2568]: I0603 16:45:19.955118 2568 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/maas-controller-585f56b77d-tvgvz" Jun 03 16:45:19.966880 ip-10-0-135-67 kubenswrapper[2568]: I0603 16:45:19.966831 2568 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="opendatahub/maas-controller-58995fd7b7-9qk6w" podStartSLOduration=1.404419503 podStartE2EDuration="3.966819557s" podCreationTimestamp="2026-06-03 16:45:16 +0000 UTC" firstStartedPulling="2026-06-03 16:45:16.547997863 +0000 UTC m=+688.690172495" lastFinishedPulling="2026-06-03 16:45:19.110397914 +0000 UTC m=+691.252572549" observedRunningTime="2026-06-03 16:45:19.965641136 +0000 UTC m=+692.107815791" watchObservedRunningTime="2026-06-03 16:45:19.966819557 +0000 UTC m=+692.108994211" Jun 03 16:45:19.979472 ip-10-0-135-67 kubenswrapper[2568]: I0603 16:45:19.979438 2568 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="opendatahub/maas-controller-585f56b77d-tvgvz" podStartSLOduration=2.242943685 podStartE2EDuration="4.979422658s" podCreationTimestamp="2026-06-03 16:45:15 +0000 UTC" firstStartedPulling="2026-06-03 16:45:16.363652641 +0000 UTC m=+688.505827274" lastFinishedPulling="2026-06-03 16:45:19.100131611 +0000 UTC m=+691.242306247" observedRunningTime="2026-06-03 16:45:19.97862798 +0000 UTC m=+692.120802636" watchObservedRunningTime="2026-06-03 16:45:19.979422658 +0000 UTC m=+692.121597313" Jun 03 16:45:30.965363 ip-10-0-135-67 kubenswrapper[2568]: I0603 16:45:30.965332 2568 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/maas-controller-585f56b77d-tvgvz" Jun 03 16:45:30.965719 ip-10-0-135-67 kubenswrapper[2568]: I0603 16:45:30.965576 2568 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/maas-controller-58995fd7b7-9qk6w" Jun 03 16:45:31.025876 ip-10-0-135-67 kubenswrapper[2568]: I0603 16:45:31.025844 2568 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["opendatahub/maas-controller-585f56b77d-tvgvz"] Jun 03 16:45:31.026111 ip-10-0-135-67 kubenswrapper[2568]: I0603 16:45:31.026078 2568 kuberuntime_container.go:864] "Killing container with a grace period" pod="opendatahub/maas-controller-585f56b77d-tvgvz" podUID="85fe1aa7-d873-4b8b-a6c7-05eb186a0cab" containerName="manager" containerID="cri-o://148faeb7da62b8ad51bd7bea1a9f68ac172b4b86cec647f9e0b04f2a4edc64ad" gracePeriod=30 Jun 03 16:45:31.269028 ip-10-0-135-67 kubenswrapper[2568]: I0603 16:45:31.268985 2568 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-585f56b77d-tvgvz" Jun 03 16:45:31.328915 ip-10-0-135-67 kubenswrapper[2568]: I0603 16:45:31.328888 2568 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-qxvtb\" (UniqueName: \"kubernetes.io/projected/85fe1aa7-d873-4b8b-a6c7-05eb186a0cab-kube-api-access-qxvtb\") pod \"85fe1aa7-d873-4b8b-a6c7-05eb186a0cab\" (UID: \"85fe1aa7-d873-4b8b-a6c7-05eb186a0cab\") " Jun 03 16:45:31.330957 ip-10-0-135-67 kubenswrapper[2568]: I0603 16:45:31.330924 2568 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/85fe1aa7-d873-4b8b-a6c7-05eb186a0cab-kube-api-access-qxvtb" (OuterVolumeSpecName: "kube-api-access-qxvtb") pod "85fe1aa7-d873-4b8b-a6c7-05eb186a0cab" (UID: "85fe1aa7-d873-4b8b-a6c7-05eb186a0cab"). InnerVolumeSpecName "kube-api-access-qxvtb". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 03 16:45:31.429482 ip-10-0-135-67 kubenswrapper[2568]: I0603 16:45:31.429454 2568 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-qxvtb\" (UniqueName: \"kubernetes.io/projected/85fe1aa7-d873-4b8b-a6c7-05eb186a0cab-kube-api-access-qxvtb\") on node \"ip-10-0-135-67.ec2.internal\" DevicePath \"\"" Jun 03 16:45:32.005209 ip-10-0-135-67 kubenswrapper[2568]: I0603 16:45:32.005176 2568 generic.go:358] "Generic (PLEG): container finished" podID="85fe1aa7-d873-4b8b-a6c7-05eb186a0cab" containerID="148faeb7da62b8ad51bd7bea1a9f68ac172b4b86cec647f9e0b04f2a4edc64ad" exitCode=0 Jun 03 16:45:32.005603 ip-10-0-135-67 kubenswrapper[2568]: I0603 16:45:32.005249 2568 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-585f56b77d-tvgvz" Jun 03 16:45:32.005603 ip-10-0-135-67 kubenswrapper[2568]: I0603 16:45:32.005262 2568 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-585f56b77d-tvgvz" event={"ID":"85fe1aa7-d873-4b8b-a6c7-05eb186a0cab","Type":"ContainerDied","Data":"148faeb7da62b8ad51bd7bea1a9f68ac172b4b86cec647f9e0b04f2a4edc64ad"} Jun 03 16:45:32.005603 ip-10-0-135-67 kubenswrapper[2568]: I0603 16:45:32.005302 2568 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-585f56b77d-tvgvz" event={"ID":"85fe1aa7-d873-4b8b-a6c7-05eb186a0cab","Type":"ContainerDied","Data":"b382141433eb6d580a5d5db570e31e06eff5f8b36e504665eeaa5b0c96392073"} Jun 03 16:45:32.005603 ip-10-0-135-67 kubenswrapper[2568]: I0603 16:45:32.005325 2568 scope.go:117] "RemoveContainer" containerID="148faeb7da62b8ad51bd7bea1a9f68ac172b4b86cec647f9e0b04f2a4edc64ad" Jun 03 16:45:32.014935 ip-10-0-135-67 kubenswrapper[2568]: I0603 16:45:32.014917 2568 scope.go:117] "RemoveContainer" containerID="148faeb7da62b8ad51bd7bea1a9f68ac172b4b86cec647f9e0b04f2a4edc64ad" Jun 03 16:45:32.015204 ip-10-0-135-67 kubenswrapper[2568]: E0603 16:45:32.015186 2568 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"148faeb7da62b8ad51bd7bea1a9f68ac172b4b86cec647f9e0b04f2a4edc64ad\": container with ID starting with 148faeb7da62b8ad51bd7bea1a9f68ac172b4b86cec647f9e0b04f2a4edc64ad not found: ID does not exist" containerID="148faeb7da62b8ad51bd7bea1a9f68ac172b4b86cec647f9e0b04f2a4edc64ad" Jun 03 16:45:32.015280 ip-10-0-135-67 kubenswrapper[2568]: I0603 16:45:32.015220 2568 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"148faeb7da62b8ad51bd7bea1a9f68ac172b4b86cec647f9e0b04f2a4edc64ad"} err="failed to get container status \"148faeb7da62b8ad51bd7bea1a9f68ac172b4b86cec647f9e0b04f2a4edc64ad\": rpc error: code = NotFound desc = could not find container \"148faeb7da62b8ad51bd7bea1a9f68ac172b4b86cec647f9e0b04f2a4edc64ad\": container with ID starting with 148faeb7da62b8ad51bd7bea1a9f68ac172b4b86cec647f9e0b04f2a4edc64ad not found: ID does not exist" Jun 03 16:45:32.026085 ip-10-0-135-67 kubenswrapper[2568]: I0603 16:45:32.026062 2568 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["opendatahub/maas-controller-585f56b77d-tvgvz"] Jun 03 16:45:32.030079 ip-10-0-135-67 kubenswrapper[2568]: I0603 16:45:32.030059 2568 kubelet.go:2547] "SyncLoop REMOVE" source="api" pods=["opendatahub/maas-controller-585f56b77d-tvgvz"] Jun 03 16:45:32.410917 ip-10-0-135-67 kubenswrapper[2568]: I0603 16:45:32.410838 2568 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="85fe1aa7-d873-4b8b-a6c7-05eb186a0cab" path="/var/lib/kubelet/pods/85fe1aa7-d873-4b8b-a6c7-05eb186a0cab/volumes" Jun 03 16:45:48.603639 ip-10-0-135-67 kubenswrapper[2568]: I0603 16:45:48.603565 2568 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["opendatahub/maas-api-88d68d59f-9ktbl"] Jun 03 16:45:48.604157 ip-10-0-135-67 kubenswrapper[2568]: I0603 16:45:48.604141 2568 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="85fe1aa7-d873-4b8b-a6c7-05eb186a0cab" containerName="manager" Jun 03 16:45:48.604206 ip-10-0-135-67 kubenswrapper[2568]: I0603 16:45:48.604160 2568 state_mem.go:107] "Deleted CPUSet assignment" podUID="85fe1aa7-d873-4b8b-a6c7-05eb186a0cab" containerName="manager" Jun 03 16:45:48.604263 ip-10-0-135-67 kubenswrapper[2568]: I0603 16:45:48.604253 2568 memory_manager.go:356] "RemoveStaleState removing state" podUID="85fe1aa7-d873-4b8b-a6c7-05eb186a0cab" containerName="manager" Jun 03 16:45:48.609072 ip-10-0-135-67 kubenswrapper[2568]: I0603 16:45:48.609050 2568 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-api-88d68d59f-9ktbl" Jun 03 16:45:48.610983 ip-10-0-135-67 kubenswrapper[2568]: I0603 16:45:48.610958 2568 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"maas-api-serving-cert\"" Jun 03 16:45:48.611130 ip-10-0-135-67 kubenswrapper[2568]: I0603 16:45:48.611071 2568 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"maas-api-dockercfg-gw9rr\"" Jun 03 16:45:48.616155 ip-10-0-135-67 kubenswrapper[2568]: I0603 16:45:48.616130 2568 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-api-88d68d59f-9ktbl"] Jun 03 16:45:48.769468 ip-10-0-135-67 kubenswrapper[2568]: I0603 16:45:48.769437 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/6e22e7ea-573c-469e-9c33-45efe4d6880b-maas-api-tls\") pod \"maas-api-88d68d59f-9ktbl\" (UID: \"6e22e7ea-573c-469e-9c33-45efe4d6880b\") " pod="opendatahub/maas-api-88d68d59f-9ktbl" Jun 03 16:45:48.769611 ip-10-0-135-67 kubenswrapper[2568]: I0603 16:45:48.769521 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-htpm6\" (UniqueName: \"kubernetes.io/projected/6e22e7ea-573c-469e-9c33-45efe4d6880b-kube-api-access-htpm6\") pod \"maas-api-88d68d59f-9ktbl\" (UID: \"6e22e7ea-573c-469e-9c33-45efe4d6880b\") " pod="opendatahub/maas-api-88d68d59f-9ktbl" Jun 03 16:45:48.870887 ip-10-0-135-67 kubenswrapper[2568]: I0603 16:45:48.870806 2568 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-htpm6\" (UniqueName: \"kubernetes.io/projected/6e22e7ea-573c-469e-9c33-45efe4d6880b-kube-api-access-htpm6\") pod \"maas-api-88d68d59f-9ktbl\" (UID: \"6e22e7ea-573c-469e-9c33-45efe4d6880b\") " pod="opendatahub/maas-api-88d68d59f-9ktbl" Jun 03 16:45:48.870887 ip-10-0-135-67 kubenswrapper[2568]: I0603 16:45:48.870865 2568 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/6e22e7ea-573c-469e-9c33-45efe4d6880b-maas-api-tls\") pod \"maas-api-88d68d59f-9ktbl\" (UID: \"6e22e7ea-573c-469e-9c33-45efe4d6880b\") " pod="opendatahub/maas-api-88d68d59f-9ktbl" Jun 03 16:45:48.873337 ip-10-0-135-67 kubenswrapper[2568]: I0603 16:45:48.873315 2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/6e22e7ea-573c-469e-9c33-45efe4d6880b-maas-api-tls\") pod \"maas-api-88d68d59f-9ktbl\" (UID: \"6e22e7ea-573c-469e-9c33-45efe4d6880b\") " pod="opendatahub/maas-api-88d68d59f-9ktbl" Jun 03 16:45:48.878342 ip-10-0-135-67 kubenswrapper[2568]: I0603 16:45:48.878317 2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-htpm6\" (UniqueName: \"kubernetes.io/projected/6e22e7ea-573c-469e-9c33-45efe4d6880b-kube-api-access-htpm6\") pod \"maas-api-88d68d59f-9ktbl\" (UID: \"6e22e7ea-573c-469e-9c33-45efe4d6880b\") " pod="opendatahub/maas-api-88d68d59f-9ktbl" Jun 03 16:45:48.921802 ip-10-0-135-67 kubenswrapper[2568]: I0603 16:45:48.921777 2568 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-api-88d68d59f-9ktbl" Jun 03 16:45:49.059050 ip-10-0-135-67 kubenswrapper[2568]: I0603 16:45:49.059020 2568 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-api-88d68d59f-9ktbl"] Jun 03 16:45:49.061030 ip-10-0-135-67 kubenswrapper[2568]: W0603 16:45:49.060986 2568 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod6e22e7ea_573c_469e_9c33_45efe4d6880b.slice/crio-37e0d7a094a05cfb50ac5ff93108ad38634ceb70590d1a0863e6df519a192d8b WatchSource:0}: Error finding container 37e0d7a094a05cfb50ac5ff93108ad38634ceb70590d1a0863e6df519a192d8b: Status 404 returned error can't find the container with id 37e0d7a094a05cfb50ac5ff93108ad38634ceb70590d1a0863e6df519a192d8b Jun 03 16:45:49.083932 ip-10-0-135-67 kubenswrapper[2568]: I0603 16:45:49.083900 2568 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-api-88d68d59f-9ktbl" event={"ID":"6e22e7ea-573c-469e-9c33-45efe4d6880b","Type":"ContainerStarted","Data":"37e0d7a094a05cfb50ac5ff93108ad38634ceb70590d1a0863e6df519a192d8b"} Jun 03 16:45:49.135447 ip-10-0-135-67 kubenswrapper[2568]: I0603 16:45:49.135383 2568 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-processing-58b6c8fdc7-t2g4x"] Jun 03 16:45:49.140087 ip-10-0-135-67 kubenswrapper[2568]: I0603 16:45:49.140068 2568 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-58b6c8fdc7-t2g4x" Jun 03 16:45:49.142074 ip-10-0-135-67 kubenswrapper[2568]: I0603 16:45:49.142049 2568 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"payload-processing-plugins\"" Jun 03 16:45:49.142173 ip-10-0-135-67 kubenswrapper[2568]: I0603 16:45:49.142049 2568 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"payload-processing-dockercfg-frndt\"" Jun 03 16:45:49.145722 ip-10-0-135-67 kubenswrapper[2568]: I0603 16:45:49.145703 2568 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-58b6c8fdc7-t2g4x"] Jun 03 16:45:49.249978 ip-10-0-135-67 kubenswrapper[2568]: I0603 16:45:49.249948 2568 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-jmf7m"] Jun 03 16:45:49.274756 ip-10-0-135-67 kubenswrapper[2568]: I0603 16:45:49.274714 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-bmlf6\" (UniqueName: \"kubernetes.io/projected/274dd9b3-ebd9-49fc-8b15-26367deba2df-kube-api-access-bmlf6\") pod \"payload-processing-58b6c8fdc7-t2g4x\" (UID: \"274dd9b3-ebd9-49fc-8b15-26367deba2df\") " pod="openshift-ingress/payload-processing-58b6c8fdc7-t2g4x" Jun 03 16:45:49.375367 ip-10-0-135-67 kubenswrapper[2568]: I0603 16:45:49.375342 2568 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-bmlf6\" (UniqueName: \"kubernetes.io/projected/274dd9b3-ebd9-49fc-8b15-26367deba2df-kube-api-access-bmlf6\") pod \"payload-processing-58b6c8fdc7-t2g4x\" (UID: \"274dd9b3-ebd9-49fc-8b15-26367deba2df\") " pod="openshift-ingress/payload-processing-58b6c8fdc7-t2g4x" Jun 03 16:45:49.382482 ip-10-0-135-67 kubenswrapper[2568]: I0603 16:45:49.382456 2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-bmlf6\" (UniqueName: \"kubernetes.io/projected/274dd9b3-ebd9-49fc-8b15-26367deba2df-kube-api-access-bmlf6\") pod \"payload-processing-58b6c8fdc7-t2g4x\" (UID: \"274dd9b3-ebd9-49fc-8b15-26367deba2df\") " pod="openshift-ingress/payload-processing-58b6c8fdc7-t2g4x" Jun 03 16:45:49.451111 ip-10-0-135-67 kubenswrapper[2568]: I0603 16:45:49.451051 2568 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-58b6c8fdc7-t2g4x" Jun 03 16:45:49.577340 ip-10-0-135-67 kubenswrapper[2568]: I0603 16:45:49.577307 2568 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-58b6c8fdc7-t2g4x"] Jun 03 16:45:49.580509 ip-10-0-135-67 kubenswrapper[2568]: W0603 16:45:49.580457 2568 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod274dd9b3_ebd9_49fc_8b15_26367deba2df.slice/crio-5cbb75674e997d944b67949dc3500e2254e558cdf72f8c27367d33de60884e73 WatchSource:0}: Error finding container 5cbb75674e997d944b67949dc3500e2254e558cdf72f8c27367d33de60884e73: Status 404 returned error can't find the container with id 5cbb75674e997d944b67949dc3500e2254e558cdf72f8c27367d33de60884e73 Jun 03 16:45:50.088485 ip-10-0-135-67 kubenswrapper[2568]: I0603 16:45:50.088449 2568 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-58b6c8fdc7-t2g4x" event={"ID":"274dd9b3-ebd9-49fc-8b15-26367deba2df","Type":"ContainerStarted","Data":"5cbb75674e997d944b67949dc3500e2254e558cdf72f8c27367d33de60884e73"} Jun 03 16:45:51.094444 ip-10-0-135-67 kubenswrapper[2568]: I0603 16:45:51.094405 2568 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-api-88d68d59f-9ktbl" event={"ID":"6e22e7ea-573c-469e-9c33-45efe4d6880b","Type":"ContainerStarted","Data":"6f37198425ac8dbe0a142b92a2b6a418919a63f4f7f571cafc2f44ec9ad80ecb"} Jun 03 16:45:51.094894 ip-10-0-135-67 kubenswrapper[2568]: I0603 16:45:51.094576 2568 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/maas-api-88d68d59f-9ktbl" Jun 03 16:45:51.109224 ip-10-0-135-67 kubenswrapper[2568]: I0603 16:45:51.109171 2568 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="opendatahub/maas-api-88d68d59f-9ktbl" podStartSLOduration=1.468414446 podStartE2EDuration="3.109154608s" podCreationTimestamp="2026-06-03 16:45:48 +0000 UTC" firstStartedPulling="2026-06-03 16:45:49.062719711 +0000 UTC m=+721.204894344" lastFinishedPulling="2026-06-03 16:45:50.703459867 +0000 UTC m=+722.845634506" observedRunningTime="2026-06-03 16:45:51.108113546 +0000 UTC m=+723.250288190" watchObservedRunningTime="2026-06-03 16:45:51.109154608 +0000 UTC m=+723.251329263" Jun 03 16:45:52.100130 ip-10-0-135-67 kubenswrapper[2568]: I0603 16:45:52.100092 2568 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-58b6c8fdc7-t2g4x" event={"ID":"274dd9b3-ebd9-49fc-8b15-26367deba2df","Type":"ContainerStarted","Data":"3fb2aa082ff7dcec10b2160e459d2342e16df3af706a283b9dcf12e43c6882a4"} Jun 03 16:45:52.100503 ip-10-0-135-67 kubenswrapper[2568]: I0603 16:45:52.100166 2568 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-processing-58b6c8fdc7-t2g4x" Jun 03 16:45:52.115173 ip-10-0-135-67 kubenswrapper[2568]: I0603 16:45:52.115129 2568 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-ingress/payload-processing-58b6c8fdc7-t2g4x" podStartSLOduration=0.823127271 podStartE2EDuration="3.115114749s" podCreationTimestamp="2026-06-03 16:45:49 +0000 UTC" firstStartedPulling="2026-06-03 16:45:49.582647976 +0000 UTC m=+721.724822607" lastFinishedPulling="2026-06-03 16:45:51.874635448 +0000 UTC m=+724.016810085" observedRunningTime="2026-06-03 16:45:52.113569057 +0000 UTC m=+724.255743712" watchObservedRunningTime="2026-06-03 16:45:52.115114749 +0000 UTC m=+724.257289403" Jun 03 16:45:57.105843 ip-10-0-135-67 kubenswrapper[2568]: I0603 16:45:57.105814 2568 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/maas-api-88d68d59f-9ktbl" Jun 03 16:46:03.106350 ip-10-0-135-67 kubenswrapper[2568]: I0603 16:46:03.106316 2568 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-processing-58b6c8fdc7-t2g4x" Jun 03 16:46:36.621860 ip-10-0-135-67 kubenswrapper[2568]: I0603 16:46:36.621823 2568 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["kuadrant-system/authorino-58774f46b4-gzq9b"] Jun 03 16:46:36.626800 ip-10-0-135-67 kubenswrapper[2568]: I0603 16:46:36.626782 2568 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-58774f46b4-gzq9b" Jun 03 16:46:36.629431 ip-10-0-135-67 kubenswrapper[2568]: I0603 16:46:36.629406 2568 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"authorino-oidc-ca\"" Jun 03 16:46:36.629543 ip-10-0-135-67 kubenswrapper[2568]: I0603 16:46:36.629495 2568 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"authorino-server-cert\"" Jun 03 16:46:36.629697 ip-10-0-135-67 kubenswrapper[2568]: I0603 16:46:36.629683 2568 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"authorino-authorino-dockercfg-kk8gn\"" Jun 03 16:46:36.631805 ip-10-0-135-67 kubenswrapper[2568]: I0603 16:46:36.631777 2568 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-58774f46b4-gzq9b"] Jun 03 16:46:36.766650 ip-10-0-135-67 kubenswrapper[2568]: I0603 16:46:36.766624 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"oidc-ca\" (UniqueName: \"kubernetes.io/configmap/ed50966e-c19b-4f8e-b277-176ce351b71d-oidc-ca\") pod \"authorino-58774f46b4-gzq9b\" (UID: \"ed50966e-c19b-4f8e-b277-176ce351b71d\") " pod="kuadrant-system/authorino-58774f46b4-gzq9b" Jun 03 16:46:36.766782 ip-10-0-135-67 kubenswrapper[2568]: I0603 16:46:36.766675 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/ed50966e-c19b-4f8e-b277-176ce351b71d-tls-cert\") pod \"authorino-58774f46b4-gzq9b\" (UID: \"ed50966e-c19b-4f8e-b277-176ce351b71d\") " pod="kuadrant-system/authorino-58774f46b4-gzq9b" Jun 03 16:46:36.766782 ip-10-0-135-67 kubenswrapper[2568]: I0603 16:46:36.766692 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-4w8cv\" (UniqueName: \"kubernetes.io/projected/ed50966e-c19b-4f8e-b277-176ce351b71d-kube-api-access-4w8cv\") pod \"authorino-58774f46b4-gzq9b\" (UID: \"ed50966e-c19b-4f8e-b277-176ce351b71d\") " pod="kuadrant-system/authorino-58774f46b4-gzq9b" Jun 03 16:46:36.867691 ip-10-0-135-67 kubenswrapper[2568]: I0603 16:46:36.867663 2568 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"oidc-ca\" (UniqueName: \"kubernetes.io/configmap/ed50966e-c19b-4f8e-b277-176ce351b71d-oidc-ca\") pod \"authorino-58774f46b4-gzq9b\" (UID: \"ed50966e-c19b-4f8e-b277-176ce351b71d\") " pod="kuadrant-system/authorino-58774f46b4-gzq9b" Jun 03 16:46:36.867826 ip-10-0-135-67 kubenswrapper[2568]: I0603 16:46:36.867723 2568 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/ed50966e-c19b-4f8e-b277-176ce351b71d-tls-cert\") pod \"authorino-58774f46b4-gzq9b\" (UID: \"ed50966e-c19b-4f8e-b277-176ce351b71d\") " pod="kuadrant-system/authorino-58774f46b4-gzq9b" Jun 03 16:46:36.867826 ip-10-0-135-67 kubenswrapper[2568]: I0603 16:46:36.867744 2568 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-4w8cv\" (UniqueName: \"kubernetes.io/projected/ed50966e-c19b-4f8e-b277-176ce351b71d-kube-api-access-4w8cv\") pod \"authorino-58774f46b4-gzq9b\" (UID: \"ed50966e-c19b-4f8e-b277-176ce351b71d\") " pod="kuadrant-system/authorino-58774f46b4-gzq9b" Jun 03 16:46:36.868326 ip-10-0-135-67 kubenswrapper[2568]: I0603 16:46:36.868305 2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"oidc-ca\" (UniqueName: \"kubernetes.io/configmap/ed50966e-c19b-4f8e-b277-176ce351b71d-oidc-ca\") pod \"authorino-58774f46b4-gzq9b\" (UID: \"ed50966e-c19b-4f8e-b277-176ce351b71d\") " pod="kuadrant-system/authorino-58774f46b4-gzq9b" Jun 03 16:46:36.870088 ip-10-0-135-67 kubenswrapper[2568]: I0603 16:46:36.870062 2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/ed50966e-c19b-4f8e-b277-176ce351b71d-tls-cert\") pod \"authorino-58774f46b4-gzq9b\" (UID: \"ed50966e-c19b-4f8e-b277-176ce351b71d\") " pod="kuadrant-system/authorino-58774f46b4-gzq9b" Jun 03 16:46:36.875492 ip-10-0-135-67 kubenswrapper[2568]: I0603 16:46:36.875438 2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-4w8cv\" (UniqueName: \"kubernetes.io/projected/ed50966e-c19b-4f8e-b277-176ce351b71d-kube-api-access-4w8cv\") pod \"authorino-58774f46b4-gzq9b\" (UID: \"ed50966e-c19b-4f8e-b277-176ce351b71d\") " pod="kuadrant-system/authorino-58774f46b4-gzq9b" Jun 03 16:46:36.937930 ip-10-0-135-67 kubenswrapper[2568]: I0603 16:46:36.937904 2568 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-58774f46b4-gzq9b" Jun 03 16:46:37.074045 ip-10-0-135-67 kubenswrapper[2568]: I0603 16:46:37.074018 2568 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-58774f46b4-gzq9b"] Jun 03 16:46:37.076139 ip-10-0-135-67 kubenswrapper[2568]: W0603 16:46:37.076107 2568 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-poded50966e_c19b_4f8e_b277_176ce351b71d.slice/crio-908e91502a74a441cb890bab243984135cc6250ae6b6b9ec19fdaa53b9f2901c WatchSource:0}: Error finding container 908e91502a74a441cb890bab243984135cc6250ae6b6b9ec19fdaa53b9f2901c: Status 404 returned error can't find the container with id 908e91502a74a441cb890bab243984135cc6250ae6b6b9ec19fdaa53b9f2901c Jun 03 16:46:37.280152 ip-10-0-135-67 kubenswrapper[2568]: I0603 16:46:37.280117 2568 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-58774f46b4-gzq9b" event={"ID":"ed50966e-c19b-4f8e-b277-176ce351b71d","Type":"ContainerStarted","Data":"908e91502a74a441cb890bab243984135cc6250ae6b6b9ec19fdaa53b9f2901c"} Jun 03 16:46:38.285289 ip-10-0-135-67 kubenswrapper[2568]: I0603 16:46:38.285249 2568 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-58774f46b4-gzq9b" event={"ID":"ed50966e-c19b-4f8e-b277-176ce351b71d","Type":"ContainerStarted","Data":"b8f7b4893eb2a3334667b6d1fa0e7444c561e9e31db089de9c292bcf00ea229c"} Jun 03 16:46:38.308967 ip-10-0-135-67 kubenswrapper[2568]: I0603 16:46:38.308911 2568 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="kuadrant-system/authorino-58774f46b4-gzq9b" podStartSLOduration=1.777588788 podStartE2EDuration="2.308894778s" podCreationTimestamp="2026-06-03 16:46:36 +0000 UTC" firstStartedPulling="2026-06-03 16:46:37.077336275 +0000 UTC m=+769.219510907" lastFinishedPulling="2026-06-03 16:46:37.608642259 +0000 UTC m=+769.750816897" observedRunningTime="2026-06-03 16:46:38.307663364 +0000 UTC m=+770.449838018" watchObservedRunningTime="2026-06-03 16:46:38.308894778 +0000 UTC m=+770.451069433" Jun 03 16:46:46.107108 ip-10-0-135-67 kubenswrapper[2568]: I0603 16:46:46.107070 2568 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-jmf7m"] Jun 03 16:46:50.391898 ip-10-0-135-67 kubenswrapper[2568]: I0603 16:46:50.391863 2568 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-jmf7m"] Jun 03 16:47:07.392378 ip-10-0-135-67 kubenswrapper[2568]: I0603 16:47:07.392290 2568 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-jmf7m"] Jun 03 16:47:13.690333 ip-10-0-135-67 kubenswrapper[2568]: I0603 16:47:13.690297 2568 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-jmf7m"] Jun 03 16:47:19.792175 ip-10-0-135-67 kubenswrapper[2568]: I0603 16:47:19.792134 2568 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-jmf7m"] Jun 03 16:47:38.385578 ip-10-0-135-67 kubenswrapper[2568]: I0603 16:47:38.385546 2568 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-jmf7m"] Jun 03 16:48:49.965729 ip-10-0-135-67 kubenswrapper[2568]: I0603 16:48:49.965698 2568 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-86d7c6cc77-mwpf2_b1e67fcc-fd50-4a1e-af4e-48c44fb8db7d/console-operator/1.log" Jun 03 16:48:49.967512 ip-10-0-135-67 kubenswrapper[2568]: I0603 16:48:49.967494 2568 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-86d7c6cc77-mwpf2_b1e67fcc-fd50-4a1e-af4e-48c44fb8db7d/console-operator/1.log" Jun 03 16:48:49.972643 ip-10-0-135-67 kubenswrapper[2568]: I0603 16:48:49.972623 2568 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-94fdt_dd3dac0d-018e-4c8a-98c7-daedef6dedb9/ovn-acl-logging/0.log" Jun 03 16:48:49.974361 ip-10-0-135-67 kubenswrapper[2568]: I0603 16:48:49.974344 2568 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-94fdt_dd3dac0d-018e-4c8a-98c7-daedef6dedb9/ovn-acl-logging/0.log" Jun 03 16:53:50.001167 ip-10-0-135-67 kubenswrapper[2568]: I0603 16:53:50.001143 2568 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-86d7c6cc77-mwpf2_b1e67fcc-fd50-4a1e-af4e-48c44fb8db7d/console-operator/1.log" Jun 03 16:53:50.003884 ip-10-0-135-67 kubenswrapper[2568]: I0603 16:53:50.003856 2568 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-86d7c6cc77-mwpf2_b1e67fcc-fd50-4a1e-af4e-48c44fb8db7d/console-operator/1.log" Jun 03 16:53:50.007403 ip-10-0-135-67 kubenswrapper[2568]: I0603 16:53:50.007381 2568 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-94fdt_dd3dac0d-018e-4c8a-98c7-daedef6dedb9/ovn-acl-logging/0.log" Jun 03 16:53:50.009855 ip-10-0-135-67 kubenswrapper[2568]: I0603 16:53:50.009840 2568 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-94fdt_dd3dac0d-018e-4c8a-98c7-daedef6dedb9/ovn-acl-logging/0.log" Jun 03 16:54:03.698496 ip-10-0-135-67 kubenswrapper[2568]: I0603 16:54:03.698463 2568 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_authorino-58774f46b4-gzq9b_ed50966e-c19b-4f8e-b277-176ce351b71d/authorino/0.log" Jun 03 16:54:08.610460 ip-10-0-135-67 kubenswrapper[2568]: I0603 16:54:08.610429 2568 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_maas-api-88d68d59f-9ktbl_6e22e7ea-573c-469e-9c33-45efe4d6880b/maas-api/0.log" Jun 03 16:54:08.735686 ip-10-0-135-67 kubenswrapper[2568]: I0603 16:54:08.735655 2568 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_maas-controller-58995fd7b7-9qk6w_ab4a0f7f-cce9-4270-86f8-78bd0a18e078/manager/0.log" Jun 03 16:54:09.091318 ip-10-0-135-67 kubenswrapper[2568]: I0603 16:54:09.091294 2568 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-5f84758474-km5sn_8333f4cf-cd6f-4918-a180-63e7fcfee215/copy-manifests/0.log" Jun 03 16:54:09.097118 ip-10-0-135-67 kubenswrapper[2568]: I0603 16:54:09.097094 2568 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-5f84758474-km5sn_8333f4cf-cd6f-4918-a180-63e7fcfee215/manager/0.log" Jun 03 16:54:10.208915 ip-10-0-135-67 kubenswrapper[2568]: I0603 16:54:10.208890 2568 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b7596ggtk_acc83364-b4c7-4074-941a-3765c95b24e4/util/0.log" Jun 03 16:54:10.214796 ip-10-0-135-67 kubenswrapper[2568]: I0603 16:54:10.214776 2568 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b7596ggtk_acc83364-b4c7-4074-941a-3765c95b24e4/pull/0.log" Jun 03 16:54:10.220751 ip-10-0-135-67 kubenswrapper[2568]: I0603 16:54:10.220732 2568 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b7596ggtk_acc83364-b4c7-4074-941a-3765c95b24e4/extract/0.log" Jun 03 16:54:10.329925 ip-10-0-135-67 kubenswrapper[2568]: I0603 16:54:10.329892 2568 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e05gp8c_af8ad6c3-2b9a-4751-8407-f4e59900033e/pull/0.log" Jun 03 16:54:10.336396 ip-10-0-135-67 kubenswrapper[2568]: I0603 16:54:10.336380 2568 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e05gp8c_af8ad6c3-2b9a-4751-8407-f4e59900033e/extract/0.log" Jun 03 16:54:10.342505 ip-10-0-135-67 kubenswrapper[2568]: I0603 16:54:10.342482 2568 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e05gp8c_af8ad6c3-2b9a-4751-8407-f4e59900033e/util/0.log" Jun 03 16:54:10.450274 ip-10-0-135-67 kubenswrapper[2568]: I0603 16:54:10.450245 2568 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73q49dg_23e7591f-cd45-44fe-9c67-cecdcb347126/pull/0.log" Jun 03 16:54:10.455292 ip-10-0-135-67 kubenswrapper[2568]: I0603 16:54:10.455273 2568 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73q49dg_23e7591f-cd45-44fe-9c67-cecdcb347126/extract/0.log" Jun 03 16:54:10.460092 ip-10-0-135-67 kubenswrapper[2568]: I0603 16:54:10.460033 2568 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73q49dg_23e7591f-cd45-44fe-9c67-cecdcb347126/util/0.log" Jun 03 16:54:10.570655 ip-10-0-135-67 kubenswrapper[2568]: I0603 16:54:10.570636 2568 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef164bzd_19b4a4f7-3790-4de1-bd6c-d0b5eecaf14a/util/0.log" Jun 03 16:54:10.576057 ip-10-0-135-67 kubenswrapper[2568]: I0603 16:54:10.576027 2568 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef164bzd_19b4a4f7-3790-4de1-bd6c-d0b5eecaf14a/pull/0.log" Jun 03 16:54:10.581769 ip-10-0-135-67 kubenswrapper[2568]: I0603 16:54:10.581748 2568 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef164bzd_19b4a4f7-3790-4de1-bd6c-d0b5eecaf14a/extract/0.log" Jun 03 16:54:10.695434 ip-10-0-135-67 kubenswrapper[2568]: I0603 16:54:10.695407 2568 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_authorino-58774f46b4-gzq9b_ed50966e-c19b-4f8e-b277-176ce351b71d/authorino/0.log" Jun 03 16:54:11.034297 ip-10-0-135-67 kubenswrapper[2568]: I0603 16:54:11.034268 2568 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_kuadrant-console-plugin-6cb54b5c86-5swtz_489d2859-3969-4a25-be37-5c339cc4dc8b/kuadrant-console-plugin/0.log" Jun 03 16:54:11.382058 ip-10-0-135-67 kubenswrapper[2568]: I0603 16:54:11.381926 2568 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_limitador-limitador-78c99df468-jmf7m_3b49a9e3-b45a-44fc-b443-39cbe26599db/limitador/0.log" Jun 03 16:54:12.065756 ip-10-0-135-67 kubenswrapper[2568]: I0603 16:54:12.065718 2568 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_kube-auth-proxy-598f4f7759-b6b48_fcb7566e-d1ea-47f6-9a52-6587b52d501d/kube-auth-proxy/0.log" Jun 03 16:54:12.407113 ip-10-0-135-67 kubenswrapper[2568]: I0603 16:54:12.407038 2568 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-processing-58b6c8fdc7-t2g4x_274dd9b3-ebd9-49fc-8b15-26367deba2df/payload-processing/0.log" Jun 03 16:54:17.553057 ip-10-0-135-67 kubenswrapper[2568]: I0603 16:54:17.553021 2568 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-must-gather-s47xq/must-gather-jgxjd"] Jun 03 16:54:17.555814 ip-10-0-135-67 kubenswrapper[2568]: I0603 16:54:17.555793 2568 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-s47xq/must-gather-jgxjd" Jun 03 16:54:17.558242 ip-10-0-135-67 kubenswrapper[2568]: I0603 16:54:17.558223 2568 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-must-gather-s47xq\"/\"openshift-service-ca.crt\"" Jun 03 16:54:17.558863 ip-10-0-135-67 kubenswrapper[2568]: I0603 16:54:17.558840 2568 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-must-gather-s47xq\"/\"kube-root-ca.crt\"" Jun 03 16:54:17.558970 ip-10-0-135-67 kubenswrapper[2568]: I0603 16:54:17.558868 2568 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-must-gather-s47xq\"/\"default-dockercfg-dsvp8\"" Jun 03 16:54:17.568199 ip-10-0-135-67 kubenswrapper[2568]: I0603 16:54:17.568179 2568 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-s47xq/must-gather-jgxjd"] Jun 03 16:54:17.651016 ip-10-0-135-67 kubenswrapper[2568]: I0603 16:54:17.650975 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"must-gather-output\" (UniqueName: \"kubernetes.io/empty-dir/09cc7861-a77a-418f-be08-6553c867133d-must-gather-output\") pod \"must-gather-jgxjd\" (UID: \"09cc7861-a77a-418f-be08-6553c867133d\") " pod="openshift-must-gather-s47xq/must-gather-jgxjd" Jun 03 16:54:17.651154 ip-10-0-135-67 kubenswrapper[2568]: I0603 16:54:17.651089 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-jwxx9\" (UniqueName: \"kubernetes.io/projected/09cc7861-a77a-418f-be08-6553c867133d-kube-api-access-jwxx9\") pod \"must-gather-jgxjd\" (UID: \"09cc7861-a77a-418f-be08-6553c867133d\") " pod="openshift-must-gather-s47xq/must-gather-jgxjd" Jun 03 16:54:17.752253 ip-10-0-135-67 kubenswrapper[2568]: I0603 16:54:17.752221 2568 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"must-gather-output\" (UniqueName: \"kubernetes.io/empty-dir/09cc7861-a77a-418f-be08-6553c867133d-must-gather-output\") pod \"must-gather-jgxjd\" (UID: \"09cc7861-a77a-418f-be08-6553c867133d\") " pod="openshift-must-gather-s47xq/must-gather-jgxjd" Jun 03 16:54:17.752386 ip-10-0-135-67 kubenswrapper[2568]: I0603 16:54:17.752275 2568 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-jwxx9\" (UniqueName: \"kubernetes.io/projected/09cc7861-a77a-418f-be08-6553c867133d-kube-api-access-jwxx9\") pod \"must-gather-jgxjd\" (UID: \"09cc7861-a77a-418f-be08-6553c867133d\") " pod="openshift-must-gather-s47xq/must-gather-jgxjd" Jun 03 16:54:17.752559 ip-10-0-135-67 kubenswrapper[2568]: I0603 16:54:17.752542 2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"must-gather-output\" (UniqueName: \"kubernetes.io/empty-dir/09cc7861-a77a-418f-be08-6553c867133d-must-gather-output\") pod \"must-gather-jgxjd\" (UID: \"09cc7861-a77a-418f-be08-6553c867133d\") " pod="openshift-must-gather-s47xq/must-gather-jgxjd" Jun 03 16:54:17.759365 ip-10-0-135-67 kubenswrapper[2568]: I0603 16:54:17.759341 2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-jwxx9\" (UniqueName: \"kubernetes.io/projected/09cc7861-a77a-418f-be08-6553c867133d-kube-api-access-jwxx9\") pod \"must-gather-jgxjd\" (UID: \"09cc7861-a77a-418f-be08-6553c867133d\") " pod="openshift-must-gather-s47xq/must-gather-jgxjd" Jun 03 16:54:17.865873 ip-10-0-135-67 kubenswrapper[2568]: I0603 16:54:17.865800 2568 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-s47xq/must-gather-jgxjd" Jun 03 16:54:17.995266 ip-10-0-135-67 kubenswrapper[2568]: I0603 16:54:17.995238 2568 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-s47xq/must-gather-jgxjd"] Jun 03 16:54:17.997796 ip-10-0-135-67 kubenswrapper[2568]: W0603 16:54:17.997760 2568 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod09cc7861_a77a_418f_be08_6553c867133d.slice/crio-01e5ec6c98c2eddc8f750f49b8bdf5901dbdd347e6dfa270e11e8be0145301f0 WatchSource:0}: Error finding container 01e5ec6c98c2eddc8f750f49b8bdf5901dbdd347e6dfa270e11e8be0145301f0: Status 404 returned error can't find the container with id 01e5ec6c98c2eddc8f750f49b8bdf5901dbdd347e6dfa270e11e8be0145301f0 Jun 03 16:54:17.999481 ip-10-0-135-67 kubenswrapper[2568]: I0603 16:54:17.999463 2568 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider Jun 03 16:54:18.040058 ip-10-0-135-67 kubenswrapper[2568]: I0603 16:54:18.040028 2568 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-s47xq/must-gather-jgxjd" event={"ID":"09cc7861-a77a-418f-be08-6553c867133d","Type":"ContainerStarted","Data":"01e5ec6c98c2eddc8f750f49b8bdf5901dbdd347e6dfa270e11e8be0145301f0"} Jun 03 16:54:19.046950 ip-10-0-135-67 kubenswrapper[2568]: I0603 16:54:19.046867 2568 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-s47xq/must-gather-jgxjd" event={"ID":"09cc7861-a77a-418f-be08-6553c867133d","Type":"ContainerStarted","Data":"9dfdb8a595657e3e29b1eff1fc47bbadcdd82c55b49fc70a42030ed4d424f831"} Jun 03 16:54:19.046950 ip-10-0-135-67 kubenswrapper[2568]: I0603 16:54:19.046916 2568 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-s47xq/must-gather-jgxjd" event={"ID":"09cc7861-a77a-418f-be08-6553c867133d","Type":"ContainerStarted","Data":"ee2bb6c6bd52ff7989f652badfc2c9f5f5d1c3c0cf83f6b6a873d2b488dbe815"} Jun 03 16:54:19.065203 ip-10-0-135-67 kubenswrapper[2568]: I0603 16:54:19.065143 2568 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-must-gather-s47xq/must-gather-jgxjd" podStartSLOduration=1.403676377 podStartE2EDuration="2.065125421s" podCreationTimestamp="2026-06-03 16:54:17 +0000 UTC" firstStartedPulling="2026-06-03 16:54:17.999597324 +0000 UTC m=+1230.141771957" lastFinishedPulling="2026-06-03 16:54:18.661046369 +0000 UTC m=+1230.803221001" observedRunningTime="2026-06-03 16:54:19.062626778 +0000 UTC m=+1231.204801432" watchObservedRunningTime="2026-06-03 16:54:19.065125421 +0000 UTC m=+1231.207300076" Jun 03 16:54:20.394904 ip-10-0-135-67 kubenswrapper[2568]: I0603 16:54:20.394871 2568 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_global-pull-secret-syncer-jmmft_5c5a9b32-c7b7-4da2-85fa-7db4f429606d/global-pull-secret-syncer/0.log" Jun 03 16:54:20.467174 ip-10-0-135-67 kubenswrapper[2568]: I0603 16:54:20.467147 2568 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_konnectivity-agent-vcz76_969318db-7cb1-4ad5-99f2-66d7f803c8a3/konnectivity-agent/0.log" Jun 03 16:54:20.508769 ip-10-0-135-67 kubenswrapper[2568]: I0603 16:54:20.508736 2568 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_kube-apiserver-proxy-ip-10-0-135-67.ec2.internal_4639241fb18cd938c7f40c97e0b0879c/haproxy/0.log" Jun 03 16:54:24.411571 ip-10-0-135-67 kubenswrapper[2568]: I0603 16:54:24.411345 2568 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b7596ggtk_acc83364-b4c7-4074-941a-3765c95b24e4/extract/0.log" Jun 03 16:54:24.435546 ip-10-0-135-67 kubenswrapper[2568]: I0603 16:54:24.435477 2568 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b7596ggtk_acc83364-b4c7-4074-941a-3765c95b24e4/util/0.log" Jun 03 16:54:24.457522 ip-10-0-135-67 kubenswrapper[2568]: I0603 16:54:24.457432 2568 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b7596ggtk_acc83364-b4c7-4074-941a-3765c95b24e4/pull/0.log" Jun 03 16:54:24.483822 ip-10-0-135-67 kubenswrapper[2568]: I0603 16:54:24.483753 2568 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e05gp8c_af8ad6c3-2b9a-4751-8407-f4e59900033e/extract/0.log" Jun 03 16:54:24.505350 ip-10-0-135-67 kubenswrapper[2568]: I0603 16:54:24.505253 2568 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e05gp8c_af8ad6c3-2b9a-4751-8407-f4e59900033e/util/0.log" Jun 03 16:54:24.528620 ip-10-0-135-67 kubenswrapper[2568]: I0603 16:54:24.528590 2568 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e05gp8c_af8ad6c3-2b9a-4751-8407-f4e59900033e/pull/0.log" Jun 03 16:54:24.558332 ip-10-0-135-67 kubenswrapper[2568]: I0603 16:54:24.558299 2568 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73q49dg_23e7591f-cd45-44fe-9c67-cecdcb347126/extract/0.log" Jun 03 16:54:24.591997 ip-10-0-135-67 kubenswrapper[2568]: I0603 16:54:24.591870 2568 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73q49dg_23e7591f-cd45-44fe-9c67-cecdcb347126/util/0.log" Jun 03 16:54:24.618609 ip-10-0-135-67 kubenswrapper[2568]: I0603 16:54:24.618570 2568 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73q49dg_23e7591f-cd45-44fe-9c67-cecdcb347126/pull/0.log" Jun 03 16:54:24.648945 ip-10-0-135-67 kubenswrapper[2568]: I0603 16:54:24.648917 2568 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef164bzd_19b4a4f7-3790-4de1-bd6c-d0b5eecaf14a/extract/0.log" Jun 03 16:54:24.670855 ip-10-0-135-67 kubenswrapper[2568]: I0603 16:54:24.670749 2568 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef164bzd_19b4a4f7-3790-4de1-bd6c-d0b5eecaf14a/util/0.log" Jun 03 16:54:24.695542 ip-10-0-135-67 kubenswrapper[2568]: I0603 16:54:24.695508 2568 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef164bzd_19b4a4f7-3790-4de1-bd6c-d0b5eecaf14a/pull/0.log" Jun 03 16:54:24.729188 ip-10-0-135-67 kubenswrapper[2568]: I0603 16:54:24.729156 2568 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_authorino-58774f46b4-gzq9b_ed50966e-c19b-4f8e-b277-176ce351b71d/authorino/0.log" Jun 03 16:54:24.821798 ip-10-0-135-67 kubenswrapper[2568]: I0603 16:54:24.821764 2568 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_kuadrant-console-plugin-6cb54b5c86-5swtz_489d2859-3969-4a25-be37-5c339cc4dc8b/kuadrant-console-plugin/0.log" Jun 03 16:54:24.914587 ip-10-0-135-67 kubenswrapper[2568]: I0603 16:54:24.914559 2568 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_limitador-limitador-78c99df468-jmf7m_3b49a9e3-b45a-44fc-b443-39cbe26599db/limitador/0.log" Jun 03 16:54:26.198063 ip-10-0-135-67 kubenswrapper[2568]: I0603 16:54:26.198033 2568 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_3dc38f0d-f7bf-415b-a488-267c48ef13f3/alertmanager/0.log" Jun 03 16:54:26.220216 ip-10-0-135-67 kubenswrapper[2568]: I0603 16:54:26.220182 2568 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_3dc38f0d-f7bf-415b-a488-267c48ef13f3/config-reloader/0.log" Jun 03 16:54:26.242834 ip-10-0-135-67 kubenswrapper[2568]: I0603 16:54:26.242790 2568 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_3dc38f0d-f7bf-415b-a488-267c48ef13f3/kube-rbac-proxy-web/0.log" Jun 03 16:54:26.264837 ip-10-0-135-67 kubenswrapper[2568]: I0603 16:54:26.264804 2568 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_3dc38f0d-f7bf-415b-a488-267c48ef13f3/kube-rbac-proxy/0.log" Jun 03 16:54:26.286736 ip-10-0-135-67 kubenswrapper[2568]: I0603 16:54:26.286704 2568 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_3dc38f0d-f7bf-415b-a488-267c48ef13f3/kube-rbac-proxy-metric/0.log" Jun 03 16:54:26.308469 ip-10-0-135-67 kubenswrapper[2568]: I0603 16:54:26.308430 2568 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_3dc38f0d-f7bf-415b-a488-267c48ef13f3/prom-label-proxy/0.log" Jun 03 16:54:26.330475 ip-10-0-135-67 kubenswrapper[2568]: I0603 16:54:26.330445 2568 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_3dc38f0d-f7bf-415b-a488-267c48ef13f3/init-config-reloader/0.log" Jun 03 16:54:26.374182 ip-10-0-135-67 kubenswrapper[2568]: I0603 16:54:26.374140 2568 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_cluster-monitoring-operator-69b6cbdb88-tzxs6_48e00082-b030-48ac-aa35-9cb1ab31fae8/cluster-monitoring-operator/0.log" Jun 03 16:54:26.420193 ip-10-0-135-67 kubenswrapper[2568]: I0603 16:54:26.420160 2568 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_kube-state-metrics-8469c486bb-pkwds_f61b4ac6-d530-43f4-8f5f-c44f45455887/kube-state-metrics/0.log" Jun 03 16:54:26.439742 ip-10-0-135-67 kubenswrapper[2568]: I0603 16:54:26.439698 2568 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_kube-state-metrics-8469c486bb-pkwds_f61b4ac6-d530-43f4-8f5f-c44f45455887/kube-rbac-proxy-main/0.log" Jun 03 16:54:26.465554 ip-10-0-135-67 kubenswrapper[2568]: I0603 16:54:26.465473 2568 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_kube-state-metrics-8469c486bb-pkwds_f61b4ac6-d530-43f4-8f5f-c44f45455887/kube-rbac-proxy-self/0.log" Jun 03 16:54:26.555087 ip-10-0-135-67 kubenswrapper[2568]: I0603 16:54:26.555052 2568 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-289mx_24de6081-0ed9-49d4-b2fa-6f4e6d3c8d39/node-exporter/0.log" Jun 03 16:54:26.581370 ip-10-0-135-67 kubenswrapper[2568]: I0603 16:54:26.581316 2568 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-289mx_24de6081-0ed9-49d4-b2fa-6f4e6d3c8d39/kube-rbac-proxy/0.log" Jun 03 16:54:26.605944 ip-10-0-135-67 kubenswrapper[2568]: I0603 16:54:26.605912 2568 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-289mx_24de6081-0ed9-49d4-b2fa-6f4e6d3c8d39/init-textfile/0.log" Jun 03 16:54:26.839332 ip-10-0-135-67 kubenswrapper[2568]: I0603 16:54:26.839297 2568 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_openshift-state-metrics-85658796db-trt8m_674fabaf-399c-4cec-8f61-c9e1c778f57b/kube-rbac-proxy-main/0.log" Jun 03 16:54:26.862693 ip-10-0-135-67 kubenswrapper[2568]: I0603 16:54:26.862660 2568 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_openshift-state-metrics-85658796db-trt8m_674fabaf-399c-4cec-8f61-c9e1c778f57b/kube-rbac-proxy-self/0.log" Jun 03 16:54:26.884271 ip-10-0-135-67 kubenswrapper[2568]: I0603 16:54:26.884239 2568 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_openshift-state-metrics-85658796db-trt8m_674fabaf-399c-4cec-8f61-c9e1c778f57b/openshift-state-metrics/0.log" Jun 03 16:54:27.091317 ip-10-0-135-67 kubenswrapper[2568]: I0603 16:54:27.091267 2568 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-operator-658bcd8bdf-sfc6m_9d684eec-bf8e-4476-b54d-03535a181804/prometheus-operator/0.log" Jun 03 16:54:27.110993 ip-10-0-135-67 kubenswrapper[2568]: I0603 16:54:27.110955 2568 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-operator-658bcd8bdf-sfc6m_9d684eec-bf8e-4476-b54d-03535a181804/kube-rbac-proxy/0.log" Jun 03 16:54:27.136641 ip-10-0-135-67 kubenswrapper[2568]: I0603 16:54:27.136548 2568 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-operator-admission-webhook-59b7f8756b-6mxg6_84bdc7c7-212d-47d8-90b7-52853cf73684/prometheus-operator-admission-webhook/0.log" Jun 03 16:54:27.166934 ip-10-0-135-67 kubenswrapper[2568]: I0603 16:54:27.166886 2568 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_telemeter-client-64d9fbdc45-k5bxp_3423b27c-4dd3-4af1-9a1f-4668f19b1aed/telemeter-client/0.log" Jun 03 16:54:27.188750 ip-10-0-135-67 kubenswrapper[2568]: I0603 16:54:27.188704 2568 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_telemeter-client-64d9fbdc45-k5bxp_3423b27c-4dd3-4af1-9a1f-4668f19b1aed/reload/0.log" Jun 03 16:54:27.210481 ip-10-0-135-67 kubenswrapper[2568]: I0603 16:54:27.210450 2568 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_telemeter-client-64d9fbdc45-k5bxp_3423b27c-4dd3-4af1-9a1f-4668f19b1aed/kube-rbac-proxy/0.log" Jun 03 16:54:28.515437 ip-10-0-135-67 kubenswrapper[2568]: I0603 16:54:28.515384 2568 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-network-console_networking-console-plugin-76c9bb5fdf-fmks7_46731be4-da64-4d9c-ba2d-b2b7c8ceefbd/networking-console-plugin/0.log" Jun 03 16:54:29.097632 ip-10-0-135-67 kubenswrapper[2568]: I0603 16:54:29.097584 2568 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-86d7c6cc77-mwpf2_b1e67fcc-fd50-4a1e-af4e-48c44fb8db7d/console-operator/1.log" Jun 03 16:54:29.106747 ip-10-0-135-67 kubenswrapper[2568]: I0603 16:54:29.106714 2568 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-86d7c6cc77-mwpf2_b1e67fcc-fd50-4a1e-af4e-48c44fb8db7d/console-operator/2.log" Jun 03 16:54:29.576385 ip-10-0-135-67 kubenswrapper[2568]: I0603 16:54:29.576342 2568 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console_downloads-c65b8dc4b-rwv6s_f8c27eb0-19f6-4e05-b152-cada0ca804ed/download-server/0.log" Jun 03 16:54:29.963701 ip-10-0-135-67 kubenswrapper[2568]: I0603 16:54:29.963617 2568 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-must-gather-s47xq/perf-node-gather-daemonset-7wlgh"] Jun 03 16:54:29.968915 ip-10-0-135-67 kubenswrapper[2568]: I0603 16:54:29.968886 2568 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-s47xq/perf-node-gather-daemonset-7wlgh" Jun 03 16:54:29.974194 ip-10-0-135-67 kubenswrapper[2568]: I0603 16:54:29.974173 2568 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-s47xq/perf-node-gather-daemonset-7wlgh"] Jun 03 16:54:30.086934 ip-10-0-135-67 kubenswrapper[2568]: I0603 16:54:30.086887 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/e467213a-cf35-4698-acd4-6133326e29cb-sys\") pod \"perf-node-gather-daemonset-7wlgh\" (UID: \"e467213a-cf35-4698-acd4-6133326e29cb\") " pod="openshift-must-gather-s47xq/perf-node-gather-daemonset-7wlgh" Jun 03 16:54:30.087151 ip-10-0-135-67 kubenswrapper[2568]: I0603 16:54:30.086951 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/e467213a-cf35-4698-acd4-6133326e29cb-proc\") pod \"perf-node-gather-daemonset-7wlgh\" (UID: \"e467213a-cf35-4698-acd4-6133326e29cb\") " pod="openshift-must-gather-s47xq/perf-node-gather-daemonset-7wlgh" Jun 03 16:54:30.087151 ip-10-0-135-67 kubenswrapper[2568]: I0603 16:54:30.086985 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-qpqlp\" (UniqueName: \"kubernetes.io/projected/e467213a-cf35-4698-acd4-6133326e29cb-kube-api-access-qpqlp\") pod \"perf-node-gather-daemonset-7wlgh\" (UID: \"e467213a-cf35-4698-acd4-6133326e29cb\") " pod="openshift-must-gather-s47xq/perf-node-gather-daemonset-7wlgh" Jun 03 16:54:30.087151 ip-10-0-135-67 kubenswrapper[2568]: I0603 16:54:30.087031 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/e467213a-cf35-4698-acd4-6133326e29cb-lib-modules\") pod \"perf-node-gather-daemonset-7wlgh\" (UID: \"e467213a-cf35-4698-acd4-6133326e29cb\") " pod="openshift-must-gather-s47xq/perf-node-gather-daemonset-7wlgh" Jun 03 16:54:30.087151 ip-10-0-135-67 kubenswrapper[2568]: I0603 16:54:30.087054 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/e467213a-cf35-4698-acd4-6133326e29cb-podres\") pod \"perf-node-gather-daemonset-7wlgh\" (UID: \"e467213a-cf35-4698-acd4-6133326e29cb\") " pod="openshift-must-gather-s47xq/perf-node-gather-daemonset-7wlgh" Jun 03 16:54:30.188107 ip-10-0-135-67 kubenswrapper[2568]: I0603 16:54:30.188068 2568 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/e467213a-cf35-4698-acd4-6133326e29cb-sys\") pod \"perf-node-gather-daemonset-7wlgh\" (UID: \"e467213a-cf35-4698-acd4-6133326e29cb\") " pod="openshift-must-gather-s47xq/perf-node-gather-daemonset-7wlgh" Jun 03 16:54:30.188107 ip-10-0-135-67 kubenswrapper[2568]: I0603 16:54:30.188110 2568 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/e467213a-cf35-4698-acd4-6133326e29cb-proc\") pod \"perf-node-gather-daemonset-7wlgh\" (UID: \"e467213a-cf35-4698-acd4-6133326e29cb\") " pod="openshift-must-gather-s47xq/perf-node-gather-daemonset-7wlgh" Jun 03 16:54:30.188308 ip-10-0-135-67 kubenswrapper[2568]: I0603 16:54:30.188160 2568 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-qpqlp\" (UniqueName: \"kubernetes.io/projected/e467213a-cf35-4698-acd4-6133326e29cb-kube-api-access-qpqlp\") pod \"perf-node-gather-daemonset-7wlgh\" (UID: \"e467213a-cf35-4698-acd4-6133326e29cb\") " pod="openshift-must-gather-s47xq/perf-node-gather-daemonset-7wlgh" Jun 03 16:54:30.188308 ip-10-0-135-67 kubenswrapper[2568]: I0603 16:54:30.188181 2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/e467213a-cf35-4698-acd4-6133326e29cb-proc\") pod \"perf-node-gather-daemonset-7wlgh\" (UID: \"e467213a-cf35-4698-acd4-6133326e29cb\") " pod="openshift-must-gather-s47xq/perf-node-gather-daemonset-7wlgh" Jun 03 16:54:30.188308 ip-10-0-135-67 kubenswrapper[2568]: I0603 16:54:30.188207 2568 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/e467213a-cf35-4698-acd4-6133326e29cb-lib-modules\") pod \"perf-node-gather-daemonset-7wlgh\" (UID: \"e467213a-cf35-4698-acd4-6133326e29cb\") " pod="openshift-must-gather-s47xq/perf-node-gather-daemonset-7wlgh" Jun 03 16:54:30.188308 ip-10-0-135-67 kubenswrapper[2568]: I0603 16:54:30.188233 2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/e467213a-cf35-4698-acd4-6133326e29cb-sys\") pod \"perf-node-gather-daemonset-7wlgh\" (UID: \"e467213a-cf35-4698-acd4-6133326e29cb\") " pod="openshift-must-gather-s47xq/perf-node-gather-daemonset-7wlgh" Jun 03 16:54:30.188308 ip-10-0-135-67 kubenswrapper[2568]: I0603 16:54:30.188234 2568 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/e467213a-cf35-4698-acd4-6133326e29cb-podres\") pod \"perf-node-gather-daemonset-7wlgh\" (UID: \"e467213a-cf35-4698-acd4-6133326e29cb\") " pod="openshift-must-gather-s47xq/perf-node-gather-daemonset-7wlgh" Jun 03 16:54:30.188530 ip-10-0-135-67 kubenswrapper[2568]: I0603 16:54:30.188341 2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/e467213a-cf35-4698-acd4-6133326e29cb-podres\") pod \"perf-node-gather-daemonset-7wlgh\" (UID: \"e467213a-cf35-4698-acd4-6133326e29cb\") " pod="openshift-must-gather-s47xq/perf-node-gather-daemonset-7wlgh" Jun 03 16:54:30.188530 ip-10-0-135-67 kubenswrapper[2568]: I0603 16:54:30.188392 2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/e467213a-cf35-4698-acd4-6133326e29cb-lib-modules\") pod \"perf-node-gather-daemonset-7wlgh\" (UID: \"e467213a-cf35-4698-acd4-6133326e29cb\") " pod="openshift-must-gather-s47xq/perf-node-gather-daemonset-7wlgh" Jun 03 16:54:30.197169 ip-10-0-135-67 kubenswrapper[2568]: I0603 16:54:30.196322 2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-qpqlp\" (UniqueName: \"kubernetes.io/projected/e467213a-cf35-4698-acd4-6133326e29cb-kube-api-access-qpqlp\") pod \"perf-node-gather-daemonset-7wlgh\" (UID: \"e467213a-cf35-4698-acd4-6133326e29cb\") " pod="openshift-must-gather-s47xq/perf-node-gather-daemonset-7wlgh" Jun 03 16:54:30.285194 ip-10-0-135-67 kubenswrapper[2568]: I0603 16:54:30.285162 2568 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-s47xq/perf-node-gather-daemonset-7wlgh" Jun 03 16:54:30.438849 ip-10-0-135-67 kubenswrapper[2568]: I0603 16:54:30.438819 2568 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-s47xq/perf-node-gather-daemonset-7wlgh"] Jun 03 16:54:31.033315 ip-10-0-135-67 kubenswrapper[2568]: I0603 16:54:31.033289 2568 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_dns-default-tn2hz_0f3a9c08-8974-46c9-9245-fbfc1a73e96c/dns/0.log" Jun 03 16:54:31.055163 ip-10-0-135-67 kubenswrapper[2568]: I0603 16:54:31.055135 2568 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_dns-default-tn2hz_0f3a9c08-8974-46c9-9245-fbfc1a73e96c/kube-rbac-proxy/0.log" Jun 03 16:54:31.109899 ip-10-0-135-67 kubenswrapper[2568]: I0603 16:54:31.109862 2568 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-s47xq/perf-node-gather-daemonset-7wlgh" event={"ID":"e467213a-cf35-4698-acd4-6133326e29cb","Type":"ContainerStarted","Data":"b2678619832f8eea92feae468d3d8a9c9a95d5ed2d53cc1e401bd7f3897b54fc"} Jun 03 16:54:31.110065 ip-10-0-135-67 kubenswrapper[2568]: I0603 16:54:31.109907 2568 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-s47xq/perf-node-gather-daemonset-7wlgh" event={"ID":"e467213a-cf35-4698-acd4-6133326e29cb","Type":"ContainerStarted","Data":"d978120789cce5b52fd92e7319d89ea76a8d2d55f205912fa3c2120ae867a418"} Jun 03 16:54:31.110065 ip-10-0-135-67 kubenswrapper[2568]: I0603 16:54:31.109971 2568 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-must-gather-s47xq/perf-node-gather-daemonset-7wlgh" Jun 03 16:54:31.127063 ip-10-0-135-67 kubenswrapper[2568]: I0603 16:54:31.126995 2568 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-must-gather-s47xq/perf-node-gather-daemonset-7wlgh" podStartSLOduration=2.126977225 podStartE2EDuration="2.126977225s" podCreationTimestamp="2026-06-03 16:54:29 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2026-06-03 16:54:31.123490627 +0000 UTC m=+1243.265665280" watchObservedRunningTime="2026-06-03 16:54:31.126977225 +0000 UTC m=+1243.269151880" Jun 03 16:54:31.159390 ip-10-0-135-67 kubenswrapper[2568]: I0603 16:54:31.159364 2568 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_node-resolver-wrnbf_d250f8ac-2da7-4c87-85e2-dad87073a681/dns-node-resolver/0.log" Jun 03 16:54:31.683554 ip-10-0-135-67 kubenswrapper[2568]: I0603 16:54:31.683524 2568 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_node-ca-ktq4g_f40f3f2b-b437-46a6-8ea2-b770ea9bd2a3/node-ca/0.log" Jun 03 16:54:32.626881 ip-10-0-135-67 kubenswrapper[2568]: I0603 16:54:32.626849 2568 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_kube-auth-proxy-598f4f7759-b6b48_fcb7566e-d1ea-47f6-9a52-6587b52d501d/kube-auth-proxy/0.log" Jun 03 16:54:32.706726 ip-10-0-135-67 kubenswrapper[2568]: I0603 16:54:32.706700 2568 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-processing-58b6c8fdc7-t2g4x_274dd9b3-ebd9-49fc-8b15-26367deba2df/payload-processing/0.log" Jun 03 16:54:33.227441 ip-10-0-135-67 kubenswrapper[2568]: I0603 16:54:33.227400 2568 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress-canary_ingress-canary-mjr7l_7839d8fc-3e8c-481e-93f6-5e2eb79ee81f/serve-healthcheck-canary/0.log" Jun 03 16:54:33.803647 ip-10-0-135-67 kubenswrapper[2568]: I0603 16:54:33.801434 2568 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-kwjkx_4cf0c8f9-cdc4-473e-9089-b042490e78a1/kube-rbac-proxy/0.log" Jun 03 16:54:33.822819 ip-10-0-135-67 kubenswrapper[2568]: I0603 16:54:33.822793 2568 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-kwjkx_4cf0c8f9-cdc4-473e-9089-b042490e78a1/exporter/0.log" Jun 03 16:54:33.845149 ip-10-0-135-67 kubenswrapper[2568]: I0603 16:54:33.845124 2568 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-kwjkx_4cf0c8f9-cdc4-473e-9089-b042490e78a1/extractor/0.log" Jun 03 16:54:35.901562 ip-10-0-135-67 kubenswrapper[2568]: I0603 16:54:35.901536 2568 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_maas-api-88d68d59f-9ktbl_6e22e7ea-573c-469e-9c33-45efe4d6880b/maas-api/0.log" Jun 03 16:54:35.927045 ip-10-0-135-67 kubenswrapper[2568]: I0603 16:54:35.927018 2568 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_maas-controller-58995fd7b7-9qk6w_ab4a0f7f-cce9-4270-86f8-78bd0a18e078/manager/0.log" Jun 03 16:54:36.020351 ip-10-0-135-67 kubenswrapper[2568]: I0603 16:54:36.020325 2568 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-5f84758474-km5sn_8333f4cf-cd6f-4918-a180-63e7fcfee215/manager/0.log" Jun 03 16:54:36.040597 ip-10-0-135-67 kubenswrapper[2568]: I0603 16:54:36.040575 2568 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-5f84758474-km5sn_8333f4cf-cd6f-4918-a180-63e7fcfee215/copy-manifests/0.log" Jun 03 16:54:37.125482 ip-10-0-135-67 kubenswrapper[2568]: I0603 16:54:37.125457 2568 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-must-gather-s47xq/perf-node-gather-daemonset-7wlgh" Jun 03 16:54:37.501019 ip-10-0-135-67 kubenswrapper[2568]: I0603 16:54:37.500978 2568 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-lws-operator_lws-controller-manager-69bc585896-vqzbf_9c9fc1b3-19e7-4da6-92c9-0415194e0271/manager/0.log" Jun 03 16:54:42.205733 ip-10-0-135-67 kubenswrapper[2568]: I0603 16:54:42.205688 2568 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-kube-storage-version-migrator_migrator-96c6f749-9jl2b_9be31efe-89c6-4af0-bdb5-dee0b6353d81/migrator/0.log" Jun 03 16:54:42.226163 ip-10-0-135-67 kubenswrapper[2568]: I0603 16:54:42.226134 2568 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-kube-storage-version-migrator_migrator-96c6f749-9jl2b_9be31efe-89c6-4af0-bdb5-dee0b6353d81/graceful-termination/0.log" Jun 03 16:54:43.791267 ip-10-0-135-67 kubenswrapper[2568]: I0603 16:54:43.791238 2568 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-q2q9l_ce603907-50de-4706-9fa0-5edcca2ea9ea/kube-multus-additional-cni-plugins/0.log" Jun 03 16:54:43.811436 ip-10-0-135-67 kubenswrapper[2568]: I0603 16:54:43.811408 2568 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-q2q9l_ce603907-50de-4706-9fa0-5edcca2ea9ea/egress-router-binary-copy/0.log" Jun 03 16:54:43.833521 ip-10-0-135-67 kubenswrapper[2568]: I0603 16:54:43.833500 2568 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-q2q9l_ce603907-50de-4706-9fa0-5edcca2ea9ea/cni-plugins/0.log" Jun 03 16:54:43.854876 ip-10-0-135-67 kubenswrapper[2568]: I0603 16:54:43.854856 2568 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-q2q9l_ce603907-50de-4706-9fa0-5edcca2ea9ea/bond-cni-plugin/0.log" Jun 03 16:54:43.876438 ip-10-0-135-67 kubenswrapper[2568]: I0603 16:54:43.876416 2568 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-q2q9l_ce603907-50de-4706-9fa0-5edcca2ea9ea/routeoverride-cni/0.log" Jun 03 16:54:43.896432 ip-10-0-135-67 kubenswrapper[2568]: I0603 16:54:43.896413 2568 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-q2q9l_ce603907-50de-4706-9fa0-5edcca2ea9ea/whereabouts-cni-bincopy/0.log" Jun 03 16:54:43.916641 ip-10-0-135-67 kubenswrapper[2568]: I0603 16:54:43.916617 2568 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-q2q9l_ce603907-50de-4706-9fa0-5edcca2ea9ea/whereabouts-cni/0.log" Jun 03 16:54:44.119368 ip-10-0-135-67 kubenswrapper[2568]: I0603 16:54:44.119292 2568 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-kf7b6_4a0bbce9-a5e7-409d-af6c-911d3173c133/kube-multus/0.log" Jun 03 16:54:44.200496 ip-10-0-135-67 kubenswrapper[2568]: I0603 16:54:44.200466 2568 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_network-metrics-daemon-54gnw_ddc210bb-9544-4ca7-b2de-f84c92d84510/network-metrics-daemon/0.log" Jun 03 16:54:44.219492 ip-10-0-135-67 kubenswrapper[2568]: I0603 16:54:44.219466 2568 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_network-metrics-daemon-54gnw_ddc210bb-9544-4ca7-b2de-f84c92d84510/kube-rbac-proxy/0.log" Jun 03 16:54:45.099150 ip-10-0-135-67 kubenswrapper[2568]: I0603 16:54:45.099124 2568 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-94fdt_dd3dac0d-018e-4c8a-98c7-daedef6dedb9/ovn-controller/0.log" Jun 03 16:54:45.115459 ip-10-0-135-67 kubenswrapper[2568]: I0603 16:54:45.115435 2568 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-94fdt_dd3dac0d-018e-4c8a-98c7-daedef6dedb9/ovn-acl-logging/0.log" Jun 03 16:54:45.121058 ip-10-0-135-67 kubenswrapper[2568]: I0603 16:54:45.121040 2568 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-94fdt_dd3dac0d-018e-4c8a-98c7-daedef6dedb9/ovn-acl-logging/1.log" Jun 03 16:54:45.138152 ip-10-0-135-67 kubenswrapper[2568]: I0603 16:54:45.138132 2568 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-94fdt_dd3dac0d-018e-4c8a-98c7-daedef6dedb9/kube-rbac-proxy-node/0.log" Jun 03 16:54:45.158167 ip-10-0-135-67 kubenswrapper[2568]: I0603 16:54:45.158149 2568 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-94fdt_dd3dac0d-018e-4c8a-98c7-daedef6dedb9/kube-rbac-proxy-ovn-metrics/0.log" Jun 03 16:54:45.176632 ip-10-0-135-67 kubenswrapper[2568]: I0603 16:54:45.176617 2568 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-94fdt_dd3dac0d-018e-4c8a-98c7-daedef6dedb9/northd/0.log" Jun 03 16:54:45.195843 ip-10-0-135-67 kubenswrapper[2568]: I0603 16:54:45.195820 2568 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-94fdt_dd3dac0d-018e-4c8a-98c7-daedef6dedb9/nbdb/0.log" Jun 03 16:54:45.215498 ip-10-0-135-67 kubenswrapper[2568]: I0603 16:54:45.215478 2568 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-94fdt_dd3dac0d-018e-4c8a-98c7-daedef6dedb9/sbdb/0.log" Jun 03 16:54:45.345399 ip-10-0-135-67 kubenswrapper[2568]: I0603 16:54:45.345370 2568 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-94fdt_dd3dac0d-018e-4c8a-98c7-daedef6dedb9/ovnkube-controller/0.log"